Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Accepting connections; addr='AF_INET(0.0.0.0:601)' Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/account_lockout.pdb', version='5', pub_date='2015-04-07' Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/lustre_iem.pdb', version='5', pub_date='2015-05-22' Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/locdrv_iem.pdb', version='4', pub_date='2018-04-27' Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/ip-monitor-link.pdb', version='5', pub_date='2019-06-08' Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/ext4err.pdb', version='4', pub_date='2016-11-16' Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Configuration reload request received, reloading configuration; Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Configuration reload finished; Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Accepting connections; addr='AF_INET(0.0.0.0:601)' Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/account_lockout.pdb', version='5', pub_date='2015-04-07' Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/lustre_iem.pdb', version='5', pub_date='2015-05-22' Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/locdrv_iem.pdb', version='4', pub_date='2018-04-27' Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/ip-monitor-link.pdb', version='5', pub_date='2019-06-08' Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/ext4err.pdb', version='4', pub_date='2016-11-16' Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Configuration reload request received, reloading configuration; Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Configuration reload finished; Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Accepting connections; addr='AF_INET(0.0.0.0:601)' Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/account_lockout.pdb', version='5', pub_date='2015-04-07' Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/lustre_iem.pdb', version='5', pub_date='2015-05-22' Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/locdrv_iem.pdb', version='4', pub_date='2018-04-27' Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/ip-monitor-link.pdb', version='5', pub_date='2019-06-08' Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/ext4err.pdb', version='4', pub_date='2016-11-16' Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Configuration reload request received, reloading configuration; Nov 3 03:13:11 kjcf05n00 syslog-ng[15617]: Configuration reload finished; Nov 3 03:13:17 kjcf05n00 mcfcli[3673891]: %3|1730625197.474|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 03:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T03:13:27.238166952-06:00 level=info msg="Completed cleanup jobs" duration=11.658222ms Nov 3 03:13:36 kjcf05n00 mcfcli[3673891]: %3|1730625216.262|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:13:47 kjcf05n00 mcfcli[3673891]: %3|1730625227.474|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 03:14:13 kjcf05n00 mcfcli[3673891]: %3|1730625253.934|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:14:17 kjcf05n00 mcfcli[3673891]: %3|1730625257.475|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 03:14:47 kjcf05n00 mcfcli[3673891]: %3|1730625287.476|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 03:14:49 kjcf05n00 mcfcli[3673891]: %3|1730625289.699|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:14:53 kjcf05n00 zabbix-server[904271]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 03:14:53 kjcf05n00 zabbix-server[904271]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n03' from event '45694' Nov 3 03:14:53 kjcf05n00 zabbix-server[904271]: Filesystem 'kjcf05' has been mounted Nov 3 03:14:53 kjcf05n00 zabbix-server[904271]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 03:14:53 kjcf05n00 zabbix-server[904271]: Running puppet on 'None' Nov 3 03:14:55 kjcf05n06 puppet-agent[2138409]: Using configured environment 'production' Nov 3 03:14:55 kjcf05n06 puppet-agent[2138409]: Retrieving pluginfacts Nov 3 03:14:55 kjcf05n06 puppet-agent[2138409]: Retrieving plugin Nov 3 03:14:56 kjcf05n03 puppet-agent[52306]: Using configured environment 'production' Nov 3 03:14:56 kjcf05n03 puppet-agent[52306]: Retrieving pluginfacts Nov 3 03:14:56 kjcf05n03 puppet-agent[52306]: Retrieving plugin Nov 3 03:14:56 kjcf05n03 puppet-agent[52306]: Loading facts Nov 3 03:14:56 kjcf05n05 puppet-agent[2277600]: Using configured environment 'production' Nov 3 03:14:56 kjcf05n05 puppet-agent[2277600]: Retrieving pluginfacts Nov 3 03:14:56 kjcf05n05 puppet-agent[2277600]: Retrieving plugin Nov 3 03:14:56 kjcf05n02 puppet-agent[112368]: Using configured environment 'production' Nov 3 03:14:56 kjcf05n02 puppet-agent[112368]: Retrieving pluginfacts Nov 3 03:14:56 kjcf05n02 puppet-agent[112368]: Retrieving plugin Nov 3 03:14:56 kjcf05n02 puppet-agent[112368]: Loading facts Nov 3 03:14:56 kjcf05n07 puppet-agent[2133568]: Using configured environment 'production' Nov 3 03:14:56 kjcf05n07 puppet-agent[2133568]: Retrieving pluginfacts Nov 3 03:14:56 kjcf05n07 puppet-agent[2133568]: Retrieving plugin Nov 3 03:14:56 kjcf05n04 puppet-agent[2141440]: Using configured environment 'production' Nov 3 03:14:56 kjcf05n04 puppet-agent[2141440]: Retrieving pluginfacts Nov 3 03:14:56 kjcf05n04 puppet-agent[2141440]: Retrieving plugin Nov 3 03:14:56 kjcf05n04 puppet-agent[2141440]: Loading facts Nov 3 03:14:56 kjcf05n05 puppet-agent[2277600]: Loading facts Nov 3 03:14:56 kjcf05n06 puppet-agent[2138409]: Loading facts Nov 3 03:14:56 kjcf05n01 puppet-agent[2863746]: Using configured environment 'production' Nov 3 03:14:56 kjcf05n01 puppet-agent[2863746]: Retrieving pluginfacts Nov 3 03:14:56 kjcf05n01 puppet-agent[2863746]: Retrieving plugin Nov 3 03:14:56 kjcf05n07 puppet-agent[2133568]: Loading facts Nov 3 03:14:56 kjcf05n00 puppet-agent[904451]: Using configured environment 'production' Nov 3 03:14:56 kjcf05n00 puppet-agent[904451]: Retrieving pluginfacts Nov 3 03:14:56 kjcf05n00 puppet-agent[904451]: Retrieving plugin Nov 3 03:14:57 kjcf05n01 puppet-agent[2863746]: Loading facts Nov 3 03:14:56 kjcf05n00 puppet-agent[904451]: Loading facts Nov 3 03:14:57 kjcf05n00 python3.9[904445]: [dimm_checker.py:116 - get_state() ] [ERROR] CSM:Generic : Could not retrieve error information. ipmi_sel_parse: internal IPMI error Nov 3 03:14:59 kjcf05n02 puppet-agent[112368]: Caching catalog for kjcf05n02 Nov 3 03:14:59 kjcf05n02 puppet-agent[112368]: Applying configuration version '1730625297' Nov 3 03:14:59 kjcf05n06 puppet-agent[2138409]: Caching catalog for kjcf05n06 Nov 3 03:14:59 kjcf05n06 puppet-agent[2138409]: Applying configuration version '1730625297' Nov 3 03:14:58 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 03:14:58 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 03:14:59 kjcf05n03 puppet-agent[52306]: Caching catalog for kjcf05n03 Nov 3 03:14:59 kjcf05n03 puppet-agent[52306]: Applying configuration version '1730625297' Nov 3 03:14:59 kjcf05n07 puppet-agent[2133568]: Caching catalog for kjcf05n07 Nov 3 03:14:59 kjcf05n07 puppet-agent[2133568]: Applying configuration version '1730625297' Nov 3 03:15:00 kjcf05n01 puppet-agent[2863746]: Caching catalog for kjcf05n01 Nov 3 03:15:00 kjcf05n01 puppet-agent[2863746]: Applying configuration version '1730625298' Nov 3 03:15:00 kjcf05n00 puppet-agent[904451]: Caching catalog for kjcf05n00 Nov 3 03:15:00 kjcf05n00 puppet-agent[904451]: Applying configuration version '1730625298' Nov 3 03:15:01 kjcf05n02 puppet-agent[112368]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 03:15:01 kjcf05n02 puppet-agent[112368]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 03:15:01 kjcf05n02 puppet-agent[112368]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 03:15:01 kjcf05n06 puppet-agent[2138409]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 03:15:01 kjcf05n06 puppet-agent[2138409]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 03:15:01 kjcf05n06 puppet-agent[2138409]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 03:15:01 kjcf05n03 puppet-agent[52306]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 03:15:01 kjcf05n03 puppet-agent[52306]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 03:15:01 kjcf05n03 puppet-agent[52306]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 03:15:01 kjcf05n07 puppet-agent[2133568]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 03:15:01 kjcf05n07 puppet-agent[2133568]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 03:15:01 kjcf05n07 puppet-agent[2133568]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 03:15:01 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 03:15:01 kjcf05n02 zabbix_agent2[54101]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 03:15:01 kjcf05n02 zabbix_agent2[3218]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 03:15:01 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 03:15:01 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 03:15:01 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 03:15:01 kjcf05n02 puppet-agent[112368]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: Press Ctrl+C to exit. Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: Plugin support version 1.0 Nov 3 03:15:01 kjcf05n02 zabbix_agent2[113072]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 03:15:01 kjcf05n05 puppet-agent[2277600]: Caching catalog for kjcf05n05 Nov 3 03:15:01 kjcf05n05 puppet-agent[2277600]: Applying configuration version '1730625300' Nov 3 03:15:01 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2086183]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 03:15:01 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 03:15:01 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 03:15:01 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 03:15:01 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 03:15:01 kjcf05n06 puppet-agent[2138409]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: Press Ctrl+C to exit. Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: Plugin support version 1.0 Nov 3 03:15:01 kjcf05n06 zabbix_agent2[2138819]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 03:15:02 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 03:15:02 kjcf05n03 zabbix_agent2[35195]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 03:15:02 kjcf05n03 zabbix_agent2[3159]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:15:02 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 03:15:02 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 03:15:02 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 03:15:02 kjcf05n03 puppet-agent[52306]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: Press Ctrl+C to exit. Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2081398]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 03:15:02 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 03:15:02 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 03:15:02 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 03:15:02 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 03:15:02 kjcf05n07 puppet-agent[2133568]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: Plugin support version 1.0 Nov 3 03:15:02 kjcf05n03 zabbix_agent2[52660]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: Press Ctrl+C to exit. Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: Plugin support version 1.0 Nov 3 03:15:02 kjcf05n07 zabbix_agent2[2134477]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 03:15:02 kjcf05n00 grafana[16174]: logger=ngalert.state.manager rule_uid=file_creates org_id=1 t=2024-11-03T03:15:02.561123176-06:00 level=info msg="Detected stale state entry" cacheID="[[\"__alert_rule_namespace_uid__\",\"c23SNyGIz\"],[\"__alert_rule_uid__\",\"file_creates\"],[\"alertname\",\"Lustre_File_Creates\"],[\"grafana_folder\",\"Lustre Performance\"],[\"mdt\",\"mknod\"]]" state=Normal reason=Error Nov 3 03:15:02 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 03:15:03 kjcf05n01 puppet-agent[2863746]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 03:15:03 kjcf05n01 puppet-agent[2863746]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-02:53:01]/mode) mode changed '0755' to '0750' Nov 3 03:15:03 kjcf05n01 puppet-agent[2863746]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-02:53:01/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 03:15:03 kjcf05n01 puppet-agent[2863746]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-02:53:01/vmcore]/mode) mode changed '0600' to '0640' Nov 3 03:15:03 kjcf05n01 puppet-agent[2863746]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-02:53:01/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 03:15:03 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 03:15:03 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 03:15:03 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 03:15:03 kjcf05n00 puppet-agent[904451]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 03:15:03 kjcf05n06 puppet-agent[2138409]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 03:15:03 kjcf05n06 puppet-agent[2138409]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 03:15:03 kjcf05n06 puppet-agent[2138409]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 03:15:03 kjcf05n06 puppet-agent[2138409]: Applied catalog in 4.74 seconds Nov 3 03:15:03 kjcf05n02 puppet-agent[112368]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 03:15:03 kjcf05n02 puppet-agent[112368]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 03:15:03 kjcf05n02 puppet-agent[112368]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 03:15:03 kjcf05n02 puppet-agent[112368]: Applied catalog in 5.08 seconds Nov 3 03:15:03 kjcf05n07 puppet-agent[2133568]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 03:15:03 kjcf05n07 puppet-agent[2133568]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 03:15:03 kjcf05n07 puppet-agent[2133568]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 03:15:03 kjcf05n05 puppet-agent[2277600]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 03:15:03 kjcf05n05 puppet-agent[2277600]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 03:15:03 kjcf05n05 puppet-agent[2277600]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 03:15:04 kjcf05n03 puppet-agent[52306]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 03:15:04 kjcf05n03 puppet-agent[52306]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 03:15:04 kjcf05n03 puppet-agent[52306]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 03:15:04 kjcf05n03 puppet-agent[52306]: Applied catalog in 4.97 seconds Nov 3 03:15:04 kjcf05n01 puppet-agent[2863746]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 03:15:04 kjcf05n01 puppet-agent[2863746]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 03:15:04 kjcf05n01 puppet-agent[2863746]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 03:15:04 kjcf05n07 puppet-agent[2133568]: Applied catalog in 4.84 seconds Nov 3 03:15:04 kjcf05n00 puppet-agent[904451]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 03:15:04 kjcf05n00 puppet-agent[904451]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 03:15:04 kjcf05n00 puppet-agent[904451]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 03:15:04 kjcf05n00 zabbix_server[15742]: Zabbix agent item "system.swap.size[,total]" on host "kjcf05n05" failed: first network error, wait for 15 seconds Nov 3 03:15:04 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2218636]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 03:15:04 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 03:15:04 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 03:15:04 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 03:15:04 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 03:15:04 kjcf05n05 puppet-agent[2277600]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: Press Ctrl+C to exit. Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: Plugin support version 1.0 Nov 3 03:15:04 kjcf05n05 zabbix_agent2[2278385]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 03:15:05 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2852175]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 03:15:05 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 03:15:05 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 03:15:05 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 03:15:05 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 03:15:05 kjcf05n01 puppet-agent[2863746]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: Press Ctrl+C to exit. Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: Plugin support version 1.0 Nov 3 03:15:05 kjcf05n01 zabbix_agent2[2864102]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 03:15:04 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 03:15:04 kjcf05n00 zabbix_agent2[885185]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 03:15:05 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 03:15:04 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 03:15:04 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 03:15:04 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 03:15:04 kjcf05n00 puppet-agent[904451]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: Press Ctrl+C to exit. Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: Plugin support version 1.0 Nov 3 03:15:04 kjcf05n00 zabbix_agent2[905220]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 03:15:05 kjcf05n00 zabbix-server[905250]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 03:15:05 kjcf05n00 zabbix-server[905295]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 03:15:06 kjcf05n05 puppet-agent[2277600]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 03:15:06 kjcf05n05 puppet-agent[2277600]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 03:15:06 kjcf05n05 puppet-agent[2277600]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 03:15:06 kjcf05n05 puppet-agent[2277600]: Applied catalog in 4.73 seconds Nov 3 03:15:06 kjcf05n00 zabbix-server[905304]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 03:15:06 kjcf05n00 zabbix-server[905306]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 03:15:07 kjcf05n01 puppet-agent[2863746]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_030021.log]/mode) mode changed '0644' to '0640' Nov 3 03:15:07 kjcf05n01 puppet-agent[2863746]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_031204.log]/mode) mode changed '0644' to '0640' Nov 3 03:15:06 kjcf05n00 puppet-agent[904451]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 03:15:07 kjcf05n01 puppet-agent[2863746]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_030021.log]/mode) mode changed '0644' to '0640' Nov 3 03:15:07 kjcf05n01 puppet-agent[2863746]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_031204.log]/mode) mode changed '0644' to '0640' Nov 3 03:15:07 kjcf05n01 puppet-agent[2863746]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_031205]/mode) mode changed '0755' to '0750' Nov 3 03:15:07 kjcf05n01 puppet-agent[2863746]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_031205/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 03:15:07 kjcf05n01 puppet-agent[2863746]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 03:15:07 kjcf05n01 puppet-agent[2863746]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 03:15:07 kjcf05n01 puppet-agent[2863746]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 03:15:07 kjcf05n00 puppet-agent[904451]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 03:15:07 kjcf05n00 puppet-agent[904451]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 03:15:07 kjcf05n00 puppet-agent[904451]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 03:15:08 kjcf05n01 puppet-agent[2863746]: Applied catalog in 8.45 seconds Nov 3 03:15:08 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 03:15:08 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 03:15:08 kjcf05n00 puppet-agent[904451]: Applied catalog in 8.30 seconds Nov 3 03:15:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730625316', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 03:15:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730625316'} Nov 3 03:15:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:15:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730625316', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 03:15:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730625316'} Nov 3 03:15:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:15:17 kjcf05n00 mcfcli[3673891]: %3|1730625317.476|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 03:15:19 kjcf05n00 zabbix_server[15783]: resuming Zabbix agent checks on host "kjcf05n05": connection restored Nov 3 03:15:29 kjcf05n00 mcfcli[3673891]: %3|1730625329.696|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:15:47 kjcf05n00 mcfcli[3673891]: %3|1730625347.478|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 03:15:55 kjcf05n04 puppet-agent[2141440]: Caching catalog for kjcf05n04 Nov 3 03:15:55 kjcf05n04 puppet-agent[2141440]: Applying configuration version '1730625354' Nov 3 03:15:57 kjcf05n04 puppet-agent[2141440]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 03:15:57 kjcf05n04 puppet-agent[2141440]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 03:15:57 kjcf05n04 puppet-agent[2141440]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 03:15:58 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2083821]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 03:15:58 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 03:15:58 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 03:15:58 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 03:15:58 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 03:15:58 kjcf05n04 puppet-agent[2141440]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: Press Ctrl+C to exit. Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: Plugin support version 1.0 Nov 3 03:15:58 kjcf05n04 zabbix_agent2[2143307]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 03:16:00 kjcf05n04 puppet-agent[2141440]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 03:16:00 kjcf05n04 puppet-agent[2141440]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 03:16:00 kjcf05n04 puppet-agent[2141440]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 03:16:00 kjcf05n04 puppet-agent[2141440]: Applied catalog in 4.78 seconds Nov 3 03:16:00 kjcf05n00 zabbix-server[904271]: puppet completed status:(0): '' Nov 3 03:16:00 kjcf05n00 zabbix-server[904271]: Event '45694' acknowledged Nov 3 03:16:00 kjcf05n00 zabbix-server[904271]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n03"}' Nov 3 03:16:09 kjcf05n00 mcfcli[3673891]: %3|1730625369.693|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:16:17 kjcf05n00 mcfcli[3673891]: %3|1730625377.479|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 03:16:24 kjcf05n03 dwd[5164]: nvme15n1 passed periodic SMART status check Nov 3 03:16:24 kjcf05n03 dwd[5164]: nvme10n1 passed periodic SMART status check Nov 3 03:16:24 kjcf05n03 dwd[5164]: nvme11n1 passed periodic SMART status check Nov 3 03:16:24 kjcf05n03 dwd[5164]: nvme21n1 passed periodic SMART status check Nov 3 03:16:25 kjcf05n03 dwd[5164]: nvme7n1 passed periodic SMART status check Nov 3 03:16:25 kjcf05n03 dwd[5164]: nvme20n1 passed periodic SMART status check Nov 3 03:16:25 kjcf05n03 dwd[5164]: nvme12n1 passed periodic SMART status check Nov 3 03:16:26 kjcf05n03 dwd[5164]: nvme6n1 passed periodic SMART status check Nov 3 03:16:26 kjcf05n03 dwd[5164]: nvme16n1 passed periodic SMART status check Nov 3 03:16:26 kjcf05n03 dwd[5164]: nvme5n1 passed periodic SMART status check Nov 3 03:16:26 kjcf05n03 dwd[5164]: nvme22n1 passed periodic SMART status check Nov 3 03:16:46 kjcf05n00 mcfcli[3673891]: %3|1730625406.904|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:16:47 kjcf05n00 mcfcli[3673891]: %3|1730625407.479|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 03:17:02 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/21', errno='Permission denied (13)' Nov 3 03:17:17 kjcf05n00 mcfcli[3673891]: %3|1730625437.480|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 03:17:24 kjcf05n00 mcfcli[3673891]: %3|1730625444.764|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:17:47 kjcf05n00 mcfcli[3673891]: %3|1730625467.481|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 03:18:04 kjcf05n00 mcfcli[3673891]: %3|1730625484.761|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:18:17 kjcf05n00 mcfcli[3673891]: %3|1730625497.482|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 03:18:44 kjcf05n00 mcfcli[3673891]: %3|1730625524.758|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:18:47 kjcf05n00 mcfcli[3673891]: %3|1730625527.483|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 76 identical error(s) suppressed) Nov 3 03:19:17 kjcf05n00 mcfcli[3673891]: %3|1730625557.483|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:19:24 kjcf05n00 mcfcli[3673891]: %3|1730625564.755|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:19:47 kjcf05n00 mcfcli[3673891]: %3|1730625587.484|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 03:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 03:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 03:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 03:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 03:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 03:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 03:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 03:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 03:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 03:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 03:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 03:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 03:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 03:20:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 03:20:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:20:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 03:20:00 kjcf05n00 python3.9[907817]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 03:20:03 kjcf05n00 mcfcli[3673891]: %3|1730625603.861|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:20:17 kjcf05n00 mcfcli[3673891]: %3|1730625617.485|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:20:43 kjcf05n00 mcfcli[3673891]: %3|1730625643.383|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:20:47 kjcf05n00 mcfcli[3673891]: %3|1730625647.486|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 03:20:55 kjcf05n02 nslcd[6978]: [e87ccd] ldap_result() failed: Can't contact LDAP server Nov 3 03:21:17 kjcf05n00 mcfcli[3673891]: %3|1730625677.487|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 03:21:19 kjcf05n00 mcfcli[3673891]: %3|1730625679.986|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:21:47 kjcf05n00 mcfcli[3673891]: %3|1730625707.488|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 03:21:58 kjcf05n00 mcfcli[3673891]: %3|1730625718.101|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:22:01 kjcf05n01 syslog-ng[15072]: Configuration reload request received, reloading configuration; Nov 3 03:22:01 kjcf05n01 syslog-ng[15072]: Configuration reload finished; Nov 3 03:22:01 kjcf05n01 syslog-ng[15072]: Configuration reload request received, reloading configuration; Nov 3 03:22:01 kjcf05n01 syslog-ng[15072]: Configuration reload finished; Nov 3 03:22:01 kjcf05n01 syslog-ng[15072]: Configuration reload request received, reloading configuration; Nov 3 03:22:01 kjcf05n01 syslog-ng[15072]: Configuration reload finished; Nov 3 03:22:02 kjcf05n01 syslog-ng[15072]: Configuration reload request received, reloading configuration; Nov 3 03:22:02 kjcf05n01 syslog-ng[15072]: Configuration reload finished; Nov 3 03:22:17 kjcf05n00 mcfcli[3673891]: %3|1730625737.489|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:22:34 kjcf05n00 mcfcli[3673891]: %3|1730625754.955|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:22:47 kjcf05n00 mcfcli[3673891]: %3|1730625767.490|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 03:22:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 03:22:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 03:22:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 03:22:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 03:22:59 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 03:22:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 03:23:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 03:23:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 03:23:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 03:23:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 03:23:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 03:23:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 03:23:10 kjcf05n00 zabbix_server[15737]: Zabbix agent item "vfs.fs.inode[/var/lib/pacemaker,pfree]" on host "kjcf05n03" failed: first network error, wait for 15 seconds Nov 3 03:23:12 kjcf05n00 mcfcli[3673891]: %3|1730625792.786|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T09:23:15.867477Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 03:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T09:23:15.867556Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.101ms Nov 3 03:23:16 kjcf05n02 fstonithd.py[15134]: My partner 172.16.2.6 is kdumping. Forcing HA into GATHER state. Nov 3 03:23:16 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 03:23:16 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 03:23:16 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 03:23:17 kjcf05n00 mcfcli[3673891]: %3|1730625797.936|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 03:23:18 kjcf05n02 root[127462]: is_enc_ipmi_off starts Nov 3 03:23:18 kjcf05n02 root[127463]: is_viking_off starts Nov 3 03:23:18 kjcf05n02 root[127479]: is_lan_ipmi_off leaves Nov 3 03:23:18 kjcf05n02 root[127481]: is_lan_ipmi_sec_off leaves Nov 3 03:23:18 kjcf05n02 root[127484]: I am in slot 0; partner is in slot 1 Nov 3 03:23:18 kjcf05n02 root[127487]: I am master Nov 3 03:23:25 kjcf05n02 root[127629]: is_viking_off leaves Nov 3 03:23:25 kjcf05n02 root[127632]: kjcf05n03 not already off look at kdump Nov 3 03:23:25 kjcf05n02 root[127633]: is_kdump_off starts Nov 3 03:23:25 kjcf05n02 fence_kdump[127634]: waiting for message from '172.16.2.6' Nov 3 03:23:25 kjcf05n02 fence_kdump[127634]: received valid message from '172.16.2.6' Nov 3 03:23:25 kjcf05n02 root[127647]: is_kdump_off detected kdump on kjcf05n03 Nov 3 03:23:25 kjcf05n02 root[127650]: kjcf05n03 is kdumping Nov 3 03:23:25 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='30', error='Connection reset by peer (104)' Nov 3 03:23:25 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='30', client='AF_INET(172.16.2.6:37613)', local='AF_INET(0.0.0.0:601)' Nov 3 03:23:25 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.cpu.util[,steal]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 03:23:25 kjcf05n02 root[127762]: is_enc_ipmi_off starts Nov 3 03:23:25 kjcf05n02 root[127763]: is_viking_off starts Nov 3 03:23:25 kjcf05n02 root[127779]: is_lan_ipmi_off leaves Nov 3 03:23:25 kjcf05n02 root[127781]: is_lan_ipmi_sec_off leaves Nov 3 03:23:25 kjcf05n02 root[127784]: I am in slot 0; partner is in slot 1 Nov 3 03:23:25 kjcf05n02 root[127787]: I am master Nov 3 03:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T03:23:27.246735875-06:00 level=info msg="Completed cleanup jobs" duration=20.272126ms Nov 3 03:23:27 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 03:23:27 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 03:23:32 kjcf05n02 root[127968]: is_viking_off leaves Nov 3 03:23:32 kjcf05n02 root[127971]: kjcf05n03 not already off look at kdump Nov 3 03:23:32 kjcf05n02 root[127972]: is_kdump_off starts Nov 3 03:23:32 kjcf05n02 fence_kdump[127973]: waiting for message from '172.16.2.6' Nov 3 03:23:32 kjcf05n02 fence_kdump[127973]: received valid message from '172.16.2.6' Nov 3 03:23:32 kjcf05n02 root[127988]: is_kdump_off detected kdump on kjcf05n03 Nov 3 03:23:32 kjcf05n02 root[127989]: kjcf05n03 is kdumping Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130178]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130181]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130178]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130179]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130181]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130178]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130179]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130181]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130179]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130178]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130181]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130179]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130178]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130181]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130179]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130178]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130181]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130179]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130178]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130181]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130179]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130178]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130181]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130179]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130181]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130215]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130178]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130181]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130215]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130178]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130181]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130179]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130181]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130181]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130181]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130181]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130181]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130181]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130181]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130181]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 systemd-udevd[130177]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:23:36 kjcf05n02 dwd[5220]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 03:23:36 kjcf05n02 dwd[5220]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 03:23:36 kjcf05n02 dwd[5220]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 03:23:36 kjcf05n02 dwd[5220]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 03:23:36 kjcf05n02 dwd[5220]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 03:23:36 kjcf05n02 dwd[5220]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 03:23:36 kjcf05n02 dwd[5220]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 03:23:36 kjcf05n02 dwd[5220]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 03:23:36 kjcf05n02 dwd[5220]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 03:23:36 kjcf05n02 dwd[5220]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 03:23:36 kjcf05n02 dwd[5220]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 03:23:37 kjcf05n02 dwd[5220]: Starting NVME thread for nvme6n1 Nov 3 03:23:37 kjcf05n02 dwd[5220]: Starting NVME thread for nvme15n1 Nov 3 03:23:37 kjcf05n02 dwd[5220]: Starting NVME thread for nvme16n1 Nov 3 03:23:37 kjcf05n02 dwd[5220]: Starting NVME thread for nvme5n1 Nov 3 03:23:37 kjcf05n02 dwd[5220]: Starting NVME thread for nvme20n1 Nov 3 03:23:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 03:23:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 03:23:37 kjcf05n02 dwd[5220]: Starting NVME thread for nvme11n1 Nov 3 03:23:37 kjcf05n02 dwd[5220]: Starting NVME thread for nvme22n1 Nov 3 03:23:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 03:23:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 03:23:38 kjcf05n02 dwd[5220]: Starting NVME thread for nvme21n1 Nov 3 03:23:38 kjcf05n02 dwd[5220]: Starting NVME thread for nvme12n1 Nov 3 03:23:38 kjcf05n02 dwd[5220]: Starting NVME thread for nvme10n1 Nov 3 03:23:38 kjcf05n02 dwd[5220]: Starting NVME thread for nvme7n1 Nov 3 03:23:40 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.swap.size[,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 03:23:44 kjcf05n02 diskmonitor[17478]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 03:23:47 kjcf05n00 mcfcli[3673891]: %3|1730625827.991|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:23:48 kjcf05n00 mcfcli[3673891]: %3|1730625828.951|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:23:53 kjcf05n02 diskmonitor[17478]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 03:23:53 kjcf05n02 diskmonitor[17478]: Scan for ReadErrorMax change for md66 Nov 3 03:23:53 kjcf05n02 diskmonitor[17478]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 03:23:53 kjcf05n02 diskmonitor[17478]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 03:23:53 kjcf05n02 diskmonitor[17478]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.min.76c05c063fa0949b68ee86c1978c2ca8 file Nov 3 03:23:53 kjcf05n02 diskmonitor[17478]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.max.76c05c063fa0949b68ee86c1978c2ca8 file Nov 3 03:23:53 kjcf05n02 diskmonitor[17478]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 03:23:53 kjcf05n02 diskmonitor[17478]: Set sync_speed_min (10000) for md66 Nov 3 03:23:53 kjcf05n02 diskmonitor[17478]: Set sync_speed_max (200000) for md66 Nov 3 03:23:53 kjcf05n02 diskmonitor[17478]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 03:23:55 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n03": interface unavailable Nov 3 03:23:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 03:23:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 03:23:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 03:23:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 03:24:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 03:24:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 03:24:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 03:24:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 03:24:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 03:24:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 03:24:09 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 3 03:24:09 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 8 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007240 sec, idle for 1 hour(s)] Nov 3 03:24:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 03:24:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 03:24:17 kjcf05n00 mcfcli[3673891]: %3|1730625857.992|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 03:24:28 kjcf05n00 mcfcli[3673891]: %3|1730625868.949|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:24:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 03:24:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 03:24:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 03:24:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 03:24:47 kjcf05n02 nslcd[6978]: [b141f2] ldap_result() failed: Can't contact LDAP server Nov 3 03:24:47 kjcf05n02 nslcd[6978]: [b71efb] ldap_result() failed: Can't contact LDAP server Nov 3 03:24:47 kjcf05n00 mcfcli[3673891]: %3|1730625887.992|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 03:24:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 03:24:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 03:24:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 03:24:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 03:25:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 03:25:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 03:25:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 03:25:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 03:25:00 kjcf05n00 python3.9[910730]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 03:25:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 03:25:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 03:25:08 kjcf05n00 mcfcli[3673891]: %3|1730625908.946|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:25:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 03:25:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 03:25:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730625914', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 03:25:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730625914'} Nov 3 03:25:14 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:25:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730625914', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 03:25:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730625914'} Nov 3 03:25:14 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:25:17 kjcf05n00 mcfcli[3673891]: %3|1730625917.993|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 03:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 03:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 03:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 03:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 03:25:47 kjcf05n00 mcfcli[3673891]: %3|1730625947.994|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:25:48 kjcf05n00 mcfcli[3673891]: %3|1730625948.519|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 03:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 03:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 03:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 03:26:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 03:26:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 03:26:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 03:26:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 03:26:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 03:26:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 03:26:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 03:26:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 03:26:17 kjcf05n00 mcfcli[3673891]: %3|1730625977.995|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 03:26:28 kjcf05n00 mcfcli[3673891]: %3|1730625988.354|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:26:33 kjcf05n00 zabbix-server[912082]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 03:26:33 kjcf05n00 zabbix-server[912082]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n03:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 03:26:33 kjcf05n00 log_interesting_event.py[912082]: Event '45696' acknowledged Nov 3 03:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 03:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 03:26:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 03:26:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 03:26:47 kjcf05n00 mcfcli[3673891]: %3|1730626007.996|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 03:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 03:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 03:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 03:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 03:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 03:27:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 03:27:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 03:27:04 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:9a:1a Nov 3 03:27:04 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 03:27:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 03:27:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 03:27:07 kjcf05n00 mcfcli[3673891]: %3|1730626027.387|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:27:08 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 03:27:08 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a kjcf05n03 Nov 3 03:27:08 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.6 Nov 3 03:27:08 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 03:27:08 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 03:27:08 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.6 Nov 3 03:27:08 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/pxelinux.cfg to 172.16.2.6 Nov 3 03:27:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 03:27:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 03:27:11 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/vmlinuz_diskless to 172.16.2.6 Nov 3 03:27:14 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/initramfs-diskless.img to 172.16.2.6 Nov 3 03:27:17 kjcf05n00 mcfcli[3673891]: %3|1730626037.996|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 03:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 03:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 03:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 03:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 03:27:44 kjcf05n00 mcfcli[3673891]: %3|1730626064.402|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:27:47 kjcf05n00 mcfcli[3673891]: %3|1730626067.998|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 03:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 03:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 03:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 03:28:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 03:28:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 03:28:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 03:28:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 03:28:01 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:58616). Nov 3 03:28:01 kjcf05n01 rsyncd[2869464]: connect from kjcf05n03 (172.16.2.6) Nov 3 03:28:01 kjcf05n01 rsyncd[2869464]: rsync on puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 03:28:01 kjcf05n01 rsyncd[2869464]: building file list Nov 3 03:28:01 kjcf05n01 rsyncd[2869464]: sent 11446 bytes received 136 bytes total size 10901 Nov 3 03:28:01 kjcf05n01 systemd[1]: rsyncd@591-172.16.2.2:873-172.16.2.6:58616.service: Succeeded. Nov 3 03:28:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 03:28:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 03:28:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 03:28:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 03:28:10 kjcf05n02 diskmonitor[17478]: Unable to Get Channel Cipher Suites Nov 3 03:28:13 kjcf05n02 diskmonitor[17478]: Error: Received an Unexpected Open Session Response Nov 3 03:28:16 kjcf05n02 diskmonitor[3218]: Last message 'Error: Received an U' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 03:28:16 kjcf05n02 fstonithd.py[15134]: Listening for kdump packets from partner Nov 3 03:28:18 kjcf05n00 mcfcli[3673891]: %3|1730626098.499|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 03:28:24 kjcf05n00 mcfcli[3673891]: %3|1730626104.297|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 03:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 03:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 03:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 03:28:48 kjcf05n00 mcfcli[3673891]: %3|1730626128.939|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 03:28:55 kjcf05n02 dwd[5220]: nvme12n1 passed periodic SMART status check Nov 3 03:28:55 kjcf05n02 dwd[5220]: nvme10n1 passed periodic SMART status check Nov 3 03:28:55 kjcf05n02 dwd[5220]: nvme7n1 passed periodic SMART status check Nov 3 03:28:55 kjcf05n02 dwd[5220]: nvme21n1 passed periodic SMART status check Nov 3 03:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 03:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 03:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 03:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 03:29:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 03:29:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 03:29:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 03:29:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 03:29:01 kjcf05n00 mcfcli[3673891]: %3|1730626141.128|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:29:03 kjcf05n02 dwd[5220]: nvme11n1 passed periodic SMART status check Nov 3 03:29:03 kjcf05n02 dwd[5220]: nvme15n1 passed periodic SMART status check Nov 3 03:29:03 kjcf05n02 dwd[5220]: nvme6n1 passed periodic SMART status check Nov 3 03:29:03 kjcf05n02 dwd[5220]: nvme16n1 passed periodic SMART status check Nov 3 03:29:03 kjcf05n02 dwd[5220]: nvme22n1 passed periodic SMART status check Nov 3 03:29:03 kjcf05n02 dwd[5220]: nvme5n1 passed periodic SMART status check Nov 3 03:29:03 kjcf05n02 dwd[5220]: nvme20n1 passed periodic SMART status check Nov 3 03:29:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 03:29:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 03:29:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 03:29:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 03:29:18 kjcf05n00 mcfcli[3673891]: %3|1730626158.939|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:29:28 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='30', client='AF_INET(172.16.2.6:41471)', local='AF_INET(0.0.0.0:601)' Nov 3 03:29:28 kjcf05n03 syslog-ng[3202]: Configuration reload request received, reloading configuration; Nov 3 03:29:28 kjcf05n03 syslog-ng[3202]: Configuration reload finished; Nov 3 03:29:28 kjcf05n03 syslog-ng[3202]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 03:29:28 kjcf05n03 dracut: dracut-049-135.git20210121.el8 Nov 3 03:29:28 kjcf05n03 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 03:29:28 kjcf05n03 dracut: Loading and integrity checking all crypto modules Nov 3 03:29:28 kjcf05n03 dracut: Self testing crypto algorithms Nov 3 03:29:28 kjcf05n03 dracut: rd.md=0: removing MD RAID activation Nov 3 03:29:28 kjcf05n03 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 03:29:28 kjcf05n03 Copying live image to RAM... Nov 3 03:29:28 kjcf05n03 (this may take a minute) Nov 3 03:29:28 kjcf05n03 Done copying live image to RAM. Nov 3 03:29:28 kjcf05n03 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 03:29:28 kjcf05n03 dracut: Checking integrity of kernel Nov 3 03:29:28 kjcf05n03 dracut: All initrd crypto checks done Nov 3 03:29:28 kjcf05n03 dracut: Switching root Nov 3 03:29:28 kjcf05n03 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 03:29:28 kjcf05n03 systemd: Detected architecture x86-64. Nov 3 03:29:28 kjcf05n03 systemd: Set hostname to . Nov 3 03:29:28 kjcf05n03 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 03:29:28 kjcf05n03 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 03:29:28 kjcf05n03 systemd: Listening on Journal Socket (/dev/log). Nov 3 03:29:28 kjcf05n03 systemd: Listening on Journal Socket. Nov 3 03:29:28 kjcf05n03 systemd: Mounting /WIBS... Nov 3 03:29:28 kjcf05n03 systemd: Starting Remount Root and Kernel File Systems... Nov 3 03:29:28 kjcf05n03 systemd: Listening on udev Control Socket. Nov 3 03:29:28 kjcf05n03 systemd-journald[1527]: Journal started Nov 3 03:29:28 kjcf05n03 systemd-journald[1527]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 03:29:28 kjcf05n03 systemd-modules-load[1521]: Inserted module 'fuse' Nov 3 03:29:28 kjcf05n03 systemd[1]: Mounted POSIX Message Queue File System. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Apply Kernel Variables... Nov 3 03:29:28 kjcf05n03 systemd[1]: Mounting FUSE Control File System... Nov 3 03:29:28 kjcf05n03 systemd[1]: Mounting Kernel Configuration File System... Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Rebuild Hardware Database... Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Create System Users... Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Load/Save Random Seed... Nov 3 03:29:28 kjcf05n03 systemd[1]: Mounted FUSE Control File System. Nov 3 03:29:28 kjcf05n03 systemd-sysctl[1535]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 03:29:28 kjcf05n03 systemd-sysctl[1535]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Apply Kernel Variables. Nov 3 03:29:28 kjcf05n03 systemd[1]: Mounted Kernel Configuration File System. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Create System Users. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Load/Save Random Seed. Nov 3 03:29:28 kjcf05n03 systemd-journald[1527]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 03:29:28 kjcf05n03 systemd-tmpfiles[1547]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 03:29:28 kjcf05n03 systemd-tmpfiles[1547]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started udev Coldplug all Devices. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Rebuild Hardware Database. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting udev Kernel Device Manager... Nov 3 03:29:28 kjcf05n03 systemd-udevd[1556]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started udev Kernel Device Manager. Nov 3 03:29:28 kjcf05n03 systemd[1]: Found device /dev/ttyS0. Nov 3 03:29:28 kjcf05n03 systemd-udevd[1567]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:29:28 kjcf05n03 systemd-udevd[1616]: Using default interface naming scheme 'rhel-8.0'. Nov 3 03:29:28 kjcf05n03 systemd-udevd[1616]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:29:28 kjcf05n03 systemd-udevd[1623]: Using default interface naming scheme 'rhel-8.0'. Nov 3 03:29:28 kjcf05n03 systemd-udevd[1623]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:29:28 kjcf05n03 systemd-udevd[1577]: Using default interface naming scheme 'rhel-8.0'. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 03:29:28 kjcf05n03 systemd-udevd[1577]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:29:28 kjcf05n03 systemd[1]: Reached target Local File Systems (Pre). Nov 3 03:29:28 kjcf05n03 systemd[1]: Reached target Local File Systems. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Rebuild Journal Catalog. Nov 3 03:29:28 kjcf05n03 systemd-tmpfiles[1775]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 03:29:28 kjcf05n03 systemd-tmpfiles[1775]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 03:29:28 kjcf05n03 systemd-tmpfiles[1775]: "/var/tmp" already exists and is not a directory. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Create Volatile Files and Directories. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting RPC Bind... Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 03:29:28 kjcf05n03 root[1800]: openibd: running in auto mode Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started RPC Bind. Nov 3 03:29:28 kjcf05n03 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 03:29:28 kjcf05n03 systemd-modules-load[1847]: Inserted module 'ib_iser' Nov 3 03:29:28 kjcf05n03 systemd-modules-load[1847]: Inserted module 'ib_isert' Nov 3 03:29:28 kjcf05n03 systemd[1]: Started RDMA Node Description Daemon. Nov 3 03:29:28 kjcf05n03 systemd-modules-load[1847]: Inserted module 'ib_srpt' Nov 3 03:29:28 kjcf05n03 systemd-udevd[1601]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:29:28 kjcf05n03 systemd-udevd[1610]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:29:28 kjcf05n03 systemd-modules-load[1839]: Inserted module 'ib_ipoib' Nov 3 03:29:28 kjcf05n03 systemd-modules-load[1847]: Inserted module 'rdma_ucm' Nov 3 03:29:28 kjcf05n03 systemd-modules-load[1847]: Module 'svcrdma' is blacklisted Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 03:29:28 kjcf05n03 systemd-udevd[1610]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 03:29:28 kjcf05n03 systemd-udevd[1601]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 03:29:28 kjcf05n03 systemd-modules-load[1839]: Inserted module 'ib_umad' Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 03:29:28 kjcf05n03 systemd[1]: Reached target RDMA Hardware. Nov 3 03:29:28 kjcf05n03 systemd[1]: Reached target Network (Pre). Nov 3 03:29:28 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 03:29:28 kjcf05n03 systemd[3202]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:28 kjcf05n03 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 03:29:28 kjcf05n03 openibd[1782]: Loading HCA driver and Access Layer:[ OK ] Nov 3 03:29:28 kjcf05n03 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Update is Completed... Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Update is Completed. Nov 3 03:29:28 kjcf05n03 setup-icl[1751]: Setting LAN IP Address to 203.0.113.4 Nov 3 03:29:28 kjcf05n03 setup-icl[1751]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 03:29:28 kjcf05n03 setup-icl[1751]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 03:29:28 kjcf05n03 setup-icl[1751]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 03:29:28 kjcf05n03 systemd-udevd[1601]: Using default interface naming scheme 'rhel-8.0'. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 03:29:28 kjcf05n03 systemd[1]: Reached target System Initialization. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 03:29:28 kjcf05n03 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 03:29:28 kjcf05n03 systemd[1]: Listening on lldpad.socket. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 03:29:28 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 03:29:28 kjcf05n03 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 03:29:28 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 03:29:28 kjcf05n03 systemd[1]: Reached target Sockets. Nov 3 03:29:28 kjcf05n03 systemd[1]: Reached target Basic System. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started D-Bus System Message Bus. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Name Service Cache Daemon... Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 03:29:28 kjcf05n03 nscd[2120]: 2120 monitoring file `/etc/hosts` (1) Nov 3 03:29:28 kjcf05n03 nscd[2120]: 2120 monitoring directory `/etc` (2) Nov 3 03:29:28 kjcf05n03 nscd[2120]: 2120 monitoring file `/etc/resolv.conf` (3) Nov 3 03:29:28 kjcf05n03 nscd[2120]: 2120 monitoring directory `/etc` (2) Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 03:29:28 kjcf05n03 dwd[2117]: dwd: option Lethal: 0 Nov 3 03:29:28 kjcf05n03 dwd[2117]: dwd: option Interval: 60 Nov 3 03:29:28 kjcf05n03 dwd[2117]: dwd: option abrtlimit: 10 Nov 3 03:29:28 kjcf05n03 dwd[2117]: dwd: option DZPeriod: 604800 Nov 3 03:29:28 kjcf05n03 dwd[2117]: dwd: option SmartPeriod: 43200 Nov 3 03:29:28 kjcf05n03 dwd[2117]: dwd: option SDDEnabled: 1 Nov 3 03:29:28 kjcf05n03 dwd[2117]: dwd: option SDDAwaitScale: 3 Nov 3 03:29:28 kjcf05n03 dwd[2117]: dwd: option SDDAwaitMin: 100 Nov 3 03:29:28 kjcf05n03 dwd[2117]: dwd: option Verbosity: 1 Nov 3 03:29:28 kjcf05n03 dwd[2117]: dwd: option StandAlone: 0 Nov 3 03:29:28 kjcf05n03 dwd[2117]: dwd: vMay 29 2024 : 15:38:26 Nov 3 03:29:28 kjcf05n03 dwd[2117]: /usr/sbin/dwd -d --standalone=0 Nov 3 03:29:28 kjcf05n03 dwd[2117]: option Lethal: 0 Nov 3 03:29:28 kjcf05n03 dwd[2117]: option Interval: 60 Nov 3 03:29:28 kjcf05n03 dwd[2117]: option abrtlimit: 10 Nov 3 03:29:28 kjcf05n03 dwd[2117]: option DZPeriod: 604800 Nov 3 03:29:28 kjcf05n03 dwd[2117]: option SmartPeriod: 43200 Nov 3 03:29:28 kjcf05n03 dwd[2117]: option SDDEnabled: 1 Nov 3 03:29:28 kjcf05n03 dwd[2117]: option SDDAwaitScale: 3 Nov 3 03:29:28 kjcf05n03 dwd[2117]: option SDDAwaitMin: 100 Nov 3 03:29:28 kjcf05n03 dwd[2117]: option Verbosity: 1 Nov 3 03:29:28 kjcf05n03 dwd[2117]: option StandAlone: 0 Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 03:29:28 kjcf05n03 network[2119]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 03:29:28 kjcf05n03 mcelog[2131]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 03:29:28 kjcf05n03 mcelog[2131]: CPU is unsupported Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 0 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 1 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 2 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 3 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 4 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 5 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 6 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 7 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 8 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 9 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 10 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 11 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 12 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 13 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 14 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 15 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 16 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 17 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 18 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 19 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 20 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 21 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 22 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 23 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 24 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 25 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 26 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 27 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 28 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 29 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 30 Nov 3 03:29:28 kjcf05n03 cpupower[2153]: Setting cpu: 31 Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 03:29:28 kjcf05n03 dbus-daemon[2116]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[2154]: Setting up Mellanox network interface: ib1 Nov 3 03:29:28 kjcf05n03 network[2155]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 03:29:28 kjcf05n03 network[2119]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 03:29:28 kjcf05n03 chronyd[2182]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 03:29:28 kjcf05n03 beSetMlxConfig[2166]: ConnectX-3 multiport not detected Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 03:29:28 kjcf05n03 network[2176]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 03:29:28 kjcf05n03 network[2119]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 03:29:28 kjcf05n03 systemd[1]: Started irqbalance daemon. Nov 3 03:29:28 kjcf05n03 network[2204]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Resets System Activity Logs... Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 03:29:28 kjcf05n03 chronyd[2182]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 03:29:28 kjcf05n03 chronyd[2182]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[2224]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Name Service Cache Daemon. Nov 3 03:29:28 kjcf05n03 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 03:29:28 kjcf05n03 beSetMlxConfig[2166]: Starting MST (Mellanox Software Tools) driver set Nov 3 03:29:28 kjcf05n03 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 0 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 1 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 2 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 3 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 4 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 5 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 6 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 7 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 8 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 9 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 10 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 11 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 12 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 13 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 14 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 15 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 16 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 17 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 18 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 19 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 20 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 21 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 22 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 23 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 24 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 25 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 26 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 27 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 28 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 29 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 30 Nov 3 03:29:28 kjcf05n03 cpupower[2276]: Idlestate 2 disabled on CPU 31 Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[2256]: Setting up Mellanox network interface: ib0 Nov 3 03:29:28 kjcf05n03 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 03:29:28 kjcf05n03 mdraid-phy[2261]: no Cutlass to worry about Nov 3 03:29:28 kjcf05n03 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[2274]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Resets System Activity Logs. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Manage Cutlass PHYs. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 03:29:28 kjcf05n03 beSetMlxConfig[2166]: Loading MST PCI module - Success Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[2312]: No configuration found for ib1 Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[2313]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[2321]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 03:29:28 kjcf05n03 beSetMlxConfig[2166]: Loading MST PCI configuration module - Success Nov 3 03:29:28 kjcf05n03 beSetMlxConfig[2166]: Create devices Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[2330]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[2342]: No configuration found for ib0 Nov 3 03:29:28 kjcf05n03 mlnx_conf_mgr[2356]: INFO: No configurations found for mlx5_1, skipping. Nov 3 03:29:28 kjcf05n03 sssd[sssd][2214]: Starting up Nov 3 03:29:28 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[2381]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 03:29:28 kjcf05n03 mlnx_conf_mgr[2436]: INFO: No configurations found for mlx5_0, skipping. Nov 3 03:29:28 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 03:29:28 kjcf05n03 sssd[be[implicit_files]][2408]: Starting up Nov 3 03:29:28 kjcf05n03 sssd[nss][2534]: Starting up Nov 3 03:29:28 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 03:29:28 kjcf05n03 systemd[1]: Reached target User and Group Name Lookups. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Login Service... Nov 3 03:29:28 kjcf05n03 systemd-logind[2624]: New seat seat0. Nov 3 03:29:28 kjcf05n03 systemd-logind[2624]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Login Service. Nov 3 03:29:28 kjcf05n03 python3.9[2180]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 03:29:28 kjcf05n03 python3.9[3202]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 03:29:28 kjcf05n03 systemd-sysctl[2769]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 03:29:28 kjcf05n03 systemd-sysctl[2769]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 03:29:28 kjcf05n03 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 03:29:28 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 03:29:28 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 03:29:28 kjcf05n03 python3.9[2940]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 03:29:28 kjcf05n03 python3.9[3202]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 03:29:28 kjcf05n03 network[2119]: Bringing up loopback interface: [ OK ] Nov 3 03:29:28 kjcf05n03 systemd-sysctl[3104]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 03:29:28 kjcf05n03 systemd-sysctl[3104]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 03:29:28 kjcf05n03 systemd[1]: Started LSB: Bring up/down networking. Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 03:29:28 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 03:29:28 kjcf05n03 systemd[1]: Reached target Network. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 03:29:28 kjcf05n03 systemd[1]: Reached target Network is Online. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 03:29:28 kjcf05n03 sm-notify[3197]: Version 2.3.3 starting Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting System Logger Daemon... Nov 3 03:29:28 kjcf05n03 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 03:29:28 kjcf05n03 python3.9[3147]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 03:29:28 kjcf05n03 python3.9[3202]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 03:29:28 kjcf05n03 sshd[3178]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 03:29:28 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Notify NFS peers of a restart. Nov 3 03:29:28 kjcf05n03 systemd[1]: Reached target NFS client services. Nov 3 03:29:28 kjcf05n03 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 03:29:28 kjcf05n03 systemd[1]: Reached target Remote File Systems. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Permit User Sessions... Nov 3 03:29:28 kjcf05n03 lldpad[3157]: setsockopt nearest_bridge: Invalid argument Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Permit User Sessions. Nov 3 03:29:28 kjcf05n03 lldpad[3157]: setsockopt nearest_bridge: Invalid argument Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Serial Getty on ttyS0. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Getty on tty1. Nov 3 03:29:28 kjcf05n03 systemd[1]: Reached target Login Prompts. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 03:29:28 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 03:29:28 kjcf05n03 syslog-ng[3202]: [2024-11-03T09:28:15.452168] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 03:29:28 kjcf05n03 syslog-ng[3202]: [2024-11-03T09:28:15.452519] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 03:29:28 kjcf05n03 syslog-ng[3202]: [2024-11-03T09:28:15.452559] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 03:29:28 kjcf05n03 syslog-ng[3202]: [2024-11-03T09:28:15.453150] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 03:29:28 kjcf05n03 syslog-ng[3202]: [2024-11-03T09:28:15.453359] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 03:29:28 kjcf05n03 systemd[1]: Started System Logger Daemon. Nov 3 03:29:28 kjcf05n03 beSetMlxConfig[2166]: Unloading MST PCI module (unused) - Success Nov 3 03:29:28 kjcf05n03 python3.9[3219]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 03:29:28 kjcf05n03 python3.9[3202]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 03:29:28 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 03:29:28 kjcf05n03 python3.9[3445]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 03:29:28 kjcf05n03 python3.9[3202]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 03:29:28 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 03:29:28 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 03:29:28 kjcf05n03 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 03:29:28 kjcf05n03 chronyd[2182]: System's initial offset : 0.004799 seconds slow of true (slew) Nov 3 03:29:28 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 03:29:28 kjcf05n03 beSetMlxConfig[2166]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 03:29:28 kjcf05n03 beSetMlxConfig[2166]: ib mode Nov 3 03:29:28 kjcf05n03 root[3466]: openibd: Set node_desc for mlx5_0: kjcf05n03 HCA-1 Nov 3 03:29:28 kjcf05n03 root[3468]: openibd: Set node_desc for mlx5_1: kjcf05n03 HCA-2 Nov 3 03:29:28 kjcf05n03 beSetMlxConfig[2166]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 03:29:28 kjcf05n03 beSetMlxConfig[2166]: ib mode Nov 3 03:29:28 kjcf05n03 systemd-udevd[1556]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 03:29:28 kjcf05n03 systemd-udevd[3485]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:29:28 kjcf05n03 systemd-udevd[3486]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:29:28 kjcf05n03 systemd-udevd[3489]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:29:28 kjcf05n03 systemd-udevd[3491]: Using default interface naming scheme 'rhel-8.0'. Nov 3 03:29:28 kjcf05n03 systemd-udevd[3491]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:29:28 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 03:29:28 kjcf05n03 systemd[3202]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:28 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[3527]: Setting up Mellanox network interface: ib1 Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[3528]: Setting up Mellanox network interface: ib0 Nov 3 03:29:28 kjcf05n03 systemd-udevd[3488]: Using default interface naming scheme 'rhel-8.0'. Nov 3 03:29:28 kjcf05n03 systemd-udevd[3487]: Using default interface naming scheme 'rhel-8.0'. Nov 3 03:29:28 kjcf05n03 systemd-udevd[3488]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:29:28 kjcf05n03 systemd-udevd[3487]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Puppet agent... Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[3582]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[3583]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[3608]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[3609]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[3610]: No configuration found for ib0 Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[3611]: No configuration found for ib1 Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[3618]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[3619]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 03:29:28 kjcf05n03 mlnx_conf_mgr[3658]: INFO: No configurations found for mlx5_0, skipping. Nov 3 03:29:28 kjcf05n03 mlnx_conf_mgr[3659]: INFO: No configurations found for mlx5_1, skipping. Nov 3 03:29:28 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 03:29:28 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 03:29:28 kjcf05n03 systemd[1]: Stopping Command Scheduler... Nov 3 03:29:28 kjcf05n03 systemd[1]: crond.service: Succeeded. Nov 3 03:29:28 kjcf05n03 systemd[1]: Stopped Command Scheduler. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 03:29:28 kjcf05n03 systemd[1]: Stopping Job spooling tools... Nov 3 03:29:28 kjcf05n03 systemd[1]: atd.service: Succeeded. Nov 3 03:29:28 kjcf05n03 systemd[1]: Stopped Job spooling tools. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 03:29:28 kjcf05n03 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 03:29:28 kjcf05n03 lldpad[3157]: init_ports: Error adding device ib0 Nov 3 03:29:28 kjcf05n03 lldpad[3157]: init_ports: Error adding device ib1 Nov 3 03:29:28 kjcf05n03 lldpad[3157]: Signal 15 received - terminating Nov 3 03:29:28 kjcf05n03 systemd[1]: lldpad.service: Succeeded. Nov 3 03:29:28 kjcf05n03 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 03:29:28 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 03:29:28 kjcf05n03 systemd[1]: lldpad.socket: Succeeded. Nov 3 03:29:28 kjcf05n03 systemd[1]: Closed lldpad.socket. Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 03:29:28 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting IPMI Driver... Nov 3 03:29:28 kjcf05n03 systemd[1]: Started IPMI Driver. Nov 3 03:29:28 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:28 kjcf05n03 systemd[3202]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:28 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Ipmievd Daemon... Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 1 | Nov-03-2024 | 08:58:39 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 2 | Nov-03-2024 | 08:59:31 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 3 | Nov-03-2024 | 08:59:31 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 4 | Nov-03-2024 | 09:00:36 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 5 | Nov-03-2024 | 09:00:36 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 6 | Nov-03-2024 | 09:25:32 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 7 | Nov-03-2024 | 09:25:32 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 8 | Nov-03-2024 | 09:25:32 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 9 | Nov-03-2024 | 09:25:32 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 10 | Nov-03-2024 | 09:25:32 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 11 | Nov-03-2024 | 09:25:32 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 12 | Nov-03-2024 | 09:25:32 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 13 | Nov-03-2024 | 09:25:32 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 14 | Nov-03-2024 | 09:25:32 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 15 | Nov-03-2024 | 09:25:32 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 16 | Nov-03-2024 | 09:25:32 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 17 | Nov-03-2024 | 09:25:32 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 18 | Nov-03-2024 | 09:26:03 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 19 | Nov-03-2024 | 09:26:03 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 20 | Nov-03-2024 | 09:26:03 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 21 | Nov-03-2024 | 09:26:03 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 22 | Nov-03-2024 | 09:26:03 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 23 | Nov-03-2024 | 09:26:03 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 24 | Nov-03-2024 | 09:26:03 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 25 | Nov-03-2024 | 09:26:03 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 26 | Nov-03-2024 | 09:26:03 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 27 | Nov-03-2024 | 09:26:03 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 28 | Nov-03-2024 | 09:26:03 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 29 | Nov-03-2024 | 09:26:03 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 30 | Nov-03-2024 | 09:26:03 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 31 | Nov-03-2024 | 09:26:03 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 32 | Nov-03-2024 | 09:26:03 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 33 | Nov-03-2024 | 09:26:03 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 34 | Nov-03-2024 | 09:26:03 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 35 | Nov-03-2024 | 09:26:03 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 36 | Nov-03-2024 | 09:26:03 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 37 | Nov-03-2024 | 09:26:03 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 38 | Nov-03-2024 | 09:26:03 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 39 | Nov-03-2024 | 09:26:03 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 40 | Nov-03-2024 | 09:26:04 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 41 | Nov-03-2024 | 09:26:04 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 42 | Nov-03-2024 | 09:26:04 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 43 | Nov-03-2024 | 09:26:04 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 44 | Nov-03-2024 | 09:26:04 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 45 | Nov-03-2024 | 09:26:04 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 46 | Nov-03-2024 | 09:26:04 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 47 | Nov-03-2024 | 09:26:04 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 48 | Nov-03-2024 | 09:26:04 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4003]: 49 | Nov-03-2024 | 09:26:04 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:29:28 kjcf05n03 ipmievd[4006]: Reading sensors... Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Ipmievd Daemon. Nov 3 03:29:28 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:28 kjcf05n03 systemd[3202]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 03:29:28 kjcf05n03 nscd[2120]: 2120 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 03:29:28 kjcf05n03 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 03:29:28 kjcf05n03 systemd[1]: Stopped Set Mellanox configuration. Nov 3 03:29:28 kjcf05n03 systemd[1]: Stopping Set Mellanox configuration... Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 03:29:28 kjcf05n03 beSetMlxConfig[4064]: ConnectX-3 multiport not detected Nov 3 03:29:28 kjcf05n03 beSetMlxConfig[4064]: Starting MST (Mellanox Software Tools) driver set Nov 3 03:29:28 kjcf05n03 beSetMlxConfig[4064]: Loading MST PCI module - Success Nov 3 03:29:28 kjcf05n03 systemd-udevd[1556]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 03:29:28 kjcf05n03 beSetMlxConfig[4064]: [warn] mst_pciconf is already loaded, skipping Nov 3 03:29:28 kjcf05n03 beSetMlxConfig[4064]: Create devices Nov 3 03:29:28 kjcf05n03 beSetMlxConfig[4064]: Unloading MST PCI module (unused) - Success Nov 3 03:29:28 kjcf05n03 ipmievd[4006]: Waiting for events... Nov 3 03:29:28 kjcf05n03 beSetMlxConfig[4064]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 03:29:28 kjcf05n03 beSetMlxConfig[4064]: ib mode Nov 3 03:29:28 kjcf05n03 beSetMlxConfig[4064]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 03:29:28 kjcf05n03 beSetMlxConfig[4064]: ib mode Nov 3 03:29:28 kjcf05n03 systemd-udevd[1556]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 03:29:28 kjcf05n03 systemd-udevd[4965]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:29:28 kjcf05n03 systemd-udevd[4966]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:29:28 kjcf05n03 systemd-udevd[4969]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:29:28 kjcf05n03 systemd-udevd[4972]: Using default interface naming scheme 'rhel-8.0'. Nov 3 03:29:28 kjcf05n03 systemd-udevd[4972]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:29:28 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 03:29:28 kjcf05n03 systemd[3202]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:28 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[5007]: Setting up Mellanox network interface: ib1 Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[5008]: Setting up Mellanox network interface: ib0 Nov 3 03:29:28 kjcf05n03 systemd-udevd[4967]: Using default interface naming scheme 'rhel-8.0'. Nov 3 03:29:28 kjcf05n03 systemd-udevd[4968]: Using default interface naming scheme 'rhel-8.0'. Nov 3 03:29:28 kjcf05n03 systemd-udevd[4967]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:29:28 kjcf05n03 systemd-udevd[4968]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[5062]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[5063]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[5088]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[5089]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[5090]: No configuration found for ib1 Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[5091]: No configuration found for ib0 Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[5098]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 03:29:28 kjcf05n03 mlnx_interface_mgr[5099]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 03:29:28 kjcf05n03 mlnx_conf_mgr[5135]: INFO: No configurations found for mlx5_1, skipping. Nov 3 03:29:28 kjcf05n03 mlnx_conf_mgr[5139]: INFO: No configurations found for mlx5_0, skipping. Nov 3 03:29:28 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 03:29:28 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}bf6197c365d146e21443ec4a5ead5628aa61164f70b361229d1096b5c7b65f0f' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}bf6197c365d146e21443ec4a5ead5628aa61164f70b361229d1096b5c7b65f0f' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}fac332fd1796cca4f9d628e5c21127566b6162c788e806a1738260ee7fd2520b' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}fac332fd1796cca4f9d628e5c21127566b6162c788e806a1738260ee7fd2520b' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}92343cddf2a024703116369feb0723da08fa3696379b14a2611ba9ba9a8a77d0' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}92343cddf2a024703116369feb0723da08fa3696379b14a2611ba9ba9a8a77d0' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}1000d4241aa33271fe54ea0f78cbf836f9347b1dc31d2b8163d67bf674c3d3ff' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}1000d4241aa33271fe54ea0f78cbf836f9347b1dc31d2b8163d67bf674c3d3ff' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 03:29:28 kjcf05n03 systemd[1]: Stopping NTP client/server... Nov 3 03:29:28 kjcf05n03 chronyd[2182]: chronyd exiting Nov 3 03:29:28 kjcf05n03 systemd[1]: chronyd.service: Succeeded. Nov 3 03:29:28 kjcf05n03 systemd[1]: Stopped NTP client/server. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 03:29:28 kjcf05n03 chronyd[5174]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 03:29:28 kjcf05n03 chronyd[5174]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 03:29:28 kjcf05n03 chronyd[5174]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 03:29:28 kjcf05n03 chronyd[5174]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 03:29:28 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 03:29:28 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:28 kjcf05n03 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 03:29:28 kjcf05n03 systemd[1]: dwd.service: Succeeded. Nov 3 03:29:28 kjcf05n03 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 03:29:28 kjcf05n03 dwd[5205]: dwd: vMay 29 2024 : 15:38:26 Nov 3 03:29:28 kjcf05n03 dwd[5205]: /usr/sbin/dwd -i 15 -d Nov 3 03:29:28 kjcf05n03 dwd[5205]: dwd: option Lethal: 0 Nov 3 03:29:28 kjcf05n03 dwd[5205]: dwd: option Interval: 15 Nov 3 03:29:28 kjcf05n03 dwd[5205]: dwd: option abrtlimit: 10 Nov 3 03:29:28 kjcf05n03 dwd[5205]: dwd: option DZPeriod: 604800 Nov 3 03:29:28 kjcf05n03 dwd[5205]: dwd: option SmartPeriod: 43200 Nov 3 03:29:28 kjcf05n03 dwd[5205]: dwd: option SDDEnabled: 1 Nov 3 03:29:28 kjcf05n03 dwd[5205]: dwd: option SDDAwaitScale: 3 Nov 3 03:29:28 kjcf05n03 dwd[5205]: dwd: option SDDAwaitMin: 100 Nov 3 03:29:28 kjcf05n03 dwd[5205]: dwd: option Verbosity: 1 Nov 3 03:29:28 kjcf05n03 dwd[5205]: dwd: option StandAlone: 0 Nov 3 03:29:28 kjcf05n03 dwd[5205]: option Lethal: 0 Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 03:29:28 kjcf05n03 dwd[5205]: option Interval: 15 Nov 3 03:29:28 kjcf05n03 dwd[5205]: option abrtlimit: 10 Nov 3 03:29:28 kjcf05n03 dwd[5205]: option DZPeriod: 604800 Nov 3 03:29:28 kjcf05n03 dwd[5205]: option SmartPeriod: 43200 Nov 3 03:29:28 kjcf05n03 dwd[5205]: option SDDEnabled: 1 Nov 3 03:29:28 kjcf05n03 dwd[5205]: option SDDAwaitScale: 3 Nov 3 03:29:28 kjcf05n03 dwd[5205]: option SDDAwaitMin: 100 Nov 3 03:29:28 kjcf05n03 dwd[5205]: option Verbosity: 1 Nov 3 03:29:28 kjcf05n03 dwd[5205]: option StandAlone: 0 Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 03:29:28 kjcf05n03 dwd[5206]: option Lethal now set to 1 Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 03:29:28 kjcf05n03 dwd[5206]: option abrtlimit now set to 1 Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 03:29:28 kjcf05n03 dwd[5206]: option SmartPeriod now set to 86400 Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 03:29:28 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 03:29:28 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Discard unused blocks. Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:28 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:28 kjcf05n03 python3.9[5235]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 03:29:28 kjcf05n03 python3.9[3202]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 03:29:28 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Periodic ZFS scrub. Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:28 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 03:29:28 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting Sed Control Plane worker process... Nov 3 03:29:28 kjcf05n03 sedcpwrkr[5373]: Using config script: /etc/sedcpwrkr.conf Nov 3 03:29:28 kjcf05n03 sedcpwrkr[5373]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 03:29:28 kjcf05n03 sedcpwrkr[5373]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 03:29:28 kjcf05n03 sedcpwrkr[5373]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 03:29:28 kjcf05n03 sedcpwrkr[5373]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 03:29:28 kjcf05n03 sedcpwrkr[5373]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 03:29:28 kjcf05n03 sedcpwrkr[5373]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 03:29:28 kjcf05n03 sedcpwrkr-server[5404]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 03:29:28 kjcf05n03 sedcpwrkr[5373]: celery multi v5.2.7 (dawn-chorus) Nov 3 03:29:28 kjcf05n03 sedcpwrkr[5373]: > Starting nodes... Nov 3 03:29:28 kjcf05n03 sedcpwrkr[5373]: > sedcpwrkr@kjcf05n03: OK Nov 3 03:29:28 kjcf05n03 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 03:29:28 kjcf05n03 sedcpwrkr-server[5406]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 03:29:28 kjcf05n03 sedcpwrkr-server[5406]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 03:29:28 kjcf05n03 sedcpwrkr-server[5406]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 03:29:28 kjcf05n03 systemd[1]: Started Sed Control Plane worker process. Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 03:29:28 kjcf05n03 systemd[1]: Reloading System Logger Daemon. Nov 3 03:29:28 kjcf05n03 systemd[1]: Reloaded System Logger Daemon. Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 03:29:28 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 03:29:28 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 03:29:28 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:28 kjcf05n03 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 03:29:28 kjcf05n03 systemd-udevd[1556]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 03:29:28 kjcf05n03 iptables.init[5473]: iptables: Applying firewall rules: [ OK ] Nov 3 03:29:28 kjcf05n03 systemd[1]: Started IPv4 firewall with iptables. Nov 3 03:29:29 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:29 kjcf05n03 systemd[3202]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:29 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:29 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:29 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 03:29:29 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 03:29:29 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 03:29:29 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 03:29:29 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 03:29:29 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 03:29:29 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 03:29:29 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 03:29:29 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 03:29:29 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 03:29:30 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 03:29:30 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 03:29:30 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 03:29:30 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 03:29:30 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 03:29:30 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 03:29:30 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 03:29:30 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 03:29:30 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 03:29:30 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 03:29:30 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 03:29:30 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 03:29:30 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 03:29:30 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 03:29:30 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 03:29:30 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 03:29:30 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 03:29:30 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 03:29:30 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 03:29:30 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 03:29:30 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 03:29:30 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 03:29:30 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 03:29:30 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 03:29:30 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 03:29:30 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 03:29:30 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 03:29:30 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 03:29:30 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 03:29:30 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 03:29:30 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 03:29:30 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 03:29:30 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 03:29:30 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 03:29:30 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 03:29:30 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 03:29:30 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 03:29:30 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 03:29:30 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 03:29:30 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 03:29:30 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:30 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 03:29:30 kjcf05n03 systemd[1]: openhpid.service: Supervising process 5571 which is not our child. We'll most likely not notice when it exits. Nov 3 03:29:30 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 03:29:30 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:30 kjcf05n03 openhpid[5571]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 03:29:30 kjcf05n03 openhpid[5571]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 03:29:30 kjcf05n03 openhpid[5571]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 03:29:30 kjcf05n03 openhpid[5571]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 03:29:30 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:31 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:31 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:31 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 03:29:31 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 03:29:31 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 03:29:31 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 03:29:31 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:31 kjcf05n03 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 03:29:31 kjcf05n03 dcs-collectord[5662]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 03:29:31 kjcf05n03 hpi.inv.log[5662]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 03:29:31 kjcf05n03 dcs-collectord[5662]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 03:29:31 kjcf05n03 dcs-collectord[5662]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 03:29:31 kjcf05n03 dcs-collector[5653]: Starting dcs-collector:[ OK ] Nov 3 03:29:31 kjcf05n03 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 03:29:31 kjcf05n03 dcs-collectord[5665]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 03:29:31 kjcf05n03 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 03:29:31 kjcf05n03 dcs-collectord[5665]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 03:29:31 kjcf05n03 dcs-collectord[5665]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 03:29:31 kjcf05n03 dcs-collectord[5665]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 03:29:31 kjcf05n03 dcs-collectord[5665]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 03:29:31 kjcf05n03 dcs-collectord[5665]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 03:29:31 kjcf05n03 dcs-collectord[5665]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259349028", "units": "kB"}, {"name": "MemAvailable", "value": "258628196", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821324", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686880", "units": "kB"}, {"name": "Inactive", "value": "961820", "units": "kB"}, {"name": "Active(anon)", "value": "1520856", "units": "kB"}, {"name": "Inactive(anon)", "value": "825516", "units": "kB"}, {"name": "Active(file)", "value": "166024", "units": "kB"}, {"name": "Inactive(file)", "value": "136304", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "753060", "units": "kB"}, {"name": "Mapped", "value": "86096", "units": "kB"}, {"name": "Shmem", "value": "1593448", "units": "kB"}, {"name": "KReclaimable", "value": "108164", "units": "kB"}, {"name": "Slab", "value": "273156", "units": "kB"}, {"name": "SReclaimable", "value": "108164", "units": "kB"}, {"name": "SUnreclaim", "value": "164992", "units": "kB"}, {"name": "KernelStack", "value": "9744", "units": "kB"}, {"name": "PageTables", "value": "20056", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3098740", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11136", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "4096", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "289096", "units": "kB"}, {"name": "DirectMap2M", "value": "24741888", "units": "kB"}, {"name": "DirectMap1G", "value": "243269632", "units": "kB"}]}' Nov 3 03:29:31 kjcf05n03 dcs-collectord[5665]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 03:29:31 kjcf05n03 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 03:29:31 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:32 kjcf05n03 dcs-collectord[5665]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 03:29:32 kjcf05n03 dcs-collectord[5665]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730626171.6165104], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730626171.8647366], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730626171.548815, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 03:29:32 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:32 kjcf05n03 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 03:29:32 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:32 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:32 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 03:29:32 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 03:29:32 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 03:29:32 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 03:29:32 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:32 kjcf05n03 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 03:29:32 kjcf05n03 firmware-update-orc[5771]: Using config script: /etc/firmware_update_orc.conf Nov 3 03:29:32 kjcf05n03 firmware-update-orc[5771]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 03:29:32 kjcf05n03 firmware-update-orc[5771]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 03:29:32 kjcf05n03 firmware-update-orc[5771]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 03:29:32 kjcf05n03 firmware-update-orc[5771]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 03:29:32 kjcf05n03 firmware-update-orc[5771]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 03:29:32 kjcf05n03 firmware-update-orc[5771]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 03:29:32 kjcf05n03 firmware-update-orc-server[5809]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 03:29:33 kjcf05n03 firmware-update-orc[5771]: celery multi v5.2.7 (dawn-chorus) Nov 3 03:29:33 kjcf05n03 firmware-update-orc[5771]: > Starting nodes... Nov 3 03:29:33 kjcf05n03 firmware-update-orc[5771]: > worker1@kjcf05n03: OK Nov 3 03:29:33 kjcf05n03 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 03:29:33 kjcf05n03 firmware-update-orc-server[5811]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 03:29:33 kjcf05n03 firmware-update-orc-server[5811]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 03:29:33 kjcf05n03 firmware-update-orc-server[5811]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 03:29:33 kjcf05n03 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 03:29:33 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:33 kjcf05n03 systemd[3202]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:33 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:33 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:33 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 03:29:33 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 03:29:33 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 03:29:33 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 03:29:33 kjcf05n03 dbus-daemon[2116]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 03:29:33 kjcf05n03 dbus-daemon[2116]: [system] Reloaded configuration Nov 3 03:29:33 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 03:29:33 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 03:29:33 kjcf05n03 dbus-daemon[2116]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 03:29:33 kjcf05n03 dbus-daemon[2116]: [system] Reloaded configuration Nov 3 03:29:33 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 03:29:33 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 03:29:33 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 03:29:33 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 03:29:33 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:33 kjcf05n03 systemd[1]: Starting Manages hardware resources... Nov 3 03:29:34 kjcf05n03 ras-resource-manager-agent[5927]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 03:29:34 kjcf05n03 ras-resource-manager-agent[5913]: Starting ras-resource-manager-agent:[ OK ] Nov 3 03:29:34 kjcf05n03 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 03:29:34 kjcf05n03 ras-resource-manager-agent[5929]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 03:29:34 kjcf05n03 ras-resource-manager-client[5929]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 03:29:34 kjcf05n03 systemd[1]: Started Manages hardware resources. Nov 3 03:29:34 kjcf05n03 ras-resource-manager-client[5929]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 03:29:34 kjcf05n03 ras-resource-manager-client[5939]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 03:29:34 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:35 kjcf05n03 systemd[3202]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:35 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:35 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:35 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 03:29:35 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 03:29:35 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:35 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 03:29:35 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:35 kjcf05n03 systemd[3202]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: Press Ctrl+C to exit. Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: Plugin support version 1.0 Nov 3 03:29:35 kjcf05n03 zabbix_agent2[6013]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 03:29:35 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:35 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:35 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:36 kjcf05n03 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 03:29:36 kjcf05n03 dcs-notification-sender[6088]: dcs-notification-senderd is stopped Nov 3 03:29:36 kjcf05n03 zabbix-agent2[6102]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 03:29:36 kjcf05n03 dcs-notification-sender[6088]: Starting notification-sender:[ OK ] Nov 3 03:29:36 kjcf05n03 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 03:29:36 kjcf05n03 zabbix-agent2[6108]: INFO DCS notification agent started. (agent.py:61) Nov 3 03:29:36 kjcf05n03 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 03:29:36 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:37 kjcf05n03 systemd[3202]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:37 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:37 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:37 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:37 kjcf05n03 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 03:29:37 kjcf05n03 dcs-collectord[6210]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 03:29:37 kjcf05n03 dcs-collectord[6210]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 03:29:37 kjcf05n03 dcs-bulk-data-sender[6210]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 03:29:37 kjcf05n03 dcs-bulk-data-sender[6201]: Starting bulk-data-sender:[ OK ] Nov 3 03:29:37 kjcf05n03 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 03:29:37 kjcf05n03 dcs-collectord[6212]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 03:29:37 kjcf05n03 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 03:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 03:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 03:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 03:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 03:29:37 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:38 kjcf05n03 systemd[3202]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:38 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:38 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:38 kjcf05n03 nscd[2120]: 2120 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 03:29:38 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 03:29:38 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 03:29:38 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 03:29:38 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 03:29:38 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 03:29:38 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 03:29:38 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 03:29:38 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 03:29:38 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 03:29:38 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 03:29:38 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 03:29:38 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 03:29:38 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 03:29:38 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 03:29:38 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 03:29:38 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 03:29:38 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 03:29:38 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 03:29:38 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 03:29:38 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 03:29:38 kjcf05n03 systemd[1]: Stopping System Security Services Daemon... Nov 3 03:29:38 kjcf05n03 sssd[nss][2534]: Shutting down (status = 0) Nov 3 03:29:38 kjcf05n03 sssd[be[implicit_files]][2408]: Shutting down (status = 0) Nov 3 03:29:38 kjcf05n03 systemd[1]: sssd.service: Succeeded. Nov 3 03:29:38 kjcf05n03 systemd[1]: Stopped System Security Services Daemon. Nov 3 03:29:38 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 03:29:38 kjcf05n03 python3.9[5235]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 03:29:39 kjcf05n03 python3.9[3202]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:39 kjcf05n03 sssd[sssd][6284]: Starting up Nov 3 03:29:39 kjcf05n03 sssd[be[implicit_files]][6294]: Starting up Nov 3 03:29:39 kjcf05n03 sssd[nss][6295]: Starting up Nov 3 03:29:39 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 03:29:39 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 03:29:39 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 03:29:40 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 03:29:40 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 03:29:40 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 03:29:40 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 03:29:40 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 03:29:40 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 03:29:40 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure) defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 03:29:40 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure: defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 03:29:40 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure) defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 03:29:40 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure: defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 03:29:40 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 03:29:40 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 03:29:40 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 03:29:40 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 03:29:40 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:29:40 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:29:40 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:40 kjcf05n03 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 03:29:41 kjcf05n03 icinga2[6341]: [2024-11-03 03:29:41 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 03:29:41 kjcf05n03 icinga2[6341]: [2024-11-03 03:29:41 -0600] information/cli: Loading configuration file(s). Nov 3 03:29:41 kjcf05n03 icinga2[6341]: [2024-11-03 03:29:41 -0600] information/ConfigItem: Committing config item(s). Nov 3 03:29:41 kjcf05n03 icinga2[6341]: [2024-11-03 03:29:41 -0600] information/ApiListener: My API identity: kjcf05n03 Nov 3 03:29:41 kjcf05n03 icinga2[6341]: [2024-11-03 03:29:41 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 03:29:41 kjcf05n03 icinga2[6341]: [2024-11-03 03:29:41 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 03:29:41 kjcf05n03 icinga2[6341]: [2024-11-03 03:29:41 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 03:29:41 kjcf05n03 icinga2[6341]: [2024-11-03 03:29:41 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 03:29:41 kjcf05n03 icinga2[6341]: [2024-11-03 03:29:41 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 03:29:41 kjcf05n03 icinga2[6341]: [2024-11-03 03:29:41 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 03:29:41 kjcf05n03 icinga2[6341]: [2024-11-03 03:29:41 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 03:29:41 kjcf05n03 icinga2[6341]: [2024-11-03 03:29:41 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 03:29:41 kjcf05n03 icinga2[6341]: [2024-11-03 03:29:41 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 03:29:41 kjcf05n03 icinga2[6341]: [2024-11-03 03:29:41 -0600] information/cli: Closing console log. Nov 3 03:29:41 kjcf05n03 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 03:29:41 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:41 kjcf05n00 mcfcli[3673891]: %3|1730626181.125|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:29:41 kjcf05n03 systemd[3202]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:41 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:41 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:42 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 03:29:42 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 03:29:42 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:42 kjcf05n03 systemd[1]: Started Icinga2 network monitor. Nov 3 03:29:42 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:42 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 03:29:42 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:42 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:43 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 03:29:43 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 03:29:43 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 03:29:43 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 03:29:43 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 03:29:43 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 03:29:43 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 03:29:43 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 03:29:43 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 03:29:43 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 03:29:43 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 03:29:43 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 03:29:43 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 03:29:43 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 03:29:43 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:43 kjcf05n03 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 03:29:43 kjcf05n03 nslcd[6956]: version 0.9.9 starting Nov 3 03:29:43 kjcf05n03 nslcd[6956]: accepting connections Nov 3 03:29:43 kjcf05n03 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 03:29:43 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:44 kjcf05n03 systemd[3202]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:44 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:44 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:44 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 03:29:44 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 03:29:44 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 03:29:44 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 03:29:44 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 03:29:44 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 03:29:45 kjcf05n03 dcs-bulk-data-sender[6212]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 03:29:45 kjcf05n03 dcs-collectord[6212]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 03:29:45 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 03:29:45 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 03:29:45 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:45 kjcf05n03 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 03:29:45 kjcf05n03 dearcpw[7199]: Using config script: /etc/dearcpw.conf Nov 3 03:29:45 kjcf05n03 dearcpw[7199]: - Creating default directory: '/var/log/dearcpw' Nov 3 03:29:45 kjcf05n03 dearcpw[7199]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 03:29:45 kjcf05n03 dearcpw[7199]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 03:29:45 kjcf05n03 dearcpw[7199]: - Creating default directory: '/var/run/dearcpw' Nov 3 03:29:45 kjcf05n03 dearcpw[7199]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 03:29:45 kjcf05n03 dearcpw[7199]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 03:29:46 kjcf05n03 dearcpw-server[7239]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 03:29:46 kjcf05n03 dearcpw[7199]: celery multi v5.2.7 (dawn-chorus) Nov 3 03:29:46 kjcf05n03 dearcpw[7199]: > Starting nodes... Nov 3 03:29:46 kjcf05n03 dearcpw[7199]: > dearcpw@kjcf05n03: OK Nov 3 03:29:46 kjcf05n03 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 03:29:46 kjcf05n03 dearcpw-server[7241]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 03:29:46 kjcf05n03 dearcpw-server[7241]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 03:29:46 kjcf05n03 dearcpw-server[7241]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 03:29:46 kjcf05n03 systemd[1]: Started DEAR Control Plane worker process. Nov 3 03:29:46 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:46 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:46 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 03:29:46 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 03:29:46 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 03:29:46 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 03:29:46 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 03:29:46 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 03:29:46 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 03:29:46 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 03:29:46 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 03:29:46 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 03:29:46 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:58650). Nov 3 03:29:46 kjcf05n01 rsyncd[2869923]: connect from kjcf05n03 (172.16.2.6) Nov 3 03:29:46 kjcf05n01 rsyncd[2869923]: rsync to puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 03:29:46 kjcf05n01 rsyncd[2869923]: receiving file list Nov 3 03:29:46 kjcf05n01 rsyncd[2869923]: sent 29 bytes received 325 bytes total size 10901 Nov 3 03:29:46 kjcf05n01 systemd[1]: rsyncd@592-172.16.2.2:873-172.16.2.6:58650.service: Succeeded. Nov 3 03:29:46 kjcf05n03 puppet[7445]: IEC: 017000000: Node is up and running: { "node": "kjcf05n03" } Nov 3 03:29:46 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 03:29:46 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 03:29:46 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 03:29:46 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 03:29:46 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 03:29:46 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 03:29:46 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 03:29:46 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 03:29:46 kjcf05n03 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 03:29:46 kjcf05n03 dcs-collectord[5665]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 03:29:47 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 03:29:47 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 03:29:47 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 03:29:47 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 03:29:47 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 03:29:47 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 03:29:48 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 03:29:48 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 03:29:48 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 03:29:48 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 03:29:49 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 03:29:49 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 03:29:49 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 03:29:49 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 03:29:49 kjcf05n00 mcfcli[3673891]: %3|1730626189.001|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 03:29:49 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 03:29:49 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 03:29:49 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:50 kjcf05n03 ipmievd[4006]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 03:29:50 kjcf05n03 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 03:29:50 kjcf05n03 ipmievd[4006]: System Event sensor - Timestamp Clock Sync Nov 3 03:29:50 kjcf05n03 ipmievd[3202]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:50 kjcf05n03 diskless-swap[7625]: HA_PS_000: recovering journal Nov 3 03:29:50 kjcf05n03 systemd-udevd[1556]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 03:29:50 kjcf05n03 diskless-swap[7625]: HA_PS_000: clean, 2266/6400 files, 7033/25600 blocks Nov 3 03:29:50 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 03:29:50 kjcf05n03 diskless-swap[7625]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 03:29:50 kjcf05n03 diskless-swap[7625]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 03:29:50 kjcf05n03 diskless-swap[7625]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 03:29:50 kjcf05n03 diskless-swap[7625]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 03:29:50 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 03:29:50 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:50 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:50 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 03:29:50 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 03:29:50 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 03:29:50 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 03:29:50 kjcf05n03 systemd[1]: Stopping OpenSSH server daemon... Nov 3 03:29:51 kjcf05n03 systemd[1]: sshd.service: Succeeded. Nov 3 03:29:51 kjcf05n03 systemd[1]: Stopped OpenSSH server daemon. Nov 3 03:29:51 kjcf05n03 systemd[1]: Stopped target sshd-keygen.target. Nov 3 03:29:51 kjcf05n03 systemd[1]: Stopping sshd-keygen.target. Nov 3 03:29:51 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 03:29:51 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 03:29:51 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 03:29:51 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 03:29:51 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 03:29:51 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 03:29:51 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 03:29:51 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 03:29:51 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 03:29:51 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 03:29:51 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 03:29:52 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 03:29:52 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 03:29:52 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 03:29:52 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 03:29:53 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 03:29:53 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 03:29:53 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 03:29:53 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 03:29:54 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 03:29:54 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 03:29:54 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 03:29:54 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 03:29:54 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:54 kjcf05n03 systemd[1]: Set up automount opt-firmware.automount. Nov 3 03:29:54 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:54 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:54 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 03:29:54 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 03:29:54 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:54 kjcf05n03 systemd[1]: Set up automount mnt-llog.automount. Nov 3 03:29:54 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:54 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:54 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 03:29:54 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 03:29:54 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:55 kjcf05n03 systemd[1]: Set up automount usr-share-man.automount. Nov 3 03:29:55 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:29:55 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:29:55 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 03:29:55 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 03:29:55 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 03:29:55 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 03:29:55 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 03:29:55 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 03:29:55 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 03:29:55 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 03:29:55 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 03:29:55 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 03:29:55 kjcf05n03 systemd[1]: Reloading. Nov 3 03:29:55 kjcf05n03 systemd[1]: Starting Crash recovery kernel arming... Nov 3 03:29:55 kjcf05n03 kdumpctl[7949]: kdump: No kdump initial ramdisk found. Nov 3 03:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 03:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 03:29:55 kjcf05n03 kdumpctl[7949]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 03:29:55 kjcf05n03 dracut[8061]: dracut-049-135.git20210121.el8 Nov 3 03:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 03:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 03:29:56 kjcf05n03 dracut[8063]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 03:29:56 kjcf05n03 dracut[8063]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 03:29:56 kjcf05n03 dracut[8063]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 03:29:56 kjcf05n03 dracut[8063]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 03:29:56 kjcf05n03 dracut[8063]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 03:29:56 kjcf05n03 dracut[8063]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 03:29:56 kjcf05n03 dracut[8063]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 03:29:56 kjcf05n03 dracut[8063]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + is_func check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ type -t check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 0 -ne 0 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check -h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local dev holder Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + require_binaries mdadm expr Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _module_name=90hperaid Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ mdadm = \-\m ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for cmd in "$@" Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + find_binary mdadm Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for cmd in "$@" Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + find_binary expr Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n -h ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for dev in "${!host_fs_types[@]}" Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ nfs != *_raid_member ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + continue Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _ret=255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + ret=255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ 255 = 0 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ 255 = 255 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ module_depends hperaid Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: +++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: +++ set -x Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ depends Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo rootfs-block Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ return 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ _ret=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ return 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for _moddep in $(module_depends $_mod) Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all == *\ hperaid\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + add_dracutmodules+=' rootfs-block ' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ == *\ hperaid\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check_module rootfs-block Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _mod=rootfs-block Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddep Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ == *\ rootfs-block\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n '' ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all == *\ rootfs-block\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + module_check rootfs-block 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _forced=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 2 -eq 2 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _forced=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + is_func check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ type -t check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 0 -ne 0 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check -h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _ret=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + ret=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ 0 = 0 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ module_depends rootfs-block Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: +++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 03:29:56 kjcf05n03 kdumpctl[3202]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ depends Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo fs-lib Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ _ret=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ return 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for _moddep in $(module_depends $_mod) Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all == *\ rootfs-block\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + add_dracutmodules+=' fs-lib ' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ == *\ rootfs-block\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check_module fs-lib Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _mod=fs-lib Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddep Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n '' ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + mods_checked_as_dep+=' fs-lib ' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all == *\ fs-lib\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + module_check fs-lib 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _forced=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 2 -eq 2 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _forced=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + is_func check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ type -t check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 0 -ne 0 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check -h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _ret=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + ret=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ 0 = 0 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ module_depends fs-lib Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: +++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ depends Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ return 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ _ret=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ return 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + mods_to_load+=' fs-lib ' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + mods_to_load+=' rootfs-block ' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + mods_to_load+=' hperaid ' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _mod=90kernel-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _mod=kernel-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check_module kernel-modules 1 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _mod=kernel-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddep Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n 1 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all = all ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + module_check kernel-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _forced=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 1 -eq 2 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + is_func check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ type -t check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 0 -ne 0 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check -h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + true Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _ret=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + ret=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ 0 != 0 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ module_depends kernel-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: +++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ depends Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ true Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ _ret=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ return 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + mods_to_load+=' kernel-modules ' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _mod=90kernel-modules-extra Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _mod=kernel-modules-extra Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check_module kernel-modules-extra 1 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _mod=kernel-modules-extra Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddep Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n 1 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all = all ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + module_check kernel-modules-extra Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _forced=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 1 -eq 2 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + is_func check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ type -t check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 0 -ne 0 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check -h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + true Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _ret=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + ret=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ 0 != 0 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ module_depends kernel-modules-extra Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: +++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ depends Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ true Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ _ret=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ return 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + mods_to_load+=' kernel-modules-extra ' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _mod=90kernel-network-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _mod=kernel-network-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check_module kernel-network-modules 1 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _mod=kernel-network-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddep Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n 1 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all = all ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + module_check kernel-network-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _forced=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 1 -eq 2 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + is_func check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ type -t check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 0 -ne 0 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check -h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _ret=255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + ret=255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ 255 != 0 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n 1 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 1 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _mod=90livenet Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _mod=livenet Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check_module livenet 1 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _mod=livenet Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddep Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n 1 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all = all ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + module_check livenet Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _forced=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 1 -eq 2 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + is_func check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ type -t check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 0 -ne 0 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check -h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _ret=255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + ret=255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ 255 != 0 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n 1 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 1 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _mod=90lvm Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _mod=lvm Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check_module lvm 1 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _mod=lvm Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddep Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n 1 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all = all ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + module_check lvm Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _forced=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 1 -eq 2 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + is_func check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ type -t check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 0 -ne 0 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check -h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + require_binaries lvm Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _module_name=90lvm Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ lvm = \-\m ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for cmd in "$@" Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + find_binary lvm Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n -h ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for fs in "${host_fs_types[@]}" Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ nfs = LVM*_member ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _ret=255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + ret=255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ 255 != 0 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n 1 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 1 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _mod=90mdraid Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _mod=mdraid Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check_module mdraid 1 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _mod=mdraid Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddep Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n 1 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all = all ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + module_check mdraid Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _forced=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 1 -eq 2 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + is_func check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ type -t check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 0 -ne 0 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check -h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _rootdev Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + require_binaries mdadm expr Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _module_name=90mdraid Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ mdadm = \-\m ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for cmd in "$@" Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + find_binary mdadm Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for cmd in "$@" Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + find_binary expr Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n -h ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for dev in "${!host_fs_types[@]}" Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ nfs != *_raid_member ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + continue Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _ret=255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + ret=255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ 255 != 0 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n 1 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 1 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _mod=90multipath Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _mod=multipath Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check_module multipath 1 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _mod=multipath Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddep Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n 1 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all = all ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + module_check multipath Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _forced=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 1 -eq 2 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + is_func check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ type -t check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 0 -ne 0 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check -h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _rootdev Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n -h ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for_each_host_dev_and_slaves is_mpath Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _func=is_mpath Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _dev Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for _dev in "${host_devs[@]}" Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + continue Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 1 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _ret=255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + ret=255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ 255 != 0 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n 1 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 1 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _mod=90qemu Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _mod=qemu Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check_module qemu 1 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _mod=qemu Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddep Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n 1 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all = all ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + module_check qemu Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _forced=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 1 -eq 2 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + is_func check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ type -t check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 0 -ne 0 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check -h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n -h ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + type -P systemd-detect-virt Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ systemd-detect-virt --vm Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + vm=none Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + (( 1 != 0 )) Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _ret=255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + ret=255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ 255 != 0 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n 1 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 1 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _mod=90qemu-net Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _mod=qemu-net Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check_module qemu-net 1 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _mod=qemu-net Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddep Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n 1 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all = all ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + module_check qemu-net Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _forced=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 1 -eq 2 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + is_func check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ type -t check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 0 -ne 0 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check -h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n -h ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + type -P systemd-detect-virt Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ systemd-detect-virt --vm Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + vm= Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + (( 1 != 0 )) Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _ret=255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + ret=255 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ 255 != 0 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n 1 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + return 1 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _mod=90stratis Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + _mod=stratis Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check_module stratis 1 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _mod=stratis Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddep Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -n 1 ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ all = all ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + module_check stratis Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ read a b Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _forced=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _hostonly=-h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 1 -eq 2 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + is_func check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: ++ type -t check Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + '[' 0 -ne 0 ']' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + check -h Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _module_name=90stratis Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + local _ret=0 Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + [[ stratisd-init = \-\m ]] Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + for cmd in "$@" Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + find_binary stratisd-init Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 03:29:56 kjcf05n03 kdumpctl[7949]: + set +x Nov 3 03:29:56 kjcf05n03 dracut[8063]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 03:29:56 kjcf05n03 dracut[8063]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 03:29:56 kjcf05n03 dracut[8063]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 03:29:56 kjcf05n03 dracut[8063]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 03:29:56 kjcf05n03 dracut[8063]: memstrack is available Nov 3 03:29:56 kjcf05n03 dracut[8063]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 03:29:56 kjcf05n03 dracut[8063]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 03:29:57 kjcf05n03 dracut[8063]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 03:29:57 kjcf05n03 dracut[8063]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 03:29:57 kjcf05n03 dracut[8063]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 03:29:57 kjcf05n03 dracut[8063]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 03:29:57 kjcf05n03 dracut[8063]: *** Including module: bash *** Nov 3 03:29:57 kjcf05n03 dracut[8063]: *** Including module: systemd *** Nov 3 03:29:57 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n03": interface became available Nov 3 03:29:58 kjcf05n03 dracut[8063]: *** Including module: fips *** Nov 3 03:29:58 kjcf05n03 dracut[8063]: *** Including module: systemd-initrd *** Nov 3 03:29:58 kjcf05n03 dracut[8063]: *** Including module: watchdog-modules *** Nov 3 03:29:58 kjcf05n03 dracut[8063]: *** Including module: nss-softokn *** Nov 3 03:29:58 kjcf05n03 dracut[8063]: *** Including module: i18n *** Nov 3 03:29:58 kjcf05n03 dracut[8063]: No KEYMAP configured. Nov 3 03:29:58 kjcf05n03 dracut[8063]: *** Including module: network-legacy *** Nov 3 03:29:59 kjcf05n03 dracut[8063]: *** Including module: network *** Nov 3 03:29:59 kjcf05n03 dracut[8063]: *** Including module: ib_bonding *** Nov 3 03:29:59 kjcf05n03 dracut[8063]: *** Including module: drm *** Nov 3 03:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 03:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 03:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 03:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 03:30:00 kjcf05n00 zabbix-server[913930]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 03:30:00 kjcf05n00 zabbix-server[913930]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n03 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n03:system.uptime): 00:02:43\\"}}"' Nov 3 03:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 03:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 03:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 03:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 03:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 03:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 03:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 03:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 03:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 03:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 03:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 03:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 03:30:00 kjcf05n00 log_interesting_event.py[913930]: Event '45699' acknowledged Nov 3 03:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 03:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 03:30:00 kjcf05n00 zabbix-server[913946]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 03:30:00 kjcf05n00 zabbix-server[913946]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 3 03:30:00 kjcf05n00 log_interesting_event.py[913946]: Event '45700' acknowledged Nov 3 03:30:00 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31410 deleted. Nov 3 03:30:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 03:30:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:30:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 03:30:01 kjcf05n03 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 03:30:01 kjcf05n03 dcs-collectord[5665]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 03:30:03 kjcf05n03 dracut[8063]: *** Including module: hperaid *** Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + install Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + local rule rule_path Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + inst_multiple cat expr Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.6TCK3P/initramfs -a -f cat expr Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + _ret=0 Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + (( 0 != 0 )) Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + : Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + return 0 Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + inst_multiple -o mdmon Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.6TCK3P/initramfs -a -f -o mdmon Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + _ret=0 Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + (( 0 != 0 )) Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + : Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + return 0 Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: ++ command -v partx Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + inst /usr/sbin/partx /sbin/partx Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + local _hostonly_install Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + [[ -e /tmp/dracut.6TCK3P/initramfs//sbin/partx ]] Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.6TCK3P/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + (( 0 != 0 )) Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + : Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: ++ command -v mdadm Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + local _hostonly_install Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + [[ -e /tmp/dracut.6TCK3P/initramfs//sbin/mdadm ]] Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.6TCK3P/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + (( 0 != 0 )) Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + : Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + [[ yes == \y\e\s ]] Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + local _raidconf Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: ++ cmdline Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: ++ local _activated dev line UUID Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: ++ declare -A _activated Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: ++ for dev in "${!host_fs_types[@]}" Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: ++ [[ nfs != *_raid_member ]] Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: ++ continue Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + _raidconf= Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + [[ -n '' ]] Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + inst_rules 64-md-raid.rules Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + local _target=/etc/udev/rules.d _rule _found Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + inst_dir /usr/lib/udev/rules.d Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + [[ -e /tmp/dracut.6TCK3P/initramfs//usr/lib/udev/rules.d ]] Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + return 0 Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + inst_dir /etc/udev/rules.d Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + [[ -e /tmp/dracut.6TCK3P/initramfs//etc/udev/rules.d ]] Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + return 0 Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + for _rule in "$@" Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + continue Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + continue Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + for r in '' $dracutbasedir/rules.d/ Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + [[ 64-md-raid.rules != /* ]] Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + continue Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + for r in '' $dracutbasedir/rules.d/ Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + continue Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + [[ -n '' ]] Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + set +x Nov 3 03:30:03 kjcf05n03 dracut[8063]: Skipping udev rule: 64-md-raid.rules Nov 3 03:30:02 kjcf05n00 python3.9[913845]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + installkernel Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + instmods =drivers/md Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + local _optional=-o Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + local _silent Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + local _ret Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + [[ '' = yes ]] Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + [[ =drivers/md = \-\c ]] Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + [[ =drivers/md = \-\s ]] Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + (( 1 == 0 )) Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.6TCK3P/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + _ret=0 Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + (( 0 != 0 )) Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + [[ -n '' ]] Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + return 0 Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + _ret=0 Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + unset check depends cmdline install installkernel Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + return 0 Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + modules_loaded+='hperaid ' Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + '[' -n '' ']' Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + _d_mod=90kernel-modules Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + _d_mod=kernel-modules Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + [[ '' = yes ]] Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + dinfo '*** Including module: kernel-modules ***' Nov 3 03:30:03 kjcf05n03 kdumpctl[7949]: + set +x Nov 3 03:30:03 kjcf05n03 dracut[8063]: *** Including module: kernel-modules *** Nov 3 03:30:04 kjcf05n03 dracut[8063]: *** Including module: kernel-modules-extra *** Nov 3 03:30:04 kjcf05n03 dracut[8063]: *** Including module: kernel-network-modules *** Nov 3 03:30:04 kjcf05n03 dracut[8063]: *** Including module: diskless-mod *** Nov 3 03:30:04 kjcf05n03 dracut[8063]: *** Including module: fstab-sys *** Nov 3 03:30:04 kjcf05n03 dracut[8063]: *** Including module: nfs *** Nov 3 03:30:04 kjcf05n03 dracut[8063]: *** Including module: rootfs-block *** Nov 3 03:30:04 kjcf05n03 dracut[8063]: *** Including module: terminfo *** Nov 3 03:30:04 kjcf05n03 dracut[8063]: *** Including module: udev-rules *** Nov 3 03:30:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 03:30:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 03:30:05 kjcf05n03 dracut[8063]: Skipping udev rule: 91-permissions.rules Nov 3 03:30:05 kjcf05n03 dracut[8063]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 03:30:05 kjcf05n03 dracut[8063]: *** Including module: dracut-systemd *** Nov 3 03:30:06 kjcf05n03 dracut[8063]: *** Including module: usrmount *** Nov 3 03:30:06 kjcf05n03 dracut[8063]: *** Including module: base *** Nov 3 03:30:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730626205', 'host':'kjcf05n03', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 03:30:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730626205', 'host':'kjcf05n03', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 03:30:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730626205'} Nov 3 03:30:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730626205'} Nov 3 03:30:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:30:06 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 03:30:06 kjcf05n03 dracut[8063]: *** Including module: fs-lib *** Nov 3 03:30:06 kjcf05n03 dracut[8063]: *** Including module: kdumpbase *** Nov 3 03:30:07 kjcf05n03 dracut[8063]: *** Including module: memstrack *** Nov 3 03:30:07 kjcf05n03 dracut[8063]: *** Including module: shutdown *** Nov 3 03:30:07 kjcf05n03 dracut[8063]: *** Including module: squash *** Nov 3 03:30:07 kjcf05n03 dracut[8063]: *** Including modules done *** Nov 3 03:30:07 kjcf05n03 dracut[8063]: *** Installing kernel module dependencies *** Nov 3 03:30:07 kjcf05n03 dracut[8063]: *** Installing kernel module dependencies done *** Nov 3 03:30:07 kjcf05n03 dracut[8063]: *** Resolving executable dependencies *** Nov 3 03:30:09 kjcf05n03 dracut[8063]: *** Resolving executable dependencies done*** Nov 3 03:30:09 kjcf05n03 dracut[8063]: *** Hardlinking files *** Nov 3 03:30:09 kjcf05n03 dracut[8063]: *** Hardlinking files done *** Nov 3 03:30:09 kjcf05n03 dracut[8063]: *** Generating early-microcode cpio image *** Nov 3 03:30:09 kjcf05n03 dracut[8063]: *** Constructing AuthenticAMD.bin **** Nov 3 03:30:09 kjcf05n03 dracut[8063]: *** Store current command line parameters *** Nov 3 03:30:09 kjcf05n03 dracut[8063]: Stored kernel commandline: Nov 3 03:30:09 kjcf05n03 dracut[8063]: rd.driver.pre=sd_mod Nov 3 03:30:09 kjcf05n03 dracut[8063]: rd.driver.pre=nvme Nov 3 03:30:09 kjcf05n03 dracut[8063]: rd.driver.pre=ipmi_si Nov 3 03:30:09 kjcf05n03 dracut[8063]: rd.driver.pre=ipmi_devintf Nov 3 03:30:09 kjcf05n03 dracut[8063]: rd.driver.pre=ipmi_msghandler Nov 3 03:30:09 kjcf05n03 dracut[8063]: nameserver=172.16.2.2 Nov 3 03:30:09 kjcf05n03 dracut[8063]: nameserver=127.0.0.1 Nov 3 03:30:09 kjcf05n03 dracut[8063]: nameserver=172.16.2.2 Nov 3 03:30:09 kjcf05n03 dracut[8063]: nameserver=127.0.0.1 Nov 3 03:30:09 kjcf05n03 dracut[8063]: ifname=kdump-meth0:00:09:3d:06:9a:1a team=mgmt0:kdump-meth0 Nov 3 03:30:09 kjcf05n03 dracut[8063]: rd.neednet Nov 3 03:30:09 kjcf05n03 dracut[8063]: kdumpnic=mgmt0 Nov 3 03:30:09 kjcf05n03 dracut[8063]: bootdev=mgmt0 Nov 3 03:30:09 kjcf05n03 dracut[8063]: *** Install squash loader *** Nov 3 03:30:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 03:30:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 03:30:09 kjcf05n03 check_diskmonit[14193]: DISKMONITOR CHECK: ERROR: Failed to run dm_report. Exit code: 1. Error output: b'Error: diskmonitor not running\n' Nov 3 03:30:09 kjcf05n03 dracut[8063]: *** Squashing the files inside the initramfs *** Nov 3 03:30:10 kjcf05n03 dracut[8063]: *** Squashing the files inside the initramfs done *** Nov 3 03:30:10 kjcf05n03 dracut[8063]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 03:30:10 kjcf05n03 dracut[8063]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 03:30:11 kjcf05n03 kdumpctl[7949]: kdump: kexec: loaded kdump kernel Nov 3 03:30:11 kjcf05n03 kdumpctl[7949]: kdump: Starting kdump: [OK] Nov 3 03:30:11 kjcf05n03 systemd[1]: Started Crash recovery kernel arming. Nov 3 03:30:11 kjcf05n03 systemd[1]: Reloading. Nov 3 03:30:11 kjcf05n03 systemd[3202]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:30:11 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:30:11 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:30:11 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 03:30:11 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 03:30:11 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 03:30:11 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 03:30:11 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 03:30:11 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 03:30:11 kjcf05n03 ifdown[14693]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 03:30:11 kjcf05n03 ifdown[14694]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 03:30:11 kjcf05n03 ifdown[14695]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 03:30:11 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 03:30:11 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 03:30:11 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 03:30:11 kjcf05n03 ifup[14755]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 03:30:11 kjcf05n03 ifup[14756]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 03:30:11 kjcf05n03 ifup[14757]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 03:30:14 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 03:30:16 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 03:30:16 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 03:30:16 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 03:30:16 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 03:30:16 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 03:30:16 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 03:30:16 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 03:30:16 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 03:30:16 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 03:30:16 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 03:30:16 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 03:30:16 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 03:30:16 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 03:30:16 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 03:30:16 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 03:30:16 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 03:30:16 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 03:30:16 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 03:30:16 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 03:30:16 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 03:30:16 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 03:30:16 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 03:30:16 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 03:30:16 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 03:30:16 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 03:30:16 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 03:30:16 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 03:30:16 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 03:30:16 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 03:30:16 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 03:30:16 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 03:30:16 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 03:30:16 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 03:30:16 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 03:30:16 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 03:30:16 kjcf05n03 ifdown[14942]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 03:30:16 kjcf05n03 ifdown[14943]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 03:30:16 kjcf05n03 ifdown[14944]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 03:30:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730625914', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 03:30:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730625914'} Nov 3 03:30:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:30:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730625914', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 03:30:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730625914'} Nov 3 03:30:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:30:16 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 03:30:16 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 03:30:16 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 03:30:16 kjcf05n03 ifup[15006]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 03:30:16 kjcf05n03 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 03:30:16 kjcf05n03 dcs-collectord[5665]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 03:30:16 kjcf05n03 ifup[15007]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 03:30:16 kjcf05n03 ifup[15009]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 03:30:18 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 03:30:19 kjcf05n00 mcfcli[3673891]: %3|1730626219.001|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:30:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730626219', 'host':'kjcf05n03', 'service_name':'Arrays and Disk Status', 'value':'UNKNOWN', 'message':'Diskmonitor not running'}"] Nov 3 03:30:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Arrays and Disk Status', 'description': 'Diskmonitor not running', 'message': 'Diskmonitor not running', 'value': 'unknown', 'timestamp': '1730626219'} Nov 3 03:30:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:30:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730626219', 'host':'kjcf05n03', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 03:30:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730626219'} Nov 3 03:30:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:30:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730626219', 'host':'kjcf05n03', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.66, 1.82, 0.82'}"] Nov 3 03:30:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Load', 'description': 'OK - load average: 1.66, 1.82, 0.82', 'message': 'OK - load average: 1.66, 1.82, 0.82', 'value': 'ok', 'timestamp': '1730626219'} Nov 3 03:30:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:30:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730626219', 'host':'kjcf05n03', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 329 processes with STATE = RSZDT '}"] Nov 3 03:30:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Total Processes', 'description': 'PROCS OK: 329 processes with STATE = RSZDT ', 'message': 'PROCS OK: 329 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730626219'} Nov 3 03:30:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:30:20 kjcf05n00 mcfcli[3673891]: %3|1730626220.134|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:30:21 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 03:30:21 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 03:30:21 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 03:30:21 kjcf05n03 systemd[1]: Reloading. Nov 3 03:30:21 kjcf05n03 systemd[1]: Starting Corosync Cluster Engine... Nov 3 03:30:21 kjcf05n03 await_ha_peer[15237]: Waiting for HA peer kjcf05n02 Nov 3 03:30:21 kjcf05n00 zabbix-server[914386]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 03:30:21 kjcf05n00 zabbix-server[914386]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 339.91\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 184.38\\"}}"' Nov 3 03:30:21 kjcf05n00 log_interesting_event.py[914386]: Event '45708' acknowledged Nov 3 03:30:23 kjcf05n03 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 03:30:23 kjcf05n03 await_ha_peer[15237]: Peer kjcf05n02 has started, starting HA Nov 3 03:30:23 kjcf05n03 systemd[1]: Started Corosync Cluster Engine. Nov 3 03:30:23 kjcf05n03 systemd[1]: Started Fast STONITH daemon. Nov 3 03:30:23 kjcf05n03 fstonithd.py[15291]: Listening for kdump packets from partner Nov 3 03:30:23 kjcf05n03 systemd[1]: Reloading. Nov 3 03:30:23 kjcf05n03 systemd[3202]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:30:23 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:30:23 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:30:23 kjcf05n03 systemd[1]: Reloading. Nov 3 03:30:24 kjcf05n03 systemd[1]: Reached target resource-agents dependencies. Nov 3 03:30:24 kjcf05n03 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 03:30:24 kjcf05n03 systemd[1]: Reloading. Nov 3 03:30:24 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 03:30:24 kjcf05n03 puppet-agent[3593]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:30:24 kjcf05n03 puppet[3593]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:30:24 kjcf05n03 puppet-agent[3593]: Applied catalog in 93.68 seconds Nov 3 03:30:24 kjcf05n03 puppet[3593]: Notice: Applied catalog in 93.68 seconds Nov 3 03:30:24 kjcf05n03 systemd[1]: Started Puppet agent. Nov 3 03:30:24 kjcf05n03 systemd[1]: Starting Set absolute GEM time... Nov 3 03:30:24 kjcf05n03 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 03:30:24 kjcf05n03 systemd[1]: Reached target Timers. Nov 3 03:30:24 kjcf05n03 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 03:30:24 kjcf05n03 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 03:30:24 kjcf05n03 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 03:30:24 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 03:30:24 kjcf05n03 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 03:30:24 kjcf05n03 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 03:30:24 kjcf05n03 wce-disable.sh[15433]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 03:30:24 kjcf05n03 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 03:30:24 kjcf05n03 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 03:30:24 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 03:30:24 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 03:30:24 kjcf05n03 systemd[1]: set_gem_time.service: Succeeded. Nov 3 03:30:24 kjcf05n03 systemd[1]: Started Set absolute GEM time. Nov 3 03:30:25 kjcf05n03 python3.9[15429]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 03:30:25 kjcf05n03 python3.9[15429]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 03:30:25 kjcf05n03 gateway-ec-node.py[15430]: Starting gateway-ec-node service Nov 3 03:30:25 kjcf05n03 RFSF-API[15428]: INFO[2024-11-03T03:30:24-06:00] Datapath API RESTful Service starting Nov 3 03:30:25 kjcf05n03 dp-api-server-node[15428]: INFO[2024-11-03T03:30:24-06:00] Datapath API RESTful Service starting Nov 3 03:30:25 kjcf05n03 RFSF-API[15428]: INFO[2024-11-03T03:30:24-06:00] Running in production mode, starting dbus event listener Nov 3 03:30:25 kjcf05n03 dp-api-server-node[15428]: INFO[2024-11-03T03:30:24-06:00] Running in production mode, starting dbus event listener Nov 3 03:30:25 kjcf05n03 RFSF-API[15428]: INFO[2024-11-03T03:30:24-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 03:30:25 kjcf05n03 dp-api-server-node[15428]: INFO[2024-11-03T03:30:24-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 03:30:25 kjcf05n03 RFSF-API[15428]: INFO[2024-11-03T03:30:24-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 03:30:25 kjcf05n03 dp-api-server-node[15428]: INFO[2024-11-03T03:30:24-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 03:30:25 kjcf05n03 RFSF-API[15428]: INFO[2024-11-03T03:30:24-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 03:30:25 kjcf05n03 dp-api-server-node[15428]: INFO[2024-11-03T03:30:24-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 03:30:25 kjcf05n03 RFSF-API[15428]: INFO[2024-11-03T03:30:24-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 03:30:25 kjcf05n03 dp-api-server-node[15428]: INFO[2024-11-03T03:30:24-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 03:30:25 kjcf05n03 RFSF-API[15428]: INFO[2024-11-03T03:30:24-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 03:30:25 kjcf05n03 dp-api-server-node[15428]: INFO[2024-11-03T03:30:24-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 03:30:25 kjcf05n03 RFSF-API[15428]: INFO[2024-11-03T03:30:24-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 03:30:25 kjcf05n03 dp-api-server-node[15428]: INFO[2024-11-03T03:30:24-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 03:30:25 kjcf05n03 RFSF-API[15428]: INFO[2024-11-03T03:30:24-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 03:30:25 kjcf05n03 dp-api-server-node[15428]: INFO[2024-11-03T03:30:24-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 03:30:25 kjcf05n03 RFSF-API[15428]: INFO[2024-11-03T03:30:24-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 03:30:25 kjcf05n03 dp-api-server-node[15428]: INFO[2024-11-03T03:30:24-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 03:30:25 kjcf05n03 RFSF-API[15428]: INFO[2024-11-03T03:30:24-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 03:30:25 kjcf05n03 dp-api-server-node[15428]: INFO[2024-11-03T03:30:24-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 03:30:25 kjcf05n03 RFSF-API[15428]: INFO[2024-11-03T03:30:24-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 03:30:25 kjcf05n03 dp-api-server-node[15428]: INFO[2024-11-03T03:30:24-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 03:30:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730626229', 'host':'kjcf05n03', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(336.0B/360.0B), ib1=(56.0B/360.0B), icl0=(7.2kB/8.9kB), lo=(600.0B/600.0B), meth0=(1541.5MB/7.9MB), mgmt0=(1478.3MB/7.9MB)'}"] Nov 3 03:30:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(336.0B/360.0B), ib1=(56.0B/360.0B), icl0=(7.2kB/8.9kB), lo=(600.0B/600.0B), meth0=(1541.5MB/7.9MB), mgmt0=(1478.3MB/7.9MB)', 'message': 'NET OK - (Rx/Tx) ib0=(336.0B/360.0B), ib1=(56.0B/360.0B), icl0=(7.2kB/8.9kB), lo=(600.0B/600.0B), meth0=(1541.5MB/7.9MB), mgmt0=(1478.3MB/7.9MB)', 'value': 'ok', 'timestamp': '1730626229'} Nov 3 03:30:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:30:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730626229', 'host':'kjcf05n03', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 03:30:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730626229'} Nov 3 03:30:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:30:30 kjcf05n03 systemd[1]: Reloading. Nov 3 03:30:30 kjcf05n03 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 03:30:30 kjcf05n03 systemd[1]: Reloading. Nov 3 03:30:30 kjcf05n03 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 03:30:31 kjcf05n03 diskmonitor_pre[15896]: Key management is currently disabled.DEAR disabled Nov 3 03:30:31 kjcf05n03 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 03:30:31 kjcf05n03 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 03:30:31 kjcf05n03 dcs-collectord[5665]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 03:30:31 kjcf05n03 dcs-collectord[5665]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 03:30:32 kjcf05n03 sh[15941]: LNET configured: New Created Nov 3 03:30:32 kjcf05n03 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 03:30:32 kjcf05n03 LCNmon[17953]: Interface ib0 is up Nov 3 03:30:32 kjcf05n03 LCNmon[17953]: Interface ib1 is up Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: /var/run/diskmonitor does not exist, creating Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: Creating /var/run/diskmonitor/disk Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: Creating /var/run/diskmonitor/encl Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: Creating /var/run/diskmonitor/cli Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: RAS_Interlocks_enabled: 1 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: add handler for sig: 14 sa_flags: 10000004 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: add handler for sig: 1 sa_flags: 10000004 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: add handler for sig: 2 sa_flags: 00000004 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: add handler for sig: 15 sa_flags: 00000004 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: add handler for sig: 6 sa_flags: 00000004 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: add handler for sig: 3 sa_flags: 00000004 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: add handler for sig: 30 sa_flags: 00000004 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: add handler for sig: 20 sa_flags: 00000004 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: add handler for sig: 10 sa_flags: 10000004 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: add handler for sig: 11 sa_flags: 00000004 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: add handler for sig: 7 sa_flags: 00000004 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: add handler for sig: 4 sa_flags: 00000004 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: add handler for sig: 8 sa_flags: 00000004 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: Using HA Baton locks - key: diskmonitor Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: Baton will be held for at most 570 seconds Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: DMMP Enabled: 0 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: random seed: a722e5a8 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: NVMe Enclosure: 1 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: ZFS Enclosure: 0 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: Dbus, Initialized Connection Successfully Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: int_catcher_thread: thread start Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: Received dbus message 4 org.freedesktop.DBus -> :1.98 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b07bec_S4EUNF0MA05386M encl_slot: 0 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b07bed_S4EUNF0MA05387D encl_slot: 0 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 03:30:35 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 03:30:34 kjcf05n00 httpd[902565]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-B): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n03', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 03:30:35 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18239 (bash) Nov 3 03:30:35 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 03:30:35 kjcf05n03 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 03:30:35 kjcf05n03 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 03:30:35 kjcf05n03 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 03:30:35 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 03:30:35 kjcf05n03 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 03:30:36 kjcf05n03 openhpid[5571]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 03:30:36 kjcf05n03 openhpid[5571]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 03:30:36 kjcf05n03 systemd[1]: openhpid.service: Succeeded. Nov 3 03:30:36 kjcf05n03 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 03:30:36 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 03:30:36 kjcf05n03 systemd[1]: openhpid.service: Supervising process 18481 which is not our child. We'll most likely not notice when it exits. Nov 3 03:30:36 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 03:30:36 kjcf05n03 systemd[1]: Reached target Multi-User System. Nov 3 03:30:36 kjcf05n03 systemd[1]: Reached target Graphical Interface. Nov 3 03:30:36 kjcf05n03 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 03:30:36 kjcf05n03 dcs-collectord[5665]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 03:30:36 kjcf05n03 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 03:30:36 kjcf05n03 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 03:30:36 kjcf05n03 systemd[1]: Startup finished in 51.087s (kernel) + 2min 29.377s (userspace) = 3min 20.464s. Nov 3 03:30:36 kjcf05n03 openhpid[18481]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 03:30:36 kjcf05n03 openhpid[18481]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 03:30:36 kjcf05n03 openhpid[18481]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 03:30:36 kjcf05n03 openhpid[18481]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 03:30:36 kjcf05n03 LCNmon[17953]: 10.16.100.52 is unreachable via ib0 Nov 3 03:30:36 kjcf05n03 LCNmon[17953]: 10.16.100.58 is unreachable via ib0 Nov 3 03:30:36 kjcf05n03 LCNmon[17953]: 10.16.100.56 is unreachable via ib0 Nov 3 03:30:36 kjcf05n03 LCNmon[17953]: 10.16.100.57 is unreachable via ib0 Nov 3 03:30:36 kjcf05n03 LCNmon[17953]: 10.16.100.61 is unreachable via ib0 Nov 3 03:30:36 kjcf05n03 LCNmon[17953]: Can ping through interface ib0 Nov 3 03:30:37 kjcf05n03 LCNmon[17953]: Can ping through interface ib1 Nov 3 03:30:37 kjcf05n03 LCNmon[17953]: NIC ib0, initial state UP Nov 3 03:30:37 kjcf05n03 LCNmon[17953]: NIC ib1, initial state UP Nov 3 03:30:37 kjcf05n03 LCNmon[17953]: LCNstat initial state UP Nov 3 03:30:37 kjcf05n03 LCNmon[17953]: LCNmon monitoring hosts kjcf05n03 and kjcf05n02 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 03:30:40 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 03:30:46 kjcf05n03 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 03:30:46 kjcf05n03 dcs-collectord[5665]: WARNING No data collected (hpi_parser.py:353) Nov 3 03:30:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730626248', 'host':'kjcf05n03', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.7% (4396184 kB) used.'}"] Nov 3 03:30:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'RAM usage', 'description': 'OK - 1.7% (4396184 kB) used.', 'message': 'OK - 1.7% (4396184 kB) used.', 'value': 'ok', 'timestamp': '1730626248'} Nov 3 03:30:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:30:49 kjcf05n00 mcfcli[3673891]: %3|1730626249.002|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 03:30:55 kjcf05n00 mcfcli[3673891]: %3|1730626255.268|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:31:00 kjcf05n03 ipmievd[4006]: System Event sensor - Timestamp Clock Sync Nov 3 03:31:00 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31409 deleted. Nov 3 03:31:01 kjcf05n03 ipmievd[3202]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:31:01 kjcf05n03 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b07bec_S4EUNF0MA05386M encl_sn: USE26000024VS001, slot: 1 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 03:31:13 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 03:31:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730626276', 'host':'kjcf05n03', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 03:31:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730626276'} Nov 3 03:31:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:31:17 kjcf05n03 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 03:31:19 kjcf05n00 mcfcli[3673891]: %3|1730626279.002|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:31:21 kjcf05n02 firmware-update-orc-server[5898]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "6fb6ae95-f109-4886-a6f0-b5c7115d2315"} (logger.py:65) Nov 3 03:31:21 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 146246 (get_disk_device) Nov 3 03:31:21 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 03:31:21 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 03:31:21 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 03:31:21 kjcf05n03 ras-resource-manager-agent[5929]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "62b77d44-99c6-11ef-9be6-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 03:31:21 kjcf05n03 ras-resource-manager-agent[5929]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '62b77d44-99c6-11ef-9be6-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 03:31:21 kjcf05n03 ras-resource-manager-agent[5929]: INFO Submitting new device inserted signal, starting to qualify drive: 62b77d44-99c6-11ef-9be6-00093d069a1b (admin_action.py:110) Nov 3 03:31:21 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '62b77d44-99c6-11ef-9be6-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 03:31:21 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '62b77d44-99c6-11ef-9be6-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 03:31:21 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '62b77d44-99c6-11ef-9be6-00093d069a1b', 'response ID': '62c1cfec-99c6-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 03:31:21 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 62c1cfec-99c6-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 03:31:21 kjcf05n02 ccp-client[146267]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 03:31:21 kjcf05n02 ccp-client[146267]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 03:31:21 kjcf05n02 ccp-client[146277]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 03:31:21 kjcf05n02 ccp-client[146267]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 03:31:21 kjcf05n02 ccp-client[146267]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 03:31:21 kjcf05n02 ccp-client[146277]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 03:31:21 kjcf05n02 ccp-client[146277]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 03:31:21 kjcf05n03 diskmonitor[17409]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 03:31:21 kjcf05n03 ras-resource-manager-agent[5929]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "6309491c-99c6-11ef-9be6-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 03:31:21 kjcf05n03 ras-resource-manager-agent[5929]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '6309491c-99c6-11ef-9be6-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 03:31:21 kjcf05n03 ras-resource-manager-agent[5929]: INFO Submitting new device inserted signal, starting to qualify drive: 6309491c-99c6-11ef-9be6-00093d069a1b (admin_action.py:110) Nov 3 03:31:21 kjcf05n03 firmware-update-orc-server[5885]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "eb82e1ce-351b-4063-bac6-6e65df5ffa5b"} (logger.py:65) Nov 3 03:31:21 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '6309491c-99c6-11ef-9be6-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 03:31:21 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '6309491c-99c6-11ef-9be6-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 03:31:21 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '6309491c-99c6-11ef-9be6-00093d069a1b', 'response ID': '631058d8-99c6-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 03:31:21 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 631058d8-99c6-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 03:31:24 kjcf05n02 DRVFW[146399]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 03:31:24 kjcf05n02 ccp-client[146400]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 03:31:24 kjcf05n02 ccp-client[146400]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 03:31:24 kjcf05n02 ccp-client[146409]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 03:31:24 kjcf05n02 ccp-client[146400]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 03:31:24 kjcf05n02 ccp-client[146400]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 03:31:24 kjcf05n02 ccp-client[146409]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 03:31:24 kjcf05n02 ccp-client[146409]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 03:31:24 kjcf05n02 firmware-update-orc-server[5898]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 03:31:26 kjcf05n03 ras-resource-manager-agent[5929]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '62b77d44-99c6-11ef-9be6-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 03:31:26 kjcf05n03 ras-resource-manager-agent[5929]: INFO Drive qualification complete responding: 62b77d44-99c6-11ef-9be6-00093d069a1b (admin_action.py:205) Nov 3 03:31:26 kjcf05n03 ras-resource-manager-agent[5929]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "62b77d44-99c6-11ef-9be6-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} (interesting_event.py:59) Nov 3 03:31:26 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 62c1cfec-99c6-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 03:31:26 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '62b77d44-99c6-11ef-9be6-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': '62b77d44-99c6-11ef-9be6-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}}} (logger.py:65) Nov 3 03:31:28 kjcf05n03 diskmonitor[17409]: 024VS001, slot: 10 Nov 3 03:31:28 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 03:31:28 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b07bed_S4EUNF0MA05387D encl_sn: USE26000024VS001, slot: 2 Nov 3 03:31:28 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 03:31:28 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 03:31:28 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 03:31:28 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 03:31:28 kjcf05n03 diskmonitor[17409]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 03:31:28 kjcf05n03 diskmonitor[17409]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 03:31:28 kjcf05n03 diskmonitor[17409]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 03:31:28 kjcf05n03 diskmonitor[17409]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 03:31:28 kjcf05n03 diskmonitor[17409]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 03:31:28 kjcf05n03 diskmonitor[17409]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "62b77d44-99c6-11ef-9be6-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 03:31:28 kjcf05n03 diskmonitor[17409]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 03:31:28 kjcf05n03 diskmonitor[17409]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 03:31:28 kjcf05n03 diskmonitor[17409]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "6309491c-99c6-11ef-9be6-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 03:31:28 kjcf05n03 diskmonitor[17409]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 03:31:28 kjcf05n03 diskmonitor[17409]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 03:31:33 kjcf05n00 mcfcli[3673891]: %3|1730626293.013|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:31:33 kjcf05n03 chronyd[5174]: Selected source 172.16.2.1 Nov 3 03:31:36 kjcf05n03 systemd[1]: Unmounting /mnt/llog... Nov 3 03:31:36 kjcf05n03 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 03:31:36 kjcf05n03 systemd[1]: Unmounted /mnt/llog. Nov 3 03:31:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730626296}"] Nov 3 03:31:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730626296, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:31:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:31:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730626296}"] Nov 3 03:31:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730626296, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:31:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:31:36 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22504 (get_disk_device) Nov 3 03:31:36 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 03:31:36 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 03:31:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730626296}"] Nov 3 03:31:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730626296, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:31:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:31:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730626296}"] Nov 3 03:31:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730626296, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:31:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:31:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730626296}"] Nov 3 03:31:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730626296, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:31:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:31:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730626296}"] Nov 3 03:31:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730626296, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:31:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:31:37 kjcf05n03 ccp-client[22526]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 03:31:37 kjcf05n03 ccp-client[22526]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 03:31:37 kjcf05n03 ccp-client[22537]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 03:31:37 kjcf05n03 ccp-client[22526]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 03:31:37 kjcf05n03 ccp-client[22526]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 03:31:37 kjcf05n03 ccp-client[22537]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 03:31:37 kjcf05n03 ccp-client[22537]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 03:31:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730626296}"] Nov 3 03:31:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730626296, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:31:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:31:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730626296}"] Nov 3 03:31:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730626296, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:31:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:31:40 kjcf05n03 DRVFW[22738]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 03:31:40 kjcf05n03 python3.9[5235]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 03:31:40 kjcf05n03 python3.9[3202]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:31:40 kjcf05n03 ccp-client[22739]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 03:31:40 kjcf05n03 ccp-client[22739]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 03:31:40 kjcf05n03 ccp-client[22753]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 03:31:40 kjcf05n03 ccp-client[22739]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 03:31:40 kjcf05n03 ccp-client[22739]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 03:31:40 kjcf05n03 ccp-client[22753]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 03:31:40 kjcf05n03 ccp-client[22753]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 03:31:40 kjcf05n03 firmware-update-orc-server[5885]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 03:31:41 kjcf05n03 ras-resource-manager-agent[5929]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "62b77d44-99c6-11ef-9be6-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} (service_main_handler.py:66) Nov 3 03:31:41 kjcf05n03 ras-resource-manager-agent[5929]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '62b77d44-99c6-11ef-9be6-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 03:31:41 kjcf05n03 ras-resource-manager-agent[5929]: INFO Device qualification response has been acknowledged: 62b77d44-99c6-11ef-9be6-00093d069a1b (admin_action.py:151) Nov 3 03:31:41 kjcf05n03 ras-resource-manager-agent[5929]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '6309491c-99c6-11ef-9be6-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 03:31:41 kjcf05n03 ras-resource-manager-agent[5929]: INFO Drive qualification complete responding: 6309491c-99c6-11ef-9be6-00093d069a1b (admin_action.py:205) Nov 3 03:31:41 kjcf05n03 ras-resource-manager-agent[5929]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "6309491c-99c6-11ef-9be6-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (interesting_event.py:59) Nov 3 03:31:41 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 631058d8-99c6-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 03:31:41 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '6309491c-99c6-11ef-9be6-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': '6309491c-99c6-11ef-9be6-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}}} (logger.py:65) Nov 3 03:31:45 kjcf05n03 diskmonitor[17409]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 03:31:46 kjcf05n03 diskmonitor[17409]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 03:31:46 kjcf05n03 ras-resource-manager-agent[5929]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "7198aedc-99c6-11ef-9be6-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 03:31:46 kjcf05n03 ras-resource-manager-agent[5929]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '7198aedc-99c6-11ef-9be6-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 03:31:46 kjcf05n03 ras-resource-manager-agent[5929]: INFO Requests ['6309491c-99c6-11ef-9be6-00093d069a1b', '7198aedc-99c6-11ef-9be6-00093d069a1b'] already in progress (admin_action.py:99) Nov 3 03:31:46 kjcf05n03 ras-resource-manager-agent[5929]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '7198aedc-99c6-11ef-9be6-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 03:31:46 kjcf05n03 ras-resource-manager-agent[5929]: INFO Drive qualification complete responding: 7198aedc-99c6-11ef-9be6-00093d069a1b (admin_action.py:205) Nov 3 03:31:46 kjcf05n03 ras-resource-manager-agent[5929]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "6309491c-99c6-11ef-9be6-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (interesting_event.py:59) Nov 3 03:31:46 kjcf05n03 ras-resource-manager-agent[5929]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "7198aedc-99c6-11ef-9be6-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (interesting_event.py:59) Nov 3 03:31:49 kjcf05n00 mcfcli[3673891]: %3|1730626309.003|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "62b77d44-99c6-11ef-9be6-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: Dbus, handle_ingress_ras_signals, uuid: 62b77d44-99c6-11ef-9be6-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "62b77d44-99c6-11ef-9be6-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: main: Pending firmware leveling requests exist, rescanning disks Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "7198aedc-99c6-11ef-9be6-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: leaving test state: 1 next state: 2 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: lock req: no timeout Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: leaving test state: 2 next state: 4 Nov 3 03:31:50 kjcf05n03 diskmonitor[17409]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 03:32:08 kjcf05n00 mcfcli[3673891]: %3|1730626328.631|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:32:19 kjcf05n00 mcfcli[3673891]: %3|1730626339.004|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 03:32:42 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 03:32:42 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 03:32:42 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 03:32:45 kjcf05n00 mcfcli[3673891]: %3|1730626365.389|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:32:45 kjcf05n03 ras-resource-manager-agent[5929]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "6309491c-99c6-11ef-9be6-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 03:32:45 kjcf05n03 ras-resource-manager-agent[5929]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '6309491c-99c6-11ef-9be6-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 03:32:45 kjcf05n03 ras-resource-manager-agent[5929]: INFO Device qualification response has been acknowledged: 6309491c-99c6-11ef-9be6-00093d069a1b (admin_action.py:151) Nov 3 03:32:45 kjcf05n03 ras-resource-manager-agent[5929]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "6309491c-99c6-11ef-9be6-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 03:32:45 kjcf05n03 ras-resource-manager-agent[5929]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '6309491c-99c6-11ef-9be6-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 03:32:45 kjcf05n03 ras-resource-manager-agent[5929]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "7198aedc-99c6-11ef-9be6-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 03:32:45 kjcf05n03 ras-resource-manager-agent[5929]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '7198aedc-99c6-11ef-9be6-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 03:32:45 kjcf05n03 ras-resource-manager-agent[5929]: INFO Device qualification response has been acknowledged: 7198aedc-99c6-11ef-9be6-00093d069a1b (admin_action.py:151) Nov 3 03:32:46 kjcf05n03 diskmonitor[17409]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 03:32:49 kjcf05n00 mcfcli[3673891]: %3|1730626369.004|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:32:57 kjcf05n03 dcs-collectord[5665]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 03:32:57 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 03:32:57 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 03:32:57 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 03:33:05 kjcf05n03 diskmonitor[17409]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "6309491c-99c6-11ef-9be6-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 3 03:33:05 kjcf05n03 diskmonitor[17409]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 03:33:05 kjcf05n03 diskmonitor[17409]: Dbus, handle_ingress_ras_signals, uuid: 6309491c-99c6-11ef-9be6-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 03:33:05 kjcf05n03 diskmonitor[17409]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 03:33:05 kjcf05n03 diskmonitor[17409]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "6309491c-99c6-11ef-9be6-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 3 03:33:05 kjcf05n03 diskmonitor[17409]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "6309491c-99c6-11ef-9be6-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 3 03:33:05 kjcf05n03 diskmonitor[17409]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 03:33:05 kjcf05n03 diskmonitor[17409]: Dbus, handle_ingress_ras_signals, uuid: 6309491c-99c6-11ef-9be6-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 03:33:05 kjcf05n03 diskmonitor[17409]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "6309491c-99c6-11ef-9be6-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 3 03:33:05 kjcf05n03 diskmonitor[17409]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "7198aedc-99c6-11ef-9be6-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 3 03:33:05 kjcf05n03 diskmonitor[17409]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 03:33:05 kjcf05n03 diskmonitor[17409]: Dbus, handle_ingress_ras_signals, uuid: 7198aedc-99c6-11ef-9be6-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 03:33:05 kjcf05n03 diskmonitor[17409]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "7198aedc-99c6-11ef-9be6-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 3 03:33:05 kjcf05n03 diskmonitor[17409]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 03:33:05 kjcf05n03 diskmonitor[17409]: lock acquired Nov 3 03:33:05 kjcf05n03 diskmonitor[17409]: leaving test state: 4 next state: 8 Nov 3 03:33:05 kjcf05n03 diskmonitor[17409]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 03:33:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730626386}"] Nov 3 03:33:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730626386, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:33:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:33:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:33:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:33:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:33:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:33:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:33:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:33:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:33:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:33:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:33:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:33:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:33:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:33:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.262578ms Nov 3 03:33:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:33:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.262578ms Nov 3 03:33:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:03:33:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 03:33:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:33:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Inactive', 'timestamp': 1730626386}"] Nov 3 03:33:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730626386, 'value': 'Inactive', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:33:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:33:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:33:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:33:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:33:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:33:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:33:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:33:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:33:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:33:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:33:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:33:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:33:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:33:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.176356ms Nov 3 03:33:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:33:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.176356ms Nov 3 03:33:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:03:33:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 03:33:19 kjcf05n00 mcfcli[3673891]: %3|1730626399.004|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 03:33:20 kjcf05n03 diskmonitor[17409]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 03:33:20 kjcf05n03 diskmonitor[17409]: leaving test state: 8 next state: 20 Nov 3 03:33:20 kjcf05n03 diskmonitor[17409]: leaving test state: 20 next state: 40 Nov 3 03:33:20 kjcf05n03 diskmonitor[17409]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 29c91a58000 Nov 3 03:33:20 kjcf05n03 diskmonitor[17409]: leaving test state: 40 next state: 80 Nov 3 03:33:24 kjcf05n00 mcfcli[3673891]: %3|1730626404.519|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T03:33:27.252784105-06:00 level=info msg="Completed cleanup jobs" duration=26.161215ms Nov 3 03:33:49 kjcf05n00 mcfcli[3673891]: %3|1730626429.005|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 03:34:03 kjcf05n00 mcfcli[3673891]: %3|1730626443.882|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:34:19 kjcf05n00 mcfcli[3673891]: %3|1730626459.007|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:34:19 kjcf05n03 diskmonitor[17409]: leaving test state: 80 next state: 100 Nov 3 03:34:19 kjcf05n03 diskmonitor[17409]: lock release: time: Sun Nov 3 03:34:13 2024 Nov 3 03:34:19 kjcf05n03 diskmonitor[17409]: leaving test state: 100 next state: 1 Nov 3 03:34:42 kjcf05n00 mcfcli[3673891]: %3|1730626482.036|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:34:49 kjcf05n00 mcfcli[3673891]: %3|1730626489.007|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 03:34:51 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 03:35:01 kjcf05n00 python3.9[917071]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 03:35:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730625914', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 03:35:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730625914'} Nov 3 03:35:14 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:35:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730625914', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 03:35:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730625914'} Nov 3 03:35:14 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:35:17 kjcf05n00 mcfcli[3673891]: %3|1730626517.583|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:35:19 kjcf05n00 mcfcli[3673891]: %3|1730626519.008|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 03:35:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730626522', 'host':'kjcf05n03', 'service_name':'Arrays and Disk Status', 'value':'OK', 'message':'No arrays found, T10PI: Not relevant on this system\\nTotal number of disk slots available: 24\\nTotal number of disks found: 24\\n\\nslot: 1, wwn: eui.345950304db010370025384500000004, cap: 3840755982336, dev: nvme14n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\nslot: 13, wwn: eui.345950304db010210025384500000004, cap: 3840755982336, dev: nvme13n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\n\\nMD RAID to Lustre mapping\\n\\n\\n\\n\\nDegraded Array information:\\n\\nAll arrays are in clean state on node kjcf05n03'}"] Nov 3 03:35:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Arrays and Disk Status', 'description': 'No arrays found, T10PI: Not relevant on this system\\nTotal number of disk slots available: 24\\nTotal number of disks found: 24\\n\\nslot: 1, wwn: eui.345950304db010370025384500000004, cap: 3840755982336, dev: nvme14n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\nslot: 13, wwn: eui.345950304db010210025384500000004, cap: 3840755982336, dev: nvme13n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\n\\nMD RAID to Lustre mapping\\n\\n\\n\\n\\nDegraded Array information:\\n\\nAll arrays are in clean state on node kjcf05n03', 'message': 'No arrays found, T10PI: Not relevant on this system\\nTotal number of disk slots available: 24\\nTotal number of disks found: 24\\n\\nslot: 1, wwn: eui.345950304db010370025384500000004, cap: 3840755982336, dev: nvme14n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\nslot: 13, wwn: eui.345950304db010210025384500000004, cap: 3840755982336, dev: nvme13n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\n\\nMD RAID to Lustre mapping\\n\\n\\n\\n\\nDegraded Array information:\\n\\nAll arrays are in clean state on node kjcf05n03', 'value': 'ok', 'timestamp': '1730626522'} Nov 3 03:35:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:35:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730626536}"] Nov 3 03:35:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730626536, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:35:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:35:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:35:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:35:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:35:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:35:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:35:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:35:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:35:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:35:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:35:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:35:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:35:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:35:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.281874ms Nov 3 03:35:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:35:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.281874ms Nov 3 03:35:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:03:35:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 03:35:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:35:49 kjcf05n00 mcfcli[3673891]: %3|1730626549.008|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 03:35:55 kjcf05n00 zabbix-server[917798]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 03:35:55 kjcf05n00 zabbix-server[917798]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n03' from event '45714' Nov 3 03:35:55 kjcf05n00 zabbix-server[917798]: Host created 'enclosure_USE26000024VS001' Nov 3 03:35:55 kjcf05n00 zabbix-server[917798]: Running puppet on 'kjcf05n03' Nov 3 03:35:55 kjcf05n00 mcfcli[3673891]: %3|1730626555.552|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:35:57 kjcf05n03 puppet-agent[33439]: Using configured environment 'production' Nov 3 03:35:57 kjcf05n03 puppet-agent[33439]: Retrieving pluginfacts Nov 3 03:35:57 kjcf05n03 puppet-agent[33439]: Retrieving plugin Nov 3 03:35:57 kjcf05n03 puppet-agent[33439]: Loading facts Nov 3 03:36:00 kjcf05n03 puppet-agent[33439]: Caching catalog for kjcf05n03 Nov 3 03:36:00 kjcf05n03 puppet-agent[33439]: Applying configuration version '1730626558' Nov 3 03:36:02 kjcf05n03 puppet-agent[33439]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 03:36:02 kjcf05n03 puppet-agent[33439]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 03:36:02 kjcf05n03 puppet-agent[33439]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 03:36:03 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 03:36:03 kjcf05n03 zabbix_agent2[6013]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 03:36:03 kjcf05n03 zabbix_agent2[3202]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:36:03 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 03:36:03 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 03:36:03 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 03:36:03 kjcf05n03 puppet-agent[33439]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: Press Ctrl+C to exit. Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: Plugin support version 1.0 Nov 3 03:36:03 kjcf05n03 zabbix_agent2[33772]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 03:36:04 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 03:36:05 kjcf05n03 puppet-agent[33439]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 03:36:05 kjcf05n03 puppet-agent[33439]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 03:36:05 kjcf05n03 puppet-agent[33439]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 03:36:05 kjcf05n03 puppet-agent[33439]: Applied catalog in 5.44 seconds Nov 3 03:36:05 kjcf05n00 zabbix-server[917798]: puppet completed status:(0): '' Nov 3 03:36:05 kjcf05n00 zabbix-server[917798]: Event '45714' acknowledged Nov 3 03:36:05 kjcf05n00 zabbix-server[917798]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n03"}' Nov 3 03:36:19 kjcf05n00 mcfcli[3673891]: %3|1730626579.010|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 03:36:34 kjcf05n00 mcfcli[3673891]: %3|1730626594.014|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:36:49 kjcf05n00 mcfcli[3673891]: %3|1730626609.511|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 03:37:12 kjcf05n00 mcfcli[3673891]: %3|1730626632.181|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:37:19 kjcf05n00 mcfcli[3673891]: %3|1730626639.511|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 03:37:45 kjcf05n00 zabbix-server[918794]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 03:37:45 kjcf05n00 zabbix-server[918794]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 110.54\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 125.2\\"}}"' Nov 3 03:37:46 kjcf05n00 log_interesting_event.py[918794]: Event '45716' acknowledged Nov 3 03:37:49 kjcf05n00 mcfcli[3673891]: %3|1730626669.943|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 03:37:51 kjcf05n00 mcfcli[3673891]: %3|1730626671.782|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:38:19 kjcf05n00 mcfcli[3673891]: %3|1730626699.943|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:38:29 kjcf05n00 mcfcli[3673891]: %3|1730626709.208|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:38:49 kjcf05n00 mcfcli[3673891]: %3|1730626729.943|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 03:38:53 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/21', errno='Permission denied (13)' Nov 3 03:39:07 kjcf05n00 mcfcli[3673891]: %3|1730626747.056|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:39:19 kjcf05n00 mcfcli[3673891]: %3|1730626759.944|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 03:39:45 kjcf05n00 mcfcli[3673891]: %3|1730626785.921|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:39:50 kjcf05n00 mcfcli[3673891]: %3|1730626790.013|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 03:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 03:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 03:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 03:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 03:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 03:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 03:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 03:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 03:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 03:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 03:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 03:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 03:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 03:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 03:40:01 kjcf05n00 python3.9[920030]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 03:40:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 03:40:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:40:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 03:40:20 kjcf05n00 mcfcli[3673891]: %3|1730626820.013|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:40:21 kjcf05n00 mcfcli[3673891]: %3|1730626821.683|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:40:50 kjcf05n00 mcfcli[3673891]: %3|1730626850.013|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 03:40:57 kjcf05n02 nslcd[6978]: [45e146] ldap_result() failed: Can't contact LDAP server Nov 3 03:40:59 kjcf05n00 mcfcli[3673891]: %3|1730626859.885|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:41:09 kjcf05n03 root[41417]: failback_xyraid Nov 3 03:41:11 kjcf05n03 root[41529]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 03:41:12 kjcf05n03 root[41603]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 03:41:16 kjcf05n02 systemd[1]: data-kjcf05n03:md66.mount: Succeeded. Nov 3 03:41:20 kjcf05n00 mcfcli[3673891]: %3|1730626880.015|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 03:41:26 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme21n1 Nov 3 03:41:26 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme6n1 Nov 3 03:41:26 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme20n1 Nov 3 03:41:26 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme10n1 Nov 3 03:41:26 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme11n1 Nov 3 03:41:26 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme16n1 Nov 3 03:41:26 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme15n1 Nov 3 03:41:26 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme12n1 Nov 3 03:41:26 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme22n1 Nov 3 03:41:26 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme7n1 Nov 3 03:41:26 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme5n1 Nov 3 03:41:28 kjcf05n03 dwd[5206]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 03:41:28 kjcf05n03 dwd[5206]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 03:41:28 kjcf05n03 dwd[5206]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 03:41:28 kjcf05n03 dwd[5206]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 03:41:28 kjcf05n03 dwd[5206]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 03:41:28 kjcf05n03 dwd[5206]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 03:41:28 kjcf05n03 dwd[5206]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 03:41:28 kjcf05n03 dwd[5206]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 03:41:28 kjcf05n03 dwd[5206]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 03:41:28 kjcf05n03 dwd[5206]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 03:41:28 kjcf05n03 dwd[5206]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 03:41:29 kjcf05n03 dwd[5206]: Starting NVME thread for nvme10n1 Nov 3 03:41:29 kjcf05n03 dwd[5206]: Starting NVME thread for nvme15n1 Nov 3 03:41:29 kjcf05n03 dwd[5206]: Starting NVME thread for nvme21n1 Nov 3 03:41:29 kjcf05n03 dwd[5206]: Starting NVME thread for nvme11n1 Nov 3 03:41:29 kjcf05n03 dwd[5206]: Starting NVME thread for nvme20n1 Nov 3 03:41:30 kjcf05n03 dwd[5206]: Starting NVME thread for nvme12n1 Nov 3 03:41:30 kjcf05n03 systemd-udevd[44898]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44897]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44901]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44900]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44897]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44898]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44901]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44900]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44897]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44898]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44901]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44900]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44897]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44901]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44898]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44900]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44897]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44898]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44901]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44900]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44897]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44898]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44901]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44900]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44897]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44898]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44901]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44900]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44897]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44901]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44898]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44897]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44935]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44938]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44939]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44941]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44935]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44938]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44939]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44941]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44935]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44934]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44935]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44941]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44935]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44934]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44935]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44934]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44935]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44934]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44935]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44934]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44935]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44934]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44935]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44935]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44934]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44935]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44934]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44935]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44934]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44935]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44935]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 systemd-udevd[44935]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:41:30 kjcf05n03 dcs-bulk-data-sender[6212]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 141}' Nov 3 03:41:30 kjcf05n03 nslcd[6956]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 03:41:30 kjcf05n03 dwd[5206]: Starting NVME thread for nvme7n1 Nov 3 03:41:30 kjcf05n03 dwd[5206]: Starting NVME thread for nvme6n1 Nov 3 03:41:30 kjcf05n03 dwd[5206]: Starting NVME thread for nvme5n1 Nov 3 03:41:30 kjcf05n03 dwd[5206]: Starting NVME thread for nvme16n1 Nov 3 03:41:30 kjcf05n03 dwd[5206]: Starting NVME thread for nvme22n1 Nov 3 03:41:35 kjcf05n03 diskmonitor[17409]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 03:41:38 kjcf05n00 mcfcli[3673891]: %3|1730626898.554|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:41:42 kjcf05n03 diskmonitor[17409]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 03:41:42 kjcf05n03 diskmonitor[17409]: Scan for ReadErrorMax change for md66 Nov 3 03:41:42 kjcf05n03 diskmonitor[17409]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 03:41:42 kjcf05n03 diskmonitor[17409]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 03:41:42 kjcf05n03 diskmonitor[17409]: read_saved_file: md66 no saved speed Nov 3 03:41:42 kjcf05n03 diskmonitor[17409]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 03:41:42 kjcf05n03 diskmonitor[17409]: Set sync_speed_min (10000) for md66 Nov 3 03:41:42 kjcf05n03 diskmonitor[17409]: Set sync_speed_max (200000) for md66 Nov 3 03:41:42 kjcf05n03 diskmonitor[17409]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 03:41:50 kjcf05n00 mcfcli[3673891]: %3|1730626910.015|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 03:42:13 kjcf05n02 diskmonitor[17478]: Removed MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 03:42:13 kjcf05n02 diskmonitor[17478]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 03:42:17 kjcf05n03 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 03:42:17 kjcf05n03 systemd-tmpfiles[47371]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 03:42:17 kjcf05n03 systemd-tmpfiles[47371]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 03:42:17 kjcf05n03 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 03:42:17 kjcf05n03 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 03:42:18 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47537 (bash) Nov 3 03:42:18 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 03:42:18 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 03:42:18 kjcf05n00 mcfcli[3673891]: %3|1730626938.551|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:42:20 kjcf05n00 mcfcli[3673891]: %3|1730626940.016|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 03:42:50 kjcf05n00 mcfcli[3673891]: %3|1730626970.017|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 03:42:56 kjcf05n00 mcfcli[3673891]: %3|1730626976.743|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:43:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730626986}"] Nov 3 03:43:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730626986, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:43:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.435591ms Nov 3 03:43:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.435591ms Nov 3 03:43:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:03:43:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 03:43:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:43:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730626986}"] Nov 3 03:43:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730626986, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:43:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.566357ms Nov 3 03:43:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.566357ms Nov 3 03:43:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:03:43:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 03:43:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:43:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730626986}"] Nov 3 03:43:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730626986, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:43:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.099672ms Nov 3 03:43:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.099672ms Nov 3 03:43:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:03:43:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 03:43:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:43:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730626986}"] Nov 3 03:43:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730626986, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:43:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.750208ms Nov 3 03:43:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.750208ms Nov 3 03:43:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:03:43:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 03:43:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:43:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730626986}"] Nov 3 03:43:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730626986, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:43:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.219346ms Nov 3 03:43:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.219346ms Nov 3 03:43:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:03:43:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 03:43:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:43:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730626986}"] Nov 3 03:43:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730626986, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:43:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.488932ms Nov 3 03:43:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.488932ms Nov 3 03:43:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:03:43:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 03:43:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:43:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730626986}"] Nov 3 03:43:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730626986, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:43:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.518276ms Nov 3 03:43:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.518276ms Nov 3 03:43:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:03:43:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 03:43:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:43:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730626987}"] Nov 3 03:43:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730626987, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:43:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.906861ms Nov 3 03:43:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.906861ms Nov 3 03:43:08 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:03:43:08 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 03:43:08 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:43:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730626987}"] Nov 3 03:43:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730626987, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:43:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.037637ms Nov 3 03:43:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.037637ms Nov 3 03:43:08 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:03:43:08 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 03:43:08 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:43:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730626987}"] Nov 3 03:43:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730626987, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:43:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.816151ms Nov 3 03:43:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.816151ms Nov 3 03:43:08 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:03:43:08 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 03:43:08 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:43:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730626987}"] Nov 3 03:43:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730626987, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 03:43:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 03:43:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T03:43:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 03:43:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T03:43:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 03:43:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T03:43:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.801905ms Nov 3 03:43:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T03:43:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.801905ms Nov 3 03:43:08 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:03:43:08 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 03:43:08 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:43:20 kjcf05n00 mcfcli[3673891]: %3|1730627000.018|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T03:43:27.254155963-06:00 level=info msg="Completed cleanup jobs" duration=27.288787ms Nov 3 03:43:30 kjcf05n05 dwd[10696]: md1 read await report (#disks=53, min #ops=5.0e6): mean=27.0, sd=1.1, min=21.9, q1=26.7, q2=27.2, q3=27.6, max=28.4 (dm-56/0x5000c500ae885aaf) Nov 3 03:43:30 kjcf05n05 dwd[10696]: md1 write await report (#disks=53, min #ops=4.1e6): mean=28.1, sd=1.1, min=24.7, q1=27.5, q2=27.9, q3=28.5, max=32.3 (dm-75/0x5000c500ca45bf2b) Nov 3 03:43:35 kjcf05n00 mcfcli[3673891]: %3|1730627015.298|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:43:50 kjcf05n00 mcfcli[3673891]: %3|1730627030.018|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:44:15 kjcf05n00 mcfcli[3673891]: %3|1730627055.295|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:44:20 kjcf05n00 mcfcli[3673891]: %3|1730627060.018|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:44:25 kjcf05n04 dwd[10437]: md0 read await report (#disks=53, min #ops=5.1e6): mean=27.0, sd=1.0, min=23.5, q1=26.4, q2=27.2, q3=27.7, max=28.6 (dm-28/0x5000c500c9ad6f9b) Nov 3 03:44:25 kjcf05n04 dwd[10437]: md0 write await report (#disks=53, min #ops=4.1e6): mean=28.7, sd=0.8, min=27.0, q1=28.3, q2=28.7, q3=29.2, max=31.6 (dm-73/0x5000c500c9a5777b) Nov 3 03:44:43 kjcf05n06 dwd[5504]: md128 write await report (#disks=12, min #ops=2.2e5): mean=0.0, sd=0.0, min=0.0, q1=0.0, q2=0.0, q3=0.0, max=0.0 (nvme23n1p1/eui.345950304e3005880025384500000003) Nov 3 03:44:43 kjcf05n06 dwd[5504]: md0 read await report (#disks=12, min #ops=3.7e7): mean=0.3, sd=0.0, min=0.3, q1=0.3, q2=0.3, q3=0.3, max=0.3 (nvme4n1p3/eui.345950304e3006210025384500000003) Nov 3 03:44:43 kjcf05n06 dwd[5504]: md0 write await report (#disks=12, min #ops=5.0e7): mean=0.4, sd=0.0, min=0.4, q1=0.4, q2=0.4, q3=0.4, max=0.4 (nvme4n1p3/eui.345950304e3006210025384500000003) Nov 3 03:44:43 kjcf05n06 dwd[5504]: md129 write await report (#disks=12, min #ops=2.6e5): mean=0.1, sd=0.0, min=0.1, q1=0.1, q2=0.1, q3=0.1, max=0.1 (nvme23n1p2/eui.345950304e3005880025384500000003) Nov 3 03:44:45 kjcf05n00 zabbix-server[922975]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 03:44:45 kjcf05n00 zabbix-server[922975]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 120.03\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 108.16\\"}}"' Nov 3 03:44:45 kjcf05n00 log_interesting_event.py[922975]: Event '45718' acknowledged Nov 3 03:44:50 kjcf05n00 mcfcli[3673891]: %3|1730627090.019|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:44:54 kjcf05n00 zabbix-server[923048]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 03:44:54 kjcf05n00 zabbix-server[923048]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n03' from event '45719' Nov 3 03:44:54 kjcf05n00 zabbix-server[923048]: Filesystem 'kjcf05' has been mounted Nov 3 03:44:55 kjcf05n00 mcfcli[3673891]: %3|1730627095.293|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:44:55 kjcf05n00 zabbix-server[923048]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 03:44:55 kjcf05n00 zabbix-server[923048]: Running puppet on 'None' Nov 3 03:44:57 kjcf05n03 puppet-agent[51810]: Using configured environment 'production' Nov 3 03:44:57 kjcf05n03 puppet-agent[51810]: Retrieving pluginfacts Nov 3 03:44:57 kjcf05n03 puppet-agent[51810]: Retrieving plugin Nov 3 03:44:57 kjcf05n03 puppet-agent[51810]: Loading facts Nov 3 03:44:57 kjcf05n02 puppet-agent[170901]: Using configured environment 'production' Nov 3 03:44:57 kjcf05n02 puppet-agent[170901]: Retrieving pluginfacts Nov 3 03:44:57 kjcf05n02 puppet-agent[170901]: Retrieving plugin Nov 3 03:44:57 kjcf05n05 puppet-agent[2325188]: Using configured environment 'production' Nov 3 03:44:57 kjcf05n05 puppet-agent[2325188]: Retrieving pluginfacts Nov 3 03:44:57 kjcf05n05 puppet-agent[2325188]: Retrieving plugin Nov 3 03:44:57 kjcf05n05 puppet-agent[2325188]: Loading facts Nov 3 03:44:57 kjcf05n06 puppet-agent[2190970]: Using configured environment 'production' Nov 3 03:44:57 kjcf05n06 puppet-agent[2190970]: Retrieving pluginfacts Nov 3 03:44:57 kjcf05n06 puppet-agent[2190970]: Retrieving plugin Nov 3 03:44:57 kjcf05n06 puppet-agent[2190970]: Loading facts Nov 3 03:44:57 kjcf05n04 puppet-agent[2187971]: Using configured environment 'production' Nov 3 03:44:57 kjcf05n04 puppet-agent[2187971]: Retrieving pluginfacts Nov 3 03:44:57 kjcf05n04 puppet-agent[2187971]: Retrieving plugin Nov 3 03:44:57 kjcf05n04 puppet-agent[2187971]: Loading facts Nov 3 03:44:57 kjcf05n07 puppet-agent[2186150]: Using configured environment 'production' Nov 3 03:44:57 kjcf05n07 puppet-agent[2186150]: Retrieving pluginfacts Nov 3 03:44:57 kjcf05n07 puppet-agent[2186150]: Retrieving plugin Nov 3 03:44:57 kjcf05n07 puppet-agent[2186150]: Loading facts Nov 3 03:44:57 kjcf05n01 puppet-agent[2875795]: Using configured environment 'production' Nov 3 03:44:57 kjcf05n01 puppet-agent[2875795]: Retrieving pluginfacts Nov 3 03:44:57 kjcf05n01 puppet-agent[2875795]: Retrieving plugin Nov 3 03:44:57 kjcf05n01 puppet-agent[2875795]: Loading facts Nov 3 03:44:57 kjcf05n02 puppet-agent[170901]: Loading facts Nov 3 03:44:57 kjcf05n00 puppet-agent[923121]: Using configured environment 'production' Nov 3 03:44:57 kjcf05n00 puppet-agent[923121]: Retrieving pluginfacts Nov 3 03:44:57 kjcf05n00 puppet-agent[923121]: Retrieving plugin Nov 3 03:44:58 kjcf05n00 puppet-agent[923121]: Loading facts Nov 3 03:45:00 kjcf05n03 puppet-agent[51810]: Caching catalog for kjcf05n03 Nov 3 03:45:00 kjcf05n03 puppet-agent[51810]: Applying configuration version '1730627098' Nov 3 03:45:00 kjcf05n06 puppet-agent[2190970]: Caching catalog for kjcf05n06 Nov 3 03:45:00 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 03:45:00 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 03:45:00 kjcf05n02 puppet-agent[170901]: Caching catalog for kjcf05n02 Nov 3 03:45:00 kjcf05n02 puppet-agent[170901]: Applying configuration version '1730627098' Nov 3 03:45:00 kjcf05n06 puppet-agent[2190970]: Applying configuration version '1730627099' Nov 3 03:45:01 kjcf05n07 puppet-agent[2186150]: Caching catalog for kjcf05n07 Nov 3 03:45:01 kjcf05n07 puppet-agent[2186150]: Applying configuration version '1730627099' Nov 3 03:45:01 kjcf05n01 puppet-agent[2875795]: Caching catalog for kjcf05n01 Nov 3 03:45:02 kjcf05n01 puppet-agent[2875795]: Applying configuration version '1730627099' Nov 3 03:45:01 kjcf05n00 puppet-agent[923121]: Caching catalog for kjcf05n00 Nov 3 03:45:02 kjcf05n00 puppet-agent[923121]: Applying configuration version '1730627100' Nov 3 03:45:02 kjcf05n03 puppet-agent[51810]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 03:45:02 kjcf05n03 puppet-agent[51810]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 03:45:02 kjcf05n03 puppet-agent[51810]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 03:45:02 kjcf05n02 puppet-agent[170901]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 03:45:02 kjcf05n02 puppet-agent[170901]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 03:45:02 kjcf05n02 puppet-agent[170901]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 03:45:02 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 03:45:02 kjcf05n03 zabbix_agent2[33772]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 03:45:02 kjcf05n03 zabbix_agent2[3202]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:45:02 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 03:45:02 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 03:45:02 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 03:45:02 kjcf05n03 puppet-agent[51810]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: Press Ctrl+C to exit. Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: Plugin support version 1.0 Nov 3 03:45:02 kjcf05n03 zabbix_agent2[52250]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 03:45:02 kjcf05n06 puppet-agent[2190970]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 03:45:02 kjcf05n06 puppet-agent[2190970]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 03:45:02 kjcf05n06 puppet-agent[2190970]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 03:45:03 kjcf05n07 puppet-agent[2186150]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 03:45:03 kjcf05n07 puppet-agent[2186150]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 03:45:03 kjcf05n07 puppet-agent[2186150]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 03:45:03 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 03:45:03 kjcf05n02 zabbix_agent2[113072]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 03:45:03 kjcf05n02 zabbix_agent2[3218]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 03:45:03 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 03:45:03 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 03:45:03 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 03:45:03 kjcf05n02 puppet-agent[170901]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: Press Ctrl+C to exit. Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: Plugin support version 1.0 Nov 3 03:45:03 kjcf05n02 zabbix_agent2[171379]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 03:45:03 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2138819]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 03:45:03 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 03:45:03 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 03:45:03 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 03:45:03 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 03:45:03 kjcf05n06 puppet-agent[2190970]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: Press Ctrl+C to exit. Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: Plugin support version 1.0 Nov 3 03:45:03 kjcf05n06 zabbix_agent2[2191394]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 03:45:04 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2134477]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 03:45:04 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 03:45:04 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 03:45:04 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 03:45:04 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 03:45:04 kjcf05n07 puppet-agent[2186150]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: Press Ctrl+C to exit. Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: Plugin support version 1.0 Nov 3 03:45:04 kjcf05n07 zabbix_agent2[2187070]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 03:45:05 kjcf05n01 puppet-agent[2875795]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 03:45:05 kjcf05n01 puppet-agent[2875795]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-03:23:16]/mode) mode changed '0755' to '0750' Nov 3 03:45:05 kjcf05n01 puppet-agent[2875795]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-03:23:16/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 03:45:05 kjcf05n01 puppet-agent[2875795]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-03:23:16/vmcore]/mode) mode changed '0600' to '0640' Nov 3 03:45:05 kjcf05n01 puppet-agent[2875795]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-03:23:16/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 03:45:05 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 03:45:05 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 03:45:05 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 03:45:05 kjcf05n03 puppet-agent[51810]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 03:45:05 kjcf05n03 puppet-agent[51810]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 03:45:05 kjcf05n03 puppet-agent[51810]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 03:45:04 kjcf05n00 puppet-agent[923121]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 03:45:05 kjcf05n06 puppet-agent[2190970]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 03:45:05 kjcf05n06 puppet-agent[2190970]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 03:45:05 kjcf05n06 puppet-agent[2190970]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 03:45:05 kjcf05n06 puppet-agent[2190970]: Applied catalog in 4.76 seconds Nov 3 03:45:05 kjcf05n02 puppet-agent[170901]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 03:45:05 kjcf05n02 puppet-agent[170901]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 03:45:05 kjcf05n02 puppet-agent[170901]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 03:45:05 kjcf05n03 puppet-agent[51810]: Applied catalog in 5.13 seconds Nov 3 03:45:05 kjcf05n01 puppet-agent[2875795]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 03:45:05 kjcf05n01 puppet-agent[2875795]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 03:45:05 kjcf05n01 puppet-agent[2875795]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 03:45:05 kjcf05n07 puppet-agent[2186150]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 03:45:05 kjcf05n07 puppet-agent[2186150]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 03:45:05 kjcf05n07 puppet-agent[2186150]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 03:45:05 kjcf05n02 puppet-agent[170901]: Applied catalog in 5.10 seconds Nov 3 03:45:05 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 03:45:05 kjcf05n00 puppet-agent[923121]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 03:45:05 kjcf05n00 puppet-agent[923121]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 03:45:05 kjcf05n00 puppet-agent[923121]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 03:45:06 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2864102]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 03:45:06 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 03:45:06 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 03:45:06 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 03:45:06 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 03:45:06 kjcf05n01 puppet-agent[2875795]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: Press Ctrl+C to exit. Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: Plugin support version 1.0 Nov 3 03:45:06 kjcf05n01 zabbix_agent2[2876157]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 03:45:06 kjcf05n07 puppet-agent[2186150]: Applied catalog in 4.91 seconds Nov 3 03:45:06 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 03:45:06 kjcf05n00 zabbix_agent2[905220]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 03:45:06 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 03:45:06 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 03:45:06 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 03:45:06 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 03:45:06 kjcf05n00 puppet-agent[923121]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: Press Ctrl+C to exit. Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: Plugin support version 1.0 Nov 3 03:45:06 kjcf05n00 zabbix_agent2[923762]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 03:45:06 kjcf05n00 zabbix-server[923792]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 03:45:07 kjcf05n00 python3.9[923052]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 03:45:07 kjcf05n00 zabbix-server[923841]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 03:45:07 kjcf05n00 zabbix-server[923864]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 03:45:08 kjcf05n00 zabbix-server[923878]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 03:45:08 kjcf05n01 puppet-agent[2875795]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_033035.log]/mode) mode changed '0644' to '0640' Nov 3 03:45:08 kjcf05n01 puppet-agent[2875795]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_034218.log]/mode) mode changed '0644' to '0640' Nov 3 03:45:08 kjcf05n00 puppet-agent[923121]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 03:45:09 kjcf05n01 puppet-agent[2875795]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_033035.log]/mode) mode changed '0644' to '0640' Nov 3 03:45:09 kjcf05n01 puppet-agent[2875795]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_034218.log]/mode) mode changed '0644' to '0640' Nov 3 03:45:09 kjcf05n01 puppet-agent[2875795]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_034219]/mode) mode changed '0755' to '0750' Nov 3 03:45:09 kjcf05n01 puppet-agent[2875795]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_034219/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 03:45:09 kjcf05n01 puppet-agent[2875795]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 03:45:09 kjcf05n01 puppet-agent[2875795]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 03:45:09 kjcf05n01 puppet-agent[2875795]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 03:45:09 kjcf05n00 puppet-agent[923121]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 03:45:09 kjcf05n00 puppet-agent[923121]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 03:45:09 kjcf05n00 puppet-agent[923121]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 03:45:10 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 03:45:10 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 03:45:10 kjcf05n01 puppet-agent[2875795]: Applied catalog in 8.68 seconds Nov 3 03:45:10 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 03:45:10 kjcf05n00 puppet-agent[923121]: Applied catalog in 8.52 seconds Nov 3 03:45:12 kjcf05n07 dwd[5489]: md130 write await report (#disks=12, min #ops=2.0e5): mean=0.0, sd=0.0, min=0.0, q1=0.0, q2=0.0, q3=0.0, max=0.0 (nvme13n1p1/eui.345950304e3006020025384500000003) Nov 3 03:45:12 kjcf05n07 dwd[5489]: md1 read await report (#disks=12, min #ops=3.7e7): mean=0.3, sd=0.0, min=0.3, q1=0.3, q2=0.3, q3=0.3, max=0.3 (nvme7n1p3/eui.345950304e3006150025384500000003) Nov 3 03:45:12 kjcf05n07 dwd[5489]: md1 write await report (#disks=12, min #ops=5.0e7): mean=0.4, sd=0.0, min=0.4, q1=0.4, q2=0.4, q3=0.4, max=0.4 (nvme7n1p3/eui.345950304e3006150025384500000003) Nov 3 03:45:12 kjcf05n07 dwd[5489]: md131 write await report (#disks=12, min #ops=2.5e5): mean=0.1, sd=0.0, min=0.1, q1=0.1, q2=0.1, q3=0.1, max=0.1 (nvme5n1p2/eui.345950304e3006240025384500000003) Nov 3 03:45:13 kjcf05n05 puppet-agent[2325188]: Caching catalog for kjcf05n05 Nov 3 03:45:13 kjcf05n05 puppet-agent[2325188]: Applying configuration version '1730627109' Nov 3 03:45:15 kjcf05n05 puppet-agent[2325188]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 03:45:15 kjcf05n05 puppet-agent[2325188]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 03:45:15 kjcf05n05 puppet-agent[2325188]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 03:45:16 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2278385]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 03:45:16 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 03:45:16 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 03:45:16 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 03:45:16 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 03:45:16 kjcf05n05 puppet-agent[2325188]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: Press Ctrl+C to exit. Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: Plugin support version 1.0 Nov 3 03:45:16 kjcf05n05 zabbix_agent2[2326217]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 03:45:18 kjcf05n05 puppet-agent[2325188]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 03:45:18 kjcf05n05 puppet-agent[2325188]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 03:45:18 kjcf05n05 puppet-agent[2325188]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 03:45:18 kjcf05n05 puppet-agent[2325188]: Applied catalog in 5.08 seconds Nov 3 03:45:20 kjcf05n00 mcfcli[3673891]: %3|1730627120.019|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:45:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730627123', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 03:45:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730627123'} Nov 3 03:45:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:45:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730627123', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 03:45:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730627123'} Nov 3 03:45:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:45:35 kjcf05n00 mcfcli[3673891]: %3|1730627135.290|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:45:50 kjcf05n00 mcfcli[3673891]: %3|1730627150.021|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 03:45:51 kjcf05n04 puppet-agent[2187971]: Caching catalog for kjcf05n04 Nov 3 03:45:51 kjcf05n04 puppet-agent[2187971]: Applying configuration version '1730627149' Nov 3 03:45:54 kjcf05n04 puppet-agent[2187971]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 03:45:54 kjcf05n04 puppet-agent[2187971]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 03:45:54 kjcf05n04 puppet-agent[2187971]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 03:45:54 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2143307]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 03:45:54 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 03:45:54 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 03:45:54 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 03:45:54 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 03:45:54 kjcf05n04 puppet-agent[2187971]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: Press Ctrl+C to exit. Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: Plugin support version 1.0 Nov 3 03:45:54 kjcf05n04 zabbix_agent2[2189807]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 03:45:56 kjcf05n04 puppet-agent[2187971]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 03:45:56 kjcf05n04 puppet-agent[2187971]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 03:45:56 kjcf05n04 puppet-agent[2187971]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 03:45:56 kjcf05n04 puppet-agent[2187971]: Applied catalog in 4.83 seconds Nov 3 03:45:56 kjcf05n00 zabbix-server[923048]: puppet completed status:(0): '' Nov 3 03:45:56 kjcf05n00 zabbix-server[923048]: Event '45719' acknowledged Nov 3 03:45:56 kjcf05n00 zabbix-server[923048]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n03"}' Nov 3 03:46:15 kjcf05n00 mcfcli[3673891]: %3|1730627175.287|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:46:20 kjcf05n00 mcfcli[3673891]: %3|1730627180.021|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:46:43 kjcf05n03 dwd[5206]: nvme15n1 passed periodic SMART status check Nov 3 03:46:43 kjcf05n03 dwd[5206]: nvme10n1 passed periodic SMART status check Nov 3 03:46:44 kjcf05n03 dwd[5206]: nvme11n1 passed periodic SMART status check Nov 3 03:46:44 kjcf05n03 dwd[5206]: nvme20n1 passed periodic SMART status check Nov 3 03:46:44 kjcf05n03 dwd[5206]: nvme12n1 passed periodic SMART status check Nov 3 03:46:44 kjcf05n03 dwd[5206]: nvme21n1 passed periodic SMART status check Nov 3 03:46:45 kjcf05n03 dwd[5206]: nvme5n1 passed periodic SMART status check Nov 3 03:46:45 kjcf05n03 dwd[5206]: nvme16n1 passed periodic SMART status check Nov 3 03:46:45 kjcf05n03 dwd[5206]: nvme6n1 passed periodic SMART status check Nov 3 03:46:45 kjcf05n03 dwd[5206]: nvme22n1 passed periodic SMART status check Nov 3 03:46:45 kjcf05n03 dwd[5206]: nvme7n1 passed periodic SMART status check Nov 3 03:46:50 kjcf05n00 mcfcli[3673891]: %3|1730627210.022|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:46:55 kjcf05n00 mcfcli[3673891]: %3|1730627215.093|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:46:58 kjcf05n06 diskmonitor[19372]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 03:47:20 kjcf05n00 mcfcli[3673891]: %3|1730627240.022|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:47:28 kjcf05n04 diskmonitor[39342]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 03:47:34 kjcf05n00 mcfcli[3673891]: %3|1730627254.935|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:47:50 kjcf05n00 mcfcli[3673891]: %3|1730627270.024|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 03:48:13 kjcf05n00 mcfcli[3673891]: %3|1730627293.455|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:48:20 kjcf05n00 mcfcli[3673891]: %3|1730627300.024|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 03:48:50 kjcf05n00 mcfcli[3673891]: %3|1730627330.024|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:48:52 kjcf05n00 mcfcli[3673891]: %3|1730627332.314|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:48:55 kjcf05n07 diskmonitor[19063]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 03:49:20 kjcf05n00 mcfcli[3673891]: %3|1730627360.024|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:49:28 kjcf05n05 diskmonitor[40540]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 03:49:29 kjcf05n00 mcfcli[3673891]: %3|1730627369.116|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:49:48 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/21', errno='Permission denied (13)' Nov 3 03:49:50 kjcf05n00 mcfcli[3673891]: %3|1730627390.025|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 03:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 03:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 03:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 03:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 03:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 03:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 03:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 03:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 03:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 03:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 03:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 03:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 03:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 03:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 03:50:01 kjcf05n00 python3.9[926626]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 03:50:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 03:50:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 03:50:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 03:50:07 kjcf05n00 mcfcli[3673891]: %3|1730627407.432|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:50:20 kjcf05n00 mcfcli[3673891]: %3|1730627420.026|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:50:47 kjcf05n00 mcfcli[3673891]: %3|1730627447.105|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:50:50 kjcf05n00 mcfcli[3673891]: %3|1730627450.026|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 03:50:55 kjcf05n03 chronyd[5174]: Selected source 16.110.135.123 Nov 3 03:51:20 kjcf05n00 mcfcli[3673891]: %3|1730627480.026|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:51:27 kjcf05n00 mcfcli[3673891]: %3|1730627487.102|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:51:50 kjcf05n00 mcfcli[3673891]: %3|1730627510.028|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:52:04 kjcf05n00 mcfcli[3673891]: %3|1730627524.835|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:52:20 kjcf05n00 mcfcli[3673891]: %3|1730627540.028|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 03:52:43 kjcf05n00 mcfcli[3673891]: %3|1730627563.691|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:52:50 kjcf05n00 mcfcli[3673891]: %3|1730627570.029|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 03:53:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 03:53:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 03:53:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 03:53:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 03:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T09:53:15.868450Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 03:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T09:53:15.868511Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.083ms Nov 3 03:53:20 kjcf05n00 mcfcli[3673891]: %3|1730627600.029|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:53:22 kjcf05n00 mcfcli[3673891]: %3|1730627602.718|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:53:24 kjcf05n00 zabbix_server[15720]: Zabbix agent item "proc.num" on host "kjcf05n03" failed: first network error, wait for 15 seconds Nov 3 03:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T03:53:27.256688839-06:00 level=info msg="Completed cleanup jobs" duration=30.275659ms Nov 3 03:53:30 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 03:53:30 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 03:53:30 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 03:53:30 kjcf05n02 fstonithd.py[15134]: My partner 172.16.2.6 is kdumping. Forcing HA into GATHER state. Nov 3 03:53:32 kjcf05n02 root[186192]: is_enc_ipmi_off starts Nov 3 03:53:32 kjcf05n02 root[186194]: is_viking_off starts Nov 3 03:53:32 kjcf05n02 root[186226]: is_lan_ipmi_sec_off leaves Nov 3 03:53:32 kjcf05n02 root[186228]: is_lan_ipmi_off leaves Nov 3 03:53:32 kjcf05n02 root[186236]: I am master Nov 3 03:53:32 kjcf05n02 root[186237]: I am in slot 0; partner is in slot 1 Nov 3 03:53:33 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='30', error='Connection reset by peer (104)' Nov 3 03:53:33 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='30', client='AF_INET(172.16.2.6:41471)', local='AF_INET(0.0.0.0:601)' Nov 3 03:53:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 03:53:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 03:53:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 03:53:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 03:53:39 kjcf05n00 zabbix_server[15765]: Zabbix agent item "system.cpu.util[,softirq]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 03:53:40 kjcf05n00 zabbix_server[15737]: Zabbix agent item "system.cpu.util[,steal]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 03:53:41 kjcf05n00 zabbix_server[15753]: Zabbix agent item "system.cpu.util[,system]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 03:53:42 kjcf05n00 zabbix_server[15736]: Zabbix agent item "system.cpu.util[,user]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 03:53:43 kjcf05n02 root[186529]: is_viking_off leaves Nov 3 03:53:43 kjcf05n02 root[186532]: kjcf05n03 not already off look at kdump Nov 3 03:53:43 kjcf05n02 root[186533]: is_kdump_off starts Nov 3 03:53:43 kjcf05n02 fence_kdump[186534]: waiting for message from '172.16.2.6' Nov 3 03:53:43 kjcf05n02 fence_kdump[186534]: received valid message from '172.16.2.6' Nov 3 03:53:43 kjcf05n02 root[186539]: is_kdump_off detected kdump on kjcf05n03 Nov 3 03:53:44 kjcf05n02 root[186542]: kjcf05n03 is kdumping Nov 3 03:53:44 kjcf05n02 root[186660]: is_viking_off starts Nov 3 03:53:44 kjcf05n02 root[186658]: is_enc_ipmi_off starts Nov 3 03:53:44 kjcf05n02 root[186679]: I am master Nov 3 03:53:44 kjcf05n02 root[186681]: is_lan_ipmi_off leaves Nov 3 03:53:44 kjcf05n02 root[186683]: is_lan_ipmi_sec_off leaves Nov 3 03:53:44 kjcf05n02 root[186686]: I am in slot 0; partner is in slot 1 Nov 3 03:53:49 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 03:53:49 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 03:53:50 kjcf05n00 mcfcli[3673891]: %3|1730627630.029|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:53:51 kjcf05n02 root[186840]: is_viking_off leaves Nov 3 03:53:51 kjcf05n02 root[186843]: kjcf05n03 not already off look at kdump Nov 3 03:53:51 kjcf05n02 root[186844]: is_kdump_off starts Nov 3 03:53:51 kjcf05n02 fence_kdump[186845]: waiting for message from '172.16.2.6' Nov 3 03:53:51 kjcf05n02 fence_kdump[186845]: received valid message from '172.16.2.6' Nov 3 03:53:52 kjcf05n02 root[186846]: is_kdump_off detected kdump on kjcf05n03 Nov 3 03:53:52 kjcf05n02 root[186847]: kjcf05n03 is kdumping Nov 3 03:53:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 03:53:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 03:53:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 03:53:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 03:53:56 kjcf05n02 dwd[5220]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 03:53:56 kjcf05n02 dwd[5220]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 03:53:56 kjcf05n02 dwd[5220]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 03:53:56 kjcf05n02 dwd[5220]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 03:53:56 kjcf05n02 dwd[5220]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 03:53:56 kjcf05n02 dwd[5220]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 03:53:56 kjcf05n02 dwd[5220]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 03:53:56 kjcf05n02 dwd[5220]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 03:53:56 kjcf05n02 dwd[5220]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 03:53:56 kjcf05n02 dwd[5220]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 03:53:56 kjcf05n02 dwd[5220]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 03:53:56 kjcf05n02 diskmonitor[17478]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 03:53:56 kjcf05n02 dwd[5220]: Starting NVME thread for nvme10n1 Nov 3 03:53:57 kjcf05n02 dwd[5220]: Starting NVME thread for nvme22n1 Nov 3 03:53:57 kjcf05n02 dwd[5220]: Starting NVME thread for nvme12n1 Nov 3 03:53:57 kjcf05n02 dwd[5220]: Starting NVME thread for nvme5n1 Nov 3 03:53:57 kjcf05n02 dwd[5220]: Starting NVME thread for nvme20n1 Nov 3 03:53:57 kjcf05n02 dwd[5220]: Starting NVME thread for nvme16n1 Nov 3 03:53:57 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vfs.fs.inode[/var/lib/mdraidscripts,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 03:53:58 kjcf05n02 dwd[5220]: Starting NVME thread for nvme21n1 Nov 3 03:53:58 kjcf05n02 dwd[5220]: Starting NVME thread for nvme7n1 Nov 3 03:53:58 kjcf05n02 dwd[5220]: Starting NVME thread for nvme15n1 Nov 3 03:53:58 kjcf05n02 dwd[5220]: Starting NVME thread for nvme6n1 Nov 3 03:53:58 kjcf05n02 dwd[5220]: Starting NVME thread for nvme11n1 Nov 3 03:53:59 kjcf05n02 systemd-udevd[189430]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189433]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189434]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189430]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189433]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189430]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189434]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189433]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189430]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189434]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189430]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189433]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189434]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189433]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189434]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189430]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189434]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189433]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189430]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189433]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189434]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189430]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189434]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189430]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189468]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189471]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189472]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189473]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189467]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189472]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189473]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189471]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189467]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189472]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189468]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189467]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189468]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189467]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189472]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189467]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189472]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189467]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189472]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189467]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189467]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189472]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189467]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189472]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189467]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189467]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189472]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189467]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189472]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189467]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189467]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n02 systemd-udevd[189467]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 03:53:59 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 03:53:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 03:54:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 03:54:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 03:54:02 kjcf05n00 mcfcli[3673891]: %3|1730627642.348|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:54:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 03:54:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 03:54:07 kjcf05n02 diskmonitor[17478]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 03:54:07 kjcf05n02 diskmonitor[17478]: Scan for ReadErrorMax change for md66 Nov 3 03:54:07 kjcf05n02 diskmonitor[17478]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 03:54:07 kjcf05n02 diskmonitor[17478]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 03:54:07 kjcf05n02 diskmonitor[17478]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.min.76c05c063fa0949b68ee86c1978c2ca8 file Nov 3 03:54:07 kjcf05n02 diskmonitor[17478]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.max.76c05c063fa0949b68ee86c1978c2ca8 file Nov 3 03:54:07 kjcf05n02 diskmonitor[17478]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 03:54:07 kjcf05n02 diskmonitor[17478]: Set sync_speed_min (10000) for md66 Nov 3 03:54:07 kjcf05n02 diskmonitor[17478]: Set sync_speed_max (200000) for md66 Nov 3 03:54:07 kjcf05n02 diskmonitor[17478]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 03:54:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 03:54:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 03:54:12 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n03": interface unavailable Nov 3 03:54:20 kjcf05n00 mcfcli[3673891]: %3|1730627660.031|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:54:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 03:54:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 03:54:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 03:54:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 03:54:40 kjcf05n00 mcfcli[3673891]: %3|1730627680.781|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:54:50 kjcf05n00 mcfcli[3673891]: %3|1730627690.032|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 03:54:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 03:54:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 03:54:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 03:54:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 03:54:59 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 03:54:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 03:55:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 03:55:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 03:55:00 kjcf05n02 nslcd[6978]: ldap_result() failed: Can't contact LDAP server Nov 3 03:55:01 kjcf05n00 python3.9[929653]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 03:55:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 03:55:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 03:55:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 03:55:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 03:55:16 kjcf05n00 mcfcli[3673891]: %3|1730627716.938|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:55:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730627717', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 03:55:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730627717'} Nov 3 03:55:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:55:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730627717', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 03:55:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730627717'} Nov 3 03:55:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 03:55:20 kjcf05n00 mcfcli[3673891]: %3|1730627720.032|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 03:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 03:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 03:55:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 03:55:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 03:55:50 kjcf05n00 mcfcli[3673891]: %3|1730627750.032|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 03:55:55 kjcf05n00 mcfcli[3673891]: %3|1730627755.150|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 03:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 03:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 03:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 03:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 03:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 03:55:59 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 03:55:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 03:56:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 03:56:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 03:56:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 03:56:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 03:56:20 kjcf05n00 mcfcli[3673891]: %3|1730627780.033|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 03:56:32 kjcf05n00 mcfcli[3673891]: %3|1730627792.842|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:56:32 kjcf05n00 zabbix-server[930957]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 03:56:32 kjcf05n00 zabbix-server[930957]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n03:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 03:56:32 kjcf05n00 log_interesting_event.py[930957]: Event '45721' acknowledged Nov 3 03:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 03:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 03:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 03:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 03:56:50 kjcf05n00 mcfcli[3673891]: %3|1730627810.033|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 03:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 03:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 03:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 03:57:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 03:57:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 03:57:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 03:57:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 03:57:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 03:57:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 03:57:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 03:57:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 03:57:11 kjcf05n00 mcfcli[3673891]: %3|1730627831.979|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:57:19 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:9a:1a Nov 3 03:57:19 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 03:57:20 kjcf05n00 mcfcli[3673891]: %3|1730627840.034|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 03:57:23 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 03:57:23 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a kjcf05n03 Nov 3 03:57:23 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.6 Nov 3 03:57:23 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 03:57:23 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 03:57:23 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.6 Nov 3 03:57:23 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/pxelinux.cfg to 172.16.2.6 Nov 3 03:57:26 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/vmlinuz_diskless to 172.16.2.6 Nov 3 03:57:29 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/initramfs-diskless.img to 172.16.2.6 Nov 3 03:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 03:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 03:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 03:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 03:57:50 kjcf05n00 mcfcli[3673891]: %3|1730627870.035|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 03:57:50 kjcf05n00 mcfcli[3673891]: %3|1730627870.828|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 03:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 03:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 03:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 03:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 03:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 03:58:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 03:58:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 03:58:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 03:58:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 03:58:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 03:58:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 03:58:16 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:56596). Nov 3 03:58:16 kjcf05n01 rsyncd[2881596]: connect from kjcf05n03 (172.16.2.6) Nov 3 03:58:16 kjcf05n01 rsyncd[2881596]: rsync on puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 03:58:16 kjcf05n01 rsyncd[2881596]: building file list Nov 3 03:58:16 kjcf05n01 rsyncd[2881596]: sent 11446 bytes received 136 bytes total size 10901 Nov 3 03:58:16 kjcf05n01 systemd[1]: rsyncd@593-172.16.2.2:873-172.16.2.6:56596.service: Succeeded. Nov 3 03:58:20 kjcf05n00 mcfcli[3673891]: %3|1730627900.035|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 03:58:28 kjcf05n00 mcfcli[3673891]: %3|1730627908.289|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:58:30 kjcf05n02 fstonithd.py[15134]: Listening for kdump packets from partner Nov 3 03:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 03:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 03:58:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 03:58:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 03:58:50 kjcf05n00 mcfcli[3673891]: %3|1730627930.035|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 03:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 03:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 03:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 03:58:56 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 03:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 03:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 03:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 03:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 03:59:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 03:59:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 03:59:08 kjcf05n00 mcfcli[3673891]: %3|1730627948.286|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:59:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 03:59:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 03:59:20 kjcf05n00 mcfcli[3673891]: %3|1730627960.036|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 03:59:20 kjcf05n02 dwd[5220]: nvme5n1 passed periodic SMART status check Nov 3 03:59:20 kjcf05n02 dwd[5220]: nvme11n1 passed periodic SMART status check Nov 3 03:59:20 kjcf05n02 dwd[5220]: nvme6n1 passed periodic SMART status check Nov 3 03:59:20 kjcf05n02 dwd[5220]: nvme10n1 passed periodic SMART status check Nov 3 03:59:20 kjcf05n02 dwd[5220]: nvme16n1 passed periodic SMART status check Nov 3 03:59:20 kjcf05n02 dwd[5220]: nvme20n1 passed periodic SMART status check Nov 3 03:59:20 kjcf05n02 dwd[5220]: nvme12n1 passed periodic SMART status check Nov 3 03:59:20 kjcf05n02 dwd[5220]: nvme7n1 passed periodic SMART status check Nov 3 03:59:20 kjcf05n02 dwd[5220]: nvme15n1 passed periodic SMART status check Nov 3 03:59:20 kjcf05n02 dwd[5220]: nvme22n1 passed periodic SMART status check Nov 3 03:59:20 kjcf05n02 dwd[5220]: nvme21n1 passed periodic SMART status check Nov 3 03:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 03:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 03:59:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 03:59:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 03:59:41 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='107', client='AF_INET(172.16.2.6:35903)', local='AF_INET(0.0.0.0:601)' Nov 3 03:59:41 kjcf05n03 syslog-ng[3111]: Configuration reload request received, reloading configuration; Nov 3 03:59:41 kjcf05n03 syslog-ng[3111]: Configuration reload finished; Nov 3 03:59:41 kjcf05n03 syslog-ng[3111]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 03:59:41 kjcf05n03 dracut: dracut-049-135.git20210121.el8 Nov 3 03:59:41 kjcf05n03 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 03:59:41 kjcf05n03 dracut: Loading and integrity checking all crypto modules Nov 3 03:59:41 kjcf05n03 dracut: Self testing crypto algorithms Nov 3 03:59:41 kjcf05n03 dracut: rd.md=0: removing MD RAID activation Nov 3 03:59:41 kjcf05n03 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 03:59:41 kjcf05n03 Copying live image to RAM... Nov 3 03:59:41 kjcf05n03 (this may take a minute) Nov 3 03:59:41 kjcf05n03 Done copying live image to RAM. Nov 3 03:59:41 kjcf05n03 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 03:59:41 kjcf05n03 dracut: Checking integrity of kernel Nov 3 03:59:41 kjcf05n03 dracut: All initrd crypto checks done Nov 3 03:59:41 kjcf05n03 dracut: Switching root Nov 3 03:59:41 kjcf05n03 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 03:59:41 kjcf05n03 systemd: Detected architecture x86-64. Nov 3 03:59:41 kjcf05n03 systemd: Set hostname to . Nov 3 03:59:41 kjcf05n03 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 03:59:41 kjcf05n03 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 03:59:41 kjcf05n03 systemd: Reached target ZFS pool import target. Nov 3 03:59:41 kjcf05n03 systemd: Reached target rpc_pipefs.target. Nov 3 03:59:41 kjcf05n03 systemd: Listening on RPCbind Server Activation Socket. Nov 3 03:59:41 kjcf05n03 systemd: Listening on initctl Compatibility Named Pipe. Nov 3 03:59:41 kjcf05n03 systemd: Set up automount Arbitrary Executable File Formats File System Automount Point. Nov 3 03:59:41 kjcf05n03 systemd-journald[1521]: Journal started Nov 3 03:59:41 kjcf05n03 systemd-journald[1521]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 03:59:41 kjcf05n03 systemd-modules-load[1512]: Inserted module 'fuse' Nov 3 03:59:41 kjcf05n03 systemd[1]: Mounted Huge Pages File System. Nov 3 03:59:41 kjcf05n03 systemd[1]: Mounted Kernel Debug File System. Nov 3 03:59:41 kjcf05n03 systemd[1]: Mounted /WIBS. Nov 3 03:59:41 kjcf05n03 systemd[1]: Mounted Temporary Directory (/tmp). Nov 3 03:59:41 kjcf05n03 systemd[1]: Mounted /mnt. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Remount Root and Kernel File Systems. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Load/Save Random Seed... Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Rebuild Hardware Database... Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Create System Users... Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Apply Kernel Variables... Nov 3 03:59:41 kjcf05n03 systemd[1]: Mounting Kernel Configuration File System... Nov 3 03:59:41 kjcf05n03 systemd[1]: Mounting FUSE Control File System... Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Load/Save Random Seed. Nov 3 03:59:41 kjcf05n03 systemd[1]: Mounted Kernel Configuration File System. Nov 3 03:59:41 kjcf05n03 systemd[1]: Mounted FUSE Control File System. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Create System Users. Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 03:59:41 kjcf05n03 systemd-sysctl[1542]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 03:59:41 kjcf05n03 systemd-sysctl[1542]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Apply Kernel Variables. Nov 3 03:59:41 kjcf05n03 systemd-journald[1521]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 03:59:41 kjcf05n03 systemd-tmpfiles[1549]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 03:59:41 kjcf05n03 systemd-tmpfiles[1549]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started udev Coldplug all Devices. Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Rebuild Hardware Database. Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting udev Kernel Device Manager... Nov 3 03:59:41 kjcf05n03 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started udev Kernel Device Manager. Nov 3 03:59:41 kjcf05n03 systemd[1]: Found device /dev/ttyS0. Nov 3 03:59:41 kjcf05n03 systemd-udevd[1566]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:59:41 kjcf05n03 systemd-udevd[1614]: Using default interface naming scheme 'rhel-8.0'. Nov 3 03:59:41 kjcf05n03 systemd-udevd[1614]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:59:41 kjcf05n03 systemd-udevd[1627]: Using default interface naming scheme 'rhel-8.0'. Nov 3 03:59:41 kjcf05n03 systemd-udevd[1627]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:59:41 kjcf05n03 systemd-udevd[1616]: Using default interface naming scheme 'rhel-8.0'. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 03:59:41 kjcf05n03 systemd-udevd[1616]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:59:41 kjcf05n03 systemd[1]: Reached target Local File Systems (Pre). Nov 3 03:59:41 kjcf05n03 systemd[1]: Reached target Local File Systems. Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 03:59:41 kjcf05n03 root[1783]: openibd: running in auto mode Nov 3 03:59:41 kjcf05n03 systemd-tmpfiles[1774]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 03:59:41 kjcf05n03 systemd-tmpfiles[1774]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 03:59:41 kjcf05n03 systemd-tmpfiles[1774]: "/var/tmp" already exists and is not a directory. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Create Volatile Files and Directories. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Rebuild Journal Catalog. Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting RPC Bind... Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started RPC Bind. Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 03:59:41 kjcf05n03 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 03:59:41 kjcf05n03 systemd[1]: Started RDMA Node Description Daemon. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 03:59:41 kjcf05n03 systemd-modules-load[1892]: Inserted module 'ib_iser' Nov 3 03:59:41 kjcf05n03 systemd-modules-load[1892]: Inserted module 'ib_isert' Nov 3 03:59:41 kjcf05n03 systemd-modules-load[1892]: Inserted module 'ib_srpt' Nov 3 03:59:41 kjcf05n03 systemd-udevd[1669]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:59:41 kjcf05n03 systemd-udevd[1593]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:59:41 kjcf05n03 systemd-modules-load[1887]: Inserted module 'ib_ipoib' Nov 3 03:59:41 kjcf05n03 systemd-modules-load[1892]: Inserted module 'rdma_ucm' Nov 3 03:59:41 kjcf05n03 systemd-modules-load[1892]: Module 'svcrdma' is blacklisted Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 03:59:41 kjcf05n03 systemd-udevd[1593]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 03:59:41 kjcf05n03 systemd-udevd[1669]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 03:59:41 kjcf05n03 systemd-modules-load[1887]: Inserted module 'ib_umad' Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 03:59:41 kjcf05n03 systemd[1]: Reached target Network (Pre). Nov 3 03:59:41 kjcf05n03 systemd[1]: Reached target RDMA Hardware. Nov 3 03:59:41 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 03:59:41 kjcf05n03 systemd[3111]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:59:41 kjcf05n03 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 03:59:41 kjcf05n03 openibd[1771]: Loading HCA driver and Access Layer:[ OK ] Nov 3 03:59:41 kjcf05n03 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Update is Completed... Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Update is Completed. Nov 3 03:59:41 kjcf05n03 setup-icl[1750]: Setting LAN IP Address to 203.0.113.4 Nov 3 03:59:41 kjcf05n03 setup-icl[1750]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 03:59:41 kjcf05n03 setup-icl[1750]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 03:59:41 kjcf05n03 setup-icl[1750]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 03:59:41 kjcf05n03 systemd-udevd[1669]: Using default interface naming scheme 'rhel-8.0'. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 03:59:41 kjcf05n03 systemd[1]: Reached target System Initialization. Nov 3 03:59:41 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 03:59:41 kjcf05n03 systemd[1]: Listening on lldpad.socket. Nov 3 03:59:41 kjcf05n03 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 03:59:41 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 03:59:41 kjcf05n03 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 03:59:41 kjcf05n03 systemd[1]: Reached target Sockets. Nov 3 03:59:41 kjcf05n03 systemd[1]: Reached target Basic System. Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 03:59:41 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Resets System Activity Logs... Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 03:59:41 kjcf05n03 network[2077]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 03:59:41 kjcf05n03 mlnx_interface_mgr[2080]: Setting up Mellanox network interface: ib1 Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Name Service Cache Daemon... Nov 3 03:59:41 kjcf05n03 systemd[1]: Started irqbalance daemon. Nov 3 03:59:41 kjcf05n03 nscd[2109]: 2109 monitoring file `/etc/hosts` (1) Nov 3 03:59:41 kjcf05n03 nscd[2109]: 2109 monitoring directory `/etc` (2) Nov 3 03:59:41 kjcf05n03 nscd[2109]: 2109 monitoring file `/etc/resolv.conf` (3) Nov 3 03:59:41 kjcf05n03 nscd[2109]: 2109 monitoring directory `/etc` (2) Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 03:59:41 kjcf05n03 network[2096]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 03:59:41 kjcf05n03 network[2077]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 03:59:41 kjcf05n03 chronyd[2145]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 03:59:41 kjcf05n03 dwd[2121]: dwd: vMay 29 2024 : 15:38:26 Nov 3 03:59:41 kjcf05n03 dwd[2121]: /usr/sbin/dwd -d --standalone=0 Nov 3 03:59:41 kjcf05n03 dwd[2121]: dwd: option Lethal: 0 Nov 3 03:59:41 kjcf05n03 dwd[2121]: dwd: option Interval: 60 Nov 3 03:59:41 kjcf05n03 dwd[2121]: dwd: option abrtlimit: 10 Nov 3 03:59:41 kjcf05n03 dwd[2121]: dwd: option DZPeriod: 604800 Nov 3 03:59:41 kjcf05n03 dwd[2121]: dwd: option SmartPeriod: 43200 Nov 3 03:59:41 kjcf05n03 dwd[2121]: dwd: option SDDEnabled: 1 Nov 3 03:59:41 kjcf05n03 dwd[2121]: dwd: option SDDAwaitScale: 3 Nov 3 03:59:41 kjcf05n03 dwd[2121]: dwd: option SDDAwaitMin: 100 Nov 3 03:59:41 kjcf05n03 dwd[2121]: dwd: option Verbosity: 1 Nov 3 03:59:41 kjcf05n03 dwd[2121]: dwd: option StandAlone: 0 Nov 3 03:59:41 kjcf05n03 dwd[2121]: option Lethal: 0 Nov 3 03:59:41 kjcf05n03 dwd[2121]: option Interval: 60 Nov 3 03:59:41 kjcf05n03 dwd[2121]: option abrtlimit: 10 Nov 3 03:59:41 kjcf05n03 dwd[2121]: option DZPeriod: 604800 Nov 3 03:59:41 kjcf05n03 dwd[2121]: option SmartPeriod: 43200 Nov 3 03:59:41 kjcf05n03 dwd[2121]: option SDDEnabled: 1 Nov 3 03:59:41 kjcf05n03 dwd[2121]: option SDDAwaitScale: 3 Nov 3 03:59:41 kjcf05n03 dwd[2121]: option SDDAwaitMin: 100 Nov 3 03:59:41 kjcf05n03 dwd[2121]: option Verbosity: 1 Nov 3 03:59:41 kjcf05n03 dwd[2121]: option StandAlone: 0 Nov 3 03:59:41 kjcf05n03 mcelog[2127]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 03:59:41 kjcf05n03 mcelog[2127]: CPU is unsupported Nov 3 03:59:41 kjcf05n03 network[2125]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 03:59:41 kjcf05n03 network[2077]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 0 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 1 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 2 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 3 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 4 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 5 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 6 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 7 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 8 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 9 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 10 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 11 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 12 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 13 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 14 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 15 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 16 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 17 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 18 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 19 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 20 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 21 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 22 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 23 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 24 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 25 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 26 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 27 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 28 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 29 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 30 Nov 3 03:59:41 kjcf05n03 cpupower[2159]: Setting cpu: 31 Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 03:59:41 kjcf05n03 beSetMlxConfig[2141]: ConnectX-3 multiport not detected Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 03:59:41 kjcf05n03 network[2154]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 03:59:41 kjcf05n03 mlnx_interface_mgr[2156]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 03:59:41 kjcf05n03 systemd[1]: Started D-Bus System Message Bus. Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 03:59:41 kjcf05n03 chronyd[2145]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 03:59:41 kjcf05n03 chronyd[2145]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Resets System Activity Logs. Nov 3 03:59:41 kjcf05n03 mlnx_interface_mgr[2196]: Setting up Mellanox network interface: ib0 Nov 3 03:59:41 kjcf05n03 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 03:59:41 kjcf05n03 mlnx_interface_mgr[2200]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 03:59:41 kjcf05n03 mdraid-phy[2202]: no Cutlass to worry about Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Name Service Cache Daemon. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 03:59:41 kjcf05n03 mlnx_interface_mgr[2229]: No configuration found for ib1 Nov 3 03:59:41 kjcf05n03 beSetMlxConfig[2141]: Starting MST (Mellanox Software Tools) driver set Nov 3 03:59:41 kjcf05n03 sssd[sssd][2066]: Starting up Nov 3 03:59:41 kjcf05n03 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 03:59:41 kjcf05n03 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 03:59:41 kjcf05n03 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 03:59:41 kjcf05n03 dbus-daemon[2197]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 0 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 1 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 2 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 3 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 4 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 5 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 6 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 7 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 8 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 9 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 10 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 11 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 12 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 13 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 14 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 15 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 16 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 17 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 18 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 19 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 20 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 21 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 22 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 23 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 24 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 25 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 26 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 27 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 28 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 29 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 30 Nov 3 03:59:41 kjcf05n03 cpupower[2258]: Idlestate 2 disabled on CPU 31 Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Manage Cutlass PHYs. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 03:59:41 kjcf05n03 mlnx_interface_mgr[2254]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 03:59:41 kjcf05n03 mlnx_interface_mgr[2260]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 03:59:41 kjcf05n03 dbus-daemon[2197]: [system] Successfully activated service 'org.freedesktop.systemd1' Nov 3 03:59:41 kjcf05n03 beSetMlxConfig[2141]: Loading MST PCI module - Success Nov 3 03:59:41 kjcf05n03 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 03:59:41 kjcf05n03 mlnx_interface_mgr[2279]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 03:59:41 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 03:59:41 kjcf05n03 mlnx_conf_mgr[2303]: INFO: No configurations found for mlx5_1, skipping. Nov 3 03:59:41 kjcf05n03 beSetMlxConfig[2141]: Loading MST PCI configuration module - Success Nov 3 03:59:41 kjcf05n03 beSetMlxConfig[2141]: Create devices Nov 3 03:59:41 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 03:59:41 kjcf05n03 mlnx_interface_mgr[2312]: No configuration found for ib0 Nov 3 03:59:41 kjcf05n03 mlnx_interface_mgr[2332]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 03:59:41 kjcf05n03 mlnx_conf_mgr[2380]: INFO: No configurations found for mlx5_0, skipping. Nov 3 03:59:41 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 03:59:41 kjcf05n03 sssd[be[implicit_files]][2289]: Starting up Nov 3 03:59:41 kjcf05n03 sssd[nss][2437]: Starting up Nov 3 03:59:41 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 03:59:41 kjcf05n03 systemd[1]: Reached target User and Group Name Lookups. Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Login Service... Nov 3 03:59:41 kjcf05n03 systemd-logind[2537]: New seat seat0. Nov 3 03:59:41 kjcf05n03 systemd-logind[2537]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Login Service. Nov 3 03:59:41 kjcf05n03 python3.9[2205]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 03:59:41 kjcf05n03 python3.9[3111]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 03:59:41 kjcf05n03 systemd-sysctl[2708]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 03:59:41 kjcf05n03 systemd-sysctl[2708]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 03:59:41 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 03:59:41 kjcf05n03 network[2077]: Bringing up loopback interface: [ OK ] Nov 3 03:59:41 kjcf05n03 python3.9[2944]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 03:59:41 kjcf05n03 python3.9[3111]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 03:59:41 kjcf05n03 systemd-sysctl[3036]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 03:59:41 kjcf05n03 systemd-sysctl[3036]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 03:59:41 kjcf05n03 systemd[1]: Started LSB: Bring up/down networking. Nov 3 03:59:41 kjcf05n03 systemd[1]: Reached target Network. Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 03:59:41 kjcf05n03 systemd[1]: Reached target Network is Online. Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting System Logger Daemon... Nov 3 03:59:41 kjcf05n03 sm-notify[3099]: Version 2.3.3 starting Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 03:59:41 kjcf05n03 sshd[3073]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 03:59:41 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Notify NFS peers of a restart. Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 03:59:41 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 03:59:41 kjcf05n03 systemd[1]: Reached target NFS client services. Nov 3 03:59:41 kjcf05n03 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 03:59:41 kjcf05n03 systemd[1]: Reached target Remote File Systems. Nov 3 03:59:41 kjcf05n03 lldpad[3074]: setsockopt nearest_bridge: Invalid argument Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Permit User Sessions... Nov 3 03:59:41 kjcf05n03 lldpad[3074]: setsockopt nearest_bridge: Invalid argument Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Permit User Sessions. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Getty on tty1. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 03:59:41 kjcf05n03 python3.9[3151]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 03:59:41 kjcf05n03 python3.9[3111]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Serial Getty on ttyS0. Nov 3 03:59:41 kjcf05n03 systemd[1]: Reached target Login Prompts. Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 03:59:41 kjcf05n03 syslog-ng[3111]: [2024-11-03T09:58:28.433220] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 03:59:41 kjcf05n03 syslog-ng[3111]: [2024-11-03T09:58:28.433494] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 03:59:41 kjcf05n03 syslog-ng[3111]: [2024-11-03T09:58:28.433529] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 03:59:41 kjcf05n03 syslog-ng[3111]: [2024-11-03T09:58:28.434088] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 03:59:41 kjcf05n03 syslog-ng[3111]: [2024-11-03T09:58:28.434278] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 03:59:41 kjcf05n03 systemd[1]: Started System Logger Daemon. Nov 3 03:59:41 kjcf05n03 beSetMlxConfig[2141]: Unloading MST PCI module (unused) - Success Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 03:59:41 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 03:59:41 kjcf05n03 python3.9[3247]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 03:59:41 kjcf05n03 python3.9[3111]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 03:59:41 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 03:59:41 kjcf05n03 python3.9[3396]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 03:59:41 kjcf05n03 python3.9[3111]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 03:59:41 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 03:59:41 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 03:59:41 kjcf05n03 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 03:59:41 kjcf05n03 chronyd[2145]: System's initial offset : 0.001954 seconds slow of true (slew) Nov 3 03:59:41 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 03:59:41 kjcf05n03 beSetMlxConfig[2141]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 03:59:41 kjcf05n03 beSetMlxConfig[2141]: ib mode Nov 3 03:59:41 kjcf05n03 beSetMlxConfig[2141]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 03:59:41 kjcf05n03 root[3420]: openibd: Set node_desc for mlx5_0: kjcf05n03 HCA-1 Nov 3 03:59:41 kjcf05n03 root[3422]: openibd: Set node_desc for mlx5_1: kjcf05n03 HCA-2 Nov 3 03:59:41 kjcf05n03 beSetMlxConfig[2141]: ib mode Nov 3 03:59:41 kjcf05n03 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 03:59:41 kjcf05n03 systemd-udevd[3436]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:59:41 kjcf05n03 systemd-udevd[3435]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:59:41 kjcf05n03 systemd-udevd[3439]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:59:41 kjcf05n03 systemd-udevd[3440]: Using default interface naming scheme 'rhel-8.0'. Nov 3 03:59:41 kjcf05n03 systemd-udevd[3440]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:59:41 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 03:59:41 kjcf05n03 systemd[3111]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:59:41 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 03:59:41 kjcf05n03 mlnx_interface_mgr[3477]: Setting up Mellanox network interface: ib1 Nov 3 03:59:41 kjcf05n03 mlnx_interface_mgr[3478]: Setting up Mellanox network interface: ib0 Nov 3 03:59:41 kjcf05n03 systemd-udevd[3438]: Using default interface naming scheme 'rhel-8.0'. Nov 3 03:59:41 kjcf05n03 systemd-udevd[3437]: Using default interface naming scheme 'rhel-8.0'. Nov 3 03:59:41 kjcf05n03 systemd-udevd[3438]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:59:41 kjcf05n03 systemd-udevd[3437]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:59:41 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 03:59:41 kjcf05n03 systemd[1]: Starting Puppet agent... Nov 3 03:59:41 kjcf05n03 mlnx_interface_mgr[3527]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 03:59:41 kjcf05n03 mlnx_interface_mgr[3528]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 03:59:41 kjcf05n03 mlnx_interface_mgr[3558]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 03:59:41 kjcf05n03 mlnx_interface_mgr[3559]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 03:59:41 kjcf05n03 mlnx_interface_mgr[3560]: No configuration found for ib1 Nov 3 03:59:41 kjcf05n03 mlnx_interface_mgr[3561]: No configuration found for ib0 Nov 3 03:59:41 kjcf05n03 mlnx_interface_mgr[3566]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 03:59:41 kjcf05n03 mlnx_interface_mgr[3569]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 03:59:41 kjcf05n03 mlnx_conf_mgr[3605]: INFO: No configurations found for mlx5_1, skipping. Nov 3 03:59:41 kjcf05n03 mlnx_conf_mgr[3609]: INFO: No configurations found for mlx5_0, skipping. Nov 3 03:59:41 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 03:59:41 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 03:59:41 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 03:59:41 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 03:59:42 kjcf05n03 systemd[1]: Stopping Command Scheduler... Nov 3 03:59:42 kjcf05n03 systemd[1]: crond.service: Succeeded. Nov 3 03:59:42 kjcf05n03 systemd[1]: Stopped Command Scheduler. Nov 3 03:59:42 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 03:59:42 kjcf05n03 systemd[1]: Stopping Job spooling tools... Nov 3 03:59:42 kjcf05n03 systemd[1]: atd.service: Succeeded. Nov 3 03:59:42 kjcf05n03 systemd[1]: Stopped Job spooling tools. Nov 3 03:59:42 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 03:59:42 kjcf05n03 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 03:59:42 kjcf05n03 lldpad[3074]: init_ports: Error adding device ib0 Nov 3 03:59:42 kjcf05n03 lldpad[3074]: init_ports: Error adding device ib1 Nov 3 03:59:42 kjcf05n03 lldpad[3074]: Signal 15 received - terminating Nov 3 03:59:42 kjcf05n03 systemd[1]: lldpad.service: Succeeded. Nov 3 03:59:42 kjcf05n03 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 03:59:42 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 03:59:42 kjcf05n03 systemd[1]: lldpad.socket: Succeeded. Nov 3 03:59:42 kjcf05n03 systemd[1]: Closed lldpad.socket. Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 03:59:42 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:42 kjcf05n03 systemd[1]: Starting IPMI Driver... Nov 3 03:59:42 kjcf05n03 systemd[1]: Started IPMI Driver. Nov 3 03:59:42 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:42 kjcf05n03 systemd[3111]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:59:42 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:42 kjcf05n03 systemd[1]: Starting Ipmievd Daemon... Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 1 | Nov-03-2024 | 09:28:53 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 2 | Nov-03-2024 | 09:29:45 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 3 | Nov-03-2024 | 09:29:46 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 4 | Nov-03-2024 | 09:30:51 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 5 | Nov-03-2024 | 09:30:52 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 6 | Nov-03-2024 | 09:55:47 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 7 | Nov-03-2024 | 09:55:47 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 8 | Nov-03-2024 | 09:55:47 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 9 | Nov-03-2024 | 09:55:47 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 10 | Nov-03-2024 | 09:55:47 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 11 | Nov-03-2024 | 09:55:47 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 12 | Nov-03-2024 | 09:55:47 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 13 | Nov-03-2024 | 09:55:47 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 14 | Nov-03-2024 | 09:55:47 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 15 | Nov-03-2024 | 09:55:47 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 16 | Nov-03-2024 | 09:55:47 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 17 | Nov-03-2024 | 09:55:47 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 18 | Nov-03-2024 | 09:55:47 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 19 | Nov-03-2024 | 09:55:47 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 20 | Nov-03-2024 | 09:55:47 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 21 | Nov-03-2024 | 09:55:47 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 22 | Nov-03-2024 | 09:55:47 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 23 | Nov-03-2024 | 09:55:47 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 24 | Nov-03-2024 | 09:55:47 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 25 | Nov-03-2024 | 09:55:47 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 26 | Nov-03-2024 | 09:55:47 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 27 | Nov-03-2024 | 09:55:47 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 28 | Nov-03-2024 | 09:55:48 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 29 | Nov-03-2024 | 09:55:48 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 30 | Nov-03-2024 | 09:55:48 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 31 | Nov-03-2024 | 09:55:48 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 32 | Nov-03-2024 | 09:55:48 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 33 | Nov-03-2024 | 09:55:48 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 34 | Nov-03-2024 | 09:55:48 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 35 | Nov-03-2024 | 09:55:48 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 36 | Nov-03-2024 | 09:55:48 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 37 | Nov-03-2024 | 09:55:48 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 38 | Nov-03-2024 | 09:56:17 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 39 | Nov-03-2024 | 09:56:17 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 40 | Nov-03-2024 | 09:56:17 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 41 | Nov-03-2024 | 09:56:17 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 42 | Nov-03-2024 | 09:56:17 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 43 | Nov-03-2024 | 09:56:17 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 44 | Nov-03-2024 | 09:56:17 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 45 | Nov-03-2024 | 09:56:17 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 46 | Nov-03-2024 | 09:56:17 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 47 | Nov-03-2024 | 09:56:17 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 48 | Nov-03-2024 | 09:56:17 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 03:59:42 kjcf05n03 ipmievd[3952]: 49 | Nov-03-2024 | 09:56:17 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 03:59:42 kjcf05n03 ipmievd[3955]: Reading sensors... Nov 3 03:59:42 kjcf05n03 systemd[1]: Started Ipmievd Daemon. Nov 3 03:59:42 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:42 kjcf05n03 systemd[3111]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 03:59:42 kjcf05n03 nscd[2109]: 2109 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 03:59:42 kjcf05n03 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 03:59:42 kjcf05n03 systemd[1]: Stopped Set Mellanox configuration. Nov 3 03:59:42 kjcf05n03 systemd[1]: Stopping Set Mellanox configuration... Nov 3 03:59:42 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 03:59:42 kjcf05n03 beSetMlxConfig[4013]: ConnectX-3 multiport not detected Nov 3 03:59:42 kjcf05n03 beSetMlxConfig[4013]: Starting MST (Mellanox Software Tools) driver set Nov 3 03:59:42 kjcf05n03 beSetMlxConfig[4013]: Loading MST PCI module - Success Nov 3 03:59:42 kjcf05n03 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 03:59:42 kjcf05n03 beSetMlxConfig[4013]: [warn] mst_pciconf is already loaded, skipping Nov 3 03:59:42 kjcf05n03 beSetMlxConfig[4013]: Create devices Nov 3 03:59:42 kjcf05n03 beSetMlxConfig[4013]: Unloading MST PCI module (unused) - Success Nov 3 03:59:42 kjcf05n03 ipmievd[3955]: Waiting for events... Nov 3 03:59:42 kjcf05n03 beSetMlxConfig[4013]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 03:59:42 kjcf05n03 beSetMlxConfig[4013]: ib mode Nov 3 03:59:42 kjcf05n03 beSetMlxConfig[4013]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 03:59:42 kjcf05n03 beSetMlxConfig[4013]: ib mode Nov 3 03:59:42 kjcf05n03 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 03:59:42 kjcf05n03 systemd-udevd[4912]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:59:42 kjcf05n03 systemd-udevd[4913]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:59:42 kjcf05n03 systemd-udevd[4916]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:59:42 kjcf05n03 systemd-udevd[4919]: Using default interface naming scheme 'rhel-8.0'. Nov 3 03:59:42 kjcf05n03 systemd-udevd[4919]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:59:42 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 03:59:42 kjcf05n03 systemd[3111]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:59:42 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 03:59:42 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 03:59:42 kjcf05n03 mlnx_interface_mgr[4954]: Setting up Mellanox network interface: ib0 Nov 3 03:59:42 kjcf05n03 mlnx_interface_mgr[4955]: Setting up Mellanox network interface: ib1 Nov 3 03:59:42 kjcf05n03 systemd-udevd[4915]: Using default interface naming scheme 'rhel-8.0'. Nov 3 03:59:42 kjcf05n03 systemd-udevd[4915]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:59:42 kjcf05n03 mlnx_interface_mgr[5004]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 03:59:42 kjcf05n03 mlnx_interface_mgr[5005]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 03:59:42 kjcf05n03 mlnx_interface_mgr[5021]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 03:59:42 kjcf05n03 mlnx_interface_mgr[5020]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 03:59:42 kjcf05n03 mlnx_interface_mgr[5023]: No configuration found for ib0 Nov 3 03:59:42 kjcf05n03 mlnx_interface_mgr[5022]: No configuration found for ib1 Nov 3 03:59:42 kjcf05n03 systemd-udevd[4914]: Using default interface naming scheme 'rhel-8.0'. Nov 3 03:59:42 kjcf05n03 systemd-udevd[4914]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 03:59:42 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 03:59:42 kjcf05n03 mlnx_interface_mgr[5030]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 03:59:42 kjcf05n03 mlnx_interface_mgr[5031]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 03:59:42 kjcf05n03 mlnx_conf_mgr[5082]: INFO: No configurations found for mlx5_0, skipping. Nov 3 03:59:42 kjcf05n03 mlnx_conf_mgr[5086]: INFO: No configurations found for mlx5_1, skipping. Nov 3 03:59:42 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 03:59:42 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}e63821dc317acb281f7ea4e1ddeb472faa8c93b3c0869480b4763dff5c48647c' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}e63821dc317acb281f7ea4e1ddeb472faa8c93b3c0869480b4763dff5c48647c' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}7fc51bf3a0c8561ed6f91e91cdee2667df1984b882a028f031cdd8632e1ffb54' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}7fc51bf3a0c8561ed6f91e91cdee2667df1984b882a028f031cdd8632e1ffb54' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}2c7866675052ba72054b5e59b3c5f2da71b1bc6513e3803d85bf1dc57eed6d07' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}2c7866675052ba72054b5e59b3c5f2da71b1bc6513e3803d85bf1dc57eed6d07' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}eefb2b761b822bce567c0b1d388652bf14932428043fe652fa9c3a1a907660c2' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}eefb2b761b822bce567c0b1d388652bf14932428043fe652fa9c3a1a907660c2' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 03:59:42 kjcf05n03 systemd[1]: Stopping NTP client/server... Nov 3 03:59:42 kjcf05n03 chronyd[2145]: chronyd exiting Nov 3 03:59:42 kjcf05n03 systemd[1]: chronyd.service: Succeeded. Nov 3 03:59:42 kjcf05n03 systemd[1]: Stopped NTP client/server. Nov 3 03:59:42 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 03:59:42 kjcf05n03 chronyd[5120]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 03:59:42 kjcf05n03 chronyd[5120]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 03:59:42 kjcf05n03 chronyd[5120]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 03:59:42 kjcf05n03 chronyd[5120]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 03:59:42 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 03:59:42 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:42 kjcf05n03 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 03:59:42 kjcf05n03 systemd[1]: dwd.service: Succeeded. Nov 3 03:59:42 kjcf05n03 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 03:59:42 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 03:59:42 kjcf05n03 dwd[5151]: dwd: vMay 29 2024 : 15:38:26 Nov 3 03:59:42 kjcf05n03 dwd[5151]: /usr/sbin/dwd -i 15 -d Nov 3 03:59:42 kjcf05n03 dwd[5151]: dwd: option Lethal: 0 Nov 3 03:59:42 kjcf05n03 dwd[5151]: dwd: option Interval: 15 Nov 3 03:59:42 kjcf05n03 dwd[5151]: dwd: option abrtlimit: 10 Nov 3 03:59:42 kjcf05n03 dwd[5151]: dwd: option DZPeriod: 604800 Nov 3 03:59:42 kjcf05n03 dwd[5151]: dwd: option SmartPeriod: 43200 Nov 3 03:59:42 kjcf05n03 dwd[5151]: dwd: option SDDEnabled: 1 Nov 3 03:59:42 kjcf05n03 dwd[5151]: dwd: option SDDAwaitScale: 3 Nov 3 03:59:42 kjcf05n03 dwd[5151]: dwd: option SDDAwaitMin: 100 Nov 3 03:59:42 kjcf05n03 dwd[5151]: dwd: option Verbosity: 1 Nov 3 03:59:42 kjcf05n03 dwd[5151]: dwd: option StandAlone: 0 Nov 3 03:59:42 kjcf05n03 dwd[5151]: option Lethal: 0 Nov 3 03:59:42 kjcf05n03 dwd[5151]: option Interval: 15 Nov 3 03:59:42 kjcf05n03 dwd[5151]: option abrtlimit: 10 Nov 3 03:59:42 kjcf05n03 dwd[5151]: option DZPeriod: 604800 Nov 3 03:59:42 kjcf05n03 dwd[5151]: option SmartPeriod: 43200 Nov 3 03:59:42 kjcf05n03 dwd[5151]: option SDDEnabled: 1 Nov 3 03:59:42 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 03:59:42 kjcf05n03 dwd[5151]: option SDDAwaitScale: 3 Nov 3 03:59:42 kjcf05n03 dwd[5151]: option SDDAwaitMin: 100 Nov 3 03:59:42 kjcf05n03 dwd[5151]: option Verbosity: 1 Nov 3 03:59:42 kjcf05n03 dwd[5151]: option StandAlone: 0 Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 03:59:42 kjcf05n03 dwd[5153]: option Lethal now set to 1 Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 03:59:42 kjcf05n03 dwd[5153]: option abrtlimit now set to 1 Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 03:59:42 kjcf05n03 dwd[5153]: option SmartPeriod now set to 86400 Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 03:59:42 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:42 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 03:59:42 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:42 kjcf05n03 systemd[1]: Started Discard unused blocks. Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:59:42 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:42 kjcf05n03 python3.9[5182]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 03:59:42 kjcf05n03 python3.9[3111]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 03:59:42 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:42 kjcf05n03 systemd[1]: Started Periodic ZFS scrub. Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:59:42 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 03:59:42 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:42 kjcf05n03 systemd[1]: Starting Sed Control Plane worker process... Nov 3 03:59:42 kjcf05n03 sedcpwrkr[5321]: Using config script: /etc/sedcpwrkr.conf Nov 3 03:59:42 kjcf05n03 sedcpwrkr[5321]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 03:59:42 kjcf05n03 sedcpwrkr[5321]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 03:59:42 kjcf05n03 sedcpwrkr[5321]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 03:59:42 kjcf05n03 sedcpwrkr[5321]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 03:59:42 kjcf05n03 sedcpwrkr[5321]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 03:59:42 kjcf05n03 sedcpwrkr[5321]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 03:59:42 kjcf05n03 sedcpwrkr-server[5352]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 03:59:42 kjcf05n03 sedcpwrkr[5321]: celery multi v5.2.7 (dawn-chorus) Nov 3 03:59:42 kjcf05n03 sedcpwrkr[5321]: > Starting nodes... Nov 3 03:59:42 kjcf05n03 sedcpwrkr[5321]: > sedcpwrkr@kjcf05n03: OK Nov 3 03:59:42 kjcf05n03 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 03:59:42 kjcf05n03 sedcpwrkr-server[5354]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 03:59:42 kjcf05n03 sedcpwrkr-server[5354]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 03:59:42 kjcf05n03 sedcpwrkr-server[5354]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 03:59:42 kjcf05n03 systemd[1]: Started Sed Control Plane worker process. Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 03:59:42 kjcf05n03 systemd[1]: Reloading System Logger Daemon. Nov 3 03:59:42 kjcf05n03 systemd[1]: Reloaded System Logger Daemon. Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 03:59:42 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 03:59:42 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 03:59:42 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:42 kjcf05n03 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 03:59:42 kjcf05n03 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 03:59:42 kjcf05n03 iptables.init[5421]: iptables: Applying firewall rules: [ OK ] Nov 3 03:59:42 kjcf05n03 systemd[1]: Started IPv4 firewall with iptables. Nov 3 03:59:42 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:43 kjcf05n03 systemd[3111]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 03:59:43 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 03:59:43 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 03:59:43 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:44 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 03:59:44 kjcf05n03 systemd[1]: openhpid.service: Supervising process 5518 which is not our child. We'll most likely not notice when it exits. Nov 3 03:59:44 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 03:59:44 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:44 kjcf05n03 openhpid[5518]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 03:59:44 kjcf05n03 openhpid[5518]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 03:59:44 kjcf05n03 openhpid[5518]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 03:59:44 kjcf05n03 openhpid[5518]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 03:59:44 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:44 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:59:44 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:59:44 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 03:59:44 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 03:59:44 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 03:59:44 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 03:59:44 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:45 kjcf05n03 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 03:59:45 kjcf05n03 dcs-collectord[5609]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 03:59:45 kjcf05n03 hpi.inv.log[5609]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 03:59:45 kjcf05n03 dcs-collectord[5609]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 03:59:45 kjcf05n03 dcs-collectord[5609]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 03:59:45 kjcf05n03 dcs-collector[5600]: Starting dcs-collector:[ OK ] Nov 3 03:59:45 kjcf05n03 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 03:59:45 kjcf05n03 dcs-collectord[5612]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 03:59:45 kjcf05n03 dcs-collectord[5612]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 03:59:45 kjcf05n03 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 03:59:45 kjcf05n03 dcs-collectord[5612]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 03:59:45 kjcf05n03 dcs-collectord[5612]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 03:59:45 kjcf05n03 dcs-collectord[5612]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 03:59:45 kjcf05n03 dcs-collectord[5612]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 03:59:45 kjcf05n03 dcs-collectord[5612]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 03:59:45 kjcf05n03 dcs-collectord[5612]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259341840", "units": "kB"}, {"name": "MemAvailable", "value": "258621168", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821328", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1687040", "units": "kB"}, {"name": "Inactive", "value": "965996", "units": "kB"}, {"name": "Active(anon)", "value": "1520600", "units": "kB"}, {"name": "Inactive(anon)", "value": "830108", "units": "kB"}, {"name": "Active(file)", "value": "166440", "units": "kB"}, {"name": "Inactive(file)", "value": "135888", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "756096", "units": "kB"}, {"name": "Mapped", "value": "86464", "units": "kB"}, {"name": "Shmem", "value": "1593452", "units": "kB"}, {"name": "KReclaimable", "value": "108496", "units": "kB"}, {"name": "Slab", "value": "276072", "units": "kB"}, {"name": "SReclaimable", "value": "108496", "units": "kB"}, {"name": "SUnreclaim", "value": "167576", "units": "kB"}, {"name": "KernelStack", "value": "9696", "units": "kB"}, {"name": "PageTables", "value": "19744", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3305728", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11136", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "4096", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "289096", "units": "kB"}, {"name": "DirectMap2M", "value": "22644736", "units": "kB"}, {"name": "DirectMap1G", "value": "245366784", "units": "kB"}]}' Nov 3 03:59:45 kjcf05n03 dcs-collectord[5612]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 03:59:45 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:45 kjcf05n00 zabbix-server[932665]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 03:59:45 kjcf05n00 zabbix-server[932665]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 88.72\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 136.33\\"}}"' Nov 3 03:59:45 kjcf05n00 mcfcli[3673891]: %3|1730627985.283|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 03:59:45 kjcf05n00 log_interesting_event.py[932665]: Event '45722' acknowledged Nov 3 03:59:45 kjcf05n03 systemd[3111]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:59:45 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:59:45 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:59:45 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 03:59:45 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 03:59:45 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 03:59:45 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 03:59:46 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:46 kjcf05n03 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 03:59:46 kjcf05n03 firmware-update-orc[5693]: Using config script: /etc/firmware_update_orc.conf Nov 3 03:59:46 kjcf05n03 firmware-update-orc[5693]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 03:59:46 kjcf05n03 firmware-update-orc[5693]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 03:59:46 kjcf05n03 firmware-update-orc[5693]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 03:59:46 kjcf05n03 firmware-update-orc[5693]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 03:59:46 kjcf05n03 firmware-update-orc[5693]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 03:59:46 kjcf05n03 firmware-update-orc[5693]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 03:59:46 kjcf05n03 dcs-collectord[5612]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 03:59:46 kjcf05n03 dcs-collectord[5612]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730627985.228544], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730627986.4019806], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730627985.161549, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 03:59:46 kjcf05n03 firmware-update-orc-server[5729]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 03:59:46 kjcf05n03 firmware-update-orc[5693]: celery multi v5.2.7 (dawn-chorus) Nov 3 03:59:46 kjcf05n03 firmware-update-orc[5693]: > Starting nodes... Nov 3 03:59:46 kjcf05n03 firmware-update-orc[5693]: > worker1@kjcf05n03: OK Nov 3 03:59:46 kjcf05n03 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 03:59:46 kjcf05n03 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 03:59:46 kjcf05n03 firmware-update-orc-server[5758]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 03:59:47 kjcf05n03 firmware-update-orc-server[5758]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 03:59:47 kjcf05n03 firmware-update-orc-server[5758]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 03:59:47 kjcf05n03 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 03:59:47 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:47 kjcf05n03 systemd[3111]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:59:47 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:59:47 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:59:47 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 03:59:47 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 03:59:47 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 03:59:47 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 03:59:47 kjcf05n03 dbus-daemon[2197]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 03:59:47 kjcf05n03 dbus-daemon[2197]: [system] Reloaded configuration Nov 3 03:59:47 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 03:59:47 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 03:59:47 kjcf05n03 dbus-daemon[2197]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 03:59:47 kjcf05n03 dbus-daemon[2197]: [system] Reloaded configuration Nov 3 03:59:47 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 03:59:47 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 03:59:47 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 03:59:47 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 03:59:47 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:47 kjcf05n03 systemd[1]: Starting Manages hardware resources... Nov 3 03:59:48 kjcf05n03 ras-resource-manager-agent[5874]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 03:59:48 kjcf05n03 ras-resource-manager-agent[5860]: Starting ras-resource-manager-agent:[ OK ] Nov 3 03:59:48 kjcf05n03 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 03:59:48 kjcf05n03 ras-resource-manager-agent[5876]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 03:59:48 kjcf05n03 ras-resource-manager-client[5876]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 03:59:48 kjcf05n03 systemd[1]: Started Manages hardware resources. Nov 3 03:59:48 kjcf05n03 ras-resource-manager-client[5876]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 03:59:48 kjcf05n03 ras-resource-manager-client[5886]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 03:59:48 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:48 kjcf05n03 systemd[3111]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:59:48 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:59:48 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:59:48 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 03:59:48 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 03:59:48 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:48 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 03:59:48 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:49 kjcf05n03 systemd[3111]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: Starting Zabbix Agent 2 (6.2.1) Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: Press Ctrl+C to exit. Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: Plugin support version 1.0 Nov 3 03:59:49 kjcf05n03 zabbix_agent2[5960]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 03:59:49 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:59:49 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:59:49 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:49 kjcf05n03 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 03:59:49 kjcf05n03 dcs-notification-sender[6037]: dcs-notification-senderd is stopped Nov 3 03:59:49 kjcf05n03 zabbix-agent2[6055]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 03:59:49 kjcf05n03 dcs-notification-sender[6037]: Starting notification-sender:[ OK ] Nov 3 03:59:49 kjcf05n03 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 03:59:50 kjcf05n03 zabbix-agent2[6057]: INFO DCS notification agent started. (agent.py:61) Nov 3 03:59:50 kjcf05n03 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 03:59:50 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:50 kjcf05n00 mcfcli[3673891]: %3|1730627990.037|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 03:59:50 kjcf05n03 systemd[3111]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:59:50 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:59:50 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:59:50 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:50 kjcf05n03 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 03:59:51 kjcf05n03 dcs-collectord[6142]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 03:59:51 kjcf05n03 dcs-collectord[6142]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 03:59:51 kjcf05n03 dcs-bulk-data-sender[6142]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 03:59:51 kjcf05n03 dcs-bulk-data-sender[6133]: Starting bulk-data-sender:[ OK ] Nov 3 03:59:51 kjcf05n03 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 03:59:51 kjcf05n03 dcs-collectord[6144]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 03:59:51 kjcf05n03 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 03:59:51 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:51 kjcf05n03 systemd[3111]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:59:51 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:59:51 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:59:51 kjcf05n03 nscd[2109]: 2109 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 03:59:51 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 03:59:51 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 03:59:51 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 03:59:51 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 03:59:51 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 03:59:51 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 03:59:51 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 03:59:51 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 03:59:51 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 03:59:51 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 03:59:51 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 03:59:51 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 03:59:51 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 03:59:51 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 03:59:52 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 03:59:52 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 03:59:52 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 03:59:52 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 03:59:52 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 03:59:52 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 03:59:52 kjcf05n03 systemd[1]: Stopping System Security Services Daemon... Nov 3 03:59:52 kjcf05n03 sssd[nss][2437]: Shutting down (status = 0) Nov 3 03:59:52 kjcf05n03 sssd[be[implicit_files]][2289]: Shutting down (status = 0) Nov 3 03:59:52 kjcf05n03 systemd[1]: sssd.service: Succeeded. Nov 3 03:59:52 kjcf05n03 systemd[1]: Stopped System Security Services Daemon. Nov 3 03:59:52 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 03:59:52 kjcf05n03 sssd[sssd][6233]: Starting up Nov 3 03:59:52 kjcf05n03 python3.9[5182]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 03:59:52 kjcf05n03 python3.9[3111]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:59:52 kjcf05n03 sssd[be[implicit_files]][6235]: Starting up Nov 3 03:59:53 kjcf05n03 sssd[nss][6236]: Starting up Nov 3 03:59:53 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 03:59:53 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 03:59:53 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 03:59:54 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure) defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 03:59:54 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure: defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 03:59:54 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure) defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 03:59:54 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure: defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 03:59:54 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 03:59:54 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 03:59:54 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 03:59:54 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 03:59:54 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 03:59:54 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 03:59:54 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:54 kjcf05n03 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 03:59:54 kjcf05n03 icinga2[6297]: [2024-11-03 03:59:54 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 03:59:54 kjcf05n03 icinga2[6297]: [2024-11-03 03:59:54 -0600] information/cli: Loading configuration file(s). Nov 3 03:59:54 kjcf05n03 icinga2[6297]: [2024-11-03 03:59:54 -0600] information/ConfigItem: Committing config item(s). Nov 3 03:59:54 kjcf05n03 icinga2[6297]: [2024-11-03 03:59:54 -0600] information/ApiListener: My API identity: kjcf05n03 Nov 3 03:59:54 kjcf05n03 icinga2[6297]: [2024-11-03 03:59:54 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 03:59:54 kjcf05n03 icinga2[6297]: [2024-11-03 03:59:54 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 03:59:54 kjcf05n03 icinga2[6297]: [2024-11-03 03:59:54 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 03:59:54 kjcf05n03 icinga2[6297]: [2024-11-03 03:59:54 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 03:59:54 kjcf05n03 icinga2[6297]: [2024-11-03 03:59:54 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 03:59:54 kjcf05n03 icinga2[6297]: [2024-11-03 03:59:54 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 03:59:54 kjcf05n03 icinga2[6297]: [2024-11-03 03:59:54 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 03:59:54 kjcf05n03 icinga2[6297]: [2024-11-03 03:59:54 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 03:59:54 kjcf05n03 icinga2[6297]: [2024-11-03 03:59:54 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 03:59:54 kjcf05n03 icinga2[6297]: [2024-11-03 03:59:54 -0600] information/cli: Closing console log. Nov 3 03:59:54 kjcf05n03 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 03:59:54 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:55 kjcf05n03 systemd[3111]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:59:55 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:59:55 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:59:55 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 03:59:55 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 03:59:55 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:55 kjcf05n03 systemd[1]: Started Icinga2 network monitor. Nov 3 03:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 03:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 03:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 03:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 03:59:56 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:56 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 03:59:56 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:59:56 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:59:56 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 03:59:56 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 03:59:56 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 03:59:56 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 03:59:56 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 03:59:56 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 03:59:56 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 03:59:56 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 03:59:56 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 03:59:56 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 03:59:56 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 03:59:56 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 03:59:56 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 03:59:56 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 03:59:56 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:56 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 03:59:57 kjcf05n03 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 03:59:57 kjcf05n03 nslcd[6914]: version 0.9.9 starting Nov 3 03:59:57 kjcf05n03 nslcd[6914]: accepting connections Nov 3 03:59:57 kjcf05n03 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 03:59:57 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:58 kjcf05n03 systemd[3111]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 03:59:58 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 03:59:58 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 03:59:58 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 03:59:58 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 03:59:58 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 03:59:58 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 03:59:58 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 03:59:58 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 03:59:59 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 03:59:59 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 03:59:59 kjcf05n03 systemd[1]: Reloading. Nov 3 03:59:59 kjcf05n03 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 03:59:59 kjcf05n03 dearcpw[7014]: Using config script: /etc/dearcpw.conf Nov 3 03:59:59 kjcf05n03 dearcpw[7014]: - Creating default directory: '/var/log/dearcpw' Nov 3 03:59:59 kjcf05n03 dearcpw[7014]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 03:59:59 kjcf05n03 dearcpw[7014]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 03:59:59 kjcf05n03 dearcpw[7014]: - Creating default directory: '/var/run/dearcpw' Nov 3 03:59:59 kjcf05n03 dearcpw[7014]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 03:59:59 kjcf05n03 dearcpw[7014]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 03:59:59 kjcf05n03 dearcpw-server[7054]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 03:59:59 kjcf05n03 dearcpw[7014]: celery multi v5.2.7 (dawn-chorus) Nov 3 03:59:59 kjcf05n03 dearcpw[7014]: > Starting nodes... Nov 3 03:59:59 kjcf05n03 dearcpw[7014]: > dearcpw@kjcf05n03: OK Nov 3 03:59:59 kjcf05n03 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 03:59:59 kjcf05n03 dearcpw-server[7056]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 04:00:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 04:00:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 04:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 04:00:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 04:00:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 04:00:00 kjcf05n03 dearcpw-server[7056]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 04:00:00 kjcf05n03 dearcpw-server[7056]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 04:00:00 kjcf05n03 systemd[1]: Started DEAR Control Plane worker process. Nov 3 04:00:00 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:00:00 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:00:00 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 04:00:00 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 04:00:00 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 04:00:00 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 04:00:00 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 04:00:00 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 04:00:00 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 04:00:00 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 04:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 04:00:00 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:56630). Nov 3 04:00:00 kjcf05n01 rsyncd[2882187]: connect from kjcf05n03 (172.16.2.6) Nov 3 04:00:00 kjcf05n01 rsyncd[2882187]: rsync to puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 04:00:00 kjcf05n01 rsyncd[2882187]: receiving file list Nov 3 04:00:00 kjcf05n01 rsyncd[2882187]: sent 29 bytes received 325 bytes total size 10901 Nov 3 04:00:00 kjcf05n01 systemd[1]: rsyncd@594-172.16.2.2:873-172.16.2.6:56630.service: Succeeded. Nov 3 04:00:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 04:00:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:00:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 04:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 04:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 04:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 04:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 04:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 04:00:00 kjcf05n03 dcs-bulk-data-sender[6144]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 04:00:00 kjcf05n03 dcs-collectord[6144]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 04:00:00 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 04:00:00 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 04:00:00 kjcf05n03 puppet[7101]: IEC: 017000000: Node is up and running: { "node": "kjcf05n03" } Nov 3 04:00:00 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 04:00:00 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 04:00:00 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 04:00:00 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 04:00:00 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 04:00:00 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 04:00:00 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 04:00:00 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 04:00:00 kjcf05n03 dcs-collectord[5612]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 04:00:00 kjcf05n03 dcs-collectord[5612]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 04:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 04:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 04:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 04:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 04:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 04:00:00 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 04:00:00 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 04:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 04:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 04:00:01 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 04:00:01 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 04:00:01 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 04:00:01 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 04:00:01 kjcf05n00 python3.9[932793]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 04:00:02 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 04:00:02 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 04:00:02 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 04:00:02 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 04:00:02 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 04:00:02 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 04:00:02 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 04:00:02 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 04:00:03 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 04:00:03 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 04:00:03 kjcf05n03 systemd[1]: Reloading. Nov 3 04:00:03 kjcf05n03 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 04:00:03 kjcf05n03 diskless-swap[7195]: HA_PS_000: recovering journal Nov 3 04:00:03 kjcf05n03 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 04:00:03 kjcf05n03 diskless-swap[7195]: HA_PS_000: clean, 2266/6400 files, 7033/25600 blocks Nov 3 04:00:04 kjcf05n03 ipmievd[3955]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 04:00:04 kjcf05n03 ipmievd[3955]: System Event sensor - Timestamp Clock Sync Nov 3 04:00:04 kjcf05n03 ipmievd[3111]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:00:04 kjcf05n03 diskless-swap[7195]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 04:00:04 kjcf05n03 diskless-swap[7195]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 04:00:04 kjcf05n03 diskless-swap[7195]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 04:00:04 kjcf05n03 diskless-swap[7195]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 04:00:04 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 04:00:04 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:00:04 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:00:04 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 04:00:04 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 04:00:04 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 04:00:04 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 04:00:04 kjcf05n03 systemd[1]: Stopping OpenSSH server daemon... Nov 3 04:00:04 kjcf05n03 systemd[1]: sshd.service: Succeeded. Nov 3 04:00:04 kjcf05n03 systemd[1]: Stopped OpenSSH server daemon. Nov 3 04:00:04 kjcf05n03 systemd[1]: Stopped target sshd-keygen.target. Nov 3 04:00:04 kjcf05n03 systemd[1]: Stopping sshd-keygen.target. Nov 3 04:00:04 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 04:00:04 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 04:00:04 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 04:00:04 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 04:00:04 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 04:00:05 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 04:00:05 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 04:00:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 04:00:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 04:00:05 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 04:00:05 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 04:00:05 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 04:00:05 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 04:00:06 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 04:00:06 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 04:00:06 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 04:00:06 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 04:00:07 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 04:00:07 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 04:00:07 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 04:00:07 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 04:00:07 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 04:00:07 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 04:00:07 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 04:00:07 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 04:00:07 kjcf05n03 systemd[1]: Reloading. Nov 3 04:00:07 kjcf05n03 systemd[1]: Set up automount opt-firmware.automount. Nov 3 04:00:08 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:00:08 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:00:08 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 04:00:08 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 04:00:08 kjcf05n03 systemd[1]: Reloading. Nov 3 04:00:08 kjcf05n03 systemd[1]: Set up automount mnt-llog.automount. Nov 3 04:00:08 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:00:08 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:00:08 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 04:00:08 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 04:00:08 kjcf05n03 systemd[1]: Reloading. Nov 3 04:00:08 kjcf05n03 systemd[1]: Set up automount usr-share-man.automount. Nov 3 04:00:08 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:00:08 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:00:08 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 04:00:08 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 04:00:08 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 04:00:08 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 04:00:08 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 04:00:08 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 04:00:08 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 04:00:08 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 04:00:08 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 04:00:08 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 04:00:08 kjcf05n03 systemd[1]: Reloading. Nov 3 04:00:09 kjcf05n03 systemd[1]: Starting Crash recovery kernel arming... Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: kdump: No kdump initial ramdisk found. Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 04:00:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 04:00:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 04:00:09 kjcf05n03 dracut[7941]: dracut-049-135.git20210121.el8 Nov 3 04:00:09 kjcf05n03 dracut[7943]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 04:00:09 kjcf05n03 dracut[7943]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 04:00:09 kjcf05n03 dracut[7943]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 04:00:09 kjcf05n03 dracut[7943]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 04:00:09 kjcf05n03 dracut[7943]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 04:00:09 kjcf05n03 dracut[7943]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 04:00:09 kjcf05n03 dracut[7943]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 04:00:09 kjcf05n03 dracut[7943]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + is_func check Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: ++ type -t check Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + '[' 0 -ne 0 ']' Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + check -h Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + local dev holder Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + require_binaries mdadm expr Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + local _module_name=90hperaid Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + local _ret=0 Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + [[ mdadm = \-\m ]] Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + for cmd in "$@" Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + find_binary mdadm Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + for cmd in "$@" Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + find_binary expr Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + return 0 Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + [[ -n -h ]] Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + for dev in "${!host_fs_types[@]}" Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + [[ nfs != *_raid_member ]] Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + continue Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + return 255 Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + _ret=255 Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + hostonly=-h Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + return 255 Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + ret=255 Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + [[ 255 = 0 ]] Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: + [[ 255 = 255 ]] Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: ++ module_depends hperaid Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: +++ read a b Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: ++ local _ret Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: ++ unset check depends cmdline install installkernel Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 04:00:09 kjcf05n03 kdumpctl[7829]: +++ set -x Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ depends Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo rootfs-block Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ return 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ _ret=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ return 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + for _moddep in $(module_depends $_mod) Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all == *\ hperaid\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + add_dracutmodules+=' rootfs-block ' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ == *\ hperaid\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check_module rootfs-block Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _mod=rootfs-block Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddep Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ == *\ rootfs-block\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n '' ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all == *\ rootfs-block\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + module_check rootfs-block 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 04:00:10 kjcf05n03 kdumpctl[3111]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _forced=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 2 -eq 2 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _forced=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + is_func check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ type -t check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 0 -ne 0 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check -h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _ret=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + ret=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ 0 = 0 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ module_depends rootfs-block Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: +++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 04:00:10 kjcf05n03 kdumpctl[3111]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ depends Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo fs-lib Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ _ret=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ return 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + for _moddep in $(module_depends $_mod) Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all == *\ rootfs-block\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + add_dracutmodules+=' fs-lib ' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ == *\ rootfs-block\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check_module fs-lib Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _mod=fs-lib Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddep Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n '' ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + mods_checked_as_dep+=' fs-lib ' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all == *\ fs-lib\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + module_check fs-lib 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _forced=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 2 -eq 2 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _forced=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + is_func check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ type -t check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 0 -ne 0 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check -h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _ret=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + ret=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ 0 = 0 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ module_depends fs-lib Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: +++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ depends Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ return 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ _ret=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ return 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + mods_to_load+=' fs-lib ' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + mods_to_load+=' rootfs-block ' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + mods_to_load+=' hperaid ' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _mod=90kernel-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _mod=kernel-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check_module kernel-modules 1 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _mod=kernel-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddep Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n 1 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all = all ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + module_check kernel-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _forced=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 1 -eq 2 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + is_func check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ type -t check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 0 -ne 0 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check -h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + true Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _ret=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + ret=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ 0 != 0 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ module_depends kernel-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: +++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ depends Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ true Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ _ret=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ return 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + mods_to_load+=' kernel-modules ' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _mod=90kernel-modules-extra Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _mod=kernel-modules-extra Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check_module kernel-modules-extra 1 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _mod=kernel-modules-extra Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddep Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n 1 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all = all ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + module_check kernel-modules-extra Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _forced=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 1 -eq 2 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + is_func check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ type -t check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 0 -ne 0 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check -h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + true Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _ret=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + ret=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ 0 != 0 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ module_depends kernel-modules-extra Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: +++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ depends Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ true Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ _ret=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ return 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + mods_to_load+=' kernel-modules-extra ' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _mod=90kernel-network-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _mod=kernel-network-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check_module kernel-network-modules 1 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _mod=kernel-network-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddep Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n 1 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all = all ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + module_check kernel-network-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _forced=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 1 -eq 2 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + is_func check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ type -t check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 0 -ne 0 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check -h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _ret=255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + ret=255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ 255 != 0 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n 1 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 1 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _mod=90livenet Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _mod=livenet Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check_module livenet 1 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _mod=livenet Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddep Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n 1 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all = all ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + module_check livenet Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _forced=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 1 -eq 2 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + is_func check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ type -t check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 0 -ne 0 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check -h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _ret=255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + ret=255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ 255 != 0 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n 1 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 1 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _mod=90lvm Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _mod=lvm Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check_module lvm 1 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _mod=lvm Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddep Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n 1 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all = all ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + module_check lvm Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _forced=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 1 -eq 2 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + is_func check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ type -t check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 0 -ne 0 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check -h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + require_binaries lvm Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _module_name=90lvm Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ lvm = \-\m ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + for cmd in "$@" Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + find_binary lvm Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n -h ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + for fs in "${host_fs_types[@]}" Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ nfs = LVM*_member ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _ret=255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + ret=255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ 255 != 0 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n 1 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 1 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _mod=90mdraid Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _mod=mdraid Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check_module mdraid 1 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _mod=mdraid Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddep Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n 1 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all = all ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + module_check mdraid Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _forced=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 1 -eq 2 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + is_func check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ type -t check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 0 -ne 0 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check -h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _rootdev Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + require_binaries mdadm expr Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _module_name=90mdraid Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ mdadm = \-\m ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + for cmd in "$@" Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + find_binary mdadm Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + for cmd in "$@" Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + find_binary expr Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n -h ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + for dev in "${!host_fs_types[@]}" Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ nfs != *_raid_member ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + continue Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _ret=255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + ret=255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ 255 != 0 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n 1 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 1 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _mod=90multipath Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _mod=multipath Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check_module multipath 1 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _mod=multipath Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddep Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n 1 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all = all ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + module_check multipath Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _forced=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 1 -eq 2 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + is_func check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ type -t check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 0 -ne 0 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check -h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _rootdev Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n -h ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + for_each_host_dev_and_slaves is_mpath Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _func=is_mpath Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _dev Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + for _dev in "${host_devs[@]}" Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + continue Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 1 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _ret=255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + ret=255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ 255 != 0 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n 1 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 1 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _mod=90qemu Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _mod=qemu Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check_module qemu 1 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _mod=qemu Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddep Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n 1 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all = all ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + module_check qemu Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _forced=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 1 -eq 2 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + is_func check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ type -t check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 0 -ne 0 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check -h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n -h ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + type -P systemd-detect-virt Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ systemd-detect-virt --vm Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + vm=none Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + (( 1 != 0 )) Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _ret=255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + ret=255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ 255 != 0 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n 1 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 1 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _mod=90qemu-net Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _mod=qemu-net Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check_module qemu-net 1 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _mod=qemu-net Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddep Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n 1 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all = all ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + module_check qemu-net Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _forced=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 1 -eq 2 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + is_func check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ type -t check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 0 -ne 0 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check -h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n -h ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + type -P systemd-detect-virt Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ systemd-detect-virt --vm Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + vm= Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + (( 1 != 0 )) Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _ret=255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + ret=255 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ 255 != 0 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n 1 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + return 1 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _mod=90stratis Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + _mod=stratis Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check_module stratis 1 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _mod=stratis Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddep Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -n 1 ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ all = all ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + module_check stratis Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ read a b Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _forced=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _hostonly=-h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 1 -eq 2 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + is_func check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: ++ type -t check Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + '[' 0 -ne 0 ']' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + check -h Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _module_name=90stratis Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + local _ret=0 Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + [[ stratisd-init = \-\m ]] Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + for cmd in "$@" Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + find_binary stratisd-init Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 04:00:10 kjcf05n03 kdumpctl[7829]: + set +x Nov 3 04:00:10 kjcf05n03 dracut[7943]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 04:00:10 kjcf05n03 dracut[7943]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 04:00:10 kjcf05n03 dracut[7943]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 04:00:10 kjcf05n03 dracut[7943]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 04:00:10 kjcf05n03 dracut[7943]: memstrack is available Nov 3 04:00:10 kjcf05n03 dracut[7943]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 04:00:10 kjcf05n03 dracut[7943]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 04:00:10 kjcf05n03 dracut[7943]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 04:00:10 kjcf05n03 dracut[7943]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 04:00:10 kjcf05n03 dracut[7943]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 04:00:10 kjcf05n03 dracut[7943]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 04:00:10 kjcf05n03 dracut[7943]: *** Including module: bash *** Nov 3 04:00:11 kjcf05n03 dracut[7943]: *** Including module: systemd *** Nov 3 04:00:11 kjcf05n03 dracut[7943]: *** Including module: fips *** Nov 3 04:00:12 kjcf05n03 dracut[7943]: *** Including module: systemd-initrd *** Nov 3 04:00:12 kjcf05n03 dracut[7943]: *** Including module: watchdog-modules *** Nov 3 04:00:12 kjcf05n03 dracut[7943]: *** Including module: nss-softokn *** Nov 3 04:00:12 kjcf05n03 dracut[7943]: *** Including module: i18n *** Nov 3 04:00:12 kjcf05n03 dracut[7943]: No KEYMAP configured. Nov 3 04:00:12 kjcf05n03 dracut[7943]: *** Including module: network-legacy *** Nov 3 04:00:12 kjcf05n03 dracut[7943]: *** Including module: network *** Nov 3 04:00:13 kjcf05n03 dracut[7943]: *** Including module: ib_bonding *** Nov 3 04:00:13 kjcf05n03 dracut[7943]: *** Including module: drm *** Nov 3 04:00:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730627717', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 04:00:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730627717'} Nov 3 04:00:14 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:00:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730627717', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 04:00:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730627717'} Nov 3 04:00:14 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:00:15 kjcf05n03 dcs-collectord[5612]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 04:00:15 kjcf05n03 dcs-collectord[5612]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 04:00:16 kjcf05n03 dracut[7943]: *** Including module: hperaid *** Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + install Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + local rule rule_path Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + inst_multiple cat expr Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.0DCpVv/initramfs -a -f cat expr Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + _ret=0 Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + (( 0 != 0 )) Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + : Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + return 0 Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + inst_multiple -o mdmon Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.0DCpVv/initramfs -a -f -o mdmon Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + _ret=0 Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + (( 0 != 0 )) Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + : Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + return 0 Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: ++ command -v partx Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + inst /usr/sbin/partx /sbin/partx Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + local _hostonly_install Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + [[ -e /tmp/dracut.0DCpVv/initramfs//sbin/partx ]] Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.0DCpVv/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + (( 0 != 0 )) Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + : Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: ++ command -v mdadm Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + local _hostonly_install Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + [[ -e /tmp/dracut.0DCpVv/initramfs//sbin/mdadm ]] Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.0DCpVv/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + (( 0 != 0 )) Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + : Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + [[ yes == \y\e\s ]] Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + local _raidconf Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: ++ cmdline Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: ++ local _activated dev line UUID Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: ++ declare -A _activated Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: ++ for dev in "${!host_fs_types[@]}" Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: ++ [[ nfs != *_raid_member ]] Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: ++ continue Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + _raidconf= Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + [[ -n '' ]] Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + inst_rules 64-md-raid.rules Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + local _target=/etc/udev/rules.d _rule _found Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + inst_dir /usr/lib/udev/rules.d Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + [[ -e /tmp/dracut.0DCpVv/initramfs//usr/lib/udev/rules.d ]] Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + return 0 Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + inst_dir /etc/udev/rules.d Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + [[ -e /tmp/dracut.0DCpVv/initramfs//etc/udev/rules.d ]] Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + return 0 Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + for _rule in "$@" Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + continue Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + continue Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + for r in '' $dracutbasedir/rules.d/ Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + [[ 64-md-raid.rules != /* ]] Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + continue Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + for r in '' $dracutbasedir/rules.d/ Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + continue Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + [[ -n '' ]] Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 04:00:16 kjcf05n03 kdumpctl[7829]: + set +x Nov 3 04:00:16 kjcf05n03 dracut[7943]: Skipping udev rule: 64-md-raid.rules Nov 3 04:00:16 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n03": interface became available Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + installkernel Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + instmods =drivers/md Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + local _optional=-o Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + local _silent Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + local _ret Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + [[ '' = yes ]] Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + [[ =drivers/md = \-\c ]] Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + [[ =drivers/md = \-\s ]] Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + (( 1 == 0 )) Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.0DCpVv/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + _ret=0 Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + (( 0 != 0 )) Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + [[ -n '' ]] Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + return 0 Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + _ret=0 Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + unset check depends cmdline install installkernel Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + return 0 Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + modules_loaded+='hperaid ' Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + '[' -n '' ']' Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + _d_mod=90kernel-modules Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + _d_mod=kernel-modules Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + [[ '' = yes ]] Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + dinfo '*** Including module: kernel-modules ***' Nov 3 04:00:17 kjcf05n03 kdumpctl[7829]: + set +x Nov 3 04:00:17 kjcf05n03 dracut[7943]: *** Including module: kernel-modules *** Nov 3 04:00:17 kjcf05n03 dracut[7943]: *** Including module: kernel-modules-extra *** Nov 3 04:00:17 kjcf05n03 dracut[7943]: *** Including module: kernel-network-modules *** Nov 3 04:00:17 kjcf05n03 dracut[7943]: *** Including module: diskless-mod *** Nov 3 04:00:17 kjcf05n03 dracut[7943]: *** Including module: fstab-sys *** Nov 3 04:00:17 kjcf05n03 dracut[7943]: *** Including module: nfs *** Nov 3 04:00:18 kjcf05n03 dracut[7943]: *** Including module: rootfs-block *** Nov 3 04:00:18 kjcf05n03 dracut[7943]: *** Including module: terminfo *** Nov 3 04:00:18 kjcf05n03 dracut[7943]: *** Including module: udev-rules *** Nov 3 04:00:18 kjcf05n03 dracut[7943]: Skipping udev rule: 91-permissions.rules Nov 3 04:00:18 kjcf05n03 dracut[7943]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 04:00:18 kjcf05n03 dracut[7943]: *** Including module: dracut-systemd *** Nov 3 04:00:19 kjcf05n03 dracut[7943]: *** Including module: usrmount *** Nov 3 04:00:19 kjcf05n03 dracut[7943]: *** Including module: base *** Nov 3 04:00:20 kjcf05n03 dracut[7943]: *** Including module: fs-lib *** Nov 3 04:00:20 kjcf05n03 dracut[7943]: *** Including module: kdumpbase *** Nov 3 04:00:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730628019', 'host':'kjcf05n03', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128617 MiB (99.98% inode=100%);'}"] Nov 3 04:00:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730628019', 'host':'kjcf05n03', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.91, 1.89, 0.83'}"] Nov 3 04:00:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128617 MiB (99.98% inode=100%);', 'message': 'DISK OK - free space: /tmp 128617 MiB (99.98% inode=100%);', 'value': 'ok', 'timestamp': '1730628019'} Nov 3 04:00:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730628019', 'host':'kjcf05n03', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 335 processes with STATE = RSZDT '}"] Nov 3 04:00:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Load', 'description': 'OK - load average: 1.91, 1.89, 0.83', 'message': 'OK - load average: 1.91, 1.89, 0.83', 'value': 'ok', 'timestamp': '1730628019'} Nov 3 04:00:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Total Processes', 'description': 'PROCS OK: 335 processes with STATE = RSZDT ', 'message': 'PROCS OK: 335 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730628019'} Nov 3 04:00:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:00:20 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 04:00:20 kjcf05n00 mcfcli[3673891]: %3|1730628020.038|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:00:20 kjcf05n03 dracut[7943]: *** Including module: memstrack *** Nov 3 04:00:20 kjcf05n03 dracut[7943]: *** Including module: shutdown *** Nov 3 04:00:20 kjcf05n03 dracut[7943]: *** Including module: squash *** Nov 3 04:00:20 kjcf05n03 dracut[7943]: *** Including modules done *** Nov 3 04:00:20 kjcf05n03 dracut[7943]: *** Installing kernel module dependencies *** Nov 3 04:00:20 kjcf05n00 zabbix-server[933272]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 04:00:20 kjcf05n00 zabbix-server[933272]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n03 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n03:system.uptime): 00:02:47\\"}}"' Nov 3 04:00:20 kjcf05n00 log_interesting_event.py[933272]: Event '45724' acknowledged Nov 3 04:00:21 kjcf05n03 dracut[7943]: *** Installing kernel module dependencies done *** Nov 3 04:00:21 kjcf05n03 dracut[7943]: *** Resolving executable dependencies *** Nov 3 04:00:22 kjcf05n03 dracut[7943]: *** Resolving executable dependencies done*** Nov 3 04:00:22 kjcf05n03 dracut[7943]: *** Hardlinking files *** Nov 3 04:00:22 kjcf05n03 dracut[7943]: *** Hardlinking files done *** Nov 3 04:00:22 kjcf05n03 dracut[7943]: *** Generating early-microcode cpio image *** Nov 3 04:00:22 kjcf05n03 dracut[7943]: *** Constructing AuthenticAMD.bin **** Nov 3 04:00:22 kjcf05n03 dracut[7943]: *** Store current command line parameters *** Nov 3 04:00:22 kjcf05n03 dracut[7943]: Stored kernel commandline: Nov 3 04:00:22 kjcf05n03 dracut[7943]: rd.driver.pre=sd_mod Nov 3 04:00:22 kjcf05n03 dracut[7943]: rd.driver.pre=nvme Nov 3 04:00:22 kjcf05n03 dracut[7943]: rd.driver.pre=ipmi_si Nov 3 04:00:22 kjcf05n03 dracut[7943]: rd.driver.pre=ipmi_devintf Nov 3 04:00:22 kjcf05n03 dracut[7943]: rd.driver.pre=ipmi_msghandler Nov 3 04:00:22 kjcf05n03 dracut[7943]: nameserver=172.16.2.2 Nov 3 04:00:22 kjcf05n03 dracut[7943]: nameserver=127.0.0.1 Nov 3 04:00:22 kjcf05n03 dracut[7943]: nameserver=172.16.2.2 Nov 3 04:00:22 kjcf05n03 dracut[7943]: nameserver=127.0.0.1 Nov 3 04:00:22 kjcf05n03 dracut[7943]: ifname=kdump-meth0:00:09:3d:06:9a:1a team=mgmt0:kdump-meth0 Nov 3 04:00:22 kjcf05n03 dracut[7943]: rd.neednet Nov 3 04:00:22 kjcf05n03 dracut[7943]: kdumpnic=mgmt0 Nov 3 04:00:22 kjcf05n03 dracut[7943]: bootdev=mgmt0 Nov 3 04:00:22 kjcf05n03 dracut[7943]: *** Install squash loader *** Nov 3 04:00:23 kjcf05n03 dracut[7943]: *** Squashing the files inside the initramfs *** Nov 3 04:00:23 kjcf05n03 dracut[7943]: *** Squashing the files inside the initramfs done *** Nov 3 04:00:23 kjcf05n03 dracut[7943]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 04:00:23 kjcf05n03 dracut[7943]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 04:00:24 kjcf05n03 kdumpctl[7829]: kdump: kexec: loaded kdump kernel Nov 3 04:00:24 kjcf05n03 kdumpctl[7829]: kdump: Starting kdump: [OK] Nov 3 04:00:24 kjcf05n03 systemd[1]: Started Crash recovery kernel arming. Nov 3 04:00:24 kjcf05n03 systemd[1]: Reloading. Nov 3 04:00:24 kjcf05n03 systemd[3111]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:00:24 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:00:24 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:00:24 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 04:00:24 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 04:00:24 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 04:00:24 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 04:00:24 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 04:00:24 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 04:00:24 kjcf05n03 ifdown[14552]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 04:00:24 kjcf05n03 ifdown[14553]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:00:24 kjcf05n03 ifdown[14554]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:00:24 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 04:00:24 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 04:00:24 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 04:00:25 kjcf05n03 ifup[14614]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 04:00:25 kjcf05n03 ifup[14615]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:00:25 kjcf05n03 ifup[14616]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:00:24 kjcf05n00 mcfcli[3673891]: %3|1730628024.693|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:00:26 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 04:00:29 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 04:00:29 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 04:00:29 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:00:29 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 04:00:29 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:00:29 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:00:29 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:00:29 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 04:00:29 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 04:00:29 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 04:00:29 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 04:00:29 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:00:29 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:00:29 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:00:29 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:00:29 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 04:00:29 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 04:00:29 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 04:00:29 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 04:00:29 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 04:00:29 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 04:00:29 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 04:00:29 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 04:00:29 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 04:00:29 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 04:00:29 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 04:00:29 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 04:00:29 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 04:00:29 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 04:00:29 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 04:00:29 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 04:00:29 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 04:00:29 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 04:00:29 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 04:00:29 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 04:00:29 kjcf05n03 ifdown[14792]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 04:00:29 kjcf05n03 ifdown[14793]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:00:29 kjcf05n03 ifdown[14794]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:00:29 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 04:00:29 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 04:00:29 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 04:00:30 kjcf05n03 ifup[14854]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 04:00:30 kjcf05n03 ifup[14855]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:00:30 kjcf05n03 ifup[14856]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:00:30 kjcf05n03 dcs-collectord[5612]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 04:00:30 kjcf05n03 dcs-collectord[5612]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 04:00:32 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 04:00:34 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 04:00:34 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 04:00:34 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 04:00:34 kjcf05n03 systemd[1]: Reloading. Nov 3 04:00:34 kjcf05n03 systemd[1]: Starting Corosync Cluster Engine... Nov 3 04:00:34 kjcf05n03 await_ha_peer[15056]: Waiting for HA peer kjcf05n02 Nov 3 04:00:36 kjcf05n03 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 04:00:36 kjcf05n03 await_ha_peer[15056]: Peer kjcf05n02 has started, starting HA Nov 3 04:00:36 kjcf05n03 systemd[1]: Started Corosync Cluster Engine. Nov 3 04:00:36 kjcf05n03 systemd[1]: Started Fast STONITH daemon. Nov 3 04:00:36 kjcf05n03 fstonithd.py[15110]: Listening for kdump packets from partner Nov 3 04:00:36 kjcf05n03 systemd[1]: Reloading. Nov 3 04:00:36 kjcf05n03 systemd[3111]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:00:36 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:00:36 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:00:36 kjcf05n03 systemd[1]: Reloading. Nov 3 04:00:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730628036', 'host':'kjcf05n03', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(840.0B/656.0B), ib1=(896.0B/656.0B), icl0=(5.0kB/6.8kB), lo=(600.0B/600.0B), meth0=(1541.1MB/7.7MB), mgmt0=(1478.0MB/7.7MB)'}"] Nov 3 04:00:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(840.0B/656.0B), ib1=(896.0B/656.0B), icl0=(5.0kB/6.8kB), lo=(600.0B/600.0B), meth0=(1541.1MB/7.7MB), mgmt0=(1478.0MB/7.7MB)', 'message': 'NET OK - (Rx/Tx) ib0=(840.0B/656.0B), ib1=(896.0B/656.0B), icl0=(5.0kB/6.8kB), lo=(600.0B/600.0B), meth0=(1541.1MB/7.7MB), mgmt0=(1478.0MB/7.7MB)', 'value': 'ok', 'timestamp': '1730628036'} Nov 3 04:00:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:00:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730628036', 'host':'kjcf05n03', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 04:00:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730628036'} Nov 3 04:00:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:00:37 kjcf05n03 systemd[1]: Reached target resource-agents dependencies. Nov 3 04:00:37 kjcf05n03 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 04:00:37 kjcf05n03 systemd[1]: Reloading. Nov 3 04:00:37 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 04:00:37 kjcf05n03 puppet-agent[3543]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:00:37 kjcf05n03 puppet[3543]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:00:37 kjcf05n03 puppet-agent[3543]: Applied catalog in 93.15 seconds Nov 3 04:00:37 kjcf05n03 puppet[3543]: Notice: Applied catalog in 93.15 seconds Nov 3 04:00:37 kjcf05n03 systemd[1]: Started Puppet agent. Nov 3 04:00:37 kjcf05n03 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 04:00:37 kjcf05n03 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 04:00:37 kjcf05n03 systemd[1]: Starting Set absolute GEM time... Nov 3 04:00:37 kjcf05n03 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 04:00:37 kjcf05n03 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 04:00:37 kjcf05n03 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 04:00:37 kjcf05n03 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 04:00:37 kjcf05n03 systemd[1]: Reached target Timers. Nov 3 04:00:37 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 04:00:37 kjcf05n03 wce-disable.sh[15262]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 04:00:37 kjcf05n03 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 04:00:37 kjcf05n03 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 04:00:37 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 04:00:37 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 04:00:37 kjcf05n03 systemd[1]: set_gem_time.service: Succeeded. Nov 3 04:00:37 kjcf05n03 systemd[1]: Started Set absolute GEM time. Nov 3 04:00:38 kjcf05n03 python3.9[15266]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 04:00:38 kjcf05n03 python3.9[15266]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 04:00:38 kjcf05n03 gateway-ec-node.py[15267]: Starting gateway-ec-node service Nov 3 04:00:38 kjcf05n03 RFSF-API[15265]: INFO[2024-11-03T04:00:37-06:00] Datapath API RESTful Service starting Nov 3 04:00:38 kjcf05n03 dp-api-server-node[15265]: INFO[2024-11-03T04:00:37-06:00] Datapath API RESTful Service starting Nov 3 04:00:38 kjcf05n03 RFSF-API[15265]: INFO[2024-11-03T04:00:38-06:00] Running in production mode, starting dbus event listener Nov 3 04:00:38 kjcf05n03 dp-api-server-node[15265]: INFO[2024-11-03T04:00:38-06:00] Running in production mode, starting dbus event listener Nov 3 04:00:38 kjcf05n03 RFSF-API[15265]: INFO[2024-11-03T04:00:38-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 04:00:38 kjcf05n03 dp-api-server-node[15265]: INFO[2024-11-03T04:00:38-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 04:00:38 kjcf05n03 RFSF-API[15265]: INFO[2024-11-03T04:00:38-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 04:00:38 kjcf05n03 dp-api-server-node[15265]: INFO[2024-11-03T04:00:38-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 04:00:38 kjcf05n03 RFSF-API[15265]: INFO[2024-11-03T04:00:38-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 04:00:38 kjcf05n03 dp-api-server-node[15265]: INFO[2024-11-03T04:00:38-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 04:00:38 kjcf05n03 RFSF-API[15265]: INFO[2024-11-03T04:00:38-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 04:00:38 kjcf05n03 dp-api-server-node[15265]: INFO[2024-11-03T04:00:38-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 04:00:38 kjcf05n03 RFSF-API[15265]: INFO[2024-11-03T04:00:38-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 04:00:38 kjcf05n03 dp-api-server-node[15265]: INFO[2024-11-03T04:00:38-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 04:00:38 kjcf05n03 RFSF-API[15265]: INFO[2024-11-03T04:00:38-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 04:00:38 kjcf05n03 dp-api-server-node[15265]: INFO[2024-11-03T04:00:38-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 04:00:38 kjcf05n03 RFSF-API[15265]: INFO[2024-11-03T04:00:38-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 04:00:38 kjcf05n03 dp-api-server-node[15265]: INFO[2024-11-03T04:00:38-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 04:00:38 kjcf05n03 RFSF-API[15265]: INFO[2024-11-03T04:00:38-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 04:00:38 kjcf05n03 dp-api-server-node[15265]: INFO[2024-11-03T04:00:38-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 04:00:38 kjcf05n03 RFSF-API[15265]: INFO[2024-11-03T04:00:38-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 04:00:38 kjcf05n03 dp-api-server-node[15265]: INFO[2024-11-03T04:00:38-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 04:00:38 kjcf05n03 RFSF-API[15265]: INFO[2024-11-03T04:00:38-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 04:00:38 kjcf05n03 dp-api-server-node[15265]: INFO[2024-11-03T04:00:38-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 04:00:43 kjcf05n03 systemd[1]: Reloading. Nov 3 04:00:43 kjcf05n03 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 04:00:43 kjcf05n03 systemd[1]: Reloading. Nov 3 04:00:43 kjcf05n03 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 04:00:44 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/21', errno='Permission denied (13)' Nov 3 04:00:44 kjcf05n03 diskmonitor_pre[15698]: Key management is currently disabled.DEAR disabled Nov 3 04:00:44 kjcf05n03 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 04:00:45 kjcf05n03 dcs-collectord[5612]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 04:00:45 kjcf05n03 dcs-collectord[5612]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 04:00:45 kjcf05n03 dcs-collectord[5612]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 04:00:45 kjcf05n03 sh[15759]: LNET configured: New Created Nov 3 04:00:45 kjcf05n03 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 04:00:45 kjcf05n03 LCNmon[17770]: Interface ib0 is up Nov 3 04:00:45 kjcf05n03 LCNmon[17770]: Interface ib1 is up Nov 3 04:00:45 kjcf05n03 LCNmon[17770]: Can ping through interface ib0 Nov 3 04:00:45 kjcf05n03 LCNmon[17770]: Can ping through interface ib1 Nov 3 04:00:45 kjcf05n03 LCNmon[17770]: NIC ib0, initial state UP Nov 3 04:00:45 kjcf05n03 LCNmon[17770]: NIC ib1, initial state UP Nov 3 04:00:45 kjcf05n03 LCNmon[17770]: LCNstat initial state UP Nov 3 04:00:46 kjcf05n03 LCNmon[17770]: LCNmon monitoring hosts kjcf05n03 and kjcf05n02 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: /var/run/diskmonitor does not exist, creating Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: Creating /var/run/diskmonitor/disk Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: Creating /var/run/diskmonitor/encl Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: Creating /var/run/diskmonitor/cli Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: RAS_Interlocks_enabled: 1 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: add handler for sig: 14 sa_flags: 10000004 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: add handler for sig: 1 sa_flags: 10000004 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: add handler for sig: 2 sa_flags: 00000004 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: add handler for sig: 15 sa_flags: 00000004 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: add handler for sig: 6 sa_flags: 00000004 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: add handler for sig: 3 sa_flags: 00000004 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: add handler for sig: 30 sa_flags: 00000004 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: add handler for sig: 20 sa_flags: 00000004 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: add handler for sig: 10 sa_flags: 10000004 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: add handler for sig: 11 sa_flags: 00000004 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: add handler for sig: 7 sa_flags: 00000004 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: add handler for sig: 4 sa_flags: 00000004 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: add handler for sig: 8 sa_flags: 00000004 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: Using HA Baton locks - key: diskmonitor Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: Baton will be held for at most 570 seconds Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: DMMP Enabled: 0 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: random seed: 2e50f69 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: NVMe Enclosure: 1 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: ZFS Enclosure: 0 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: Dbus, Initialized Connection Successfully Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: int_catcher_thread: thread start Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: Received dbus message 4 org.freedesktop.DBus -> :1.90 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b07bec_S4EUNF0MA05386M encl_slot: 0 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b07bed_S4EUNF0MA05387D encl_slot: 0 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 04:00:48 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 04:00:48 kjcf05n00 httpd[902569]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-B): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n03', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 04:00:49 kjcf05n03 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 04:00:49 kjcf05n03 openhpid[5518]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 04:00:49 kjcf05n03 openhpid[5518]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 04:00:50 kjcf05n03 systemd[1]: openhpid.service: Succeeded. Nov 3 04:00:50 kjcf05n03 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 04:00:50 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 04:00:50 kjcf05n03 systemd[1]: openhpid.service: Supervising process 18301 which is not our child. We'll most likely not notice when it exits. Nov 3 04:00:50 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 04:00:50 kjcf05n03 systemd[1]: Reached target Multi-User System. Nov 3 04:00:50 kjcf05n03 systemd[1]: Reached target Graphical Interface. Nov 3 04:00:50 kjcf05n03 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 04:00:50 kjcf05n03 dcs-collectord[5612]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 04:00:50 kjcf05n03 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 04:00:50 kjcf05n03 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 04:00:50 kjcf05n03 systemd[1]: Startup finished in 50.243s (kernel) + 2min 28.839s (userspace) = 3min 19.082s. Nov 3 04:00:50 kjcf05n03 openhpid[18301]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 04:00:50 kjcf05n03 openhpid[18301]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 04:00:50 kjcf05n03 openhpid[18301]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 04:00:50 kjcf05n03 openhpid[18301]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 04:00:50 kjcf05n00 mcfcli[3673891]: %3|1730628050.038|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 04:00:51 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18374 (bash) Nov 3 04:00:51 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 04:00:51 kjcf05n03 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 04:00:51 kjcf05n03 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 04:00:51 kjcf05n03 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 04:00:51 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 04:00:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730628051', 'host':'kjcf05n03', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.7% (4381432 kB) used.'}"] Nov 3 04:00:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'RAM usage', 'description': 'OK - 1.7% (4381432 kB) used.', 'message': 'OK - 1.7% (4381432 kB) used.', 'value': 'ok', 'timestamp': '1730628051'} Nov 3 04:00:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 04:00:54 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 04:00:56 kjcf05n02 nslcd[6978]: [16e9e8] ldap_result() failed: Can't contact LDAP server Nov 3 04:00:56 kjcf05n02 nslcd[6978]: [90cde7] ldap_result() failed: Can't contact LDAP server Nov 3 04:00:56 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31411 deleted. Nov 3 04:01:00 kjcf05n03 dcs-collectord[5612]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 04:01:00 kjcf05n03 dcs-collectord[5612]: WARNING No data collected (hpi_parser.py:353) Nov 3 04:01:04 kjcf05n00 mcfcli[3673891]: %3|1730628064.690|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:01:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730628065', 'host':'kjcf05n03', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 04:01:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730628065'} Nov 3 04:01:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730628065', 'host':'kjcf05n03', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 04:01:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730628065'} Nov 3 04:01:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:01:14 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 04:01:14 kjcf05n03 ipmievd[3955]: System Event sensor - Timestamp Clock Sync Nov 3 04:01:15 kjcf05n03 ipmievd[3111]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:01:15 kjcf05n03 dcs-collectord[5612]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 04:01:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730628076', 'host':'kjcf05n03', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 04:01:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730628076'} Nov 3 04:01:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:01:20 kjcf05n00 mcfcli[3673891]: %3|1730628080.038|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b07bed_S4EUNF0MA05387D encl_sn: USE26000024VS001, slot: 2 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b07bec_S4EUNF0MA05386M encl_sn: USE26000024VS001, slot: 1 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 04:01:27 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 04:01:30 kjcf05n03 dcs-collectord[5612]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 04:01:35 kjcf05n02 firmware-update-orc-server[5898]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "575b7da2-fd9f-4d2d-b791-2a1079ee5225"} (logger.py:65) Nov 3 04:01:35 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 205342 (get_disk_device) Nov 3 04:01:35 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 04:01:35 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 04:01:35 kjcf05n03 diskmonitor[17208]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 04:01:35 kjcf05n03 ras-resource-manager-agent[5876]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "9bb31262-99ca-11ef-86c2-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 04:01:35 kjcf05n03 ras-resource-manager-agent[5876]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '9bb31262-99ca-11ef-86c2-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 04:01:35 kjcf05n03 ras-resource-manager-agent[5876]: INFO Submitting new device inserted signal, starting to qualify drive: 9bb31262-99ca-11ef-86c2-00093d069a1b (admin_action.py:110) Nov 3 04:01:34 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '9bb31262-99ca-11ef-86c2-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 04:01:34 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '9bb31262-99ca-11ef-86c2-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 04:01:34 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '9bb31262-99ca-11ef-86c2-00093d069a1b', 'response ID': '9bbdff38-99ca-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 04:01:34 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 9bbdff38-99ca-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 04:01:35 kjcf05n02 ccp-client[205364]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 04:01:35 kjcf05n02 ccp-client[205364]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 04:01:35 kjcf05n02 ccp-client[205387]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 04:01:35 kjcf05n02 ccp-client[205364]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 04:01:35 kjcf05n02 ccp-client[205364]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 04:01:35 kjcf05n02 ccp-client[205387]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 04:01:35 kjcf05n02 ccp-client[205387]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 04:01:35 kjcf05n03 diskmonitor[17208]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 04:01:35 kjcf05n03 ras-resource-manager-agent[5876]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "9c0435ca-99ca-11ef-86c2-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 04:01:35 kjcf05n03 ras-resource-manager-agent[5876]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '9c0435ca-99ca-11ef-86c2-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 04:01:35 kjcf05n03 ras-resource-manager-agent[5876]: INFO Submitting new device inserted signal, starting to qualify drive: 9c0435ca-99ca-11ef-86c2-00093d069a1b (admin_action.py:110) Nov 3 04:01:35 kjcf05n03 firmware-update-orc-server[5832]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "4c0cb098-8203-4dad-8abb-66b9aee2570d"} (logger.py:65) Nov 3 04:01:35 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '9c0435ca-99ca-11ef-86c2-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 04:01:35 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '9c0435ca-99ca-11ef-86c2-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 04:01:35 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '9c0435ca-99ca-11ef-86c2-00093d069a1b', 'response ID': '9c0bd190-99ca-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 04:01:35 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 9c0bd190-99ca-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 04:01:38 kjcf05n02 DRVFW[205498]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 04:01:38 kjcf05n02 ccp-client[205499]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 04:01:38 kjcf05n02 ccp-client[205499]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 04:01:38 kjcf05n02 ccp-client[205508]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 04:01:38 kjcf05n02 ccp-client[205499]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 04:01:38 kjcf05n02 ccp-client[205508]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 04:01:38 kjcf05n02 ccp-client[205508]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 04:01:38 kjcf05n02 ccp-client[205499]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 04:01:38 kjcf05n02 firmware-update-orc-server[5898]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 04:01:39 kjcf05n03 ras-resource-manager-agent[5876]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '9bb31262-99ca-11ef-86c2-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 04:01:39 kjcf05n03 ras-resource-manager-agent[5876]: INFO Drive qualification complete responding: 9bb31262-99ca-11ef-86c2-00093d069a1b (admin_action.py:205) Nov 3 04:01:39 kjcf05n03 ras-resource-manager-agent[5876]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "9bb31262-99ca-11ef-86c2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (interesting_event.py:59) Nov 3 04:01:38 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 9bbdff38-99ca-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 04:01:38 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '9bb31262-99ca-11ef-86c2-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': '9bb31262-99ca-11ef-86c2-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}}} (logger.py:65) Nov 3 04:01:42 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 04:01:42 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 04:01:42 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 04:01:42 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 04:01:42 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 04:01:42 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 04:01:42 kjcf05n03 diskmonitor[17208]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 04:01:42 kjcf05n03 diskmonitor[17208]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 04:01:42 kjcf05n03 diskmonitor[17208]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 04:01:42 kjcf05n03 diskmonitor[17208]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 04:01:42 kjcf05n03 diskmonitor[17208]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 04:01:42 kjcf05n03 diskmonitor[17208]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "9bb31262-99ca-11ef-86c2-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 04:01:42 kjcf05n03 diskmonitor[17208]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 04:01:42 kjcf05n03 diskmonitor[17208]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 04:01:42 kjcf05n03 diskmonitor[17208]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "9c0435ca-99ca-11ef-86c2-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 04:01:42 kjcf05n03 diskmonitor[17208]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 04:01:42 kjcf05n03 diskmonitor[17208]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 04:01:44 kjcf05n00 mcfcli[3673891]: %3|1730628104.577|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:01:47 kjcf05n03 chronyd[5120]: Selected source 172.16.2.1 Nov 3 04:01:50 kjcf05n00 mcfcli[3673891]: %3|1730628110.040|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 04:01:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730628110}"] Nov 3 04:01:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730628110, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:01:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:01:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730628110}"] Nov 3 04:01:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730628110, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:01:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:01:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730628110}"] Nov 3 04:01:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730628110, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:01:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:01:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730628110}"] Nov 3 04:01:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730628110, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:01:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:01:50 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22366 (get_disk_device) Nov 3 04:01:50 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 04:01:50 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 04:01:50 kjcf05n03 ccp-client[22389]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 04:01:50 kjcf05n03 ccp-client[22389]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 04:01:50 kjcf05n03 ccp-client[22401]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 04:01:50 kjcf05n03 ccp-client[22389]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 04:01:50 kjcf05n03 ccp-client[22401]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 04:01:50 kjcf05n03 ccp-client[22401]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 04:01:50 kjcf05n03 ccp-client[22389]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 04:01:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730628110}"] Nov 3 04:01:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730628110, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:01:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:01:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730628110}"] Nov 3 04:01:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730628110, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:01:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:01:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730628110}"] Nov 3 04:01:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730628110, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:01:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:01:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730628110}"] Nov 3 04:01:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730628110, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:01:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:01:51 kjcf05n03 systemd[1]: Unmounting /mnt/llog... Nov 3 04:01:51 kjcf05n03 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 04:01:51 kjcf05n03 systemd[1]: Unmounted /mnt/llog. Nov 3 04:01:53 kjcf05n03 python3.9[5182]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 04:01:54 kjcf05n03 python3.9[3111]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:01:54 kjcf05n03 DRVFW[22583]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 04:01:54 kjcf05n03 ccp-client[22584]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 04:01:54 kjcf05n03 ccp-client[22584]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 04:01:54 kjcf05n03 ccp-client[22593]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 04:01:54 kjcf05n03 ccp-client[22584]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 04:01:54 kjcf05n03 ccp-client[22584]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 04:01:54 kjcf05n03 ccp-client[22593]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 04:01:54 kjcf05n03 ccp-client[22593]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 04:01:54 kjcf05n03 firmware-update-orc-server[5832]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 04:01:55 kjcf05n03 ras-resource-manager-agent[5876]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "9bb31262-99ca-11ef-86c2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (service_main_handler.py:66) Nov 3 04:01:55 kjcf05n03 ras-resource-manager-agent[5876]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '9bb31262-99ca-11ef-86c2-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 04:01:55 kjcf05n03 ras-resource-manager-agent[5876]: INFO Device qualification response has been acknowledged: 9bb31262-99ca-11ef-86c2-00093d069a1b (admin_action.py:151) Nov 3 04:01:55 kjcf05n03 ras-resource-manager-agent[5876]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '9c0435ca-99ca-11ef-86c2-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 04:01:55 kjcf05n03 ras-resource-manager-agent[5876]: INFO Drive qualification complete responding: 9c0435ca-99ca-11ef-86c2-00093d069a1b (admin_action.py:205) Nov 3 04:01:55 kjcf05n03 ras-resource-manager-agent[5876]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "9c0435ca-99ca-11ef-86c2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (interesting_event.py:59) Nov 3 04:01:55 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 9c0bd190-99ca-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 04:01:55 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '9c0435ca-99ca-11ef-86c2-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': '9c0435ca-99ca-11ef-86c2-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}}} (logger.py:65) Nov 3 04:01:59 kjcf05n03 diskmonitor[17208]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 04:01:59 kjcf05n03 diskmonitor[17208]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 04:01:59 kjcf05n03 ras-resource-manager-agent[5876]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "aa668b90-99ca-11ef-86c2-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 04:01:59 kjcf05n03 ras-resource-manager-agent[5876]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'aa668b90-99ca-11ef-86c2-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 04:01:59 kjcf05n03 ras-resource-manager-agent[5876]: INFO Requests ['9c0435ca-99ca-11ef-86c2-00093d069a1b', 'aa668b90-99ca-11ef-86c2-00093d069a1b'] already in progress (admin_action.py:99) Nov 3 04:01:59 kjcf05n03 ras-resource-manager-agent[5876]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'aa668b90-99ca-11ef-86c2-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 04:01:59 kjcf05n03 ras-resource-manager-agent[5876]: INFO Drive qualification complete responding: aa668b90-99ca-11ef-86c2-00093d069a1b (admin_action.py:205) Nov 3 04:01:59 kjcf05n03 ras-resource-manager-agent[5876]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "9c0435ca-99ca-11ef-86c2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (interesting_event.py:59) Nov 3 04:01:59 kjcf05n03 ras-resource-manager-agent[5876]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "aa668b90-99ca-11ef-86c2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (interesting_event.py:59) Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "9bb31262-99ca-11ef-86c2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: Dbus, handle_ingress_ras_signals, uuid: 9bb31262-99ca-11ef-86c2-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "9bb31262-99ca-11ef-86c2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: main: Pending firmware leveling requests exist, rescanning disks Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "aa668b90-99ca-11ef-86c2-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: leaving test state: 1 next state: 2 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: lock req: no timeout Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: leaving test state: 2 next state: 4 Nov 3 04:02:06 kjcf05n03 diskmonitor[17208]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 04:02:20 kjcf05n00 mcfcli[3673891]: %3|1730628140.040|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 04:02:24 kjcf05n00 mcfcli[3673891]: %3|1730628144.308|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:02:43 kjcf05n03 ras-resource-manager-agent[5876]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "9c0435ca-99ca-11ef-86c2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (service_main_handler.py:66) Nov 3 04:02:43 kjcf05n03 ras-resource-manager-agent[5876]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '9c0435ca-99ca-11ef-86c2-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 04:02:43 kjcf05n03 ras-resource-manager-agent[5876]: INFO Device qualification response has been acknowledged: 9c0435ca-99ca-11ef-86c2-00093d069a1b (admin_action.py:151) Nov 3 04:02:43 kjcf05n03 ras-resource-manager-agent[5876]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "9c0435ca-99ca-11ef-86c2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (service_main_handler.py:66) Nov 3 04:02:43 kjcf05n03 ras-resource-manager-agent[5876]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '9c0435ca-99ca-11ef-86c2-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 04:02:43 kjcf05n03 ras-resource-manager-agent[5876]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "aa668b90-99ca-11ef-86c2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (service_main_handler.py:66) Nov 3 04:02:43 kjcf05n03 ras-resource-manager-agent[5876]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'aa668b90-99ca-11ef-86c2-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 04:02:43 kjcf05n03 ras-resource-manager-agent[5876]: INFO Device qualification response has been acknowledged: aa668b90-99ca-11ef-86c2-00093d069a1b (admin_action.py:151) Nov 3 04:02:43 kjcf05n03 diskmonitor[17208]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 04:02:50 kjcf05n00 mcfcli[3673891]: %3|1730628170.040|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:02:55 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 04:02:55 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 04:02:55 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 04:03:00 kjcf05n03 diskmonitor[17208]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "9c0435ca-99ca-11ef-86c2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 3 04:03:00 kjcf05n03 diskmonitor[17208]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 04:03:00 kjcf05n03 diskmonitor[17208]: Dbus, handle_ingress_ras_signals, uuid: 9c0435ca-99ca-11ef-86c2-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 04:03:00 kjcf05n03 diskmonitor[17208]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 04:03:00 kjcf05n03 diskmonitor[17208]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "9c0435ca-99ca-11ef-86c2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 3 04:03:00 kjcf05n03 diskmonitor[17208]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "9c0435ca-99ca-11ef-86c2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 3 04:03:00 kjcf05n03 diskmonitor[17208]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 04:03:00 kjcf05n03 diskmonitor[17208]: Dbus, handle_ingress_ras_signals, uuid: 9c0435ca-99ca-11ef-86c2-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 04:03:00 kjcf05n03 diskmonitor[17208]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "9c0435ca-99ca-11ef-86c2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 3 04:03:00 kjcf05n03 diskmonitor[17208]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "aa668b90-99ca-11ef-86c2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 3 04:03:00 kjcf05n03 diskmonitor[17208]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 04:03:00 kjcf05n03 diskmonitor[17208]: Dbus, handle_ingress_ras_signals, uuid: aa668b90-99ca-11ef-86c2-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 04:03:00 kjcf05n03 diskmonitor[17208]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "aa668b90-99ca-11ef-86c2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 3 04:03:00 kjcf05n03 diskmonitor[17208]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 04:03:00 kjcf05n03 diskmonitor[17208]: lock acquired Nov 3 04:03:00 kjcf05n03 diskmonitor[17208]: leaving test state: 4 next state: 8 Nov 3 04:03:00 kjcf05n03 diskmonitor[17208]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 04:03:02 kjcf05n00 mcfcli[3673891]: %3|1730628182.398|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:03:11 kjcf05n03 dcs-collectord[5612]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 04:03:11 kjcf05n03 diskmonitor[17208]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 04:03:11 kjcf05n03 diskmonitor[17208]: leaving test state: 8 next state: 20 Nov 3 04:03:11 kjcf05n03 diskmonitor[17208]: leaving test state: 20 next state: 40 Nov 3 04:03:11 kjcf05n03 diskmonitor[17208]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 1625a208000 Nov 3 04:03:11 kjcf05n03 diskmonitor[17208]: leaving test state: 40 next state: 80 Nov 3 04:03:11 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 04:03:11 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 04:03:11 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 04:03:20 kjcf05n00 mcfcli[3673891]: %3|1730628200.040|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 04:03:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730628201}"] Nov 3 04:03:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730628201, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:03:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:03:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:03:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:03:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:03:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:03:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:03:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:03:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:03:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:03:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:03:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:03:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:03:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:03:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.955172ms Nov 3 04:03:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:03:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.955172ms Nov 3 04:03:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:03:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:03:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:03:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730628202}"] Nov 3 04:03:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730628202, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:03:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:03:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:03:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:03:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:03:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:03:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:03:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:03:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:03:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:03:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:03:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:03:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:03:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:03:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.560001ms Nov 3 04:03:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:03:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.560001ms Nov 3 04:03:22 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:03:22 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:03:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T04:03:27.252756406-06:00 level=info msg="Completed cleanup jobs" duration=26.107041ms Nov 3 04:03:38 kjcf05n00 mcfcli[3673891]: %3|1730628218.191|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:03:50 kjcf05n00 mcfcli[3673891]: %3|1730628230.041|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:03:56 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31412 deleted. Nov 3 04:04:12 kjcf05n03 diskmonitor[17208]: leaving test state: 80 next state: 100 Nov 3 04:04:12 kjcf05n03 diskmonitor[17208]: lock release: time: Sun Nov 3 04:04:07 2024 Nov 3 04:04:12 kjcf05n03 diskmonitor[17208]: leaving test state: 100 next state: 1 Nov 3 04:04:18 kjcf05n00 mcfcli[3673891]: %3|1730628258.100|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:04:20 kjcf05n00 mcfcli[3673891]: %3|1730628260.041|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:04:50 kjcf05n00 mcfcli[3673891]: %3|1730628290.042|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:04:57 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 04:04:58 kjcf05n00 mcfcli[3673891]: %3|1730628298.097|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:05:01 kjcf05n00 python3.9[935946]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 04:05:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730627717', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 04:05:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730627717'} Nov 3 04:05:14 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:05:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730627717', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 04:05:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730627717'} Nov 3 04:05:14 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:05:20 kjcf05n00 mcfcli[3673891]: %3|1730628320.043|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:05:34 kjcf05n00 mcfcli[3673891]: %3|1730628334.050|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:05:50 kjcf05n00 mcfcli[3673891]: %3|1730628350.043|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 04:05:56 kjcf05n00 zabbix-server[936642]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 04:05:56 kjcf05n00 zabbix-server[936642]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n03' from event '45736' Nov 3 04:05:57 kjcf05n00 zabbix-server[936642]: Host created 'enclosure_USE26000024VS001' Nov 3 04:05:57 kjcf05n00 zabbix-server[936642]: Running puppet on 'kjcf05n03' Nov 3 04:05:59 kjcf05n03 puppet-agent[32859]: Using configured environment 'production' Nov 3 04:05:59 kjcf05n03 puppet-agent[32859]: Retrieving pluginfacts Nov 3 04:05:59 kjcf05n03 puppet-agent[32859]: Retrieving plugin Nov 3 04:05:59 kjcf05n03 puppet-agent[32859]: Loading facts Nov 3 04:06:02 kjcf05n03 puppet-agent[32859]: Caching catalog for kjcf05n03 Nov 3 04:06:02 kjcf05n03 puppet-agent[32859]: Applying configuration version '1730628360' Nov 3 04:06:04 kjcf05n03 puppet-agent[32859]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 04:06:04 kjcf05n03 puppet-agent[32859]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 04:06:04 kjcf05n03 puppet-agent[32859]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 04:06:05 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 04:06:05 kjcf05n03 zabbix_agent2[5960]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 04:06:05 kjcf05n03 zabbix_agent2[3111]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:06:05 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 04:06:05 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 04:06:05 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 04:06:05 kjcf05n03 puppet-agent[32859]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: Press Ctrl+C to exit. Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: Plugin support version 1.0 Nov 3 04:06:05 kjcf05n03 zabbix_agent2[33210]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 04:06:07 kjcf05n03 puppet-agent[32859]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 04:06:07 kjcf05n03 puppet-agent[32859]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 04:06:07 kjcf05n03 puppet-agent[32859]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 04:06:08 kjcf05n03 puppet-agent[32859]: Applied catalog in 5.11 seconds Nov 3 04:06:07 kjcf05n00 zabbix-server[936642]: puppet completed status:(0): '' Nov 3 04:06:07 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 04:06:07 kjcf05n00 zabbix-server[936642]: Event '45736' acknowledged Nov 3 04:06:07 kjcf05n00 zabbix-server[936642]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n03"}' Nov 3 04:06:12 kjcf05n00 mcfcli[3673891]: %3|1730628372.969|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:06:20 kjcf05n00 mcfcli[3673891]: %3|1730628380.044|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 04:06:50 kjcf05n00 mcfcli[3673891]: %3|1730628410.045|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 04:06:52 kjcf05n00 mcfcli[3673891]: %3|1730628412.742|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:07:20 kjcf05n00 mcfcli[3673891]: %3|1730628440.045|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:07:30 kjcf05n00 mcfcli[3673891]: %3|1730628450.814|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:07:40 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 3 04:07:50 kjcf05n00 mcfcli[3673891]: %3|1730628470.045|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 04:08:06 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 3 04:08:06 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 3 04:08:06 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 3 04:08:06 kjcf05n00 mcfcli[3673891]: %3|1730628486.326|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:08:08 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 3 04:08:08 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 3 04:08:20 kjcf05n00 mcfcli[3673891]: %3|1730628500.046|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 04:08:33 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 3 04:08:45 kjcf05n00 mcfcli[3673891]: %3|1730628525.752|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:08:50 kjcf05n00 mcfcli[3673891]: %3|1730628530.046|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:09:02 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 3 04:09:02 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 3 04:09:20 kjcf05n00 mcfcli[3673891]: %3|1730628560.048|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:09:24 kjcf05n00 mcfcli[3673891]: %3|1730628564.643|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:09:50 kjcf05n00 mcfcli[3673891]: %3|1730628590.048|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 04:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 04:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 04:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 04:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 04:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 04:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 04:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 04:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 04:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 04:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 04:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 04:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 04:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 04:10:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 04:10:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:10:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 04:10:01 kjcf05n00 python3.9[938794]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 04:10:02 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 04:10:02 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 04:10:02 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 04:10:04 kjcf05n00 mcfcli[3673891]: %3|1730628604.611|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:10:20 kjcf05n00 mcfcli[3673891]: %3|1730628620.049|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:10:41 kjcf05n00 mcfcli[3673891]: %3|1730628641.882|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:10:46 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 3 04:10:46 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 3 04:10:46 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 3 04:10:50 kjcf05n00 mcfcli[3673891]: %3|1730628650.049|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 04:11:20 kjcf05n00 mcfcli[3673891]: %3|1730628680.050|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:11:20 kjcf05n00 mcfcli[3673891]: %3|1730628680.674|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:11:25 kjcf05n03 root[41402]: failback_xyraid Nov 3 04:11:26 kjcf05n03 root[41520]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 04:11:27 kjcf05n03 root[41594]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 04:11:28 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 04:11:28 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 04:11:28 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 04:11:31 kjcf05n02 systemd[1]: data-kjcf05n03:md66.mount: Succeeded. Nov 3 04:11:35 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme21n1 Nov 3 04:11:35 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme11n1 Nov 3 04:11:35 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme10n1 Nov 3 04:11:35 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme5n1 Nov 3 04:11:35 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme6n1 Nov 3 04:11:35 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme15n1 Nov 3 04:11:35 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme7n1 Nov 3 04:11:35 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme12n1 Nov 3 04:11:35 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme16n1 Nov 3 04:11:35 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme22n1 Nov 3 04:11:35 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme20n1 Nov 3 04:11:37 kjcf05n03 dwd[5153]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 04:11:37 kjcf05n03 dwd[5153]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 04:11:37 kjcf05n03 dwd[5153]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 04:11:37 kjcf05n03 dwd[5153]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 04:11:37 kjcf05n03 dwd[5153]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 04:11:37 kjcf05n03 dwd[5153]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 04:11:37 kjcf05n03 dwd[5153]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 04:11:37 kjcf05n03 dwd[5153]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 04:11:37 kjcf05n03 dwd[5153]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 04:11:37 kjcf05n03 dwd[5153]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 04:11:37 kjcf05n03 dwd[5153]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 04:11:37 kjcf05n03 dwd[5153]: Starting NVME thread for nvme10n1 Nov 3 04:11:37 kjcf05n03 dwd[5153]: Starting NVME thread for nvme15n1 Nov 3 04:11:37 kjcf05n03 dwd[5153]: Starting NVME thread for nvme21n1 Nov 3 04:11:37 kjcf05n03 dwd[5153]: Starting NVME thread for nvme11n1 Nov 3 04:11:37 kjcf05n03 dwd[5153]: Starting NVME thread for nvme20n1 Nov 3 04:11:37 kjcf05n03 systemd-udevd[44373]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44374]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44376]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44377]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44373]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44374]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44376]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44377]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44373]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44374]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44377]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44376]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44373]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44374]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44377]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44376]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44373]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44374]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44377]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44376]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44373]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44374]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44377]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44376]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44373]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44374]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44377]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44373]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44376]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44377]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44374]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44376]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 04:11:37 kjcf05n03 systemd-udevd[44411]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44414]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44415]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44410]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44417]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44415]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44414]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44410]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44417]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44414]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44410]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44417]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44410]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44417]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44414]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44410]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44414]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44410]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44414]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44410]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44414]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44410]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44410]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44414]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44410]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44414]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44410]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 dwd[5153]: Starting NVME thread for nvme12n1 Nov 3 04:11:38 kjcf05n03 systemd-udevd[44414]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44410]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44410]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44410]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 systemd-udevd[44410]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:11:38 kjcf05n03 dwd[5153]: Starting NVME thread for nvme7n1 Nov 3 04:11:38 kjcf05n03 dwd[5153]: Starting NVME thread for nvme6n1 Nov 3 04:11:38 kjcf05n03 dwd[5153]: Starting NVME thread for nvme5n1 Nov 3 04:11:38 kjcf05n03 dwd[5153]: Starting NVME thread for nvme16n1 Nov 3 04:11:38 kjcf05n03 dwd[5153]: Starting NVME thread for nvme22n1 Nov 3 04:11:39 kjcf05n03 nslcd[6914]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 04:11:40 kjcf05n03 dcs-bulk-data-sender[6144]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 3 04:11:49 kjcf05n03 diskmonitor[17208]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 04:11:50 kjcf05n00 mcfcli[3673891]: %3|1730628710.051|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:11:56 kjcf05n03 diskmonitor[17208]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 04:11:56 kjcf05n03 diskmonitor[17208]: Scan for ReadErrorMax change for md66 Nov 3 04:11:56 kjcf05n03 diskmonitor[17208]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 04:11:56 kjcf05n03 diskmonitor[17208]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 04:11:56 kjcf05n03 diskmonitor[17208]: read_saved_file: md66 no saved speed Nov 3 04:11:56 kjcf05n03 diskmonitor[17208]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 04:11:56 kjcf05n03 diskmonitor[17208]: Set sync_speed_min (10000) for md66 Nov 3 04:11:56 kjcf05n03 diskmonitor[17208]: Set sync_speed_max (200000) for md66 Nov 3 04:11:56 kjcf05n03 diskmonitor[17208]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 04:12:00 kjcf05n00 mcfcli[3673891]: %3|1730628720.191|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:12:08 kjcf05n02 diskmonitor[17478]: Removed MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 04:12:08 kjcf05n02 diskmonitor[17478]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 04:12:20 kjcf05n00 mcfcli[3673891]: %3|1730628740.051|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:12:32 kjcf05n03 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 04:12:32 kjcf05n03 systemd-tmpfiles[47089]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 04:12:32 kjcf05n03 systemd-tmpfiles[47089]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 04:12:32 kjcf05n03 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 04:12:32 kjcf05n03 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 04:12:34 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47365 (bash) Nov 3 04:12:34 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 04:12:34 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 04:12:40 kjcf05n00 mcfcli[3673891]: %3|1730628760.188|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:12:50 kjcf05n00 mcfcli[3673891]: %3|1730628770.051|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:13:18 kjcf05n00 mcfcli[3673891]: %3|1730628798.507|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:13:20 kjcf05n00 mcfcli[3673891]: %3|1730628800.052|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 04:13:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730628800}"] Nov 3 04:13:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730628800, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:13:20 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:20-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:20 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:20-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:20 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:20-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:20 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:20-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:20 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:20-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:20 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:20-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:20 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:20-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.001258ms Nov 3 04:13:20 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:20-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.001258ms Nov 3 04:13:20 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:13:20 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:13:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:13:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730628800}"] Nov 3 04:13:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730628800, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:13:20 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:20-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:20 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:20-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:20 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:20-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:20 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:20-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:20 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:20-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:20 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:20-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:20 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:20-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.300268ms Nov 3 04:13:20 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:20-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.300268ms Nov 3 04:13:20 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:13:20 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:13:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:13:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730628800}"] Nov 3 04:13:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730628800, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:13:20 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:20-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:20 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:20-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:20 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:20-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:20 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:20-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:20 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:20-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:20 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:20-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:20 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:20-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.282494ms Nov 3 04:13:20 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:20-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.282494ms Nov 3 04:13:20 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:13:20 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:13:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:13:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730628800}"] Nov 3 04:13:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730628800, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:13:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.025072ms Nov 3 04:13:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.025072ms Nov 3 04:13:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:13:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:13:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:13:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730628800}"] Nov 3 04:13:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730628800, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:13:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.945473ms Nov 3 04:13:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.945473ms Nov 3 04:13:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:13:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:13:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:13:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730628800}"] Nov 3 04:13:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730628800, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:13:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.717607ms Nov 3 04:13:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.717607ms Nov 3 04:13:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:13:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:13:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:13:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730628800}"] Nov 3 04:13:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730628800, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:13:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.79814ms Nov 3 04:13:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.79814ms Nov 3 04:13:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:13:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:13:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:13:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730628800}"] Nov 3 04:13:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730628800, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:13:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.248592ms Nov 3 04:13:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.248592ms Nov 3 04:13:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:13:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:13:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:13:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730628800}"] Nov 3 04:13:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730628800, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:13:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.038127ms Nov 3 04:13:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.038127ms Nov 3 04:13:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:13:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:13:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:13:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730628800}"] Nov 3 04:13:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730628800, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:13:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.973295ms Nov 3 04:13:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.973295ms Nov 3 04:13:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:13:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:13:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:13:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730628800}"] Nov 3 04:13:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730628800, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:13:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:13:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:13:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:13:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:13:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:13:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:13:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.957075ms Nov 3 04:13:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:13:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.957075ms Nov 3 04:13:22 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:13:22 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:13:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T04:13:27.252689229-06:00 level=info msg="Completed cleanup jobs" duration=26.237618ms Nov 3 04:13:50 kjcf05n00 mcfcli[3673891]: %3|1730628830.052|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 04:13:58 kjcf05n00 mcfcli[3673891]: %3|1730628838.179|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:14:20 kjcf05n00 mcfcli[3673891]: %3|1730628860.053|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:14:36 kjcf05n00 mcfcli[3673891]: %3|1730628876.357|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:14:50 kjcf05n00 mcfcli[3673891]: %3|1730628890.054|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:14:55 kjcf05n00 zabbix-server[941988]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 04:14:55 kjcf05n00 zabbix-server[941988]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n03' from event '45739' Nov 3 04:14:56 kjcf05n00 zabbix-server[941988]: Filesystem 'kjcf05' has been mounted Nov 3 04:14:56 kjcf05n00 zabbix-server[941988]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 04:14:56 kjcf05n00 zabbix-server[941988]: Running puppet on 'None' Nov 3 04:14:58 kjcf05n03 puppet-agent[52087]: Using configured environment 'production' Nov 3 04:14:58 kjcf05n03 puppet-agent[52087]: Retrieving pluginfacts Nov 3 04:14:58 kjcf05n03 puppet-agent[52087]: Retrieving plugin Nov 3 04:14:58 kjcf05n07 puppet-agent[2239605]: Using configured environment 'production' Nov 3 04:14:58 kjcf05n07 puppet-agent[2239605]: Retrieving pluginfacts Nov 3 04:14:58 kjcf05n07 puppet-agent[2239605]: Retrieving plugin Nov 3 04:14:58 kjcf05n02 puppet-agent[229457]: Using configured environment 'production' Nov 3 04:14:58 kjcf05n02 puppet-agent[229457]: Retrieving pluginfacts Nov 3 04:14:58 kjcf05n02 puppet-agent[229457]: Retrieving plugin Nov 3 04:14:58 kjcf05n04 puppet-agent[2246075]: Using configured environment 'production' Nov 3 04:14:58 kjcf05n04 puppet-agent[2246075]: Retrieving pluginfacts Nov 3 04:14:58 kjcf05n04 puppet-agent[2246075]: Retrieving plugin Nov 3 04:14:58 kjcf05n04 puppet-agent[2246075]: Loading facts Nov 3 04:14:58 kjcf05n06 puppet-agent[2243888]: Using configured environment 'production' Nov 3 04:14:58 kjcf05n06 puppet-agent[2243888]: Retrieving pluginfacts Nov 3 04:14:58 kjcf05n06 puppet-agent[2243888]: Retrieving plugin Nov 3 04:14:58 kjcf05n06 puppet-agent[2243888]: Loading facts Nov 3 04:14:58 kjcf05n05 puppet-agent[2385291]: Using configured environment 'production' Nov 3 04:14:58 kjcf05n05 puppet-agent[2385291]: Retrieving pluginfacts Nov 3 04:14:58 kjcf05n05 puppet-agent[2385291]: Retrieving plugin Nov 3 04:14:59 kjcf05n01 puppet-agent[2887920]: Using configured environment 'production' Nov 3 04:14:59 kjcf05n01 puppet-agent[2887920]: Retrieving pluginfacts Nov 3 04:14:59 kjcf05n01 puppet-agent[2887920]: Retrieving plugin Nov 3 04:14:59 kjcf05n03 puppet-agent[52087]: Loading facts Nov 3 04:14:59 kjcf05n07 puppet-agent[2239605]: Loading facts Nov 3 04:14:59 kjcf05n02 puppet-agent[229457]: Loading facts Nov 3 04:14:59 kjcf05n05 puppet-agent[2385291]: Loading facts Nov 3 04:14:59 kjcf05n00 puppet-agent[942056]: Using configured environment 'production' Nov 3 04:14:59 kjcf05n00 puppet-agent[942056]: Retrieving pluginfacts Nov 3 04:14:59 kjcf05n00 puppet-agent[942056]: Retrieving plugin Nov 3 04:14:59 kjcf05n01 puppet-agent[2887920]: Loading facts Nov 3 04:14:59 kjcf05n00 puppet-agent[942056]: Loading facts Nov 3 04:15:02 kjcf05n06 puppet-agent[2243888]: Caching catalog for kjcf05n06 Nov 3 04:15:02 kjcf05n06 puppet-agent[2243888]: Applying configuration version '1730628900' Nov 3 04:15:02 kjcf05n00 python3.9[941987]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 04:15:02 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 04:15:02 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 04:15:03 kjcf05n01 puppet-agent[2887920]: Caching catalog for kjcf05n01 Nov 3 04:15:03 kjcf05n02 puppet-agent[229457]: Caching catalog for kjcf05n02 Nov 3 04:15:03 kjcf05n02 puppet-agent[229457]: Applying configuration version '1730628900' Nov 3 04:15:03 kjcf05n01 puppet-agent[2887920]: Applying configuration version '1730628901' Nov 3 04:15:04 kjcf05n03 puppet-agent[52087]: Caching catalog for kjcf05n03 Nov 3 04:15:04 kjcf05n03 puppet-agent[52087]: Applying configuration version '1730628900' Nov 3 04:15:04 kjcf05n07 puppet-agent[2239605]: Caching catalog for kjcf05n07 Nov 3 04:15:04 kjcf05n07 puppet-agent[2239605]: Applying configuration version '1730628900' Nov 3 04:15:04 kjcf05n06 puppet-agent[2243888]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 04:15:04 kjcf05n06 puppet-agent[2243888]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 04:15:04 kjcf05n06 puppet-agent[2243888]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 04:15:04 kjcf05n00 puppet-agent[942056]: Caching catalog for kjcf05n00 Nov 3 04:15:04 kjcf05n00 puppet-agent[942056]: Applying configuration version '1730628902' Nov 3 04:15:05 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2191394]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 04:15:05 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 04:15:05 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 04:15:05 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 04:15:05 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 04:15:05 kjcf05n06 puppet-agent[2243888]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: Press Ctrl+C to exit. Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: Plugin support version 1.0 Nov 3 04:15:05 kjcf05n06 zabbix_agent2[2244291]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 04:15:05 kjcf05n02 puppet-agent[229457]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 04:15:05 kjcf05n02 puppet-agent[229457]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 04:15:05 kjcf05n02 puppet-agent[229457]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 04:15:06 kjcf05n03 puppet-agent[52087]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 04:15:06 kjcf05n03 puppet-agent[52087]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 04:15:06 kjcf05n03 puppet-agent[52087]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 04:15:06 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 04:15:06 kjcf05n02 zabbix_agent2[171379]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 04:15:06 kjcf05n02 zabbix_agent2[3218]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 04:15:06 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 04:15:06 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 04:15:06 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 04:15:06 kjcf05n02 puppet-agent[229457]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: Press Ctrl+C to exit. Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: Plugin support version 1.0 Nov 3 04:15:06 kjcf05n02 zabbix_agent2[229865]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 04:15:06 kjcf05n07 puppet-agent[2239605]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 04:15:06 kjcf05n07 puppet-agent[2239605]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 04:15:06 kjcf05n07 puppet-agent[2239605]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 04:15:06 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 04:15:06 kjcf05n03 zabbix_agent2[33210]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 04:15:06 kjcf05n03 zabbix_agent2[3111]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:15:06 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 04:15:06 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 04:15:06 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 04:15:06 kjcf05n03 puppet-agent[52087]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: Press Ctrl+C to exit. Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: Plugin support version 1.0 Nov 3 04:15:06 kjcf05n03 zabbix_agent2[52463]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 04:15:06 kjcf05n06 puppet-agent[2243888]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 04:15:06 kjcf05n06 puppet-agent[2243888]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 04:15:06 kjcf05n06 puppet-agent[2243888]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 04:15:07 kjcf05n01 puppet-agent[2887920]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 04:15:07 kjcf05n01 puppet-agent[2887920]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-03:53:29]/mode) mode changed '0755' to '0750' Nov 3 04:15:07 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 04:15:07 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 04:15:07 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 04:15:07 kjcf05n01 puppet-agent[2887920]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-03:53:29/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 04:15:07 kjcf05n01 puppet-agent[2887920]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-03:53:29/vmcore]/mode) mode changed '0600' to '0640' Nov 3 04:15:07 kjcf05n01 puppet-agent[2887920]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-03:53:29/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 04:15:07 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2187070]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 04:15:07 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 04:15:07 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 04:15:07 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 04:15:07 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 04:15:07 kjcf05n07 puppet-agent[2239605]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: Press Ctrl+C to exit. Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: Plugin support version 1.0 Nov 3 04:15:07 kjcf05n07 zabbix_agent2[2240582]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 04:15:07 kjcf05n05 puppet-agent[2385291]: Caching catalog for kjcf05n05 Nov 3 04:15:07 kjcf05n05 puppet-agent[2385291]: Applying configuration version '1730628905' Nov 3 04:15:07 kjcf05n06 puppet-agent[2243888]: Applied catalog in 5.13 seconds Nov 3 04:15:07 kjcf05n04 puppet-agent[2246075]: Caching catalog for kjcf05n04 Nov 3 04:15:07 kjcf05n04 puppet-agent[2246075]: Applying configuration version '1730628905' Nov 3 04:15:07 kjcf05n01 puppet-agent[2887920]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 04:15:07 kjcf05n01 puppet-agent[2887920]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 04:15:07 kjcf05n01 puppet-agent[2887920]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 04:15:07 kjcf05n00 puppet-agent[942056]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 04:15:08 kjcf05n02 puppet-agent[229457]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 04:15:08 kjcf05n02 puppet-agent[229457]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 04:15:08 kjcf05n02 puppet-agent[229457]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 04:15:08 kjcf05n02 puppet-agent[229457]: Applied catalog in 5.23 seconds Nov 3 04:15:08 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2876157]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 04:15:08 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 04:15:08 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 04:15:08 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 04:15:08 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 04:15:08 kjcf05n01 puppet-agent[2887920]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: Press Ctrl+C to exit. Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: Plugin support version 1.0 Nov 3 04:15:08 kjcf05n01 zabbix_agent2[2888329]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 04:15:08 kjcf05n03 puppet-agent[52087]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 04:15:08 kjcf05n03 puppet-agent[52087]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 04:15:08 kjcf05n03 puppet-agent[52087]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 04:15:08 kjcf05n03 puppet-agent[52087]: Applied catalog in 5.12 seconds Nov 3 04:15:08 kjcf05n07 puppet-agent[2239605]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 04:15:08 kjcf05n07 puppet-agent[2239605]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 04:15:08 kjcf05n07 puppet-agent[2239605]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 04:15:08 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 04:15:08 kjcf05n00 puppet-agent[942056]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 04:15:08 kjcf05n00 puppet-agent[942056]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 04:15:08 kjcf05n00 puppet-agent[942056]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 04:15:09 kjcf05n05 puppet-agent[2385291]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 04:15:09 kjcf05n05 puppet-agent[2385291]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 04:15:09 kjcf05n05 puppet-agent[2385291]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 04:15:09 kjcf05n07 puppet-agent[2239605]: Applied catalog in 4.89 seconds Nov 3 04:15:09 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 04:15:09 kjcf05n00 zabbix_agent2[923762]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 04:15:09 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 04:15:09 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 04:15:09 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 04:15:09 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 04:15:09 kjcf05n00 puppet-agent[942056]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: Press Ctrl+C to exit. Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: Plugin support version 1.0 Nov 3 04:15:09 kjcf05n00 zabbix_agent2[942950]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 04:15:09 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2326217]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 04:15:09 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 04:15:09 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 04:15:09 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 04:15:09 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 04:15:09 kjcf05n05 puppet-agent[2385291]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: Press Ctrl+C to exit. Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: Plugin support version 1.0 Nov 3 04:15:09 kjcf05n05 zabbix_agent2[2385999]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 04:15:10 kjcf05n04 puppet-agent[2246075]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 04:15:10 kjcf05n04 puppet-agent[2246075]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 04:15:10 kjcf05n04 puppet-agent[2246075]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 04:15:09 kjcf05n00 zabbix-server[942975]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 04:15:10 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2189807]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 04:15:10 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 04:15:10 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 04:15:10 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 04:15:10 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 04:15:10 kjcf05n04 puppet-agent[2246075]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: Press Ctrl+C to exit. Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: Plugin support version 1.0 Nov 3 04:15:10 kjcf05n04 zabbix_agent2[2246698]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 04:15:10 kjcf05n01 puppet-agent[2887920]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_040049.log]/mode) mode changed '0644' to '0640' Nov 3 04:15:10 kjcf05n01 puppet-agent[2887920]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_041234.log]/mode) mode changed '0644' to '0640' Nov 3 04:15:10 kjcf05n00 zabbix-server[942976]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 04:15:10 kjcf05n00 zabbix-server[942987]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 04:15:11 kjcf05n00 zabbix-server[942989]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 04:15:11 kjcf05n01 puppet-agent[2887920]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_040050.log]/mode) mode changed '0644' to '0640' Nov 3 04:15:11 kjcf05n01 puppet-agent[2887920]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_041234.log]/mode) mode changed '0644' to '0640' Nov 3 04:15:11 kjcf05n01 puppet-agent[2887920]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_041234]/mode) mode changed '0755' to '0750' Nov 3 04:15:11 kjcf05n01 puppet-agent[2887920]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_041234/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 04:15:11 kjcf05n01 puppet-agent[2887920]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 04:15:11 kjcf05n01 puppet-agent[2887920]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 04:15:11 kjcf05n01 puppet-agent[2887920]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 04:15:11 kjcf05n05 puppet-agent[2385291]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 04:15:11 kjcf05n05 puppet-agent[2385291]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 04:15:11 kjcf05n05 puppet-agent[2385291]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 04:15:11 kjcf05n05 puppet-agent[2385291]: Applied catalog in 4.82 seconds Nov 3 04:15:11 kjcf05n00 puppet-agent[942056]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 04:15:12 kjcf05n04 puppet-agent[2246075]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 04:15:12 kjcf05n04 puppet-agent[2246075]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 04:15:12 kjcf05n04 puppet-agent[2246075]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 04:15:12 kjcf05n01 puppet-agent[2887920]: Applied catalog in 8.72 seconds Nov 3 04:15:12 kjcf05n04 puppet-agent[2246075]: Applied catalog in 4.79 seconds Nov 3 04:15:12 kjcf05n00 puppet-agent[942056]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 04:15:12 kjcf05n00 puppet-agent[942056]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 04:15:12 kjcf05n00 puppet-agent[942056]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 04:15:13 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 04:15:13 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 04:15:13 kjcf05n00 puppet-agent[942056]: Applied catalog in 8.50 seconds Nov 3 04:15:13 kjcf05n00 zabbix-server[941988]: puppet completed status:(0): '' Nov 3 04:15:13 kjcf05n00 mcfcli[3673891]: %3|1730628913.385|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:15:13 kjcf05n00 zabbix-server[941988]: Event '45739' acknowledged Nov 3 04:15:13 kjcf05n00 zabbix-server[941988]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n03"}' Nov 3 04:15:20 kjcf05n00 mcfcli[3673891]: %3|1730628920.054|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:15:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730628920', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 04:15:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730628920'} Nov 3 04:15:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:15:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730628920', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 04:15:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730628920'} Nov 3 04:15:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:15:50 kjcf05n00 mcfcli[3673891]: %3|1730628950.054|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 04:15:53 kjcf05n00 mcfcli[3673891]: %3|1730628953.010|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:16:20 kjcf05n00 mcfcli[3673891]: %3|1730628980.054|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 04:16:33 kjcf05n00 mcfcli[3673891]: %3|1730628993.007|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:16:50 kjcf05n00 mcfcli[3673891]: %3|1730629010.055|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 04:16:52 kjcf05n03 dwd[5153]: nvme20n1 passed periodic SMART status check Nov 3 04:16:52 kjcf05n03 dwd[5153]: nvme15n1 passed periodic SMART status check Nov 3 04:16:52 kjcf05n03 dwd[5153]: nvme21n1 passed periodic SMART status check Nov 3 04:16:52 kjcf05n03 dwd[5153]: nvme11n1 passed periodic SMART status check Nov 3 04:16:52 kjcf05n03 dwd[5153]: nvme10n1 passed periodic SMART status check Nov 3 04:16:55 kjcf05n03 dwd[5153]: nvme12n1 passed periodic SMART status check Nov 3 04:16:55 kjcf05n03 dwd[5153]: nvme6n1 passed periodic SMART status check Nov 3 04:16:55 kjcf05n03 dwd[5153]: nvme7n1 passed periodic SMART status check Nov 3 04:16:55 kjcf05n03 dwd[5153]: nvme22n1 passed periodic SMART status check Nov 3 04:16:55 kjcf05n03 dwd[5153]: nvme16n1 passed periodic SMART status check Nov 3 04:16:55 kjcf05n03 dwd[5153]: nvme5n1 passed periodic SMART status check Nov 3 04:17:07 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/21', errno='Permission denied (13)' Nov 3 04:17:12 kjcf05n00 mcfcli[3673891]: %3|1730629032.454|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:17:20 kjcf05n00 mcfcli[3673891]: %3|1730629040.055|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:17:50 kjcf05n00 mcfcli[3673891]: %3|1730629070.057|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:17:52 kjcf05n00 mcfcli[3673891]: %3|1730629072.279|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:18:20 kjcf05n00 mcfcli[3673891]: %3|1730629100.057|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 04:18:29 kjcf05n00 mcfcli[3673891]: %3|1730629109.796|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:18:50 kjcf05n00 mcfcli[3673891]: %3|1730629130.057|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:19:09 kjcf05n00 mcfcli[3673891]: %3|1730629149.214|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:19:20 kjcf05n00 mcfcli[3673891]: %3|1730629160.057|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:19:45 kjcf05n00 mcfcli[3673891]: %3|1730629185.101|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:19:50 kjcf05n00 mcfcli[3673891]: %3|1730629190.059|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 04:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 04:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 04:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 04:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 04:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 04:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 04:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 04:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 04:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 04:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 04:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 04:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 04:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 04:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 04:20:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 04:20:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:20:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 04:20:02 kjcf05n00 python3.9[945382]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 04:20:20 kjcf05n00 mcfcli[3673891]: %3|1730629220.059|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 04:20:25 kjcf05n00 mcfcli[3673891]: %3|1730629225.098|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:20:50 kjcf05n00 mcfcli[3673891]: %3|1730629250.059|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:21:02 kjcf05n00 mcfcli[3673891]: %3|1730629262.841|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:21:20 kjcf05n00 mcfcli[3673891]: %3|1730629280.059|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:21:23 kjcf05n02 nslcd[6978]: [0e0f76] ldap_result() failed: Can't contact LDAP server Nov 3 04:21:23 kjcf05n02 nslcd[6978]: [52255a] ldap_result() failed: Can't contact LDAP server Nov 3 04:21:42 kjcf05n00 mcfcli[3673891]: %3|1730629302.838|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:21:50 kjcf05n00 mcfcli[3673891]: %3|1730629310.061|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:22:20 kjcf05n00 mcfcli[3673891]: %3|1730629340.061|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:22:22 kjcf05n00 mcfcli[3673891]: %3|1730629342.784|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:22:45 kjcf05n01 diskmonitor[1331407]: leaving test state: 1 next state: 2 Nov 3 04:22:45 kjcf05n01 diskmonitor[1331407]: lock req: no timeout Nov 3 04:22:45 kjcf05n01 diskmonitor[1331407]: leaving test state: 2 next state: 4 Nov 3 04:22:50 kjcf05n00 mcfcli[3673891]: %3|1730629370.061|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:23:00 kjcf05n00 mcfcli[3673891]: %3|1730629380.451|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T10:23:15.868200Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 04:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T10:23:15.868259Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.080ms Nov 3 04:23:20 kjcf05n00 mcfcli[3673891]: %3|1730629400.450|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 04:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T04:23:27.268995538-06:00 level=info msg="Completed cleanup jobs" duration=42.405337ms Nov 3 04:23:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 04:23:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 04:23:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 04:23:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 04:23:40 kjcf05n00 zabbix_server[15741]: Zabbix agent item "system.cpu.util[,steal]" on host "kjcf05n03" failed: first network error, wait for 15 seconds Nov 3 04:23:40 kjcf05n00 mcfcli[3673891]: %3|1730629420.387|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:23:45 kjcf05n02 fstonithd.py[15134]: My partner 172.16.2.6 is kdumping. Forcing HA into GATHER state. Nov 3 04:23:45 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 04:23:45 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 04:23:45 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 04:23:47 kjcf05n02 root[244972]: is_viking_off starts Nov 3 04:23:47 kjcf05n02 root[244973]: is_enc_ipmi_off starts Nov 3 04:23:47 kjcf05n02 root[244991]: is_lan_ipmi_off leaves Nov 3 04:23:47 kjcf05n02 root[244993]: is_lan_ipmi_sec_off leaves Nov 3 04:23:47 kjcf05n02 root[244997]: I am in slot 0; partner is in slot 1 Nov 3 04:23:47 kjcf05n02 root[244999]: I am master Nov 3 04:23:50 kjcf05n00 mcfcli[3673891]: %3|1730629430.561|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 04:23:53 kjcf05n01 diskmonitor[1331407]: lock acquired Nov 3 04:23:53 kjcf05n01 diskmonitor[1331407]: leaving test state: 4 next state: 8 Nov 3 04:23:54 kjcf05n02 root[245103]: is_viking_off leaves Nov 3 04:23:54 kjcf05n02 root[245106]: kjcf05n03 not already off look at kdump Nov 3 04:23:54 kjcf05n02 root[245107]: is_kdump_off starts Nov 3 04:23:54 kjcf05n02 fence_kdump[245108]: waiting for message from '172.16.2.6' Nov 3 04:23:54 kjcf05n02 fence_kdump[245108]: received valid message from '172.16.2.6' Nov 3 04:23:54 kjcf05n02 root[245121]: is_kdump_off detected kdump on kjcf05n03 Nov 3 04:23:54 kjcf05n02 root[245122]: kjcf05n03 is kdumping Nov 3 04:23:55 kjcf05n02 root[245219]: is_enc_ipmi_off starts Nov 3 04:23:55 kjcf05n02 root[245220]: is_viking_off starts Nov 3 04:23:55 kjcf05n02 root[245239]: is_lan_ipmi_off leaves Nov 3 04:23:55 kjcf05n02 root[245241]: I am master Nov 3 04:23:55 kjcf05n02 root[245243]: is_lan_ipmi_sec_off leaves Nov 3 04:23:55 kjcf05n02 root[245246]: I am in slot 0; partner is in slot 1 Nov 3 04:23:55 kjcf05n00 zabbix_server[15740]: Zabbix agent item "dcs.lustre.filesystem_name[kjcf05]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 04:23:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 04:23:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 04:23:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 04:23:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 04:23:56 kjcf05n00 zabbix_server[15770]: Zabbix agent item "vm.memory.size[buffers]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 04:23:57 kjcf05n00 zabbix_server[15735]: Zabbix agent item "vm.memory.size[cached]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 04:23:58 kjcf05n00 zabbix_server[15766]: Zabbix agent item "vm.memory.size[free]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 04:24:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 04:24:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 04:24:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 04:24:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 04:24:01 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 04:24:01 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 04:24:02 kjcf05n02 root[245727]: is_viking_off leaves Nov 3 04:24:02 kjcf05n02 root[245730]: kjcf05n03 not already off look at kdump Nov 3 04:24:02 kjcf05n02 root[245732]: is_kdump_off starts Nov 3 04:24:02 kjcf05n02 fence_kdump[245733]: waiting for message from '172.16.2.6' Nov 3 04:24:03 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='107', error='Connection reset by peer (104)' Nov 3 04:24:03 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='107', client='AF_INET(172.16.2.6:35903)', local='AF_INET(0.0.0.0:601)' Nov 3 04:24:03 kjcf05n02 fence_kdump[245733]: received valid message from '172.16.2.6' Nov 3 04:24:03 kjcf05n02 root[245769]: is_kdump_off detected kdump on kjcf05n03 Nov 3 04:24:03 kjcf05n02 root[245770]: kjcf05n03 is kdumping Nov 3 04:24:04 kjcf05n01 diskmonitor[1331407]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 3 04:24:04 kjcf05n01 diskmonitor[1331407]: leaving test state: 8 next state: 20 Nov 3 04:24:04 kjcf05n01 diskmonitor[1331407]: leaving test state: 20 next state: 40 Nov 3 04:24:04 kjcf05n01 diskmonitor[1331407]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset 17169a80000 Nov 3 04:24:04 kjcf05n01 diskmonitor[1331407]: leaving test state: 40 next state: 80 Nov 3 04:24:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 04:24:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 04:24:07 kjcf05n02 systemd-udevd[248089]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248090]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248089]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248090]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248089]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248090]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248089]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248090]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248089]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248090]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248089]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248090]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248089]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248090]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248090]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248089]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248090]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248127]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248129]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248131]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248133]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248127]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248129]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248131]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248133]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248127]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248129]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248131]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248127]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248131]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248127]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248129]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248127]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248127]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248129]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248127]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248129]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248127]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248129]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248127]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248127]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248129]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248127]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248129]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248127]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248129]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248127]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248129]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:24:07 kjcf05n02 systemd-udevd[248129]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:24:08 kjcf05n02 dwd[5220]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 04:24:08 kjcf05n02 dwd[5220]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 04:24:08 kjcf05n02 dwd[5220]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 04:24:08 kjcf05n02 dwd[5220]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 04:24:08 kjcf05n02 dwd[5220]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 04:24:08 kjcf05n02 dwd[5220]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 04:24:08 kjcf05n02 dwd[5220]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 04:24:08 kjcf05n02 dwd[5220]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 04:24:08 kjcf05n02 dwd[5220]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 04:24:08 kjcf05n02 dwd[5220]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 04:24:08 kjcf05n02 dwd[5220]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 04:24:08 kjcf05n02 dwd[5220]: Starting NVME thread for nvme7n1 Nov 3 04:24:08 kjcf05n02 dwd[5220]: Starting NVME thread for nvme15n1 Nov 3 04:24:08 kjcf05n02 dwd[5220]: Starting NVME thread for nvme6n1 Nov 3 04:24:08 kjcf05n02 dwd[5220]: Starting NVME thread for nvme10n1 Nov 3 04:24:08 kjcf05n02 dwd[5220]: Starting NVME thread for nvme21n1 Nov 3 04:24:08 kjcf05n02 dwd[5220]: Starting NVME thread for nvme16n1 Nov 3 04:24:08 kjcf05n02 dwd[5220]: Starting NVME thread for nvme20n1 Nov 3 04:24:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 04:24:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 04:24:09 kjcf05n02 dwd[5220]: Starting NVME thread for nvme22n1 Nov 3 04:24:09 kjcf05n02 dwd[5220]: Starting NVME thread for nvme11n1 Nov 3 04:24:09 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 3 04:24:09 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 7 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007519 sec, idle for 1 hour(s)] Nov 3 04:24:10 kjcf05n02 dwd[5220]: Starting NVME thread for nvme12n1 Nov 3 04:24:10 kjcf05n02 dwd[5220]: Starting NVME thread for nvme5n1 Nov 3 04:24:13 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vfs.fs.size[/var/lib/reboot_cnt,used]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 04:24:16 kjcf05n00 mcfcli[3673891]: %3|1730629456.800|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:24:20 kjcf05n00 mcfcli[3673891]: %3|1730629460.561|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:24:21 kjcf05n02 diskmonitor[17478]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 04:24:28 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n03": interface unavailable Nov 3 04:24:28 kjcf05n02 diskmonitor[17478]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 04:24:28 kjcf05n02 diskmonitor[17478]: Scan for ReadErrorMax change for md66 Nov 3 04:24:28 kjcf05n02 diskmonitor[17478]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 04:24:28 kjcf05n02 diskmonitor[17478]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 04:24:28 kjcf05n02 diskmonitor[17478]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.min.76c05c063fa0949b68ee86c1978c2ca8 file Nov 3 04:24:28 kjcf05n02 diskmonitor[17478]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.max.76c05c063fa0949b68ee86c1978c2ca8 file Nov 3 04:24:28 kjcf05n02 diskmonitor[17478]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 04:24:28 kjcf05n02 diskmonitor[17478]: Set sync_speed_min (10000) for md66 Nov 3 04:24:28 kjcf05n02 diskmonitor[17478]: Set sync_speed_max (200000) for md66 Nov 3 04:24:28 kjcf05n02 diskmonitor[17478]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 04:24:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 04:24:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 04:24:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 04:24:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 04:24:50 kjcf05n00 mcfcli[3673891]: %3|1730629490.562|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:24:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 04:24:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 04:24:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 04:24:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 04:24:56 kjcf05n00 mcfcli[3673891]: %3|1730629496.797|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:24:59 kjcf05n01 diskmonitor[1331407]: leaving test state: 80 next state: 100 Nov 3 04:24:59 kjcf05n01 diskmonitor[1331407]: lock release: time: Sun Nov 3 04:24:57 2024 Nov 3 04:24:59 kjcf05n01 diskmonitor[1331407]: leaving test state: 100 next state: 1 Nov 3 04:24:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 04:24:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 04:25:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 04:25:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 04:25:01 kjcf05n00 python3.9[948273]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 04:25:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 04:25:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 04:25:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 04:25:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 04:25:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730629514', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 04:25:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730629514'} Nov 3 04:25:14 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:25:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730629514', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 04:25:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730629514'} Nov 3 04:25:14 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:25:16 kjcf05n02 nslcd[6978]: [9cf92e] ldap_result() failed: Can't contact LDAP server Nov 3 04:25:20 kjcf05n00 mcfcli[3673891]: %3|1730629520.563|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 04:25:35 kjcf05n00 mcfcli[3673891]: %3|1730629535.586|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 04:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 04:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 04:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 04:25:50 kjcf05n00 mcfcli[3673891]: %3|1730629550.563|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 04:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 04:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 04:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 04:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 04:26:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 04:26:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 04:26:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 04:26:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 04:26:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 04:26:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 04:26:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 04:26:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 04:26:12 kjcf05n00 mcfcli[3673891]: %3|1730629572.405|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:26:20 kjcf05n00 mcfcli[3673891]: %3|1730629580.564|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:26:34 kjcf05n00 zabbix-server[949535]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 04:26:34 kjcf05n00 zabbix-server[949535]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n03:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 04:26:34 kjcf05n00 log_interesting_event.py[949535]: Event '45740' acknowledged Nov 3 04:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 04:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 04:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 04:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 04:26:50 kjcf05n00 mcfcli[3673891]: %3|1730629610.565|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:26:52 kjcf05n00 mcfcli[3673891]: %3|1730629612.402|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 04:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 04:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 04:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 04:26:59 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 04:26:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 04:27:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 04:27:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 04:27:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 04:27:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 04:27:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 04:27:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 04:27:20 kjcf05n00 mcfcli[3673891]: %3|1730629640.565|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 04:27:28 kjcf05n00 mcfcli[3673891]: %3|1730629648.847|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:27:32 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:9a:1a Nov 3 04:27:32 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 04:27:36 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 04:27:36 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a kjcf05n03 Nov 3 04:27:36 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.6 Nov 3 04:27:36 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 04:27:36 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 04:27:36 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.6 Nov 3 04:27:36 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/pxelinux.cfg to 172.16.2.6 Nov 3 04:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 04:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 04:27:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 04:27:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 04:27:39 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/vmlinuz_diskless to 172.16.2.6 Nov 3 04:27:42 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/initramfs-diskless.img to 172.16.2.6 Nov 3 04:27:50 kjcf05n00 mcfcli[3673891]: %3|1730629670.969|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 04:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 04:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 04:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 04:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 04:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 04:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 04:28:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 04:28:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 04:28:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 04:28:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 04:28:07 kjcf05n00 mcfcli[3673891]: %3|1730629687.620|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:28:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 04:28:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 04:28:20 kjcf05n00 mcfcli[3673891]: %3|1730629700.970|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:28:29 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:46408). Nov 3 04:28:29 kjcf05n01 rsyncd[2894470]: connect from kjcf05n03 (172.16.2.6) Nov 3 04:28:29 kjcf05n01 rsyncd[2894470]: rsync on puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 04:28:29 kjcf05n01 rsyncd[2894470]: building file list Nov 3 04:28:29 kjcf05n01 rsyncd[2894470]: sent 11446 bytes received 136 bytes total size 10901 Nov 3 04:28:29 kjcf05n01 systemd[1]: rsyncd@595-172.16.2.2:873-172.16.2.6:46408.service: Succeeded. Nov 3 04:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 04:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 04:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 04:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 04:28:45 kjcf05n02 fstonithd.py[15134]: Listening for kdump packets from partner Nov 3 04:28:46 kjcf05n00 mcfcli[3673891]: %3|1730629726.266|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:28:51 kjcf05n00 mcfcli[3673891]: %3|1730629731.067|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 04:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 04:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 04:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 04:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 04:29:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 04:29:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 04:29:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 04:29:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 04:29:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 04:29:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 04:29:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 04:29:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 04:29:19 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 04:29:21 kjcf05n00 mcfcli[3673891]: %3|1730629761.067|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 04:29:25 kjcf05n00 mcfcli[3673891]: %3|1730629765.559|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:29:35 kjcf05n02 dwd[5220]: nvme16n1 passed periodic SMART status check Nov 3 04:29:35 kjcf05n02 dwd[5220]: nvme20n1 passed periodic SMART status check Nov 3 04:29:35 kjcf05n02 dwd[5220]: nvme6n1 passed periodic SMART status check Nov 3 04:29:35 kjcf05n02 dwd[5220]: nvme22n1 passed periodic SMART status check Nov 3 04:29:35 kjcf05n02 dwd[5220]: nvme7n1 passed periodic SMART status check Nov 3 04:29:35 kjcf05n02 dwd[5220]: nvme15n1 passed periodic SMART status check Nov 3 04:29:35 kjcf05n02 dwd[5220]: nvme10n1 passed periodic SMART status check Nov 3 04:29:35 kjcf05n02 dwd[5220]: nvme21n1 passed periodic SMART status check Nov 3 04:29:35 kjcf05n02 dwd[5220]: nvme12n1 passed periodic SMART status check Nov 3 04:29:35 kjcf05n02 dwd[5220]: nvme11n1 passed periodic SMART status check Nov 3 04:29:35 kjcf05n02 dwd[5220]: nvme5n1 passed periodic SMART status check Nov 3 04:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 04:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 04:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 04:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 04:29:49 kjcf05n02 nslcd[6978]: [efd79f] ldap_result() failed: Can't contact LDAP server Nov 3 04:29:51 kjcf05n00 mcfcli[3673891]: %3|1730629791.068|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 04:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 04:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 04:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 04:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 04:29:56 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='30', client='AF_INET(172.16.2.6:36693)', local='AF_INET(0.0.0.0:601)' Nov 3 04:29:56 kjcf05n03 syslog-ng[3124]: Configuration reload request received, reloading configuration; Nov 3 04:29:56 kjcf05n03 syslog-ng[3124]: Configuration reload finished; Nov 3 04:29:56 kjcf05n03 syslog-ng[3124]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 04:29:56 kjcf05n03 dracut: dracut-049-135.git20210121.el8 Nov 3 04:29:56 kjcf05n03 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 04:29:56 kjcf05n03 dracut: Loading and integrity checking all crypto modules Nov 3 04:29:56 kjcf05n03 dracut: Self testing crypto algorithms Nov 3 04:29:56 kjcf05n03 dracut: rd.md=0: removing MD RAID activation Nov 3 04:29:56 kjcf05n03 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 04:29:56 kjcf05n03 Copying live image to RAM... Nov 3 04:29:56 kjcf05n03 (this may take a minute) Nov 3 04:29:56 kjcf05n03 Done copying live image to RAM. Nov 3 04:29:56 kjcf05n03 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 04:29:56 kjcf05n03 dracut: Checking integrity of kernel Nov 3 04:29:56 kjcf05n03 dracut: All initrd crypto checks done Nov 3 04:29:56 kjcf05n03 dracut: Switching root Nov 3 04:29:56 kjcf05n03 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 04:29:56 kjcf05n03 systemd: Detected architecture x86-64. Nov 3 04:29:56 kjcf05n03 systemd: Set hostname to . Nov 3 04:29:56 kjcf05n03 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 04:29:56 kjcf05n03 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 04:29:56 kjcf05n03 systemd: Created slice system-getty.slice. Nov 3 04:29:56 kjcf05n03 systemd: Listening on udev Control Socket. Nov 3 04:29:56 kjcf05n03 systemd: Created slice system-sshd\x2dkeygen.slice. Nov 3 04:29:56 kjcf05n03 systemd: Created slice User and Session Slice. Nov 3 04:29:56 kjcf05n03 systemd: Reached target Slices. Nov 3 04:29:56 kjcf05n03 systemd-journald[1529]: Journal started Nov 3 04:29:56 kjcf05n03 systemd-journald[1529]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 04:29:56 kjcf05n03 systemd-modules-load[1523]: Inserted module 'fuse' Nov 3 04:29:56 kjcf05n03 systemd[1]: Mounted POSIX Message Queue File System. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Remount Root and Kernel File Systems. Nov 3 04:29:56 kjcf05n03 systemd[1]: Mounted /mnt. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Load Kernel Modules. Nov 3 04:29:56 kjcf05n03 systemd[1]: Mounted Kernel Debug File System. Nov 3 04:29:56 kjcf05n03 systemd[1]: Mounted /WIBS. Nov 3 04:29:56 kjcf05n03 systemd[1]: Mounted /data. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 3 04:29:56 kjcf05n03 systemd[1]: Mounted Huge Pages File System. Nov 3 04:29:56 kjcf05n03 systemd[1]: Mounted Temporary Directory (/tmp). Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Create list of required static device nodes for the current kernel. Nov 3 04:29:56 kjcf05n03 systemd[1]: Mounting Kernel Configuration File System... Nov 3 04:29:56 kjcf05n03 systemd[1]: Mounting FUSE Control File System... Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Apply Kernel Variables... Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Rebuild Hardware Database... Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Load/Save Random Seed... Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Create System Users... Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 04:29:56 kjcf05n03 systemd[1]: Mounted Kernel Configuration File System. Nov 3 04:29:56 kjcf05n03 systemd[1]: Mounted FUSE Control File System. Nov 3 04:29:56 kjcf05n03 systemd-sysctl[1550]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 04:29:56 kjcf05n03 systemd-sysctl[1550]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Apply Kernel Variables. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Load/Save Random Seed. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Create System Users. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 04:29:56 kjcf05n03 systemd-journald[1529]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 04:29:56 kjcf05n03 systemd-tmpfiles[1558]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 04:29:56 kjcf05n03 systemd-tmpfiles[1558]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started udev Coldplug all Devices. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Rebuild Hardware Database. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting udev Kernel Device Manager... Nov 3 04:29:56 kjcf05n03 systemd-udevd[1564]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started udev Kernel Device Manager. Nov 3 04:29:56 kjcf05n03 systemd[1]: Found device /dev/ttyS0. Nov 3 04:29:56 kjcf05n03 systemd-udevd[1577]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 04:29:56 kjcf05n03 systemd-udevd[1588]: Using default interface naming scheme 'rhel-8.0'. Nov 3 04:29:56 kjcf05n03 systemd-udevd[1588]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 04:29:56 kjcf05n03 systemd-udevd[1581]: Using default interface naming scheme 'rhel-8.0'. Nov 3 04:29:56 kjcf05n03 systemd-udevd[1581]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 04:29:56 kjcf05n03 systemd-udevd[1596]: Using default interface naming scheme 'rhel-8.0'. Nov 3 04:29:56 kjcf05n03 systemd-udevd[1596]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 04:29:56 kjcf05n03 systemd[1]: Reached target Local File Systems (Pre). Nov 3 04:29:56 kjcf05n03 systemd[1]: Reached target Local File Systems. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 04:29:56 kjcf05n03 systemd-tmpfiles[1770]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 04:29:56 kjcf05n03 systemd-tmpfiles[1770]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 04:29:56 kjcf05n03 root[1780]: openibd: running in auto mode Nov 3 04:29:56 kjcf05n03 systemd-tmpfiles[1770]: "/var/tmp" already exists and is not a directory. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Create Volatile Files and Directories. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting RPC Bind... Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Rebuild Journal Catalog. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started RPC Bind. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 04:29:56 kjcf05n03 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 04:29:56 kjcf05n03 systemd[1]: Started RDMA Node Description Daemon. Nov 3 04:29:56 kjcf05n03 systemd-modules-load[1890]: Inserted module 'ib_iser' Nov 3 04:29:56 kjcf05n03 systemd-modules-load[1890]: Inserted module 'ib_isert' Nov 3 04:29:56 kjcf05n03 systemd-modules-load[1890]: Inserted module 'ib_srpt' Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 04:29:56 kjcf05n03 systemd-modules-load[1898]: Inserted module 'ib_ipoib' Nov 3 04:29:56 kjcf05n03 systemd-udevd[1568]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 04:29:56 kjcf05n03 systemd-udevd[1612]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 04:29:56 kjcf05n03 systemd-modules-load[1890]: Inserted module 'rdma_ucm' Nov 3 04:29:56 kjcf05n03 systemd-modules-load[1890]: Module 'svcrdma' is blacklisted Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 04:29:56 kjcf05n03 systemd-udevd[1612]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 04:29:56 kjcf05n03 systemd-udevd[1568]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 04:29:56 kjcf05n03 systemd-modules-load[1898]: Inserted module 'ib_umad' Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 04:29:56 kjcf05n03 systemd[1]: Reached target RDMA Hardware. Nov 3 04:29:56 kjcf05n03 systemd[1]: Reached target Network (Pre). Nov 3 04:29:56 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 04:29:56 kjcf05n03 systemd[3124]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:29:56 kjcf05n03 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 04:29:56 kjcf05n03 openibd[1765]: Loading HCA driver and Access Layer:[ OK ] Nov 3 04:29:56 kjcf05n03 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Update is Completed... Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Update is Completed. Nov 3 04:29:56 kjcf05n03 setup-icl[1757]: Setting LAN IP Address to 203.0.113.4 Nov 3 04:29:56 kjcf05n03 setup-icl[1757]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 04:29:56 kjcf05n03 setup-icl[1757]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 04:29:56 kjcf05n03 setup-icl[1757]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 04:29:56 kjcf05n03 systemd-udevd[1568]: Using default interface naming scheme 'rhel-8.0'. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 04:29:56 kjcf05n03 systemd[1]: Reached target System Initialization. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 04:29:56 kjcf05n03 systemd[1]: Listening on lldpad.socket. Nov 3 04:29:56 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 04:29:56 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 04:29:56 kjcf05n03 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 04:29:56 kjcf05n03 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 04:29:56 kjcf05n03 systemd[1]: Reached target Sockets. Nov 3 04:29:56 kjcf05n03 systemd[1]: Reached target Basic System. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Resets System Activity Logs... Nov 3 04:29:56 kjcf05n03 chronyd[2081]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 04:29:56 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 04:29:56 kjcf05n03 network[2073]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 0 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 1 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 2 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 3 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 4 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 5 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 6 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 7 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 8 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 9 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 10 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 11 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 12 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 13 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 14 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 15 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 16 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 17 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 18 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 19 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 20 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 21 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 22 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 23 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 24 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 25 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 26 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 27 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 28 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 29 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 30 Nov 3 04:29:56 kjcf05n03 cpupower[2110]: Setting cpu: 31 Nov 3 04:29:56 kjcf05n03 network[2073]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:29:56 kjcf05n03 network[2096]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[2107]: Setting up Mellanox network interface: ib0 Nov 3 04:29:56 kjcf05n03 systemd[1]: Started irqbalance daemon. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 04:29:56 kjcf05n03 network[2120]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:29:56 kjcf05n03 network[2073]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 04:29:56 kjcf05n03 mcelog[2139]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 04:29:56 kjcf05n03 mcelog[2139]: CPU is unsupported Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 04:29:56 kjcf05n03 chronyd[2081]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 04:29:56 kjcf05n03 chronyd[2081]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 04:29:56 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 04:29:56 kjcf05n03 network[2142]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Name Service Cache Daemon... Nov 3 04:29:56 kjcf05n03 beSetMlxConfig[2144]: ConnectX-3 multiport not detected Nov 3 04:29:56 kjcf05n03 systemd[1]: Started D-Bus System Message Bus. Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[2174]: Setting up Mellanox network interface: ib1 Nov 3 04:29:56 kjcf05n03 nscd[2210]: 2210 monitoring file `/etc/hosts` (1) Nov 3 04:29:56 kjcf05n03 nscd[2210]: 2210 monitoring directory `/etc` (2) Nov 3 04:29:56 kjcf05n03 nscd[2210]: 2210 monitoring file `/etc/resolv.conf` (3) Nov 3 04:29:56 kjcf05n03 nscd[2210]: 2210 monitoring directory `/etc` (2) Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[2179]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 04:29:56 kjcf05n03 dwd[2175]: dwd: vMay 29 2024 : 15:38:26 Nov 3 04:29:56 kjcf05n03 dwd[2175]: /usr/sbin/dwd -d --standalone=0 Nov 3 04:29:56 kjcf05n03 dwd[2175]: dwd: option Lethal: 0 Nov 3 04:29:56 kjcf05n03 dwd[2175]: option Lethal: 0 Nov 3 04:29:56 kjcf05n03 dwd[2175]: dwd: option Interval: 60 Nov 3 04:29:56 kjcf05n03 dwd[2175]: option Interval: 60 Nov 3 04:29:56 kjcf05n03 dwd[2175]: option abrtlimit: 10 Nov 3 04:29:56 kjcf05n03 dwd[2175]: dwd: option abrtlimit: 10 Nov 3 04:29:56 kjcf05n03 dwd[2175]: dwd: option DZPeriod: 604800 Nov 3 04:29:56 kjcf05n03 dwd[2175]: dwd: option SmartPeriod: 43200 Nov 3 04:29:56 kjcf05n03 dwd[2175]: dwd: option SDDEnabled: 1 Nov 3 04:29:56 kjcf05n03 dwd[2175]: option DZPeriod: 604800 Nov 3 04:29:56 kjcf05n03 dwd[2175]: option SmartPeriod: 43200 Nov 3 04:29:56 kjcf05n03 dwd[2175]: option SDDEnabled: 1 Nov 3 04:29:56 kjcf05n03 dwd[2175]: dwd: option SDDAwaitScale: 3 Nov 3 04:29:56 kjcf05n03 dwd[2175]: option SDDAwaitScale: 3 Nov 3 04:29:56 kjcf05n03 dwd[2175]: option SDDAwaitMin: 100 Nov 3 04:29:56 kjcf05n03 dwd[2175]: dwd: option SDDAwaitMin: 100 Nov 3 04:29:56 kjcf05n03 dwd[2175]: dwd: option Verbosity: 1 Nov 3 04:29:56 kjcf05n03 dwd[2175]: dwd: option StandAlone: 0 Nov 3 04:29:56 kjcf05n03 dwd[2175]: option Verbosity: 1 Nov 3 04:29:56 kjcf05n03 dwd[2175]: option StandAlone: 0 Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Resets System Activity Logs. Nov 3 04:29:56 kjcf05n03 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 04:29:56 kjcf05n03 mdraid-phy[2221]: no Cutlass to worry about Nov 3 04:29:56 kjcf05n03 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[2235]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 0 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 1 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 2 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 3 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 4 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 5 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 6 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 7 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 8 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 9 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 10 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 11 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 12 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 13 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 14 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 15 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 16 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 17 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 18 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 19 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 20 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 21 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 22 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 23 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 24 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 25 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 26 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 27 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 28 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 29 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 30 Nov 3 04:29:56 kjcf05n03 cpupower[2257]: Idlestate 2 disabled on CPU 31 Nov 3 04:29:56 kjcf05n03 dbus-daemon[2187]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 04:29:56 kjcf05n03 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 04:29:56 kjcf05n03 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[2253]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 04:29:56 kjcf05n03 beSetMlxConfig[2144]: Starting MST (Mellanox Software Tools) driver set Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Name Service Cache Daemon. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Manage Cutlass PHYs. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[2267]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[2271]: No configuration found for ib0 Nov 3 04:29:56 kjcf05n03 beSetMlxConfig[2144]: Loading MST PCI module - Success Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[2281]: No configuration found for ib1 Nov 3 04:29:56 kjcf05n03 sssd[sssd][2122]: Starting up Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[2286]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 04:29:56 kjcf05n03 beSetMlxConfig[2144]: Loading MST PCI configuration module - Success Nov 3 04:29:56 kjcf05n03 beSetMlxConfig[2144]: Create devices Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[2294]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 04:29:56 kjcf05n03 mlnx_conf_mgr[2316]: INFO: No configurations found for mlx5_0, skipping. Nov 3 04:29:56 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 04:29:56 kjcf05n03 mlnx_conf_mgr[2340]: INFO: No configurations found for mlx5_1, skipping. Nov 3 04:29:56 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 04:29:56 kjcf05n03 sssd[be[implicit_files]][2312]: Starting up Nov 3 04:29:56 kjcf05n03 sssd[nss][2455]: Starting up Nov 3 04:29:56 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 04:29:56 kjcf05n03 systemd[1]: Reached target User and Group Name Lookups. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Login Service... Nov 3 04:29:56 kjcf05n03 systemd-logind[2560]: New seat seat0. Nov 3 04:29:56 kjcf05n03 systemd-logind[2560]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Login Service. Nov 3 04:29:56 kjcf05n03 systemd-sysctl[2716]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 04:29:56 kjcf05n03 systemd-sysctl[2716]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 04:29:56 kjcf05n03 python3.9[2233]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 04:29:56 kjcf05n03 python3.9[3124]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 04:29:56 kjcf05n03 network[2073]: Bringing up loopback interface: [ OK ] Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 04:29:56 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 04:29:56 kjcf05n03 systemd-sysctl[3067]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 04:29:56 kjcf05n03 systemd-sysctl[3067]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 04:29:56 kjcf05n03 systemd[1]: Started LSB: Bring up/down networking. Nov 3 04:29:56 kjcf05n03 systemd[1]: Reached target Network. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 04:29:56 kjcf05n03 systemd[1]: Reached target Network is Online. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting System Logger Daemon... Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 04:29:56 kjcf05n03 sm-notify[3135]: Version 2.3.3 starting Nov 3 04:29:56 kjcf05n03 python3.9[3068]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 04:29:56 kjcf05n03 python3.9[3124]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Notify NFS peers of a restart. Nov 3 04:29:56 kjcf05n03 systemd[1]: Reached target NFS client services. Nov 3 04:29:56 kjcf05n03 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 04:29:56 kjcf05n03 systemd[1]: Reached target Remote File Systems. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Permit User Sessions... Nov 3 04:29:56 kjcf05n03 lldpad[3105]: setsockopt nearest_bridge: Invalid argument Nov 3 04:29:56 kjcf05n03 lldpad[3124]: Last message 'setsockopt nearest_b' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:29:56 kjcf05n03 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Permit User Sessions. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Getty on tty1. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Serial Getty on ttyS0. Nov 3 04:29:56 kjcf05n03 systemd[1]: Reached target Login Prompts. Nov 3 04:29:56 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 04:29:56 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 04:29:56 kjcf05n03 syslog-ng[3124]: [2024-11-03T10:28:41.242249] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 04:29:56 kjcf05n03 syslog-ng[3124]: [2024-11-03T10:28:41.242541] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 04:29:56 kjcf05n03 syslog-ng[3124]: [2024-11-03T10:28:41.242577] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 04:29:56 kjcf05n03 syslog-ng[3124]: [2024-11-03T10:28:41.243148] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 04:29:56 kjcf05n03 syslog-ng[3124]: [2024-11-03T10:28:41.243448] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 04:29:56 kjcf05n03 systemd[1]: Started System Logger Daemon. Nov 3 04:29:56 kjcf05n03 beSetMlxConfig[2144]: Unloading MST PCI module (unused) - Success Nov 3 04:29:56 kjcf05n03 sshd[3171]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 04:29:56 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 04:29:56 kjcf05n03 python3.9[3172]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 04:29:56 kjcf05n03 python3.9[3124]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 04:29:56 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 04:29:56 kjcf05n03 python3.9[3398]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 04:29:56 kjcf05n03 python3.9[3124]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 04:29:56 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 04:29:56 kjcf05n03 python3.9[3401]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 04:29:56 kjcf05n03 python3.9[3124]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 04:29:56 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 04:29:56 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 04:29:56 kjcf05n03 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 04:29:56 kjcf05n03 chronyd[2081]: System's initial offset : 0.003342 seconds slow of true (slew) Nov 3 04:29:56 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 04:29:56 kjcf05n03 beSetMlxConfig[2144]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 04:29:56 kjcf05n03 beSetMlxConfig[2144]: ib mode Nov 3 04:29:56 kjcf05n03 beSetMlxConfig[2144]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 04:29:56 kjcf05n03 root[3427]: openibd: Set node_desc for mlx5_0: kjcf05n03 HCA-1 Nov 3 04:29:56 kjcf05n03 root[3429]: openibd: Set node_desc for mlx5_1: kjcf05n03 HCA-2 Nov 3 04:29:56 kjcf05n03 beSetMlxConfig[2144]: ib mode Nov 3 04:29:56 kjcf05n03 systemd-udevd[1564]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 04:29:56 kjcf05n03 systemd-udevd[3439]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 04:29:56 kjcf05n03 systemd-udevd[3440]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 04:29:56 kjcf05n03 systemd-udevd[3443]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 04:29:56 kjcf05n03 systemd-udevd[3444]: Using default interface naming scheme 'rhel-8.0'. Nov 3 04:29:56 kjcf05n03 systemd-udevd[3444]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 04:29:56 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 04:29:56 kjcf05n03 systemd[3124]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:29:56 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[3481]: Setting up Mellanox network interface: ib1 Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[3482]: Setting up Mellanox network interface: ib0 Nov 3 04:29:56 kjcf05n03 systemd-udevd[3442]: Using default interface naming scheme 'rhel-8.0'. Nov 3 04:29:56 kjcf05n03 systemd-udevd[3441]: Using default interface naming scheme 'rhel-8.0'. Nov 3 04:29:56 kjcf05n03 systemd-udevd[3442]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 04:29:56 kjcf05n03 systemd-udevd[3441]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Puppet agent... Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[3531]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[3532]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[3562]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[3563]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[3564]: No configuration found for ib0 Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[3565]: No configuration found for ib1 Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[3572]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[3573]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 04:29:56 kjcf05n03 mlnx_conf_mgr[3612]: INFO: No configurations found for mlx5_0, skipping. Nov 3 04:29:56 kjcf05n03 mlnx_conf_mgr[3613]: INFO: No configurations found for mlx5_1, skipping. Nov 3 04:29:56 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 04:29:56 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 04:29:56 kjcf05n03 systemd[1]: Stopping Command Scheduler... Nov 3 04:29:56 kjcf05n03 systemd[1]: crond.service: Succeeded. Nov 3 04:29:56 kjcf05n03 systemd[1]: Stopped Command Scheduler. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 04:29:56 kjcf05n03 systemd[1]: Stopping Job spooling tools... Nov 3 04:29:56 kjcf05n03 systemd[1]: atd.service: Succeeded. Nov 3 04:29:56 kjcf05n03 systemd[1]: Stopped Job spooling tools. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 04:29:56 kjcf05n03 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 04:29:56 kjcf05n03 lldpad[3105]: init_ports: Error adding device ib0 Nov 3 04:29:56 kjcf05n03 lldpad[3105]: init_ports: Error adding device ib1 Nov 3 04:29:56 kjcf05n03 lldpad[3105]: Signal 15 received - terminating Nov 3 04:29:56 kjcf05n03 systemd[1]: lldpad.service: Succeeded. Nov 3 04:29:56 kjcf05n03 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 04:29:56 kjcf05n03 systemd[1]: Reloading. Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 04:29:56 kjcf05n03 systemd[1]: lldpad.socket: Succeeded. Nov 3 04:29:56 kjcf05n03 systemd[1]: Closed lldpad.socket. Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 04:29:56 kjcf05n03 systemd[1]: Reloading. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting IPMI Driver... Nov 3 04:29:56 kjcf05n03 systemd[1]: Started IPMI Driver. Nov 3 04:29:56 kjcf05n03 systemd[1]: Reloading. Nov 3 04:29:56 kjcf05n03 systemd[3124]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:29:56 kjcf05n03 systemd[1]: Reloading. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Ipmievd Daemon... Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 1 | Nov-03-2024 | 09:59:08 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 2 | Nov-03-2024 | 09:59:59 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 3 | Nov-03-2024 | 09:59:59 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 4 | Nov-03-2024 | 10:01:05 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 5 | Nov-03-2024 | 10:01:06 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 6 | Nov-03-2024 | 10:26:02 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 7 | Nov-03-2024 | 10:26:02 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 8 | Nov-03-2024 | 10:26:02 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 9 | Nov-03-2024 | 10:26:02 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 10 | Nov-03-2024 | 10:26:02 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 11 | Nov-03-2024 | 10:26:02 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 12 | Nov-03-2024 | 10:26:02 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 13 | Nov-03-2024 | 10:26:02 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 14 | Nov-03-2024 | 10:26:02 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 15 | Nov-03-2024 | 10:26:02 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 16 | Nov-03-2024 | 10:26:02 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 17 | Nov-03-2024 | 10:26:02 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 18 | Nov-03-2024 | 10:26:02 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 19 | Nov-03-2024 | 10:26:02 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 20 | Nov-03-2024 | 10:26:02 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 21 | Nov-03-2024 | 10:26:02 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 22 | Nov-03-2024 | 10:26:02 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 23 | Nov-03-2024 | 10:26:02 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 24 | Nov-03-2024 | 10:26:02 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 25 | Nov-03-2024 | 10:26:02 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 26 | Nov-03-2024 | 10:26:02 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 27 | Nov-03-2024 | 10:26:02 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 28 | Nov-03-2024 | 10:26:03 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 29 | Nov-03-2024 | 10:26:03 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 30 | Nov-03-2024 | 10:26:03 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 31 | Nov-03-2024 | 10:26:03 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 32 | Nov-03-2024 | 10:26:03 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 33 | Nov-03-2024 | 10:26:03 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 34 | Nov-03-2024 | 10:26:03 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 35 | Nov-03-2024 | 10:26:03 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 36 | Nov-03-2024 | 10:26:03 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 37 | Nov-03-2024 | 10:26:03 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 38 | Nov-03-2024 | 10:26:33 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 39 | Nov-03-2024 | 10:26:33 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 40 | Nov-03-2024 | 10:26:33 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 41 | Nov-03-2024 | 10:26:33 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 42 | Nov-03-2024 | 10:26:33 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 43 | Nov-03-2024 | 10:26:33 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 44 | Nov-03-2024 | 10:26:33 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 45 | Nov-03-2024 | 10:26:33 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 46 | Nov-03-2024 | 10:26:33 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 47 | Nov-03-2024 | 10:26:33 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 48 | Nov-03-2024 | 10:26:33 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 49 | Nov-03-2024 | 10:26:33 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 50 | Nov-03-2024 | 10:26:33 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 51 | Nov-03-2024 | 10:26:33 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 52 | Nov-03-2024 | 10:26:33 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 53 | Nov-03-2024 | 10:26:33 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 54 | Nov-03-2024 | 10:26:33 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 55 | Nov-03-2024 | 10:26:33 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 56 | Nov-03-2024 | 10:26:33 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 57 | Nov-03-2024 | 10:26:33 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 58 | Nov-03-2024 | 10:26:33 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 59 | Nov-03-2024 | 10:26:33 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 60 | Nov-03-2024 | 10:26:34 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 61 | Nov-03-2024 | 10:26:34 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 62 | Nov-03-2024 | 10:26:34 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 63 | Nov-03-2024 | 10:26:34 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 64 | Nov-03-2024 | 10:26:34 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 65 | Nov-03-2024 | 10:26:34 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 66 | Nov-03-2024 | 10:26:34 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 67 | Nov-03-2024 | 10:26:34 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 68 | Nov-03-2024 | 10:26:34 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3955]: 69 | Nov-03-2024 | 10:26:34 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 04:29:56 kjcf05n03 ipmievd[3959]: Reading sensors... Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Ipmievd Daemon. Nov 3 04:29:56 kjcf05n03 systemd[1]: Reloading. Nov 3 04:29:56 kjcf05n03 systemd[3124]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 04:29:56 kjcf05n03 nscd[2210]: 2210 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 04:29:56 kjcf05n03 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 04:29:56 kjcf05n03 systemd[1]: Stopped Set Mellanox configuration. Nov 3 04:29:56 kjcf05n03 systemd[1]: Stopping Set Mellanox configuration... Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 04:29:56 kjcf05n03 beSetMlxConfig[4015]: ConnectX-3 multiport not detected Nov 3 04:29:56 kjcf05n03 beSetMlxConfig[4015]: Starting MST (Mellanox Software Tools) driver set Nov 3 04:29:56 kjcf05n03 beSetMlxConfig[4015]: Loading MST PCI module - Success Nov 3 04:29:56 kjcf05n03 systemd-udevd[1564]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 04:29:56 kjcf05n03 beSetMlxConfig[4015]: [warn] mst_pciconf is already loaded, skipping Nov 3 04:29:56 kjcf05n03 beSetMlxConfig[4015]: Create devices Nov 3 04:29:56 kjcf05n03 beSetMlxConfig[4015]: Unloading MST PCI module (unused) - Success Nov 3 04:29:56 kjcf05n03 ipmievd[3959]: Waiting for events... Nov 3 04:29:56 kjcf05n03 beSetMlxConfig[4015]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 04:29:56 kjcf05n03 beSetMlxConfig[4015]: ib mode Nov 3 04:29:56 kjcf05n03 beSetMlxConfig[4015]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 04:29:56 kjcf05n03 beSetMlxConfig[4015]: ib mode Nov 3 04:29:56 kjcf05n03 systemd-udevd[1564]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 04:29:56 kjcf05n03 systemd-udevd[4914]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 04:29:56 kjcf05n03 systemd-udevd[4915]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 04:29:56 kjcf05n03 systemd-udevd[4918]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 04:29:56 kjcf05n03 systemd-udevd[4920]: Using default interface naming scheme 'rhel-8.0'. Nov 3 04:29:56 kjcf05n03 systemd-udevd[4920]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 04:29:56 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 04:29:56 kjcf05n03 systemd[3124]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:29:56 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[4957]: Setting up Mellanox network interface: ib1 Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[4956]: Setting up Mellanox network interface: ib0 Nov 3 04:29:56 kjcf05n03 systemd-udevd[4917]: Using default interface naming scheme 'rhel-8.0'. Nov 3 04:29:56 kjcf05n03 systemd-udevd[4917]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[5006]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[5007]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[5021]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[5023]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[5024]: No configuration found for ib1 Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[5025]: No configuration found for ib0 Nov 3 04:29:56 kjcf05n03 systemd-udevd[4916]: Using default interface naming scheme 'rhel-8.0'. Nov 3 04:29:56 kjcf05n03 systemd-udevd[4916]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[5032]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 04:29:56 kjcf05n03 mlnx_interface_mgr[5033]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 04:29:56 kjcf05n03 mlnx_conf_mgr[5087]: INFO: No configurations found for mlx5_1, skipping. Nov 3 04:29:56 kjcf05n03 mlnx_conf_mgr[5088]: INFO: No configurations found for mlx5_0, skipping. Nov 3 04:29:56 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 04:29:56 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}20b16c4e536ee3bfa3f0ac93628cb40fa3311e42f1880cf4e02e0c4c7c0475f1' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}20b16c4e536ee3bfa3f0ac93628cb40fa3311e42f1880cf4e02e0c4c7c0475f1' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}a3de42fbc6c54adb080503bb83db42912605284070162736c362d2ee63b26984' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}a3de42fbc6c54adb080503bb83db42912605284070162736c362d2ee63b26984' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}bdfcda41b28071f621c1e5bb59e158a0f69394b08d0b8a53944a3a51fc7b0f63' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}bdfcda41b28071f621c1e5bb59e158a0f69394b08d0b8a53944a3a51fc7b0f63' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}df7e5fc1254ab2e5c28e9a47ec285b582cca554b25c033f60a7b772a49ef5fa5' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}df7e5fc1254ab2e5c28e9a47ec285b582cca554b25c033f60a7b772a49ef5fa5' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 04:29:56 kjcf05n03 chronyd[2081]: chronyd exiting Nov 3 04:29:56 kjcf05n03 systemd[1]: Stopping NTP client/server... Nov 3 04:29:56 kjcf05n03 systemd[1]: chronyd.service: Succeeded. Nov 3 04:29:56 kjcf05n03 systemd[1]: Stopped NTP client/server. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 04:29:56 kjcf05n03 chronyd[5126]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 04:29:56 kjcf05n03 chronyd[5126]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 04:29:56 kjcf05n03 chronyd[5126]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 04:29:56 kjcf05n03 chronyd[5126]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 04:29:56 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 04:29:56 kjcf05n03 systemd[1]: Reloading. Nov 3 04:29:56 kjcf05n03 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 04:29:56 kjcf05n03 systemd[1]: dwd.service: Succeeded. Nov 3 04:29:56 kjcf05n03 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 04:29:56 kjcf05n03 dwd[5158]: dwd: vMay 29 2024 : 15:38:26 Nov 3 04:29:56 kjcf05n03 dwd[5158]: /usr/sbin/dwd -i 15 -d Nov 3 04:29:56 kjcf05n03 dwd[5158]: dwd: option Lethal: 0 Nov 3 04:29:56 kjcf05n03 dwd[5158]: dwd: option Interval: 15 Nov 3 04:29:56 kjcf05n03 dwd[5158]: dwd: option abrtlimit: 10 Nov 3 04:29:56 kjcf05n03 dwd[5158]: dwd: option DZPeriod: 604800 Nov 3 04:29:56 kjcf05n03 dwd[5158]: dwd: option SmartPeriod: 43200 Nov 3 04:29:56 kjcf05n03 dwd[5158]: dwd: option SDDEnabled: 1 Nov 3 04:29:56 kjcf05n03 dwd[5158]: dwd: option SDDAwaitScale: 3 Nov 3 04:29:56 kjcf05n03 dwd[5158]: dwd: option SDDAwaitMin: 100 Nov 3 04:29:56 kjcf05n03 dwd[5158]: dwd: option Verbosity: 1 Nov 3 04:29:56 kjcf05n03 dwd[5158]: dwd: option StandAlone: 0 Nov 3 04:29:56 kjcf05n03 dwd[5158]: option Lethal: 0 Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 04:29:56 kjcf05n03 dwd[5158]: option Interval: 15 Nov 3 04:29:56 kjcf05n03 dwd[5158]: option abrtlimit: 10 Nov 3 04:29:56 kjcf05n03 dwd[5158]: option DZPeriod: 604800 Nov 3 04:29:56 kjcf05n03 dwd[5158]: option SmartPeriod: 43200 Nov 3 04:29:56 kjcf05n03 dwd[5158]: option SDDEnabled: 1 Nov 3 04:29:56 kjcf05n03 dwd[5158]: option SDDAwaitScale: 3 Nov 3 04:29:56 kjcf05n03 dwd[5158]: option SDDAwaitMin: 100 Nov 3 04:29:56 kjcf05n03 dwd[5158]: option Verbosity: 1 Nov 3 04:29:56 kjcf05n03 dwd[5158]: option StandAlone: 0 Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 04:29:56 kjcf05n03 dwd[5159]: option Lethal now set to 1 Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 04:29:56 kjcf05n03 dwd[5159]: option abrtlimit now set to 1 Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 04:29:56 kjcf05n03 dwd[5159]: option SmartPeriod now set to 86400 Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 04:29:56 kjcf05n03 systemd[1]: Reloading. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 04:29:56 kjcf05n03 systemd[1]: Reloading. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Discard unused blocks. Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:29:56 kjcf05n03 systemd[1]: Reloading. Nov 3 04:29:56 kjcf05n03 python3.9[5188]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 04:29:56 kjcf05n03 python3.9[3124]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 04:29:56 kjcf05n03 systemd[1]: Reloading. Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Periodic ZFS scrub. Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:29:56 kjcf05n03 systemd[1]: Reloading. Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 04:29:56 kjcf05n03 systemd[1]: Reloading. Nov 3 04:29:56 kjcf05n03 systemd[1]: Starting Sed Control Plane worker process... Nov 3 04:29:56 kjcf05n03 sedcpwrkr[5325]: Using config script: /etc/sedcpwrkr.conf Nov 3 04:29:56 kjcf05n03 sedcpwrkr[5325]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 04:29:56 kjcf05n03 sedcpwrkr[5325]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 04:29:56 kjcf05n03 sedcpwrkr[5325]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 04:29:56 kjcf05n03 sedcpwrkr[5325]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 04:29:56 kjcf05n03 sedcpwrkr[5325]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 04:29:56 kjcf05n03 sedcpwrkr[5325]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 04:29:56 kjcf05n03 sedcpwrkr-server[5356]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 04:29:56 kjcf05n03 sedcpwrkr[5325]: celery multi v5.2.7 (dawn-chorus) Nov 3 04:29:56 kjcf05n03 sedcpwrkr[5325]: > Starting nodes... Nov 3 04:29:56 kjcf05n03 sedcpwrkr[5325]: > sedcpwrkr@kjcf05n03: OK Nov 3 04:29:56 kjcf05n03 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 04:29:56 kjcf05n03 sedcpwrkr-server[5358]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 04:29:56 kjcf05n03 sedcpwrkr-server[5358]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 04:29:56 kjcf05n03 sedcpwrkr-server[5358]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 04:29:56 kjcf05n03 systemd[1]: Started Sed Control Plane worker process. Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 04:29:56 kjcf05n03 systemd[1]: Reloading System Logger Daemon. Nov 3 04:29:56 kjcf05n03 systemd[1]: Reloaded System Logger Daemon. Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 04:29:56 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 04:29:56 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 04:29:57 kjcf05n03 systemd[1]: Reloading. Nov 3 04:29:57 kjcf05n00 diskmonitor[2758297]: leaving test state: 1 next state: 2 Nov 3 04:29:57 kjcf05n00 diskmonitor[2758297]: lock req: no timeout Nov 3 04:29:57 kjcf05n00 diskmonitor[2758297]: leaving test state: 2 next state: 4 Nov 3 04:29:57 kjcf05n03 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 04:29:57 kjcf05n03 systemd-udevd[1564]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 04:29:57 kjcf05n03 iptables.init[5425]: iptables: Applying firewall rules: [ OK ] Nov 3 04:29:57 kjcf05n03 systemd[1]: Started IPv4 firewall with iptables. Nov 3 04:29:57 kjcf05n03 systemd[1]: Reloading. Nov 3 04:29:58 kjcf05n03 systemd[3124]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 04:29:58 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 04:29:58 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 04:29:58 kjcf05n03 systemd[1]: Reloading. Nov 3 04:29:59 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 04:29:59 kjcf05n03 systemd[1]: openhpid.service: Supervising process 5522 which is not our child. We'll most likely not notice when it exits. Nov 3 04:29:59 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 04:29:59 kjcf05n03 systemd[1]: Reloading. Nov 3 04:29:59 kjcf05n03 openhpid[5522]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 04:29:59 kjcf05n03 openhpid[5522]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 04:29:59 kjcf05n03 openhpid[5522]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 04:29:59 kjcf05n03 openhpid[5522]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 04:29:59 kjcf05n03 systemd[1]: Reloading. Nov 3 04:29:59 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:29:59 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:29:59 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 04:29:59 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 04:29:59 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 04:29:59 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 04:29:59 kjcf05n03 systemd[1]: Reloading. Nov 3 04:29:59 kjcf05n03 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 04:30:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 04:30:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 04:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 04:30:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 04:30:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 04:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 04:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 04:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 04:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 04:30:00 kjcf05n03 dcs-collectord[5613]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 04:30:00 kjcf05n03 hpi.inv.log[5613]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 04:30:00 kjcf05n03 dcs-collectord[5613]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 04:30:00 kjcf05n03 dcs-collectord[5613]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 04:30:00 kjcf05n03 dcs-collector[5604]: Starting dcs-collector:[ OK ] Nov 3 04:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 04:30:00 kjcf05n03 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 04:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 04:30:00 kjcf05n03 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 04:30:00 kjcf05n03 dcs-collectord[5616]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 04:30:00 kjcf05n03 dcs-collectord[5616]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 04:30:00 kjcf05n03 dcs-collectord[5616]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 04:30:00 kjcf05n03 dcs-collectord[5616]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 04:30:00 kjcf05n03 dcs-collectord[5616]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 04:30:00 kjcf05n03 dcs-collectord[5616]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 04:30:00 kjcf05n03 dcs-collectord[5616]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 04:30:00 kjcf05n03 dcs-collectord[5616]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259351716", "units": "kB"}, {"name": "MemAvailable", "value": "258631232", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821324", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686692", "units": "kB"}, {"name": "Inactive", "value": "957280", "units": "kB"}, {"name": "Active(anon)", "value": "1520612", "units": "kB"}, {"name": "Inactive(anon)", "value": "821032", "units": "kB"}, {"name": "Active(file)", "value": "166080", "units": "kB"}, {"name": "Inactive(file)", "value": "136248", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "748564", "units": "kB"}, {"name": "Mapped", "value": "86808", "units": "kB"}, {"name": "Shmem", "value": "1593448", "units": "kB"}, {"name": "KReclaimable", "value": "108872", "units": "kB"}, {"name": "Slab", "value": "275068", "units": "kB"}, {"name": "SReclaimable", "value": "108872", "units": "kB"}, {"name": "SUnreclaim", "value": "166196", "units": "kB"}, {"name": "KernelStack", "value": "9792", "units": "kB"}, {"name": "PageTables", "value": "18960", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3109212", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11136", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "4096", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "301384", "units": "kB"}, {"name": "DirectMap2M", "value": "23681024", "units": "kB"}, {"name": "DirectMap1G", "value": "244318208", "units": "kB"}]}' Nov 3 04:30:00 kjcf05n03 dcs-collectord[5616]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 04:30:00 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 04:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 04:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 04:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 04:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 04:30:00 kjcf05n03 systemd[3124]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:30:00 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:30:00 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:30:00 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 04:30:00 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 04:30:00 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 04:30:00 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 04:30:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 04:30:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:30:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 04:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 04:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 04:30:01 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:01 kjcf05n03 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 04:30:01 kjcf05n03 firmware-update-orc[5699]: Using config script: /etc/firmware_update_orc.conf Nov 3 04:30:01 kjcf05n03 firmware-update-orc[5699]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 04:30:01 kjcf05n03 firmware-update-orc[5699]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 04:30:01 kjcf05n03 firmware-update-orc[5699]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 04:30:01 kjcf05n03 firmware-update-orc[5699]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 04:30:01 kjcf05n03 firmware-update-orc[5699]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 04:30:01 kjcf05n03 firmware-update-orc[5699]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 04:30:01 kjcf05n03 dcs-collectord[5616]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 04:30:01 kjcf05n03 dcs-collectord[5616]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730629800.1175907], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730629801.2897742], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730629800.051274, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 04:30:01 kjcf05n03 firmware-update-orc-server[5735]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 04:30:01 kjcf05n03 firmware-update-orc[5699]: celery multi v5.2.7 (dawn-chorus) Nov 3 04:30:01 kjcf05n03 firmware-update-orc[5699]: > Starting nodes... Nov 3 04:30:01 kjcf05n03 firmware-update-orc[5699]: > worker1@kjcf05n03: OK Nov 3 04:30:01 kjcf05n03 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 04:30:01 kjcf05n03 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 04:30:01 kjcf05n03 firmware-update-orc-server[5764]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 04:30:01 kjcf05n03 firmware-update-orc-server[5764]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 04:30:01 kjcf05n03 firmware-update-orc-server[5764]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 04:30:01 kjcf05n03 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 04:30:01 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:02 kjcf05n03 systemd[3124]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:30:02 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:30:02 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:30:02 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 04:30:02 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 04:30:02 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 04:30:02 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 04:30:02 kjcf05n03 dbus-daemon[2187]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 04:30:02 kjcf05n03 dbus-daemon[2187]: [system] Reloaded configuration Nov 3 04:30:02 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 04:30:02 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 04:30:02 kjcf05n03 dbus-daemon[2187]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 04:30:02 kjcf05n03 dbus-daemon[2187]: [system] Reloaded configuration Nov 3 04:30:02 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 04:30:02 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 04:30:02 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 04:30:02 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 04:30:02 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:02 kjcf05n03 systemd[1]: Starting Manages hardware resources... Nov 3 04:30:02 kjcf05n00 python3.9[951306]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 04:30:03 kjcf05n03 ras-resource-manager-agent[5880]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 04:30:03 kjcf05n03 ras-resource-manager-agent[5866]: Starting ras-resource-manager-agent:[ OK ] Nov 3 04:30:03 kjcf05n03 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 04:30:03 kjcf05n03 ras-resource-manager-agent[5882]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 04:30:03 kjcf05n03 ras-resource-manager-client[5882]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 04:30:03 kjcf05n03 systemd[1]: Started Manages hardware resources. Nov 3 04:30:03 kjcf05n03 ras-resource-manager-client[5882]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 04:30:03 kjcf05n03 ras-resource-manager-client[5892]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 04:30:03 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:03 kjcf05n03 systemd[3124]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:30:03 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:30:03 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:30:03 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 04:30:03 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 04:30:03 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:03 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 04:30:03 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:03 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 04:30:04 kjcf05n03 systemd[3124]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: Press Ctrl+C to exit. Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: Plugin support version 1.0 Nov 3 04:30:04 kjcf05n03 zabbix_agent2[5966]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 04:30:04 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:30:04 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:30:04 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:04 kjcf05n03 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 04:30:04 kjcf05n03 dcs-notification-sender[6042]: dcs-notification-senderd is stopped Nov 3 04:30:04 kjcf05n03 zabbix-agent2[6056]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 04:30:04 kjcf05n03 dcs-notification-sender[6042]: Starting notification-sender:[ OK ] Nov 3 04:30:04 kjcf05n03 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 04:30:05 kjcf05n03 zabbix-agent2[6058]: INFO DCS notification agent started. (agent.py:61) Nov 3 04:30:05 kjcf05n03 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 04:30:05 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:05 kjcf05n03 systemd[3124]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:30:05 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:30:05 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:30:05 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:05 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 3 04:30:05 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 3 04:30:05 kjcf05n03 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 04:30:05 kjcf05n00 mcfcli[3673891]: %3|1730629805.556|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:30:05 kjcf05n03 dcs-collectord[6149]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 04:30:05 kjcf05n03 dcs-collectord[6149]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 04:30:05 kjcf05n03 dcs-bulk-data-sender[6149]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 04:30:05 kjcf05n03 dcs-bulk-data-sender[6140]: Starting bulk-data-sender:[ OK ] Nov 3 04:30:05 kjcf05n03 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 04:30:05 kjcf05n03 dcs-collectord[6151]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 04:30:05 kjcf05n03 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 04:30:05 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:06 kjcf05n03 systemd[3124]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:30:06 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:30:06 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:30:06 kjcf05n03 nscd[2210]: 2210 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 04:30:06 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 04:30:06 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 04:30:06 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 04:30:06 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 04:30:06 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 04:30:06 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 04:30:06 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 04:30:06 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 04:30:06 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 04:30:06 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 04:30:06 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 04:30:06 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 04:30:06 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 04:30:06 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 04:30:06 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 04:30:06 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 04:30:07 kjcf05n03 systemd[1]: Stopping System Security Services Daemon... Nov 3 04:30:07 kjcf05n03 sssd[nss][2455]: Shutting down (status = 0) Nov 3 04:30:07 kjcf05n03 sssd[be[implicit_files]][2312]: Shutting down (status = 0) Nov 3 04:30:07 kjcf05n03 systemd[1]: sssd.service: Succeeded. Nov 3 04:30:07 kjcf05n03 systemd[1]: Stopped System Security Services Daemon. Nov 3 04:30:07 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 04:30:07 kjcf05n03 sssd[sssd][6239]: Starting up Nov 3 04:30:07 kjcf05n03 python3.9[5188]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 04:30:07 kjcf05n03 python3.9[3124]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:30:07 kjcf05n03 sssd[be[implicit_files]][6240]: Starting up Nov 3 04:30:07 kjcf05n03 sssd[nss][6241]: Starting up Nov 3 04:30:07 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 04:30:07 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 04:30:07 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 04:30:08 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 04:30:08 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 04:30:08 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 04:30:08 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 04:30:08 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 04:30:08 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 04:30:08 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure) defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 04:30:08 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure: defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 04:30:08 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure) defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 04:30:08 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure: defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 04:30:08 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 04:30:08 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 04:30:08 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 04:30:08 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 04:30:08 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 04:30:08 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 04:30:08 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:09 kjcf05n03 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 04:30:09 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 3 04:30:09 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 3 04:30:09 kjcf05n03 icinga2[6299]: [2024-11-03 04:30:09 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 04:30:09 kjcf05n03 icinga2[6299]: [2024-11-03 04:30:09 -0600] information/cli: Loading configuration file(s). Nov 3 04:30:09 kjcf05n03 icinga2[6299]: [2024-11-03 04:30:09 -0600] information/ConfigItem: Committing config item(s). Nov 3 04:30:09 kjcf05n03 icinga2[6299]: [2024-11-03 04:30:09 -0600] information/ApiListener: My API identity: kjcf05n03 Nov 3 04:30:09 kjcf05n03 icinga2[6299]: [2024-11-03 04:30:09 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 04:30:09 kjcf05n03 icinga2[6299]: [2024-11-03 04:30:09 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 04:30:09 kjcf05n03 icinga2[6299]: [2024-11-03 04:30:09 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 04:30:09 kjcf05n03 icinga2[6299]: [2024-11-03 04:30:09 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 04:30:09 kjcf05n03 icinga2[6299]: [2024-11-03 04:30:09 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 04:30:09 kjcf05n03 icinga2[6299]: [2024-11-03 04:30:09 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 04:30:09 kjcf05n03 icinga2[6299]: [2024-11-03 04:30:09 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 04:30:09 kjcf05n03 icinga2[6299]: [2024-11-03 04:30:09 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 04:30:09 kjcf05n03 icinga2[6299]: [2024-11-03 04:30:09 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 04:30:09 kjcf05n03 icinga2[6299]: [2024-11-03 04:30:09 -0600] information/cli: Closing console log. Nov 3 04:30:09 kjcf05n03 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 04:30:09 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:10 kjcf05n03 systemd[3124]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:30:10 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:30:10 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:30:10 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 04:30:10 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 04:30:10 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:10 kjcf05n03 systemd[1]: Started Icinga2 network monitor. Nov 3 04:30:10 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:11 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 04:30:11 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:30:11 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:30:11 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 04:30:11 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 04:30:11 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 04:30:11 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 04:30:11 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 04:30:11 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 04:30:11 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 04:30:11 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 04:30:11 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 04:30:11 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 04:30:11 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 04:30:11 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 04:30:11 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 04:30:11 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 04:30:11 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:12 kjcf05n03 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 04:30:12 kjcf05n03 nslcd[6912]: version 0.9.9 starting Nov 3 04:30:12 kjcf05n03 nslcd[6912]: accepting connections Nov 3 04:30:12 kjcf05n03 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 04:30:12 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:12 kjcf05n03 systemd[3124]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:30:12 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:30:12 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:30:12 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 04:30:12 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 04:30:12 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 04:30:12 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 04:30:13 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 04:30:13 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 04:30:13 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 04:30:13 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 04:30:13 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:14 kjcf05n03 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 04:30:14 kjcf05n03 dearcpw[7000]: Using config script: /etc/dearcpw.conf Nov 3 04:30:14 kjcf05n03 dearcpw[7000]: - Creating default directory: '/var/log/dearcpw' Nov 3 04:30:14 kjcf05n03 dearcpw[7000]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 04:30:14 kjcf05n03 dearcpw[7000]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 04:30:14 kjcf05n03 dearcpw[7000]: - Creating default directory: '/var/run/dearcpw' Nov 3 04:30:14 kjcf05n03 dearcpw[7000]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 04:30:14 kjcf05n03 dearcpw[7000]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 04:30:14 kjcf05n03 dearcpw-server[7113]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 04:30:14 kjcf05n03 dearcpw[7000]: celery multi v5.2.7 (dawn-chorus) Nov 3 04:30:14 kjcf05n03 dearcpw[7000]: > Starting nodes... Nov 3 04:30:14 kjcf05n03 dearcpw[7000]: > dearcpw@kjcf05n03: OK Nov 3 04:30:14 kjcf05n03 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 04:30:14 kjcf05n03 dearcpw-server[7190]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 04:30:14 kjcf05n03 dearcpw-server[7190]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 04:30:14 kjcf05n03 dearcpw-server[7190]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 04:30:14 kjcf05n03 systemd[1]: Started DEAR Control Plane worker process. Nov 3 04:30:14 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:30:14 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:30:14 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 04:30:14 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 04:30:14 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 04:30:14 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 04:30:14 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 04:30:14 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 04:30:14 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 04:30:14 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 04:30:14 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 04:30:14 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 04:30:15 kjcf05n03 puppet[7381]: IEC: 017000000: Node is up and running: { "node": "kjcf05n03" } Nov 3 04:30:15 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 04:30:15 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 04:30:15 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 04:30:15 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 04:30:15 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 04:30:15 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 04:30:15 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 04:30:15 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 04:30:15 kjcf05n03 dcs-bulk-data-sender[6151]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 04:30:15 kjcf05n03 dcs-collectord[6151]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 04:30:15 kjcf05n03 dcs-collectord[5616]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 04:30:15 kjcf05n03 dcs-collectord[5616]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 04:30:15 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:46442). Nov 3 04:30:15 kjcf05n01 rsyncd[2895105]: connect from kjcf05n03 (172.16.2.6) Nov 3 04:30:15 kjcf05n01 rsyncd[2895105]: rsync to puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 04:30:15 kjcf05n01 rsyncd[2895105]: receiving file list Nov 3 04:30:15 kjcf05n01 rsyncd[2895105]: sent 29 bytes received 325 bytes total size 10901 Nov 3 04:30:15 kjcf05n01 systemd[1]: rsyncd@596-172.16.2.2:873-172.16.2.6:46442.service: Succeeded. Nov 3 04:30:14 kjcf05n00 diskmonitor[2758297]: lock acquired Nov 3 04:30:14 kjcf05n00 diskmonitor[2758297]: leaving test state: 4 next state: 8 Nov 3 04:30:15 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 04:30:15 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 04:30:16 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 04:30:16 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 04:30:16 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 04:30:16 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 04:30:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730629514', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 04:30:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730629514'} Nov 3 04:30:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:30:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730629514', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 04:30:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730629514'} Nov 3 04:30:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:30:16 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 04:30:16 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 04:30:16 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 04:30:16 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 04:30:17 kjcf05n03 ipmievd[3959]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 04:30:17 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 04:30:17 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 04:30:17 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 04:30:17 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 04:30:17 kjcf05n03 ipmievd[3959]: System Event sensor - Timestamp Clock Sync Nov 3 04:30:17 kjcf05n00 diskmonitor[2758297]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 3 04:30:17 kjcf05n00 diskmonitor[2758297]: leaving test state: 8 next state: 20 Nov 3 04:30:17 kjcf05n00 diskmonitor[2758297]: leaving test state: 20 next state: 40 Nov 3 04:30:17 kjcf05n00 diskmonitor[2758297]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset 530ee20000 Nov 3 04:30:17 kjcf05n00 diskmonitor[2758297]: leaving test state: 40 next state: 80 Nov 3 04:30:18 kjcf05n03 ipmievd[3124]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:30:18 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 04:30:18 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 04:30:18 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:18 kjcf05n03 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 04:30:18 kjcf05n03 diskless-swap[7582]: HA_PS_000: recovering journal Nov 3 04:30:18 kjcf05n03 systemd-udevd[1564]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 04:30:18 kjcf05n03 diskless-swap[7582]: HA_PS_000: clean, 2266/6400 files, 7033/25600 blocks Nov 3 04:30:18 kjcf05n03 diskless-swap[7582]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 04:30:18 kjcf05n03 diskless-swap[7582]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 04:30:18 kjcf05n03 diskless-swap[7582]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 04:30:18 kjcf05n03 diskless-swap[7582]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 04:30:18 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 04:30:18 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:30:18 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:30:18 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 04:30:18 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 04:30:18 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 04:30:18 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 04:30:18 kjcf05n03 systemd[1]: Stopping OpenSSH server daemon... Nov 3 04:30:19 kjcf05n03 systemd[1]: sshd.service: Succeeded. Nov 3 04:30:19 kjcf05n03 systemd[1]: Stopped OpenSSH server daemon. Nov 3 04:30:19 kjcf05n03 systemd[1]: Stopped target sshd-keygen.target. Nov 3 04:30:19 kjcf05n03 systemd[1]: Stopping sshd-keygen.target. Nov 3 04:30:19 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 04:30:19 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 04:30:19 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 04:30:19 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 04:30:19 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 04:30:19 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 04:30:19 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 04:30:20 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 04:30:20 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 04:30:20 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 04:30:20 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 04:30:20 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 04:30:20 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 04:30:20 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 04:30:20 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 04:30:21 kjcf05n00 mcfcli[3673891]: %3|1730629821.069|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 04:30:21 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 04:30:21 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 04:30:21 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 04:30:21 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 04:30:22 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 04:30:22 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 04:30:22 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 04:30:22 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 04:30:22 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:22 kjcf05n03 systemd[1]: Set up automount opt-firmware.automount. Nov 3 04:30:22 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:30:22 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:30:22 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 04:30:22 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 04:30:22 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:23 kjcf05n03 systemd[1]: Set up automount mnt-llog.automount. Nov 3 04:30:23 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:30:23 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:30:23 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 04:30:23 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 04:30:23 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:23 kjcf05n03 systemd[1]: Set up automount usr-share-man.automount. Nov 3 04:30:23 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:30:23 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:30:23 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 04:30:23 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 04:30:23 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 04:30:23 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 04:30:23 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 04:30:23 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 04:30:23 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 04:30:23 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 04:30:23 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 04:30:23 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 04:30:23 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:23 kjcf05n03 systemd[1]: Starting Crash recovery kernel arming... Nov 3 04:30:23 kjcf05n03 kdumpctl[7811]: kdump: No kdump initial ramdisk found. Nov 3 04:30:23 kjcf05n03 kdumpctl[7811]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 04:30:24 kjcf05n03 dracut[7923]: dracut-049-135.git20210121.el8 Nov 3 04:30:24 kjcf05n03 dracut[7925]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 04:30:24 kjcf05n03 dracut[7925]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 04:30:24 kjcf05n03 dracut[7925]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 04:30:24 kjcf05n03 dracut[7925]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 04:30:24 kjcf05n03 dracut[7925]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 04:30:24 kjcf05n03 dracut[7925]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 04:30:24 kjcf05n03 dracut[7925]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 04:30:24 kjcf05n03 dracut[7925]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + is_func check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check -h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local dev holder Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + require_binaries mdadm expr Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _module_name=90hperaid Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ mdadm = \-\m ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for cmd in "$@" Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + find_binary mdadm Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for cmd in "$@" Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + find_binary expr Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n -h ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for dev in "${!host_fs_types[@]}" Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ nfs != *_raid_member ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + continue Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _ret=255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + ret=255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ 255 = 0 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ 255 = 255 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ module_depends hperaid Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: +++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: +++ set -x Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ depends Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo rootfs-block Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ return 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ _ret=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ return 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for _moddep in $(module_depends $_mod) Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all == *\ hperaid\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + add_dracutmodules+=' rootfs-block ' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ == *\ hperaid\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check_module rootfs-block Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _mod=rootfs-block Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ == *\ rootfs-block\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n '' ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all == *\ rootfs-block\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + module_check rootfs-block 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 2 -eq 2 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _forced=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + is_func check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check -h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _ret=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + ret=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ 0 = 0 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ module_depends rootfs-block Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: +++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 04:30:24 kjcf05n03 kdumpctl[3124]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ depends Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo fs-lib Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ _ret=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ return 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for _moddep in $(module_depends $_mod) Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all == *\ rootfs-block\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + add_dracutmodules+=' fs-lib ' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ == *\ rootfs-block\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check_module fs-lib Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _mod=fs-lib Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n '' ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + mods_checked_as_dep+=' fs-lib ' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all == *\ fs-lib\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + module_check fs-lib 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 2 -eq 2 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _forced=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + is_func check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check -h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _ret=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + ret=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ 0 = 0 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ module_depends fs-lib Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: +++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ depends Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ return 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ _ret=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ return 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + mods_to_load+=' fs-lib ' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + mods_to_load+=' rootfs-block ' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + mods_to_load+=' hperaid ' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _mod=90kernel-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _mod=kernel-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check_module kernel-modules 1 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _mod=kernel-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all = all ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + module_check kernel-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 1 -eq 2 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + is_func check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check -h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + true Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _ret=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + ret=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ 0 != 0 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ module_depends kernel-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: +++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ depends Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ true Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ _ret=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ return 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + mods_to_load+=' kernel-modules ' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _mod=90kernel-modules-extra Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _mod=kernel-modules-extra Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check_module kernel-modules-extra 1 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _mod=kernel-modules-extra Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all = all ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + module_check kernel-modules-extra Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 1 -eq 2 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + is_func check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check -h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + true Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _ret=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + ret=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ 0 != 0 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ module_depends kernel-modules-extra Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: +++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ depends Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ true Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ _ret=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ return 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + mods_to_load+=' kernel-modules-extra ' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _mod=90kernel-network-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _mod=kernel-network-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check_module kernel-network-modules 1 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _mod=kernel-network-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all = all ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + module_check kernel-network-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 1 -eq 2 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + is_func check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check -h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _ret=255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + ret=255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ 255 != 0 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 1 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _mod=90livenet Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _mod=livenet Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check_module livenet 1 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _mod=livenet Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all = all ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + module_check livenet Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 1 -eq 2 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + is_func check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check -h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _ret=255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + ret=255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ 255 != 0 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 1 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _mod=90lvm Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _mod=lvm Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check_module lvm 1 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _mod=lvm Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all = all ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + module_check lvm Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 1 -eq 2 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + is_func check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check -h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + require_binaries lvm Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _module_name=90lvm Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ lvm = \-\m ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for cmd in "$@" Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + find_binary lvm Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n -h ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for fs in "${host_fs_types[@]}" Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ nfs = LVM*_member ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _ret=255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + ret=255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ 255 != 0 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 1 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _mod=90mdraid Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _mod=mdraid Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check_module mdraid 1 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _mod=mdraid Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all = all ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + module_check mdraid Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 1 -eq 2 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + is_func check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check -h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _rootdev Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + require_binaries mdadm expr Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _module_name=90mdraid Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ mdadm = \-\m ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for cmd in "$@" Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + find_binary mdadm Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for cmd in "$@" Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + find_binary expr Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n -h ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for dev in "${!host_fs_types[@]}" Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ nfs != *_raid_member ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + continue Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _ret=255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + ret=255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ 255 != 0 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 1 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _mod=90multipath Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _mod=multipath Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check_module multipath 1 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _mod=multipath Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all = all ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + module_check multipath Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 1 -eq 2 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + is_func check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check -h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _rootdev Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n -h ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for_each_host_dev_and_slaves is_mpath Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _func=is_mpath Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _dev Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for _dev in "${host_devs[@]}" Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + continue Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 1 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _ret=255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + ret=255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ 255 != 0 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 1 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _mod=90qemu Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _mod=qemu Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check_module qemu 1 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _mod=qemu Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all = all ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + module_check qemu Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 1 -eq 2 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + is_func check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check -h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n -h ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + type -P systemd-detect-virt Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ systemd-detect-virt --vm Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + vm=none Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + (( 1 != 0 )) Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _ret=255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + ret=255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ 255 != 0 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 1 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _mod=90qemu-net Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _mod=qemu-net Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check_module qemu-net 1 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _mod=qemu-net Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all = all ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + module_check qemu-net Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 1 -eq 2 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + is_func check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check -h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n -h ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + type -P systemd-detect-virt Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ systemd-detect-virt --vm Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + vm= Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + (( 1 != 0 )) Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _ret=255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + ret=255 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ 255 != 0 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + return 1 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _mod=90stratis Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + _mod=stratis Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check_module stratis 1 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _mod=stratis Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ all = all ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + module_check stratis Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 1 -eq 2 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + is_func check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + check -h Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _module_name=90stratis Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + local _ret=0 Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + [[ stratisd-init = \-\m ]] Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + for cmd in "$@" Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + find_binary stratisd-init Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 04:30:24 kjcf05n03 kdumpctl[7811]: + set +x Nov 3 04:30:24 kjcf05n03 dracut[7925]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 04:30:24 kjcf05n03 dracut[7925]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 04:30:24 kjcf05n03 dracut[7925]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 04:30:24 kjcf05n03 dracut[7925]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 04:30:25 kjcf05n03 dracut[7925]: memstrack is available Nov 3 04:30:25 kjcf05n03 dracut[7925]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 04:30:25 kjcf05n03 dracut[7925]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 04:30:25 kjcf05n03 dracut[7925]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 04:30:25 kjcf05n03 dracut[7925]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 04:30:25 kjcf05n03 dracut[7925]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 04:30:25 kjcf05n03 dracut[7925]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 04:30:25 kjcf05n03 dracut[7925]: *** Including module: bash *** Nov 3 04:30:25 kjcf05n03 dracut[7925]: *** Including module: systemd *** Nov 3 04:30:26 kjcf05n03 dracut[7925]: *** Including module: fips *** Nov 3 04:30:26 kjcf05n03 dracut[7925]: *** Including module: systemd-initrd *** Nov 3 04:30:26 kjcf05n03 dracut[7925]: *** Including module: watchdog-modules *** Nov 3 04:30:26 kjcf05n03 dracut[7925]: *** Including module: nss-softokn *** Nov 3 04:30:26 kjcf05n03 dracut[7925]: *** Including module: i18n *** Nov 3 04:30:26 kjcf05n03 dracut[7925]: No KEYMAP configured. Nov 3 04:30:27 kjcf05n03 dracut[7925]: *** Including module: network-legacy *** Nov 3 04:30:27 kjcf05n03 dracut[7925]: *** Including module: network *** Nov 3 04:30:27 kjcf05n03 dracut[7925]: *** Including module: ib_bonding *** Nov 3 04:30:27 kjcf05n03 dracut[7925]: *** Including module: drm *** Nov 3 04:30:30 kjcf05n03 dcs-collectord[5616]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 04:30:30 kjcf05n03 dcs-collectord[5616]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 04:30:30 kjcf05n03 dracut[7925]: *** Including module: hperaid *** Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + install Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + local rule rule_path Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + inst_multiple cat expr Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.REDJvy/initramfs -a -f cat expr Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + _ret=0 Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + (( 0 != 0 )) Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + : Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + return 0 Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + inst_multiple -o mdmon Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.REDJvy/initramfs -a -f -o mdmon Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + _ret=0 Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + (( 0 != 0 )) Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + : Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + return 0 Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: ++ command -v partx Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + inst /usr/sbin/partx /sbin/partx Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + local _hostonly_install Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + [[ -e /tmp/dracut.REDJvy/initramfs//sbin/partx ]] Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.REDJvy/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + (( 0 != 0 )) Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + : Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: ++ command -v mdadm Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + local _hostonly_install Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + [[ -e /tmp/dracut.REDJvy/initramfs//sbin/mdadm ]] Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.REDJvy/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + (( 0 != 0 )) Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + : Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + [[ yes == \y\e\s ]] Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + local _raidconf Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: ++ cmdline Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: ++ local _activated dev line UUID Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: ++ declare -A _activated Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: ++ for dev in "${!host_fs_types[@]}" Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: ++ [[ nfs != *_raid_member ]] Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: ++ continue Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + _raidconf= Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + [[ -n '' ]] Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + inst_rules 64-md-raid.rules Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + local _target=/etc/udev/rules.d _rule _found Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + inst_dir /usr/lib/udev/rules.d Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + [[ -e /tmp/dracut.REDJvy/initramfs//usr/lib/udev/rules.d ]] Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + return 0 Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + inst_dir /etc/udev/rules.d Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + [[ -e /tmp/dracut.REDJvy/initramfs//etc/udev/rules.d ]] Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + return 0 Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + for _rule in "$@" Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + continue Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + continue Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + for r in '' $dracutbasedir/rules.d/ Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + [[ 64-md-raid.rules != /* ]] Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + continue Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + for r in '' $dracutbasedir/rules.d/ Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + continue Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + [[ -n '' ]] Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 04:30:30 kjcf05n03 kdumpctl[7811]: + set +x Nov 3 04:30:30 kjcf05n03 dracut[7925]: Skipping udev rule: 64-md-raid.rules Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + installkernel Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + instmods =drivers/md Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + local _optional=-o Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + local _silent Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + local _ret Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + [[ '' = yes ]] Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + [[ =drivers/md = \-\c ]] Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + [[ =drivers/md = \-\s ]] Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + (( 1 == 0 )) Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.REDJvy/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + _ret=0 Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + (( 0 != 0 )) Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + [[ -n '' ]] Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + return 0 Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + _ret=0 Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + return 0 Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + modules_loaded+='hperaid ' Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + '[' -n '' ']' Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + _d_mod=90kernel-modules Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + _d_mod=kernel-modules Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + [[ '' = yes ]] Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + dinfo '*** Including module: kernel-modules ***' Nov 3 04:30:31 kjcf05n03 kdumpctl[7811]: + set +x Nov 3 04:30:31 kjcf05n03 dracut[7925]: *** Including module: kernel-modules *** Nov 3 04:30:31 kjcf05n03 dracut[7925]: *** Including module: kernel-modules-extra *** Nov 3 04:30:31 kjcf05n03 dracut[7925]: *** Including module: kernel-network-modules *** Nov 3 04:30:31 kjcf05n03 dracut[7925]: *** Including module: diskless-mod *** Nov 3 04:30:31 kjcf05n03 dracut[7925]: *** Including module: fstab-sys *** Nov 3 04:30:31 kjcf05n03 dracut[7925]: *** Including module: nfs *** Nov 3 04:30:32 kjcf05n03 dracut[7925]: *** Including module: rootfs-block *** Nov 3 04:30:32 kjcf05n03 dracut[7925]: *** Including module: terminfo *** Nov 3 04:30:32 kjcf05n03 dracut[7925]: *** Including module: udev-rules *** Nov 3 04:30:32 kjcf05n03 dracut[7925]: Skipping udev rule: 91-permissions.rules Nov 3 04:30:32 kjcf05n03 dracut[7925]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 04:30:32 kjcf05n03 dracut[7925]: *** Including module: dracut-systemd *** Nov 3 04:30:33 kjcf05n03 dracut[7925]: *** Including module: usrmount *** Nov 3 04:30:33 kjcf05n03 dracut[7925]: *** Including module: base *** Nov 3 04:30:33 kjcf05n03 dracut[7925]: *** Including module: fs-lib *** Nov 3 04:30:33 kjcf05n03 dracut[7925]: *** Including module: kdumpbase *** Nov 3 04:30:33 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n03": interface became available Nov 3 04:30:34 kjcf05n03 dracut[7925]: *** Including module: memstrack *** Nov 3 04:30:34 kjcf05n03 dracut[7925]: *** Including module: shutdown *** Nov 3 04:30:34 kjcf05n03 dracut[7925]: *** Including module: squash *** Nov 3 04:30:34 kjcf05n03 dracut[7925]: *** Including modules done *** Nov 3 04:30:34 kjcf05n03 dracut[7925]: *** Installing kernel module dependencies *** Nov 3 04:30:35 kjcf05n03 dracut[7925]: *** Installing kernel module dependencies done *** Nov 3 04:30:35 kjcf05n03 dracut[7925]: *** Resolving executable dependencies *** Nov 3 04:30:36 kjcf05n03 dracut[7925]: *** Resolving executable dependencies done*** Nov 3 04:30:36 kjcf05n03 dracut[7925]: *** Hardlinking files *** Nov 3 04:30:36 kjcf05n03 dracut[7925]: *** Hardlinking files done *** Nov 3 04:30:36 kjcf05n03 dracut[7925]: *** Generating early-microcode cpio image *** Nov 3 04:30:36 kjcf05n03 dracut[7925]: *** Constructing AuthenticAMD.bin **** Nov 3 04:30:36 kjcf05n03 dracut[7925]: *** Store current command line parameters *** Nov 3 04:30:36 kjcf05n03 dracut[7925]: Stored kernel commandline: Nov 3 04:30:36 kjcf05n03 dracut[7925]: rd.driver.pre=sd_mod Nov 3 04:30:36 kjcf05n03 dracut[7925]: rd.driver.pre=nvme Nov 3 04:30:36 kjcf05n03 dracut[7925]: rd.driver.pre=ipmi_si Nov 3 04:30:36 kjcf05n03 dracut[7925]: rd.driver.pre=ipmi_devintf Nov 3 04:30:36 kjcf05n03 dracut[7925]: rd.driver.pre=ipmi_msghandler Nov 3 04:30:36 kjcf05n03 dracut[7925]: nameserver=172.16.2.2 Nov 3 04:30:36 kjcf05n03 dracut[7925]: nameserver=127.0.0.1 Nov 3 04:30:36 kjcf05n03 dracut[7925]: nameserver=172.16.2.2 Nov 3 04:30:36 kjcf05n03 dracut[7925]: nameserver=127.0.0.1 Nov 3 04:30:36 kjcf05n03 dracut[7925]: ifname=kdump-meth0:00:09:3d:06:9a:1a team=mgmt0:kdump-meth0 Nov 3 04:30:36 kjcf05n03 dracut[7925]: rd.neednet Nov 3 04:30:36 kjcf05n03 dracut[7925]: kdumpnic=mgmt0 Nov 3 04:30:36 kjcf05n03 dracut[7925]: bootdev=mgmt0 Nov 3 04:30:36 kjcf05n03 dracut[7925]: *** Install squash loader *** Nov 3 04:30:36 kjcf05n03 dracut[7925]: *** Squashing the files inside the initramfs *** Nov 3 04:30:37 kjcf05n03 dracut[7925]: *** Squashing the files inside the initramfs done *** Nov 3 04:30:37 kjcf05n03 dracut[7925]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 04:30:37 kjcf05n03 dracut[7925]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 04:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 04:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 04:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 04:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 04:30:38 kjcf05n03 kdumpctl[7811]: kdump: kexec: loaded kdump kernel Nov 3 04:30:38 kjcf05n03 kdumpctl[7811]: kdump: Starting kdump: [OK] Nov 3 04:30:38 kjcf05n03 systemd[1]: Started Crash recovery kernel arming. Nov 3 04:30:38 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:38 kjcf05n00 zabbix-server[952458]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 04:30:38 kjcf05n00 zabbix-server[952458]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n03 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n03:system.uptime): 00:02:51\\"}}"' Nov 3 04:30:38 kjcf05n00 log_interesting_event.py[952458]: Event '45741' acknowledged Nov 3 04:30:38 kjcf05n00 zabbix-server[952461]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 04:30:38 kjcf05n03 systemd[3124]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:30:38 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:30:38 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:30:38 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 04:30:38 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 04:30:38 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 04:30:38 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 04:30:38 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 04:30:38 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 04:30:38 kjcf05n03 ifdown[14493]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 04:30:38 kjcf05n03 ifdown[14494]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:30:38 kjcf05n03 ifdown[14495]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:30:38 kjcf05n00 zabbix-server[952461]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 3 04:30:38 kjcf05n00 log_interesting_event.py[952461]: Event '45743' acknowledged Nov 3 04:30:38 kjcf05n00 zabbix-server[952462]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 04:30:38 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 04:30:38 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 04:30:38 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 04:30:38 kjcf05n00 zabbix-server[952462]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 3 04:30:38 kjcf05n00 log_interesting_event.py[952462]: Event '45744' acknowledged Nov 3 04:30:39 kjcf05n03 ifup[14555]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 04:30:39 kjcf05n03 ifup[14556]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:30:39 kjcf05n03 ifup[14557]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:30:40 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 04:30:41 kjcf05n00 mcfcli[3673891]: %3|1730629841.716|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:30:43 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 04:30:43 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 04:30:43 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 04:30:43 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:30:43 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:30:43 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:30:43 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:30:43 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 04:30:43 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 04:30:43 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 04:30:43 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 04:30:43 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:30:43 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:30:43 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:30:43 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:30:43 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 04:30:43 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 04:30:43 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 04:30:43 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 04:30:43 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 04:30:43 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 04:30:43 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 04:30:43 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 04:30:43 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 04:30:43 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 04:30:43 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 04:30:43 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 04:30:43 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 04:30:43 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 04:30:43 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 04:30:43 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 04:30:43 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 04:30:43 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 04:30:43 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 04:30:43 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 04:30:43 kjcf05n03 ifdown[14735]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 04:30:43 kjcf05n03 ifdown[14736]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:30:43 kjcf05n03 ifdown[14737]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:30:43 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 04:30:43 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 04:30:43 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 04:30:44 kjcf05n03 ifup[14798]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 04:30:44 kjcf05n03 ifup[14799]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:30:44 kjcf05n03 ifup[14800]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:30:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730629843', 'host':'kjcf05n03', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(0.0B/300.0B), ib1=(0.0B/0.0B), icl0=(4.8kB/6.6kB), lo=(500.0B/500.0B), meth0=(1541.0MB/7.6MB), mgmt0=(1477.7MB/7.6MB)'}"] Nov 3 04:30:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(0.0B/300.0B), ib1=(0.0B/0.0B), icl0=(4.8kB/6.6kB), lo=(500.0B/500.0B), meth0=(1541.0MB/7.6MB), mgmt0=(1477.7MB/7.6MB)', 'message': 'NET OK - (Rx/Tx) ib0=(0.0B/300.0B), ib1=(0.0B/0.0B), icl0=(4.8kB/6.6kB), lo=(500.0B/500.0B), meth0=(1541.0MB/7.6MB), mgmt0=(1477.7MB/7.6MB)', 'value': 'ok', 'timestamp': '1730629843'} Nov 3 04:30:44 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:30:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730629844', 'host':'kjcf05n03', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 04:30:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730629844'} Nov 3 04:30:44 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:30:45 kjcf05n03 dcs-collectord[5616]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 04:30:45 kjcf05n03 dcs-collectord[5616]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 04:30:45 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 04:30:48 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 04:30:48 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 04:30:48 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 04:30:48 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:48 kjcf05n03 systemd[1]: Starting Corosync Cluster Engine... Nov 3 04:30:48 kjcf05n03 await_ha_peer[15020]: Waiting for HA peer kjcf05n02 Nov 3 04:30:50 kjcf05n03 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 04:30:50 kjcf05n03 await_ha_peer[15020]: Peer kjcf05n02 has started, starting HA Nov 3 04:30:50 kjcf05n03 systemd[1]: Started Corosync Cluster Engine. Nov 3 04:30:50 kjcf05n03 systemd[1]: Started Fast STONITH daemon. Nov 3 04:30:50 kjcf05n03 fstonithd.py[15070]: Listening for kdump packets from partner Nov 3 04:30:50 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:50 kjcf05n03 systemd[3124]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:30:50 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:30:50 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:30:50 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:51 kjcf05n03 systemd[1]: Reached target resource-agents dependencies. Nov 3 04:30:51 kjcf05n03 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 04:30:51 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:51 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 04:30:51 kjcf05n03 puppet-agent[3547]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 04:30:51 kjcf05n03 puppet[3547]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 04:30:51 kjcf05n03 puppet-agent[3547]: Applied catalog in 93.49 seconds Nov 3 04:30:51 kjcf05n03 puppet[3547]: Notice: Applied catalog in 93.49 seconds Nov 3 04:30:51 kjcf05n03 systemd[1]: Started Puppet agent. Nov 3 04:30:51 kjcf05n03 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 04:30:51 kjcf05n03 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 04:30:51 kjcf05n03 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 04:30:51 kjcf05n03 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 04:30:51 kjcf05n03 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 04:30:51 kjcf05n03 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 04:30:51 kjcf05n03 systemd[1]: Reached target Timers. Nov 3 04:30:51 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 04:30:51 kjcf05n03 systemd[1]: Starting Set absolute GEM time... Nov 3 04:30:51 kjcf05n03 wce-disable.sh[15209]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 04:30:51 kjcf05n03 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 04:30:51 kjcf05n03 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 04:30:51 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 04:30:51 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 04:30:51 kjcf05n03 systemd[1]: set_gem_time.service: Succeeded. Nov 3 04:30:51 kjcf05n03 systemd[1]: Started Set absolute GEM time. Nov 3 04:30:51 kjcf05n00 mcfcli[3673891]: %3|1730629851.570|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 04:30:52 kjcf05n03 python3.9[15213]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 04:30:52 kjcf05n03 python3.9[15213]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 04:30:52 kjcf05n03 gateway-ec-node.py[15212]: Starting gateway-ec-node service Nov 3 04:30:52 kjcf05n03 RFSF-API[15211]: INFO[2024-11-03T04:30:52-06:00] Datapath API RESTful Service starting Nov 3 04:30:52 kjcf05n03 dp-api-server-node[15211]: INFO[2024-11-03T04:30:52-06:00] Datapath API RESTful Service starting Nov 3 04:30:52 kjcf05n03 RFSF-API[15211]: INFO[2024-11-03T04:30:52-06:00] Running in production mode, starting dbus event listener Nov 3 04:30:52 kjcf05n03 dp-api-server-node[15211]: INFO[2024-11-03T04:30:52-06:00] Running in production mode, starting dbus event listener Nov 3 04:30:52 kjcf05n03 RFSF-API[15211]: INFO[2024-11-03T04:30:52-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 04:30:52 kjcf05n03 dp-api-server-node[15211]: INFO[2024-11-03T04:30:52-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 04:30:52 kjcf05n03 RFSF-API[15211]: INFO[2024-11-03T04:30:52-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 04:30:52 kjcf05n03 dp-api-server-node[15211]: INFO[2024-11-03T04:30:52-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 04:30:52 kjcf05n03 RFSF-API[15211]: INFO[2024-11-03T04:30:52-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 04:30:52 kjcf05n03 dp-api-server-node[15211]: INFO[2024-11-03T04:30:52-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 04:30:52 kjcf05n03 RFSF-API[15211]: INFO[2024-11-03T04:30:52-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 04:30:52 kjcf05n03 dp-api-server-node[15211]: INFO[2024-11-03T04:30:52-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 04:30:52 kjcf05n03 RFSF-API[15211]: INFO[2024-11-03T04:30:52-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 04:30:52 kjcf05n03 dp-api-server-node[15211]: INFO[2024-11-03T04:30:52-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 04:30:52 kjcf05n03 RFSF-API[15211]: INFO[2024-11-03T04:30:52-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 04:30:52 kjcf05n03 dp-api-server-node[15211]: INFO[2024-11-03T04:30:52-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 04:30:52 kjcf05n03 RFSF-API[15211]: INFO[2024-11-03T04:30:52-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 04:30:52 kjcf05n03 dp-api-server-node[15211]: INFO[2024-11-03T04:30:52-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 04:30:52 kjcf05n03 RFSF-API[15211]: INFO[2024-11-03T04:30:52-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 04:30:52 kjcf05n03 dp-api-server-node[15211]: INFO[2024-11-03T04:30:52-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 04:30:52 kjcf05n03 RFSF-API[15211]: INFO[2024-11-03T04:30:52-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 04:30:52 kjcf05n03 dp-api-server-node[15211]: INFO[2024-11-03T04:30:52-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 04:30:52 kjcf05n03 RFSF-API[15211]: INFO[2024-11-03T04:30:52-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 04:30:52 kjcf05n03 dp-api-server-node[15211]: INFO[2024-11-03T04:30:52-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 04:30:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730629855', 'host':'kjcf05n03', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.5% (3885248 kB) used.'}"] Nov 3 04:30:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'RAM usage', 'description': 'OK - 1.5% (3885248 kB) used.', 'message': 'OK - 1.5% (3885248 kB) used.', 'value': 'ok', 'timestamp': '1730629855'} Nov 3 04:30:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:30:59 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:59 kjcf05n03 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 04:30:59 kjcf05n03 systemd[1]: Reloading. Nov 3 04:30:59 kjcf05n03 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 04:31:00 kjcf05n03 diskmonitor_pre[15711]: Key management is currently disabled.DEAR disabled Nov 3 04:31:00 kjcf05n03 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 04:31:00 kjcf05n03 dcs-collectord[5616]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 04:31:00 kjcf05n03 dcs-collectord[5616]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 04:31:00 kjcf05n03 dcs-collectord[5616]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 04:31:01 kjcf05n03 sh[15746]: LNET configured: New Created Nov 3 04:31:01 kjcf05n00 httpd[902570]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-B): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n03', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 04:31:01 kjcf05n03 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 04:31:01 kjcf05n03 LCNmon[17767]: Interface ib0 is up Nov 3 04:31:01 kjcf05n03 LCNmon[17767]: Interface ib1 is up Nov 3 04:31:01 kjcf05n03 LCNmon[17767]: Can ping through interface ib0 Nov 3 04:31:02 kjcf05n03 LCNmon[17767]: Can ping through interface ib1 Nov 3 04:31:02 kjcf05n03 LCNmon[17767]: NIC ib0, initial state UP Nov 3 04:31:02 kjcf05n03 LCNmon[17767]: NIC ib1, initial state UP Nov 3 04:31:02 kjcf05n03 LCNmon[17767]: LCNstat initial state UP Nov 3 04:31:02 kjcf05n03 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 04:31:02 kjcf05n03 LCNmon[17767]: LCNmon monitoring hosts kjcf05n03 and kjcf05n02 Nov 3 04:31:03 kjcf05n01 rsnapshot[2895290]: /usr/bin/rsnapshot -c /etc/rsnapshot.kjcf05n00.conf weekly: completed successfully Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: /var/run/diskmonitor does not exist, creating Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: Creating /var/run/diskmonitor/disk Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: Creating /var/run/diskmonitor/encl Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: Creating /var/run/diskmonitor/cli Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: RAS_Interlocks_enabled: 1 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: add handler for sig: 14 sa_flags: 10000004 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: add handler for sig: 1 sa_flags: 10000004 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: add handler for sig: 2 sa_flags: 00000004 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: add handler for sig: 15 sa_flags: 00000004 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: add handler for sig: 6 sa_flags: 00000004 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: add handler for sig: 3 sa_flags: 00000004 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: add handler for sig: 30 sa_flags: 00000004 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: add handler for sig: 20 sa_flags: 00000004 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: add handler for sig: 10 sa_flags: 10000004 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: add handler for sig: 11 sa_flags: 00000004 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: add handler for sig: 7 sa_flags: 00000004 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: add handler for sig: 4 sa_flags: 00000004 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: add handler for sig: 8 sa_flags: 00000004 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: Using HA Baton locks - key: diskmonitor Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: Baton will be held for at most 570 seconds Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: DMMP Enabled: 0 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: random seed: 96da6f88 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: NVMe Enclosure: 1 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: ZFS Enclosure: 0 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: Dbus, Initialized Connection Successfully Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: int_catcher_thread: thread start Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: Received dbus message 4 org.freedesktop.DBus -> :1.92 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b07bec_S4EUNF0MA05386M encl_slot: 0 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b07bed_S4EUNF0MA05387D encl_slot: 0 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 04:31:03 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 04:31:04 kjcf05n01 rsnapshot[2895296]: /usr/bin/rsnapshot -c /etc/rsnapshot.kjcf05n01.conf weekly: completed successfully Nov 3 04:31:04 kjcf05n01 rsnapshot[2895299]: /usr/bin/rsnapshot -c /etc/rsnapshot.mysql.conf weekly: completed successfully Nov 3 04:31:05 kjcf05n03 openhpid[5522]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 04:31:05 kjcf05n03 openhpid[5522]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 04:31:05 kjcf05n03 systemd[1]: openhpid.service: Succeeded. Nov 3 04:31:05 kjcf05n03 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 04:31:05 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 04:31:05 kjcf05n03 systemd[1]: openhpid.service: Supervising process 18258 which is not our child. We'll most likely not notice when it exits. Nov 3 04:31:05 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 04:31:05 kjcf05n03 systemd[1]: Reached target Multi-User System. Nov 3 04:31:05 kjcf05n03 systemd[1]: Reached target Graphical Interface. Nov 3 04:31:05 kjcf05n03 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 04:31:05 kjcf05n03 dcs-collectord[5616]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 04:31:05 kjcf05n03 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 04:31:05 kjcf05n03 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 04:31:05 kjcf05n03 systemd[1]: Startup finished in 50.177s (kernel) + 2min 31.084s (userspace) = 3min 21.262s. Nov 3 04:31:05 kjcf05n03 openhpid[18258]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 04:31:05 kjcf05n03 openhpid[18258]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 04:31:05 kjcf05n03 openhpid[18258]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 04:31:05 kjcf05n03 openhpid[18258]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 04:31:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730629865', 'host':'kjcf05n03', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 04:31:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730629865'} Nov 3 04:31:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:31:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730629865', 'host':'kjcf05n03', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 04:31:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730629865'} Nov 3 04:31:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:31:06 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18368 (bash) Nov 3 04:31:06 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 04:31:06 kjcf05n03 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 04:31:06 kjcf05n03 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 04:31:06 kjcf05n03 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 04:31:06 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 04:31:09 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 04:31:09 kjcf05n00 diskmonitor[2758297]: leaving test state: 80 next state: 100 Nov 3 04:31:09 kjcf05n00 diskmonitor[2758297]: lock release: time: Sun Nov 3 04:31:09 2024 Nov 3 04:31:09 kjcf05n00 diskmonitor[2758297]: leaving test state: 100 next state: 1 Nov 3 04:31:13 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31413 deleted. Nov 3 04:31:15 kjcf05n03 dcs-collectord[5616]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 04:31:15 kjcf05n03 dcs-collectord[5616]: WARNING No data collected (hpi_parser.py:353) Nov 3 04:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730629879', 'host':'kjcf05n03', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 04:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730629879', 'host':'kjcf05n03', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 04:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730629879'} Nov 3 04:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730629879'} Nov 3 04:31:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:31:19 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 04:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730629879', 'host':'kjcf05n03', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.47, 1.75, 0.84'}"] Nov 3 04:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Load', 'description': 'OK - load average: 1.47, 1.75, 0.84', 'message': 'OK - load average: 1.47, 1.75, 0.84', 'value': 'ok', 'timestamp': '1730629879'} Nov 3 04:31:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730629879', 'host':'kjcf05n03', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 362 processes with STATE = RSZDT '}"] Nov 3 04:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Total Processes', 'description': 'PROCS OK: 362 processes with STATE = RSZDT ', 'message': 'PROCS OK: 362 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730629879'} Nov 3 04:31:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:31:21 kjcf05n00 mcfcli[3673891]: %3|1730629881.265|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:31:21 kjcf05n00 mcfcli[3673891]: %3|1730629881.970|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 04:31:27 kjcf05n03 ipmievd[3959]: System Event sensor - Timestamp Clock Sync Nov 3 04:31:30 kjcf05n03 ipmievd[3124]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:31:30 kjcf05n03 dcs-collectord[5616]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b07bed_S4EUNF0MA05387D encl_sn: USE26000024VS001, slot: 2 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b07bec_S4EUNF0MA05386M encl_sn: USE26000024VS001, slot: 1 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 04:31:42 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 04:31:45 kjcf05n03 dcs-collectord[5616]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 04:31:50 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 04:31:50 kjcf05n03 ras-resource-manager-agent[5882]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "d5efa888-99ce-11ef-ad50-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 04:31:50 kjcf05n03 ras-resource-manager-agent[5882]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'd5efa888-99ce-11ef-ad50-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 04:31:50 kjcf05n03 ras-resource-manager-agent[5882]: INFO Submitting new device inserted signal, starting to qualify drive: d5efa888-99ce-11ef-ad50-00093d069a1b (admin_action.py:110) Nov 3 04:31:50 kjcf05n02 firmware-update-orc-server[5898]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "5f411768-0b75-45a6-a0bb-88efd6dc30de"} (logger.py:65) Nov 3 04:31:50 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 263990 (get_disk_device) Nov 3 04:31:50 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 04:31:50 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 04:31:50 kjcf05n02 ccp-client[264011]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 04:31:50 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'd5efa888-99ce-11ef-ad50-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 04:31:50 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'd5efa888-99ce-11ef-ad50-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 04:31:50 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': 'd5efa888-99ce-11ef-ad50-00093d069a1b', 'response ID': 'd5fa400e-99ce-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 04:31:50 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: d5fa400e-99ce-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 04:31:51 kjcf05n02 ccp-client[264011]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 04:31:51 kjcf05n02 ccp-client[264020]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 04:31:51 kjcf05n02 ccp-client[264011]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 04:31:51 kjcf05n02 ccp-client[264011]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 04:31:51 kjcf05n02 ccp-client[264020]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 04:31:51 kjcf05n02 ccp-client[264020]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 04:31:51 kjcf05n03 diskmonitor[17358]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 04:31:51 kjcf05n03 ras-resource-manager-agent[5882]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "d640f09e-99ce-11ef-ad50-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 04:31:51 kjcf05n03 ras-resource-manager-agent[5882]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'd640f09e-99ce-11ef-ad50-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 04:31:51 kjcf05n03 ras-resource-manager-agent[5882]: INFO Submitting new device inserted signal, starting to qualify drive: d640f09e-99ce-11ef-ad50-00093d069a1b (admin_action.py:110) Nov 3 04:31:51 kjcf05n03 firmware-update-orc-server[5838]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "f75e1c20-d2ac-4aa5-ad9c-fa04206caa78"} (logger.py:65) Nov 3 04:31:50 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'd640f09e-99ce-11ef-ad50-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 04:31:50 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'd640f09e-99ce-11ef-ad50-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 04:31:50 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': 'd640f09e-99ce-11ef-ad50-00093d069a1b', 'response ID': 'd6485f0a-99ce-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 04:31:50 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: d6485f0a-99ce-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 04:31:51 kjcf05n00 mcfcli[3673891]: %3|1730629911.971|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:31:54 kjcf05n02 DRVFW[264151]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 04:31:54 kjcf05n02 ccp-client[264152]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 04:31:54 kjcf05n02 ccp-client[264152]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 04:31:54 kjcf05n02 ccp-client[264165]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 04:31:54 kjcf05n02 ccp-client[264152]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 04:31:54 kjcf05n02 ccp-client[264165]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 04:31:54 kjcf05n02 ccp-client[264165]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 04:31:54 kjcf05n02 ccp-client[264152]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 04:31:54 kjcf05n02 firmware-update-orc-server[5898]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 04:31:55 kjcf05n03 ras-resource-manager-agent[5882]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'd5efa888-99ce-11ef-ad50-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 04:31:55 kjcf05n03 ras-resource-manager-agent[5882]: INFO Drive qualification complete responding: d5efa888-99ce-11ef-ad50-00093d069a1b (admin_action.py:205) Nov 3 04:31:55 kjcf05n03 ras-resource-manager-agent[5882]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "d5efa888-99ce-11ef-ad50-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (interesting_event.py:59) Nov 3 04:31:55 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: d5fa400e-99ce-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 04:31:55 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': 'd5efa888-99ce-11ef-ad50-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'd5efa888-99ce-11ef-ad50-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}}} (logger.py:65) Nov 3 04:31:59 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 04:31:59 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 04:31:59 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 04:31:59 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 04:31:59 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 04:31:59 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 04:31:59 kjcf05n03 diskmonitor[17358]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 04:31:59 kjcf05n03 diskmonitor[17358]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 04:31:59 kjcf05n03 diskmonitor[17358]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 04:31:59 kjcf05n03 diskmonitor[17358]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 04:31:59 kjcf05n03 diskmonitor[17358]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 04:31:59 kjcf05n03 diskmonitor[17358]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "d5efa888-99ce-11ef-ad50-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 04:31:59 kjcf05n03 diskmonitor[17358]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 04:31:59 kjcf05n03 diskmonitor[17358]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 04:31:59 kjcf05n03 diskmonitor[17358]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "d640f09e-99ce-11ef-ad50-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 04:31:59 kjcf05n03 diskmonitor[17358]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 04:31:59 kjcf05n03 diskmonitor[17358]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 04:31:59 kjcf05n00 mcfcli[3673891]: %3|1730629919.682|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:32:01 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22160 (get_disk_device) Nov 3 04:32:01 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 04:32:01 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 04:32:01 kjcf05n03 ccp-client[22198]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 04:32:01 kjcf05n03 ccp-client[22198]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 04:32:01 kjcf05n03 ccp-client[22207]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 04:32:01 kjcf05n03 ccp-client[22198]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 04:32:01 kjcf05n03 ccp-client[22198]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 04:32:01 kjcf05n03 ccp-client[22207]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 04:32:01 kjcf05n03 ccp-client[22207]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 04:32:01 kjcf05n03 chronyd[5126]: Selected source 172.16.2.1 Nov 3 04:32:04 kjcf05n03 DRVFW[22391]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 04:32:04 kjcf05n03 ccp-client[22392]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 04:32:04 kjcf05n03 ccp-client[22392]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 04:32:04 kjcf05n03 ccp-client[22403]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 04:32:04 kjcf05n03 ccp-client[22392]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 04:32:04 kjcf05n03 ccp-client[22392]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 04:32:04 kjcf05n03 ccp-client[22403]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 04:32:04 kjcf05n03 ccp-client[22403]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 04:32:04 kjcf05n03 firmware-update-orc-server[5838]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 04:32:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730629925}"] Nov 3 04:32:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730629925, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:32:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:32:05 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: d6485f0a-99ce-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 04:32:05 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': 'd640f09e-99ce-11ef-ad50-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'd640f09e-99ce-11ef-ad50-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}}} (logger.py:65) Nov 3 04:32:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730629925}"] Nov 3 04:32:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730629925, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:32:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:32:06 kjcf05n03 ras-resource-manager-agent[5882]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'd640f09e-99ce-11ef-ad50-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 3 04:32:06 kjcf05n03 ras-resource-manager-agent[5882]: INFO Drive qualification complete responding: d640f09e-99ce-11ef-ad50-00093d069a1b (admin_action.py:205) Nov 3 04:32:06 kjcf05n03 ras-resource-manager-agent[5882]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "d640f09e-99ce-11ef-ad50-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (interesting_event.py:59) Nov 3 04:32:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730629925}"] Nov 3 04:32:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730629925, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:32:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:32:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730629925}"] Nov 3 04:32:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730629925, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:32:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:32:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730629925}"] Nov 3 04:32:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730629925, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:32:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:32:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730629926}"] Nov 3 04:32:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730629926, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:32:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:32:07 kjcf05n03 systemd[1]: Unmounting /mnt/llog... Nov 3 04:32:07 kjcf05n03 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 04:32:07 kjcf05n03 systemd[1]: Unmounted /mnt/llog. Nov 3 04:32:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730629932}"] Nov 3 04:32:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730629932, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:32:12 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:32:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730629932}"] Nov 3 04:32:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730629932, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:32:12 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:32:13 kjcf05n03 python3.9[5188]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 04:32:15 kjcf05n03 python3.9[3124]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:32:15 kjcf05n03 ras-resource-manager-agent[5882]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "d5efa888-99ce-11ef-ad50-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (service_main_handler.py:66) Nov 3 04:32:15 kjcf05n03 ras-resource-manager-agent[5882]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'd5efa888-99ce-11ef-ad50-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 04:32:15 kjcf05n03 ras-resource-manager-agent[5882]: INFO Device qualification response has been acknowledged: d5efa888-99ce-11ef-ad50-00093d069a1b (admin_action.py:151) Nov 3 04:32:15 kjcf05n03 ras-resource-manager-agent[5882]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "d640f09e-99ce-11ef-ad50-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (service_main_handler.py:66) Nov 3 04:32:15 kjcf05n03 ras-resource-manager-agent[5882]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'd640f09e-99ce-11ef-ad50-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 3 04:32:15 kjcf05n03 ras-resource-manager-agent[5882]: INFO Device qualification response has been acknowledged: d640f09e-99ce-11ef-ad50-00093d069a1b (admin_action.py:151) Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "d5efa888-99ce-11ef-ad50-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: Dbus, handle_ingress_ras_signals, uuid: d5efa888-99ce-11ef-ad50-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "d5efa888-99ce-11ef-ad50-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "d640f09e-99ce-11ef-ad50-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: Dbus, handle_ingress_ras_signals, uuid: d640f09e-99ce-11ef-ad50-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "d640f09e-99ce-11ef-ad50-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 04:32:17 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 04:32:19 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 04:32:19 kjcf05n03 diskmonitor[17358]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 04:32:21 kjcf05n00 mcfcli[3673891]: %3|1730629941.971|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:32:24 kjcf05n03 diskmonitor[17358]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 04:32:24 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 04:32:24 kjcf05n03 diskmonitor[17358]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 04:32:24 kjcf05n03 diskmonitor[17358]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 04:32:24 kjcf05n03 diskmonitor[17358]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 04:32:24 kjcf05n03 diskmonitor[17358]: leaving test state: 1 next state: 2 Nov 3 04:32:24 kjcf05n03 diskmonitor[17358]: lock req: no timeout Nov 3 04:32:24 kjcf05n03 diskmonitor[17358]: leaving test state: 2 next state: 4 Nov 3 04:32:24 kjcf05n03 diskmonitor[17358]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 04:32:37 kjcf05n00 mcfcli[3673891]: %3|1730629957.208|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:32:52 kjcf05n00 mcfcli[3673891]: %3|1730629972.072|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 04:33:11 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 04:33:12 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 04:33:12 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 04:33:15 kjcf05n00 mcfcli[3673891]: %3|1730629995.415|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:33:21 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 04:33:21 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 04:33:21 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 04:33:22 kjcf05n00 mcfcli[3673891]: %3|1730630002.072|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 04:33:26 kjcf05n03 dcs-collectord[5616]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 04:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T04:33:27.269155509-06:00 level=info msg="Completed cleanup jobs" duration=42.704015ms Nov 3 04:33:30 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/21', errno='Permission denied (13)' Nov 3 04:33:34 kjcf05n03 diskmonitor[17358]: lock acquired Nov 3 04:33:34 kjcf05n03 diskmonitor[17358]: leaving test state: 4 next state: 8 Nov 3 04:33:41 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730630020}"] Nov 3 04:33:41 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730630020, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:33:41 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:33:41-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:33:41 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:33:41-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:33:41 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:33:41-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:33:41 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:33:41-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:33:41 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:33:41-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:33:41 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:33:41-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:33:41 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:33:41-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.995998ms Nov 3 04:33:41 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:33:41-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.995998ms Nov 3 04:33:41 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:33:41 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:33:41 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:33:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730630026}"] Nov 3 04:33:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730630026, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:33:46 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:33:46-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:33:46 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:33:46-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:33:46 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:33:46-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:33:46 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:33:46-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:33:46 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:33:46-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:33:46 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:33:46-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:33:46 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:33:46-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.164894ms Nov 3 04:33:46 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:33:46-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.164894ms Nov 3 04:33:46 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:33:46 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:33:46 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:33:51 kjcf05n03 diskmonitor[17358]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 04:33:51 kjcf05n03 diskmonitor[17358]: leaving test state: 8 next state: 20 Nov 3 04:33:51 kjcf05n03 diskmonitor[17358]: leaving test state: 20 next state: 40 Nov 3 04:33:51 kjcf05n03 diskmonitor[17358]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 146e6000000 Nov 3 04:33:51 kjcf05n03 diskmonitor[17358]: leaving test state: 40 next state: 80 Nov 3 04:33:52 kjcf05n00 mcfcli[3673891]: %3|1730630032.072|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:33:55 kjcf05n00 mcfcli[3673891]: %3|1730630035.395|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:33:57 kjcf05n03 diskmonitor[17358]: leaving test state: 80 next state: 100 Nov 3 04:33:57 kjcf05n03 diskmonitor[17358]: lock release: time: Sun Nov 3 04:33:52 2024 Nov 3 04:33:57 kjcf05n03 diskmonitor[17358]: leaving test state: 100 next state: 1 Nov 3 04:34:13 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31414 deleted. Nov 3 04:34:22 kjcf05n00 mcfcli[3673891]: %3|1730630062.072|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 04:34:33 kjcf05n00 mcfcli[3673891]: %3|1730630073.944|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:34:52 kjcf05n00 mcfcli[3673891]: %3|1730630092.073|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 04:35:02 kjcf05n00 python3.9[955347]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 04:35:04 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 04:35:11 kjcf05n00 mcfcli[3673891]: %3|1730630111.693|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:35:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730629514', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 04:35:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730629514'} Nov 3 04:35:15 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:35:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730629514', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 04:35:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730629514'} Nov 3 04:35:15 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:35:22 kjcf05n00 mcfcli[3673891]: %3|1730630122.073|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:35:51 kjcf05n00 mcfcli[3673891]: %3|1730630151.035|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:35:52 kjcf05n00 mcfcli[3673891]: %3|1730630152.074|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:36:00 kjcf05n00 zabbix-server[956145]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 04:36:00 kjcf05n00 zabbix-server[956145]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n03' from event '45761' Nov 3 04:36:00 kjcf05n00 zabbix-server[956145]: Host created 'enclosure_USE26000024VS001' Nov 3 04:36:00 kjcf05n00 zabbix-server[956145]: Running puppet on 'kjcf05n03' Nov 3 04:36:02 kjcf05n03 puppet-agent[32505]: Using configured environment 'production' Nov 3 04:36:02 kjcf05n03 puppet-agent[32505]: Retrieving pluginfacts Nov 3 04:36:02 kjcf05n03 puppet-agent[32505]: Retrieving plugin Nov 3 04:36:02 kjcf05n03 puppet-agent[32505]: Loading facts Nov 3 04:36:08 kjcf05n03 puppet-agent[32505]: Caching catalog for kjcf05n03 Nov 3 04:36:08 kjcf05n03 puppet-agent[32505]: Applying configuration version '1730630164' Nov 3 04:36:10 kjcf05n03 puppet-agent[32505]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 04:36:10 kjcf05n03 puppet-agent[32505]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 04:36:10 kjcf05n03 puppet-agent[32505]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 04:36:10 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 04:36:10 kjcf05n03 zabbix_agent2[5966]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 04:36:10 kjcf05n03 zabbix_agent2[3124]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:36:10 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 04:36:10 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 04:36:10 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 04:36:10 kjcf05n03 puppet-agent[32505]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: Press Ctrl+C to exit. Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: Plugin support version 1.0 Nov 3 04:36:10 kjcf05n03 zabbix_agent2[33119]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 04:36:10 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 04:36:12 kjcf05n03 puppet-agent[32505]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 04:36:12 kjcf05n03 puppet-agent[32505]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 04:36:12 kjcf05n03 puppet-agent[32505]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 04:36:13 kjcf05n00 zabbix-server[956145]: puppet completed status:(0): '' Nov 3 04:36:13 kjcf05n00 zabbix-server[956145]: Event '45761' acknowledged Nov 3 04:36:13 kjcf05n00 zabbix-server[956145]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n03"}' Nov 3 04:36:13 kjcf05n03 puppet-agent[32505]: Applied catalog in 5.16 seconds Nov 3 04:36:22 kjcf05n00 mcfcli[3673891]: %3|1730630182.075|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 04:36:29 kjcf05n00 mcfcli[3673891]: %3|1730630189.592|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:36:52 kjcf05n00 mcfcli[3673891]: %3|1730630212.075|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 04:37:09 kjcf05n00 mcfcli[3673891]: %3|1730630229.588|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:37:22 kjcf05n00 mcfcli[3673891]: %3|1730630242.075|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 04:37:49 kjcf05n00 mcfcli[3673891]: %3|1730630269.585|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:37:52 kjcf05n00 mcfcli[3673891]: %3|1730630272.075|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 04:38:22 kjcf05n00 mcfcli[3673891]: %3|1730630302.076|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 04:38:26 kjcf05n00 mcfcli[3673891]: %3|1730630306.463|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:38:52 kjcf05n00 mcfcli[3673891]: %3|1730630332.076|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:39:04 kjcf05n00 mcfcli[3673891]: %3|1730630344.022|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:39:22 kjcf05n00 mcfcli[3673891]: %3|1730630362.077|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 04:39:43 kjcf05n00 mcfcli[3673891]: %3|1730630383.078|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:39:52 kjcf05n00 mcfcli[3673891]: %3|1730630392.077|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 04:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 04:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 04:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 04:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 04:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 04:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 04:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 04:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 04:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 04:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 04:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 04:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 04:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 04:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 04:40:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 04:40:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:40:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 04:40:02 kjcf05n00 python3.9[958222]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 04:40:20 kjcf05n00 mcfcli[3673891]: %3|1730630420.494|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:40:22 kjcf05n00 mcfcli[3673891]: %3|1730630422.078|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:40:52 kjcf05n00 mcfcli[3673891]: %3|1730630452.079|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 04:40:58 kjcf05n00 mcfcli[3673891]: %3|1730630458.285|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:41:22 kjcf05n00 mcfcli[3673891]: %3|1730630482.079|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:41:36 kjcf05n00 mcfcli[3673891]: %3|1730630496.357|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:41:40 kjcf05n03 root[41188]: failback_xyraid Nov 3 04:41:42 kjcf05n03 root[41301]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 04:41:43 kjcf05n03 root[41376]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 04:41:44 kjcf05n02 nslcd[6978]: [a7c4c9] ldap_result() failed: Can't contact LDAP server Nov 3 04:41:47 kjcf05n02 systemd[1]: data-kjcf05n03:md66.mount: Succeeded. Nov 3 04:41:51 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme6n1 Nov 3 04:41:51 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme7n1 Nov 3 04:41:51 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme11n1 Nov 3 04:41:51 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme12n1 Nov 3 04:41:51 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme5n1 Nov 3 04:41:51 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme16n1 Nov 3 04:41:51 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme20n1 Nov 3 04:41:51 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme21n1 Nov 3 04:41:51 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme10n1 Nov 3 04:41:51 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme15n1 Nov 3 04:41:51 kjcf05n02 dwd[5220]: Drive path is missing, purging: nvme22n1 Nov 3 04:41:52 kjcf05n03 diskmonitor[17358]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 04:41:52 kjcf05n00 mcfcli[3673891]: %3|1730630512.079|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:41:52 kjcf05n03 dwd[5159]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 04:41:52 kjcf05n03 dwd[5159]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 04:41:52 kjcf05n03 dwd[5159]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 04:41:52 kjcf05n03 dwd[5159]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 04:41:52 kjcf05n03 dwd[5159]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 04:41:52 kjcf05n03 dwd[5159]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 04:41:52 kjcf05n03 dwd[5159]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 04:41:52 kjcf05n03 dwd[5159]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 04:41:52 kjcf05n03 dwd[5159]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 04:41:52 kjcf05n03 dwd[5159]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 04:41:52 kjcf05n03 dwd[5159]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 04:41:52 kjcf05n03 dwd[5159]: Starting NVME thread for nvme10n1 Nov 3 04:41:53 kjcf05n03 dwd[5159]: Starting NVME thread for nvme15n1 Nov 3 04:41:53 kjcf05n03 dwd[5159]: Starting NVME thread for nvme21n1 Nov 3 04:41:53 kjcf05n03 dwd[5159]: Starting NVME thread for nvme11n1 Nov 3 04:41:53 kjcf05n03 dwd[5159]: Starting NVME thread for nvme20n1 Nov 3 04:41:54 kjcf05n03 dwd[5159]: Starting NVME thread for nvme12n1 Nov 3 04:41:54 kjcf05n03 systemd-udevd[44422]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44424]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44422]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44426]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44428]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44424]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44422]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44426]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44428]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44424]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44422]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44426]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44428]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44424]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44422]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44426]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44428]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44424]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44422]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44428]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44426]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44424]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44422]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44428]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44426]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44424]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44422]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44428]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44426]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44424]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44422]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44426]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44464]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44463]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44460]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44465]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44464]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44463]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44465]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44460]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44459]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44465]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44460]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44460]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44465]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44459]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44465]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44465]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44459]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44465]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44459]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44459]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44465]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44465]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44465]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44459]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44459]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44465]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44459]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44465]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44459]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44459]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44459]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 systemd-udevd[44459]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:41:54 kjcf05n03 dwd[5159]: Starting NVME thread for nvme7n1 Nov 3 04:41:54 kjcf05n03 dwd[5159]: Starting NVME thread for nvme6n1 Nov 3 04:41:54 kjcf05n03 dwd[5159]: Starting NVME thread for nvme5n1 Nov 3 04:41:54 kjcf05n03 dwd[5159]: Starting NVME thread for nvme16n1 Nov 3 04:41:54 kjcf05n03 dwd[5159]: Starting NVME thread for nvme22n1 Nov 3 04:41:55 kjcf05n03 dcs-bulk-data-sender[6151]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 3 04:41:59 kjcf05n03 diskmonitor[17358]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 04:41:59 kjcf05n03 diskmonitor[17358]: Scan for ReadErrorMax change for md66 Nov 3 04:41:59 kjcf05n03 diskmonitor[17358]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 04:41:59 kjcf05n03 diskmonitor[17358]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 04:41:59 kjcf05n03 diskmonitor[17358]: read_saved_file: md66 no saved speed Nov 3 04:41:59 kjcf05n03 diskmonitor[17358]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 04:41:59 kjcf05n03 diskmonitor[17358]: Set sync_speed_min (10000) for md66 Nov 3 04:41:59 kjcf05n03 diskmonitor[17358]: Set sync_speed_max (200000) for md66 Nov 3 04:41:59 kjcf05n03 diskmonitor[17358]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 04:42:02 kjcf05n03 nslcd[6912]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 04:42:02 kjcf05n02 diskmonitor[17478]: Removed MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 04:42:02 kjcf05n02 diskmonitor[17478]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 04:42:13 kjcf05n00 mcfcli[3673891]: %3|1730630533.295|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:42:22 kjcf05n00 mcfcli[3673891]: %3|1730630542.081|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 04:42:44 kjcf05n03 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 04:42:44 kjcf05n03 systemd-tmpfiles[47138]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 04:42:44 kjcf05n03 systemd-tmpfiles[47138]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 04:42:44 kjcf05n03 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 04:42:44 kjcf05n03 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 04:42:49 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47420 (bash) Nov 3 04:42:49 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 04:42:49 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 04:42:52 kjcf05n00 mcfcli[3673891]: %3|1730630572.081|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:42:52 kjcf05n00 mcfcli[3673891]: %3|1730630572.650|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:43:22 kjcf05n00 mcfcli[3673891]: %3|1730630602.081|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 04:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T04:43:27.269239132-06:00 level=info msg="Completed cleanup jobs" duration=42.783523ms Nov 3 04:43:29 kjcf05n00 mcfcli[3673891]: %3|1730630609.393|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:43:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730630615}"] Nov 3 04:43:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730630615, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:43:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.89051ms Nov 3 04:43:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.89051ms Nov 3 04:43:35 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:43:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:43:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:43:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730630615}"] Nov 3 04:43:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730630615, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:43:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.924294ms Nov 3 04:43:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.924294ms Nov 3 04:43:35 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:43:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:43:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:43:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730630615}"] Nov 3 04:43:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730630615, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:43:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.612911ms Nov 3 04:43:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.612911ms Nov 3 04:43:35 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:43:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:43:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:43:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730630615}"] Nov 3 04:43:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730630615, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:43:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.063655ms Nov 3 04:43:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.063655ms Nov 3 04:43:35 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:43:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:43:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:43:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730630615}"] Nov 3 04:43:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730630615, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:43:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.888236ms Nov 3 04:43:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.888236ms Nov 3 04:43:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:43:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:43:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:43:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730630615}"] Nov 3 04:43:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730630615, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:43:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.060609ms Nov 3 04:43:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.060609ms Nov 3 04:43:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:43:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:43:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:43:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730630615}"] Nov 3 04:43:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730630615, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:43:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.85125ms Nov 3 04:43:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.85125ms Nov 3 04:43:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:43:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:43:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:43:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730630615}"] Nov 3 04:43:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730630615, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:43:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.111895ms Nov 3 04:43:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.111895ms Nov 3 04:43:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:43:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:43:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:43:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730630615}"] Nov 3 04:43:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730630615, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:43:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.163142ms Nov 3 04:43:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.163142ms Nov 3 04:43:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:43:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:43:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:43:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730630615}"] Nov 3 04:43:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730630615, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:43:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.889699ms Nov 3 04:43:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.889699ms Nov 3 04:43:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:43:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:43:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:43:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730630615}"] Nov 3 04:43:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730630615, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:43:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:43:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:43:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:43:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:43:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:43:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:43:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.231529ms Nov 3 04:43:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:43:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.231529ms Nov 3 04:43:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:43:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:43:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:43:52 kjcf05n00 mcfcli[3673891]: %3|1730630632.082|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 04:44:03 kjcf05n00 mcfcli[3673891]: %3|1730630643.893|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:44:22 kjcf05n00 mcfcli[3673891]: %3|1730630662.082|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 04:44:41 kjcf05n00 mcfcli[3673891]: %3|1730630681.501|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:44:52 kjcf05n00 mcfcli[3673891]: %3|1730630692.082|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:44:58 kjcf05n00 zabbix-server[961283]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 04:44:58 kjcf05n00 zabbix-server[961283]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n03' from event '45763' Nov 3 04:44:58 kjcf05n00 zabbix-server[961283]: Filesystem 'kjcf05' has been mounted Nov 3 04:44:59 kjcf05n00 zabbix-server[961283]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 04:44:59 kjcf05n00 zabbix-server[961283]: Running puppet on 'None' Nov 3 04:45:01 kjcf05n05 puppet-agent[2432486]: Using configured environment 'production' Nov 3 04:45:01 kjcf05n05 puppet-agent[2432486]: Retrieving pluginfacts Nov 3 04:45:01 kjcf05n05 puppet-agent[2432486]: Retrieving plugin Nov 3 04:45:01 kjcf05n07 puppet-agent[2293028]: Using configured environment 'production' Nov 3 04:45:01 kjcf05n07 puppet-agent[2293028]: Retrieving pluginfacts Nov 3 04:45:01 kjcf05n07 puppet-agent[2293028]: Retrieving plugin Nov 3 04:45:01 kjcf05n06 puppet-agent[2296495]: Using configured environment 'production' Nov 3 04:45:01 kjcf05n06 puppet-agent[2296495]: Retrieving pluginfacts Nov 3 04:45:01 kjcf05n06 puppet-agent[2296495]: Retrieving plugin Nov 3 04:45:01 kjcf05n06 puppet-agent[2296495]: Loading facts Nov 3 04:45:01 kjcf05n02 puppet-agent[288125]: Using configured environment 'production' Nov 3 04:45:01 kjcf05n02 puppet-agent[288125]: Retrieving pluginfacts Nov 3 04:45:01 kjcf05n02 puppet-agent[288125]: Retrieving plugin Nov 3 04:45:01 kjcf05n03 puppet-agent[51672]: Using configured environment 'production' Nov 3 04:45:01 kjcf05n03 puppet-agent[51672]: Retrieving pluginfacts Nov 3 04:45:01 kjcf05n03 puppet-agent[51672]: Retrieving plugin Nov 3 04:45:01 kjcf05n04 puppet-agent[2292671]: Using configured environment 'production' Nov 3 04:45:01 kjcf05n04 puppet-agent[2292671]: Retrieving pluginfacts Nov 3 04:45:01 kjcf05n04 puppet-agent[2292671]: Retrieving plugin Nov 3 04:45:01 kjcf05n05 puppet-agent[2432486]: Loading facts Nov 3 04:45:01 kjcf05n01 puppet-agent[2900773]: Using configured environment 'production' Nov 3 04:45:01 kjcf05n01 puppet-agent[2900773]: Retrieving pluginfacts Nov 3 04:45:01 kjcf05n01 puppet-agent[2900773]: Retrieving plugin Nov 3 04:45:01 kjcf05n02 puppet-agent[288125]: Loading facts Nov 3 04:45:01 kjcf05n03 puppet-agent[51672]: Loading facts Nov 3 04:45:02 kjcf05n04 puppet-agent[2292671]: Loading facts Nov 3 04:45:01 kjcf05n00 puppet-agent[961354]: Using configured environment 'production' Nov 3 04:45:01 kjcf05n00 puppet-agent[961354]: Retrieving pluginfacts Nov 3 04:45:01 kjcf05n00 puppet-agent[961354]: Retrieving plugin Nov 3 04:45:02 kjcf05n07 puppet-agent[2293028]: Loading facts Nov 3 04:45:02 kjcf05n01 puppet-agent[2900773]: Loading facts Nov 3 04:45:02 kjcf05n00 puppet-agent[961354]: Loading facts Nov 3 04:45:02 kjcf05n00 python3.9[961273]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 04:45:05 kjcf05n07 puppet-agent[2293028]: Caching catalog for kjcf05n07 Nov 3 04:45:05 kjcf05n07 puppet-agent[2293028]: Applying configuration version '1730630703' Nov 3 04:45:05 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 04:45:05 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 04:45:07 kjcf05n01 puppet-agent[2900773]: Caching catalog for kjcf05n01 Nov 3 04:45:07 kjcf05n06 puppet-agent[2296495]: Caching catalog for kjcf05n06 Nov 3 04:45:07 kjcf05n06 puppet-agent[2296495]: Applying configuration version '1730630703' Nov 3 04:45:08 kjcf05n01 puppet-agent[2900773]: Applying configuration version '1730630704' Nov 3 04:45:08 kjcf05n02 puppet-agent[288125]: Caching catalog for kjcf05n02 Nov 3 04:45:08 kjcf05n02 puppet-agent[288125]: Applying configuration version '1730630702' Nov 3 04:45:08 kjcf05n03 puppet-agent[51672]: Caching catalog for kjcf05n03 Nov 3 04:45:08 kjcf05n03 puppet-agent[51672]: Applying configuration version '1730630703' Nov 3 04:45:08 kjcf05n00 puppet-agent[961354]: Caching catalog for kjcf05n00 Nov 3 04:45:09 kjcf05n00 puppet-agent[961354]: Applying configuration version '1730630706' Nov 3 04:45:09 kjcf05n07 puppet-agent[2293028]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 04:45:09 kjcf05n07 puppet-agent[2293028]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 04:45:09 kjcf05n07 puppet-agent[2293028]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 04:45:09 kjcf05n05 puppet-agent[2432486]: Caching catalog for kjcf05n05 Nov 3 04:45:09 kjcf05n05 puppet-agent[2432486]: Applying configuration version '1730630707' Nov 3 04:45:09 kjcf05n06 puppet-agent[2296495]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 04:45:09 kjcf05n06 puppet-agent[2296495]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 04:45:09 kjcf05n06 puppet-agent[2296495]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 04:45:10 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2240582]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 04:45:10 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 04:45:10 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 04:45:10 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 04:45:10 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 04:45:10 kjcf05n07 puppet-agent[2293028]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: Press Ctrl+C to exit. Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: Plugin support version 1.0 Nov 3 04:45:10 kjcf05n07 zabbix_agent2[2293699]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 04:45:10 kjcf05n04 puppet-agent[2292671]: Caching catalog for kjcf05n04 Nov 3 04:45:10 kjcf05n04 puppet-agent[2292671]: Applying configuration version '1730630707' Nov 3 04:45:10 kjcf05n02 puppet-agent[288125]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 04:45:10 kjcf05n02 puppet-agent[288125]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 04:45:10 kjcf05n02 puppet-agent[288125]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 04:45:10 kjcf05n03 puppet-agent[51672]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 04:45:10 kjcf05n03 puppet-agent[51672]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 04:45:10 kjcf05n03 puppet-agent[51672]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 04:45:10 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2244291]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 04:45:10 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 04:45:10 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 04:45:10 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 04:45:10 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 04:45:10 kjcf05n06 puppet-agent[2296495]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: Press Ctrl+C to exit. Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: Plugin support version 1.0 Nov 3 04:45:10 kjcf05n06 zabbix_agent2[2296954]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 04:45:10 kjcf05n01 puppet-agent[2900773]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 04:45:10 kjcf05n01 puppet-agent[2900773]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-04:23:45]/mode) mode changed '0755' to '0750' Nov 3 04:45:10 kjcf05n01 puppet-agent[2900773]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-04:23:45/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 04:45:10 kjcf05n01 puppet-agent[2900773]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-04:23:45/vmcore]/mode) mode changed '0600' to '0640' Nov 3 04:45:10 kjcf05n01 puppet-agent[2900773]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-04:23:45/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 04:45:10 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 04:45:10 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 04:45:10 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 04:45:10 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 04:45:10 kjcf05n02 zabbix_agent2[229865]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 04:45:10 kjcf05n02 zabbix_agent2[3218]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 04:45:10 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 04:45:10 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 04:45:10 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 04:45:10 kjcf05n02 puppet-agent[288125]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: Press Ctrl+C to exit. Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: Plugin support version 1.0 Nov 3 04:45:10 kjcf05n02 zabbix_agent2[288888]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 04:45:11 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 04:45:11 kjcf05n03 zabbix_agent2[33119]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 04:45:11 kjcf05n03 zabbix_agent2[3124]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 04:45:11 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 04:45:11 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 04:45:11 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 04:45:11 kjcf05n03 puppet-agent[51672]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: Press Ctrl+C to exit. Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: Plugin support version 1.0 Nov 3 04:45:11 kjcf05n03 zabbix_agent2[52115]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 04:45:11 kjcf05n01 puppet-agent[2900773]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 04:45:11 kjcf05n01 puppet-agent[2900773]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 04:45:11 kjcf05n01 puppet-agent[2900773]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 04:45:11 kjcf05n07 puppet-agent[2293028]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 04:45:11 kjcf05n07 puppet-agent[2293028]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 04:45:11 kjcf05n07 puppet-agent[2293028]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 04:45:11 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 04:45:11 kjcf05n05 puppet-agent[2432486]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 04:45:11 kjcf05n05 puppet-agent[2432486]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 04:45:11 kjcf05n05 puppet-agent[2432486]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 04:45:12 kjcf05n06 puppet-agent[2296495]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 04:45:12 kjcf05n06 puppet-agent[2296495]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 04:45:12 kjcf05n06 puppet-agent[2296495]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 04:45:12 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2888329]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 04:45:12 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 04:45:12 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 04:45:12 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 04:45:12 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 04:45:12 kjcf05n01 puppet-agent[2900773]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: Press Ctrl+C to exit. Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: Plugin support version 1.0 Nov 3 04:45:12 kjcf05n01 zabbix_agent2[2901134]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 04:45:11 kjcf05n00 puppet-agent[961354]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 04:45:12 kjcf05n07 puppet-agent[2293028]: Applied catalog in 6.62 seconds Nov 3 04:45:12 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2385999]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 04:45:12 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 04:45:12 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 04:45:12 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 04:45:12 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 04:45:12 kjcf05n05 puppet-agent[2432486]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: Press Ctrl+C to exit. Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: Plugin support version 1.0 Nov 3 04:45:12 kjcf05n05 zabbix_agent2[2433172]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 04:45:12 kjcf05n06 puppet-agent[2296495]: Applied catalog in 5.00 seconds Nov 3 04:45:12 kjcf05n04 puppet-agent[2292671]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 04:45:12 kjcf05n04 puppet-agent[2292671]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 04:45:12 kjcf05n04 puppet-agent[2292671]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 04:45:13 kjcf05n02 puppet-agent[288125]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 04:45:13 kjcf05n02 puppet-agent[288125]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 04:45:13 kjcf05n02 puppet-agent[288125]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 04:45:13 kjcf05n02 puppet-agent[288125]: Applied catalog in 5.24 seconds Nov 3 04:45:13 kjcf05n03 puppet-agent[51672]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 04:45:13 kjcf05n03 puppet-agent[51672]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 04:45:13 kjcf05n03 puppet-agent[51672]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 04:45:13 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2246698]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 04:45:13 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 04:45:13 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 04:45:13 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 04:45:13 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 04:45:13 kjcf05n04 puppet-agent[2292671]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: Press Ctrl+C to exit. Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: Plugin support version 1.0 Nov 3 04:45:13 kjcf05n04 zabbix_agent2[2293288]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 04:45:13 kjcf05n00 puppet-agent[961354]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 04:45:13 kjcf05n00 puppet-agent[961354]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 04:45:13 kjcf05n00 puppet-agent[961354]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 04:45:13 kjcf05n03 puppet-agent[51672]: Applied catalog in 5.31 seconds Nov 3 04:45:14 kjcf05n01 puppet-agent[2900773]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_043104.log]/mode) mode changed '0644' to '0640' Nov 3 04:45:14 kjcf05n01 puppet-agent[2900773]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_044249.log]/mode) mode changed '0644' to '0640' Nov 3 04:45:13 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 04:45:13 kjcf05n00 zabbix_agent2[942950]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 04:45:14 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 04:45:13 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 04:45:13 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 04:45:13 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 04:45:13 kjcf05n00 puppet-agent[961354]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: Starting Zabbix Agent 2 (6.2.1) Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: Press Ctrl+C to exit. Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: Plugin support version 1.0 Nov 3 04:45:13 kjcf05n00 zabbix_agent2[962319]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 04:45:14 kjcf05n05 puppet-agent[2432486]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 04:45:14 kjcf05n05 puppet-agent[2432486]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 04:45:14 kjcf05n05 puppet-agent[2432486]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 04:45:14 kjcf05n00 zabbix-server[962342]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 04:45:14 kjcf05n05 puppet-agent[2432486]: Applied catalog in 5.01 seconds Nov 3 04:45:15 kjcf05n01 puppet-agent[2900773]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_043106.log]/mode) mode changed '0644' to '0640' Nov 3 04:45:15 kjcf05n01 puppet-agent[2900773]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_044249.log]/mode) mode changed '0644' to '0640' Nov 3 04:45:15 kjcf05n01 puppet-agent[2900773]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_044250]/mode) mode changed '0755' to '0750' Nov 3 04:45:15 kjcf05n01 puppet-agent[2900773]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_044250/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 04:45:15 kjcf05n01 puppet-agent[2900773]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 04:45:15 kjcf05n01 puppet-agent[2900773]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 04:45:15 kjcf05n01 puppet-agent[2900773]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 04:45:14 kjcf05n00 zabbix-server[962378]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 04:45:15 kjcf05n04 puppet-agent[2292671]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 04:45:15 kjcf05n04 puppet-agent[2292671]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 04:45:15 kjcf05n04 puppet-agent[2292671]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 04:45:15 kjcf05n04 puppet-agent[2292671]: Applied catalog in 4.93 seconds Nov 3 04:45:15 kjcf05n00 zabbix-server[962406]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 04:45:15 kjcf05n00 zabbix-server[962408]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 04:45:16 kjcf05n01 puppet-agent[2900773]: Applied catalog in 8.66 seconds Nov 3 04:45:15 kjcf05n00 puppet-agent[961354]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 04:45:16 kjcf05n00 puppet-agent[961354]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 04:45:16 kjcf05n00 puppet-agent[961354]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 04:45:16 kjcf05n00 puppet-agent[961354]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 04:45:17 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 04:45:17 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 04:45:17 kjcf05n00 puppet-agent[961354]: Applied catalog in 8.76 seconds Nov 3 04:45:17 kjcf05n00 zabbix-server[961283]: puppet completed status:(0): '' Nov 3 04:45:17 kjcf05n00 zabbix-server[961283]: Event '45763' acknowledged Nov 3 04:45:17 kjcf05n00 mcfcli[3673891]: %3|1730630717.988|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:45:18 kjcf05n00 zabbix-server[961283]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n03"}' Nov 3 04:45:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730630721', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 04:45:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730630721'} Nov 3 04:45:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:45:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730630721', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 04:45:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730630721'} Nov 3 04:45:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:45:22 kjcf05n00 mcfcli[3673891]: %3|1730630722.083|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 04:45:52 kjcf05n00 mcfcli[3673891]: %3|1730630752.084|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 04:45:57 kjcf05n00 mcfcli[3673891]: %3|1730630757.985|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:46:22 kjcf05n00 mcfcli[3673891]: %3|1730630782.085|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 04:46:37 kjcf05n00 mcfcli[3673891]: %3|1730630797.982|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:46:52 kjcf05n00 mcfcli[3673891]: %3|1730630812.085|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 04:47:08 kjcf05n03 dwd[5159]: nvme12n1 passed periodic SMART status check Nov 3 04:47:08 kjcf05n03 dwd[5159]: nvme21n1 passed periodic SMART status check Nov 3 04:47:08 kjcf05n03 dwd[5159]: nvme11n1 passed periodic SMART status check Nov 3 04:47:08 kjcf05n03 dwd[5159]: nvme15n1 passed periodic SMART status check Nov 3 04:47:08 kjcf05n03 dwd[5159]: nvme20n1 passed periodic SMART status check Nov 3 04:47:09 kjcf05n03 dwd[5159]: nvme22n1 passed periodic SMART status check Nov 3 04:47:09 kjcf05n03 dwd[5159]: nvme10n1 passed periodic SMART status check Nov 3 04:47:09 kjcf05n03 dwd[5159]: nvme7n1 passed periodic SMART status check Nov 3 04:47:09 kjcf05n03 dwd[5159]: nvme6n1 passed periodic SMART status check Nov 3 04:47:09 kjcf05n03 dwd[5159]: nvme5n1 passed periodic SMART status check Nov 3 04:47:09 kjcf05n03 dwd[5159]: nvme16n1 passed periodic SMART status check Nov 3 04:47:16 kjcf05n00 mcfcli[3673891]: %3|1730630836.064|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:47:22 kjcf05n00 mcfcli[3673891]: %3|1730630842.086|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 04:47:52 kjcf05n00 mcfcli[3673891]: %3|1730630872.087|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 04:47:54 kjcf05n00 mcfcli[3673891]: %3|1730630874.247|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:48:22 kjcf05n00 mcfcli[3673891]: %3|1730630902.087|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:48:33 kjcf05n00 mcfcli[3673891]: %3|1730630913.852|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:48:52 kjcf05n00 mcfcli[3673891]: %3|1730630932.088|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:49:10 kjcf05n00 mcfcli[3673891]: %3|1730630950.753|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:49:22 kjcf05n00 mcfcli[3673891]: %3|1730630962.088|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 04:49:48 kjcf05n00 mcfcli[3673891]: %3|1730630988.005|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:49:52 kjcf05n00 mcfcli[3673891]: %3|1730630992.088|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 04:49:53 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/21', errno='Permission denied (13)' Nov 3 04:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 04:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 04:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 04:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 04:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 04:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 04:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 04:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 04:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 04:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 04:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 04:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 04:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 04:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 04:50:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 04:50:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 04:50:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 04:50:02 kjcf05n00 python3.9[964756]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 04:50:22 kjcf05n00 mcfcli[3673891]: %3|1730631022.089|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:50:23 kjcf05n00 mcfcli[3673891]: %3|1730631023.845|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:50:52 kjcf05n00 mcfcli[3673891]: %3|1730631052.090|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 04:51:01 kjcf05n00 mcfcli[3673891]: %3|1730631061.794|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:51:22 kjcf05n00 mcfcli[3673891]: %3|1730631082.090|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:51:38 kjcf05n00 mcfcli[3673891]: %3|1730631098.978|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:51:52 kjcf05n00 mcfcli[3673891]: %3|1730631112.090|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 04:52:17 kjcf05n00 mcfcli[3673891]: %3|1730631137.820|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:52:22 kjcf05n00 mcfcli[3673891]: %3|1730631142.091|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 04:52:44 kjcf05n02 nslcd[6978]: [6afb66] ldap_result() failed: Can't contact LDAP server Nov 3 04:52:52 kjcf05n00 mcfcli[3673891]: %3|1730631172.091|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:52:57 kjcf05n00 mcfcli[3673891]: %3|1730631177.787|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T10:53:15.867871Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 04:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T10:53:15.867942Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.090ms Nov 3 04:53:22 kjcf05n00 mcfcli[3673891]: %3|1730631202.092|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T04:53:27.255583189-06:00 level=info msg="Completed cleanup jobs" duration=29.180137ms Nov 3 04:53:34 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=255 Nov 3 04:53:34 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 255. kjcf05n02: ssh: connect to host kjcf05n02 port 22: Connection timed out pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 255 Nov 3 04:53:34 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=255 Nov 3 04:53:34 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 255. kjcf05n02: ssh: connect to host kjcf05n02 port 22: Connection timed out Nov 3 04:53:34 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 255 Nov 3 04:53:35 kjcf05n00 mcfcli[3673891]: %3|1730631215.341|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:53:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 04:53:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 04:53:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 04:53:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 04:53:52 kjcf05n00 mcfcli[3673891]: %3|1730631232.093|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:53:55 kjcf05n00 zabbix_server[15765]: Zabbix agent item "dcs.lustre.device.ost.name[OST0000,ost_name]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 3 04:53:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 04:53:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 04:53:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 04:53:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 04:53:58 kjcf05n00 zabbix_server[15738]: Zabbix agent item "agent.ping" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 3 04:53:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 04:53:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 04:54:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 04:54:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 04:54:00 kjcf05n03 fstonithd.py[15070]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 3 04:54:01 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 04:54:01 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 04:54:01 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 04:54:01 kjcf05n03 root[66716]: is_enc_ipmi_off starts Nov 3 04:54:01 kjcf05n03 root[66717]: is_viking_off starts Nov 3 04:54:01 kjcf05n03 root[66735]: is_lan_ipmi_off leaves Nov 3 04:54:01 kjcf05n03 root[66737]: is_lan_ipmi_sec_off leaves Nov 3 04:54:01 kjcf05n03 root[66744]: I am in slot 1; partner is in slot 0 Nov 3 04:54:02 kjcf05n03 root[66752]: I am not master; I will get master Nov 3 04:54:06 kjcf05n03 LCNmon[17767]: 10.16.100.52 is unreachable via ib0 Nov 3 04:54:06 kjcf05n03 LCNmon[17767]: 10.16.100.58 is unreachable via ib0 Nov 3 04:54:06 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='15', error='Connection reset by peer (104)' Nov 3 04:54:06 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='15', client='AF_INET(172.16.2.5:35993)', local='AF_INET(0.0.0.0:601)' Nov 3 04:54:07 kjcf05n03 root[66953]: I am now master Nov 3 04:54:10 kjcf05n03 diskmonitor[17358]: run_on_master: ntry=1/10, neither node is master, retrying Nov 3 04:54:10 kjcf05n03 diskmonitor[17358]: run_on_master: ntry=2/10, neither node is master, retrying Nov 3 04:54:10 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0000,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 04:54:10 kjcf05n03 LCNmon[17767]: 10.16.100.52 is unreachable via ib1 Nov 3 04:54:10 kjcf05n03 LCNmon[17767]: 10.16.100.58 is unreachable via ib1 Nov 3 04:54:12 kjcf05n03 root[67177]: is_viking_off leaves Nov 3 04:54:12 kjcf05n03 root[67180]: kjcf05n02 not already off look at kdump Nov 3 04:54:12 kjcf05n03 root[67181]: is_kdump_off starts Nov 3 04:54:12 kjcf05n03 fence_kdump[67182]: waiting for message from '172.16.2.5' Nov 3 04:54:13 kjcf05n00 zabbix_server[15747]: Zabbix agent item "vfs.fs.inode[/etc/ganesha,pfree]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 04:54:13 kjcf05n03 fence_kdump[67182]: received valid message from '172.16.2.5' Nov 3 04:54:13 kjcf05n03 root[67201]: is_kdump_off detected kdump on kjcf05n02 Nov 3 04:54:13 kjcf05n03 root[67202]: kjcf05n02 is kdumping Nov 3 04:54:14 kjcf05n03 root[67295]: is_viking_off starts Nov 3 04:54:14 kjcf05n03 root[67294]: is_enc_ipmi_off starts Nov 3 04:54:14 kjcf05n03 root[67311]: is_lan_ipmi_sec_off leaves Nov 3 04:54:14 kjcf05n03 root[67313]: is_lan_ipmi_off leaves Nov 3 04:54:14 kjcf05n03 root[67326]: I am in slot 1; partner is in slot 0 Nov 3 04:54:14 kjcf05n03 root[67329]: I am master Nov 3 04:54:15 kjcf05n00 mcfcli[3673891]: %3|1730631255.338|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:54:20 kjcf05n03 root[67444]: is_viking_off leaves Nov 3 04:54:20 kjcf05n03 root[67447]: kjcf05n02 not already off look at kdump Nov 3 04:54:20 kjcf05n03 root[67448]: is_kdump_off starts Nov 3 04:54:20 kjcf05n03 fence_kdump[67449]: waiting for message from '172.16.2.5' Nov 3 04:54:21 kjcf05n03 fence_kdump[67449]: received valid message from '172.16.2.5' Nov 3 04:54:21 kjcf05n03 root[67463]: is_kdump_off detected kdump on kjcf05n02 Nov 3 04:54:21 kjcf05n03 root[67464]: kjcf05n02 is kdumping Nov 3 04:54:22 kjcf05n00 mcfcli[3673891]: %3|1730631262.093|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:54:23 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 04:54:23 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 04:54:25 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.mdt.name[MDT0000,mdt_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 04:54:26 kjcf05n03 dwd[5159]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 04:54:26 kjcf05n03 dwd[5159]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 04:54:26 kjcf05n03 dwd[5159]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 04:54:26 kjcf05n03 dwd[5159]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 04:54:26 kjcf05n03 dwd[5159]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 04:54:26 kjcf05n03 dwd[5159]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 04:54:26 kjcf05n03 dwd[5159]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 04:54:26 kjcf05n03 dwd[5159]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 04:54:26 kjcf05n03 dwd[5159]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 04:54:26 kjcf05n03 dwd[5159]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 04:54:26 kjcf05n03 dwd[5159]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 04:54:26 kjcf05n03 dwd[5159]: Starting NVME thread for nvme25n1 Nov 3 04:54:26 kjcf05n03 dwd[5159]: Starting NVME thread for nvme8n1 Nov 3 04:54:26 kjcf05n03 dwd[5159]: Starting NVME thread for nvme18n1 Nov 3 04:54:26 kjcf05n03 dwd[5159]: Starting NVME thread for nvme23n1 Nov 3 04:54:27 kjcf05n03 dwd[5159]: Starting NVME thread for nvme9n1 Nov 3 04:54:27 kjcf05n03 dwd[5159]: Starting NVME thread for nvme4n1 Nov 3 04:54:27 kjcf05n03 dwd[5159]: Starting NVME thread for nvme2n1 Nov 3 04:54:27 kjcf05n03 systemd-udevd[69771]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69769]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69772]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69774]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69772]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69771]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69769]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69774]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69772]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69769]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69771]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69774]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69772]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69769]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69771]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69774]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69772]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69771]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69769]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69790]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69794]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69774]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69796]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69772]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69771]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69799]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69769]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69790]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69794]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69796]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69772]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69774]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69799]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69790]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69769]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69794]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69796]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69772]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69774]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69790]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69769]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69799]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69790]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69772]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69790]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69769]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69772]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69799]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69796]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69769]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 dwd[5159]: Starting NVME thread for nvme3n1 Nov 3 04:54:27 kjcf05n03 systemd-udevd[69790]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69772]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69769]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69790]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69769]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69769]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69790]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69769]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69790]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69769]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69790]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69769]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69769]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 systemd-udevd[69769]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 04:54:27 kjcf05n03 dwd[5159]: Starting NVME thread for nvme19n1 Nov 3 04:54:27 kjcf05n03 dwd[5159]: Starting NVME thread for nvme17n1 Nov 3 04:54:27 kjcf05n03 dwd[5159]: Starting NVME thread for nvme24n1 Nov 3 04:54:28 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vfs.fs.size[/etc/ganesha,used]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 04:54:29 kjcf05n03 diskmonitor[17358]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 04:54:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 04:54:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 04:54:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 04:54:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 04:54:38 kjcf05n03 diskmonitor[17358]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 04:54:38 kjcf05n03 diskmonitor[17358]: Scan for ReadErrorMax change for md65 Nov 3 04:54:38 kjcf05n03 diskmonitor[17358]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 04:54:38 kjcf05n03 diskmonitor[17358]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 04:54:38 kjcf05n03 diskmonitor[17358]: read_saved_file: md65 no saved speed Nov 3 04:54:38 kjcf05n03 diskmonitor[17358]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 04:54:38 kjcf05n03 diskmonitor[17358]: Set sync_speed_min (10000) for md65 Nov 3 04:54:38 kjcf05n03 diskmonitor[17358]: Set sync_speed_max (200000) for md65 Nov 3 04:54:38 kjcf05n03 diskmonitor[17358]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 04:54:40 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 3 04:54:43 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 3 04:54:52 kjcf05n00 mcfcli[3673891]: %3|1730631292.094|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:54:53 kjcf05n00 mcfcli[3673891]: %3|1730631293.533|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:54:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 04:54:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 04:54:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 04:54:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 04:54:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 04:54:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 04:54:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 04:54:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 04:55:02 kjcf05n00 python3.9[967829]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 04:55:06 kjcf05n03 LCNmon[17767]: 10.16.100.52 is unreachable via ib0 Nov 3 04:55:06 kjcf05n03 LCNmon[17767]: 10.16.100.58 is unreachable via ib0 Nov 3 04:55:10 kjcf05n03 LCNmon[17767]: 10.16.100.52 is unreachable via ib1 Nov 3 04:55:10 kjcf05n03 LCNmon[17767]: 10.16.100.58 is unreachable via ib1 Nov 3 04:55:22 kjcf05n00 mcfcli[3673891]: %3|1730631322.094|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 04:55:31 kjcf05n00 mcfcli[3673891]: %3|1730631331.308|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:55:31 kjcf05n03 nslcd[6912]: ldap_result() failed: Can't contact LDAP server Nov 3 04:55:31 kjcf05n03 nslcd[6912]: (re)loading /etc/nsswitch.conf Nov 3 04:55:31 kjcf05n03 nslcd[6912]: [b0dc51] ldap_result() failed: Can't contact LDAP server Nov 3 04:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 04:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 04:55:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 04:55:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 04:55:52 kjcf05n00 mcfcli[3673891]: %3|1730631352.094|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 04:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 04:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 04:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 04:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 04:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 04:55:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 04:55:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 04:56:06 kjcf05n03 LCNmon[17767]: 10.16.100.52 is unreachable via ib0 Nov 3 04:56:06 kjcf05n03 LCNmon[17767]: 10.16.100.58 is unreachable via ib0 Nov 3 04:56:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730631365}"] Nov 3 04:56:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730631365, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:56:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.489302ms Nov 3 04:56:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.489302ms Nov 3 04:56:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:56:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:56:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:56:06 kjcf05n00 mcfcli[3673891]: %3|1730631366.966|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:56:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730631366}"] Nov 3 04:56:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730631366, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:56:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.166206ms Nov 3 04:56:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.166206ms Nov 3 04:56:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:56:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:56:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:56:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730631366}"] Nov 3 04:56:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730631366, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:56:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.263599ms Nov 3 04:56:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.263599ms Nov 3 04:56:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:56:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:56:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:56:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730631366}"] Nov 3 04:56:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730631366, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:56:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.991229ms Nov 3 04:56:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.991229ms Nov 3 04:56:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:56:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:56:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:56:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730631367}"] Nov 3 04:56:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730631367, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:56:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.211482ms Nov 3 04:56:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.211482ms Nov 3 04:56:08 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:56:08 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:56:08 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:56:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730631368}"] Nov 3 04:56:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730631368, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:56:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.919184ms Nov 3 04:56:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.919184ms Nov 3 04:56:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:56:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:56:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:56:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730631368}"] Nov 3 04:56:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730631368, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:56:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.627301ms Nov 3 04:56:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.627301ms Nov 3 04:56:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:56:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:56:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:56:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730631368}"] Nov 3 04:56:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730631368, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:56:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.206242ms Nov 3 04:56:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.206242ms Nov 3 04:56:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:56:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:56:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:56:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730631368}"] Nov 3 04:56:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730631368, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:56:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.884409ms Nov 3 04:56:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.884409ms Nov 3 04:56:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:56:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:56:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:56:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730631368}"] Nov 3 04:56:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730631368, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:56:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.013411ms Nov 3 04:56:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.013411ms Nov 3 04:56:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:56:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:56:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:56:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730631368}"] Nov 3 04:56:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730631368, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 04:56:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 04:56:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T04:56:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 04:56:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T04:56:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 04:56:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T04:56:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.807736ms Nov 3 04:56:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T04:56:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.807736ms Nov 3 04:56:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:04:56:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 04:56:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 04:56:10 kjcf05n03 LCNmon[17767]: 10.16.100.52 is unreachable via ib1 Nov 3 04:56:10 kjcf05n03 LCNmon[17767]: 10.16.100.58 is unreachable via ib1 Nov 3 04:56:22 kjcf05n00 mcfcli[3673891]: %3|1730631382.096|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 04:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 04:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 04:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 04:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 04:56:45 kjcf05n00 mcfcli[3673891]: %3|1730631405.071|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:56:52 kjcf05n00 mcfcli[3673891]: %3|1730631412.096|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 04:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 04:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 04:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 04:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 04:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 04:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 04:56:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 04:56:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 04:57:06 kjcf05n03 LCNmon[17767]: 10.16.100.52 is unreachable via ib0 Nov 3 04:57:06 kjcf05n03 LCNmon[17767]: 10.16.100.58 is unreachable via ib0 Nov 3 04:57:09 kjcf05n00 zabbix-server[969431]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 04:57:09 kjcf05n00 zabbix-server[969431]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 04:57:09 kjcf05n00 log_interesting_event.py[969431]: Event '45764' acknowledged Nov 3 04:57:10 kjcf05n03 LCNmon[17767]: 10.16.100.52 is unreachable via ib1 Nov 3 04:57:10 kjcf05n03 LCNmon[17767]: 10.16.100.58 is unreachable via ib1 Nov 3 04:57:22 kjcf05n00 mcfcli[3673891]: %3|1730631442.096|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 04:57:25 kjcf05n00 mcfcli[3673891]: %3|1730631445.068|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 04:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 04:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 04:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 04:57:49 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 3 04:57:49 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 04:57:52 kjcf05n00 mcfcli[3673891]: %3|1730631472.096|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 04:57:53 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 04:57:53 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 3 04:57:53 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 3 04:57:53 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 04:57:53 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 04:57:53 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 3 04:57:53 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 3 04:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 04:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 04:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 04:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 04:57:56 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 3 04:57:58 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 3 04:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 04:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 04:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 04:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 04:58:03 kjcf05n00 mcfcli[3673891]: %3|1730631483.157|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:58:06 kjcf05n03 LCNmon[17767]: 10.16.100.52 is unreachable via ib0 Nov 3 04:58:06 kjcf05n03 LCNmon[17767]: 10.16.100.58 is unreachable via ib0 Nov 3 04:58:10 kjcf05n03 LCNmon[17767]: 10.16.100.52 is unreachable via ib1 Nov 3 04:58:10 kjcf05n03 LCNmon[17767]: 10.16.100.58 is unreachable via ib1 Nov 3 04:58:22 kjcf05n00 mcfcli[3673891]: %3|1730631502.098|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 04:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 04:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 04:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 04:58:43 kjcf05n00 mcfcli[3673891]: %3|1730631523.153|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:58:46 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:59780). Nov 3 04:58:46 kjcf05n01 rsyncd[2906725]: connect from kjcf05n02 (172.16.2.5) Nov 3 04:58:46 kjcf05n01 rsyncd[2906725]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 04:58:46 kjcf05n01 rsyncd[2906725]: building file list Nov 3 04:58:46 kjcf05n01 rsyncd[2906725]: sent 11450 bytes received 136 bytes total size 10905 Nov 3 04:58:46 kjcf05n01 systemd[1]: rsyncd@597-172.16.2.2:873-172.16.2.5:59780.service: Succeeded. Nov 3 04:58:52 kjcf05n00 mcfcli[3673891]: %3|1730631532.597|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 04:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 04:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 04:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 04:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 04:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 04:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 04:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 04:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 04:59:00 kjcf05n03 fstonithd.py[15070]: Listening for kdump packets from partner Nov 3 04:59:06 kjcf05n03 LCNmon[17767]: 10.16.100.52 is unreachable via ib0 Nov 3 04:59:06 kjcf05n03 LCNmon[17767]: 10.16.100.58 is unreachable via ib0 Nov 3 04:59:10 kjcf05n03 LCNmon[17767]: 10.16.100.52 is unreachable via ib1 Nov 3 04:59:10 kjcf05n03 LCNmon[17767]: 10.16.100.58 is unreachable via ib1 Nov 3 04:59:21 kjcf05n00 mcfcli[3673891]: %3|1730631561.193|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:59:22 kjcf05n00 mcfcli[3673891]: %3|1730631562.598|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 04:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 04:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 04:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 04:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 04:59:41 kjcf05n03 dwd[5159]: nvme23n1 passed periodic SMART status check Nov 3 04:59:41 kjcf05n03 dwd[5159]: nvme8n1 passed periodic SMART status check Nov 3 04:59:41 kjcf05n03 dwd[5159]: nvme9n1 passed periodic SMART status check Nov 3 04:59:41 kjcf05n03 dwd[5159]: nvme25n1 passed periodic SMART status check Nov 3 04:59:41 kjcf05n03 dwd[5159]: nvme18n1 passed periodic SMART status check Nov 3 04:59:42 kjcf05n03 dwd[5159]: nvme3n1 passed periodic SMART status check Nov 3 04:59:42 kjcf05n03 dwd[5159]: nvme2n1 passed periodic SMART status check Nov 3 04:59:42 kjcf05n03 dwd[5159]: nvme19n1 passed periodic SMART status check Nov 3 04:59:42 kjcf05n03 dwd[5159]: nvme4n1 passed periodic SMART status check Nov 3 04:59:43 kjcf05n03 dwd[5159]: nvme24n1 passed periodic SMART status check Nov 3 04:59:43 kjcf05n03 dwd[5159]: nvme17n1 passed periodic SMART status check Nov 3 04:59:48 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 04:59:52 kjcf05n00 mcfcli[3673891]: %3|1730631592.598|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 04:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 04:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 04:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 04:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 04:59:57 kjcf05n00 mcfcli[3673891]: %3|1730631597.817|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 04:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 04:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 04:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 04:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 05:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 05:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 05:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 05:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 05:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 05:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 05:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 05:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 05:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 05:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 05:00:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 05:00:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:00:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 05:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 05:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 05:00:02 kjcf05n00 python3.9[970919]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 05:00:06 kjcf05n03 LCNmon[17767]: 10.16.100.52 is unreachable via ib0 Nov 3 05:00:06 kjcf05n03 LCNmon[17767]: 10.16.100.58 is unreachable via ib0 Nov 3 05:00:09 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 05:00:10 kjcf05n03 LCNmon[17767]: 10.16.100.52 is unreachable via ib1 Nov 3 05:00:10 kjcf05n03 LCNmon[17767]: 10.16.100.58 is unreachable via ib1 Nov 3 05:00:11 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='15', client='AF_INET(172.16.2.5:34769)', local='AF_INET(0.0.0.0:601)' Nov 3 05:00:11 kjcf05n02 syslog-ng[3168]: Configuration reload request received, reloading configuration; Nov 3 05:00:11 kjcf05n02 syslog-ng[3168]: Configuration reload finished; Nov 3 05:00:11 kjcf05n02 syslog-ng[3168]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 05:00:11 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 3 05:00:11 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 05:00:11 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 3 05:00:11 kjcf05n02 dracut: Self testing crypto algorithms Nov 3 05:00:11 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 3 05:00:11 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 05:00:11 kjcf05n02 Copying live image to RAM... Nov 3 05:00:11 kjcf05n02 (this may take a minute) Nov 3 05:00:11 kjcf05n02 Done copying live image to RAM. Nov 3 05:00:11 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 05:00:11 kjcf05n02 dracut: Checking integrity of kernel Nov 3 05:00:11 kjcf05n02 dracut: All initrd crypto checks done Nov 3 05:00:11 kjcf05n02 dracut: Switching root Nov 3 05:00:11 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 05:00:11 kjcf05n02 systemd: Detected architecture x86-64. Nov 3 05:00:11 kjcf05n02 systemd: Set hostname to . Nov 3 05:00:11 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 05:00:11 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 05:00:11 kjcf05n02 systemd: Reached target Swap. Nov 3 05:00:11 kjcf05n02 systemd: Created slice system-getty.slice. Nov 3 05:00:11 kjcf05n02 systemd: Created slice system-sshd\x2dkeygen.slice. Nov 3 05:00:11 kjcf05n02 systemd: Listening on udev Kernel Socket. Nov 3 05:00:11 kjcf05n02 systemd: Started Dispatch Password Requests to Console Directory Watch. Nov 3 05:00:11 kjcf05n02 systemd-journald[1553]: Journal started Nov 3 05:00:11 kjcf05n02 systemd-journald[1553]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 05:00:11 kjcf05n02 systemd-modules-load[1537]: Inserted module 'fuse' Nov 3 05:00:11 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 3 05:00:11 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 05:00:11 kjcf05n02 systemd-sysctl[1562]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 05:00:11 kjcf05n02 systemd-sysctl[1562]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Create System Users. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 05:00:11 kjcf05n02 systemd-journald[1553]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 05:00:11 kjcf05n02 systemd-tmpfiles[1572]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 05:00:11 kjcf05n02 systemd-tmpfiles[1572]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 3 05:00:11 kjcf05n02 systemd-udevd[1579]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 3 05:00:11 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 3 05:00:11 kjcf05n02 systemd-udevd[1650]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:00:11 kjcf05n02 systemd-udevd[1620]: Using default interface naming scheme 'rhel-8.0'. Nov 3 05:00:11 kjcf05n02 systemd-udevd[1620]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:00:11 kjcf05n02 systemd-udevd[1649]: Using default interface naming scheme 'rhel-8.0'. Nov 3 05:00:11 kjcf05n02 systemd-udevd[1649]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:00:11 kjcf05n02 systemd-udevd[1637]: Using default interface naming scheme 'rhel-8.0'. Nov 3 05:00:11 kjcf05n02 systemd-udevd[1637]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 05:00:11 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 3 05:00:11 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 3 05:00:11 kjcf05n02 root[1802]: openibd: running in auto mode Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 05:00:11 kjcf05n02 systemd-tmpfiles[1803]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 05:00:11 kjcf05n02 systemd-tmpfiles[1803]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 05:00:11 kjcf05n02 systemd-tmpfiles[1803]: "/var/tmp" already exists and is not a directory. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started RPC Bind. Nov 3 05:00:11 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 3 05:00:11 kjcf05n02 systemd-modules-load[1934]: Inserted module 'ib_iser' Nov 3 05:00:11 kjcf05n02 systemd-modules-load[1934]: Inserted module 'ib_isert' Nov 3 05:00:11 kjcf05n02 systemd-modules-load[1934]: Inserted module 'ib_srpt' Nov 3 05:00:11 kjcf05n02 systemd-udevd[1600]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:00:11 kjcf05n02 systemd-modules-load[1921]: Inserted module 'ib_ipoib' Nov 3 05:00:11 kjcf05n02 systemd-udevd[1590]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:00:11 kjcf05n02 systemd-modules-load[1934]: Inserted module 'rdma_ucm' Nov 3 05:00:11 kjcf05n02 systemd-modules-load[1934]: Module 'svcrdma' is blacklisted Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 05:00:11 kjcf05n02 systemd-udevd[1600]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 05:00:11 kjcf05n02 systemd-udevd[1590]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 05:00:11 kjcf05n02 systemd-modules-load[1921]: Inserted module 'ib_umad' Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 05:00:11 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 3 05:00:11 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 3 05:00:11 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 05:00:11 kjcf05n02 systemd[3168]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:11 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 05:00:11 kjcf05n02 openibd[1787]: Loading HCA driver and Access Layer:[ OK ] Nov 3 05:00:11 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Update is Completed. Nov 3 05:00:11 kjcf05n02 setup-icl[1782]: Setting LAN IP Address to 203.0.113.3 Nov 3 05:00:11 kjcf05n02 setup-icl[1782]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 05:00:11 kjcf05n02 setup-icl[1782]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 05:00:11 kjcf05n02 setup-icl[1782]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 05:00:11 kjcf05n02 systemd-udevd[1600]: Using default interface naming scheme 'rhel-8.0'. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 05:00:11 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 05:00:11 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 3 05:00:11 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 05:00:11 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 05:00:11 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 05:00:11 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 05:00:11 kjcf05n02 systemd[1]: Reached target Sockets. Nov 3 05:00:11 kjcf05n02 systemd[1]: Reached target Basic System. Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 05:00:11 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 3 05:00:11 kjcf05n02 mdraid-phy[2095]: no Cutlass to worry about Nov 3 05:00:11 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[2113]: Setting up Mellanox network interface: ib1 Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 05:00:11 kjcf05n02 mcelog[2130]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 05:00:11 kjcf05n02 mcelog[2130]: CPU is unsupported Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[2129]: Setting up Mellanox network interface: ib0 Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 05:00:11 kjcf05n02 nscd[2172]: 2172 monitoring file `/etc/hosts` (1) Nov 3 05:00:11 kjcf05n02 nscd[2172]: 2172 monitoring directory `/etc` (2) Nov 3 05:00:11 kjcf05n02 nscd[2172]: 2172 monitoring file `/etc/resolv.conf` (3) Nov 3 05:00:11 kjcf05n02 nscd[2172]: 2172 monitoring directory `/etc` (2) Nov 3 05:00:11 kjcf05n02 chronyd[2180]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 05:00:11 kjcf05n02 beSetMlxConfig[2201]: ConnectX-3 multiport not detected Nov 3 05:00:11 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[2214]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 05:00:11 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[2217]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 05:00:11 kjcf05n02 dwd[2215]: dwd: vMay 29 2024 : 15:38:26 Nov 3 05:00:11 kjcf05n02 dwd[2215]: /usr/sbin/dwd -d --standalone=0 Nov 3 05:00:11 kjcf05n02 dwd[2215]: dwd: option Lethal: 0 Nov 3 05:00:11 kjcf05n02 dwd[2215]: dwd: option Interval: 60 Nov 3 05:00:11 kjcf05n02 dwd[2215]: dwd: option abrtlimit: 10 Nov 3 05:00:11 kjcf05n02 dwd[2215]: dwd: option DZPeriod: 604800 Nov 3 05:00:11 kjcf05n02 dwd[2215]: dwd: option SmartPeriod: 43200 Nov 3 05:00:11 kjcf05n02 dwd[2215]: dwd: option SDDEnabled: 1 Nov 3 05:00:11 kjcf05n02 dwd[2215]: dwd: option SDDAwaitScale: 3 Nov 3 05:00:11 kjcf05n02 dwd[2215]: dwd: option SDDAwaitMin: 100 Nov 3 05:00:11 kjcf05n02 dwd[2215]: dwd: option Verbosity: 1 Nov 3 05:00:11 kjcf05n02 dwd[2215]: dwd: option StandAlone: 0 Nov 3 05:00:11 kjcf05n02 dwd[2215]: option Lethal: 0 Nov 3 05:00:11 kjcf05n02 dwd[2215]: option Interval: 60 Nov 3 05:00:11 kjcf05n02 dwd[2215]: option abrtlimit: 10 Nov 3 05:00:11 kjcf05n02 dwd[2215]: option DZPeriod: 604800 Nov 3 05:00:11 kjcf05n02 dwd[2215]: option SmartPeriod: 43200 Nov 3 05:00:11 kjcf05n02 dwd[2215]: option SDDEnabled: 1 Nov 3 05:00:11 kjcf05n02 dwd[2215]: option SDDAwaitScale: 3 Nov 3 05:00:11 kjcf05n02 dwd[2215]: option SDDAwaitMin: 100 Nov 3 05:00:11 kjcf05n02 dwd[2215]: option Verbosity: 1 Nov 3 05:00:11 kjcf05n02 dwd[2215]: option StandAlone: 0 Nov 3 05:00:11 kjcf05n02 network[2223]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 05:00:11 kjcf05n02 chronyd[2180]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 05:00:11 kjcf05n02 chronyd[2180]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 0 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 1 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 2 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 3 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 4 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 5 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 6 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 7 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 8 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 9 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 10 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 11 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 12 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 13 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 14 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 15 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 16 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 17 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 18 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 19 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 20 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 21 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 22 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 23 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 24 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 25 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 26 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 27 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 28 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 29 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 30 Nov 3 05:00:11 kjcf05n02 cpupower[2264]: Setting cpu: 31 Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[2247]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 3 05:00:11 kjcf05n02 network[2256]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[2257]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 05:00:11 kjcf05n02 network[2223]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 3 05:00:11 kjcf05n02 dbus-daemon[2230]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 05:00:11 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 05:00:11 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 05:00:11 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[2273]: No configuration found for ib1 Nov 3 05:00:11 kjcf05n02 beSetMlxConfig[2201]: Starting MST (Mellanox Software Tools) driver set Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 3 05:00:11 kjcf05n02 network[2274]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[2275]: No configuration found for ib0 Nov 3 05:00:11 kjcf05n02 network[2223]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 05:00:11 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 0 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 1 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 2 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 3 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 4 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 5 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 6 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 7 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 8 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 9 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 10 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 11 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 12 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 13 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 14 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 15 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 16 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 17 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 18 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 19 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 20 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 21 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 22 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 23 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 24 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 25 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 26 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 27 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 28 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 29 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 30 Nov 3 05:00:11 kjcf05n02 cpupower[2297]: Idlestate 2 disabled on CPU 31 Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[2285]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 05:00:11 kjcf05n02 sssd[sssd][2131]: Starting up Nov 3 05:00:11 kjcf05n02 network[2290]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[2294]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 05:00:11 kjcf05n02 beSetMlxConfig[2201]: Loading MST PCI module - Success Nov 3 05:00:11 kjcf05n02 mlnx_conf_mgr[2345]: INFO: No configurations found for mlx5_1, skipping. Nov 3 05:00:11 kjcf05n02 mlnx_conf_mgr[2350]: INFO: No configurations found for mlx5_0, skipping. Nov 3 05:00:11 kjcf05n02 beSetMlxConfig[2201]: Loading MST PCI configuration module - Success Nov 3 05:00:11 kjcf05n02 beSetMlxConfig[2201]: Create devices Nov 3 05:00:11 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 05:00:11 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 05:00:11 kjcf05n02 sssd[be[implicit_files]][2349]: Starting up Nov 3 05:00:11 kjcf05n02 sssd[nss][2464]: Starting up Nov 3 05:00:11 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 05:00:11 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Login Service... Nov 3 05:00:11 kjcf05n02 systemd-logind[2576]: New seat seat0. Nov 3 05:00:11 kjcf05n02 systemd-logind[2576]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Login Service. Nov 3 05:00:11 kjcf05n02 python3.9[2258]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 05:00:11 kjcf05n02 python3.9[3168]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:11 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 05:00:11 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 05:00:11 kjcf05n02 systemd-sysctl[2820]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 05:00:11 kjcf05n02 systemd-sysctl[2820]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 05:00:11 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 05:00:11 kjcf05n02 python3.9[2861]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 05:00:11 kjcf05n02 python3.9[3168]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 05:00:11 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 05:00:11 kjcf05n02 network[2223]: Bringing up loopback interface: [ OK ] Nov 3 05:00:11 kjcf05n02 python3.9[3067]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 05:00:11 kjcf05n02 python3.9[3168]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 05:00:11 kjcf05n02 systemd-sysctl[3160]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 05:00:11 kjcf05n02 systemd-sysctl[3160]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 05:00:11 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 3 05:00:11 kjcf05n02 systemd[1]: Reached target Network. Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 05:00:11 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 05:00:11 kjcf05n02 sm-notify[3169]: Version 2.3.3 starting Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 05:00:11 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 05:00:11 kjcf05n02 sshd[3171]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 05:00:11 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 3 05:00:11 kjcf05n02 beSetMlxConfig[2201]: Unloading MST PCI module (unused) - Success Nov 3 05:00:11 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 05:00:11 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 3 05:00:11 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 05:00:11 kjcf05n02 lldpad[3180]: setsockopt nearest_bridge: Invalid argument Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 3 05:00:11 kjcf05n02 lldpad[3180]: setsockopt nearest_bridge: Invalid argument Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 3 05:00:11 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 3 05:00:11 kjcf05n02 python3.9[3192]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 05:00:11 kjcf05n02 python3.9[3168]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:11 kjcf05n02 syslog-ng[3168]: [2024-11-03T10:58:58.902664] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 05:00:11 kjcf05n02 syslog-ng[3168]: [2024-11-03T10:58:58.902934] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 05:00:11 kjcf05n02 syslog-ng[3168]: [2024-11-03T10:58:58.902967] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 05:00:11 kjcf05n02 syslog-ng[3168]: [2024-11-03T10:58:58.903505] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 05:00:11 kjcf05n02 syslog-ng[3168]: [2024-11-03T10:58:58.903678] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 05:00:11 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 05:00:11 kjcf05n02 python3.9[3422]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 05:00:11 kjcf05n02 python3.9[3168]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 05:00:11 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 05:00:11 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 05:00:11 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 05:00:11 kjcf05n02 chronyd[2180]: System's initial offset : 0.002168 seconds slow of true (slew) Nov 3 05:00:11 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 05:00:11 kjcf05n02 beSetMlxConfig[2201]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 05:00:11 kjcf05n02 beSetMlxConfig[2201]: ib mode Nov 3 05:00:11 kjcf05n02 root[3442]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 3 05:00:11 kjcf05n02 root[3444]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 3 05:00:11 kjcf05n02 beSetMlxConfig[2201]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 05:00:11 kjcf05n02 beSetMlxConfig[2201]: ib mode Nov 3 05:00:11 kjcf05n02 systemd-udevd[1579]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 05:00:11 kjcf05n02 systemd-udevd[3459]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:00:11 kjcf05n02 systemd-udevd[3460]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:00:11 kjcf05n02 systemd-udevd[3463]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:00:11 kjcf05n02 systemd-udevd[3466]: Using default interface naming scheme 'rhel-8.0'. Nov 3 05:00:11 kjcf05n02 systemd-udevd[3466]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:00:11 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 05:00:11 kjcf05n02 systemd[3168]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:11 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[3501]: Setting up Mellanox network interface: ib1 Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[3502]: Setting up Mellanox network interface: ib0 Nov 3 05:00:11 kjcf05n02 systemd-udevd[3462]: Using default interface naming scheme 'rhel-8.0'. Nov 3 05:00:11 kjcf05n02 systemd-udevd[3462]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[3551]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[3552]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[3567]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[3568]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[3569]: No configuration found for ib1 Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[3570]: No configuration found for ib0 Nov 3 05:00:11 kjcf05n02 systemd-udevd[3461]: Using default interface naming scheme 'rhel-8.0'. Nov 3 05:00:11 kjcf05n02 systemd-udevd[3461]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[3577]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[3578]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 05:00:11 kjcf05n02 mlnx_conf_mgr[3632]: INFO: No configurations found for mlx5_1, skipping. Nov 3 05:00:11 kjcf05n02 mlnx_conf_mgr[3633]: INFO: No configurations found for mlx5_0, skipping. Nov 3 05:00:11 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 05:00:11 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 05:00:11 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 3 05:00:11 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 3 05:00:11 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 05:00:11 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 3 05:00:11 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 3 05:00:11 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 05:00:11 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 05:00:11 kjcf05n02 lldpad[3180]: init_ports: Error adding device ib0 Nov 3 05:00:11 kjcf05n02 lldpad[3180]: init_ports: Error adding device ib1 Nov 3 05:00:11 kjcf05n02 lldpad[3180]: Signal 15 received - terminating Nov 3 05:00:11 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 3 05:00:11 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 05:00:11 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 05:00:11 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 3 05:00:11 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 05:00:11 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 3 05:00:11 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 3 05:00:11 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:11 kjcf05n02 systemd[3168]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:11 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 1 | Nov-03-2024 | 08:28:22 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 2 | Nov-03-2024 | 08:29:14 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 3 | Nov-03-2024 | 08:29:15 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 4 | Nov-03-2024 | 08:30:20 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 5 | Nov-03-2024 | 08:30:21 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 6 | Nov-03-2024 | 10:56:17 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 7 | Nov-03-2024 | 10:56:17 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 8 | Nov-03-2024 | 10:56:17 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 9 | Nov-03-2024 | 10:56:17 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 10 | Nov-03-2024 | 10:56:17 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 11 | Nov-03-2024 | 10:56:17 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 12 | Nov-03-2024 | 10:56:17 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 13 | Nov-03-2024 | 10:56:17 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 14 | Nov-03-2024 | 10:56:17 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 15 | Nov-03-2024 | 10:56:17 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 16 | Nov-03-2024 | 10:56:17 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 17 | Nov-03-2024 | 10:56:17 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 18 | Nov-03-2024 | 10:56:48 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 19 | Nov-03-2024 | 10:56:48 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 20 | Nov-03-2024 | 10:56:48 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 21 | Nov-03-2024 | 10:56:48 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 22 | Nov-03-2024 | 10:56:48 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 23 | Nov-03-2024 | 10:56:48 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 24 | Nov-03-2024 | 10:56:48 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 25 | Nov-03-2024 | 10:56:48 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 26 | Nov-03-2024 | 10:56:48 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 27 | Nov-03-2024 | 10:56:48 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 28 | Nov-03-2024 | 10:56:48 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 05:00:11 kjcf05n02 ipmievd[3980]: 29 | Nov-03-2024 | 10:56:48 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 05:00:11 kjcf05n02 ipmievd[3983]: Reading sensors... Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 3 05:00:11 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:11 kjcf05n02 systemd[3168]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 05:00:11 kjcf05n02 nscd[2172]: 2172 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 05:00:11 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 05:00:11 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 3 05:00:11 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 05:00:11 kjcf05n02 beSetMlxConfig[4039]: ConnectX-3 multiport not detected Nov 3 05:00:11 kjcf05n02 beSetMlxConfig[4039]: Starting MST (Mellanox Software Tools) driver set Nov 3 05:00:11 kjcf05n02 beSetMlxConfig[4039]: Loading MST PCI module - Success Nov 3 05:00:11 kjcf05n02 systemd-udevd[1579]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 05:00:11 kjcf05n02 beSetMlxConfig[4039]: [warn] mst_pciconf is already loaded, skipping Nov 3 05:00:11 kjcf05n02 beSetMlxConfig[4039]: Create devices Nov 3 05:00:11 kjcf05n02 beSetMlxConfig[4039]: Unloading MST PCI module (unused) - Success Nov 3 05:00:11 kjcf05n02 ipmievd[3983]: Waiting for events... Nov 3 05:00:11 kjcf05n02 beSetMlxConfig[4039]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 05:00:11 kjcf05n02 beSetMlxConfig[4039]: ib mode Nov 3 05:00:11 kjcf05n02 beSetMlxConfig[4039]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 05:00:11 kjcf05n02 beSetMlxConfig[4039]: ib mode Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 05:00:11 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 05:00:11 kjcf05n02 systemd-udevd[1579]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 05:00:11 kjcf05n02 systemd-udevd[4943]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:00:11 kjcf05n02 systemd-udevd[4944]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:00:11 kjcf05n02 systemd-udevd[4947]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:00:11 kjcf05n02 systemd-udevd[4950]: Using default interface naming scheme 'rhel-8.0'. Nov 3 05:00:11 kjcf05n02 systemd-udevd[4950]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:00:11 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 05:00:11 kjcf05n02 systemd[3168]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:11 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[4985]: Setting up Mellanox network interface: ib0 Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[4986]: Setting up Mellanox network interface: ib1 Nov 3 05:00:11 kjcf05n02 systemd-udevd[4946]: Using default interface naming scheme 'rhel-8.0'. Nov 3 05:00:11 kjcf05n02 systemd-udevd[4945]: Using default interface naming scheme 'rhel-8.0'. Nov 3 05:00:11 kjcf05n02 systemd-udevd[4946]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:00:11 kjcf05n02 systemd-udevd[4945]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[5035]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[5036]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[5067]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[5066]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[5068]: No configuration found for ib1 Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[5069]: No configuration found for ib0 Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[5076]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 05:00:11 kjcf05n02 mlnx_interface_mgr[5077]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 05:00:11 kjcf05n02 mlnx_conf_mgr[5116]: INFO: No configurations found for mlx5_0, skipping. Nov 3 05:00:11 kjcf05n02 mlnx_conf_mgr[5117]: INFO: No configurations found for mlx5_1, skipping. Nov 3 05:00:11 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 05:00:11 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}f3374fa8f4e0e6a9b3bc6d33cd39ac65244f7e84b17a16031dfef0b31a946851' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}f3374fa8f4e0e6a9b3bc6d33cd39ac65244f7e84b17a16031dfef0b31a946851' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}060061b5b19023060b1371f9dc7329ab50cc1ac920ca0d435ad633b61fc4da35' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}060061b5b19023060b1371f9dc7329ab50cc1ac920ca0d435ad633b61fc4da35' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}87abd4b864a88dfcf04e3cb11ac8437813a3bbff70065816ef03e7fb9d1df70d' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}87abd4b864a88dfcf04e3cb11ac8437813a3bbff70065816ef03e7fb9d1df70d' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}ce0bfcadb2816e903aa00715de4a92f554de7ae0d866e7f641970412c8cf8429' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}ce0bfcadb2816e903aa00715de4a92f554de7ae0d866e7f641970412c8cf8429' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 05:00:11 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 3 05:00:11 kjcf05n02 chronyd[2180]: chronyd exiting Nov 3 05:00:11 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 3 05:00:11 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 05:00:11 kjcf05n02 chronyd[5151]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 05:00:11 kjcf05n02 chronyd[5151]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 05:00:11 kjcf05n02 chronyd[5151]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 05:00:11 kjcf05n02 chronyd[5151]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 05:00:11 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 05:00:11 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:11 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 05:00:11 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 3 05:00:11 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 05:00:11 kjcf05n02 dwd[5182]: dwd: vMay 29 2024 : 15:38:26 Nov 3 05:00:11 kjcf05n02 dwd[5182]: /usr/sbin/dwd -i 15 -d Nov 3 05:00:11 kjcf05n02 dwd[5182]: dwd: option Lethal: 0 Nov 3 05:00:11 kjcf05n02 dwd[5182]: dwd: option Interval: 15 Nov 3 05:00:11 kjcf05n02 dwd[5182]: dwd: option abrtlimit: 10 Nov 3 05:00:11 kjcf05n02 dwd[5182]: dwd: option DZPeriod: 604800 Nov 3 05:00:11 kjcf05n02 dwd[5182]: dwd: option SmartPeriod: 43200 Nov 3 05:00:11 kjcf05n02 dwd[5182]: dwd: option SDDEnabled: 1 Nov 3 05:00:11 kjcf05n02 dwd[5182]: dwd: option SDDAwaitScale: 3 Nov 3 05:00:11 kjcf05n02 dwd[5182]: dwd: option SDDAwaitMin: 100 Nov 3 05:00:11 kjcf05n02 dwd[5182]: dwd: option Verbosity: 1 Nov 3 05:00:11 kjcf05n02 dwd[5182]: dwd: option StandAlone: 0 Nov 3 05:00:11 kjcf05n02 dwd[5182]: option Lethal: 0 Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 05:00:11 kjcf05n02 dwd[5182]: option Interval: 15 Nov 3 05:00:11 kjcf05n02 dwd[5182]: option abrtlimit: 10 Nov 3 05:00:11 kjcf05n02 dwd[5182]: option DZPeriod: 604800 Nov 3 05:00:11 kjcf05n02 dwd[5182]: option SmartPeriod: 43200 Nov 3 05:00:11 kjcf05n02 dwd[5182]: option SDDEnabled: 1 Nov 3 05:00:11 kjcf05n02 dwd[5182]: option SDDAwaitScale: 3 Nov 3 05:00:11 kjcf05n02 dwd[5182]: option SDDAwaitMin: 100 Nov 3 05:00:11 kjcf05n02 dwd[5182]: option Verbosity: 1 Nov 3 05:00:11 kjcf05n02 dwd[5182]: option StandAlone: 0 Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 05:00:11 kjcf05n02 dwd[5183]: option Lethal now set to 1 Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 05:00:11 kjcf05n02 dwd[5183]: option abrtlimit now set to 1 Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 05:00:11 kjcf05n02 dwd[5183]: option SmartPeriod now set to 86400 Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 05:00:11 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 05:00:11 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:11 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:11 kjcf05n02 python3.9[5212]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 05:00:11 kjcf05n02 python3.9[3168]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 05:00:11 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:11 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 05:00:11 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:11 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 3 05:00:11 kjcf05n02 sedcpwrkr[5351]: Using config script: /etc/sedcpwrkr.conf Nov 3 05:00:11 kjcf05n02 sedcpwrkr[5351]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 05:00:11 kjcf05n02 sedcpwrkr[5351]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 05:00:11 kjcf05n02 sedcpwrkr[5351]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 05:00:11 kjcf05n02 sedcpwrkr[5351]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 05:00:11 kjcf05n02 sedcpwrkr[5351]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 05:00:11 kjcf05n02 sedcpwrkr[5351]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 05:00:11 kjcf05n02 sedcpwrkr-server[5382]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 05:00:11 kjcf05n02 sedcpwrkr[5351]: celery multi v5.2.7 (dawn-chorus) Nov 3 05:00:11 kjcf05n02 sedcpwrkr[5351]: > Starting nodes... Nov 3 05:00:11 kjcf05n02 sedcpwrkr[5351]: > sedcpwrkr@kjcf05n02: OK Nov 3 05:00:11 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 05:00:11 kjcf05n02 sedcpwrkr-server[5384]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 05:00:11 kjcf05n02 sedcpwrkr-server[5384]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 05:00:11 kjcf05n02 sedcpwrkr-server[5384]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 05:00:11 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 05:00:11 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 3 05:00:11 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 05:00:11 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 05:00:11 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 05:00:12 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:12 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 05:00:12 kjcf05n02 systemd-udevd[1579]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 05:00:12 kjcf05n02 iptables.init[5447]: iptables: Applying firewall rules: [ OK ] Nov 3 05:00:12 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 3 05:00:12 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:12 kjcf05n02 systemd[3168]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:12 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:12 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:12 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 05:00:12 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 05:00:12 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 05:00:12 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 05:00:12 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 05:00:12 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 05:00:12 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 05:00:12 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 05:00:12 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 05:00:12 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 05:00:13 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 05:00:13 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 05:00:13 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 05:00:13 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 05:00:13 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 05:00:13 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 05:00:13 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 05:00:13 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 05:00:13 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 05:00:13 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 05:00:13 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 05:00:13 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 05:00:13 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 05:00:13 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 05:00:13 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 05:00:13 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 05:00:13 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 05:00:13 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 05:00:13 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 05:00:13 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 05:00:13 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 05:00:13 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 05:00:13 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 05:00:13 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 05:00:13 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 05:00:13 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 05:00:13 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 05:00:13 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 05:00:13 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 05:00:13 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 05:00:13 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 05:00:13 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 05:00:13 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 05:00:13 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 05:00:13 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 05:00:13 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 05:00:13 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 05:00:13 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 05:00:13 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 05:00:13 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 05:00:13 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:13 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 05:00:13 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5548 which is not our child. We'll most likely not notice when it exits. Nov 3 05:00:13 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 05:00:13 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:13 kjcf05n02 openhpid[5548]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 05:00:13 kjcf05n02 openhpid[5548]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 05:00:13 kjcf05n02 openhpid[5548]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 05:00:13 kjcf05n02 openhpid[5548]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 05:00:13 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:14 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:14 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:14 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 05:00:14 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 05:00:14 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 05:00:14 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 05:00:14 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:14 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 05:00:14 kjcf05n02 dcs-collectord[5639]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 05:00:14 kjcf05n02 hpi.inv.log[5639]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 05:00:14 kjcf05n02 dcs-collectord[5639]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 05:00:14 kjcf05n02 dcs-collectord[5639]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 05:00:14 kjcf05n02 dcs-collector[5630]: Starting dcs-collector:[ OK ] Nov 3 05:00:14 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 05:00:14 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 05:00:14 kjcf05n02 dcs-collectord[5642]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 05:00:14 kjcf05n02 dcs-collectord[5642]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 05:00:14 kjcf05n02 dcs-collectord[5642]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 05:00:14 kjcf05n02 dcs-collectord[5642]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 05:00:14 kjcf05n02 dcs-collectord[5642]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 05:00:14 kjcf05n02 dcs-collectord[5642]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 05:00:14 kjcf05n02 dcs-collectord[5642]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 05:00:14 kjcf05n02 dcs-collectord[5642]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259345076", "units": "kB"}, {"name": "MemAvailable", "value": "258624672", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821160", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686788", "units": "kB"}, {"name": "Inactive", "value": "963952", "units": "kB"}, {"name": "Active(anon)", "value": "1520592", "units": "kB"}, {"name": "Inactive(anon)", "value": "827932", "units": "kB"}, {"name": "Active(file)", "value": "166196", "units": "kB"}, {"name": "Inactive(file)", "value": "136020", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "755288", "units": "kB"}, {"name": "Mapped", "value": "86192", "units": "kB"}, {"name": "Shmem", "value": "1593368", "units": "kB"}, {"name": "KReclaimable", "value": "108796", "units": "kB"}, {"name": "Slab", "value": "276256", "units": "kB"}, {"name": "SReclaimable", "value": "108796", "units": "kB"}, {"name": "SUnreclaim", "value": "167460", "units": "kB"}, {"name": "KernelStack", "value": "9664", "units": "kB"}, {"name": "PageTables", "value": "20616", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3233124", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11136", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "2048", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "246088", "units": "kB"}, {"name": "DirectMap2M", "value": "17444864", "units": "kB"}, {"name": "DirectMap1G", "value": "250609664", "units": "kB"}]}' Nov 3 05:00:14 kjcf05n02 dcs-collectord[5642]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 05:00:14 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:15 kjcf05n02 dcs-collectord[5642]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 05:00:15 kjcf05n02 dcs-collectord[5642]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730631614.6690943], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730631614.903656], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730631614.598666, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 05:00:15 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:15 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 05:00:15 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:15 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:15 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 05:00:15 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 05:00:15 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 05:00:15 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 05:00:15 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:15 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 05:00:15 kjcf05n02 firmware-update-orc[5748]: Using config script: /etc/firmware_update_orc.conf Nov 3 05:00:15 kjcf05n02 firmware-update-orc[5748]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 05:00:15 kjcf05n02 firmware-update-orc[5748]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 05:00:15 kjcf05n02 firmware-update-orc[5748]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 05:00:15 kjcf05n02 firmware-update-orc[5748]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 05:00:15 kjcf05n02 firmware-update-orc[5748]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 05:00:15 kjcf05n02 firmware-update-orc[5748]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 05:00:16 kjcf05n02 firmware-update-orc-server[5784]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 05:00:16 kjcf05n02 firmware-update-orc[5748]: celery multi v5.2.7 (dawn-chorus) Nov 3 05:00:16 kjcf05n02 firmware-update-orc[5748]: > Starting nodes... Nov 3 05:00:16 kjcf05n02 firmware-update-orc[5748]: > worker1@kjcf05n02: OK Nov 3 05:00:16 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 05:00:16 kjcf05n02 firmware-update-orc-server[5788]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 05:00:16 kjcf05n02 firmware-update-orc-server[5788]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 05:00:16 kjcf05n02 firmware-update-orc-server[5788]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 05:00:16 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 05:00:16 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:16 kjcf05n02 systemd[3168]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:16 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:16 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:16 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 05:00:16 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 05:00:16 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 05:00:16 kjcf05n02 dbus-daemon[2230]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 05:00:16 kjcf05n02 dbus-daemon[2230]: [system] Reloaded configuration Nov 3 05:00:16 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 05:00:16 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 05:00:16 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 05:00:16 kjcf05n02 dbus-daemon[2230]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 05:00:16 kjcf05n02 dbus-daemon[2230]: [system] Reloaded configuration Nov 3 05:00:16 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 05:00:16 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 05:00:16 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 05:00:16 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 05:00:16 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:16 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 3 05:00:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730631616', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 05:00:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730631616'} Nov 3 05:00:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:00:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730631616', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 05:00:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730631616'} Nov 3 05:00:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:00:17 kjcf05n02 ras-resource-manager-agent[5904]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 05:00:17 kjcf05n02 ras-resource-manager-agent[5890]: Starting ras-resource-manager-agent:[ OK ] Nov 3 05:00:17 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 05:00:17 kjcf05n02 ras-resource-manager-agent[5906]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 05:00:17 kjcf05n02 ras-resource-manager-client[5906]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 05:00:17 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 3 05:00:17 kjcf05n02 ras-resource-manager-client[5906]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 05:00:17 kjcf05n02 ras-resource-manager-client[5916]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 05:00:17 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:17 kjcf05n02 systemd[3168]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:17 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:17 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:17 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 05:00:17 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 05:00:17 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:18 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 05:00:18 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:18 kjcf05n02 systemd[3168]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: Press Ctrl+C to exit. Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: Plugin support version 1.0 Nov 3 05:00:18 kjcf05n02 zabbix_agent2[5990]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 05:00:18 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:18 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:18 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:18 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 05:00:19 kjcf05n02 dcs-notification-sender[6065]: dcs-notification-senderd is stopped Nov 3 05:00:19 kjcf05n02 zabbix-agent2[6079]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 05:00:19 kjcf05n02 dcs-notification-sender[6065]: Starting notification-sender:[ OK ] Nov 3 05:00:19 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 05:00:19 kjcf05n02 zabbix-agent2[6081]: INFO DCS notification agent started. (agent.py:61) Nov 3 05:00:19 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 05:00:19 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:19 kjcf05n02 systemd[3168]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:19 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:19 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:20 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:20 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 05:00:20 kjcf05n02 dcs-collectord[6186]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 05:00:20 kjcf05n02 dcs-collectord[6186]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 05:00:20 kjcf05n02 dcs-bulk-data-sender[6186]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 05:00:20 kjcf05n02 dcs-bulk-data-sender[6177]: Starting bulk-data-sender:[ OK ] Nov 3 05:00:20 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 05:00:20 kjcf05n02 dcs-collectord[6188]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 05:00:20 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 05:00:20 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:20 kjcf05n02 systemd[3168]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:20 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:20 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:20 kjcf05n02 nscd[2172]: 2172 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 05:00:20 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 05:00:20 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 05:00:20 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 05:00:20 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 05:00:20 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 05:00:20 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 05:00:20 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 05:00:20 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 05:00:20 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 05:00:20 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 05:00:20 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 05:00:20 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 05:00:20 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 05:00:20 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 05:00:21 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 05:00:21 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 05:00:21 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 05:00:21 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 05:00:21 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 05:00:21 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 05:00:21 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 3 05:00:21 kjcf05n02 sssd[nss][2464]: Shutting down (status = 0) Nov 3 05:00:21 kjcf05n02 sssd[be[implicit_files]][2349]: Shutting down (status = 0) Nov 3 05:00:21 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 3 05:00:21 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 3 05:00:21 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 05:00:22 kjcf05n02 sssd[sssd][6258]: Starting up Nov 3 05:00:22 kjcf05n02 sssd[be[implicit_files]][6259]: Starting up Nov 3 05:00:22 kjcf05n02 python3.9[5212]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 05:00:22 kjcf05n02 python3.9[3168]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:22 kjcf05n02 sssd[nss][6260]: Starting up Nov 3 05:00:22 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 05:00:22 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 05:00:22 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 05:00:22 kjcf05n00 mcfcli[3673891]: %3|1730631622.600|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:00:23 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 05:00:23 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 05:00:23 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 05:00:23 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 05:00:23 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 05:00:23 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 05:00:23 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 05:00:23 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 05:00:23 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:00:23 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:00:23 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:23 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 05:00:24 kjcf05n02 icinga2[6325]: [2024-11-03 05:00:23 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 05:00:24 kjcf05n02 icinga2[6325]: [2024-11-03 05:00:23 -0600] information/cli: Loading configuration file(s). Nov 3 05:00:24 kjcf05n02 icinga2[6325]: [2024-11-03 05:00:23 -0600] information/ConfigItem: Committing config item(s). Nov 3 05:00:24 kjcf05n02 icinga2[6325]: [2024-11-03 05:00:23 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 3 05:00:24 kjcf05n02 icinga2[6325]: [2024-11-03 05:00:23 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 05:00:24 kjcf05n02 icinga2[6325]: [2024-11-03 05:00:23 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 05:00:24 kjcf05n02 icinga2[6325]: [2024-11-03 05:00:23 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 05:00:24 kjcf05n02 icinga2[6325]: [2024-11-03 05:00:23 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 05:00:24 kjcf05n02 icinga2[6325]: [2024-11-03 05:00:23 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 05:00:24 kjcf05n02 icinga2[6325]: [2024-11-03 05:00:23 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 05:00:24 kjcf05n02 icinga2[6325]: [2024-11-03 05:00:23 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 05:00:24 kjcf05n02 icinga2[6325]: [2024-11-03 05:00:23 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 05:00:24 kjcf05n02 icinga2[6325]: [2024-11-03 05:00:23 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 05:00:24 kjcf05n02 icinga2[6325]: [2024-11-03 05:00:23 -0600] information/cli: Closing console log. Nov 3 05:00:24 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 05:00:24 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:24 kjcf05n02 systemd[3168]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:24 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:24 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:24 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 05:00:24 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 05:00:24 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:24 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 3 05:00:25 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:25 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 05:00:25 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:25 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:26 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 05:00:26 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 05:00:26 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 05:00:26 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 05:00:26 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 05:00:26 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 05:00:26 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 05:00:26 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 05:00:26 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 05:00:26 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 05:00:26 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 05:00:26 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 05:00:26 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 05:00:26 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 05:00:26 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:26 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 05:00:26 kjcf05n02 nslcd[7234]: version 0.9.9 starting Nov 3 05:00:26 kjcf05n02 nslcd[7234]: accepting connections Nov 3 05:00:26 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 05:00:26 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:27 kjcf05n02 systemd[3168]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:27 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:27 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:27 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 05:00:27 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 05:00:27 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 05:00:27 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 05:00:27 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 05:00:27 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 05:00:28 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 05:00:28 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 05:00:28 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:28 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 05:00:28 kjcf05n02 dearcpw[7431]: Using config script: /etc/dearcpw.conf Nov 3 05:00:28 kjcf05n02 dearcpw[7431]: - Creating default directory: '/var/log/dearcpw' Nov 3 05:00:28 kjcf05n02 dearcpw[7431]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 05:00:28 kjcf05n02 dearcpw[7431]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 05:00:28 kjcf05n02 dearcpw[7431]: - Creating default directory: '/var/run/dearcpw' Nov 3 05:00:28 kjcf05n02 dearcpw[7431]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 05:00:28 kjcf05n02 dearcpw[7431]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 05:00:28 kjcf05n02 dearcpw-server[7471]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 05:00:28 kjcf05n02 dearcpw[7431]: celery multi v5.2.7 (dawn-chorus) Nov 3 05:00:28 kjcf05n02 dearcpw[7431]: > Starting nodes... Nov 3 05:00:28 kjcf05n02 dearcpw[7431]: > dearcpw@kjcf05n02: OK Nov 3 05:00:28 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 05:00:28 kjcf05n02 dearcpw-server[7473]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 05:00:28 kjcf05n02 dearcpw-server[7473]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 05:00:28 kjcf05n02 dearcpw-server[7473]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 05:00:29 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 3 05:00:29 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:29 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:29 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 05:00:29 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 05:00:29 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 05:00:29 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 05:00:29 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 05:00:29 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 05:00:29 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 05:00:29 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 05:00:29 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 05:00:29 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 05:00:29 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:59814). Nov 3 05:00:29 kjcf05n01 rsyncd[2907245]: connect from kjcf05n02 (172.16.2.5) Nov 3 05:00:29 kjcf05n01 rsyncd[2907245]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 05:00:29 kjcf05n01 rsyncd[2907245]: receiving file list Nov 3 05:00:29 kjcf05n01 rsyncd[2907245]: sent 29 bytes received 324 bytes total size 10905 Nov 3 05:00:29 kjcf05n01 systemd[1]: rsyncd@598-172.16.2.2:873-172.16.2.5:59814.service: Succeeded. Nov 3 05:00:29 kjcf05n02 puppet[7508]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 3 05:00:29 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 05:00:29 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 05:00:29 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 05:00:29 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 05:00:29 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 05:00:29 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 05:00:29 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 05:00:29 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 05:00:29 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 05:00:29 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 05:00:29 kjcf05n02 dcs-collectord[5642]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 05:00:29 kjcf05n02 dcs-collectord[5642]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 05:00:30 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 05:00:30 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 05:00:30 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 05:00:30 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 05:00:30 kjcf05n02 dcs-bulk-data-sender[6188]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 05:00:30 kjcf05n02 dcs-collectord[6188]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 05:00:31 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 05:00:31 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 05:00:31 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 05:00:31 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 05:00:31 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 05:00:31 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 05:00:31 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 05:00:31 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 05:00:32 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 05:00:32 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 05:00:32 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:32 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 05:00:32 kjcf05n02 diskless-swap[7605]: HA_PS_000: recovering journal Nov 3 05:00:32 kjcf05n02 systemd-udevd[1579]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 05:00:32 kjcf05n02 diskless-swap[7605]: HA_PS_000: clean, 2277/6400 files, 7066/25600 blocks Nov 3 05:00:32 kjcf05n02 diskless-swap[7605]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 05:00:32 kjcf05n02 diskless-swap[7605]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 05:00:32 kjcf05n02 diskless-swap[7605]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 05:00:32 kjcf05n02 diskless-swap[7605]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 05:00:32 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 05:00:32 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:32 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:32 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 05:00:32 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 05:00:32 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 05:00:32 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 05:00:32 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 3 05:00:33 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 3 05:00:33 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 3 05:00:33 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 3 05:00:33 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 3 05:00:33 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 05:00:33 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 05:00:33 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 05:00:33 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 05:00:33 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 05:00:33 kjcf05n02 ipmievd[3983]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 05:00:33 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 05:00:33 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 05:00:33 kjcf05n02 ipmievd[3983]: System Event sensor - Timestamp Clock Sync Nov 3 05:00:34 kjcf05n02 ipmievd[3168]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:34 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 05:00:34 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 05:00:34 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 05:00:34 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 05:00:34 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 05:00:34 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 05:00:34 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 05:00:34 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 05:00:35 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 05:00:35 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 05:00:35 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 05:00:35 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 05:00:36 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 05:00:36 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 05:00:36 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 05:00:36 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 05:00:36 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:36 kjcf05n00 mcfcli[3673891]: %3|1730631636.261|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:00:36 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 3 05:00:36 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:36 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:36 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 05:00:36 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 05:00:36 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:36 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 3 05:00:37 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:37 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:37 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 05:00:37 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 05:00:37 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:37 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 3 05:00:37 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:37 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:37 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 05:00:37 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 05:00:37 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 05:00:37 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 05:00:37 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 05:00:37 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 05:00:37 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 05:00:37 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 05:00:37 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 05:00:37 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 05:00:37 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 05:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 05:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 05:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 05:00:37 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 3 05:00:37 kjcf05n02 kdumpctl[7831]: kdump: No kdump initial ramdisk found. Nov 3 05:00:37 kjcf05n02 kdumpctl[7831]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 05:00:38 kjcf05n02 dracut[7943]: dracut-049-135.git20210121.el8 Nov 3 05:00:38 kjcf05n02 dracut[7945]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 05:00:38 kjcf05n02 dracut[7945]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 05:00:38 kjcf05n02 dracut[7945]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 05:00:38 kjcf05n02 dracut[7945]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 05:00:38 kjcf05n02 dracut[7945]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 05:00:38 kjcf05n02 dracut[7945]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 05:00:38 kjcf05n02 dracut[7945]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 05:00:38 kjcf05n02 dracut[7945]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + is_func check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check -h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local dev holder Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + require_binaries mdadm expr Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _module_name=90hperaid Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ mdadm = \-\m ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for cmd in "$@" Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + find_binary mdadm Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for cmd in "$@" Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + find_binary expr Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n -h ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for dev in "${!host_fs_types[@]}" Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ nfs != *_raid_member ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + continue Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _ret=255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + ret=255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ 255 = 0 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ 255 = 255 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ module_depends hperaid Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: +++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: +++ set -x Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ depends Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo rootfs-block Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ return 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ _ret=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ return 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for _moddep in $(module_depends $_mod) Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all == *\ hperaid\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + add_dracutmodules+=' rootfs-block ' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ == *\ hperaid\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check_module rootfs-block Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _mod=rootfs-block Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ == *\ rootfs-block\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n '' ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all == *\ rootfs-block\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + module_check rootfs-block 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 05:00:38 kjcf05n02 kdumpctl[3168]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 2 -eq 2 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _forced=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + is_func check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check -h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _ret=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + ret=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ 0 = 0 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ module_depends rootfs-block Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: +++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 05:00:38 kjcf05n02 kdumpctl[3168]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ depends Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo fs-lib Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ _ret=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ return 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for _moddep in $(module_depends $_mod) Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all == *\ rootfs-block\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + add_dracutmodules+=' fs-lib ' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ == *\ rootfs-block\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check_module fs-lib Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _mod=fs-lib Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n '' ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + mods_checked_as_dep+=' fs-lib ' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all == *\ fs-lib\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + module_check fs-lib 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 05:00:38 kjcf05n02 kdumpctl[3168]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 2 -eq 2 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _forced=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + is_func check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check -h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _ret=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + ret=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ 0 = 0 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ module_depends fs-lib Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: +++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ depends Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ return 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ _ret=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ return 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + mods_to_load+=' fs-lib ' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + mods_to_load+=' rootfs-block ' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + mods_to_load+=' hperaid ' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _mod=90kernel-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _mod=kernel-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check_module kernel-modules 1 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _mod=kernel-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all = all ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + module_check kernel-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 1 -eq 2 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + is_func check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check -h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + true Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _ret=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + ret=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ 0 != 0 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ module_depends kernel-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: +++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ depends Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ true Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ _ret=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ return 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + mods_to_load+=' kernel-modules ' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _mod=90kernel-modules-extra Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _mod=kernel-modules-extra Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check_module kernel-modules-extra 1 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _mod=kernel-modules-extra Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all = all ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + module_check kernel-modules-extra Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 1 -eq 2 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + is_func check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check -h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + true Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _ret=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + ret=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ 0 != 0 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ module_depends kernel-modules-extra Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: +++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ depends Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ true Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ _ret=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ return 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + mods_to_load+=' kernel-modules-extra ' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _mod=90kernel-network-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _mod=kernel-network-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check_module kernel-network-modules 1 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _mod=kernel-network-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all = all ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + module_check kernel-network-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 1 -eq 2 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + is_func check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check -h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _ret=255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + ret=255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ 255 != 0 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 1 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _mod=90livenet Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _mod=livenet Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check_module livenet 1 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _mod=livenet Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all = all ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + module_check livenet Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 1 -eq 2 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + is_func check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check -h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _ret=255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + ret=255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ 255 != 0 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 1 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _mod=90lvm Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _mod=lvm Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check_module lvm 1 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _mod=lvm Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all = all ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + module_check lvm Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 1 -eq 2 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + is_func check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check -h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + require_binaries lvm Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _module_name=90lvm Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ lvm = \-\m ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for cmd in "$@" Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + find_binary lvm Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n -h ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for fs in "${host_fs_types[@]}" Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ nfs = LVM*_member ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _ret=255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + ret=255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ 255 != 0 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 1 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _mod=90mdraid Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _mod=mdraid Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check_module mdraid 1 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _mod=mdraid Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all = all ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + module_check mdraid Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 1 -eq 2 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + is_func check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check -h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _rootdev Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + require_binaries mdadm expr Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _module_name=90mdraid Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ mdadm = \-\m ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for cmd in "$@" Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + find_binary mdadm Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for cmd in "$@" Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + find_binary expr Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n -h ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for dev in "${!host_fs_types[@]}" Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ nfs != *_raid_member ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + continue Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _ret=255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + ret=255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ 255 != 0 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 1 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _mod=90multipath Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _mod=multipath Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check_module multipath 1 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _mod=multipath Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all = all ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + module_check multipath Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 1 -eq 2 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + is_func check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check -h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _rootdev Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n -h ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for_each_host_dev_and_slaves is_mpath Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _func=is_mpath Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _dev Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for _dev in "${host_devs[@]}" Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + continue Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 1 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _ret=255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + ret=255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ 255 != 0 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 1 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _mod=90qemu Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _mod=qemu Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check_module qemu 1 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _mod=qemu Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all = all ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + module_check qemu Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 1 -eq 2 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + is_func check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check -h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n -h ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + type -P systemd-detect-virt Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ systemd-detect-virt --vm Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + vm=none Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + (( 1 != 0 )) Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _ret=255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + ret=255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ 255 != 0 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 1 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _mod=90qemu-net Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _mod=qemu-net Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check_module qemu-net 1 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _mod=qemu-net Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all = all ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + module_check qemu-net Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 1 -eq 2 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + is_func check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check -h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n -h ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + type -P systemd-detect-virt Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ systemd-detect-virt --vm Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + vm= Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + (( 1 != 0 )) Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _ret=255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + ret=255 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ 255 != 0 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + return 1 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _mod=90stratis Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + _mod=stratis Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check_module stratis 1 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _mod=stratis Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ all = all ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + module_check stratis Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 1 -eq 2 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + is_func check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + check -h Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _module_name=90stratis Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + local _ret=0 Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + [[ stratisd-init = \-\m ]] Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + for cmd in "$@" Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + find_binary stratisd-init Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 05:00:38 kjcf05n02 kdumpctl[7831]: + set +x Nov 3 05:00:38 kjcf05n02 dracut[7945]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 05:00:38 kjcf05n02 dracut[7945]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 05:00:38 kjcf05n02 dracut[7945]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 05:00:38 kjcf05n02 dracut[7945]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 05:00:38 kjcf05n02 dracut[7945]: memstrack is available Nov 3 05:00:38 kjcf05n02 dracut[7945]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 05:00:38 kjcf05n02 dracut[7945]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 05:00:38 kjcf05n02 dracut[7945]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 05:00:38 kjcf05n02 dracut[7945]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 05:00:38 kjcf05n02 dracut[7945]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 05:00:39 kjcf05n02 dracut[7945]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 05:00:39 kjcf05n02 dracut[7945]: *** Including module: bash *** Nov 3 05:00:39 kjcf05n02 dracut[7945]: *** Including module: systemd *** Nov 3 05:00:40 kjcf05n02 dracut[7945]: *** Including module: fips *** Nov 3 05:00:40 kjcf05n02 dracut[7945]: *** Including module: systemd-initrd *** Nov 3 05:00:40 kjcf05n02 dracut[7945]: *** Including module: watchdog-modules *** Nov 3 05:00:40 kjcf05n02 dracut[7945]: *** Including module: nss-softokn *** Nov 3 05:00:40 kjcf05n02 dracut[7945]: *** Including module: i18n *** Nov 3 05:00:40 kjcf05n02 dracut[7945]: No KEYMAP configured. Nov 3 05:00:40 kjcf05n02 dracut[7945]: *** Including module: network-legacy *** Nov 3 05:00:41 kjcf05n02 dracut[7945]: *** Including module: network *** Nov 3 05:00:41 kjcf05n02 dracut[7945]: *** Including module: ib_bonding *** Nov 3 05:00:41 kjcf05n02 dracut[7945]: *** Including module: drm *** Nov 3 05:00:44 kjcf05n02 dracut[7945]: *** Including module: hperaid *** Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + install Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + local rule rule_path Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + inst_multiple cat expr Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.NT8lAK/initramfs -a -f cat expr Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + _ret=0 Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + (( 0 != 0 )) Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + : Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + return 0 Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + inst_multiple -o mdmon Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.NT8lAK/initramfs -a -f -o mdmon Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + _ret=0 Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + (( 0 != 0 )) Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + : Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + return 0 Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: ++ command -v partx Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + inst /usr/sbin/partx /sbin/partx Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + local _hostonly_install Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + [[ -e /tmp/dracut.NT8lAK/initramfs//sbin/partx ]] Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.NT8lAK/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + (( 0 != 0 )) Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + : Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: ++ command -v mdadm Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + local _hostonly_install Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + [[ -e /tmp/dracut.NT8lAK/initramfs//sbin/mdadm ]] Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.NT8lAK/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + (( 0 != 0 )) Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + : Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + [[ yes == \y\e\s ]] Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + local _raidconf Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: ++ cmdline Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: ++ local _activated dev line UUID Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: ++ declare -A _activated Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: ++ for dev in "${!host_fs_types[@]}" Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: ++ [[ nfs != *_raid_member ]] Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: ++ continue Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + _raidconf= Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + [[ -n '' ]] Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + inst_rules 64-md-raid.rules Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + local _target=/etc/udev/rules.d _rule _found Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + inst_dir /usr/lib/udev/rules.d Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + [[ -e /tmp/dracut.NT8lAK/initramfs//usr/lib/udev/rules.d ]] Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + return 0 Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + inst_dir /etc/udev/rules.d Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + [[ -e /tmp/dracut.NT8lAK/initramfs//etc/udev/rules.d ]] Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + return 0 Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + for _rule in "$@" Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + continue Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + continue Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + for r in '' $dracutbasedir/rules.d/ Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + [[ 64-md-raid.rules != /* ]] Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + continue Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + for r in '' $dracutbasedir/rules.d/ Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + continue Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + [[ -n '' ]] Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 05:00:44 kjcf05n02 kdumpctl[7831]: + set +x Nov 3 05:00:44 kjcf05n02 dracut[7945]: Skipping udev rule: 64-md-raid.rules Nov 3 05:00:44 kjcf05n02 dcs-collectord[5642]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 05:00:45 kjcf05n02 dcs-collectord[5642]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + installkernel Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + instmods =drivers/md Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + local _optional=-o Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + local _silent Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + local _ret Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + [[ '' = yes ]] Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + [[ =drivers/md = \-\c ]] Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + [[ =drivers/md = \-\s ]] Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + (( 1 == 0 )) Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.NT8lAK/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + _ret=0 Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + (( 0 != 0 )) Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + [[ -n '' ]] Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + return 0 Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + _ret=0 Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + return 0 Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + modules_loaded+='hperaid ' Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + '[' -n '' ']' Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + _d_mod=90kernel-modules Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + _d_mod=kernel-modules Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + [[ '' = yes ]] Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + dinfo '*** Including module: kernel-modules ***' Nov 3 05:00:45 kjcf05n02 kdumpctl[7831]: + set +x Nov 3 05:00:45 kjcf05n02 dracut[7945]: *** Including module: kernel-modules *** Nov 3 05:00:45 kjcf05n02 dracut[7945]: *** Including module: kernel-modules-extra *** Nov 3 05:00:45 kjcf05n02 dracut[7945]: *** Including module: kernel-network-modules *** Nov 3 05:00:45 kjcf05n02 dracut[7945]: *** Including module: diskless-mod *** Nov 3 05:00:45 kjcf05n02 dracut[7945]: *** Including module: fstab-sys *** Nov 3 05:00:45 kjcf05n02 dracut[7945]: *** Including module: nfs *** Nov 3 05:00:46 kjcf05n02 dracut[7945]: *** Including module: rootfs-block *** Nov 3 05:00:46 kjcf05n02 dracut[7945]: *** Including module: terminfo *** Nov 3 05:00:46 kjcf05n02 dracut[7945]: *** Including module: udev-rules *** Nov 3 05:00:46 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 3 05:00:46 kjcf05n02 dracut[7945]: Skipping udev rule: 91-permissions.rules Nov 3 05:00:46 kjcf05n02 dracut[7945]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 05:00:46 kjcf05n02 dracut[7945]: *** Including module: dracut-systemd *** Nov 3 05:00:47 kjcf05n02 dracut[7945]: *** Including module: usrmount *** Nov 3 05:00:47 kjcf05n02 dracut[7945]: *** Including module: base *** Nov 3 05:00:47 kjcf05n02 dracut[7945]: *** Including module: fs-lib *** Nov 3 05:00:47 kjcf05n02 dracut[7945]: *** Including module: kdumpbase *** Nov 3 05:00:48 kjcf05n02 dracut[7945]: *** Including module: memstrack *** Nov 3 05:00:48 kjcf05n02 dracut[7945]: *** Including module: shutdown *** Nov 3 05:00:48 kjcf05n02 dracut[7945]: *** Including module: squash *** Nov 3 05:00:48 kjcf05n02 dracut[7945]: *** Including modules done *** Nov 3 05:00:48 kjcf05n02 dracut[7945]: *** Installing kernel module dependencies *** Nov 3 05:00:49 kjcf05n02 dracut[7945]: *** Installing kernel module dependencies done *** Nov 3 05:00:49 kjcf05n02 dracut[7945]: *** Resolving executable dependencies *** Nov 3 05:00:49 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 3 05:00:50 kjcf05n02 dracut[7945]: *** Resolving executable dependencies done*** Nov 3 05:00:50 kjcf05n02 dracut[7945]: *** Hardlinking files *** Nov 3 05:00:50 kjcf05n02 dracut[7945]: *** Hardlinking files done *** Nov 3 05:00:50 kjcf05n02 dracut[7945]: *** Generating early-microcode cpio image *** Nov 3 05:00:50 kjcf05n02 dracut[7945]: *** Constructing AuthenticAMD.bin **** Nov 3 05:00:50 kjcf05n02 dracut[7945]: *** Store current command line parameters *** Nov 3 05:00:50 kjcf05n02 dracut[7945]: Stored kernel commandline: Nov 3 05:00:50 kjcf05n02 dracut[7945]: rd.driver.pre=sd_mod Nov 3 05:00:50 kjcf05n02 dracut[7945]: rd.driver.pre=nvme Nov 3 05:00:50 kjcf05n02 dracut[7945]: rd.driver.pre=ipmi_si Nov 3 05:00:50 kjcf05n02 dracut[7945]: rd.driver.pre=ipmi_devintf Nov 3 05:00:50 kjcf05n02 dracut[7945]: rd.driver.pre=ipmi_msghandler Nov 3 05:00:50 kjcf05n02 dracut[7945]: nameserver=172.16.2.2 Nov 3 05:00:50 kjcf05n02 dracut[7945]: nameserver=127.0.0.1 Nov 3 05:00:50 kjcf05n02 dracut[7945]: nameserver=172.16.2.2 Nov 3 05:00:50 kjcf05n02 dracut[7945]: nameserver=127.0.0.1 Nov 3 05:00:50 kjcf05n02 dracut[7945]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 3 05:00:50 kjcf05n02 dracut[7945]: rd.neednet Nov 3 05:00:50 kjcf05n02 dracut[7945]: kdumpnic=mgmt0 Nov 3 05:00:50 kjcf05n02 dracut[7945]: bootdev=mgmt0 Nov 3 05:00:50 kjcf05n02 dracut[7945]: *** Install squash loader *** Nov 3 05:00:50 kjcf05n02 dracut[7945]: *** Squashing the files inside the initramfs *** Nov 3 05:00:51 kjcf05n02 dracut[7945]: *** Squashing the files inside the initramfs done *** Nov 3 05:00:51 kjcf05n02 dracut[7945]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 05:00:51 kjcf05n02 dracut[7945]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 05:00:51 kjcf05n02 kdumpctl[7831]: kdump: kexec: loaded kdump kernel Nov 3 05:00:51 kjcf05n02 kdumpctl[7831]: kdump: Starting kdump: [OK] Nov 3 05:00:51 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 3 05:00:51 kjcf05n02 systemd[1]: Reloading. Nov 3 05:00:51 kjcf05n00 zabbix-server[971541]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:00:51 kjcf05n00 zabbix-server[971541]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:51\\"}}"' Nov 3 05:00:51 kjcf05n00 log_interesting_event.py[971541]: Event '45767' acknowledged Nov 3 05:00:52 kjcf05n02 systemd[3168]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:00:52 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:00:52 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:00:52 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 05:00:52 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 05:00:52 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 05:00:52 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 05:00:52 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 05:00:52 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 05:00:52 kjcf05n02 ifdown[14511]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 05:00:52 kjcf05n02 ifdown[14512]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:00:52 kjcf05n02 ifdown[14514]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:00:51 kjcf05n00 zabbix-server[971542]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:00:51 kjcf05n00 zabbix-server[971542]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 3 05:00:52 kjcf05n00 log_interesting_event.py[971542]: Event '45768' acknowledged Nov 3 05:00:52 kjcf05n00 zabbix-server[971543]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:00:52 kjcf05n00 zabbix-server[971543]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 3 05:00:52 kjcf05n00 log_interesting_event.py[971543]: Event '45765' acknowledged Nov 3 05:00:52 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 05:00:52 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 05:00:52 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 05:00:52 kjcf05n02 ifup[14576]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 05:00:52 kjcf05n02 ifup[14577]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:00:52 kjcf05n02 ifup[14578]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:00:52 kjcf05n00 mcfcli[3673891]: %3|1730631652.984|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 05:00:54 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 05:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 05:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 05:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 05:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 05:00:56 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 05:00:57 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 05:00:57 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 05:00:57 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:00:57 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:00:57 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:00:57 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:00:57 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 05:00:57 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 05:00:57 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 05:00:57 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 05:00:57 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:00:57 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:00:57 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:00:57 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:00:57 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 05:00:57 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 05:00:57 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 05:00:57 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 05:00:57 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 05:00:57 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 05:00:57 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 05:00:57 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 05:00:57 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 05:00:57 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 05:00:57 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 05:00:57 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 05:00:57 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 05:00:57 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 05:00:57 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 05:00:57 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 05:00:57 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 05:00:57 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 05:00:57 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 05:00:57 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 05:00:57 kjcf05n02 ifdown[14825]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 05:00:57 kjcf05n02 ifdown[14826]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:00:57 kjcf05n02 ifdown[14841]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:00:57 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 05:00:57 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 05:00:57 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 05:00:57 kjcf05n02 ifup[14908]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 05:00:57 kjcf05n02 ifup[14909]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:00:57 kjcf05n02 ifup[14910]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:00:58 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 05:00:58 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 3 05:00:58 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 05:00:58 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running Nov 3 05:00:58 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 3 05:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 05:00:59 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 05:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 05:01:00 kjcf05n02 dcs-collectord[5642]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 05:01:00 kjcf05n02 dcs-collectord[5642]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 05:01:01 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 05:01:02 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 05:01:02 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 05:01:02 kjcf05n02 systemd[1]: Reloading. Nov 3 05:01:02 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 3 05:01:02 kjcf05n02 await_ha_peer[15137]: Waiting for HA peer kjcf05n03 Nov 3 05:01:03 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 05:01:03 kjcf05n02 await_ha_peer[15137]: Peer kjcf05n03 has started, starting HA Nov 3 05:01:04 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 3 05:01:04 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 3 05:01:04 kjcf05n02 fstonithd.py[15191]: Listening for kdump packets from partner Nov 3 05:01:04 kjcf05n02 systemd[1]: Reloading. Nov 3 05:01:04 kjcf05n02 systemd[3168]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:01:04 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:01:04 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:01:04 kjcf05n02 systemd[1]: Reloading. Nov 3 05:01:04 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 3 05:01:04 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 05:01:05 kjcf05n02 systemd[1]: Reloading. Nov 3 05:01:05 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 05:01:05 kjcf05n02 puppet-agent[3593]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:01:05 kjcf05n02 puppet[3593]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:01:05 kjcf05n02 puppet-agent[3593]: Applied catalog in 90.50 seconds Nov 3 05:01:05 kjcf05n02 puppet[3593]: Notice: Applied catalog in 90.50 seconds Nov 3 05:01:05 kjcf05n02 systemd[1]: Started Puppet agent. Nov 3 05:01:05 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 05:01:05 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 3 05:01:05 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 05:01:05 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 05:01:05 kjcf05n02 systemd[1]: Reached target Timers. Nov 3 05:01:05 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 05:01:05 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 05:01:05 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 05:01:05 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 05:01:05 kjcf05n02 wce-disable.sh[15382]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 05:01:05 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 05:01:05 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 05:01:05 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 05:01:05 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 05:01:05 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 3 05:01:05 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 3 05:01:05 kjcf05n02 RFSF-API[15384]: INFO[2024-11-03T05:01:05-06:00] Datapath API RESTful Service starting Nov 3 05:01:05 kjcf05n02 dp-api-server-node[15384]: INFO[2024-11-03T05:01:05-06:00] Datapath API RESTful Service starting Nov 3 05:01:05 kjcf05n02 RFSF-API[15384]: INFO[2024-11-03T05:01:05-06:00] Running in production mode, starting dbus event listener Nov 3 05:01:05 kjcf05n02 dp-api-server-node[15384]: INFO[2024-11-03T05:01:05-06:00] Running in production mode, starting dbus event listener Nov 3 05:01:05 kjcf05n02 RFSF-API[15384]: INFO[2024-11-03T05:01:05-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 05:01:05 kjcf05n02 dp-api-server-node[15384]: INFO[2024-11-03T05:01:05-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 05:01:05 kjcf05n02 RFSF-API[15384]: INFO[2024-11-03T05:01:05-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 05:01:05 kjcf05n02 dp-api-server-node[15384]: INFO[2024-11-03T05:01:05-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 05:01:05 kjcf05n02 RFSF-API[15384]: INFO[2024-11-03T05:01:05-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 05:01:05 kjcf05n02 dp-api-server-node[15384]: INFO[2024-11-03T05:01:05-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 05:01:05 kjcf05n02 RFSF-API[15384]: INFO[2024-11-03T05:01:05-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 05:01:05 kjcf05n02 dp-api-server-node[15384]: INFO[2024-11-03T05:01:05-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 05:01:05 kjcf05n02 RFSF-API[15384]: INFO[2024-11-03T05:01:05-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 05:01:05 kjcf05n02 dp-api-server-node[15384]: INFO[2024-11-03T05:01:05-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 05:01:05 kjcf05n02 RFSF-API[15384]: INFO[2024-11-03T05:01:05-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 05:01:05 kjcf05n02 dp-api-server-node[15384]: INFO[2024-11-03T05:01:05-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 05:01:05 kjcf05n02 RFSF-API[15384]: INFO[2024-11-03T05:01:05-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 05:01:05 kjcf05n02 dp-api-server-node[15384]: INFO[2024-11-03T05:01:05-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 05:01:05 kjcf05n02 RFSF-API[15384]: INFO[2024-11-03T05:01:05-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 05:01:05 kjcf05n02 dp-api-server-node[15384]: INFO[2024-11-03T05:01:05-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 05:01:05 kjcf05n02 RFSF-API[15384]: INFO[2024-11-03T05:01:05-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 05:01:05 kjcf05n02 dp-api-server-node[15384]: INFO[2024-11-03T05:01:05-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 05:01:05 kjcf05n02 RFSF-API[15384]: INFO[2024-11-03T05:01:05-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 05:01:05 kjcf05n02 dp-api-server-node[15384]: INFO[2024-11-03T05:01:05-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 05:01:05 kjcf05n02 python3.9[15386]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 05:01:05 kjcf05n02 python3.9[15386]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 05:01:05 kjcf05n02 gateway-ec-node.py[15385]: Starting gateway-ec-node service Nov 3 05:01:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730631665', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 2.33, 1.97, 0.87'}"] Nov 3 05:01:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 2.33, 1.97, 0.87', 'message': 'OK - load average: 2.33, 1.97, 0.87', 'value': 'ok', 'timestamp': '1730631665'} Nov 3 05:01:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:01:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730631669', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 340 processes with STATE = RSZDT '}"] Nov 3 05:01:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 340 processes with STATE = RSZDT ', 'message': 'PROCS OK: 340 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730631669'} Nov 3 05:01:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:01:12 kjcf05n02 systemd[1]: Reloading. Nov 3 05:01:12 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 05:01:12 kjcf05n02 systemd[1]: Reloading. Nov 3 05:01:12 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 05:01:12 kjcf05n02 diskmonitor_pre[15828]: Key management is currently disabled.DEAR disabled Nov 3 05:01:13 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 05:01:14 kjcf05n02 sh[15893]: LNET configured: New Created Nov 3 05:01:14 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 05:01:14 kjcf05n02 LCNmon[17974]: Interface ib0 is up Nov 3 05:01:14 kjcf05n02 LCNmon[17974]: Interface ib1 is up Nov 3 05:01:14 kjcf05n02 LCNmon[17974]: Can ping through interface ib0 Nov 3 05:01:14 kjcf05n02 LCNmon[17974]: Can ping through interface ib1 Nov 3 05:01:14 kjcf05n02 LCNmon[17974]: NIC ib0, initial state UP Nov 3 05:01:14 kjcf05n02 LCNmon[17974]: NIC ib1, initial state UP Nov 3 05:01:14 kjcf05n02 LCNmon[17974]: LCNstat initial state UP Nov 3 05:01:15 kjcf05n02 dcs-collectord[5642]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 05:01:15 kjcf05n02 dcs-collectord[5642]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 05:01:15 kjcf05n02 dcs-collectord[5642]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 05:01:15 kjcf05n02 LCNmon[17974]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 3 05:01:15 kjcf05n00 httpd[902568]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 05:01:16 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: /var/run/diskmonitor does not exist, creating Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: Creating /var/run/diskmonitor/disk Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: Creating /var/run/diskmonitor/encl Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: Creating /var/run/diskmonitor/cli Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: RAS_Interlocks_enabled: 1 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: add handler for sig: 14 sa_flags: 10000004 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: add handler for sig: 1 sa_flags: 10000004 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: add handler for sig: 2 sa_flags: 00000004 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: add handler for sig: 15 sa_flags: 00000004 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: add handler for sig: 6 sa_flags: 00000004 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: add handler for sig: 3 sa_flags: 00000004 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: add handler for sig: 30 sa_flags: 00000004 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: add handler for sig: 20 sa_flags: 00000004 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: add handler for sig: 10 sa_flags: 10000004 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: add handler for sig: 11 sa_flags: 00000004 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: add handler for sig: 7 sa_flags: 00000004 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: add handler for sig: 4 sa_flags: 00000004 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: add handler for sig: 8 sa_flags: 00000004 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: Using HA Baton locks - key: diskmonitor Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: Baton will be held for at most 570 seconds Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: DMMP Enabled: 0 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: random seed: 64862f14 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: NVMe Enclosure: 1 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: ZFS Enclosure: 0 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: Dbus, Initialized Connection Successfully Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: int_catcher_thread: thread start Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: Received dbus message 4 org.freedesktop.DBus -> :1.103 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 05:01:16 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 05:01:16 kjcf05n00 mcfcli[3673891]: %3|1730631676.258|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:01:18 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31408 deleted. Nov 3 05:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730631679', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 05:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730631679'} Nov 3 05:01:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730631679', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 05:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730631679'} Nov 3 05:01:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:01:19 kjcf05n02 openhpid[5548]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 05:01:19 kjcf05n02 openhpid[5548]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 05:01:19 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 3 05:01:19 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 05:01:19 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 05:01:19 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18585 which is not our child. We'll most likely not notice when it exits. Nov 3 05:01:19 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 05:01:20 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 3 05:01:20 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 3 05:01:20 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 05:01:20 kjcf05n02 dcs-collectord[5642]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 05:01:20 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 05:01:20 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 05:01:20 kjcf05n02 systemd[1]: Startup finished in 50.360s (kernel) + 2min 28.372s (userspace) = 3min 18.733s. Nov 3 05:01:20 kjcf05n02 openhpid[18585]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 05:01:20 kjcf05n02 openhpid[18585]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 05:01:20 kjcf05n02 openhpid[18585]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 05:01:20 kjcf05n02 openhpid[18585]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 05:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730631679', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.7% (4383920 kB) used.'}"] Nov 3 05:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.7% (4383920 kB) used.', 'message': 'OK - 1.7% (4383920 kB) used.', 'value': 'ok', 'timestamp': '1730631679'} Nov 3 05:01:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:01:20 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18656 (bash) Nov 3 05:01:20 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 05:01:20 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 05:01:20 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 05:01:20 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 05:01:20 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 05:01:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730631681', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 05:01:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730631681'} Nov 3 05:01:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 05:01:22 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 05:01:22 kjcf05n00 mcfcli[3673891]: %3|1730631682.984|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:01:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730631683', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(3976.0B/2552.0B), ib1=(2576.0B/2560.0B), icl0=(7.8kB/9.5kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.3MB), mgmt0=(1478.3MB/8.2MB)'}"] Nov 3 05:01:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(3976.0B/2552.0B), ib1=(2576.0B/2560.0B), icl0=(7.8kB/9.5kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.3MB), mgmt0=(1478.3MB/8.2MB)', 'message': 'NET OK - (Rx/Tx) ib0=(3976.0B/2552.0B), ib1=(2576.0B/2560.0B), icl0=(7.8kB/9.5kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.3MB), mgmt0=(1478.3MB/8.2MB)', 'value': 'ok', 'timestamp': '1730631683'} Nov 3 05:01:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:01:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730631683', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 05:01:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730631683'} Nov 3 05:01:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:01:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730631685', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 05:01:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730631685'} Nov 3 05:01:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:01:30 kjcf05n02 dcs-collectord[5642]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 05:01:30 kjcf05n02 dcs-collectord[5642]: WARNING No data collected (hpi_parser.py:353) Nov 3 05:01:44 kjcf05n02 ipmievd[3983]: System Event sensor - Timestamp Clock Sync Nov 3 05:01:45 kjcf05n02 ipmievd[3168]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:01:45 kjcf05n02 dcs-collectord[5642]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 05:01:52 kjcf05n00 mcfcli[3673891]: %3|1730631712.986|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 05:01:55 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 05:01:56 kjcf05n00 mcfcli[3673891]: %3|1730631716.255|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:02:00 kjcf05n02 dcs-collectord[5642]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 05:02:01 kjcf05n03 nslcd[6912]: [e8944a] ldap_result() failed: Can't contact LDAP server Nov 3 05:02:03 kjcf05n03 firmware-update-orc-server[5838]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "171a1fac-0d65-4f47-85ce-1a1196680134"} (logger.py:65) Nov 3 05:02:03 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 84117 (get_disk_device) Nov 3 05:02:03 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 05:02:03 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 05:02:03 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 05:02:03 kjcf05n02 ras-resource-manager-agent[5906]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "0e70b3a6-99d3-11ef-94be-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 05:02:03 kjcf05n02 ras-resource-manager-agent[5906]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '0e70b3a6-99d3-11ef-94be-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 05:02:03 kjcf05n02 ras-resource-manager-agent[5906]: INFO Submitting new device inserted signal, starting to qualify drive: 0e70b3a6-99d3-11ef-94be-00093d0695e3 (admin_action.py:110) Nov 3 05:02:03 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '0e70b3a6-99d3-11ef-94be-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 05:02:03 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '0e70b3a6-99d3-11ef-94be-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 05:02:03 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '0e70b3a6-99d3-11ef-94be-00093d0695e3', 'response ID': '0e7b37d6-99d3-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 05:02:03 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 0e7b37d6-99d3-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 05:02:03 kjcf05n03 ccp-client[84138]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 05:02:03 kjcf05n03 ccp-client[84138]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 05:02:03 kjcf05n03 ccp-client[84147]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 05:02:03 kjcf05n03 ccp-client[84138]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 05:02:03 kjcf05n03 ccp-client[84147]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 05:02:03 kjcf05n03 ccp-client[84147]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 05:02:03 kjcf05n03 ccp-client[84138]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 05:02:04 kjcf05n02 diskmonitor[17586]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 05:02:04 kjcf05n02 ras-resource-manager-agent[5906]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "0ebdfed6-99d3-11ef-94be-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 05:02:04 kjcf05n02 ras-resource-manager-agent[5906]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '0ebdfed6-99d3-11ef-94be-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 05:02:04 kjcf05n02 ras-resource-manager-agent[5906]: INFO Submitting new device inserted signal, starting to qualify drive: 0ebdfed6-99d3-11ef-94be-00093d0695e3 (admin_action.py:110) Nov 3 05:02:04 kjcf05n02 firmware-update-orc-server[5862]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "a1b91977-11b0-4a9b-accb-5afa29dcca02"} (logger.py:65) Nov 3 05:02:03 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '0ebdfed6-99d3-11ef-94be-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 05:02:03 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '0ebdfed6-99d3-11ef-94be-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 05:02:03 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '0ebdfed6-99d3-11ef-94be-00093d0695e3', 'response ID': '0ec6a586-99d3-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 05:02:03 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 0ec6a586-99d3-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 05:02:06 kjcf05n03 DRVFW[84259]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 05:02:06 kjcf05n03 ccp-client[84271]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 05:02:06 kjcf05n03 ccp-client[84271]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 05:02:06 kjcf05n03 ccp-client[84280]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 05:02:06 kjcf05n03 ccp-client[84271]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 05:02:06 kjcf05n03 ccp-client[84271]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 05:02:06 kjcf05n03 ccp-client[84280]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 05:02:06 kjcf05n03 ccp-client[84280]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 05:02:06 kjcf05n03 firmware-update-orc-server[5838]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 05:02:08 kjcf05n02 ras-resource-manager-agent[5906]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '0e70b3a6-99d3-11ef-94be-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 05:02:08 kjcf05n02 ras-resource-manager-agent[5906]: INFO Drive qualification complete responding: 0e70b3a6-99d3-11ef-94be-00093d0695e3 (admin_action.py:205) Nov 3 05:02:08 kjcf05n02 ras-resource-manager-agent[5906]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "0e70b3a6-99d3-11ef-94be-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (interesting_event.py:59) Nov 3 05:02:08 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 0e7b37d6-99d3-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 05:02:08 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '0e70b3a6-99d3-11ef-94be-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '0e70b3a6-99d3-11ef-94be-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}}} (logger.py:65) Nov 3 05:02:12 kjcf05n02 diskmonitor[17586]: 004 Nov 3 05:02:12 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 05:02:12 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 05:02:12 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 05:02:12 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 05:02:12 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 05:02:12 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 05:02:12 kjcf05n02 diskmonitor[17586]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 05:02:12 kjcf05n02 diskmonitor[17586]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 05:02:12 kjcf05n02 diskmonitor[17586]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 05:02:12 kjcf05n02 diskmonitor[17586]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 05:02:12 kjcf05n02 diskmonitor[17586]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 05:02:12 kjcf05n02 diskmonitor[17586]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "0e70b3a6-99d3-11ef-94be-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 05:02:12 kjcf05n02 diskmonitor[17586]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 05:02:12 kjcf05n02 diskmonitor[17586]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 05:02:12 kjcf05n02 diskmonitor[17586]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "0ebdfed6-99d3-11ef-94be-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 05:02:12 kjcf05n02 diskmonitor[17586]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 05:02:12 kjcf05n02 diskmonitor[17586]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 05:02:17 kjcf05n02 chronyd[5151]: Selected source 172.16.2.1 Nov 3 05:02:19 kjcf05n02 ras-resource-manager-agent[5906]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "0e70b3a6-99d3-11ef-94be-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (service_main_handler.py:66) Nov 3 05:02:19 kjcf05n02 ras-resource-manager-agent[5906]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '0e70b3a6-99d3-11ef-94be-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 05:02:19 kjcf05n02 ras-resource-manager-agent[5906]: INFO Device qualification response has been acknowledged: 0e70b3a6-99d3-11ef-94be-00093d0695e3 (admin_action.py:151) Nov 3 05:02:19 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22600 (get_disk_device) Nov 3 05:02:19 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 05:02:19 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 05:02:19 kjcf05n02 ccp-client[22635]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 05:02:19 kjcf05n02 ccp-client[22635]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 05:02:19 kjcf05n02 ccp-client[22682]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 05:02:19 kjcf05n02 ccp-client[22635]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 05:02:19 kjcf05n02 ccp-client[22635]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 05:02:19 kjcf05n02 ccp-client[22682]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 05:02:19 kjcf05n02 ccp-client[22682]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 05:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730631739}"] Nov 3 05:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730631739, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:02:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730631739}"] Nov 3 05:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730631739, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:02:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730631739}"] Nov 3 05:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730631739, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:02:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730631739}"] Nov 3 05:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730631739, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:02:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730631739}"] Nov 3 05:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730631739, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:02:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:02:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730631739}"] Nov 3 05:02:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730631739, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:02:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:02:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730631739}"] Nov 3 05:02:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730631739, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:02:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:02:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730631739}"] Nov 3 05:02:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730631739, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:02:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:02:20 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 3 05:02:20 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 05:02:20 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 3 05:02:22 kjcf05n02 DRVFW[23579]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 05:02:22 kjcf05n02 ccp-client[23582]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 05:02:22 kjcf05n02 ccp-client[23582]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 05:02:22 kjcf05n02 ccp-client[23619]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 05:02:22 kjcf05n02 ccp-client[23582]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 05:02:22 kjcf05n02 ccp-client[23619]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 05:02:22 kjcf05n02 ccp-client[23619]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 05:02:22 kjcf05n02 ccp-client[23582]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 05:02:22 kjcf05n02 firmware-update-orc-server[5862]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 05:02:23 kjcf05n02 diskmonitor[17586]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 05:02:23 kjcf05n02 ras-resource-manager-agent[5906]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '0ebdfed6-99d3-11ef-94be-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 05:02:23 kjcf05n02 ras-resource-manager-agent[5906]: INFO Drive qualification complete responding: 0ebdfed6-99d3-11ef-94be-00093d0695e3 (admin_action.py:205) Nov 3 05:02:23 kjcf05n02 ras-resource-manager-agent[5906]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "0ebdfed6-99d3-11ef-94be-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 3 05:02:22 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 0ec6a586-99d3-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 05:02:22 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '0ebdfed6-99d3-11ef-94be-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '0ebdfed6-99d3-11ef-94be-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}}} (logger.py:65) Nov 3 05:02:23 kjcf05n02 diskmonitor[17586]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 05:02:23 kjcf05n02 ras-resource-manager-agent[5906]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "1a5cb750-99d3-11ef-94be-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 05:02:23 kjcf05n02 ras-resource-manager-agent[5906]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '1a5cb750-99d3-11ef-94be-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 05:02:23 kjcf05n02 ras-resource-manager-agent[5906]: INFO Requests ['0ebdfed6-99d3-11ef-94be-00093d0695e3', '1a5cb750-99d3-11ef-94be-00093d0695e3'] already in progress (admin_action.py:99) Nov 3 05:02:23 kjcf05n02 ras-resource-manager-agent[5906]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '1a5cb750-99d3-11ef-94be-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 05:02:23 kjcf05n02 ras-resource-manager-agent[5906]: INFO Drive qualification complete responding: 1a5cb750-99d3-11ef-94be-00093d0695e3 (admin_action.py:205) Nov 3 05:02:23 kjcf05n02 ras-resource-manager-agent[5906]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "0ebdfed6-99d3-11ef-94be-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 3 05:02:23 kjcf05n02 ras-resource-manager-agent[5906]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "1a5cb750-99d3-11ef-94be-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 3 05:02:23 kjcf05n00 mcfcli[3673891]: %3|1730631743.101|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 05:02:23 kjcf05n02 python3.9[5212]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 05:02:23 kjcf05n02 python3.9[3168]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:02:24 kjcf05n00 zabbix-server[972856]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:02:24 kjcf05n00 zabbix-server[972856]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 109.11\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 94.96\\"}}"' Nov 3 05:02:24 kjcf05n00 log_interesting_event.py[972856]: Event '45775' acknowledged Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "0e70b3a6-99d3-11ef-94be-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: Dbus, handle_ingress_ras_signals, uuid: 0e70b3a6-99d3-11ef-94be-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "0e70b3a6-99d3-11ef-94be-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: main: Pending firmware leveling requests exist, rescanning disks Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "1a5cb750-99d3-11ef-94be-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: leaving test state: 1 next state: 2 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: lock req: no timeout Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: leaving test state: 2 next state: 4 Nov 3 05:02:28 kjcf05n02 diskmonitor[17586]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 05:02:35 kjcf05n00 mcfcli[3673891]: %3|1730631755.497|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:02:45 kjcf05n00 zabbix-server[972876]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:02:45 kjcf05n00 zabbix-server[972876]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 178.54\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 133.35\\"}}"' Nov 3 05:02:45 kjcf05n00 log_interesting_event.py[972876]: Event '45776' acknowledged Nov 3 05:02:53 kjcf05n00 mcfcli[3673891]: %3|1730631773.101|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 05:03:11 kjcf05n00 mcfcli[3673891]: %3|1730631791.104|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:03:23 kjcf05n00 mcfcli[3673891]: %3|1730631803.102|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:03:24 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 05:03:24 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 05:03:24 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 05:03:27 kjcf05n02 ras-resource-manager-agent[5906]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "0ebdfed6-99d3-11ef-94be-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 05:03:27 kjcf05n02 ras-resource-manager-agent[5906]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '0ebdfed6-99d3-11ef-94be-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 05:03:27 kjcf05n02 ras-resource-manager-agent[5906]: INFO Device qualification response has been acknowledged: 0ebdfed6-99d3-11ef-94be-00093d0695e3 (admin_action.py:151) Nov 3 05:03:27 kjcf05n02 ras-resource-manager-agent[5906]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "0ebdfed6-99d3-11ef-94be-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 05:03:27 kjcf05n02 ras-resource-manager-agent[5906]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '0ebdfed6-99d3-11ef-94be-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 05:03:27 kjcf05n02 ras-resource-manager-agent[5906]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "1a5cb750-99d3-11ef-94be-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 05:03:27 kjcf05n02 ras-resource-manager-agent[5906]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '1a5cb750-99d3-11ef-94be-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 05:03:27 kjcf05n02 ras-resource-manager-agent[5906]: INFO Device qualification response has been acknowledged: 1a5cb750-99d3-11ef-94be-00093d0695e3 (admin_action.py:151) Nov 3 05:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T05:03:27.253138114-06:00 level=info msg="Completed cleanup jobs" duration=26.421362ms Nov 3 05:03:28 kjcf05n02 diskmonitor[17586]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 05:03:40 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 05:03:40 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 05:03:40 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 05:03:40 kjcf05n02 dcs-collectord[5642]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 05:03:44 kjcf05n02 diskmonitor[17586]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "0ebdfed6-99d3-11ef-94be-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 05:03:44 kjcf05n02 diskmonitor[17586]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 05:03:44 kjcf05n02 diskmonitor[17586]: Dbus, handle_ingress_ras_signals, uuid: 0ebdfed6-99d3-11ef-94be-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 05:03:44 kjcf05n02 diskmonitor[17586]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 05:03:44 kjcf05n02 diskmonitor[17586]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "0ebdfed6-99d3-11ef-94be-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 05:03:44 kjcf05n02 diskmonitor[17586]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "0ebdfed6-99d3-11ef-94be-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 05:03:44 kjcf05n02 diskmonitor[17586]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 05:03:44 kjcf05n02 diskmonitor[17586]: Dbus, handle_ingress_ras_signals, uuid: 0ebdfed6-99d3-11ef-94be-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 05:03:44 kjcf05n02 diskmonitor[17586]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "0ebdfed6-99d3-11ef-94be-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 05:03:44 kjcf05n02 diskmonitor[17586]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "1a5cb750-99d3-11ef-94be-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 05:03:44 kjcf05n02 diskmonitor[17586]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 05:03:44 kjcf05n02 diskmonitor[17586]: Dbus, handle_ingress_ras_signals, uuid: 1a5cb750-99d3-11ef-94be-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 05:03:44 kjcf05n02 diskmonitor[17586]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "1a5cb750-99d3-11ef-94be-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 05:03:44 kjcf05n02 diskmonitor[17586]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 05:03:44 kjcf05n02 diskmonitor[17586]: lock acquired Nov 3 05:03:44 kjcf05n02 diskmonitor[17586]: leaving test state: 4 next state: 8 Nov 3 05:03:44 kjcf05n02 diskmonitor[17586]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 05:03:49 kjcf05n00 mcfcli[3673891]: %3|1730631829.301|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:03:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730631829}"] Nov 3 05:03:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730631829, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:03:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:03:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:03:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:03:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:03:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:03:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:03:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:03:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:03:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:03:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:03:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:03:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:03:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:03:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.057703ms Nov 3 05:03:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:03:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.057703ms Nov 3 05:03:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:03:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:03:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:03:53 kjcf05n00 mcfcli[3673891]: %3|1730631833.103|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 05:03:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Inactive', 'timestamp': 1730631833}"] Nov 3 05:03:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730631833, 'value': 'Inactive', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:03:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:03:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:03:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:03:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:03:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:03:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:03:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:03:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:03:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:03:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:03:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:03:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:03:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:03:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.289017ms Nov 3 05:03:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:03:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.289017ms Nov 3 05:03:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:03:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:04:02 kjcf05n02 diskmonitor[17586]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 05:04:02 kjcf05n02 diskmonitor[17586]: leaving test state: 8 next state: 20 Nov 3 05:04:02 kjcf05n02 diskmonitor[17586]: leaving test state: 20 next state: 40 Nov 3 05:04:02 kjcf05n02 diskmonitor[17586]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset b0b83f8000 Nov 3 05:04:02 kjcf05n02 diskmonitor[17586]: leaving test state: 40 next state: 80 Nov 3 05:04:23 kjcf05n00 mcfcli[3673891]: %3|1730631863.103|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:04:26 kjcf05n00 mcfcli[3673891]: %3|1730631866.776|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:04:49 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 05:04:53 kjcf05n00 mcfcli[3673891]: %3|1730631893.105|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 05:05:04 kjcf05n02 diskmonitor[17586]: leaving test state: 80 next state: 100 Nov 3 05:05:04 kjcf05n02 diskmonitor[17586]: lock release: time: Sun Nov 3 05:04:56 2024 Nov 3 05:05:04 kjcf05n02 diskmonitor[17586]: leaving test state: 100 next state: 1 Nov 3 05:05:04 kjcf05n00 mcfcli[3673891]: %3|1730631904.855|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:05:08 kjcf05n00 python3.9[974222]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 05:05:11 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 05:05:23 kjcf05n00 mcfcli[3673891]: %3|1730631923.105|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:05:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730631616', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 05:05:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730631616'} Nov 3 05:05:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:05:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730631616', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 05:05:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730631616'} Nov 3 05:05:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:05:44 kjcf05n00 mcfcli[3673891]: %3|1730631944.852|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:05:53 kjcf05n00 mcfcli[3673891]: %3|1730631953.105|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:06:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730631979}"] Nov 3 05:06:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730631979, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:06:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:06:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:06:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:06:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:06:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:06:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:06:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:06:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:06:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:06:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:06:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:06:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:06:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:06:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.289859ms Nov 3 05:06:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:06:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.289859ms Nov 3 05:06:19 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:06:19 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:06:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:06:23 kjcf05n00 mcfcli[3673891]: %3|1730631983.105|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:06:23 kjcf05n00 mcfcli[3673891]: %3|1730631983.375|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:06:53 kjcf05n00 mcfcli[3673891]: %3|1730632013.107|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 05:06:59 kjcf05n00 mcfcli[3673891]: %3|1730632019.844|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:07:06 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 3 05:07:06 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 3 05:07:06 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 3 05:07:08 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 3 05:07:08 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 3 05:07:08 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 3 05:07:08 kjcf05n06 chronyd[5469]: Selected source 172.16.2.1 Nov 3 05:07:23 kjcf05n00 mcfcli[3673891]: %3|1730632043.107|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 05:07:39 kjcf05n00 mcfcli[3673891]: %3|1730632059.622|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:07:53 kjcf05n00 mcfcli[3673891]: %3|1730632073.108|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:08:19 kjcf05n00 mcfcli[3673891]: %3|1730632099.619|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:08:23 kjcf05n00 mcfcli[3673891]: %3|1730632103.108|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:08:43 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 05:08:43 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 05:08:43 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 05:08:53 kjcf05n00 mcfcli[3673891]: %3|1730632133.108|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:08:57 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 05:08:57 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 05:08:57 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 05:08:59 kjcf05n00 mcfcli[3673891]: %3|1730632139.616|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:09:06 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 3 05:09:23 kjcf05n00 mcfcli[3673891]: %3|1730632163.108|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 05:09:34 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 3 05:09:34 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 3 05:09:37 kjcf05n00 mcfcli[3673891]: %3|1730632177.002|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:09:53 kjcf05n00 mcfcli[3673891]: %3|1730632193.109|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 05:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 05:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 05:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 05:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 05:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 05:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 05:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 05:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 05:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 05:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 05:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 05:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 05:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 05:10:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 05:10:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:10:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 05:10:02 kjcf05n00 python3.9[977061]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 05:10:14 kjcf05n00 mcfcli[3673891]: %3|1730632214.502|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:10:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730631616', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 05:10:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730631616'} Nov 3 05:10:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:10:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730631616', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 05:10:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730631616'} Nov 3 05:10:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:10:23 kjcf05n00 mcfcli[3673891]: %3|1730632223.110|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 05:10:53 kjcf05n00 mcfcli[3673891]: %3|1730632253.101|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:10:53 kjcf05n00 mcfcli[3673891]: %3|1730632253.610|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 05:11:23 kjcf05n00 mcfcli[3673891]: %3|1730632283.610|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:11:32 kjcf05n00 mcfcli[3673891]: %3|1730632292.942|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:11:38 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 3 05:11:53 kjcf05n00 mcfcli[3673891]: %3|1730632313.612|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 05:11:54 kjcf05n02 root[42112]: failback_xyraid Nov 3 05:11:56 kjcf05n02 root[42232]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 05:11:57 kjcf05n02 root[42383]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 05:12:00 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 3 05:12:03 kjcf05n03 dwd[5159]: Drive path is missing, purging: nvme8n1 Nov 3 05:12:03 kjcf05n03 dwd[5159]: Drive path is missing, purging: nvme17n1 Nov 3 05:12:03 kjcf05n03 dwd[5159]: Drive path is missing, purging: nvme3n1 Nov 3 05:12:03 kjcf05n03 dwd[5159]: Drive path is missing, purging: nvme9n1 Nov 3 05:12:03 kjcf05n03 dwd[5159]: Drive path is missing, purging: nvme23n1 Nov 3 05:12:03 kjcf05n03 dwd[5159]: Drive path is missing, purging: nvme4n1 Nov 3 05:12:03 kjcf05n03 dwd[5159]: Drive path is missing, purging: nvme2n1 Nov 3 05:12:03 kjcf05n03 dwd[5159]: Drive path is missing, purging: nvme18n1 Nov 3 05:12:03 kjcf05n03 dwd[5159]: Drive path is missing, purging: nvme19n1 Nov 3 05:12:03 kjcf05n03 dwd[5159]: Drive path is missing, purging: nvme25n1 Nov 3 05:12:03 kjcf05n03 dwd[5159]: Drive path is missing, purging: nvme24n1 Nov 3 05:12:05 kjcf05n02 dwd[5183]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 05:12:05 kjcf05n02 dwd[5183]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 05:12:05 kjcf05n02 dwd[5183]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 05:12:05 kjcf05n02 dwd[5183]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 05:12:05 kjcf05n02 dwd[5183]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 05:12:05 kjcf05n02 dwd[5183]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 05:12:05 kjcf05n02 dwd[5183]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 05:12:05 kjcf05n02 dwd[5183]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 05:12:05 kjcf05n02 dwd[5183]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 05:12:05 kjcf05n02 dwd[5183]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 05:12:05 kjcf05n02 dwd[5183]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 05:12:05 kjcf05n02 dwd[5183]: Starting NVME thread for nvme2n1 Nov 3 05:12:05 kjcf05n02 dwd[5183]: Starting NVME thread for nvme18n1 Nov 3 05:12:05 kjcf05n02 dwd[5183]: Starting NVME thread for nvme19n1 Nov 3 05:12:05 kjcf05n02 dwd[5183]: Starting NVME thread for nvme9n1 Nov 3 05:12:06 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 3 05:12:06 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 3 05:12:06 kjcf05n02 dwd[5183]: Starting NVME thread for nvme3n1 Nov 3 05:12:06 kjcf05n02 systemd-udevd[45091]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45095]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45091]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45095]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45091]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45095]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45091]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45095]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45091]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45095]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45091]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45095]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45091]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45121]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45095]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45123]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45091]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45125]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45128]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45121]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45095]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45091]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45128]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45121]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45091]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45121]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45121]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45121]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45128]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45091]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45123]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45121]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45091]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45121]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45121]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45121]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45121]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 dwd[5183]: Starting NVME thread for nvme24n1 Nov 3 05:12:06 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:12:06 kjcf05n02 nslcd[7234]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 05:12:07 kjcf05n02 dwd[5183]: Starting NVME thread for nvme4n1 Nov 3 05:12:07 kjcf05n02 dwd[5183]: Starting NVME thread for nvme23n1 Nov 3 05:12:07 kjcf05n02 dwd[5183]: Starting NVME thread for nvme17n1 Nov 3 05:12:07 kjcf05n02 dwd[5183]: Starting NVME thread for nvme25n1 Nov 3 05:12:07 kjcf05n02 dwd[5183]: Starting NVME thread for nvme8n1 Nov 3 05:12:10 kjcf05n02 diskmonitor[17586]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 05:12:10 kjcf05n03 diskmonitor[17358]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 05:12:10 kjcf05n03 diskmonitor[17358]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 05:12:10 kjcf05n02 dcs-bulk-data-sender[6188]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 3 05:12:12 kjcf05n00 mcfcli[3673891]: %3|1730632332.939|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:12:17 kjcf05n02 diskmonitor[17586]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 05:12:17 kjcf05n02 diskmonitor[17586]: Scan for ReadErrorMax change for md65 Nov 3 05:12:17 kjcf05n02 diskmonitor[17586]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 05:12:17 kjcf05n02 diskmonitor[17586]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 05:12:17 kjcf05n02 diskmonitor[17586]: read_saved_file: md65 no saved speed Nov 3 05:12:17 kjcf05n02 diskmonitor[17586]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 05:12:17 kjcf05n02 diskmonitor[17586]: Set sync_speed_min (10000) for md65 Nov 3 05:12:17 kjcf05n02 diskmonitor[17586]: Set sync_speed_max (200000) for md65 Nov 3 05:12:17 kjcf05n02 diskmonitor[17586]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 05:12:23 kjcf05n00 mcfcli[3673891]: %3|1730632343.991|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 05:12:47 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47616 (bash) Nov 3 05:12:47 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 05:12:47 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 05:12:51 kjcf05n00 mcfcli[3673891]: %3|1730632371.837|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:12:53 kjcf05n00 mcfcli[3673891]: %3|1730632373.992|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:13:01 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 05:13:01 kjcf05n02 systemd-tmpfiles[48127]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 05:13:01 kjcf05n02 systemd-tmpfiles[48127]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 05:13:01 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 05:13:01 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 05:13:05 kjcf05n03 nslcd[6912]: [8e1f29] ldap_result() failed: Can't contact LDAP server Nov 3 05:13:24 kjcf05n00 mcfcli[3673891]: %3|1730632404.113|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 05:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T05:13:27.248204812-06:00 level=info msg="Completed cleanup jobs" duration=21.771965ms Nov 3 05:13:29 kjcf05n00 mcfcli[3673891]: %3|1730632409.430|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:13:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730632429}"] Nov 3 05:13:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730632429, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:13:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.951014ms Nov 3 05:13:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.951014ms Nov 3 05:13:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:13:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:13:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:13:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730632429}"] Nov 3 05:13:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730632429, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:13:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.989877ms Nov 3 05:13:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.989877ms Nov 3 05:13:50 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:13:50 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:13:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:13:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730632429}"] Nov 3 05:13:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730632429, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:13:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.767761ms Nov 3 05:13:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.767761ms Nov 3 05:13:50 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:13:50 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:13:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:13:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730632429}"] Nov 3 05:13:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730632429, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:13:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.729279ms Nov 3 05:13:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.729279ms Nov 3 05:13:50 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:13:50 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:13:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:13:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730632429}"] Nov 3 05:13:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730632429, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:13:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.158111ms Nov 3 05:13:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.158111ms Nov 3 05:13:50 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:13:50 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:13:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:13:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730632429}"] Nov 3 05:13:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730632429, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:13:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.238232ms Nov 3 05:13:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.238232ms Nov 3 05:13:50 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:13:50 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:13:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:13:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730632429}"] Nov 3 05:13:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730632429, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:13:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.23744ms Nov 3 05:13:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.23744ms Nov 3 05:13:50 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:13:50 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:13:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:13:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730632429}"] Nov 3 05:13:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730632429, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:13:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.210149ms Nov 3 05:13:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.210149ms Nov 3 05:13:50 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:13:50 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:13:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:13:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730632429}"] Nov 3 05:13:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730632429, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:13:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.879891ms Nov 3 05:13:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.879891ms Nov 3 05:13:51 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:13:51 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:13:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:13:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730632429}"] Nov 3 05:13:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730632429, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:13:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.105994ms Nov 3 05:13:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.105994ms Nov 3 05:13:51 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:13:51 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:13:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:13:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730632429}"] Nov 3 05:13:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730632429, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:13:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:13:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:13:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:13:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:13:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:13:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:13:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.493009ms Nov 3 05:13:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:13:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.493009ms Nov 3 05:13:51 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:13:51 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:13:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:13:54 kjcf05n00 mcfcli[3673891]: %3|1730632434.114|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:14:00 kjcf05n00 zabbix-server[979555]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:14:00 kjcf05n00 zabbix-server[979555]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '45788' Nov 3 05:14:00 kjcf05n00 zabbix-server[979555]: Filesystem 'kjcf05' has been mounted Nov 3 05:14:01 kjcf05n00 zabbix-server[979555]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 05:14:01 kjcf05n00 zabbix-server[979555]: Running puppet on 'None' Nov 3 05:14:03 kjcf05n07 puppet-agent[2344931]: Using configured environment 'production' Nov 3 05:14:03 kjcf05n07 puppet-agent[2344931]: Retrieving pluginfacts Nov 3 05:14:03 kjcf05n07 puppet-agent[2344931]: Retrieving plugin Nov 3 05:14:03 kjcf05n03 puppet-agent[106305]: Using configured environment 'production' Nov 3 05:14:03 kjcf05n03 puppet-agent[106305]: Retrieving pluginfacts Nov 3 05:14:03 kjcf05n03 puppet-agent[106305]: Retrieving plugin Nov 3 05:14:03 kjcf05n04 puppet-agent[2349926]: Using configured environment 'production' Nov 3 05:14:03 kjcf05n04 puppet-agent[2349926]: Retrieving pluginfacts Nov 3 05:14:03 kjcf05n04 puppet-agent[2349926]: Retrieving plugin Nov 3 05:14:03 kjcf05n04 puppet-agent[2349926]: Loading facts Nov 3 05:14:03 kjcf05n05 puppet-agent[2489421]: Using configured environment 'production' Nov 3 05:14:03 kjcf05n05 puppet-agent[2489421]: Retrieving pluginfacts Nov 3 05:14:03 kjcf05n05 puppet-agent[2489421]: Retrieving plugin Nov 3 05:14:03 kjcf05n02 puppet-agent[49886]: Using configured environment 'production' Nov 3 05:14:03 kjcf05n02 puppet-agent[49886]: Retrieving pluginfacts Nov 3 05:14:03 kjcf05n02 puppet-agent[49886]: Retrieving plugin Nov 3 05:14:03 kjcf05n02 puppet-agent[49886]: Loading facts Nov 3 05:14:03 kjcf05n06 puppet-agent[2347571]: Using configured environment 'production' Nov 3 05:14:03 kjcf05n06 puppet-agent[2347571]: Retrieving pluginfacts Nov 3 05:14:03 kjcf05n06 puppet-agent[2347571]: Retrieving plugin Nov 3 05:14:03 kjcf05n07 puppet-agent[2344931]: Loading facts Nov 3 05:14:03 kjcf05n01 puppet-agent[2912621]: Using configured environment 'production' Nov 3 05:14:03 kjcf05n01 puppet-agent[2912621]: Retrieving pluginfacts Nov 3 05:14:03 kjcf05n01 puppet-agent[2912621]: Retrieving plugin Nov 3 05:14:03 kjcf05n01 puppet-agent[2912621]: Loading facts Nov 3 05:14:03 kjcf05n03 puppet-agent[106305]: Loading facts Nov 3 05:14:03 kjcf05n05 puppet-agent[2489421]: Loading facts Nov 3 05:14:03 kjcf05n06 puppet-agent[2347571]: Loading facts Nov 3 05:14:03 kjcf05n00 puppet-agent[979631]: Using configured environment 'production' Nov 3 05:14:03 kjcf05n00 puppet-agent[979631]: Retrieving pluginfacts Nov 3 05:14:03 kjcf05n00 puppet-agent[979631]: Retrieving plugin Nov 3 05:14:03 kjcf05n00 puppet-agent[979631]: Loading facts Nov 3 05:14:06 kjcf05n07 puppet-agent[2344931]: Caching catalog for kjcf05n07 Nov 3 05:14:06 kjcf05n07 puppet-agent[2344931]: Applying configuration version '1730632444' Nov 3 05:14:06 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 05:14:06 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 05:14:07 kjcf05n03 puppet-agent[106305]: Caching catalog for kjcf05n03 Nov 3 05:14:07 kjcf05n03 puppet-agent[106305]: Applying configuration version '1730632444' Nov 3 05:14:07 kjcf05n02 puppet-agent[49886]: Caching catalog for kjcf05n02 Nov 3 05:14:07 kjcf05n02 puppet-agent[49886]: Applying configuration version '1730632444' Nov 3 05:14:07 kjcf05n06 puppet-agent[2347571]: Caching catalog for kjcf05n06 Nov 3 05:14:07 kjcf05n06 puppet-agent[2347571]: Applying configuration version '1730632445' Nov 3 05:14:08 kjcf05n01 puppet-agent[2912621]: Caching catalog for kjcf05n01 Nov 3 05:14:08 kjcf05n01 puppet-agent[2912621]: Applying configuration version '1730632445' Nov 3 05:14:08 kjcf05n07 puppet-agent[2344931]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 05:14:08 kjcf05n07 puppet-agent[2344931]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 05:14:08 kjcf05n07 puppet-agent[2344931]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 05:14:08 kjcf05n00 puppet-agent[979631]: Caching catalog for kjcf05n00 Nov 3 05:14:08 kjcf05n00 puppet-agent[979631]: Applying configuration version '1730632446' Nov 3 05:14:08 kjcf05n00 mcfcli[3673891]: %3|1730632448.933|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:14:09 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2293699]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 05:14:09 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 05:14:09 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 05:14:09 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 05:14:09 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 05:14:09 kjcf05n07 puppet-agent[2344931]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: Press Ctrl+C to exit. Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: Plugin support version 1.0 Nov 3 05:14:09 kjcf05n07 zabbix_agent2[2345490]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 05:14:09 kjcf05n03 puppet-agent[106305]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 05:14:09 kjcf05n03 puppet-agent[106305]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 05:14:09 kjcf05n03 puppet-agent[106305]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 05:14:09 kjcf05n02 puppet-agent[49886]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 05:14:09 kjcf05n02 puppet-agent[49886]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 05:14:09 kjcf05n02 puppet-agent[49886]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 05:14:09 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 05:14:09 kjcf05n03 zabbix_agent2[52115]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 05:14:09 kjcf05n03 zabbix_agent2[3124]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:14:09 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 05:14:09 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 05:14:09 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 05:14:09 kjcf05n03 puppet-agent[106305]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: Press Ctrl+C to exit. Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: Plugin support version 1.0 Nov 3 05:14:09 kjcf05n03 zabbix_agent2[106777]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 05:14:09 kjcf05n06 puppet-agent[2347571]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 05:14:09 kjcf05n06 puppet-agent[2347571]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 05:14:09 kjcf05n06 puppet-agent[2347571]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 05:14:10 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 05:14:10 kjcf05n02 zabbix_agent2[5990]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 05:14:10 kjcf05n02 zabbix_agent2[3168]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:14:10 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 05:14:10 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 05:14:10 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 05:14:10 kjcf05n02 puppet-agent[49886]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: Press Ctrl+C to exit. Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: Plugin support version 1.0 Nov 3 05:14:10 kjcf05n02 zabbix_agent2[50262]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 05:14:10 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2296954]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 05:14:10 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 05:14:10 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 05:14:10 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 05:14:10 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 05:14:10 kjcf05n06 puppet-agent[2347571]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: Press Ctrl+C to exit. Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: Plugin support version 1.0 Nov 3 05:14:10 kjcf05n06 zabbix_agent2[2348004]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 05:14:11 kjcf05n07 puppet-agent[2344931]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 05:14:11 kjcf05n07 puppet-agent[2344931]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 05:14:11 kjcf05n07 puppet-agent[2344931]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 05:14:11 kjcf05n07 puppet-agent[2344931]: Applied catalog in 4.93 seconds Nov 3 05:14:11 kjcf05n01 puppet-agent[2912621]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 05:14:11 kjcf05n01 puppet-agent[2912621]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-04:54:00]/mode) mode changed '0755' to '0750' Nov 3 05:14:11 kjcf05n01 puppet-agent[2912621]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-04:54:00/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 05:14:11 kjcf05n01 puppet-agent[2912621]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-04:54:00/vmcore]/mode) mode changed '0600' to '0640' Nov 3 05:14:11 kjcf05n01 puppet-agent[2912621]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-04:54:00/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 05:14:11 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 05:14:11 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 05:14:11 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 05:14:12 kjcf05n01 puppet-agent[2912621]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 05:14:12 kjcf05n01 puppet-agent[2912621]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 05:14:12 kjcf05n01 puppet-agent[2912621]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 05:14:11 kjcf05n00 puppet-agent[979631]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 05:14:12 kjcf05n03 puppet-agent[106305]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 05:14:12 kjcf05n03 puppet-agent[106305]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 05:14:12 kjcf05n03 puppet-agent[106305]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 05:14:12 kjcf05n06 puppet-agent[2347571]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 05:14:12 kjcf05n06 puppet-agent[2347571]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 05:14:12 kjcf05n06 puppet-agent[2347571]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 05:14:12 kjcf05n06 puppet-agent[2347571]: Applied catalog in 4.78 seconds Nov 3 05:14:12 kjcf05n02 puppet-agent[49886]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 05:14:12 kjcf05n02 puppet-agent[49886]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 05:14:12 kjcf05n02 puppet-agent[49886]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 05:14:12 kjcf05n03 puppet-agent[106305]: Applied catalog in 5.17 seconds Nov 3 05:14:12 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2901134]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 05:14:12 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 05:14:12 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 05:14:12 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 05:14:12 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 05:14:12 kjcf05n01 puppet-agent[2912621]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: Press Ctrl+C to exit. Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: Plugin support version 1.0 Nov 3 05:14:12 kjcf05n01 zabbix_agent2[2912979]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 05:14:12 kjcf05n02 puppet-agent[49886]: Applied catalog in 5.07 seconds Nov 3 05:14:12 kjcf05n00 puppet-agent[979631]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 05:14:12 kjcf05n00 puppet-agent[979631]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 05:14:12 kjcf05n00 puppet-agent[979631]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 05:14:13 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 05:14:13 kjcf05n00 zabbix_agent2[962319]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 05:14:13 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 05:14:13 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 05:14:13 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 05:14:13 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 05:14:13 kjcf05n00 puppet-agent[979631]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: Press Ctrl+C to exit. Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: Plugin support version 1.0 Nov 3 05:14:13 kjcf05n00 zabbix_agent2[980186]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 05:14:13 kjcf05n00 zabbix-server[980213]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:14:14 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 05:14:14 kjcf05n01 puppet-agent[2912621]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_050120.log]/mode) mode changed '0644' to '0640' Nov 3 05:14:14 kjcf05n01 puppet-agent[2912621]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_051247.log]/mode) mode changed '0644' to '0640' Nov 3 05:14:14 kjcf05n01 puppet-agent[2912621]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_051247]/mode) mode changed '0755' to '0750' Nov 3 05:14:14 kjcf05n01 puppet-agent[2912621]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_051247/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 05:14:14 kjcf05n00 zabbix-server[980215]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:14:14 kjcf05n00 zabbix-server[980227]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:14:15 kjcf05n01 puppet-agent[2912621]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_050120.log]/mode) mode changed '0644' to '0640' Nov 3 05:14:15 kjcf05n01 puppet-agent[2912621]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_051247.log]/mode) mode changed '0644' to '0640' Nov 3 05:14:15 kjcf05n01 puppet-agent[2912621]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 05:14:15 kjcf05n01 puppet-agent[2912621]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 05:14:15 kjcf05n01 puppet-agent[2912621]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 05:14:15 kjcf05n00 zabbix-server[980229]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:14:15 kjcf05n00 puppet-agent[979631]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 05:14:18 kjcf05n01 puppet-agent[2912621]: Applied catalog in 9.93 seconds Nov 3 05:14:18 kjcf05n00 puppet-agent[979631]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 05:14:18 kjcf05n00 puppet-agent[979631]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 05:14:18 kjcf05n00 puppet-agent[979631]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 05:14:18 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 05:14:19 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 05:14:19 kjcf05n00 puppet-agent[979631]: Applied catalog in 10.29 seconds Nov 3 05:14:24 kjcf05n00 mcfcli[3673891]: %3|1730632464.115|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:14:31 kjcf05n05 puppet-agent[2489421]: Caching catalog for kjcf05n05 Nov 3 05:14:31 kjcf05n05 puppet-agent[2489421]: Applying configuration version '1730632467' Nov 3 05:14:33 kjcf05n05 puppet-agent[2489421]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 05:14:33 kjcf05n05 puppet-agent[2489421]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 05:14:33 kjcf05n05 puppet-agent[2489421]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 05:14:34 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2433172]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 05:14:34 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 05:14:34 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 05:14:34 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 05:14:34 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 05:14:34 kjcf05n05 puppet-agent[2489421]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: Press Ctrl+C to exit. Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: Plugin support version 1.0 Nov 3 05:14:34 kjcf05n05 zabbix_agent2[2491476]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 05:14:36 kjcf05n05 puppet-agent[2489421]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 05:14:36 kjcf05n05 puppet-agent[2489421]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 05:14:36 kjcf05n05 puppet-agent[2489421]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 05:14:36 kjcf05n05 puppet-agent[2489421]: Applied catalog in 5.05 seconds Nov 3 05:14:47 kjcf05n00 mcfcli[3673891]: %3|1730632487.031|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:14:54 kjcf05n00 mcfcli[3673891]: %3|1730632494.115|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 05:15:02 kjcf05n00 python3.9[980623]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 05:15:15 kjcf05n04 puppet-agent[2349926]: Caching catalog for kjcf05n04 Nov 3 05:15:15 kjcf05n04 puppet-agent[2349926]: Applying configuration version '1730632513' Nov 3 05:15:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730632515', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 05:15:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730632515'} Nov 3 05:15:15 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:15:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730632515', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 05:15:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730632515'} Nov 3 05:15:15 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:15:17 kjcf05n04 puppet-agent[2349926]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 05:15:17 kjcf05n04 puppet-agent[2349926]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 05:15:17 kjcf05n04 puppet-agent[2349926]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 05:15:18 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2293288]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 05:15:18 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 05:15:18 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 05:15:18 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 05:15:18 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 05:15:18 kjcf05n04 puppet-agent[2349926]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: Press Ctrl+C to exit. Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: Plugin support version 1.0 Nov 3 05:15:18 kjcf05n04 zabbix_agent2[2352329]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 05:15:20 kjcf05n04 puppet-agent[2349926]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 05:15:20 kjcf05n04 puppet-agent[2349926]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 05:15:20 kjcf05n04 puppet-agent[2349926]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 05:15:20 kjcf05n04 puppet-agent[2349926]: Applied catalog in 4.85 seconds Nov 3 05:15:20 kjcf05n00 zabbix-server[979555]: puppet completed status:(0): '' Nov 3 05:15:20 kjcf05n00 zabbix-server[979555]: Event '45788' acknowledged Nov 3 05:15:20 kjcf05n00 zabbix-server[979555]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 3 05:15:24 kjcf05n00 mcfcli[3673891]: %3|1730632524.115|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:15:27 kjcf05n00 mcfcli[3673891]: %3|1730632527.000|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:15:54 kjcf05n00 mcfcli[3673891]: %3|1730632554.115|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 05:16:03 kjcf05n00 mcfcli[3673891]: %3|1730632563.804|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:16:24 kjcf05n00 mcfcli[3673891]: %3|1730632584.116|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 05:16:40 kjcf05n00 mcfcli[3673891]: %3|1730632600.658|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:16:54 kjcf05n00 mcfcli[3673891]: %3|1730632614.117|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 05:17:11 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/21', errno='Permission denied (13)' Nov 3 05:17:19 kjcf05n00 mcfcli[3673891]: %3|1730632639.698|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:17:20 kjcf05n02 dwd[5183]: nvme2n1 passed periodic SMART status check Nov 3 05:17:20 kjcf05n02 dwd[5183]: nvme19n1 passed periodic SMART status check Nov 3 05:17:20 kjcf05n02 dwd[5183]: nvme18n1 passed periodic SMART status check Nov 3 05:17:21 kjcf05n02 dwd[5183]: nvme9n1 passed periodic SMART status check Nov 3 05:17:21 kjcf05n02 dwd[5183]: nvme3n1 passed periodic SMART status check Nov 3 05:17:21 kjcf05n02 dwd[5183]: nvme24n1 passed periodic SMART status check Nov 3 05:17:22 kjcf05n02 dwd[5183]: nvme4n1 passed periodic SMART status check Nov 3 05:17:22 kjcf05n02 dwd[5183]: nvme17n1 passed periodic SMART status check Nov 3 05:17:22 kjcf05n02 dwd[5183]: nvme23n1 passed periodic SMART status check Nov 3 05:17:22 kjcf05n02 dwd[5183]: nvme8n1 passed periodic SMART status check Nov 3 05:17:22 kjcf05n02 dwd[5183]: nvme25n1 passed periodic SMART status check Nov 3 05:17:24 kjcf05n00 mcfcli[3673891]: %3|1730632644.117|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 05:17:54 kjcf05n00 mcfcli[3673891]: %3|1730632674.118|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:17:55 kjcf05n00 mcfcli[3673891]: %3|1730632675.566|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:18:24 kjcf05n00 mcfcli[3673891]: %3|1730632704.118|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:18:34 kjcf05n00 mcfcli[3673891]: %3|1730632714.530|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:18:54 kjcf05n00 mcfcli[3673891]: %3|1730632734.119|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:19:14 kjcf05n00 mcfcli[3673891]: %3|1730632754.140|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:19:24 kjcf05n00 mcfcli[3673891]: %3|1730632764.119|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 05:19:53 kjcf05n00 mcfcli[3673891]: %3|1730632793.279|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:19:54 kjcf05n00 mcfcli[3673891]: %3|1730632794.119|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 05:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 05:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 05:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 05:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 05:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 05:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 05:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 05:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 05:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 05:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 05:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 05:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 05:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 05:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 05:20:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 05:20:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:20:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 05:20:03 kjcf05n00 python3.9[983578]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 05:20:24 kjcf05n00 mcfcli[3673891]: %3|1730632824.120|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:20:33 kjcf05n00 mcfcli[3673891]: %3|1730632833.276|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:20:54 kjcf05n00 mcfcli[3673891]: %3|1730632854.121|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:21:11 kjcf05n00 mcfcli[3673891]: %3|1730632871.070|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:21:24 kjcf05n00 mcfcli[3673891]: %3|1730632884.121|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 05:21:48 kjcf05n00 mcfcli[3673891]: %3|1730632908.782|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:21:54 kjcf05n00 mcfcli[3673891]: %3|1730632914.122|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 05:22:01 kjcf05n03 nslcd[6912]: [e87ccd] ldap_result() failed: Can't contact LDAP server Nov 3 05:22:24 kjcf05n00 mcfcli[3673891]: %3|1730632944.122|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 05:22:26 kjcf05n00 mcfcli[3673891]: %3|1730632946.786|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:22:54 kjcf05n00 mcfcli[3673891]: %3|1730632974.123|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:23:06 kjcf05n00 mcfcli[3673891]: %3|1730632986.783|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T11:23:15.867505Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 05:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T11:23:15.867569Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.088ms Nov 3 05:23:22 kjcf05n01 rsnapshot[2916681]: /usr/bin/rsnapshot -c /etc/rsnapshot.kjcf05n00.conf sync: completed successfully Nov 3 05:23:22 kjcf05n01 rsnapshot[2916683]: /usr/bin/rsnapshot -c /etc/rsnapshot.kjcf05n00.conf daily: completed successfully Nov 3 05:23:24 kjcf05n00 mcfcli[3673891]: %3|1730633004.124|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 05:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T05:23:27.253288906-06:00 level=info msg="Completed cleanup jobs" duration=26.149273ms Nov 3 05:23:30 kjcf05n01 rsnapshot[2916793]: /usr/bin/rsnapshot -c /etc/rsnapshot.kjcf05n01.conf sync: completed successfully Nov 3 05:23:30 kjcf05n01 rsnapshot[2916795]: /usr/bin/rsnapshot -c /etc/rsnapshot.kjcf05n01.conf daily: completed successfully Nov 3 05:23:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 05:23:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 05:23:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 05:23:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 05:23:39 kjcf05n01 rsnapshot[2916874]: /usr/bin/rsnapshot -c /etc/rsnapshot.mysql.conf sync: completed successfully Nov 3 05:23:39 kjcf05n01 rsnapshot[2916876]: /usr/bin/rsnapshot -c /etc/rsnapshot.mysql.conf daily: completed successfully Nov 3 05:23:43 kjcf05n00 mcfcli[3673891]: %3|1730633023.198|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:23:52 kjcf05n00 zabbix_server[15753]: Zabbix agent item "system.uptime" on host "kjcf05n03" failed: first network error, wait for 15 seconds Nov 3 05:23:54 kjcf05n00 mcfcli[3673891]: %3|1730633034.124|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:23:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 05:23:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 05:23:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 05:23:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 05:23:59 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 05:23:59 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 05:23:59 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 05:23:59 kjcf05n02 fstonithd.py[15191]: My partner 172.16.2.6 is kdumping. Forcing HA into GATHER state. Nov 3 05:23:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 05:23:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 05:23:59 kjcf05n02 root[67250]: is_viking_off starts Nov 3 05:23:59 kjcf05n02 root[67249]: is_enc_ipmi_off starts Nov 3 05:23:59 kjcf05n02 root[67266]: is_lan_ipmi_off leaves Nov 3 05:24:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 05:24:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 05:24:00 kjcf05n02 root[67268]: is_lan_ipmi_sec_off leaves Nov 3 05:24:00 kjcf05n02 root[67272]: I am in slot 0; partner is in slot 1 Nov 3 05:24:00 kjcf05n02 root[67294]: I am not master; I will get master Nov 3 05:24:04 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='30', error='Connection reset by peer (104)' Nov 3 05:24:04 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='30', client='AF_INET(172.16.2.6:36693)', local='AF_INET(0.0.0.0:601)' Nov 3 05:24:05 kjcf05n02 root[67405]: I am now master Nov 3 05:24:07 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vfs.fs.size[/var/lib/reboot_cnt,total]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 05:24:09 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 3 05:24:09 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 9 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007391 sec, idle for 1 hour(s)] Nov 3 05:24:09 kjcf05n00 zabbix_server[15735]: Zabbix agent item "vfs.fs.inode[/mnt/persistent_ha_data,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 05:24:11 kjcf05n02 root[67586]: is_viking_off leaves Nov 3 05:24:11 kjcf05n02 root[67589]: kjcf05n03 not already off look at kdump Nov 3 05:24:11 kjcf05n02 root[67590]: is_kdump_off starts Nov 3 05:24:11 kjcf05n02 fence_kdump[67591]: waiting for message from '172.16.2.6' Nov 3 05:24:10 kjcf05n00 zabbix_server[15727]: Zabbix agent item "vfs.fs.inode[/var/lib/pacemaker,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 05:24:11 kjcf05n02 fence_kdump[67591]: received valid message from '172.16.2.6' Nov 3 05:24:11 kjcf05n02 root[67606]: is_kdump_off detected kdump on kjcf05n03 Nov 3 05:24:11 kjcf05n02 root[67607]: kjcf05n03 is kdumping Nov 3 05:24:11 kjcf05n02 root[67696]: is_viking_off starts Nov 3 05:24:11 kjcf05n02 root[67695]: is_enc_ipmi_off starts Nov 3 05:24:12 kjcf05n02 root[67713]: is_lan_ipmi_off leaves Nov 3 05:24:12 kjcf05n02 root[67715]: is_lan_ipmi_sec_off leaves Nov 3 05:24:11 kjcf05n00 zabbix_server[15757]: Zabbix agent item "vfs.fs.inode[/var/lib/mdraidscripts,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 05:24:12 kjcf05n02 root[67734]: I am in slot 0; partner is in slot 1 Nov 3 05:24:12 kjcf05n02 root[67737]: I am master Nov 3 05:24:15 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 05:24:15 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 05:24:19 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib0 Nov 3 05:24:19 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib0 Nov 3 05:24:22 kjcf05n00 mcfcli[3673891]: %3|1730633062.282|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:24:23 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib1 Nov 3 05:24:23 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib1 Nov 3 05:24:24 kjcf05n00 mcfcli[3673891]: %3|1730633064.124|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:24:25 kjcf05n02 root[68108]: is_viking_off leaves Nov 3 05:24:25 kjcf05n02 root[68111]: kjcf05n03 not already off look at kdump Nov 3 05:24:25 kjcf05n02 root[68112]: is_kdump_off starts Nov 3 05:24:25 kjcf05n02 fence_kdump[68113]: waiting for message from '172.16.2.6' Nov 3 05:24:25 kjcf05n02 fence_kdump[68113]: received valid message from '172.16.2.6' Nov 3 05:24:25 kjcf05n02 root[68114]: is_kdump_off detected kdump on kjcf05n03 Nov 3 05:24:25 kjcf05n02 root[68115]: kjcf05n03 is kdumping Nov 3 05:24:26 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.cpu.util[,system]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 05:24:30 kjcf05n02 dwd[5183]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 05:24:30 kjcf05n02 dwd[5183]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 05:24:30 kjcf05n02 dwd[5183]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 05:24:30 kjcf05n02 dwd[5183]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 05:24:30 kjcf05n02 dwd[5183]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 05:24:30 kjcf05n02 dwd[5183]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 05:24:30 kjcf05n02 dwd[5183]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 05:24:30 kjcf05n02 dwd[5183]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 05:24:30 kjcf05n02 dwd[5183]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 05:24:30 kjcf05n02 dwd[5183]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 05:24:30 kjcf05n02 dwd[5183]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 05:24:30 kjcf05n02 dwd[5183]: Starting NVME thread for nvme16n1 Nov 3 05:24:30 kjcf05n02 systemd-udevd[70451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70455]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70454]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70450]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70455]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70454]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70450]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70455]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70454]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70450]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70455]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70454]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70450]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70455]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70454]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70450]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70455]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70454]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70450]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70455]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70454]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70450]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70455]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70454]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70450]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70488]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70490]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70492]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70494]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70487]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70492]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70494]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70488]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70487]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70492]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70490]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70487]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70487]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70490]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70492]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70487]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70487]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70490]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70490]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70487]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70490]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70487]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70487]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70490]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70487]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70490]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70487]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70490]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70487]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70490]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70490]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 systemd-udevd[70490]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:24:30 kjcf05n02 dwd[5183]: Starting NVME thread for nvme22n1 Nov 3 05:24:30 kjcf05n02 dwd[5183]: Starting NVME thread for nvme15n1 Nov 3 05:24:30 kjcf05n02 dwd[5183]: Starting NVME thread for nvme6n1 Nov 3 05:24:30 kjcf05n02 dwd[5183]: Starting NVME thread for nvme11n1 Nov 3 05:24:31 kjcf05n02 dwd[5183]: Starting NVME thread for nvme7n1 Nov 3 05:24:31 kjcf05n02 dwd[5183]: Starting NVME thread for nvme10n1 Nov 3 05:24:31 kjcf05n02 dwd[5183]: Starting NVME thread for nvme20n1 Nov 3 05:24:31 kjcf05n02 dwd[5183]: Starting NVME thread for nvme21n1 Nov 3 05:24:31 kjcf05n02 dwd[5183]: Starting NVME thread for nvme5n1 Nov 3 05:24:31 kjcf05n02 dwd[5183]: Starting NVME thread for nvme12n1 Nov 3 05:24:32 kjcf05n02 diskmonitor[17586]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 05:24:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 05:24:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 05:24:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 05:24:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 05:24:41 kjcf05n02 diskmonitor[17586]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 05:24:41 kjcf05n02 diskmonitor[17586]: Scan for ReadErrorMax change for md66 Nov 3 05:24:41 kjcf05n02 diskmonitor[17586]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 05:24:41 kjcf05n02 diskmonitor[17586]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 05:24:41 kjcf05n02 diskmonitor[17586]: read_saved_file: md66 no saved speed Nov 3 05:24:41 kjcf05n02 diskmonitor[17586]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 05:24:41 kjcf05n02 diskmonitor[17586]: Set sync_speed_min (10000) for md66 Nov 3 05:24:41 kjcf05n02 diskmonitor[17586]: Set sync_speed_max (200000) for md66 Nov 3 05:24:41 kjcf05n02 diskmonitor[17586]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 05:24:41 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n03": interface unavailable Nov 3 05:24:54 kjcf05n00 mcfcli[3673891]: %3|1730633094.124|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:24:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 05:24:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 05:24:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 05:24:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 05:25:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 05:25:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 05:25:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 05:25:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 05:25:01 kjcf05n00 python3.9[986820]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 05:25:01 kjcf05n00 mcfcli[3673891]: %3|1730633101.357|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:25:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730633114', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 05:25:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730633114'} Nov 3 05:25:15 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:25:19 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib0 Nov 3 05:25:19 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib0 Nov 3 05:25:23 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib1 Nov 3 05:25:23 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib1 Nov 3 05:25:24 kjcf05n00 mcfcli[3673891]: %3|1730633124.125|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:25:30 kjcf05n02 nslcd[7234]: ldap_result() failed: Can't contact LDAP server Nov 3 05:25:30 kjcf05n02 nslcd[7234]: (re)loading /etc/nsswitch.conf Nov 3 05:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 05:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 05:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 05:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 05:25:39 kjcf05n00 mcfcli[3673891]: %3|1730633139.504|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:25:54 kjcf05n00 mcfcli[3673891]: %3|1730633154.126|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 05:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 05:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 05:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 05:25:59 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 05:25:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 05:26:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 05:26:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 05:26:14 kjcf05n00 mcfcli[3673891]: %3|1730633174.646|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:26:19 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib0 Nov 3 05:26:19 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib0 Nov 3 05:26:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730633180}"] Nov 3 05:26:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730633180, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:26:20 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:20-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:20 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:20-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:20 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:20-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:20 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:20-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:20 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:20-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:20 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:20-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:20 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:20-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.240757ms Nov 3 05:26:20 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:20-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.240757ms Nov 3 05:26:20 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:26:20 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:26:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:26:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730633180}"] Nov 3 05:26:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730633180, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:26:20 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:20-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:20 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:20-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:20 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:20-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:20 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:20-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:20 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:20-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:20 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:20-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:20 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:20-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.088442ms Nov 3 05:26:20 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:20-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.088442ms Nov 3 05:26:20 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:26:20 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:26:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:26:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730633180}"] Nov 3 05:26:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730633180, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:26:20 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:20-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:20 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:20-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:20 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:20-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:20 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:20-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:20 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:20-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:20 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:20-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:20 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:20-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.599075ms Nov 3 05:26:20 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:20-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.599075ms Nov 3 05:26:20 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:26:20 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:26:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:26:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730633180}"] Nov 3 05:26:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730633180, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:26:20 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:20-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:20 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:20-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:20 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:20-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:20 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:20-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:20 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:20-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:20 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:20-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:20 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:20-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.86347ms Nov 3 05:26:20 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:20-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.86347ms Nov 3 05:26:20 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:26:20 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:26:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:26:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730633180}"] Nov 3 05:26:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730633180, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:26:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.204549ms Nov 3 05:26:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.204549ms Nov 3 05:26:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:26:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:26:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:26:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730633180}"] Nov 3 05:26:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730633180, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:26:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.735513ms Nov 3 05:26:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.735513ms Nov 3 05:26:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:26:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:26:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:26:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730633180}"] Nov 3 05:26:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730633180, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:26:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.852108ms Nov 3 05:26:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.852108ms Nov 3 05:26:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:26:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:26:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:26:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730633180}"] Nov 3 05:26:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730633180, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:26:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.895169ms Nov 3 05:26:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.895169ms Nov 3 05:26:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:26:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:26:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:26:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730633180}"] Nov 3 05:26:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730633180, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:26:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.869982ms Nov 3 05:26:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.869982ms Nov 3 05:26:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:26:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:26:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:26:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730633180}"] Nov 3 05:26:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730633180, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:26:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.701657ms Nov 3 05:26:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.701657ms Nov 3 05:26:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:26:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:26:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:26:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730633180}"] Nov 3 05:26:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730633180, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:26:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:26:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:26:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:26:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:26:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:26:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:26:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.892775ms Nov 3 05:26:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:26:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.892775ms Nov 3 05:26:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:26:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:26:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:26:23 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib1 Nov 3 05:26:23 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib1 Nov 3 05:26:24 kjcf05n00 mcfcli[3673891]: %3|1730633184.126|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 05:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 05:26:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 05:26:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 05:26:54 kjcf05n00 mcfcli[3673891]: %3|1730633214.127|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:26:54 kjcf05n00 mcfcli[3673891]: %3|1730633214.643|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 05:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 05:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 05:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 05:27:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 05:27:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 05:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 05:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 05:27:19 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib0 Nov 3 05:27:19 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib0 Nov 3 05:27:23 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib1 Nov 3 05:27:23 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib1 Nov 3 05:27:24 kjcf05n00 mcfcli[3673891]: %3|1730633244.127|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:27:32 kjcf05n00 zabbix-server[988600]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:27:32 kjcf05n00 zabbix-server[988600]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n03:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 05:27:32 kjcf05n00 mcfcli[3673891]: %3|1730633252.805|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:27:32 kjcf05n00 log_interesting_event.py[988600]: Event '45790' acknowledged Nov 3 05:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 05:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 05:27:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 05:27:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 05:27:45 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:9a:1a Nov 3 05:27:45 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 05:27:49 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 05:27:49 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a kjcf05n03 Nov 3 05:27:49 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.6 Nov 3 05:27:49 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 05:27:49 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 05:27:49 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.6 Nov 3 05:27:49 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/pxelinux.cfg to 172.16.2.6 Nov 3 05:27:51 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/vmlinuz_diskless to 172.16.2.6 Nov 3 05:27:54 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/initramfs-diskless.img to 172.16.2.6 Nov 3 05:27:54 kjcf05n00 mcfcli[3673891]: %3|1730633274.127|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 05:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 05:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 05:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 05:28:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 05:28:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 05:28:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 05:28:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 05:28:12 kjcf05n00 mcfcli[3673891]: %3|1730633292.160|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:28:19 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib0 Nov 3 05:28:19 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib0 Nov 3 05:28:23 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib1 Nov 3 05:28:23 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib1 Nov 3 05:28:24 kjcf05n00 mcfcli[3673891]: %3|1730633304.128|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 05:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 05:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 05:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 05:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 05:28:41 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:42448). Nov 3 05:28:41 kjcf05n01 rsyncd[2918968]: connect from kjcf05n03 (172.16.2.6) Nov 3 05:28:41 kjcf05n01 rsyncd[2918968]: rsync on puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 05:28:41 kjcf05n01 rsyncd[2918968]: building file list Nov 3 05:28:41 kjcf05n01 rsyncd[2918968]: sent 11446 bytes received 136 bytes total size 10901 Nov 3 05:28:41 kjcf05n01 systemd[1]: rsyncd@599-172.16.2.2:873-172.16.2.6:42448.service: Succeeded. Nov 3 05:28:50 kjcf05n00 mcfcli[3673891]: %3|1730633330.257|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:28:54 kjcf05n00 mcfcli[3673891]: %3|1730633334.128|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 05:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 05:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 05:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 05:28:59 kjcf05n02 fstonithd.py[15191]: Listening for kdump packets from partner Nov 3 05:29:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 05:29:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 05:29:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 05:29:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 05:29:19 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib0 Nov 3 05:29:19 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib0 Nov 3 05:29:23 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib1 Nov 3 05:29:23 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib1 Nov 3 05:29:24 kjcf05n00 mcfcli[3673891]: %3|1730633364.130|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 05:29:24 kjcf05n00 mcfcli[3673891]: %3|1730633364.881|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:29:25 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 05:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 05:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 05:29:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 05:29:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 05:29:45 kjcf05n02 dwd[5183]: nvme22n1 passed periodic SMART status check Nov 3 05:29:45 kjcf05n02 dwd[5183]: nvme6n1 passed periodic SMART status check Nov 3 05:29:45 kjcf05n02 dwd[5183]: nvme15n1 passed periodic SMART status check Nov 3 05:29:45 kjcf05n02 dwd[5183]: nvme16n1 passed periodic SMART status check Nov 3 05:29:46 kjcf05n02 dwd[5183]: nvme5n1 passed periodic SMART status check Nov 3 05:29:46 kjcf05n02 dwd[5183]: nvme12n1 passed periodic SMART status check Nov 3 05:29:46 kjcf05n02 dwd[5183]: nvme10n1 passed periodic SMART status check Nov 3 05:29:46 kjcf05n02 dwd[5183]: nvme20n1 passed periodic SMART status check Nov 3 05:29:46 kjcf05n02 dwd[5183]: nvme7n1 passed periodic SMART status check Nov 3 05:29:46 kjcf05n02 dwd[5183]: nvme21n1 passed periodic SMART status check Nov 3 05:29:46 kjcf05n02 dwd[5183]: nvme11n1 passed periodic SMART status check Nov 3 05:29:54 kjcf05n00 mcfcli[3673891]: %3|1730633394.130|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 05:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 05:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 05:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 05:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 05:30:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 05:30:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 05:30:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 05:30:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 05:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 05:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 05:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 05:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 05:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 05:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 05:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 05:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 05:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 05:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 05:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 05:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 05:30:02 kjcf05n00 mcfcli[3673891]: %3|1730633402.044|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:30:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 05:30:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:30:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 05:30:03 kjcf05n00 python3.9[989856]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 05:30:09 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='136', client='AF_INET(172.16.2.6:39665)', local='AF_INET(0.0.0.0:601)' Nov 3 05:30:09 kjcf05n03 syslog-ng[3161]: Configuration reload request received, reloading configuration; Nov 3 05:30:09 kjcf05n03 syslog-ng[3161]: Configuration reload finished; Nov 3 05:30:09 kjcf05n03 syslog-ng[3161]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 05:30:09 kjcf05n03 dracut: dracut-049-135.git20210121.el8 Nov 3 05:30:09 kjcf05n03 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 05:30:09 kjcf05n03 dracut: Loading and integrity checking all crypto modules Nov 3 05:30:09 kjcf05n03 dracut: Self testing crypto algorithms Nov 3 05:30:09 kjcf05n03 dracut: rd.md=0: removing MD RAID activation Nov 3 05:30:09 kjcf05n03 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 05:30:09 kjcf05n03 Copying live image to RAM... Nov 3 05:30:09 kjcf05n03 (this may take a minute) Nov 3 05:30:09 kjcf05n03 Done copying live image to RAM. Nov 3 05:30:09 kjcf05n03 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 05:30:09 kjcf05n03 dracut: Checking integrity of kernel Nov 3 05:30:09 kjcf05n03 dracut: All initrd crypto checks done Nov 3 05:30:09 kjcf05n03 dracut: Switching root Nov 3 05:30:09 kjcf05n03 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 05:30:09 kjcf05n03 systemd: Detected architecture x86-64. Nov 3 05:30:09 kjcf05n03 systemd: Set hostname to . Nov 3 05:30:09 kjcf05n03 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 05:30:09 kjcf05n03 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 05:30:09 kjcf05n03 systemd: Reached target Swap. Nov 3 05:30:09 kjcf05n03 systemd: Reached target ZFS pool import target. Nov 3 05:30:09 kjcf05n03 systemd: Reached target ZFS startup target. Nov 3 05:30:09 kjcf05n03 systemd: Created slice User and Session Slice. Nov 3 05:30:09 kjcf05n03 systemd: Created slice system-sshd\x2dkeygen.slice. Nov 3 05:30:09 kjcf05n03 systemd-journald[1513]: Journal started Nov 3 05:30:09 kjcf05n03 systemd-journald[1513]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 05:30:09 kjcf05n03 systemd-modules-load[1511]: Inserted module 'fuse' Nov 3 05:30:09 kjcf05n03 systemd[1]: Mounted Kernel Configuration File System. Nov 3 05:30:09 kjcf05n03 systemd[1]: Mounted FUSE Control File System. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 05:30:09 kjcf05n03 systemd-sysctl[1534]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 05:30:09 kjcf05n03 systemd-sysctl[1534]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Apply Kernel Variables. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Load/Save Random Seed. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Create System Users. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 05:30:09 kjcf05n03 systemd-journald[1513]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started udev Coldplug all Devices. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 05:30:09 kjcf05n03 systemd-tmpfiles[1542]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 05:30:09 kjcf05n03 systemd-tmpfiles[1542]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Rebuild Hardware Database. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting udev Kernel Device Manager... Nov 3 05:30:09 kjcf05n03 systemd-udevd[1550]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started udev Kernel Device Manager. Nov 3 05:30:09 kjcf05n03 systemd[1]: Found device /dev/ttyS0. Nov 3 05:30:09 kjcf05n03 systemd-udevd[1600]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:30:09 kjcf05n03 systemd-udevd[1607]: Using default interface naming scheme 'rhel-8.0'. Nov 3 05:30:09 kjcf05n03 systemd-udevd[1607]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:30:09 kjcf05n03 systemd-udevd[1608]: Using default interface naming scheme 'rhel-8.0'. Nov 3 05:30:09 kjcf05n03 systemd-udevd[1608]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:30:09 kjcf05n03 systemd-udevd[1614]: Using default interface naming scheme 'rhel-8.0'. Nov 3 05:30:09 kjcf05n03 systemd-udevd[1614]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 05:30:09 kjcf05n03 systemd[1]: Reached target Local File Systems (Pre). Nov 3 05:30:09 kjcf05n03 systemd[1]: Reached target Local File Systems. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 05:30:09 kjcf05n03 systemd-tmpfiles[1757]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 05:30:09 kjcf05n03 systemd-tmpfiles[1757]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 05:30:09 kjcf05n03 systemd-tmpfiles[1757]: "/var/tmp" already exists and is not a directory. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Rebuild Journal Catalog. Nov 3 05:30:09 kjcf05n03 root[1780]: openibd: running in auto mode Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Create Volatile Files and Directories. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 05:30:09 kjcf05n03 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting RPC Bind... Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 05:30:09 kjcf05n03 systemd[1]: Started RDMA Node Description Daemon. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 05:30:09 kjcf05n03 systemd-modules-load[1828]: Inserted module 'ib_iser' Nov 3 05:30:09 kjcf05n03 systemd-modules-load[1828]: Inserted module 'ib_isert' Nov 3 05:30:09 kjcf05n03 systemd-modules-load[1828]: Inserted module 'ib_srpt' Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 05:30:09 kjcf05n03 systemd-udevd[1596]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:30:09 kjcf05n03 systemd-udevd[1600]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started RPC Bind. Nov 3 05:30:09 kjcf05n03 systemd-modules-load[1823]: Inserted module 'ib_ipoib' Nov 3 05:30:09 kjcf05n03 systemd-udevd[1596]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 05:30:09 kjcf05n03 systemd-udevd[1600]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 05:30:09 kjcf05n03 systemd-modules-load[1828]: Inserted module 'rdma_ucm' Nov 3 05:30:09 kjcf05n03 systemd-modules-load[1828]: Module 'svcrdma' is blacklisted Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 05:30:09 kjcf05n03 systemd-modules-load[1823]: Inserted module 'ib_umad' Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 05:30:09 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 05:30:09 kjcf05n03 systemd[3161]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:09 kjcf05n03 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 05:30:09 kjcf05n03 systemd[1]: Reached target Network (Pre). Nov 3 05:30:09 kjcf05n03 systemd[1]: Reached target RDMA Hardware. Nov 3 05:30:09 kjcf05n03 openibd[1766]: Loading HCA driver and Access Layer:[ OK ] Nov 3 05:30:09 kjcf05n03 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Update is Completed... Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Update is Completed. Nov 3 05:30:09 kjcf05n03 setup-icl[1742]: Setting LAN IP Address to 203.0.113.4 Nov 3 05:30:09 kjcf05n03 setup-icl[1742]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 05:30:09 kjcf05n03 setup-icl[1742]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 05:30:09 kjcf05n03 setup-icl[1742]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 05:30:09 kjcf05n03 systemd-udevd[1596]: Using default interface naming scheme 'rhel-8.0'. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 05:30:09 kjcf05n03 systemd[1]: Reached target System Initialization. Nov 3 05:30:09 kjcf05n03 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 05:30:09 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 05:30:09 kjcf05n03 systemd[1]: Listening on lldpad.socket. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 05:30:09 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 05:30:09 kjcf05n03 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 05:30:09 kjcf05n03 systemd[1]: Reached target Sockets. Nov 3 05:30:09 kjcf05n03 systemd[1]: Reached target Basic System. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started irqbalance daemon. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 05:30:09 kjcf05n03 network[2107]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 05:30:09 kjcf05n03 beSetMlxConfig[2112]: ConnectX-3 multiport not detected Nov 3 05:30:09 kjcf05n03 mcelog[2126]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 05:30:09 kjcf05n03 mcelog[2126]: CPU is unsupported Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 05:30:09 kjcf05n03 systemd[1]: Started D-Bus System Message Bus. Nov 3 05:30:09 kjcf05n03 network[2128]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 05:30:09 kjcf05n03 network[2107]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[2141]: Setting up Mellanox network interface: ib1 Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 0 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 1 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 2 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 3 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 4 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 5 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 6 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 7 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 8 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 9 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 10 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 11 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 12 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 13 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 14 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 15 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 16 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 17 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 18 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 19 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 20 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 21 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 22 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 23 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 24 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 25 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 26 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 27 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 28 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 29 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 30 Nov 3 05:30:09 kjcf05n03 cpupower[2165]: Setting cpu: 31 Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 05:30:09 kjcf05n03 dwd[2150]: dwd: vMay 29 2024 : 15:38:26 Nov 3 05:30:09 kjcf05n03 dwd[2150]: /usr/sbin/dwd -d --standalone=0 Nov 3 05:30:09 kjcf05n03 dwd[2150]: dwd: option Lethal: 0 Nov 3 05:30:09 kjcf05n03 dwd[2150]: dwd: option Interval: 60 Nov 3 05:30:09 kjcf05n03 dwd[2150]: dwd: option abrtlimit: 10 Nov 3 05:30:09 kjcf05n03 dwd[2150]: dwd: option DZPeriod: 604800 Nov 3 05:30:09 kjcf05n03 dwd[2150]: dwd: option SmartPeriod: 43200 Nov 3 05:30:09 kjcf05n03 dwd[2150]: dwd: option SDDEnabled: 1 Nov 3 05:30:09 kjcf05n03 dwd[2150]: dwd: option SDDAwaitScale: 3 Nov 3 05:30:09 kjcf05n03 dwd[2150]: dwd: option SDDAwaitMin: 100 Nov 3 05:30:09 kjcf05n03 dwd[2150]: dwd: option Verbosity: 1 Nov 3 05:30:09 kjcf05n03 dwd[2150]: dwd: option StandAlone: 0 Nov 3 05:30:09 kjcf05n03 dwd[2150]: option Lethal: 0 Nov 3 05:30:09 kjcf05n03 dwd[2150]: option Interval: 60 Nov 3 05:30:09 kjcf05n03 dwd[2150]: option abrtlimit: 10 Nov 3 05:30:09 kjcf05n03 dwd[2150]: option DZPeriod: 604800 Nov 3 05:30:09 kjcf05n03 dwd[2150]: option SmartPeriod: 43200 Nov 3 05:30:09 kjcf05n03 dwd[2150]: option SDDEnabled: 1 Nov 3 05:30:09 kjcf05n03 dwd[2150]: option SDDAwaitScale: 3 Nov 3 05:30:09 kjcf05n03 dwd[2150]: option SDDAwaitMin: 100 Nov 3 05:30:09 kjcf05n03 dwd[2150]: option Verbosity: 1 Nov 3 05:30:09 kjcf05n03 dwd[2150]: option StandAlone: 0 Nov 3 05:30:09 kjcf05n03 network[2152]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:30:09 kjcf05n03 network[2107]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Resets System Activity Logs... Nov 3 05:30:09 kjcf05n03 chronyd[2214]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Name Service Cache Daemon... Nov 3 05:30:09 kjcf05n03 beSetMlxConfig[2112]: Starting MST (Mellanox Software Tools) driver set Nov 3 05:30:09 kjcf05n03 nscd[2225]: 2225 monitoring file `/etc/hosts` (1) Nov 3 05:30:09 kjcf05n03 nscd[2225]: 2225 monitoring directory `/etc` (2) Nov 3 05:30:09 kjcf05n03 nscd[2225]: 2225 monitoring file `/etc/resolv.conf` (3) Nov 3 05:30:09 kjcf05n03 nscd[2225]: 2225 monitoring directory `/etc` (2) Nov 3 05:30:09 kjcf05n03 network[2188]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[2207]: Setting up Mellanox network interface: ib0 Nov 3 05:30:09 kjcf05n03 dbus-daemon[2151]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[2245]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 05:30:09 kjcf05n03 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 05:30:09 kjcf05n03 beSetMlxConfig[2112]: Loading MST PCI module - Success Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 05:30:09 kjcf05n03 chronyd[2214]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 05:30:09 kjcf05n03 chronyd[2214]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 05:30:09 kjcf05n03 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 05:30:09 kjcf05n03 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 05:30:09 kjcf05n03 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 05:30:09 kjcf05n03 mdraid-phy[2275]: no Cutlass to worry about Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[2291]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 05:30:09 kjcf05n03 beSetMlxConfig[2112]: Loading MST PCI configuration module - Success Nov 3 05:30:09 kjcf05n03 beSetMlxConfig[2112]: Create devices Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[2296]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Resets System Activity Logs. Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 0 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 1 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 2 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 3 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 4 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 5 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 6 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 7 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 8 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 9 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 10 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 11 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 12 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 13 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 14 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 15 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 16 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 17 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 18 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 19 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 20 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 21 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 22 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 23 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 24 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 25 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 26 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 27 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 28 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 29 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 30 Nov 3 05:30:09 kjcf05n03 cpupower[2303]: Idlestate 2 disabled on CPU 31 Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Name Service Cache Daemon. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Manage Cutlass PHYs. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[2302]: No configuration found for ib1 Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[2313]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[2339]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[2340]: No configuration found for ib0 Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[2360]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 05:30:09 kjcf05n03 mlnx_conf_mgr[2386]: INFO: No configurations found for mlx5_1, skipping. Nov 3 05:30:09 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 05:30:09 kjcf05n03 sssd[sssd][2237]: Starting up Nov 3 05:30:09 kjcf05n03 mlnx_conf_mgr[2421]: INFO: No configurations found for mlx5_0, skipping. Nov 3 05:30:09 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 05:30:09 kjcf05n03 sssd[be[implicit_files]][2468]: Starting up Nov 3 05:30:09 kjcf05n03 sssd[nss][2553]: Starting up Nov 3 05:30:09 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 05:30:09 kjcf05n03 systemd[1]: Reached target User and Group Name Lookups. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Login Service... Nov 3 05:30:09 kjcf05n03 python3.9[2102]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 05:30:09 kjcf05n03 python3.9[3161]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 05:30:09 kjcf05n03 systemd-logind[2682]: New seat seat0. Nov 3 05:30:09 kjcf05n03 systemd-logind[2682]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Login Service. Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 05:30:09 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 05:30:09 kjcf05n03 systemd-sysctl[2779]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 05:30:09 kjcf05n03 systemd-sysctl[2779]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 05:30:09 kjcf05n03 python3.9[2794]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 05:30:09 kjcf05n03 python3.9[3161]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 05:30:09 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 05:30:09 kjcf05n03 python3.9[2985]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 05:30:09 kjcf05n03 python3.9[3161]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 05:30:09 kjcf05n03 network[2107]: Bringing up loopback interface: [ OK ] Nov 3 05:30:09 kjcf05n03 systemd-sysctl[3107]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 05:30:09 kjcf05n03 systemd-sysctl[3107]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 05:30:09 kjcf05n03 systemd[1]: Started LSB: Bring up/down networking. Nov 3 05:30:09 kjcf05n03 systemd[1]: Reached target Network. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 05:30:09 kjcf05n03 systemd[1]: Reached target Network is Online. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting System Logger Daemon... Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 05:30:09 kjcf05n03 sm-notify[3162]: Version 2.3.3 starting Nov 3 05:30:09 kjcf05n03 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Notify NFS peers of a restart. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 05:30:09 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 05:30:09 kjcf05n03 systemd[1]: Reached target NFS client services. Nov 3 05:30:09 kjcf05n03 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 05:30:09 kjcf05n03 systemd[1]: Reached target Remote File Systems. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Permit User Sessions... Nov 3 05:30:09 kjcf05n03 lldpad[3151]: setsockopt nearest_bridge: Invalid argument Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Permit User Sessions. Nov 3 05:30:09 kjcf05n03 lldpad[3151]: setsockopt nearest_bridge: Invalid argument Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Getty on tty1. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 05:30:09 kjcf05n03 python3.9[3185]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 05:30:09 kjcf05n03 python3.9[3161]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Serial Getty on ttyS0. Nov 3 05:30:09 kjcf05n03 systemd[1]: Reached target Login Prompts. Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 05:30:09 kjcf05n03 syslog-ng[3161]: [2024-11-03T11:28:55.283993] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 05:30:09 kjcf05n03 syslog-ng[3161]: [2024-11-03T11:28:55.284287] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 05:30:09 kjcf05n03 syslog-ng[3161]: [2024-11-03T11:28:55.284321] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 05:30:09 kjcf05n03 syslog-ng[3161]: [2024-11-03T11:28:55.284897] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 05:30:09 kjcf05n03 syslog-ng[3161]: [2024-11-03T11:28:55.285207] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 05:30:09 kjcf05n03 systemd[1]: Started System Logger Daemon. Nov 3 05:30:09 kjcf05n03 beSetMlxConfig[2112]: Unloading MST PCI module (unused) - Success Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 05:30:09 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 05:30:09 kjcf05n03 python3.9[3424]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 05:30:09 kjcf05n03 python3.9[3161]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 05:30:09 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 05:30:09 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 05:30:09 kjcf05n03 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 05:30:09 kjcf05n03 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 05:30:09 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 05:30:09 kjcf05n03 sshd[3433]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 05:30:09 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 05:30:09 kjcf05n03 chronyd[2214]: System's initial offset : 0.000337 seconds slow of true (slew) Nov 3 05:30:09 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 05:30:09 kjcf05n03 beSetMlxConfig[2112]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 05:30:09 kjcf05n03 beSetMlxConfig[2112]: ib mode Nov 3 05:30:09 kjcf05n03 root[3452]: openibd: Set node_desc for mlx5_0: kjcf05n03 HCA-1 Nov 3 05:30:09 kjcf05n03 root[3454]: openibd: Set node_desc for mlx5_1: kjcf05n03 HCA-2 Nov 3 05:30:09 kjcf05n03 beSetMlxConfig[2112]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 05:30:09 kjcf05n03 beSetMlxConfig[2112]: ib mode Nov 3 05:30:09 kjcf05n03 systemd-udevd[1550]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 05:30:09 kjcf05n03 systemd-udevd[3470]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:30:09 kjcf05n03 systemd-udevd[3469]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:30:09 kjcf05n03 systemd-udevd[3473]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:30:09 kjcf05n03 systemd-udevd[3474]: Using default interface naming scheme 'rhel-8.0'. Nov 3 05:30:09 kjcf05n03 systemd-udevd[3474]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:30:09 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 05:30:09 kjcf05n03 systemd[3161]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:09 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[3511]: Setting up Mellanox network interface: ib0 Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[3512]: Setting up Mellanox network interface: ib1 Nov 3 05:30:09 kjcf05n03 systemd-udevd[3471]: Using default interface naming scheme 'rhel-8.0'. Nov 3 05:30:09 kjcf05n03 systemd-udevd[3471]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[3561]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[3562]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[3576]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[3578]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[3579]: No configuration found for ib0 Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[3580]: No configuration found for ib1 Nov 3 05:30:09 kjcf05n03 systemd-udevd[3472]: Using default interface naming scheme 'rhel-8.0'. Nov 3 05:30:09 kjcf05n03 systemd-udevd[3472]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Puppet agent... Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[3585]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[3588]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 05:30:09 kjcf05n03 mlnx_conf_mgr[3643]: INFO: No configurations found for mlx5_1, skipping. Nov 3 05:30:09 kjcf05n03 mlnx_conf_mgr[3642]: INFO: No configurations found for mlx5_0, skipping. Nov 3 05:30:09 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 05:30:09 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 05:30:09 kjcf05n03 systemd[1]: Stopping Command Scheduler... Nov 3 05:30:09 kjcf05n03 systemd[1]: crond.service: Succeeded. Nov 3 05:30:09 kjcf05n03 systemd[1]: Stopped Command Scheduler. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 05:30:09 kjcf05n03 systemd[1]: Stopping Job spooling tools... Nov 3 05:30:09 kjcf05n03 systemd[1]: atd.service: Succeeded. Nov 3 05:30:09 kjcf05n03 systemd[1]: Stopped Job spooling tools. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 05:30:09 kjcf05n03 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 05:30:09 kjcf05n03 lldpad[3151]: init_ports: Error adding device ib0 Nov 3 05:30:09 kjcf05n03 lldpad[3151]: init_ports: Error adding device ib1 Nov 3 05:30:09 kjcf05n03 lldpad[3151]: Signal 15 received - terminating Nov 3 05:30:09 kjcf05n03 systemd[1]: lldpad.service: Succeeded. Nov 3 05:30:09 kjcf05n03 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 05:30:09 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 05:30:09 kjcf05n03 systemd[1]: lldpad.socket: Succeeded. Nov 3 05:30:09 kjcf05n03 systemd[1]: Closed lldpad.socket. Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 05:30:09 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting IPMI Driver... Nov 3 05:30:09 kjcf05n03 systemd[1]: Started IPMI Driver. Nov 3 05:30:09 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:09 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:09 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Ipmievd Daemon... Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 1 | Nov-03-2024 | 10:29:21 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 2 | Nov-03-2024 | 10:30:14 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 3 | Nov-03-2024 | 10:30:14 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 4 | Nov-03-2024 | 10:31:19 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 5 | Nov-03-2024 | 10:31:20 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 6 | Nov-03-2024 | 11:26:14 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 7 | Nov-03-2024 | 11:26:14 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 8 | Nov-03-2024 | 11:26:14 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 9 | Nov-03-2024 | 11:26:14 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 10 | Nov-03-2024 | 11:26:14 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 11 | Nov-03-2024 | 11:26:14 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 12 | Nov-03-2024 | 11:26:14 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 13 | Nov-03-2024 | 11:26:14 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 14 | Nov-03-2024 | 11:26:14 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 15 | Nov-03-2024 | 11:26:14 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 16 | Nov-03-2024 | 11:26:14 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 17 | Nov-03-2024 | 11:26:14 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 18 | Nov-03-2024 | 11:26:15 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 19 | Nov-03-2024 | 11:26:15 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 20 | Nov-03-2024 | 11:26:15 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 21 | Nov-03-2024 | 11:26:15 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 22 | Nov-03-2024 | 11:26:15 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 23 | Nov-03-2024 | 11:26:15 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 24 | Nov-03-2024 | 11:26:15 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 25 | Nov-03-2024 | 11:26:15 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 26 | Nov-03-2024 | 11:26:15 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 27 | Nov-03-2024 | 11:26:15 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 28 | Nov-03-2024 | 11:26:15 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 29 | Nov-03-2024 | 11:26:15 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 30 | Nov-03-2024 | 11:26:15 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 31 | Nov-03-2024 | 11:26:15 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 32 | Nov-03-2024 | 11:26:15 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 33 | Nov-03-2024 | 11:26:15 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 34 | Nov-03-2024 | 11:26:15 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 35 | Nov-03-2024 | 11:26:15 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 36 | Nov-03-2024 | 11:26:15 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 37 | Nov-03-2024 | 11:26:15 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 38 | Nov-03-2024 | 11:26:45 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 39 | Nov-03-2024 | 11:26:45 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 40 | Nov-03-2024 | 11:26:45 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 41 | Nov-03-2024 | 11:26:45 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 42 | Nov-03-2024 | 11:26:45 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 43 | Nov-03-2024 | 11:26:45 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 44 | Nov-03-2024 | 11:26:45 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 45 | Nov-03-2024 | 11:26:45 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 46 | Nov-03-2024 | 11:26:45 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 47 | Nov-03-2024 | 11:26:45 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 48 | Nov-03-2024 | 11:26:45 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 49 | Nov-03-2024 | 11:26:45 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 50 | Nov-03-2024 | 11:26:45 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 51 | Nov-03-2024 | 11:26:45 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 52 | Nov-03-2024 | 11:26:45 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 53 | Nov-03-2024 | 11:26:45 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 54 | Nov-03-2024 | 11:26:45 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 55 | Nov-03-2024 | 11:26:45 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 56 | Nov-03-2024 | 11:26:45 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 57 | Nov-03-2024 | 11:26:45 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 58 | Nov-03-2024 | 11:26:45 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 59 | Nov-03-2024 | 11:26:45 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 60 | Nov-03-2024 | 11:26:47 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 61 | Nov-03-2024 | 11:26:47 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 62 | Nov-03-2024 | 11:26:47 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 63 | Nov-03-2024 | 11:26:47 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 64 | Nov-03-2024 | 11:26:47 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 65 | Nov-03-2024 | 11:26:47 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 66 | Nov-03-2024 | 11:26:47 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 67 | Nov-03-2024 | 11:26:47 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 68 | Nov-03-2024 | 11:26:47 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3989]: 69 | Nov-03-2024 | 11:26:47 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 05:30:09 kjcf05n03 ipmievd[3994]: Reading sensors... Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Ipmievd Daemon. Nov 3 05:30:09 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:09 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 05:30:09 kjcf05n03 nscd[2225]: 2225 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 05:30:09 kjcf05n03 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 05:30:09 kjcf05n03 systemd[1]: Stopped Set Mellanox configuration. Nov 3 05:30:09 kjcf05n03 systemd[1]: Stopping Set Mellanox configuration... Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 05:30:09 kjcf05n03 beSetMlxConfig[4050]: ConnectX-3 multiport not detected Nov 3 05:30:09 kjcf05n03 beSetMlxConfig[4050]: Starting MST (Mellanox Software Tools) driver set Nov 3 05:30:09 kjcf05n03 beSetMlxConfig[4050]: Loading MST PCI module - Success Nov 3 05:30:09 kjcf05n03 systemd-udevd[1550]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 05:30:09 kjcf05n03 beSetMlxConfig[4050]: [warn] mst_pciconf is already loaded, skipping Nov 3 05:30:09 kjcf05n03 beSetMlxConfig[4050]: Create devices Nov 3 05:30:09 kjcf05n03 beSetMlxConfig[4050]: Unloading MST PCI module (unused) - Success Nov 3 05:30:09 kjcf05n03 ipmievd[3994]: Waiting for events... Nov 3 05:30:09 kjcf05n03 beSetMlxConfig[4050]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 05:30:09 kjcf05n03 beSetMlxConfig[4050]: ib mode Nov 3 05:30:09 kjcf05n03 beSetMlxConfig[4050]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 05:30:09 kjcf05n03 beSetMlxConfig[4050]: ib mode Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 05:30:09 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 05:30:09 kjcf05n03 systemd-udevd[1550]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 05:30:09 kjcf05n03 systemd-udevd[4953]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:30:09 kjcf05n03 systemd-udevd[4954]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:30:09 kjcf05n03 systemd-udevd[4957]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:30:09 kjcf05n03 systemd-udevd[4959]: Using default interface naming scheme 'rhel-8.0'. Nov 3 05:30:09 kjcf05n03 systemd-udevd[4959]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:30:09 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 05:30:09 kjcf05n03 systemd[3161]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:09 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[4995]: Setting up Mellanox network interface: ib0 Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[4996]: Setting up Mellanox network interface: ib1 Nov 3 05:30:09 kjcf05n03 systemd-udevd[4956]: Using default interface naming scheme 'rhel-8.0'. Nov 3 05:30:09 kjcf05n03 systemd-udevd[4955]: Using default interface naming scheme 'rhel-8.0'. Nov 3 05:30:09 kjcf05n03 systemd-udevd[4956]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:30:09 kjcf05n03 systemd-udevd[4955]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[5045]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[5046]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[5076]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[5077]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[5078]: No configuration found for ib0 Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[5079]: No configuration found for ib1 Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[5086]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 05:30:09 kjcf05n03 mlnx_interface_mgr[5087]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 05:30:09 kjcf05n03 mlnx_conf_mgr[5123]: INFO: No configurations found for mlx5_0, skipping. Nov 3 05:30:09 kjcf05n03 mlnx_conf_mgr[5127]: INFO: No configurations found for mlx5_1, skipping. Nov 3 05:30:09 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 05:30:09 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}fbea2308b502f2a36da4cde38f76032e9b9cc42b6edabd0ff5ab476681d127d8' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}fbea2308b502f2a36da4cde38f76032e9b9cc42b6edabd0ff5ab476681d127d8' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}fa8656dfcaa42ce5d2a3b18b7a6940c86b391ab6432222ef3f4e6812271735bd' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}fa8656dfcaa42ce5d2a3b18b7a6940c86b391ab6432222ef3f4e6812271735bd' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}4ab10ff703b159e30d65900947d77f10800895125cd9525da4c0ed30c98fd5a8' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}4ab10ff703b159e30d65900947d77f10800895125cd9525da4c0ed30c98fd5a8' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}a558c8b5812c9b0cc348f0f81201df7a6d6848d87b0324d8704bab554bda630d' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}a558c8b5812c9b0cc348f0f81201df7a6d6848d87b0324d8704bab554bda630d' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 05:30:09 kjcf05n03 systemd[1]: Stopping NTP client/server... Nov 3 05:30:09 kjcf05n03 chronyd[2214]: chronyd exiting Nov 3 05:30:09 kjcf05n03 systemd[1]: chronyd.service: Succeeded. Nov 3 05:30:09 kjcf05n03 systemd[1]: Stopped NTP client/server. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 05:30:09 kjcf05n03 chronyd[5162]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 05:30:09 kjcf05n03 chronyd[5162]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 05:30:09 kjcf05n03 chronyd[5162]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 05:30:09 kjcf05n03 chronyd[5162]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 05:30:09 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 05:30:09 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:09 kjcf05n03 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 05:30:09 kjcf05n03 systemd[1]: dwd.service: Succeeded. Nov 3 05:30:09 kjcf05n03 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 05:30:09 kjcf05n03 dwd[5196]: dwd: vMay 29 2024 : 15:38:26 Nov 3 05:30:09 kjcf05n03 dwd[5196]: /usr/sbin/dwd -i 15 -d Nov 3 05:30:09 kjcf05n03 dwd[5196]: dwd: option Lethal: 0 Nov 3 05:30:09 kjcf05n03 dwd[5196]: dwd: option Interval: 15 Nov 3 05:30:09 kjcf05n03 dwd[5196]: dwd: option abrtlimit: 10 Nov 3 05:30:09 kjcf05n03 dwd[5196]: dwd: option DZPeriod: 604800 Nov 3 05:30:09 kjcf05n03 dwd[5196]: dwd: option SmartPeriod: 43200 Nov 3 05:30:09 kjcf05n03 dwd[5196]: dwd: option SDDEnabled: 1 Nov 3 05:30:09 kjcf05n03 dwd[5196]: dwd: option SDDAwaitScale: 3 Nov 3 05:30:09 kjcf05n03 dwd[5196]: dwd: option SDDAwaitMin: 100 Nov 3 05:30:09 kjcf05n03 dwd[5196]: dwd: option Verbosity: 1 Nov 3 05:30:09 kjcf05n03 dwd[5196]: dwd: option StandAlone: 0 Nov 3 05:30:09 kjcf05n03 dwd[5196]: option Lethal: 0 Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 05:30:09 kjcf05n03 dwd[5196]: option Interval: 15 Nov 3 05:30:09 kjcf05n03 dwd[5196]: option abrtlimit: 10 Nov 3 05:30:09 kjcf05n03 dwd[5196]: option DZPeriod: 604800 Nov 3 05:30:09 kjcf05n03 dwd[5196]: option SmartPeriod: 43200 Nov 3 05:30:09 kjcf05n03 dwd[5196]: option SDDEnabled: 1 Nov 3 05:30:09 kjcf05n03 dwd[5196]: option SDDAwaitScale: 3 Nov 3 05:30:09 kjcf05n03 dwd[5196]: option SDDAwaitMin: 100 Nov 3 05:30:09 kjcf05n03 dwd[5196]: option Verbosity: 1 Nov 3 05:30:09 kjcf05n03 dwd[5196]: option StandAlone: 0 Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 05:30:09 kjcf05n03 dwd[5197]: option Lethal now set to 1 Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 05:30:09 kjcf05n03 dwd[5197]: option abrtlimit now set to 1 Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 05:30:09 kjcf05n03 dwd[5197]: option SmartPeriod now set to 86400 Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 05:30:09 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 05:30:09 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Discard unused blocks. Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:09 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:09 kjcf05n03 python3.9[5226]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 05:30:09 kjcf05n03 python3.9[3161]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 05:30:09 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Periodic ZFS scrub. Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:09 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 05:30:09 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:09 kjcf05n03 systemd[1]: Starting Sed Control Plane worker process... Nov 3 05:30:09 kjcf05n03 sedcpwrkr[5363]: Using config script: /etc/sedcpwrkr.conf Nov 3 05:30:09 kjcf05n03 sedcpwrkr[5363]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 05:30:09 kjcf05n03 sedcpwrkr[5363]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 05:30:09 kjcf05n03 sedcpwrkr[5363]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 05:30:09 kjcf05n03 sedcpwrkr[5363]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 05:30:09 kjcf05n03 sedcpwrkr[5363]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 05:30:09 kjcf05n03 sedcpwrkr[5363]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 05:30:09 kjcf05n03 sedcpwrkr-server[5394]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 05:30:09 kjcf05n03 sedcpwrkr[5363]: celery multi v5.2.7 (dawn-chorus) Nov 3 05:30:09 kjcf05n03 sedcpwrkr[5363]: > Starting nodes... Nov 3 05:30:09 kjcf05n03 sedcpwrkr[5363]: > sedcpwrkr@kjcf05n03: OK Nov 3 05:30:09 kjcf05n03 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 05:30:09 kjcf05n03 sedcpwrkr-server[5396]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 05:30:09 kjcf05n03 sedcpwrkr-server[5396]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 05:30:09 kjcf05n03 sedcpwrkr-server[5396]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 05:30:09 kjcf05n03 systemd[1]: Started Sed Control Plane worker process. Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 05:30:09 kjcf05n03 systemd[1]: Reloading System Logger Daemon. Nov 3 05:30:09 kjcf05n03 systemd[1]: Reloaded System Logger Daemon. Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 05:30:09 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 05:30:09 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 05:30:09 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:10 kjcf05n03 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 05:30:10 kjcf05n03 systemd-udevd[1550]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 05:30:10 kjcf05n03 iptables.init[5463]: iptables: Applying firewall rules: [ OK ] Nov 3 05:30:10 kjcf05n03 systemd[1]: Started IPv4 firewall with iptables. Nov 3 05:30:10 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:10 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:10 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:10 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:10 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 05:30:10 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 05:30:10 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 05:30:10 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 05:30:10 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 05:30:10 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 05:30:10 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 05:30:10 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 05:30:10 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 05:30:10 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 05:30:11 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 05:30:11 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 05:30:11 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 05:30:11 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 05:30:11 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 05:30:11 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 05:30:11 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 05:30:11 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 05:30:11 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 05:30:11 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 05:30:11 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 05:30:11 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 05:30:11 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 05:30:11 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 05:30:11 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 05:30:11 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 05:30:11 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 05:30:11 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 05:30:11 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 05:30:11 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 05:30:11 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 05:30:11 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 05:30:11 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 05:30:11 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 05:30:11 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 05:30:11 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 05:30:11 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 05:30:11 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 05:30:11 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 05:30:11 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 05:30:11 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 05:30:11 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 05:30:11 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 05:30:11 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 05:30:11 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 05:30:11 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 05:30:11 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 05:30:11 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 05:30:11 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 05:30:11 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 05:30:11 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:11 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 05:30:11 kjcf05n03 systemd[1]: openhpid.service: Supervising process 5561 which is not our child. We'll most likely not notice when it exits. Nov 3 05:30:11 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 05:30:11 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:11 kjcf05n03 openhpid[5561]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 05:30:11 kjcf05n03 openhpid[5561]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 05:30:11 kjcf05n03 openhpid[5561]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 05:30:11 kjcf05n03 openhpid[5561]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 05:30:11 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:11 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:11 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:12 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 05:30:12 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 05:30:12 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 05:30:12 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 05:30:12 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:12 kjcf05n03 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 05:30:12 kjcf05n03 dcs-collectord[5652]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 05:30:12 kjcf05n03 hpi.inv.log[5652]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 05:30:12 kjcf05n03 dcs-collectord[5652]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 05:30:12 kjcf05n03 dcs-collectord[5652]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 05:30:12 kjcf05n03 dcs-collector[5643]: Starting dcs-collector:[ OK ] Nov 3 05:30:12 kjcf05n03 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 05:30:12 kjcf05n03 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 05:30:12 kjcf05n03 dcs-collectord[5655]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 05:30:12 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 05:30:12 kjcf05n03 dcs-collectord[5655]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 05:30:12 kjcf05n03 dcs-collectord[5655]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 05:30:12 kjcf05n03 dcs-collectord[5655]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 05:30:12 kjcf05n03 dcs-collectord[5655]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 05:30:12 kjcf05n03 dcs-collectord[5655]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 05:30:12 kjcf05n03 dcs-collectord[5655]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259345872", "units": "kB"}, {"name": "MemAvailable", "value": "258625716", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821328", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1687300", "units": "kB"}, {"name": "Inactive", "value": "961164", "units": "kB"}, {"name": "Active(anon)", "value": "1520788", "units": "kB"}, {"name": "Inactive(anon)", "value": "825348", "units": "kB"}, {"name": "Active(file)", "value": "166512", "units": "kB"}, {"name": "Inactive(file)", "value": "135816", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "752788", "units": "kB"}, {"name": "Mapped", "value": "85652", "units": "kB"}, {"name": "Shmem", "value": "1593452", "units": "kB"}, {"name": "KReclaimable", "value": "109184", "units": "kB"}, {"name": "Slab", "value": "274764", "units": "kB"}, {"name": "SReclaimable", "value": "109184", "units": "kB"}, {"name": "SUnreclaim", "value": "165580", "units": "kB"}, {"name": "KernelStack", "value": "9792", "units": "kB"}, {"name": "PageTables", "value": "20268", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3344020", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11264", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "8192", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "319816", "units": "kB"}, {"name": "DirectMap2M", "value": "22614016", "units": "kB"}, {"name": "DirectMap1G", "value": "245366784", "units": "kB"}]}' Nov 3 05:30:12 kjcf05n03 dcs-collectord[5655]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 05:30:12 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:13 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:13 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:13 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:13 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 05:30:13 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 05:30:13 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 05:30:13 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 05:30:13 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:13 kjcf05n03 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 05:30:13 kjcf05n03 firmware-update-orc[5736]: Using config script: /etc/firmware_update_orc.conf Nov 3 05:30:13 kjcf05n03 firmware-update-orc[5736]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 05:30:13 kjcf05n03 firmware-update-orc[5736]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 05:30:13 kjcf05n03 firmware-update-orc[5736]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 05:30:13 kjcf05n03 firmware-update-orc[5736]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 05:30:13 kjcf05n03 firmware-update-orc[5736]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 05:30:13 kjcf05n03 firmware-update-orc[5736]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 05:30:14 kjcf05n03 dcs-collectord[5655]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 05:30:14 kjcf05n03 dcs-collectord[5655]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730633412.6661775], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730633413.8435318], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730633412.5966911, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 05:30:14 kjcf05n03 firmware-update-orc-server[5772]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 05:30:14 kjcf05n03 firmware-update-orc[5736]: celery multi v5.2.7 (dawn-chorus) Nov 3 05:30:14 kjcf05n03 firmware-update-orc[5736]: > Starting nodes... Nov 3 05:30:14 kjcf05n03 firmware-update-orc[5736]: > worker1@kjcf05n03: OK Nov 3 05:30:14 kjcf05n03 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 05:30:14 kjcf05n03 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 05:30:14 kjcf05n03 firmware-update-orc-server[5801]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 05:30:14 kjcf05n03 firmware-update-orc-server[5801]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 05:30:14 kjcf05n03 firmware-update-orc-server[5801]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 05:30:14 kjcf05n03 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 05:30:14 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:14 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:14 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:14 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:14 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 05:30:14 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 05:30:14 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 05:30:14 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 05:30:14 kjcf05n03 dbus-daemon[2151]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 05:30:14 kjcf05n03 dbus-daemon[2151]: [system] Reloaded configuration Nov 3 05:30:14 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 05:30:14 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 05:30:14 kjcf05n03 dbus-daemon[2151]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 05:30:14 kjcf05n03 dbus-daemon[2151]: [system] Reloaded configuration Nov 3 05:30:14 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 05:30:14 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 05:30:14 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 05:30:14 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 05:30:14 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:15 kjcf05n03 systemd[1]: Starting Manages hardware resources... Nov 3 05:30:15 kjcf05n03 ras-resource-manager-agent[5917]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 05:30:15 kjcf05n03 ras-resource-manager-agent[5903]: Starting ras-resource-manager-agent:[ OK ] Nov 3 05:30:15 kjcf05n03 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 05:30:15 kjcf05n03 ras-resource-manager-agent[5919]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 05:30:15 kjcf05n03 ras-resource-manager-client[5919]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 05:30:15 kjcf05n03 systemd[1]: Started Manages hardware resources. Nov 3 05:30:15 kjcf05n03 ras-resource-manager-client[5919]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 05:30:15 kjcf05n03 ras-resource-manager-client[5929]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 05:30:15 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:16 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:16 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:16 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:16 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 05:30:16 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 05:30:16 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:16 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 05:30:16 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:16 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:16 kjcf05n03 zabbix_agent2[6003]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:30:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730633416', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 05:30:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730633416'} Nov 3 05:30:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:30:16 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 05:30:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730633114', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 05:30:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730633114'} Nov 3 05:30:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: Press Ctrl+C to exit. Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: Plugin support version 1.0 Nov 3 05:30:17 kjcf05n03 zabbix_agent2[6003]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 05:30:17 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:17 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:17 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:17 kjcf05n03 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 05:30:17 kjcf05n03 dcs-notification-sender[6079]: dcs-notification-senderd is stopped Nov 3 05:30:17 kjcf05n03 zabbix-agent2[6093]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 05:30:17 kjcf05n03 dcs-notification-sender[6079]: Starting notification-sender:[ OK ] Nov 3 05:30:17 kjcf05n03 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 05:30:17 kjcf05n03 zabbix-agent2[6099]: INFO DCS notification agent started. (agent.py:61) Nov 3 05:30:17 kjcf05n03 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 05:30:17 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:17 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:17 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:17 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:17 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:18 kjcf05n03 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 05:30:18 kjcf05n03 dcs-collectord[6204]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 05:30:18 kjcf05n03 dcs-collectord[6204]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 05:30:18 kjcf05n03 dcs-bulk-data-sender[6204]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 05:30:18 kjcf05n03 dcs-bulk-data-sender[6195]: Starting bulk-data-sender:[ OK ] Nov 3 05:30:18 kjcf05n03 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 05:30:18 kjcf05n03 dcs-collectord[6206]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 05:30:18 kjcf05n03 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 05:30:18 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:19 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:19 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:19 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:19 kjcf05n03 nscd[2225]: 2225 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 05:30:19 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 05:30:19 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 05:30:19 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 05:30:19 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 05:30:19 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 05:30:19 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 05:30:19 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 05:30:19 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 05:30:19 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 05:30:19 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 05:30:19 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 05:30:19 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 05:30:19 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 05:30:19 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 05:30:19 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib0 Nov 3 05:30:19 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib0 Nov 3 05:30:19 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 05:30:19 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 05:30:19 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 05:30:19 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 05:30:19 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 05:30:19 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 05:30:19 kjcf05n03 systemd[1]: Stopping System Security Services Daemon... Nov 3 05:30:19 kjcf05n03 sssd[nss][2553]: Shutting down (status = 0) Nov 3 05:30:19 kjcf05n03 sssd[be[implicit_files]][2468]: Shutting down (status = 0) Nov 3 05:30:19 kjcf05n03 systemd[1]: sssd.service: Succeeded. Nov 3 05:30:19 kjcf05n03 systemd[1]: Stopped System Security Services Daemon. Nov 3 05:30:19 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 05:30:19 kjcf05n03 python3.9[5226]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 05:30:20 kjcf05n03 python3.9[3161]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:20 kjcf05n03 sssd[sssd][6270]: Starting up Nov 3 05:30:20 kjcf05n03 sssd[be[implicit_files]][6271]: Starting up Nov 3 05:30:20 kjcf05n03 sssd[nss][6288]: Starting up Nov 3 05:30:20 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 05:30:20 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 05:30:20 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 05:30:21 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 05:30:21 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 05:30:21 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 05:30:21 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 05:30:21 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 05:30:21 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 05:30:21 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure) defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 05:30:21 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure: defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 05:30:21 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure) defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 05:30:21 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure: defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 05:30:21 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 05:30:21 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 05:30:21 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 05:30:21 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 05:30:21 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 05:30:21 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 05:30:21 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:21 kjcf05n03 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 05:30:22 kjcf05n03 icinga2[6336]: [2024-11-03 05:30:21 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 05:30:22 kjcf05n03 icinga2[6336]: [2024-11-03 05:30:21 -0600] information/cli: Loading configuration file(s). Nov 3 05:30:22 kjcf05n03 icinga2[6336]: [2024-11-03 05:30:21 -0600] information/ConfigItem: Committing config item(s). Nov 3 05:30:22 kjcf05n03 icinga2[6336]: [2024-11-03 05:30:22 -0600] information/ApiListener: My API identity: kjcf05n03 Nov 3 05:30:22 kjcf05n03 icinga2[6336]: [2024-11-03 05:30:22 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 05:30:22 kjcf05n03 icinga2[6336]: [2024-11-03 05:30:22 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 05:30:22 kjcf05n03 icinga2[6336]: [2024-11-03 05:30:22 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 05:30:22 kjcf05n03 icinga2[6336]: [2024-11-03 05:30:22 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 05:30:22 kjcf05n03 icinga2[6336]: [2024-11-03 05:30:22 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 05:30:22 kjcf05n03 icinga2[6336]: [2024-11-03 05:30:22 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 05:30:22 kjcf05n03 icinga2[6336]: [2024-11-03 05:30:22 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 05:30:22 kjcf05n03 icinga2[6336]: [2024-11-03 05:30:22 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 05:30:22 kjcf05n03 icinga2[6336]: [2024-11-03 05:30:22 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 05:30:22 kjcf05n03 icinga2[6336]: [2024-11-03 05:30:22 -0600] information/cli: Closing console log. Nov 3 05:30:22 kjcf05n03 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 05:30:22 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:22 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:22 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:22 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:23 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 05:30:23 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 05:30:23 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:23 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib1 Nov 3 05:30:23 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib1 Nov 3 05:30:23 kjcf05n03 systemd[1]: Started Icinga2 network monitor. Nov 3 05:30:23 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:23 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 05:30:23 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:23 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:24 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 05:30:24 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 05:30:24 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 05:30:24 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 05:30:24 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 05:30:24 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 05:30:24 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 05:30:24 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 05:30:24 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 05:30:24 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 05:30:24 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 05:30:24 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 05:30:24 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 05:30:24 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 05:30:24 kjcf05n00 mcfcli[3673891]: %3|1730633424.130|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:30:24 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:24 kjcf05n03 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 05:30:24 kjcf05n03 nslcd[7249]: version 0.9.9 starting Nov 3 05:30:24 kjcf05n03 nslcd[7249]: accepting connections Nov 3 05:30:24 kjcf05n03 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 05:30:24 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:25 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:25 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:25 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:25 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 05:30:25 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 05:30:25 kjcf05n03 dcs-bulk-data-sender[6206]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 05:30:25 kjcf05n03 dcs-collectord[6206]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 05:30:25 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 05:30:25 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 05:30:26 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 05:30:26 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 05:30:26 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 05:30:26 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 05:30:26 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:26 kjcf05n03 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 05:30:26 kjcf05n03 dearcpw[7450]: Using config script: /etc/dearcpw.conf Nov 3 05:30:26 kjcf05n03 dearcpw[7450]: - Creating default directory: '/var/log/dearcpw' Nov 3 05:30:26 kjcf05n03 dearcpw[7450]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 05:30:26 kjcf05n03 dearcpw[7450]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 05:30:26 kjcf05n03 dearcpw[7450]: - Creating default directory: '/var/run/dearcpw' Nov 3 05:30:26 kjcf05n03 dearcpw[7450]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 05:30:26 kjcf05n03 dearcpw[7450]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 05:30:27 kjcf05n03 dearcpw-server[7490]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 05:30:27 kjcf05n03 dearcpw[7450]: celery multi v5.2.7 (dawn-chorus) Nov 3 05:30:27 kjcf05n03 dearcpw[7450]: > Starting nodes... Nov 3 05:30:27 kjcf05n03 dearcpw[7450]: > dearcpw@kjcf05n03: OK Nov 3 05:30:27 kjcf05n03 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 05:30:27 kjcf05n03 dearcpw-server[7492]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 05:30:27 kjcf05n03 dearcpw-server[7492]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 05:30:27 kjcf05n03 dearcpw-server[7492]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 05:30:27 kjcf05n03 systemd[1]: Started DEAR Control Plane worker process. Nov 3 05:30:27 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:27 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:27 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 05:30:27 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 05:30:27 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 05:30:27 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 05:30:27 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 05:30:27 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 05:30:27 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 05:30:27 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 05:30:27 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 05:30:27 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 05:30:27 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:42482). Nov 3 05:30:27 kjcf05n01 rsyncd[2919561]: connect from kjcf05n03 (172.16.2.6) Nov 3 05:30:27 kjcf05n01 rsyncd[2919561]: rsync to puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 05:30:27 kjcf05n01 rsyncd[2919561]: receiving file list Nov 3 05:30:27 kjcf05n01 rsyncd[2919561]: sent 29 bytes received 325 bytes total size 10901 Nov 3 05:30:27 kjcf05n01 systemd[1]: rsyncd@600-172.16.2.2:873-172.16.2.6:42482.service: Succeeded. Nov 3 05:30:27 kjcf05n03 puppet[7528]: IEC: 017000000: Node is up and running: { "node": "kjcf05n03" } Nov 3 05:30:27 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 05:30:27 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 05:30:27 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 05:30:27 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 05:30:27 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 05:30:27 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 05:30:27 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 05:30:27 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 05:30:27 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 05:30:27 kjcf05n03 dcs-collectord[5655]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 05:30:28 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 05:30:28 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 05:30:28 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 05:30:28 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 05:30:28 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 05:30:28 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 05:30:29 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 05:30:29 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 05:30:29 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 05:30:29 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 05:30:30 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 05:30:30 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 05:30:30 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 05:30:30 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 05:30:30 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 05:30:30 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 05:30:30 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:31 kjcf05n03 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 05:30:31 kjcf05n03 diskless-swap[7616]: HA_PS_000: recovering journal Nov 3 05:30:31 kjcf05n03 systemd-udevd[1550]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 05:30:31 kjcf05n03 diskless-swap[7616]: HA_PS_000: clean, 2267/6400 files, 7034/25600 blocks Nov 3 05:30:31 kjcf05n03 ipmievd[3994]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 05:30:31 kjcf05n03 ipmievd[3994]: System Event sensor - Timestamp Clock Sync Nov 3 05:30:31 kjcf05n03 diskless-swap[7616]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 05:30:31 kjcf05n03 ipmievd[3994]: System Event sensor - Timestamp Clock Sync Nov 3 05:30:31 kjcf05n03 diskless-swap[7616]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 05:30:31 kjcf05n03 diskless-swap[7616]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 05:30:31 kjcf05n03 diskless-swap[7616]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 05:30:31 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 05:30:31 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:31 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:31 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 05:30:31 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 05:30:31 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 05:30:31 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 05:30:31 kjcf05n03 systemd[1]: Stopping OpenSSH server daemon... Nov 3 05:30:31 kjcf05n03 systemd[1]: sshd.service: Succeeded. Nov 3 05:30:31 kjcf05n03 systemd[1]: Stopped OpenSSH server daemon. Nov 3 05:30:31 kjcf05n03 systemd[1]: Stopped target sshd-keygen.target. Nov 3 05:30:31 kjcf05n03 systemd[1]: Stopping sshd-keygen.target. Nov 3 05:30:31 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 05:30:31 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 05:30:31 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 05:30:31 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 05:30:31 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 05:30:32 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 05:30:32 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 05:30:32 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 05:30:32 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 05:30:32 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 05:30:32 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 05:30:33 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 05:30:33 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 05:30:33 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 05:30:33 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 05:30:34 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 05:30:34 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 05:30:34 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 05:30:34 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 05:30:34 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 05:30:34 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 05:30:34 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 05:30:34 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 05:30:34 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:34 kjcf05n03 systemd[1]: Set up automount opt-firmware.automount. Nov 3 05:30:35 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:35 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:35 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 05:30:35 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 05:30:35 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:35 kjcf05n03 systemd[1]: Set up automount mnt-llog.automount. Nov 3 05:30:35 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:35 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:35 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 05:30:35 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 05:30:35 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:36 kjcf05n03 systemd[1]: Set up automount usr-share-man.automount. Nov 3 05:30:36 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:36 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:36 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 05:30:36 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 05:30:36 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 05:30:36 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 05:30:36 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 05:30:36 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 05:30:36 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 05:30:36 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 05:30:36 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 05:30:36 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 05:30:36 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:36 kjcf05n03 systemd[1]: Starting Crash recovery kernel arming... Nov 3 05:30:36 kjcf05n03 kdumpctl[7856]: kdump: No kdump initial ramdisk found. Nov 3 05:30:36 kjcf05n03 kdumpctl[7856]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 05:30:36 kjcf05n03 dracut[7968]: dracut-049-135.git20210121.el8 Nov 3 05:30:37 kjcf05n03 dracut[7970]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 05:30:37 kjcf05n03 dracut[7970]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 05:30:37 kjcf05n03 dracut[7970]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 05:30:37 kjcf05n03 dracut[7970]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 05:30:37 kjcf05n03 dracut[7970]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 05:30:37 kjcf05n03 dracut[7970]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 05:30:37 kjcf05n03 dracut[7970]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 05:30:37 kjcf05n03 dracut[7970]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + is_func check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ type -t check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 0 -ne 0 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check -h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local dev holder Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + require_binaries mdadm expr Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _module_name=90hperaid Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ mdadm = \-\m ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for cmd in "$@" Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + find_binary mdadm Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for cmd in "$@" Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + find_binary expr Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n -h ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for dev in "${!host_fs_types[@]}" Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ nfs != *_raid_member ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + continue Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _ret=255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + ret=255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ 255 = 0 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ 255 = 255 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ module_depends hperaid Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: +++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: +++ set -x Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ depends Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo rootfs-block Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ return 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ _ret=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ return 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for _moddep in $(module_depends $_mod) Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all == *\ hperaid\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + add_dracutmodules+=' rootfs-block ' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ == *\ hperaid\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check_module rootfs-block Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _mod=rootfs-block Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddep Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ == *\ rootfs-block\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n '' ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all == *\ rootfs-block\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + module_check rootfs-block 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _forced=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 2 -eq 2 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _forced=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + is_func check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ type -t check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 0 -ne 0 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check -h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _ret=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + ret=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ 0 = 0 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ module_depends rootfs-block Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: +++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 05:30:37 kjcf05n03 kdumpctl[3161]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ depends Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo fs-lib Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ _ret=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ return 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for _moddep in $(module_depends $_mod) Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all == *\ rootfs-block\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + add_dracutmodules+=' fs-lib ' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ == *\ rootfs-block\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check_module fs-lib Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _mod=fs-lib Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddep Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n '' ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + mods_checked_as_dep+=' fs-lib ' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all == *\ fs-lib\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + module_check fs-lib 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _forced=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 2 -eq 2 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _forced=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + is_func check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ type -t check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 0 -ne 0 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check -h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _ret=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + ret=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ 0 = 0 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ module_depends fs-lib Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: +++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ depends Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ return 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ _ret=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ return 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + mods_to_load+=' fs-lib ' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + mods_to_load+=' rootfs-block ' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + mods_to_load+=' hperaid ' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _mod=90kernel-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _mod=kernel-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check_module kernel-modules 1 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _mod=kernel-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddep Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n 1 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all = all ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + module_check kernel-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _forced=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 1 -eq 2 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + is_func check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ type -t check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 0 -ne 0 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check -h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + true Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _ret=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + ret=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ 0 != 0 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ module_depends kernel-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: +++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ depends Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ true Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ _ret=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ return 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + mods_to_load+=' kernel-modules ' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _mod=90kernel-modules-extra Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _mod=kernel-modules-extra Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check_module kernel-modules-extra 1 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _mod=kernel-modules-extra Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddep Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n 1 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all = all ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + module_check kernel-modules-extra Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _forced=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 1 -eq 2 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + is_func check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ type -t check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 0 -ne 0 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check -h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + true Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _ret=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + ret=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ 0 != 0 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ module_depends kernel-modules-extra Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: +++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ depends Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ true Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ _ret=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ return 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + mods_to_load+=' kernel-modules-extra ' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _mod=90kernel-network-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _mod=kernel-network-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check_module kernel-network-modules 1 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _mod=kernel-network-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddep Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n 1 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all = all ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + module_check kernel-network-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _forced=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 1 -eq 2 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + is_func check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ type -t check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 0 -ne 0 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check -h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _ret=255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + ret=255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ 255 != 0 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n 1 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 1 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _mod=90livenet Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _mod=livenet Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check_module livenet 1 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _mod=livenet Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddep Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n 1 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all = all ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + module_check livenet Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _forced=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 1 -eq 2 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + is_func check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ type -t check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 0 -ne 0 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check -h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _ret=255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + ret=255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ 255 != 0 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n 1 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 1 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _mod=90lvm Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _mod=lvm Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check_module lvm 1 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _mod=lvm Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddep Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n 1 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all = all ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + module_check lvm Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _forced=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 1 -eq 2 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + is_func check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ type -t check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 0 -ne 0 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check -h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + require_binaries lvm Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _module_name=90lvm Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ lvm = \-\m ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for cmd in "$@" Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + find_binary lvm Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n -h ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for fs in "${host_fs_types[@]}" Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ nfs = LVM*_member ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _ret=255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + ret=255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ 255 != 0 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n 1 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 1 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _mod=90mdraid Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _mod=mdraid Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check_module mdraid 1 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _mod=mdraid Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddep Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n 1 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all = all ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + module_check mdraid Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _forced=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 1 -eq 2 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + is_func check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ type -t check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 0 -ne 0 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check -h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _rootdev Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + require_binaries mdadm expr Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _module_name=90mdraid Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ mdadm = \-\m ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for cmd in "$@" Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + find_binary mdadm Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for cmd in "$@" Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + find_binary expr Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n -h ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for dev in "${!host_fs_types[@]}" Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ nfs != *_raid_member ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + continue Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _ret=255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + ret=255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ 255 != 0 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n 1 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 1 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _mod=90multipath Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _mod=multipath Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check_module multipath 1 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _mod=multipath Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddep Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n 1 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all = all ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + module_check multipath Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _forced=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 1 -eq 2 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + is_func check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ type -t check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 0 -ne 0 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check -h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _rootdev Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n -h ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for_each_host_dev_and_slaves is_mpath Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _func=is_mpath Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _dev Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for _dev in "${host_devs[@]}" Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + continue Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 1 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _ret=255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + ret=255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ 255 != 0 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n 1 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 1 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _mod=90qemu Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _mod=qemu Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check_module qemu 1 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _mod=qemu Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddep Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n 1 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all = all ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + module_check qemu Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _forced=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 1 -eq 2 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + is_func check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ type -t check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 0 -ne 0 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check -h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n -h ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + type -P systemd-detect-virt Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ systemd-detect-virt --vm Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + vm=none Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + (( 1 != 0 )) Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _ret=255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + ret=255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ 255 != 0 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n 1 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 1 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _mod=90qemu-net Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _mod=qemu-net Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check_module qemu-net 1 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _mod=qemu-net Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddep Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n 1 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all = all ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + module_check qemu-net Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _forced=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 1 -eq 2 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + is_func check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ type -t check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 0 -ne 0 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check -h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n -h ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + type -P systemd-detect-virt Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ systemd-detect-virt --vm Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + vm= Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + (( 1 != 0 )) Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _ret=255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + ret=255 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ 255 != 0 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n 1 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + return 1 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _mod=90stratis Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + _mod=stratis Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check_module stratis 1 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _mod=stratis Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddep Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -n 1 ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ all = all ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + module_check stratis Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ read a b Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _forced=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _hostonly=-h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 1 -eq 2 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + is_func check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: ++ type -t check Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + '[' 0 -ne 0 ']' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + check -h Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _module_name=90stratis Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + local _ret=0 Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + [[ stratisd-init = \-\m ]] Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + for cmd in "$@" Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + find_binary stratisd-init Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 05:30:37 kjcf05n03 kdumpctl[7856]: + set +x Nov 3 05:30:37 kjcf05n03 dracut[7970]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 05:30:37 kjcf05n03 dracut[7970]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 05:30:37 kjcf05n03 dracut[7970]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 05:30:37 kjcf05n03 dracut[7970]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 05:30:37 kjcf05n03 dracut[7970]: memstrack is available Nov 3 05:30:37 kjcf05n03 dracut[7970]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 05:30:37 kjcf05n03 dracut[7970]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 05:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 05:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 05:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 05:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 05:30:37 kjcf05n03 dracut[7970]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 05:30:37 kjcf05n03 dracut[7970]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 05:30:37 kjcf05n03 dracut[7970]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 05:30:37 kjcf05n03 dracut[7970]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 05:30:38 kjcf05n03 dracut[7970]: *** Including module: bash *** Nov 3 05:30:38 kjcf05n03 dracut[7970]: *** Including module: systemd *** Nov 3 05:30:38 kjcf05n03 dracut[7970]: *** Including module: fips *** Nov 3 05:30:39 kjcf05n03 dracut[7970]: *** Including module: systemd-initrd *** Nov 3 05:30:39 kjcf05n03 dracut[7970]: *** Including module: watchdog-modules *** Nov 3 05:30:39 kjcf05n03 dracut[7970]: *** Including module: nss-softokn *** Nov 3 05:30:39 kjcf05n03 dracut[7970]: *** Including module: i18n *** Nov 3 05:30:39 kjcf05n03 dracut[7970]: No KEYMAP configured. Nov 3 05:30:39 kjcf05n03 dracut[7970]: *** Including module: network-legacy *** Nov 3 05:30:40 kjcf05n03 dracut[7970]: *** Including module: network *** Nov 3 05:30:40 kjcf05n03 dracut[7970]: *** Including module: ib_bonding *** Nov 3 05:30:40 kjcf05n03 dracut[7970]: *** Including module: drm *** Nov 3 05:30:42 kjcf05n00 mcfcli[3673891]: %3|1730633442.041|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:30:42 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 05:30:42 kjcf05n03 dcs-collectord[5655]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 05:30:43 kjcf05n03 dracut[7970]: *** Including module: hperaid *** Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + install Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + local rule rule_path Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + inst_multiple cat expr Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.EIoi51/initramfs -a -f cat expr Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + _ret=0 Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + (( 0 != 0 )) Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + : Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + return 0 Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + inst_multiple -o mdmon Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.EIoi51/initramfs -a -f -o mdmon Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + _ret=0 Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + (( 0 != 0 )) Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + : Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + return 0 Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: ++ command -v partx Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + inst /usr/sbin/partx /sbin/partx Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + local _hostonly_install Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + [[ -e /tmp/dracut.EIoi51/initramfs//sbin/partx ]] Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.EIoi51/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + (( 0 != 0 )) Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + : Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: ++ command -v mdadm Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + local _hostonly_install Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + [[ -e /tmp/dracut.EIoi51/initramfs//sbin/mdadm ]] Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.EIoi51/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + (( 0 != 0 )) Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + : Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + [[ yes == \y\e\s ]] Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + local _raidconf Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: ++ cmdline Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: ++ local _activated dev line UUID Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: ++ declare -A _activated Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: ++ for dev in "${!host_fs_types[@]}" Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: ++ [[ nfs != *_raid_member ]] Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: ++ continue Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + _raidconf= Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + [[ -n '' ]] Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + inst_rules 64-md-raid.rules Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + local _target=/etc/udev/rules.d _rule _found Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + inst_dir /usr/lib/udev/rules.d Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + [[ -e /tmp/dracut.EIoi51/initramfs//usr/lib/udev/rules.d ]] Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + return 0 Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + inst_dir /etc/udev/rules.d Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + [[ -e /tmp/dracut.EIoi51/initramfs//etc/udev/rules.d ]] Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + return 0 Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + for _rule in "$@" Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + continue Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + continue Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + for r in '' $dracutbasedir/rules.d/ Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + [[ 64-md-raid.rules != /* ]] Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + continue Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + for r in '' $dracutbasedir/rules.d/ Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + continue Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + [[ -n '' ]] Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 05:30:43 kjcf05n03 kdumpctl[7856]: + set +x Nov 3 05:30:43 kjcf05n03 dracut[7970]: Skipping udev rule: 64-md-raid.rules Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + installkernel Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + instmods =drivers/md Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + local _optional=-o Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + local _silent Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + local _ret Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + [[ '' = yes ]] Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + [[ =drivers/md = \-\c ]] Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + [[ =drivers/md = \-\s ]] Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + (( 1 == 0 )) Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.EIoi51/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + _ret=0 Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + (( 0 != 0 )) Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + [[ -n '' ]] Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + return 0 Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + _ret=0 Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + unset check depends cmdline install installkernel Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + return 0 Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + modules_loaded+='hperaid ' Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + '[' -n '' ']' Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + _d_mod=90kernel-modules Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + _d_mod=kernel-modules Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + [[ '' = yes ]] Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + dinfo '*** Including module: kernel-modules ***' Nov 3 05:30:44 kjcf05n03 kdumpctl[7856]: + set +x Nov 3 05:30:44 kjcf05n03 dracut[7970]: *** Including module: kernel-modules *** Nov 3 05:30:44 kjcf05n03 dracut[7970]: *** Including module: kernel-modules-extra *** Nov 3 05:30:44 kjcf05n03 dracut[7970]: *** Including module: kernel-network-modules *** Nov 3 05:30:44 kjcf05n03 dracut[7970]: *** Including module: diskless-mod *** Nov 3 05:30:44 kjcf05n03 dracut[7970]: *** Including module: fstab-sys *** Nov 3 05:30:44 kjcf05n03 dracut[7970]: *** Including module: nfs *** Nov 3 05:30:45 kjcf05n03 dracut[7970]: *** Including module: rootfs-block *** Nov 3 05:30:45 kjcf05n03 dracut[7970]: *** Including module: terminfo *** Nov 3 05:30:45 kjcf05n03 dracut[7970]: *** Including module: udev-rules *** Nov 3 05:30:45 kjcf05n03 dracut[7970]: Skipping udev rule: 91-permissions.rules Nov 3 05:30:45 kjcf05n03 dracut[7970]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 05:30:45 kjcf05n03 dracut[7970]: *** Including module: dracut-systemd *** Nov 3 05:30:46 kjcf05n03 dracut[7970]: *** Including module: usrmount *** Nov 3 05:30:46 kjcf05n03 dracut[7970]: *** Including module: base *** Nov 3 05:30:46 kjcf05n03 dracut[7970]: *** Including module: fs-lib *** Nov 3 05:30:46 kjcf05n03 dracut[7970]: *** Including module: kdumpbase *** Nov 3 05:30:47 kjcf05n03 dracut[7970]: *** Including module: memstrack *** Nov 3 05:30:47 kjcf05n03 dracut[7970]: *** Including module: shutdown *** Nov 3 05:30:47 kjcf05n03 dracut[7970]: *** Including module: squash *** Nov 3 05:30:47 kjcf05n03 dracut[7970]: *** Including modules done *** Nov 3 05:30:47 kjcf05n03 dracut[7970]: *** Installing kernel module dependencies *** Nov 3 05:30:47 kjcf05n03 dracut[7970]: *** Installing kernel module dependencies done *** Nov 3 05:30:47 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n03": interface became available Nov 3 05:30:48 kjcf05n03 dracut[7970]: *** Resolving executable dependencies *** Nov 3 05:30:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730633448', 'host':'kjcf05n03', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.4% (3703000 kB) used.'}"] Nov 3 05:30:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'RAM usage', 'description': 'OK - 1.4% (3703000 kB) used.', 'message': 'OK - 1.4% (3703000 kB) used.', 'value': 'ok', 'timestamp': '1730633448'} Nov 3 05:30:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:30:49 kjcf05n03 dracut[7970]: *** Resolving executable dependencies done*** Nov 3 05:30:49 kjcf05n03 dracut[7970]: *** Hardlinking files *** Nov 3 05:30:49 kjcf05n03 dracut[7970]: *** Hardlinking files done *** Nov 3 05:30:49 kjcf05n03 dracut[7970]: *** Generating early-microcode cpio image *** Nov 3 05:30:49 kjcf05n03 dracut[7970]: *** Constructing AuthenticAMD.bin **** Nov 3 05:30:49 kjcf05n03 dracut[7970]: *** Store current command line parameters *** Nov 3 05:30:49 kjcf05n03 dracut[7970]: Stored kernel commandline: Nov 3 05:30:49 kjcf05n03 dracut[7970]: rd.driver.pre=sd_mod Nov 3 05:30:49 kjcf05n03 dracut[7970]: rd.driver.pre=nvme Nov 3 05:30:49 kjcf05n03 dracut[7970]: rd.driver.pre=ipmi_si Nov 3 05:30:49 kjcf05n03 dracut[7970]: rd.driver.pre=ipmi_devintf Nov 3 05:30:49 kjcf05n03 dracut[7970]: rd.driver.pre=ipmi_msghandler Nov 3 05:30:49 kjcf05n03 dracut[7970]: nameserver=172.16.2.2 Nov 3 05:30:49 kjcf05n03 dracut[7970]: nameserver=127.0.0.1 Nov 3 05:30:49 kjcf05n03 dracut[7970]: nameserver=172.16.2.2 Nov 3 05:30:49 kjcf05n03 dracut[7970]: nameserver=127.0.0.1 Nov 3 05:30:49 kjcf05n03 dracut[7970]: ifname=kdump-meth0:00:09:3d:06:9a:1a team=mgmt0:kdump-meth0 Nov 3 05:30:49 kjcf05n03 dracut[7970]: rd.neednet Nov 3 05:30:49 kjcf05n03 dracut[7970]: kdumpnic=mgmt0 Nov 3 05:30:49 kjcf05n03 dracut[7970]: bootdev=mgmt0 Nov 3 05:30:49 kjcf05n03 dracut[7970]: *** Install squash loader *** Nov 3 05:30:49 kjcf05n03 dracut[7970]: *** Squashing the files inside the initramfs *** Nov 3 05:30:50 kjcf05n03 dracut[7970]: *** Squashing the files inside the initramfs done *** Nov 3 05:30:50 kjcf05n03 dracut[7970]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 05:30:50 kjcf05n03 dracut[7970]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 05:30:50 kjcf05n00 zabbix-server[990594]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:30:50 kjcf05n00 zabbix-server[990594]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n03 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n03:system.uptime): 00:02:51\\"}}"' Nov 3 05:30:50 kjcf05n00 log_interesting_event.py[990594]: Event '45791' acknowledged Nov 3 05:30:50 kjcf05n00 zabbix-server[990595]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:30:50 kjcf05n00 zabbix-server[990595]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 3 05:30:50 kjcf05n00 log_interesting_event.py[990595]: Event '45792' acknowledged Nov 3 05:30:50 kjcf05n00 zabbix-server[990596]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:30:50 kjcf05n00 zabbix-server[990596]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 3 05:30:50 kjcf05n00 log_interesting_event.py[990596]: Event '45794' acknowledged Nov 3 05:30:51 kjcf05n03 kdumpctl[7856]: kdump: kexec: loaded kdump kernel Nov 3 05:30:51 kjcf05n03 kdumpctl[7856]: kdump: Starting kdump: [OK] Nov 3 05:30:51 kjcf05n03 systemd[1]: Started Crash recovery kernel arming. Nov 3 05:30:51 kjcf05n03 systemd[1]: Reloading. Nov 3 05:30:51 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:30:51 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:30:51 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:30:51 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 05:30:51 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 05:30:51 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 05:30:51 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 05:30:51 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 05:30:51 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 05:30:51 kjcf05n03 ifdown[14559]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 05:30:51 kjcf05n03 ifdown[14560]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:30:51 kjcf05n03 ifdown[14561]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:30:51 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 05:30:51 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 05:30:51 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 05:30:52 kjcf05n03 ifup[14621]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 05:30:52 kjcf05n03 ifup[14622]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:30:52 kjcf05n03 ifup[14623]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:30:53 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 05:30:54 kjcf05n00 mcfcli[3673891]: %3|1730633454.130|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 05:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 05:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 05:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 05:30:56 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 05:30:56 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 05:30:56 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 05:30:56 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:30:56 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:30:56 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:30:56 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:30:56 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 05:30:56 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 05:30:56 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 05:30:56 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 05:30:56 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:30:56 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:30:56 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:30:56 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:30:56 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 05:30:56 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 05:30:56 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 05:30:56 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 05:30:56 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 05:30:56 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 05:30:56 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 05:30:56 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 05:30:56 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 05:30:56 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 05:30:56 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 05:30:56 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 05:30:56 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 05:30:56 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 05:30:56 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 05:30:56 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 05:30:56 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 05:30:56 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 05:30:56 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 05:30:56 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 05:30:56 kjcf05n03 ifdown[14803]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 05:30:56 kjcf05n03 ifdown[14804]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:30:56 kjcf05n03 ifdown[14805]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:30:56 kjcf05n03 ifup[14866]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 05:30:56 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 05:30:56 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 05:30:56 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 05:30:56 kjcf05n03 ifup[14867]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:30:56 kjcf05n03 ifup[14868]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:30:58 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 05:30:58 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 05:30:58 kjcf05n03 dcs-collectord[5655]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 05:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 05:31:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 05:31:01 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 05:31:01 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 05:31:01 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 05:31:01 kjcf05n03 systemd[1]: Reloading. Nov 3 05:31:01 kjcf05n03 systemd[1]: Starting Corosync Cluster Engine... Nov 3 05:31:01 kjcf05n03 await_ha_peer[15071]: Waiting for HA peer kjcf05n02 Nov 3 05:31:03 kjcf05n03 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 05:31:03 kjcf05n03 await_ha_peer[15071]: Peer kjcf05n02 has started, starting HA Nov 3 05:31:03 kjcf05n03 systemd[1]: Started Corosync Cluster Engine. Nov 3 05:31:03 kjcf05n03 systemd[1]: Started Fast STONITH daemon. Nov 3 05:31:03 kjcf05n03 fstonithd.py[15128]: Listening for kdump packets from partner Nov 3 05:31:03 kjcf05n03 systemd[1]: Reloading. Nov 3 05:31:03 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:31:03 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:31:03 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:31:03 kjcf05n03 systemd[1]: Reloading. Nov 3 05:31:04 kjcf05n03 systemd[1]: Reached target resource-agents dependencies. Nov 3 05:31:04 kjcf05n03 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 05:31:04 kjcf05n03 systemd[1]: Reloading. Nov 3 05:31:04 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 05:31:04 kjcf05n03 puppet-agent[3603]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 05:31:04 kjcf05n03 puppet[3603]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 05:31:04 kjcf05n03 puppet-agent[3603]: Applied catalog in 92.65 seconds Nov 3 05:31:04 kjcf05n03 puppet[3603]: Notice: Applied catalog in 92.65 seconds Nov 3 05:31:04 kjcf05n03 systemd[1]: Started Puppet agent. Nov 3 05:31:04 kjcf05n03 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 05:31:04 kjcf05n03 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 05:31:04 kjcf05n03 systemd[1]: Reached target Timers. Nov 3 05:31:04 kjcf05n03 systemd[1]: Starting Set absolute GEM time... Nov 3 05:31:04 kjcf05n03 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 05:31:04 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 05:31:04 kjcf05n03 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 05:31:04 kjcf05n03 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 05:31:04 kjcf05n03 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 05:31:04 kjcf05n03 wce-disable.sh[15264]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 05:31:04 kjcf05n03 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 05:31:04 kjcf05n03 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 05:31:04 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 05:31:04 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 05:31:04 kjcf05n03 systemd[1]: set_gem_time.service: Succeeded. Nov 3 05:31:04 kjcf05n03 systemd[1]: Started Set absolute GEM time. Nov 3 05:31:05 kjcf05n03 python3.9[15268]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 05:31:05 kjcf05n03 python3.9[15268]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 05:31:05 kjcf05n03 gateway-ec-node.py[15267]: Starting gateway-ec-node service Nov 3 05:31:05 kjcf05n03 RFSF-API[15266]: INFO[2024-11-03T05:31:04-06:00] Datapath API RESTful Service starting Nov 3 05:31:05 kjcf05n03 dp-api-server-node[15266]: INFO[2024-11-03T05:31:04-06:00] Datapath API RESTful Service starting Nov 3 05:31:05 kjcf05n03 RFSF-API[15266]: INFO[2024-11-03T05:31:04-06:00] Running in production mode, starting dbus event listener Nov 3 05:31:05 kjcf05n03 dp-api-server-node[15266]: INFO[2024-11-03T05:31:04-06:00] Running in production mode, starting dbus event listener Nov 3 05:31:05 kjcf05n03 RFSF-API[15266]: INFO[2024-11-03T05:31:04-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 05:31:05 kjcf05n03 dp-api-server-node[15266]: INFO[2024-11-03T05:31:04-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 05:31:05 kjcf05n03 RFSF-API[15266]: INFO[2024-11-03T05:31:04-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 05:31:05 kjcf05n03 dp-api-server-node[15266]: INFO[2024-11-03T05:31:04-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 05:31:05 kjcf05n03 RFSF-API[15266]: INFO[2024-11-03T05:31:04-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 05:31:05 kjcf05n03 dp-api-server-node[15266]: INFO[2024-11-03T05:31:04-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 05:31:05 kjcf05n03 RFSF-API[15266]: INFO[2024-11-03T05:31:04-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 05:31:05 kjcf05n03 dp-api-server-node[15266]: INFO[2024-11-03T05:31:04-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 05:31:05 kjcf05n03 RFSF-API[15266]: INFO[2024-11-03T05:31:04-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 05:31:05 kjcf05n03 dp-api-server-node[15266]: INFO[2024-11-03T05:31:04-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 05:31:05 kjcf05n03 RFSF-API[15266]: INFO[2024-11-03T05:31:04-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 05:31:05 kjcf05n03 dp-api-server-node[15266]: INFO[2024-11-03T05:31:04-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 05:31:05 kjcf05n03 RFSF-API[15266]: INFO[2024-11-03T05:31:04-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 05:31:05 kjcf05n03 dp-api-server-node[15266]: INFO[2024-11-03T05:31:04-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 05:31:05 kjcf05n03 RFSF-API[15266]: INFO[2024-11-03T05:31:04-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 05:31:05 kjcf05n03 dp-api-server-node[15266]: INFO[2024-11-03T05:31:04-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 05:31:05 kjcf05n03 RFSF-API[15266]: INFO[2024-11-03T05:31:04-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 05:31:05 kjcf05n03 dp-api-server-node[15266]: INFO[2024-11-03T05:31:04-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 05:31:05 kjcf05n03 RFSF-API[15266]: INFO[2024-11-03T05:31:04-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 05:31:05 kjcf05n03 dp-api-server-node[15266]: INFO[2024-11-03T05:31:04-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 05:31:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730633465', 'host':'kjcf05n03', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 05:31:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730633465', 'host':'kjcf05n03', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 05:31:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730633465'} Nov 3 05:31:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:31:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730633465'} Nov 3 05:31:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:31:10 kjcf05n03 systemd[1]: Reloading. Nov 3 05:31:10 kjcf05n03 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 05:31:10 kjcf05n03 systemd[1]: Reloading. Nov 3 05:31:10 kjcf05n03 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 05:31:11 kjcf05n03 diskmonitor_pre[15632]: Key management is currently disabled.DEAR disabled Nov 3 05:31:11 kjcf05n03 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 05:31:12 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 05:31:13 kjcf05n03 dcs-collectord[5655]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 05:31:13 kjcf05n03 dcs-collectord[5655]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 05:31:13 kjcf05n03 sh[15697]: LNET configured: New Created Nov 3 05:31:13 kjcf05n03 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 05:31:13 kjcf05n03 LCNmon[17777]: Interface ib0 is up Nov 3 05:31:13 kjcf05n03 LCNmon[17777]: Interface ib1 is up Nov 3 05:31:13 kjcf05n03 LCNmon[17777]: Can ping through interface ib0 Nov 3 05:31:13 kjcf05n03 LCNmon[17777]: Can ping through interface ib1 Nov 3 05:31:13 kjcf05n03 LCNmon[17777]: NIC ib0, initial state UP Nov 3 05:31:13 kjcf05n03 LCNmon[17777]: NIC ib1, initial state UP Nov 3 05:31:13 kjcf05n03 LCNmon[17777]: LCNstat initial state UP Nov 3 05:31:13 kjcf05n03 LCNmon[17777]: LCNmon monitoring hosts kjcf05n03 and kjcf05n02 Nov 3 05:31:14 kjcf05n00 httpd[902566]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-B): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n03', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: /var/run/diskmonitor does not exist, creating Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: Creating /var/run/diskmonitor/disk Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: Creating /var/run/diskmonitor/encl Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: Creating /var/run/diskmonitor/cli Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: RAS_Interlocks_enabled: 1 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: add handler for sig: 14 sa_flags: 10000004 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: add handler for sig: 1 sa_flags: 10000004 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: add handler for sig: 2 sa_flags: 00000004 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: add handler for sig: 15 sa_flags: 00000004 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: add handler for sig: 6 sa_flags: 00000004 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: add handler for sig: 3 sa_flags: 00000004 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: add handler for sig: 30 sa_flags: 00000004 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: add handler for sig: 20 sa_flags: 00000004 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: add handler for sig: 10 sa_flags: 10000004 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: add handler for sig: 11 sa_flags: 00000004 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: add handler for sig: 7 sa_flags: 00000004 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: add handler for sig: 4 sa_flags: 00000004 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: add handler for sig: 8 sa_flags: 00000004 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: Using HA Baton locks - key: diskmonitor Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: Baton will be held for at most 570 seconds Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: DMMP Enabled: 0 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: random seed: 4fcef07a Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: NVMe Enclosure: 1 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: ZFS Enclosure: 0 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: Dbus, Initialized Connection Successfully Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: int_catcher_thread: thread start Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: Received dbus message 4 org.freedesktop.DBus -> :1.92 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b07bec_S4EUNF0MA05386M encl_slot: 0 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b07bed_S4EUNF0MA05387D encl_slot: 0 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 05:31:15 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 05:31:15 kjcf05n03 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 05:31:17 kjcf05n03 openhpid[5561]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 05:31:17 kjcf05n03 openhpid[5561]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 05:31:17 kjcf05n03 systemd[1]: openhpid.service: Succeeded. Nov 3 05:31:17 kjcf05n03 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 05:31:17 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 05:31:17 kjcf05n03 systemd[1]: openhpid.service: Supervising process 18324 which is not our child. We'll most likely not notice when it exits. Nov 3 05:31:17 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 05:31:17 kjcf05n03 systemd[1]: Reached target Multi-User System. Nov 3 05:31:17 kjcf05n03 systemd[1]: Reached target Graphical Interface. Nov 3 05:31:17 kjcf05n03 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 05:31:17 kjcf05n03 dcs-collectord[5655]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 05:31:17 kjcf05n03 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 05:31:17 kjcf05n03 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 05:31:17 kjcf05n03 systemd[1]: Startup finished in 50.934s (kernel) + 2min 30.340s (userspace) = 3min 21.274s. Nov 3 05:31:17 kjcf05n03 openhpid[18324]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 05:31:17 kjcf05n03 openhpid[18324]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 05:31:17 kjcf05n03 openhpid[18324]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 05:31:17 kjcf05n03 openhpid[18324]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 05:31:19 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18432 (bash) Nov 3 05:31:19 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 05:31:19 kjcf05n03 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 05:31:19 kjcf05n03 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 05:31:19 kjcf05n03 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 05:31:19 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 05:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730633479', 'host':'kjcf05n03', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 05:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730633479', 'host':'kjcf05n03', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 05:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730633479'} Nov 3 05:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730633479'} Nov 3 05:31:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:31:19 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 05:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730633479', 'host':'kjcf05n03', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 2.60, 2.20, 0.99'}"] Nov 3 05:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Load', 'description': 'OK - load average: 2.60, 2.20, 0.99', 'message': 'OK - load average: 2.60, 2.20, 0.99', 'value': 'ok', 'timestamp': '1730633479'} Nov 3 05:31:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730633479', 'host':'kjcf05n03', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 362 processes with STATE = RSZDT '}"] Nov 3 05:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Total Processes', 'description': 'PROCS OK: 362 processes with STATE = RSZDT ', 'message': 'PROCS OK: 362 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730633479'} Nov 3 05:31:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:31:20 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31416 deleted. Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 05:31:21 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 05:31:22 kjcf05n00 mcfcli[3673891]: %3|1730633482.038|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:31:23 kjcf05n00 zabbix-server[990936]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:31:23 kjcf05n00 zabbix-server[990936]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 238.95\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 105.84\\"}}"' Nov 3 05:31:24 kjcf05n00 log_interesting_event.py[990936]: Event '45797' acknowledged Nov 3 05:31:24 kjcf05n00 mcfcli[3673891]: %3|1730633484.132|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:31:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730633486', 'host':'kjcf05n03', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(3920.0B/2736.0B), ib1=(2576.0B/2200.0B), icl0=(8.2kB/9.9kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.1MB), mgmt0=(1478.2MB/8.0MB)'}"] Nov 3 05:31:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(3920.0B/2736.0B), ib1=(2576.0B/2200.0B), icl0=(8.2kB/9.9kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.1MB), mgmt0=(1478.2MB/8.0MB)', 'message': 'NET OK - (Rx/Tx) ib0=(3920.0B/2736.0B), ib1=(2576.0B/2200.0B), icl0=(8.2kB/9.9kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.1MB), mgmt0=(1478.2MB/8.0MB)', 'value': 'ok', 'timestamp': '1730633486'} Nov 3 05:31:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:31:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730633487', 'host':'kjcf05n03', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 05:31:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730633487'} Nov 3 05:31:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:31:28 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 05:31:28 kjcf05n03 dcs-collectord[5655]: WARNING No data collected (hpi_parser.py:353) Nov 3 05:31:41 kjcf05n03 ipmievd[3994]: System Event sensor - Timestamp Clock Sync Nov 3 05:31:43 kjcf05n03 ipmievd[3161]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:31:43 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b07bed_S4EUNF0MA05387D encl_sn: USE26000024VS001, slot: 2 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b07bec_S4EUNF0MA05386M encl_sn: USE26000024VS001, slot: 1 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 05:31:53 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 05:31:54 kjcf05n00 mcfcli[3673891]: %3|1730633514.132|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:31:58 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 05:32:01 kjcf05n03 diskmonitor[17394]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 05:32:01 kjcf05n03 ras-resource-manager-agent[5919]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "3def58ae-99d7-11ef-9e66-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 05:32:01 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '3def58ae-99d7-11ef-9e66-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 05:32:01 kjcf05n03 ras-resource-manager-agent[5919]: INFO Submitting new device inserted signal, starting to qualify drive: 3def58ae-99d7-11ef-9e66-00093d069a1b (admin_action.py:110) Nov 3 05:32:01 kjcf05n02 firmware-update-orc-server[5862]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "fa53ad7e-8f8b-4072-805b-ca3e121f9b2f"} (logger.py:65) Nov 3 05:32:01 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 86152 (get_disk_device) Nov 3 05:32:01 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 05:32:01 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 05:32:00 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '3def58ae-99d7-11ef-9e66-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 05:32:00 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '3def58ae-99d7-11ef-9e66-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 05:32:00 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '3def58ae-99d7-11ef-9e66-00093d069a1b', 'response ID': '3dfa82f6-99d7-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 05:32:00 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 3dfa82f6-99d7-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 05:32:01 kjcf05n02 ccp-client[86187]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 05:32:01 kjcf05n02 ccp-client[86187]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 05:32:01 kjcf05n02 ccp-client[86199]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 05:32:01 kjcf05n02 ccp-client[86187]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 05:32:01 kjcf05n02 ccp-client[86199]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 05:32:01 kjcf05n02 ccp-client[86199]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 05:32:01 kjcf05n02 ccp-client[86187]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 05:32:01 kjcf05n03 diskmonitor[17394]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 05:32:01 kjcf05n03 ras-resource-manager-agent[5919]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "3e3b7482-99d7-11ef-9e66-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 05:32:01 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '3e3b7482-99d7-11ef-9e66-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 05:32:01 kjcf05n03 ras-resource-manager-agent[5919]: INFO Submitting new device inserted signal, starting to qualify drive: 3e3b7482-99d7-11ef-9e66-00093d069a1b (admin_action.py:110) Nov 3 05:32:01 kjcf05n03 firmware-update-orc-server[5878]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "5d1c1b85-6e30-4d05-9462-9b722fb3b1e7"} (logger.py:65) Nov 3 05:32:01 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '3e3b7482-99d7-11ef-9e66-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 05:32:01 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '3e3b7482-99d7-11ef-9e66-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 05:32:01 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '3e3b7482-99d7-11ef-9e66-00093d069a1b', 'response ID': '3e437772-99d7-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 05:32:01 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 3e437772-99d7-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 05:32:02 kjcf05n00 mcfcli[3673891]: %3|1730633522.035|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:32:04 kjcf05n02 DRVFW[86371]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 05:32:04 kjcf05n02 ccp-client[86372]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 05:32:04 kjcf05n02 ccp-client[86372]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 05:32:04 kjcf05n02 ccp-client[86381]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 05:32:04 kjcf05n02 ccp-client[86372]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 05:32:04 kjcf05n02 ccp-client[86381]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 05:32:04 kjcf05n02 ccp-client[86372]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 05:32:04 kjcf05n02 ccp-client[86381]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 05:32:04 kjcf05n02 firmware-update-orc-server[5862]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 05:32:05 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 3dfa82f6-99d7-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 05:32:05 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '3def58ae-99d7-11ef-9e66-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': '3def58ae-99d7-11ef-9e66-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}}} (logger.py:65) Nov 3 05:32:06 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '3def58ae-99d7-11ef-9e66-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 05:32:06 kjcf05n03 ras-resource-manager-agent[5919]: INFO Drive qualification complete responding: 3def58ae-99d7-11ef-9e66-00093d069a1b (admin_action.py:205) Nov 3 05:32:06 kjcf05n03 ras-resource-manager-agent[5919]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "3def58ae-99d7-11ef-9e66-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (interesting_event.py:59) Nov 3 05:32:07 kjcf05n02 nslcd[7234]: [e8944a] ldap_result() failed: Can't contact LDAP server Nov 3 05:32:10 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 05:32:10 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 05:32:10 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 05:32:10 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 05:32:10 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 05:32:10 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 05:32:10 kjcf05n03 diskmonitor[17394]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 05:32:10 kjcf05n03 diskmonitor[17394]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 05:32:10 kjcf05n03 diskmonitor[17394]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 05:32:10 kjcf05n03 diskmonitor[17394]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 05:32:10 kjcf05n03 diskmonitor[17394]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 05:32:10 kjcf05n03 diskmonitor[17394]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "3def58ae-99d7-11ef-9e66-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 05:32:10 kjcf05n03 diskmonitor[17394]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 05:32:10 kjcf05n03 diskmonitor[17394]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 05:32:10 kjcf05n03 diskmonitor[17394]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "3e3b7482-99d7-11ef-9e66-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 05:32:10 kjcf05n03 diskmonitor[17394]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 05:32:10 kjcf05n03 diskmonitor[17394]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 05:32:14 kjcf05n03 chronyd[5162]: Selected source 16.110.135.123 Nov 3 05:32:16 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22280 (get_disk_device) Nov 3 05:32:16 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 05:32:16 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 05:32:16 kjcf05n03 ccp-client[22301]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 05:32:16 kjcf05n03 ccp-client[22301]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 05:32:16 kjcf05n03 ccp-client[22318]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 05:32:16 kjcf05n03 ccp-client[22301]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 05:32:16 kjcf05n03 ccp-client[22301]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 05:32:16 kjcf05n03 ccp-client[22318]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 05:32:16 kjcf05n03 ccp-client[22318]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 05:32:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730633537}"] Nov 3 05:32:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730633537, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:32:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:32:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730633537}"] Nov 3 05:32:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730633537, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:32:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:32:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730633537}"] Nov 3 05:32:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730633537, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:32:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:32:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730633537}"] Nov 3 05:32:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730633537, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:32:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:32:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730633537}"] Nov 3 05:32:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730633537, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:32:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:32:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730633537}"] Nov 3 05:32:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730633537, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:32:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:32:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730633537}"] Nov 3 05:32:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730633537, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:32:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:32:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730633537}"] Nov 3 05:32:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730633537, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:32:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:32:19 kjcf05n03 DRVFW[22541]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 05:32:20 kjcf05n03 ccp-client[22542]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 05:32:20 kjcf05n03 ccp-client[22542]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 05:32:20 kjcf05n03 ccp-client[22554]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 05:32:20 kjcf05n03 ccp-client[22542]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 05:32:20 kjcf05n03 ccp-client[22542]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 05:32:20 kjcf05n03 ccp-client[22554]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 05:32:20 kjcf05n03 ccp-client[22554]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 05:32:20 kjcf05n03 systemd[1]: Unmounting /mnt/llog... Nov 3 05:32:20 kjcf05n03 firmware-update-orc-server[5878]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 05:32:20 kjcf05n03 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 05:32:20 kjcf05n03 systemd[1]: Unmounted /mnt/llog. Nov 3 05:32:20 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '3e3b7482-99d7-11ef-9e66-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 05:32:20 kjcf05n03 ras-resource-manager-agent[5919]: INFO Drive qualification complete responding: 3e3b7482-99d7-11ef-9e66-00093d069a1b (admin_action.py:205) Nov 3 05:32:20 kjcf05n03 ras-resource-manager-agent[5919]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "3e3b7482-99d7-11ef-9e66-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (interesting_event.py:59) Nov 3 05:32:20 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 3e437772-99d7-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 05:32:20 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '3e3b7482-99d7-11ef-9e66-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': '3e3b7482-99d7-11ef-9e66-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}}} (logger.py:65) Nov 3 05:32:21 kjcf05n03 ras-resource-manager-agent[5919]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "3def58ae-99d7-11ef-9e66-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (service_main_handler.py:66) Nov 3 05:32:21 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '3def58ae-99d7-11ef-9e66-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 05:32:21 kjcf05n03 ras-resource-manager-agent[5919]: INFO Device qualification response has been acknowledged: 3def58ae-99d7-11ef-9e66-00093d069a1b (admin_action.py:151) Nov 3 05:32:21 kjcf05n03 ras-resource-manager-agent[5919]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "3e3b7482-99d7-11ef-9e66-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (service_main_handler.py:66) Nov 3 05:32:21 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '3e3b7482-99d7-11ef-9e66-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 05:32:21 kjcf05n03 ras-resource-manager-agent[5919]: INFO Device qualification response has been acknowledged: 3e3b7482-99d7-11ef-9e66-00093d069a1b (admin_action.py:151) Nov 3 05:32:21 kjcf05n03 python3.9[5226]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 05:32:23 kjcf05n03 python3.9[3161]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "3def58ae-99d7-11ef-9e66-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: Dbus, handle_ingress_ras_signals, uuid: 3def58ae-99d7-11ef-9e66-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "3def58ae-99d7-11ef-9e66-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "3e3b7482-99d7-11ef-9e66-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: Dbus, handle_ingress_ras_signals, uuid: 3e3b7482-99d7-11ef-9e66-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "3e3b7482-99d7-11ef-9e66-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 05:32:23 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 05:32:24 kjcf05n00 mcfcli[3673891]: %3|1730633544.132|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 05:32:25 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 05:32:25 kjcf05n03 diskmonitor[17394]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 05:32:30 kjcf05n03 diskmonitor[17394]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 05:32:30 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 05:32:30 kjcf05n03 diskmonitor[17394]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 05:32:30 kjcf05n03 diskmonitor[17394]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 05:32:30 kjcf05n03 diskmonitor[17394]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 05:32:30 kjcf05n03 diskmonitor[17394]: leaving test state: 1 next state: 2 Nov 3 05:32:30 kjcf05n03 diskmonitor[17394]: lock req: no timeout Nov 3 05:32:30 kjcf05n03 diskmonitor[17394]: leaving test state: 2 next state: 4 Nov 3 05:32:30 kjcf05n03 diskmonitor[17394]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 05:32:37 kjcf05n00 mcfcli[3673891]: %3|1730633557.921|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:32:54 kjcf05n00 mcfcli[3673891]: %3|1730633574.132|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:33:17 kjcf05n00 mcfcli[3673891]: %3|1730633597.918|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:33:22 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 05:33:22 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 05:33:22 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 05:33:24 kjcf05n00 mcfcli[3673891]: %3|1730633604.133|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T05:33:27.253013305-06:00 level=info msg="Completed cleanup jobs" duration=26.194327ms Nov 3 05:33:34 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/21', errno='Permission denied (13)' Nov 3 05:33:37 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 05:33:37 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 05:33:37 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 05:33:38 kjcf05n03 dcs-collectord[5655]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 05:33:45 kjcf05n03 diskmonitor[17394]: lock acquired Nov 3 05:33:45 kjcf05n03 diskmonitor[17394]: leaving test state: 4 next state: 8 Nov 3 05:33:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730633627}"] Nov 3 05:33:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730633627, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:33:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:33:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:33:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:33:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:33:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:33:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:33:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:33:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:33:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:33:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:33:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:33:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:33:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:33:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.246588ms Nov 3 05:33:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:33:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.246588ms Nov 3 05:33:47 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:33:47 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:33:47 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:33:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730633627}"] Nov 3 05:33:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730633627, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:33:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:33:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:33:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:33:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:33:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:33:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:33:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:33:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:33:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:33:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:33:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:33:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:33:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:33:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.946285ms Nov 3 05:33:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:33:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.946285ms Nov 3 05:33:47 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:33:47 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:33:47 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:33:54 kjcf05n00 mcfcli[3673891]: %3|1730633634.134|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:33:56 kjcf05n00 mcfcli[3673891]: %3|1730633636.267|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:34:04 kjcf05n03 diskmonitor[17394]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 05:34:04 kjcf05n03 diskmonitor[17394]: leaving test state: 8 next state: 20 Nov 3 05:34:04 kjcf05n03 diskmonitor[17394]: leaving test state: 20 next state: 40 Nov 3 05:34:04 kjcf05n03 diskmonitor[17394]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 244edfb0000 Nov 3 05:34:04 kjcf05n03 diskmonitor[17394]: leaving test state: 40 next state: 80 Nov 3 05:34:24 kjcf05n00 mcfcli[3673891]: %3|1730633664.134|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 05:34:33 kjcf05n00 mcfcli[3673891]: %3|1730633673.838|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:34:54 kjcf05n00 mcfcli[3673891]: %3|1730633694.134|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 05:35:03 kjcf05n00 python3.9[993076]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 05:35:08 kjcf05n03 diskmonitor[17394]: leaving test state: 80 next state: 100 Nov 3 05:35:08 kjcf05n03 diskmonitor[17394]: lock release: time: Sun Nov 3 05:35:02 2024 Nov 3 05:35:08 kjcf05n03 diskmonitor[17394]: leaving test state: 100 next state: 1 Nov 3 05:35:13 kjcf05n00 mcfcli[3673891]: %3|1730633713.653|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730633416', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 05:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730633416'} Nov 3 05:35:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730633114', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 05:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730633114'} Nov 3 05:35:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:35:17 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 05:35:24 kjcf05n00 mcfcli[3673891]: %3|1730633724.134|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:35:53 kjcf05n00 mcfcli[3673891]: %3|1730633753.045|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:35:54 kjcf05n00 mcfcli[3673891]: %3|1730633754.134|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:36:24 kjcf05n00 mcfcli[3673891]: %3|1730633784.136|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 05:36:27 kjcf05n00 mcfcli[3673891]: %3|1730633787.744|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:36:54 kjcf05n00 mcfcli[3673891]: %3|1730633814.137|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:37:05 kjcf05n00 mcfcli[3673891]: %3|1730633825.309|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:37:24 kjcf05n00 mcfcli[3673891]: %3|1730633844.137|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:37:44 kjcf05n00 mcfcli[3673891]: %3|1730633864.751|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:37:54 kjcf05n00 mcfcli[3673891]: %3|1730633874.137|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:38:24 kjcf05n00 mcfcli[3673891]: %3|1730633904.138|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:38:24 kjcf05n00 mcfcli[3673891]: %3|1730633904.452|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:38:42 kjcf05n03 chronyd[5162]: Selected source 172.16.2.1 Nov 3 05:38:54 kjcf05n00 mcfcli[3673891]: %3|1730633934.138|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 05:39:02 kjcf05n00 mcfcli[3673891]: %3|1730633942.353|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:39:24 kjcf05n00 mcfcli[3673891]: %3|1730633964.139|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:39:42 kjcf05n00 mcfcli[3673891]: %3|1730633982.350|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:39:54 kjcf05n00 mcfcli[3673891]: %3|1730633994.139|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 05:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 05:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 05:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 05:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 05:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 05:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 05:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 05:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 05:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 05:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 05:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 05:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 05:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 05:40:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 05:40:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:40:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 05:40:03 kjcf05n00 python3.9[995929]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 05:40:18 kjcf05n00 mcfcli[3673891]: %3|1730634018.677|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:40:24 kjcf05n00 mcfcli[3673891]: %3|1730634024.140|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 05:40:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730633416', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 05:40:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730633416'} Nov 3 05:40:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:40:54 kjcf05n00 mcfcli[3673891]: %3|1730634054.140|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:40:57 kjcf05n00 mcfcli[3673891]: %3|1730634057.685|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:41:24 kjcf05n00 mcfcli[3673891]: %3|1730634084.141|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 05:41:35 kjcf05n00 mcfcli[3673891]: %3|1730634095.131|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:41:54 kjcf05n03 root[41167]: failback_xyraid Nov 3 05:41:54 kjcf05n00 mcfcli[3673891]: %3|1730634114.141|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:41:55 kjcf05n03 root[41289]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 05:41:56 kjcf05n03 root[41350]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 05:42:00 kjcf05n02 systemd[1]: data-kjcf05n03:md66.mount: Succeeded. Nov 3 05:42:03 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme21n1 Nov 3 05:42:03 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme6n1 Nov 3 05:42:03 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme12n1 Nov 3 05:42:03 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme7n1 Nov 3 05:42:03 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme16n1 Nov 3 05:42:03 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme11n1 Nov 3 05:42:03 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme5n1 Nov 3 05:42:03 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme20n1 Nov 3 05:42:03 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme10n1 Nov 3 05:42:03 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme22n1 Nov 3 05:42:03 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme15n1 Nov 3 05:42:05 kjcf05n03 dwd[5197]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 05:42:05 kjcf05n03 dwd[5197]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 05:42:05 kjcf05n03 dwd[5197]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 05:42:05 kjcf05n03 dwd[5197]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 05:42:05 kjcf05n03 dwd[5197]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 05:42:05 kjcf05n03 dwd[5197]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 05:42:05 kjcf05n03 dwd[5197]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 05:42:05 kjcf05n03 dwd[5197]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 05:42:05 kjcf05n03 dwd[5197]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 05:42:05 kjcf05n03 dwd[5197]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 05:42:05 kjcf05n03 dwd[5197]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 05:42:05 kjcf05n03 dwd[5197]: Starting NVME thread for nvme10n1 Nov 3 05:42:05 kjcf05n03 dwd[5197]: Starting NVME thread for nvme15n1 Nov 3 05:42:05 kjcf05n03 dwd[5197]: Starting NVME thread for nvme21n1 Nov 3 05:42:06 kjcf05n03 dwd[5197]: Starting NVME thread for nvme11n1 Nov 3 05:42:06 kjcf05n03 dwd[5197]: Starting NVME thread for nvme20n1 Nov 3 05:42:06 kjcf05n03 dwd[5197]: Starting NVME thread for nvme12n1 Nov 3 05:42:06 kjcf05n03 systemd-udevd[44218]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44219]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44221]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44218]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44219]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44224]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44221]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44218]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44224]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44219]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44221]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44218]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44219]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44224]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44221]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44218]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44219]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44224]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44221]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44218]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44219]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44224]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44218]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44221]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44219]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44224]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44218]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44221]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44219]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44224]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44218]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44219]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44256]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44258]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44260]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44255]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44262]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44258]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44260]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44262]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44255]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44256]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44258]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44255]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44258]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44255]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44256]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44255]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44256]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44255]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44256]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44255]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44256]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44255]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44255]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44256]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44255]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44256]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44255]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44256]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44255]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44255]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44255]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:42:06 kjcf05n03 systemd-udevd[44255]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:42:07 kjcf05n03 nslcd[7249]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 05:42:07 kjcf05n03 dwd[5197]: Starting NVME thread for nvme7n1 Nov 3 05:42:07 kjcf05n03 dwd[5197]: Starting NVME thread for nvme6n1 Nov 3 05:42:07 kjcf05n03 dwd[5197]: Starting NVME thread for nvme5n1 Nov 3 05:42:07 kjcf05n03 dwd[5197]: Starting NVME thread for nvme16n1 Nov 3 05:42:07 kjcf05n03 dwd[5197]: Starting NVME thread for nvme22n1 Nov 3 05:42:10 kjcf05n03 dcs-bulk-data-sender[6206]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 141}' Nov 3 05:42:11 kjcf05n03 diskmonitor[17394]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 05:42:13 kjcf05n00 mcfcli[3673891]: %3|1730634133.006|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:42:18 kjcf05n03 diskmonitor[17394]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 05:42:18 kjcf05n03 diskmonitor[17394]: Scan for ReadErrorMax change for md66 Nov 3 05:42:18 kjcf05n03 diskmonitor[17394]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 05:42:18 kjcf05n03 diskmonitor[17394]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 05:42:18 kjcf05n03 diskmonitor[17394]: read_saved_file: md66 no saved speed Nov 3 05:42:18 kjcf05n03 diskmonitor[17394]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 05:42:18 kjcf05n03 diskmonitor[17394]: Set sync_speed_min (10000) for md66 Nov 3 05:42:18 kjcf05n03 diskmonitor[17394]: Set sync_speed_max (200000) for md66 Nov 3 05:42:18 kjcf05n03 diskmonitor[17394]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 05:42:24 kjcf05n00 mcfcli[3673891]: %3|1730634144.141|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:42:38 kjcf05n02 diskmonitor[17586]: Removed MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 05:42:38 kjcf05n02 diskmonitor[17586]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 05:42:46 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 46546 (bash) Nov 3 05:42:46 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 05:42:46 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 05:42:51 kjcf05n00 mcfcli[3673891]: %3|1730634171.228|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:42:54 kjcf05n00 mcfcli[3673891]: %3|1730634174.143|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 05:42:58 kjcf05n03 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 05:42:58 kjcf05n03 systemd-tmpfiles[47010]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 05:42:58 kjcf05n03 systemd-tmpfiles[47010]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 05:42:58 kjcf05n03 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 05:42:58 kjcf05n03 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 05:43:24 kjcf05n00 mcfcli[3673891]: %3|1730634204.143|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T05:43:27.253076954-06:00 level=info msg="Completed cleanup jobs" duration=26.483368ms Nov 3 05:43:30 kjcf05n00 mcfcli[3673891]: %3|1730634210.132|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:43:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730634227}"] Nov 3 05:43:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730634227, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:43:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.065809ms Nov 3 05:43:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.065809ms Nov 3 05:43:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:43:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:43:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:43:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730634227}"] Nov 3 05:43:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730634227, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:43:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.8742ms Nov 3 05:43:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.8742ms Nov 3 05:43:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:43:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:43:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:43:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730634227}"] Nov 3 05:43:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730634227, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:43:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.901121ms Nov 3 05:43:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.901121ms Nov 3 05:43:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:43:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:43:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:43:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730634227}"] Nov 3 05:43:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730634227, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:43:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.035632ms Nov 3 05:43:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.035632ms Nov 3 05:43:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:43:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:43:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:43:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730634227}"] Nov 3 05:43:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730634227, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:43:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.777619ms Nov 3 05:43:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.777619ms Nov 3 05:43:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:43:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:43:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:43:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730634227}"] Nov 3 05:43:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730634227, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:43:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.162129ms Nov 3 05:43:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.162129ms Nov 3 05:43:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:43:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:43:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:43:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730634228}"] Nov 3 05:43:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730634228, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:43:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.13545ms Nov 3 05:43:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.13545ms Nov 3 05:43:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:43:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:43:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:43:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730634228}"] Nov 3 05:43:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730634228, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:43:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.201422ms Nov 3 05:43:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.201422ms Nov 3 05:43:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:43:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:43:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:43:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730634228}"] Nov 3 05:43:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730634228, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:43:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.130399ms Nov 3 05:43:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.130399ms Nov 3 05:43:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:43:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:43:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:43:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730634228}"] Nov 3 05:43:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730634228, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:43:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.893967ms Nov 3 05:43:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.893967ms Nov 3 05:43:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:43:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:43:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:43:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730634228}"] Nov 3 05:43:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730634228, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 05:43:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 05:43:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T05:43:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 05:43:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T05:43:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 05:43:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T05:43:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.523874ms Nov 3 05:43:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T05:43:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.523874ms Nov 3 05:43:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:05:43:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 05:43:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:43:54 kjcf05n00 mcfcli[3673891]: %3|1730634234.143|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:44:02 kjcf05n00 zabbix-server[998310]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:44:02 kjcf05n00 zabbix-server[998310]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n03' from event '45812' Nov 3 05:44:02 kjcf05n00 zabbix-server[998310]: Filesystem 'kjcf05' has been mounted Nov 3 05:44:03 kjcf05n00 zabbix-server[998310]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 05:44:03 kjcf05n00 zabbix-server[998310]: Running puppet on 'None' Nov 3 05:44:05 kjcf05n02 puppet-agent[108656]: Using configured environment 'production' Nov 3 05:44:05 kjcf05n02 puppet-agent[108656]: Retrieving pluginfacts Nov 3 05:44:05 kjcf05n02 puppet-agent[108656]: Retrieving plugin Nov 3 05:44:05 kjcf05n06 puppet-agent[2400223]: Using configured environment 'production' Nov 3 05:44:05 kjcf05n06 puppet-agent[2400223]: Retrieving pluginfacts Nov 3 05:44:05 kjcf05n06 puppet-agent[2400223]: Retrieving plugin Nov 3 05:44:05 kjcf05n04 puppet-agent[2396760]: Using configured environment 'production' Nov 3 05:44:05 kjcf05n04 puppet-agent[2396760]: Retrieving pluginfacts Nov 3 05:44:05 kjcf05n04 puppet-agent[2396760]: Retrieving plugin Nov 3 05:44:05 kjcf05n03 puppet-agent[48790]: Using configured environment 'production' Nov 3 05:44:05 kjcf05n03 puppet-agent[48790]: Retrieving pluginfacts Nov 3 05:44:05 kjcf05n03 puppet-agent[48790]: Retrieving plugin Nov 3 05:44:05 kjcf05n07 puppet-agent[2397742]: Using configured environment 'production' Nov 3 05:44:05 kjcf05n07 puppet-agent[2397742]: Retrieving pluginfacts Nov 3 05:44:05 kjcf05n07 puppet-agent[2397742]: Retrieving plugin Nov 3 05:44:05 kjcf05n05 puppet-agent[2536995]: Using configured environment 'production' Nov 3 05:44:05 kjcf05n05 puppet-agent[2536995]: Retrieving pluginfacts Nov 3 05:44:05 kjcf05n05 puppet-agent[2536995]: Retrieving plugin Nov 3 05:44:05 kjcf05n02 puppet-agent[108656]: Loading facts Nov 3 05:44:05 kjcf05n06 puppet-agent[2400223]: Loading facts Nov 3 05:44:05 kjcf05n04 puppet-agent[2396760]: Loading facts Nov 3 05:44:05 kjcf05n01 puppet-agent[2924748]: Using configured environment 'production' Nov 3 05:44:05 kjcf05n01 puppet-agent[2924748]: Retrieving pluginfacts Nov 3 05:44:05 kjcf05n01 puppet-agent[2924748]: Retrieving plugin Nov 3 05:44:05 kjcf05n03 puppet-agent[48790]: Loading facts Nov 3 05:44:05 kjcf05n05 puppet-agent[2536995]: Loading facts Nov 3 05:44:05 kjcf05n00 puppet-agent[998378]: Using configured environment 'production' Nov 3 05:44:05 kjcf05n00 puppet-agent[998378]: Retrieving pluginfacts Nov 3 05:44:05 kjcf05n00 puppet-agent[998378]: Retrieving plugin Nov 3 05:44:06 kjcf05n07 puppet-agent[2397742]: Loading facts Nov 3 05:44:06 kjcf05n01 puppet-agent[2924748]: Loading facts Nov 3 05:44:06 kjcf05n00 puppet-agent[998378]: Loading facts Nov 3 05:44:06 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 05:44:08 kjcf05n06 puppet-agent[2400223]: Caching catalog for kjcf05n06 Nov 3 05:44:08 kjcf05n06 puppet-agent[2400223]: Applying configuration version '1730634247' Nov 3 05:44:09 kjcf05n07 puppet-agent[2397742]: Caching catalog for kjcf05n07 Nov 3 05:44:09 kjcf05n07 puppet-agent[2397742]: Applying configuration version '1730634248' Nov 3 05:44:09 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 05:44:09 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 05:44:10 kjcf05n03 puppet-agent[48790]: Caching catalog for kjcf05n03 Nov 3 05:44:10 kjcf05n03 puppet-agent[48790]: Applying configuration version '1730634246' Nov 3 05:44:10 kjcf05n02 puppet-agent[108656]: Caching catalog for kjcf05n02 Nov 3 05:44:10 kjcf05n02 puppet-agent[108656]: Applying configuration version '1730634246' Nov 3 05:44:10 kjcf05n00 mcfcli[3673891]: %3|1730634250.130|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:44:11 kjcf05n06 puppet-agent[2400223]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 05:44:11 kjcf05n06 puppet-agent[2400223]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 05:44:11 kjcf05n06 puppet-agent[2400223]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 05:44:11 kjcf05n00 puppet-agent[998378]: Caching catalog for kjcf05n00 Nov 3 05:44:11 kjcf05n00 puppet-agent[998378]: Applying configuration version '1730634249' Nov 3 05:44:11 kjcf05n07 puppet-agent[2397742]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 05:44:11 kjcf05n07 puppet-agent[2397742]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 05:44:11 kjcf05n07 puppet-agent[2397742]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 05:44:11 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2348004]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 05:44:11 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 05:44:11 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 05:44:11 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 05:44:11 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 05:44:11 kjcf05n06 puppet-agent[2400223]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: Press Ctrl+C to exit. Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: Plugin support version 1.0 Nov 3 05:44:11 kjcf05n06 zabbix_agent2[2400631]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 05:44:11 kjcf05n01 puppet-agent[2924748]: Caching catalog for kjcf05n01 Nov 3 05:44:11 kjcf05n01 puppet-agent[2924748]: Applying configuration version '1730634247' Nov 3 05:44:12 kjcf05n03 puppet-agent[48790]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 05:44:12 kjcf05n03 puppet-agent[48790]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 05:44:12 kjcf05n03 puppet-agent[48790]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 05:44:12 kjcf05n02 puppet-agent[108656]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 05:44:12 kjcf05n02 puppet-agent[108656]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 05:44:12 kjcf05n02 puppet-agent[108656]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 05:44:12 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2345490]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 05:44:12 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 05:44:12 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 05:44:12 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 05:44:12 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 05:44:12 kjcf05n07 puppet-agent[2397742]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: Press Ctrl+C to exit. Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: Plugin support version 1.0 Nov 3 05:44:12 kjcf05n07 zabbix_agent2[2398173]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 05:44:13 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 05:44:13 kjcf05n03 zabbix_agent2[6003]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 05:44:13 kjcf05n03 zabbix_agent2[3161]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 05:44:13 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 05:44:13 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 05:44:13 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 05:44:13 kjcf05n03 puppet-agent[48790]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: Press Ctrl+C to exit. Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: Plugin support version 1.0 Nov 3 05:44:13 kjcf05n03 zabbix_agent2[49296]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 05:44:13 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 05:44:13 kjcf05n02 zabbix_agent2[50262]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 05:44:13 kjcf05n02 zabbix_agent2[3168]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 05:44:13 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 05:44:13 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 05:44:13 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 05:44:13 kjcf05n02 puppet-agent[108656]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: Press Ctrl+C to exit. Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: Plugin support version 1.0 Nov 3 05:44:13 kjcf05n02 zabbix_agent2[109045]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 05:44:13 kjcf05n06 puppet-agent[2400223]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 05:44:13 kjcf05n06 puppet-agent[2400223]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 05:44:13 kjcf05n06 puppet-agent[2400223]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 05:44:14 kjcf05n00 puppet-agent[998378]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 05:44:14 kjcf05n06 puppet-agent[2400223]: Applied catalog in 5.49 seconds Nov 3 05:44:14 kjcf05n07 puppet-agent[2397742]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 05:44:14 kjcf05n07 puppet-agent[2397742]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 05:44:14 kjcf05n07 puppet-agent[2397742]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 05:44:15 kjcf05n07 puppet-agent[2397742]: Applied catalog in 5.17 seconds Nov 3 05:44:15 kjcf05n01 puppet-agent[2924748]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 05:44:15 kjcf05n01 puppet-agent[2924748]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-05:23:57]/mode) mode changed '0755' to '0750' Nov 3 05:44:15 kjcf05n01 puppet-agent[2924748]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-05:23:57/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 05:44:15 kjcf05n01 puppet-agent[2924748]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-05:23:57/vmcore]/mode) mode changed '0600' to '0640' Nov 3 05:44:15 kjcf05n01 puppet-agent[2924748]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-05:23:57/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 05:44:15 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 05:44:15 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 05:44:15 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 05:44:15 kjcf05n02 puppet-agent[108656]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 05:44:15 kjcf05n02 puppet-agent[108656]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 05:44:15 kjcf05n02 puppet-agent[108656]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 05:44:15 kjcf05n00 puppet-agent[998378]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 05:44:15 kjcf05n00 puppet-agent[998378]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 05:44:15 kjcf05n00 puppet-agent[998378]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 05:44:15 kjcf05n03 puppet-agent[48790]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 05:44:15 kjcf05n03 puppet-agent[48790]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 05:44:15 kjcf05n03 puppet-agent[48790]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 05:44:15 kjcf05n02 puppet-agent[108656]: Applied catalog in 5.16 seconds Nov 3 05:44:15 kjcf05n03 puppet-agent[48790]: Applied catalog in 5.40 seconds Nov 3 05:44:15 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 05:44:15 kjcf05n00 zabbix_agent2[980186]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 05:44:15 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 05:44:15 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 05:44:15 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 05:44:15 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 05:44:15 kjcf05n00 puppet-agent[998378]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 05:44:16 kjcf05n01 puppet-agent[2924748]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 05:44:16 kjcf05n01 puppet-agent[2924748]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 05:44:16 kjcf05n01 puppet-agent[2924748]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: Press Ctrl+C to exit. Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: Plugin support version 1.0 Nov 3 05:44:15 kjcf05n00 zabbix_agent2[998986]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 05:44:16 kjcf05n00 zabbix-server[999013]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:44:16 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2912979]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 05:44:16 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 05:44:16 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 05:44:16 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 05:44:16 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 05:44:16 kjcf05n01 puppet-agent[2924748]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: Press Ctrl+C to exit. Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: Plugin support version 1.0 Nov 3 05:44:16 kjcf05n01 zabbix_agent2[2925104]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 05:44:16 kjcf05n00 zabbix-server[999043]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:44:17 kjcf05n00 zabbix-server[999064]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:44:17 kjcf05n00 zabbix-server[999090]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:44:17 kjcf05n00 puppet-agent[998378]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 05:44:18 kjcf05n01 puppet-agent[2924748]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_053117.log]/mode) mode changed '0644' to '0640' Nov 3 05:44:18 kjcf05n01 puppet-agent[2924748]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_054246.log]/mode) mode changed '0644' to '0640' Nov 3 05:44:18 kjcf05n00 puppet-agent[998378]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 05:44:18 kjcf05n00 puppet-agent[998378]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 05:44:18 kjcf05n00 puppet-agent[998378]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 05:44:19 kjcf05n01 puppet-agent[2924748]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_053119.log]/mode) mode changed '0644' to '0640' Nov 3 05:44:19 kjcf05n01 puppet-agent[2924748]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_054246.log]/mode) mode changed '0644' to '0640' Nov 3 05:44:19 kjcf05n01 puppet-agent[2924748]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_054246]/mode) mode changed '0755' to '0750' Nov 3 05:44:19 kjcf05n01 puppet-agent[2924748]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_054246/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 05:44:19 kjcf05n01 puppet-agent[2924748]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 05:44:19 kjcf05n01 puppet-agent[2924748]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 05:44:19 kjcf05n01 puppet-agent[2924748]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 05:44:19 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 05:44:19 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 05:44:19 kjcf05n00 puppet-agent[998378]: Applied catalog in 8.66 seconds Nov 3 05:44:20 kjcf05n01 puppet-agent[2924748]: Applied catalog in 8.82 seconds Nov 3 05:44:21 kjcf05n05 puppet-agent[2536995]: Caching catalog for kjcf05n05 Nov 3 05:44:21 kjcf05n05 puppet-agent[2536995]: Applying configuration version '1730634259' Nov 3 05:44:23 kjcf05n05 puppet-agent[2536995]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 05:44:23 kjcf05n05 puppet-agent[2536995]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 05:44:23 kjcf05n05 puppet-agent[2536995]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 05:44:24 kjcf05n00 mcfcli[3673891]: %3|1730634264.143|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 05:44:24 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2491476]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 05:44:24 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 05:44:24 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 05:44:24 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 05:44:24 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 05:44:24 kjcf05n05 puppet-agent[2536995]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: Press Ctrl+C to exit. Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: Plugin support version 1.0 Nov 3 05:44:24 kjcf05n05 zabbix_agent2[2538006]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 05:44:26 kjcf05n05 puppet-agent[2536995]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 05:44:26 kjcf05n05 puppet-agent[2536995]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 05:44:26 kjcf05n05 puppet-agent[2536995]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 05:44:26 kjcf05n05 puppet-agent[2536995]: Applied catalog in 4.84 seconds Nov 3 05:44:48 kjcf05n00 mcfcli[3673891]: %3|1730634288.843|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:44:51 kjcf05n04 puppet-agent[2396760]: Caching catalog for kjcf05n04 Nov 3 05:44:51 kjcf05n04 puppet-agent[2396760]: Applying configuration version '1730634289' Nov 3 05:44:53 kjcf05n04 puppet-agent[2396760]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 05:44:53 kjcf05n04 puppet-agent[2396760]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 05:44:53 kjcf05n04 puppet-agent[2396760]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 05:44:53 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2352329]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 05:44:53 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 05:44:53 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 05:44:53 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 05:44:53 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 05:44:53 kjcf05n04 puppet-agent[2396760]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: Starting Zabbix Agent 2 (6.2.1) Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: Press Ctrl+C to exit. Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: Plugin support version 1.0 Nov 3 05:44:53 kjcf05n04 zabbix_agent2[2398446]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 05:44:54 kjcf05n00 mcfcli[3673891]: %3|1730634294.144|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:44:55 kjcf05n04 puppet-agent[2396760]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 05:44:55 kjcf05n04 puppet-agent[2396760]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 05:44:55 kjcf05n04 puppet-agent[2396760]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 05:44:55 kjcf05n04 puppet-agent[2396760]: Applied catalog in 4.70 seconds Nov 3 05:44:55 kjcf05n00 zabbix-server[998310]: puppet completed status:(0): '' Nov 3 05:44:55 kjcf05n00 zabbix-server[998310]: Event '45812' acknowledged Nov 3 05:44:55 kjcf05n00 zabbix-server[998310]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n03"}' Nov 3 05:44:57 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 05:45:05 kjcf05n00 python3.9[999549]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 05:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730634318', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 05:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730634318'} Nov 3 05:45:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730634318', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 05:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730634318'} Nov 3 05:45:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 05:45:24 kjcf05n00 mcfcli[3673891]: %3|1730634324.144|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:45:28 kjcf05n00 mcfcli[3673891]: %3|1730634328.841|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:45:54 kjcf05n00 mcfcli[3673891]: %3|1730634354.145|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:46:06 kjcf05n00 mcfcli[3673891]: %3|1730634366.481|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:46:24 kjcf05n00 mcfcli[3673891]: %3|1730634384.145|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:46:46 kjcf05n00 mcfcli[3673891]: %3|1730634406.478|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:46:54 kjcf05n00 mcfcli[3673891]: %3|1730634414.146|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:47:20 kjcf05n03 dwd[5197]: nvme10n1 passed periodic SMART status check Nov 3 05:47:20 kjcf05n03 dwd[5197]: nvme15n1 passed periodic SMART status check Nov 3 05:47:21 kjcf05n03 dwd[5197]: nvme20n1 passed periodic SMART status check Nov 3 05:47:21 kjcf05n03 dwd[5197]: nvme11n1 passed periodic SMART status check Nov 3 05:47:21 kjcf05n03 dwd[5197]: nvme21n1 passed periodic SMART status check Nov 3 05:47:21 kjcf05n03 dwd[5197]: nvme12n1 passed periodic SMART status check Nov 3 05:47:22 kjcf05n03 dwd[5197]: nvme7n1 passed periodic SMART status check Nov 3 05:47:22 kjcf05n03 dwd[5197]: nvme6n1 passed periodic SMART status check Nov 3 05:47:22 kjcf05n03 dwd[5197]: nvme16n1 passed periodic SMART status check Nov 3 05:47:22 kjcf05n03 dwd[5197]: nvme5n1 passed periodic SMART status check Nov 3 05:47:22 kjcf05n03 dwd[5197]: nvme22n1 passed periodic SMART status check Nov 3 05:47:24 kjcf05n00 mcfcli[3673891]: %3|1730634444.146|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:47:24 kjcf05n00 mcfcli[3673891]: %3|1730634444.364|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:47:54 kjcf05n00 mcfcli[3673891]: %3|1730634474.147|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:47:59 kjcf05n00 mcfcli[3673891]: %3|1730634479.884|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:48:23 kjcf05n00 zabbix-server[1001605]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:48:23 kjcf05n00 zabbix-server[1001605]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 58.42\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 102.08\\"}}"' Nov 3 05:48:23 kjcf05n00 log_interesting_event.py[1001605]: Event '45813' acknowledged Nov 3 05:48:24 kjcf05n00 mcfcli[3673891]: %3|1730634504.148|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 05:48:34 kjcf05n00 mcfcli[3673891]: %3|1730634514.893|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:48:54 kjcf05n00 mcfcli[3673891]: %3|1730634534.148|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:49:12 kjcf05n00 mcfcli[3673891]: %3|1730634552.738|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:49:24 kjcf05n00 mcfcli[3673891]: %3|1730634564.148|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:49:50 kjcf05n00 mcfcli[3673891]: %3|1730634590.604|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:49:54 kjcf05n00 mcfcli[3673891]: %3|1730634594.150|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 05:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 05:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 05:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 05:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 05:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 05:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 05:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 05:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 05:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 05:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 05:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 05:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 05:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 05:50:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 05:50:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 05:50:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 05:50:04 kjcf05n00 python3.9[1002359]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 05:50:23 kjcf05n00 mcfcli[3673891]: %3|1730634623.276|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:50:24 kjcf05n00 mcfcli[3673891]: %3|1730634624.150|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:50:54 kjcf05n00 mcfcli[3673891]: %3|1730634654.150|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 05:50:58 kjcf05n00 mcfcli[3673891]: %3|1730634658.233|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:51:24 kjcf05n00 mcfcli[3673891]: %3|1730634684.151|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:51:36 kjcf05n00 mcfcli[3673891]: %3|1730634696.829|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:51:54 kjcf05n00 mcfcli[3673891]: %3|1730634714.151|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:52:10 kjcf05n02 nslcd[7234]: [e87ccd] ldap_result() failed: Can't contact LDAP server Nov 3 05:52:15 kjcf05n00 mcfcli[3673891]: %3|1730634735.843|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:52:24 kjcf05n00 mcfcli[3673891]: %3|1730634744.153|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:52:52 kjcf05n00 mcfcli[3673891]: %3|1730634772.257|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:52:54 kjcf05n00 mcfcli[3673891]: %3|1730634774.153|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 05:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T11:53:15.868342Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 05:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T11:53:15.868408Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.085ms Nov 3 05:53:24 kjcf05n00 mcfcli[3673891]: %3|1730634804.153|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T05:53:27.26776933-06:00 level=info msg="Completed cleanup jobs" duration=41.341004ms Nov 3 05:53:29 kjcf05n00 mcfcli[3673891]: %3|1730634809.873|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:53:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 05:53:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 05:53:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 05:53:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 05:53:52 kjcf05n00 zabbix_server[15723]: Zabbix agent item "system.uptime" on host "kjcf05n03" failed: first network error, wait for 15 seconds Nov 3 05:53:54 kjcf05n00 mcfcli[3673891]: %3|1730634834.154|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:53:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 05:53:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 05:53:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 05:53:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 05:53:58 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 05:53:58 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 05:53:58 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 05:53:58 kjcf05n02 fstonithd.py[15191]: My partner 172.16.2.6 is kdumping. Forcing HA into GATHER state. Nov 3 05:54:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 05:54:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 05:54:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 05:54:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 05:54:00 kjcf05n02 root[125951]: is_enc_ipmi_off starts Nov 3 05:54:00 kjcf05n02 root[125953]: is_viking_off starts Nov 3 05:54:00 kjcf05n02 root[125970]: I am master Nov 3 05:54:00 kjcf05n02 root[125973]: I am in slot 0; partner is in slot 1 Nov 3 05:54:00 kjcf05n02 root[125978]: is_lan_ipmi_off leaves Nov 3 05:54:00 kjcf05n02 root[125983]: is_lan_ipmi_sec_off leaves Nov 3 05:54:07 kjcf05n02 root[126145]: is_viking_off leaves Nov 3 05:54:07 kjcf05n02 root[126154]: kjcf05n03 not already off look at kdump Nov 3 05:54:07 kjcf05n02 root[126160]: is_kdump_off starts Nov 3 05:54:07 kjcf05n02 fence_kdump[126161]: waiting for message from '172.16.2.6' Nov 3 05:54:07 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vfs.fs.size[/etc/ganesha,total]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 05:54:07 kjcf05n02 fence_kdump[126161]: received valid message from '172.16.2.6' Nov 3 05:54:07 kjcf05n02 root[126187]: is_kdump_off detected kdump on kjcf05n03 Nov 3 05:54:07 kjcf05n02 root[126188]: kjcf05n03 is kdumping Nov 3 05:54:08 kjcf05n02 root[126297]: is_viking_off starts Nov 3 05:54:08 kjcf05n02 root[126296]: is_enc_ipmi_off starts Nov 3 05:54:08 kjcf05n02 root[126354]: I am master Nov 3 05:54:08 kjcf05n02 root[126357]: I am in slot 0; partner is in slot 1 Nov 3 05:54:08 kjcf05n02 root[126365]: is_lan_ipmi_sec_off leaves Nov 3 05:54:08 kjcf05n02 root[126367]: is_lan_ipmi_off leaves Nov 3 05:54:09 kjcf05n00 zabbix_server[15734]: Zabbix agent item "vfs.fs.inode[/mnt/persistent_ha_data,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 05:54:09 kjcf05n00 mcfcli[3673891]: %3|1730634849.870|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:54:10 kjcf05n00 zabbix_server[15768]: Zabbix agent item "vfs.fs.inode[/var/lib/pacemaker,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 05:54:11 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='136', error='Connection reset by peer (104)' Nov 3 05:54:11 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='136', client='AF_INET(172.16.2.6:39665)', local='AF_INET(0.0.0.0:601)' Nov 3 05:54:14 kjcf05n02 root[126481]: is_viking_off leaves Nov 3 05:54:14 kjcf05n02 root[126484]: kjcf05n03 not already off look at kdump Nov 3 05:54:14 kjcf05n02 root[126485]: is_kdump_off starts Nov 3 05:54:14 kjcf05n02 fence_kdump[126486]: waiting for message from '172.16.2.6' Nov 3 05:54:15 kjcf05n02 fence_kdump[126486]: received valid message from '172.16.2.6' Nov 3 05:54:15 kjcf05n02 root[126487]: is_kdump_off detected kdump on kjcf05n03 Nov 3 05:54:15 kjcf05n02 root[126488]: kjcf05n03 is kdumping Nov 3 05:54:16 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 05:54:16 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 05:54:19 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib0 Nov 3 05:54:19 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib0 Nov 3 05:54:19 kjcf05n02 dwd[5183]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 05:54:19 kjcf05n02 dwd[5183]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 05:54:19 kjcf05n02 dwd[5183]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 05:54:19 kjcf05n02 dwd[5183]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 05:54:19 kjcf05n02 dwd[5183]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 05:54:19 kjcf05n02 dwd[5183]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 05:54:19 kjcf05n02 dwd[5183]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 05:54:19 kjcf05n02 dwd[5183]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 05:54:19 kjcf05n02 dwd[5183]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 05:54:19 kjcf05n02 dwd[5183]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 05:54:19 kjcf05n02 dwd[5183]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 05:54:19 kjcf05n02 dwd[5183]: Starting NVME thread for nvme6n1 Nov 3 05:54:20 kjcf05n02 dwd[5183]: Starting NVME thread for nvme15n1 Nov 3 05:54:20 kjcf05n02 dwd[5183]: Starting NVME thread for nvme16n1 Nov 3 05:54:20 kjcf05n02 dwd[5183]: Starting NVME thread for nvme5n1 Nov 3 05:54:20 kjcf05n02 dwd[5183]: Starting NVME thread for nvme20n1 Nov 3 05:54:20 kjcf05n02 dwd[5183]: Starting NVME thread for nvme11n1 Nov 3 05:54:20 kjcf05n02 systemd-udevd[128769]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128770]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128774]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128772]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128770]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128769]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128774]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128772]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128770]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128769]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128774]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128772]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128770]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128769]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128774]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128772]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128770]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128769]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128774]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128772]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128770]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128769]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128774]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128772]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128770]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128774]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128769]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128772]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128770]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128774]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128769]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128772]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128807]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128811]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128809]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128814]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128809]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128807]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128811]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128814]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128806]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128811]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128809]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128811]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128809]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128806]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128811]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128806]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128811]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128806]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128811]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128806]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128811]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128811]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128811]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128806]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128811]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128806]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128811]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128806]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128811]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128811]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128811]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 systemd-udevd[128811]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 05:54:20 kjcf05n02 dwd[5183]: Starting NVME thread for nvme22n1 Nov 3 05:54:20 kjcf05n02 dwd[5183]: Starting NVME thread for nvme21n1 Nov 3 05:54:21 kjcf05n02 dwd[5183]: Starting NVME thread for nvme12n1 Nov 3 05:54:21 kjcf05n02 dwd[5183]: Starting NVME thread for nvme10n1 Nov 3 05:54:21 kjcf05n02 dwd[5183]: Starting NVME thread for nvme7n1 Nov 3 05:54:23 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib1 Nov 3 05:54:23 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib1 Nov 3 05:54:24 kjcf05n00 mcfcli[3673891]: %3|1730634864.154|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:54:25 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.cpu.util[,steal]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 05:54:31 kjcf05n02 diskmonitor[17586]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 05:54:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 05:54:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 05:54:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 05:54:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 05:54:40 kjcf05n02 diskmonitor[17586]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 05:54:40 kjcf05n02 diskmonitor[17586]: Scan for ReadErrorMax change for md66 Nov 3 05:54:40 kjcf05n02 diskmonitor[17586]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 05:54:40 kjcf05n02 diskmonitor[17586]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 05:54:40 kjcf05n02 diskmonitor[17586]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.min.76c05c063fa0949b68ee86c1978c2ca8 file Nov 3 05:54:40 kjcf05n02 diskmonitor[17586]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.max.76c05c063fa0949b68ee86c1978c2ca8 file Nov 3 05:54:40 kjcf05n02 diskmonitor[17586]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 05:54:40 kjcf05n02 diskmonitor[17586]: Set sync_speed_min (10000) for md66 Nov 3 05:54:40 kjcf05n02 diskmonitor[17586]: Set sync_speed_max (200000) for md66 Nov 3 05:54:40 kjcf05n02 diskmonitor[17586]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 05:54:40 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n03": interface unavailable Nov 3 05:54:46 kjcf05n00 mcfcli[3673891]: %3|1730634886.175|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:54:54 kjcf05n00 mcfcli[3673891]: %3|1730634894.654|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 05:54:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 05:54:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 05:54:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 05:54:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 05:54:59 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 05:54:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 05:55:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 05:55:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 05:55:03 kjcf05n00 python3.9[1005362]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 05:55:19 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib0 Nov 3 05:55:19 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib0 Nov 3 05:55:23 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib1 Nov 3 05:55:23 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib1 Nov 3 05:55:24 kjcf05n00 mcfcli[3673891]: %3|1730634924.134|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:55:24 kjcf05n00 mcfcli[3673891]: %3|1730634924.655|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:55:28 kjcf05n02 nslcd[7234]: [b141f2] ldap_result() failed: Can't contact LDAP server Nov 3 05:55:28 kjcf05n02 nslcd[7234]: [b71efb] ldap_result() failed: Can't contact LDAP server Nov 3 05:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 05:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 05:55:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 05:55:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 05:55:54 kjcf05n00 mcfcli[3673891]: %3|1730634954.655|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 05:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 05:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 05:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 05:56:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 05:56:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 05:56:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 05:56:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 05:56:02 kjcf05n00 mcfcli[3673891]: %3|1730634962.703|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:56:19 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib0 Nov 3 05:56:19 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib0 Nov 3 05:56:23 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib1 Nov 3 05:56:23 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib1 Nov 3 05:56:24 kjcf05n00 mcfcli[3673891]: %3|1730634984.657|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 05:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 05:56:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 05:56:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 05:56:42 kjcf05n00 mcfcli[3673891]: %3|1730635002.700|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:56:54 kjcf05n00 mcfcli[3673891]: %3|1730635014.657|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 05:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 05:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 05:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 05:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 05:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 05:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 05:57:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 05:57:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 05:57:19 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib0 Nov 3 05:57:19 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib0 Nov 3 05:57:21 kjcf05n00 mcfcli[3673891]: %3|1730635041.800|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:57:23 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib1 Nov 3 05:57:23 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib1 Nov 3 05:57:25 kjcf05n00 mcfcli[3673891]: %3|1730635045.013|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 05:57:34 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:9a:1a Nov 3 05:57:34 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 05:57:34 kjcf05n00 zabbix-server[1007179]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 05:57:34 kjcf05n00 zabbix-server[1007179]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n03:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 05:57:34 kjcf05n00 log_interesting_event.py[1007179]: Event '45815' acknowledged Nov 3 05:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 05:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 05:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 05:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 05:57:38 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 05:57:38 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a kjcf05n03 Nov 3 05:57:38 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.6 Nov 3 05:57:38 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 05:57:38 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 05:57:38 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.6 Nov 3 05:57:38 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/pxelinux.cfg to 172.16.2.6 Nov 3 05:57:41 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/vmlinuz_diskless to 172.16.2.6 Nov 3 05:57:43 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/initramfs-diskless.img to 172.16.2.6 Nov 3 05:57:55 kjcf05n00 mcfcli[3673891]: %3|1730635075.013|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 05:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 05:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 05:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 05:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 05:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 05:58:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 05:58:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 05:58:01 kjcf05n00 mcfcli[3673891]: %3|1730635081.797|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:58:19 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib0 Nov 3 05:58:19 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib0 Nov 3 05:58:23 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib1 Nov 3 05:58:23 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib1 Nov 3 05:58:25 kjcf05n00 mcfcli[3673891]: %3|1730635105.159|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 05:58:31 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:44172). Nov 3 05:58:31 kjcf05n01 rsyncd[2930865]: connect from kjcf05n03 (172.16.2.6) Nov 3 05:58:31 kjcf05n01 rsyncd[2930865]: rsync on puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 05:58:31 kjcf05n01 rsyncd[2930865]: building file list Nov 3 05:58:31 kjcf05n01 rsyncd[2930865]: sent 11446 bytes received 136 bytes total size 10901 Nov 3 05:58:31 kjcf05n01 systemd[1]: rsyncd@601-172.16.2.2:873-172.16.2.6:44172.service: Succeeded. Nov 3 05:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 05:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 05:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 05:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 05:58:38 kjcf05n00 mcfcli[3673891]: %3|1730635118.146|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:58:55 kjcf05n00 mcfcli[3673891]: %3|1730635135.159|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 05:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 05:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 05:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 05:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 05:58:58 kjcf05n02 fstonithd.py[15191]: Listening for kdump packets from partner Nov 3 05:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 05:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 05:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 05:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 05:59:14 kjcf05n00 mcfcli[3673891]: %3|1730635154.450|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:59:18 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 05:59:19 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib0 Nov 3 05:59:19 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib0 Nov 3 05:59:23 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib1 Nov 3 05:59:23 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib1 Nov 3 05:59:25 kjcf05n00 mcfcli[3673891]: %3|1730635165.159|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 05:59:34 kjcf05n02 dwd[5183]: nvme6n1 passed periodic SMART status check Nov 3 05:59:35 kjcf05n02 dwd[5183]: nvme5n1 passed periodic SMART status check Nov 3 05:59:35 kjcf05n02 dwd[5183]: nvme20n1 passed periodic SMART status check Nov 3 05:59:35 kjcf05n02 dwd[5183]: nvme22n1 passed periodic SMART status check Nov 3 05:59:35 kjcf05n02 dwd[5183]: nvme11n1 passed periodic SMART status check Nov 3 05:59:35 kjcf05n02 dwd[5183]: nvme12n1 passed periodic SMART status check Nov 3 05:59:35 kjcf05n02 dwd[5183]: nvme16n1 passed periodic SMART status check Nov 3 05:59:35 kjcf05n02 dwd[5183]: nvme21n1 passed periodic SMART status check Nov 3 05:59:35 kjcf05n02 dwd[5183]: nvme15n1 passed periodic SMART status check Nov 3 05:59:35 kjcf05n02 dwd[5183]: nvme10n1 passed periodic SMART status check Nov 3 05:59:36 kjcf05n02 dwd[5183]: nvme7n1 passed periodic SMART status check Nov 3 05:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 05:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 05:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 05:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 05:59:52 kjcf05n00 mcfcli[3673891]: %3|1730635192.327|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 05:59:55 kjcf05n00 mcfcli[3673891]: %3|1730635195.160|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 05:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 05:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 05:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 05:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 06:00:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 06:00:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 06:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 06:00:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 06:00:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 06:00:00 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='107', client='AF_INET(172.16.2.6:35581)', local='AF_INET(0.0.0.0:601)' Nov 3 06:00:00 kjcf05n03 syslog-ng[3190]: Configuration reload request received, reloading configuration; Nov 3 06:00:00 kjcf05n03 syslog-ng[3190]: Configuration reload finished; Nov 3 06:00:00 kjcf05n03 syslog-ng[3190]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 06:00:00 kjcf05n03 dracut: dracut-049-135.git20210121.el8 Nov 3 06:00:00 kjcf05n03 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 06:00:00 kjcf05n03 dracut: Loading and integrity checking all crypto modules Nov 3 06:00:00 kjcf05n03 dracut: Self testing crypto algorithms Nov 3 06:00:00 kjcf05n03 dracut: rd.md=0: removing MD RAID activation Nov 3 06:00:00 kjcf05n03 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 06:00:00 kjcf05n03 Copying live image to RAM... Nov 3 06:00:00 kjcf05n03 (this may take a minute) Nov 3 06:00:00 kjcf05n03 Done copying live image to RAM. Nov 3 06:00:00 kjcf05n03 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 06:00:00 kjcf05n03 dracut: Checking integrity of kernel Nov 3 06:00:00 kjcf05n03 dracut: All initrd crypto checks done Nov 3 06:00:00 kjcf05n03 dracut: Switching root Nov 3 06:00:00 kjcf05n03 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 06:00:00 kjcf05n03 systemd: Detected architecture x86-64. Nov 3 06:00:00 kjcf05n03 systemd: Set hostname to . Nov 3 06:00:00 kjcf05n03 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 06:00:00 kjcf05n03 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 06:00:00 kjcf05n03 systemd: Listening on Journal Socket. Nov 3 06:00:00 kjcf05n03 systemd: Mounting /mnt... Nov 3 06:00:00 kjcf05n03 systemd: Mounting /WIBS... Nov 3 06:00:00 kjcf05n03 systemd: Listening on Device-mapper event daemon FIFOs. Nov 3 06:00:00 kjcf05n03 systemd: Listening on Journal Socket (/dev/log). Nov 3 06:00:00 kjcf05n03 systemd-journald[1536]: Journal started Nov 3 06:00:00 kjcf05n03 systemd-journald[1536]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 06:00:00 kjcf05n03 systemd-modules-load[1519]: Inserted module 'fuse' Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Remount Root and Kernel File Systems. Nov 3 06:00:00 kjcf05n03 systemd[1]: Mounted Kernel Debug File System. Nov 3 06:00:00 kjcf05n03 systemd[1]: Mounted Huge Pages File System. Nov 3 06:00:00 kjcf05n03 systemd[1]: Mounted Temporary Directory (/tmp). Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Load/Save Random Seed... Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Rebuild Hardware Database... Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Create System Users... Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 06:00:00 kjcf05n03 systemd[1]: Mounting FUSE Control File System... Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Apply Kernel Variables... Nov 3 06:00:00 kjcf05n03 systemd[1]: Mounting Kernel Configuration File System... Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Load/Save Random Seed. Nov 3 06:00:00 kjcf05n03 systemd[1]: Mounted FUSE Control File System. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Create System Users. Nov 3 06:00:00 kjcf05n03 systemd[1]: Mounted Kernel Configuration File System. Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 06:00:00 kjcf05n03 systemd-sysctl[1552]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 06:00:00 kjcf05n03 systemd-sysctl[1552]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Apply Kernel Variables. Nov 3 06:00:00 kjcf05n03 systemd-journald[1536]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 06:00:00 kjcf05n03 systemd-tmpfiles[1560]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 06:00:00 kjcf05n03 systemd-tmpfiles[1560]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started udev Coldplug all Devices. Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Rebuild Hardware Database. Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting udev Kernel Device Manager... Nov 3 06:00:00 kjcf05n03 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started udev Kernel Device Manager. Nov 3 06:00:00 kjcf05n03 systemd[1]: Found device /dev/ttyS0. Nov 3 06:00:00 kjcf05n03 systemd-udevd[1638]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:00:00 kjcf05n03 systemd-udevd[1642]: Using default interface naming scheme 'rhel-8.0'. Nov 3 06:00:00 kjcf05n03 systemd-udevd[1642]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:00:00 kjcf05n03 systemd-udevd[1589]: Using default interface naming scheme 'rhel-8.0'. Nov 3 06:00:00 kjcf05n03 systemd-udevd[1589]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:00:00 kjcf05n03 systemd-udevd[1581]: Using default interface naming scheme 'rhel-8.0'. Nov 3 06:00:00 kjcf05n03 systemd-udevd[1581]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 06:00:00 kjcf05n03 systemd[1]: Reached target Local File Systems (Pre). Nov 3 06:00:00 kjcf05n03 systemd[1]: Reached target Local File Systems. Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 06:00:00 kjcf05n03 root[1795]: openibd: running in auto mode Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Rebuild Journal Catalog. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 06:00:00 kjcf05n03 systemd-tmpfiles[1796]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 06:00:00 kjcf05n03 systemd-tmpfiles[1796]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 06:00:00 kjcf05n03 systemd-tmpfiles[1796]: "/var/tmp" already exists and is not a directory. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Create Volatile Files and Directories. Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting RPC Bind... Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 06:00:00 kjcf05n03 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 06:00:00 kjcf05n03 systemd[1]: Started RPC Bind. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started RDMA Node Description Daemon. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 06:00:00 kjcf05n03 systemd-modules-load[1854]: Inserted module 'ib_iser' Nov 3 06:00:00 kjcf05n03 systemd-modules-load[1854]: Inserted module 'ib_isert' Nov 3 06:00:00 kjcf05n03 systemd-modules-load[1854]: Inserted module 'ib_srpt' Nov 3 06:00:00 kjcf05n03 systemd-udevd[1616]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:00:00 kjcf05n03 systemd-udevd[1633]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:00:00 kjcf05n03 systemd-udevd[1633]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 06:00:00 kjcf05n03 systemd-udevd[1616]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 06:00:00 kjcf05n03 systemd-modules-load[1860]: Inserted module 'ib_ipoib' Nov 3 06:00:00 kjcf05n03 systemd-modules-load[1854]: Inserted module 'rdma_ucm' Nov 3 06:00:00 kjcf05n03 systemd-modules-load[1854]: Module 'svcrdma' is blacklisted Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 06:00:00 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 06:00:00 kjcf05n03 systemd[3190]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:00 kjcf05n03 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 06:00:00 kjcf05n03 systemd-modules-load[1860]: Inserted module 'ib_umad' Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 06:00:00 kjcf05n03 systemd[1]: Reached target Network (Pre). Nov 3 06:00:00 kjcf05n03 systemd[1]: Reached target RDMA Hardware. Nov 3 06:00:00 kjcf05n03 openibd[1777]: Loading HCA driver and Access Layer:[ OK ] Nov 3 06:00:00 kjcf05n03 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Update is Completed... Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Update is Completed. Nov 3 06:00:00 kjcf05n03 setup-icl[1758]: Setting LAN IP Address to 203.0.113.4 Nov 3 06:00:00 kjcf05n03 setup-icl[1758]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 06:00:00 kjcf05n03 setup-icl[1758]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 06:00:00 kjcf05n03 setup-icl[1758]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 06:00:00 kjcf05n03 systemd-udevd[1616]: Using default interface naming scheme 'rhel-8.0'. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 06:00:00 kjcf05n03 systemd[1]: Reached target System Initialization. Nov 3 06:00:00 kjcf05n03 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 06:00:00 kjcf05n03 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 06:00:00 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 06:00:00 kjcf05n03 systemd[1]: Listening on lldpad.socket. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 06:00:00 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 06:00:00 kjcf05n03 systemd[1]: Reached target Sockets. Nov 3 06:00:00 kjcf05n03 systemd[1]: Reached target Basic System. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 06:00:00 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 0 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 1 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 2 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 3 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 4 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 5 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 6 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 7 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 8 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 9 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 10 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 11 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 12 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 13 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 14 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 15 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 16 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 17 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 18 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 19 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 20 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 21 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 22 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 23 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 24 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 25 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 26 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 27 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 28 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 29 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 30 Nov 3 06:00:00 kjcf05n03 cpupower[2110]: Setting cpu: 31 Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 06:00:00 kjcf05n03 systemd[1]: Started D-Bus System Message Bus. Nov 3 06:00:00 kjcf05n03 beSetMlxConfig[2111]: ConnectX-3 multiport not detected Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Name Service Cache Daemon... Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[2131]: Setting up Mellanox network interface: ib1 Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 06:00:00 kjcf05n03 nscd[2147]: 2147 monitoring file `/etc/hosts` (1) Nov 3 06:00:00 kjcf05n03 nscd[2147]: 2147 monitoring directory `/etc` (2) Nov 3 06:00:00 kjcf05n03 nscd[2147]: 2147 monitoring file `/etc/resolv.conf` (3) Nov 3 06:00:00 kjcf05n03 nscd[2147]: 2147 monitoring directory `/etc` (2) Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 06:00:00 kjcf05n03 systemd[1]: Started irqbalance daemon. Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Resets System Activity Logs... Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 06:00:00 kjcf05n03 network[2176]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 06:00:00 kjcf05n03 dbus-daemon[2136]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 06:00:00 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 06:00:00 kjcf05n03 beSetMlxConfig[2111]: Starting MST (Mellanox Software Tools) driver set Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 06:00:00 kjcf05n03 chronyd[2243]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 06:00:00 kjcf05n03 network[2218]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 06:00:00 kjcf05n03 network[2176]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[2219]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 06:00:00 kjcf05n03 mcelog[2244]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 06:00:00 kjcf05n03 mcelog[2244]: CPU is unsupported Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[2240]: Setting up Mellanox network interface: ib0 Nov 3 06:00:00 kjcf05n03 beSetMlxConfig[2111]: Loading MST PCI module - Success Nov 3 06:00:00 kjcf05n03 dwd[2241]: dwd: option Lethal: 0 Nov 3 06:00:00 kjcf05n03 dwd[2241]: dwd: option Interval: 60 Nov 3 06:00:00 kjcf05n03 dwd[2241]: dwd: option abrtlimit: 10 Nov 3 06:00:00 kjcf05n03 dwd[2241]: dwd: option DZPeriod: 604800 Nov 3 06:00:00 kjcf05n03 dwd[2241]: dwd: option SmartPeriod: 43200 Nov 3 06:00:00 kjcf05n03 dwd[2241]: dwd: option SDDEnabled: 1 Nov 3 06:00:00 kjcf05n03 dwd[2241]: dwd: option SDDAwaitScale: 3 Nov 3 06:00:00 kjcf05n03 dwd[2241]: dwd: option SDDAwaitMin: 100 Nov 3 06:00:00 kjcf05n03 dwd[2241]: dwd: option Verbosity: 1 Nov 3 06:00:00 kjcf05n03 dwd[2241]: dwd: option StandAlone: 0 Nov 3 06:00:00 kjcf05n03 dwd[2241]: dwd: vMay 29 2024 : 15:38:26 Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 06:00:00 kjcf05n03 dwd[2241]: /usr/sbin/dwd -d --standalone=0 Nov 3 06:00:00 kjcf05n03 dwd[2241]: option Lethal: 0 Nov 3 06:00:00 kjcf05n03 dwd[2241]: option Interval: 60 Nov 3 06:00:00 kjcf05n03 dwd[2241]: option abrtlimit: 10 Nov 3 06:00:00 kjcf05n03 dwd[2241]: option DZPeriod: 604800 Nov 3 06:00:00 kjcf05n03 dwd[2241]: option SmartPeriod: 43200 Nov 3 06:00:00 kjcf05n03 dwd[2241]: option SDDEnabled: 1 Nov 3 06:00:00 kjcf05n03 dwd[2241]: option SDDAwaitScale: 3 Nov 3 06:00:00 kjcf05n03 dwd[2241]: option SDDAwaitMin: 100 Nov 3 06:00:00 kjcf05n03 dwd[2241]: option Verbosity: 1 Nov 3 06:00:00 kjcf05n03 dwd[2241]: option StandAlone: 0 Nov 3 06:00:00 kjcf05n03 network[2245]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 0 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 1 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 2 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 3 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 4 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 5 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 6 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 7 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 8 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 9 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 10 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 11 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 12 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 13 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 14 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 15 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 16 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 17 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 18 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 19 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 20 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 21 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 22 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 23 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 24 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 25 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 26 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 27 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 28 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 29 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 30 Nov 3 06:00:00 kjcf05n03 cpupower[2268]: Idlestate 2 disabled on CPU 31 Nov 3 06:00:00 kjcf05n03 network[2176]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[2255]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 06:00:00 kjcf05n03 mdraid-phy[2253]: no Cutlass to worry about Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Name Service Cache Daemon. Nov 3 06:00:00 kjcf05n03 network[2282]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 06:00:00 kjcf05n03 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 06:00:00 kjcf05n03 beSetMlxConfig[2111]: Loading MST PCI configuration module - Success Nov 3 06:00:00 kjcf05n03 beSetMlxConfig[2111]: Create devices Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[2299]: No configuration found for ib1 Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Resets System Activity Logs. Nov 3 06:00:00 kjcf05n03 chronyd[2243]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 06:00:00 kjcf05n03 chronyd[2243]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 06:00:00 kjcf05n03 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[2301]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 06:00:00 kjcf05n03 sssd[sssd][2135]: Starting up Nov 3 06:00:00 kjcf05n03 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 06:00:00 kjcf05n03 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Manage Cutlass PHYs. Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[2313]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 06:00:00 kjcf05n03 dbus-daemon[2136]: [system] Successfully activated service 'org.freedesktop.systemd1' Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[2339]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 06:00:00 kjcf05n03 mlnx_conf_mgr[2374]: INFO: No configurations found for mlx5_1, skipping. Nov 3 06:00:00 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[2380]: No configuration found for ib0 Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[2414]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 06:00:00 kjcf05n03 mlnx_conf_mgr[2456]: INFO: No configurations found for mlx5_0, skipping. Nov 3 06:00:00 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 06:00:00 kjcf05n03 sssd[be[implicit_files]][2375]: Starting up Nov 3 06:00:00 kjcf05n03 sssd[nss][2523]: Starting up Nov 3 06:00:00 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 06:00:00 kjcf05n03 systemd[1]: Reached target User and Group Name Lookups. Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Login Service... Nov 3 06:00:00 kjcf05n03 systemd-logind[2614]: New seat seat0. Nov 3 06:00:00 kjcf05n03 systemd-logind[2614]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Login Service. Nov 3 06:00:00 kjcf05n03 python3.9[2260]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 06:00:00 kjcf05n03 python3.9[3190]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 06:00:00 kjcf05n03 systemd-sysctl[2834]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 06:00:00 kjcf05n03 systemd-sysctl[2834]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 06:00:00 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 06:00:00 kjcf05n03 network[2176]: Bringing up loopback interface: [ OK ] Nov 3 06:00:00 kjcf05n03 python3.9[3098]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 06:00:00 kjcf05n03 python3.9[3190]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:00 kjcf05n03 systemd-sysctl[3167]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 06:00:00 kjcf05n03 systemd-sysctl[3167]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 06:00:00 kjcf05n03 systemd[1]: Started LSB: Bring up/down networking. Nov 3 06:00:00 kjcf05n03 systemd[1]: Reached target Network. Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 06:00:00 kjcf05n03 systemd[1]: Reached target Network is Online. Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting System Logger Daemon... Nov 3 06:00:00 kjcf05n03 sm-notify[3180]: Version 2.3.3 starting Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 06:00:00 kjcf05n03 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Notify NFS peers of a restart. Nov 3 06:00:00 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 06:00:00 kjcf05n03 beSetMlxConfig[2111]: Unloading MST PCI module (unused) - Success Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 06:00:00 kjcf05n03 systemd[1]: Reached target NFS client services. Nov 3 06:00:00 kjcf05n03 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 06:00:00 kjcf05n03 systemd[1]: Reached target Remote File Systems. Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Permit User Sessions... Nov 3 06:00:00 kjcf05n03 lldpad[3174]: setsockopt nearest_bridge: Invalid argument Nov 3 06:00:00 kjcf05n03 lldpad[3190]: Last message 'setsockopt nearest_b' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:00 kjcf05n03 sshd[3212]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 06:00:00 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Permit User Sessions. Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 06:00:00 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Getty on tty1. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Serial Getty on ttyS0. Nov 3 06:00:00 kjcf05n03 systemd[1]: Reached target Login Prompts. Nov 3 06:00:00 kjcf05n03 syslog-ng[3190]: [2024-11-03T11:58:43.440509] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 06:00:00 kjcf05n03 syslog-ng[3190]: [2024-11-03T11:58:43.440811] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 06:00:00 kjcf05n03 syslog-ng[3190]: [2024-11-03T11:58:43.440845] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 06:00:00 kjcf05n03 syslog-ng[3190]: [2024-11-03T11:58:43.441409] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 06:00:00 kjcf05n03 syslog-ng[3190]: [2024-11-03T11:58:43.441588] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 06:00:00 kjcf05n03 systemd[1]: Started System Logger Daemon. Nov 3 06:00:00 kjcf05n03 python3.9[3383]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 06:00:00 kjcf05n03 python3.9[3190]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 06:00:00 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 06:00:00 kjcf05n03 python3.9[3436]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 06:00:00 kjcf05n03 python3.9[3190]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 06:00:00 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 06:00:00 kjcf05n03 python3.9[3439]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 06:00:00 kjcf05n03 python3.9[3190]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 06:00:00 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 06:00:00 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 06:00:00 kjcf05n03 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 06:00:00 kjcf05n03 chronyd[2243]: System's initial offset : 0.000902 seconds slow of true (slew) Nov 3 06:00:00 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 06:00:00 kjcf05n03 beSetMlxConfig[2111]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 06:00:00 kjcf05n03 beSetMlxConfig[2111]: ib mode Nov 3 06:00:00 kjcf05n03 beSetMlxConfig[2111]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 06:00:00 kjcf05n03 root[3462]: openibd: Set node_desc for mlx5_0: kjcf05n03 HCA-1 Nov 3 06:00:00 kjcf05n03 root[3464]: openibd: Set node_desc for mlx5_1: kjcf05n03 HCA-2 Nov 3 06:00:00 kjcf05n03 beSetMlxConfig[2111]: ib mode Nov 3 06:00:00 kjcf05n03 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 06:00:00 kjcf05n03 systemd-udevd[3479]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:00:00 kjcf05n03 systemd-udevd[3478]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:00:00 kjcf05n03 systemd-udevd[3482]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:00:00 kjcf05n03 systemd-udevd[3483]: Using default interface naming scheme 'rhel-8.0'. Nov 3 06:00:00 kjcf05n03 systemd-udevd[3483]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:00:00 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 06:00:00 kjcf05n03 systemd[3190]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:00 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[3520]: Setting up Mellanox network interface: ib0 Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[3521]: Setting up Mellanox network interface: ib1 Nov 3 06:00:00 kjcf05n03 systemd-udevd[3480]: Using default interface naming scheme 'rhel-8.0'. Nov 3 06:00:00 kjcf05n03 systemd-udevd[3480]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[3571]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[3570]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[3587]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[3586]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[3589]: No configuration found for ib0 Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[3588]: No configuration found for ib1 Nov 3 06:00:00 kjcf05n03 systemd-udevd[3481]: Using default interface naming scheme 'rhel-8.0'. Nov 3 06:00:00 kjcf05n03 systemd-udevd[3481]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Puppet agent... Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[3596]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[3597]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 06:00:00 kjcf05n03 mlnx_conf_mgr[3651]: INFO: No configurations found for mlx5_1, skipping. Nov 3 06:00:00 kjcf05n03 mlnx_conf_mgr[3652]: INFO: No configurations found for mlx5_0, skipping. Nov 3 06:00:00 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 06:00:00 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 06:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 06:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 06:00:00 kjcf05n03 systemd[1]: Stopping Command Scheduler... Nov 3 06:00:00 kjcf05n03 systemd[1]: crond.service: Succeeded. Nov 3 06:00:00 kjcf05n03 systemd[1]: Stopped Command Scheduler. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 06:00:00 kjcf05n03 systemd[1]: Stopping Job spooling tools... Nov 3 06:00:00 kjcf05n03 systemd[1]: atd.service: Succeeded. Nov 3 06:00:00 kjcf05n03 systemd[1]: Stopped Job spooling tools. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 06:00:00 kjcf05n03 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 06:00:00 kjcf05n03 lldpad[3174]: init_ports: Error adding device ib0 Nov 3 06:00:00 kjcf05n03 lldpad[3174]: init_ports: Error adding device ib1 Nov 3 06:00:00 kjcf05n03 lldpad[3174]: Signal 15 received - terminating Nov 3 06:00:00 kjcf05n03 systemd[1]: lldpad.service: Succeeded. Nov 3 06:00:00 kjcf05n03 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 06:00:00 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 06:00:00 kjcf05n03 systemd[1]: lldpad.socket: Succeeded. Nov 3 06:00:00 kjcf05n03 systemd[1]: Closed lldpad.socket. Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 06:00:00 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting IPMI Driver... Nov 3 06:00:00 kjcf05n03 systemd[1]: Started IPMI Driver. Nov 3 06:00:00 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:00 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:00 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Ipmievd Daemon... Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 1 | Nov-03-2024 | 11:29:35 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 2 | Nov-03-2024 | 11:30:26 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 3 | Nov-03-2024 | 11:30:27 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 4 | Nov-03-2024 | 11:31:33 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 5 | Nov-03-2024 | 11:31:33 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 6 | Nov-03-2024 | 11:56:04 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 7 | Nov-03-2024 | 11:56:04 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 8 | Nov-03-2024 | 11:56:04 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 9 | Nov-03-2024 | 11:56:04 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 10 | Nov-03-2024 | 11:56:04 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 11 | Nov-03-2024 | 11:56:04 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 12 | Nov-03-2024 | 11:56:04 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 13 | Nov-03-2024 | 11:56:04 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 14 | Nov-03-2024 | 11:56:04 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 15 | Nov-03-2024 | 11:56:04 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 16 | Nov-03-2024 | 11:56:04 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 17 | Nov-03-2024 | 11:56:04 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 18 | Nov-03-2024 | 11:56:34 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 19 | Nov-03-2024 | 11:56:34 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 20 | Nov-03-2024 | 11:56:34 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 21 | Nov-03-2024 | 11:56:34 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 22 | Nov-03-2024 | 11:56:34 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 23 | Nov-03-2024 | 11:56:34 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 24 | Nov-03-2024 | 11:56:34 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 25 | Nov-03-2024 | 11:56:34 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 26 | Nov-03-2024 | 11:56:34 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 27 | Nov-03-2024 | 11:56:34 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 28 | Nov-03-2024 | 11:56:34 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 29 | Nov-03-2024 | 11:56:34 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 30 | Nov-03-2024 | 11:56:34 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 31 | Nov-03-2024 | 11:56:34 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 32 | Nov-03-2024 | 11:56:34 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 33 | Nov-03-2024 | 11:56:34 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 34 | Nov-03-2024 | 11:56:34 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 35 | Nov-03-2024 | 11:56:34 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 36 | Nov-03-2024 | 11:56:34 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 37 | Nov-03-2024 | 11:56:34 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 38 | Nov-03-2024 | 11:56:34 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 39 | Nov-03-2024 | 11:56:34 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 40 | Nov-03-2024 | 11:56:35 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 41 | Nov-03-2024 | 11:56:35 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 42 | Nov-03-2024 | 11:56:35 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 43 | Nov-03-2024 | 11:56:35 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 44 | Nov-03-2024 | 11:56:35 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 45 | Nov-03-2024 | 11:56:35 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 46 | Nov-03-2024 | 11:56:35 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 47 | Nov-03-2024 | 11:56:35 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 48 | Nov-03-2024 | 11:56:35 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3996]: 49 | Nov-03-2024 | 11:56:35 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:00:00 kjcf05n03 ipmievd[3999]: Reading sensors... Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Ipmievd Daemon. Nov 3 06:00:00 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:00 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 06:00:00 kjcf05n03 nscd[2147]: 2147 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 06:00:00 kjcf05n03 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 06:00:00 kjcf05n03 systemd[1]: Stopped Set Mellanox configuration. Nov 3 06:00:00 kjcf05n03 systemd[1]: Stopping Set Mellanox configuration... Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 06:00:00 kjcf05n03 beSetMlxConfig[4055]: ConnectX-3 multiport not detected Nov 3 06:00:00 kjcf05n03 beSetMlxConfig[4055]: Starting MST (Mellanox Software Tools) driver set Nov 3 06:00:00 kjcf05n03 beSetMlxConfig[4055]: Loading MST PCI module - Success Nov 3 06:00:00 kjcf05n03 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 06:00:00 kjcf05n03 beSetMlxConfig[4055]: [warn] mst_pciconf is already loaded, skipping Nov 3 06:00:00 kjcf05n03 beSetMlxConfig[4055]: Create devices Nov 3 06:00:00 kjcf05n03 beSetMlxConfig[4055]: Unloading MST PCI module (unused) - Success Nov 3 06:00:00 kjcf05n03 ipmievd[3999]: Waiting for events... Nov 3 06:00:00 kjcf05n03 beSetMlxConfig[4055]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 06:00:00 kjcf05n03 beSetMlxConfig[4055]: ib mode Nov 3 06:00:00 kjcf05n03 beSetMlxConfig[4055]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 06:00:00 kjcf05n03 beSetMlxConfig[4055]: ib mode Nov 3 06:00:00 kjcf05n03 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 06:00:00 kjcf05n03 systemd-udevd[4956]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:00:00 kjcf05n03 systemd-udevd[4957]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:00:00 kjcf05n03 systemd-udevd[4960]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:00:00 kjcf05n03 systemd-udevd[4963]: Using default interface naming scheme 'rhel-8.0'. Nov 3 06:00:00 kjcf05n03 systemd-udevd[4963]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:00:00 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 06:00:00 kjcf05n03 systemd[3190]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:00 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[4998]: Setting up Mellanox network interface: ib1 Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[4999]: Setting up Mellanox network interface: ib0 Nov 3 06:00:00 kjcf05n03 systemd-udevd[4958]: Using default interface naming scheme 'rhel-8.0'. Nov 3 06:00:00 kjcf05n03 systemd-udevd[4959]: Using default interface naming scheme 'rhel-8.0'. Nov 3 06:00:00 kjcf05n03 systemd-udevd[4958]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:00:00 kjcf05n03 systemd-udevd[4959]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[5048]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[5049]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[5079]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[5080]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[5081]: No configuration found for ib1 Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[5082]: No configuration found for ib0 Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[5087]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 06:00:00 kjcf05n03 mlnx_interface_mgr[5090]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 06:00:00 kjcf05n03 mlnx_conf_mgr[5127]: INFO: No configurations found for mlx5_1, skipping. Nov 3 06:00:00 kjcf05n03 mlnx_conf_mgr[5130]: INFO: No configurations found for mlx5_0, skipping. Nov 3 06:00:00 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 06:00:00 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}17b89f3af7ead2a24d5e7ef8dc44e5c4493bd5ede941aa15b729e52ac9a1d974' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}17b89f3af7ead2a24d5e7ef8dc44e5c4493bd5ede941aa15b729e52ac9a1d974' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}d542ea3226051c9e58fd555e8b9ff7d74dd1a5fd2495a4e7bd219e896357083a' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}d542ea3226051c9e58fd555e8b9ff7d74dd1a5fd2495a4e7bd219e896357083a' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}525a159deddf4c1beb9f0572321ba1bb46b5712043066900c1c0b5b292467640' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}525a159deddf4c1beb9f0572321ba1bb46b5712043066900c1c0b5b292467640' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}0dcf1334cde0368b2aff62fc01216fc4f9f85be8284bc0745158a58d557442a4' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}0dcf1334cde0368b2aff62fc01216fc4f9f85be8284bc0745158a58d557442a4' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 06:00:00 kjcf05n03 systemd[1]: Stopping NTP client/server... Nov 3 06:00:00 kjcf05n03 chronyd[2243]: chronyd exiting Nov 3 06:00:00 kjcf05n03 systemd[1]: chronyd.service: Succeeded. Nov 3 06:00:00 kjcf05n03 systemd[1]: Stopped NTP client/server. Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 06:00:00 kjcf05n03 chronyd[5166]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 06:00:00 kjcf05n03 chronyd[5166]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 06:00:00 kjcf05n03 chronyd[5166]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 06:00:00 kjcf05n03 chronyd[5166]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 06:00:00 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 06:00:00 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:00 kjcf05n03 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 06:00:00 kjcf05n03 systemd[1]: dwd.service: Succeeded. Nov 3 06:00:00 kjcf05n03 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 06:00:00 kjcf05n03 dwd[5199]: dwd: vMay 29 2024 : 15:38:26 Nov 3 06:00:00 kjcf05n03 dwd[5199]: /usr/sbin/dwd -i 15 -d Nov 3 06:00:00 kjcf05n03 dwd[5199]: dwd: option Lethal: 0 Nov 3 06:00:00 kjcf05n03 dwd[5199]: dwd: option Interval: 15 Nov 3 06:00:00 kjcf05n03 dwd[5199]: dwd: option abrtlimit: 10 Nov 3 06:00:00 kjcf05n03 dwd[5199]: dwd: option DZPeriod: 604800 Nov 3 06:00:00 kjcf05n03 dwd[5199]: dwd: option SmartPeriod: 43200 Nov 3 06:00:00 kjcf05n03 dwd[5199]: dwd: option SDDEnabled: 1 Nov 3 06:00:00 kjcf05n03 dwd[5199]: dwd: option SDDAwaitScale: 3 Nov 3 06:00:00 kjcf05n03 dwd[5199]: dwd: option SDDAwaitMin: 100 Nov 3 06:00:00 kjcf05n03 dwd[5199]: dwd: option Verbosity: 1 Nov 3 06:00:00 kjcf05n03 dwd[5199]: dwd: option StandAlone: 0 Nov 3 06:00:00 kjcf05n03 dwd[5199]: option Lethal: 0 Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 06:00:00 kjcf05n03 dwd[5199]: option Interval: 15 Nov 3 06:00:00 kjcf05n03 dwd[5199]: option abrtlimit: 10 Nov 3 06:00:00 kjcf05n03 dwd[5199]: option DZPeriod: 604800 Nov 3 06:00:00 kjcf05n03 dwd[5199]: option SmartPeriod: 43200 Nov 3 06:00:00 kjcf05n03 dwd[5199]: option SDDEnabled: 1 Nov 3 06:00:00 kjcf05n03 dwd[5199]: option SDDAwaitScale: 3 Nov 3 06:00:00 kjcf05n03 dwd[5199]: option SDDAwaitMin: 100 Nov 3 06:00:00 kjcf05n03 dwd[5199]: option Verbosity: 1 Nov 3 06:00:00 kjcf05n03 dwd[5199]: option StandAlone: 0 Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 06:00:00 kjcf05n03 dwd[5200]: option Lethal now set to 1 Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 06:00:00 kjcf05n03 dwd[5200]: option abrtlimit now set to 1 Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 06:00:00 kjcf05n03 dwd[5200]: option SmartPeriod now set to 86400 Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 06:00:00 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 06:00:00 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Discard unused blocks. Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:00 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:00 kjcf05n03 python3.9[5229]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 06:00:00 kjcf05n03 python3.9[3190]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 06:00:00 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Periodic ZFS scrub. Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:00 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 06:00:00 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting Sed Control Plane worker process... Nov 3 06:00:00 kjcf05n03 sedcpwrkr[5366]: Using config script: /etc/sedcpwrkr.conf Nov 3 06:00:00 kjcf05n03 sedcpwrkr[5366]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 06:00:00 kjcf05n03 sedcpwrkr[5366]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 06:00:00 kjcf05n03 sedcpwrkr[5366]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 06:00:00 kjcf05n03 sedcpwrkr[5366]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 06:00:00 kjcf05n03 sedcpwrkr[5366]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 06:00:00 kjcf05n03 sedcpwrkr[5366]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 06:00:00 kjcf05n03 sedcpwrkr-server[5397]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 06:00:00 kjcf05n03 sedcpwrkr[5366]: celery multi v5.2.7 (dawn-chorus) Nov 3 06:00:00 kjcf05n03 sedcpwrkr[5366]: > Starting nodes... Nov 3 06:00:00 kjcf05n03 sedcpwrkr[5366]: > sedcpwrkr@kjcf05n03: OK Nov 3 06:00:00 kjcf05n03 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 06:00:00 kjcf05n03 sedcpwrkr-server[5399]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 06:00:00 kjcf05n03 sedcpwrkr-server[5399]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 06:00:00 kjcf05n03 sedcpwrkr-server[5399]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 06:00:00 kjcf05n03 systemd[1]: Started Sed Control Plane worker process. Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 06:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 06:00:00 kjcf05n03 systemd[1]: Reloading System Logger Daemon. Nov 3 06:00:00 kjcf05n03 systemd[1]: Reloaded System Logger Daemon. Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 06:00:00 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 06:00:00 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 06:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 06:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 06:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 06:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 06:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 06:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 06:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 06:00:00 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 06:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 06:00:00 kjcf05n03 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 06:00:00 kjcf05n03 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 06:00:00 kjcf05n03 iptables.init[5466]: iptables: Applying firewall rules: [ OK ] Nov 3 06:00:00 kjcf05n03 systemd[1]: Started IPv4 firewall with iptables. Nov 3 06:00:00 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:01 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:01 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:01 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:01 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 06:00:01 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 06:00:01 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 06:00:01 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 06:00:01 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 06:00:01 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 06:00:01 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 06:00:01 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 06:00:01 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 06:00:01 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 06:00:02 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 06:00:02 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 06:00:02 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 06:00:02 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 06:00:02 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 06:00:02 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 06:00:02 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 06:00:02 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 06:00:02 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 06:00:02 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 06:00:02 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 06:00:02 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 06:00:02 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 06:00:02 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 06:00:02 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 06:00:02 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 06:00:02 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 06:00:02 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 06:00:02 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 06:00:02 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 06:00:02 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 06:00:02 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 06:00:02 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 06:00:02 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 06:00:02 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 06:00:02 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 06:00:02 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 06:00:02 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 06:00:02 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 06:00:02 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 06:00:02 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 06:00:02 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 06:00:02 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 06:00:02 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 06:00:02 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 06:00:02 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 06:00:02 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 06:00:02 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 06:00:02 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 06:00:02 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 06:00:02 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:02 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 06:00:02 kjcf05n03 systemd[1]: openhpid.service: Supervising process 5566 which is not our child. We'll most likely not notice when it exits. Nov 3 06:00:02 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 06:00:02 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:02 kjcf05n03 openhpid[5566]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 06:00:02 kjcf05n03 openhpid[5566]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 06:00:02 kjcf05n03 openhpid[5566]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 06:00:02 kjcf05n03 openhpid[5566]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 06:00:02 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 06:00:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:00:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 06:00:03 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:03 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:03 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 06:00:03 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 06:00:03 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 06:00:03 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 06:00:03 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:03 kjcf05n03 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 06:00:03 kjcf05n03 dcs-collectord[5657]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 06:00:03 kjcf05n03 hpi.inv.log[5657]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 06:00:03 kjcf05n03 dcs-collectord[5657]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 06:00:03 kjcf05n03 dcs-collectord[5657]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 06:00:03 kjcf05n03 dcs-collector[5648]: Starting dcs-collector:[ OK ] Nov 3 06:00:03 kjcf05n03 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 06:00:03 kjcf05n03 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 06:00:03 kjcf05n03 dcs-collectord[5660]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 06:00:03 kjcf05n03 dcs-collectord[5660]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 06:00:03 kjcf05n03 dcs-collectord[5660]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 06:00:03 kjcf05n03 dcs-collectord[5660]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 06:00:03 kjcf05n03 dcs-collectord[5660]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 06:00:03 kjcf05n03 dcs-collectord[5660]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 06:00:03 kjcf05n03 dcs-collectord[5660]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 06:00:03 kjcf05n03 dcs-collectord[5660]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259344264", "units": "kB"}, {"name": "MemAvailable", "value": "258624028", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821320", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1687368", "units": "kB"}, {"name": "Inactive", "value": "964612", "units": "kB"}, {"name": "Active(anon)", "value": "1520800", "units": "kB"}, {"name": "Inactive(anon)", "value": "828852", "units": "kB"}, {"name": "Active(file)", "value": "166568", "units": "kB"}, {"name": "Inactive(file)", "value": "135760", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "754384", "units": "kB"}, {"name": "Mapped", "value": "86024", "units": "kB"}, {"name": "Shmem", "value": "1593444", "units": "kB"}, {"name": "KReclaimable", "value": "109368", "units": "kB"}, {"name": "Slab", "value": "275604", "units": "kB"}, {"name": "SReclaimable", "value": "109368", "units": "kB"}, {"name": "SUnreclaim", "value": "166236", "units": "kB"}, {"name": "KernelStack", "value": "9808", "units": "kB"}, {"name": "PageTables", "value": "19296", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3323996", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11264", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "4096", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "270664", "units": "kB"}, {"name": "DirectMap2M", "value": "22663168", "units": "kB"}, {"name": "DirectMap1G", "value": "245366784", "units": "kB"}]}' Nov 3 06:00:03 kjcf05n03 dcs-collectord[5660]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 06:00:03 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:04 kjcf05n03 dcs-collectord[5660]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 06:00:04 kjcf05n03 dcs-collectord[5660]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730635203.4893625], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730635203.7225668], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730635203.4196153, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 06:00:04 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:04 kjcf05n03 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 06:00:04 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:04 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:04 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 06:00:04 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 06:00:04 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 06:00:04 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 06:00:04 kjcf05n00 python3.9[1008496]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 06:00:04 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:04 kjcf05n03 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 06:00:04 kjcf05n03 firmware-update-orc[5766]: Using config script: /etc/firmware_update_orc.conf Nov 3 06:00:04 kjcf05n03 firmware-update-orc[5766]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 06:00:04 kjcf05n03 firmware-update-orc[5766]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 06:00:04 kjcf05n03 firmware-update-orc[5766]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 06:00:04 kjcf05n03 firmware-update-orc[5766]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 06:00:04 kjcf05n03 firmware-update-orc[5766]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 06:00:04 kjcf05n03 firmware-update-orc[5766]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 06:00:04 kjcf05n03 firmware-update-orc-server[5802]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 06:00:04 kjcf05n03 firmware-update-orc[5766]: celery multi v5.2.7 (dawn-chorus) Nov 3 06:00:04 kjcf05n03 firmware-update-orc[5766]: > Starting nodes... Nov 3 06:00:04 kjcf05n03 firmware-update-orc[5766]: > worker1@kjcf05n03: OK Nov 3 06:00:04 kjcf05n03 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 06:00:05 kjcf05n03 firmware-update-orc-server[5806]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 06:00:05 kjcf05n03 firmware-update-orc-server[5806]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 06:00:05 kjcf05n03 firmware-update-orc-server[5806]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 06:00:05 kjcf05n03 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 06:00:05 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:05 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:05 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:05 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:05 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 06:00:05 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 06:00:05 kjcf05n03 dbus-daemon[2136]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 06:00:05 kjcf05n03 dbus-daemon[2136]: [system] Reloaded configuration Nov 3 06:00:05 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 06:00:05 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 06:00:05 kjcf05n03 dbus-daemon[2136]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 06:00:05 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 06:00:05 kjcf05n03 dbus-daemon[2136]: [system] Reloaded configuration Nov 3 06:00:05 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 06:00:05 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 06:00:05 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 06:00:05 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 06:00:05 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 06:00:05 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:05 kjcf05n03 systemd[1]: Starting Manages hardware resources... Nov 3 06:00:06 kjcf05n03 ras-resource-manager-agent[5922]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 06:00:06 kjcf05n03 ras-resource-manager-agent[5908]: Starting ras-resource-manager-agent:[ OK ] Nov 3 06:00:06 kjcf05n03 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 06:00:06 kjcf05n03 ras-resource-manager-agent[5924]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 06:00:06 kjcf05n03 ras-resource-manager-client[5924]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 06:00:06 kjcf05n03 systemd[1]: Started Manages hardware resources. Nov 3 06:00:06 kjcf05n03 ras-resource-manager-client[5924]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 06:00:06 kjcf05n03 ras-resource-manager-client[5934]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 06:00:06 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:06 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:06 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:06 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:06 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 06:00:06 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 06:00:07 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:07 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 06:00:07 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:07 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: Press Ctrl+C to exit. Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: Plugin support version 1.0 Nov 3 06:00:07 kjcf05n03 zabbix_agent2[6008]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 06:00:07 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:07 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:07 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:08 kjcf05n03 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 06:00:08 kjcf05n03 dcs-notification-sender[6083]: dcs-notification-senderd is stopped Nov 3 06:00:08 kjcf05n03 zabbix-agent2[6097]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 06:00:08 kjcf05n03 dcs-notification-sender[6083]: Starting notification-sender:[ OK ] Nov 3 06:00:08 kjcf05n03 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 06:00:08 kjcf05n03 zabbix-agent2[6099]: INFO DCS notification agent started. (agent.py:61) Nov 3 06:00:08 kjcf05n03 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 06:00:08 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:08 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:08 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:08 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:09 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:09 kjcf05n03 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 06:00:09 kjcf05n03 dcs-collectord[6186]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 06:00:09 kjcf05n03 dcs-collectord[6186]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 06:00:09 kjcf05n03 dcs-bulk-data-sender[6186]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 06:00:09 kjcf05n03 dcs-bulk-data-sender[6177]: Starting bulk-data-sender:[ OK ] Nov 3 06:00:09 kjcf05n03 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 06:00:09 kjcf05n03 dcs-collectord[6203]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 06:00:09 kjcf05n03 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 06:00:09 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:09 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:09 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:09 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:09 kjcf05n03 nscd[2147]: 2147 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 06:00:09 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 06:00:09 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 06:00:09 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 06:00:09 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 06:00:09 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 06:00:09 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 06:00:09 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 06:00:09 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 06:00:09 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 06:00:09 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 06:00:09 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 06:00:09 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 06:00:09 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 06:00:09 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 06:00:10 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 06:00:10 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 06:00:10 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 06:00:10 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 06:00:10 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 06:00:10 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 06:00:10 kjcf05n03 systemd[1]: Stopping System Security Services Daemon... Nov 3 06:00:10 kjcf05n03 sssd[nss][2523]: Shutting down (status = 0) Nov 3 06:00:10 kjcf05n03 sssd[be[implicit_files]][2375]: Shutting down (status = 0) Nov 3 06:00:10 kjcf05n03 systemd[1]: sssd.service: Succeeded. Nov 3 06:00:10 kjcf05n03 systemd[1]: Stopped System Security Services Daemon. Nov 3 06:00:10 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 06:00:10 kjcf05n03 sssd[sssd][6275]: Starting up Nov 3 06:00:11 kjcf05n03 python3.9[5229]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 06:00:11 kjcf05n03 python3.9[3190]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:11 kjcf05n03 sssd[be[implicit_files]][6276]: Starting up Nov 3 06:00:11 kjcf05n03 sssd[nss][6277]: Starting up Nov 3 06:00:11 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 06:00:11 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 06:00:11 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 06:00:12 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 06:00:12 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 06:00:12 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure) defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 06:00:12 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure: defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 06:00:12 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure) defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 06:00:12 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure: defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 06:00:12 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 06:00:12 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 06:00:12 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 06:00:12 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 06:00:12 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:00:12 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:00:12 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:12 kjcf05n03 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 06:00:13 kjcf05n03 icinga2[6341]: [2024-11-03 06:00:12 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 06:00:13 kjcf05n03 icinga2[6341]: [2024-11-03 06:00:12 -0600] information/cli: Loading configuration file(s). Nov 3 06:00:13 kjcf05n03 icinga2[6341]: [2024-11-03 06:00:12 -0600] information/ConfigItem: Committing config item(s). Nov 3 06:00:13 kjcf05n03 icinga2[6341]: [2024-11-03 06:00:12 -0600] information/ApiListener: My API identity: kjcf05n03 Nov 3 06:00:13 kjcf05n03 icinga2[6341]: [2024-11-03 06:00:12 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 06:00:13 kjcf05n03 icinga2[6341]: [2024-11-03 06:00:12 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 06:00:13 kjcf05n03 icinga2[6341]: [2024-11-03 06:00:12 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 06:00:13 kjcf05n03 icinga2[6341]: [2024-11-03 06:00:12 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 06:00:13 kjcf05n03 icinga2[6341]: [2024-11-03 06:00:12 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 06:00:13 kjcf05n03 icinga2[6341]: [2024-11-03 06:00:12 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 06:00:13 kjcf05n03 icinga2[6341]: [2024-11-03 06:00:12 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 06:00:13 kjcf05n03 icinga2[6341]: [2024-11-03 06:00:12 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 06:00:13 kjcf05n03 icinga2[6341]: [2024-11-03 06:00:12 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 06:00:13 kjcf05n03 icinga2[6341]: [2024-11-03 06:00:12 -0600] information/cli: Closing console log. Nov 3 06:00:13 kjcf05n03 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 06:00:13 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:13 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:13 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:13 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:13 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 06:00:13 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 06:00:13 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:13 kjcf05n03 systemd[1]: Started Icinga2 network monitor. Nov 3 06:00:14 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:14 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 06:00:14 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:14 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:14 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 06:00:14 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 06:00:14 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 06:00:14 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 06:00:14 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 06:00:14 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 06:00:15 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 06:00:15 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 06:00:15 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 06:00:15 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 06:00:15 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 06:00:15 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 06:00:15 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 06:00:15 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 06:00:15 kjcf05n03 dcs-bulk-data-sender[6203]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 06:00:15 kjcf05n03 dcs-collectord[6203]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 06:00:15 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:15 kjcf05n03 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 06:00:15 kjcf05n03 nslcd[7259]: version 0.9.9 starting Nov 3 06:00:15 kjcf05n03 nslcd[7259]: accepting connections Nov 3 06:00:15 kjcf05n03 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 06:00:15 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:16 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:16 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:16 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:16 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 06:00:16 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 06:00:16 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 06:00:16 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 06:00:16 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 06:00:16 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 06:00:17 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 06:00:17 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 06:00:17 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:17 kjcf05n03 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 06:00:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730635217', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 06:00:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730635217'} Nov 3 06:00:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:00:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730635217', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 06:00:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730635217'} Nov 3 06:00:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:00:17 kjcf05n03 dearcpw[7458]: Using config script: /etc/dearcpw.conf Nov 3 06:00:17 kjcf05n03 dearcpw[7458]: - Creating default directory: '/var/log/dearcpw' Nov 3 06:00:17 kjcf05n03 dearcpw[7458]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 06:00:17 kjcf05n03 dearcpw[7458]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 06:00:17 kjcf05n03 dearcpw[7458]: - Creating default directory: '/var/run/dearcpw' Nov 3 06:00:17 kjcf05n03 dearcpw[7458]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 06:00:17 kjcf05n03 dearcpw[7458]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 06:00:17 kjcf05n03 dearcpw-server[7498]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 06:00:17 kjcf05n03 dearcpw[7458]: celery multi v5.2.7 (dawn-chorus) Nov 3 06:00:17 kjcf05n03 dearcpw[7458]: > Starting nodes... Nov 3 06:00:17 kjcf05n03 dearcpw[7458]: > dearcpw@kjcf05n03: OK Nov 3 06:00:17 kjcf05n03 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 06:00:17 kjcf05n03 dearcpw-server[7500]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 06:00:17 kjcf05n03 dearcpw-server[7500]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 06:00:17 kjcf05n03 dearcpw-server[7500]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 06:00:18 kjcf05n03 systemd[1]: Started DEAR Control Plane worker process. Nov 3 06:00:18 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:18 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:18 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 06:00:18 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 06:00:18 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 06:00:18 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 06:00:18 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 06:00:18 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 06:00:18 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 06:00:18 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 06:00:18 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 06:00:18 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 06:00:18 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:44206). Nov 3 06:00:18 kjcf05n01 rsyncd[2931537]: connect from kjcf05n03 (172.16.2.6) Nov 3 06:00:18 kjcf05n01 rsyncd[2931537]: rsync to puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 06:00:18 kjcf05n01 rsyncd[2931537]: receiving file list Nov 3 06:00:18 kjcf05n01 rsyncd[2931537]: sent 29 bytes received 325 bytes total size 10901 Nov 3 06:00:18 kjcf05n01 systemd[1]: rsyncd@602-172.16.2.2:873-172.16.2.6:44206.service: Succeeded. Nov 3 06:00:18 kjcf05n03 puppet[7539]: IEC: 017000000: Node is up and running: { "node": "kjcf05n03" } Nov 3 06:00:18 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 06:00:18 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 06:00:18 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 06:00:18 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 06:00:18 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 06:00:18 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 06:00:18 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 06:00:18 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 06:00:18 kjcf05n03 dcs-collectord[5660]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 06:00:18 kjcf05n03 dcs-collectord[5660]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 06:00:18 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 06:00:18 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 06:00:19 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 06:00:19 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 06:00:19 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 06:00:19 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 06:00:19 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib0 Nov 3 06:00:19 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib0 Nov 3 06:00:20 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 06:00:20 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 06:00:20 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 06:00:20 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 06:00:20 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 06:00:20 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 06:00:20 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 06:00:20 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 06:00:21 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 06:00:21 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 06:00:21 kjcf05n03 ipmievd[3999]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 06:00:21 kjcf05n03 ipmievd[3999]: System Event sensor - Timestamp Clock Sync Nov 3 06:00:21 kjcf05n03 ipmievd[3190]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:21 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:21 kjcf05n03 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 06:00:21 kjcf05n03 diskless-swap[7625]: HA_PS_000: recovering journal Nov 3 06:00:21 kjcf05n03 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 06:00:21 kjcf05n03 diskless-swap[7625]: HA_PS_000: clean, 2267/6400 files, 7035/25600 blocks Nov 3 06:00:21 kjcf05n03 diskless-swap[7625]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 06:00:22 kjcf05n03 diskless-swap[7625]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 06:00:22 kjcf05n03 diskless-swap[7625]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 06:00:22 kjcf05n03 diskless-swap[7625]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 06:00:22 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 06:00:22 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:22 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:22 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 06:00:22 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 06:00:22 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 06:00:22 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 06:00:22 kjcf05n03 systemd[1]: Stopping OpenSSH server daemon... Nov 3 06:00:22 kjcf05n03 systemd[1]: sshd.service: Succeeded. Nov 3 06:00:22 kjcf05n03 systemd[1]: Stopped OpenSSH server daemon. Nov 3 06:00:22 kjcf05n03 systemd[1]: Stopped target sshd-keygen.target. Nov 3 06:00:22 kjcf05n03 systemd[1]: Stopping sshd-keygen.target. Nov 3 06:00:22 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 06:00:22 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 06:00:22 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 06:00:22 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 06:00:22 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 06:00:22 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 06:00:22 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 06:00:22 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 06:00:22 kjcf05n00 zabbix-server[1009102]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 06:00:22 kjcf05n00 zabbix-server[1009102]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 86.32\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 84.32\\"}}"' Nov 3 06:00:22 kjcf05n00 log_interesting_event.py[1009102]: Event '45816' acknowledged Nov 3 06:00:23 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 06:00:23 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 06:00:23 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 06:00:23 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 06:00:23 kjcf05n02 LCNmon[17974]: 10.16.100.53 is unreachable via ib1 Nov 3 06:00:23 kjcf05n02 LCNmon[17974]: 10.16.100.59 is unreachable via ib1 Nov 3 06:00:24 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 06:00:24 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 06:00:24 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 06:00:24 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 06:00:24 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 06:00:24 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 06:00:24 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 06:00:24 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 06:00:25 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 06:00:25 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 06:00:25 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 06:00:25 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 06:00:25 kjcf05n00 mcfcli[3673891]: %3|1730635225.161|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:00:25 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:25 kjcf05n03 systemd[1]: Set up automount opt-firmware.automount. Nov 3 06:00:25 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:25 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:25 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 06:00:25 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 06:00:25 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:26 kjcf05n03 systemd[1]: Set up automount mnt-llog.automount. Nov 3 06:00:26 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:26 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:26 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 06:00:26 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 06:00:26 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:26 kjcf05n03 systemd[1]: Set up automount usr-share-man.automount. Nov 3 06:00:26 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:26 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:26 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 06:00:26 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 06:00:26 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 06:00:26 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 06:00:26 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 06:00:26 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 06:00:26 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 06:00:26 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 06:00:26 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 06:00:26 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 06:00:26 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:27 kjcf05n03 systemd[1]: Starting Crash recovery kernel arming... Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: kdump: No kdump initial ramdisk found. Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 06:00:27 kjcf05n03 dracut[7964]: dracut-049-135.git20210121.el8 Nov 3 06:00:27 kjcf05n03 dracut[7979]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 06:00:27 kjcf05n03 dracut[7979]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 06:00:27 kjcf05n03 dracut[7979]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 06:00:27 kjcf05n03 dracut[7979]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 06:00:27 kjcf05n03 dracut[7979]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 06:00:27 kjcf05n03 dracut[7979]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 06:00:27 kjcf05n03 dracut[7979]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 06:00:27 kjcf05n03 dracut[7979]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + is_func check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ type -t check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check -h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local dev holder Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + require_binaries mdadm expr Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _module_name=90hperaid Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ mdadm = \-\m ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for cmd in "$@" Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + find_binary mdadm Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for cmd in "$@" Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + find_binary expr Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n -h ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for dev in "${!host_fs_types[@]}" Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ nfs != *_raid_member ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + continue Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _ret=255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + ret=255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ 255 = 0 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ 255 = 255 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ module_depends hperaid Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: +++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: +++ set -x Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ depends Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo rootfs-block Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ return 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ _ret=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ return 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for _moddep in $(module_depends $_mod) Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all == *\ hperaid\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + add_dracutmodules+=' rootfs-block ' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ == *\ hperaid\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check_module rootfs-block Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _mod=rootfs-block Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddep Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ == *\ rootfs-block\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n '' ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all == *\ rootfs-block\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + module_check rootfs-block 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _forced=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 2 -eq 2 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _forced=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + is_func check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ type -t check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check -h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _ret=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + ret=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ 0 = 0 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ module_depends rootfs-block Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: +++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 06:00:27 kjcf05n03 kdumpctl[3190]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ depends Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo fs-lib Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ _ret=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ return 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for _moddep in $(module_depends $_mod) Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all == *\ rootfs-block\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + add_dracutmodules+=' fs-lib ' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ == *\ rootfs-block\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check_module fs-lib Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _mod=fs-lib Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddep Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n '' ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + mods_checked_as_dep+=' fs-lib ' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all == *\ fs-lib\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + module_check fs-lib 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _forced=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 2 -eq 2 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _forced=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + is_func check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ type -t check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check -h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _ret=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + ret=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ 0 = 0 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ module_depends fs-lib Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: +++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ depends Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ return 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ _ret=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ return 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + mods_to_load+=' fs-lib ' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + mods_to_load+=' rootfs-block ' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + mods_to_load+=' hperaid ' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _mod=90kernel-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _mod=kernel-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check_module kernel-modules 1 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _mod=kernel-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddep Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all = all ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + module_check kernel-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _forced=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 1 -eq 2 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + is_func check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ type -t check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check -h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + true Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _ret=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + ret=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ 0 != 0 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ module_depends kernel-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: +++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ depends Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ true Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ _ret=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ return 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + mods_to_load+=' kernel-modules ' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _mod=90kernel-modules-extra Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _mod=kernel-modules-extra Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check_module kernel-modules-extra 1 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _mod=kernel-modules-extra Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddep Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all = all ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + module_check kernel-modules-extra Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _forced=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 1 -eq 2 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + is_func check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ type -t check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check -h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + true Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _ret=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + ret=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ 0 != 0 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ module_depends kernel-modules-extra Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: +++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ depends Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ true Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ _ret=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ return 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + mods_to_load+=' kernel-modules-extra ' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _mod=90kernel-network-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _mod=kernel-network-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check_module kernel-network-modules 1 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _mod=kernel-network-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddep Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all = all ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + module_check kernel-network-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _forced=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 1 -eq 2 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + is_func check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ type -t check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check -h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _ret=255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + ret=255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ 255 != 0 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 1 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _mod=90livenet Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _mod=livenet Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check_module livenet 1 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _mod=livenet Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddep Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all = all ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + module_check livenet Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _forced=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 1 -eq 2 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + is_func check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ type -t check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check -h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _ret=255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + ret=255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ 255 != 0 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 1 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _mod=90lvm Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _mod=lvm Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check_module lvm 1 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _mod=lvm Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddep Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all = all ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + module_check lvm Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _forced=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 1 -eq 2 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + is_func check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ type -t check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check -h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + require_binaries lvm Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _module_name=90lvm Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ lvm = \-\m ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for cmd in "$@" Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + find_binary lvm Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n -h ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for fs in "${host_fs_types[@]}" Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ nfs = LVM*_member ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _ret=255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + ret=255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ 255 != 0 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 1 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _mod=90mdraid Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _mod=mdraid Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check_module mdraid 1 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _mod=mdraid Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddep Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all = all ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + module_check mdraid Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 06:00:27 kjcf05n03 kdumpctl[3190]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _forced=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 1 -eq 2 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + is_func check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ type -t check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check -h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _rootdev Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + require_binaries mdadm expr Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _module_name=90mdraid Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ mdadm = \-\m ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for cmd in "$@" Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + find_binary mdadm Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for cmd in "$@" Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + find_binary expr Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n -h ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for dev in "${!host_fs_types[@]}" Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ nfs != *_raid_member ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + continue Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _ret=255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + ret=255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ 255 != 0 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 1 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _mod=90multipath Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _mod=multipath Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check_module multipath 1 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _mod=multipath Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddep Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all = all ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + module_check multipath Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _forced=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 1 -eq 2 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + is_func check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ type -t check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check -h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _rootdev Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n -h ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for_each_host_dev_and_slaves is_mpath Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _func=is_mpath Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _dev Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for _dev in "${host_devs[@]}" Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + continue Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 1 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _ret=255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + ret=255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ 255 != 0 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 1 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _mod=90qemu Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _mod=qemu Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check_module qemu 1 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _mod=qemu Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddep Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all = all ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + module_check qemu Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _forced=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 1 -eq 2 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + is_func check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ type -t check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check -h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n -h ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + type -P systemd-detect-virt Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ systemd-detect-virt --vm Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + vm=none Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + (( 1 != 0 )) Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _ret=255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + ret=255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ 255 != 0 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 1 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _mod=90qemu-net Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _mod=qemu-net Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check_module qemu-net 1 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _mod=qemu-net Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddep Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all = all ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + module_check qemu-net Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _forced=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 1 -eq 2 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + is_func check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ type -t check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check -h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n -h ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + type -P systemd-detect-virt Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ systemd-detect-virt --vm Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + vm= Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + (( 1 != 0 )) Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _ret=255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + ret=255 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ 255 != 0 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + return 1 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _mod=90stratis Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + _mod=stratis Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check_module stratis 1 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _mod=stratis Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddep Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ all = all ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + module_check stratis Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ read a b Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _forced=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _hostonly=-h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 1 -eq 2 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + is_func check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: ++ type -t check Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + check -h Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _module_name=90stratis Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + local _ret=0 Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + [[ stratisd-init = \-\m ]] Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + for cmd in "$@" Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + find_binary stratisd-init Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 06:00:27 kjcf05n03 kdumpctl[7852]: + set +x Nov 3 06:00:27 kjcf05n03 dracut[7979]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 06:00:27 kjcf05n03 dracut[7979]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 06:00:27 kjcf05n03 dracut[7979]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 06:00:27 kjcf05n03 dracut[7979]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 06:00:28 kjcf05n03 dracut[7979]: memstrack is available Nov 3 06:00:28 kjcf05n03 dracut[7979]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 06:00:28 kjcf05n03 dracut[7979]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 06:00:28 kjcf05n03 dracut[7979]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 06:00:28 kjcf05n03 dracut[7979]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 06:00:28 kjcf05n03 dracut[7979]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 06:00:28 kjcf05n03 dracut[7979]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 06:00:28 kjcf05n03 dracut[7979]: *** Including module: bash *** Nov 3 06:00:28 kjcf05n03 dracut[7979]: *** Including module: systemd *** Nov 3 06:00:29 kjcf05n03 dracut[7979]: *** Including module: fips *** Nov 3 06:00:29 kjcf05n03 dracut[7979]: *** Including module: systemd-initrd *** Nov 3 06:00:29 kjcf05n03 dracut[7979]: *** Including module: watchdog-modules *** Nov 3 06:00:29 kjcf05n03 dracut[7979]: *** Including module: nss-softokn *** Nov 3 06:00:29 kjcf05n03 dracut[7979]: *** Including module: i18n *** Nov 3 06:00:29 kjcf05n03 dracut[7979]: No KEYMAP configured. Nov 3 06:00:30 kjcf05n03 dracut[7979]: *** Including module: network-legacy *** Nov 3 06:00:30 kjcf05n03 dracut[7979]: *** Including module: network *** Nov 3 06:00:30 kjcf05n03 dracut[7979]: *** Including module: ib_bonding *** Nov 3 06:00:30 kjcf05n03 dracut[7979]: *** Including module: drm *** Nov 3 06:00:30 kjcf05n00 mcfcli[3673891]: %3|1730635230.368|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:00:33 kjcf05n03 dcs-collectord[5660]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 06:00:33 kjcf05n03 dcs-collectord[5660]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 06:00:33 kjcf05n03 dracut[7979]: *** Including module: hperaid *** Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + install Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + local rule rule_path Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + inst_multiple cat expr Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.zqHBqh/initramfs -a -f cat expr Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + _ret=0 Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + (( 0 != 0 )) Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + : Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + return 0 Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + inst_multiple -o mdmon Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.zqHBqh/initramfs -a -f -o mdmon Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + _ret=0 Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + (( 0 != 0 )) Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + : Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + return 0 Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: ++ command -v partx Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + inst /usr/sbin/partx /sbin/partx Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + local _hostonly_install Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + [[ -e /tmp/dracut.zqHBqh/initramfs//sbin/partx ]] Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.zqHBqh/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + (( 0 != 0 )) Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + : Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: ++ command -v mdadm Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + local _hostonly_install Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + [[ -e /tmp/dracut.zqHBqh/initramfs//sbin/mdadm ]] Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.zqHBqh/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + (( 0 != 0 )) Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + : Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + [[ yes == \y\e\s ]] Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + local _raidconf Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: ++ cmdline Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: ++ local _activated dev line UUID Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: ++ declare -A _activated Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: ++ for dev in "${!host_fs_types[@]}" Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: ++ [[ nfs != *_raid_member ]] Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: ++ continue Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + _raidconf= Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + [[ -n '' ]] Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + inst_rules 64-md-raid.rules Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + local _target=/etc/udev/rules.d _rule _found Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + inst_dir /usr/lib/udev/rules.d Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + [[ -e /tmp/dracut.zqHBqh/initramfs//usr/lib/udev/rules.d ]] Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + return 0 Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + inst_dir /etc/udev/rules.d Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + [[ -e /tmp/dracut.zqHBqh/initramfs//etc/udev/rules.d ]] Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + return 0 Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + for _rule in "$@" Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + continue Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + continue Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + for r in '' $dracutbasedir/rules.d/ Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + [[ 64-md-raid.rules != /* ]] Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + continue Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + for r in '' $dracutbasedir/rules.d/ Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + continue Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + [[ -n '' ]] Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 06:00:33 kjcf05n03 kdumpctl[7852]: + set +x Nov 3 06:00:33 kjcf05n03 dracut[7979]: Skipping udev rule: 64-md-raid.rules Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + installkernel Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + instmods =drivers/md Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + local _optional=-o Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + local _silent Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + local _ret Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + [[ '' = yes ]] Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + [[ =drivers/md = \-\c ]] Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + [[ =drivers/md = \-\s ]] Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + (( 1 == 0 )) Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.zqHBqh/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + _ret=0 Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + (( 0 != 0 )) Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + [[ -n '' ]] Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + return 0 Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + _ret=0 Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + return 0 Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + modules_loaded+='hperaid ' Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + '[' -n '' ']' Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + _d_mod=90kernel-modules Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + _d_mod=kernel-modules Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + [[ '' = yes ]] Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + dinfo '*** Including module: kernel-modules ***' Nov 3 06:00:34 kjcf05n03 kdumpctl[7852]: + set +x Nov 3 06:00:34 kjcf05n03 dracut[7979]: *** Including module: kernel-modules *** Nov 3 06:00:34 kjcf05n03 dracut[7979]: *** Including module: kernel-modules-extra *** Nov 3 06:00:34 kjcf05n03 dracut[7979]: *** Including module: kernel-network-modules *** Nov 3 06:00:35 kjcf05n03 dracut[7979]: *** Including module: diskless-mod *** Nov 3 06:00:35 kjcf05n03 dracut[7979]: *** Including module: fstab-sys *** Nov 3 06:00:35 kjcf05n03 dracut[7979]: *** Including module: nfs *** Nov 3 06:00:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730635234', 'host':'kjcf05n03', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(0.0B/0.0B), ib1=(0.0B/0.0B), icl0=(4.4kB/6.0kB), lo=(500.0B/500.0B), meth0=(1540.9MB/7.6MB), mgmt0=(1477.6MB/7.6MB)'}"] Nov 3 06:00:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(0.0B/0.0B), ib1=(0.0B/0.0B), icl0=(4.4kB/6.0kB), lo=(500.0B/500.0B), meth0=(1540.9MB/7.6MB), mgmt0=(1477.6MB/7.6MB)', 'message': 'NET OK - (Rx/Tx) ib0=(0.0B/0.0B), ib1=(0.0B/0.0B), icl0=(4.4kB/6.0kB), lo=(500.0B/500.0B), meth0=(1540.9MB/7.6MB), mgmt0=(1477.6MB/7.6MB)', 'value': 'ok', 'timestamp': '1730635234'} Nov 3 06:00:35 kjcf05n03 dracut[7979]: *** Including module: rootfs-block *** Nov 3 06:00:35 kjcf05n03 dracut[7979]: *** Including module: terminfo *** Nov 3 06:00:35 kjcf05n03 dracut[7979]: *** Including module: udev-rules *** Nov 3 06:00:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:00:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730635235', 'host':'kjcf05n03', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 06:00:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730635235'} Nov 3 06:00:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:00:36 kjcf05n03 dracut[7979]: Skipping udev rule: 91-permissions.rules Nov 3 06:00:36 kjcf05n03 dracut[7979]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 06:00:36 kjcf05n03 dracut[7979]: *** Including module: dracut-systemd *** Nov 3 06:00:36 kjcf05n03 dracut[7979]: *** Including module: usrmount *** Nov 3 06:00:36 kjcf05n03 dracut[7979]: *** Including module: base *** Nov 3 06:00:36 kjcf05n03 dracut[7979]: *** Including module: fs-lib *** Nov 3 06:00:37 kjcf05n03 dracut[7979]: *** Including module: kdumpbase *** Nov 3 06:00:37 kjcf05n03 dracut[7979]: *** Including module: memstrack *** Nov 3 06:00:37 kjcf05n03 dracut[7979]: *** Including module: shutdown *** Nov 3 06:00:37 kjcf05n03 dracut[7979]: *** Including module: squash *** Nov 3 06:00:37 kjcf05n03 dracut[7979]: *** Including modules done *** Nov 3 06:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 06:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 06:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 06:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 06:00:37 kjcf05n03 dracut[7979]: *** Installing kernel module dependencies *** Nov 3 06:00:38 kjcf05n03 dracut[7979]: *** Installing kernel module dependencies done *** Nov 3 06:00:38 kjcf05n03 dracut[7979]: *** Resolving executable dependencies *** Nov 3 06:00:39 kjcf05n03 dracut[7979]: *** Resolving executable dependencies done*** Nov 3 06:00:39 kjcf05n03 dracut[7979]: *** Hardlinking files *** Nov 3 06:00:39 kjcf05n03 dracut[7979]: *** Hardlinking files done *** Nov 3 06:00:39 kjcf05n03 dracut[7979]: *** Generating early-microcode cpio image *** Nov 3 06:00:39 kjcf05n03 dracut[7979]: *** Constructing AuthenticAMD.bin **** Nov 3 06:00:39 kjcf05n03 dracut[7979]: *** Store current command line parameters *** Nov 3 06:00:39 kjcf05n03 dracut[7979]: Stored kernel commandline: Nov 3 06:00:39 kjcf05n03 dracut[7979]: rd.driver.pre=sd_mod Nov 3 06:00:39 kjcf05n03 dracut[7979]: rd.driver.pre=nvme Nov 3 06:00:39 kjcf05n03 dracut[7979]: rd.driver.pre=ipmi_si Nov 3 06:00:39 kjcf05n03 dracut[7979]: rd.driver.pre=ipmi_devintf Nov 3 06:00:39 kjcf05n03 dracut[7979]: rd.driver.pre=ipmi_msghandler Nov 3 06:00:39 kjcf05n03 dracut[7979]: nameserver=172.16.2.2 Nov 3 06:00:39 kjcf05n03 dracut[7979]: nameserver=127.0.0.1 Nov 3 06:00:39 kjcf05n03 dracut[7979]: nameserver=172.16.2.2 Nov 3 06:00:39 kjcf05n03 dracut[7979]: nameserver=127.0.0.1 Nov 3 06:00:39 kjcf05n03 dracut[7979]: ifname=kdump-meth0:00:09:3d:06:9a:1a team=mgmt0:kdump-meth0 Nov 3 06:00:39 kjcf05n03 dracut[7979]: rd.neednet Nov 3 06:00:39 kjcf05n03 dracut[7979]: kdumpnic=mgmt0 Nov 3 06:00:39 kjcf05n03 dracut[7979]: bootdev=mgmt0 Nov 3 06:00:39 kjcf05n03 dracut[7979]: *** Install squash loader *** Nov 3 06:00:39 kjcf05n03 dracut[7979]: *** Squashing the files inside the initramfs *** Nov 3 06:00:40 kjcf05n03 dracut[7979]: *** Squashing the files inside the initramfs done *** Nov 3 06:00:40 kjcf05n03 dracut[7979]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 06:00:40 kjcf05n03 dracut[7979]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 06:00:41 kjcf05n03 kdumpctl[7852]: kdump: kexec: loaded kdump kernel Nov 3 06:00:41 kjcf05n03 kdumpctl[7852]: kdump: Starting kdump: [OK] Nov 3 06:00:41 kjcf05n03 systemd[1]: Started Crash recovery kernel arming. Nov 3 06:00:41 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:41 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:41 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:41 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:41 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 06:00:41 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 06:00:41 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 06:00:41 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 06:00:41 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 06:00:41 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 06:00:41 kjcf05n03 ifdown[14544]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 06:00:41 kjcf05n03 ifdown[14545]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:00:41 kjcf05n03 ifdown[14546]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:00:41 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 06:00:41 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 06:00:41 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 06:00:42 kjcf05n03 ifup[14606]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 06:00:42 kjcf05n03 ifup[14607]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:00:42 kjcf05n03 ifup[14608]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:00:43 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 06:00:46 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 06:00:46 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 06:00:46 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 06:00:46 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:00:46 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:00:46 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:00:46 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:00:46 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 06:00:46 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 06:00:46 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 06:00:46 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 06:00:46 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:00:46 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:00:46 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:00:46 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:00:46 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 06:00:46 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 06:00:46 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 06:00:46 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 06:00:46 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 06:00:46 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 06:00:46 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 06:00:46 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 06:00:46 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 06:00:46 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 06:00:46 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 06:00:46 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 06:00:46 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 06:00:46 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 06:00:46 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 06:00:46 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 06:00:46 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 06:00:46 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 06:00:46 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 06:00:46 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 06:00:46 kjcf05n03 ifdown[14793]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 06:00:46 kjcf05n03 ifdown[14794]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:00:46 kjcf05n03 ifdown[14795]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:00:46 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 06:00:46 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 06:00:46 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 06:00:47 kjcf05n03 ifup[14855]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 06:00:47 kjcf05n03 ifup[14856]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:00:47 kjcf05n03 ifup[14857]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:00:48 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 06:00:49 kjcf05n03 dcs-collectord[5660]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 06:00:49 kjcf05n03 dcs-collectord[5660]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 06:00:49 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n03": interface became available Nov 3 06:00:51 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 06:00:51 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 06:00:51 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 06:00:51 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:51 kjcf05n03 systemd[1]: Starting Corosync Cluster Engine... Nov 3 06:00:51 kjcf05n03 await_ha_peer[15064]: Waiting for HA peer kjcf05n02 Nov 3 06:00:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730635251', 'host':'kjcf05n03', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.4% (3707628 kB) used.'}"] Nov 3 06:00:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'RAM usage', 'description': 'OK - 1.4% (3707628 kB) used.', 'message': 'OK - 1.4% (3707628 kB) used.', 'value': 'ok', 'timestamp': '1730635251'} Nov 3 06:00:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:00:52 kjcf05n00 zabbix-server[1009236]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 06:00:52 kjcf05n00 zabbix-server[1009236]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n03 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n03:system.uptime): 00:03:06\\"}}"' Nov 3 06:00:52 kjcf05n00 log_interesting_event.py[1009236]: Event '45819' acknowledged Nov 3 06:00:53 kjcf05n03 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 06:00:53 kjcf05n03 await_ha_peer[15064]: Peer kjcf05n02 has started, starting HA Nov 3 06:00:53 kjcf05n03 systemd[1]: Started Corosync Cluster Engine. Nov 3 06:00:53 kjcf05n03 systemd[1]: Started Fast STONITH daemon. Nov 3 06:00:53 kjcf05n03 fstonithd.py[15125]: Listening for kdump packets from partner Nov 3 06:00:53 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:53 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:00:53 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:53 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:54 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:54 kjcf05n03 systemd[1]: Reached target resource-agents dependencies. Nov 3 06:00:54 kjcf05n03 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 06:00:54 kjcf05n03 systemd[1]: Reloading. Nov 3 06:00:54 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 06:00:54 kjcf05n03 puppet-agent[3612]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:00:54 kjcf05n03 puppet[3612]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:00:54 kjcf05n03 puppet-agent[3612]: Applied catalog in 91.98 seconds Nov 3 06:00:54 kjcf05n03 puppet[3612]: Notice: Applied catalog in 91.98 seconds Nov 3 06:00:54 kjcf05n03 systemd[1]: Started Puppet agent. Nov 3 06:00:54 kjcf05n03 systemd[1]: Starting Set absolute GEM time... Nov 3 06:00:54 kjcf05n03 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 06:00:54 kjcf05n03 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 06:00:54 kjcf05n03 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 06:00:54 kjcf05n03 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 06:00:54 kjcf05n03 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 06:00:54 kjcf05n03 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 06:00:54 kjcf05n03 systemd[1]: Reached target Timers. Nov 3 06:00:54 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 06:00:54 kjcf05n03 wce-disable.sh[15262]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 06:00:54 kjcf05n03 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 06:00:54 kjcf05n03 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 06:00:54 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 06:00:54 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 06:00:54 kjcf05n03 systemd[1]: set_gem_time.service: Succeeded. Nov 3 06:00:54 kjcf05n03 systemd[1]: Started Set absolute GEM time. Nov 3 06:00:55 kjcf05n03 gateway-ec-node.py[15260]: Starting gateway-ec-node service Nov 3 06:00:55 kjcf05n03 python3.9[15261]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 06:00:55 kjcf05n03 python3.9[15261]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 06:00:55 kjcf05n03 RFSF-API[15259]: INFO[2024-11-03T06:00:54-06:00] Datapath API RESTful Service starting Nov 3 06:00:55 kjcf05n03 dp-api-server-node[15259]: INFO[2024-11-03T06:00:54-06:00] Datapath API RESTful Service starting Nov 3 06:00:55 kjcf05n03 RFSF-API[15259]: INFO[2024-11-03T06:00:54-06:00] Running in production mode, starting dbus event listener Nov 3 06:00:55 kjcf05n03 dp-api-server-node[15259]: INFO[2024-11-03T06:00:54-06:00] Running in production mode, starting dbus event listener Nov 3 06:00:55 kjcf05n03 RFSF-API[15259]: INFO[2024-11-03T06:00:54-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 06:00:55 kjcf05n03 dp-api-server-node[15259]: INFO[2024-11-03T06:00:54-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 06:00:55 kjcf05n03 RFSF-API[15259]: INFO[2024-11-03T06:00:54-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 06:00:55 kjcf05n03 dp-api-server-node[15259]: INFO[2024-11-03T06:00:54-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 06:00:55 kjcf05n03 dp-api-server-node[15259]: INFO[2024-11-03T06:00:54-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 06:00:55 kjcf05n03 RFSF-API[15259]: INFO[2024-11-03T06:00:54-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 06:00:55 kjcf05n03 RFSF-API[15259]: INFO[2024-11-03T06:00:54-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 06:00:55 kjcf05n03 dp-api-server-node[15259]: INFO[2024-11-03T06:00:54-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 06:00:55 kjcf05n03 RFSF-API[15259]: INFO[2024-11-03T06:00:54-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 06:00:55 kjcf05n03 dp-api-server-node[15259]: INFO[2024-11-03T06:00:54-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 06:00:55 kjcf05n03 RFSF-API[15259]: INFO[2024-11-03T06:00:54-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 06:00:55 kjcf05n03 dp-api-server-node[15259]: INFO[2024-11-03T06:00:54-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 06:00:55 kjcf05n03 RFSF-API[15259]: INFO[2024-11-03T06:00:54-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 06:00:55 kjcf05n03 dp-api-server-node[15259]: INFO[2024-11-03T06:00:54-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 06:00:55 kjcf05n03 RFSF-API[15259]: INFO[2024-11-03T06:00:54-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 06:00:55 kjcf05n03 dp-api-server-node[15259]: INFO[2024-11-03T06:00:54-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 06:00:55 kjcf05n03 RFSF-API[15259]: INFO[2024-11-03T06:00:54-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 06:00:55 kjcf05n03 dp-api-server-node[15259]: INFO[2024-11-03T06:00:54-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 06:00:55 kjcf05n03 RFSF-API[15259]: INFO[2024-11-03T06:00:54-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 06:00:55 kjcf05n03 dp-api-server-node[15259]: INFO[2024-11-03T06:00:54-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 06:00:55 kjcf05n00 mcfcli[3673891]: %3|1730635255.161|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:00:55 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31418 deleted. Nov 3 06:01:02 kjcf05n03 systemd[1]: Reloading. Nov 3 06:01:02 kjcf05n03 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 06:01:02 kjcf05n03 systemd[1]: Reloading. Nov 3 06:01:02 kjcf05n03 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 06:01:02 kjcf05n03 diskmonitor_pre[15718]: Key management is currently disabled.DEAR disabled Nov 3 06:01:02 kjcf05n03 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 06:01:03 kjcf05n03 dcs-collectord[5660]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 06:01:03 kjcf05n03 dcs-collectord[5660]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 06:01:03 kjcf05n03 dcs-collectord[5660]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 06:01:04 kjcf05n03 sh[15796]: LNET configured: New Created Nov 3 06:01:04 kjcf05n03 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 06:01:04 kjcf05n03 LCNmon[17815]: Interface ib0 is up Nov 3 06:01:04 kjcf05n03 LCNmon[17815]: Interface ib1 is up Nov 3 06:01:04 kjcf05n03 LCNmon[17815]: Can ping through interface ib0 Nov 3 06:01:04 kjcf05n03 LCNmon[17815]: Can ping through interface ib1 Nov 3 06:01:04 kjcf05n03 LCNmon[17815]: NIC ib0, initial state UP Nov 3 06:01:04 kjcf05n03 LCNmon[17815]: NIC ib1, initial state UP Nov 3 06:01:04 kjcf05n03 LCNmon[17815]: LCNstat initial state UP Nov 3 06:01:04 kjcf05n03 LCNmon[17815]: LCNmon monitoring hosts kjcf05n03 and kjcf05n02 Nov 3 06:01:04 kjcf05n00 httpd[902565]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-B): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n03', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 06:01:05 kjcf05n03 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 06:01:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730635265', 'host':'kjcf05n03', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 06:01:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730635265'} Nov 3 06:01:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:01:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730635265', 'host':'kjcf05n03', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 06:01:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730635265'} Nov 3 06:01:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: /var/run/diskmonitor does not exist, creating Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: Creating /var/run/diskmonitor/disk Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: Creating /var/run/diskmonitor/encl Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: Creating /var/run/diskmonitor/cli Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: RAS_Interlocks_enabled: 1 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: add handler for sig: 14 sa_flags: 10000004 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: add handler for sig: 1 sa_flags: 10000004 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: add handler for sig: 2 sa_flags: 00000004 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: add handler for sig: 15 sa_flags: 00000004 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: add handler for sig: 6 sa_flags: 00000004 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: add handler for sig: 3 sa_flags: 00000004 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: add handler for sig: 30 sa_flags: 00000004 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: add handler for sig: 20 sa_flags: 00000004 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: add handler for sig: 10 sa_flags: 10000004 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: add handler for sig: 11 sa_flags: 00000004 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: add handler for sig: 7 sa_flags: 00000004 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: add handler for sig: 4 sa_flags: 00000004 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: add handler for sig: 8 sa_flags: 00000004 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: Using HA Baton locks - key: diskmonitor Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: Baton will be held for at most 570 seconds Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: DMMP Enabled: 0 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: random seed: 4d9a8b28 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: NVMe Enclosure: 1 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: ZFS Enclosure: 0 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: Dbus, Initialized Connection Successfully Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: int_catcher_thread: thread start Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: Received dbus message 4 org.freedesktop.DBus -> :1.93 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b07bec_S4EUNF0MA05386M encl_slot: 0 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b07bed_S4EUNF0MA05387D encl_slot: 0 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 06:01:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 06:01:07 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18202 (bash) Nov 3 06:01:07 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 06:01:07 kjcf05n03 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 06:01:07 kjcf05n03 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 06:01:07 kjcf05n03 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 06:01:07 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 06:01:08 kjcf05n03 openhpid[5566]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 06:01:08 kjcf05n03 openhpid[5566]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 06:01:08 kjcf05n00 mcfcli[3673891]: %3|1730635268.831|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:01:09 kjcf05n03 systemd[1]: openhpid.service: Succeeded. Nov 3 06:01:09 kjcf05n03 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 06:01:09 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 06:01:09 kjcf05n03 systemd[1]: openhpid.service: Supervising process 18384 which is not our child. We'll most likely not notice when it exits. Nov 3 06:01:09 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 06:01:09 kjcf05n03 systemd[1]: Reached target Multi-User System. Nov 3 06:01:09 kjcf05n03 systemd[1]: Reached target Graphical Interface. Nov 3 06:01:09 kjcf05n03 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 06:01:09 kjcf05n03 dcs-collectord[5660]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 06:01:09 kjcf05n03 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 06:01:09 kjcf05n03 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 06:01:09 kjcf05n03 systemd[1]: Startup finished in 50.474s (kernel) + 2min 32.572s (userspace) = 3min 23.046s. Nov 3 06:01:09 kjcf05n03 openhpid[18384]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 06:01:09 kjcf05n03 openhpid[18384]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 06:01:09 kjcf05n03 openhpid[18384]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 06:01:09 kjcf05n03 openhpid[18384]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 06:01:13 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 06:01:18 kjcf05n03 dcs-collectord[5660]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 06:01:18 kjcf05n03 dcs-collectord[5660]: WARNING No data collected (hpi_parser.py:353) Nov 3 06:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730635279', 'host':'kjcf05n03', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 06:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730635279'} Nov 3 06:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730635279', 'host':'kjcf05n03', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 06:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730635279'} Nov 3 06:01:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:01:19 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 06:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730635279', 'host':'kjcf05n03', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.19, 1.66, 0.80'}"] Nov 3 06:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Load', 'description': 'OK - load average: 1.19, 1.66, 0.80', 'message': 'OK - load average: 1.19, 1.66, 0.80', 'value': 'ok', 'timestamp': '1730635279'} Nov 3 06:01:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730635279', 'host':'kjcf05n03', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 366 processes with STATE = RSZDT '}"] Nov 3 06:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Total Processes', 'description': 'PROCS OK: 366 processes with STATE = RSZDT ', 'message': 'PROCS OK: 366 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730635279'} Nov 3 06:01:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:01:25 kjcf05n00 mcfcli[3673891]: %3|1730635285.162|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:01:31 kjcf05n03 ipmievd[3999]: System Event sensor - Timestamp Clock Sync Nov 3 06:01:34 kjcf05n03 ipmievd[3190]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:01:34 kjcf05n03 dcs-collectord[5660]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b07bed_S4EUNF0MA05387D encl_sn: USE26000024VS001, slot: 2 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b07bec_S4EUNF0MA05386M encl_sn: USE26000024VS001, slot: 1 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 06:01:45 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 06:01:49 kjcf05n03 dcs-collectord[5660]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 06:01:48 kjcf05n00 mcfcli[3673891]: %3|1730635308.828|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:01:53 kjcf05n02 firmware-update-orc-server[5862]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "b0bd3009-7ea3-4f27-94dd-0758a8f25bfd"} (logger.py:65) Nov 3 06:01:53 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 144327 (get_disk_device) Nov 3 06:01:53 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 06:01:53 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 06:01:52 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '6a0d98de-99db-11ef-858f-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 06:01:52 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '6a0d98de-99db-11ef-858f-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 06:01:52 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '6a0d98de-99db-11ef-858f-00093d069a1b', 'response ID': '6a18c880-99db-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 06:01:52 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 6a18c880-99db-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 06:01:53 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db0100700253845000000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 06:01:53 kjcf05n03 ras-resource-manager-agent[5924]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "6a0d98de-99db-11ef-858f-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 06:01:53 kjcf05n03 ras-resource-manager-agent[5924]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '6a0d98de-99db-11ef-858f-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 06:01:53 kjcf05n03 ras-resource-manager-agent[5924]: INFO Submitting new device inserted signal, starting to qualify drive: 6a0d98de-99db-11ef-858f-00093d069a1b (admin_action.py:110) Nov 3 06:01:53 kjcf05n02 ccp-client[144362]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 06:01:53 kjcf05n02 ccp-client[144362]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 06:01:53 kjcf05n02 ccp-client[144373]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 06:01:53 kjcf05n02 ccp-client[144362]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 06:01:53 kjcf05n02 ccp-client[144362]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 06:01:53 kjcf05n02 ccp-client[144373]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 06:01:53 kjcf05n02 ccp-client[144373]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 06:01:53 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '6a5e4ae0-99db-11ef-858f-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 06:01:53 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '6a5e4ae0-99db-11ef-858f-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 06:01:53 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '6a5e4ae0-99db-11ef-858f-00093d069a1b', 'response ID': '6a662094-99db-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 06:01:53 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 6a662094-99db-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 06:01:53 kjcf05n03 diskmonitor[17404]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 06:01:53 kjcf05n03 ras-resource-manager-agent[5924]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "6a5e4ae0-99db-11ef-858f-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 06:01:53 kjcf05n03 ras-resource-manager-agent[5924]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '6a5e4ae0-99db-11ef-858f-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 06:01:53 kjcf05n03 ras-resource-manager-agent[5924]: INFO Submitting new device inserted signal, starting to qualify drive: 6a5e4ae0-99db-11ef-858f-00093d069a1b (admin_action.py:110) Nov 3 06:01:53 kjcf05n03 firmware-update-orc-server[5881]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "991f73c8-4a61-41e6-9e55-a70633b72616"} (logger.py:65) Nov 3 06:01:55 kjcf05n00 mcfcli[3673891]: %3|1730635315.162|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:01:56 kjcf05n02 DRVFW[144482]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 06:01:56 kjcf05n02 ccp-client[144483]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 06:01:56 kjcf05n02 ccp-client[144483]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 06:01:56 kjcf05n02 ccp-client[144492]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 06:01:56 kjcf05n02 ccp-client[144483]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 06:01:56 kjcf05n02 ccp-client[144492]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 06:01:56 kjcf05n02 ccp-client[144492]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 06:01:56 kjcf05n02 ccp-client[144483]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 06:01:56 kjcf05n02 firmware-update-orc-server[5862]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 06:01:57 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 6a18c880-99db-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 06:01:57 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '6a0d98de-99db-11ef-858f-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': '6a0d98de-99db-11ef-858f-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}}} (logger.py:65) Nov 3 06:01:58 kjcf05n03 ras-resource-manager-agent[5924]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '6a0d98de-99db-11ef-858f-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 06:01:58 kjcf05n03 ras-resource-manager-agent[5924]: INFO Drive qualification complete responding: 6a0d98de-99db-11ef-858f-00093d069a1b (admin_action.py:205) Nov 3 06:01:58 kjcf05n03 ras-resource-manager-agent[5924]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "6a0d98de-99db-11ef-858f-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (interesting_event.py:59) Nov 3 06:02:00 kjcf05n03 diskmonitor[17404]: 04 Nov 3 06:02:00 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 06:02:00 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 06:02:00 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 06:02:00 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 06:02:00 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 06:02:00 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 06:02:00 kjcf05n03 diskmonitor[17404]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 06:02:00 kjcf05n03 diskmonitor[17404]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 06:02:00 kjcf05n03 diskmonitor[17404]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 06:02:00 kjcf05n03 diskmonitor[17404]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 06:02:00 kjcf05n03 diskmonitor[17404]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 06:02:00 kjcf05n03 diskmonitor[17404]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "6a0d98de-99db-11ef-858f-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 06:02:00 kjcf05n03 diskmonitor[17404]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 06:02:00 kjcf05n03 diskmonitor[17404]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 06:02:00 kjcf05n03 diskmonitor[17404]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "6a5e4ae0-99db-11ef-858f-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 06:02:00 kjcf05n03 diskmonitor[17404]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 06:02:00 kjcf05n03 diskmonitor[17404]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 06:02:02 kjcf05n03 ras-resource-manager-agent[5924]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "6a0d98de-99db-11ef-858f-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (service_main_handler.py:66) Nov 3 06:02:02 kjcf05n03 ras-resource-manager-agent[5924]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '6a0d98de-99db-11ef-858f-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 06:02:02 kjcf05n03 ras-resource-manager-agent[5924]: INFO Device qualification response has been acknowledged: 6a0d98de-99db-11ef-858f-00093d069a1b (admin_action.py:151) Nov 3 06:02:05 kjcf05n03 chronyd[5166]: Selected source 172.16.2.1 Nov 3 06:02:06 kjcf05n03 diskmonitor[17404]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 06:02:06 kjcf05n03 diskmonitor[17404]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 06:02:06 kjcf05n03 ras-resource-manager-agent[5924]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "723835a0-99db-11ef-858f-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 06:02:06 kjcf05n03 ras-resource-manager-agent[5924]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '723835a0-99db-11ef-858f-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 06:02:06 kjcf05n03 ras-resource-manager-agent[5924]: INFO Requests ['6a5e4ae0-99db-11ef-858f-00093d069a1b', '723835a0-99db-11ef-858f-00093d069a1b'] already in progress (admin_action.py:99) Nov 3 06:02:08 kjcf05n03 systemd[1]: Unmounting /mnt/llog... Nov 3 06:02:08 kjcf05n03 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 06:02:08 kjcf05n03 systemd[1]: Unmounted /mnt/llog. Nov 3 06:02:08 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 23642 (get_disk_device) Nov 3 06:02:08 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 06:02:08 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 06:02:08 kjcf05n03 ccp-client[23668]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 06:02:09 kjcf05n03 ccp-client[23668]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 06:02:09 kjcf05n03 ccp-client[23683]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 06:02:09 kjcf05n03 ccp-client[23668]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 06:02:09 kjcf05n03 ccp-client[23683]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 06:02:09 kjcf05n03 ccp-client[23683]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 06:02:09 kjcf05n03 ccp-client[23668]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 06:02:12 kjcf05n03 DRVFW[23953]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 06:02:12 kjcf05n03 ccp-client[23954]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 06:02:12 kjcf05n03 ccp-client[23954]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 06:02:12 kjcf05n03 ccp-client[23983]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 06:02:12 kjcf05n03 ccp-client[23954]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 06:02:12 kjcf05n03 ccp-client[23954]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 06:02:12 kjcf05n03 ccp-client[23983]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 06:02:12 kjcf05n03 ccp-client[23983]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 06:02:12 kjcf05n03 firmware-update-orc-server[5881]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 06:02:12 kjcf05n03 ras-resource-manager-agent[5924]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '6a5e4ae0-99db-11ef-858f-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 06:02:12 kjcf05n03 ras-resource-manager-agent[5924]: INFO Drive qualification complete responding: 6a5e4ae0-99db-11ef-858f-00093d069a1b (admin_action.py:205) Nov 3 06:02:12 kjcf05n03 ras-resource-manager-agent[5924]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "6a5e4ae0-99db-11ef-858f-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (interesting_event.py:59) Nov 3 06:02:12 kjcf05n03 ras-resource-manager-agent[5924]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "723835a0-99db-11ef-858f-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (interesting_event.py:59) Nov 3 06:02:12 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 6a662094-99db-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 06:02:12 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '6a5e4ae0-99db-11ef-858f-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': '6a5e4ae0-99db-11ef-858f-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}}} (logger.py:65) Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "6a0d98de-99db-11ef-858f-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: Dbus, handle_ingress_ras_signals, uuid: 6a0d98de-99db-11ef-858f-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "6a0d98de-99db-11ef-858f-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: main: Pending firmware leveling requests exist, rescanning disks Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "723835a0-99db-11ef-858f-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: leaving test state: 1 next state: 2 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: lock req: no timeout Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: leaving test state: 2 next state: 4 Nov 3 06:02:13 kjcf05n03 diskmonitor[17404]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 06:02:21 kjcf05n03 python3.9[5229]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 06:02:24 kjcf05n03 python3.9[3190]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:02:24 kjcf05n00 mcfcli[3673891]: %3|1730635344.656|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:02:25 kjcf05n00 mcfcli[3673891]: %3|1730635345.163|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 06:02:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730635358}"] Nov 3 06:02:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730635358, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:02:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:02:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730635358}"] Nov 3 06:02:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730635358, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:02:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:02:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730635358}"] Nov 3 06:02:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730635358, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:02:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:02:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730635358}"] Nov 3 06:02:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730635358, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:02:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:02:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730635358}"] Nov 3 06:02:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730635358, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:02:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:02:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730635358}"] Nov 3 06:02:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730635358, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:02:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:02:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730635362}"] Nov 3 06:02:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730635362, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:02:42 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:02:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730635362}"] Nov 3 06:02:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730635362, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:02:42 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:02:55 kjcf05n00 mcfcli[3673891]: %3|1730635375.164|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 06:03:01 kjcf05n00 mcfcli[3673891]: %3|1730635381.682|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:03:04 kjcf05n03 ras-resource-manager-agent[5924]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "6a5e4ae0-99db-11ef-858f-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 06:03:04 kjcf05n03 ras-resource-manager-agent[5924]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '6a5e4ae0-99db-11ef-858f-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 06:03:04 kjcf05n03 ras-resource-manager-agent[5924]: INFO Device qualification response has been acknowledged: 6a5e4ae0-99db-11ef-858f-00093d069a1b (admin_action.py:151) Nov 3 06:03:04 kjcf05n03 ras-resource-manager-agent[5924]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "723835a0-99db-11ef-858f-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 06:03:04 kjcf05n03 ras-resource-manager-agent[5924]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '723835a0-99db-11ef-858f-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 06:03:04 kjcf05n03 ras-resource-manager-agent[5924]: INFO Device qualification response has been acknowledged: 723835a0-99db-11ef-858f-00093d069a1b (admin_action.py:151) Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "6a5e4ae0-99db-11ef-858f-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: Dbus, handle_ingress_ras_signals, uuid: 6a5e4ae0-99db-11ef-858f-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "6a5e4ae0-99db-11ef-858f-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "723835a0-99db-11ef-858f-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: Dbus, handle_ingress_ras_signals, uuid: 723835a0-99db-11ef-858f-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "723835a0-99db-11ef-858f-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 06:03:07 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 06:03:08 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 06:03:14 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 06:03:14 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 06:03:14 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 06:03:25 kjcf05n03 diskmonitor[17404]: vme24n1 in enclosure slot: 10 Nov 3 06:03:25 kjcf05n03 diskmonitor[17404]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 06:03:25 kjcf05n03 diskmonitor[17404]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 06:03:25 kjcf05n03 diskmonitor[17404]: lock acquired Nov 3 06:03:25 kjcf05n03 diskmonitor[17404]: leaving test state: 4 next state: 8 Nov 3 06:03:25 kjcf05n03 diskmonitor[17404]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 06:03:25 kjcf05n00 mcfcli[3673891]: %3|1730635405.164|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 06:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T06:03:27.25266773-06:00 level=info msg="Completed cleanup jobs" duration=26.225345ms Nov 3 06:03:29 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 06:03:29 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 06:03:29 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 06:03:29 kjcf05n03 dcs-collectord[5660]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 06:03:38 kjcf05n03 diskmonitor[17404]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 06:03:38 kjcf05n03 diskmonitor[17404]: leaving test state: 8 next state: 20 Nov 3 06:03:38 kjcf05n03 diskmonitor[17404]: leaving test state: 20 next state: 40 Nov 3 06:03:38 kjcf05n03 diskmonitor[17404]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 1320ebe0000 Nov 3 06:03:38 kjcf05n03 diskmonitor[17404]: leaving test state: 40 next state: 80 Nov 3 06:03:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730635418}"] Nov 3 06:03:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730635418, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:03:38 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:03:38-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:03:38 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:03:38-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:03:38 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:03:38-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:03:38 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:03:38-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:03:38 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:03:38-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:03:38 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:03:38-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:03:38 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:03:38-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.951404ms Nov 3 06:03:38 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:03:38-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.951404ms Nov 3 06:03:38 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:03:38 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:03:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:03:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730635418}"] Nov 3 06:03:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730635418, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:03:38 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:03:38-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:03:38 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:03:38-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:03:38 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:03:38-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:03:38 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:03:38-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:03:38 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:03:38-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:03:38 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:03:38-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:03:38 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:03:38-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.908845ms Nov 3 06:03:38 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:03:38-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.908845ms Nov 3 06:03:38 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:03:38 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:03:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:03:40 kjcf05n00 mcfcli[3673891]: %3|1730635420.373|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:03:55 kjcf05n00 mcfcli[3673891]: %3|1730635435.164|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 06:04:19 kjcf05n00 mcfcli[3673891]: %3|1730635459.842|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:04:25 kjcf05n00 mcfcli[3673891]: %3|1730635465.165|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:04:40 kjcf05n03 diskmonitor[17404]: leaving test state: 80 next state: 100 Nov 3 06:04:40 kjcf05n03 diskmonitor[17404]: lock release: time: Sun Nov 3 06:04:35 2024 Nov 3 06:04:40 kjcf05n03 diskmonitor[17404]: leaving test state: 100 next state: 1 Nov 3 06:04:55 kjcf05n00 mcfcli[3673891]: %3|1730635495.166|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 06:04:58 kjcf05n00 mcfcli[3673891]: %3|1730635498.452|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:05:03 kjcf05n00 python3.9[1011728]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 06:05:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730635217', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 06:05:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730635217'} Nov 3 06:05:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:05:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730635217', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 06:05:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730635217'} Nov 3 06:05:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:05:23 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 06:05:25 kjcf05n00 mcfcli[3673891]: %3|1730635525.166|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:05:37 kjcf05n00 mcfcli[3673891]: %3|1730635537.628|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:05:55 kjcf05n00 mcfcli[3673891]: %3|1730635555.166|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 06:06:15 kjcf05n00 mcfcli[3673891]: %3|1730635575.712|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:06:25 kjcf05n00 mcfcli[3673891]: %3|1730635585.167|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 06:06:53 kjcf05n00 mcfcli[3673891]: %3|1730635613.608|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:06:55 kjcf05n00 mcfcli[3673891]: %3|1730635615.167|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:07:25 kjcf05n00 mcfcli[3673891]: %3|1730635645.167|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 06:07:31 kjcf05n00 mcfcli[3673891]: %3|1730635651.581|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:07:55 kjcf05n00 mcfcli[3673891]: %3|1730635675.168|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:07:57 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 3 06:07:57 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 06:07:57 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 06:07:57 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 06:08:09 kjcf05n00 mcfcli[3673891]: %3|1730635689.585|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:08:25 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 3 06:08:25 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 3 06:08:25 kjcf05n00 mcfcli[3673891]: %3|1730635705.168|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:08:26 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 06:08:26 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 06:08:26 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 06:08:45 kjcf05n00 mcfcli[3673891]: %3|1730635725.807|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:08:55 kjcf05n00 mcfcli[3673891]: %3|1730635735.168|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 06:09:24 kjcf05n00 mcfcli[3673891]: %3|1730635764.013|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:09:25 kjcf05n00 mcfcli[3673891]: %3|1730635765.169|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 06:09:37 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 3 06:09:55 kjcf05n00 mcfcli[3673891]: %3|1730635795.169|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 06:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 06:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 06:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 06:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 06:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 06:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 06:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 06:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 06:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 06:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 06:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 06:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 06:10:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 06:10:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:10:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 06:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 06:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 06:10:01 kjcf05n00 mcfcli[3673891]: %3|1730635801.572|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:10:03 kjcf05n00 python3.9[1014541]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 06:10:05 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 3 06:10:05 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 3 06:10:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730635217', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 06:10:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730635217'} Nov 3 06:10:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:10:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730635217', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 06:10:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730635217'} Nov 3 06:10:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:10:25 kjcf05n00 mcfcli[3673891]: %3|1730635825.169|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:10:39 kjcf05n00 mcfcli[3673891]: %3|1730635839.010|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:10:47 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 3 06:10:47 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 3 06:10:47 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 3 06:10:55 kjcf05n00 mcfcli[3673891]: %3|1730635855.170|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 06:11:18 kjcf05n00 mcfcli[3673891]: %3|1730635878.624|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:11:25 kjcf05n00 mcfcli[3673891]: %3|1730635885.171|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 06:11:29 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 3 06:11:29 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 3 06:11:29 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 3 06:11:42 kjcf05n03 root[41839]: failback_xyraid Nov 3 06:11:43 kjcf05n03 root[41963]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 06:11:44 kjcf05n03 root[42038]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 06:11:48 kjcf05n02 systemd[1]: data-kjcf05n03:md66.mount: Succeeded. Nov 3 06:11:52 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme16n1 Nov 3 06:11:52 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme20n1 Nov 3 06:11:52 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme12n1 Nov 3 06:11:52 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme11n1 Nov 3 06:11:52 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme6n1 Nov 3 06:11:52 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme7n1 Nov 3 06:11:52 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme22n1 Nov 3 06:11:52 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme21n1 Nov 3 06:11:52 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme15n1 Nov 3 06:11:52 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme5n1 Nov 3 06:11:52 kjcf05n02 dwd[5183]: Drive path is missing, purging: nvme10n1 Nov 3 06:11:53 kjcf05n03 dwd[5200]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 06:11:53 kjcf05n03 dwd[5200]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 06:11:53 kjcf05n03 dwd[5200]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 06:11:53 kjcf05n03 dwd[5200]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 06:11:53 kjcf05n03 dwd[5200]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 06:11:53 kjcf05n03 dwd[5200]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 06:11:53 kjcf05n03 dwd[5200]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 06:11:53 kjcf05n03 dwd[5200]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 06:11:53 kjcf05n03 dwd[5200]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 06:11:53 kjcf05n03 dwd[5200]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 06:11:53 kjcf05n03 dwd[5200]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 06:11:53 kjcf05n03 dwd[5200]: Starting NVME thread for nvme10n1 Nov 3 06:11:53 kjcf05n03 dwd[5200]: Starting NVME thread for nvme15n1 Nov 3 06:11:54 kjcf05n03 dwd[5200]: Starting NVME thread for nvme21n1 Nov 3 06:11:54 kjcf05n03 dwd[5200]: Starting NVME thread for nvme11n1 Nov 3 06:11:54 kjcf05n03 dwd[5200]: Starting NVME thread for nvme20n1 Nov 3 06:11:55 kjcf05n03 dwd[5200]: Starting NVME thread for nvme12n1 Nov 3 06:11:55 kjcf05n03 systemd-udevd[44886]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44887]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44889]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44892]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44886]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44887]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44889]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44887]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44892]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44886]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44889]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44887]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44886]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44892]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44889]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44887]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44892]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44886]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44889]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44887]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44892]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44886]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44889]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44887]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44889]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44886]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44892]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44887]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44889]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44886]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44892]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44887]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44926]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44924]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44928]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44930]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44926]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44928]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44930]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44924]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44928]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44923]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44924]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44923]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44924]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44928]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44924]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44928]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44924]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44928]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44924]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44928]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44924]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44924]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44928]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44924]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44928]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44924]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44928]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44924]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44928]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44928]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44928]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 systemd-udevd[44928]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:11:55 kjcf05n03 dcs-bulk-data-sender[6203]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 3 06:11:55 kjcf05n03 dwd[5200]: Starting NVME thread for nvme7n1 Nov 3 06:11:55 kjcf05n03 dwd[5200]: Starting NVME thread for nvme6n1 Nov 3 06:11:55 kjcf05n03 dwd[5200]: Starting NVME thread for nvme5n1 Nov 3 06:11:55 kjcf05n03 dwd[5200]: Starting NVME thread for nvme16n1 Nov 3 06:11:55 kjcf05n00 mcfcli[3673891]: %3|1730635915.171|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 06:11:55 kjcf05n03 dwd[5200]: Starting NVME thread for nvme22n1 Nov 3 06:11:56 kjcf05n00 mcfcli[3673891]: %3|1730635916.390|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:11:58 kjcf05n03 nslcd[7259]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 06:11:59 kjcf05n03 diskmonitor[17404]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 06:12:08 kjcf05n03 diskmonitor[17404]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 06:12:08 kjcf05n03 diskmonitor[17404]: Scan for ReadErrorMax change for md66 Nov 3 06:12:08 kjcf05n03 diskmonitor[17404]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 06:12:08 kjcf05n03 diskmonitor[17404]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 06:12:08 kjcf05n03 diskmonitor[17404]: read_saved_file: md66 no saved speed Nov 3 06:12:08 kjcf05n03 diskmonitor[17404]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 06:12:08 kjcf05n03 diskmonitor[17404]: Set sync_speed_min (10000) for md66 Nov 3 06:12:08 kjcf05n03 diskmonitor[17404]: Set sync_speed_max (200000) for md66 Nov 3 06:12:08 kjcf05n03 diskmonitor[17404]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 06:12:11 kjcf05n02 nslcd[7234]: [5f007c] ldap_result() failed: Can't contact LDAP server Nov 3 06:12:25 kjcf05n00 mcfcli[3673891]: %3|1730635945.171|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:12:32 kjcf05n02 nslcd[7234]: [d062c2] ldap_result() failed: Can't contact LDAP server Nov 3 06:12:34 kjcf05n02 diskmonitor[17586]: Removed MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 06:12:34 kjcf05n02 diskmonitor[17586]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 06:12:36 kjcf05n00 mcfcli[3673891]: %3|1730635956.387|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:12:47 kjcf05n03 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 06:12:47 kjcf05n03 systemd-tmpfiles[47531]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 06:12:47 kjcf05n03 systemd-tmpfiles[47531]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 06:12:47 kjcf05n03 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 06:12:47 kjcf05n03 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 06:12:51 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47723 (bash) Nov 3 06:12:51 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 06:12:51 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 06:12:55 kjcf05n00 mcfcli[3673891]: %3|1730635975.172|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:13:14 kjcf05n00 mcfcli[3673891]: %3|1730635994.032|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:13:25 kjcf05n00 mcfcli[3673891]: %3|1730636005.173|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 06:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T06:13:27.253102402-06:00 level=info msg="Completed cleanup jobs" duration=26.08378ms Nov 3 06:13:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730636018}"] Nov 3 06:13:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636018, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:13:38 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:38-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:38 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:38-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:38 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:38-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:38 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:38-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:38 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:38-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:38 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:38-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:38 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:38-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.086037ms Nov 3 06:13:38 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:38-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.086037ms Nov 3 06:13:38 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:13:38 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:13:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:13:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730636018}"] Nov 3 06:13:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636018, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:13:38 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:38-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:38 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:38-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:38 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:38-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:38 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:38-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:38 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:38-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:38 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:38-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:38 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:38-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.99734ms Nov 3 06:13:38 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:38-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.99734ms Nov 3 06:13:38 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:13:38 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:13:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:13:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730636018}"] Nov 3 06:13:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636018, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:13:39 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:39-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:39 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:39-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:39 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:39-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:39 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:39-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:39 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:39-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:39 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:39-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:39 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:39-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.658546ms Nov 3 06:13:39 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:39-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.658546ms Nov 3 06:13:39 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:13:39 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:13:39 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:13:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730636018}"] Nov 3 06:13:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636018, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:13:39 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:39-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:39 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:39-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:39 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:39-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:39 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:39-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:39 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:39-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:39 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:39-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:39 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:39-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.674496ms Nov 3 06:13:39 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:39-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.674496ms Nov 3 06:13:39 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:13:39 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:13:39 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:13:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730636018}"] Nov 3 06:13:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636018, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:13:39 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:39-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:39 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:39-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:39 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:39-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:39 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:39-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:39 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:39-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:39 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:39-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:39 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:39-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.080316ms Nov 3 06:13:39 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:39-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.080316ms Nov 3 06:13:39 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:13:39 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:13:39 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:13:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730636018}"] Nov 3 06:13:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636018, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:13:39 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:39-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:39 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:39-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:39 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:39-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:39 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:39-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:39 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:39-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:39 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:39-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:39 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:39-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.843956ms Nov 3 06:13:39 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:39-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.843956ms Nov 3 06:13:39 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:13:39 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:13:39 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:13:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730636018}"] Nov 3 06:13:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636018, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:13:39 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:39-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:39 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:39-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:39 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:39-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:39 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:39-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:39 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:39-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:39 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:39-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:39 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:39-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.919295ms Nov 3 06:13:39 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:39-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.919295ms Nov 3 06:13:39 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:13:39 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:13:39 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:13:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730636018}"] Nov 3 06:13:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636018, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:13:39 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:39-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:39 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:39-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:39 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:39-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:39 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:39-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:39 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:39-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:39 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:39-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:39 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:39-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.819036ms Nov 3 06:13:39 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:39-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.819036ms Nov 3 06:13:39 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:13:39 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:13:39 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:13:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730636018}"] Nov 3 06:13:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636018, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:13:39 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:39-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:39 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:39-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:39 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:39-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:39 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:39-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:39 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:39-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:39 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:39-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:39 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:39-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.92228ms Nov 3 06:13:39 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:39-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.92228ms Nov 3 06:13:39 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:13:39 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:13:39 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:13:40 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730636018}"] Nov 3 06:13:40 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636018, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:13:40 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:40-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:40 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:40-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:40 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:40-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:40 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:40-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:40 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:40-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:40 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:40-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:40 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:40-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.01305ms Nov 3 06:13:40 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:40-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.01305ms Nov 3 06:13:40 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:13:40 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:13:40 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:13:40 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730636018}"] Nov 3 06:13:40 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636018, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:13:40 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:40-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:40 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:40-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:13:40 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:40-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:40 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:13:40-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:40 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:40-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:13:40 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:13:40-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:13:40 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:13:40-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.647418ms Nov 3 06:13:40 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:13:40-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.647418ms Nov 3 06:13:40 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:13:40 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:13:40 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:13:52 kjcf05n00 mcfcli[3673891]: %3|1730636032.476|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:13:55 kjcf05n00 mcfcli[3673891]: %3|1730636035.173|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:14:01 kjcf05n00 zabbix-server[1016963]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 06:14:01 kjcf05n00 zabbix-server[1016963]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n03' from event '45834' Nov 3 06:14:01 kjcf05n00 zabbix-server[1016963]: Filesystem 'kjcf05' has been mounted Nov 3 06:14:02 kjcf05n00 zabbix-server[1016963]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 06:14:02 kjcf05n00 zabbix-server[1016963]: Running puppet on 'None' Nov 3 06:14:04 kjcf05n02 puppet-agent[167052]: Using configured environment 'production' Nov 3 06:14:04 kjcf05n02 puppet-agent[167052]: Retrieving pluginfacts Nov 3 06:14:04 kjcf05n06 puppet-agent[2452855]: Using configured environment 'production' Nov 3 06:14:04 kjcf05n06 puppet-agent[2452855]: Retrieving pluginfacts Nov 3 06:14:04 kjcf05n06 puppet-agent[2452855]: Retrieving plugin Nov 3 06:14:04 kjcf05n03 puppet-agent[49786]: Using configured environment 'production' Nov 3 06:14:04 kjcf05n03 puppet-agent[49786]: Retrieving pluginfacts Nov 3 06:14:04 kjcf05n03 puppet-agent[49786]: Retrieving plugin Nov 3 06:14:04 kjcf05n07 puppet-agent[2450846]: Using configured environment 'production' Nov 3 06:14:04 kjcf05n07 puppet-agent[2450846]: Retrieving pluginfacts Nov 3 06:14:04 kjcf05n07 puppet-agent[2450846]: Retrieving plugin Nov 3 06:14:04 kjcf05n05 puppet-agent[2596632]: Using configured environment 'production' Nov 3 06:14:04 kjcf05n05 puppet-agent[2596632]: Retrieving pluginfacts Nov 3 06:14:04 kjcf05n05 puppet-agent[2596632]: Retrieving plugin Nov 3 06:14:04 kjcf05n04 puppet-agent[2454700]: Using configured environment 'production' Nov 3 06:14:04 kjcf05n04 puppet-agent[2454700]: Retrieving pluginfacts Nov 3 06:14:04 kjcf05n04 puppet-agent[2454700]: Retrieving plugin Nov 3 06:14:04 kjcf05n02 puppet-agent[167052]: Retrieving plugin Nov 3 06:14:04 kjcf05n06 puppet-agent[2452855]: Loading facts Nov 3 06:14:05 kjcf05n01 puppet-agent[2936796]: Using configured environment 'production' Nov 3 06:14:05 kjcf05n01 puppet-agent[2936796]: Retrieving pluginfacts Nov 3 06:14:05 kjcf05n01 puppet-agent[2936796]: Retrieving plugin Nov 3 06:14:05 kjcf05n03 puppet-agent[49786]: Loading facts Nov 3 06:14:05 kjcf05n02 puppet-agent[167052]: Loading facts Nov 3 06:14:05 kjcf05n07 puppet-agent[2450846]: Loading facts Nov 3 06:14:05 kjcf05n05 puppet-agent[2596632]: Loading facts Nov 3 06:14:05 kjcf05n04 puppet-agent[2454700]: Loading facts Nov 3 06:14:04 kjcf05n00 puppet-agent[1017028]: Using configured environment 'production' Nov 3 06:14:04 kjcf05n00 puppet-agent[1017028]: Retrieving pluginfacts Nov 3 06:14:04 kjcf05n00 puppet-agent[1017028]: Retrieving plugin Nov 3 06:14:05 kjcf05n01 puppet-agent[2936796]: Loading facts Nov 3 06:14:05 kjcf05n00 puppet-agent[1017028]: Loading facts Nov 3 06:14:09 kjcf05n02 puppet-agent[167052]: Caching catalog for kjcf05n02 Nov 3 06:14:09 kjcf05n02 puppet-agent[167052]: Applying configuration version '1730636046' Nov 3 06:14:09 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 06:14:10 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 06:14:10 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 06:14:11 kjcf05n06 puppet-agent[2452855]: Caching catalog for kjcf05n06 Nov 3 06:14:11 kjcf05n06 puppet-agent[2452855]: Applying configuration version '1730636046' Nov 3 06:14:12 kjcf05n07 puppet-agent[2450846]: Caching catalog for kjcf05n07 Nov 3 06:14:12 kjcf05n07 puppet-agent[2450846]: Applying configuration version '1730636046' Nov 3 06:14:12 kjcf05n03 puppet-agent[49786]: Caching catalog for kjcf05n03 Nov 3 06:14:12 kjcf05n03 puppet-agent[49786]: Applying configuration version '1730636046' Nov 3 06:14:12 kjcf05n01 puppet-agent[2936796]: Caching catalog for kjcf05n01 Nov 3 06:14:13 kjcf05n01 puppet-agent[2936796]: Applying configuration version '1730636049' Nov 3 06:14:13 kjcf05n02 puppet-agent[167052]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 06:14:13 kjcf05n02 puppet-agent[167052]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 06:14:13 kjcf05n02 puppet-agent[167052]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 06:14:13 kjcf05n06 puppet-agent[2452855]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 06:14:13 kjcf05n06 puppet-agent[2452855]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 06:14:13 kjcf05n06 puppet-agent[2452855]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 06:14:14 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 06:14:14 kjcf05n02 zabbix_agent2[109045]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 06:14:14 kjcf05n02 zabbix_agent2[3168]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:14:14 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 06:14:14 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 06:14:14 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 06:14:14 kjcf05n02 puppet-agent[167052]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: Press Ctrl+C to exit. Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: Plugin support version 1.0 Nov 3 06:14:14 kjcf05n02 zabbix_agent2[167564]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 06:14:14 kjcf05n03 puppet-agent[49786]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 06:14:14 kjcf05n03 puppet-agent[49786]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 06:14:14 kjcf05n03 puppet-agent[49786]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 06:14:14 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2400631]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 06:14:14 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 06:14:14 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 06:14:14 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 06:14:14 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 06:14:14 kjcf05n06 puppet-agent[2452855]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: Press Ctrl+C to exit. Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: Plugin support version 1.0 Nov 3 06:14:14 kjcf05n06 zabbix_agent2[2453415]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 06:14:14 kjcf05n07 puppet-agent[2450846]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 06:14:14 kjcf05n07 puppet-agent[2450846]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 06:14:14 kjcf05n07 puppet-agent[2450846]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 06:14:15 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 06:14:15 kjcf05n03 zabbix_agent2[6008]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 06:14:15 kjcf05n03 zabbix_agent2[3190]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:14:15 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 06:14:15 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 06:14:15 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 06:14:15 kjcf05n03 puppet-agent[49786]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: Press Ctrl+C to exit. Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: Plugin support version 1.0 Nov 3 06:14:15 kjcf05n03 zabbix_agent2[50600]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 06:14:15 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2398173]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 06:14:15 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 06:14:15 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 06:14:15 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 06:14:15 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 06:14:15 kjcf05n07 puppet-agent[2450846]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: Press Ctrl+C to exit. Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: Plugin support version 1.0 Nov 3 06:14:15 kjcf05n07 zabbix_agent2[2451495]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 06:14:15 kjcf05n01 puppet-agent[2936796]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 06:14:15 kjcf05n01 puppet-agent[2936796]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-05:53:57]/mode) mode changed '0755' to '0750' Nov 3 06:14:15 kjcf05n01 puppet-agent[2936796]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-05:53:57/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 06:14:15 kjcf05n01 puppet-agent[2936796]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-05:53:57/vmcore]/mode) mode changed '0600' to '0640' Nov 3 06:14:15 kjcf05n01 puppet-agent[2936796]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-05:53:57/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 06:14:15 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 06:14:15 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 06:14:15 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 06:14:15 kjcf05n00 puppet-agent[1017028]: Caching catalog for kjcf05n00 Nov 3 06:14:15 kjcf05n00 puppet-agent[1017028]: Applying configuration version '1730636051' Nov 3 06:14:16 kjcf05n06 puppet-agent[2452855]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 06:14:16 kjcf05n06 puppet-agent[2452855]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 06:14:16 kjcf05n06 puppet-agent[2452855]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 06:14:16 kjcf05n02 puppet-agent[167052]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 06:14:16 kjcf05n02 puppet-agent[167052]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 06:14:16 kjcf05n02 puppet-agent[167052]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 06:14:16 kjcf05n02 puppet-agent[167052]: Applied catalog in 6.69 seconds Nov 3 06:14:16 kjcf05n06 puppet-agent[2452855]: Applied catalog in 4.95 seconds Nov 3 06:14:16 kjcf05n01 puppet-agent[2936796]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 06:14:16 kjcf05n01 puppet-agent[2936796]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 06:14:16 kjcf05n01 puppet-agent[2936796]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 06:14:17 kjcf05n03 puppet-agent[49786]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 06:14:17 kjcf05n03 puppet-agent[49786]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 06:14:17 kjcf05n03 puppet-agent[49786]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 06:14:17 kjcf05n03 puppet-agent[49786]: Applied catalog in 5.35 seconds Nov 3 06:14:17 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2925104]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 06:14:17 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 06:14:17 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 06:14:17 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 06:14:17 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 06:14:17 kjcf05n01 puppet-agent[2936796]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: Press Ctrl+C to exit. Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: Plugin support version 1.0 Nov 3 06:14:17 kjcf05n01 zabbix_agent2[2937251]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 06:14:17 kjcf05n07 puppet-agent[2450846]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 06:14:17 kjcf05n07 puppet-agent[2450846]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 06:14:17 kjcf05n07 puppet-agent[2450846]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 06:14:17 kjcf05n07 puppet-agent[2450846]: Applied catalog in 5.13 seconds Nov 3 06:14:18 kjcf05n00 puppet-agent[1017028]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 06:14:19 kjcf05n01 puppet-agent[2936796]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_060105.log]/mode) mode changed '0644' to '0640' Nov 3 06:14:19 kjcf05n01 puppet-agent[2936796]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_061250.log]/mode) mode changed '0644' to '0640' Nov 3 06:14:20 kjcf05n01 puppet-agent[2936796]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_060107.log]/mode) mode changed '0644' to '0640' Nov 3 06:14:20 kjcf05n01 puppet-agent[2936796]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_061250.log]/mode) mode changed '0644' to '0640' Nov 3 06:14:20 kjcf05n01 puppet-agent[2936796]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_061251]/mode) mode changed '0755' to '0750' Nov 3 06:14:20 kjcf05n01 puppet-agent[2936796]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_061251/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 06:14:20 kjcf05n01 puppet-agent[2936796]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 06:14:20 kjcf05n01 puppet-agent[2936796]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 06:14:20 kjcf05n01 puppet-agent[2936796]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 06:14:19 kjcf05n00 puppet-agent[1017028]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 06:14:19 kjcf05n00 puppet-agent[1017028]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 06:14:19 kjcf05n00 puppet-agent[1017028]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 06:14:20 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 06:14:20 kjcf05n00 zabbix_agent2[998986]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 06:14:20 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 06:14:20 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 06:14:20 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 06:14:20 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 06:14:20 kjcf05n00 puppet-agent[1017028]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: Press Ctrl+C to exit. Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: Plugin support version 1.0 Nov 3 06:14:20 kjcf05n00 zabbix_agent2[1017741]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 06:14:20 kjcf05n00 zabbix-server[1017781]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 06:14:21 kjcf05n01 puppet-agent[2936796]: Applied catalog in 8.77 seconds Nov 3 06:14:21 kjcf05n00 zabbix-server[1017782]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 06:14:21 kjcf05n00 zabbix-server[1017787]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 06:14:21 kjcf05n05 puppet-agent[2596632]: Caching catalog for kjcf05n05 Nov 3 06:14:21 kjcf05n05 puppet-agent[2596632]: Applying configuration version '1730636059' Nov 3 06:14:21 kjcf05n00 zabbix-server[1017789]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 06:14:22 kjcf05n00 puppet-agent[1017028]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 06:14:23 kjcf05n00 puppet-agent[1017028]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 06:14:23 kjcf05n00 puppet-agent[1017028]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 06:14:23 kjcf05n00 puppet-agent[1017028]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 06:14:24 kjcf05n05 puppet-agent[2596632]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 06:14:24 kjcf05n05 puppet-agent[2596632]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 06:14:24 kjcf05n05 puppet-agent[2596632]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 06:14:23 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 06:14:24 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 06:14:24 kjcf05n00 puppet-agent[1017028]: Applied catalog in 8.59 seconds Nov 3 06:14:24 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2538006]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 06:14:24 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 06:14:24 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 06:14:24 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 06:14:24 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 06:14:24 kjcf05n05 puppet-agent[2596632]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: Press Ctrl+C to exit. Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: Plugin support version 1.0 Nov 3 06:14:24 kjcf05n05 zabbix_agent2[2598016]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 06:14:25 kjcf05n00 mcfcli[3673891]: %3|1730636065.173|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 06:14:26 kjcf05n05 puppet-agent[2596632]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 06:14:26 kjcf05n05 puppet-agent[2596632]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 06:14:26 kjcf05n05 puppet-agent[2596632]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 06:14:26 kjcf05n05 puppet-agent[2596632]: Applied catalog in 4.94 seconds Nov 3 06:14:28 kjcf05n00 mcfcli[3673891]: %3|1730636068.740|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:14:55 kjcf05n00 mcfcli[3673891]: %3|1730636095.173|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:15:01 kjcf05n04 puppet-agent[2454700]: Caching catalog for kjcf05n04 Nov 3 06:15:01 kjcf05n04 puppet-agent[2454700]: Applying configuration version '1730636099' Nov 3 06:15:03 kjcf05n04 puppet-agent[2454700]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 06:15:03 kjcf05n04 puppet-agent[2454700]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 06:15:03 kjcf05n04 puppet-agent[2454700]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 06:15:03 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2398446]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 06:15:03 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 06:15:03 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 06:15:03 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 06:15:03 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 06:15:03 kjcf05n04 puppet-agent[2454700]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: Press Ctrl+C to exit. Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: Plugin support version 1.0 Nov 3 06:15:03 kjcf05n04 zabbix_agent2[2456666]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 06:15:04 kjcf05n00 python3.9[1018162]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 06:15:05 kjcf05n04 puppet-agent[2454700]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 06:15:05 kjcf05n04 puppet-agent[2454700]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 06:15:05 kjcf05n04 puppet-agent[2454700]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 06:15:06 kjcf05n04 puppet-agent[2454700]: Applied catalog in 4.77 seconds Nov 3 06:15:05 kjcf05n00 zabbix-server[1016963]: puppet completed status:(0): '' Nov 3 06:15:05 kjcf05n00 zabbix-server[1016963]: Event '45834' acknowledged Nov 3 06:15:05 kjcf05n00 zabbix-server[1016963]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n03"}' Nov 3 06:15:08 kjcf05n00 mcfcli[3673891]: %3|1730636108.737|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:15:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730636117', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 06:15:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730636117'} Nov 3 06:15:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:15:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730636117', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 06:15:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730636117'} Nov 3 06:15:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:15:25 kjcf05n00 mcfcli[3673891]: %3|1730636125.173|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:15:47 kjcf05n00 mcfcli[3673891]: %3|1730636147.305|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:15:55 kjcf05n00 mcfcli[3673891]: %3|1730636155.175|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:16:25 kjcf05n00 mcfcli[3673891]: %3|1730636185.175|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:16:26 kjcf05n00 mcfcli[3673891]: %3|1730636186.057|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:16:55 kjcf05n00 mcfcli[3673891]: %3|1730636215.175|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 06:17:06 kjcf05n00 mcfcli[3673891]: %3|1730636226.053|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:17:08 kjcf05n03 dwd[5200]: nvme15n1 passed periodic SMART status check Nov 3 06:17:08 kjcf05n03 dwd[5200]: nvme10n1 passed periodic SMART status check Nov 3 06:17:09 kjcf05n03 dwd[5200]: nvme20n1 passed periodic SMART status check Nov 3 06:17:09 kjcf05n03 dwd[5200]: nvme12n1 passed periodic SMART status check Nov 3 06:17:09 kjcf05n03 dwd[5200]: nvme21n1 passed periodic SMART status check Nov 3 06:17:09 kjcf05n03 dwd[5200]: nvme11n1 passed periodic SMART status check Nov 3 06:17:11 kjcf05n03 dwd[5200]: nvme22n1 passed periodic SMART status check Nov 3 06:17:11 kjcf05n03 dwd[5200]: nvme6n1 passed periodic SMART status check Nov 3 06:17:11 kjcf05n03 dwd[5200]: nvme5n1 passed periodic SMART status check Nov 3 06:17:11 kjcf05n03 dwd[5200]: nvme7n1 passed periodic SMART status check Nov 3 06:17:11 kjcf05n03 dwd[5200]: nvme16n1 passed periodic SMART status check Nov 3 06:17:25 kjcf05n00 mcfcli[3673891]: %3|1730636245.177|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 06:17:43 kjcf05n00 mcfcli[3673891]: %3|1730636263.927|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:17:55 kjcf05n00 mcfcli[3673891]: %3|1730636275.177|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:18:23 kjcf05n00 mcfcli[3673891]: %3|1730636303.924|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:18:25 kjcf05n00 mcfcli[3673891]: %3|1730636305.177|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:18:55 kjcf05n00 mcfcli[3673891]: %3|1730636335.178|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 06:18:59 kjcf05n00 mcfcli[3673891]: %3|1730636339.445|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:19:23 kjcf05n00 zabbix-server[1020848]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 06:19:23 kjcf05n00 zabbix-server[1020848]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 189.55\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 131.01\\"}}"' Nov 3 06:19:24 kjcf05n00 log_interesting_event.py[1020848]: Event '45836' acknowledged Nov 3 06:19:25 kjcf05n00 mcfcli[3673891]: %3|1730636365.178|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:19:39 kjcf05n00 mcfcli[3673891]: %3|1730636379.442|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:19:55 kjcf05n00 mcfcli[3673891]: %3|1730636395.179|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 06:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 06:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 06:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 06:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 06:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 06:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 06:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 06:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 06:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 06:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 06:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 06:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 06:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 06:20:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 06:20:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:20:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 06:20:04 kjcf05n00 python3.9[1021006]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 06:20:16 kjcf05n00 mcfcli[3673891]: %3|1730636416.936|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:20:25 kjcf05n00 mcfcli[3673891]: %3|1730636425.179|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 06:20:55 kjcf05n00 mcfcli[3673891]: %3|1730636455.180|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:20:55 kjcf05n00 mcfcli[3673891]: %3|1730636455.298|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:21:25 kjcf05n00 mcfcli[3673891]: %3|1730636485.680|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 06:21:35 kjcf05n00 mcfcli[3673891]: %3|1730636495.175|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:21:55 kjcf05n00 mcfcli[3673891]: %3|1730636515.681|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 06:22:12 kjcf05n00 mcfcli[3673891]: %3|1730636532.789|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:22:25 kjcf05n00 mcfcli[3673891]: %3|1730636545.682|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:22:50 kjcf05n00 mcfcli[3673891]: %3|1730636570.378|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:22:55 kjcf05n00 mcfcli[3673891]: %3|1730636575.683|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T12:23:15.868507Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 06:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T12:23:15.868573Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.084ms Nov 3 06:23:25 kjcf05n00 mcfcli[3673891]: %3|1730636605.683|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T06:23:27.247384593-06:00 level=info msg="Completed cleanup jobs" duration=20.48262ms Nov 3 06:23:28 kjcf05n00 mcfcli[3673891]: %3|1730636608.110|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:23:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 06:23:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 06:23:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 06:23:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 06:23:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 06:23:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 06:23:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 06:23:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 06:23:56 kjcf05n00 mcfcli[3673891]: %3|1730636636.027|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 06:23:56 kjcf05n00 zabbix_server[15773]: Zabbix agent item "dcs.lustre.device.ost.name[OST0001,ost_name]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 3 06:23:58 kjcf05n00 zabbix_server[15739]: Zabbix agent item "dcs.lustre.filesystem_name[kjcf05]" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 3 06:23:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 06:23:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 06:24:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 06:24:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 06:24:02 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='15', error='Connection reset by peer (104)' Nov 3 06:24:02 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='15', client='AF_INET(172.16.2.5:34769)', local='AF_INET(0.0.0.0:601)' Nov 3 06:24:02 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 06:24:02 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 06:24:02 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 06:24:02 kjcf05n03 fstonithd.py[15125]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 3 06:24:03 kjcf05n03 root[66880]: is_enc_ipmi_off starts Nov 3 06:24:03 kjcf05n03 root[66881]: is_viking_off starts Nov 3 06:24:03 kjcf05n03 root[66899]: I am not master; I will get master Nov 3 06:24:03 kjcf05n03 root[66902]: I am in slot 1; partner is in slot 0 Nov 3 06:24:03 kjcf05n03 root[66904]: is_lan_ipmi_off leaves Nov 3 06:24:03 kjcf05n03 root[66912]: is_lan_ipmi_sec_off leaves Nov 3 06:24:07 kjcf05n00 mcfcli[3673891]: %3|1730636647.715|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:24:08 kjcf05n03 root[67025]: I am now master Nov 3 06:24:09 kjcf05n03 LCNmon[17815]: 10.16.100.52 is unreachable via ib0 Nov 3 06:24:09 kjcf05n03 LCNmon[17815]: 10.16.100.58 is unreachable via ib0 Nov 3 06:24:09 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 3 06:24:09 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 11 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007289 sec, idle for 1 hour(s)] Nov 3 06:24:11 kjcf05n03 root[67095]: is_viking_off leaves Nov 3 06:24:11 kjcf05n03 root[67098]: kjcf05n02 not already off look at kdump Nov 3 06:24:11 kjcf05n03 root[67099]: is_kdump_off starts Nov 3 06:24:11 kjcf05n03 fence_kdump[67100]: waiting for message from '172.16.2.5' Nov 3 06:24:11 kjcf05n03 fence_kdump[67100]: received valid message from '172.16.2.5' Nov 3 06:24:11 kjcf05n03 root[67114]: is_kdump_off detected kdump on kjcf05n02 Nov 3 06:24:11 kjcf05n03 root[67115]: kjcf05n02 is kdumping Nov 3 06:24:11 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0001,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 06:24:11 kjcf05n03 root[67206]: is_viking_off starts Nov 3 06:24:11 kjcf05n03 root[67205]: is_enc_ipmi_off starts Nov 3 06:24:11 kjcf05n03 root[67223]: is_lan_ipmi_off leaves Nov 3 06:24:11 kjcf05n03 root[67225]: is_lan_ipmi_sec_off leaves Nov 3 06:24:11 kjcf05n03 root[67239]: I am master Nov 3 06:24:12 kjcf05n03 root[67253]: I am in slot 1; partner is in slot 0 Nov 3 06:24:13 kjcf05n03 LCNmon[17815]: 10.16.100.52 is unreachable via ib1 Nov 3 06:24:13 kjcf05n03 LCNmon[17815]: 10.16.100.58 is unreachable via ib1 Nov 3 06:24:13 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vfs.fs.size[/etc/ganesha,used]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 06:24:14 kjcf05n00 zabbix_server[15762]: Zabbix agent item "vfs.fs.size[/mnt/persistent_ha_data,pused]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 06:24:18 kjcf05n03 root[67413]: is_viking_off leaves Nov 3 06:24:18 kjcf05n03 root[67416]: kjcf05n02 not already off look at kdump Nov 3 06:24:18 kjcf05n03 root[67417]: is_kdump_off starts Nov 3 06:24:18 kjcf05n03 fence_kdump[67418]: waiting for message from '172.16.2.5' Nov 3 06:24:18 kjcf05n03 fence_kdump[67418]: received valid message from '172.16.2.5' Nov 3 06:24:18 kjcf05n03 root[67433]: is_kdump_off detected kdump on kjcf05n02 Nov 3 06:24:18 kjcf05n03 root[67434]: kjcf05n02 is kdumping Nov 3 06:24:18 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 06:24:18 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 06:24:22 kjcf05n03 dwd[5200]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 06:24:22 kjcf05n03 dwd[5200]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 06:24:22 kjcf05n03 dwd[5200]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 06:24:22 kjcf05n03 dwd[5200]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 06:24:22 kjcf05n03 dwd[5200]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 06:24:22 kjcf05n03 dwd[5200]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 06:24:22 kjcf05n03 dwd[5200]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 06:24:22 kjcf05n03 dwd[5200]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 06:24:22 kjcf05n03 dwd[5200]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 06:24:22 kjcf05n03 dwd[5200]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 06:24:22 kjcf05n03 dwd[5200]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 06:24:22 kjcf05n03 dwd[5200]: Starting NVME thread for nvme25n1 Nov 3 06:24:23 kjcf05n03 dwd[5200]: Starting NVME thread for nvme8n1 Nov 3 06:24:23 kjcf05n03 dwd[5200]: Starting NVME thread for nvme18n1 Nov 3 06:24:23 kjcf05n03 dwd[5200]: Starting NVME thread for nvme23n1 Nov 3 06:24:23 kjcf05n03 systemd-udevd[69683]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69682]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69684]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69686]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69683]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69684]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69682]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69686]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69683]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69684]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69686]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69682]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69683]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69684]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69686]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69683]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69682]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69684]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69686]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69683]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69682]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69684]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69686]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69683]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69682]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69710]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69684]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69686]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69713]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69715]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69683]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69719]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69710]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69682]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69684]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69686]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69713]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69719]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69710]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69682]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69684]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69710]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69710]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69710]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69684]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69710]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69719]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69710]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69713]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69682]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69710]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69719]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69684]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69710]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69684]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69710]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69710]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69684]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69710]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69684]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69710]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69684]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69710]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 systemd-udevd[69710]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:24:23 kjcf05n03 dwd[5200]: Starting NVME thread for nvme9n1 Nov 3 06:24:23 kjcf05n03 dwd[5200]: Starting NVME thread for nvme4n1 Nov 3 06:24:23 kjcf05n03 dwd[5200]: Starting NVME thread for nvme2n1 Nov 3 06:24:24 kjcf05n03 dwd[5200]: Starting NVME thread for nvme3n1 Nov 3 06:24:24 kjcf05n03 dwd[5200]: Starting NVME thread for nvme19n1 Nov 3 06:24:24 kjcf05n03 dwd[5200]: Starting NVME thread for nvme17n1 Nov 3 06:24:24 kjcf05n03 dwd[5200]: Starting NVME thread for nvme24n1 Nov 3 06:24:26 kjcf05n00 mcfcli[3673891]: %3|1730636666.028|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 06:24:26 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.mdt.name[MDT0000,mdt_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 06:24:29 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vm.memory.size[pavailable]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 06:24:34 kjcf05n03 diskmonitor[17404]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 06:24:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 06:24:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 06:24:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 06:24:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 06:24:41 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 3 06:24:42 kjcf05n03 diskmonitor[17404]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 06:24:42 kjcf05n03 diskmonitor[17404]: Scan for ReadErrorMax change for md65 Nov 3 06:24:42 kjcf05n03 diskmonitor[17404]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 06:24:42 kjcf05n03 diskmonitor[17404]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 06:24:42 kjcf05n03 diskmonitor[17404]: read_saved_file: md65 no saved speed Nov 3 06:24:42 kjcf05n03 diskmonitor[17404]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 06:24:42 kjcf05n03 diskmonitor[17404]: Set sync_speed_min (10000) for md65 Nov 3 06:24:42 kjcf05n03 diskmonitor[17404]: Set sync_speed_max (200000) for md65 Nov 3 06:24:42 kjcf05n03 diskmonitor[17404]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 06:24:44 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 3 06:24:47 kjcf05n00 mcfcli[3673891]: %3|1730636687.712|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:24:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 06:24:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 06:24:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 06:24:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 06:24:56 kjcf05n00 mcfcli[3673891]: %3|1730636696.028|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 06:24:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 06:24:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 06:24:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 06:24:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 06:25:07 kjcf05n00 python3.9[1024048]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 06:25:09 kjcf05n03 LCNmon[17815]: 10.16.100.52 is unreachable via ib0 Nov 3 06:25:09 kjcf05n03 LCNmon[17815]: 10.16.100.58 is unreachable via ib0 Nov 3 06:25:13 kjcf05n03 LCNmon[17815]: 10.16.100.52 is unreachable via ib1 Nov 3 06:25:13 kjcf05n03 LCNmon[17815]: 10.16.100.58 is unreachable via ib1 Nov 3 06:25:26 kjcf05n00 mcfcli[3673891]: %3|1730636726.029|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 06:25:27 kjcf05n00 mcfcli[3673891]: %3|1730636727.404|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:25:33 kjcf05n03 nslcd[7259]: ldap_result() failed: Can't contact LDAP server Nov 3 06:25:33 kjcf05n03 nslcd[7259]: (re)loading /etc/nsswitch.conf Nov 3 06:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 06:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 06:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 06:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 06:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 06:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 06:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 06:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 06:25:56 kjcf05n00 mcfcli[3673891]: %3|1730636756.029|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:25:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 06:25:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 06:25:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 06:25:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 06:26:07 kjcf05n00 mcfcli[3673891]: %3|1730636767.401|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:26:09 kjcf05n03 LCNmon[17815]: 10.16.100.52 is unreachable via ib0 Nov 3 06:26:09 kjcf05n03 LCNmon[17815]: 10.16.100.58 is unreachable via ib0 Nov 3 06:26:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730636769}"] Nov 3 06:26:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636769, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:26:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.313142ms Nov 3 06:26:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.313142ms Nov 3 06:26:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:26:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:26:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:26:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730636769}"] Nov 3 06:26:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636769, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:26:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.689644ms Nov 3 06:26:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.689644ms Nov 3 06:26:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:26:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:26:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:26:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730636769}"] Nov 3 06:26:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636769, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:26:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.785584ms Nov 3 06:26:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.785584ms Nov 3 06:26:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:26:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:26:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:26:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730636769}"] Nov 3 06:26:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636769, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:26:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.922179ms Nov 3 06:26:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.922179ms Nov 3 06:26:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:26:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:26:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:26:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730636769}"] Nov 3 06:26:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636769, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:26:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.776998ms Nov 3 06:26:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.776998ms Nov 3 06:26:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:26:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:26:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:26:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730636769}"] Nov 3 06:26:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636769, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:26:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.008261ms Nov 3 06:26:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.008261ms Nov 3 06:26:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:26:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:26:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:26:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730636769}"] Nov 3 06:26:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636769, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:26:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.108909ms Nov 3 06:26:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.108909ms Nov 3 06:26:10 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:26:10 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:26:10 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:26:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730636769}"] Nov 3 06:26:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636769, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:26:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.684986ms Nov 3 06:26:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.684986ms Nov 3 06:26:10 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:26:10 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:26:10 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:26:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730636769}"] Nov 3 06:26:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636769, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:26:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.710885ms Nov 3 06:26:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.710885ms Nov 3 06:26:10 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:26:10 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:26:10 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:26:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730636769}"] Nov 3 06:26:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636769, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:26:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.25859ms Nov 3 06:26:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.25859ms Nov 3 06:26:10 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:26:10 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:26:10 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:26:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730636769}"] Nov 3 06:26:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730636769, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:26:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:26:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:26:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:26:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:26:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:26:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:26:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.146881ms Nov 3 06:26:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:26:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.146881ms Nov 3 06:26:10 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:26:10 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:26:10 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:26:13 kjcf05n03 LCNmon[17815]: 10.16.100.52 is unreachable via ib1 Nov 3 06:26:13 kjcf05n03 LCNmon[17815]: 10.16.100.58 is unreachable via ib1 Nov 3 06:26:26 kjcf05n00 mcfcli[3673891]: %3|1730636786.186|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 06:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 06:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 06:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 06:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 06:26:45 kjcf05n00 mcfcli[3673891]: %3|1730636805.178|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 06:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 06:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 06:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 06:26:56 kjcf05n00 mcfcli[3673891]: %3|1730636816.186|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 06:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 06:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 06:26:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 06:26:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 06:27:09 kjcf05n03 LCNmon[17815]: 10.16.100.52 is unreachable via ib0 Nov 3 06:27:09 kjcf05n03 LCNmon[17815]: 10.16.100.58 is unreachable via ib0 Nov 3 06:27:11 kjcf05n00 zabbix-server[1025745]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 06:27:11 kjcf05n00 zabbix-server[1025745]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 06:27:11 kjcf05n00 log_interesting_event.py[1025745]: Event '45838' acknowledged Nov 3 06:27:13 kjcf05n03 LCNmon[17815]: 10.16.100.52 is unreachable via ib1 Nov 3 06:27:13 kjcf05n03 LCNmon[17815]: 10.16.100.58 is unreachable via ib1 Nov 3 06:27:23 kjcf05n00 mcfcli[3673891]: %3|1730636843.242|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:27:26 kjcf05n00 mcfcli[3673891]: %3|1730636846.187|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 06:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 06:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 06:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 06:27:50 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 3 06:27:50 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 06:27:54 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 06:27:54 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 3 06:27:54 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 3 06:27:54 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 06:27:54 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 06:27:54 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 3 06:27:54 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 3 06:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 06:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 06:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 06:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 06:27:56 kjcf05n00 mcfcli[3673891]: %3|1730636876.187|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:27:57 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 3 06:27:59 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 3 06:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 06:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 06:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 06:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 06:28:01 kjcf05n00 mcfcli[3673891]: %3|1730636881.361|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:28:09 kjcf05n03 LCNmon[17815]: 10.16.100.52 is unreachable via ib0 Nov 3 06:28:09 kjcf05n03 LCNmon[17815]: 10.16.100.58 is unreachable via ib0 Nov 3 06:28:13 kjcf05n03 LCNmon[17815]: 10.16.100.52 is unreachable via ib1 Nov 3 06:28:13 kjcf05n03 LCNmon[17815]: 10.16.100.58 is unreachable via ib1 Nov 3 06:28:26 kjcf05n00 mcfcli[3673891]: %3|1730636906.188|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 06:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 06:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 06:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 06:28:39 kjcf05n00 mcfcli[3673891]: %3|1730636919.863|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:28:46 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:38230). Nov 3 06:28:46 kjcf05n01 rsyncd[2943032]: connect from kjcf05n02 (172.16.2.5) Nov 3 06:28:46 kjcf05n01 rsyncd[2943032]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 06:28:46 kjcf05n01 rsyncd[2943032]: building file list Nov 3 06:28:46 kjcf05n01 rsyncd[2943032]: sent 11449 bytes received 136 bytes total size 10905 Nov 3 06:28:46 kjcf05n01 systemd[1]: rsyncd@603-172.16.2.2:873-172.16.2.5:38230.service: Succeeded. Nov 3 06:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 06:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 06:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 06:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 06:28:56 kjcf05n00 mcfcli[3673891]: %3|1730636936.188|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 06:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 06:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 06:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 06:29:02 kjcf05n03 fstonithd.py[15125]: Listening for kdump packets from partner Nov 3 06:29:09 kjcf05n03 LCNmon[17815]: 10.16.100.52 is unreachable via ib0 Nov 3 06:29:09 kjcf05n03 LCNmon[17815]: 10.16.100.58 is unreachable via ib0 Nov 3 06:29:13 kjcf05n03 LCNmon[17815]: 10.16.100.52 is unreachable via ib1 Nov 3 06:29:13 kjcf05n03 LCNmon[17815]: 10.16.100.58 is unreachable via ib1 Nov 3 06:29:17 kjcf05n00 mcfcli[3673891]: %3|1730636957.572|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:29:23 kjcf05n00 zabbix-server[1027030]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 06:29:23 kjcf05n00 zabbix-server[1027030]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 175.74\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 111.65\\"}}"' Nov 3 06:29:23 kjcf05n00 log_interesting_event.py[1027030]: Event '45839' acknowledged Nov 3 06:29:26 kjcf05n00 mcfcli[3673891]: %3|1730636966.188|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:29:37 kjcf05n03 dwd[5200]: nvme25n1 passed periodic SMART status check Nov 3 06:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 06:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 06:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 06:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 06:29:38 kjcf05n03 dwd[5200]: nvme2n1 passed periodic SMART status check Nov 3 06:29:38 kjcf05n03 dwd[5200]: nvme9n1 passed periodic SMART status check Nov 3 06:29:38 kjcf05n03 dwd[5200]: nvme23n1 passed periodic SMART status check Nov 3 06:29:38 kjcf05n03 dwd[5200]: nvme8n1 passed periodic SMART status check Nov 3 06:29:38 kjcf05n03 dwd[5200]: nvme18n1 passed periodic SMART status check Nov 3 06:29:38 kjcf05n03 dwd[5200]: nvme4n1 passed periodic SMART status check Nov 3 06:29:39 kjcf05n03 dwd[5200]: nvme17n1 passed periodic SMART status check Nov 3 06:29:39 kjcf05n03 dwd[5200]: nvme3n1 passed periodic SMART status check Nov 3 06:29:39 kjcf05n03 dwd[5200]: nvme19n1 passed periodic SMART status check Nov 3 06:29:39 kjcf05n03 dwd[5200]: nvme24n1 passed periodic SMART status check Nov 3 06:29:41 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 06:29:53 kjcf05n00 mcfcli[3673891]: %3|1730636993.735|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 06:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 06:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 06:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 06:29:56 kjcf05n00 mcfcli[3673891]: %3|1730636996.188|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 06:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 06:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 06:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 06:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 06:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 06:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 06:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 06:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 06:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 06:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 06:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 06:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 06:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 06:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 06:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 06:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 06:30:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 06:30:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:30:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 06:30:04 kjcf05n00 python3.9[1027198]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 06:30:07 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 06:30:09 kjcf05n03 LCNmon[17815]: 10.16.100.52 is unreachable via ib0 Nov 3 06:30:09 kjcf05n03 LCNmon[17815]: 10.16.100.58 is unreachable via ib0 Nov 3 06:30:12 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='105', client='AF_INET(172.16.2.5:37809)', local='AF_INET(0.0.0.0:601)' Nov 3 06:30:12 kjcf05n02 syslog-ng[3146]: Configuration reload request received, reloading configuration; Nov 3 06:30:12 kjcf05n02 syslog-ng[3146]: Configuration reload finished; Nov 3 06:30:12 kjcf05n02 syslog-ng[3146]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 06:30:12 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 3 06:30:12 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 06:30:12 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 3 06:30:12 kjcf05n02 dracut: Self testing crypto algorithms Nov 3 06:30:12 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 3 06:30:12 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 06:30:12 kjcf05n02 Copying live image to RAM... Nov 3 06:30:12 kjcf05n02 (this may take a minute) Nov 3 06:30:12 kjcf05n02 Done copying live image to RAM. Nov 3 06:30:12 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 06:30:12 kjcf05n02 dracut: Checking integrity of kernel Nov 3 06:30:12 kjcf05n02 dracut: All initrd crypto checks done Nov 3 06:30:12 kjcf05n02 dracut: Switching root Nov 3 06:30:12 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 06:30:12 kjcf05n02 systemd: Detected architecture x86-64. Nov 3 06:30:12 kjcf05n02 systemd: Set hostname to . Nov 3 06:30:12 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 06:30:12 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 06:30:12 kjcf05n02 systemd: Created slice User and Session Slice. Nov 3 06:30:12 kjcf05n02 systemd: Created slice system-serial\x2dgetty.slice. Nov 3 06:30:12 kjcf05n02 systemd: Listening on RPCbind Server Activation Socket. Nov 3 06:30:12 kjcf05n02 systemd: Listening on Journal Socket. Nov 3 06:30:12 kjcf05n02 systemd: Mounting /data... Nov 3 06:30:12 kjcf05n02 systemd-journald[1528]: Journal started Nov 3 06:30:12 kjcf05n02 systemd-journald[1528]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 06:30:12 kjcf05n02 systemd-modules-load[1514]: Inserted module 'fuse' Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 3 06:30:12 kjcf05n02 systemd[1]: Mounted POSIX Message Queue File System. Nov 3 06:30:12 kjcf05n02 systemd[1]: Mounted /mnt. Nov 3 06:30:12 kjcf05n02 systemd[1]: Mounted Kernel Debug File System. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Create list of required static device nodes for the current kernel. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Remount Root and Kernel File Systems. Nov 3 06:30:12 kjcf05n02 systemd[1]: Mounted Temporary Directory (/tmp). Nov 3 06:30:12 kjcf05n02 systemd[1]: Mounted /WIBS. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Create System Users... Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Load/Save Random Seed... Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Rebuild Hardware Database... Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 06:30:12 kjcf05n02 systemd[1]: Mounting Kernel Configuration File System... Nov 3 06:30:12 kjcf05n02 systemd[1]: Mounting FUSE Control File System... Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Apply Kernel Variables... Nov 3 06:30:12 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Create System Users. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 3 06:30:12 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 06:30:12 kjcf05n02 systemd-journald[1528]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 06:30:12 kjcf05n02 systemd-sysctl[1551]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 06:30:12 kjcf05n02 systemd-sysctl[1551]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 3 06:30:12 kjcf05n02 systemd-tmpfiles[1556]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 06:30:12 kjcf05n02 systemd-tmpfiles[1556]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 3 06:30:12 kjcf05n02 systemd-udevd[1563]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 3 06:30:12 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 3 06:30:12 kjcf05n02 systemd-udevd[1580]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:30:12 kjcf05n02 systemd-udevd[1588]: Using default interface naming scheme 'rhel-8.0'. Nov 3 06:30:12 kjcf05n02 systemd-udevd[1588]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:30:12 kjcf05n02 systemd-udevd[1589]: Using default interface naming scheme 'rhel-8.0'. Nov 3 06:30:12 kjcf05n02 systemd-udevd[1589]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:30:12 kjcf05n02 systemd-udevd[1584]: Using default interface naming scheme 'rhel-8.0'. Nov 3 06:30:12 kjcf05n02 systemd-udevd[1584]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 06:30:12 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 3 06:30:12 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 06:30:12 kjcf05n02 root[1785]: openibd: running in auto mode Nov 3 06:30:12 kjcf05n02 systemd-tmpfiles[1779]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 06:30:12 kjcf05n02 systemd-tmpfiles[1779]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 3 06:30:12 kjcf05n02 systemd-tmpfiles[1779]: "/var/tmp" already exists and is not a directory. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started RPC Bind. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 06:30:12 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 06:30:12 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 06:30:12 kjcf05n02 systemd-modules-load[1885]: Inserted module 'ib_iser' Nov 3 06:30:12 kjcf05n02 systemd-modules-load[1885]: Inserted module 'ib_isert' Nov 3 06:30:12 kjcf05n02 systemd-modules-load[1885]: Inserted module 'ib_srpt' Nov 3 06:30:12 kjcf05n02 systemd-udevd[1578]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:30:12 kjcf05n02 systemd-udevd[1610]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:30:12 kjcf05n02 systemd-modules-load[1901]: Inserted module 'ib_ipoib' Nov 3 06:30:12 kjcf05n02 systemd-modules-load[1885]: Inserted module 'rdma_ucm' Nov 3 06:30:12 kjcf05n02 systemd-modules-load[1885]: Module 'svcrdma' is blacklisted Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 06:30:12 kjcf05n02 systemd-udevd[1610]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 06:30:12 kjcf05n02 systemd-udevd[1578]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 06:30:12 kjcf05n02 systemd-modules-load[1901]: Inserted module 'ib_umad' Nov 3 06:30:12 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 06:30:12 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 06:30:12 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 3 06:30:12 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 3 06:30:12 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 06:30:12 kjcf05n02 openibd[1773]: Loading HCA driver and Access Layer:[ OK ] Nov 3 06:30:12 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Update is Completed. Nov 3 06:30:12 kjcf05n02 setup-icl[1759]: Setting LAN IP Address to 203.0.113.3 Nov 3 06:30:12 kjcf05n02 setup-icl[1759]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 06:30:12 kjcf05n02 setup-icl[1759]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 06:30:12 kjcf05n02 setup-icl[1759]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 06:30:12 kjcf05n02 systemd-udevd[1578]: Using default interface naming scheme 'rhel-8.0'. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 06:30:12 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 06:30:12 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 06:30:12 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 06:30:12 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 06:30:12 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 06:30:12 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 3 06:30:12 kjcf05n02 systemd[1]: Reached target Sockets. Nov 3 06:30:12 kjcf05n02 systemd[1]: Reached target Basic System. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 06:30:12 kjcf05n02 dwd[2078]: dwd: vMay 29 2024 : 15:38:26 Nov 3 06:30:12 kjcf05n02 dwd[2078]: /usr/sbin/dwd -d --standalone=0 Nov 3 06:30:12 kjcf05n02 dwd[2078]: dwd: option Lethal: 0 Nov 3 06:30:12 kjcf05n02 dwd[2078]: dwd: option Interval: 60 Nov 3 06:30:12 kjcf05n02 dwd[2078]: dwd: option abrtlimit: 10 Nov 3 06:30:12 kjcf05n02 dwd[2078]: dwd: option DZPeriod: 604800 Nov 3 06:30:12 kjcf05n02 dwd[2078]: dwd: option SmartPeriod: 43200 Nov 3 06:30:12 kjcf05n02 dwd[2078]: dwd: option SDDEnabled: 1 Nov 3 06:30:12 kjcf05n02 dwd[2078]: dwd: option SDDAwaitScale: 3 Nov 3 06:30:12 kjcf05n02 dwd[2078]: dwd: option SDDAwaitMin: 100 Nov 3 06:30:12 kjcf05n02 dwd[2078]: dwd: option Verbosity: 1 Nov 3 06:30:12 kjcf05n02 dwd[2078]: dwd: option StandAlone: 0 Nov 3 06:30:12 kjcf05n02 dwd[2078]: option Lethal: 0 Nov 3 06:30:12 kjcf05n02 dwd[2078]: option Interval: 60 Nov 3 06:30:12 kjcf05n02 dwd[2078]: option abrtlimit: 10 Nov 3 06:30:12 kjcf05n02 dwd[2078]: option DZPeriod: 604800 Nov 3 06:30:12 kjcf05n02 dwd[2078]: option SmartPeriod: 43200 Nov 3 06:30:12 kjcf05n02 dwd[2078]: option SDDEnabled: 1 Nov 3 06:30:12 kjcf05n02 dwd[2078]: option SDDAwaitScale: 3 Nov 3 06:30:12 kjcf05n02 dwd[2078]: option SDDAwaitMin: 100 Nov 3 06:30:12 kjcf05n02 dwd[2078]: option Verbosity: 1 Nov 3 06:30:12 kjcf05n02 dwd[2078]: option StandAlone: 0 Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 06:30:12 kjcf05n02 nscd[2102]: 2102 monitoring file `/etc/hosts` (1) Nov 3 06:30:12 kjcf05n02 nscd[2102]: 2102 monitoring directory `/etc` (2) Nov 3 06:30:12 kjcf05n02 nscd[2102]: 2102 monitoring file `/etc/resolv.conf` (3) Nov 3 06:30:12 kjcf05n02 nscd[2102]: 2102 monitoring directory `/etc` (2) Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[2092]: Setting up Mellanox network interface: ib1 Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 06:30:12 kjcf05n02 mcelog[2101]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 06:30:12 kjcf05n02 mcelog[2101]: CPU is unsupported Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 0 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 1 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 2 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 3 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 4 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 5 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 6 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 7 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 8 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 9 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 10 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 11 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 12 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 13 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 14 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 15 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 16 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 17 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 18 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 19 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 20 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 21 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 22 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 23 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 24 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 25 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 26 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 27 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 28 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 29 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 30 Nov 3 06:30:12 kjcf05n02 cpupower[2119]: Setting cpu: 31 Nov 3 06:30:12 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 06:30:12 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 06:30:12 kjcf05n02 network[2145]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[2144]: Setting up Mellanox network interface: ib0 Nov 3 06:30:12 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 06:30:12 kjcf05n02 network[2174]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 06:30:12 kjcf05n02 network[2145]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 06:30:12 kjcf05n02 chronyd[2208]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[2186]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 06:30:12 kjcf05n02 dbus-daemon[2153]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 06:30:12 kjcf05n02 network[2204]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:30:12 kjcf05n02 network[2145]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 06:30:12 kjcf05n02 beSetMlxConfig[2206]: ConnectX-3 multiport not detected Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[2211]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 06:30:12 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 06:30:12 kjcf05n02 network[2223]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 06:30:12 kjcf05n02 mdraid-phy[2226]: no Cutlass to worry about Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[2230]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 3 06:30:12 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 06:30:12 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 06:30:12 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 06:30:12 kjcf05n02 sssd[sssd][2076]: Starting up Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 0 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 1 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 2 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 3 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 4 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 5 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 6 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 7 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 8 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 9 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 10 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 11 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 12 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 13 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 14 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 15 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 16 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 17 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 18 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 19 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 20 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 21 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 22 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 23 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 24 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 25 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 26 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 27 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 28 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 29 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 30 Nov 3 06:30:12 kjcf05n02 cpupower[2257]: Idlestate 2 disabled on CPU 31 Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[2242]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[2251]: No configuration found for ib1 Nov 3 06:30:12 kjcf05n02 dbus-daemon[2153]: [system] Successfully activated service 'org.freedesktop.systemd1' Nov 3 06:30:12 kjcf05n02 chronyd[2208]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 06:30:12 kjcf05n02 chronyd[2208]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[2262]: No configuration found for ib0 Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[2271]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 06:30:12 kjcf05n02 beSetMlxConfig[2206]: Starting MST (Mellanox Software Tools) driver set Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[2279]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 06:30:12 kjcf05n02 beSetMlxConfig[2206]: Loading MST PCI module - Success Nov 3 06:30:12 kjcf05n02 mlnx_conf_mgr[2309]: INFO: No configurations found for mlx5_1, skipping. Nov 3 06:30:12 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 06:30:12 kjcf05n02 mlnx_conf_mgr[2332]: INFO: No configurations found for mlx5_0, skipping. Nov 3 06:30:12 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 06:30:12 kjcf05n02 beSetMlxConfig[2206]: Loading MST PCI configuration module - Success Nov 3 06:30:12 kjcf05n02 beSetMlxConfig[2206]: Create devices Nov 3 06:30:12 kjcf05n02 sssd[be[implicit_files]][2272]: Starting up Nov 3 06:30:12 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 06:30:12 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 06:30:12 kjcf05n02 sssd[nss][2402]: Starting up Nov 3 06:30:12 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 06:30:12 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Login Service... Nov 3 06:30:12 kjcf05n02 systemd-logind[2513]: New seat seat0. Nov 3 06:30:12 kjcf05n02 systemd-logind[2513]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Login Service. Nov 3 06:30:12 kjcf05n02 python3.9[2079]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 06:30:12 kjcf05n02 python3.9[3146]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 06:30:12 kjcf05n02 systemd-sysctl[2732]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 06:30:12 kjcf05n02 systemd-sysctl[2732]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 06:30:12 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 06:30:12 kjcf05n02 python3.9[2822]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 06:30:12 kjcf05n02 python3.9[3146]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 06:30:12 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 06:30:12 kjcf05n02 network[2145]: Bringing up loopback interface: [ OK ] Nov 3 06:30:12 kjcf05n02 systemd-sysctl[3078]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 06:30:12 kjcf05n02 systemd-sysctl[3078]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 06:30:12 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 3 06:30:12 kjcf05n02 systemd[1]: Reached target Network. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 06:30:12 kjcf05n02 python3.9[3024]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 06:30:12 kjcf05n02 python3.9[3146]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 06:30:12 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 06:30:12 kjcf05n02 sm-notify[3154]: Version 2.3.3 starting Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 3 06:30:12 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 3 06:30:12 kjcf05n02 sshd[3121]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 06:30:12 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 06:30:12 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 3 06:30:12 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 06:30:12 kjcf05n02 lldpad[3134]: setsockopt nearest_bridge: Invalid argument Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 3 06:30:12 kjcf05n02 lldpad[3134]: setsockopt nearest_bridge: Invalid argument Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 3 06:30:12 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 06:30:12 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 06:30:12 kjcf05n02 beSetMlxConfig[2206]: Unloading MST PCI module (unused) - Success Nov 3 06:30:12 kjcf05n02 syslog-ng[3146]: [2024-11-03T12:28:59.480467] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 06:30:12 kjcf05n02 syslog-ng[3146]: [2024-11-03T12:28:59.480733] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 06:30:12 kjcf05n02 syslog-ng[3146]: [2024-11-03T12:28:59.480764] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 06:30:12 kjcf05n02 syslog-ng[3146]: [2024-11-03T12:28:59.481307] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 06:30:12 kjcf05n02 syslog-ng[3146]: [2024-11-03T12:28:59.481567] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 06:30:12 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 3 06:30:12 kjcf05n02 python3.9[3179]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 06:30:12 kjcf05n02 python3.9[3146]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 06:30:12 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 06:30:12 kjcf05n02 python3.9[3403]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 06:30:12 kjcf05n02 python3.9[3146]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 06:30:12 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 06:30:12 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 06:30:12 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 06:30:12 kjcf05n02 chronyd[2208]: System's initial offset : 0.005413 seconds slow of true (slew) Nov 3 06:30:12 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 06:30:12 kjcf05n02 beSetMlxConfig[2206]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 06:30:12 kjcf05n02 beSetMlxConfig[2206]: ib mode Nov 3 06:30:12 kjcf05n02 root[3424]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 3 06:30:12 kjcf05n02 root[3426]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 3 06:30:12 kjcf05n02 beSetMlxConfig[2206]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 06:30:12 kjcf05n02 beSetMlxConfig[2206]: ib mode Nov 3 06:30:12 kjcf05n02 systemd-udevd[1563]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 06:30:12 kjcf05n02 systemd-udevd[3443]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:30:12 kjcf05n02 systemd-udevd[3444]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:30:12 kjcf05n02 systemd-udevd[3447]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:30:12 kjcf05n02 systemd-udevd[3449]: Using default interface naming scheme 'rhel-8.0'. Nov 3 06:30:12 kjcf05n02 systemd-udevd[3449]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:30:12 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 06:30:12 kjcf05n02 systemd[3146]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:12 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[3485]: Setting up Mellanox network interface: ib1 Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[3486]: Setting up Mellanox network interface: ib0 Nov 3 06:30:12 kjcf05n02 systemd-udevd[3445]: Using default interface naming scheme 'rhel-8.0'. Nov 3 06:30:12 kjcf05n02 systemd-udevd[3446]: Using default interface naming scheme 'rhel-8.0'. Nov 3 06:30:12 kjcf05n02 systemd-udevd[3445]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:30:12 kjcf05n02 systemd-udevd[3446]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[3536]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[3535]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[3566]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[3567]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[3569]: No configuration found for ib0 Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[3568]: No configuration found for ib1 Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[3577]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[3576]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 06:30:12 kjcf05n02 mlnx_conf_mgr[3616]: INFO: No configurations found for mlx5_1, skipping. Nov 3 06:30:12 kjcf05n02 mlnx_conf_mgr[3617]: INFO: No configurations found for mlx5_0, skipping. Nov 3 06:30:12 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 06:30:12 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 06:30:12 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 3 06:30:12 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 3 06:30:12 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 06:30:12 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 3 06:30:12 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 3 06:30:12 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 06:30:12 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 06:30:12 kjcf05n02 lldpad[3134]: init_ports: Error adding device ib0 Nov 3 06:30:12 kjcf05n02 lldpad[3134]: init_ports: Error adding device ib1 Nov 3 06:30:12 kjcf05n02 lldpad[3134]: Signal 15 received - terminating Nov 3 06:30:12 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 3 06:30:12 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 06:30:12 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 06:30:12 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 3 06:30:12 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 06:30:12 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 3 06:30:12 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 3 06:30:12 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:12 kjcf05n02 systemd[3146]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:12 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 1 | Nov-03-2024 | 10:59:37 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 2 | Nov-03-2024 | 11:00:28 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 3 | Nov-03-2024 | 11:00:29 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 4 | Nov-03-2024 | 11:01:34 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 5 | Nov-03-2024 | 11:01:34 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 6 | Nov-03-2024 | 12:26:18 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 7 | Nov-03-2024 | 12:26:18 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 8 | Nov-03-2024 | 12:26:18 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 9 | Nov-03-2024 | 12:26:18 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 10 | Nov-03-2024 | 12:26:18 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 11 | Nov-03-2024 | 12:26:18 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 12 | Nov-03-2024 | 12:26:18 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 13 | Nov-03-2024 | 12:26:18 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 14 | Nov-03-2024 | 12:26:18 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 15 | Nov-03-2024 | 12:26:18 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 16 | Nov-03-2024 | 12:26:18 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 17 | Nov-03-2024 | 12:26:18 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 18 | Nov-03-2024 | 12:26:49 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 19 | Nov-03-2024 | 12:26:49 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 20 | Nov-03-2024 | 12:26:49 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 21 | Nov-03-2024 | 12:26:49 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 22 | Nov-03-2024 | 12:26:49 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 23 | Nov-03-2024 | 12:26:49 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 24 | Nov-03-2024 | 12:26:49 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 25 | Nov-03-2024 | 12:26:49 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 26 | Nov-03-2024 | 12:26:49 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 27 | Nov-03-2024 | 12:26:49 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 28 | Nov-03-2024 | 12:26:49 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 06:30:12 kjcf05n02 ipmievd[3959]: 29 | Nov-03-2024 | 12:26:49 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 06:30:12 kjcf05n02 ipmievd[3962]: Reading sensors... Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 3 06:30:12 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:12 kjcf05n02 systemd[3146]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 06:30:12 kjcf05n02 nscd[2102]: 2102 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 06:30:12 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 06:30:12 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 3 06:30:12 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 06:30:12 kjcf05n02 beSetMlxConfig[4018]: ConnectX-3 multiport not detected Nov 3 06:30:12 kjcf05n02 beSetMlxConfig[4018]: Starting MST (Mellanox Software Tools) driver set Nov 3 06:30:12 kjcf05n02 beSetMlxConfig[4018]: Loading MST PCI module - Success Nov 3 06:30:12 kjcf05n02 systemd-udevd[1563]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 06:30:12 kjcf05n02 beSetMlxConfig[4018]: [warn] mst_pciconf is already loaded, skipping Nov 3 06:30:12 kjcf05n02 beSetMlxConfig[4018]: Create devices Nov 3 06:30:12 kjcf05n02 beSetMlxConfig[4018]: Unloading MST PCI module (unused) - Success Nov 3 06:30:12 kjcf05n02 ipmievd[3962]: Waiting for events... Nov 3 06:30:12 kjcf05n02 beSetMlxConfig[4018]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 06:30:12 kjcf05n02 beSetMlxConfig[4018]: ib mode Nov 3 06:30:12 kjcf05n02 beSetMlxConfig[4018]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 06:30:12 kjcf05n02 beSetMlxConfig[4018]: ib mode Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 06:30:12 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 06:30:12 kjcf05n02 systemd-udevd[1563]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 06:30:12 kjcf05n02 systemd-udevd[4922]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:30:12 kjcf05n02 systemd-udevd[4923]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:30:12 kjcf05n02 systemd-udevd[4926]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:30:12 kjcf05n02 systemd-udevd[4929]: Using default interface naming scheme 'rhel-8.0'. Nov 3 06:30:12 kjcf05n02 systemd-udevd[4929]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:30:12 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 06:30:12 kjcf05n02 systemd[3146]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:12 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[4964]: Setting up Mellanox network interface: ib1 Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[4965]: Setting up Mellanox network interface: ib0 Nov 3 06:30:12 kjcf05n02 systemd-udevd[4925]: Using default interface naming scheme 'rhel-8.0'. Nov 3 06:30:12 kjcf05n02 systemd-udevd[4924]: Using default interface naming scheme 'rhel-8.0'. Nov 3 06:30:12 kjcf05n02 systemd-udevd[4925]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:30:12 kjcf05n02 systemd-udevd[4924]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[5014]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[5015]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[5045]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[5046]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[5047]: No configuration found for ib1 Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[5048]: No configuration found for ib0 Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[5055]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 06:30:12 kjcf05n02 mlnx_interface_mgr[5056]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 06:30:12 kjcf05n02 mlnx_conf_mgr[5095]: INFO: No configurations found for mlx5_1, skipping. Nov 3 06:30:12 kjcf05n02 mlnx_conf_mgr[5096]: INFO: No configurations found for mlx5_0, skipping. Nov 3 06:30:12 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 06:30:12 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}a9eb192fe5f6482ea117c618ae2cf95a46cd2d30590cf62af91c4045678cf2da' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}a9eb192fe5f6482ea117c618ae2cf95a46cd2d30590cf62af91c4045678cf2da' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}29338a73659eae7158637eed7434838535760f5add1662f5fe79b82c962bf732' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}29338a73659eae7158637eed7434838535760f5add1662f5fe79b82c962bf732' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}0a7a3d34c7ebaf1c4151e553ce2ab083644f79acb0fcb1e6e02be2cd2bef578f' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}0a7a3d34c7ebaf1c4151e553ce2ab083644f79acb0fcb1e6e02be2cd2bef578f' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}a9334a61fe7a60473cb67842a13a9cb9a319c4260bf78ee5f0207326bc3304fe' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}a9334a61fe7a60473cb67842a13a9cb9a319c4260bf78ee5f0207326bc3304fe' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 06:30:12 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 3 06:30:12 kjcf05n02 chronyd[2208]: chronyd exiting Nov 3 06:30:12 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 3 06:30:12 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 06:30:12 kjcf05n02 chronyd[5130]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 06:30:12 kjcf05n02 chronyd[5130]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 06:30:12 kjcf05n02 chronyd[5130]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 06:30:12 kjcf05n02 chronyd[5130]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 06:30:12 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 06:30:12 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:12 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 06:30:12 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 3 06:30:12 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 06:30:12 kjcf05n02 dwd[5161]: dwd: vMay 29 2024 : 15:38:26 Nov 3 06:30:12 kjcf05n02 dwd[5161]: /usr/sbin/dwd -i 15 -d Nov 3 06:30:12 kjcf05n02 dwd[5161]: dwd: option Lethal: 0 Nov 3 06:30:12 kjcf05n02 dwd[5161]: dwd: option Interval: 15 Nov 3 06:30:12 kjcf05n02 dwd[5161]: dwd: option abrtlimit: 10 Nov 3 06:30:12 kjcf05n02 dwd[5161]: dwd: option DZPeriod: 604800 Nov 3 06:30:12 kjcf05n02 dwd[5161]: dwd: option SmartPeriod: 43200 Nov 3 06:30:12 kjcf05n02 dwd[5161]: dwd: option SDDEnabled: 1 Nov 3 06:30:12 kjcf05n02 dwd[5161]: dwd: option SDDAwaitScale: 3 Nov 3 06:30:12 kjcf05n02 dwd[5161]: dwd: option SDDAwaitMin: 100 Nov 3 06:30:12 kjcf05n02 dwd[5161]: dwd: option Verbosity: 1 Nov 3 06:30:12 kjcf05n02 dwd[5161]: dwd: option StandAlone: 0 Nov 3 06:30:12 kjcf05n02 dwd[5161]: option Lethal: 0 Nov 3 06:30:12 kjcf05n02 dwd[5161]: option Interval: 15 Nov 3 06:30:12 kjcf05n02 dwd[5161]: option abrtlimit: 10 Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 06:30:12 kjcf05n02 dwd[5161]: option DZPeriod: 604800 Nov 3 06:30:12 kjcf05n02 dwd[5161]: option SmartPeriod: 43200 Nov 3 06:30:12 kjcf05n02 dwd[5161]: option SDDEnabled: 1 Nov 3 06:30:12 kjcf05n02 dwd[5161]: option SDDAwaitScale: 3 Nov 3 06:30:12 kjcf05n02 dwd[5161]: option SDDAwaitMin: 100 Nov 3 06:30:12 kjcf05n02 dwd[5161]: option Verbosity: 1 Nov 3 06:30:12 kjcf05n02 dwd[5161]: option StandAlone: 0 Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 06:30:12 kjcf05n02 dwd[5162]: option Lethal now set to 1 Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 06:30:12 kjcf05n02 dwd[5162]: option abrtlimit now set to 1 Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 06:30:12 kjcf05n02 dwd[5162]: option SmartPeriod now set to 86400 Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 06:30:12 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 06:30:12 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:12 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:12 kjcf05n02 python3.9[5191]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 06:30:12 kjcf05n02 python3.9[3146]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 06:30:12 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:12 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 06:30:12 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 3 06:30:12 kjcf05n02 sedcpwrkr[5328]: Using config script: /etc/sedcpwrkr.conf Nov 3 06:30:12 kjcf05n02 sedcpwrkr[5328]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 06:30:12 kjcf05n02 sedcpwrkr[5328]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 06:30:12 kjcf05n02 sedcpwrkr[5328]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 06:30:12 kjcf05n02 sedcpwrkr[5328]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 06:30:12 kjcf05n02 sedcpwrkr[5328]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 06:30:12 kjcf05n02 sedcpwrkr[5328]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 06:30:12 kjcf05n02 sedcpwrkr-server[5359]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 06:30:12 kjcf05n02 sedcpwrkr[5328]: celery multi v5.2.7 (dawn-chorus) Nov 3 06:30:12 kjcf05n02 sedcpwrkr[5328]: > Starting nodes... Nov 3 06:30:12 kjcf05n02 sedcpwrkr[5328]: > sedcpwrkr@kjcf05n02: OK Nov 3 06:30:12 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 06:30:12 kjcf05n02 sedcpwrkr-server[5361]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 06:30:12 kjcf05n02 sedcpwrkr-server[5361]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 06:30:12 kjcf05n02 sedcpwrkr-server[5361]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 06:30:12 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 06:30:12 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 3 06:30:12 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 06:30:12 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 06:30:12 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 06:30:12 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:12 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 06:30:12 kjcf05n02 systemd-udevd[1563]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 06:30:12 kjcf05n02 iptables.init[5428]: iptables: Applying firewall rules: [ OK ] Nov 3 06:30:12 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 3 06:30:12 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:13 kjcf05n02 systemd[3146]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 06:30:13 kjcf05n03 LCNmon[17815]: 10.16.100.52 is unreachable via ib1 Nov 3 06:30:13 kjcf05n03 LCNmon[17815]: 10.16.100.58 is unreachable via ib1 Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 06:30:13 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 06:30:13 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 06:30:13 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:13 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 06:30:14 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5525 which is not our child. We'll most likely not notice when it exits. Nov 3 06:30:14 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 06:30:14 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:14 kjcf05n02 openhpid[5525]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 06:30:14 kjcf05n02 openhpid[5525]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 06:30:14 kjcf05n02 openhpid[5525]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 06:30:14 kjcf05n02 openhpid[5525]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 06:30:14 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:14 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:14 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:14 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 06:30:14 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 06:30:14 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 06:30:14 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 06:30:14 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:14 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 06:30:15 kjcf05n02 dcs-collectord[5616]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 06:30:15 kjcf05n02 hpi.inv.log[5616]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 06:30:15 kjcf05n02 dcs-collectord[5616]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 06:30:15 kjcf05n02 dcs-collectord[5616]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 06:30:15 kjcf05n02 dcs-collector[5607]: Starting dcs-collector:[ OK ] Nov 3 06:30:15 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 06:30:15 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 06:30:15 kjcf05n02 dcs-collectord[5619]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 06:30:15 kjcf05n02 dcs-collectord[5619]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 06:30:15 kjcf05n02 dcs-collectord[5619]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 06:30:15 kjcf05n02 dcs-collectord[5619]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 06:30:15 kjcf05n02 dcs-collectord[5619]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 06:30:15 kjcf05n02 dcs-collectord[5619]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 06:30:15 kjcf05n02 dcs-collectord[5619]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 06:30:15 kjcf05n02 dcs-collectord[5619]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259345932", "units": "kB"}, {"name": "MemAvailable", "value": "258625588", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821280", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686800", "units": "kB"}, {"name": "Inactive", "value": "961200", "units": "kB"}, {"name": "Active(anon)", "value": "1520804", "units": "kB"}, {"name": "Inactive(anon)", "value": "824868", "units": "kB"}, {"name": "Active(file)", "value": "165996", "units": "kB"}, {"name": "Inactive(file)", "value": "136332", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "751568", "units": "kB"}, {"name": "Mapped", "value": "86328", "units": "kB"}, {"name": "Shmem", "value": "1593404", "units": "kB"}, {"name": "KReclaimable", "value": "108804", "units": "kB"}, {"name": "Slab", "value": "274240", "units": "kB"}, {"name": "SReclaimable", "value": "108804", "units": "kB"}, {"name": "SUnreclaim", "value": "165436", "units": "kB"}, {"name": "KernelStack", "value": "9744", "units": "kB"}, {"name": "PageTables", "value": "19840", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3218224", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11392", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "2048", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "266568", "units": "kB"}, {"name": "DirectMap2M", "value": "22667264", "units": "kB"}, {"name": "DirectMap1G", "value": "245366784", "units": "kB"}]}' Nov 3 06:30:15 kjcf05n02 dcs-collectord[5619]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 06:30:15 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:15 kjcf05n02 systemd[3146]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:15 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:15 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:15 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 06:30:15 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 06:30:15 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 06:30:15 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 06:30:15 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:16 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 06:30:16 kjcf05n02 firmware-update-orc[5700]: Using config script: /etc/firmware_update_orc.conf Nov 3 06:30:16 kjcf05n02 firmware-update-orc[5700]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 06:30:16 kjcf05n02 firmware-update-orc[5700]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 06:30:16 kjcf05n02 firmware-update-orc[5700]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 06:30:16 kjcf05n02 firmware-update-orc[5700]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 06:30:16 kjcf05n02 firmware-update-orc[5700]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 06:30:16 kjcf05n02 firmware-update-orc[5700]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 06:30:16 kjcf05n02 dcs-collectord[5619]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 06:30:16 kjcf05n02 dcs-collectord[5619]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730637015.2075515], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730637016.3759935], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730637015.1412473, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 06:30:16 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 06:30:16 kjcf05n02 firmware-update-orc-server[5748]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 06:30:16 kjcf05n02 firmware-update-orc[5700]: celery multi v5.2.7 (dawn-chorus) Nov 3 06:30:16 kjcf05n02 firmware-update-orc[5700]: > Starting nodes... Nov 3 06:30:16 kjcf05n02 firmware-update-orc[5700]: > worker1@kjcf05n02: OK Nov 3 06:30:16 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 06:30:17 kjcf05n02 firmware-update-orc-server[5765]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 06:30:17 kjcf05n02 firmware-update-orc-server[5765]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 06:30:17 kjcf05n02 firmware-update-orc-server[5765]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 06:30:17 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 06:30:17 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:17 kjcf05n02 systemd[3146]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:17 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:17 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:17 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 06:30:17 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 06:30:17 kjcf05n02 dbus-daemon[2153]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 06:30:17 kjcf05n02 dbus-daemon[2153]: [system] Reloaded configuration Nov 3 06:30:17 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 06:30:17 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 06:30:17 kjcf05n02 dbus-daemon[2153]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 06:30:17 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 06:30:17 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 06:30:17 kjcf05n02 dbus-daemon[2153]: [system] Reloaded configuration Nov 3 06:30:17 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 06:30:17 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 06:30:17 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 06:30:17 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 06:30:17 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:17 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 3 06:30:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730637017', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 06:30:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730637017'} Nov 3 06:30:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:30:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730637017', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 06:30:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730637017'} Nov 3 06:30:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:30:18 kjcf05n02 ras-resource-manager-agent[5881]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 06:30:18 kjcf05n02 ras-resource-manager-agent[5867]: Starting ras-resource-manager-agent:[ OK ] Nov 3 06:30:18 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 06:30:18 kjcf05n02 ras-resource-manager-agent[5883]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 06:30:18 kjcf05n02 ras-resource-manager-client[5883]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 06:30:18 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 3 06:30:18 kjcf05n02 ras-resource-manager-client[5883]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 06:30:18 kjcf05n02 ras-resource-manager-client[5893]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 06:30:18 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:18 kjcf05n02 systemd[3146]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:18 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:18 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:18 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 06:30:18 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 06:30:18 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:18 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 06:30:18 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:19 kjcf05n02 systemd[3146]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: Press Ctrl+C to exit. Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: Plugin support version 1.0 Nov 3 06:30:19 kjcf05n02 zabbix_agent2[5967]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 06:30:19 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:19 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:19 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:19 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 06:30:19 kjcf05n02 dcs-notification-sender[6043]: dcs-notification-senderd is stopped Nov 3 06:30:19 kjcf05n02 zabbix-agent2[6057]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 06:30:19 kjcf05n02 dcs-notification-sender[6043]: Starting notification-sender:[ OK ] Nov 3 06:30:19 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 06:30:20 kjcf05n02 zabbix-agent2[6063]: INFO DCS notification agent started. (agent.py:61) Nov 3 06:30:20 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 06:30:20 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:20 kjcf05n02 systemd[3146]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:20 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:20 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:20 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:20 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 06:30:20 kjcf05n02 dcs-collectord[6147]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 06:30:21 kjcf05n02 dcs-collectord[6147]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 06:30:21 kjcf05n02 dcs-bulk-data-sender[6147]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 06:30:21 kjcf05n02 dcs-bulk-data-sender[6138]: Starting bulk-data-sender:[ OK ] Nov 3 06:30:21 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 06:30:21 kjcf05n02 dcs-collectord[6149]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 06:30:21 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 06:30:21 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:21 kjcf05n02 systemd[3146]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:21 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:21 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:21 kjcf05n02 nscd[2102]: 2102 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 06:30:21 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 06:30:21 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 06:30:21 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 06:30:21 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 06:30:21 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 06:30:21 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 06:30:21 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 06:30:21 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 06:30:21 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 06:30:21 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 06:30:21 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 06:30:21 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 06:30:21 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 06:30:21 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 06:30:22 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 06:30:22 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 06:30:22 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 06:30:22 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 06:30:22 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 06:30:22 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 06:30:22 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 3 06:30:22 kjcf05n02 sssd[nss][2402]: Shutting down (status = 0) Nov 3 06:30:22 kjcf05n02 sssd[be[implicit_files]][2272]: Shutting down (status = 0) Nov 3 06:30:22 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 3 06:30:22 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 3 06:30:22 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 06:30:22 kjcf05n02 sssd[sssd][6239]: Starting up Nov 3 06:30:22 kjcf05n02 python3.9[5191]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 06:30:22 kjcf05n02 python3.9[3146]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:22 kjcf05n02 sssd[be[implicit_files]][6240]: Starting up Nov 3 06:30:23 kjcf05n02 sssd[nss][6241]: Starting up Nov 3 06:30:23 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 06:30:23 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 06:30:23 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 06:30:24 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 06:30:24 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 06:30:24 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 06:30:24 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 06:30:24 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 06:30:24 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 06:30:24 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 06:30:24 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 06:30:24 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 06:30:24 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 06:30:24 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 06:30:24 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 06:30:24 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:24 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 06:30:24 kjcf05n02 icinga2[6300]: [2024-11-03 06:30:24 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 06:30:24 kjcf05n02 icinga2[6300]: [2024-11-03 06:30:24 -0600] information/cli: Loading configuration file(s). Nov 3 06:30:24 kjcf05n02 icinga2[6300]: [2024-11-03 06:30:24 -0600] information/ConfigItem: Committing config item(s). Nov 3 06:30:24 kjcf05n02 icinga2[6300]: [2024-11-03 06:30:24 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 3 06:30:24 kjcf05n02 icinga2[6300]: [2024-11-03 06:30:24 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 06:30:24 kjcf05n02 icinga2[6300]: [2024-11-03 06:30:24 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 06:30:24 kjcf05n02 icinga2[6300]: [2024-11-03 06:30:24 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 06:30:24 kjcf05n02 icinga2[6300]: [2024-11-03 06:30:24 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 06:30:24 kjcf05n02 icinga2[6300]: [2024-11-03 06:30:24 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 06:30:24 kjcf05n02 icinga2[6300]: [2024-11-03 06:30:24 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 06:30:24 kjcf05n02 icinga2[6300]: [2024-11-03 06:30:24 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 06:30:24 kjcf05n02 icinga2[6300]: [2024-11-03 06:30:24 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 06:30:24 kjcf05n02 icinga2[6300]: [2024-11-03 06:30:24 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 06:30:24 kjcf05n02 icinga2[6300]: [2024-11-03 06:30:24 -0600] information/cli: Closing console log. Nov 3 06:30:24 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 06:30:24 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:25 kjcf05n02 systemd[3146]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:25 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:25 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:25 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 06:30:25 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 06:30:25 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:25 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 3 06:30:25 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:26 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 06:30:26 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:26 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:26 kjcf05n00 mcfcli[3673891]: %3|1730637026.189|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 06:30:26 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 06:30:26 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 06:30:26 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 06:30:26 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 06:30:26 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 06:30:26 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 06:30:26 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 06:30:26 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 06:30:26 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 06:30:26 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 06:30:26 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 06:30:26 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 06:30:26 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 06:30:26 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 06:30:26 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:27 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 06:30:27 kjcf05n02 nslcd[6910]: version 0.9.9 starting Nov 3 06:30:27 kjcf05n02 nslcd[6910]: accepting connections Nov 3 06:30:27 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 06:30:27 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:27 kjcf05n02 systemd[3146]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:27 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:27 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:27 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 06:30:27 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 06:30:27 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 06:30:27 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 06:30:28 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 06:30:28 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 06:30:28 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 06:30:28 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 06:30:28 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:28 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 06:30:29 kjcf05n02 dearcpw[6997]: Using config script: /etc/dearcpw.conf Nov 3 06:30:29 kjcf05n02 dearcpw[6997]: - Creating default directory: '/var/log/dearcpw' Nov 3 06:30:29 kjcf05n02 dearcpw[6997]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 06:30:29 kjcf05n02 dearcpw[6997]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 06:30:29 kjcf05n02 dearcpw[6997]: - Creating default directory: '/var/run/dearcpw' Nov 3 06:30:29 kjcf05n02 dearcpw[6997]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 06:30:29 kjcf05n02 dearcpw[6997]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 06:30:29 kjcf05n02 dearcpw-server[7047]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 06:30:29 kjcf05n02 dearcpw[6997]: celery multi v5.2.7 (dawn-chorus) Nov 3 06:30:29 kjcf05n02 dearcpw[6997]: > Starting nodes... Nov 3 06:30:29 kjcf05n02 dearcpw[6997]: > dearcpw@kjcf05n02: OK Nov 3 06:30:29 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 06:30:29 kjcf05n02 dearcpw-server[7049]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 06:30:29 kjcf05n02 dearcpw-server[7049]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 06:30:29 kjcf05n02 dearcpw-server[7049]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 06:30:29 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 3 06:30:29 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:29 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:29 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 06:30:29 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 06:30:29 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 06:30:29 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 06:30:29 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 06:30:29 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 06:30:29 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 06:30:29 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 06:30:29 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 06:30:29 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 06:30:30 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:38264). Nov 3 06:30:30 kjcf05n01 rsyncd[2943665]: connect from kjcf05n02 (172.16.2.5) Nov 3 06:30:30 kjcf05n01 rsyncd[2943665]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 06:30:30 kjcf05n01 rsyncd[2943665]: receiving file list Nov 3 06:30:30 kjcf05n01 rsyncd[2943665]: sent 29 bytes received 325 bytes total size 10905 Nov 3 06:30:30 kjcf05n01 systemd[1]: rsyncd@604-172.16.2.2:873-172.16.2.5:38264.service: Succeeded. Nov 3 06:30:30 kjcf05n02 puppet[7074]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 3 06:30:30 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 06:30:30 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 06:30:30 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 06:30:30 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 06:30:30 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 06:30:30 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 06:30:30 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 06:30:30 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 06:30:30 kjcf05n02 dcs-bulk-data-sender[6149]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 06:30:30 kjcf05n02 dcs-collectord[6149]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 06:30:30 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 06:30:30 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 06:30:30 kjcf05n02 dcs-collectord[5619]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 06:30:30 kjcf05n02 dcs-collectord[5619]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 06:30:30 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 06:30:30 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 06:30:30 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 06:30:30 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 06:30:31 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 06:30:31 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 06:30:31 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 06:30:31 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 06:30:31 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 06:30:32 kjcf05n00 mcfcli[3673891]: %3|1730637032.023|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:30:32 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 06:30:32 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 06:30:32 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 06:30:32 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 06:30:33 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 06:30:33 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 06:30:33 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:33 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 06:30:33 kjcf05n02 diskless-swap[7193]: HA_PS_000: recovering journal Nov 3 06:30:33 kjcf05n02 systemd-udevd[1563]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 06:30:33 kjcf05n02 diskless-swap[7193]: HA_PS_000: clean, 2279/6400 files, 7068/25600 blocks Nov 3 06:30:33 kjcf05n02 diskless-swap[7193]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 06:30:33 kjcf05n02 diskless-swap[7193]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 06:30:33 kjcf05n02 diskless-swap[7193]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 06:30:33 kjcf05n02 diskless-swap[7193]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 06:30:33 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 06:30:33 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:33 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:33 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 06:30:33 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 06:30:33 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 06:30:33 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 06:30:33 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 3 06:30:33 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 3 06:30:33 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 3 06:30:33 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 3 06:30:33 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 3 06:30:33 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 06:30:33 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 06:30:33 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 06:30:33 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 06:30:33 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 06:30:33 kjcf05n02 ipmievd[3962]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 06:30:33 kjcf05n02 ipmievd[3962]: System Event sensor - Timestamp Clock Sync Nov 3 06:30:34 kjcf05n02 ipmievd[3146]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:34 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 06:30:34 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 06:30:34 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 06:30:34 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 06:30:34 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 06:30:34 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 06:30:35 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 06:30:35 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 06:30:35 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 06:30:35 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 06:30:36 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 06:30:36 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 06:30:36 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 06:30:36 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 06:30:36 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 06:30:36 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 06:30:36 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 06:30:36 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 06:30:36 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:37 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 3 06:30:37 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:37 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:37 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 06:30:37 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 06:30:37 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 06:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 06:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 06:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 06:30:37 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 3 06:30:37 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:37 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:37 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 06:30:37 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 06:30:37 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:37 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 3 06:30:38 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:38 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:38 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 06:30:38 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 06:30:38 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 06:30:38 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 06:30:38 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 06:30:38 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 06:30:38 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 06:30:38 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 06:30:38 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 06:30:38 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 06:30:38 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:38 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 3 06:30:38 kjcf05n02 kdumpctl[7825]: kdump: No kdump initial ramdisk found. Nov 3 06:30:38 kjcf05n02 kdumpctl[7825]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 06:30:38 kjcf05n02 dracut[7937]: dracut-049-135.git20210121.el8 Nov 3 06:30:39 kjcf05n02 dracut[7939]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 06:30:39 kjcf05n02 dracut[7939]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 06:30:39 kjcf05n02 dracut[7939]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 06:30:39 kjcf05n02 dracut[7939]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 06:30:39 kjcf05n02 dracut[7939]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 06:30:39 kjcf05n02 dracut[7939]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 06:30:39 kjcf05n02 dracut[7939]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 06:30:39 kjcf05n02 dracut[7939]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local dev holder Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + require_binaries mdadm expr Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _module_name=90hperaid Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ mdadm = \-\m ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for cmd in "$@" Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + find_binary mdadm Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for cmd in "$@" Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + find_binary expr Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n -h ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for dev in "${!host_fs_types[@]}" Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ nfs != *_raid_member ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + continue Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _ret=255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + ret=255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ 255 = 0 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ 255 = 255 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ module_depends hperaid Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: +++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: +++ set -x Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ depends Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo rootfs-block Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ return 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ _ret=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ return 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for _moddep in $(module_depends $_mod) Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all == *\ hperaid\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + add_dracutmodules+=' rootfs-block ' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ == *\ hperaid\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check_module rootfs-block Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _mod=rootfs-block Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ == *\ rootfs-block\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n '' ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all == *\ rootfs-block\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + module_check rootfs-block 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 2 -eq 2 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _forced=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _ret=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + ret=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ 0 = 0 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ module_depends rootfs-block Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: +++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 06:30:39 kjcf05n02 kdumpctl[3146]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ depends Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo fs-lib Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ _ret=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ return 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for _moddep in $(module_depends $_mod) Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all == *\ rootfs-block\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + add_dracutmodules+=' fs-lib ' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ == *\ rootfs-block\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check_module fs-lib Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _mod=fs-lib Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n '' ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + mods_checked_as_dep+=' fs-lib ' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all == *\ fs-lib\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + module_check fs-lib 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 2 -eq 2 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _forced=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _ret=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + ret=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ 0 = 0 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ module_depends fs-lib Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: +++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ depends Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ return 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ _ret=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ return 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + mods_to_load+=' fs-lib ' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + mods_to_load+=' rootfs-block ' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + mods_to_load+=' hperaid ' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _mod=90kernel-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _mod=kernel-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check_module kernel-modules 1 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _mod=kernel-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all = all ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + module_check kernel-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 1 -eq 2 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + true Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _ret=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + ret=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ 0 != 0 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ module_depends kernel-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: +++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ depends Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ true Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ _ret=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ return 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + mods_to_load+=' kernel-modules ' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _mod=90kernel-modules-extra Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _mod=kernel-modules-extra Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check_module kernel-modules-extra 1 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _mod=kernel-modules-extra Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all = all ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + module_check kernel-modules-extra Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 1 -eq 2 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + true Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _ret=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + ret=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ 0 != 0 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ module_depends kernel-modules-extra Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: +++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ depends Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ true Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ _ret=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ return 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + mods_to_load+=' kernel-modules-extra ' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _mod=90kernel-network-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _mod=kernel-network-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check_module kernel-network-modules 1 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _mod=kernel-network-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all = all ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + module_check kernel-network-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 1 -eq 2 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _ret=255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + ret=255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ 255 != 0 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 1 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _mod=90livenet Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _mod=livenet Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check_module livenet 1 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _mod=livenet Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all = all ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + module_check livenet Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 1 -eq 2 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _ret=255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + ret=255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ 255 != 0 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 1 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _mod=90lvm Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _mod=lvm Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check_module lvm 1 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _mod=lvm Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all = all ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + module_check lvm Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 1 -eq 2 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + require_binaries lvm Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _module_name=90lvm Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ lvm = \-\m ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for cmd in "$@" Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + find_binary lvm Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n -h ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for fs in "${host_fs_types[@]}" Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ nfs = LVM*_member ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _ret=255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + ret=255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ 255 != 0 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 1 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _mod=90mdraid Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _mod=mdraid Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check_module mdraid 1 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _mod=mdraid Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all = all ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + module_check mdraid Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 1 -eq 2 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _rootdev Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + require_binaries mdadm expr Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _module_name=90mdraid Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ mdadm = \-\m ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for cmd in "$@" Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + find_binary mdadm Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for cmd in "$@" Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + find_binary expr Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n -h ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for dev in "${!host_fs_types[@]}" Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ nfs != *_raid_member ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + continue Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _ret=255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + ret=255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ 255 != 0 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 1 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _mod=90multipath Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _mod=multipath Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check_module multipath 1 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _mod=multipath Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all = all ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + module_check multipath Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 1 -eq 2 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _rootdev Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n -h ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for_each_host_dev_and_slaves is_mpath Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _func=is_mpath Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _dev Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for _dev in "${host_devs[@]}" Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + continue Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 1 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _ret=255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + ret=255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ 255 != 0 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 1 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _mod=90qemu Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _mod=qemu Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check_module qemu 1 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _mod=qemu Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all = all ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + module_check qemu Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 1 -eq 2 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n -h ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + type -P systemd-detect-virt Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ systemd-detect-virt --vm Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + vm=none Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + (( 1 != 0 )) Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _ret=255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + ret=255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ 255 != 0 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 1 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _mod=90qemu-net Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _mod=qemu-net Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check_module qemu-net 1 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _mod=qemu-net Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all = all ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + module_check qemu-net Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 1 -eq 2 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n -h ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + type -P systemd-detect-virt Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ systemd-detect-virt --vm Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + vm= Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + (( 1 != 0 )) Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _ret=255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + ret=255 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ 255 != 0 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + return 1 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _mod=90stratis Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + _mod=stratis Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check_module stratis 1 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _mod=stratis Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ all = all ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + module_check stratis Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 1 -eq 2 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _module_name=90stratis Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + local _ret=0 Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + [[ stratisd-init = \-\m ]] Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + for cmd in "$@" Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + find_binary stratisd-init Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 06:30:39 kjcf05n02 kdumpctl[7825]: + set +x Nov 3 06:30:39 kjcf05n02 dracut[7939]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 06:30:39 kjcf05n02 dracut[7939]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 06:30:39 kjcf05n02 dracut[7939]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 06:30:39 kjcf05n02 dracut[7939]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 06:30:39 kjcf05n02 dracut[7939]: memstrack is available Nov 3 06:30:39 kjcf05n02 dracut[7939]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 06:30:39 kjcf05n02 dracut[7939]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 06:30:39 kjcf05n02 dracut[7939]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 06:30:39 kjcf05n02 dracut[7939]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 06:30:39 kjcf05n02 dracut[7939]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 06:30:40 kjcf05n02 dracut[7939]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 06:30:40 kjcf05n02 dracut[7939]: *** Including module: bash *** Nov 3 06:30:40 kjcf05n02 dracut[7939]: *** Including module: systemd *** Nov 3 06:30:40 kjcf05n02 dracut[7939]: *** Including module: fips *** Nov 3 06:30:41 kjcf05n02 dracut[7939]: *** Including module: systemd-initrd *** Nov 3 06:30:41 kjcf05n02 dracut[7939]: *** Including module: watchdog-modules *** Nov 3 06:30:41 kjcf05n02 dracut[7939]: *** Including module: nss-softokn *** Nov 3 06:30:41 kjcf05n02 dracut[7939]: *** Including module: i18n *** Nov 3 06:30:41 kjcf05n02 dracut[7939]: No KEYMAP configured. Nov 3 06:30:41 kjcf05n02 dracut[7939]: *** Including module: network-legacy *** Nov 3 06:30:41 kjcf05n02 dracut[7939]: *** Including module: network *** Nov 3 06:30:41 kjcf05n02 dracut[7939]: *** Including module: ib_bonding *** Nov 3 06:30:41 kjcf05n02 dracut[7939]: *** Including module: drm *** Nov 3 06:30:43 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},cooling,discovery.float]" became not supported: Invalid discovery rule value: cannot parse as a valid JSON object: invalid object format, expected opening character '{' or '[' at: 'ZBX_DATANOTREADY' Nov 3 06:30:43 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},cooling,discovery.int]" became not supported: Invalid discovery rule value: cannot parse as a valid JSON object: invalid object format, expected opening character '{' or '[' at: 'ZBX_DATANOTREADY' Nov 3 06:30:43 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},cooling,discovery.string]" became not supported: Invalid discovery rule value: cannot parse as a valid JSON object: invalid object format, expected opening character '{' or '[' at: 'ZBX_DATANOTREADY' Nov 3 06:30:43 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},cooling,discovery.uint]" became not supported: Invalid discovery rule value: cannot parse as a valid JSON object: invalid object format, expected opening character '{' or '[' at: 'ZBX_DATANOTREADY' Nov 3 06:30:45 kjcf05n02 dracut[7939]: *** Including module: hperaid *** Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + install Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + local rule rule_path Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + inst_multiple cat expr Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.vUaL6K/initramfs -a -f cat expr Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + _ret=0 Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + (( 0 != 0 )) Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + : Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + inst_multiple -o mdmon Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.vUaL6K/initramfs -a -f -o mdmon Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + _ret=0 Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + (( 0 != 0 )) Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + : Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: ++ command -v partx Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + inst /usr/sbin/partx /sbin/partx Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + local _hostonly_install Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + [[ -e /tmp/dracut.vUaL6K/initramfs//sbin/partx ]] Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.vUaL6K/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + (( 0 != 0 )) Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + : Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: ++ command -v mdadm Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + local _hostonly_install Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + [[ -e /tmp/dracut.vUaL6K/initramfs//sbin/mdadm ]] Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.vUaL6K/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + (( 0 != 0 )) Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + : Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + [[ yes == \y\e\s ]] Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + local _raidconf Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: ++ cmdline Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: ++ local _activated dev line UUID Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: ++ declare -A _activated Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: ++ for dev in "${!host_fs_types[@]}" Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: ++ [[ nfs != *_raid_member ]] Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: ++ continue Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + _raidconf= Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + [[ -n '' ]] Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + inst_rules 64-md-raid.rules Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + local _target=/etc/udev/rules.d _rule _found Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + inst_dir /usr/lib/udev/rules.d Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + [[ -e /tmp/dracut.vUaL6K/initramfs//usr/lib/udev/rules.d ]] Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + inst_dir /etc/udev/rules.d Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + [[ -e /tmp/dracut.vUaL6K/initramfs//etc/udev/rules.d ]] Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + for _rule in "$@" Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + continue Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + continue Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + for r in '' $dracutbasedir/rules.d/ Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + [[ 64-md-raid.rules != /* ]] Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + continue Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + for r in '' $dracutbasedir/rules.d/ Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + continue Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + [[ -n '' ]] Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + set +x Nov 3 06:30:45 kjcf05n02 dracut[7939]: Skipping udev rule: 64-md-raid.rules Nov 3 06:30:45 kjcf05n02 dcs-collectord[5619]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 06:30:45 kjcf05n02 dcs-collectord[5619]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + installkernel Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + instmods =drivers/md Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + local _optional=-o Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + local _silent Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + [[ '' = yes ]] Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + [[ =drivers/md = \-\c ]] Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + [[ =drivers/md = \-\s ]] Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + (( 1 == 0 )) Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.vUaL6K/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + _ret=0 Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + (( 0 != 0 )) Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + [[ -n '' ]] Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + _ret=0 Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + modules_loaded+='hperaid ' Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + '[' -n '' ']' Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + _d_mod=90kernel-modules Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + _d_mod=kernel-modules Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + [[ '' = yes ]] Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + dinfo '*** Including module: kernel-modules ***' Nov 3 06:30:45 kjcf05n02 kdumpctl[7825]: + set +x Nov 3 06:30:45 kjcf05n02 dracut[7939]: *** Including module: kernel-modules *** Nov 3 06:30:45 kjcf05n02 dracut[7939]: *** Including module: kernel-modules-extra *** Nov 3 06:30:45 kjcf05n00 zabbix_server[15640]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},cooling,discovery.int]" became supported Nov 3 06:30:45 kjcf05n00 zabbix_server[15640]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},cooling,discovery.string]" became supported Nov 3 06:30:45 kjcf05n00 zabbix_server[15640]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},cooling,discovery.uint]" became supported Nov 3 06:30:46 kjcf05n02 dracut[7939]: *** Including module: kernel-network-modules *** Nov 3 06:30:46 kjcf05n02 dracut[7939]: *** Including module: diskless-mod *** Nov 3 06:30:46 kjcf05n02 dracut[7939]: *** Including module: fstab-sys *** Nov 3 06:30:46 kjcf05n02 dracut[7939]: *** Including module: nfs *** Nov 3 06:30:46 kjcf05n02 dracut[7939]: *** Including module: rootfs-block *** Nov 3 06:30:46 kjcf05n02 dracut[7939]: *** Including module: terminfo *** Nov 3 06:30:46 kjcf05n02 dracut[7939]: *** Including module: udev-rules *** Nov 3 06:30:47 kjcf05n02 dracut[7939]: Skipping udev rule: 91-permissions.rules Nov 3 06:30:47 kjcf05n02 dracut[7939]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 06:30:47 kjcf05n02 dracut[7939]: *** Including module: dracut-systemd *** Nov 3 06:30:47 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 3 06:30:48 kjcf05n02 dracut[7939]: *** Including module: usrmount *** Nov 3 06:30:48 kjcf05n02 dracut[7939]: *** Including module: base *** Nov 3 06:30:48 kjcf05n02 dracut[7939]: *** Including module: fs-lib *** Nov 3 06:30:48 kjcf05n02 dracut[7939]: *** Including module: kdumpbase *** Nov 3 06:30:49 kjcf05n02 dracut[7939]: *** Including module: memstrack *** Nov 3 06:30:49 kjcf05n02 dracut[7939]: *** Including module: shutdown *** Nov 3 06:30:49 kjcf05n02 dracut[7939]: *** Including module: squash *** Nov 3 06:30:49 kjcf05n02 dracut[7939]: *** Including modules done *** Nov 3 06:30:49 kjcf05n02 dracut[7939]: *** Installing kernel module dependencies *** Nov 3 06:30:49 kjcf05n02 dracut[7939]: *** Installing kernel module dependencies done *** Nov 3 06:30:49 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},disk,discovery.float]" became not supported: Invalid discovery rule value: cannot parse as a valid JSON object: invalid object format, expected opening character '{' or '[' at: 'ZBX_DATANOTREADY' Nov 3 06:30:49 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},disk,discovery.int]" became not supported: Invalid discovery rule value: cannot parse as a valid JSON object: invalid object format, expected opening character '{' or '[' at: 'ZBX_DATANOTREADY' Nov 3 06:30:49 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},disk,discovery.string]" became not supported: Invalid discovery rule value: cannot parse as a valid JSON object: invalid object format, expected opening character '{' or '[' at: 'ZBX_DATANOTREADY' Nov 3 06:30:49 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},io_blade,discovery.float]" became not supported: Invalid discovery rule value: cannot parse as a valid JSON object: invalid object format, expected opening character '{' or '[' at: 'ZBX_DATANOTREADY' Nov 3 06:30:49 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},io_blade,discovery.int]" became not supported: Invalid discovery rule value: cannot parse as a valid JSON object: invalid object format, expected opening character '{' or '[' at: 'ZBX_DATANOTREADY' Nov 3 06:30:49 kjcf05n02 dracut[7939]: *** Resolving executable dependencies *** Nov 3 06:30:50 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 3 06:30:50 kjcf05n02 dracut[7939]: *** Resolving executable dependencies done*** Nov 3 06:30:50 kjcf05n02 dracut[7939]: *** Hardlinking files *** Nov 3 06:30:50 kjcf05n02 dracut[7939]: *** Hardlinking files done *** Nov 3 06:30:50 kjcf05n02 dracut[7939]: *** Generating early-microcode cpio image *** Nov 3 06:30:50 kjcf05n02 dracut[7939]: *** Constructing AuthenticAMD.bin **** Nov 3 06:30:50 kjcf05n02 dracut[7939]: *** Store current command line parameters *** Nov 3 06:30:50 kjcf05n02 dracut[7939]: Stored kernel commandline: Nov 3 06:30:50 kjcf05n02 dracut[7939]: rd.driver.pre=sd_mod Nov 3 06:30:50 kjcf05n02 dracut[7939]: rd.driver.pre=nvme Nov 3 06:30:50 kjcf05n02 dracut[7939]: rd.driver.pre=ipmi_si Nov 3 06:30:50 kjcf05n02 dracut[7939]: rd.driver.pre=ipmi_devintf Nov 3 06:30:50 kjcf05n02 dracut[7939]: rd.driver.pre=ipmi_msghandler Nov 3 06:30:50 kjcf05n02 dracut[7939]: nameserver=172.16.2.2 Nov 3 06:30:50 kjcf05n02 dracut[7939]: nameserver=127.0.0.1 Nov 3 06:30:50 kjcf05n02 dracut[7939]: nameserver=172.16.2.2 Nov 3 06:30:50 kjcf05n02 dracut[7939]: nameserver=127.0.0.1 Nov 3 06:30:50 kjcf05n02 dracut[7939]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 3 06:30:50 kjcf05n02 dracut[7939]: rd.neednet Nov 3 06:30:50 kjcf05n02 dracut[7939]: kdumpnic=mgmt0 Nov 3 06:30:50 kjcf05n02 dracut[7939]: bootdev=mgmt0 Nov 3 06:30:50 kjcf05n02 dracut[7939]: *** Install squash loader *** Nov 3 06:30:50 kjcf05n02 dracut[7939]: *** Squashing the files inside the initramfs *** Nov 3 06:30:51 kjcf05n02 dracut[7939]: *** Squashing the files inside the initramfs done *** Nov 3 06:30:51 kjcf05n02 dracut[7939]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 06:30:51 kjcf05n02 dracut[7939]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 06:30:51 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},disk,discovery.string]" became supported Nov 3 06:30:51 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},io_blade,discovery.float]" became supported Nov 3 06:30:51 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},io_blade,discovery.int]" became supported Nov 3 06:30:52 kjcf05n02 kdumpctl[7825]: kdump: kexec: loaded kdump kernel Nov 3 06:30:52 kjcf05n02 kdumpctl[7825]: kdump: Starting kdump: [OK] Nov 3 06:30:52 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 3 06:30:52 kjcf05n02 systemd[1]: Reloading. Nov 3 06:30:52 kjcf05n02 systemd[3146]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:30:52 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:30:52 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:30:52 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 06:30:52 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 06:30:52 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 06:30:52 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 06:30:52 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 06:30:52 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 06:30:52 kjcf05n02 ifdown[14522]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 06:30:52 kjcf05n02 ifdown[14523]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:30:52 kjcf05n02 ifdown[14524]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:30:53 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 06:30:53 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 06:30:53 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 06:30:53 kjcf05n02 ifup[14600]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 06:30:53 kjcf05n02 ifup[14601]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:30:53 kjcf05n02 ifup[14602]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:30:53 kjcf05n00 zabbix-server[1027944]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 06:30:53 kjcf05n00 zabbix-server[1027944]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:51\\"}}"' Nov 3 06:30:54 kjcf05n00 log_interesting_event.py[1027944]: Event '45856' acknowledged Nov 3 06:30:54 kjcf05n00 zabbix-server[1027946]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 06:30:54 kjcf05n00 zabbix-server[1027946]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 3 06:30:54 kjcf05n00 zabbix_server[15640]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},io_blade,discovery.string]" became not supported: Invalid discovery rule value: cannot parse as a valid JSON object: invalid object format, expected opening character '{' or '[' at: 'ZBX_DATANOTREADY' Nov 3 06:30:54 kjcf05n00 zabbix_server[15640]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},io_blade,discovery.uint]" became not supported: Invalid discovery rule value: cannot parse as a valid JSON object: invalid object format, expected opening character '{' or '[' at: 'ZBX_DATANOTREADY' Nov 3 06:30:54 kjcf05n00 zabbix_server[15640]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},io_subboard,discovery.float]" became not supported: Invalid discovery rule value: cannot parse as a valid JSON object: invalid object format, expected opening character '{' or '[' at: 'ZBX_DATANOTREADY' Nov 3 06:30:54 kjcf05n00 zabbix_server[15640]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},io_subboard,discovery.int]" became not supported: Invalid discovery rule value: cannot parse as a valid JSON object: invalid object format, expected opening character '{' or '[' at: 'ZBX_DATANOTREADY' Nov 3 06:30:54 kjcf05n00 zabbix_server[15640]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},io_subboard,discovery.string]" became not supported: Invalid discovery rule value: cannot parse as a valid JSON object: invalid object format, expected opening character '{' or '[' at: 'ZBX_DATANOTREADY' Nov 3 06:30:54 kjcf05n00 log_interesting_event.py[1027946]: Event '45857' acknowledged Nov 3 06:30:54 kjcf05n00 zabbix-server[1027948]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 06:30:54 kjcf05n00 zabbix-server[1027948]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 3 06:30:54 kjcf05n00 log_interesting_event.py[1027948]: Event '45858' acknowledged Nov 3 06:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 06:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 06:30:55 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 06:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 06:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 06:30:56 kjcf05n00 mcfcli[3673891]: %3|1730637056.190|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 06:30:57 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 06:30:57 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 06:30:57 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 06:30:57 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:30:57 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:30:57 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:30:57 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:30:57 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 06:30:57 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 06:30:57 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 06:30:57 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 06:30:57 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:30:57 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:30:57 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:30:57 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:30:57 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 06:30:57 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 06:30:57 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 06:30:57 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 06:30:57 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 06:30:57 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 06:30:57 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 06:30:57 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 06:30:57 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 06:30:57 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 06:30:57 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 06:30:57 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 06:30:57 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 06:30:57 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 06:30:57 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 06:30:57 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 06:30:57 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 06:30:57 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 06:30:57 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 06:30:57 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 06:30:57 kjcf05n02 ifdown[14782]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 06:30:57 kjcf05n02 ifdown[14783]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:30:57 kjcf05n02 ifdown[14784]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:30:57 kjcf05n00 zabbix_server[15640]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},io_subboard,discovery.float]" became supported Nov 3 06:30:57 kjcf05n00 zabbix_server[15640]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},io_subboard,discovery.int]" became supported Nov 3 06:30:57 kjcf05n00 zabbix_server[15640]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},io_subboard,discovery.string]" became supported Nov 3 06:30:58 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 06:30:58 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 06:30:58 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 06:30:58 kjcf05n02 ifup[14860]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 06:30:58 kjcf05n02 ifup[14861]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:30:58 kjcf05n02 ifup[14862]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 06:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 06:31:00 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 06:31:00 kjcf05n02 dcs-collectord[5619]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 06:31:00 kjcf05n02 dcs-collectord[5619]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 06:31:00 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},io_subboard,discovery.uint]" became not supported: Invalid discovery rule value: cannot parse as a valid JSON object: invalid object format, expected opening character '{' or '[' at: 'ZBX_DATANOTREADY' Nov 3 06:31:00 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},power_supply,discovery.int]" became not supported: Invalid discovery rule value: cannot parse as a valid JSON object: invalid object format, expected opening character '{' or '[' at: 'ZBX_DATANOTREADY' Nov 3 06:31:00 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},power_supply,discovery.string]" became not supported: Invalid discovery rule value: cannot parse as a valid JSON object: invalid object format, expected opening character '{' or '[' at: 'ZBX_DATANOTREADY' Nov 3 06:31:00 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},power_supply,discovery.uint]" became not supported: Invalid discovery rule value: cannot parse as a valid JSON object: invalid object format, expected opening character '{' or '[' at: 'ZBX_DATANOTREADY' Nov 3 06:31:02 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 06:31:02 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 06:31:02 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 06:31:02 kjcf05n02 systemd[1]: Reloading. Nov 3 06:31:03 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 3 06:31:03 kjcf05n02 await_ha_peer[15060]: Waiting for HA peer kjcf05n03 Nov 3 06:31:03 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},power_supply,discovery.uint]" became supported Nov 3 06:31:04 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 06:31:04 kjcf05n02 await_ha_peer[15060]: Peer kjcf05n03 has started, starting HA Nov 3 06:31:04 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 3 06:31:04 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 3 06:31:04 kjcf05n02 fstonithd.py[15113]: Listening for kdump packets from partner Nov 3 06:31:04 kjcf05n02 systemd[1]: Reloading. Nov 3 06:31:05 kjcf05n02 systemd[3146]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:31:05 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:31:05 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:31:05 kjcf05n02 systemd[1]: Reloading. Nov 3 06:31:05 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 3 06:31:05 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 06:31:05 kjcf05n02 systemd[1]: Reloading. Nov 3 06:31:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730637064', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 06:31:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730637064'} Nov 3 06:31:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:31:05 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31417 deleted. Nov 3 06:31:05 kjcf05n02 systemd[1]: Reloading. Nov 3 06:31:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730637065', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 2.15, 1.93, 0.86'}"] Nov 3 06:31:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 2.15, 1.93, 0.86', 'message': 'OK - load average: 2.15, 1.93, 0.86', 'value': 'ok', 'timestamp': '1730637065'} Nov 3 06:31:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:31:06 kjcf05n02 puppet-agent[3551]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 06:31:06 kjcf05n02 puppet[3551]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 06:31:06 kjcf05n02 puppet-agent[3551]: Applied catalog in 90.57 seconds Nov 3 06:31:06 kjcf05n02 puppet[3551]: Notice: Applied catalog in 90.57 seconds Nov 3 06:31:06 kjcf05n02 systemd[1]: Started Puppet agent. Nov 3 06:31:06 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 06:31:06 kjcf05n02 systemd[1]: Reached target Timers. Nov 3 06:31:06 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 3 06:31:06 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 06:31:06 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 06:31:06 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 06:31:06 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 06:31:06 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 06:31:06 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 06:31:06 kjcf05n02 wce-disable.sh[15276]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 06:31:06 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 06:31:06 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 06:31:06 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 06:31:06 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 06:31:06 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 3 06:31:06 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 3 06:31:06 kjcf05n02 python3.9[15278]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 06:31:06 kjcf05n02 python3.9[15278]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 06:31:06 kjcf05n02 gateway-ec-node.py[15279]: Starting gateway-ec-node service Nov 3 06:31:06 kjcf05n02 RFSF-API[15277]: INFO[2024-11-03T06:31:06-06:00] Datapath API RESTful Service starting Nov 3 06:31:06 kjcf05n02 dp-api-server-node[15277]: INFO[2024-11-03T06:31:06-06:00] Datapath API RESTful Service starting Nov 3 06:31:06 kjcf05n02 RFSF-API[15277]: INFO[2024-11-03T06:31:06-06:00] Running in production mode, starting dbus event listener Nov 3 06:31:06 kjcf05n02 dp-api-server-node[15277]: INFO[2024-11-03T06:31:06-06:00] Running in production mode, starting dbus event listener Nov 3 06:31:06 kjcf05n02 RFSF-API[15277]: INFO[2024-11-03T06:31:06-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 06:31:06 kjcf05n02 dp-api-server-node[15277]: INFO[2024-11-03T06:31:06-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 06:31:06 kjcf05n02 RFSF-API[15277]: INFO[2024-11-03T06:31:06-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 06:31:06 kjcf05n02 dp-api-server-node[15277]: INFO[2024-11-03T06:31:06-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 06:31:06 kjcf05n02 RFSF-API[15277]: INFO[2024-11-03T06:31:06-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 06:31:06 kjcf05n02 dp-api-server-node[15277]: INFO[2024-11-03T06:31:06-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 06:31:06 kjcf05n02 RFSF-API[15277]: INFO[2024-11-03T06:31:06-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 06:31:06 kjcf05n02 dp-api-server-node[15277]: INFO[2024-11-03T06:31:06-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 06:31:06 kjcf05n02 RFSF-API[15277]: INFO[2024-11-03T06:31:06-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 06:31:06 kjcf05n02 dp-api-server-node[15277]: INFO[2024-11-03T06:31:06-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 06:31:06 kjcf05n02 RFSF-API[15277]: INFO[2024-11-03T06:31:06-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 06:31:06 kjcf05n02 dp-api-server-node[15277]: INFO[2024-11-03T06:31:06-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 06:31:06 kjcf05n02 RFSF-API[15277]: INFO[2024-11-03T06:31:06-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 06:31:06 kjcf05n02 dp-api-server-node[15277]: INFO[2024-11-03T06:31:06-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 06:31:06 kjcf05n02 RFSF-API[15277]: INFO[2024-11-03T06:31:06-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 06:31:06 kjcf05n02 dp-api-server-node[15277]: INFO[2024-11-03T06:31:06-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 06:31:06 kjcf05n02 RFSF-API[15277]: INFO[2024-11-03T06:31:06-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 06:31:06 kjcf05n02 dp-api-server-node[15277]: INFO[2024-11-03T06:31:06-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 06:31:06 kjcf05n02 RFSF-API[15277]: INFO[2024-11-03T06:31:06-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 06:31:06 kjcf05n02 dp-api-server-node[15277]: INFO[2024-11-03T06:31:06-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 06:31:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730637066', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.5% (3879836 kB) used.'}"] Nov 3 06:31:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.5% (3879836 kB) used.', 'message': 'OK - 1.5% (3879836 kB) used.', 'value': 'ok', 'timestamp': '1730637066'} Nov 3 06:31:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:31:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730637069', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 339 processes with STATE = RSZDT '}"] Nov 3 06:31:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 339 processes with STATE = RSZDT ', 'message': 'PROCS OK: 339 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730637069'} Nov 3 06:31:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:31:10 kjcf05n00 mcfcli[3673891]: %3|1730637070.687|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:31:10 kjcf05n02 systemd[1]: Reloading. Nov 3 06:31:10 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 06:31:10 kjcf05n02 systemd[1]: Reloading. Nov 3 06:31:11 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 06:31:11 kjcf05n02 diskmonitor_pre[15644]: Key management is currently disabled.DEAR disabled Nov 3 06:31:11 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 06:31:13 kjcf05n02 sh[15712]: LNET configured: New Created Nov 3 06:31:13 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 06:31:13 kjcf05n02 LCNmon[17891]: Interface ib0 is up Nov 3 06:31:13 kjcf05n02 LCNmon[17891]: Interface ib1 is up Nov 3 06:31:13 kjcf05n02 LCNmon[17891]: Can ping through interface ib0 Nov 3 06:31:15 kjcf05n02 dcs-collectord[5619]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 06:31:15 kjcf05n02 dcs-collectord[5619]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 06:31:15 kjcf05n02 dcs-collectord[5619]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: /var/run/diskmonitor does not exist, creating Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: Creating /var/run/diskmonitor/disk Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: Creating /var/run/diskmonitor/encl Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: Creating /var/run/diskmonitor/cli Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: RAS_Interlocks_enabled: 1 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: add handler for sig: 14 sa_flags: 10000004 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: add handler for sig: 1 sa_flags: 10000004 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: add handler for sig: 2 sa_flags: 00000004 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: add handler for sig: 15 sa_flags: 00000004 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: add handler for sig: 6 sa_flags: 00000004 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: add handler for sig: 3 sa_flags: 00000004 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: add handler for sig: 30 sa_flags: 00000004 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: add handler for sig: 20 sa_flags: 00000004 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: add handler for sig: 10 sa_flags: 10000004 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: add handler for sig: 11 sa_flags: 00000004 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: add handler for sig: 7 sa_flags: 00000004 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: add handler for sig: 4 sa_flags: 00000004 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: add handler for sig: 8 sa_flags: 00000004 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: Using HA Baton locks - key: diskmonitor Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: Baton will be held for at most 570 seconds Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: DMMP Enabled: 0 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: random seed: f3676927 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: NVMe Enclosure: 1 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: ZFS Enclosure: 0 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: Dbus, Initialized Connection Successfully Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: int_catcher_thread: thread start Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: Received dbus message 4 org.freedesktop.DBus -> :1.93 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 06:31:15 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 06:31:16 kjcf05n00 httpd[902572]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 06:31:17 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 06:31:17 kjcf05n02 LCNmon[17891]: 10.16.100.60 is unreachable via ib1 Nov 3 06:31:17 kjcf05n02 LCNmon[17891]: Can ping through interface ib1 Nov 3 06:31:17 kjcf05n02 LCNmon[17891]: NIC ib0, initial state UP Nov 3 06:31:17 kjcf05n02 LCNmon[17891]: NIC ib1, initial state UP Nov 3 06:31:17 kjcf05n02 LCNmon[17891]: LCNstat initial state UP Nov 3 06:31:17 kjcf05n02 LCNmon[17891]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 3 06:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730637079', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 06:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730637079'} Nov 3 06:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730637079', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 06:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730637079'} Nov 3 06:31:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:31:20 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 06:31:20 kjcf05n02 openhpid[5525]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 06:31:20 kjcf05n02 openhpid[5525]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 06:31:20 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 3 06:31:20 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 06:31:20 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 06:31:20 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18567 which is not our child. We'll most likely not notice when it exits. Nov 3 06:31:20 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 06:31:20 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 3 06:31:20 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 3 06:31:20 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 06:31:20 kjcf05n02 dcs-collectord[5619]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 06:31:20 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 06:31:20 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 06:31:20 kjcf05n02 systemd[1]: Startup finished in 50.639s (kernel) + 2min 27.910s (userspace) = 3min 18.549s. Nov 3 06:31:20 kjcf05n02 openhpid[18567]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 06:31:20 kjcf05n02 openhpid[18567]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 06:31:20 kjcf05n02 openhpid[18567]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 06:31:20 kjcf05n02 openhpid[18567]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 06:31:21 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18673 (bash) Nov 3 06:31:21 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 06:31:21 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 06:31:21 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 06:31:21 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 06:31:21 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 06:31:21 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 06:31:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730637081', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 06:31:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730637081'} Nov 3 06:31:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:31:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730637083', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(4.0kB/2908.0B), ib1=(2632.0B/2644.0B), icl0=(8.0kB/9.6kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.2MB), mgmt0=(1478.4MB/8.2MB)'}"] Nov 3 06:31:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730637083', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 06:31:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(4.0kB/2908.0B), ib1=(2632.0B/2644.0B), icl0=(8.0kB/9.6kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.2MB), mgmt0=(1478.4MB/8.2MB)', 'message': 'NET OK - (Rx/Tx) ib0=(4.0kB/2908.0B), ib1=(2632.0B/2644.0B), icl0=(8.0kB/9.6kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.2MB), mgmt0=(1478.4MB/8.2MB)', 'value': 'ok', 'timestamp': '1730637083'} Nov 3 06:31:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730637083'} Nov 3 06:31:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:31:26 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 06:31:26 kjcf05n00 mcfcli[3673891]: %3|1730637086.190|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 06:31:30 kjcf05n02 dcs-collectord[5619]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 06:31:30 kjcf05n02 dcs-collectord[5619]: WARNING No data collected (hpi_parser.py:353) Nov 3 06:31:44 kjcf05n02 ipmievd[3962]: System Event sensor - Timestamp Clock Sync Nov 3 06:31:45 kjcf05n02 ipmievd[3146]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:31:45 kjcf05n02 dcs-collectord[5619]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 06:31:46 kjcf05n00 mcfcli[3673891]: %3|1730637106.391|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 06:31:54 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 06:31:56 kjcf05n00 mcfcli[3673891]: %3|1730637116.190|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:32:00 kjcf05n02 dcs-collectord[5619]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 06:32:00 kjcf05n03 nslcd[7259]: [e8944a] ldap_result() failed: Can't contact LDAP server Nov 3 06:32:01 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 06:32:01 kjcf05n02 ras-resource-manager-agent[5883]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "a02f9f6c-99df-11ef-80e4-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 06:32:01 kjcf05n02 ras-resource-manager-agent[5883]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'a02f9f6c-99df-11ef-80e4-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 06:32:01 kjcf05n02 ras-resource-manager-agent[5883]: INFO Submitting new device inserted signal, starting to qualify drive: a02f9f6c-99df-11ef-80e4-00093d0695e3 (admin_action.py:110) Nov 3 06:32:01 kjcf05n03 firmware-update-orc-server[5881]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "7ab777b1-ed77-49a4-bec2-8d257bc8d12c"} (logger.py:65) Nov 3 06:32:01 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 84996 (get_disk_device) Nov 3 06:32:01 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 06:32:01 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 06:32:01 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'a02f9f6c-99df-11ef-80e4-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 06:32:01 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'a02f9f6c-99df-11ef-80e4-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 06:32:01 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': 'a02f9f6c-99df-11ef-80e4-00093d0695e3', 'response ID': 'a0398284-99df-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 06:32:01 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: a0398284-99df-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 06:32:02 kjcf05n03 ccp-client[85017]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 06:32:02 kjcf05n03 ccp-client[85017]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 06:32:02 kjcf05n03 ccp-client[85026]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 06:32:02 kjcf05n03 ccp-client[85017]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 06:32:02 kjcf05n03 ccp-client[85026]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 06:32:02 kjcf05n03 ccp-client[85026]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 06:32:02 kjcf05n03 ccp-client[85017]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 06:32:02 kjcf05n02 diskmonitor[17412]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 06:32:02 kjcf05n02 ras-resource-manager-agent[5883]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "a07e4608-99df-11ef-80e4-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 06:32:02 kjcf05n02 ras-resource-manager-agent[5883]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'a07e4608-99df-11ef-80e4-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 06:32:02 kjcf05n02 ras-resource-manager-agent[5883]: INFO Submitting new device inserted signal, starting to qualify drive: a07e4608-99df-11ef-80e4-00093d0695e3 (admin_action.py:110) Nov 3 06:32:02 kjcf05n02 firmware-update-orc-server[5843]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "daab2119-1c7a-43c1-83db-960023d8b974"} (logger.py:65) Nov 3 06:32:02 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'a07e4608-99df-11ef-80e4-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 06:32:02 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'a07e4608-99df-11ef-80e4-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 06:32:02 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': 'a07e4608-99df-11ef-80e4-00093d0695e3', 'response ID': 'a08500b0-99df-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 06:32:02 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: a08500b0-99df-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 06:32:05 kjcf05n03 DRVFW[85173]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 06:32:05 kjcf05n03 ccp-client[85174]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 06:32:05 kjcf05n03 ccp-client[85174]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 06:32:05 kjcf05n03 ccp-client[85183]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 06:32:05 kjcf05n03 ccp-client[85174]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 06:32:05 kjcf05n03 ccp-client[85183]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 06:32:05 kjcf05n03 ccp-client[85183]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 06:32:05 kjcf05n03 ccp-client[85174]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 06:32:05 kjcf05n03 firmware-update-orc-server[5881]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 06:32:06 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: a0398284-99df-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 06:32:06 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': 'a02f9f6c-99df-11ef-80e4-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': 'a02f9f6c-99df-11ef-80e4-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}}} (logger.py:65) Nov 3 06:32:07 kjcf05n02 ras-resource-manager-agent[5883]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'a02f9f6c-99df-11ef-80e4-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 06:32:07 kjcf05n02 ras-resource-manager-agent[5883]: INFO Drive qualification complete responding: a02f9f6c-99df-11ef-80e4-00093d0695e3 (admin_action.py:205) Nov 3 06:32:07 kjcf05n02 ras-resource-manager-agent[5883]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "a02f9f6c-99df-11ef-80e4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (interesting_event.py:59) Nov 3 06:32:12 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 06:32:12 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 06:32:12 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 06:32:12 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 06:32:12 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 06:32:12 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 06:32:12 kjcf05n02 diskmonitor[17412]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 06:32:12 kjcf05n02 diskmonitor[17412]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 06:32:12 kjcf05n02 diskmonitor[17412]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 06:32:12 kjcf05n02 diskmonitor[17412]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 06:32:12 kjcf05n02 diskmonitor[17412]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 06:32:12 kjcf05n02 diskmonitor[17412]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "a02f9f6c-99df-11ef-80e4-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 06:32:12 kjcf05n02 diskmonitor[17412]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 06:32:12 kjcf05n02 diskmonitor[17412]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 06:32:12 kjcf05n02 diskmonitor[17412]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "a07e4608-99df-11ef-80e4-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 06:32:12 kjcf05n02 diskmonitor[17412]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 06:32:12 kjcf05n02 diskmonitor[17412]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 06:32:16 kjcf05n02 chronyd[5130]: Selected source 172.16.2.1 Nov 3 06:32:17 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22370 (get_disk_device) Nov 3 06:32:17 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 06:32:17 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 06:32:17 kjcf05n02 ccp-client[22391]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 06:32:17 kjcf05n02 ccp-client[22391]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 06:32:17 kjcf05n02 ccp-client[22400]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 06:32:17 kjcf05n02 ccp-client[22391]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 06:32:17 kjcf05n02 ccp-client[22391]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 06:32:17 kjcf05n02 ccp-client[22400]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 06:32:17 kjcf05n02 ccp-client[22400]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 06:32:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730637140}"] Nov 3 06:32:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730637140, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:32:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:32:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730637140}"] Nov 3 06:32:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730637140, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:32:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:32:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730637140}"] Nov 3 06:32:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730637140, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:32:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:32:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730637140}"] Nov 3 06:32:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730637140, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:32:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:32:20 kjcf05n02 DRVFW[22677]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 06:32:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730637140}"] Nov 3 06:32:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730637140, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:32:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:32:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730637140}"] Nov 3 06:32:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730637140, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:32:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:32:21 kjcf05n02 ccp-client[22679]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 06:32:21 kjcf05n02 ccp-client[22679]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 06:32:21 kjcf05n02 ccp-client[22706]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 06:32:21 kjcf05n02 ccp-client[22679]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 06:32:21 kjcf05n02 ccp-client[22679]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 06:32:21 kjcf05n02 ccp-client[22706]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 06:32:21 kjcf05n02 ccp-client[22706]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 06:32:21 kjcf05n02 firmware-update-orc-server[5843]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 06:32:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730637140}"] Nov 3 06:32:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730637140, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:32:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:32:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730637140}"] Nov 3 06:32:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730637140, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:32:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:32:21 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},cooling,discovery.float]" became supported Nov 3 06:32:21 kjcf05n02 ras-resource-manager-agent[5883]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'a07e4608-99df-11ef-80e4-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 06:32:21 kjcf05n02 ras-resource-manager-agent[5883]: INFO Drive qualification complete responding: a07e4608-99df-11ef-80e4-00093d0695e3 (admin_action.py:205) Nov 3 06:32:21 kjcf05n02 ras-resource-manager-agent[5883]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "a07e4608-99df-11ef-80e4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} (interesting_event.py:59) Nov 3 06:32:21 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},io_blade,discovery.string]" became supported Nov 3 06:32:21 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},io_blade,discovery.uint]" became supported Nov 3 06:32:21 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},io_subboard,discovery.uint]" became supported Nov 3 06:32:21 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},power_supply,discovery.int]" became supported Nov 3 06:32:21 kjcf05n00 zabbix_server[15639]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},power_supply,discovery.string]" became supported Nov 3 06:32:21 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: a08500b0-99df-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 06:32:21 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': 'a07e4608-99df-11ef-80e4-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': 'a07e4608-99df-11ef-80e4-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 18}}}} (logger.py:65) Nov 3 06:32:21 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 3 06:32:21 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 06:32:21 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 3 06:32:24 kjcf05n02 python3.9[5191]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 06:32:24 kjcf05n00 mcfcli[3673891]: %3|1730637144.560|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:32:26 kjcf05n00 mcfcli[3673891]: %3|1730637146.191|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 06:32:28 kjcf05n02 python3.9[3146]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:32:28 kjcf05n02 ras-resource-manager-agent[5883]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "a02f9f6c-99df-11ef-80e4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (service_main_handler.py:66) Nov 3 06:32:28 kjcf05n02 ras-resource-manager-agent[5883]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'a02f9f6c-99df-11ef-80e4-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 06:32:28 kjcf05n02 ras-resource-manager-agent[5883]: INFO Device qualification response has been acknowledged: a02f9f6c-99df-11ef-80e4-00093d0695e3 (admin_action.py:151) Nov 3 06:32:28 kjcf05n02 ras-resource-manager-agent[5883]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "a07e4608-99df-11ef-80e4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} (service_main_handler.py:66) Nov 3 06:32:28 kjcf05n02 ras-resource-manager-agent[5883]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'a07e4608-99df-11ef-80e4-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 06:32:28 kjcf05n02 ras-resource-manager-agent[5883]: INFO Device qualification response has been acknowledged: a07e4608-99df-11ef-80e4-00093d0695e3 (admin_action.py:151) Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "a02f9f6c-99df-11ef-80e4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: Dbus, handle_ingress_ras_signals, uuid: a02f9f6c-99df-11ef-80e4-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "a02f9f6c-99df-11ef-80e4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "a07e4608-99df-11ef-80e4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: Dbus, handle_ingress_ras_signals, uuid: a07e4608-99df-11ef-80e4-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "a07e4608-99df-11ef-80e4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 06:32:30 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 06:32:32 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 06:32:32 kjcf05n02 diskmonitor[17412]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 06:32:36 kjcf05n02 diskmonitor[17412]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 06:32:36 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 06:32:36 kjcf05n02 diskmonitor[17412]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 06:32:36 kjcf05n02 diskmonitor[17412]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 06:32:36 kjcf05n02 diskmonitor[17412]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 06:32:36 kjcf05n02 diskmonitor[17412]: leaving test state: 1 next state: 2 Nov 3 06:32:36 kjcf05n02 diskmonitor[17412]: lock req: no timeout Nov 3 06:32:36 kjcf05n02 diskmonitor[17412]: leaving test state: 2 next state: 4 Nov 3 06:32:36 kjcf05n02 diskmonitor[17412]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 06:32:50 kjcf05n00 zabbix_server[15640]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},disk,discovery.float]" became supported Nov 3 06:32:50 kjcf05n00 zabbix_server[15640]: discovery rule "enclosure_USE26000024VS001:xrtx.enclosure.components.discovery[{$SERIAL_NUMBER},disk,discovery.int]" became supported Nov 3 06:32:56 kjcf05n00 mcfcli[3673891]: %3|1730637176.192|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:33:03 kjcf05n00 mcfcli[3673891]: %3|1730637183.785|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:33:23 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 06:33:23 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 06:33:23 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 06:33:26 kjcf05n00 mcfcli[3673891]: %3|1730637206.192|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T06:33:27.252814024-06:00 level=info msg="Completed cleanup jobs" duration=26.212871ms Nov 3 06:33:38 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 06:33:38 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 06:33:38 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 06:33:41 kjcf05n02 dcs-collectord[5619]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 06:33:43 kjcf05n00 mcfcli[3673891]: %3|1730637223.259|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:33:46 kjcf05n02 diskmonitor[17412]: lock acquired Nov 3 06:33:46 kjcf05n02 diskmonitor[17412]: leaving test state: 4 next state: 8 Nov 3 06:33:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730637230}"] Nov 3 06:33:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730637230, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:33:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:33:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:33:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:33:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:33:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:33:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:33:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:33:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:33:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:33:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:33:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:33:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:33:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:33:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.21054ms Nov 3 06:33:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:33:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.21054ms Nov 3 06:33:50 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:33:50 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:33:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:33:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730637230}"] Nov 3 06:33:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730637230, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:33:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:33:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:33:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:33:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:33:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:33:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:33:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:33:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:33:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:33:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:33:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:33:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:33:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:33:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.057713ms Nov 3 06:33:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:33:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.057713ms Nov 3 06:33:50 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:33:50 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:33:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:33:56 kjcf05n00 mcfcli[3673891]: %3|1730637236.192|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:34:08 kjcf05n02 diskmonitor[17412]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 06:34:08 kjcf05n02 diskmonitor[17412]: leaving test state: 8 next state: 20 Nov 3 06:34:08 kjcf05n02 diskmonitor[17412]: leaving test state: 20 next state: 40 Nov 3 06:34:08 kjcf05n02 diskmonitor[17412]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 58db8000 Nov 3 06:34:08 kjcf05n02 diskmonitor[17412]: leaving test state: 40 next state: 80 Nov 3 06:34:20 kjcf05n00 mcfcli[3673891]: %3|1730637260.925|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:34:26 kjcf05n00 mcfcli[3673891]: %3|1730637266.193|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:34:56 kjcf05n00 mcfcli[3673891]: %3|1730637296.194|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:35:00 kjcf05n00 mcfcli[3673891]: %3|1730637300.347|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:35:04 kjcf05n00 python3.9[1030516]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 06:35:07 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 06:35:12 kjcf05n02 diskmonitor[17412]: leaving test state: 80 next state: 100 Nov 3 06:35:12 kjcf05n02 diskmonitor[17412]: lock release: time: Sun Nov 3 06:35:06 2024 Nov 3 06:35:12 kjcf05n02 diskmonitor[17412]: leaving test state: 100 next state: 1 Nov 3 06:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730637017', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 06:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730637017'} Nov 3 06:35:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730637017', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 06:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730637017'} Nov 3 06:35:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:35:26 kjcf05n00 mcfcli[3673891]: %3|1730637326.194|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 06:35:32 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 06:35:38 kjcf05n00 mcfcli[3673891]: %3|1730637338.387|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:35:56 kjcf05n00 mcfcli[3673891]: %3|1730637356.194|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:36:15 kjcf05n00 mcfcli[3673891]: %3|1730637375.144|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:36:26 kjcf05n00 mcfcli[3673891]: %3|1730637386.194|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 06:36:55 kjcf05n00 mcfcli[3673891]: %3|1730637415.141|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:36:56 kjcf05n00 mcfcli[3673891]: %3|1730637416.195|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:37:26 kjcf05n00 mcfcli[3673891]: %3|1730637446.196|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:37:34 kjcf05n00 mcfcli[3673891]: %3|1730637454.620|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:37:56 kjcf05n00 mcfcli[3673891]: %3|1730637476.196|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 06:38:12 kjcf05n00 mcfcli[3673891]: %3|1730637492.215|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:38:26 kjcf05n00 mcfcli[3673891]: %3|1730637506.196|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 06:38:48 kjcf05n00 mcfcli[3673891]: %3|1730637528.782|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:38:56 kjcf05n00 mcfcli[3673891]: %3|1730637536.196|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 06:39:26 kjcf05n00 mcfcli[3673891]: %3|1730637566.198|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:39:26 kjcf05n00 mcfcli[3673891]: %3|1730637566.590|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:39:56 kjcf05n00 mcfcli[3673891]: %3|1730637596.697|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 06:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 06:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 06:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 06:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 06:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 06:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 06:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 06:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 06:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 06:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 06:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 06:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 06:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 06:40:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 06:40:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:40:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 06:40:03 kjcf05n00 mcfcli[3673891]: %3|1730637603.788|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:40:04 kjcf05n00 python3.9[1033365]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 06:40:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730637017', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 06:40:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730637017'} Nov 3 06:40:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:40:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730637017', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 06:40:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730637017'} Nov 3 06:40:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:40:26 kjcf05n00 mcfcli[3673891]: %3|1730637626.697|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 06:40:42 kjcf05n00 mcfcli[3673891]: %3|1730637642.838|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:40:56 kjcf05n00 mcfcli[3673891]: %3|1730637656.698|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:41:18 kjcf05n00 mcfcli[3673891]: %3|1730637678.664|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:41:26 kjcf05n00 mcfcli[3673891]: %3|1730637686.698|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 06:41:55 kjcf05n02 root[42709]: failback_xyraid Nov 3 06:41:56 kjcf05n00 mcfcli[3673891]: %3|1730637716.699|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 06:41:57 kjcf05n02 root[42823]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 06:41:58 kjcf05n02 root[42980]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 06:41:58 kjcf05n00 mcfcli[3673891]: %3|1730637718.299|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:42:01 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 3 06:42:05 kjcf05n03 dwd[5200]: Drive path is missing, purging: nvme8n1 Nov 3 06:42:05 kjcf05n03 dwd[5200]: Drive path is missing, purging: nvme19n1 Nov 3 06:42:05 kjcf05n03 dwd[5200]: Drive path is missing, purging: nvme9n1 Nov 3 06:42:05 kjcf05n03 dwd[5200]: Drive path is missing, purging: nvme24n1 Nov 3 06:42:05 kjcf05n03 dwd[5200]: Drive path is missing, purging: nvme18n1 Nov 3 06:42:05 kjcf05n03 dwd[5200]: Drive path is missing, purging: nvme23n1 Nov 3 06:42:05 kjcf05n03 dwd[5200]: Drive path is missing, purging: nvme2n1 Nov 3 06:42:05 kjcf05n03 dwd[5200]: Drive path is missing, purging: nvme17n1 Nov 3 06:42:05 kjcf05n03 dwd[5200]: Drive path is missing, purging: nvme4n1 Nov 3 06:42:05 kjcf05n03 dwd[5200]: Drive path is missing, purging: nvme3n1 Nov 3 06:42:05 kjcf05n03 dwd[5200]: Drive path is missing, purging: nvme25n1 Nov 3 06:42:08 kjcf05n02 dwd[5162]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 06:42:08 kjcf05n02 dwd[5162]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 06:42:08 kjcf05n02 dwd[5162]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 06:42:08 kjcf05n02 dwd[5162]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 06:42:08 kjcf05n02 dwd[5162]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 06:42:08 kjcf05n02 dwd[5162]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 06:42:08 kjcf05n02 dwd[5162]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 06:42:08 kjcf05n02 dwd[5162]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 06:42:08 kjcf05n02 dwd[5162]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 06:42:08 kjcf05n02 dwd[5162]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 06:42:08 kjcf05n02 dwd[5162]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 06:42:08 kjcf05n02 dwd[5162]: Starting NVME thread for nvme2n1 Nov 3 06:42:08 kjcf05n02 dwd[5162]: Starting NVME thread for nvme18n1 Nov 3 06:42:08 kjcf05n02 dwd[5162]: Starting NVME thread for nvme19n1 Nov 3 06:42:08 kjcf05n02 dwd[5162]: Starting NVME thread for nvme9n1 Nov 3 06:42:09 kjcf05n02 dwd[5162]: Starting NVME thread for nvme3n1 Nov 3 06:42:09 kjcf05n02 systemd-udevd[45738]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45739]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45741]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45743]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45738]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45739]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45741]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45743]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45738]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45739]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45741]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45743]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45738]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45739]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45741]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45743]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45738]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45739]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45741]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45743]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45763]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45739]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45738]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45768]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45743]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45765]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45741]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45739]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45763]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45771]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45738]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45743]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45741]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45768]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45765]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45763]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45771]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45738]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45743]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45741]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45765]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45768]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 dwd[5162]: Starting NVME thread for nvme24n1 Nov 3 06:42:09 kjcf05n02 systemd-udevd[45763]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45741]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45763]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45768]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45741]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45771]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45763]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45741]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45738]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45763]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45741]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45763]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45741]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45741]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45763]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45741]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45763]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45741]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45763]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45741]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45741]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:42:09 kjcf05n02 systemd-udevd[45741]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:42:10 kjcf05n02 dwd[5162]: Starting NVME thread for nvme4n1 Nov 3 06:42:10 kjcf05n02 dwd[5162]: Starting NVME thread for nvme23n1 Nov 3 06:42:10 kjcf05n02 dwd[5162]: Starting NVME thread for nvme17n1 Nov 3 06:42:10 kjcf05n02 dwd[5162]: Starting NVME thread for nvme25n1 Nov 3 06:42:10 kjcf05n02 dcs-bulk-data-sender[6149]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 3 06:42:10 kjcf05n02 dwd[5162]: Starting NVME thread for nvme8n1 Nov 3 06:42:10 kjcf05n02 nslcd[6910]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 06:42:16 kjcf05n02 diskmonitor[17412]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 06:42:23 kjcf05n02 diskmonitor[17412]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 06:42:23 kjcf05n02 diskmonitor[17412]: Scan for ReadErrorMax change for md65 Nov 3 06:42:23 kjcf05n02 diskmonitor[17412]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 06:42:23 kjcf05n02 diskmonitor[17412]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 06:42:23 kjcf05n02 diskmonitor[17412]: read_saved_file: md65 no saved speed Nov 3 06:42:23 kjcf05n02 diskmonitor[17412]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 06:42:23 kjcf05n02 diskmonitor[17412]: Set sync_speed_min (10000) for md65 Nov 3 06:42:23 kjcf05n02 diskmonitor[17412]: Set sync_speed_max (200000) for md65 Nov 3 06:42:23 kjcf05n02 diskmonitor[17412]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 06:42:26 kjcf05n00 mcfcli[3673891]: %3|1730637746.699|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 06:42:37 kjcf05n00 mcfcli[3673891]: %3|1730637757.078|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:42:50 kjcf05n03 diskmonitor[17404]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 06:42:50 kjcf05n03 diskmonitor[17404]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 06:42:56 kjcf05n00 mcfcli[3673891]: %3|1730637776.699|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 06:43:01 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 06:43:01 kjcf05n02 systemd-tmpfiles[48553]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 06:43:01 kjcf05n02 systemd-tmpfiles[48553]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 06:43:01 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 06:43:01 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 06:43:04 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 48813 (bash) Nov 3 06:43:04 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 06:43:04 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 06:43:15 kjcf05n00 mcfcli[3673891]: %3|1730637795.661|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:43:26 kjcf05n00 mcfcli[3673891]: %3|1730637806.700|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 06:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T06:43:27.254190304-06:00 level=info msg="Completed cleanup jobs" duration=27.577728ms Nov 3 06:43:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730637830}"] Nov 3 06:43:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730637830, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:43:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.178981ms Nov 3 06:43:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.178981ms Nov 3 06:43:50 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:43:50 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:43:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:43:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730637830}"] Nov 3 06:43:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730637830, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:43:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.887515ms Nov 3 06:43:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.887515ms Nov 3 06:43:50 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:43:50 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:43:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:43:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730637830}"] Nov 3 06:43:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730637830, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:43:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.156799ms Nov 3 06:43:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.156799ms Nov 3 06:43:50 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:43:50 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:43:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:43:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730637830}"] Nov 3 06:43:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730637830, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:43:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.06143ms Nov 3 06:43:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.06143ms Nov 3 06:43:51 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:43:51 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:43:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:43:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730637830}"] Nov 3 06:43:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730637830, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:43:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.256256ms Nov 3 06:43:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.256256ms Nov 3 06:43:51 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:43:51 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:43:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:43:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730637830}"] Nov 3 06:43:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730637830, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:43:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.211732ms Nov 3 06:43:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.211732ms Nov 3 06:43:51 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:43:51 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:43:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:43:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730637830}"] Nov 3 06:43:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730637830, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:43:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.302643ms Nov 3 06:43:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.302643ms Nov 3 06:43:51 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:43:51 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:43:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:43:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730637830}"] Nov 3 06:43:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730637830, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:43:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.130339ms Nov 3 06:43:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.130339ms Nov 3 06:43:51 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:43:51 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:43:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:43:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730637830}"] Nov 3 06:43:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730637830, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:43:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.849494ms Nov 3 06:43:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.849494ms Nov 3 06:43:51 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:43:51 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:43:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:43:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730637830}"] Nov 3 06:43:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730637830, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:43:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.040912ms Nov 3 06:43:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.040912ms Nov 3 06:43:51 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:43:51 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:43:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:43:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730637830}"] Nov 3 06:43:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730637830, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:43:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:43:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:43:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:43:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:43:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:43:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:43:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.035432ms Nov 3 06:43:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:43:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.035432ms Nov 3 06:43:52 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:43:52 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:43:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:43:55 kjcf05n00 mcfcli[3673891]: %3|1730637835.239|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:43:56 kjcf05n00 mcfcli[3673891]: %3|1730637836.701|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 06:44:03 kjcf05n00 zabbix-server[1035848]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 06:44:03 kjcf05n00 zabbix-server[1035848]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '45896' Nov 3 06:44:03 kjcf05n00 zabbix-server[1035848]: Filesystem 'kjcf05' has been mounted Nov 3 06:44:03 kjcf05n00 zabbix-server[1035848]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 06:44:03 kjcf05n00 zabbix-server[1035848]: Running puppet on 'None' Nov 3 06:44:05 kjcf05n02 puppet-agent[50557]: Using configured environment 'production' Nov 3 06:44:05 kjcf05n02 puppet-agent[50557]: Retrieving pluginfacts Nov 3 06:44:05 kjcf05n02 puppet-agent[50557]: Retrieving plugin Nov 3 06:44:05 kjcf05n06 puppet-agent[2505753]: Using configured environment 'production' Nov 3 06:44:05 kjcf05n06 puppet-agent[2505753]: Retrieving pluginfacts Nov 3 06:44:05 kjcf05n06 puppet-agent[2505753]: Retrieving plugin Nov 3 06:44:05 kjcf05n06 puppet-agent[2505753]: Loading facts Nov 3 06:44:05 kjcf05n03 puppet-agent[107121]: Using configured environment 'production' Nov 3 06:44:05 kjcf05n03 puppet-agent[107121]: Retrieving pluginfacts Nov 3 06:44:05 kjcf05n03 puppet-agent[107121]: Retrieving plugin Nov 3 06:44:05 kjcf05n03 puppet-agent[107121]: Loading facts Nov 3 06:44:05 kjcf05n05 puppet-agent[2645645]: Using configured environment 'production' Nov 3 06:44:05 kjcf05n05 puppet-agent[2645645]: Retrieving pluginfacts Nov 3 06:44:05 kjcf05n05 puppet-agent[2645645]: Retrieving plugin Nov 3 06:44:05 kjcf05n04 puppet-agent[2502807]: Using configured environment 'production' Nov 3 06:44:05 kjcf05n04 puppet-agent[2502807]: Retrieving pluginfacts Nov 3 06:44:05 kjcf05n04 puppet-agent[2502807]: Retrieving plugin Nov 3 06:44:05 kjcf05n04 puppet-agent[2502807]: Loading facts Nov 3 06:44:06 kjcf05n07 puppet-agent[2503580]: Using configured environment 'production' Nov 3 06:44:06 kjcf05n07 puppet-agent[2503580]: Retrieving pluginfacts Nov 3 06:44:06 kjcf05n07 puppet-agent[2503580]: Retrieving plugin Nov 3 06:44:06 kjcf05n07 puppet-agent[2503580]: Loading facts Nov 3 06:44:06 kjcf05n02 puppet-agent[50557]: Loading facts Nov 3 06:44:06 kjcf05n01 puppet-agent[2949011]: Using configured environment 'production' Nov 3 06:44:06 kjcf05n01 puppet-agent[2949011]: Retrieving pluginfacts Nov 3 06:44:06 kjcf05n01 puppet-agent[2949011]: Retrieving plugin Nov 3 06:44:06 kjcf05n01 puppet-agent[2949011]: Loading facts Nov 3 06:44:06 kjcf05n05 puppet-agent[2645645]: Loading facts Nov 3 06:44:06 kjcf05n00 puppet-agent[1035948]: Using configured environment 'production' Nov 3 06:44:06 kjcf05n00 puppet-agent[1035948]: Retrieving pluginfacts Nov 3 06:44:06 kjcf05n00 puppet-agent[1035948]: Retrieving plugin Nov 3 06:44:06 kjcf05n00 puppet-agent[1035948]: Loading facts Nov 3 06:44:09 kjcf05n03 puppet-agent[107121]: Caching catalog for kjcf05n03 Nov 3 06:44:09 kjcf05n03 puppet-agent[107121]: Applying configuration version '1730637847' Nov 3 06:44:08 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 06:44:08 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 06:44:09 kjcf05n02 puppet-agent[50557]: Caching catalog for kjcf05n02 Nov 3 06:44:09 kjcf05n02 puppet-agent[50557]: Applying configuration version '1730637847' Nov 3 06:44:10 kjcf05n07 puppet-agent[2503580]: Caching catalog for kjcf05n07 Nov 3 06:44:10 kjcf05n07 puppet-agent[2503580]: Applying configuration version '1730637848' Nov 3 06:44:10 kjcf05n06 puppet-agent[2505753]: Caching catalog for kjcf05n06 Nov 3 06:44:10 kjcf05n06 puppet-agent[2505753]: Applying configuration version '1730637847' Nov 3 06:44:10 kjcf05n01 puppet-agent[2949011]: Caching catalog for kjcf05n01 Nov 3 06:44:10 kjcf05n01 puppet-agent[2949011]: Applying configuration version '1730637847' Nov 3 06:44:11 kjcf05n03 puppet-agent[107121]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 06:44:11 kjcf05n03 puppet-agent[107121]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 06:44:11 kjcf05n03 puppet-agent[107121]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 06:44:11 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 06:44:11 kjcf05n03 zabbix_agent2[50600]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 06:44:11 kjcf05n03 zabbix_agent2[3190]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 06:44:11 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 06:44:11 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 06:44:11 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 06:44:11 kjcf05n03 puppet-agent[107121]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: Press Ctrl+C to exit. Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: Plugin support version 1.0 Nov 3 06:44:11 kjcf05n03 zabbix_agent2[107503]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 06:44:11 kjcf05n00 puppet-agent[1035948]: Caching catalog for kjcf05n00 Nov 3 06:44:11 kjcf05n00 puppet-agent[1035948]: Applying configuration version '1730637849' Nov 3 06:44:11 kjcf05n02 puppet-agent[50557]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 06:44:11 kjcf05n02 puppet-agent[50557]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 06:44:11 kjcf05n02 puppet-agent[50557]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 06:44:12 kjcf05n07 puppet-agent[2503580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 06:44:12 kjcf05n07 puppet-agent[2503580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 06:44:12 kjcf05n07 puppet-agent[2503580]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 06:44:12 kjcf05n06 puppet-agent[2505753]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 06:44:12 kjcf05n06 puppet-agent[2505753]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 06:44:12 kjcf05n06 puppet-agent[2505753]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 06:44:12 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 06:44:12 kjcf05n02 zabbix_agent2[5967]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 06:44:12 kjcf05n02 zabbix_agent2[3146]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 06:44:12 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 06:44:12 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 06:44:12 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 06:44:12 kjcf05n02 puppet-agent[50557]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: Press Ctrl+C to exit. Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: Plugin support version 1.0 Nov 3 06:44:12 kjcf05n02 zabbix_agent2[50930]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 06:44:12 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2451495]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 06:44:12 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 06:44:12 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 06:44:12 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 06:44:12 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 06:44:12 kjcf05n07 puppet-agent[2503580]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: Press Ctrl+C to exit. Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: Plugin support version 1.0 Nov 3 06:44:12 kjcf05n07 zabbix_agent2[2504151]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 06:44:12 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2453415]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 06:44:12 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 06:44:12 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 06:44:12 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 06:44:12 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 06:44:12 kjcf05n06 puppet-agent[2505753]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: Press Ctrl+C to exit. Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: Plugin support version 1.0 Nov 3 06:44:12 kjcf05n06 zabbix_agent2[2506169]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 06:44:12 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 06:44:13 kjcf05n01 puppet-agent[2949011]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 06:44:13 kjcf05n01 puppet-agent[2949011]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-06:24:02]/mode) mode changed '0755' to '0750' Nov 3 06:44:13 kjcf05n01 puppet-agent[2949011]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-06:24:02/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 06:44:13 kjcf05n01 puppet-agent[2949011]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-06:24:02/vmcore]/mode) mode changed '0600' to '0640' Nov 3 06:44:13 kjcf05n01 puppet-agent[2949011]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-06:24:02/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 06:44:13 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 06:44:13 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 06:44:13 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 06:44:13 kjcf05n03 puppet-agent[107121]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 06:44:13 kjcf05n03 puppet-agent[107121]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 06:44:13 kjcf05n03 puppet-agent[107121]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 06:44:13 kjcf05n03 puppet-agent[107121]: Applied catalog in 5.03 seconds Nov 3 06:44:14 kjcf05n01 puppet-agent[2949011]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 06:44:14 kjcf05n01 puppet-agent[2949011]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 06:44:14 kjcf05n01 puppet-agent[2949011]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 06:44:14 kjcf05n00 puppet-agent[1035948]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 06:44:14 kjcf05n02 puppet-agent[50557]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 06:44:14 kjcf05n02 puppet-agent[50557]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 06:44:14 kjcf05n02 puppet-agent[50557]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 06:44:14 kjcf05n02 puppet-agent[50557]: Applied catalog in 5.02 seconds Nov 3 06:44:14 kjcf05n06 puppet-agent[2505753]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 06:44:14 kjcf05n06 puppet-agent[2505753]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 06:44:14 kjcf05n06 puppet-agent[2505753]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 06:44:14 kjcf05n07 puppet-agent[2503580]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 06:44:14 kjcf05n07 puppet-agent[2503580]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 06:44:14 kjcf05n07 puppet-agent[2503580]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 06:44:14 kjcf05n07 puppet-agent[2503580]: Applied catalog in 5.06 seconds Nov 3 06:44:15 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2937251]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 06:44:15 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 06:44:15 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 06:44:15 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 06:44:15 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 06:44:15 kjcf05n01 puppet-agent[2949011]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: Press Ctrl+C to exit. Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: Plugin support version 1.0 Nov 3 06:44:15 kjcf05n01 zabbix_agent2[2949368]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 06:44:15 kjcf05n06 puppet-agent[2505753]: Applied catalog in 4.81 seconds Nov 3 06:44:15 kjcf05n00 puppet-agent[1035948]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 06:44:15 kjcf05n00 puppet-agent[1035948]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 06:44:15 kjcf05n00 puppet-agent[1035948]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 06:44:16 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1017741]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 06:44:16 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 06:44:16 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 06:44:16 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 06:44:16 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 06:44:16 kjcf05n00 puppet-agent[1035948]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: Press Ctrl+C to exit. Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: Plugin support version 1.0 Nov 3 06:44:16 kjcf05n00 zabbix_agent2[1036467]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 06:44:16 kjcf05n00 zabbix-server[1036492]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 06:44:17 kjcf05n00 zabbix-server[1036498]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 06:44:17 kjcf05n01 puppet-agent[2949011]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_063121.log]/mode) mode changed '0644' to '0640' Nov 3 06:44:17 kjcf05n01 puppet-agent[2949011]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_064304.log]/mode) mode changed '0644' to '0640' Nov 3 06:44:17 kjcf05n01 puppet-agent[2949011]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_064304]/mode) mode changed '0755' to '0750' Nov 3 06:44:17 kjcf05n01 puppet-agent[2949011]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_064304/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 06:44:17 kjcf05n00 zabbix-server[1036507]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 06:44:17 kjcf05n00 zabbix-server[1036510]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 06:44:18 kjcf05n01 puppet-agent[2949011]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_063121.log]/mode) mode changed '0644' to '0640' Nov 3 06:44:18 kjcf05n01 puppet-agent[2949011]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_064304.log]/mode) mode changed '0644' to '0640' Nov 3 06:44:18 kjcf05n01 puppet-agent[2949011]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 06:44:18 kjcf05n01 puppet-agent[2949011]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 06:44:18 kjcf05n01 puppet-agent[2949011]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 06:44:18 kjcf05n00 puppet-agent[1035948]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 06:44:20 kjcf05n01 puppet-agent[2949011]: Applied catalog in 9.68 seconds Nov 3 06:44:19 kjcf05n00 puppet-agent[1035948]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 06:44:19 kjcf05n00 puppet-agent[1035948]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 06:44:19 kjcf05n00 puppet-agent[1035948]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 06:44:20 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 06:44:21 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 06:44:20 kjcf05n00 puppet-agent[1035948]: Applied catalog in 9.45 seconds Nov 3 06:44:23 kjcf05n04 puppet-agent[2502807]: Caching catalog for kjcf05n04 Nov 3 06:44:23 kjcf05n04 puppet-agent[2502807]: Applying configuration version '1730637859' Nov 3 06:44:25 kjcf05n04 puppet-agent[2502807]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 06:44:25 kjcf05n04 puppet-agent[2502807]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 06:44:25 kjcf05n04 puppet-agent[2502807]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 06:44:26 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2456666]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 06:44:26 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 06:44:26 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 06:44:26 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 06:44:26 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 06:44:26 kjcf05n04 puppet-agent[2502807]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: Press Ctrl+C to exit. Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: Plugin support version 1.0 Nov 3 06:44:26 kjcf05n04 zabbix_agent2[2503768]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 06:44:26 kjcf05n00 mcfcli[3673891]: %3|1730637866.701|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:44:27 kjcf05n04 puppet-agent[2502807]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 06:44:27 kjcf05n04 puppet-agent[2502807]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 06:44:27 kjcf05n04 puppet-agent[2502807]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 06:44:27 kjcf05n04 puppet-agent[2502807]: Applied catalog in 4.95 seconds Nov 3 06:44:33 kjcf05n00 mcfcli[3673891]: %3|1730637873.787|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:44:40 kjcf05n05 puppet-agent[2645645]: Caching catalog for kjcf05n05 Nov 3 06:44:40 kjcf05n05 puppet-agent[2645645]: Applying configuration version '1730637878' Nov 3 06:44:42 kjcf05n05 puppet-agent[2645645]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 06:44:42 kjcf05n05 puppet-agent[2645645]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 06:44:42 kjcf05n05 puppet-agent[2645645]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 06:44:43 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2598016]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 06:44:43 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 06:44:43 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 06:44:43 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 06:44:43 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 06:44:43 kjcf05n05 puppet-agent[2645645]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: Starting Zabbix Agent 2 (6.2.1) Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: Press Ctrl+C to exit. Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: Plugin support version 1.0 Nov 3 06:44:43 kjcf05n05 zabbix_agent2[2648344]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 06:44:45 kjcf05n05 puppet-agent[2645645]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 06:44:45 kjcf05n05 puppet-agent[2645645]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 06:44:45 kjcf05n05 puppet-agent[2645645]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 06:44:45 kjcf05n05 puppet-agent[2645645]: Applied catalog in 4.79 seconds Nov 3 06:44:45 kjcf05n00 zabbix-server[1035848]: puppet completed status:(0): '' Nov 3 06:44:45 kjcf05n00 zabbix-server[1035848]: Event '45896' acknowledged Nov 3 06:44:45 kjcf05n00 zabbix-server[1035848]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 3 06:44:52 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 06:44:56 kjcf05n00 mcfcli[3673891]: %3|1730637896.701|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:45:04 kjcf05n00 python3.9[1037005]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 06:45:13 kjcf05n00 mcfcli[3673891]: %3|1730637913.784|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:45:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730637919', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 06:45:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730637919'} Nov 3 06:45:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:45:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730637919', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 06:45:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730637919'} Nov 3 06:45:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:45:26 kjcf05n00 mcfcli[3673891]: %3|1730637926.702|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 06:45:53 kjcf05n00 mcfcli[3673891]: %3|1730637953.322|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:45:56 kjcf05n00 mcfcli[3673891]: %3|1730637956.703|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:46:27 kjcf05n00 mcfcli[3673891]: %3|1730637987.037|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 06:46:30 kjcf05n00 mcfcli[3673891]: %3|1730637990.448|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:46:57 kjcf05n00 mcfcli[3673891]: %3|1730638017.037|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:47:09 kjcf05n00 mcfcli[3673891]: %3|1730638029.983|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:47:23 kjcf05n02 dwd[5162]: nvme18n1 passed periodic SMART status check Nov 3 06:47:23 kjcf05n02 dwd[5162]: nvme9n1 passed periodic SMART status check Nov 3 06:47:23 kjcf05n02 dwd[5162]: nvme2n1 passed periodic SMART status check Nov 3 06:47:23 kjcf05n02 dwd[5162]: nvme19n1 passed periodic SMART status check Nov 3 06:47:24 kjcf05n02 dwd[5162]: nvme3n1 passed periodic SMART status check Nov 3 06:47:24 kjcf05n02 dwd[5162]: nvme4n1 passed periodic SMART status check Nov 3 06:47:24 kjcf05n02 dwd[5162]: nvme24n1 passed periodic SMART status check Nov 3 06:47:26 kjcf05n02 dwd[5162]: nvme17n1 passed periodic SMART status check Nov 3 06:47:26 kjcf05n02 dwd[5162]: nvme23n1 passed periodic SMART status check Nov 3 06:47:26 kjcf05n02 dwd[5162]: nvme8n1 passed periodic SMART status check Nov 3 06:47:26 kjcf05n02 dwd[5162]: nvme25n1 passed periodic SMART status check Nov 3 06:47:27 kjcf05n00 mcfcli[3673891]: %3|1730638047.038|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:47:45 kjcf05n00 zabbix-server[1038769]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 06:47:45 kjcf05n00 zabbix-server[1038769]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 104.7\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 103.2\\"}}"' Nov 3 06:47:45 kjcf05n00 log_interesting_event.py[1038769]: Event '45897' acknowledged Nov 3 06:47:49 kjcf05n00 mcfcli[3673891]: %3|1730638069.980|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:47:57 kjcf05n00 mcfcli[3673891]: %3|1730638077.205|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 06:48:27 kjcf05n00 mcfcli[3673891]: %3|1730638107.205|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:48:27 kjcf05n00 mcfcli[3673891]: %3|1730638107.452|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:48:57 kjcf05n00 mcfcli[3673891]: %3|1730638137.206|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 06:49:06 kjcf05n00 mcfcli[3673891]: %3|1730638146.504|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:49:27 kjcf05n00 mcfcli[3673891]: %3|1730638167.207|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:49:45 kjcf05n00 mcfcli[3673891]: %3|1730638185.723|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:49:57 kjcf05n00 mcfcli[3673891]: %3|1730638197.207|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 06:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 06:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 06:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 06:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 06:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 06:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 06:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 06:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 06:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 06:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 06:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 06:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 06:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 06:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 06:50:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 06:50:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 06:50:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 06:50:04 kjcf05n00 python3.9[1039885]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 06:50:25 kjcf05n00 mcfcli[3673891]: %3|1730638225.536|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:50:27 kjcf05n00 mcfcli[3673891]: %3|1730638227.207|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 06:50:57 kjcf05n00 mcfcli[3673891]: %3|1730638257.208|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:51:03 kjcf05n00 mcfcli[3673891]: %3|1730638263.487|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:51:27 kjcf05n00 mcfcli[3673891]: %3|1730638287.208|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:51:43 kjcf05n00 mcfcli[3673891]: %3|1730638303.484|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:51:57 kjcf05n00 mcfcli[3673891]: %3|1730638317.209|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:52:02 kjcf05n03 nslcd[7259]: [e87ccd] ldap_result() failed: Can't contact LDAP server Nov 3 06:52:12 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:52:12-06:00] Checking for stale sessions... Nov 3 06:52:12 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:52:12-06:00] Checking for stale sessions... Nov 3 06:52:19 kjcf05n00 mcfcli[3673891]: %3|1730638339.129|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:52:27 kjcf05n00 mcfcli[3673891]: %3|1730638347.209|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 06:52:57 kjcf05n00 mcfcli[3673891]: %3|1730638377.211|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 06:52:57 kjcf05n00 mcfcli[3673891]: %3|1730638377.454|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T12:53:15.867504Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 06:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T12:53:15.867567Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.079ms Nov 3 06:53:27 kjcf05n00 mcfcli[3673891]: %3|1730638407.211|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 06:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T06:53:27.261926544-06:00 level=info msg="Completed cleanup jobs" duration=35.541282ms Nov 3 06:53:34 kjcf05n00 mcfcli[3673891]: %3|1730638414.804|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:53:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 06:53:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 06:53:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 06:53:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 06:53:57 kjcf05n00 mcfcli[3673891]: %3|1730638437.711|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 06:53:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 06:53:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 06:54:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 06:54:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 06:54:09 kjcf05n00 zabbix_server[15769]: Zabbix agent item "vfs.fs.inode[/mnt/persistent_ha_data,pfree]" on host "kjcf05n03" failed: first network error, wait for 15 seconds Nov 3 06:54:13 kjcf05n00 mcfcli[3673891]: %3|1730638453.399|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:54:16 kjcf05n02 fstonithd.py[15113]: My partner 172.16.2.6 is kdumping. Forcing HA into GATHER state. Nov 3 06:54:16 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 06:54:16 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 06:54:16 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 06:54:17 kjcf05n02 root[68360]: is_viking_off starts Nov 3 06:54:17 kjcf05n02 root[68358]: is_enc_ipmi_off starts Nov 3 06:54:17 kjcf05n02 root[68378]: I am not master; I will get master Nov 3 06:54:17 kjcf05n02 root[68380]: is_lan_ipmi_sec_off leaves Nov 3 06:54:17 kjcf05n02 root[68383]: I am in slot 0; partner is in slot 1 Nov 3 06:54:17 kjcf05n02 root[68385]: is_lan_ipmi_off leaves Nov 3 06:54:22 kjcf05n02 LCNmon[17891]: 10.16.100.53 is unreachable via ib0 Nov 3 06:54:22 kjcf05n02 LCNmon[17891]: 10.16.100.59 is unreachable via ib0 Nov 3 06:54:22 kjcf05n02 root[68549]: I am now master Nov 3 06:54:23 kjcf05n02 root[68586]: is_viking_off leaves Nov 3 06:54:23 kjcf05n02 root[68595]: kjcf05n03 not already off look at kdump Nov 3 06:54:23 kjcf05n02 root[68597]: is_kdump_off starts Nov 3 06:54:23 kjcf05n02 fence_kdump[68598]: waiting for message from '172.16.2.6' Nov 3 06:54:23 kjcf05n02 fence_kdump[68598]: received valid message from '172.16.2.6' Nov 3 06:54:23 kjcf05n02 root[68599]: is_kdump_off detected kdump on kjcf05n03 Nov 3 06:54:23 kjcf05n02 root[68600]: kjcf05n03 is kdumping Nov 3 06:54:23 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='107', error='Connection reset by peer (104)' Nov 3 06:54:23 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='107', client='AF_INET(172.16.2.6:35581)', local='AF_INET(0.0.0.0:601)' Nov 3 06:54:24 kjcf05n02 root[68690]: is_enc_ipmi_off starts Nov 3 06:54:24 kjcf05n02 root[68691]: is_viking_off starts Nov 3 06:54:24 kjcf05n02 root[68719]: is_lan_ipmi_sec_off leaves Nov 3 06:54:24 kjcf05n02 root[68721]: is_lan_ipmi_off leaves Nov 3 06:54:24 kjcf05n02 root[68724]: I am in slot 0; partner is in slot 1 Nov 3 06:54:24 kjcf05n02 root[68727]: I am master Nov 3 06:54:24 kjcf05n00 zabbix_server[15783]: Zabbix agent item "net.if.in["icl0"]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 06:54:25 kjcf05n00 zabbix_server[15726]: Zabbix agent item "proc.num[,,run]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 06:54:26 kjcf05n02 LCNmon[17891]: 10.16.100.53 is unreachable via ib1 Nov 3 06:54:26 kjcf05n02 LCNmon[17891]: 10.16.100.59 is unreachable via ib1 Nov 3 06:54:26 kjcf05n00 zabbix_server[15765]: Zabbix agent item "xrtx.enclosure.serial_number[USE26000024VS001]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 06:54:27 kjcf05n00 zabbix_server[15768]: Zabbix agent item "system.cpu.intr" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 06:54:27 kjcf05n00 mcfcli[3673891]: %3|1730638467.711|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:54:28 kjcf05n00 zabbix_server[15757]: Zabbix agent item "system.cpu.load[all,avg15]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 06:54:30 kjcf05n02 root[68934]: is_viking_off leaves Nov 3 06:54:30 kjcf05n02 root[68937]: kjcf05n03 not already off look at kdump Nov 3 06:54:30 kjcf05n02 root[68938]: is_kdump_off starts Nov 3 06:54:30 kjcf05n02 fence_kdump[68939]: waiting for message from '172.16.2.6' Nov 3 06:54:30 kjcf05n02 fence_kdump[68939]: received valid message from '172.16.2.6' Nov 3 06:54:30 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 06:54:30 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 06:54:31 kjcf05n02 root[68940]: is_kdump_off detected kdump on kjcf05n03 Nov 3 06:54:31 kjcf05n02 root[68941]: kjcf05n03 is kdumping Nov 3 06:54:35 kjcf05n02 systemd-udevd[71242]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71244]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71246]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71248]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71242]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71244]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71246]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71248]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71242]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71244]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71246]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71248]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71242]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71244]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71246]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71248]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71242]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71244]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71246]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71248]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71242]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71244]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71246]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71248]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71242]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71244]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71246]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71248]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71242]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71244]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71246]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71248]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71282]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71280]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71284]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71286]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71282]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71280]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71284]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71286]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71282]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71280]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71286]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71282]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71286]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71282]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71286]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71282]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71286]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71282]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71286]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71282]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71286]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71282]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71282]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71286]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71282]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71286]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71282]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71282]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71286]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71282]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71286]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 systemd-udevd[71286]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 06:54:35 kjcf05n02 dwd[5162]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 06:54:35 kjcf05n02 dwd[5162]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 06:54:35 kjcf05n02 dwd[5162]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 06:54:35 kjcf05n02 dwd[5162]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 06:54:35 kjcf05n02 dwd[5162]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 06:54:35 kjcf05n02 dwd[5162]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 06:54:35 kjcf05n02 dwd[5162]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 06:54:35 kjcf05n02 dwd[5162]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 06:54:35 kjcf05n02 dwd[5162]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 06:54:35 kjcf05n02 dwd[5162]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 06:54:35 kjcf05n02 dwd[5162]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 06:54:35 kjcf05n02 dwd[5162]: Starting NVME thread for nvme16n1 Nov 3 06:54:35 kjcf05n02 dwd[5162]: Starting NVME thread for nvme22n1 Nov 3 06:54:35 kjcf05n02 dwd[5162]: Starting NVME thread for nvme15n1 Nov 3 06:54:35 kjcf05n02 dwd[5162]: Starting NVME thread for nvme6n1 Nov 3 06:54:36 kjcf05n02 dwd[5162]: Starting NVME thread for nvme11n1 Nov 3 06:54:36 kjcf05n02 dwd[5162]: Starting NVME thread for nvme7n1 Nov 3 06:54:36 kjcf05n02 dwd[5162]: Starting NVME thread for nvme10n1 Nov 3 06:54:36 kjcf05n02 dwd[5162]: Starting NVME thread for nvme20n1 Nov 3 06:54:36 kjcf05n02 dwd[5162]: Starting NVME thread for nvme21n1 Nov 3 06:54:37 kjcf05n02 dwd[5162]: Starting NVME thread for nvme5n1 Nov 3 06:54:37 kjcf05n02 dwd[5162]: Starting NVME thread for nvme12n1 Nov 3 06:54:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 06:54:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 06:54:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 06:54:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 06:54:43 kjcf05n00 zabbix_server[15783]: Zabbix agent item "net.if.out["ib1"]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 06:54:48 kjcf05n02 diskmonitor[17412]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 06:54:52 kjcf05n00 mcfcli[3673891]: %3|1730638492.295|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:54:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 06:54:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 06:54:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 06:54:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 06:54:56 kjcf05n02 diskmonitor[17412]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 06:54:56 kjcf05n02 diskmonitor[17412]: Scan for ReadErrorMax change for md66 Nov 3 06:54:56 kjcf05n02 diskmonitor[17412]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 06:54:56 kjcf05n02 diskmonitor[17412]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 06:54:56 kjcf05n02 diskmonitor[17412]: read_saved_file: md66 no saved speed Nov 3 06:54:56 kjcf05n02 diskmonitor[17412]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 06:54:56 kjcf05n02 diskmonitor[17412]: Set sync_speed_min (10000) for md66 Nov 3 06:54:56 kjcf05n02 diskmonitor[17412]: Set sync_speed_max (200000) for md66 Nov 3 06:54:56 kjcf05n02 diskmonitor[17412]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 06:54:57 kjcf05n00 mcfcli[3673891]: %3|1730638497.712|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:54:58 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n03": interface unavailable Nov 3 06:55:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 06:55:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 06:55:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 06:55:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 06:55:02 kjcf05n00 python3.9[1042734]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 06:55:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730638515', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 06:55:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730638515'} Nov 3 06:55:15 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:55:22 kjcf05n02 LCNmon[17891]: 10.16.100.53 is unreachable via ib0 Nov 3 06:55:22 kjcf05n02 LCNmon[17891]: 10.16.100.59 is unreachable via ib0 Nov 3 06:55:26 kjcf05n02 LCNmon[17891]: 10.16.100.53 is unreachable via ib1 Nov 3 06:55:26 kjcf05n02 LCNmon[17891]: 10.16.100.59 is unreachable via ib1 Nov 3 06:55:27 kjcf05n00 mcfcli[3673891]: %3|1730638527.712|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 06:55:32 kjcf05n00 mcfcli[3673891]: %3|1730638532.292|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 06:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 06:55:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 06:55:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 06:55:46 kjcf05n02 nslcd[6910]: ldap_result() failed: Can't contact LDAP server Nov 3 06:55:46 kjcf05n02 nslcd[6910]: (re)loading /etc/nsswitch.conf Nov 3 06:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 06:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 06:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 06:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 06:55:57 kjcf05n00 mcfcli[3673891]: %3|1730638557.712|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:56:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 06:56:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 06:56:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 06:56:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 06:56:12 kjcf05n00 mcfcli[3673891]: %3|1730638572.290|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:56:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730638581}"] Nov 3 06:56:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730638581, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:56:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.435662ms Nov 3 06:56:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.435662ms Nov 3 06:56:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:56:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:56:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:56:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730638581}"] Nov 3 06:56:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730638581, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:56:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.080106ms Nov 3 06:56:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.080106ms Nov 3 06:56:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:56:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:56:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:56:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730638581}"] Nov 3 06:56:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730638581, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:56:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.134567ms Nov 3 06:56:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.134567ms Nov 3 06:56:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:56:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:56:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:56:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730638581}"] Nov 3 06:56:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730638581, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:56:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.060028ms Nov 3 06:56:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.060028ms Nov 3 06:56:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:56:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:56:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:56:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730638581}"] Nov 3 06:56:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730638581, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:56:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.797616ms Nov 3 06:56:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.797616ms Nov 3 06:56:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:56:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:56:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:56:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730638581}"] Nov 3 06:56:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730638581, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:56:22 kjcf05n02 LCNmon[17891]: 10.16.100.53 is unreachable via ib0 Nov 3 06:56:22 kjcf05n02 LCNmon[17891]: 10.16.100.59 is unreachable via ib0 Nov 3 06:56:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.634404ms Nov 3 06:56:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.634404ms Nov 3 06:56:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:56:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:56:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:56:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730638581}"] Nov 3 06:56:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730638581, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:56:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.874711ms Nov 3 06:56:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.874711ms Nov 3 06:56:22 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:56:22 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:56:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:56:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730638581}"] Nov 3 06:56:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730638581, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:56:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.999815ms Nov 3 06:56:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.999815ms Nov 3 06:56:22 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:56:22 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:56:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:56:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730638581}"] Nov 3 06:56:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730638581, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:56:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.286663ms Nov 3 06:56:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.286663ms Nov 3 06:56:22 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:56:22 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:56:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:56:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730638581}"] Nov 3 06:56:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730638581, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:56:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.697512ms Nov 3 06:56:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.697512ms Nov 3 06:56:22 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:56:22 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:56:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:56:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730638581}"] Nov 3 06:56:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730638581, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 06:56:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 06:56:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T06:56:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 06:56:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T06:56:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 06:56:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T06:56:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.147953ms Nov 3 06:56:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T06:56:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.147953ms Nov 3 06:56:22 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:06:56:22 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 06:56:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 06:56:26 kjcf05n02 LCNmon[17891]: 10.16.100.53 is unreachable via ib1 Nov 3 06:56:26 kjcf05n02 LCNmon[17891]: 10.16.100.59 is unreachable via ib1 Nov 3 06:56:27 kjcf05n00 mcfcli[3673891]: %3|1730638587.713|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 06:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 06:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 06:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 06:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 06:56:50 kjcf05n00 mcfcli[3673891]: %3|1730638610.016|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 06:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 06:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 06:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 06:56:57 kjcf05n00 mcfcli[3673891]: %3|1730638617.713|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 06:57:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 06:57:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 06:57:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 06:57:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 06:57:22 kjcf05n02 LCNmon[17891]: 10.16.100.53 is unreachable via ib0 Nov 3 06:57:22 kjcf05n02 LCNmon[17891]: 10.16.100.59 is unreachable via ib0 Nov 3 06:57:26 kjcf05n02 LCNmon[17891]: 10.16.100.53 is unreachable via ib1 Nov 3 06:57:26 kjcf05n02 LCNmon[17891]: 10.16.100.59 is unreachable via ib1 Nov 3 06:57:27 kjcf05n00 mcfcli[3673891]: %3|1730638647.714|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 06:57:29 kjcf05n00 mcfcli[3673891]: %3|1730638649.277|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 06:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 06:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 06:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 06:57:52 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:9a:1a Nov 3 06:57:52 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 06:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 06:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 06:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 06:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 06:57:56 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 06:57:56 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a kjcf05n03 Nov 3 06:57:56 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.6 Nov 3 06:57:56 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 06:57:56 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 06:57:56 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.6 Nov 3 06:57:56 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/pxelinux.cfg to 172.16.2.6 Nov 3 06:57:57 kjcf05n00 mcfcli[3673891]: %3|1730638677.966|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 06:57:59 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/vmlinuz_diskless to 172.16.2.6 Nov 3 06:58:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 06:58:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 06:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 06:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 06:58:01 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/initramfs-diskless.img to 172.16.2.6 Nov 3 06:58:06 kjcf05n00 mcfcli[3673891]: %3|1730638686.675|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:58:22 kjcf05n02 LCNmon[17891]: 10.16.100.53 is unreachable via ib0 Nov 3 06:58:22 kjcf05n02 LCNmon[17891]: 10.16.100.59 is unreachable via ib0 Nov 3 06:58:26 kjcf05n02 LCNmon[17891]: 10.16.100.53 is unreachable via ib1 Nov 3 06:58:26 kjcf05n02 LCNmon[17891]: 10.16.100.59 is unreachable via ib1 Nov 3 06:58:28 kjcf05n00 mcfcli[3673891]: %3|1730638708.042|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 06:58:34 kjcf05n00 zabbix-server[1045215]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 06:58:34 kjcf05n00 zabbix-server[1045215]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n03:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 06:58:34 kjcf05n00 log_interesting_event.py[1045215]: Event '45900' acknowledged Nov 3 06:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 06:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 06:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 06:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 06:58:41 kjcf05n00 mcfcli[3673891]: %3|1730638721.808|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 1ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:58:49 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:60576). Nov 3 06:58:49 kjcf05n01 rsyncd[2955170]: connect from kjcf05n03 (172.16.2.6) Nov 3 06:58:49 kjcf05n01 rsyncd[2955170]: rsync on puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 06:58:49 kjcf05n01 rsyncd[2955170]: building file list Nov 3 06:58:49 kjcf05n01 rsyncd[2955170]: sent 11446 bytes received 136 bytes total size 10901 Nov 3 06:58:49 kjcf05n01 systemd[1]: rsyncd@605-172.16.2.2:873-172.16.2.6:60576.service: Succeeded. Nov 3 06:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 06:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 06:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 06:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 06:58:58 kjcf05n00 mcfcli[3673891]: %3|1730638738.043|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 06:59:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 06:59:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 06:59:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 06:59:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 06:59:16 kjcf05n02 fstonithd.py[15113]: Listening for kdump packets from partner Nov 3 06:59:17 kjcf05n00 mcfcli[3673891]: %3|1730638757.160|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:59:22 kjcf05n02 LCNmon[17891]: 10.16.100.53 is unreachable via ib0 Nov 3 06:59:22 kjcf05n02 LCNmon[17891]: 10.16.100.59 is unreachable via ib0 Nov 3 06:59:26 kjcf05n02 LCNmon[17891]: 10.16.100.53 is unreachable via ib1 Nov 3 06:59:26 kjcf05n02 LCNmon[17891]: 10.16.100.59 is unreachable via ib1 Nov 3 06:59:28 kjcf05n00 mcfcli[3673891]: %3|1730638768.216|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 06:59:34 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 06:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 06:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 06:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 06:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 06:59:54 kjcf05n00 mcfcli[3673891]: %3|1730638794.663|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 06:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 06:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 06:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 06:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 06:59:58 kjcf05n00 mcfcli[3673891]: %3|1730638798.217|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 07:00:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 07:00:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 07:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 07:00:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 07:00:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 07:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 07:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 07:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 07:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 07:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 07:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 07:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 07:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 07:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 07:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 07:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 07:00:01 kjcf05n02 dwd[5162]: nvme6n1 passed periodic SMART status check Nov 3 07:00:01 kjcf05n02 dwd[5162]: nvme22n1 passed periodic SMART status check Nov 3 07:00:01 kjcf05n02 dwd[5162]: nvme16n1 passed periodic SMART status check Nov 3 07:00:01 kjcf05n02 dwd[5162]: nvme15n1 passed periodic SMART status check Nov 3 07:00:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 07:00:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:00:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 07:00:02 kjcf05n02 dwd[5162]: nvme5n1 passed periodic SMART status check Nov 3 07:00:02 kjcf05n02 dwd[5162]: nvme10n1 passed periodic SMART status check Nov 3 07:00:02 kjcf05n02 dwd[5162]: nvme7n1 passed periodic SMART status check Nov 3 07:00:02 kjcf05n02 dwd[5162]: nvme21n1 passed periodic SMART status check Nov 3 07:00:02 kjcf05n02 dwd[5162]: nvme20n1 passed periodic SMART status check Nov 3 07:00:02 kjcf05n02 dwd[5162]: nvme11n1 passed periodic SMART status check Nov 3 07:00:02 kjcf05n02 dwd[5162]: nvme12n1 passed periodic SMART status check Nov 3 07:00:06 kjcf05n00 python3.9[1045921]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 07:00:15 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='39', client='AF_INET(172.16.2.6:36645)', local='AF_INET(0.0.0.0:601)' Nov 3 07:00:15 kjcf05n03 syslog-ng[3176]: Configuration reload request received, reloading configuration; Nov 3 07:00:15 kjcf05n03 syslog-ng[3176]: Configuration reload finished; Nov 3 07:00:15 kjcf05n03 syslog-ng[3176]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 07:00:15 kjcf05n03 dracut: dracut-049-135.git20210121.el8 Nov 3 07:00:15 kjcf05n03 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 07:00:15 kjcf05n03 dracut: Loading and integrity checking all crypto modules Nov 3 07:00:15 kjcf05n03 dracut: Self testing crypto algorithms Nov 3 07:00:15 kjcf05n03 dracut: rd.md=0: removing MD RAID activation Nov 3 07:00:15 kjcf05n03 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 07:00:15 kjcf05n03 Copying live image to RAM... Nov 3 07:00:15 kjcf05n03 (this may take a minute) Nov 3 07:00:15 kjcf05n03 Done copying live image to RAM. Nov 3 07:00:15 kjcf05n03 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 07:00:15 kjcf05n03 dracut: Checking integrity of kernel Nov 3 07:00:15 kjcf05n03 dracut: All initrd crypto checks done Nov 3 07:00:15 kjcf05n03 dracut: Switching root Nov 3 07:00:15 kjcf05n03 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 07:00:15 kjcf05n03 systemd: Detected architecture x86-64. Nov 3 07:00:15 kjcf05n03 systemd: Set hostname to . Nov 3 07:00:15 kjcf05n03 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 07:00:15 kjcf05n03 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 07:00:15 kjcf05n03 systemd: Listening on Journal Socket. Nov 3 07:00:15 kjcf05n03 systemd: Mounting Kernel Debug File System... Nov 3 07:00:15 kjcf05n03 systemd: Mounting /mnt... Nov 3 07:00:15 kjcf05n03 systemd: Mounting /WIBS... Nov 3 07:00:15 kjcf05n03 systemd: Listening on Device-mapper event daemon FIFOs. Nov 3 07:00:15 kjcf05n03 systemd-journald[1525]: Journal started Nov 3 07:00:15 kjcf05n03 systemd-journald[1525]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 07:00:15 kjcf05n03 systemd[1]: Mounted Kernel Debug File System. Nov 3 07:00:15 kjcf05n03 systemd[1]: Mounted /mnt. Nov 3 07:00:15 kjcf05n03 systemd[1]: Mounted /WIBS. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Create list of required static device nodes for the current kernel. Nov 3 07:00:15 kjcf05n03 systemd[1]: Mounted POSIX Message Queue File System. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 3 07:00:15 kjcf05n03 systemd-modules-load[1534]: Inserted module 'fuse' Nov 3 07:00:15 kjcf05n03 systemd[1]: Mounted Temporary Directory (/tmp). Nov 3 07:00:15 kjcf05n03 systemd[1]: Mounted /data. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Remount Root and Kernel File Systems. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Load Kernel Modules. Nov 3 07:00:15 kjcf05n03 systemd[1]: Mounted Huge Pages File System. Nov 3 07:00:15 kjcf05n03 systemd[1]: Mounting FUSE Control File System... Nov 3 07:00:15 kjcf05n03 systemd[1]: Mounting Kernel Configuration File System... Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Apply Kernel Variables... Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Rebuild Hardware Database... Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Create System Users... Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Load/Save Random Seed... Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 07:00:15 kjcf05n03 systemd[1]: Mounted FUSE Control File System. Nov 3 07:00:15 kjcf05n03 systemd[1]: Mounted Kernel Configuration File System. Nov 3 07:00:15 kjcf05n03 systemd-sysctl[1547]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 07:00:15 kjcf05n03 systemd-sysctl[1547]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Apply Kernel Variables. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Create System Users. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Load/Save Random Seed. Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 07:00:15 kjcf05n03 systemd-journald[1525]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 07:00:15 kjcf05n03 systemd-tmpfiles[1557]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 07:00:15 kjcf05n03 systemd-tmpfiles[1557]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started udev Coldplug all Devices. Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Rebuild Hardware Database. Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting udev Kernel Device Manager... Nov 3 07:00:15 kjcf05n03 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started udev Kernel Device Manager. Nov 3 07:00:15 kjcf05n03 systemd[1]: Found device /dev/ttyS0. Nov 3 07:00:15 kjcf05n03 systemd-udevd[1570]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:00:15 kjcf05n03 systemd-udevd[1630]: Using default interface naming scheme 'rhel-8.0'. Nov 3 07:00:15 kjcf05n03 systemd-udevd[1630]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:00:15 kjcf05n03 systemd-udevd[1614]: Using default interface naming scheme 'rhel-8.0'. Nov 3 07:00:15 kjcf05n03 systemd-udevd[1614]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:00:15 kjcf05n03 systemd-udevd[1620]: Using default interface naming scheme 'rhel-8.0'. Nov 3 07:00:15 kjcf05n03 systemd-udevd[1620]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 07:00:15 kjcf05n03 systemd[1]: Reached target Local File Systems (Pre). Nov 3 07:00:15 kjcf05n03 systemd[1]: Reached target Local File Systems. Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 07:00:15 kjcf05n03 systemd-tmpfiles[1785]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 07:00:15 kjcf05n03 systemd-tmpfiles[1785]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 07:00:15 kjcf05n03 systemd-tmpfiles[1785]: "/var/tmp" already exists and is not a directory. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Create Volatile Files and Directories. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Rebuild Journal Catalog. Nov 3 07:00:15 kjcf05n03 root[1816]: openibd: running in auto mode Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting RPC Bind... Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started RPC Bind. Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 07:00:15 kjcf05n03 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 07:00:15 kjcf05n03 systemd[1]: Started RDMA Node Description Daemon. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 07:00:15 kjcf05n03 systemd-modules-load[1873]: Inserted module 'ib_iser' Nov 3 07:00:15 kjcf05n03 systemd-modules-load[1873]: Inserted module 'ib_isert' Nov 3 07:00:15 kjcf05n03 systemd-modules-load[1873]: Inserted module 'ib_srpt' Nov 3 07:00:15 kjcf05n03 systemd-udevd[1629]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:00:15 kjcf05n03 systemd-udevd[1602]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:00:15 kjcf05n03 systemd-modules-load[1879]: Inserted module 'ib_ipoib' Nov 3 07:00:15 kjcf05n03 systemd-modules-load[1873]: Inserted module 'rdma_ucm' Nov 3 07:00:15 kjcf05n03 systemd-modules-load[1873]: Module 'svcrdma' is blacklisted Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 07:00:15 kjcf05n03 systemd-udevd[1629]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 07:00:15 kjcf05n03 systemd-udevd[1602]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 07:00:15 kjcf05n03 systemd-modules-load[1879]: Inserted module 'ib_umad' Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 07:00:15 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 07:00:15 kjcf05n03 systemd[3176]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:15 kjcf05n03 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 07:00:15 kjcf05n03 systemd[1]: Reached target Network (Pre). Nov 3 07:00:15 kjcf05n03 systemd[1]: Reached target RDMA Hardware. Nov 3 07:00:15 kjcf05n03 openibd[1801]: Loading HCA driver and Access Layer:[ OK ] Nov 3 07:00:15 kjcf05n03 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Update is Completed... Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Update is Completed. Nov 3 07:00:15 kjcf05n03 setup-icl[1769]: Setting LAN IP Address to 203.0.113.4 Nov 3 07:00:15 kjcf05n03 setup-icl[1769]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 07:00:15 kjcf05n03 setup-icl[1769]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 07:00:15 kjcf05n03 setup-icl[1769]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 07:00:15 kjcf05n03 systemd-udevd[1629]: Using default interface naming scheme 'rhel-8.0'. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 07:00:15 kjcf05n03 systemd[1]: Reached target System Initialization. Nov 3 07:00:15 kjcf05n03 systemd[1]: Listening on lldpad.socket. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 07:00:15 kjcf05n03 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 07:00:15 kjcf05n03 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 07:00:15 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 07:00:15 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 07:00:15 kjcf05n03 systemd[1]: Reached target Sockets. Nov 3 07:00:15 kjcf05n03 systemd[1]: Reached target Basic System. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started D-Bus System Message Bus. Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 0 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 1 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 2 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 3 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 4 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 5 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 6 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 7 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 8 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 9 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 10 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 11 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 12 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 13 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 14 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 15 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 16 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 17 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 18 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 19 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 20 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 21 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 22 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 23 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 24 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 25 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 26 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 27 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 28 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 29 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 30 Nov 3 07:00:15 kjcf05n03 cpupower[2121]: Setting cpu: 31 Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[2122]: Setting up Mellanox network interface: ib1 Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 07:00:15 kjcf05n03 mcelog[2134]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 07:00:15 kjcf05n03 mcelog[2134]: CPU is unsupported Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 07:00:15 kjcf05n03 systemd[1]: Started irqbalance daemon. Nov 3 07:00:15 kjcf05n03 dwd[2126]: dwd: vMay 29 2024 : 15:38:26 Nov 3 07:00:15 kjcf05n03 dwd[2126]: /usr/sbin/dwd -d --standalone=0 Nov 3 07:00:15 kjcf05n03 dwd[2126]: dwd: option Lethal: 0 Nov 3 07:00:15 kjcf05n03 dwd[2126]: dwd: option Interval: 60 Nov 3 07:00:15 kjcf05n03 dwd[2126]: dwd: option abrtlimit: 10 Nov 3 07:00:15 kjcf05n03 dwd[2126]: dwd: option DZPeriod: 604800 Nov 3 07:00:15 kjcf05n03 dwd[2126]: dwd: option SmartPeriod: 43200 Nov 3 07:00:15 kjcf05n03 dwd[2126]: dwd: option SDDEnabled: 1 Nov 3 07:00:15 kjcf05n03 dwd[2126]: dwd: option SDDAwaitScale: 3 Nov 3 07:00:15 kjcf05n03 dwd[2126]: dwd: option SDDAwaitMin: 100 Nov 3 07:00:15 kjcf05n03 dwd[2126]: dwd: option Verbosity: 1 Nov 3 07:00:15 kjcf05n03 dwd[2126]: dwd: option StandAlone: 0 Nov 3 07:00:15 kjcf05n03 dwd[2126]: option Lethal: 0 Nov 3 07:00:15 kjcf05n03 dwd[2126]: option Interval: 60 Nov 3 07:00:15 kjcf05n03 dwd[2126]: option abrtlimit: 10 Nov 3 07:00:15 kjcf05n03 dwd[2126]: option DZPeriod: 604800 Nov 3 07:00:15 kjcf05n03 dwd[2126]: option SmartPeriod: 43200 Nov 3 07:00:15 kjcf05n03 dwd[2126]: option SDDEnabled: 1 Nov 3 07:00:15 kjcf05n03 dwd[2126]: option SDDAwaitScale: 3 Nov 3 07:00:15 kjcf05n03 dwd[2126]: option SDDAwaitMin: 100 Nov 3 07:00:15 kjcf05n03 dwd[2126]: option Verbosity: 1 Nov 3 07:00:15 kjcf05n03 dwd[2126]: option StandAlone: 0 Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[2154]: Setting up Mellanox network interface: ib0 Nov 3 07:00:15 kjcf05n03 dbus-daemon[2124]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Name Service Cache Daemon... Nov 3 07:00:15 kjcf05n03 nscd[2212]: 2212 monitoring file `/etc/hosts` (1) Nov 3 07:00:15 kjcf05n03 nscd[2212]: 2212 monitoring directory `/etc` (2) Nov 3 07:00:15 kjcf05n03 nscd[2212]: 2212 monitoring file `/etc/resolv.conf` (3) Nov 3 07:00:15 kjcf05n03 nscd[2212]: 2212 monitoring directory `/etc` (2) Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[2194]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Resets System Activity Logs... Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[2221]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 07:00:15 kjcf05n03 network[2232]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[2234]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 07:00:15 kjcf05n03 chronyd[2264]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 07:00:15 kjcf05n03 network[2255]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 07:00:15 kjcf05n03 network[2232]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[2257]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[2261]: No configuration found for ib1 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 0 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 1 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 2 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 3 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 4 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 5 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 6 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 7 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 8 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 9 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 10 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 11 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 12 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 13 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 14 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 15 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 16 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 17 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 18 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 19 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 20 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 21 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 22 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 23 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 24 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 25 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 26 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 27 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 28 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 29 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 30 Nov 3 07:00:15 kjcf05n03 cpupower[2281]: Idlestate 2 disabled on CPU 31 Nov 3 07:00:15 kjcf05n03 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 07:00:15 kjcf05n03 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 07:00:15 kjcf05n03 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 07:00:15 kjcf05n03 mdraid-phy[2275]: no Cutlass to worry about Nov 3 07:00:15 kjcf05n03 beSetMlxConfig[2269]: ConnectX-3 multiport not detected Nov 3 07:00:15 kjcf05n03 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 07:00:15 kjcf05n03 network[2276]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:00:15 kjcf05n03 network[2232]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[2279]: No configuration found for ib0 Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Name Service Cache Daemon. Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[2286]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Resets System Activity Logs. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Manage Cutlass PHYs. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 07:00:15 kjcf05n03 network[2290]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[2295]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 07:00:15 kjcf05n03 chronyd[2264]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 07:00:15 kjcf05n03 chronyd[2264]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 07:00:15 kjcf05n03 mlnx_conf_mgr[2316]: INFO: No configurations found for mlx5_1, skipping. Nov 3 07:00:15 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 07:00:15 kjcf05n03 mlnx_conf_mgr[2353]: INFO: No configurations found for mlx5_0, skipping. Nov 3 07:00:15 kjcf05n03 beSetMlxConfig[2269]: Starting MST (Mellanox Software Tools) driver set Nov 3 07:00:15 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 07:00:15 kjcf05n03 beSetMlxConfig[2269]: Loading MST PCI module - Success Nov 3 07:00:15 kjcf05n03 beSetMlxConfig[2269]: Loading MST PCI configuration module - Success Nov 3 07:00:15 kjcf05n03 beSetMlxConfig[2269]: Create devices Nov 3 07:00:15 kjcf05n03 sssd[sssd][2262]: Starting up Nov 3 07:00:15 kjcf05n03 sssd[be[implicit_files]][2417]: Starting up Nov 3 07:00:15 kjcf05n03 sssd[nss][2514]: Starting up Nov 3 07:00:15 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 07:00:15 kjcf05n03 systemd[1]: Reached target User and Group Name Lookups. Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Login Service... Nov 3 07:00:15 kjcf05n03 python3.9[2123]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 07:00:15 kjcf05n03 python3.9[3176]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 07:00:15 kjcf05n03 systemd-logind[2612]: New seat seat0. Nov 3 07:00:15 kjcf05n03 systemd-logind[2612]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Login Service. Nov 3 07:00:15 kjcf05n03 systemd-sysctl[2779]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 07:00:15 kjcf05n03 systemd-sysctl[2779]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 07:00:15 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 07:00:15 kjcf05n03 python3.9[2817]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 07:00:15 kjcf05n03 python3.9[3176]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 07:00:15 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 07:00:15 kjcf05n03 network[2232]: Bringing up loopback interface: [ OK ] Nov 3 07:00:15 kjcf05n03 python3.9[3016]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 07:00:15 kjcf05n03 python3.9[3176]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 07:00:15 kjcf05n03 systemd-sysctl[3137]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 07:00:15 kjcf05n03 systemd-sysctl[3137]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 07:00:15 kjcf05n03 systemd[1]: Started LSB: Bring up/down networking. Nov 3 07:00:15 kjcf05n03 systemd[1]: Reached target Network. Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 07:00:15 kjcf05n03 systemd[1]: Reached target Network is Online. Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting System Logger Daemon... Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 07:00:15 kjcf05n03 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 07:00:15 kjcf05n03 sm-notify[3178]: Version 2.3.3 starting Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Notify NFS peers of a restart. Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 07:00:15 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 07:00:15 kjcf05n03 systemd[1]: Reached target NFS client services. Nov 3 07:00:15 kjcf05n03 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 07:00:15 kjcf05n03 systemd[1]: Reached target Remote File Systems. Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Permit User Sessions... Nov 3 07:00:15 kjcf05n03 lldpad[3174]: setsockopt nearest_bridge: Invalid argument Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Permit User Sessions. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Getty on tty1. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 07:00:15 kjcf05n03 lldpad[3174]: setsockopt nearest_bridge: Invalid argument Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 07:00:15 kjcf05n03 beSetMlxConfig[2269]: Unloading MST PCI module (unused) - Success Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Serial Getty on ttyS0. Nov 3 07:00:15 kjcf05n03 systemd[1]: Reached target Login Prompts. Nov 3 07:00:15 kjcf05n03 python3.9[3193]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 07:00:15 kjcf05n03 python3.9[3176]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 07:00:15 kjcf05n03 syslog-ng[3176]: [2024-11-03T12:59:02.162537] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 07:00:15 kjcf05n03 syslog-ng[3176]: [2024-11-03T12:59:02.162793] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 07:00:15 kjcf05n03 syslog-ng[3176]: [2024-11-03T12:59:02.162827] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 07:00:15 kjcf05n03 syslog-ng[3176]: [2024-11-03T12:59:02.163360] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 07:00:15 kjcf05n03 syslog-ng[3176]: [2024-11-03T12:59:02.163539] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 07:00:15 kjcf05n03 systemd[1]: Started System Logger Daemon. Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 07:00:15 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 07:00:15 kjcf05n03 python3.9[3428]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 07:00:15 kjcf05n03 python3.9[3176]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 07:00:15 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 07:00:15 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 07:00:15 kjcf05n03 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 07:00:15 kjcf05n03 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 07:00:15 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 07:00:15 kjcf05n03 sshd[3437]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 07:00:15 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 07:00:15 kjcf05n03 chronyd[2264]: System's initial offset : 0.003168 seconds slow of true (slew) Nov 3 07:00:15 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 07:00:15 kjcf05n03 beSetMlxConfig[2269]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 07:00:15 kjcf05n03 beSetMlxConfig[2269]: ib mode Nov 3 07:00:15 kjcf05n03 root[3455]: openibd: Set node_desc for mlx5_0: kjcf05n03 HCA-1 Nov 3 07:00:15 kjcf05n03 root[3457]: openibd: Set node_desc for mlx5_1: kjcf05n03 HCA-2 Nov 3 07:00:15 kjcf05n03 beSetMlxConfig[2269]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 07:00:15 kjcf05n03 beSetMlxConfig[2269]: ib mode Nov 3 07:00:15 kjcf05n03 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 07:00:15 kjcf05n03 systemd-udevd[3472]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:00:15 kjcf05n03 systemd-udevd[3473]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:00:15 kjcf05n03 systemd-udevd[3476]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:00:15 kjcf05n03 systemd-udevd[3477]: Using default interface naming scheme 'rhel-8.0'. Nov 3 07:00:15 kjcf05n03 systemd-udevd[3477]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:00:15 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 07:00:15 kjcf05n03 systemd[3176]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:15 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[3514]: Setting up Mellanox network interface: ib1 Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[3515]: Setting up Mellanox network interface: ib0 Nov 3 07:00:15 kjcf05n03 systemd-udevd[3474]: Using default interface naming scheme 'rhel-8.0'. Nov 3 07:00:15 kjcf05n03 systemd-udevd[3475]: Using default interface naming scheme 'rhel-8.0'. Nov 3 07:00:15 kjcf05n03 systemd-udevd[3474]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:00:15 kjcf05n03 systemd-udevd[3475]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Puppet agent... Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[3564]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[3565]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[3595]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[3596]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[3597]: No configuration found for ib1 Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[3598]: No configuration found for ib0 Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[3605]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[3606]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 07:00:15 kjcf05n03 mlnx_conf_mgr[3644]: INFO: No configurations found for mlx5_1, skipping. Nov 3 07:00:15 kjcf05n03 mlnx_conf_mgr[3646]: INFO: No configurations found for mlx5_0, skipping. Nov 3 07:00:15 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 07:00:15 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 07:00:15 kjcf05n03 systemd[1]: Stopping Command Scheduler... Nov 3 07:00:15 kjcf05n03 systemd[1]: crond.service: Succeeded. Nov 3 07:00:15 kjcf05n03 systemd[1]: Stopped Command Scheduler. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 07:00:15 kjcf05n03 systemd[1]: Stopping Job spooling tools... Nov 3 07:00:15 kjcf05n03 systemd[1]: atd.service: Succeeded. Nov 3 07:00:15 kjcf05n03 systemd[1]: Stopped Job spooling tools. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 07:00:15 kjcf05n03 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 07:00:15 kjcf05n03 lldpad[3174]: init_ports: Error adding device ib0 Nov 3 07:00:15 kjcf05n03 lldpad[3174]: init_ports: Error adding device ib1 Nov 3 07:00:15 kjcf05n03 lldpad[3174]: Signal 15 received - terminating Nov 3 07:00:15 kjcf05n03 systemd[1]: lldpad.service: Succeeded. Nov 3 07:00:15 kjcf05n03 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 07:00:15 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 07:00:15 kjcf05n03 systemd[1]: lldpad.socket: Succeeded. Nov 3 07:00:15 kjcf05n03 systemd[1]: Closed lldpad.socket. Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 07:00:15 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting IPMI Driver... Nov 3 07:00:15 kjcf05n03 systemd[1]: Started IPMI Driver. Nov 3 07:00:15 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:15 kjcf05n03 systemd[3176]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:15 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Ipmievd Daemon... Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 1 | Nov-03-2024 | 11:59:25 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 2 | Nov-03-2024 | 12:00:17 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 3 | Nov-03-2024 | 12:00:18 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 4 | Nov-03-2024 | 12:01:24 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 5 | Nov-03-2024 | 12:01:24 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 6 | Nov-03-2024 | 12:55:08 | Sensor #0 (Generator ID 21h) | Memory | Assertion Event | Correctable memory error ; OEM Event Data2 code = 30h ; OEM Event Data3 code = 00h Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 7 | Nov-03-2024 | 12:56:21 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 8 | Nov-03-2024 | 12:56:21 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 9 | Nov-03-2024 | 12:56:21 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 10 | Nov-03-2024 | 12:56:21 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 11 | Nov-03-2024 | 12:56:21 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 12 | Nov-03-2024 | 12:56:21 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 13 | Nov-03-2024 | 12:56:21 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 14 | Nov-03-2024 | 12:56:21 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 15 | Nov-03-2024 | 12:56:21 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 16 | Nov-03-2024 | 12:56:21 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 17 | Nov-03-2024 | 12:56:21 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 18 | Nov-03-2024 | 12:56:21 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 19 | Nov-03-2024 | 12:56:21 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 20 | Nov-03-2024 | 12:56:21 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 21 | Nov-03-2024 | 12:56:21 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 22 | Nov-03-2024 | 12:56:21 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 23 | Nov-03-2024 | 12:56:21 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 24 | Nov-03-2024 | 12:56:21 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 25 | Nov-03-2024 | 12:56:21 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 26 | Nov-03-2024 | 12:56:21 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 27 | Nov-03-2024 | 12:56:21 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 28 | Nov-03-2024 | 12:56:21 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 29 | Nov-03-2024 | 12:56:22 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 30 | Nov-03-2024 | 12:56:22 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 31 | Nov-03-2024 | 12:56:22 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 32 | Nov-03-2024 | 12:56:22 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 33 | Nov-03-2024 | 12:56:22 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 34 | Nov-03-2024 | 12:56:22 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 35 | Nov-03-2024 | 12:56:22 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 36 | Nov-03-2024 | 12:56:22 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 37 | Nov-03-2024 | 12:56:22 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 38 | Nov-03-2024 | 12:56:22 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 39 | Nov-03-2024 | 12:56:52 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 40 | Nov-03-2024 | 12:56:52 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 41 | Nov-03-2024 | 12:56:52 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 42 | Nov-03-2024 | 12:56:52 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 43 | Nov-03-2024 | 12:56:52 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 44 | Nov-03-2024 | 12:56:52 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 45 | Nov-03-2024 | 12:56:52 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 46 | Nov-03-2024 | 12:56:52 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 47 | Nov-03-2024 | 12:56:52 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 48 | Nov-03-2024 | 12:56:52 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 49 | Nov-03-2024 | 12:56:52 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 50 | Nov-03-2024 | 12:56:52 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 51 | Nov-03-2024 | 12:56:52 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 52 | Nov-03-2024 | 12:56:52 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 53 | Nov-03-2024 | 12:56:52 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 54 | Nov-03-2024 | 12:56:52 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 55 | Nov-03-2024 | 12:56:52 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 56 | Nov-03-2024 | 12:56:52 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 57 | Nov-03-2024 | 12:56:52 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 58 | Nov-03-2024 | 12:56:52 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 59 | Nov-03-2024 | 12:56:52 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 60 | Nov-03-2024 | 12:56:52 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 61 | Nov-03-2024 | 12:56:54 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 62 | Nov-03-2024 | 12:56:54 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 63 | Nov-03-2024 | 12:56:54 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 64 | Nov-03-2024 | 12:56:54 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 65 | Nov-03-2024 | 12:56:54 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 66 | Nov-03-2024 | 12:56:54 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 67 | Nov-03-2024 | 12:56:54 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 68 | Nov-03-2024 | 12:56:54 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 69 | Nov-03-2024 | 12:56:54 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3989]: 70 | Nov-03-2024 | 12:56:54 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:00:15 kjcf05n03 ipmievd[3994]: Reading sensors... Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Ipmievd Daemon. Nov 3 07:00:15 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:15 kjcf05n03 systemd[3176]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 07:00:15 kjcf05n03 nscd[2212]: 2212 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 07:00:15 kjcf05n03 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 07:00:15 kjcf05n03 systemd[1]: Stopped Set Mellanox configuration. Nov 3 07:00:15 kjcf05n03 systemd[1]: Stopping Set Mellanox configuration... Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 07:00:15 kjcf05n03 beSetMlxConfig[4050]: ConnectX-3 multiport not detected Nov 3 07:00:15 kjcf05n03 beSetMlxConfig[4050]: Starting MST (Mellanox Software Tools) driver set Nov 3 07:00:15 kjcf05n03 beSetMlxConfig[4050]: Loading MST PCI module - Success Nov 3 07:00:15 kjcf05n03 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 07:00:15 kjcf05n03 beSetMlxConfig[4050]: [warn] mst_pciconf is already loaded, skipping Nov 3 07:00:15 kjcf05n03 beSetMlxConfig[4050]: Create devices Nov 3 07:00:15 kjcf05n03 beSetMlxConfig[4050]: Unloading MST PCI module (unused) - Success Nov 3 07:00:15 kjcf05n03 ipmievd[3994]: Waiting for events... Nov 3 07:00:15 kjcf05n03 beSetMlxConfig[4050]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 07:00:15 kjcf05n03 beSetMlxConfig[4050]: ib mode Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 07:00:15 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 07:00:15 kjcf05n03 beSetMlxConfig[4050]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 07:00:15 kjcf05n03 beSetMlxConfig[4050]: ib mode Nov 3 07:00:15 kjcf05n03 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 07:00:15 kjcf05n03 systemd-udevd[4954]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:00:15 kjcf05n03 systemd-udevd[4955]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:00:15 kjcf05n03 systemd-udevd[4958]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:00:15 kjcf05n03 systemd-udevd[4960]: Using default interface naming scheme 'rhel-8.0'. Nov 3 07:00:15 kjcf05n03 systemd-udevd[4960]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:00:15 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 07:00:15 kjcf05n03 systemd[3176]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:15 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[4996]: Setting up Mellanox network interface: ib0 Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[4997]: Setting up Mellanox network interface: ib1 Nov 3 07:00:15 kjcf05n03 systemd-udevd[4956]: Using default interface naming scheme 'rhel-8.0'. Nov 3 07:00:15 kjcf05n03 systemd-udevd[4956]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[5046]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[5047]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[5061]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[5063]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[5064]: No configuration found for ib1 Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[5065]: No configuration found for ib0 Nov 3 07:00:15 kjcf05n03 systemd-udevd[4957]: Using default interface naming scheme 'rhel-8.0'. Nov 3 07:00:15 kjcf05n03 systemd-udevd[4957]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[5069]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 07:00:15 kjcf05n03 mlnx_interface_mgr[5073]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 07:00:15 kjcf05n03 mlnx_conf_mgr[5124]: INFO: No configurations found for mlx5_1, skipping. Nov 3 07:00:15 kjcf05n03 mlnx_conf_mgr[5128]: INFO: No configurations found for mlx5_0, skipping. Nov 3 07:00:15 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 07:00:15 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}2599ec4991ff4646f0876d0d380ef3086b44a2f72335fe2ef0e90a66d7c30490' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}2599ec4991ff4646f0876d0d380ef3086b44a2f72335fe2ef0e90a66d7c30490' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}aa58629cef5dd35fc50edc85aabeb9d021ba021e061f7c5571f6af16b584992d' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}aa58629cef5dd35fc50edc85aabeb9d021ba021e061f7c5571f6af16b584992d' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}937e466a1b824708379ffc7b9addfde0bb96318f0bc97cae2ed238bb202e19fa' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}937e466a1b824708379ffc7b9addfde0bb96318f0bc97cae2ed238bb202e19fa' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}2248ce692ea9131d485ef983d15535a96ee6f44b845e233594af60f99ba27d07' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}2248ce692ea9131d485ef983d15535a96ee6f44b845e233594af60f99ba27d07' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 07:00:15 kjcf05n03 systemd[1]: Stopping NTP client/server... Nov 3 07:00:15 kjcf05n03 chronyd[2264]: chronyd exiting Nov 3 07:00:15 kjcf05n03 systemd[1]: chronyd.service: Succeeded. Nov 3 07:00:15 kjcf05n03 systemd[1]: Stopped NTP client/server. Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 07:00:15 kjcf05n03 chronyd[5162]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 07:00:15 kjcf05n03 chronyd[5162]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 07:00:15 kjcf05n03 chronyd[5162]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 07:00:15 kjcf05n03 chronyd[5162]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 07:00:15 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 07:00:15 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:15 kjcf05n03 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 07:00:15 kjcf05n03 systemd[1]: dwd.service: Succeeded. Nov 3 07:00:15 kjcf05n03 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 07:00:15 kjcf05n03 dwd[5194]: dwd: vMay 29 2024 : 15:38:26 Nov 3 07:00:15 kjcf05n03 dwd[5194]: /usr/sbin/dwd -i 15 -d Nov 3 07:00:15 kjcf05n03 dwd[5194]: dwd: option Lethal: 0 Nov 3 07:00:15 kjcf05n03 dwd[5194]: dwd: option Interval: 15 Nov 3 07:00:15 kjcf05n03 dwd[5194]: dwd: option abrtlimit: 10 Nov 3 07:00:15 kjcf05n03 dwd[5194]: dwd: option DZPeriod: 604800 Nov 3 07:00:15 kjcf05n03 dwd[5194]: dwd: option SmartPeriod: 43200 Nov 3 07:00:15 kjcf05n03 dwd[5194]: dwd: option SDDEnabled: 1 Nov 3 07:00:15 kjcf05n03 dwd[5194]: dwd: option SDDAwaitScale: 3 Nov 3 07:00:15 kjcf05n03 dwd[5194]: dwd: option SDDAwaitMin: 100 Nov 3 07:00:15 kjcf05n03 dwd[5194]: dwd: option Verbosity: 1 Nov 3 07:00:15 kjcf05n03 dwd[5194]: dwd: option StandAlone: 0 Nov 3 07:00:15 kjcf05n03 dwd[5194]: option Lethal: 0 Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 07:00:15 kjcf05n03 dwd[5194]: option Interval: 15 Nov 3 07:00:15 kjcf05n03 dwd[5194]: option abrtlimit: 10 Nov 3 07:00:15 kjcf05n03 dwd[5194]: option DZPeriod: 604800 Nov 3 07:00:15 kjcf05n03 dwd[5194]: option SmartPeriod: 43200 Nov 3 07:00:15 kjcf05n03 dwd[5194]: option SDDEnabled: 1 Nov 3 07:00:15 kjcf05n03 dwd[5194]: option SDDAwaitScale: 3 Nov 3 07:00:15 kjcf05n03 dwd[5194]: option SDDAwaitMin: 100 Nov 3 07:00:15 kjcf05n03 dwd[5194]: option Verbosity: 1 Nov 3 07:00:15 kjcf05n03 dwd[5194]: option StandAlone: 0 Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 07:00:15 kjcf05n03 dwd[5195]: option Lethal now set to 1 Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 07:00:15 kjcf05n03 dwd[5195]: option abrtlimit now set to 1 Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 07:00:15 kjcf05n03 dwd[5195]: option SmartPeriod now set to 86400 Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 07:00:15 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 07:00:15 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Discard unused blocks. Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:15 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 07:00:15 kjcf05n03 python3.9[5224]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 07:00:15 kjcf05n03 python3.9[3176]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:15 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Periodic ZFS scrub. Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:15 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 07:00:15 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:15 kjcf05n03 systemd[1]: Starting Sed Control Plane worker process... Nov 3 07:00:15 kjcf05n03 sedcpwrkr[5363]: Using config script: /etc/sedcpwrkr.conf Nov 3 07:00:15 kjcf05n03 sedcpwrkr[5363]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 07:00:15 kjcf05n03 sedcpwrkr[5363]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 07:00:15 kjcf05n03 sedcpwrkr[5363]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 07:00:15 kjcf05n03 sedcpwrkr[5363]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 07:00:15 kjcf05n03 sedcpwrkr[5363]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 07:00:15 kjcf05n03 sedcpwrkr[5363]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 07:00:15 kjcf05n03 sedcpwrkr-server[5394]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 07:00:15 kjcf05n03 sedcpwrkr[5363]: celery multi v5.2.7 (dawn-chorus) Nov 3 07:00:15 kjcf05n03 sedcpwrkr[5363]: > Starting nodes... Nov 3 07:00:15 kjcf05n03 sedcpwrkr[5363]: > sedcpwrkr@kjcf05n03: OK Nov 3 07:00:15 kjcf05n03 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 07:00:15 kjcf05n03 sedcpwrkr-server[5396]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 07:00:15 kjcf05n03 sedcpwrkr-server[5396]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 07:00:15 kjcf05n03 sedcpwrkr-server[5396]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 07:00:15 kjcf05n03 systemd[1]: Started Sed Control Plane worker process. Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 07:00:15 kjcf05n03 systemd[1]: Reloading System Logger Daemon. Nov 3 07:00:15 kjcf05n03 systemd[1]: Reloaded System Logger Daemon. Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 07:00:15 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 07:00:15 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 07:00:16 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:16 kjcf05n03 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 07:00:16 kjcf05n03 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 07:00:16 kjcf05n03 iptables.init[5463]: iptables: Applying firewall rules: [ OK ] Nov 3 07:00:16 kjcf05n03 systemd[1]: Started IPv4 firewall with iptables. Nov 3 07:00:16 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:16 kjcf05n03 systemd[3176]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:16 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 07:00:17 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 07:00:17 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 07:00:17 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:17 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 07:00:17 kjcf05n03 systemd[1]: openhpid.service: Supervising process 5561 which is not our child. We'll most likely not notice when it exits. Nov 3 07:00:17 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 07:00:17 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:18 kjcf05n03 openhpid[5561]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 07:00:18 kjcf05n03 openhpid[5561]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 07:00:18 kjcf05n03 openhpid[5561]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 07:00:18 kjcf05n03 openhpid[5561]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 07:00:18 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:18 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:18 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:18 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 07:00:18 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 07:00:18 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 07:00:18 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 07:00:18 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:18 kjcf05n03 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 07:00:19 kjcf05n03 dcs-collectord[5652]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 07:00:19 kjcf05n03 hpi.inv.log[5652]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 07:00:19 kjcf05n03 dcs-collectord[5652]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 07:00:19 kjcf05n03 dcs-collectord[5652]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 07:00:19 kjcf05n03 dcs-collector[5643]: Starting dcs-collector:[ OK ] Nov 3 07:00:19 kjcf05n03 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 07:00:19 kjcf05n03 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 07:00:19 kjcf05n03 dcs-collectord[5655]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 07:00:19 kjcf05n03 dcs-collectord[5655]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 07:00:19 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 07:00:19 kjcf05n03 dcs-collectord[5655]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 07:00:19 kjcf05n03 dcs-collectord[5655]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 07:00:19 kjcf05n03 dcs-collectord[5655]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 07:00:19 kjcf05n03 dcs-collectord[5655]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 07:00:19 kjcf05n03 dcs-collectord[5655]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259340200", "units": "kB"}, {"name": "MemAvailable", "value": "258619844", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821328", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1687096", "units": "kB"}, {"name": "Inactive", "value": "963856", "units": "kB"}, {"name": "Active(anon)", "value": "1520776", "units": "kB"}, {"name": "Inactive(anon)", "value": "827848", "units": "kB"}, {"name": "Active(file)", "value": "166320", "units": "kB"}, {"name": "Inactive(file)", "value": "136008", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "755332", "units": "kB"}, {"name": "Mapped", "value": "86048", "units": "kB"}, {"name": "Shmem", "value": "1593452", "units": "kB"}, {"name": "KReclaimable", "value": "109124", "units": "kB"}, {"name": "Slab", "value": "276232", "units": "kB"}, {"name": "SReclaimable", "value": "109124", "units": "kB"}, {"name": "SUnreclaim", "value": "167108", "units": "kB"}, {"name": "KernelStack", "value": "9792", "units": "kB"}, {"name": "PageTables", "value": "19836", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3317304", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11136", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "6144", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "307528", "units": "kB"}, {"name": "DirectMap2M", "value": "19480576", "units": "kB"}, {"name": "DirectMap1G", "value": "248512512", "units": "kB"}]}' Nov 3 07:00:19 kjcf05n03 dcs-collectord[5655]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 07:00:19 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:19 kjcf05n03 dcs-collectord[5655]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 07:00:19 kjcf05n03 dcs-collectord[5655]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730638818.8869228], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730638819.1219866], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730638818.8204665, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 07:00:19 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:19 kjcf05n03 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 07:00:19 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:19 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:19 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 07:00:19 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 07:00:19 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 07:00:19 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 07:00:19 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:19 kjcf05n03 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 07:00:19 kjcf05n03 firmware-update-orc[5761]: Using config script: /etc/firmware_update_orc.conf Nov 3 07:00:19 kjcf05n03 firmware-update-orc[5761]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 07:00:19 kjcf05n03 firmware-update-orc[5761]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 07:00:19 kjcf05n03 firmware-update-orc[5761]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 07:00:19 kjcf05n03 firmware-update-orc[5761]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 07:00:19 kjcf05n03 firmware-update-orc[5761]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 07:00:19 kjcf05n03 firmware-update-orc[5761]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 07:00:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730638819', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 07:00:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730638819'} Nov 3 07:00:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:00:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730638515', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 07:00:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730638515'} Nov 3 07:00:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:00:20 kjcf05n03 firmware-update-orc-server[5797]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 07:00:20 kjcf05n03 firmware-update-orc[5761]: celery multi v5.2.7 (dawn-chorus) Nov 3 07:00:20 kjcf05n03 firmware-update-orc[5761]: > Starting nodes... Nov 3 07:00:20 kjcf05n03 firmware-update-orc[5761]: > worker1@kjcf05n03: OK Nov 3 07:00:20 kjcf05n03 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 07:00:20 kjcf05n03 firmware-update-orc-server[5801]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 07:00:20 kjcf05n03 firmware-update-orc-server[5801]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 07:00:20 kjcf05n03 firmware-update-orc-server[5801]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 07:00:20 kjcf05n03 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 07:00:20 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:20 kjcf05n03 systemd[3176]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:20 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:20 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:20 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 07:00:20 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 07:00:20 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 07:00:20 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 07:00:20 kjcf05n03 dbus-daemon[2124]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 07:00:20 kjcf05n03 dbus-daemon[2124]: [system] Reloaded configuration Nov 3 07:00:20 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 07:00:20 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 07:00:20 kjcf05n03 dbus-daemon[2124]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 07:00:20 kjcf05n03 dbus-daemon[2124]: [system] Reloaded configuration Nov 3 07:00:20 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 07:00:20 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 07:00:20 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 07:00:20 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 07:00:20 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:21 kjcf05n03 systemd[1]: Starting Manages hardware resources... Nov 3 07:00:21 kjcf05n03 ras-resource-manager-agent[5917]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 07:00:21 kjcf05n03 ras-resource-manager-agent[5903]: Starting ras-resource-manager-agent:[ OK ] Nov 3 07:00:21 kjcf05n03 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 07:00:21 kjcf05n03 ras-resource-manager-agent[5919]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 07:00:21 kjcf05n03 ras-resource-manager-client[5919]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 07:00:21 kjcf05n03 systemd[1]: Started Manages hardware resources. Nov 3 07:00:21 kjcf05n03 ras-resource-manager-client[5919]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 07:00:21 kjcf05n03 ras-resource-manager-client[5929]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 07:00:21 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:22 kjcf05n02 LCNmon[17891]: 10.16.100.53 is unreachable via ib0 Nov 3 07:00:22 kjcf05n02 LCNmon[17891]: 10.16.100.59 is unreachable via ib0 Nov 3 07:00:22 kjcf05n03 systemd[3176]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:22 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:22 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:22 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 07:00:22 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 07:00:22 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:22 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 07:00:22 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:23 kjcf05n03 systemd[3176]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: Press Ctrl+C to exit. Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: Plugin support version 1.0 Nov 3 07:00:23 kjcf05n03 zabbix_agent2[6003]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 07:00:23 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:23 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:23 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:23 kjcf05n03 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 07:00:23 kjcf05n03 dcs-notification-sender[6079]: dcs-notification-senderd is stopped Nov 3 07:00:23 kjcf05n03 zabbix-agent2[6093]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 07:00:23 kjcf05n03 dcs-notification-sender[6079]: Starting notification-sender:[ OK ] Nov 3 07:00:23 kjcf05n03 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 07:00:23 kjcf05n03 zabbix-agent2[6099]: INFO DCS notification agent started. (agent.py:61) Nov 3 07:00:23 kjcf05n03 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 07:00:23 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:24 kjcf05n03 systemd[3176]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:24 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:24 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:24 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:24 kjcf05n03 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 07:00:24 kjcf05n03 dcs-collectord[6198]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 07:00:24 kjcf05n03 dcs-collectord[6198]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 07:00:24 kjcf05n03 dcs-bulk-data-sender[6198]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 07:00:24 kjcf05n03 dcs-bulk-data-sender[6189]: Starting bulk-data-sender:[ OK ] Nov 3 07:00:24 kjcf05n03 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 07:00:24 kjcf05n03 dcs-collectord[6200]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 07:00:24 kjcf05n03 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 07:00:24 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:25 kjcf05n03 systemd[3176]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:25 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:25 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:25 kjcf05n03 nscd[2212]: 2212 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 07:00:25 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 07:00:25 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 07:00:25 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 07:00:25 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 07:00:25 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 07:00:25 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 07:00:25 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 07:00:25 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 07:00:25 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 07:00:25 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 07:00:25 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 07:00:25 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 07:00:25 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 07:00:25 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 07:00:25 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 07:00:25 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 07:00:25 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 07:00:25 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 07:00:26 kjcf05n03 systemd[1]: Stopping System Security Services Daemon... Nov 3 07:00:26 kjcf05n03 sssd[nss][2514]: Shutting down (status = 0) Nov 3 07:00:26 kjcf05n03 sssd[be[implicit_files]][2417]: Shutting down (status = 0) Nov 3 07:00:26 kjcf05n03 systemd[1]: sssd.service: Succeeded. Nov 3 07:00:26 kjcf05n03 systemd[1]: Stopped System Security Services Daemon. Nov 3 07:00:26 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 07:00:26 kjcf05n02 LCNmon[17891]: 10.16.100.53 is unreachable via ib1 Nov 3 07:00:26 kjcf05n02 LCNmon[17891]: 10.16.100.59 is unreachable via ib1 Nov 3 07:00:26 kjcf05n03 sssd[sssd][6268]: Starting up Nov 3 07:00:26 kjcf05n03 sssd[be[implicit_files]][6281]: Starting up Nov 3 07:00:26 kjcf05n03 python3.9[5224]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 07:00:26 kjcf05n03 python3.9[3176]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:26 kjcf05n03 sssd[nss][6282]: Starting up Nov 3 07:00:26 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 07:00:26 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 07:00:26 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 07:00:27 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 07:00:27 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 07:00:27 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 07:00:27 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 07:00:27 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 07:00:27 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 07:00:27 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure) defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 07:00:27 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure: defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 07:00:27 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure) defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 07:00:27 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure: defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 07:00:27 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 07:00:27 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 07:00:27 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 07:00:27 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 07:00:27 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:00:27 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:00:27 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:27 kjcf05n03 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 07:00:28 kjcf05n03 icinga2[6331]: [2024-11-03 07:00:27 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 07:00:28 kjcf05n03 icinga2[6331]: [2024-11-03 07:00:27 -0600] information/cli: Loading configuration file(s). Nov 3 07:00:28 kjcf05n03 icinga2[6331]: [2024-11-03 07:00:27 -0600] information/ConfigItem: Committing config item(s). Nov 3 07:00:28 kjcf05n03 icinga2[6331]: [2024-11-03 07:00:28 -0600] information/ApiListener: My API identity: kjcf05n03 Nov 3 07:00:28 kjcf05n03 icinga2[6331]: [2024-11-03 07:00:28 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 07:00:28 kjcf05n03 icinga2[6331]: [2024-11-03 07:00:28 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 07:00:28 kjcf05n03 icinga2[6331]: [2024-11-03 07:00:28 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 07:00:28 kjcf05n03 icinga2[6331]: [2024-11-03 07:00:28 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 07:00:28 kjcf05n03 icinga2[6331]: [2024-11-03 07:00:28 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 07:00:28 kjcf05n03 icinga2[6331]: [2024-11-03 07:00:28 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 07:00:28 kjcf05n03 icinga2[6331]: [2024-11-03 07:00:28 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 07:00:28 kjcf05n03 icinga2[6331]: [2024-11-03 07:00:28 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 07:00:28 kjcf05n03 icinga2[6331]: [2024-11-03 07:00:28 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 07:00:28 kjcf05n03 icinga2[6331]: [2024-11-03 07:00:28 -0600] information/cli: Closing console log. Nov 3 07:00:28 kjcf05n03 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 07:00:28 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:28 kjcf05n00 mcfcli[3673891]: %3|1730638828.218|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 07:00:28 kjcf05n03 systemd[3176]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:28 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:28 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:29 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 07:00:29 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 07:00:29 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:29 kjcf05n03 systemd[1]: Started Icinga2 network monitor. Nov 3 07:00:29 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:29 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 07:00:29 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:29 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:30 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 07:00:30 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 07:00:30 kjcf05n03 dcs-bulk-data-sender[6200]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 07:00:30 kjcf05n03 dcs-collectord[6200]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 07:00:30 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 07:00:30 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 07:00:30 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 07:00:30 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 07:00:30 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 07:00:30 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 07:00:30 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 07:00:30 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 07:00:30 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 07:00:30 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 07:00:30 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 07:00:30 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 07:00:30 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:30 kjcf05n03 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 07:00:30 kjcf05n03 nslcd[6947]: version 0.9.9 starting Nov 3 07:00:30 kjcf05n03 nslcd[6947]: accepting connections Nov 3 07:00:30 kjcf05n03 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 07:00:30 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:31 kjcf05n03 systemd[3176]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:31 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:31 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:31 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 07:00:31 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 07:00:31 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 07:00:31 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 07:00:31 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n03": interface became available Nov 3 07:00:32 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 07:00:32 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 07:00:32 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 07:00:32 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 07:00:32 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:32 kjcf05n03 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 07:00:32 kjcf05n00 zabbix_server[15650]: item "kjcf05n03:vfs.fs.size[/mnt/persistent_ha_data,used]" became not supported: no such file or directory Nov 3 07:00:32 kjcf05n03 dearcpw[7051]: Using config script: /etc/dearcpw.conf Nov 3 07:00:32 kjcf05n03 dearcpw[7051]: - Creating default directory: '/var/log/dearcpw' Nov 3 07:00:32 kjcf05n03 dearcpw[7051]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 07:00:32 kjcf05n03 dearcpw[7051]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 07:00:32 kjcf05n03 dearcpw[7051]: - Creating default directory: '/var/run/dearcpw' Nov 3 07:00:32 kjcf05n03 dearcpw[7051]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 07:00:32 kjcf05n03 dearcpw[7051]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 07:00:32 kjcf05n00 mcfcli[3673891]: %3|1730638832.520|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:00:33 kjcf05n03 dearcpw-server[7091]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 07:00:33 kjcf05n03 dearcpw[7051]: celery multi v5.2.7 (dawn-chorus) Nov 3 07:00:33 kjcf05n03 dearcpw[7051]: > Starting nodes... Nov 3 07:00:33 kjcf05n03 dearcpw[7051]: > dearcpw@kjcf05n03: OK Nov 3 07:00:33 kjcf05n03 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 07:00:33 kjcf05n03 dearcpw-server[7093]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 07:00:33 kjcf05n03 dearcpw-server[7093]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 07:00:33 kjcf05n03 dearcpw-server[7093]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 07:00:33 kjcf05n03 systemd[1]: Started DEAR Control Plane worker process. Nov 3 07:00:33 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:33 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:33 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 07:00:33 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 07:00:33 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 07:00:33 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 07:00:33 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 07:00:33 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 07:00:33 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 07:00:33 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 07:00:33 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 07:00:33 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 07:00:33 kjcf05n00 zabbix_server[15650]: item "kjcf05n03:vfs.fs.size[/mnt/persistent_ha_data,total]" became not supported: no such file or directory Nov 3 07:00:33 kjcf05n00 zabbix_server[15650]: item "kjcf05n03:vfs.fs.inode[/mnt/persistent_ha_data,pfree]" became not supported: no such file or directory Nov 3 07:00:33 kjcf05n00 zabbix_server[15650]: item "kjcf05n03:vfs.fs.size[/mnt/persistent_ha_data,pused]" became not supported: no such file or directory Nov 3 07:00:33 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:60610). Nov 3 07:00:33 kjcf05n01 rsyncd[2955725]: connect from kjcf05n03 (172.16.2.6) Nov 3 07:00:33 kjcf05n01 rsyncd[2955725]: rsync to puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 07:00:33 kjcf05n01 rsyncd[2955725]: receiving file list Nov 3 07:00:33 kjcf05n01 rsyncd[2955725]: sent 29 bytes received 325 bytes total size 10901 Nov 3 07:00:33 kjcf05n01 systemd[1]: rsyncd@606-172.16.2.2:873-172.16.2.6:60610.service: Succeeded. Nov 3 07:00:33 kjcf05n03 puppet[7134]: IEC: 017000000: Node is up and running: { "node": "kjcf05n03" } Nov 3 07:00:33 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 07:00:33 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 07:00:33 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 07:00:33 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 07:00:33 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 07:00:33 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 07:00:33 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 07:00:33 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 07:00:34 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 07:00:34 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 07:00:34 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 07:00:34 kjcf05n03 dcs-collectord[5655]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 07:00:34 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 07:00:34 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 07:00:34 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 07:00:34 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 07:00:34 kjcf05n00 zabbix-server[1046477]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:00:34 kjcf05n00 zabbix-server[1046477]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n03 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n03:system.uptime): 00:02:28\\"}}"' Nov 3 07:00:34 kjcf05n00 log_interesting_event.py[1046477]: Event '45903' acknowledged Nov 3 07:00:34 kjcf05n00 zabbix-server[1046478]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:00:34 kjcf05n00 zabbix-server[1046478]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 3 07:00:35 kjcf05n00 log_interesting_event.py[1046478]: Event '45908' acknowledged Nov 3 07:00:35 kjcf05n00 zabbix-server[1046479]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:00:35 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 07:00:35 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 07:00:35 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 07:00:35 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 07:00:35 kjcf05n00 zabbix-server[1046479]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 3 07:00:35 kjcf05n00 log_interesting_event.py[1046479]: Event '45920' acknowledged Nov 3 07:00:36 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 07:00:36 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 07:00:36 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 07:00:36 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 07:00:36 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 07:00:36 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 07:00:36 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:37 kjcf05n03 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 07:00:37 kjcf05n03 diskless-swap[7616]: HA_PS_000: recovering journal Nov 3 07:00:37 kjcf05n03 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 07:00:37 kjcf05n03 diskless-swap[7616]: HA_PS_000: clean, 2268/6400 files, 7035/25600 blocks Nov 3 07:00:37 kjcf05n03 diskless-swap[7616]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 07:00:37 kjcf05n03 diskless-swap[7616]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 07:00:37 kjcf05n03 diskless-swap[7616]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 07:00:37 kjcf05n03 diskless-swap[7616]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 07:00:37 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 07:00:37 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:37 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:37 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 07:00:37 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 07:00:37 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 07:00:37 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 07:00:37 kjcf05n03 systemd[1]: Stopping OpenSSH server daemon... Nov 3 07:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 07:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 07:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 07:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 07:00:37 kjcf05n03 systemd[1]: sshd.service: Succeeded. Nov 3 07:00:37 kjcf05n03 systemd[1]: Stopped OpenSSH server daemon. Nov 3 07:00:37 kjcf05n03 systemd[1]: Stopped target sshd-keygen.target. Nov 3 07:00:37 kjcf05n03 systemd[1]: Stopping sshd-keygen.target. Nov 3 07:00:37 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 07:00:37 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 07:00:37 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 07:00:37 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 07:00:37 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 07:00:37 kjcf05n03 ipmievd[3994]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 07:00:37 kjcf05n03 ipmievd[3994]: System Event sensor - Timestamp Clock Sync Nov 3 07:00:38 kjcf05n03 ipmievd[3176]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:38 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 07:00:38 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 07:00:37 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 07:00:38 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 07:00:38 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 07:00:38 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 07:00:38 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 07:00:39 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 07:00:39 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 07:00:39 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 07:00:39 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 07:00:40 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 07:00:40 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 07:00:40 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 07:00:40 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 07:00:40 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 07:00:40 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 07:00:40 kjcf05n00 zabbix_server[15650]: item "kjcf05n03:vfs.fs.inode[/mnt/persistent_ha_data,pfree]" became supported Nov 3 07:00:40 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 07:00:40 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 07:00:40 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:40 kjcf05n03 systemd[1]: Set up automount opt-firmware.automount. Nov 3 07:00:41 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:41 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:41 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 07:00:41 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 07:00:41 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:41 kjcf05n03 systemd[1]: Set up automount mnt-llog.automount. Nov 3 07:00:41 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:41 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:41 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 07:00:41 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 07:00:41 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:41 kjcf05n03 systemd[1]: Set up automount usr-share-man.automount. Nov 3 07:00:41 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:41 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:41 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 07:00:41 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 07:00:41 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 07:00:41 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 07:00:41 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 07:00:41 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 07:00:41 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 07:00:41 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 07:00:41 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 07:00:41 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 07:00:41 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:42 kjcf05n03 systemd[1]: Starting Crash recovery kernel arming... Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: kdump: No kdump initial ramdisk found. Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 07:00:42 kjcf05n03 dracut[7982]: dracut-049-135.git20210121.el8 Nov 3 07:00:42 kjcf05n03 dracut[7984]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 07:00:42 kjcf05n03 dracut[7984]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 07:00:42 kjcf05n03 dracut[7984]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 07:00:42 kjcf05n03 dracut[7984]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 07:00:42 kjcf05n03 dracut[7984]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 07:00:42 kjcf05n03 dracut[7984]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 07:00:42 kjcf05n03 dracut[7984]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 07:00:42 kjcf05n03 dracut[7984]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + is_func check Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: ++ type -t check Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + '[' 0 -ne 0 ']' Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + check -h Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + local dev holder Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + require_binaries mdadm expr Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + local _module_name=90hperaid Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + local _ret=0 Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + [[ mdadm = \-\m ]] Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + for cmd in "$@" Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + find_binary mdadm Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + for cmd in "$@" Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + find_binary expr Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + return 0 Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + [[ -n -h ]] Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + for dev in "${!host_fs_types[@]}" Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + [[ nfs != *_raid_member ]] Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + continue Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + return 255 Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + _ret=255 Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + hostonly=-h Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + return 255 Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + ret=255 Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + [[ 255 = 0 ]] Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + [[ 255 = 255 ]] Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: ++ module_depends hperaid Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: +++ read a b Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: ++ local _ret Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: ++ unset check depends cmdline install installkernel Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: +++ set -x Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: ++ depends Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: ++ echo rootfs-block Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: ++ return 0 Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: ++ _ret=0 Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: ++ unset check depends cmdline install installkernel Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: ++ return 0 Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + for _moddep in $(module_depends $_mod) Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + [[ all == *\ hperaid\ * ]] Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + add_dracutmodules+=' rootfs-block ' Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + [[ == *\ hperaid\ * ]] Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + check_module rootfs-block Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + local _mod=rootfs-block Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + local _moddep Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + [[ == *\ rootfs-block\ * ]] Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + [[ -n '' ]] Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + [[ all == *\ rootfs-block\ * ]] Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + module_check rootfs-block 0 Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + local _forced=0 Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + local _hostonly=-h Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + '[' 2 -eq 2 ']' Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + _forced=0 Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:42 kjcf05n03 kdumpctl[7857]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + is_func check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ type -t check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 0 -ne 0 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check -h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _ret=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + ret=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ 0 = 0 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ module_depends rootfs-block Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: +++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 07:00:43 kjcf05n03 kdumpctl[3176]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ depends Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo fs-lib Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ _ret=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ return 0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + for _moddep in $(module_depends $_mod) Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all == *\ rootfs-block\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + add_dracutmodules+=' fs-lib ' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ == *\ rootfs-block\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check_module fs-lib Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _mod=fs-lib Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddep Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n '' ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + mods_checked_as_dep+=' fs-lib ' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all == *\ fs-lib\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + module_check fs-lib 0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _forced=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 2 -eq 2 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _forced=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + is_func check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ type -t check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 0 -ne 0 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check -h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _ret=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + ret=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ 0 = 0 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ module_depends fs-lib Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: +++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ depends Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ return 0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ _ret=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ return 0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + mods_to_load+=' fs-lib ' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + mods_to_load+=' rootfs-block ' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + mods_to_load+=' hperaid ' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _mod=90kernel-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _mod=kernel-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check_module kernel-modules 1 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _mod=kernel-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddep Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n 1 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all = all ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + module_check kernel-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _forced=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 1 -eq 2 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + is_func check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ type -t check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 0 -ne 0 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check -h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + true Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _ret=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + ret=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ 0 != 0 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ module_depends kernel-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: +++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ depends Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ true Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ _ret=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ return 0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + mods_to_load+=' kernel-modules ' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _mod=90kernel-modules-extra Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _mod=kernel-modules-extra Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check_module kernel-modules-extra 1 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _mod=kernel-modules-extra Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddep Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n 1 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all = all ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + module_check kernel-modules-extra Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _forced=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 1 -eq 2 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + is_func check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ type -t check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 0 -ne 0 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check -h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + true Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _ret=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + ret=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ 0 != 0 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ module_depends kernel-modules-extra Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: +++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ depends Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ true Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ _ret=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ return 0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + mods_to_load+=' kernel-modules-extra ' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _mod=90kernel-network-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _mod=kernel-network-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check_module kernel-network-modules 1 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _mod=kernel-network-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddep Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n 1 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all = all ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + module_check kernel-network-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _forced=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 1 -eq 2 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + is_func check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ type -t check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 0 -ne 0 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check -h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _ret=255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + ret=255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ 255 != 0 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n 1 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 1 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _mod=90livenet Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _mod=livenet Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check_module livenet 1 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _mod=livenet Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddep Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n 1 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all = all ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + module_check livenet Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _forced=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 1 -eq 2 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + is_func check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ type -t check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 0 -ne 0 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check -h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _ret=255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + ret=255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ 255 != 0 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n 1 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 1 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _mod=90lvm Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _mod=lvm Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check_module lvm 1 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _mod=lvm Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddep Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n 1 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all = all ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + module_check lvm Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _forced=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 1 -eq 2 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + is_func check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ type -t check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 0 -ne 0 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check -h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + require_binaries lvm Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _module_name=90lvm Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ lvm = \-\m ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + for cmd in "$@" Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + find_binary lvm Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n -h ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + for fs in "${host_fs_types[@]}" Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ nfs = LVM*_member ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _ret=255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + ret=255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ 255 != 0 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n 1 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 1 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _mod=90mdraid Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _mod=mdraid Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check_module mdraid 1 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _mod=mdraid Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddep Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n 1 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all = all ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + module_check mdraid Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _forced=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 1 -eq 2 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + is_func check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ type -t check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 0 -ne 0 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check -h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _rootdev Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + require_binaries mdadm expr Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _module_name=90mdraid Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ mdadm = \-\m ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + for cmd in "$@" Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + find_binary mdadm Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + for cmd in "$@" Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + find_binary expr Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n -h ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + for dev in "${!host_fs_types[@]}" Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ nfs != *_raid_member ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + continue Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _ret=255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + ret=255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ 255 != 0 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n 1 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 1 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _mod=90multipath Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _mod=multipath Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check_module multipath 1 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _mod=multipath Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddep Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n 1 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all = all ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + module_check multipath Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _forced=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 1 -eq 2 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + is_func check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ type -t check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 0 -ne 0 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check -h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _rootdev Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n -h ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + for_each_host_dev_and_slaves is_mpath Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _func=is_mpath Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _dev Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + for _dev in "${host_devs[@]}" Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + continue Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 1 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _ret=255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + ret=255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ 255 != 0 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n 1 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 1 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _mod=90qemu Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _mod=qemu Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check_module qemu 1 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _mod=qemu Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddep Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n 1 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all = all ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + module_check qemu Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _forced=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 1 -eq 2 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + is_func check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ type -t check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 0 -ne 0 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check -h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n -h ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + type -P systemd-detect-virt Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ systemd-detect-virt --vm Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + vm=none Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + (( 1 != 0 )) Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _ret=255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + ret=255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ 255 != 0 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n 1 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 1 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _mod=90qemu-net Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _mod=qemu-net Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check_module qemu-net 1 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _mod=qemu-net Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddep Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n 1 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all = all ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + module_check qemu-net Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _forced=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 1 -eq 2 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + is_func check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ type -t check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 0 -ne 0 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check -h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n -h ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + type -P systemd-detect-virt Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ systemd-detect-virt --vm Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + vm= Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + (( 1 != 0 )) Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _ret=255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + ret=255 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ 255 != 0 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n 1 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + return 1 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _mod=90stratis Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + _mod=stratis Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check_module stratis 1 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _mod=stratis Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddep Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -n 1 ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ all = all ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + module_check stratis Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ read a b Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _forced=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _hostonly=-h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 1 -eq 2 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + is_func check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: ++ type -t check Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + '[' 0 -ne 0 ']' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + check -h Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _module_name=90stratis Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + local _ret=0 Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + [[ stratisd-init = \-\m ]] Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + for cmd in "$@" Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + find_binary stratisd-init Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 07:00:43 kjcf05n03 kdumpctl[7857]: + set +x Nov 3 07:00:43 kjcf05n03 dracut[7984]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 07:00:43 kjcf05n03 dracut[7984]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 07:00:43 kjcf05n03 dracut[7984]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 07:00:43 kjcf05n03 dracut[7984]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 07:00:43 kjcf05n03 dracut[7984]: memstrack is available Nov 3 07:00:43 kjcf05n03 dracut[7984]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 07:00:43 kjcf05n03 dracut[7984]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 07:00:43 kjcf05n03 dracut[7984]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 07:00:43 kjcf05n03 dracut[7984]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 07:00:43 kjcf05n03 dracut[7984]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 07:00:43 kjcf05n03 dracut[7984]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 07:00:43 kjcf05n03 dracut[7984]: *** Including module: bash *** Nov 3 07:00:43 kjcf05n03 dracut[7984]: *** Including module: systemd *** Nov 3 07:00:44 kjcf05n03 dracut[7984]: *** Including module: fips *** Nov 3 07:00:45 kjcf05n03 dracut[7984]: *** Including module: systemd-initrd *** Nov 3 07:00:45 kjcf05n03 dracut[7984]: *** Including module: watchdog-modules *** Nov 3 07:00:45 kjcf05n03 dracut[7984]: *** Including module: nss-softokn *** Nov 3 07:00:45 kjcf05n03 dracut[7984]: *** Including module: i18n *** Nov 3 07:00:45 kjcf05n03 dracut[7984]: No KEYMAP configured. Nov 3 07:00:45 kjcf05n03 dracut[7984]: *** Including module: network-legacy *** Nov 3 07:00:45 kjcf05n03 dracut[7984]: *** Including module: network *** Nov 3 07:00:45 kjcf05n00 zabbix_server[15650]: item "kjcf05n03:vfs.fs.size[/mnt/persistent_ha_data,pused]" became supported Nov 3 07:00:45 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31415 deleted. Nov 3 07:00:45 kjcf05n03 dracut[7984]: *** Including module: ib_bonding *** Nov 3 07:00:45 kjcf05n03 dracut[7984]: *** Including module: drm *** Nov 3 07:00:46 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 07:00:46 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 07:00:46 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 07:00:46 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running Nov 3 07:00:46 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 07:00:46 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31419 deleted. Nov 3 07:00:49 kjcf05n03 dracut[7984]: *** Including module: hperaid *** Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + install Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + local rule rule_path Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + inst_multiple cat expr Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.64syZ1/initramfs -a -f cat expr Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + _ret=0 Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + (( 0 != 0 )) Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + : Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + return 0 Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + inst_multiple -o mdmon Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.64syZ1/initramfs -a -f -o mdmon Nov 3 07:00:49 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 07:00:49 kjcf05n03 dcs-collectord[5655]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + _ret=0 Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + (( 0 != 0 )) Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + : Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + return 0 Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: ++ command -v partx Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + inst /usr/sbin/partx /sbin/partx Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + local _hostonly_install Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + [[ -e /tmp/dracut.64syZ1/initramfs//sbin/partx ]] Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.64syZ1/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + (( 0 != 0 )) Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + : Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: ++ command -v mdadm Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + local _hostonly_install Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + [[ -e /tmp/dracut.64syZ1/initramfs//sbin/mdadm ]] Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.64syZ1/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + (( 0 != 0 )) Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + : Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + [[ yes == \y\e\s ]] Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + local _raidconf Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: ++ cmdline Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: ++ local _activated dev line UUID Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: ++ declare -A _activated Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: ++ for dev in "${!host_fs_types[@]}" Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: ++ [[ nfs != *_raid_member ]] Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: ++ continue Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + _raidconf= Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + [[ -n '' ]] Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + inst_rules 64-md-raid.rules Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + local _target=/etc/udev/rules.d _rule _found Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + inst_dir /usr/lib/udev/rules.d Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + [[ -e /tmp/dracut.64syZ1/initramfs//usr/lib/udev/rules.d ]] Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + return 0 Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + inst_dir /etc/udev/rules.d Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + [[ -e /tmp/dracut.64syZ1/initramfs//etc/udev/rules.d ]] Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + return 0 Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + for _rule in "$@" Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + continue Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + continue Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + for r in '' $dracutbasedir/rules.d/ Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + [[ 64-md-raid.rules != /* ]] Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + continue Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + for r in '' $dracutbasedir/rules.d/ Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + continue Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + [[ -n '' ]] Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + set +x Nov 3 07:00:49 kjcf05n03 dracut[7984]: Skipping udev rule: 64-md-raid.rules Nov 3 07:00:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730638849', 'host':'kjcf05n03', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.4% (3692576 kB) used.'}"] Nov 3 07:00:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'RAM usage', 'description': 'OK - 1.4% (3692576 kB) used.', 'message': 'OK - 1.4% (3692576 kB) used.', 'value': 'ok', 'timestamp': '1730638849'} Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + installkernel Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + instmods =drivers/md Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + local _optional=-o Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + local _silent Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + local _ret Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + [[ '' = yes ]] Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + [[ =drivers/md = \-\c ]] Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + [[ =drivers/md = \-\s ]] Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + (( 1 == 0 )) Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.64syZ1/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + _ret=0 Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + (( 0 != 0 )) Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + [[ -n '' ]] Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + return 0 Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + _ret=0 Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + unset check depends cmdline install installkernel Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + return 0 Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + modules_loaded+='hperaid ' Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + '[' -n '' ']' Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + _d_mod=90kernel-modules Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + _d_mod=kernel-modules Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + [[ '' = yes ]] Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + dinfo '*** Including module: kernel-modules ***' Nov 3 07:00:49 kjcf05n03 kdumpctl[7857]: + set +x Nov 3 07:00:49 kjcf05n03 dracut[7984]: *** Including module: kernel-modules *** Nov 3 07:00:49 kjcf05n03 dracut[7984]: *** Including module: kernel-modules-extra *** Nov 3 07:00:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:00:50 kjcf05n03 dracut[7984]: *** Including module: kernel-network-modules *** Nov 3 07:00:50 kjcf05n03 dracut[7984]: *** Including module: diskless-mod *** Nov 3 07:00:50 kjcf05n03 dracut[7984]: *** Including module: fstab-sys *** Nov 3 07:00:50 kjcf05n03 dracut[7984]: *** Including module: nfs *** Nov 3 07:00:50 kjcf05n03 dracut[7984]: *** Including module: rootfs-block *** Nov 3 07:00:50 kjcf05n00 zabbix_server[15650]: item "kjcf05n03:vfs.fs.size[/mnt/persistent_ha_data,total]" became supported Nov 3 07:00:50 kjcf05n03 dracut[7984]: *** Including module: terminfo *** Nov 3 07:00:50 kjcf05n03 dracut[7984]: *** Including module: udev-rules *** Nov 3 07:00:51 kjcf05n03 dracut[7984]: Skipping udev rule: 91-permissions.rules Nov 3 07:00:51 kjcf05n03 dracut[7984]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 07:00:51 kjcf05n03 dracut[7984]: *** Including module: dracut-systemd *** Nov 3 07:00:51 kjcf05n03 dracut[7984]: *** Including module: usrmount *** Nov 3 07:00:51 kjcf05n03 dracut[7984]: *** Including module: base *** Nov 3 07:00:52 kjcf05n03 dracut[7984]: *** Including module: fs-lib *** Nov 3 07:00:52 kjcf05n03 dracut[7984]: *** Including module: kdumpbase *** Nov 3 07:00:52 kjcf05n03 dracut[7984]: *** Including module: memstrack *** Nov 3 07:00:52 kjcf05n03 dracut[7984]: *** Including module: shutdown *** Nov 3 07:00:52 kjcf05n03 dracut[7984]: *** Including module: squash *** Nov 3 07:00:52 kjcf05n03 dracut[7984]: *** Including modules done *** Nov 3 07:00:53 kjcf05n03 dracut[7984]: *** Installing kernel module dependencies *** Nov 3 07:00:53 kjcf05n03 dracut[7984]: *** Installing kernel module dependencies done *** Nov 3 07:00:53 kjcf05n03 dracut[7984]: *** Resolving executable dependencies *** Nov 3 07:00:54 kjcf05n03 dracut[7984]: *** Resolving executable dependencies done*** Nov 3 07:00:54 kjcf05n03 dracut[7984]: *** Hardlinking files *** Nov 3 07:00:54 kjcf05n03 dracut[7984]: *** Hardlinking files done *** Nov 3 07:00:54 kjcf05n03 dracut[7984]: *** Generating early-microcode cpio image *** Nov 3 07:00:54 kjcf05n03 dracut[7984]: *** Constructing AuthenticAMD.bin **** Nov 3 07:00:54 kjcf05n03 dracut[7984]: *** Store current command line parameters *** Nov 3 07:00:54 kjcf05n03 dracut[7984]: Stored kernel commandline: Nov 3 07:00:54 kjcf05n03 dracut[7984]: rd.driver.pre=sd_mod Nov 3 07:00:54 kjcf05n03 dracut[7984]: rd.driver.pre=nvme Nov 3 07:00:54 kjcf05n03 dracut[7984]: rd.driver.pre=ipmi_si Nov 3 07:00:54 kjcf05n03 dracut[7984]: rd.driver.pre=ipmi_devintf Nov 3 07:00:54 kjcf05n03 dracut[7984]: rd.driver.pre=ipmi_msghandler Nov 3 07:00:54 kjcf05n03 dracut[7984]: nameserver=172.16.2.2 Nov 3 07:00:54 kjcf05n03 dracut[7984]: nameserver=127.0.0.1 Nov 3 07:00:54 kjcf05n03 dracut[7984]: nameserver=172.16.2.2 Nov 3 07:00:54 kjcf05n03 dracut[7984]: nameserver=127.0.0.1 Nov 3 07:00:54 kjcf05n03 dracut[7984]: ifname=kdump-meth0:00:09:3d:06:9a:1a team=mgmt0:kdump-meth0 Nov 3 07:00:54 kjcf05n03 dracut[7984]: rd.neednet Nov 3 07:00:54 kjcf05n03 dracut[7984]: kdumpnic=mgmt0 Nov 3 07:00:54 kjcf05n03 dracut[7984]: bootdev=mgmt0 Nov 3 07:00:54 kjcf05n03 dracut[7984]: *** Install squash loader *** Nov 3 07:00:54 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 07:00:54 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 07:00:54 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 07:00:54 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running Nov 3 07:00:54 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 07:00:55 kjcf05n03 dracut[7984]: *** Squashing the files inside the initramfs *** Nov 3 07:00:55 kjcf05n03 dracut[7984]: *** Squashing the files inside the initramfs done *** Nov 3 07:00:55 kjcf05n03 dracut[7984]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 07:00:55 kjcf05n00 zabbix_server[15650]: item "kjcf05n03:vfs.fs.size[/mnt/persistent_ha_data,used]" became supported Nov 3 07:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 07:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 07:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 07:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 07:00:56 kjcf05n03 dracut[7984]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 07:00:56 kjcf05n03 kdumpctl[7857]: kdump: kexec: loaded kdump kernel Nov 3 07:00:56 kjcf05n03 kdumpctl[7857]: kdump: Starting kdump: [OK] Nov 3 07:00:56 kjcf05n03 systemd[1]: Started Crash recovery kernel arming. Nov 3 07:00:56 kjcf05n03 systemd[1]: Reloading. Nov 3 07:00:56 kjcf05n03 systemd[3176]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:00:56 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:00:56 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:00:56 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 07:00:56 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 07:00:56 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 07:00:56 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 07:00:56 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 07:00:56 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 07:00:56 kjcf05n03 ifdown[14709]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 07:00:56 kjcf05n03 ifdown[14710]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:00:56 kjcf05n03 ifdown[14711]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:00:57 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 07:00:57 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 07:00:57 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 07:00:57 kjcf05n03 ifup[14785]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 07:00:57 kjcf05n03 ifup[14786]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:00:57 kjcf05n03 ifup[14787]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:00:58 kjcf05n00 mcfcli[3673891]: %3|1730638858.218|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:01:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 07:01:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 07:01:00 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 07:01:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 07:01:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 07:01:01 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 07:01:01 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 07:01:01 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 07:01:01 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:01:01 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:01:01 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:01:01 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:01:01 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 07:01:01 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 07:01:01 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 07:01:01 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 07:01:01 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:01:01 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:01:01 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:01:01 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:01:01 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 07:01:01 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 07:01:01 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 07:01:01 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 07:01:01 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 07:01:01 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 07:01:01 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 07:01:01 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 07:01:01 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 07:01:01 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 07:01:01 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 07:01:01 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 07:01:01 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 07:01:01 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 07:01:01 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 07:01:01 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 07:01:01 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 07:01:01 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 07:01:01 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 07:01:01 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 07:01:01 kjcf05n03 ifdown[14969]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 07:01:02 kjcf05n03 ifdown[14970]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:01:02 kjcf05n03 ifdown[14971]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:01:02 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 07:01:02 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 07:01:02 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 07:01:02 kjcf05n03 ifup[15045]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 07:01:02 kjcf05n03 ifup[15061]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:01:02 kjcf05n03 ifup[15062]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:01:04 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 07:01:04 kjcf05n03 dcs-collectord[5655]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 07:01:04 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 07:01:04 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 07:01:04 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 07:01:04 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 07:01:04 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running Nov 3 07:01:04 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 07:01:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730638865', 'host':'kjcf05n03', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 07:01:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730638865', 'host':'kjcf05n03', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 07:01:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730638865'} Nov 3 07:01:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730638865'} Nov 3 07:01:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:01:06 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 07:01:06 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 07:01:06 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 07:01:06 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 07:01:06 kjcf05n03 systemd[1]: Reloading. Nov 3 07:01:07 kjcf05n03 systemd[1]: Starting Corosync Cluster Engine... Nov 3 07:01:07 kjcf05n03 await_ha_peer[15331]: Waiting for HA peer kjcf05n02 Nov 3 07:01:08 kjcf05n03 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 07:01:08 kjcf05n03 await_ha_peer[15331]: Peer kjcf05n02 has started, starting HA Nov 3 07:01:08 kjcf05n00 mcfcli[3673891]: %3|1730638868.242|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:01:08 kjcf05n03 systemd[1]: Started Corosync Cluster Engine. Nov 3 07:01:08 kjcf05n03 systemd[1]: Started Fast STONITH daemon. Nov 3 07:01:08 kjcf05n03 fstonithd.py[15381]: Listening for kdump packets from partner Nov 3 07:01:08 kjcf05n03 systemd[1]: Reloading. Nov 3 07:01:09 kjcf05n03 systemd[3176]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:01:09 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:01:09 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:01:09 kjcf05n03 systemd[1]: Reloading. Nov 3 07:01:09 kjcf05n03 systemd[1]: Reached target resource-agents dependencies. Nov 3 07:01:09 kjcf05n03 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 07:01:09 kjcf05n03 systemd[1]: Reloading. Nov 3 07:01:09 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 07:01:09 kjcf05n03 puppet-agent[3580]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:01:09 kjcf05n03 puppet[3580]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:01:09 kjcf05n03 puppet-agent[3580]: Applied catalog in 91.88 seconds Nov 3 07:01:09 kjcf05n03 puppet[3580]: Notice: Applied catalog in 91.88 seconds Nov 3 07:01:09 kjcf05n03 systemd[1]: Started Puppet agent. Nov 3 07:01:09 kjcf05n03 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 07:01:09 kjcf05n03 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 07:01:09 kjcf05n03 systemd[1]: Reached target Timers. Nov 3 07:01:09 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 07:01:09 kjcf05n03 systemd[1]: Starting Set absolute GEM time... Nov 3 07:01:09 kjcf05n03 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 07:01:09 kjcf05n03 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 07:01:09 kjcf05n03 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 07:01:10 kjcf05n03 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 07:01:10 kjcf05n03 wce-disable.sh[15514]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 07:01:10 kjcf05n03 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 07:01:10 kjcf05n03 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 07:01:10 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 07:01:10 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 07:01:10 kjcf05n03 systemd[1]: set_gem_time.service: Succeeded. Nov 3 07:01:10 kjcf05n03 systemd[1]: Started Set absolute GEM time. Nov 3 07:01:10 kjcf05n03 gateway-ec-node.py[15520]: Starting gateway-ec-node service Nov 3 07:01:10 kjcf05n03 python3.9[15519]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 07:01:10 kjcf05n03 python3.9[15519]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 07:01:10 kjcf05n03 RFSF-API[15518]: INFO[2024-11-03T07:01:10-06:00] Datapath API RESTful Service starting Nov 3 07:01:10 kjcf05n03 dp-api-server-node[15518]: INFO[2024-11-03T07:01:10-06:00] Datapath API RESTful Service starting Nov 3 07:01:10 kjcf05n03 RFSF-API[15518]: INFO[2024-11-03T07:01:10-06:00] Running in production mode, starting dbus event listener Nov 3 07:01:10 kjcf05n03 dp-api-server-node[15518]: INFO[2024-11-03T07:01:10-06:00] Running in production mode, starting dbus event listener Nov 3 07:01:10 kjcf05n03 RFSF-API[15518]: INFO[2024-11-03T07:01:10-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 07:01:10 kjcf05n03 dp-api-server-node[15518]: INFO[2024-11-03T07:01:10-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 07:01:10 kjcf05n03 RFSF-API[15518]: INFO[2024-11-03T07:01:10-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 07:01:10 kjcf05n03 dp-api-server-node[15518]: INFO[2024-11-03T07:01:10-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 07:01:10 kjcf05n03 RFSF-API[15518]: INFO[2024-11-03T07:01:10-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 07:01:10 kjcf05n03 dp-api-server-node[15518]: INFO[2024-11-03T07:01:10-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 07:01:10 kjcf05n03 RFSF-API[15518]: INFO[2024-11-03T07:01:10-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 07:01:10 kjcf05n03 dp-api-server-node[15518]: INFO[2024-11-03T07:01:10-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 07:01:10 kjcf05n03 RFSF-API[15518]: INFO[2024-11-03T07:01:10-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 07:01:10 kjcf05n03 dp-api-server-node[15518]: INFO[2024-11-03T07:01:10-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 07:01:10 kjcf05n03 RFSF-API[15518]: INFO[2024-11-03T07:01:10-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 07:01:10 kjcf05n03 dp-api-server-node[15518]: INFO[2024-11-03T07:01:10-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 07:01:10 kjcf05n03 RFSF-API[15518]: INFO[2024-11-03T07:01:10-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 07:01:10 kjcf05n03 dp-api-server-node[15518]: INFO[2024-11-03T07:01:10-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 07:01:10 kjcf05n03 RFSF-API[15518]: INFO[2024-11-03T07:01:10-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 07:01:10 kjcf05n03 dp-api-server-node[15518]: INFO[2024-11-03T07:01:10-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 07:01:10 kjcf05n03 RFSF-API[15518]: INFO[2024-11-03T07:01:10-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 07:01:10 kjcf05n03 dp-api-server-node[15518]: INFO[2024-11-03T07:01:10-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 07:01:10 kjcf05n03 RFSF-API[15518]: INFO[2024-11-03T07:01:10-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 07:01:10 kjcf05n03 dp-api-server-node[15518]: INFO[2024-11-03T07:01:10-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 07:01:15 kjcf05n03 systemd[1]: Reloading. Nov 3 07:01:15 kjcf05n03 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 07:01:15 kjcf05n03 systemd[1]: Reloading. Nov 3 07:01:15 kjcf05n03 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 07:01:15 kjcf05n03 diskmonitor_pre[15976]: Key management is currently disabled.DEAR disabled Nov 3 07:01:16 kjcf05n03 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 07:01:17 kjcf05n03 sh[16033]: LNET configured: New Created Nov 3 07:01:17 kjcf05n03 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 07:01:17 kjcf05n03 LCNmon[18114]: Interface ib0 is up Nov 3 07:01:17 kjcf05n03 LCNmon[18114]: Interface ib1 is up Nov 3 07:01:17 kjcf05n03 LCNmon[18114]: Can ping through interface ib0 Nov 3 07:01:17 kjcf05n03 LCNmon[18114]: Can ping through interface ib1 Nov 3 07:01:17 kjcf05n03 LCNmon[18114]: NIC ib0, initial state UP Nov 3 07:01:17 kjcf05n03 LCNmon[18114]: NIC ib1, initial state UP Nov 3 07:01:17 kjcf05n03 LCNmon[18114]: LCNstat initial state UP Nov 3 07:01:18 kjcf05n03 LCNmon[18114]: LCNmon monitoring hosts kjcf05n03 and kjcf05n02 Nov 3 07:01:19 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 07:01:19 kjcf05n03 dcs-collectord[5655]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 07:01:19 kjcf05n03 dcs-collectord[5655]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 07:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730638879', 'host':'kjcf05n03', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 07:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730638879', 'host':'kjcf05n03', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 07:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730638879'} Nov 3 07:01:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730638879'} Nov 3 07:01:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730638879', 'host':'kjcf05n03', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.81, 1.89, 0.87'}"] Nov 3 07:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Load', 'description': 'OK - load average: 1.81, 1.89, 0.87', 'message': 'OK - load average: 1.81, 1.89, 0.87', 'value': 'ok', 'timestamp': '1730638879'} Nov 3 07:01:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730638879', 'host':'kjcf05n03', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 369 processes with STATE = RSZDT '}"] Nov 3 07:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Total Processes', 'description': 'PROCS OK: 369 processes with STATE = RSZDT ', 'message': 'PROCS OK: 369 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730638879'} Nov 3 07:01:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: /var/run/diskmonitor does not exist, creating Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: Creating /var/run/diskmonitor/disk Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: Creating /var/run/diskmonitor/encl Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: Creating /var/run/diskmonitor/cli Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: RAS_Interlocks_enabled: 1 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: add handler for sig: 14 sa_flags: 10000004 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: add handler for sig: 1 sa_flags: 10000004 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: add handler for sig: 2 sa_flags: 00000004 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: add handler for sig: 15 sa_flags: 00000004 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: add handler for sig: 6 sa_flags: 00000004 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: add handler for sig: 3 sa_flags: 00000004 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: add handler for sig: 30 sa_flags: 00000004 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: add handler for sig: 20 sa_flags: 00000004 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: add handler for sig: 10 sa_flags: 10000004 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: add handler for sig: 11 sa_flags: 00000004 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: add handler for sig: 7 sa_flags: 00000004 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: add handler for sig: 4 sa_flags: 00000004 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: add handler for sig: 8 sa_flags: 00000004 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: Using HA Baton locks - key: diskmonitor Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: Baton will be held for at most 570 seconds Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: DMMP Enabled: 0 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: random seed: b83cbb23 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: NVMe Enclosure: 1 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: ZFS Enclosure: 0 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: Dbus, Initialized Connection Successfully Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: int_catcher_thread: thread start Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: Received dbus message 4 org.freedesktop.DBus -> :1.117 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b07bec_S4EUNF0MA05386M encl_slot: 0 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b07bed_S4EUNF0MA05387D encl_slot: 0 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 07:01:20 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 07:01:20 kjcf05n00 httpd[902571]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-B): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n03', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 07:01:21 kjcf05n03 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 07:01:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730638881', 'host':'kjcf05n03', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(2632.0B/2080.0B), ib1=(2128.0B/1720.0B), icl0=(7.4kB/9.1kB), lo=(800.0B/800.0B), meth0=(1541.5MB/8.1MB), mgmt0=(1478.3MB/8.1MB)'}"] Nov 3 07:01:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730638881', 'host':'kjcf05n03', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 07:01:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(2632.0B/2080.0B), ib1=(2128.0B/1720.0B), icl0=(7.4kB/9.1kB), lo=(800.0B/800.0B), meth0=(1541.5MB/8.1MB), mgmt0=(1478.3MB/8.1MB)', 'message': 'NET OK - (Rx/Tx) ib0=(2632.0B/2080.0B), ib1=(2128.0B/1720.0B), icl0=(7.4kB/9.1kB), lo=(800.0B/800.0B), meth0=(1541.5MB/8.1MB), mgmt0=(1478.3MB/8.1MB)', 'value': 'ok', 'timestamp': '1730638881'} Nov 3 07:01:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730638881'} Nov 3 07:01:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:01:22 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 07:01:22 kjcf05n00 zabbix-server[1047370]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:01:22 kjcf05n00 zabbix-server[1047370]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 164.25\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 116.38\\"}}"' Nov 3 07:01:22 kjcf05n00 log_interesting_event.py[1047370]: Event '45929' acknowledged Nov 3 07:01:23 kjcf05n03 openhpid[5561]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 07:01:23 kjcf05n03 openhpid[5561]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 07:01:23 kjcf05n03 systemd[1]: openhpid.service: Succeeded. Nov 3 07:01:23 kjcf05n03 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 07:01:23 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 07:01:23 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18791 (bash) Nov 3 07:01:24 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 07:01:24 kjcf05n03 systemd[1]: openhpid.service: Supervising process 18802 which is not our child. We'll most likely not notice when it exits. Nov 3 07:01:24 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 07:01:24 kjcf05n03 systemd[1]: Reached target Multi-User System. Nov 3 07:01:24 kjcf05n03 systemd[1]: Reached target Graphical Interface. Nov 3 07:01:24 kjcf05n03 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 07:01:24 kjcf05n03 dcs-collectord[5655]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 07:01:24 kjcf05n03 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 07:01:24 kjcf05n03 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 07:01:24 kjcf05n03 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 07:01:24 kjcf05n03 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 07:01:24 kjcf05n03 openhpid[18802]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 07:01:24 kjcf05n03 openhpid[18802]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 07:01:24 kjcf05n03 openhpid[18802]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 07:01:24 kjcf05n03 openhpid[18802]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 07:01:24 kjcf05n03 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 07:01:24 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 07:01:24 kjcf05n03 systemd[1]: Startup finished in 50.605s (kernel) + 2min 29.523s (userspace) = 3min 20.128s. Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 07:01:26 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 07:01:28 kjcf05n00 mcfcli[3673891]: %3|1730638888.218|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:01:34 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 07:01:34 kjcf05n03 dcs-collectord[5655]: WARNING No data collected (hpi_parser.py:353) Nov 3 07:01:46 kjcf05n00 mcfcli[3673891]: %3|1730638906.858|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:01:48 kjcf05n03 ipmievd[3994]: System Event sensor - Timestamp Clock Sync Nov 3 07:01:49 kjcf05n03 ipmievd[3176]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:01:49 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 07:01:58 kjcf05n00 mcfcli[3673891]: %3|1730638918.219|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b07bed_S4EUNF0MA05387D encl_sn: USE26000024VS001, slot: 2 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b07bec_S4EUNF0MA05386M encl_sn: USE26000024VS001, slot: 1 Nov 3 07:01:58 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 07:02:04 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 07:02:06 kjcf05n02 firmware-update-orc-server[5843]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "dfe01107-f842-4fdc-8473-3e4bbe59c594"} (logger.py:65) Nov 3 07:02:06 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 86988 (get_disk_device) Nov 3 07:02:06 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 07:02:06 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 07:02:06 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e300631002538450000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 07:02:06 kjcf05n03 ras-resource-manager-agent[5919]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "d3e062ca-99e3-11ef-900b-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 07:02:06 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'd3e062ca-99e3-11ef-900b-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 07:02:06 kjcf05n03 ras-resource-manager-agent[5919]: INFO Submitting new device inserted signal, starting to qualify drive: d3e062ca-99e3-11ef-900b-00093d069a1b (admin_action.py:110) Nov 3 07:02:06 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'd3e062ca-99e3-11ef-900b-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 07:02:06 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'd3e062ca-99e3-11ef-900b-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 07:02:06 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': 'd3e062ca-99e3-11ef-900b-00093d069a1b', 'response ID': 'd3eac62a-99e3-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 07:02:06 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: d3eac62a-99e3-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 07:02:07 kjcf05n02 ccp-client[87009]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 07:02:07 kjcf05n02 ccp-client[87009]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 07:02:07 kjcf05n02 ccp-client[87022]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 07:02:07 kjcf05n02 ccp-client[87009]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 07:02:07 kjcf05n02 ccp-client[87022]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 07:02:07 kjcf05n02 ccp-client[87022]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 07:02:07 kjcf05n02 ccp-client[87009]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 07:02:07 kjcf05n03 diskmonitor[17713]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 07:02:07 kjcf05n03 ras-resource-manager-agent[5919]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "d4337d02-99e3-11ef-900b-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 07:02:07 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'd4337d02-99e3-11ef-900b-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 07:02:07 kjcf05n03 ras-resource-manager-agent[5919]: INFO Submitting new device inserted signal, starting to qualify drive: d4337d02-99e3-11ef-900b-00093d069a1b (admin_action.py:110) Nov 3 07:02:07 kjcf05n03 firmware-update-orc-server[5875]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "a362db39-8c4c-4278-a526-ab91153f7c77"} (logger.py:65) Nov 3 07:02:06 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'd4337d02-99e3-11ef-900b-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 07:02:06 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'd4337d02-99e3-11ef-900b-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 07:02:06 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': 'd4337d02-99e3-11ef-900b-00093d069a1b', 'response ID': 'd43ace54-99e3-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 07:02:06 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: d43ace54-99e3-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 07:02:10 kjcf05n02 DRVFW[87176]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 07:02:10 kjcf05n02 ccp-client[87177]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 07:02:10 kjcf05n02 ccp-client[87177]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 07:02:10 kjcf05n02 ccp-client[87186]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 07:02:10 kjcf05n02 ccp-client[87177]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 07:02:10 kjcf05n02 ccp-client[87177]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 07:02:10 kjcf05n02 ccp-client[87186]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 07:02:10 kjcf05n02 ccp-client[87186]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 07:02:10 kjcf05n02 firmware-update-orc-server[5843]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 07:02:11 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'd3e062ca-99e3-11ef-900b-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 07:02:11 kjcf05n03 ras-resource-manager-agent[5919]: INFO Drive qualification complete responding: d3e062ca-99e3-11ef-900b-00093d069a1b (admin_action.py:205) Nov 3 07:02:11 kjcf05n03 ras-resource-manager-agent[5919]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "d3e062ca-99e3-11ef-900b-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} (interesting_event.py:59) Nov 3 07:02:11 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: d3eac62a-99e3-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 07:02:11 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': 'd3e062ca-99e3-11ef-900b-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'd3e062ca-99e3-11ef-900b-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}}} (logger.py:65) Nov 3 07:02:14 kjcf05n03 diskmonitor[17713]: 0003 Nov 3 07:02:14 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 07:02:14 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 07:02:14 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 07:02:14 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 07:02:14 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 07:02:14 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 07:02:14 kjcf05n03 diskmonitor[17713]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 07:02:14 kjcf05n03 diskmonitor[17713]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 07:02:14 kjcf05n03 diskmonitor[17713]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 07:02:14 kjcf05n03 diskmonitor[17713]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 07:02:14 kjcf05n03 diskmonitor[17713]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 07:02:14 kjcf05n03 diskmonitor[17713]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "d3e062ca-99e3-11ef-900b-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 07:02:14 kjcf05n03 diskmonitor[17713]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 07:02:14 kjcf05n03 diskmonitor[17713]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 07:02:14 kjcf05n03 diskmonitor[17713]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "d4337d02-99e3-11ef-900b-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 07:02:14 kjcf05n03 diskmonitor[17713]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 07:02:14 kjcf05n03 diskmonitor[17713]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 07:02:21 kjcf05n03 chronyd[5162]: Selected source 172.16.2.1 Nov 3 07:02:22 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22577 (get_disk_device) Nov 3 07:02:22 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 07:02:22 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 07:02:22 kjcf05n03 ccp-client[22613]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 07:02:22 kjcf05n03 ccp-client[22613]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 07:02:22 kjcf05n03 ccp-client[22622]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 07:02:22 kjcf05n03 ccp-client[22613]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 07:02:22 kjcf05n03 ccp-client[22613]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 07:02:22 kjcf05n03 ccp-client[22622]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 07:02:22 kjcf05n03 ccp-client[22622]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 07:02:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730638943}"] Nov 3 07:02:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730638943, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:02:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:02:24 kjcf05n03 systemd[1]: Unmounting /mnt/llog... Nov 3 07:02:24 kjcf05n03 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 07:02:24 kjcf05n03 systemd[1]: Unmounted /mnt/llog. Nov 3 07:02:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730638944}"] Nov 3 07:02:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730638944, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:02:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:02:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730638944}"] Nov 3 07:02:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730638944, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:02:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:02:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730638944}"] Nov 3 07:02:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730638944, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:02:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:02:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730638944}"] Nov 3 07:02:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730638944, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:02:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:02:25 kjcf05n03 DRVFW[22840]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 07:02:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730638944}"] Nov 3 07:02:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730638944, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:02:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:02:25 kjcf05n03 ccp-client[22841]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 07:02:25 kjcf05n03 ccp-client[22841]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 07:02:25 kjcf05n03 ccp-client[22852]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 07:02:25 kjcf05n03 ccp-client[22841]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 07:02:25 kjcf05n03 ccp-client[22841]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 07:02:25 kjcf05n03 ccp-client[22852]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 07:02:25 kjcf05n03 ccp-client[22852]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 07:02:25 kjcf05n03 firmware-update-orc-server[5875]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 07:02:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730638945}"] Nov 3 07:02:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730638945, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:02:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:02:25 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: d43ace54-99e3-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 07:02:25 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': 'd4337d02-99e3-11ef-900b-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'd4337d02-99e3-11ef-900b-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}}} (logger.py:65) Nov 3 07:02:25 kjcf05n00 mcfcli[3673891]: %3|1730638945.978|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:02:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730638945}"] Nov 3 07:02:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730638945, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:02:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:02:26 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'd4337d02-99e3-11ef-900b-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 07:02:26 kjcf05n03 ras-resource-manager-agent[5919]: INFO Drive qualification complete responding: d4337d02-99e3-11ef-900b-00093d069a1b (admin_action.py:205) Nov 3 07:02:26 kjcf05n03 ras-resource-manager-agent[5919]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "d4337d02-99e3-11ef-900b-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (interesting_event.py:59) Nov 3 07:02:27 kjcf05n03 python3.9[5224]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 07:02:28 kjcf05n00 mcfcli[3673891]: %3|1730638948.219|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:02:29 kjcf05n03 python3.9[3176]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:02:29 kjcf05n03 ras-resource-manager-agent[5919]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "d3e062ca-99e3-11ef-900b-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} (service_main_handler.py:66) Nov 3 07:02:29 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'd3e062ca-99e3-11ef-900b-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 07:02:29 kjcf05n03 ras-resource-manager-agent[5919]: INFO Device qualification response has been acknowledged: d3e062ca-99e3-11ef-900b-00093d069a1b (admin_action.py:151) Nov 3 07:02:29 kjcf05n03 ras-resource-manager-agent[5919]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "d4337d02-99e3-11ef-900b-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 07:02:29 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'd4337d02-99e3-11ef-900b-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 07:02:29 kjcf05n03 ras-resource-manager-agent[5919]: INFO Device qualification response has been acknowledged: d4337d02-99e3-11ef-900b-00093d069a1b (admin_action.py:151) Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "d3e062ca-99e3-11ef-900b-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: Dbus, handle_ingress_ras_signals, uuid: d3e062ca-99e3-11ef-900b-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "d3e062ca-99e3-11ef-900b-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "d4337d02-99e3-11ef-900b-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: Dbus, handle_ingress_ras_signals, uuid: d4337d02-99e3-11ef-900b-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "d4337d02-99e3-11ef-900b-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 07:02:31 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 07:02:33 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 07:02:33 kjcf05n03 diskmonitor[17713]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 07:02:38 kjcf05n03 diskmonitor[17713]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 07:02:38 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 07:02:38 kjcf05n03 diskmonitor[17713]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 07:02:38 kjcf05n03 diskmonitor[17713]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 07:02:38 kjcf05n03 diskmonitor[17713]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 07:02:38 kjcf05n03 diskmonitor[17713]: leaving test state: 1 next state: 2 Nov 3 07:02:38 kjcf05n03 diskmonitor[17713]: lock req: no timeout Nov 3 07:02:38 kjcf05n03 diskmonitor[17713]: leaving test state: 2 next state: 4 Nov 3 07:02:38 kjcf05n03 diskmonitor[17713]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 07:02:45 kjcf05n00 zabbix-server[1048125]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:02:45 kjcf05n00 zabbix-server[1048125]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 58.83\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 73.56\\"}}"' Nov 3 07:02:45 kjcf05n00 log_interesting_event.py[1048125]: Event '45933' acknowledged Nov 3 07:02:50 kjcf05n02 nslcd[6910]: [8e1f29] ldap_result() failed: Can't contact LDAP server Nov 3 07:02:58 kjcf05n00 mcfcli[3673891]: %3|1730638978.220|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:03:05 kjcf05n00 mcfcli[3673891]: %3|1730638985.507|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T07:03:27.254278651-06:00 level=info msg="Completed cleanup jobs" duration=27.345723ms Nov 3 07:03:28 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 07:03:28 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 07:03:28 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 07:03:28 kjcf05n00 mcfcli[3673891]: %3|1730639008.220|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:03:43 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 07:03:43 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 07:03:43 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 07:03:44 kjcf05n03 dcs-collectord[5655]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 07:03:44 kjcf05n00 mcfcli[3673891]: %3|1730639024.313|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:03:46 kjcf05n03 diskmonitor[17713]: lock acquired Nov 3 07:03:46 kjcf05n03 diskmonitor[17713]: leaving test state: 4 next state: 8 Nov 3 07:03:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730639033}"] Nov 3 07:03:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730639033, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:03:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:03:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:03:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:03:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:03:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:03:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:03:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:03:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:03:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:03:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:03:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:03:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:03:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:03:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.106375ms Nov 3 07:03:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:03:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.106375ms Nov 3 07:03:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:03:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:03:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:03:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730639033}"] Nov 3 07:03:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730639033, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:03:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:03:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:03:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:03:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:03:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:03:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:03:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:03:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:03:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:03:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:03:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:03:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:03:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:03:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.320416ms Nov 3 07:03:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:03:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.320416ms Nov 3 07:03:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:03:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:03:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:03:58 kjcf05n00 mcfcli[3673891]: %3|1730639038.220|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:04:00 kjcf05n03 diskmonitor[17713]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 07:04:00 kjcf05n03 diskmonitor[17713]: leaving test state: 8 next state: 20 Nov 3 07:04:00 kjcf05n03 diskmonitor[17713]: leaving test state: 20 next state: 40 Nov 3 07:04:00 kjcf05n03 diskmonitor[17713]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset fcd110000 Nov 3 07:04:00 kjcf05n03 diskmonitor[17713]: leaving test state: 40 next state: 80 Nov 3 07:04:24 kjcf05n00 mcfcli[3673891]: %3|1730639064.310|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:04:28 kjcf05n00 mcfcli[3673891]: %3|1730639068.221|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:04:56 kjcf05n03 diskmonitor[17713]: leaving test state: 80 next state: 100 Nov 3 07:04:56 kjcf05n03 diskmonitor[17713]: lock release: time: Sun Nov 3 07:04:52 2024 Nov 3 07:04:56 kjcf05n03 diskmonitor[17713]: leaving test state: 100 next state: 1 Nov 3 07:04:58 kjcf05n00 mcfcli[3673891]: %3|1730639098.221|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 07:05:03 kjcf05n00 mcfcli[3673891]: %3|1730639103.264|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:05:04 kjcf05n00 python3.9[1049506]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 07:05:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730638819', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 07:05:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730638819'} Nov 3 07:05:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:05:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730638515', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 07:05:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730638515'} Nov 3 07:05:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:05:28 kjcf05n00 mcfcli[3673891]: %3|1730639128.221|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:05:39 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 07:05:40 kjcf05n00 mcfcli[3673891]: %3|1730639140.988|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:05:58 kjcf05n00 mcfcli[3673891]: %3|1730639158.222|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:06:05 kjcf05n00 zabbix-server[1050289]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:06:05 kjcf05n00 zabbix-server[1050289]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n03' from event '45938' Nov 3 07:06:05 kjcf05n00 zabbix-server[1050289]: Host created 'enclosure_USE26000024VS001' Nov 3 07:06:05 kjcf05n00 zabbix-server[1050289]: Running puppet on 'kjcf05n03' Nov 3 07:06:07 kjcf05n03 puppet-agent[32818]: Using configured environment 'production' Nov 3 07:06:07 kjcf05n03 puppet-agent[32818]: Retrieving pluginfacts Nov 3 07:06:07 kjcf05n03 puppet-agent[32818]: Retrieving plugin Nov 3 07:06:07 kjcf05n03 puppet-agent[32818]: Loading facts Nov 3 07:06:10 kjcf05n03 puppet-agent[32818]: Caching catalog for kjcf05n03 Nov 3 07:06:10 kjcf05n03 puppet-agent[32818]: Applying configuration version '1730639168' Nov 3 07:06:12 kjcf05n03 puppet-agent[32818]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 07:06:12 kjcf05n03 puppet-agent[32818]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 07:06:12 kjcf05n03 puppet-agent[32818]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 07:06:13 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 07:06:13 kjcf05n03 zabbix_agent2[6003]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 07:06:13 kjcf05n03 zabbix_agent2[3176]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:06:13 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 07:06:13 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 07:06:13 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 07:06:13 kjcf05n03 puppet-agent[32818]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: Press Ctrl+C to exit. Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: Plugin support version 1.0 Nov 3 07:06:13 kjcf05n03 zabbix_agent2[33172]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 07:06:15 kjcf05n03 puppet-agent[32818]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 07:06:15 kjcf05n03 puppet-agent[32818]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 07:06:15 kjcf05n03 puppet-agent[32818]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 07:06:14 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 07:06:15 kjcf05n00 zabbix-server[1050289]: puppet completed status:(0): '' Nov 3 07:06:15 kjcf05n00 zabbix-server[1050289]: Event '45938' acknowledged Nov 3 07:06:15 kjcf05n00 zabbix-server[1050289]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n03"}' Nov 3 07:06:15 kjcf05n00 mcfcli[3673891]: %3|1730639175.532|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:06:15 kjcf05n03 puppet-agent[32818]: Applied catalog in 4.98 seconds Nov 3 07:06:28 kjcf05n00 mcfcli[3673891]: %3|1730639188.223|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:06:51 kjcf05n00 mcfcli[3673891]: %3|1730639211.075|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:06:58 kjcf05n00 mcfcli[3673891]: %3|1730639218.223|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 07:07:17 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 3 07:07:28 kjcf05n00 mcfcli[3673891]: %3|1730639248.223|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 07:07:31 kjcf05n00 mcfcli[3673891]: %3|1730639251.072|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:07:45 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 3 07:07:45 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 3 07:07:58 kjcf05n00 mcfcli[3673891]: %3|1730639278.224|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:08:07 kjcf05n00 mcfcli[3673891]: %3|1730639287.936|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:08:10 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 07:08:10 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 07:08:10 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 07:08:28 kjcf05n00 mcfcli[3673891]: %3|1730639308.224|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:08:45 kjcf05n00 mcfcli[3673891]: %3|1730639325.452|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:08:58 kjcf05n00 mcfcli[3673891]: %3|1730639338.224|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:09:07 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 3 07:09:07 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 3 07:09:07 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 3 07:09:23 kjcf05n00 mcfcli[3673891]: %3|1730639363.375|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:09:28 kjcf05n00 mcfcli[3673891]: %3|1730639368.225|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:09:58 kjcf05n00 mcfcli[3673891]: %3|1730639398.225|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 07:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 07:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 07:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 07:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 07:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 07:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 07:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 07:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 07:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 07:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 07:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 07:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 07:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 07:10:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 07:10:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:10:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 07:10:03 kjcf05n00 mcfcli[3673891]: %3|1730639403.372|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:10:05 kjcf05n00 python3.9[1052606]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 07:10:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730638819', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 07:10:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730638819'} Nov 3 07:10:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:10:28 kjcf05n00 mcfcli[3673891]: %3|1730639428.225|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 07:10:30 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 07:10:30 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 07:10:30 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 07:10:38 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 3 07:10:38 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 3 07:10:38 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 3 07:10:42 kjcf05n00 mcfcli[3673891]: %3|1730639442.752|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:10:58 kjcf05n00 mcfcli[3673891]: %3|1730639458.226|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 07:11:13 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 3 07:11:20 kjcf05n00 mcfcli[3673891]: %3|1730639480.622|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:11:28 kjcf05n00 mcfcli[3673891]: %3|1730639488.226|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:11:41 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 3 07:11:41 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 3 07:11:58 kjcf05n03 root[41848]: failback_xyraid Nov 3 07:11:58 kjcf05n00 mcfcli[3673891]: %3|1730639518.124|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:11:58 kjcf05n00 mcfcli[3673891]: %3|1730639518.228|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 07:11:59 kjcf05n03 root[41956]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 07:12:00 kjcf05n03 root[42038]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 07:12:04 kjcf05n02 systemd[1]: data-kjcf05n03:md66.mount: Succeeded. Nov 3 07:12:08 kjcf05n02 dwd[5162]: Drive path is missing, purging: nvme5n1 Nov 3 07:12:08 kjcf05n02 dwd[5162]: Drive path is missing, purging: nvme10n1 Nov 3 07:12:08 kjcf05n02 dwd[5162]: Drive path is missing, purging: nvme20n1 Nov 3 07:12:08 kjcf05n02 dwd[5162]: Drive path is missing, purging: nvme15n1 Nov 3 07:12:08 kjcf05n02 dwd[5162]: Drive path is missing, purging: nvme11n1 Nov 3 07:12:08 kjcf05n02 dwd[5162]: Drive path is missing, purging: nvme6n1 Nov 3 07:12:08 kjcf05n02 dwd[5162]: Drive path is missing, purging: nvme7n1 Nov 3 07:12:08 kjcf05n02 dwd[5162]: Drive path is missing, purging: nvme22n1 Nov 3 07:12:08 kjcf05n02 dwd[5162]: Drive path is missing, purging: nvme12n1 Nov 3 07:12:08 kjcf05n02 dwd[5162]: Drive path is missing, purging: nvme21n1 Nov 3 07:12:08 kjcf05n02 dwd[5162]: Drive path is missing, purging: nvme16n1 Nov 3 07:12:09 kjcf05n03 dwd[5195]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 07:12:09 kjcf05n03 dwd[5195]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 07:12:09 kjcf05n03 dwd[5195]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 07:12:09 kjcf05n03 dwd[5195]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 07:12:09 kjcf05n03 dwd[5195]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 07:12:09 kjcf05n03 dwd[5195]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 07:12:09 kjcf05n03 dwd[5195]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 07:12:09 kjcf05n03 dwd[5195]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 07:12:09 kjcf05n03 dwd[5195]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 07:12:09 kjcf05n03 dwd[5195]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 07:12:09 kjcf05n03 dwd[5195]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 07:12:09 kjcf05n03 dwd[5195]: Starting NVME thread for nvme10n1 Nov 3 07:12:10 kjcf05n03 dwd[5195]: Starting NVME thread for nvme15n1 Nov 3 07:12:10 kjcf05n03 dcs-bulk-data-sender[6200]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 3 07:12:10 kjcf05n03 dwd[5195]: Starting NVME thread for nvme21n1 Nov 3 07:12:10 kjcf05n03 dwd[5195]: Starting NVME thread for nvme11n1 Nov 3 07:12:10 kjcf05n03 dwd[5195]: Starting NVME thread for nvme20n1 Nov 3 07:12:11 kjcf05n03 systemd-udevd[44799]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44801]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44804]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44801]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44799]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44804]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 dwd[5195]: Starting NVME thread for nvme12n1 Nov 3 07:12:11 kjcf05n03 systemd-udevd[44799]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44801]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44804]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44799]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44804]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44801]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44799]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44804]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44801]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44799]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44804]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44801]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44799]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44804]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44801]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44799]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44804]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44801]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44837]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44839]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44841]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44837]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44839]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44841]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44837]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44836]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44837]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44837]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44837]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44837]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44837]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44837]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44837]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44837]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44837]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44837]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44837]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:12:11 kjcf05n03 nslcd[6947]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 07:12:11 kjcf05n03 dwd[5195]: Starting NVME thread for nvme7n1 Nov 3 07:12:11 kjcf05n03 dwd[5195]: Starting NVME thread for nvme6n1 Nov 3 07:12:11 kjcf05n03 dwd[5195]: Starting NVME thread for nvme5n1 Nov 3 07:12:11 kjcf05n03 dwd[5195]: Starting NVME thread for nvme16n1 Nov 3 07:12:11 kjcf05n03 dwd[5195]: Starting NVME thread for nvme22n1 Nov 3 07:12:14 kjcf05n03 diskmonitor[17713]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 07:12:20 kjcf05n03 diskmonitor[17713]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 07:12:20 kjcf05n03 diskmonitor[17713]: Scan for ReadErrorMax change for md66 Nov 3 07:12:20 kjcf05n03 diskmonitor[17713]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 07:12:20 kjcf05n03 diskmonitor[17713]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 07:12:20 kjcf05n03 diskmonitor[17713]: read_saved_file: md66 no saved speed Nov 3 07:12:20 kjcf05n03 diskmonitor[17713]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 07:12:20 kjcf05n03 diskmonitor[17713]: Set sync_speed_min (10000) for md66 Nov 3 07:12:20 kjcf05n03 diskmonitor[17713]: Set sync_speed_max (200000) for md66 Nov 3 07:12:20 kjcf05n03 diskmonitor[17713]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 07:12:28 kjcf05n00 mcfcli[3673891]: %3|1730639548.228|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:12:37 kjcf05n00 mcfcli[3673891]: %3|1730639557.841|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:12:58 kjcf05n00 mcfcli[3673891]: %3|1730639578.229|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:13:02 kjcf05n02 diskmonitor[17412]: Removed MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 07:13:02 kjcf05n02 diskmonitor[17412]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 07:13:05 kjcf05n03 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 07:13:05 kjcf05n03 systemd-tmpfiles[47593]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 07:13:05 kjcf05n03 systemd-tmpfiles[47593]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 07:13:05 kjcf05n03 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 07:13:05 kjcf05n03 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 07:13:07 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47787 (bash) Nov 3 07:13:07 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 07:13:07 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 07:13:17 kjcf05n00 mcfcli[3673891]: %3|1730639597.838|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T07:13:27.253519093-06:00 level=info msg="Completed cleanup jobs" duration=26.361891ms Nov 3 07:13:28 kjcf05n00 mcfcli[3673891]: %3|1730639608.229|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:13:53 kjcf05n00 mcfcli[3673891]: %3|1730639633.856|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:13:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730639634}"] Nov 3 07:13:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730639634, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:13:54 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:54-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:54 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:54-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:54 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:54-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:54 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:54-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:54 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:54-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:54 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:54-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:54 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:54-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.33885ms Nov 3 07:13:54 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:54-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.33885ms Nov 3 07:13:54 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:13:54 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:13:54 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:13:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730639634}"] Nov 3 07:13:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730639634, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:13:54 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:54-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:54 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:54-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:54 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:54-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:54 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:54-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:54 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:54-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:54 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:54-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:54 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:54-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.849193ms Nov 3 07:13:54 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:54-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.849193ms Nov 3 07:13:54 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:13:54 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:13:54 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:13:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730639634}"] Nov 3 07:13:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730639634, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:13:54 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:54-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:54 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:54-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:54 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:54-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:54 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:54-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:54 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:54-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:54 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:54-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:54 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:54-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.913383ms Nov 3 07:13:54 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:54-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.913383ms Nov 3 07:13:54 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:13:54 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:13:54 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:13:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730639634}"] Nov 3 07:13:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730639634, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:13:54 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:54-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:54 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:54-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:54 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:54-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:54 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:54-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:54 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:54-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:54 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:54-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:54 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:54-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.033348ms Nov 3 07:13:54 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:54-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.033348ms Nov 3 07:13:54 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:13:54 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:13:54 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:13:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730639634}"] Nov 3 07:13:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730639634, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:13:54 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:54-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:54 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:54-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:54 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:54-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:54 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:54-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:54 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:54-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:54 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:54-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:54 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:54-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.992682ms Nov 3 07:13:54 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:54-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.992682ms Nov 3 07:13:54 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:13:54 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:13:54 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:13:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730639634}"] Nov 3 07:13:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730639634, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:13:54 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:54-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:54 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:54-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:54 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:54-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:54 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:54-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:54 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:54-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:54 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:54-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:54 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:54-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.281343ms Nov 3 07:13:54 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:54-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.281343ms Nov 3 07:13:54 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:13:54 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:13:54 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:13:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730639634}"] Nov 3 07:13:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730639634, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:13:55 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:55-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:55 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:55-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:55 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:55-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:55 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:55-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:55 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:55-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:55 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:55-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:55 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:55-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.786656ms Nov 3 07:13:55 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:55-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.786656ms Nov 3 07:13:55 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:13:55 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:13:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:13:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730639634}"] Nov 3 07:13:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730639634, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:13:55 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:55-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:55 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:55-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:55 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:55-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:55 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:55-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:55 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:55-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:55 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:55-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:55 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:55-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.677282ms Nov 3 07:13:55 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:55-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.677282ms Nov 3 07:13:55 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:13:55 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:13:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:13:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730639634}"] Nov 3 07:13:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730639634, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:13:55 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:55-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:55 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:55-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:55 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:55-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:55 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:55-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:55 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:55-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:55 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:55-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:55 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:55-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.84209ms Nov 3 07:13:55 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:55-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.84209ms Nov 3 07:13:55 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:13:55 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:13:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:13:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730639634}"] Nov 3 07:13:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730639634, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:13:55 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:55-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:55 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:55-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:55 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:55-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:55 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:55-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:55 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:55-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:55 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:55-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:55 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:55-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.311549ms Nov 3 07:13:55 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:55-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.311549ms Nov 3 07:13:55 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:13:55 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:13:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:13:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730639634}"] Nov 3 07:13:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730639634, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:13:55 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:55-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:55 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:55-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:13:55 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:55-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:55 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:13:55-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:55 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:55-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:13:55 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:13:55-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:13:55 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:13:55-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.934253ms Nov 3 07:13:55 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:13:55-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.934253ms Nov 3 07:13:55 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:13:55 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:13:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:13:58 kjcf05n00 mcfcli[3673891]: %3|1730639638.229|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:14:04 kjcf05n00 zabbix-server[1055540]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:14:04 kjcf05n00 zabbix-server[1055540]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n03' from event '45941' Nov 3 07:14:04 kjcf05n00 zabbix-server[1055540]: Filesystem 'kjcf05' has been mounted Nov 3 07:14:05 kjcf05n00 zabbix-server[1055540]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 07:14:05 kjcf05n00 zabbix-server[1055540]: Running puppet on 'None' Nov 3 07:14:07 kjcf05n07 puppet-agent[2557179]: Using configured environment 'production' Nov 3 07:14:07 kjcf05n07 puppet-agent[2557179]: Retrieving pluginfacts Nov 3 07:14:07 kjcf05n07 puppet-agent[2557179]: Retrieving plugin Nov 3 07:14:07 kjcf05n06 puppet-agent[2559239]: Using configured environment 'production' Nov 3 07:14:07 kjcf05n06 puppet-agent[2559239]: Retrieving pluginfacts Nov 3 07:14:07 kjcf05n06 puppet-agent[2559239]: Retrieving plugin Nov 3 07:14:07 kjcf05n03 puppet-agent[49686]: Using configured environment 'production' Nov 3 07:14:07 kjcf05n03 puppet-agent[49686]: Retrieving pluginfacts Nov 3 07:14:07 kjcf05n03 puppet-agent[49686]: Retrieving plugin Nov 3 07:14:07 kjcf05n04 puppet-agent[2562942]: Using configured environment 'production' Nov 3 07:14:07 kjcf05n04 puppet-agent[2562942]: Retrieving pluginfacts Nov 3 07:14:07 kjcf05n04 puppet-agent[2562942]: Retrieving plugin Nov 3 07:14:07 kjcf05n02 puppet-agent[109547]: Using configured environment 'production' Nov 3 07:14:07 kjcf05n02 puppet-agent[109547]: Retrieving pluginfacts Nov 3 07:14:07 kjcf05n02 puppet-agent[109547]: Retrieving plugin Nov 3 07:14:07 kjcf05n05 puppet-agent[2706927]: Using configured environment 'production' Nov 3 07:14:07 kjcf05n05 puppet-agent[2706927]: Retrieving pluginfacts Nov 3 07:14:07 kjcf05n05 puppet-agent[2706927]: Retrieving plugin Nov 3 07:14:07 kjcf05n05 puppet-agent[2706927]: Loading facts Nov 3 07:14:07 kjcf05n06 puppet-agent[2559239]: Loading facts Nov 3 07:14:07 kjcf05n03 puppet-agent[49686]: Loading facts Nov 3 07:14:08 kjcf05n07 puppet-agent[2557179]: Loading facts Nov 3 07:14:08 kjcf05n04 puppet-agent[2562942]: Loading facts Nov 3 07:14:08 kjcf05n01 puppet-agent[2961987]: Using configured environment 'production' Nov 3 07:14:08 kjcf05n01 puppet-agent[2961987]: Retrieving pluginfacts Nov 3 07:14:08 kjcf05n01 puppet-agent[2961987]: Retrieving plugin Nov 3 07:14:08 kjcf05n02 puppet-agent[109547]: Loading facts Nov 3 07:14:07 kjcf05n00 puppet-agent[1055646]: Using configured environment 'production' Nov 3 07:14:07 kjcf05n00 puppet-agent[1055646]: Retrieving pluginfacts Nov 3 07:14:07 kjcf05n00 puppet-agent[1055646]: Retrieving plugin Nov 3 07:14:08 kjcf05n01 puppet-agent[2961987]: Loading facts Nov 3 07:14:08 kjcf05n00 puppet-agent[1055646]: Loading facts Nov 3 07:14:10 kjcf05n03 puppet-agent[49686]: Caching catalog for kjcf05n03 Nov 3 07:14:10 kjcf05n03 puppet-agent[49686]: Applying configuration version '1730639648' Nov 3 07:14:10 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 07:14:10 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 07:14:12 kjcf05n01 puppet-agent[2961987]: Caching catalog for kjcf05n01 Nov 3 07:14:12 kjcf05n02 puppet-agent[109547]: Caching catalog for kjcf05n02 Nov 3 07:14:12 kjcf05n02 puppet-agent[109547]: Applying configuration version '1730639649' Nov 3 07:14:12 kjcf05n06 puppet-agent[2559239]: Caching catalog for kjcf05n06 Nov 3 07:14:12 kjcf05n06 puppet-agent[2559239]: Applying configuration version '1730639649' Nov 3 07:14:12 kjcf05n01 puppet-agent[2961987]: Applying configuration version '1730639650' Nov 3 07:14:12 kjcf05n07 puppet-agent[2557179]: Caching catalog for kjcf05n07 Nov 3 07:14:12 kjcf05n07 puppet-agent[2557179]: Applying configuration version '1730639649' Nov 3 07:14:12 kjcf05n00 puppet-agent[1055646]: Caching catalog for kjcf05n00 Nov 3 07:14:13 kjcf05n00 puppet-agent[1055646]: Applying configuration version '1730639651' Nov 3 07:14:13 kjcf05n05 puppet-agent[2706927]: Caching catalog for kjcf05n05 Nov 3 07:14:13 kjcf05n05 puppet-agent[2706927]: Applying configuration version '1730639651' Nov 3 07:14:13 kjcf05n03 puppet-agent[49686]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 07:14:13 kjcf05n03 puppet-agent[49686]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 07:14:13 kjcf05n03 puppet-agent[49686]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 07:14:13 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 07:14:13 kjcf05n03 zabbix_agent2[33172]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 07:14:13 kjcf05n03 zabbix_agent2[3176]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:14:13 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 07:14:13 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 07:14:13 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 07:14:13 kjcf05n03 puppet-agent[49686]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: Press Ctrl+C to exit. Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: Plugin support version 1.0 Nov 3 07:14:13 kjcf05n03 zabbix_agent2[50325]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 07:14:14 kjcf05n02 puppet-agent[109547]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 07:14:14 kjcf05n02 puppet-agent[109547]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 07:14:14 kjcf05n02 puppet-agent[109547]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 07:14:14 kjcf05n06 puppet-agent[2559239]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 07:14:14 kjcf05n06 puppet-agent[2559239]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 07:14:14 kjcf05n06 puppet-agent[2559239]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 07:14:14 kjcf05n07 puppet-agent[2557179]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 07:14:14 kjcf05n07 puppet-agent[2557179]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 07:14:14 kjcf05n07 puppet-agent[2557179]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 07:14:14 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 07:14:14 kjcf05n02 zabbix_agent2[50930]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 07:14:14 kjcf05n02 zabbix_agent2[3146]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:14:14 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 07:14:14 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 07:14:14 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 07:14:14 kjcf05n02 puppet-agent[109547]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: Press Ctrl+C to exit. Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: Plugin support version 1.0 Nov 3 07:14:14 kjcf05n02 zabbix_agent2[109943]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 07:14:15 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2506169]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 07:14:15 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 07:14:15 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 07:14:15 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 07:14:15 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 07:14:15 kjcf05n06 puppet-agent[2559239]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: Press Ctrl+C to exit. Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: Plugin support version 1.0 Nov 3 07:14:15 kjcf05n06 zabbix_agent2[2559650]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 07:14:15 kjcf05n01 puppet-agent[2961987]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 07:14:15 kjcf05n01 puppet-agent[2961987]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-06:54:15]/mode) mode changed '0755' to '0750' Nov 3 07:14:15 kjcf05n01 puppet-agent[2961987]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-06:54:15/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 07:14:15 kjcf05n01 puppet-agent[2961987]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-06:54:15/vmcore]/mode) mode changed '0600' to '0640' Nov 3 07:14:15 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 07:14:15 kjcf05n01 puppet-agent[2961987]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-06:54:15/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 07:14:15 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 07:14:15 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 07:14:15 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2504151]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 07:14:15 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 07:14:15 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 07:14:15 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 07:14:15 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 07:14:15 kjcf05n07 puppet-agent[2557179]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: Press Ctrl+C to exit. Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: Plugin support version 1.0 Nov 3 07:14:15 kjcf05n07 zabbix_agent2[2557656]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 07:14:15 kjcf05n05 puppet-agent[2706927]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 07:14:15 kjcf05n05 puppet-agent[2706927]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 07:14:15 kjcf05n05 puppet-agent[2706927]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 07:14:16 kjcf05n01 puppet-agent[2961987]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 07:14:16 kjcf05n01 puppet-agent[2961987]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 07:14:16 kjcf05n01 puppet-agent[2961987]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 07:14:15 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 07:14:15 kjcf05n00 puppet-agent[1055646]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 07:14:16 kjcf05n03 puppet-agent[49686]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 07:14:16 kjcf05n03 puppet-agent[49686]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 07:14:16 kjcf05n03 puppet-agent[49686]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 07:14:16 kjcf05n03 puppet-agent[49686]: Applied catalog in 5.80 seconds Nov 3 07:14:16 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2648344]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 07:14:16 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 07:14:16 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 07:14:16 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 07:14:16 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 07:14:16 kjcf05n05 puppet-agent[2706927]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: Press Ctrl+C to exit. Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: Plugin support version 1.0 Nov 3 07:14:16 kjcf05n05 zabbix_agent2[2707623]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 07:14:16 kjcf05n02 puppet-agent[109547]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 07:14:16 kjcf05n02 puppet-agent[109547]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 07:14:16 kjcf05n02 puppet-agent[109547]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 07:14:16 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2949368]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 07:14:16 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 07:14:16 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 07:14:16 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 07:14:16 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 07:14:16 kjcf05n01 puppet-agent[2961987]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: Press Ctrl+C to exit. Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: Plugin support version 1.0 Nov 3 07:14:16 kjcf05n01 zabbix_agent2[2962356]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 07:14:16 kjcf05n06 puppet-agent[2559239]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 07:14:16 kjcf05n06 puppet-agent[2559239]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 07:14:16 kjcf05n06 puppet-agent[2559239]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 07:14:16 kjcf05n06 puppet-agent[2559239]: Applied catalog in 4.78 seconds Nov 3 07:14:17 kjcf05n07 puppet-agent[2557179]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 07:14:17 kjcf05n07 puppet-agent[2557179]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 07:14:17 kjcf05n07 puppet-agent[2557179]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 07:14:17 kjcf05n02 puppet-agent[109547]: Applied catalog in 5.05 seconds Nov 3 07:14:16 kjcf05n00 puppet-agent[1055646]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 07:14:16 kjcf05n00 puppet-agent[1055646]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 07:14:16 kjcf05n00 puppet-agent[1055646]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 07:14:17 kjcf05n07 puppet-agent[2557179]: Applied catalog in 4.89 seconds Nov 3 07:14:17 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1036467]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 07:14:17 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 07:14:17 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 07:14:17 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 07:14:17 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 07:14:17 kjcf05n00 puppet-agent[1055646]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: Press Ctrl+C to exit. Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: Plugin support version 1.0 Nov 3 07:14:17 kjcf05n00 zabbix_agent2[1056114]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 07:14:17 kjcf05n00 zabbix-server[1056138]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:14:18 kjcf05n05 puppet-agent[2706927]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 07:14:18 kjcf05n05 puppet-agent[2706927]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 07:14:18 kjcf05n05 puppet-agent[2706927]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 07:14:18 kjcf05n05 puppet-agent[2706927]: Applied catalog in 4.87 seconds Nov 3 07:14:18 kjcf05n01 puppet-agent[2961987]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_070123.log]/mode) mode changed '0644' to '0640' Nov 3 07:14:18 kjcf05n01 puppet-agent[2961987]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_071307.log]/mode) mode changed '0644' to '0640' Nov 3 07:14:18 kjcf05n00 zabbix-server[1056139]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:14:18 kjcf05n00 zabbix-server[1056150]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:14:19 kjcf05n00 zabbix-server[1056154]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:14:19 kjcf05n01 puppet-agent[2961987]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_070123.log]/mode) mode changed '0644' to '0640' Nov 3 07:14:19 kjcf05n01 puppet-agent[2961987]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_071307.log]/mode) mode changed '0644' to '0640' Nov 3 07:14:19 kjcf05n01 puppet-agent[2961987]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_071307]/mode) mode changed '0755' to '0750' Nov 3 07:14:19 kjcf05n01 puppet-agent[2961987]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_071307/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 07:14:19 kjcf05n01 puppet-agent[2961987]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 07:14:19 kjcf05n01 puppet-agent[2961987]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 07:14:19 kjcf05n01 puppet-agent[2961987]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 07:14:19 kjcf05n00 puppet-agent[1055646]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 07:14:20 kjcf05n01 puppet-agent[2961987]: Applied catalog in 8.68 seconds Nov 3 07:14:20 kjcf05n00 puppet-agent[1055646]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 07:14:20 kjcf05n00 puppet-agent[1055646]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 07:14:20 kjcf05n00 puppet-agent[1055646]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 07:14:21 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 07:14:21 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 07:14:21 kjcf05n00 puppet-agent[1055646]: Applied catalog in 8.48 seconds Nov 3 07:14:24 kjcf05n04 puppet-agent[2562942]: Caching catalog for kjcf05n04 Nov 3 07:14:24 kjcf05n04 puppet-agent[2562942]: Applying configuration version '1730639663' Nov 3 07:14:26 kjcf05n04 puppet-agent[2562942]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 07:14:26 kjcf05n04 puppet-agent[2562942]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 07:14:26 kjcf05n04 puppet-agent[2562942]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 07:14:27 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2503768]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 07:14:27 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 07:14:27 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 07:14:27 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 07:14:27 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 07:14:27 kjcf05n04 puppet-agent[2562942]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: Press Ctrl+C to exit. Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: Plugin support version 1.0 Nov 3 07:14:27 kjcf05n04 zabbix_agent2[2564138]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 07:14:28 kjcf05n00 mcfcli[3673891]: %3|1730639668.229|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:14:29 kjcf05n04 puppet-agent[2562942]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 07:14:29 kjcf05n04 puppet-agent[2562942]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 07:14:29 kjcf05n04 puppet-agent[2562942]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 07:14:29 kjcf05n04 puppet-agent[2562942]: Applied catalog in 4.71 seconds Nov 3 07:14:29 kjcf05n00 zabbix-server[1055540]: puppet completed status:(0): '' Nov 3 07:14:29 kjcf05n00 zabbix-server[1055540]: Event '45941' acknowledged Nov 3 07:14:29 kjcf05n00 zabbix-server[1055540]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n03"}' Nov 3 07:14:33 kjcf05n00 mcfcli[3673891]: %3|1730639673.227|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:14:58 kjcf05n00 mcfcli[3673891]: %3|1730639698.230|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 07:15:04 kjcf05n00 python3.9[1056678]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 07:15:05 kjcf05n00 mcfcli[3673891]: %3|1730639705.069|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:15:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730639718', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 07:15:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730639718'} Nov 3 07:15:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:15:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730639718', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 07:15:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730639718'} Nov 3 07:15:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:15:22 kjcf05n00 zabbix-server[1057257]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:15:22 kjcf05n00 zabbix-server[1057257]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 124.56\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 82.22\\"}}"' Nov 3 07:15:22 kjcf05n00 log_interesting_event.py[1057257]: Event '45942' acknowledged Nov 3 07:15:28 kjcf05n00 mcfcli[3673891]: %3|1730639728.231|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 07:15:43 kjcf05n00 mcfcli[3673891]: %3|1730639743.139|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:15:58 kjcf05n00 mcfcli[3673891]: %3|1730639758.231|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 07:16:20 kjcf05n00 mcfcli[3673891]: %3|1730639780.967|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:16:28 kjcf05n00 mcfcli[3673891]: %3|1730639788.232|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:16:58 kjcf05n00 mcfcli[3673891]: %3|1730639818.233|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:16:59 kjcf05n00 mcfcli[3673891]: %3|1730639819.482|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:17:25 kjcf05n03 dwd[5195]: nvme20n1 passed periodic SMART status check Nov 3 07:17:25 kjcf05n03 dwd[5195]: nvme10n1 passed periodic SMART status check Nov 3 07:17:25 kjcf05n03 dwd[5195]: nvme21n1 passed periodic SMART status check Nov 3 07:17:25 kjcf05n03 dwd[5195]: nvme11n1 passed periodic SMART status check Nov 3 07:17:25 kjcf05n03 dwd[5195]: nvme15n1 passed periodic SMART status check Nov 3 07:17:26 kjcf05n03 dwd[5195]: nvme12n1 passed periodic SMART status check Nov 3 07:17:26 kjcf05n03 dwd[5195]: nvme6n1 passed periodic SMART status check Nov 3 07:17:26 kjcf05n03 dwd[5195]: nvme16n1 passed periodic SMART status check Nov 3 07:17:26 kjcf05n03 dwd[5195]: nvme7n1 passed periodic SMART status check Nov 3 07:17:26 kjcf05n03 dwd[5195]: nvme5n1 passed periodic SMART status check Nov 3 07:17:26 kjcf05n03 dwd[5195]: nvme22n1 passed periodic SMART status check Nov 3 07:17:28 kjcf05n00 mcfcli[3673891]: %3|1730639848.233|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 07:17:38 kjcf05n00 mcfcli[3673891]: %3|1730639858.018|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:17:58 kjcf05n00 mcfcli[3673891]: %3|1730639878.233|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:18:15 kjcf05n00 mcfcli[3673891]: %3|1730639895.893|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:18:28 kjcf05n00 mcfcli[3673891]: %3|1730639908.235|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:18:55 kjcf05n00 mcfcli[3673891]: %3|1730639935.890|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:18:58 kjcf05n00 mcfcli[3673891]: %3|1730639938.235|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:19:28 kjcf05n00 mcfcli[3673891]: %3|1730639968.235|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:19:35 kjcf05n00 mcfcli[3673891]: %3|1730639975.824|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:19:58 kjcf05n00 mcfcli[3673891]: %3|1730639998.236|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 07:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 07:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 07:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 07:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 07:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 07:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 07:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 07:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 07:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 07:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 07:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 07:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 07:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 07:20:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 07:20:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:20:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 07:20:05 kjcf05n00 python3.9[1059695]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 07:20:15 kjcf05n00 mcfcli[3673891]: %3|1730640015.821|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:20:28 kjcf05n00 mcfcli[3673891]: %3|1730640028.236|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 07:20:52 kjcf05n00 mcfcli[3673891]: %3|1730640052.386|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:20:58 kjcf05n00 mcfcli[3673891]: %3|1730640058.237|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 07:21:28 kjcf05n00 mcfcli[3673891]: %3|1730640088.237|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:21:31 kjcf05n00 mcfcli[3673891]: %3|1730640091.292|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:21:58 kjcf05n00 mcfcli[3673891]: %3|1730640118.238|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:22:09 kjcf05n00 mcfcli[3673891]: %3|1730640129.942|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:22:10 kjcf05n02 nslcd[6910]: [e87ccd] ldap_result() failed: Can't contact LDAP server Nov 3 07:22:28 kjcf05n00 mcfcli[3673891]: %3|1730640148.238|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:22:49 kjcf05n00 mcfcli[3673891]: %3|1730640169.265|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:22:58 kjcf05n00 mcfcli[3673891]: %3|1730640178.238|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 07:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T13:23:15.868362Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 07:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T13:23:15.868439Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.095ms Nov 3 07:23:26 kjcf05n00 mcfcli[3673891]: %3|1730640206.479|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T07:23:27.246942147-06:00 level=info msg="Completed cleanup jobs" duration=20.536721ms Nov 3 07:23:28 kjcf05n00 mcfcli[3673891]: %3|1730640208.240|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:23:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 07:23:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 07:23:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 07:23:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 07:23:58 kjcf05n00 mcfcli[3673891]: %3|1730640238.240|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:23:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 07:23:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 07:24:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 07:24:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 07:24:06 kjcf05n00 mcfcli[3673891]: %3|1730640246.433|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:24:09 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 3 07:24:09 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 10 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007616 sec, idle for 1 hour(s)] Nov 3 07:24:12 kjcf05n00 zabbix_server[15742]: Zabbix agent item "dcs.lustre.device.ost.count[{$LUSTRE_FS_NAME}]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 3 07:24:12 kjcf05n00 zabbix_server[15724]: Zabbix agent item "vfs.fs.inode[/var/lib/reboot_cnt,pfree]" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 3 07:24:16 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='105', error='Connection reset by peer (104)' Nov 3 07:24:16 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='105', client='AF_INET(172.16.2.5:37809)', local='AF_INET(0.0.0.0:601)' Nov 3 07:24:17 kjcf05n03 fstonithd.py[15381]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 3 07:24:18 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 07:24:18 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 07:24:18 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 07:24:19 kjcf05n03 root[67291]: is_viking_off starts Nov 3 07:24:19 kjcf05n03 root[67292]: is_enc_ipmi_off starts Nov 3 07:24:19 kjcf05n03 root[67312]: is_lan_ipmi_off leaves Nov 3 07:24:19 kjcf05n03 root[67314]: is_lan_ipmi_sec_off leaves Nov 3 07:24:19 kjcf05n03 root[67328]: I am in slot 1; partner is in slot 0 Nov 3 07:24:19 kjcf05n03 root[67332]: I am not master; I will get master Nov 3 07:24:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 07:24:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 07:24:22 kjcf05n00 zabbix-server[1062000]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:24:22 kjcf05n00 zabbix-server[1062000]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 106.92\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 81.77\\"}}"' Nov 3 07:24:23 kjcf05n00 log_interesting_event.py[1062000]: Event '45944' acknowledged Nov 3 07:24:24 kjcf05n03 root[67468]: I am now master Nov 3 07:24:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 07:24:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 07:24:26 kjcf05n03 root[67508]: is_viking_off leaves Nov 3 07:24:26 kjcf05n03 root[67511]: kjcf05n02 not already off look at kdump Nov 3 07:24:26 kjcf05n03 root[67512]: is_kdump_off starts Nov 3 07:24:26 kjcf05n03 fence_kdump[67513]: waiting for message from '172.16.2.5' Nov 3 07:24:26 kjcf05n03 fence_kdump[67513]: received valid message from '172.16.2.5' Nov 3 07:24:26 kjcf05n03 root[67514]: is_kdump_off detected kdump on kjcf05n02 Nov 3 07:24:26 kjcf05n03 root[67515]: kjcf05n02 is kdumping Nov 3 07:24:27 kjcf05n03 root[67603]: is_enc_ipmi_off starts Nov 3 07:24:27 kjcf05n03 root[67604]: is_viking_off starts Nov 3 07:24:27 kjcf05n03 root[67633]: is_lan_ipmi_off leaves Nov 3 07:24:27 kjcf05n03 root[67635]: is_lan_ipmi_sec_off leaves Nov 3 07:24:27 kjcf05n03 root[67643]: I am in slot 1; partner is in slot 0 Nov 3 07:24:27 kjcf05n03 root[67645]: I am master Nov 3 07:24:27 kjcf05n00 zabbix_server[15783]: Zabbix agent item "net.if.in["ib1",dropped]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 07:24:27 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0001,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 07:24:28 kjcf05n00 mcfcli[3673891]: %3|1730640268.240|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 07:24:32 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 07:24:32 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 07:24:34 kjcf05n03 root[67887]: is_viking_off leaves Nov 3 07:24:34 kjcf05n03 root[67890]: kjcf05n02 not already off look at kdump Nov 3 07:24:34 kjcf05n03 root[67891]: is_kdump_off starts Nov 3 07:24:34 kjcf05n03 fence_kdump[67892]: waiting for message from '172.16.2.5' Nov 3 07:24:34 kjcf05n03 fence_kdump[67892]: received valid message from '172.16.2.5' Nov 3 07:24:34 kjcf05n03 root[67893]: is_kdump_off detected kdump on kjcf05n02 Nov 3 07:24:34 kjcf05n03 root[67894]: kjcf05n02 is kdumping Nov 3 07:24:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 07:24:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 07:24:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 07:24:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 07:24:38 kjcf05n03 systemd-udevd[70148]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:24:38 kjcf05n03 systemd-udevd[70150]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:24:38 kjcf05n03 systemd-udevd[70149]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:24:38 kjcf05n03 systemd-udevd[70154]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:24:38 kjcf05n03 systemd-udevd[70148]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:24:38 kjcf05n03 systemd-udevd[70150]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:24:38 kjcf05n03 systemd-udevd[70149]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:24:38 kjcf05n03 systemd-udevd[70148]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 07:24:38 kjcf05n03 systemd-udevd[70154]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:24:38 kjcf05n03 systemd-udevd[70150]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 07:24:38 kjcf05n03 systemd-udevd[70149]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 07:24:38 kjcf05n03 systemd-udevd[70148]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 07:24:38 kjcf05n03 systemd-udevd[70154]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 07:24:38 kjcf05n03 systemd-udevd[70149]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 07:24:38 kjcf05n03 systemd-udevd[70150]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 07:24:38 kjcf05n03 systemd-udevd[70148]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:24:38 kjcf05n03 systemd-udevd[70154]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 07:24:38 kjcf05n03 systemd-udevd[70150]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:24:38 kjcf05n03 systemd-udevd[70149]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:24:38 kjcf05n03 systemd-udevd[70148]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70154]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70150]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70149]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70148]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70154]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70150]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70178]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70149]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70154]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70148]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70180]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70182]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70178]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70150]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70186]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70154]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70149]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70182]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70180]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70150]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70186]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70182]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70150]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70150]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70154]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70150]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70150]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70186]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70182]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70149]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70150]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70154]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70186]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70150]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70154]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70150]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70150]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70154]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70150]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70154]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70150]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70154]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70150]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 systemd-udevd[70150]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:24:39 kjcf05n03 dwd[5195]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 07:24:39 kjcf05n03 dwd[5195]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 07:24:39 kjcf05n03 dwd[5195]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 07:24:39 kjcf05n03 dwd[5195]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 07:24:39 kjcf05n03 dwd[5195]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 07:24:39 kjcf05n03 dwd[5195]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 07:24:39 kjcf05n03 dwd[5195]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 07:24:39 kjcf05n03 dwd[5195]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 07:24:39 kjcf05n03 dwd[5195]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 07:24:39 kjcf05n03 dwd[5195]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 07:24:39 kjcf05n03 dwd[5195]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 07:24:39 kjcf05n03 dwd[5195]: Starting NVME thread for nvme25n1 Nov 3 07:24:39 kjcf05n03 dwd[5195]: Starting NVME thread for nvme8n1 Nov 3 07:24:39 kjcf05n03 dwd[5195]: Starting NVME thread for nvme18n1 Nov 3 07:24:39 kjcf05n03 dwd[5195]: Starting NVME thread for nvme23n1 Nov 3 07:24:40 kjcf05n03 dwd[5195]: Starting NVME thread for nvme9n1 Nov 3 07:24:40 kjcf05n03 dwd[5195]: Starting NVME thread for nvme4n1 Nov 3 07:24:40 kjcf05n03 dwd[5195]: Starting NVME thread for nvme2n1 Nov 3 07:24:40 kjcf05n03 dwd[5195]: Starting NVME thread for nvme3n1 Nov 3 07:24:40 kjcf05n03 dwd[5195]: Starting NVME thread for nvme19n1 Nov 3 07:24:40 kjcf05n03 dwd[5195]: Starting NVME thread for nvme17n1 Nov 3 07:24:40 kjcf05n03 dwd[5195]: Starting NVME thread for nvme24n1 Nov 3 07:24:42 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0000,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 07:24:42 kjcf05n00 zabbix_server[15783]: Zabbix agent item "net.if.in["meth0",dropped]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 07:24:42 kjcf05n03 diskmonitor[17713]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 07:24:46 kjcf05n00 mcfcli[3673891]: %3|1730640286.197|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:24:54 kjcf05n03 diskmonitor[17713]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 07:24:54 kjcf05n03 diskmonitor[17713]: Scan for ReadErrorMax change for md65 Nov 3 07:24:54 kjcf05n03 diskmonitor[17713]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 07:24:54 kjcf05n03 diskmonitor[17713]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 07:24:54 kjcf05n03 diskmonitor[17713]: read_saved_file: md65 no saved speed Nov 3 07:24:54 kjcf05n03 diskmonitor[17713]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 07:24:54 kjcf05n03 diskmonitor[17713]: Set sync_speed_min (10000) for md65 Nov 3 07:24:54 kjcf05n03 diskmonitor[17713]: Set sync_speed_max (200000) for md65 Nov 3 07:24:54 kjcf05n03 diskmonitor[17713]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 07:24:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 07:24:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 07:24:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 07:24:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 07:24:57 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 3 07:24:57 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 3 07:24:58 kjcf05n00 mcfcli[3673891]: %3|1730640298.240|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 07:24:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 07:24:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 07:24:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 07:24:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 07:25:03 kjcf05n00 python3.9[1062483]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 07:25:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730640317', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 07:25:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730640317'} Nov 3 07:25:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:25:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 07:25:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 07:25:25 kjcf05n00 mcfcli[3673891]: %3|1730640325.075|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:25:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 07:25:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 07:25:28 kjcf05n00 mcfcli[3673891]: %3|1730640328.241|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 07:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 07:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 07:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 07:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 07:25:50 kjcf05n03 nslcd[6947]: ldap_result() failed: Can't contact LDAP server Nov 3 07:25:50 kjcf05n03 nslcd[6947]: (re)loading /etc/nsswitch.conf Nov 3 07:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 07:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 07:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 07:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 07:25:58 kjcf05n00 mcfcli[3673891]: %3|1730640358.241|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 07:25:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 07:25:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 07:25:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 07:25:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 07:26:04 kjcf05n00 mcfcli[3673891]: %3|1730640364.866|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:26:21 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 07:26:21 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 07:26:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730640384}"] Nov 3 07:26:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730640384, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:26:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.563871ms Nov 3 07:26:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.563871ms Nov 3 07:26:24 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:26:24 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:26:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:26:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730640384}"] Nov 3 07:26:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730640384, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:26:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.089243ms Nov 3 07:26:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.089243ms Nov 3 07:26:24 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:26:24 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:26:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:26:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730640384}"] Nov 3 07:26:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730640384, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:26:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.832892ms Nov 3 07:26:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.832892ms Nov 3 07:26:24 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:26:24 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:26:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:26:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730640384}"] Nov 3 07:26:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730640384, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:26:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.973095ms Nov 3 07:26:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.973095ms Nov 3 07:26:25 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:26:25 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:26:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:26:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730640384}"] Nov 3 07:26:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730640384, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:26:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.059778ms Nov 3 07:26:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.059778ms Nov 3 07:26:25 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:26:25 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:26:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:26:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730640384}"] Nov 3 07:26:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730640384, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:26:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.745151ms Nov 3 07:26:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.745151ms Nov 3 07:26:25 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:26:25 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:26:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:26:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730640384}"] Nov 3 07:26:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730640384, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:26:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.429389ms Nov 3 07:26:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.429389ms Nov 3 07:26:25 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:26:25 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:26:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:26:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730640385}"] Nov 3 07:26:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730640385, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:26:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.08268ms Nov 3 07:26:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.08268ms Nov 3 07:26:25 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:26:25 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:26:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:26:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730640385}"] Nov 3 07:26:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730640385, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:26:26 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:26-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:26 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:26-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:26 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:26-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:26 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:26-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:26 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:26-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:26 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:26-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:26 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:26-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.581602ms Nov 3 07:26:26 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:26-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.581602ms Nov 3 07:26:26 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:26:26 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:26:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:26:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730640385}"] Nov 3 07:26:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730640385, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:26:26 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:26-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:26 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:26-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:26 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:26-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:26 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:26-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:26 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:26-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:26 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:26-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 07:26:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 07:26:26 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:26-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.935544ms Nov 3 07:26:26 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:26-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.935544ms Nov 3 07:26:26 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:26:26 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:26:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:26:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730640385}"] Nov 3 07:26:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730640385, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:26:26 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:26-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:26 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:26-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:26:26 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:26-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:26 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:26:26-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:26 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:26-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:26:26 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:26:26-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:26:26 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:26:26-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.807097ms Nov 3 07:26:26 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:26:26-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.807097ms Nov 3 07:26:26 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:26:26 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:26:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:26:28 kjcf05n00 mcfcli[3673891]: %3|1730640388.241|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 07:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 07:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 07:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 07:26:42 kjcf05n00 mcfcli[3673891]: %3|1730640402.078|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 07:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 07:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 07:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 07:26:58 kjcf05n00 mcfcli[3673891]: %3|1730640418.242|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 07:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 07:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 07:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 07:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 07:27:21 kjcf05n00 mcfcli[3673891]: %3|1730640441.303|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:27:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 07:27:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 07:27:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 07:27:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 07:27:28 kjcf05n00 mcfcli[3673891]: %3|1730640448.242|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 07:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 07:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 07:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 07:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 07:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 07:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 07:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 07:27:58 kjcf05n00 mcfcli[3673891]: %3|1730640478.243|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 07:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 07:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 07:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 07:28:00 kjcf05n00 mcfcli[3673891]: %3|1730640480.164|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:28:06 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 3 07:28:06 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 07:28:10 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 07:28:10 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 3 07:28:10 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 3 07:28:10 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 07:28:10 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 07:28:10 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 3 07:28:10 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 3 07:28:10 kjcf05n00 zabbix-server[1064598]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:28:10 kjcf05n00 zabbix-server[1064598]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 07:28:10 kjcf05n00 log_interesting_event.py[1064598]: Event '45947' acknowledged Nov 3 07:28:12 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 3 07:28:15 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 3 07:28:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 07:28:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 07:28:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 07:28:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 07:28:28 kjcf05n00 mcfcli[3673891]: %3|1730640508.244|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 07:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 07:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 07:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 07:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 07:28:37 kjcf05n00 mcfcli[3673891]: %3|1730640517.337|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 07:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 07:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 07:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 07:28:58 kjcf05n00 mcfcli[3673891]: %3|1730640538.244|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 07:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 07:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 07:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 07:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 07:29:02 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:60206). Nov 3 07:29:02 kjcf05n01 rsyncd[2968177]: connect from kjcf05n02 (172.16.2.5) Nov 3 07:29:02 kjcf05n01 rsyncd[2968177]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 07:29:02 kjcf05n01 rsyncd[2968177]: building file list Nov 3 07:29:02 kjcf05n01 rsyncd[2968177]: sent 11450 bytes received 136 bytes total size 10905 Nov 3 07:29:02 kjcf05n01 systemd[1]: rsyncd@607-172.16.2.2:873-172.16.2.5:60206.service: Succeeded. Nov 3 07:29:15 kjcf05n00 mcfcli[3673891]: %3|1730640555.036|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:29:18 kjcf05n03 fstonithd.py[15381]: Listening for kdump packets from partner Nov 3 07:29:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 07:29:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 07:29:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 07:29:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 07:29:28 kjcf05n00 mcfcli[3673891]: %3|1730640568.244|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 07:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 07:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 07:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 07:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 07:29:51 kjcf05n00 mcfcli[3673891]: %3|1730640591.572|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 07:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 07:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 07:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 07:29:57 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 07:29:58 kjcf05n00 mcfcli[3673891]: %3|1730640598.245|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 07:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 07:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 07:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 07:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 07:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 07:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 07:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 07:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 07:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 07:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 07:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 07:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 07:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 07:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 07:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 07:30:00 kjcf05n06 chronyd[5469]: Selected source 16.110.135.123 Nov 3 07:30:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 07:30:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:30:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 07:30:05 kjcf05n03 dwd[5195]: nvme8n1 passed periodic SMART status check Nov 3 07:30:05 kjcf05n03 dwd[5195]: nvme25n1 passed periodic SMART status check Nov 3 07:30:05 kjcf05n03 dwd[5195]: nvme18n1 passed periodic SMART status check Nov 3 07:30:05 kjcf05n03 dwd[5195]: nvme23n1 passed periodic SMART status check Nov 3 07:30:05 kjcf05n00 python3.9[1065630]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 07:30:06 kjcf05n03 dwd[5195]: nvme4n1 passed periodic SMART status check Nov 3 07:30:06 kjcf05n03 dwd[5195]: nvme17n1 passed periodic SMART status check Nov 3 07:30:06 kjcf05n03 dwd[5195]: nvme3n1 passed periodic SMART status check Nov 3 07:30:06 kjcf05n03 dwd[5195]: nvme19n1 passed periodic SMART status check Nov 3 07:30:06 kjcf05n03 dwd[5195]: nvme2n1 passed periodic SMART status check Nov 3 07:30:06 kjcf05n03 dwd[5195]: nvme9n1 passed periodic SMART status check Nov 3 07:30:06 kjcf05n03 dwd[5195]: nvme24n1 passed periodic SMART status check Nov 3 07:30:17 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 07:30:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730640317', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 07:30:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730640317'} Nov 3 07:30:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:30:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730640618', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 07:30:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730640618'} Nov 3 07:30:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:30:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 07:30:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 07:30:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 07:30:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 07:30:28 kjcf05n00 mcfcli[3673891]: %3|1730640628.246|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 07:30:30 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='107', client='AF_INET(172.16.2.5:36039)', local='AF_INET(0.0.0.0:601)' Nov 3 07:30:30 kjcf05n02 syslog-ng[3148]: Configuration reload request received, reloading configuration; Nov 3 07:30:30 kjcf05n02 syslog-ng[3148]: Configuration reload finished; Nov 3 07:30:30 kjcf05n02 syslog-ng[3148]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 07:30:30 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 3 07:30:30 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 07:30:30 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 3 07:30:30 kjcf05n02 dracut: Self testing crypto algorithms Nov 3 07:30:30 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 3 07:30:30 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 07:30:30 kjcf05n02 Copying live image to RAM... Nov 3 07:30:30 kjcf05n02 (this may take a minute) Nov 3 07:30:30 kjcf05n02 Done copying live image to RAM. Nov 3 07:30:30 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 07:30:30 kjcf05n02 dracut: Checking integrity of kernel Nov 3 07:30:30 kjcf05n02 dracut: All initrd crypto checks done Nov 3 07:30:30 kjcf05n02 dracut: Switching root Nov 3 07:30:30 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 07:30:30 kjcf05n02 systemd: Detected architecture x86-64. Nov 3 07:30:30 kjcf05n02 systemd: Set hostname to . Nov 3 07:30:30 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 07:30:30 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 07:30:30 kjcf05n02 systemd: Reached target Swap. Nov 3 07:30:30 kjcf05n02 systemd: Reached target CXI Retry Handlers Started. Nov 3 07:30:30 kjcf05n02 systemd: Listening on Journal Socket (/dev/log). Nov 3 07:30:30 kjcf05n02 systemd: Listening on Journal Socket. Nov 3 07:30:30 kjcf05n02 systemd: Starting Journal Service... Nov 3 07:30:30 kjcf05n02 systemd-journald[1513]: Journal started Nov 3 07:30:30 kjcf05n02 systemd-journald[1513]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 07:30:30 kjcf05n02 systemd-modules-load[1524]: Inserted module 'fuse' Nov 3 07:30:30 kjcf05n02 systemd[1]: Mounted Temporary Directory (/tmp). Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Create list of required static device nodes for the current kernel. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Remount Root and Kernel File Systems. Nov 3 07:30:30 kjcf05n02 systemd[1]: Mounted /data. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Load Kernel Modules. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 3 07:30:30 kjcf05n02 systemd[1]: Mounted Huge Pages File System. Nov 3 07:30:30 kjcf05n02 systemd[1]: Mounted POSIX Message Queue File System. Nov 3 07:30:30 kjcf05n02 systemd[1]: Mounted /WIBS. Nov 3 07:30:30 kjcf05n02 systemd[1]: Mounted Kernel Debug File System. Nov 3 07:30:30 kjcf05n02 systemd[1]: Mounted /mnt. Nov 3 07:30:30 kjcf05n02 systemd[1]: Mounting Kernel Configuration File System... Nov 3 07:30:30 kjcf05n02 systemd[1]: Mounting FUSE Control File System... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Apply Kernel Variables... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Rebuild Hardware Database... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Create System Users... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Load/Save Random Seed... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 07:30:30 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 3 07:30:30 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 3 07:30:30 kjcf05n02 systemd-sysctl[1550]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 07:30:30 kjcf05n02 systemd-sysctl[1550]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Create System Users. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 07:30:30 kjcf05n02 systemd-journald[1513]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 07:30:30 kjcf05n02 systemd-tmpfiles[1559]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 07:30:30 kjcf05n02 systemd-tmpfiles[1559]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 3 07:30:30 kjcf05n02 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 3 07:30:30 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 3 07:30:30 kjcf05n02 systemd-udevd[1593]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:30:30 kjcf05n02 systemd-udevd[1628]: Using default interface naming scheme 'rhel-8.0'. Nov 3 07:30:30 kjcf05n02 systemd-udevd[1628]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:30:30 kjcf05n02 systemd-udevd[1589]: Using default interface naming scheme 'rhel-8.0'. Nov 3 07:30:30 kjcf05n02 systemd-udevd[1589]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:30:30 kjcf05n02 systemd-udevd[1586]: Using default interface naming scheme 'rhel-8.0'. Nov 3 07:30:30 kjcf05n02 systemd-udevd[1586]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 07:30:30 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 3 07:30:30 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 3 07:30:30 kjcf05n02 systemd-tmpfiles[1789]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 07:30:30 kjcf05n02 systemd-tmpfiles[1789]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 07:30:30 kjcf05n02 root[1802]: openibd: running in auto mode Nov 3 07:30:30 kjcf05n02 systemd-tmpfiles[1789]: "/var/tmp" already exists and is not a directory. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started RPC Bind. Nov 3 07:30:30 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 07:30:30 kjcf05n02 systemd-modules-load[1870]: Inserted module 'ib_iser' Nov 3 07:30:30 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 3 07:30:30 kjcf05n02 systemd-modules-load[1870]: Inserted module 'ib_isert' Nov 3 07:30:30 kjcf05n02 systemd-modules-load[1870]: Inserted module 'ib_srpt' Nov 3 07:30:30 kjcf05n02 systemd-modules-load[1871]: Inserted module 'ib_ipoib' Nov 3 07:30:30 kjcf05n02 systemd-udevd[1593]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:30:30 kjcf05n02 systemd-udevd[1631]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:30:30 kjcf05n02 systemd-modules-load[1870]: Inserted module 'rdma_ucm' Nov 3 07:30:30 kjcf05n02 systemd-modules-load[1870]: Module 'svcrdma' is blacklisted Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 07:30:30 kjcf05n02 systemd-udevd[1593]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 07:30:30 kjcf05n02 systemd-udevd[1631]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 07:30:30 kjcf05n02 systemd-modules-load[1871]: Inserted module 'ib_umad' Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 07:30:30 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 3 07:30:30 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 3 07:30:30 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 07:30:30 kjcf05n02 systemd[3148]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:30 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 07:30:30 kjcf05n02 openibd[1784]: Loading HCA driver and Access Layer:[ OK ] Nov 3 07:30:30 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Update is Completed. Nov 3 07:30:30 kjcf05n02 setup-icl[1772]: Setting LAN IP Address to 203.0.113.3 Nov 3 07:30:30 kjcf05n02 setup-icl[1772]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 07:30:30 kjcf05n02 setup-icl[1772]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 07:30:30 kjcf05n02 setup-icl[1772]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 07:30:30 kjcf05n02 systemd-udevd[1593]: Using default interface naming scheme 'rhel-8.0'. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 07:30:30 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 3 07:30:30 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 3 07:30:30 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 07:30:30 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 07:30:30 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 07:30:30 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 07:30:30 kjcf05n02 systemd[1]: Reached target Sockets. Nov 3 07:30:30 kjcf05n02 systemd[1]: Reached target Basic System. Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 07:30:30 kjcf05n02 network[2116]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 07:30:30 kjcf05n02 network[2132]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 07:30:30 kjcf05n02 network[2116]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 0 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 1 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 2 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 3 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 4 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 5 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 6 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 7 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 8 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 9 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 10 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 11 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 12 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 13 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 14 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 15 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 16 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 17 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 18 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 19 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 20 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 21 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 22 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 23 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 24 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 25 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 26 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 27 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 28 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 29 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 30 Nov 3 07:30:30 kjcf05n02 cpupower[2138]: Setting cpu: 31 Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 07:30:30 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 3 07:30:30 kjcf05n02 dwd[2137]: dwd: vMay 29 2024 : 15:38:26 Nov 3 07:30:30 kjcf05n02 dwd[2137]: /usr/sbin/dwd -d --standalone=0 Nov 3 07:30:30 kjcf05n02 dwd[2137]: dwd: option Lethal: 0 Nov 3 07:30:30 kjcf05n02 dwd[2137]: dwd: option Interval: 60 Nov 3 07:30:30 kjcf05n02 dwd[2137]: dwd: option abrtlimit: 10 Nov 3 07:30:30 kjcf05n02 dwd[2137]: dwd: option DZPeriod: 604800 Nov 3 07:30:30 kjcf05n02 dwd[2137]: dwd: option SmartPeriod: 43200 Nov 3 07:30:30 kjcf05n02 dwd[2137]: dwd: option SDDEnabled: 1 Nov 3 07:30:30 kjcf05n02 dwd[2137]: dwd: option SDDAwaitScale: 3 Nov 3 07:30:30 kjcf05n02 dwd[2137]: dwd: option SDDAwaitMin: 100 Nov 3 07:30:30 kjcf05n02 dwd[2137]: dwd: option Verbosity: 1 Nov 3 07:30:30 kjcf05n02 dwd[2137]: dwd: option StandAlone: 0 Nov 3 07:30:30 kjcf05n02 dwd[2137]: option Lethal: 0 Nov 3 07:30:30 kjcf05n02 dwd[2137]: option Interval: 60 Nov 3 07:30:30 kjcf05n02 dwd[2137]: option abrtlimit: 10 Nov 3 07:30:30 kjcf05n02 dwd[2137]: option DZPeriod: 604800 Nov 3 07:30:30 kjcf05n02 dwd[2137]: option SmartPeriod: 43200 Nov 3 07:30:30 kjcf05n02 dwd[2137]: option SDDEnabled: 1 Nov 3 07:30:30 kjcf05n02 dwd[2137]: option SDDAwaitScale: 3 Nov 3 07:30:30 kjcf05n02 dwd[2137]: option SDDAwaitMin: 100 Nov 3 07:30:30 kjcf05n02 dwd[2137]: option Verbosity: 1 Nov 3 07:30:30 kjcf05n02 dwd[2137]: option StandAlone: 0 Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 3 07:30:30 kjcf05n02 network[2140]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:30:30 kjcf05n02 network[2116]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 07:30:30 kjcf05n02 nscd[2155]: 2155 monitoring file `/etc/hosts` (1) Nov 3 07:30:30 kjcf05n02 nscd[2155]: 2155 monitoring directory `/etc` (2) Nov 3 07:30:30 kjcf05n02 nscd[2155]: 2155 monitoring file `/etc/resolv.conf` (3) Nov 3 07:30:30 kjcf05n02 nscd[2155]: 2155 monitoring directory `/etc` (2) Nov 3 07:30:30 kjcf05n02 chronyd[2165]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 3 07:30:30 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 07:30:30 kjcf05n02 network[2153]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 07:30:30 kjcf05n02 dbus-daemon[2148]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 07:30:30 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 07:30:30 kjcf05n02 mcelog[2195]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 07:30:30 kjcf05n02 mcelog[2195]: CPU is unsupported Nov 3 07:30:30 kjcf05n02 beSetMlxConfig[2176]: ConnectX-3 multiport not detected Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[2181]: Setting up Mellanox network interface: ib0 Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 07:30:30 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 07:30:30 kjcf05n02 chronyd[2165]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 07:30:30 kjcf05n02 chronyd[2165]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[2217]: Setting up Mellanox network interface: ib1 Nov 3 07:30:30 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 0 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 1 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 2 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 3 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 4 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 5 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 6 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 7 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 8 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 9 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 10 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 11 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 12 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 13 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 14 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 15 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 16 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 17 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 18 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 19 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 20 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 21 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 22 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 23 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 24 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 25 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 26 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 27 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 28 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 29 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 30 Nov 3 07:30:30 kjcf05n02 cpupower[2245]: Idlestate 2 disabled on CPU 31 Nov 3 07:30:30 kjcf05n02 mdraid-phy[2226]: no Cutlass to worry about Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 07:30:30 kjcf05n02 sssd[sssd][2121]: Starting up Nov 3 07:30:30 kjcf05n02 beSetMlxConfig[2176]: Starting MST (Mellanox Software Tools) driver set Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[2296]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 07:30:30 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 07:30:30 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 07:30:30 kjcf05n02 dbus-daemon[2148]: [system] Successfully activated service 'org.freedesktop.systemd1' Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[2299]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[2314]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 07:30:30 kjcf05n02 beSetMlxConfig[2176]: Loading MST PCI module - Success Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[2324]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[2328]: No configuration found for ib0 Nov 3 07:30:30 kjcf05n02 beSetMlxConfig[2176]: Loading MST PCI configuration module - Success Nov 3 07:30:30 kjcf05n02 beSetMlxConfig[2176]: Create devices Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[2332]: No configuration found for ib1 Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[2337]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[2344]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 07:30:30 kjcf05n02 mlnx_conf_mgr[2385]: INFO: No configurations found for mlx5_0, skipping. Nov 3 07:30:30 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 07:30:30 kjcf05n02 mlnx_conf_mgr[2409]: INFO: No configurations found for mlx5_1, skipping. Nov 3 07:30:30 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 07:30:30 kjcf05n02 sssd[be[implicit_files]][2317]: Starting up Nov 3 07:30:30 kjcf05n02 sssd[nss][2467]: Starting up Nov 3 07:30:30 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 07:30:30 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Login Service... Nov 3 07:30:30 kjcf05n02 systemd-logind[2572]: New seat seat0. Nov 3 07:30:30 kjcf05n02 systemd-logind[2572]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Login Service. Nov 3 07:30:30 kjcf05n02 python3.9[2218]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 07:30:30 kjcf05n02 python3.9[3148]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 07:30:30 kjcf05n02 systemd-sysctl[2759]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 07:30:30 kjcf05n02 systemd-sysctl[2759]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 07:30:30 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 07:30:30 kjcf05n02 python3.9[2889]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 07:30:30 kjcf05n02 python3.9[3148]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 07:30:30 kjcf05n02 network[2116]: Bringing up loopback interface: [ OK ] Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 07:30:30 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 07:30:30 kjcf05n02 systemd-sysctl[3089]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 07:30:30 kjcf05n02 systemd-sysctl[3089]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 07:30:30 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 3 07:30:30 kjcf05n02 systemd[1]: Reached target Network. Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 07:30:30 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 07:30:30 kjcf05n02 sm-notify[3139]: Version 2.3.3 starting Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 07:30:30 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 07:30:30 kjcf05n02 python3.9[3083]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 07:30:30 kjcf05n02 python3.9[3148]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 07:30:30 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 3 07:30:30 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 07:30:30 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 3 07:30:30 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 3 07:30:30 kjcf05n02 lldpad[3154]: setsockopt nearest_bridge: Invalid argument Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 3 07:30:30 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 3 07:30:30 kjcf05n02 sshd[3206]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 07:30:30 kjcf05n02 lldpad[3154]: setsockopt nearest_bridge: Invalid argument Nov 3 07:30:30 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 07:30:30 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 07:30:30 kjcf05n02 syslog-ng[3148]: [2024-11-03T13:29:15.482350] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 07:30:30 kjcf05n02 syslog-ng[3148]: [2024-11-03T13:29:15.482652] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 07:30:30 kjcf05n02 syslog-ng[3148]: [2024-11-03T13:29:15.482684] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 07:30:30 kjcf05n02 syslog-ng[3148]: [2024-11-03T13:29:15.483245] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 07:30:30 kjcf05n02 syslog-ng[3148]: [2024-11-03T13:29:15.483564] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 07:30:30 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 3 07:30:30 kjcf05n02 beSetMlxConfig[2176]: Unloading MST PCI module (unused) - Success Nov 3 07:30:30 kjcf05n02 python3.9[3214]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 07:30:30 kjcf05n02 python3.9[3148]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 07:30:30 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 07:30:30 kjcf05n02 python3.9[3441]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 07:30:30 kjcf05n02 python3.9[3148]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 07:30:30 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 07:30:30 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 07:30:30 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 07:30:30 kjcf05n02 chronyd[2165]: System's initial offset : 0.003089 seconds slow of true (slew) Nov 3 07:30:30 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 07:30:30 kjcf05n02 beSetMlxConfig[2176]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 07:30:30 kjcf05n02 beSetMlxConfig[2176]: ib mode Nov 3 07:30:30 kjcf05n02 root[3462]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 3 07:30:30 kjcf05n02 root[3464]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 3 07:30:30 kjcf05n02 beSetMlxConfig[2176]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 07:30:30 kjcf05n02 beSetMlxConfig[2176]: ib mode Nov 3 07:30:30 kjcf05n02 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 07:30:30 kjcf05n02 systemd-udevd[3478]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:30:30 kjcf05n02 systemd-udevd[3479]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:30:30 kjcf05n02 systemd-udevd[3482]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:30:30 kjcf05n02 systemd-udevd[3485]: Using default interface naming scheme 'rhel-8.0'. Nov 3 07:30:30 kjcf05n02 systemd-udevd[3485]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:30:30 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 07:30:30 kjcf05n02 systemd[3148]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:30 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[3520]: Setting up Mellanox network interface: ib1 Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[3521]: Setting up Mellanox network interface: ib0 Nov 3 07:30:30 kjcf05n02 systemd-udevd[3480]: Using default interface naming scheme 'rhel-8.0'. Nov 3 07:30:30 kjcf05n02 systemd-udevd[3481]: Using default interface naming scheme 'rhel-8.0'. Nov 3 07:30:30 kjcf05n02 systemd-udevd[3480]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:30:30 kjcf05n02 systemd-udevd[3481]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[3577]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[3578]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[3601]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[3602]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[3603]: No configuration found for ib1 Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[3604]: No configuration found for ib0 Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[3611]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[3612]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 07:30:30 kjcf05n02 mlnx_conf_mgr[3651]: INFO: No configurations found for mlx5_1, skipping. Nov 3 07:30:30 kjcf05n02 mlnx_conf_mgr[3652]: INFO: No configurations found for mlx5_0, skipping. Nov 3 07:30:30 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 07:30:30 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 07:30:30 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 3 07:30:30 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 3 07:30:30 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 07:30:30 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 3 07:30:30 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 3 07:30:30 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 07:30:30 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 07:30:30 kjcf05n02 lldpad[3154]: init_ports: Error adding device ib0 Nov 3 07:30:30 kjcf05n02 lldpad[3154]: init_ports: Error adding device ib1 Nov 3 07:30:30 kjcf05n02 lldpad[3154]: Signal 15 received - terminating Nov 3 07:30:30 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 3 07:30:30 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 07:30:30 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 07:30:30 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 3 07:30:30 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 07:30:30 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 3 07:30:30 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 3 07:30:30 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:30 kjcf05n02 systemd[3148]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:30 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 1 | Nov-03-2024 | 12:29:37 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 2 | Nov-03-2024 | 12:30:28 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 3 | Nov-03-2024 | 12:30:29 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 4 | Nov-03-2024 | 12:31:35 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 5 | Nov-03-2024 | 12:31:35 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 6 | Nov-03-2024 | 13:26:34 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 7 | Nov-03-2024 | 13:26:34 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 8 | Nov-03-2024 | 13:26:34 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 9 | Nov-03-2024 | 13:26:34 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 10 | Nov-03-2024 | 13:26:34 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 11 | Nov-03-2024 | 13:26:34 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 12 | Nov-03-2024 | 13:26:34 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 13 | Nov-03-2024 | 13:26:34 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 14 | Nov-03-2024 | 13:26:34 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 15 | Nov-03-2024 | 13:26:34 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 16 | Nov-03-2024 | 13:26:34 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 17 | Nov-03-2024 | 13:26:34 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 18 | Nov-03-2024 | 13:27:05 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 19 | Nov-03-2024 | 13:27:05 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 20 | Nov-03-2024 | 13:27:05 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 21 | Nov-03-2024 | 13:27:05 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 22 | Nov-03-2024 | 13:27:05 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 23 | Nov-03-2024 | 13:27:05 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 24 | Nov-03-2024 | 13:27:05 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 25 | Nov-03-2024 | 13:27:05 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 26 | Nov-03-2024 | 13:27:05 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 27 | Nov-03-2024 | 13:27:05 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 28 | Nov-03-2024 | 13:27:05 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 07:30:30 kjcf05n02 ipmievd[3999]: 29 | Nov-03-2024 | 13:27:05 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 07:30:30 kjcf05n02 ipmievd[4002]: Reading sensors... Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 3 07:30:30 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:30 kjcf05n02 systemd[3148]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 07:30:30 kjcf05n02 nscd[2155]: 2155 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 07:30:30 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 07:30:30 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 3 07:30:30 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 07:30:30 kjcf05n02 beSetMlxConfig[4059]: ConnectX-3 multiport not detected Nov 3 07:30:30 kjcf05n02 beSetMlxConfig[4059]: Starting MST (Mellanox Software Tools) driver set Nov 3 07:30:30 kjcf05n02 beSetMlxConfig[4059]: Loading MST PCI module - Success Nov 3 07:30:30 kjcf05n02 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 07:30:30 kjcf05n02 beSetMlxConfig[4059]: [warn] mst_pciconf is already loaded, skipping Nov 3 07:30:30 kjcf05n02 beSetMlxConfig[4059]: Create devices Nov 3 07:30:30 kjcf05n02 beSetMlxConfig[4059]: Unloading MST PCI module (unused) - Success Nov 3 07:30:30 kjcf05n02 ipmievd[4002]: Waiting for events... Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 07:30:30 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 07:30:30 kjcf05n02 beSetMlxConfig[4059]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 07:30:30 kjcf05n02 beSetMlxConfig[4059]: ib mode Nov 3 07:30:30 kjcf05n02 beSetMlxConfig[4059]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 07:30:30 kjcf05n02 beSetMlxConfig[4059]: ib mode Nov 3 07:30:30 kjcf05n02 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 07:30:30 kjcf05n02 systemd-udevd[4963]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:30:30 kjcf05n02 systemd-udevd[4964]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:30:30 kjcf05n02 systemd-udevd[4967]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:30:30 kjcf05n02 systemd-udevd[4970]: Using default interface naming scheme 'rhel-8.0'. Nov 3 07:30:30 kjcf05n02 systemd-udevd[4970]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:30:30 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 07:30:30 kjcf05n02 systemd[3148]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:30 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[5005]: Setting up Mellanox network interface: ib0 Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[5006]: Setting up Mellanox network interface: ib1 Nov 3 07:30:30 kjcf05n02 systemd-udevd[4965]: Using default interface naming scheme 'rhel-8.0'. Nov 3 07:30:30 kjcf05n02 systemd-udevd[4966]: Using default interface naming scheme 'rhel-8.0'. Nov 3 07:30:30 kjcf05n02 systemd-udevd[4965]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:30:30 kjcf05n02 systemd-udevd[4966]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[5061]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[5065]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[5085]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[5087]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[5088]: No configuration found for ib0 Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[5089]: No configuration found for ib1 Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[5093]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 07:30:30 kjcf05n02 mlnx_interface_mgr[5097]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 07:30:30 kjcf05n02 mlnx_conf_mgr[5133]: INFO: No configurations found for mlx5_0, skipping. Nov 3 07:30:30 kjcf05n02 mlnx_conf_mgr[5137]: INFO: No configurations found for mlx5_1, skipping. Nov 3 07:30:30 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 07:30:30 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}649af0f272c725bc9be5acd3baf37eea8b942eda0f140ca91f745909ec5f7d9c' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}649af0f272c725bc9be5acd3baf37eea8b942eda0f140ca91f745909ec5f7d9c' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}4a1bc47b17f3c45ca6ed49dfc18b44711db61cc1a48acf257d854e82b6727a44' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}4a1bc47b17f3c45ca6ed49dfc18b44711db61cc1a48acf257d854e82b6727a44' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}1618a0ede493fc3fba6339c63e192bed1a9a4deffb12197a95925be63845ff43' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}1618a0ede493fc3fba6339c63e192bed1a9a4deffb12197a95925be63845ff43' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}e04a319708177e922d0e0f00098ab1cd67ecd317cf8c640165f68f4a0cc3aa40' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}e04a319708177e922d0e0f00098ab1cd67ecd317cf8c640165f68f4a0cc3aa40' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 07:30:30 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 3 07:30:30 kjcf05n02 chronyd[2165]: chronyd exiting Nov 3 07:30:30 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 3 07:30:30 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 07:30:30 kjcf05n02 chronyd[5171]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 07:30:30 kjcf05n02 chronyd[5171]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 07:30:30 kjcf05n02 chronyd[5171]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 07:30:30 kjcf05n02 chronyd[5171]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 07:30:30 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 07:30:30 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:30 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 07:30:30 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 3 07:30:30 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 07:30:30 kjcf05n02 dwd[5205]: dwd: vMay 29 2024 : 15:38:26 Nov 3 07:30:30 kjcf05n02 dwd[5205]: /usr/sbin/dwd -i 15 -d Nov 3 07:30:30 kjcf05n02 dwd[5205]: dwd: option Lethal: 0 Nov 3 07:30:30 kjcf05n02 dwd[5205]: dwd: option Interval: 15 Nov 3 07:30:30 kjcf05n02 dwd[5205]: dwd: option abrtlimit: 10 Nov 3 07:30:30 kjcf05n02 dwd[5205]: dwd: option DZPeriod: 604800 Nov 3 07:30:30 kjcf05n02 dwd[5205]: dwd: option SmartPeriod: 43200 Nov 3 07:30:30 kjcf05n02 dwd[5205]: dwd: option SDDEnabled: 1 Nov 3 07:30:30 kjcf05n02 dwd[5205]: dwd: option SDDAwaitScale: 3 Nov 3 07:30:30 kjcf05n02 dwd[5205]: dwd: option SDDAwaitMin: 100 Nov 3 07:30:30 kjcf05n02 dwd[5205]: dwd: option Verbosity: 1 Nov 3 07:30:30 kjcf05n02 dwd[5205]: dwd: option StandAlone: 0 Nov 3 07:30:30 kjcf05n02 dwd[5205]: option Lethal: 0 Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 07:30:30 kjcf05n02 dwd[5205]: option Interval: 15 Nov 3 07:30:30 kjcf05n02 dwd[5205]: option abrtlimit: 10 Nov 3 07:30:30 kjcf05n02 dwd[5205]: option DZPeriod: 604800 Nov 3 07:30:30 kjcf05n02 dwd[5205]: option SmartPeriod: 43200 Nov 3 07:30:30 kjcf05n02 dwd[5205]: option SDDEnabled: 1 Nov 3 07:30:30 kjcf05n02 dwd[5205]: option SDDAwaitScale: 3 Nov 3 07:30:30 kjcf05n02 dwd[5205]: option SDDAwaitMin: 100 Nov 3 07:30:30 kjcf05n02 dwd[5205]: option Verbosity: 1 Nov 3 07:30:30 kjcf05n02 dwd[5205]: option StandAlone: 0 Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 07:30:30 kjcf05n02 dwd[5206]: option Lethal now set to 1 Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 07:30:30 kjcf05n02 dwd[5206]: option abrtlimit now set to 1 Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 07:30:30 kjcf05n02 dwd[5206]: option SmartPeriod now set to 86400 Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 07:30:30 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 07:30:30 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:30 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 07:30:30 kjcf05n02 python3.9[5235]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 07:30:30 kjcf05n02 python3.9[3148]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:30 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:30 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 07:30:30 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:30 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 3 07:30:30 kjcf05n02 sedcpwrkr[5372]: Using config script: /etc/sedcpwrkr.conf Nov 3 07:30:30 kjcf05n02 sedcpwrkr[5372]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 07:30:30 kjcf05n02 sedcpwrkr[5372]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 07:30:30 kjcf05n02 sedcpwrkr[5372]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 07:30:30 kjcf05n02 sedcpwrkr[5372]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 07:30:30 kjcf05n02 sedcpwrkr[5372]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 07:30:30 kjcf05n02 sedcpwrkr[5372]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 07:30:30 kjcf05n02 sedcpwrkr-server[5403]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 07:30:30 kjcf05n02 sedcpwrkr[5372]: celery multi v5.2.7 (dawn-chorus) Nov 3 07:30:30 kjcf05n02 sedcpwrkr[5372]: > Starting nodes... Nov 3 07:30:30 kjcf05n02 sedcpwrkr[5372]: > sedcpwrkr@kjcf05n02: OK Nov 3 07:30:30 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 07:30:30 kjcf05n02 sedcpwrkr-server[5405]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 07:30:30 kjcf05n02 sedcpwrkr-server[5405]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 07:30:30 kjcf05n02 sedcpwrkr-server[5405]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 07:30:30 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 07:30:30 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 3 07:30:30 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 07:30:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 07:30:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 07:30:30 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:31 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 07:30:31 kjcf05n02 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 07:30:31 kjcf05n02 iptables.init[5472]: iptables: Applying firewall rules: [ OK ] Nov 3 07:30:31 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 3 07:30:31 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:31 kjcf05n00 mcfcli[3673891]: %3|1730640631.007|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:30:31 kjcf05n02 systemd[3148]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:31 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:31 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:31 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 07:30:31 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 07:30:31 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 07:30:31 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 07:30:31 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 07:30:31 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 07:30:31 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 07:30:31 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 07:30:31 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 07:30:31 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 07:30:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 07:30:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 07:30:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 07:30:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 07:30:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 07:30:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 07:30:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 07:30:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 07:30:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 07:30:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 07:30:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 07:30:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 07:30:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 07:30:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 07:30:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 07:30:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 07:30:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 07:30:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 07:30:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 07:30:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 07:30:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 07:30:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 07:30:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 07:30:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 07:30:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 07:30:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 07:30:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 07:30:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 07:30:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 07:30:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 07:30:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 07:30:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 07:30:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 07:30:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 07:30:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 07:30:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 07:30:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 07:30:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 07:30:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 07:30:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 07:30:32 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:32 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 07:30:32 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5569 which is not our child. We'll most likely not notice when it exits. Nov 3 07:30:32 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 07:30:32 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:32 kjcf05n02 openhpid[5569]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 07:30:32 kjcf05n02 openhpid[5569]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 07:30:32 kjcf05n02 openhpid[5569]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 07:30:32 kjcf05n02 openhpid[5569]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 07:30:32 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:33 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:33 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:33 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 07:30:33 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 07:30:33 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 07:30:33 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 07:30:33 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:33 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 07:30:34 kjcf05n02 dcs-collectord[5660]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 07:30:34 kjcf05n02 hpi.inv.log[5660]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 07:30:34 kjcf05n02 dcs-collectord[5660]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 07:30:34 kjcf05n02 dcs-collectord[5660]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 07:30:34 kjcf05n02 dcs-collector[5651]: Starting dcs-collector:[ OK ] Nov 3 07:30:34 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 07:30:34 kjcf05n02 dcs-collectord[5663]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 07:30:34 kjcf05n02 dcs-collectord[5663]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 07:30:34 kjcf05n02 dcs-collectord[5663]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 07:30:34 kjcf05n02 dcs-collectord[5663]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 07:30:34 kjcf05n02 dcs-collectord[5663]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 07:30:34 kjcf05n02 dcs-collectord[5663]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 07:30:34 kjcf05n02 dcs-collectord[5663]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 07:30:34 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 07:30:34 kjcf05n02 dcs-collectord[5663]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259346260", "units": "kB"}, {"name": "MemAvailable", "value": "258626132", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821284", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1687024", "units": "kB"}, {"name": "Inactive", "value": "961116", "units": "kB"}, {"name": "Active(anon)", "value": "1520588", "units": "kB"}, {"name": "Inactive(anon)", "value": "825232", "units": "kB"}, {"name": "Active(file)", "value": "166436", "units": "kB"}, {"name": "Inactive(file)", "value": "135884", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "752052", "units": "kB"}, {"name": "Mapped", "value": "86072", "units": "kB"}, {"name": "Shmem", "value": "1593408", "units": "kB"}, {"name": "KReclaimable", "value": "109244", "units": "kB"}, {"name": "Slab", "value": "276200", "units": "kB"}, {"name": "SReclaimable", "value": "109244", "units": "kB"}, {"name": "SUnreclaim", "value": "166956", "units": "kB"}, {"name": "KernelStack", "value": "9904", "units": "kB"}, {"name": "PageTables", "value": "21020", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3290820", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11264", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "2048", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "262472", "units": "kB"}, {"name": "DirectMap2M", "value": "23719936", "units": "kB"}, {"name": "DirectMap1G", "value": "244318208", "units": "kB"}]}' Nov 3 07:30:34 kjcf05n02 dcs-collectord[5663]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 07:30:34 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:34 kjcf05n02 dcs-collectord[5663]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 07:30:34 kjcf05n02 dcs-collectord[5663]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730640633.7895198], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730640634.0429943], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730640633.7236917, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 07:30:34 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:34 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 07:30:34 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:34 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:34 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 07:30:34 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 07:30:34 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 07:30:34 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 07:30:34 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:34 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 07:30:35 kjcf05n02 firmware-update-orc[5769]: Using config script: /etc/firmware_update_orc.conf Nov 3 07:30:35 kjcf05n02 firmware-update-orc[5769]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 07:30:35 kjcf05n02 firmware-update-orc[5769]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 07:30:35 kjcf05n02 firmware-update-orc[5769]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 07:30:35 kjcf05n02 firmware-update-orc[5769]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 07:30:35 kjcf05n02 firmware-update-orc[5769]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 07:30:35 kjcf05n02 firmware-update-orc[5769]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 07:30:35 kjcf05n02 firmware-update-orc-server[5807]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 07:30:35 kjcf05n02 firmware-update-orc[5769]: celery multi v5.2.7 (dawn-chorus) Nov 3 07:30:35 kjcf05n02 firmware-update-orc[5769]: > Starting nodes... Nov 3 07:30:35 kjcf05n02 firmware-update-orc[5769]: > worker1@kjcf05n02: OK Nov 3 07:30:35 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 07:30:35 kjcf05n02 firmware-update-orc-server[5809]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 07:30:35 kjcf05n02 firmware-update-orc-server[5809]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 07:30:35 kjcf05n02 firmware-update-orc-server[5809]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 07:30:35 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 07:30:35 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:36 kjcf05n02 systemd[3148]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:36 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:36 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:36 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 07:30:36 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 07:30:36 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 07:30:36 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 07:30:36 kjcf05n02 dbus-daemon[2148]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 07:30:36 kjcf05n02 dbus-daemon[2148]: [system] Reloaded configuration Nov 3 07:30:36 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 07:30:36 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 07:30:36 kjcf05n02 dbus-daemon[2148]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 07:30:36 kjcf05n02 dbus-daemon[2148]: [system] Reloaded configuration Nov 3 07:30:36 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 07:30:36 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 07:30:36 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 07:30:36 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 07:30:36 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:36 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 3 07:30:36 kjcf05n02 ras-resource-manager-agent[5925]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 07:30:36 kjcf05n02 ras-resource-manager-agent[5911]: Starting ras-resource-manager-agent:[ OK ] Nov 3 07:30:36 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 07:30:36 kjcf05n02 ras-resource-manager-agent[5927]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 07:30:36 kjcf05n02 ras-resource-manager-client[5927]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 07:30:36 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 3 07:30:36 kjcf05n02 ras-resource-manager-client[5927]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 07:30:36 kjcf05n02 ras-resource-manager-client[5937]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 07:30:36 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:37 kjcf05n02 systemd[3148]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:37 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:37 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:37 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 07:30:37 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 07:30:37 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:37 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 07:30:37 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 07:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 07:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 07:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 07:30:38 kjcf05n02 systemd[3148]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: Press Ctrl+C to exit. Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: Plugin support version 1.0 Nov 3 07:30:38 kjcf05n02 zabbix_agent2[6011]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 07:30:38 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:38 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:38 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:38 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 07:30:38 kjcf05n02 dcs-notification-sender[6088]: dcs-notification-senderd is stopped Nov 3 07:30:38 kjcf05n02 zabbix-agent2[6106]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 07:30:38 kjcf05n02 dcs-notification-sender[6088]: Starting notification-sender:[ OK ] Nov 3 07:30:38 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 07:30:38 kjcf05n02 zabbix-agent2[6108]: INFO DCS notification agent started. (agent.py:61) Nov 3 07:30:38 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 07:30:38 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:39 kjcf05n02 systemd[3148]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:39 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:39 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:39 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:39 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 07:30:39 kjcf05n02 dcs-collectord[6204]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 07:30:39 kjcf05n02 dcs-collectord[6204]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 07:30:39 kjcf05n02 dcs-bulk-data-sender[6204]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 07:30:39 kjcf05n02 dcs-bulk-data-sender[6195]: Starting bulk-data-sender:[ OK ] Nov 3 07:30:39 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 07:30:39 kjcf05n02 dcs-collectord[6206]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 07:30:39 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 07:30:39 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:40 kjcf05n02 systemd[3148]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:40 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:40 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:40 kjcf05n02 nscd[2155]: 2155 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 07:30:40 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 07:30:40 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 07:30:40 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 07:30:40 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 07:30:40 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 07:30:40 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 07:30:40 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 07:30:40 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 07:30:40 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 07:30:40 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 07:30:40 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 07:30:40 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 07:30:40 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 07:30:40 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 07:30:40 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 07:30:40 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 07:30:40 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 07:30:41 kjcf05n02 python3.9[5235]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 07:30:41 kjcf05n02 python3.9[3148]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:41 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 3 07:30:41 kjcf05n02 sssd[nss][2467]: Shutting down (status = 0) Nov 3 07:30:41 kjcf05n02 sssd[be[implicit_files]][2317]: Shutting down (status = 0) Nov 3 07:30:41 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 3 07:30:41 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 3 07:30:41 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 07:30:41 kjcf05n02 sssd[sssd][6292]: Starting up Nov 3 07:30:41 kjcf05n02 sssd[be[implicit_files]][6293]: Starting up Nov 3 07:30:41 kjcf05n02 sssd[nss][6294]: Starting up Nov 3 07:30:41 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 07:30:41 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 07:30:41 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 07:30:42 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 07:30:42 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 07:30:42 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 07:30:42 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 07:30:42 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 07:30:42 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 07:30:42 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 07:30:42 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 07:30:42 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 07:30:42 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 07:30:42 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 07:30:42 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 07:30:42 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 07:30:42 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 07:30:42 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 07:30:42 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 07:30:42 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:42 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 07:30:43 kjcf05n02 icinga2[6343]: [2024-11-03 07:30:43 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 07:30:43 kjcf05n02 icinga2[6343]: [2024-11-03 07:30:43 -0600] information/cli: Loading configuration file(s). Nov 3 07:30:43 kjcf05n02 icinga2[6343]: [2024-11-03 07:30:43 -0600] information/ConfigItem: Committing config item(s). Nov 3 07:30:43 kjcf05n02 icinga2[6343]: [2024-11-03 07:30:43 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 3 07:30:43 kjcf05n02 icinga2[6343]: [2024-11-03 07:30:43 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 07:30:43 kjcf05n02 icinga2[6343]: [2024-11-03 07:30:43 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 07:30:43 kjcf05n02 icinga2[6343]: [2024-11-03 07:30:43 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 07:30:43 kjcf05n02 icinga2[6343]: [2024-11-03 07:30:43 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 07:30:43 kjcf05n02 icinga2[6343]: [2024-11-03 07:30:43 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 07:30:43 kjcf05n02 icinga2[6343]: [2024-11-03 07:30:43 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 07:30:43 kjcf05n02 icinga2[6343]: [2024-11-03 07:30:43 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 07:30:43 kjcf05n02 icinga2[6343]: [2024-11-03 07:30:43 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 07:30:43 kjcf05n02 icinga2[6343]: [2024-11-03 07:30:43 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 07:30:43 kjcf05n02 icinga2[6343]: [2024-11-03 07:30:43 -0600] information/cli: Closing console log. Nov 3 07:30:43 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 07:30:43 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:43 kjcf05n02 systemd[3148]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:43 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:43 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:44 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 07:30:44 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 07:30:44 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:44 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 07:30:44 kjcf05n00 zabbix-server[1066333]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:30:44 kjcf05n00 zabbix-server[1066333]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 242.13\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 177.33\\"}}"' Nov 3 07:30:44 kjcf05n00 log_interesting_event.py[1066333]: Event '45948' acknowledged Nov 3 07:30:44 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 3 07:30:44 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:45 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 07:30:45 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:45 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:45 kjcf05n02 dcs-bulk-data-sender[6206]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 07:30:45 kjcf05n02 dcs-collectord[6206]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 07:30:45 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 07:30:45 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 07:30:45 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 07:30:45 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 07:30:45 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 07:30:45 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 07:30:45 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 07:30:45 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 07:30:45 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 07:30:45 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 07:30:45 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 07:30:45 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 07:30:45 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 07:30:45 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 07:30:46 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:46 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 07:30:46 kjcf05n02 nslcd[7276]: version 0.9.9 starting Nov 3 07:30:46 kjcf05n02 nslcd[7276]: accepting connections Nov 3 07:30:46 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 07:30:46 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:46 kjcf05n02 systemd[3148]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:46 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:46 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:46 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 07:30:46 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 07:30:46 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 07:30:46 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 07:30:47 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 07:30:47 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 07:30:47 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 07:30:47 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 07:30:47 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:48 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 07:30:48 kjcf05n02 dearcpw[7461]: Using config script: /etc/dearcpw.conf Nov 3 07:30:48 kjcf05n02 dearcpw[7461]: - Creating default directory: '/var/log/dearcpw' Nov 3 07:30:48 kjcf05n02 dearcpw[7461]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 07:30:48 kjcf05n02 dearcpw[7461]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 07:30:48 kjcf05n02 dearcpw[7461]: - Creating default directory: '/var/run/dearcpw' Nov 3 07:30:48 kjcf05n02 dearcpw[7461]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 07:30:48 kjcf05n02 dearcpw[7461]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 07:30:48 kjcf05n02 dearcpw-server[7515]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 07:30:48 kjcf05n02 dearcpw[7461]: celery multi v5.2.7 (dawn-chorus) Nov 3 07:30:48 kjcf05n02 dearcpw[7461]: > Starting nodes... Nov 3 07:30:48 kjcf05n02 dearcpw[7461]: > dearcpw@kjcf05n02: OK Nov 3 07:30:48 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 07:30:48 kjcf05n02 dearcpw-server[7517]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 07:30:48 kjcf05n02 dearcpw-server[7517]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 07:30:48 kjcf05n02 dearcpw-server[7517]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 07:30:48 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 3 07:30:48 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:48 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:48 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 07:30:48 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 07:30:48 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 07:30:48 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 07:30:48 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 07:30:48 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 07:30:48 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 07:30:48 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 07:30:48 kjcf05n02 dcs-collectord[5663]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 07:30:48 kjcf05n02 dcs-collectord[5663]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 07:30:48 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 07:30:48 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 07:30:49 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:60240). Nov 3 07:30:49 kjcf05n01 rsyncd[2968793]: connect from kjcf05n02 (172.16.2.5) Nov 3 07:30:49 kjcf05n01 rsyncd[2968793]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 07:30:49 kjcf05n01 rsyncd[2968793]: receiving file list Nov 3 07:30:49 kjcf05n01 rsyncd[2968793]: sent 29 bytes received 325 bytes total size 10905 Nov 3 07:30:49 kjcf05n01 systemd[1]: rsyncd@608-172.16.2.2:873-172.16.2.5:60240.service: Succeeded. Nov 3 07:30:49 kjcf05n02 puppet[7545]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 3 07:30:49 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 07:30:49 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 07:30:49 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 07:30:49 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 07:30:49 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 07:30:49 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 07:30:49 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 07:30:49 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 07:30:49 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 07:30:49 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 07:30:49 kjcf05n02 ipmievd[4002]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 07:30:49 kjcf05n02 ipmievd[4002]: System Event sensor - Timestamp Clock Sync Nov 3 07:30:50 kjcf05n02 ipmievd[3148]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:50 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 07:30:50 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 07:30:50 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 07:30:50 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 07:30:50 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 07:30:50 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 07:30:50 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 07:30:50 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 07:30:51 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 07:30:51 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 07:30:51 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 07:30:51 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 07:30:52 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 07:30:52 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 07:30:52 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:52 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 07:30:52 kjcf05n02 diskless-swap[7642]: HA_PS_000: recovering journal Nov 3 07:30:52 kjcf05n02 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 07:30:52 kjcf05n02 diskless-swap[7642]: HA_PS_000: clean, 2280/6400 files, 7069/25600 blocks Nov 3 07:30:52 kjcf05n02 diskless-swap[7642]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 07:30:52 kjcf05n02 diskless-swap[7642]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 07:30:52 kjcf05n02 diskless-swap[7642]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 07:30:52 kjcf05n02 diskless-swap[7642]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 07:30:52 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 07:30:52 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:52 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:52 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 07:30:52 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 07:30:52 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 07:30:52 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 07:30:52 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 3 07:30:53 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 3 07:30:53 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 3 07:30:53 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 3 07:30:53 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 3 07:30:53 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 07:30:53 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 07:30:53 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 07:30:53 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 07:30:53 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 07:30:53 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 07:30:53 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 07:30:54 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 07:30:54 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 07:30:54 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 07:30:54 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 07:30:54 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 07:30:54 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 07:30:54 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 07:30:54 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 07:30:55 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 07:30:55 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 07:30:55 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 07:30:55 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 07:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 07:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 07:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 07:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 07:30:56 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 07:30:56 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 07:30:56 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 07:30:56 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 07:30:56 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:56 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 3 07:30:56 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:56 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:56 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 07:30:56 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 07:30:56 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:57 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 3 07:30:57 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:57 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:57 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 07:30:57 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 07:30:57 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:57 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 3 07:30:57 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:30:57 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:30:57 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 07:30:57 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 07:30:57 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 07:30:57 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 07:30:57 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 07:30:57 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 07:30:57 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 07:30:57 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 07:30:57 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 07:30:57 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 07:30:57 kjcf05n02 systemd[1]: Reloading. Nov 3 07:30:57 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: kdump: No kdump initial ramdisk found. Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 07:30:58 kjcf05n02 dracut[7985]: dracut-049-135.git20210121.el8 Nov 3 07:30:58 kjcf05n02 dracut[7987]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 07:30:58 kjcf05n02 dracut[7987]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 07:30:58 kjcf05n02 dracut[7987]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 07:30:58 kjcf05n02 dracut[7987]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 07:30:58 kjcf05n02 dracut[7987]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 07:30:58 kjcf05n02 dracut[7987]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 07:30:58 kjcf05n02 dracut[7987]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 07:30:58 kjcf05n02 dracut[7987]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 07:30:58 kjcf05n00 mcfcli[3673891]: %3|1730640658.246|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + is_func check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ type -t check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 0 -ne 0 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check -h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local dev holder Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + require_binaries mdadm expr Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _module_name=90hperaid Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ mdadm = \-\m ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for cmd in "$@" Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + find_binary mdadm Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for cmd in "$@" Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + find_binary expr Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n -h ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for dev in "${!host_fs_types[@]}" Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ nfs != *_raid_member ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + continue Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _ret=255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + ret=255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ 255 = 0 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ 255 = 255 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ module_depends hperaid Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: +++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: +++ set -x Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ depends Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo rootfs-block Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ return 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ _ret=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ return 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for _moddep in $(module_depends $_mod) Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all == *\ hperaid\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + add_dracutmodules+=' rootfs-block ' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ == *\ hperaid\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check_module rootfs-block Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _mod=rootfs-block Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddep Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ == *\ rootfs-block\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n '' ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all == *\ rootfs-block\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + module_check rootfs-block 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _forced=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 2 -eq 2 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _forced=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + is_func check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ type -t check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 0 -ne 0 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check -h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _ret=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + ret=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ 0 = 0 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ module_depends rootfs-block Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: +++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 07:30:58 kjcf05n02 kdumpctl[3148]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ depends Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo fs-lib Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ _ret=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ return 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for _moddep in $(module_depends $_mod) Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all == *\ rootfs-block\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + add_dracutmodules+=' fs-lib ' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ == *\ rootfs-block\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check_module fs-lib Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _mod=fs-lib Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddep Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n '' ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + mods_checked_as_dep+=' fs-lib ' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all == *\ fs-lib\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + module_check fs-lib 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _forced=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 2 -eq 2 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _forced=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + is_func check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ type -t check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 0 -ne 0 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check -h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _ret=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + ret=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ 0 = 0 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ module_depends fs-lib Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: +++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ depends Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ return 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ _ret=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ return 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + mods_to_load+=' fs-lib ' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + mods_to_load+=' rootfs-block ' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + mods_to_load+=' hperaid ' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _mod=90kernel-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _mod=kernel-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check_module kernel-modules 1 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _mod=kernel-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddep Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n 1 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all = all ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + module_check kernel-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _forced=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 1 -eq 2 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + is_func check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ type -t check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 0 -ne 0 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check -h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + true Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _ret=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + ret=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ 0 != 0 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ module_depends kernel-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: +++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ depends Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ true Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ _ret=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ return 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + mods_to_load+=' kernel-modules ' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _mod=90kernel-modules-extra Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _mod=kernel-modules-extra Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check_module kernel-modules-extra 1 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _mod=kernel-modules-extra Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddep Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n 1 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all = all ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + module_check kernel-modules-extra Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _forced=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 1 -eq 2 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + is_func check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ type -t check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 0 -ne 0 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check -h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + true Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _ret=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + ret=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ 0 != 0 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ module_depends kernel-modules-extra Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: +++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ depends Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ true Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ _ret=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ return 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + mods_to_load+=' kernel-modules-extra ' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _mod=90kernel-network-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _mod=kernel-network-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check_module kernel-network-modules 1 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _mod=kernel-network-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddep Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n 1 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all = all ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + module_check kernel-network-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _forced=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 1 -eq 2 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + is_func check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ type -t check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 0 -ne 0 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check -h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _ret=255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + ret=255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ 255 != 0 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n 1 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 1 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _mod=90livenet Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _mod=livenet Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check_module livenet 1 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _mod=livenet Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddep Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n 1 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all = all ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + module_check livenet Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _forced=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 1 -eq 2 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + is_func check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ type -t check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 0 -ne 0 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check -h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _ret=255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + ret=255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ 255 != 0 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n 1 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 1 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _mod=90lvm Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _mod=lvm Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check_module lvm 1 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _mod=lvm Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddep Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n 1 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all = all ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + module_check lvm Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 07:30:58 kjcf05n02 kdumpctl[3148]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _forced=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 1 -eq 2 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + is_func check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ type -t check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 0 -ne 0 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check -h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + require_binaries lvm Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _module_name=90lvm Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ lvm = \-\m ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for cmd in "$@" Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + find_binary lvm Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n -h ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for fs in "${host_fs_types[@]}" Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ nfs = LVM*_member ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _ret=255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + ret=255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ 255 != 0 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n 1 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 1 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _mod=90mdraid Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _mod=mdraid Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check_module mdraid 1 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _mod=mdraid Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddep Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n 1 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all = all ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + module_check mdraid Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _forced=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 1 -eq 2 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + is_func check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ type -t check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 0 -ne 0 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check -h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _rootdev Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + require_binaries mdadm expr Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _module_name=90mdraid Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ mdadm = \-\m ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for cmd in "$@" Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + find_binary mdadm Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for cmd in "$@" Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + find_binary expr Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n -h ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for dev in "${!host_fs_types[@]}" Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ nfs != *_raid_member ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + continue Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _ret=255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + ret=255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ 255 != 0 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n 1 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 1 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _mod=90multipath Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _mod=multipath Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check_module multipath 1 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _mod=multipath Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 07:30:58 kjcf05n02 kdumpctl[3148]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddep Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n 1 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all = all ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + module_check multipath Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _forced=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 1 -eq 2 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + is_func check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ type -t check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 0 -ne 0 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check -h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _rootdev Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n -h ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for_each_host_dev_and_slaves is_mpath Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _func=is_mpath Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _dev Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for _dev in "${host_devs[@]}" Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + continue Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 1 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _ret=255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + ret=255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ 255 != 0 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n 1 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 1 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _mod=90qemu Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _mod=qemu Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check_module qemu 1 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _mod=qemu Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddep Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n 1 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all = all ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + module_check qemu Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _forced=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 1 -eq 2 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + is_func check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ type -t check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 0 -ne 0 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check -h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n -h ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + type -P systemd-detect-virt Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ systemd-detect-virt --vm Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + vm=none Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + (( 1 != 0 )) Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _ret=255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + ret=255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ 255 != 0 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n 1 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 1 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _mod=90qemu-net Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _mod=qemu-net Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check_module qemu-net 1 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _mod=qemu-net Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddep Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n 1 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all = all ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + module_check qemu-net Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _forced=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 1 -eq 2 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + is_func check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ type -t check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 0 -ne 0 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check -h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n -h ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + type -P systemd-detect-virt Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ systemd-detect-virt --vm Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + vm= Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + (( 1 != 0 )) Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _ret=255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + ret=255 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ 255 != 0 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n 1 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + return 1 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _mod=90stratis Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + _mod=stratis Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check_module stratis 1 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _mod=stratis Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddep Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -n 1 ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ all = all ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + module_check stratis Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ read a b Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _forced=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _hostonly=-h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 1 -eq 2 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + is_func check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: ++ type -t check Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + '[' 0 -ne 0 ']' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + check -h Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _module_name=90stratis Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + local _ret=0 Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + [[ stratisd-init = \-\m ]] Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + for cmd in "$@" Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + find_binary stratisd-init Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 07:30:58 kjcf05n02 kdumpctl[7873]: + set +x Nov 3 07:30:58 kjcf05n02 dracut[7987]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 07:30:58 kjcf05n02 dracut[7987]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 07:30:58 kjcf05n02 dracut[7987]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 07:30:59 kjcf05n02 dracut[7987]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 07:30:59 kjcf05n02 dracut[7987]: memstrack is available Nov 3 07:30:59 kjcf05n02 dracut[7987]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 07:30:59 kjcf05n02 dracut[7987]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 07:30:59 kjcf05n02 dracut[7987]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 07:30:59 kjcf05n02 dracut[7987]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 07:30:59 kjcf05n02 dracut[7987]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 07:30:59 kjcf05n02 dracut[7987]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 07:30:59 kjcf05n02 dracut[7987]: *** Including module: bash *** Nov 3 07:30:59 kjcf05n02 dracut[7987]: *** Including module: systemd *** Nov 3 07:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 07:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 07:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 07:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 07:31:00 kjcf05n02 dracut[7987]: *** Including module: fips *** Nov 3 07:31:00 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 3 07:31:00 kjcf05n02 dracut[7987]: *** Including module: systemd-initrd *** Nov 3 07:31:00 kjcf05n02 dracut[7987]: *** Including module: watchdog-modules *** Nov 3 07:31:00 kjcf05n02 dracut[7987]: *** Including module: nss-softokn *** Nov 3 07:31:00 kjcf05n02 dracut[7987]: *** Including module: i18n *** Nov 3 07:31:00 kjcf05n02 dracut[7987]: No KEYMAP configured. Nov 3 07:31:01 kjcf05n02 dracut[7987]: *** Including module: network-legacy *** Nov 3 07:31:01 kjcf05n02 dracut[7987]: *** Including module: network *** Nov 3 07:31:01 kjcf05n02 dracut[7987]: *** Including module: ib_bonding *** Nov 3 07:31:01 kjcf05n02 dracut[7987]: *** Including module: drm *** Nov 3 07:31:01 kjcf05n00 zabbix-server[1066442]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:31:01 kjcf05n00 zabbix-server[1066442]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 3 07:31:01 kjcf05n00 log_interesting_event.py[1066442]: Event '45949' acknowledged Nov 3 07:31:04 kjcf05n02 dcs-collectord[5663]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 07:31:04 kjcf05n02 dcs-collectord[5663]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 07:31:05 kjcf05n02 dracut[7987]: *** Including module: hperaid *** Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + install Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + local rule rule_path Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + inst_multiple cat expr Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.BdNaVK/initramfs -a -f cat expr Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + _ret=0 Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + (( 0 != 0 )) Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + : Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + return 0 Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + inst_multiple -o mdmon Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.BdNaVK/initramfs -a -f -o mdmon Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + _ret=0 Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + (( 0 != 0 )) Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + : Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + return 0 Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: ++ command -v partx Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + inst /usr/sbin/partx /sbin/partx Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + local _hostonly_install Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + [[ -e /tmp/dracut.BdNaVK/initramfs//sbin/partx ]] Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.BdNaVK/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + (( 0 != 0 )) Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + : Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: ++ command -v mdadm Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + local _hostonly_install Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + [[ -e /tmp/dracut.BdNaVK/initramfs//sbin/mdadm ]] Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.BdNaVK/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + (( 0 != 0 )) Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + : Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + [[ yes == \y\e\s ]] Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + local _raidconf Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: ++ cmdline Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: ++ local _activated dev line UUID Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: ++ declare -A _activated Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: ++ for dev in "${!host_fs_types[@]}" Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: ++ [[ nfs != *_raid_member ]] Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: ++ continue Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + _raidconf= Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + [[ -n '' ]] Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + inst_rules 64-md-raid.rules Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + local _target=/etc/udev/rules.d _rule _found Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + inst_dir /usr/lib/udev/rules.d Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + [[ -e /tmp/dracut.BdNaVK/initramfs//usr/lib/udev/rules.d ]] Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + return 0 Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + inst_dir /etc/udev/rules.d Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + [[ -e /tmp/dracut.BdNaVK/initramfs//etc/udev/rules.d ]] Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + return 0 Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + for _rule in "$@" Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + continue Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + continue Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + for r in '' $dracutbasedir/rules.d/ Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + [[ 64-md-raid.rules != /* ]] Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + continue Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + for r in '' $dracutbasedir/rules.d/ Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + continue Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + [[ -n '' ]] Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + set +x Nov 3 07:31:05 kjcf05n02 dracut[7987]: Skipping udev rule: 64-md-raid.rules Nov 3 07:31:05 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 3 07:31:05 kjcf05n00 zabbix-server[1066451]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:31:05 kjcf05n00 zabbix-server[1066451]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:45\\"}}"' Nov 3 07:31:05 kjcf05n00 log_interesting_event.py[1066451]: Event '45950' acknowledged Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + installkernel Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + instmods =drivers/md Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + local _optional=-o Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + local _silent Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + local _ret Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + [[ '' = yes ]] Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + [[ =drivers/md = \-\c ]] Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + [[ =drivers/md = \-\s ]] Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + (( 1 == 0 )) Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.BdNaVK/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + _ret=0 Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + (( 0 != 0 )) Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + [[ -n '' ]] Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + return 0 Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + _ret=0 Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + unset check depends cmdline install installkernel Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + return 0 Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + modules_loaded+='hperaid ' Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + '[' -n '' ']' Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + _d_mod=90kernel-modules Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + _d_mod=kernel-modules Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + [[ '' = yes ]] Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + dinfo '*** Including module: kernel-modules ***' Nov 3 07:31:05 kjcf05n02 kdumpctl[7873]: + set +x Nov 3 07:31:05 kjcf05n02 dracut[7987]: *** Including module: kernel-modules *** Nov 3 07:31:05 kjcf05n02 dracut[7987]: *** Including module: kernel-modules-extra *** Nov 3 07:31:05 kjcf05n00 zabbix-server[1066453]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:31:05 kjcf05n00 zabbix-server[1066453]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 3 07:31:05 kjcf05n00 log_interesting_event.py[1066453]: Event '45952' acknowledged Nov 3 07:31:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730640665', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 2.22, 1.94, 0.84'}"] Nov 3 07:31:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 2.22, 1.94, 0.84', 'message': 'OK - load average: 2.22, 1.94, 0.84', 'value': 'ok', 'timestamp': '1730640665'} Nov 3 07:31:06 kjcf05n02 dracut[7987]: *** Including module: kernel-network-modules *** Nov 3 07:31:06 kjcf05n02 dracut[7987]: *** Including module: diskless-mod *** Nov 3 07:31:06 kjcf05n02 dracut[7987]: *** Including module: fstab-sys *** Nov 3 07:31:06 kjcf05n02 dracut[7987]: *** Including module: nfs *** Nov 3 07:31:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:31:06 kjcf05n02 dracut[7987]: *** Including module: rootfs-block *** Nov 3 07:31:06 kjcf05n02 dracut[7987]: *** Including module: terminfo *** Nov 3 07:31:06 kjcf05n02 dracut[7987]: *** Including module: udev-rules *** Nov 3 07:31:07 kjcf05n02 dracut[7987]: Skipping udev rule: 91-permissions.rules Nov 3 07:31:07 kjcf05n02 dracut[7987]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 07:31:07 kjcf05n02 dracut[7987]: *** Including module: dracut-systemd *** Nov 3 07:31:08 kjcf05n02 dracut[7987]: *** Including module: usrmount *** Nov 3 07:31:08 kjcf05n02 dracut[7987]: *** Including module: base *** Nov 3 07:31:08 kjcf05n02 dracut[7987]: *** Including module: fs-lib *** Nov 3 07:31:08 kjcf05n02 dracut[7987]: *** Including module: kdumpbase *** Nov 3 07:31:09 kjcf05n02 dracut[7987]: *** Including module: memstrack *** Nov 3 07:31:09 kjcf05n02 dracut[7987]: *** Including module: shutdown *** Nov 3 07:31:09 kjcf05n02 dracut[7987]: *** Including module: squash *** Nov 3 07:31:09 kjcf05n02 dracut[7987]: *** Including modules done *** Nov 3 07:31:09 kjcf05n02 dracut[7987]: *** Installing kernel module dependencies *** Nov 3 07:31:09 kjcf05n02 dracut[7987]: *** Installing kernel module dependencies done *** Nov 3 07:31:09 kjcf05n02 dracut[7987]: *** Resolving executable dependencies *** Nov 3 07:31:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730640669', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 334 processes with STATE = RSZDT '}"] Nov 3 07:31:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 334 processes with STATE = RSZDT ', 'message': 'PROCS OK: 334 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730640669'} Nov 3 07:31:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:31:11 kjcf05n02 dracut[7987]: *** Resolving executable dependencies done*** Nov 3 07:31:11 kjcf05n02 dracut[7987]: *** Hardlinking files *** Nov 3 07:31:11 kjcf05n02 dracut[7987]: *** Hardlinking files done *** Nov 3 07:31:11 kjcf05n02 dracut[7987]: *** Generating early-microcode cpio image *** Nov 3 07:31:11 kjcf05n02 dracut[7987]: *** Constructing AuthenticAMD.bin **** Nov 3 07:31:11 kjcf05n02 dracut[7987]: *** Store current command line parameters *** Nov 3 07:31:11 kjcf05n02 dracut[7987]: Stored kernel commandline: Nov 3 07:31:11 kjcf05n02 dracut[7987]: rd.driver.pre=sd_mod Nov 3 07:31:11 kjcf05n02 dracut[7987]: rd.driver.pre=nvme Nov 3 07:31:11 kjcf05n02 dracut[7987]: rd.driver.pre=ipmi_si Nov 3 07:31:11 kjcf05n02 dracut[7987]: rd.driver.pre=ipmi_devintf Nov 3 07:31:11 kjcf05n02 dracut[7987]: rd.driver.pre=ipmi_msghandler Nov 3 07:31:11 kjcf05n02 dracut[7987]: nameserver=172.16.2.2 Nov 3 07:31:11 kjcf05n02 dracut[7987]: nameserver=127.0.0.1 Nov 3 07:31:11 kjcf05n02 dracut[7987]: nameserver=172.16.2.2 Nov 3 07:31:11 kjcf05n02 dracut[7987]: nameserver=127.0.0.1 Nov 3 07:31:11 kjcf05n02 dracut[7987]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 3 07:31:11 kjcf05n02 dracut[7987]: rd.neednet Nov 3 07:31:11 kjcf05n02 dracut[7987]: kdumpnic=mgmt0 Nov 3 07:31:11 kjcf05n02 dracut[7987]: bootdev=mgmt0 Nov 3 07:31:11 kjcf05n02 dracut[7987]: *** Install squash loader *** Nov 3 07:31:11 kjcf05n00 mcfcli[3673891]: %3|1730640671.004|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:31:11 kjcf05n02 dracut[7987]: *** Squashing the files inside the initramfs *** Nov 3 07:31:12 kjcf05n02 dracut[7987]: *** Squashing the files inside the initramfs done *** Nov 3 07:31:12 kjcf05n02 dracut[7987]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 07:31:12 kjcf05n02 dracut[7987]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 07:31:13 kjcf05n02 kdumpctl[7873]: kdump: kexec: loaded kdump kernel Nov 3 07:31:13 kjcf05n02 kdumpctl[7873]: kdump: Starting kdump: [OK] Nov 3 07:31:13 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 3 07:31:13 kjcf05n02 systemd[1]: Reloading. Nov 3 07:31:13 kjcf05n02 systemd[3148]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:31:13 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:31:13 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:31:13 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 07:31:13 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 07:31:13 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 07:31:13 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 07:31:13 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 07:31:13 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 07:31:13 kjcf05n02 ifdown[14602]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 07:31:13 kjcf05n02 ifdown[14603]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:31:13 kjcf05n02 ifdown[14604]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:31:13 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 07:31:13 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 07:31:13 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 07:31:13 kjcf05n02 ifup[14664]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 07:31:13 kjcf05n02 ifup[14665]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:31:13 kjcf05n02 ifup[14666]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:31:15 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 07:31:18 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 07:31:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 07:31:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 07:31:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:31:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:31:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:31:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:31:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 07:31:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 07:31:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 07:31:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 07:31:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:31:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:31:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:31:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:31:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 07:31:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 07:31:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 07:31:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 07:31:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 07:31:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 07:31:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 07:31:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 07:31:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 07:31:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 07:31:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 07:31:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 07:31:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 07:31:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 07:31:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 07:31:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 07:31:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 07:31:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 07:31:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 07:31:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 07:31:18 kjcf05n02 ifdown[14854]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 07:31:18 kjcf05n02 ifdown[14855]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:31:18 kjcf05n02 ifdown[14856]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:31:18 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 07:31:18 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 07:31:18 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 07:31:18 kjcf05n02 ifup[14916]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 07:31:18 kjcf05n02 ifup[14917]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:31:18 kjcf05n02 ifup[14918]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:31:19 kjcf05n02 dcs-collectord[5663]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 07:31:19 kjcf05n02 dcs-collectord[5663]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 07:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730640679', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.4% (3698904 kB) used.'}"] Nov 3 07:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.4% (3698904 kB) used.', 'message': 'OK - 1.4% (3698904 kB) used.', 'value': 'ok', 'timestamp': '1730640679'} Nov 3 07:31:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:31:21 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 07:31:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 07:31:22 kjcf05n00 zabbix-server[1066555]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:31:22 kjcf05n00 zabbix-server[1066555]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 161.48\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 100.86\\"}}"' Nov 3 07:31:22 kjcf05n00 log_interesting_event.py[1066555]: Event '45956' acknowledged Nov 3 07:31:23 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 07:31:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 07:31:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 07:31:23 kjcf05n02 systemd[1]: Reloading. Nov 3 07:31:23 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 3 07:31:23 kjcf05n02 await_ha_peer[15140]: Waiting for HA peer kjcf05n03 Nov 3 07:31:25 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 07:31:25 kjcf05n02 await_ha_peer[15140]: Peer kjcf05n03 has started, starting HA Nov 3 07:31:25 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 3 07:31:25 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 3 07:31:25 kjcf05n02 fstonithd.py[15192]: Listening for kdump packets from partner Nov 3 07:31:25 kjcf05n02 systemd[1]: Reloading. Nov 3 07:31:25 kjcf05n02 systemd[3148]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:31:25 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:31:25 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:31:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730640685', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 07:31:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730640685'} Nov 3 07:31:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:31:26 kjcf05n02 systemd[1]: Reloading. Nov 3 07:31:26 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 3 07:31:26 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 07:31:26 kjcf05n02 systemd[1]: Reloading. Nov 3 07:31:26 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 07:31:26 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 07:31:26 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 07:31:26 kjcf05n02 puppet-agent[3586]: Applied catalog in 95.51 seconds Nov 3 07:31:26 kjcf05n02 puppet[3586]: Notice: Applied catalog in 95.51 seconds Nov 3 07:31:26 kjcf05n02 systemd[1]: Started Puppet agent. Nov 3 07:31:26 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 07:31:26 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 07:31:26 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 07:31:26 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 07:31:26 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 07:31:26 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 07:31:26 kjcf05n02 systemd[1]: Reached target Timers. Nov 3 07:31:26 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 07:31:26 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 3 07:31:26 kjcf05n02 wce-disable.sh[15341]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 07:31:26 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 07:31:26 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 07:31:26 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 07:31:26 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 07:31:26 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 3 07:31:26 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 3 07:31:27 kjcf05n02 gateway-ec-node.py[15340]: Starting gateway-ec-node service Nov 3 07:31:27 kjcf05n02 python3.9[15339]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 07:31:27 kjcf05n02 python3.9[15339]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 07:31:27 kjcf05n02 RFSF-API[15338]: INFO[2024-11-03T07:31:26-06:00] Datapath API RESTful Service starting Nov 3 07:31:27 kjcf05n02 dp-api-server-node[15338]: INFO[2024-11-03T07:31:26-06:00] Datapath API RESTful Service starting Nov 3 07:31:27 kjcf05n02 RFSF-API[15338]: INFO[2024-11-03T07:31:26-06:00] Running in production mode, starting dbus event listener Nov 3 07:31:27 kjcf05n02 dp-api-server-node[15338]: INFO[2024-11-03T07:31:26-06:00] Running in production mode, starting dbus event listener Nov 3 07:31:27 kjcf05n02 RFSF-API[15338]: INFO[2024-11-03T07:31:26-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 07:31:27 kjcf05n02 dp-api-server-node[15338]: INFO[2024-11-03T07:31:26-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 07:31:27 kjcf05n02 RFSF-API[15338]: INFO[2024-11-03T07:31:26-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 07:31:27 kjcf05n02 dp-api-server-node[15338]: INFO[2024-11-03T07:31:26-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 07:31:27 kjcf05n02 RFSF-API[15338]: INFO[2024-11-03T07:31:26-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 07:31:27 kjcf05n02 dp-api-server-node[15338]: INFO[2024-11-03T07:31:26-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 07:31:27 kjcf05n02 RFSF-API[15338]: INFO[2024-11-03T07:31:26-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 07:31:27 kjcf05n02 dp-api-server-node[15338]: INFO[2024-11-03T07:31:26-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 07:31:27 kjcf05n02 RFSF-API[15338]: INFO[2024-11-03T07:31:26-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 07:31:27 kjcf05n02 dp-api-server-node[15338]: INFO[2024-11-03T07:31:26-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 07:31:27 kjcf05n02 RFSF-API[15338]: INFO[2024-11-03T07:31:26-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 07:31:27 kjcf05n02 dp-api-server-node[15338]: INFO[2024-11-03T07:31:26-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 07:31:27 kjcf05n02 RFSF-API[15338]: INFO[2024-11-03T07:31:26-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 07:31:27 kjcf05n02 dp-api-server-node[15338]: INFO[2024-11-03T07:31:26-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 07:31:27 kjcf05n02 RFSF-API[15338]: INFO[2024-11-03T07:31:26-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 07:31:27 kjcf05n02 dp-api-server-node[15338]: INFO[2024-11-03T07:31:26-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 07:31:27 kjcf05n02 RFSF-API[15338]: INFO[2024-11-03T07:31:26-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 07:31:27 kjcf05n02 dp-api-server-node[15338]: INFO[2024-11-03T07:31:26-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 07:31:27 kjcf05n02 dp-api-server-node[15338]: INFO[2024-11-03T07:31:26-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 07:31:27 kjcf05n02 RFSF-API[15338]: INFO[2024-11-03T07:31:26-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 07:31:28 kjcf05n00 mcfcli[3673891]: %3|1730640688.247|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:31:33 kjcf05n02 systemd[1]: Reloading. Nov 3 07:31:34 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 07:31:34 kjcf05n02 systemd[1]: Reloading. Nov 3 07:31:34 kjcf05n02 dcs-collectord[5663]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 07:31:34 kjcf05n02 dcs-collectord[5663]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 07:31:34 kjcf05n02 dcs-collectord[5663]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 07:31:34 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 07:31:34 kjcf05n02 diskmonitor_pre[15723]: Key management is currently disabled.DEAR disabled Nov 3 07:31:34 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 07:31:36 kjcf05n02 sh[15793]: LNET configured: New Created Nov 3 07:31:36 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 07:31:36 kjcf05n02 LCNmon[17932]: Interface ib0 is up Nov 3 07:31:36 kjcf05n02 LCNmon[17932]: Interface ib1 is up Nov 3 07:31:36 kjcf05n02 LCNmon[17932]: Can ping through interface ib0 Nov 3 07:31:36 kjcf05n02 LCNmon[17932]: Can ping through interface ib1 Nov 3 07:31:36 kjcf05n02 LCNmon[17932]: NIC ib0, initial state UP Nov 3 07:31:36 kjcf05n02 LCNmon[17932]: NIC ib1, initial state UP Nov 3 07:31:36 kjcf05n02 LCNmon[17932]: LCNstat initial state UP Nov 3 07:31:36 kjcf05n02 LCNmon[17932]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 3 07:31:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730640696', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 07:31:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730640696', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 07:31:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730640696'} Nov 3 07:31:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730640696'} Nov 3 07:31:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:31:36 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 07:31:36 kjcf05n00 httpd[902570]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 07:31:37 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 07:31:37 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18091 (bash) Nov 3 07:31:37 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 07:31:37 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 07:31:37 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 07:31:37 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 07:31:37 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: /var/run/diskmonitor does not exist, creating Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: Creating /var/run/diskmonitor/disk Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: Creating /var/run/diskmonitor/encl Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: Creating /var/run/diskmonitor/cli Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: RAS_Interlocks_enabled: 1 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: add handler for sig: 14 sa_flags: 10000004 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: add handler for sig: 1 sa_flags: 10000004 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: add handler for sig: 2 sa_flags: 00000004 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: add handler for sig: 15 sa_flags: 00000004 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: add handler for sig: 6 sa_flags: 00000004 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: add handler for sig: 3 sa_flags: 00000004 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: add handler for sig: 30 sa_flags: 00000004 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: add handler for sig: 20 sa_flags: 00000004 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: add handler for sig: 10 sa_flags: 10000004 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: add handler for sig: 11 sa_flags: 00000004 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: add handler for sig: 7 sa_flags: 00000004 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: add handler for sig: 4 sa_flags: 00000004 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: add handler for sig: 8 sa_flags: 00000004 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: Using HA Baton locks - key: diskmonitor Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: Baton will be held for at most 570 seconds Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: DMMP Enabled: 0 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: random seed: a4847e66 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: NVMe Enclosure: 1 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: ZFS Enclosure: 0 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: Dbus, Initialized Connection Successfully Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: int_catcher_thread: thread start Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: Received dbus message 4 org.freedesktop.DBus -> :1.95 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 07:31:38 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 07:31:38 kjcf05n02 openhpid[5569]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 07:31:38 kjcf05n02 openhpid[5569]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 07:31:38 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 3 07:31:38 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 07:31:38 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 07:31:38 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18320 which is not our child. We'll most likely not notice when it exits. Nov 3 07:31:38 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 07:31:38 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 3 07:31:38 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 3 07:31:38 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 07:31:38 kjcf05n02 dcs-collectord[5663]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 07:31:38 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 07:31:38 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 07:31:38 kjcf05n02 systemd[1]: Startup finished in 51.036s (kernel) + 2min 30.439s (userspace) = 3min 21.475s. Nov 3 07:31:38 kjcf05n02 openhpid[18320]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 07:31:38 kjcf05n02 openhpid[18320]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 07:31:38 kjcf05n02 openhpid[18320]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 07:31:38 kjcf05n02 openhpid[18320]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: check_run_sedcmd, No Device name provided Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 07:31:43 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 07:31:46 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31420 deleted. Nov 3 07:31:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730640708', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(3304.0B/2376.0B), ib1=(2940.0B/2648.0B), icl0=(8.3kB/10.1kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.1MB), mgmt0=(1478.5MB/8.1MB)'}"] Nov 3 07:31:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(3304.0B/2376.0B), ib1=(2940.0B/2648.0B), icl0=(8.3kB/10.1kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.1MB), mgmt0=(1478.5MB/8.1MB)', 'message': 'NET OK - (Rx/Tx) ib0=(3304.0B/2376.0B), ib1=(2940.0B/2648.0B), icl0=(8.3kB/10.1kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.1MB), mgmt0=(1478.5MB/8.1MB)', 'value': 'ok', 'timestamp': '1730640708'} Nov 3 07:31:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:31:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730640708', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 07:31:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730640708'} Nov 3 07:31:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:31:49 kjcf05n02 dcs-collectord[5663]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 07:31:49 kjcf05n02 dcs-collectord[5663]: WARNING No data collected (hpi_parser.py:353) Nov 3 07:31:50 kjcf05n00 mcfcli[3673891]: %3|1730640710.334|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:31:58 kjcf05n00 mcfcli[3673891]: %3|1730640718.248|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:31:59 kjcf05n02 ipmievd[4002]: System Event sensor - Timestamp Clock Sync Nov 3 07:32:04 kjcf05n02 ipmievd[3148]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:32:04 kjcf05n02 dcs-collectord[5663]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 07:32:11 kjcf05n03 nslcd[6947]: [e8944a] ldap_result() failed: Can't contact LDAP server Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 07:32:17 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 07:32:19 kjcf05n02 dcs-collectord[5663]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 07:32:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730640741', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 07:32:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730640741'} Nov 3 07:32:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:32:25 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 07:32:25 kjcf05n02 ras-resource-manager-agent[5927]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "0fc00cba-99e8-11ef-850c-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 07:32:25 kjcf05n02 ras-resource-manager-agent[5927]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '0fc00cba-99e8-11ef-850c-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 07:32:25 kjcf05n02 ras-resource-manager-agent[5927]: INFO Submitting new device inserted signal, starting to qualify drive: 0fc00cba-99e8-11ef-850c-00093d0695e3 (admin_action.py:110) Nov 3 07:32:25 kjcf05n03 firmware-update-orc-server[5875]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "4042fedf-ac8d-4cf8-af1e-72495c22c58b"} (logger.py:65) Nov 3 07:32:25 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 85377 (get_disk_device) Nov 3 07:32:25 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 07:32:25 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 07:32:25 kjcf05n03 ccp-client[85398]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 07:32:24 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '0fc00cba-99e8-11ef-850c-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 07:32:24 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '0fc00cba-99e8-11ef-850c-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 07:32:24 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '0fc00cba-99e8-11ef-850c-00093d0695e3', 'response ID': '0fca6d18-99e8-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 07:32:24 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 0fca6d18-99e8-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 07:32:25 kjcf05n02 diskmonitor[17441]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 07:32:25 kjcf05n03 ccp-client[85398]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 07:32:25 kjcf05n03 ccp-client[85422]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 07:32:25 kjcf05n03 ccp-client[85398]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 07:32:25 kjcf05n03 ccp-client[85422]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 07:32:25 kjcf05n03 ccp-client[85398]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 07:32:25 kjcf05n03 ccp-client[85422]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 07:32:25 kjcf05n02 ras-resource-manager-agent[5927]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "1013f4c4-99e8-11ef-850c-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 07:32:25 kjcf05n02 ras-resource-manager-agent[5927]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '1013f4c4-99e8-11ef-850c-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 07:32:25 kjcf05n02 ras-resource-manager-agent[5927]: INFO Submitting new device inserted signal, starting to qualify drive: 1013f4c4-99e8-11ef-850c-00093d0695e3 (admin_action.py:110) Nov 3 07:32:25 kjcf05n02 firmware-update-orc-server[5883]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "033d7e7e-b397-48cb-8049-dbfff91f983c"} (logger.py:65) Nov 3 07:32:25 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '1013f4c4-99e8-11ef-850c-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 07:32:25 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '1013f4c4-99e8-11ef-850c-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 07:32:25 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '1013f4c4-99e8-11ef-850c-00093d0695e3', 'response ID': '101b544e-99e8-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 07:32:25 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 101b544e-99e8-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 07:32:28 kjcf05n00 mcfcli[3673891]: %3|1730640748.248|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 07:32:28 kjcf05n03 DRVFW[85529]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 07:32:28 kjcf05n03 ccp-client[85530]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 07:32:28 kjcf05n03 ccp-client[85530]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 07:32:28 kjcf05n03 ccp-client[85539]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 07:32:28 kjcf05n03 ccp-client[85530]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 07:32:28 kjcf05n03 ccp-client[85530]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 07:32:28 kjcf05n03 ccp-client[85539]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 07:32:28 kjcf05n03 ccp-client[85539]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 07:32:28 kjcf05n03 firmware-update-orc-server[5875]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 07:32:29 kjcf05n02 ras-resource-manager-agent[5927]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '0fc00cba-99e8-11ef-850c-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 07:32:29 kjcf05n02 ras-resource-manager-agent[5927]: INFO Drive qualification complete responding: 0fc00cba-99e8-11ef-850c-00093d0695e3 (admin_action.py:205) Nov 3 07:32:29 kjcf05n02 ras-resource-manager-agent[5927]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "0fc00cba-99e8-11ef-850c-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (interesting_event.py:59) Nov 3 07:32:28 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 0fca6d18-99e8-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 07:32:28 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '0fc00cba-99e8-11ef-850c-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '0fc00cba-99e8-11ef-850c-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}}} (logger.py:65) Nov 3 07:32:29 kjcf05n00 mcfcli[3673891]: %3|1730640749.279|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:32:33 kjcf05n02 diskmonitor[17441]: drive: eui.345950304db010240025384500000004 Nov 3 07:32:33 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 07:32:33 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 07:32:33 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 07:32:33 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 07:32:33 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 07:32:33 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 07:32:33 kjcf05n02 diskmonitor[17441]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 07:32:33 kjcf05n02 diskmonitor[17441]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 07:32:33 kjcf05n02 diskmonitor[17441]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 07:32:33 kjcf05n02 diskmonitor[17441]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 07:32:33 kjcf05n02 diskmonitor[17441]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 07:32:33 kjcf05n02 diskmonitor[17441]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "0fc00cba-99e8-11ef-850c-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 07:32:33 kjcf05n02 diskmonitor[17441]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 07:32:33 kjcf05n02 diskmonitor[17441]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 07:32:33 kjcf05n02 diskmonitor[17441]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "1013f4c4-99e8-11ef-850c-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 07:32:33 kjcf05n02 diskmonitor[17441]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 07:32:33 kjcf05n02 diskmonitor[17441]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 07:32:35 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22359 (get_disk_device) Nov 3 07:32:35 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 07:32:35 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 07:32:35 kjcf05n02 ccp-client[22380]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 07:32:35 kjcf05n02 ccp-client[22380]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 07:32:35 kjcf05n02 ccp-client[22393]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 07:32:35 kjcf05n02 ccp-client[22380]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 07:32:35 kjcf05n02 ccp-client[22380]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 07:32:35 kjcf05n02 ccp-client[22393]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 07:32:35 kjcf05n02 ccp-client[22393]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 07:32:35 kjcf05n02 chronyd[5171]: Selected source 172.16.2.1 Nov 3 07:32:38 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 3 07:32:38 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 07:32:38 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 3 07:32:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730640758}"] Nov 3 07:32:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730640758, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:32:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:32:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730640758}"] Nov 3 07:32:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730640758, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:32:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:32:39 kjcf05n02 DRVFW[22631]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 07:32:39 kjcf05n02 ccp-client[22642]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 07:32:39 kjcf05n02 ccp-client[22642]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 07:32:39 kjcf05n02 ccp-client[22699]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 07:32:39 kjcf05n02 ccp-client[22642]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 07:32:39 kjcf05n02 ccp-client[22642]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 07:32:39 kjcf05n02 ccp-client[22699]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 07:32:39 kjcf05n02 ccp-client[22699]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 07:32:39 kjcf05n02 firmware-update-orc-server[5883]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 07:32:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730640758}"] Nov 3 07:32:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730640758, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:32:39 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:32:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730640758}"] Nov 3 07:32:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730640758, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:32:39 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:32:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730640758}"] Nov 3 07:32:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730640758, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:32:39 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:32:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730640758}"] Nov 3 07:32:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730640758, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:32:39 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:32:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730640759}"] Nov 3 07:32:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730640759, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:32:39 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:32:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730640759}"] Nov 3 07:32:39 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730640759, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:32:39 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:32:40 kjcf05n02 ras-resource-manager-agent[5927]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '1013f4c4-99e8-11ef-850c-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}} (resource_admin.py:98) Nov 3 07:32:40 kjcf05n02 ras-resource-manager-agent[5927]: INFO Drive qualification complete responding: 1013f4c4-99e8-11ef-850c-00093d0695e3 (admin_action.py:205) Nov 3 07:32:40 kjcf05n02 ras-resource-manager-agent[5927]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "1013f4c4-99e8-11ef-850c-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (interesting_event.py:59) Nov 3 07:32:40 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 101b544e-99e8-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 07:32:40 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '1013f4c4-99e8-11ef-850c-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '1013f4c4-99e8-11ef-850c-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}}} (logger.py:65) Nov 3 07:32:47 kjcf05n02 python3.9[5235]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 07:32:47 kjcf05n02 python3.9[3148]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:32:47 kjcf05n02 ras-resource-manager-agent[5927]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "0fc00cba-99e8-11ef-850c-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (service_main_handler.py:66) Nov 3 07:32:47 kjcf05n02 ras-resource-manager-agent[5927]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '0fc00cba-99e8-11ef-850c-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 07:32:47 kjcf05n02 ras-resource-manager-agent[5927]: INFO Device qualification response has been acknowledged: 0fc00cba-99e8-11ef-850c-00093d0695e3 (admin_action.py:151) Nov 3 07:32:47 kjcf05n02 ras-resource-manager-agent[5927]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "1013f4c4-99e8-11ef-850c-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (service_main_handler.py:66) Nov 3 07:32:47 kjcf05n02 ras-resource-manager-agent[5927]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '1013f4c4-99e8-11ef-850c-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}} (resource_admin.py:98) Nov 3 07:32:47 kjcf05n02 ras-resource-manager-agent[5927]: INFO Device qualification response has been acknowledged: 1013f4c4-99e8-11ef-850c-00093d0695e3 (admin_action.py:151) Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "0fc00cba-99e8-11ef-850c-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: Dbus, handle_ingress_ras_signals, uuid: 0fc00cba-99e8-11ef-850c-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "0fc00cba-99e8-11ef-850c-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "1013f4c4-99e8-11ef-850c-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: Dbus, handle_ingress_ras_signals, uuid: 1013f4c4-99e8-11ef-850c-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "1013f4c4-99e8-11ef-850c-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 07:32:49 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 07:32:51 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 07:32:51 kjcf05n02 diskmonitor[17441]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 07:32:56 kjcf05n02 diskmonitor[17441]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 07:32:56 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 07:32:56 kjcf05n02 diskmonitor[17441]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 07:32:56 kjcf05n02 diskmonitor[17441]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 07:32:56 kjcf05n02 diskmonitor[17441]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 07:32:56 kjcf05n02 diskmonitor[17441]: leaving test state: 1 next state: 2 Nov 3 07:32:56 kjcf05n02 diskmonitor[17441]: lock req: no timeout Nov 3 07:32:56 kjcf05n02 diskmonitor[17441]: leaving test state: 2 next state: 4 Nov 3 07:32:56 kjcf05n02 diskmonitor[17441]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 07:32:58 kjcf05n00 mcfcli[3673891]: %3|1730640778.248|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 07:33:08 kjcf05n00 mcfcli[3673891]: %3|1730640788.945|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T07:33:27.252900355-06:00 level=info msg="Completed cleanup jobs" duration=26.223099ms Nov 3 07:33:28 kjcf05n00 mcfcli[3673891]: %3|1730640808.248|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:33:45 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 07:33:46 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 07:33:46 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 07:33:46 kjcf05n00 mcfcli[3673891]: %3|1730640826.892|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:33:56 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 07:33:56 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 07:33:56 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 07:33:58 kjcf05n00 mcfcli[3673891]: %3|1730640838.248|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:33:59 kjcf05n02 dcs-collectord[5663]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 07:34:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730640848}"] Nov 3 07:34:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730640848, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:34:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:34:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:34:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:34:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:34:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:34:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:34:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:34:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:34:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:34:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:34:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:34:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:34:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:34:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.527424ms Nov 3 07:34:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:34:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.527424ms Nov 3 07:34:08 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:34:08 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:34:08 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:34:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730640848}"] Nov 3 07:34:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730640848, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:34:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:34:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:34:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:34:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:34:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:34:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:34:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:34:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:34:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:34:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:34:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:34:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:34:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:34:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.13589ms Nov 3 07:34:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:34:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.13589ms Nov 3 07:34:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:34:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:34:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:34:13 kjcf05n02 diskmonitor[17441]: lock acquired Nov 3 07:34:13 kjcf05n02 diskmonitor[17441]: leaving test state: 4 next state: 8 Nov 3 07:34:26 kjcf05n00 mcfcli[3673891]: %3|1730640866.889|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:34:28 kjcf05n00 mcfcli[3673891]: %3|1730640868.250|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:34:32 kjcf05n02 diskmonitor[17441]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 07:34:32 kjcf05n02 diskmonitor[17441]: leaving test state: 8 next state: 20 Nov 3 07:34:32 kjcf05n02 diskmonitor[17441]: leaving test state: 20 next state: 40 Nov 3 07:34:32 kjcf05n02 diskmonitor[17441]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 2987b5b8000 Nov 3 07:34:32 kjcf05n02 diskmonitor[17441]: leaving test state: 40 next state: 80 Nov 3 07:34:58 kjcf05n00 mcfcli[3673891]: %3|1730640898.250|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:35:06 kjcf05n00 mcfcli[3673891]: %3|1730640906.582|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:35:11 kjcf05n00 python3.9[1068740]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 07:35:18 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 07:35:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730640317', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 07:35:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730640317'} Nov 3 07:35:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:35:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730640618', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 07:35:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730640618'} Nov 3 07:35:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:35:28 kjcf05n00 mcfcli[3673891]: %3|1730640928.250|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 07:35:29 kjcf05n02 diskmonitor[17441]: leaving test state: 80 next state: 100 Nov 3 07:35:29 kjcf05n02 diskmonitor[17441]: lock release: time: Sun Nov 3 07:35:23 2024 Nov 3 07:35:29 kjcf05n02 diskmonitor[17441]: leaving test state: 100 next state: 1 Nov 3 07:35:44 kjcf05n00 mcfcli[3673891]: %3|1730640944.633|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:35:45 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 07:35:58 kjcf05n00 mcfcli[3673891]: %3|1730640958.250|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 07:36:23 kjcf05n00 mcfcli[3673891]: %3|1730640983.594|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:36:28 kjcf05n00 mcfcli[3673891]: %3|1730640988.251|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:36:58 kjcf05n00 mcfcli[3673891]: %3|1730641018.252|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:37:01 kjcf05n00 mcfcli[3673891]: %3|1730641021.231|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:37:28 kjcf05n00 mcfcli[3673891]: %3|1730641048.252|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 07:37:39 kjcf05n00 mcfcli[3673891]: %3|1730641059.894|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:37:58 kjcf05n00 mcfcli[3673891]: %3|1730641078.253|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:38:18 kjcf05n00 mcfcli[3673891]: %3|1730641098.378|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:38:28 kjcf05n00 mcfcli[3673891]: %3|1730641108.253|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:38:57 kjcf05n00 mcfcli[3673891]: %3|1730641137.547|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:38:58 kjcf05n00 mcfcli[3673891]: %3|1730641138.253|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 07:39:28 kjcf05n00 mcfcli[3673891]: %3|1730641168.254|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 07:39:35 kjcf05n00 mcfcli[3673891]: %3|1730641175.361|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:39:58 kjcf05n00 mcfcli[3673891]: %3|1730641198.254|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 07:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 07:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 07:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 07:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 07:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 07:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 07:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 07:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 07:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 07:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 07:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 07:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 07:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 07:40:03 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 07:40:03 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:40:03 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 07:40:05 kjcf05n00 python3.9[1071654]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 07:40:13 kjcf05n00 mcfcli[3673891]: %3|1730641213.701|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:40:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730640618', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 07:40:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730640618'} Nov 3 07:40:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:40:28 kjcf05n00 mcfcli[3673891]: %3|1730641228.254|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 07:40:49 kjcf05n00 mcfcli[3673891]: %3|1730641249.781|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:40:58 kjcf05n00 mcfcli[3673891]: %3|1730641258.254|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 07:41:28 kjcf05n00 mcfcli[3673891]: %3|1730641288.255|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 07:41:28 kjcf05n00 mcfcli[3673891]: %3|1730641288.897|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:41:58 kjcf05n00 mcfcli[3673891]: %3|1730641318.256|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:42:08 kjcf05n00 mcfcli[3673891]: %3|1730641328.866|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:42:12 kjcf05n02 root[41924]: failback_xyraid Nov 3 07:42:13 kjcf05n02 root[42114]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 07:42:14 kjcf05n02 root[42321]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 07:42:17 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 3 07:42:20 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme17n1 Nov 3 07:42:20 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme25n1 Nov 3 07:42:20 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme9n1 Nov 3 07:42:20 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme2n1 Nov 3 07:42:20 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme24n1 Nov 3 07:42:20 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme18n1 Nov 3 07:42:20 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme8n1 Nov 3 07:42:20 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme23n1 Nov 3 07:42:20 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme3n1 Nov 3 07:42:20 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme19n1 Nov 3 07:42:20 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme4n1 Nov 3 07:42:22 kjcf05n02 dwd[5206]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 07:42:22 kjcf05n02 dwd[5206]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 07:42:22 kjcf05n02 dwd[5206]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 07:42:22 kjcf05n02 dwd[5206]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 07:42:22 kjcf05n02 dwd[5206]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 07:42:22 kjcf05n02 dwd[5206]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 07:42:22 kjcf05n02 dwd[5206]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 07:42:22 kjcf05n02 dwd[5206]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 07:42:22 kjcf05n02 dwd[5206]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 07:42:22 kjcf05n02 dwd[5206]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 07:42:22 kjcf05n02 dwd[5206]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 07:42:22 kjcf05n02 dwd[5206]: Starting NVME thread for nvme2n1 Nov 3 07:42:22 kjcf05n02 dwd[5206]: Starting NVME thread for nvme18n1 Nov 3 07:42:23 kjcf05n02 dwd[5206]: Starting NVME thread for nvme19n1 Nov 3 07:42:23 kjcf05n02 dwd[5206]: Starting NVME thread for nvme9n1 Nov 3 07:42:23 kjcf05n02 dwd[5206]: Starting NVME thread for nvme3n1 Nov 3 07:42:23 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45094]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45096]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45094]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45096]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45094]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45096]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45094]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45096]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45094]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45096]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45094]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45096]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45120]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45123]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45125]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45126]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45094]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45096]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45120]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45123]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45126]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45094]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45096]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45092]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45120]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45094]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45096]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45094]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45096]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45123]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45120]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45094]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45096]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45120]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45094]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45096]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45096]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45094]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45096]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45096]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45094]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45096]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45094]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45096]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45096]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45094]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45096]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 systemd-udevd[45096]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:42:23 kjcf05n02 dwd[5206]: Starting NVME thread for nvme24n1 Nov 3 07:42:24 kjcf05n02 nslcd[7276]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 07:42:24 kjcf05n02 dwd[5206]: Starting NVME thread for nvme4n1 Nov 3 07:42:24 kjcf05n02 dwd[5206]: Starting NVME thread for nvme23n1 Nov 3 07:42:24 kjcf05n02 dwd[5206]: Starting NVME thread for nvme17n1 Nov 3 07:42:24 kjcf05n02 dwd[5206]: Starting NVME thread for nvme25n1 Nov 3 07:42:24 kjcf05n02 dwd[5206]: Starting NVME thread for nvme8n1 Nov 3 07:42:25 kjcf05n02 dcs-bulk-data-sender[6206]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 3 07:42:28 kjcf05n00 mcfcli[3673891]: %3|1730641348.256|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:42:29 kjcf05n02 diskmonitor[17441]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 07:42:36 kjcf05n02 diskmonitor[17441]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 07:42:36 kjcf05n02 diskmonitor[17441]: Scan for ReadErrorMax change for md65 Nov 3 07:42:36 kjcf05n02 diskmonitor[17441]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 07:42:36 kjcf05n02 diskmonitor[17441]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 07:42:36 kjcf05n02 diskmonitor[17441]: read_saved_file: md65 no saved speed Nov 3 07:42:36 kjcf05n02 diskmonitor[17441]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 07:42:36 kjcf05n02 diskmonitor[17441]: Set sync_speed_min (10000) for md65 Nov 3 07:42:36 kjcf05n02 diskmonitor[17441]: Set sync_speed_max (200000) for md65 Nov 3 07:42:36 kjcf05n02 diskmonitor[17441]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 07:42:48 kjcf05n00 mcfcli[3673891]: %3|1730641368.863|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:42:58 kjcf05n00 mcfcli[3673891]: %3|1730641378.256|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:43:03 kjcf05n03 diskmonitor[17713]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 07:43:03 kjcf05n03 diskmonitor[17713]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 07:43:04 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47517 (bash) Nov 3 07:43:04 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 07:43:04 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 07:43:17 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 07:43:17 kjcf05n02 systemd-tmpfiles[48117]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 07:43:17 kjcf05n02 systemd-tmpfiles[48117]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 07:43:17 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 07:43:17 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 07:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T07:43:27.252785123-06:00 level=info msg="Completed cleanup jobs" duration=26.156115ms Nov 3 07:43:27 kjcf05n00 mcfcli[3673891]: %3|1730641407.918|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:43:28 kjcf05n00 mcfcli[3673891]: %3|1730641408.257|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 07:43:58 kjcf05n00 mcfcli[3673891]: %3|1730641438.258|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:44:07 kjcf05n00 zabbix-server[1074057]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:44:07 kjcf05n00 zabbix-server[1074057]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '45973' Nov 3 07:44:07 kjcf05n00 zabbix-server[1074057]: Filesystem 'kjcf05' has been mounted Nov 3 07:44:07 kjcf05n00 mcfcli[3673891]: %3|1730641447.915|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:44:07 kjcf05n00 zabbix-server[1074057]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 07:44:07 kjcf05n00 zabbix-server[1074057]: Running puppet on 'None' Nov 3 07:44:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730641449}"] Nov 3 07:44:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730641449, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:44:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.34912ms Nov 3 07:44:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.34912ms Nov 3 07:44:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:44:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:44:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:44:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730641449}"] Nov 3 07:44:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730641449, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:44:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.685156ms Nov 3 07:44:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.685156ms Nov 3 07:44:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:44:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:44:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:44:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730641449}"] Nov 3 07:44:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730641449, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:44:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.982143ms Nov 3 07:44:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.982143ms Nov 3 07:44:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:44:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:44:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:44:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730641449}"] Nov 3 07:44:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730641449, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:44:09 kjcf05n02 puppet-agent[49687]: Using configured environment 'production' Nov 3 07:44:09 kjcf05n02 puppet-agent[49687]: Retrieving pluginfacts Nov 3 07:44:09 kjcf05n02 puppet-agent[49687]: Retrieving plugin Nov 3 07:44:09 kjcf05n03 puppet-agent[106500]: Using configured environment 'production' Nov 3 07:44:09 kjcf05n03 puppet-agent[106500]: Retrieving pluginfacts Nov 3 07:44:09 kjcf05n03 puppet-agent[106500]: Retrieving plugin Nov 3 07:44:10 kjcf05n06 puppet-agent[2612880]: Using configured environment 'production' Nov 3 07:44:10 kjcf05n06 puppet-agent[2612880]: Retrieving pluginfacts Nov 3 07:44:10 kjcf05n06 puppet-agent[2612880]: Retrieving plugin Nov 3 07:44:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.247759ms Nov 3 07:44:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.247759ms Nov 3 07:44:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:44:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:44:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:44:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730641449}"] Nov 3 07:44:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730641449, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:44:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.700598ms Nov 3 07:44:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.700598ms Nov 3 07:44:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:44:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:44:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:44:10 kjcf05n07 puppet-agent[2610319]: Using configured environment 'production' Nov 3 07:44:10 kjcf05n07 puppet-agent[2610319]: Retrieving pluginfacts Nov 3 07:44:10 kjcf05n07 puppet-agent[2610319]: Retrieving plugin Nov 3 07:44:10 kjcf05n05 puppet-agent[2756902]: Using configured environment 'production' Nov 3 07:44:10 kjcf05n05 puppet-agent[2756902]: Retrieving pluginfacts Nov 3 07:44:10 kjcf05n05 puppet-agent[2756902]: Retrieving plugin Nov 3 07:44:10 kjcf05n04 puppet-agent[2611817]: Using configured environment 'production' Nov 3 07:44:10 kjcf05n04 puppet-agent[2611817]: Retrieving pluginfacts Nov 3 07:44:10 kjcf05n04 puppet-agent[2611817]: Retrieving plugin Nov 3 07:44:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730641449}"] Nov 3 07:44:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730641449, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:44:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.177167ms Nov 3 07:44:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.177167ms Nov 3 07:44:10 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:44:10 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:44:10 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:44:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730641449}"] Nov 3 07:44:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730641449, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:44:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.534176ms Nov 3 07:44:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.534176ms Nov 3 07:44:10 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:44:10 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:44:10 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:44:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730641449}"] Nov 3 07:44:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730641449, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:44:10 kjcf05n02 puppet-agent[49687]: Loading facts Nov 3 07:44:10 kjcf05n03 puppet-agent[106500]: Loading facts Nov 3 07:44:10 kjcf05n01 puppet-agent[2973948]: Using configured environment 'production' Nov 3 07:44:10 kjcf05n01 puppet-agent[2973948]: Retrieving pluginfacts Nov 3 07:44:10 kjcf05n01 puppet-agent[2973948]: Retrieving plugin Nov 3 07:44:10 kjcf05n07 puppet-agent[2610319]: Loading facts Nov 3 07:44:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.981561ms Nov 3 07:44:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.981561ms Nov 3 07:44:10 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:44:10 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:44:10 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:44:10 kjcf05n00 puppet-agent[1074121]: Using configured environment 'production' Nov 3 07:44:10 kjcf05n00 puppet-agent[1074121]: Retrieving pluginfacts Nov 3 07:44:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730641449}"] Nov 3 07:44:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730641449, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:44:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.848813ms Nov 3 07:44:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.848813ms Nov 3 07:44:10 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:44:10 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:44:10 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:44:10 kjcf05n00 puppet-agent[1074121]: Retrieving plugin Nov 3 07:44:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730641449}"] Nov 3 07:44:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730641449, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:44:10 kjcf05n05 puppet-agent[2756902]: Loading facts Nov 3 07:44:10 kjcf05n06 puppet-agent[2612880]: Loading facts Nov 3 07:44:10 kjcf05n04 puppet-agent[2611817]: Loading facts Nov 3 07:44:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.85257ms Nov 3 07:44:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.85257ms Nov 3 07:44:10 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:44:10 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:44:10 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:44:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730641449}"] Nov 3 07:44:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730641449, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 07:44:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:10-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 07:44:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:10 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T07:44:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:10-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 07:44:10 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T07:44:10-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 07:44:10 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T07:44:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.097057ms Nov 3 07:44:10 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T07:44:10-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.097057ms Nov 3 07:44:10 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:07:44:10 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 07:44:10 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:44:10 kjcf05n00 puppet-agent[1074121]: Loading facts Nov 3 07:44:11 kjcf05n01 puppet-agent[2973948]: Loading facts Nov 3 07:44:17 kjcf05n03 puppet-agent[106500]: Caching catalog for kjcf05n03 Nov 3 07:44:17 kjcf05n03 puppet-agent[106500]: Applying configuration version '1730641451' Nov 3 07:44:18 kjcf05n07 puppet-agent[2610319]: Caching catalog for kjcf05n07 Nov 3 07:44:18 kjcf05n07 puppet-agent[2610319]: Applying configuration version '1730641452' Nov 3 07:44:18 kjcf05n02 puppet-agent[49687]: Caching catalog for kjcf05n02 Nov 3 07:44:18 kjcf05n02 puppet-agent[49687]: Applying configuration version '1730641451' Nov 3 07:44:18 kjcf05n06 puppet-agent[2612880]: Caching catalog for kjcf05n06 Nov 3 07:44:18 kjcf05n06 puppet-agent[2612880]: Applying configuration version '1730641452' Nov 3 07:44:18 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 07:44:19 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 07:44:19 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 07:44:20 kjcf05n07 puppet-agent[2610319]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 07:44:20 kjcf05n07 puppet-agent[2610319]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 07:44:20 kjcf05n07 puppet-agent[2610319]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 07:44:20 kjcf05n02 puppet-agent[49687]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 07:44:20 kjcf05n02 puppet-agent[49687]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 07:44:20 kjcf05n02 puppet-agent[49687]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 07:44:20 kjcf05n06 puppet-agent[2612880]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 07:44:20 kjcf05n06 puppet-agent[2612880]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 07:44:20 kjcf05n06 puppet-agent[2612880]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 07:44:20 kjcf05n03 puppet-agent[106500]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 07:44:20 kjcf05n03 puppet-agent[106500]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 07:44:20 kjcf05n03 puppet-agent[106500]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 07:44:20 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2557656]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 07:44:20 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 07:44:20 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 07:44:20 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 07:44:20 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 07:44:20 kjcf05n07 puppet-agent[2610319]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: Press Ctrl+C to exit. Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: Plugin support version 1.0 Nov 3 07:44:20 kjcf05n07 zabbix_agent2[2610791]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 07:44:20 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2559650]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 07:44:20 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 07:44:20 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 07:44:20 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 07:44:20 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 07:44:20 kjcf05n06 puppet-agent[2612880]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: Press Ctrl+C to exit. Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: Plugin support version 1.0 Nov 3 07:44:20 kjcf05n06 zabbix_agent2[2613355]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 07:44:20 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 07:44:20 kjcf05n03 zabbix_agent2[50325]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 07:44:20 kjcf05n03 zabbix_agent2[3176]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 07:44:20 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 07:44:20 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 07:44:20 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 07:44:20 kjcf05n03 puppet-agent[106500]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: Press Ctrl+C to exit. Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: Plugin support version 1.0 Nov 3 07:44:20 kjcf05n03 zabbix_agent2[106945]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 07:44:21 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 07:44:21 kjcf05n02 zabbix_agent2[6011]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 07:44:21 kjcf05n02 zabbix_agent2[3148]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 07:44:21 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 07:44:21 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 07:44:21 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 07:44:21 kjcf05n02 puppet-agent[49687]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: Press Ctrl+C to exit. Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: Plugin support version 1.0 Nov 3 07:44:21 kjcf05n02 zabbix_agent2[50146]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 07:44:21 kjcf05n01 puppet-agent[2973948]: Caching catalog for kjcf05n01 Nov 3 07:44:21 kjcf05n00 puppet-agent[1074121]: Caching catalog for kjcf05n00 Nov 3 07:44:21 kjcf05n00 puppet-agent[1074121]: Applying configuration version '1730641457' Nov 3 07:44:22 kjcf05n01 puppet-agent[2973948]: Applying configuration version '1730641457' Nov 3 07:44:22 kjcf05n07 puppet-agent[2610319]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 07:44:22 kjcf05n07 puppet-agent[2610319]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 07:44:22 kjcf05n07 puppet-agent[2610319]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 07:44:22 kjcf05n07 puppet-agent[2610319]: Applied catalog in 5.16 seconds Nov 3 07:44:22 kjcf05n06 puppet-agent[2612880]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 07:44:22 kjcf05n06 puppet-agent[2612880]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 07:44:22 kjcf05n06 puppet-agent[2612880]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 07:44:23 kjcf05n02 puppet-agent[49687]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 07:44:23 kjcf05n02 puppet-agent[49687]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 07:44:23 kjcf05n02 puppet-agent[49687]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 07:44:23 kjcf05n03 puppet-agent[106500]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 07:44:23 kjcf05n03 puppet-agent[106500]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 07:44:23 kjcf05n03 puppet-agent[106500]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 07:44:23 kjcf05n03 puppet-agent[106500]: Applied catalog in 5.47 seconds Nov 3 07:44:23 kjcf05n06 puppet-agent[2612880]: Applied catalog in 5.13 seconds Nov 3 07:44:23 kjcf05n02 puppet-agent[49687]: Applied catalog in 5.51 seconds Nov 3 07:44:24 kjcf05n00 puppet-agent[1074121]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 07:44:25 kjcf05n01 puppet-agent[2973948]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 07:44:25 kjcf05n01 puppet-agent[2973948]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-07:24:17]/mode) mode changed '0755' to '0750' Nov 3 07:44:25 kjcf05n01 puppet-agent[2973948]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-07:24:17/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 07:44:25 kjcf05n01 puppet-agent[2973948]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-07:24:17/vmcore]/mode) mode changed '0600' to '0640' Nov 3 07:44:25 kjcf05n01 puppet-agent[2973948]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-07:24:17/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 07:44:25 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 07:44:25 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 07:44:25 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 07:44:25 kjcf05n01 puppet-agent[2973948]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 07:44:25 kjcf05n01 puppet-agent[2973948]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 07:44:25 kjcf05n01 puppet-agent[2973948]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 07:44:25 kjcf05n00 puppet-agent[1074121]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 07:44:25 kjcf05n00 puppet-agent[1074121]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 07:44:25 kjcf05n00 puppet-agent[1074121]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 07:44:26 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2962356]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 07:44:26 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 07:44:26 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 07:44:26 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 07:44:26 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 07:44:26 kjcf05n01 puppet-agent[2973948]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: Press Ctrl+C to exit. Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: Plugin support version 1.0 Nov 3 07:44:26 kjcf05n01 zabbix_agent2[2974359]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 07:44:26 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1056114]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 07:44:26 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 07:44:26 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 07:44:26 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 07:44:26 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 07:44:26 kjcf05n00 puppet-agent[1074121]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: Press Ctrl+C to exit. Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: Plugin support version 1.0 Nov 3 07:44:26 kjcf05n00 zabbix_agent2[1074743]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 07:44:26 kjcf05n00 zabbix-server[1074789]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:44:27 kjcf05n00 zabbix-server[1074890]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:44:27 kjcf05n00 zabbix-server[1074903]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:44:27 kjcf05n00 zabbix-server[1074914]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:44:28 kjcf05n01 puppet-agent[2973948]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_073137.log]/mode) mode changed '0644' to '0640' Nov 3 07:44:28 kjcf05n01 puppet-agent[2973948]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_074304.log]/mode) mode changed '0644' to '0640' Nov 3 07:44:28 kjcf05n01 puppet-agent[2973948]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_074305]/mode) mode changed '0755' to '0750' Nov 3 07:44:28 kjcf05n01 puppet-agent[2973948]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_074305/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 07:44:28 kjcf05n00 puppet-agent[1074121]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 07:44:28 kjcf05n00 mcfcli[3673891]: %3|1730641468.259|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:44:29 kjcf05n01 puppet-agent[2973948]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_073137.log]/mode) mode changed '0644' to '0640' Nov 3 07:44:29 kjcf05n01 puppet-agent[2973948]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_074304.log]/mode) mode changed '0644' to '0640' Nov 3 07:44:29 kjcf05n01 puppet-agent[2973948]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 07:44:29 kjcf05n01 puppet-agent[2973948]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 07:44:29 kjcf05n01 puppet-agent[2973948]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 07:44:29 kjcf05n00 puppet-agent[1074121]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 07:44:29 kjcf05n00 puppet-agent[1074121]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 07:44:29 kjcf05n00 puppet-agent[1074121]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 07:44:30 kjcf05n04 puppet-agent[2611817]: Caching catalog for kjcf05n04 Nov 3 07:44:30 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 07:44:30 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 07:44:30 kjcf05n00 puppet-agent[1074121]: Applied catalog in 8.71 seconds Nov 3 07:44:30 kjcf05n04 puppet-agent[2611817]: Applying configuration version '1730641467' Nov 3 07:44:30 kjcf05n01 puppet-agent[2973948]: Applied catalog in 8.93 seconds Nov 3 07:44:32 kjcf05n04 puppet-agent[2611817]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 07:44:32 kjcf05n04 puppet-agent[2611817]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 07:44:32 kjcf05n04 puppet-agent[2611817]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 07:44:33 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2564138]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 07:44:33 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 07:44:33 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 07:44:33 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 07:44:33 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 07:44:33 kjcf05n04 puppet-agent[2611817]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: Press Ctrl+C to exit. Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: Plugin support version 1.0 Nov 3 07:44:33 kjcf05n04 zabbix_agent2[2613081]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 07:44:33 kjcf05n00 zabbix_server[15753]: Zabbix agent item "vfs.fs.size[/etc/ganesha,total]" on host "kjcf05n04" failed: first network error, wait for 15 seconds Nov 3 07:44:35 kjcf05n04 puppet-agent[2611817]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 07:44:35 kjcf05n04 puppet-agent[2611817]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 07:44:35 kjcf05n04 puppet-agent[2611817]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 07:44:35 kjcf05n04 puppet-agent[2611817]: Applied catalog in 4.92 seconds Nov 3 07:44:47 kjcf05n00 mcfcli[3673891]: %3|1730641487.460|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:44:48 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 07:44:49 kjcf05n05 puppet-agent[2756902]: Caching catalog for kjcf05n05 Nov 3 07:44:49 kjcf05n05 puppet-agent[2756902]: Applying configuration version '1730641487' Nov 3 07:44:50 kjcf05n00 zabbix_server[15783]: resuming Zabbix agent checks on host "kjcf05n04": connection restored Nov 3 07:44:51 kjcf05n05 puppet-agent[2756902]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 07:44:51 kjcf05n05 puppet-agent[2756902]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 07:44:51 kjcf05n05 puppet-agent[2756902]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 07:44:52 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2707623]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 07:44:52 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 07:44:52 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 07:44:52 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 07:44:52 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 07:44:52 kjcf05n05 puppet-agent[2756902]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: Starting Zabbix Agent 2 (6.2.1) Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: Press Ctrl+C to exit. Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: Plugin support version 1.0 Nov 3 07:44:52 kjcf05n05 zabbix_agent2[2759695]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 07:44:54 kjcf05n05 puppet-agent[2756902]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 07:44:54 kjcf05n05 puppet-agent[2756902]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 07:44:54 kjcf05n05 puppet-agent[2756902]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 07:44:54 kjcf05n00 zabbix-server[1074057]: puppet completed status:(0): '' Nov 3 07:44:54 kjcf05n00 zabbix-server[1074057]: Event '45973' acknowledged Nov 3 07:44:54 kjcf05n00 zabbix-server[1074057]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 3 07:44:54 kjcf05n05 puppet-agent[2756902]: Applied catalog in 4.77 seconds Nov 3 07:44:58 kjcf05n00 mcfcli[3673891]: %3|1730641498.758|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 07:45:05 kjcf05n00 python3.9[1075257]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 07:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730641518', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 07:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730641518'} Nov 3 07:45:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730641518', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 07:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730641518'} Nov 3 07:45:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 07:45:24 kjcf05n00 mcfcli[3673891]: %3|1730641524.455|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:45:24 kjcf05n00 zabbix-server[1075676]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:45:24 kjcf05n00 zabbix-server[1075676]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 178.16\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 117.82\\"}}"' Nov 3 07:45:24 kjcf05n00 log_interesting_event.py[1075676]: Event '45974' acknowledged Nov 3 07:45:28 kjcf05n00 mcfcli[3673891]: %3|1730641528.758|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 07:45:58 kjcf05n00 mcfcli[3673891]: %3|1730641558.760|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:46:02 kjcf05n00 mcfcli[3673891]: %3|1730641562.286|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:46:28 kjcf05n00 mcfcli[3673891]: %3|1730641588.760|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 07:46:39 kjcf05n00 mcfcli[3673891]: %3|1730641599.798|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:46:58 kjcf05n00 mcfcli[3673891]: %3|1730641618.761|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 07:47:17 kjcf05n00 mcfcli[3673891]: %3|1730641637.356|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:47:29 kjcf05n00 mcfcli[3673891]: %3|1730641649.085|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 07:47:37 kjcf05n02 dwd[5206]: nvme18n1 passed periodic SMART status check Nov 3 07:47:37 kjcf05n02 dwd[5206]: nvme2n1 passed periodic SMART status check Nov 3 07:47:38 kjcf05n02 dwd[5206]: nvme3n1 passed periodic SMART status check Nov 3 07:47:38 kjcf05n02 dwd[5206]: nvme9n1 passed periodic SMART status check Nov 3 07:47:38 kjcf05n02 dwd[5206]: nvme19n1 passed periodic SMART status check Nov 3 07:47:38 kjcf05n02 dwd[5206]: nvme24n1 passed periodic SMART status check Nov 3 07:47:39 kjcf05n02 dwd[5206]: nvme23n1 passed periodic SMART status check Nov 3 07:47:39 kjcf05n02 dwd[5206]: nvme8n1 passed periodic SMART status check Nov 3 07:47:39 kjcf05n02 dwd[5206]: nvme25n1 passed periodic SMART status check Nov 3 07:47:39 kjcf05n02 dwd[5206]: nvme17n1 passed periodic SMART status check Nov 3 07:47:39 kjcf05n02 dwd[5206]: nvme4n1 passed periodic SMART status check Nov 3 07:47:55 kjcf05n00 mcfcli[3673891]: %3|1730641675.551|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:47:59 kjcf05n00 mcfcli[3673891]: %3|1730641679.085|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:48:29 kjcf05n00 mcfcli[3673891]: %3|1730641709.263|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 07:48:35 kjcf05n00 mcfcli[3673891]: %3|1730641715.548|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:48:59 kjcf05n00 mcfcli[3673891]: %3|1730641739.263|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:49:13 kjcf05n00 mcfcli[3673891]: %3|1730641753.338|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:49:29 kjcf05n00 mcfcli[3673891]: %3|1730641769.263|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:49:51 kjcf05n00 mcfcli[3673891]: %3|1730641791.018|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:49:59 kjcf05n00 mcfcli[3673891]: %3|1730641799.264|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 07:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 07:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 07:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 07:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 07:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 07:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 07:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 07:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 07:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 07:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 07:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 07:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 07:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 07:50:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 07:50:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 07:50:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 07:50:06 kjcf05n00 python3.9[1078083]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 07:50:29 kjcf05n00 mcfcli[3673891]: %3|1730641829.265|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 07:50:31 kjcf05n00 mcfcli[3673891]: %3|1730641831.015|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:50:59 kjcf05n00 mcfcli[3673891]: %3|1730641859.265|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 07:51:06 kjcf05n00 mcfcli[3673891]: %3|1730641866.689|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:51:29 kjcf05n00 mcfcli[3673891]: %3|1730641889.266|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:51:44 kjcf05n00 mcfcli[3673891]: %3|1730641904.078|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:51:59 kjcf05n00 mcfcli[3673891]: %3|1730641919.266|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 07:52:11 kjcf05n03 nslcd[6947]: [e87ccd] ldap_result() failed: Can't contact LDAP server Nov 3 07:52:21 kjcf05n00 mcfcli[3673891]: %3|1730641941.918|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:52:29 kjcf05n00 mcfcli[3673891]: %3|1730641949.266|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:52:55 kjcf05n03 nslcd[6947]: [7ed7ab] ldap_result() failed: Can't contact LDAP server Nov 3 07:52:59 kjcf05n00 mcfcli[3673891]: %3|1730641979.267|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:53:00 kjcf05n00 mcfcli[3673891]: %3|1730641980.392|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T13:53:15.868101Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 07:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T13:53:15.868156Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.077ms Nov 3 07:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T07:53:27.238770923-06:00 level=info msg="Completed cleanup jobs" duration=12.353204ms Nov 3 07:53:29 kjcf05n00 mcfcli[3673891]: %3|1730642009.267|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 07:53:38 kjcf05n00 mcfcli[3673891]: %3|1730642018.556|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:53:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 07:53:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 07:53:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 07:53:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 07:53:59 kjcf05n00 mcfcli[3673891]: %3|1730642039.268|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:53:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 07:53:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 07:54:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 07:54:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 07:54:10 kjcf05n00 zabbix_server[15724]: Zabbix agent item "vfs.fs.inode[/var/lib/pacemaker,pfree]" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 3 07:54:12 kjcf05n00 zabbix_server[15775]: Zabbix agent item "dcs.lustre.device.ost.count[{$LUSTRE_FS_NAME}]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 3 07:54:14 kjcf05n00 mcfcli[3673891]: %3|1730642054.774|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:54:15 kjcf05n03 fstonithd.py[15381]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 3 07:54:16 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 07:54:16 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 07:54:16 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 07:54:18 kjcf05n03 root[123241]: is_viking_off starts Nov 3 07:54:18 kjcf05n03 root[123240]: is_enc_ipmi_off starts Nov 3 07:54:18 kjcf05n03 root[123257]: is_lan_ipmi_off leaves Nov 3 07:54:18 kjcf05n03 root[123259]: is_lan_ipmi_sec_off leaves Nov 3 07:54:18 kjcf05n03 root[123262]: I am master Nov 3 07:54:18 kjcf05n03 root[123265]: I am in slot 1; partner is in slot 0 Nov 3 07:54:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 07:54:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 07:54:24 kjcf05n03 root[123397]: is_viking_off leaves Nov 3 07:54:24 kjcf05n03 root[123400]: kjcf05n02 not already off look at kdump Nov 3 07:54:24 kjcf05n03 root[123401]: is_kdump_off starts Nov 3 07:54:24 kjcf05n03 fence_kdump[123402]: waiting for message from '172.16.2.5' Nov 3 07:54:24 kjcf05n03 fence_kdump[123402]: received valid message from '172.16.2.5' Nov 3 07:54:24 kjcf05n03 root[123403]: is_kdump_off detected kdump on kjcf05n02 Nov 3 07:54:24 kjcf05n03 root[123404]: kjcf05n02 is kdumping Nov 3 07:54:25 kjcf05n00 zabbix_server[15772]: Zabbix agent item "vfs.fs.size[/var/lib/pacemaker,used]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 07:54:25 kjcf05n03 root[123500]: is_enc_ipmi_off starts Nov 3 07:54:25 kjcf05n03 root[123501]: is_viking_off starts Nov 3 07:54:25 kjcf05n03 root[123532]: is_lan_ipmi_off leaves Nov 3 07:54:25 kjcf05n03 root[123534]: is_lan_ipmi_sec_off leaves Nov 3 07:54:25 kjcf05n03 root[123538]: I am in slot 1; partner is in slot 0 Nov 3 07:54:25 kjcf05n03 root[123541]: I am master Nov 3 07:54:25 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 07:54:25 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 07:54:26 kjcf05n00 zabbix_server[15748]: Zabbix agent item "vfs.fs.size[/var/lib/mdraidscripts,used]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 07:54:27 kjcf05n00 zabbix_server[15777]: Zabbix agent item "system.swap.size[,pfree]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 07:54:27 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0000,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 07:54:28 kjcf05n00 zabbix_server[15729]: Zabbix agent item "system.swap.size[,total]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 07:54:28 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='107', error='Connection reset by peer (104)' Nov 3 07:54:28 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='107', client='AF_INET(172.16.2.5:36039)', local='AF_INET(0.0.0.0:601)' Nov 3 07:54:29 kjcf05n00 mcfcli[3673891]: %3|1730642069.268|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 07:54:34 kjcf05n03 root[123811]: is_viking_off leaves Nov 3 07:54:34 kjcf05n03 root[123814]: kjcf05n02 not already off look at kdump Nov 3 07:54:34 kjcf05n03 root[123815]: is_kdump_off starts Nov 3 07:54:34 kjcf05n03 fence_kdump[123826]: waiting for message from '172.16.2.5' Nov 3 07:54:34 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 07:54:34 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 07:54:34 kjcf05n03 fence_kdump[123826]: received valid message from '172.16.2.5' Nov 3 07:54:34 kjcf05n03 root[123831]: is_kdump_off detected kdump on kjcf05n02 Nov 3 07:54:34 kjcf05n03 root[123832]: kjcf05n02 is kdumping Nov 3 07:54:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 07:54:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 07:54:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 07:54:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 07:54:39 kjcf05n03 dwd[5195]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 07:54:39 kjcf05n03 dwd[5195]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 07:54:39 kjcf05n03 dwd[5195]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 07:54:39 kjcf05n03 dwd[5195]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 07:54:39 kjcf05n03 dwd[5195]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 07:54:39 kjcf05n03 dwd[5195]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 07:54:39 kjcf05n03 dwd[5195]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 07:54:39 kjcf05n03 dwd[5195]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 07:54:39 kjcf05n03 dwd[5195]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 07:54:39 kjcf05n03 dwd[5195]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 07:54:39 kjcf05n03 dwd[5195]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 07:54:39 kjcf05n03 systemd-udevd[126069]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126070]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126073]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126069]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126070]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126073]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126069]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126070]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126073]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126069]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126073]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126070]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126069]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126073]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126070]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126069]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126073]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126070]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126069]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126097]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126099]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126070]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126073]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126102]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126069]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126106]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126097]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126070]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126099]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126102]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126106]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126102]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126102]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126069]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126099]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126106]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126102]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126069]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126102]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126102]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126102]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126102]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 systemd-udevd[126068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 07:54:39 kjcf05n03 dwd[5195]: Starting NVME thread for nvme23n1 Nov 3 07:54:39 kjcf05n03 dwd[5195]: Starting NVME thread for nvme18n1 Nov 3 07:54:39 kjcf05n03 dwd[5195]: Starting NVME thread for nvme25n1 Nov 3 07:54:40 kjcf05n03 dwd[5195]: Starting NVME thread for nvme17n1 Nov 3 07:54:40 kjcf05n03 dwd[5195]: Starting NVME thread for nvme3n1 Nov 3 07:54:40 kjcf05n03 dwd[5195]: Starting NVME thread for nvme9n1 Nov 3 07:54:40 kjcf05n03 dwd[5195]: Starting NVME thread for nvme8n1 Nov 3 07:54:41 kjcf05n03 dwd[5195]: Starting NVME thread for nvme19n1 Nov 3 07:54:41 kjcf05n03 dwd[5195]: Starting NVME thread for nvme24n1 Nov 3 07:54:41 kjcf05n03 dwd[5195]: Starting NVME thread for nvme2n1 Nov 3 07:54:41 kjcf05n03 dwd[5195]: Starting NVME thread for nvme4n1 Nov 3 07:54:42 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0002,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 07:54:43 kjcf05n03 diskmonitor[17713]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 07:54:43 kjcf05n00 zabbix_server[15783]: Zabbix agent item "net.if.in["ib1",dropped]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 07:54:51 kjcf05n00 mcfcli[3673891]: %3|1730642091.673|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:54:52 kjcf05n03 diskmonitor[17713]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 07:54:52 kjcf05n03 diskmonitor[17713]: Scan for ReadErrorMax change for md65 Nov 3 07:54:52 kjcf05n03 diskmonitor[17713]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 07:54:52 kjcf05n03 diskmonitor[17713]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 07:54:52 kjcf05n03 diskmonitor[17713]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.min.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 07:54:52 kjcf05n03 diskmonitor[17713]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.max.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 07:54:52 kjcf05n03 diskmonitor[17713]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 07:54:52 kjcf05n03 diskmonitor[17713]: Set sync_speed_min (10000) for md65 Nov 3 07:54:52 kjcf05n03 diskmonitor[17713]: Set sync_speed_max (200000) for md65 Nov 3 07:54:52 kjcf05n03 diskmonitor[17713]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 07:54:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 07:54:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 07:54:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 07:54:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 07:54:57 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 3 07:54:58 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 3 07:54:59 kjcf05n00 mcfcli[3673891]: %3|1730642099.270|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:54:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 07:54:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 07:54:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 07:54:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 07:55:05 kjcf05n00 python3.9[1081084]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 07:55:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 07:55:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 07:55:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 07:55:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 07:55:27 kjcf05n00 mcfcli[3673891]: %3|1730642127.314|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:55:29 kjcf05n00 mcfcli[3673891]: %3|1730642129.270|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 07:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 07:55:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 07:55:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 07:55:46 kjcf05n03 nslcd[6947]: [b141f2] ldap_result() failed: Can't contact LDAP server Nov 3 07:55:46 kjcf05n03 nslcd[6947]: [b71efb] ldap_result() failed: Can't contact LDAP server Nov 3 07:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 07:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 07:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 07:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 07:55:59 kjcf05n00 mcfcli[3673891]: %3|1730642159.270|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 07:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 07:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 07:55:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 07:55:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 07:56:03 kjcf05n00 mcfcli[3673891]: %3|1730642163.116|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:56:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 07:56:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 07:56:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 07:56:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 07:56:29 kjcf05n00 mcfcli[3673891]: %3|1730642189.271|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 07:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 07:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 07:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 07:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 07:56:41 kjcf05n00 mcfcli[3673891]: %3|1730642201.218|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 07:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 07:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 07:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 07:56:59 kjcf05n00 mcfcli[3673891]: %3|1730642219.271|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 07:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 07:56:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 07:56:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 07:57:10 kjcf05n00 zabbix-server[1082699]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 07:57:10 kjcf05n00 zabbix-server[1082699]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 07:57:10 kjcf05n00 log_interesting_event.py[1082699]: Event '45977' acknowledged Nov 3 07:57:19 kjcf05n00 mcfcli[3673891]: %3|1730642239.186|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:57:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 07:57:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 07:57:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 07:57:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 07:57:29 kjcf05n00 mcfcli[3673891]: %3|1730642249.272|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 07:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 07:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 07:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 07:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 07:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 07:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 07:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 07:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 07:57:58 kjcf05n00 mcfcli[3673891]: %3|1730642278.459|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:57:59 kjcf05n00 mcfcli[3673891]: %3|1730642279.273|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 07:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 07:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 07:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 07:58:03 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 3 07:58:03 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 07:58:07 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 07:58:07 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 3 07:58:07 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 3 07:58:07 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 07:58:07 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 07:58:07 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 3 07:58:07 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 3 07:58:09 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 3 07:58:12 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 3 07:58:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 07:58:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 07:58:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 07:58:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 07:58:29 kjcf05n00 mcfcli[3673891]: %3|1730642309.273|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 07:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 07:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 07:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 07:58:38 kjcf05n00 mcfcli[3673891]: %3|1730642318.456|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 07:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 07:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 07:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 07:58:59 kjcf05n00 mcfcli[3673891]: %3|1730642339.274|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 07:58:59 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:56204). Nov 3 07:58:59 kjcf05n01 rsyncd[2980339]: connect from kjcf05n02 (172.16.2.5) Nov 3 07:58:59 kjcf05n01 rsyncd[2980339]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 07:58:59 kjcf05n01 rsyncd[2980339]: building file list Nov 3 07:58:59 kjcf05n01 rsyncd[2980339]: sent 11450 bytes received 136 bytes total size 10905 Nov 3 07:58:59 kjcf05n01 systemd[1]: rsyncd@609-172.16.2.2:873-172.16.2.5:56204.service: Succeeded. Nov 3 07:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 07:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 07:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 07:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 07:59:16 kjcf05n03 fstonithd.py[15381]: Listening for kdump packets from partner Nov 3 07:59:18 kjcf05n00 mcfcli[3673891]: %3|1730642358.455|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:59:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 07:59:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 07:59:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 07:59:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 07:59:29 kjcf05n00 mcfcli[3673891]: %3|1730642369.274|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 07:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 07:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 07:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 07:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 07:59:49 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 07:59:54 kjcf05n03 dwd[5195]: nvme23n1 passed periodic SMART status check Nov 3 07:59:55 kjcf05n03 dwd[5195]: nvme18n1 passed periodic SMART status check Nov 3 07:59:55 kjcf05n03 dwd[5195]: nvme3n1 passed periodic SMART status check Nov 3 07:59:55 kjcf05n03 dwd[5195]: nvme8n1 passed periodic SMART status check Nov 3 07:59:55 kjcf05n03 dwd[5195]: nvme25n1 passed periodic SMART status check Nov 3 07:59:55 kjcf05n03 dwd[5195]: nvme17n1 passed periodic SMART status check Nov 3 07:59:55 kjcf05n03 dwd[5195]: nvme19n1 passed periodic SMART status check Nov 3 07:59:55 kjcf05n03 dwd[5195]: nvme9n1 passed periodic SMART status check Nov 3 07:59:55 kjcf05n03 dwd[5195]: nvme24n1 passed periodic SMART status check Nov 3 07:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 07:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 07:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 07:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 07:59:56 kjcf05n03 dwd[5195]: nvme4n1 passed periodic SMART status check Nov 3 07:59:56 kjcf05n03 dwd[5195]: nvme2n1 passed periodic SMART status check Nov 3 07:59:58 kjcf05n00 mcfcli[3673891]: %3|1730642398.269|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 07:59:59 kjcf05n00 mcfcli[3673891]: %3|1730642399.275|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 07:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 07:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 07:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 07:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 08:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 08:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 08:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 08:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 08:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 08:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 08:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 08:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 08:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 08:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 08:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 08:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 08:00:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 08:00:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:00:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 08:00:06 kjcf05n00 python3.9[1084189]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 08:00:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730642421', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 08:00:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730642421'} Nov 3 08:00:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:00:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730642421', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 08:00:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730642421'} Nov 3 08:00:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:00:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 08:00:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 08:00:22 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 08:00:25 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='135', client='AF_INET(172.16.2.5:45399)', local='AF_INET(0.0.0.0:601)' Nov 3 08:00:25 kjcf05n02 syslog-ng[3140]: Configuration reload request received, reloading configuration; Nov 3 08:00:25 kjcf05n02 syslog-ng[3140]: Configuration reload finished; Nov 3 08:00:25 kjcf05n02 syslog-ng[3140]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 08:00:25 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 3 08:00:25 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 08:00:25 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 3 08:00:25 kjcf05n02 dracut: Self testing crypto algorithms Nov 3 08:00:25 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 3 08:00:25 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 08:00:25 kjcf05n02 Copying live image to RAM... Nov 3 08:00:25 kjcf05n02 (this may take a minute) Nov 3 08:00:25 kjcf05n02 Done copying live image to RAM. Nov 3 08:00:25 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 08:00:25 kjcf05n02 dracut: Checking integrity of kernel Nov 3 08:00:25 kjcf05n02 dracut: All initrd crypto checks done Nov 3 08:00:25 kjcf05n02 dracut: Switching root Nov 3 08:00:25 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 08:00:25 kjcf05n02 systemd: Detected architecture x86-64. Nov 3 08:00:25 kjcf05n02 systemd: Set hostname to . Nov 3 08:00:25 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 08:00:25 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 08:00:25 kjcf05n02 systemd: Created slice User and Session Slice. Nov 3 08:00:25 kjcf05n02 systemd: Listening on initctl Compatibility Named Pipe. Nov 3 08:00:25 kjcf05n02 systemd: Listening on Process Core Dump Socket. Nov 3 08:00:25 kjcf05n02 systemd: Listening on LVM2 poll daemon socket. Nov 3 08:00:25 kjcf05n02 systemd: Listening on RPCbind Server Activation Socket. Nov 3 08:00:25 kjcf05n02 systemd-journald[1517]: Journal started Nov 3 08:00:25 kjcf05n02 systemd-journald[1517]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 08:00:25 kjcf05n02 systemd-modules-load[1524]: Inserted module 'fuse' Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 3 08:00:25 kjcf05n02 systemd[1]: Mounted Temporary Directory (/tmp). Nov 3 08:00:25 kjcf05n02 systemd[1]: Mounted POSIX Message Queue File System. Nov 3 08:00:25 kjcf05n02 systemd[1]: Mounting Kernel Configuration File System... Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Apply Kernel Variables... Nov 3 08:00:25 kjcf05n02 systemd[1]: Mounting FUSE Control File System... Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Load/Save Random Seed... Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Rebuild Hardware Database... Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Create System Users... Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 08:00:25 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 3 08:00:25 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 3 08:00:25 kjcf05n02 systemd-sysctl[1547]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 08:00:25 kjcf05n02 systemd-sysctl[1547]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Create System Users. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 08:00:25 kjcf05n02 systemd-journald[1517]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 08:00:25 kjcf05n02 systemd-tmpfiles[1558]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 08:00:25 kjcf05n02 systemd-tmpfiles[1558]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 3 08:00:25 kjcf05n02 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 3 08:00:25 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 3 08:00:25 kjcf05n02 systemd-udevd[1585]: Using default interface naming scheme 'rhel-8.0'. Nov 3 08:00:25 kjcf05n02 systemd-udevd[1609]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:00:25 kjcf05n02 systemd-udevd[1585]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:00:25 kjcf05n02 systemd-udevd[1601]: Using default interface naming scheme 'rhel-8.0'. Nov 3 08:00:25 kjcf05n02 systemd-udevd[1601]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:00:25 kjcf05n02 systemd-udevd[1619]: Using default interface naming scheme 'rhel-8.0'. Nov 3 08:00:25 kjcf05n02 systemd-udevd[1619]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 08:00:25 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 3 08:00:25 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 08:00:25 kjcf05n02 root[1790]: openibd: running in auto mode Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 08:00:25 kjcf05n02 systemd-tmpfiles[1791]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 08:00:25 kjcf05n02 systemd-tmpfiles[1791]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 08:00:25 kjcf05n02 systemd-tmpfiles[1791]: "/var/tmp" already exists and is not a directory. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started RPC Bind. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 08:00:25 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 08:00:25 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 3 08:00:25 kjcf05n02 systemd-modules-load[1912]: Inserted module 'ib_iser' Nov 3 08:00:25 kjcf05n02 systemd-modules-load[1912]: Inserted module 'ib_isert' Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 08:00:25 kjcf05n02 systemd-modules-load[1912]: Inserted module 'ib_srpt' Nov 3 08:00:25 kjcf05n02 systemd-udevd[1586]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:00:25 kjcf05n02 systemd-udevd[1587]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:00:25 kjcf05n02 systemd-modules-load[1917]: Inserted module 'ib_ipoib' Nov 3 08:00:25 kjcf05n02 systemd-modules-load[1912]: Inserted module 'rdma_ucm' Nov 3 08:00:25 kjcf05n02 systemd-modules-load[1912]: Module 'svcrdma' is blacklisted Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 08:00:25 kjcf05n02 systemd-udevd[1587]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 08:00:25 kjcf05n02 systemd-udevd[1586]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 08:00:25 kjcf05n02 systemd-modules-load[1917]: Inserted module 'ib_umad' Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 08:00:25 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 08:00:25 kjcf05n02 systemd[3140]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:25 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 08:00:25 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 3 08:00:25 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 3 08:00:25 kjcf05n02 openibd[1777]: Loading HCA driver and Access Layer:[ OK ] Nov 3 08:00:25 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Update is Completed. Nov 3 08:00:25 kjcf05n02 setup-icl[1765]: Setting LAN IP Address to 203.0.113.3 Nov 3 08:00:25 kjcf05n02 setup-icl[1765]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 08:00:25 kjcf05n02 setup-icl[1765]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 08:00:25 kjcf05n02 setup-icl[1765]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 08:00:25 kjcf05n02 systemd-udevd[1586]: Using default interface naming scheme 'rhel-8.0'. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 08:00:25 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 3 08:00:25 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 08:00:25 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 08:00:25 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 08:00:25 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 08:00:25 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 08:00:25 kjcf05n02 systemd[1]: Reached target Sockets. Nov 3 08:00:25 kjcf05n02 systemd[1]: Reached target Basic System. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 08:00:25 kjcf05n02 network[2079]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 08:00:25 kjcf05n02 mcelog[2092]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 08:00:25 kjcf05n02 mcelog[2092]: CPU is unsupported Nov 3 08:00:25 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 08:00:25 kjcf05n02 network[2094]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 08:00:25 kjcf05n02 network[2079]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[2107]: Setting up Mellanox network interface: ib1 Nov 3 08:00:25 kjcf05n02 beSetMlxConfig[2106]: ConnectX-3 multiport not detected Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 0 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 1 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 2 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 3 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 4 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 5 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 6 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 7 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 8 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 9 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 10 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 11 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 12 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 13 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 14 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 15 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 16 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 17 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 18 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 19 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 20 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 21 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 22 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 23 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 24 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 25 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 26 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 27 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 28 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 29 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 30 Nov 3 08:00:25 kjcf05n02 cpupower[2131]: Setting cpu: 31 Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 08:00:25 kjcf05n02 network[2116]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:00:25 kjcf05n02 network[2079]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 3 08:00:25 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 08:00:25 kjcf05n02 nscd[2168]: 2168 monitoring file `/etc/hosts` (1) Nov 3 08:00:25 kjcf05n02 nscd[2168]: 2168 monitoring directory `/etc` (2) Nov 3 08:00:25 kjcf05n02 nscd[2168]: 2168 monitoring file `/etc/resolv.conf` (3) Nov 3 08:00:25 kjcf05n02 nscd[2168]: 2168 monitoring directory `/etc` (2) Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 08:00:25 kjcf05n02 network[2142]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[2183]: Setting up Mellanox network interface: ib0 Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 08:00:25 kjcf05n02 beSetMlxConfig[2106]: Starting MST (Mellanox Software Tools) driver set Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[2199]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 08:00:25 kjcf05n02 chronyd[2248]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 08:00:25 kjcf05n02 beSetMlxConfig[2106]: Loading MST PCI module - Success Nov 3 08:00:25 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 08:00:25 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 3 08:00:25 kjcf05n02 dwd[2245]: dwd: vMay 29 2024 : 15:38:26 Nov 3 08:00:25 kjcf05n02 dwd[2245]: /usr/sbin/dwd -d --standalone=0 Nov 3 08:00:25 kjcf05n02 dwd[2245]: dwd: option Lethal: 0 Nov 3 08:00:25 kjcf05n02 dwd[2245]: dwd: option Interval: 60 Nov 3 08:00:25 kjcf05n02 dwd[2245]: dwd: option abrtlimit: 10 Nov 3 08:00:25 kjcf05n02 dwd[2245]: dwd: option DZPeriod: 604800 Nov 3 08:00:25 kjcf05n02 dwd[2245]: dwd: option SmartPeriod: 43200 Nov 3 08:00:25 kjcf05n02 dwd[2245]: dwd: option SDDEnabled: 1 Nov 3 08:00:25 kjcf05n02 dwd[2245]: dwd: option SDDAwaitScale: 3 Nov 3 08:00:25 kjcf05n02 dwd[2245]: dwd: option SDDAwaitMin: 100 Nov 3 08:00:25 kjcf05n02 dwd[2245]: dwd: option Verbosity: 1 Nov 3 08:00:25 kjcf05n02 dwd[2245]: dwd: option StandAlone: 0 Nov 3 08:00:25 kjcf05n02 dwd[2245]: option Lethal: 0 Nov 3 08:00:25 kjcf05n02 dwd[2245]: option Interval: 60 Nov 3 08:00:25 kjcf05n02 dwd[2245]: option abrtlimit: 10 Nov 3 08:00:25 kjcf05n02 dwd[2245]: option DZPeriod: 604800 Nov 3 08:00:25 kjcf05n02 dwd[2245]: option SmartPeriod: 43200 Nov 3 08:00:25 kjcf05n02 dwd[2245]: option SDDEnabled: 1 Nov 3 08:00:25 kjcf05n02 dwd[2245]: option SDDAwaitScale: 3 Nov 3 08:00:25 kjcf05n02 dwd[2245]: option SDDAwaitMin: 100 Nov 3 08:00:25 kjcf05n02 dwd[2245]: option Verbosity: 1 Nov 3 08:00:25 kjcf05n02 dwd[2245]: option StandAlone: 0 Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[2253]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 08:00:25 kjcf05n02 dbus-daemon[2204]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 08:00:25 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[2259]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 0 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 1 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 2 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 3 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 4 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 5 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 6 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 7 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 8 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 9 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 10 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 11 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 12 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 13 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 14 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 15 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 16 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 17 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 18 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 19 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 20 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 21 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 22 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 23 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 24 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 25 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 26 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 27 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 28 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 29 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 30 Nov 3 08:00:25 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 31 Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 08:00:25 kjcf05n02 mdraid-phy[2260]: no Cutlass to worry about Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 3 08:00:25 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[2281]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 08:00:25 kjcf05n02 beSetMlxConfig[2106]: Loading MST PCI configuration module - Success Nov 3 08:00:25 kjcf05n02 beSetMlxConfig[2106]: Create devices Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[2282]: No configuration found for ib1 Nov 3 08:00:25 kjcf05n02 chronyd[2248]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 08:00:25 kjcf05n02 chronyd[2248]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[2292]: No configuration found for ib0 Nov 3 08:00:25 kjcf05n02 sssd[sssd][2128]: Starting up Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[2298]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[2326]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 08:00:25 kjcf05n02 mlnx_conf_mgr[2354]: INFO: No configurations found for mlx5_1, skipping. Nov 3 08:00:25 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 08:00:25 kjcf05n02 mlnx_conf_mgr[2384]: INFO: No configurations found for mlx5_0, skipping. Nov 3 08:00:25 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 08:00:25 kjcf05n02 sssd[be[implicit_files]][2353]: Starting up Nov 3 08:00:25 kjcf05n02 sssd[nss][2489]: Starting up Nov 3 08:00:25 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 08:00:25 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Login Service... Nov 3 08:00:25 kjcf05n02 systemd-logind[2586]: New seat seat0. Nov 3 08:00:25 kjcf05n02 systemd-logind[2586]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Login Service. Nov 3 08:00:25 kjcf05n02 systemd-sysctl[2743]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 08:00:25 kjcf05n02 systemd-sysctl[2743]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 08:00:25 kjcf05n02 python3.9[2256]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 08:00:25 kjcf05n02 python3.9[3140]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 08:00:25 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 08:00:25 kjcf05n02 network[2079]: Bringing up loopback interface: [ OK ] Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 08:00:25 kjcf05n02 systemd-sysctl[3075]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 08:00:25 kjcf05n02 systemd-sysctl[3075]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 08:00:25 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 3 08:00:25 kjcf05n02 systemd[1]: Reached target Network. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 08:00:25 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 3 08:00:25 kjcf05n02 python3.9[3049]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 08:00:25 kjcf05n02 python3.9[3140]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 08:00:25 kjcf05n02 sm-notify[3143]: Version 2.3.3 starting Nov 3 08:00:25 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 3 08:00:25 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 3 08:00:25 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 08:00:25 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 08:00:25 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 08:00:25 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 08:00:25 kjcf05n02 lldpad[3120]: setsockopt nearest_bridge: Invalid argument Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 08:00:25 kjcf05n02 lldpad[3120]: setsockopt nearest_bridge: Invalid argument Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 3 08:00:25 kjcf05n02 sshd[3169]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 08:00:25 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 3 08:00:25 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 08:00:25 kjcf05n02 syslog-ng[3140]: [2024-11-03T13:59:12.286235] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 08:00:25 kjcf05n02 syslog-ng[3140]: [2024-11-03T13:59:12.286561] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 08:00:25 kjcf05n02 syslog-ng[3140]: [2024-11-03T13:59:12.286599] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 08:00:25 kjcf05n02 syslog-ng[3140]: [2024-11-03T13:59:12.286868] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 08:00:25 kjcf05n02 syslog-ng[3140]: [2024-11-03T13:59:12.287195] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 08:00:25 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 3 08:00:25 kjcf05n02 beSetMlxConfig[2106]: Unloading MST PCI module (unused) - Success Nov 3 08:00:25 kjcf05n02 python3.9[3173]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 08:00:25 kjcf05n02 python3.9[3140]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 08:00:25 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 08:00:25 kjcf05n02 python3.9[3406]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 08:00:25 kjcf05n02 python3.9[3140]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 08:00:25 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 08:00:25 kjcf05n02 python3.9[3409]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 08:00:25 kjcf05n02 python3.9[3140]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 08:00:25 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 08:00:25 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 08:00:25 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 08:00:25 kjcf05n02 chronyd[2248]: System's initial offset : 0.002666 seconds slow of true (slew) Nov 3 08:00:25 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 08:00:25 kjcf05n02 beSetMlxConfig[2106]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 08:00:25 kjcf05n02 beSetMlxConfig[2106]: ib mode Nov 3 08:00:25 kjcf05n02 beSetMlxConfig[2106]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 08:00:25 kjcf05n02 root[3434]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 3 08:00:25 kjcf05n02 root[3436]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 3 08:00:25 kjcf05n02 beSetMlxConfig[2106]: ib mode Nov 3 08:00:25 kjcf05n02 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 08:00:25 kjcf05n02 systemd-udevd[3448]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:00:25 kjcf05n02 systemd-udevd[3449]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:00:25 kjcf05n02 systemd-udevd[3452]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:00:25 kjcf05n02 systemd-udevd[3455]: Using default interface naming scheme 'rhel-8.0'. Nov 3 08:00:25 kjcf05n02 systemd-udevd[3455]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:00:25 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 08:00:25 kjcf05n02 systemd[3140]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:25 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[3490]: Setting up Mellanox network interface: ib1 Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[3491]: Setting up Mellanox network interface: ib0 Nov 3 08:00:25 kjcf05n02 systemd-udevd[3450]: Using default interface naming scheme 'rhel-8.0'. Nov 3 08:00:25 kjcf05n02 systemd-udevd[3450]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:00:25 kjcf05n02 systemd-udevd[3451]: Using default interface naming scheme 'rhel-8.0'. Nov 3 08:00:25 kjcf05n02 systemd-udevd[3451]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[3543]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[3546]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[3570]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[3572]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[3573]: No configuration found for ib1 Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[3574]: No configuration found for ib0 Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[3579]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[3582]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 08:00:25 kjcf05n02 mlnx_conf_mgr[3618]: INFO: No configurations found for mlx5_1, skipping. Nov 3 08:00:25 kjcf05n02 mlnx_conf_mgr[3622]: INFO: No configurations found for mlx5_0, skipping. Nov 3 08:00:25 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 08:00:25 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 08:00:25 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 3 08:00:25 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 3 08:00:25 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 08:00:25 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 3 08:00:25 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 3 08:00:25 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 08:00:25 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 08:00:25 kjcf05n02 lldpad[3120]: init_ports: Error adding device ib0 Nov 3 08:00:25 kjcf05n02 lldpad[3120]: init_ports: Error adding device ib1 Nov 3 08:00:25 kjcf05n02 lldpad[3120]: Signal 15 received - terminating Nov 3 08:00:25 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 3 08:00:25 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 08:00:25 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 08:00:25 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 3 08:00:25 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 08:00:25 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 3 08:00:25 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 3 08:00:25 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:25 kjcf05n02 systemd[3140]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:25 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 1 | Nov-03-2024 | 13:29:53 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 2 | Nov-03-2024 | 13:30:47 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 3 | Nov-03-2024 | 13:30:48 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 4 | Nov-03-2024 | 13:31:53 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 5 | Nov-03-2024 | 13:31:53 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 6 | Nov-03-2024 | 13:56:32 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 7 | Nov-03-2024 | 13:56:32 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 8 | Nov-03-2024 | 13:56:32 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 9 | Nov-03-2024 | 13:56:32 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 10 | Nov-03-2024 | 13:56:32 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 11 | Nov-03-2024 | 13:56:32 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 12 | Nov-03-2024 | 13:56:32 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 13 | Nov-03-2024 | 13:56:32 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 14 | Nov-03-2024 | 13:56:32 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 15 | Nov-03-2024 | 13:56:32 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 16 | Nov-03-2024 | 13:56:32 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 17 | Nov-03-2024 | 13:56:32 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 18 | Nov-03-2024 | 13:56:32 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 19 | Nov-03-2024 | 13:56:32 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 20 | Nov-03-2024 | 13:56:32 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 21 | Nov-03-2024 | 13:56:32 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 22 | Nov-03-2024 | 13:56:32 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 23 | Nov-03-2024 | 13:56:32 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 24 | Nov-03-2024 | 13:56:32 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 25 | Nov-03-2024 | 13:56:32 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 26 | Nov-03-2024 | 13:56:32 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 27 | Nov-03-2024 | 13:56:32 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 28 | Nov-03-2024 | 13:56:34 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 29 | Nov-03-2024 | 13:56:34 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 30 | Nov-03-2024 | 13:56:34 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 31 | Nov-03-2024 | 13:56:34 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 32 | Nov-03-2024 | 13:56:34 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 33 | Nov-03-2024 | 13:56:34 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 34 | Nov-03-2024 | 13:56:34 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 35 | Nov-03-2024 | 13:56:34 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 36 | Nov-03-2024 | 13:56:34 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 37 | Nov-03-2024 | 13:56:34 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 38 | Nov-03-2024 | 13:57:03 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 39 | Nov-03-2024 | 13:57:03 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 40 | Nov-03-2024 | 13:57:03 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 41 | Nov-03-2024 | 13:57:03 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 42 | Nov-03-2024 | 13:57:03 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 43 | Nov-03-2024 | 13:57:03 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 44 | Nov-03-2024 | 13:57:03 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 45 | Nov-03-2024 | 13:57:03 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 46 | Nov-03-2024 | 13:57:03 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 47 | Nov-03-2024 | 13:57:03 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 48 | Nov-03-2024 | 13:57:03 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 08:00:25 kjcf05n02 ipmievd[3964]: 49 | Nov-03-2024 | 13:57:03 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 08:00:25 kjcf05n02 ipmievd[3967]: Reading sensors... Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 3 08:00:25 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:25 kjcf05n02 systemd[3140]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 08:00:25 kjcf05n02 nscd[2168]: 2168 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 08:00:25 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 08:00:25 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 3 08:00:25 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 08:00:25 kjcf05n02 beSetMlxConfig[4024]: ConnectX-3 multiport not detected Nov 3 08:00:25 kjcf05n02 beSetMlxConfig[4024]: Starting MST (Mellanox Software Tools) driver set Nov 3 08:00:25 kjcf05n02 beSetMlxConfig[4024]: Loading MST PCI module - Success Nov 3 08:00:25 kjcf05n02 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 08:00:25 kjcf05n02 beSetMlxConfig[4024]: [warn] mst_pciconf is already loaded, skipping Nov 3 08:00:25 kjcf05n02 beSetMlxConfig[4024]: Create devices Nov 3 08:00:25 kjcf05n02 beSetMlxConfig[4024]: Unloading MST PCI module (unused) - Success Nov 3 08:00:25 kjcf05n02 ipmievd[3967]: Waiting for events... Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 08:00:25 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 08:00:25 kjcf05n02 beSetMlxConfig[4024]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 08:00:25 kjcf05n02 beSetMlxConfig[4024]: ib mode Nov 3 08:00:25 kjcf05n02 beSetMlxConfig[4024]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 08:00:25 kjcf05n02 beSetMlxConfig[4024]: ib mode Nov 3 08:00:25 kjcf05n02 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 08:00:25 kjcf05n02 systemd-udevd[4928]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:00:25 kjcf05n02 systemd-udevd[4929]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:00:25 kjcf05n02 systemd-udevd[4932]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:00:25 kjcf05n02 systemd-udevd[4937]: Using default interface naming scheme 'rhel-8.0'. Nov 3 08:00:25 kjcf05n02 systemd-udevd[4937]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:00:25 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 08:00:25 kjcf05n02 systemd[3140]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:25 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[4970]: Setting up Mellanox network interface: ib0 Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[4971]: Setting up Mellanox network interface: ib1 Nov 3 08:00:25 kjcf05n02 systemd-udevd[4930]: Using default interface naming scheme 'rhel-8.0'. Nov 3 08:00:25 kjcf05n02 systemd-udevd[4930]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[5020]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[5021]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[5036]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[5037]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[5038]: No configuration found for ib0 Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[5039]: No configuration found for ib1 Nov 3 08:00:25 kjcf05n02 systemd-udevd[4931]: Using default interface naming scheme 'rhel-8.0'. Nov 3 08:00:25 kjcf05n02 systemd-udevd[4931]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[5044]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 08:00:25 kjcf05n02 mlnx_interface_mgr[5047]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 08:00:25 kjcf05n02 mlnx_conf_mgr[5098]: INFO: No configurations found for mlx5_0, skipping. Nov 3 08:00:25 kjcf05n02 mlnx_conf_mgr[5102]: INFO: No configurations found for mlx5_1, skipping. Nov 3 08:00:25 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 08:00:25 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}6a0826893d7ea07af2093ff0ea739cf0cf7c86828bb02c3670745f07fb128e16' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}6a0826893d7ea07af2093ff0ea739cf0cf7c86828bb02c3670745f07fb128e16' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}5470896b2e16a781b40ecb9fdac80f2383f7c913512e00772538d176defd253a' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}5470896b2e16a781b40ecb9fdac80f2383f7c913512e00772538d176defd253a' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}7d997ec4a6e9043e116251a8b455869532075ce8813365e62c188dbfab191558' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}7d997ec4a6e9043e116251a8b455869532075ce8813365e62c188dbfab191558' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}fb8ba4951ea6839c731624f018909d00a8a61e9379db3b7898f3a5c52bca2622' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}fb8ba4951ea6839c731624f018909d00a8a61e9379db3b7898f3a5c52bca2622' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 08:00:25 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 3 08:00:25 kjcf05n02 chronyd[2248]: chronyd exiting Nov 3 08:00:25 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 3 08:00:25 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 08:00:25 kjcf05n02 chronyd[5136]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 08:00:25 kjcf05n02 chronyd[5136]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 08:00:25 kjcf05n02 chronyd[5136]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 08:00:25 kjcf05n02 chronyd[5136]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 08:00:25 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 08:00:25 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:25 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 08:00:25 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 3 08:00:25 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 08:00:25 kjcf05n02 dwd[5167]: dwd: vMay 29 2024 : 15:38:26 Nov 3 08:00:25 kjcf05n02 dwd[5167]: /usr/sbin/dwd -i 15 -d Nov 3 08:00:25 kjcf05n02 dwd[5167]: dwd: option Lethal: 0 Nov 3 08:00:25 kjcf05n02 dwd[5167]: dwd: option Interval: 15 Nov 3 08:00:25 kjcf05n02 dwd[5167]: dwd: option abrtlimit: 10 Nov 3 08:00:25 kjcf05n02 dwd[5167]: dwd: option DZPeriod: 604800 Nov 3 08:00:25 kjcf05n02 dwd[5167]: dwd: option SmartPeriod: 43200 Nov 3 08:00:25 kjcf05n02 dwd[5167]: dwd: option SDDEnabled: 1 Nov 3 08:00:25 kjcf05n02 dwd[5167]: dwd: option SDDAwaitScale: 3 Nov 3 08:00:25 kjcf05n02 dwd[5167]: dwd: option SDDAwaitMin: 100 Nov 3 08:00:25 kjcf05n02 dwd[5167]: dwd: option Verbosity: 1 Nov 3 08:00:25 kjcf05n02 dwd[5167]: dwd: option StandAlone: 0 Nov 3 08:00:25 kjcf05n02 dwd[5167]: option Lethal: 0 Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 08:00:25 kjcf05n02 dwd[5167]: option Interval: 15 Nov 3 08:00:25 kjcf05n02 dwd[5167]: option abrtlimit: 10 Nov 3 08:00:25 kjcf05n02 dwd[5167]: option DZPeriod: 604800 Nov 3 08:00:25 kjcf05n02 dwd[5167]: option SmartPeriod: 43200 Nov 3 08:00:25 kjcf05n02 dwd[5167]: option SDDEnabled: 1 Nov 3 08:00:25 kjcf05n02 dwd[5167]: option SDDAwaitScale: 3 Nov 3 08:00:25 kjcf05n02 dwd[5167]: option SDDAwaitMin: 100 Nov 3 08:00:25 kjcf05n02 dwd[5167]: option Verbosity: 1 Nov 3 08:00:25 kjcf05n02 dwd[5167]: option StandAlone: 0 Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 08:00:25 kjcf05n02 dwd[5168]: option Lethal now set to 1 Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 08:00:25 kjcf05n02 dwd[5168]: option abrtlimit now set to 1 Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 08:00:25 kjcf05n02 dwd[5168]: option SmartPeriod now set to 86400 Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 08:00:25 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 08:00:25 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:25 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:25 kjcf05n02 python3.9[5197]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 08:00:25 kjcf05n02 python3.9[3140]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 08:00:25 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:25 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 08:00:25 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:25 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 3 08:00:25 kjcf05n02 sedcpwrkr[5336]: Using config script: /etc/sedcpwrkr.conf Nov 3 08:00:25 kjcf05n02 sedcpwrkr[5336]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 08:00:25 kjcf05n02 sedcpwrkr[5336]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 08:00:25 kjcf05n02 sedcpwrkr[5336]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 08:00:25 kjcf05n02 sedcpwrkr[5336]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 08:00:25 kjcf05n02 sedcpwrkr[5336]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 08:00:25 kjcf05n02 sedcpwrkr[5336]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 08:00:25 kjcf05n02 sedcpwrkr-server[5367]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 08:00:25 kjcf05n02 sedcpwrkr[5336]: celery multi v5.2.7 (dawn-chorus) Nov 3 08:00:25 kjcf05n02 sedcpwrkr[5336]: > Starting nodes... Nov 3 08:00:25 kjcf05n02 sedcpwrkr[5336]: > sedcpwrkr@kjcf05n02: OK Nov 3 08:00:25 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 08:00:25 kjcf05n02 sedcpwrkr-server[5369]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 08:00:25 kjcf05n02 sedcpwrkr-server[5369]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 08:00:25 kjcf05n02 sedcpwrkr-server[5369]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 08:00:25 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 08:00:25 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 3 08:00:25 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 08:00:25 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 08:00:25 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 08:00:25 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:26 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 08:00:26 kjcf05n02 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 08:00:26 kjcf05n02 iptables.init[5436]: iptables: Applying firewall rules: [ OK ] Nov 3 08:00:26 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 3 08:00:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 08:00:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 08:00:26 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:26 kjcf05n02 systemd[3140]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:26 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:26 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:26 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 08:00:26 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 08:00:26 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 08:00:26 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 08:00:26 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 08:00:26 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 08:00:26 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 08:00:26 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 08:00:26 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 08:00:26 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 08:00:27 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 08:00:27 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 08:00:27 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 08:00:27 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 08:00:27 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 08:00:27 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 08:00:27 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 08:00:27 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 08:00:27 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 08:00:27 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 08:00:27 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 08:00:27 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 08:00:27 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 08:00:27 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 08:00:27 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 08:00:27 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 08:00:27 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 08:00:27 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 08:00:27 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 08:00:27 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 08:00:27 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 08:00:27 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 08:00:27 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 08:00:27 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 08:00:27 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 08:00:27 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 08:00:27 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 08:00:27 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 08:00:27 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 08:00:27 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 08:00:27 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 08:00:27 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 08:00:27 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 08:00:27 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 08:00:27 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 08:00:27 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 08:00:27 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 08:00:27 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 08:00:27 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 08:00:27 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 08:00:27 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:27 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 08:00:27 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5534 which is not our child. We'll most likely not notice when it exits. Nov 3 08:00:27 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 08:00:27 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:27 kjcf05n02 openhpid[5534]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 08:00:27 kjcf05n02 openhpid[5534]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 08:00:27 kjcf05n02 openhpid[5534]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 08:00:27 kjcf05n02 openhpid[5534]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 08:00:28 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:28 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:28 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:28 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 08:00:28 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 08:00:28 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 08:00:28 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 08:00:28 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:28 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 08:00:29 kjcf05n02 dcs-collectord[5625]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 08:00:29 kjcf05n02 hpi.inv.log[5625]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 08:00:29 kjcf05n02 dcs-collectord[5625]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 08:00:29 kjcf05n02 dcs-collectord[5625]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 08:00:29 kjcf05n02 dcs-collector[5616]: Starting dcs-collector:[ OK ] Nov 3 08:00:29 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 08:00:29 kjcf05n02 dcs-collectord[5628]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 08:00:29 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 08:00:29 kjcf05n02 dcs-collectord[5628]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 08:00:29 kjcf05n02 dcs-collectord[5628]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 08:00:29 kjcf05n02 dcs-collectord[5628]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 08:00:29 kjcf05n02 dcs-collectord[5628]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 08:00:29 kjcf05n02 dcs-collectord[5628]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 08:00:29 kjcf05n02 dcs-collectord[5628]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 08:00:29 kjcf05n02 dcs-collectord[5628]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259346560", "units": "kB"}, {"name": "MemAvailable", "value": "258626088", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821268", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686672", "units": "kB"}, {"name": "Inactive", "value": "961144", "units": "kB"}, {"name": "Active(anon)", "value": "1520640", "units": "kB"}, {"name": "Inactive(anon)", "value": "824860", "units": "kB"}, {"name": "Active(file)", "value": "166032", "units": "kB"}, {"name": "Inactive(file)", "value": "136284", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "751280", "units": "kB"}, {"name": "Mapped", "value": "87188", "units": "kB"}, {"name": "Shmem", "value": "1593392", "units": "kB"}, {"name": "KReclaimable", "value": "108900", "units": "kB"}, {"name": "Slab", "value": "274384", "units": "kB"}, {"name": "SReclaimable", "value": "108900", "units": "kB"}, {"name": "SUnreclaim", "value": "165484", "units": "kB"}, {"name": "KernelStack", "value": "9760", "units": "kB"}, {"name": "PageTables", "value": "20804", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3247432", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11136", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "2048", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "260424", "units": "kB"}, {"name": "DirectMap2M", "value": "19527680", "units": "kB"}, {"name": "DirectMap1G", "value": "248512512", "units": "kB"}]}' Nov 3 08:00:29 kjcf05n02 dcs-collectord[5628]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 08:00:29 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:29 kjcf05n02 systemd[3140]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:29 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:29 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:29 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 08:00:29 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 08:00:29 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 08:00:29 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 08:00:29 kjcf05n00 mcfcli[3673891]: %3|1730642429.275|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 08:00:29 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:29 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 08:00:30 kjcf05n02 firmware-update-orc[5709]: Using config script: /etc/firmware_update_orc.conf Nov 3 08:00:30 kjcf05n02 firmware-update-orc[5709]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 08:00:30 kjcf05n02 firmware-update-orc[5709]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 08:00:30 kjcf05n02 firmware-update-orc[5709]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 08:00:30 kjcf05n02 firmware-update-orc[5709]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 08:00:30 kjcf05n02 firmware-update-orc[5709]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 08:00:30 kjcf05n02 firmware-update-orc[5709]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 08:00:30 kjcf05n02 dcs-collectord[5628]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 08:00:30 kjcf05n02 dcs-collectord[5628]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730642428.8675966], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730642430.0440862], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730642428.8013496, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 08:00:30 kjcf05n02 firmware-update-orc-server[5745]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 08:00:30 kjcf05n02 firmware-update-orc[5709]: celery multi v5.2.7 (dawn-chorus) Nov 3 08:00:30 kjcf05n02 firmware-update-orc[5709]: > Starting nodes... Nov 3 08:00:30 kjcf05n02 firmware-update-orc[5709]: > worker1@kjcf05n02: OK Nov 3 08:00:30 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 08:00:30 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 08:00:30 kjcf05n02 firmware-update-orc-server[5774]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 08:00:30 kjcf05n02 firmware-update-orc-server[5774]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 08:00:30 kjcf05n02 firmware-update-orc-server[5774]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 08:00:30 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 08:00:30 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:30 kjcf05n02 systemd[3140]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:30 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:30 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:30 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 08:00:30 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 08:00:30 kjcf05n02 dbus-daemon[2204]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 08:00:30 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 08:00:30 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 08:00:30 kjcf05n02 dbus-daemon[2204]: [system] Reloaded configuration Nov 3 08:00:30 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 08:00:30 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 08:00:30 kjcf05n02 dbus-daemon[2204]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 08:00:30 kjcf05n02 dbus-daemon[2204]: [system] Reloaded configuration Nov 3 08:00:30 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 08:00:30 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 08:00:30 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 08:00:30 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 08:00:31 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:31 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 3 08:00:31 kjcf05n02 ras-resource-manager-agent[5890]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 08:00:31 kjcf05n02 ras-resource-manager-agent[5876]: Starting ras-resource-manager-agent:[ OK ] Nov 3 08:00:31 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 08:00:31 kjcf05n02 ras-resource-manager-agent[5892]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 08:00:31 kjcf05n02 ras-resource-manager-client[5892]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 08:00:31 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 3 08:00:31 kjcf05n02 ras-resource-manager-client[5892]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 08:00:31 kjcf05n02 ras-resource-manager-client[5902]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 08:00:31 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:32 kjcf05n02 systemd[3140]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:32 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:32 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:32 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 08:00:32 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 08:00:32 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:32 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 08:00:32 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:33 kjcf05n02 systemd[3140]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: Press Ctrl+C to exit. Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: Plugin support version 1.0 Nov 3 08:00:33 kjcf05n02 zabbix_agent2[5976]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 08:00:33 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:33 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:33 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:33 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 08:00:33 kjcf05n02 dcs-notification-sender[6052]: dcs-notification-senderd is stopped Nov 3 08:00:33 kjcf05n02 zabbix-agent2[6066]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 08:00:33 kjcf05n02 dcs-notification-sender[6052]: Starting notification-sender:[ OK ] Nov 3 08:00:33 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 08:00:33 kjcf05n02 zabbix-agent2[6068]: INFO DCS notification agent started. (agent.py:61) Nov 3 08:00:33 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 08:00:33 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:34 kjcf05n02 systemd[3140]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:34 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:34 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:34 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:34 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 08:00:34 kjcf05n02 dcs-collectord[6173]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 08:00:34 kjcf05n02 dcs-collectord[6173]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 08:00:34 kjcf05n02 dcs-bulk-data-sender[6173]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 08:00:34 kjcf05n02 dcs-bulk-data-sender[6164]: Starting bulk-data-sender:[ OK ] Nov 3 08:00:34 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 08:00:34 kjcf05n02 dcs-collectord[6175]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 08:00:34 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 08:00:34 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:35 kjcf05n02 systemd[3140]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:35 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:35 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:35 kjcf05n02 nscd[2168]: 2168 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 08:00:35 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 08:00:35 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 08:00:35 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 08:00:35 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 08:00:35 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 08:00:35 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 08:00:35 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 08:00:35 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 08:00:35 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 08:00:35 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 08:00:35 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 08:00:35 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 08:00:35 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 08:00:35 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 08:00:35 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 08:00:35 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 08:00:35 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 08:00:35 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 08:00:36 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 3 08:00:36 kjcf05n02 sssd[nss][2489]: Shutting down (status = 0) Nov 3 08:00:36 kjcf05n02 sssd[be[implicit_files]][2353]: Shutting down (status = 0) Nov 3 08:00:36 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 3 08:00:36 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 3 08:00:36 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 08:00:36 kjcf05n02 python3.9[5197]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 08:00:36 kjcf05n02 python3.9[3140]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:36 kjcf05n02 sssd[sssd][6253]: Starting up Nov 3 08:00:36 kjcf05n02 sssd[be[implicit_files]][6255]: Starting up Nov 3 08:00:36 kjcf05n02 sssd[nss][6256]: Starting up Nov 3 08:00:36 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 08:00:36 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 08:00:36 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 08:00:37 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 08:00:37 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 08:00:37 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 08:00:37 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 08:00:37 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 08:00:37 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 08:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 08:00:37 kjcf05n00 mcfcli[3673891]: %3|1730642437.154|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:00:37 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 08:00:37 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 08:00:37 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 08:00:37 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 08:00:37 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 08:00:37 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 08:00:37 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 08:00:37 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 08:00:37 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:00:37 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:00:37 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 08:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 08:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 08:00:38 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 08:00:38 kjcf05n02 icinga2[6305]: [2024-11-03 08:00:38 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 08:00:38 kjcf05n02 icinga2[6305]: [2024-11-03 08:00:38 -0600] information/cli: Loading configuration file(s). Nov 3 08:00:38 kjcf05n02 icinga2[6305]: [2024-11-03 08:00:38 -0600] information/ConfigItem: Committing config item(s). Nov 3 08:00:38 kjcf05n02 icinga2[6305]: [2024-11-03 08:00:38 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 3 08:00:38 kjcf05n02 icinga2[6305]: [2024-11-03 08:00:38 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 08:00:38 kjcf05n02 icinga2[6305]: [2024-11-03 08:00:38 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 08:00:38 kjcf05n02 icinga2[6305]: [2024-11-03 08:00:38 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 08:00:38 kjcf05n02 icinga2[6305]: [2024-11-03 08:00:38 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 08:00:38 kjcf05n02 icinga2[6305]: [2024-11-03 08:00:38 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 08:00:38 kjcf05n02 icinga2[6305]: [2024-11-03 08:00:38 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 08:00:38 kjcf05n02 icinga2[6305]: [2024-11-03 08:00:38 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 08:00:38 kjcf05n02 icinga2[6305]: [2024-11-03 08:00:38 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 08:00:38 kjcf05n02 icinga2[6305]: [2024-11-03 08:00:38 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 08:00:38 kjcf05n02 icinga2[6305]: [2024-11-03 08:00:38 -0600] information/cli: Closing console log. Nov 3 08:00:38 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 08:00:38 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:38 kjcf05n02 systemd[3140]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:38 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:38 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:39 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 08:00:39 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 08:00:39 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:39 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 3 08:00:39 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:40 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 08:00:40 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:40 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:40 kjcf05n02 dcs-bulk-data-sender[6175]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 08:00:40 kjcf05n02 dcs-collectord[6175]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 08:00:40 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 08:00:40 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 08:00:40 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 08:00:40 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 08:00:40 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 08:00:40 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 08:00:40 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 08:00:40 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 08:00:40 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 08:00:40 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 08:00:40 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 08:00:40 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 08:00:40 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 08:00:40 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 08:00:41 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:41 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 08:00:41 kjcf05n02 nslcd[6921]: version 0.9.9 starting Nov 3 08:00:41 kjcf05n02 nslcd[6921]: accepting connections Nov 3 08:00:41 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 08:00:41 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:41 kjcf05n02 systemd[3140]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:41 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:41 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:41 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 08:00:41 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 08:00:42 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 08:00:42 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 08:00:42 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 08:00:42 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 08:00:42 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 08:00:42 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 08:00:42 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:43 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 08:00:43 kjcf05n02 dearcpw[7022]: Using config script: /etc/dearcpw.conf Nov 3 08:00:43 kjcf05n02 dearcpw[7022]: - Creating default directory: '/var/log/dearcpw' Nov 3 08:00:43 kjcf05n02 dearcpw[7022]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 08:00:43 kjcf05n02 dearcpw[7022]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 08:00:43 kjcf05n02 dearcpw[7022]: - Creating default directory: '/var/run/dearcpw' Nov 3 08:00:43 kjcf05n02 dearcpw[7022]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 08:00:43 kjcf05n02 dearcpw[7022]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 08:00:43 kjcf05n02 dearcpw-server[7076]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 08:00:43 kjcf05n02 dearcpw[7022]: celery multi v5.2.7 (dawn-chorus) Nov 3 08:00:43 kjcf05n02 dearcpw[7022]: > Starting nodes... Nov 3 08:00:43 kjcf05n02 dearcpw[7022]: > dearcpw@kjcf05n02: OK Nov 3 08:00:43 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 08:00:43 kjcf05n02 dearcpw-server[7078]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 08:00:43 kjcf05n02 dearcpw-server[7078]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 08:00:43 kjcf05n02 dearcpw-server[7078]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 08:00:43 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 3 08:00:43 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:43 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:43 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 08:00:43 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 08:00:43 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 08:00:43 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 08:00:43 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 08:00:43 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 08:00:43 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 08:00:43 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 08:00:43 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 08:00:43 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 08:00:44 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:56238). Nov 3 08:00:44 kjcf05n01 rsyncd[2980845]: connect from kjcf05n02 (172.16.2.5) Nov 3 08:00:44 kjcf05n01 rsyncd[2980845]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 08:00:44 kjcf05n01 rsyncd[2980845]: receiving file list Nov 3 08:00:44 kjcf05n01 rsyncd[2980845]: sent 29 bytes received 325 bytes total size 10905 Nov 3 08:00:44 kjcf05n01 systemd[1]: rsyncd@610-172.16.2.2:873-172.16.2.5:56238.service: Succeeded. Nov 3 08:00:44 kjcf05n02 puppet[7100]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 3 08:00:44 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 08:00:44 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 08:00:44 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 08:00:44 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 08:00:44 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 08:00:44 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 08:00:44 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 08:00:44 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 08:00:44 kjcf05n02 dcs-collectord[5628]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 08:00:44 kjcf05n02 dcs-collectord[5628]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 08:00:44 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 08:00:44 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 08:00:44 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 08:00:44 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 08:00:44 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 08:00:44 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 08:00:45 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 08:00:45 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 08:00:45 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 08:00:45 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 08:00:46 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 08:00:46 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 08:00:46 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 08:00:46 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 08:00:46 kjcf05n00 zabbix-server[1084934]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:00:46 kjcf05n00 zabbix-server[1084934]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 120.49\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 116\\"}}"' Nov 3 08:00:46 kjcf05n00 log_interesting_event.py[1084934]: Event '45978' acknowledged Nov 3 08:00:47 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 08:00:47 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 08:00:47 kjcf05n02 ipmievd[3967]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 08:00:47 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:47 kjcf05n02 ipmievd[3967]: System Event sensor - Timestamp Clock Sync Nov 3 08:00:47 kjcf05n02 ipmievd[3140]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:47 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 08:00:47 kjcf05n02 diskless-swap[7603]: HA_PS_000: recovering journal Nov 3 08:00:47 kjcf05n02 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 08:00:47 kjcf05n02 diskless-swap[7603]: HA_PS_000: clean, 2280/6400 files, 7069/25600 blocks Nov 3 08:00:47 kjcf05n02 diskless-swap[7603]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 08:00:47 kjcf05n02 diskless-swap[7603]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 08:00:47 kjcf05n02 diskless-swap[7603]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 08:00:47 kjcf05n02 diskless-swap[7603]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 08:00:47 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 08:00:47 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:47 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:47 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 08:00:47 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 08:00:47 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 08:00:47 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 08:00:48 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 3 08:00:48 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 3 08:00:48 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 3 08:00:48 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 3 08:00:48 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 3 08:00:48 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 08:00:48 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 08:00:48 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 08:00:48 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 08:00:48 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 08:00:48 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 08:00:48 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 08:00:48 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 08:00:48 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 08:00:48 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 08:00:48 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 08:00:49 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 08:00:49 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 08:00:49 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 08:00:49 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 08:00:50 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 08:00:50 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 08:00:50 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 08:00:50 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 08:00:50 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 08:00:51 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 08:00:51 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 08:00:51 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 08:00:51 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 08:00:51 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:51 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 3 08:00:51 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:51 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:51 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 08:00:51 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 08:00:51 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:51 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 3 08:00:51 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:51 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:51 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 08:00:51 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 08:00:51 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:52 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 3 08:00:52 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:00:52 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:00:52 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 08:00:52 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 08:00:52 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 08:00:52 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 08:00:52 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 08:00:52 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 08:00:52 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 08:00:52 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 08:00:52 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 08:00:52 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 08:00:52 kjcf05n02 systemd[1]: Reloading. Nov 3 08:00:52 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 3 08:00:52 kjcf05n02 kdumpctl[7832]: kdump: No kdump initial ramdisk found. Nov 3 08:00:52 kjcf05n02 kdumpctl[7832]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 08:00:52 kjcf05n02 dracut[7944]: dracut-049-135.git20210121.el8 Nov 3 08:00:53 kjcf05n02 dracut[7946]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 08:00:53 kjcf05n02 dracut[7946]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 08:00:53 kjcf05n02 dracut[7946]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 08:00:53 kjcf05n02 dracut[7946]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 08:00:53 kjcf05n02 dracut[7946]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 08:00:53 kjcf05n02 dracut[7946]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 08:00:53 kjcf05n02 dracut[7946]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 08:00:53 kjcf05n02 dracut[7946]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + is_func check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ type -t check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check -h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local dev holder Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + require_binaries mdadm expr Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _module_name=90hperaid Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ mdadm = \-\m ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for cmd in "$@" Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + find_binary mdadm Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for cmd in "$@" Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + find_binary expr Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n -h ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for dev in "${!host_fs_types[@]}" Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ nfs != *_raid_member ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + continue Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _ret=255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + ret=255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ 255 = 0 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ 255 = 255 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ module_depends hperaid Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: +++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: +++ set -x Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ depends Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo rootfs-block Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ return 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ _ret=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ return 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for _moddep in $(module_depends $_mod) Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all == *\ hperaid\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + add_dracutmodules+=' rootfs-block ' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ == *\ hperaid\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check_module rootfs-block Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _mod=rootfs-block Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddep Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ == *\ rootfs-block\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n '' ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all == *\ rootfs-block\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + module_check rootfs-block 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _forced=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 2 -eq 2 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _forced=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + is_func check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ type -t check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check -h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _ret=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + ret=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ 0 = 0 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ module_depends rootfs-block Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: +++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 08:00:53 kjcf05n02 kdumpctl[3140]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ depends Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo fs-lib Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ _ret=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ return 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for _moddep in $(module_depends $_mod) Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all == *\ rootfs-block\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + add_dracutmodules+=' fs-lib ' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ == *\ rootfs-block\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check_module fs-lib Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _mod=fs-lib Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddep Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n '' ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + mods_checked_as_dep+=' fs-lib ' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all == *\ fs-lib\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + module_check fs-lib 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _forced=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 2 -eq 2 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _forced=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + is_func check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ type -t check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check -h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _ret=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + ret=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ 0 = 0 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ module_depends fs-lib Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: +++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ depends Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ return 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ _ret=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ return 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + mods_to_load+=' fs-lib ' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + mods_to_load+=' rootfs-block ' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + mods_to_load+=' hperaid ' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _mod=90kernel-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _mod=kernel-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check_module kernel-modules 1 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _mod=kernel-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddep Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all = all ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + module_check kernel-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _forced=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 1 -eq 2 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + is_func check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ type -t check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check -h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + true Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _ret=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + ret=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ 0 != 0 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ module_depends kernel-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: +++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ depends Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ true Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ _ret=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ return 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + mods_to_load+=' kernel-modules ' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _mod=90kernel-modules-extra Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _mod=kernel-modules-extra Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check_module kernel-modules-extra 1 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _mod=kernel-modules-extra Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddep Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all = all ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + module_check kernel-modules-extra Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _forced=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 1 -eq 2 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + is_func check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ type -t check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check -h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + true Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _ret=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + ret=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ 0 != 0 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ module_depends kernel-modules-extra Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: +++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ depends Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ true Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ _ret=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ return 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + mods_to_load+=' kernel-modules-extra ' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _mod=90kernel-network-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _mod=kernel-network-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check_module kernel-network-modules 1 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _mod=kernel-network-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddep Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all = all ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + module_check kernel-network-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _forced=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 1 -eq 2 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + is_func check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ type -t check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check -h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _ret=255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + ret=255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ 255 != 0 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 1 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _mod=90livenet Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _mod=livenet Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check_module livenet 1 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _mod=livenet Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddep Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all = all ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + module_check livenet Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _forced=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 1 -eq 2 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + is_func check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ type -t check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check -h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _ret=255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + ret=255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ 255 != 0 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 1 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _mod=90lvm Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _mod=lvm Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check_module lvm 1 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _mod=lvm Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 08:00:53 kjcf05n02 kdumpctl[3140]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddep Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all = all ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + module_check lvm Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _forced=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 1 -eq 2 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + is_func check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ type -t check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check -h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + require_binaries lvm Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _module_name=90lvm Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ lvm = \-\m ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for cmd in "$@" Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + find_binary lvm Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n -h ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for fs in "${host_fs_types[@]}" Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ nfs = LVM*_member ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _ret=255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + ret=255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ 255 != 0 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 1 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _mod=90mdraid Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _mod=mdraid Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check_module mdraid 1 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _mod=mdraid Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddep Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all = all ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + module_check mdraid Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _forced=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 1 -eq 2 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + is_func check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ type -t check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check -h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _rootdev Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + require_binaries mdadm expr Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _module_name=90mdraid Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ mdadm = \-\m ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for cmd in "$@" Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + find_binary mdadm Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for cmd in "$@" Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + find_binary expr Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n -h ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for dev in "${!host_fs_types[@]}" Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ nfs != *_raid_member ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + continue Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _ret=255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + ret=255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ 255 != 0 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 1 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _mod=90multipath Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _mod=multipath Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check_module multipath 1 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _mod=multipath Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddep Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all = all ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + module_check multipath Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _forced=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 1 -eq 2 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + is_func check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ type -t check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check -h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _rootdev Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n -h ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for_each_host_dev_and_slaves is_mpath Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _func=is_mpath Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _dev Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for _dev in "${host_devs[@]}" Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + continue Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 1 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _ret=255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + ret=255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ 255 != 0 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 1 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _mod=90qemu Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _mod=qemu Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check_module qemu 1 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _mod=qemu Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddep Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all = all ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + module_check qemu Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _forced=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 1 -eq 2 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + is_func check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ type -t check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check -h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n -h ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + type -P systemd-detect-virt Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ systemd-detect-virt --vm Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + vm=none Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + (( 1 != 0 )) Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _ret=255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + ret=255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ 255 != 0 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 1 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _mod=90qemu-net Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _mod=qemu-net Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check_module qemu-net 1 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _mod=qemu-net Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddep Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all = all ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + module_check qemu-net Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _forced=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 1 -eq 2 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + is_func check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ type -t check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check -h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n -h ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + type -P systemd-detect-virt Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ systemd-detect-virt --vm Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + vm= Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + (( 1 != 0 )) Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _ret=255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + ret=255 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ 255 != 0 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + return 1 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _mod=90stratis Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + _mod=stratis Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check_module stratis 1 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _mod=stratis Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddep Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ all = all ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + module_check stratis Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ read a b Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _forced=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _hostonly=-h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 1 -eq 2 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + is_func check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: ++ type -t check Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + check -h Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _module_name=90stratis Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + local _ret=0 Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + [[ stratisd-init = \-\m ]] Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + for cmd in "$@" Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + find_binary stratisd-init Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 08:00:53 kjcf05n02 kdumpctl[7832]: + set +x Nov 3 08:00:53 kjcf05n02 dracut[7946]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 08:00:53 kjcf05n02 dracut[7946]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 08:00:53 kjcf05n02 dracut[7946]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 08:00:53 kjcf05n02 dracut[7946]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 08:00:53 kjcf05n02 dracut[7946]: memstrack is available Nov 3 08:00:53 kjcf05n02 dracut[7946]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 08:00:53 kjcf05n02 dracut[7946]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 08:00:53 kjcf05n02 dracut[7946]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 08:00:54 kjcf05n02 dracut[7946]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 08:00:54 kjcf05n02 dracut[7946]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 08:00:54 kjcf05n02 dracut[7946]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 08:00:54 kjcf05n02 dracut[7946]: *** Including module: bash *** Nov 3 08:00:54 kjcf05n02 dracut[7946]: *** Including module: systemd *** Nov 3 08:00:55 kjcf05n02 dracut[7946]: *** Including module: fips *** Nov 3 08:00:55 kjcf05n02 dracut[7946]: *** Including module: systemd-initrd *** Nov 3 08:00:55 kjcf05n02 dracut[7946]: *** Including module: watchdog-modules *** Nov 3 08:00:55 kjcf05n02 dracut[7946]: *** Including module: nss-softokn *** Nov 3 08:00:55 kjcf05n02 dracut[7946]: *** Including module: i18n *** Nov 3 08:00:55 kjcf05n02 dracut[7946]: No KEYMAP configured. Nov 3 08:00:55 kjcf05n02 dracut[7946]: *** Including module: network-legacy *** Nov 3 08:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 08:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 08:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 08:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 08:00:56 kjcf05n02 dracut[7946]: *** Including module: network *** Nov 3 08:00:56 kjcf05n02 dracut[7946]: *** Including module: ib_bonding *** Nov 3 08:00:56 kjcf05n02 dracut[7946]: *** Including module: drm *** Nov 3 08:00:59 kjcf05n02 dcs-collectord[5628]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 08:00:59 kjcf05n02 dcs-collectord[5628]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 08:00:59 kjcf05n00 mcfcli[3673891]: %3|1730642459.275|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 08:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 08:00:59 kjcf05n02 dracut[7946]: *** Including module: hperaid *** Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + install Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + local rule rule_path Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + inst_multiple cat expr Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.8FbPCy/initramfs -a -f cat expr Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + _ret=0 Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + (( 0 != 0 )) Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + : Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + return 0 Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + inst_multiple -o mdmon Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.8FbPCy/initramfs -a -f -o mdmon Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + _ret=0 Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + (( 0 != 0 )) Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + : Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + return 0 Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: ++ command -v partx Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + inst /usr/sbin/partx /sbin/partx Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + local _hostonly_install Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + [[ -e /tmp/dracut.8FbPCy/initramfs//sbin/partx ]] Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.8FbPCy/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + (( 0 != 0 )) Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + : Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: ++ command -v mdadm Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + local _hostonly_install Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + [[ -e /tmp/dracut.8FbPCy/initramfs//sbin/mdadm ]] Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.8FbPCy/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + (( 0 != 0 )) Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + : Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + [[ yes == \y\e\s ]] Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + local _raidconf Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: ++ cmdline Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: ++ local _activated dev line UUID Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: ++ declare -A _activated Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: ++ for dev in "${!host_fs_types[@]}" Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: ++ [[ nfs != *_raid_member ]] Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: ++ continue Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + _raidconf= Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + [[ -n '' ]] Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + inst_rules 64-md-raid.rules Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + local _target=/etc/udev/rules.d _rule _found Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + inst_dir /usr/lib/udev/rules.d Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + [[ -e /tmp/dracut.8FbPCy/initramfs//usr/lib/udev/rules.d ]] Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + return 0 Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + inst_dir /etc/udev/rules.d Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + [[ -e /tmp/dracut.8FbPCy/initramfs//etc/udev/rules.d ]] Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + return 0 Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + for _rule in "$@" Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + continue Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + continue Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + for r in '' $dracutbasedir/rules.d/ Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + [[ 64-md-raid.rules != /* ]] Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + continue Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + for r in '' $dracutbasedir/rules.d/ Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + continue Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + [[ -n '' ]] Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 08:00:59 kjcf05n02 kdumpctl[7832]: + set +x Nov 3 08:00:59 kjcf05n02 dracut[7946]: Skipping udev rule: 64-md-raid.rules Nov 3 08:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 08:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + installkernel Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + instmods =drivers/md Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + local _optional=-o Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + local _silent Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + local _ret Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + [[ '' = yes ]] Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + [[ =drivers/md = \-\c ]] Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + [[ =drivers/md = \-\s ]] Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + (( 1 == 0 )) Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.8FbPCy/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + _ret=0 Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + (( 0 != 0 )) Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + [[ -n '' ]] Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + return 0 Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + _ret=0 Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + return 0 Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + modules_loaded+='hperaid ' Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + '[' -n '' ']' Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + _d_mod=90kernel-modules Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + _d_mod=kernel-modules Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + [[ '' = yes ]] Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + dinfo '*** Including module: kernel-modules ***' Nov 3 08:01:00 kjcf05n02 kdumpctl[7832]: + set +x Nov 3 08:01:00 kjcf05n02 dracut[7946]: *** Including module: kernel-modules *** Nov 3 08:01:00 kjcf05n02 dracut[7946]: *** Including module: kernel-modules-extra *** Nov 3 08:01:01 kjcf05n02 dracut[7946]: *** Including module: kernel-network-modules *** Nov 3 08:01:01 kjcf05n02 dracut[7946]: *** Including module: diskless-mod *** Nov 3 08:01:01 kjcf05n02 dracut[7946]: *** Including module: fstab-sys *** Nov 3 08:01:01 kjcf05n02 dracut[7946]: *** Including module: nfs *** Nov 3 08:01:01 kjcf05n02 dracut[7946]: *** Including module: rootfs-block *** Nov 3 08:01:01 kjcf05n02 dracut[7946]: *** Including module: terminfo *** Nov 3 08:01:01 kjcf05n02 dracut[7946]: *** Including module: udev-rules *** Nov 3 08:01:01 kjcf05n02 dracut[7946]: Skipping udev rule: 91-permissions.rules Nov 3 08:01:01 kjcf05n02 dracut[7946]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 08:01:01 kjcf05n02 dracut[7946]: *** Including module: dracut-systemd *** Nov 3 08:01:02 kjcf05n02 dracut[7946]: *** Including module: usrmount *** Nov 3 08:01:02 kjcf05n02 dracut[7946]: *** Including module: base *** Nov 3 08:01:03 kjcf05n02 dracut[7946]: *** Including module: fs-lib *** Nov 3 08:01:03 kjcf05n02 dracut[7946]: *** Including module: kdumpbase *** Nov 3 08:01:03 kjcf05n02 dracut[7946]: *** Including module: memstrack *** Nov 3 08:01:03 kjcf05n02 dracut[7946]: *** Including module: shutdown *** Nov 3 08:01:03 kjcf05n02 dracut[7946]: *** Including module: squash *** Nov 3 08:01:03 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 3 08:01:04 kjcf05n02 dracut[7946]: *** Including modules done *** Nov 3 08:01:04 kjcf05n02 dracut[7946]: *** Installing kernel module dependencies *** Nov 3 08:01:04 kjcf05n02 dracut[7946]: *** Installing kernel module dependencies done *** Nov 3 08:01:04 kjcf05n02 dracut[7946]: *** Resolving executable dependencies *** Nov 3 08:01:05 kjcf05n02 dracut[7946]: *** Resolving executable dependencies done*** Nov 3 08:01:05 kjcf05n02 dracut[7946]: *** Hardlinking files *** Nov 3 08:01:05 kjcf05n02 dracut[7946]: *** Hardlinking files done *** Nov 3 08:01:05 kjcf05n02 dracut[7946]: *** Generating early-microcode cpio image *** Nov 3 08:01:05 kjcf05n02 dracut[7946]: *** Constructing AuthenticAMD.bin **** Nov 3 08:01:05 kjcf05n02 dracut[7946]: *** Store current command line parameters *** Nov 3 08:01:05 kjcf05n02 dracut[7946]: Stored kernel commandline: Nov 3 08:01:05 kjcf05n02 dracut[7946]: rd.driver.pre=sd_mod Nov 3 08:01:05 kjcf05n02 dracut[7946]: rd.driver.pre=nvme Nov 3 08:01:05 kjcf05n02 dracut[7946]: rd.driver.pre=ipmi_si Nov 3 08:01:05 kjcf05n02 dracut[7946]: rd.driver.pre=ipmi_devintf Nov 3 08:01:05 kjcf05n02 dracut[7946]: rd.driver.pre=ipmi_msghandler Nov 3 08:01:05 kjcf05n02 dracut[7946]: nameserver=172.16.2.2 Nov 3 08:01:05 kjcf05n02 dracut[7946]: nameserver=127.0.0.1 Nov 3 08:01:05 kjcf05n02 dracut[7946]: nameserver=172.16.2.2 Nov 3 08:01:05 kjcf05n02 dracut[7946]: nameserver=127.0.0.1 Nov 3 08:01:05 kjcf05n02 dracut[7946]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 3 08:01:05 kjcf05n02 dracut[7946]: rd.neednet Nov 3 08:01:05 kjcf05n02 dracut[7946]: kdumpnic=mgmt0 Nov 3 08:01:05 kjcf05n02 dracut[7946]: bootdev=mgmt0 Nov 3 08:01:05 kjcf05n02 dracut[7946]: *** Install squash loader *** Nov 3 08:01:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730642465', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 2.12, 1.97, 0.87'}"] Nov 3 08:01:06 kjcf05n02 dracut[7946]: *** Squashing the files inside the initramfs *** Nov 3 08:01:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 2.12, 1.97, 0.87', 'message': 'OK - load average: 2.12, 1.97, 0.87', 'value': 'ok', 'timestamp': '1730642465'} Nov 3 08:01:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:01:06 kjcf05n02 dracut[7946]: *** Squashing the files inside the initramfs done *** Nov 3 08:01:06 kjcf05n02 dracut[7946]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 08:01:06 kjcf05n02 dracut[7946]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 08:01:06 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 3 08:01:07 kjcf05n02 kdumpctl[7832]: kdump: kexec: loaded kdump kernel Nov 3 08:01:07 kjcf05n02 kdumpctl[7832]: kdump: Starting kdump: [OK] Nov 3 08:01:07 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 3 08:01:07 kjcf05n02 systemd[1]: Reloading. Nov 3 08:01:07 kjcf05n02 systemd[3140]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:01:07 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:01:07 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:01:07 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 08:01:07 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 08:01:07 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 08:01:07 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 08:01:07 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 08:01:07 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 08:01:07 kjcf05n02 ifdown[14541]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 08:01:07 kjcf05n02 ifdown[14542]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:01:07 kjcf05n02 ifdown[14543]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:01:08 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 08:01:08 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 08:01:08 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 08:01:08 kjcf05n02 ifup[14623]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 08:01:08 kjcf05n02 ifup[14624]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:01:08 kjcf05n02 ifup[14625]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:01:09 kjcf05n00 zabbix-server[1085150]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:01:09 kjcf05n00 zabbix-server[1085150]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:54\\"}}"' Nov 3 08:01:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730642469', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 328 processes with STATE = RSZDT '}"] Nov 3 08:01:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 328 processes with STATE = RSZDT ', 'message': 'PROCS OK: 328 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730642469'} Nov 3 08:01:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:01:09 kjcf05n00 log_interesting_event.py[1085150]: Event '45980' acknowledged Nov 3 08:01:09 kjcf05n00 zabbix-server[1085156]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:01:09 kjcf05n00 zabbix-server[1085156]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 3 08:01:10 kjcf05n00 log_interesting_event.py[1085156]: Event '45979' acknowledged Nov 3 08:01:10 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 08:01:10 kjcf05n00 zabbix-server[1085159]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:01:10 kjcf05n00 zabbix-server[1085159]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 3 08:01:10 kjcf05n00 log_interesting_event.py[1085159]: Event '45981' acknowledged Nov 3 08:01:12 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 08:01:12 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 08:01:12 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 08:01:12 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:01:12 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:01:12 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:01:12 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:01:12 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 08:01:12 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 08:01:12 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 08:01:12 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 08:01:12 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:01:12 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:01:12 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:01:12 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:01:12 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 08:01:12 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 08:01:12 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 08:01:12 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 08:01:12 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 08:01:12 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 08:01:12 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 08:01:12 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 08:01:12 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 08:01:12 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 08:01:12 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 08:01:12 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 08:01:12 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 08:01:12 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 08:01:12 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 08:01:12 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 08:01:12 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 08:01:12 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 08:01:12 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 08:01:12 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 08:01:12 kjcf05n02 ifdown[14807]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 08:01:12 kjcf05n02 ifdown[14808]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:01:12 kjcf05n02 ifdown[14809]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:01:13 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 08:01:13 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 08:01:13 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 08:01:13 kjcf05n02 ifup[14883]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 08:01:13 kjcf05n02 ifup[14884]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:01:13 kjcf05n02 ifup[14885]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:01:14 kjcf05n02 dcs-collectord[5628]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 08:01:14 kjcf05n02 dcs-collectord[5628]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 08:01:15 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 08:01:16 kjcf05n00 mcfcli[3673891]: %3|1730642476.912|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:01:17 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 08:01:17 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 08:01:17 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 08:01:17 kjcf05n02 systemd[1]: Reloading. Nov 3 08:01:18 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 3 08:01:18 kjcf05n02 await_ha_peer[15143]: Waiting for HA peer kjcf05n03 Nov 3 08:01:19 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 08:01:19 kjcf05n02 await_ha_peer[15143]: Peer kjcf05n03 has started, starting HA Nov 3 08:01:19 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 3 08:01:19 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 3 08:01:19 kjcf05n02 fstonithd.py[15224]: Listening for kdump packets from partner Nov 3 08:01:19 kjcf05n02 systemd[1]: Reloading. Nov 3 08:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730642479', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.4% (3817964 kB) used.'}"] Nov 3 08:01:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.4% (3817964 kB) used.', 'message': 'OK - 1.4% (3817964 kB) used.', 'value': 'ok', 'timestamp': '1730642479'} Nov 3 08:01:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:01:19 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 08:01:19 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 3 08:01:19 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 08:01:19 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running Nov 3 08:01:19 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 3 08:01:20 kjcf05n02 systemd[3140]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:01:20 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:01:20 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:01:20 kjcf05n02 systemd[1]: Reloading. Nov 3 08:01:20 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 3 08:01:20 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 08:01:20 kjcf05n02 systemd[1]: Reloading. Nov 3 08:01:21 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 08:01:21 kjcf05n02 puppet-agent[3556]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:01:21 kjcf05n02 puppet[3556]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:01:21 kjcf05n02 puppet-agent[3556]: Applied catalog in 92.85 seconds Nov 3 08:01:21 kjcf05n02 puppet[3556]: Notice: Applied catalog in 92.85 seconds Nov 3 08:01:21 kjcf05n02 systemd[1]: Started Puppet agent. Nov 3 08:01:21 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 08:01:21 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 3 08:01:21 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 08:01:21 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 08:01:21 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 08:01:21 kjcf05n02 systemd[1]: Reached target Timers. Nov 3 08:01:21 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 08:01:21 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 08:01:21 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 08:01:21 kjcf05n02 wce-disable.sh[15380]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 08:01:21 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 08:01:21 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 08:01:21 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 08:01:21 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 08:01:21 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 3 08:01:21 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 3 08:01:21 kjcf05n02 gateway-ec-node.py[15384]: Starting gateway-ec-node service Nov 3 08:01:21 kjcf05n02 python3.9[15383]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 08:01:21 kjcf05n02 python3.9[15383]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 08:01:21 kjcf05n02 RFSF-API[15382]: INFO[2024-11-03T08:01:21-06:00] Datapath API RESTful Service starting Nov 3 08:01:21 kjcf05n02 dp-api-server-node[15382]: INFO[2024-11-03T08:01:21-06:00] Datapath API RESTful Service starting Nov 3 08:01:21 kjcf05n02 RFSF-API[15382]: INFO[2024-11-03T08:01:21-06:00] Running in production mode, starting dbus event listener Nov 3 08:01:21 kjcf05n02 dp-api-server-node[15382]: INFO[2024-11-03T08:01:21-06:00] Running in production mode, starting dbus event listener Nov 3 08:01:21 kjcf05n02 RFSF-API[15382]: INFO[2024-11-03T08:01:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 08:01:21 kjcf05n02 dp-api-server-node[15382]: INFO[2024-11-03T08:01:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 08:01:21 kjcf05n02 RFSF-API[15382]: INFO[2024-11-03T08:01:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 08:01:21 kjcf05n02 dp-api-server-node[15382]: INFO[2024-11-03T08:01:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 08:01:21 kjcf05n02 RFSF-API[15382]: INFO[2024-11-03T08:01:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 08:01:21 kjcf05n02 dp-api-server-node[15382]: INFO[2024-11-03T08:01:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 08:01:21 kjcf05n02 RFSF-API[15382]: INFO[2024-11-03T08:01:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 08:01:21 kjcf05n02 dp-api-server-node[15382]: INFO[2024-11-03T08:01:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 08:01:21 kjcf05n02 RFSF-API[15382]: INFO[2024-11-03T08:01:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 08:01:21 kjcf05n02 dp-api-server-node[15382]: INFO[2024-11-03T08:01:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 08:01:21 kjcf05n02 RFSF-API[15382]: INFO[2024-11-03T08:01:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 08:01:21 kjcf05n02 dp-api-server-node[15382]: INFO[2024-11-03T08:01:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 08:01:21 kjcf05n02 RFSF-API[15382]: INFO[2024-11-03T08:01:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 08:01:21 kjcf05n02 dp-api-server-node[15382]: INFO[2024-11-03T08:01:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 08:01:21 kjcf05n02 RFSF-API[15382]: INFO[2024-11-03T08:01:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 08:01:21 kjcf05n02 dp-api-server-node[15382]: INFO[2024-11-03T08:01:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 08:01:21 kjcf05n02 RFSF-API[15382]: INFO[2024-11-03T08:01:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 08:01:21 kjcf05n02 dp-api-server-node[15382]: INFO[2024-11-03T08:01:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 08:01:21 kjcf05n02 RFSF-API[15382]: INFO[2024-11-03T08:01:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 08:01:21 kjcf05n02 dp-api-server-node[15382]: INFO[2024-11-03T08:01:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 08:01:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 08:01:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730642485', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 08:01:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730642485'} Nov 3 08:01:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:01:28 kjcf05n02 systemd[1]: Reloading. Nov 3 08:01:28 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 08:01:28 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 08:01:28 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 08:01:28 kjcf05n02 dcs-collectord[5628]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 08:01:29 kjcf05n02 dcs-collectord[5628]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 08:01:29 kjcf05n02 dcs-collectord[5628]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 08:01:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730642489', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 08:01:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730642489'} Nov 3 08:01:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:01:29 kjcf05n00 mcfcli[3673891]: %3|1730642489.275|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:01:29 kjcf05n02 diskmonitor_pre[16008]: Key management is currently disabled.DEAR disabled Nov 3 08:01:29 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 08:01:30 kjcf05n00 httpd[902565]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 08:01:31 kjcf05n02 sh[16005]: LNET configured: New Created Nov 3 08:01:31 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 08:01:31 kjcf05n02 LCNmon[18045]: Interface ib0 is up Nov 3 08:01:31 kjcf05n02 LCNmon[18045]: Interface ib1 is up Nov 3 08:01:31 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: /var/run/diskmonitor does not exist, creating Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: Creating /var/run/diskmonitor/disk Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: Creating /var/run/diskmonitor/encl Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: Creating /var/run/diskmonitor/cli Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: RAS_Interlocks_enabled: 1 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: add handler for sig: 14 sa_flags: 10000004 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: add handler for sig: 1 sa_flags: 10000004 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: add handler for sig: 2 sa_flags: 00000004 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: add handler for sig: 15 sa_flags: 00000004 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: add handler for sig: 6 sa_flags: 00000004 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: add handler for sig: 3 sa_flags: 00000004 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: add handler for sig: 30 sa_flags: 00000004 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: add handler for sig: 20 sa_flags: 00000004 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: add handler for sig: 10 sa_flags: 10000004 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: add handler for sig: 11 sa_flags: 00000004 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: add handler for sig: 7 sa_flags: 00000004 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: add handler for sig: 4 sa_flags: 00000004 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: add handler for sig: 8 sa_flags: 00000004 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: Using HA Baton locks - key: diskmonitor Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: Baton will be held for at most 570 seconds Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: DMMP Enabled: 0 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: random seed: aca5b1ad Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: NVMe Enclosure: 1 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: ZFS Enclosure: 0 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: Dbus, Initialized Connection Successfully Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: int_catcher_thread: thread start Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: Received dbus message 4 org.freedesktop.DBus -> :1.106 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 08:01:33 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 08:01:33 kjcf05n02 openhpid[5534]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 08:01:33 kjcf05n02 openhpid[5534]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 08:01:34 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 3 08:01:34 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 08:01:34 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 08:01:34 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18404 which is not our child. We'll most likely not notice when it exits. Nov 3 08:01:34 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 08:01:34 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 3 08:01:34 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 3 08:01:34 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 08:01:34 kjcf05n02 dcs-collectord[5628]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 08:01:34 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 08:01:34 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 08:01:34 kjcf05n02 systemd[1]: Startup finished in 50.856s (kernel) + 2min 28.735s (userspace) = 3min 19.592s. Nov 3 08:01:34 kjcf05n02 openhpid[18404]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 08:01:34 kjcf05n02 openhpid[18404]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 08:01:34 kjcf05n02 openhpid[18404]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 08:01:34 kjcf05n02 openhpid[18404]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 08:01:35 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18592 (bash) Nov 3 08:01:35 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 08:01:35 kjcf05n02 LCNmon[18045]: 10.16.100.54 is unreachable via ib0 Nov 3 08:01:35 kjcf05n02 LCNmon[18045]: Can ping through interface ib0 Nov 3 08:01:35 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 08:01:35 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 08:01:35 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 08:01:35 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 08:01:35 kjcf05n02 LCNmon[18045]: Can ping through interface ib1 Nov 3 08:01:35 kjcf05n02 LCNmon[18045]: NIC ib0, initial state UP Nov 3 08:01:35 kjcf05n02 LCNmon[18045]: NIC ib1, initial state UP Nov 3 08:01:35 kjcf05n02 LCNmon[18045]: LCNstat initial state UP Nov 3 08:01:35 kjcf05n02 LCNmon[18045]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 3 08:01:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730642496', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 08:01:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730642496', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 08:01:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730642496'} Nov 3 08:01:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730642496'} Nov 3 08:01:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:01:37 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 08:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 08:01:39 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 08:01:44 kjcf05n02 dcs-collectord[5628]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 08:01:44 kjcf05n02 dcs-collectord[5628]: WARNING No data collected (hpi_parser.py:353) Nov 3 08:01:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730642511', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(3528.0B/2904.0B), ib1=(2772.0B/2824.0B), icl0=(8.9kB/10.7kB), lo=(1688.0B/1688.0B), meth0=(1541.8MB/8.5MB), mgmt0=(1478.6MB/8.4MB)'}"] Nov 3 08:01:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(3528.0B/2904.0B), ib1=(2772.0B/2824.0B), icl0=(8.9kB/10.7kB), lo=(1688.0B/1688.0B), meth0=(1541.8MB/8.5MB), mgmt0=(1478.6MB/8.4MB)', 'message': 'NET OK - (Rx/Tx) ib0=(3528.0B/2904.0B), ib1=(2772.0B/2824.0B), icl0=(8.9kB/10.7kB), lo=(1688.0B/1688.0B), meth0=(1541.8MB/8.5MB), mgmt0=(1478.6MB/8.4MB)', 'value': 'ok', 'timestamp': '1730642511'} Nov 3 08:01:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:01:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730642511', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 08:01:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730642511'} Nov 3 08:01:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:01:54 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31423 deleted. Nov 3 08:01:56 kjcf05n00 mcfcli[3673891]: %3|1730642516.635|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:01:57 kjcf05n02 ipmievd[3967]: System Event sensor - Timestamp Clock Sync Nov 3 08:01:59 kjcf05n02 ipmievd[3140]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:01:59 kjcf05n02 dcs-collectord[5628]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 08:01:59 kjcf05n00 mcfcli[3673891]: %3|1730642519.276|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 08:02:11 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 08:02:14 kjcf05n02 dcs-collectord[5628]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 08:02:19 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db01012002538450000000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 08:02:19 kjcf05n02 ras-resource-manager-agent[5892]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "3d4b846c-99ec-11ef-8519-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 08:02:19 kjcf05n02 ras-resource-manager-agent[5892]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '3d4b846c-99ec-11ef-8519-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 08:02:19 kjcf05n02 ras-resource-manager-agent[5892]: INFO Submitting new device inserted signal, starting to qualify drive: 3d4b846c-99ec-11ef-8519-00093d0695e3 (admin_action.py:110) Nov 3 08:02:19 kjcf05n03 firmware-update-orc-server[5875]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "9c8bdf26-6c57-4610-8661-4d717fa3228a"} (logger.py:65) Nov 3 08:02:19 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 141360 (get_disk_device) Nov 3 08:02:19 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 08:02:19 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 08:02:19 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '3d4b846c-99ec-11ef-8519-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 08:02:19 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '3d4b846c-99ec-11ef-8519-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 08:02:19 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '3d4b846c-99ec-11ef-8519-00093d0695e3', 'response ID': '3d55eed4-99ec-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 08:02:19 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 3d55eed4-99ec-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 08:02:19 kjcf05n02 diskmonitor[17651]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 08:02:19 kjcf05n02 ras-resource-manager-agent[5892]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "3d9c51e4-99ec-11ef-8519-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 08:02:19 kjcf05n02 ras-resource-manager-agent[5892]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '3d9c51e4-99ec-11ef-8519-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 08:02:19 kjcf05n02 ras-resource-manager-agent[5892]: INFO Submitting new device inserted signal, starting to qualify drive: 3d9c51e4-99ec-11ef-8519-00093d0695e3 (admin_action.py:110) Nov 3 08:02:19 kjcf05n02 firmware-update-orc-server[5848]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "f9599bd7-67b7-4f94-8459-253917c67b90"} (logger.py:65) Nov 3 08:02:19 kjcf05n03 ccp-client[141381]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 08:02:19 kjcf05n03 ccp-client[141381]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 08:02:19 kjcf05n03 ccp-client[141390]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 08:02:19 kjcf05n03 ccp-client[141381]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 08:02:19 kjcf05n03 ccp-client[141381]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 08:02:19 kjcf05n03 ccp-client[141390]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 08:02:19 kjcf05n03 ccp-client[141390]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 08:02:19 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '3d9c51e4-99ec-11ef-8519-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 08:02:19 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '3d9c51e4-99ec-11ef-8519-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 08:02:19 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '3d9c51e4-99ec-11ef-8519-00093d0695e3', 'response ID': '3da39ada-99ec-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 08:02:19 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 3da39ada-99ec-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 08:02:22 kjcf05n03 DRVFW[141521]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 08:02:22 kjcf05n03 ccp-client[141522]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 08:02:22 kjcf05n03 ccp-client[141522]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 08:02:22 kjcf05n03 ccp-client[141531]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 08:02:22 kjcf05n03 ccp-client[141522]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 08:02:22 kjcf05n03 ccp-client[141522]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 08:02:22 kjcf05n03 ccp-client[141531]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 08:02:22 kjcf05n03 ccp-client[141531]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 08:02:22 kjcf05n03 firmware-update-orc-server[5875]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 08:02:24 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 3d55eed4-99ec-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 08:02:24 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '3d4b846c-99ec-11ef-8519-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '3d4b846c-99ec-11ef-8519-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}}} (logger.py:65) Nov 3 08:02:24 kjcf05n02 ras-resource-manager-agent[5892]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '3d4b846c-99ec-11ef-8519-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 08:02:24 kjcf05n02 ras-resource-manager-agent[5892]: INFO Drive qualification complete responding: 3d4b846c-99ec-11ef-8519-00093d0695e3 (admin_action.py:205) Nov 3 08:02:24 kjcf05n02 ras-resource-manager-agent[5892]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "3d4b846c-99ec-11ef-8519-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (interesting_event.py:59) Nov 3 08:02:26 kjcf05n02 diskmonitor[17651]: 4 Nov 3 08:02:26 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 08:02:26 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 08:02:26 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 08:02:26 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 08:02:26 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 08:02:26 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 08:02:26 kjcf05n02 diskmonitor[17651]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 08:02:26 kjcf05n02 diskmonitor[17651]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 08:02:26 kjcf05n02 diskmonitor[17651]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 08:02:26 kjcf05n02 diskmonitor[17651]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 08:02:26 kjcf05n02 diskmonitor[17651]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 08:02:26 kjcf05n02 diskmonitor[17651]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "3d4b846c-99ec-11ef-8519-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 08:02:26 kjcf05n02 diskmonitor[17651]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 08:02:26 kjcf05n02 diskmonitor[17651]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 08:02:26 kjcf05n02 diskmonitor[17651]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "3d9c51e4-99ec-11ef-8519-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 08:02:26 kjcf05n02 diskmonitor[17651]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 08:02:26 kjcf05n02 diskmonitor[17651]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 08:02:29 kjcf05n00 mcfcli[3673891]: %3|1730642549.277|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:02:30 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22425 (get_disk_device) Nov 3 08:02:30 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 08:02:30 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 08:02:30 kjcf05n02 ccp-client[22449]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 08:02:30 kjcf05n02 ccp-client[22449]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 08:02:30 kjcf05n02 ccp-client[22474]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 08:02:30 kjcf05n02 ccp-client[22449]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 08:02:30 kjcf05n02 ccp-client[22449]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 08:02:30 kjcf05n02 ccp-client[22474]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 08:02:30 kjcf05n02 ccp-client[22474]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 08:02:30 kjcf05n02 chronyd[5136]: Selected source 172.16.2.1 Nov 3 08:02:33 kjcf05n02 DRVFW[22587]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 08:02:33 kjcf05n02 ccp-client[22588]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 08:02:33 kjcf05n02 ccp-client[22588]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 08:02:33 kjcf05n02 ccp-client[22600]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 08:02:33 kjcf05n02 ccp-client[22588]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 08:02:33 kjcf05n02 ccp-client[22588]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 08:02:33 kjcf05n02 ccp-client[22600]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 08:02:33 kjcf05n02 ccp-client[22600]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 08:02:33 kjcf05n02 firmware-update-orc-server[5848]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 08:02:33 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 3da39ada-99ec-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 08:02:33 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '3d9c51e4-99ec-11ef-8519-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '3d9c51e4-99ec-11ef-8519-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}}} (logger.py:65) Nov 3 08:02:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730642553}"] Nov 3 08:02:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730642553, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:02:33 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:02:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730642553}"] Nov 3 08:02:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730642553, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:02:33 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:02:34 kjcf05n00 mcfcli[3673891]: %3|1730642554.010|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:02:34 kjcf05n02 ras-resource-manager-agent[5892]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '3d9c51e4-99ec-11ef-8519-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}} (resource_admin.py:98) Nov 3 08:02:34 kjcf05n02 ras-resource-manager-agent[5892]: INFO Drive qualification complete responding: 3d9c51e4-99ec-11ef-8519-00093d0695e3 (admin_action.py:205) Nov 3 08:02:34 kjcf05n02 ras-resource-manager-agent[5892]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "3d9c51e4-99ec-11ef-8519-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (interesting_event.py:59) Nov 3 08:02:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730642553}"] Nov 3 08:02:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730642553, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:02:34 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:02:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730642553}"] Nov 3 08:02:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730642553, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:02:34 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:02:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730642553}"] Nov 3 08:02:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730642553, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:02:34 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:02:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730642553}"] Nov 3 08:02:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730642553, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:02:34 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:02:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730642553}"] Nov 3 08:02:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730642553, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:02:34 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:02:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730642553}"] Nov 3 08:02:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730642553, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:02:34 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:02:35 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 3 08:02:35 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 08:02:35 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 3 08:02:37 kjcf05n02 python3.9[5197]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 08:02:41 kjcf05n02 python3.9[3140]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:02:41 kjcf05n02 ras-resource-manager-agent[5892]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "3d4b846c-99ec-11ef-8519-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (service_main_handler.py:66) Nov 3 08:02:41 kjcf05n02 ras-resource-manager-agent[5892]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '3d4b846c-99ec-11ef-8519-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 08:02:41 kjcf05n02 ras-resource-manager-agent[5892]: INFO Device qualification response has been acknowledged: 3d4b846c-99ec-11ef-8519-00093d0695e3 (admin_action.py:151) Nov 3 08:02:41 kjcf05n02 ras-resource-manager-agent[5892]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "3d9c51e4-99ec-11ef-8519-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (service_main_handler.py:66) Nov 3 08:02:41 kjcf05n02 ras-resource-manager-agent[5892]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '3d9c51e4-99ec-11ef-8519-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}} (resource_admin.py:98) Nov 3 08:02:41 kjcf05n02 ras-resource-manager-agent[5892]: INFO Device qualification response has been acknowledged: 3d9c51e4-99ec-11ef-8519-00093d0695e3 (admin_action.py:151) Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "3d4b846c-99ec-11ef-8519-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: Dbus, handle_ingress_ras_signals, uuid: 3d4b846c-99ec-11ef-8519-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "3d4b846c-99ec-11ef-8519-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "3d9c51e4-99ec-11ef-8519-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: Dbus, handle_ingress_ras_signals, uuid: 3d9c51e4-99ec-11ef-8519-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "3d9c51e4-99ec-11ef-8519-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 08:02:44 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 08:02:45 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 08:02:46 kjcf05n02 diskmonitor[17651]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 08:02:50 kjcf05n02 diskmonitor[17651]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 08:02:50 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 08:02:50 kjcf05n02 diskmonitor[17651]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 08:02:50 kjcf05n02 diskmonitor[17651]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 08:02:50 kjcf05n02 diskmonitor[17651]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 08:02:50 kjcf05n02 diskmonitor[17651]: leaving test state: 1 next state: 2 Nov 3 08:02:50 kjcf05n02 diskmonitor[17651]: lock req: no timeout Nov 3 08:02:50 kjcf05n02 diskmonitor[17651]: leaving test state: 2 next state: 4 Nov 3 08:02:50 kjcf05n02 diskmonitor[17651]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 08:02:59 kjcf05n00 mcfcli[3673891]: %3|1730642579.278|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:03:10 kjcf05n00 mcfcli[3673891]: %3|1730642590.708|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:03:26 kjcf05n02 diskmonitor[17651]: lock acquired Nov 3 08:03:26 kjcf05n02 diskmonitor[17651]: leaving test state: 4 next state: 8 Nov 3 08:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T08:03:27.2535994-06:00 level=info msg="Completed cleanup jobs" duration=26.592241ms Nov 3 08:03:29 kjcf05n00 mcfcli[3673891]: %3|1730642609.278|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 08:03:33 kjcf05n02 diskmonitor[17651]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 08:03:33 kjcf05n02 diskmonitor[17651]: leaving test state: 8 next state: 20 Nov 3 08:03:33 kjcf05n02 diskmonitor[17651]: leaving test state: 20 next state: 40 Nov 3 08:03:33 kjcf05n02 diskmonitor[17651]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 145a24a0000 Nov 3 08:03:33 kjcf05n02 diskmonitor[17651]: leaving test state: 40 next state: 80 Nov 3 08:03:40 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 08:03:40 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 08:03:40 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 08:03:49 kjcf05n00 mcfcli[3673891]: %3|1730642629.261|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:03:50 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 08:03:50 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 08:03:50 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 08:03:54 kjcf05n02 dcs-collectord[5628]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 08:03:59 kjcf05n00 mcfcli[3673891]: %3|1730642639.778|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 08:04:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730642643}"] Nov 3 08:04:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730642643, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:04:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:04:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:04:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:04:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:04:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:04:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:04:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:04:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:04:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:04:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:04:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:04:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:04:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:04:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.294908ms Nov 3 08:04:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:04:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.294908ms Nov 3 08:04:03 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:04:03 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:04:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:04:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730642648}"] Nov 3 08:04:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730642648, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:04:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:04:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:04:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:04:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:04:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:04:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:04:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:04:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:04:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:04:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:04:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:04:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:04:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:04:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.192887ms Nov 3 08:04:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:04:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.192887ms Nov 3 08:04:08 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:04:08 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:04:08 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:04:24 kjcf05n00 zabbix-server[1087125]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:04:24 kjcf05n00 zabbix-server[1087125]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 100.39\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 97.75\\"}}"' Nov 3 08:04:24 kjcf05n00 log_interesting_event.py[1087125]: Event '45997' acknowledged Nov 3 08:04:26 kjcf05n00 mcfcli[3673891]: %3|1730642666.814|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:04:29 kjcf05n00 mcfcli[3673891]: %3|1730642669.778|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 08:04:33 kjcf05n02 diskmonitor[17651]: leaving test state: 80 next state: 100 Nov 3 08:04:33 kjcf05n02 diskmonitor[17651]: lock release: time: Sun Nov 3 08:04:28 2024 Nov 3 08:04:33 kjcf05n02 diskmonitor[17651]: leaving test state: 100 next state: 1 Nov 3 08:04:59 kjcf05n00 mcfcli[3673891]: %3|1730642699.779|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 08:05:04 kjcf05n00 mcfcli[3673891]: %3|1730642704.151|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:05:05 kjcf05n00 python3.9[1087768]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 08:05:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730642421', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 08:05:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730642421'} Nov 3 08:05:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:05:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730642421', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 08:05:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730642421'} Nov 3 08:05:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:05:23 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 08:05:29 kjcf05n00 mcfcli[3673891]: %3|1730642729.779|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 08:05:43 kjcf05n00 mcfcli[3673891]: %3|1730642743.263|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:05:51 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 08:05:59 kjcf05n00 mcfcli[3673891]: %3|1730642759.780|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 08:06:23 kjcf05n00 mcfcli[3673891]: %3|1730642783.260|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:06:29 kjcf05n00 mcfcli[3673891]: %3|1730642789.780|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 08:06:59 kjcf05n00 mcfcli[3673891]: %3|1730642819.781|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 08:07:03 kjcf05n00 mcfcli[3673891]: %3|1730642823.257|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:07:29 kjcf05n00 mcfcli[3673891]: %3|1730642849.782|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 08:07:41 kjcf05n00 mcfcli[3673891]: %3|1730642861.271|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:07:54 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 08:07:54 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 08:07:54 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 08:08:00 kjcf05n00 mcfcli[3673891]: %3|1730642880.094|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 08:08:09 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 3 08:08:09 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 3 08:08:09 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 3 08:08:18 kjcf05n00 mcfcli[3673891]: %3|1730642898.426|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:08:30 kjcf05n00 mcfcli[3673891]: %3|1730642910.095|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 08:08:54 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 3 08:08:56 kjcf05n00 mcfcli[3673891]: %3|1730642936.405|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:09:00 kjcf05n00 mcfcli[3673891]: %3|1730642940.095|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:09:22 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 3 08:09:22 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 3 08:09:30 kjcf05n00 mcfcli[3673891]: %3|1730642970.283|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 08:09:36 kjcf05n00 mcfcli[3673891]: %3|1730642976.402|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:09:59 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 3 08:09:59 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 3 08:09:59 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 3 08:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 08:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 08:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 08:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 08:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 08:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 08:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 08:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 08:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 08:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 08:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 08:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 08:10:00 kjcf05n00 mcfcli[3673891]: %3|1730643000.284|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 08:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 08:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 08:10:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 08:10:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:10:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 08:10:10 kjcf05n00 python3.9[1090682]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 08:10:14 kjcf05n00 mcfcli[3673891]: %3|1730643014.936|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:10:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730642421', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 08:10:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730642421'} Nov 3 08:10:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:10:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730642421', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 08:10:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730642421'} Nov 3 08:10:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:10:30 kjcf05n00 mcfcli[3673891]: %3|1730643030.284|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:10:52 kjcf05n00 mcfcli[3673891]: %3|1730643052.708|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:11:00 kjcf05n00 mcfcli[3673891]: %3|1730643060.284|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:11:04 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 3 08:11:30 kjcf05n00 mcfcli[3673891]: %3|1730643090.284|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:11:31 kjcf05n00 mcfcli[3673891]: %3|1730643091.842|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:11:32 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 3 08:11:32 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 3 08:11:54 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 08:11:54 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 08:11:54 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 08:12:00 kjcf05n00 mcfcli[3673891]: %3|1730643120.284|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:12:09 kjcf05n02 root[42072]: failback_xyraid Nov 3 08:12:11 kjcf05n02 root[42223]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 08:12:11 kjcf05n03 nslcd[6947]: [45e146] ldap_result() failed: Can't contact LDAP server Nov 3 08:12:11 kjcf05n03 nslcd[6947]: [5f007c] ldap_result() failed: Can't contact LDAP server Nov 3 08:12:10 kjcf05n00 mcfcli[3673891]: %3|1730643130.813|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:12:12 kjcf05n02 root[42420]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 08:12:14 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 3 08:12:17 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme23n1 Nov 3 08:12:18 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme24n1 Nov 3 08:12:18 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme19n1 Nov 3 08:12:18 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme8n1 Nov 3 08:12:18 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme17n1 Nov 3 08:12:18 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme9n1 Nov 3 08:12:18 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme3n1 Nov 3 08:12:18 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme25n1 Nov 3 08:12:18 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme18n1 Nov 3 08:12:19 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme4n1 Nov 3 08:12:19 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme2n1 Nov 3 08:12:21 kjcf05n02 dwd[5168]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 08:12:21 kjcf05n02 dwd[5168]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 08:12:21 kjcf05n02 dwd[5168]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 08:12:21 kjcf05n02 dwd[5168]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 08:12:21 kjcf05n02 dwd[5168]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 08:12:21 kjcf05n02 dwd[5168]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 08:12:21 kjcf05n02 dwd[5168]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 08:12:21 kjcf05n02 dwd[5168]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 08:12:21 kjcf05n02 dwd[5168]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 08:12:21 kjcf05n02 dwd[5168]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 08:12:21 kjcf05n02 dwd[5168]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 08:12:22 kjcf05n02 dwd[5168]: Starting NVME thread for nvme2n1 Nov 3 08:12:22 kjcf05n02 dwd[5168]: Starting NVME thread for nvme18n1 Nov 3 08:12:22 kjcf05n02 dwd[5168]: Starting NVME thread for nvme19n1 Nov 3 08:12:22 kjcf05n02 dwd[5168]: Starting NVME thread for nvme9n1 Nov 3 08:12:22 kjcf05n02 dwd[5168]: Starting NVME thread for nvme3n1 Nov 3 08:12:22 kjcf05n02 systemd-udevd[45313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45312]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45312]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45312]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45312]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45312]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45338]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45312]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45339]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45342]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45346]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45338]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45312]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45342]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45346]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45338]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45312]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45313]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45316]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45316]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45313]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45316]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45316]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45338]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45342]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45314]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45316]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45313]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45342]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45316]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 08:12:22 kjcf05n02 systemd-udevd[45313]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 08:12:23 kjcf05n02 systemd-udevd[45316]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 08:12:23 kjcf05n02 systemd-udevd[45316]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 08:12:23 kjcf05n02 systemd-udevd[45313]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:12:23 kjcf05n02 systemd-udevd[45316]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 08:12:23 kjcf05n02 systemd-udevd[45313]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 08:12:23 kjcf05n02 systemd-udevd[45316]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:12:23 kjcf05n02 systemd-udevd[45313]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 08:12:23 kjcf05n02 systemd-udevd[45316]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:12:23 kjcf05n02 systemd-udevd[45316]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:12:23 kjcf05n02 systemd-udevd[45316]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:12:23 kjcf05n02 dwd[5168]: Starting NVME thread for nvme24n1 Nov 3 08:12:23 kjcf05n02 dwd[5168]: Starting NVME thread for nvme4n1 Nov 3 08:12:23 kjcf05n02 dwd[5168]: Starting NVME thread for nvme23n1 Nov 3 08:12:23 kjcf05n02 dwd[5168]: Starting NVME thread for nvme17n1 Nov 3 08:12:23 kjcf05n02 dwd[5168]: Starting NVME thread for nvme25n1 Nov 3 08:12:23 kjcf05n02 dwd[5168]: Starting NVME thread for nvme8n1 Nov 3 08:12:24 kjcf05n02 nslcd[6921]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 08:12:25 kjcf05n02 dcs-bulk-data-sender[6175]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 141}' Nov 3 08:12:30 kjcf05n00 mcfcli[3673891]: %3|1730643150.285|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 08:12:31 kjcf05n02 diskmonitor[17651]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 08:12:38 kjcf05n02 diskmonitor[17651]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 08:12:38 kjcf05n02 diskmonitor[17651]: Scan for ReadErrorMax change for md65 Nov 3 08:12:38 kjcf05n02 diskmonitor[17651]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 08:12:38 kjcf05n02 diskmonitor[17651]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 08:12:38 kjcf05n02 diskmonitor[17651]: read_saved_file: md65 no saved speed Nov 3 08:12:38 kjcf05n02 diskmonitor[17651]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 08:12:38 kjcf05n02 diskmonitor[17651]: Set sync_speed_min (10000) for md65 Nov 3 08:12:38 kjcf05n02 diskmonitor[17651]: Set sync_speed_max (200000) for md65 Nov 3 08:12:38 kjcf05n02 diskmonitor[17651]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 08:12:45 kjcf05n00 zabbix-server[1092352]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:12:45 kjcf05n00 zabbix-server[1092352]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 143.31\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 108.81\\"}}"' Nov 3 08:12:46 kjcf05n00 log_interesting_event.py[1092352]: Event '46000' acknowledged Nov 3 08:12:47 kjcf05n00 mcfcli[3673891]: %3|1730643167.150|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:12:59 kjcf05n03 nslcd[6947]: [d062c2] ldap_result() failed: Can't contact LDAP server Nov 3 08:13:00 kjcf05n00 mcfcli[3673891]: %3|1730643180.286|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:13:06 kjcf05n03 diskmonitor[17713]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 08:13:06 kjcf05n03 diskmonitor[17713]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 08:13:15 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 08:13:15 kjcf05n02 systemd-tmpfiles[48556]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 08:13:15 kjcf05n02 systemd-tmpfiles[48556]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 08:13:15 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 08:13:15 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 08:13:18 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 48851 (bash) Nov 3 08:13:18 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 08:13:18 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 08:13:27 kjcf05n00 mcfcli[3673891]: %3|1730643207.147|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T08:13:27.253151435-06:00 level=info msg="Completed cleanup jobs" duration=26.531368ms Nov 3 08:13:30 kjcf05n00 mcfcli[3673891]: %3|1730643210.286|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:14:00 kjcf05n00 mcfcli[3673891]: %3|1730643240.286|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:14:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730643244}"] Nov 3 08:14:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730643244, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:14:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.13578ms Nov 3 08:14:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.13578ms Nov 3 08:14:04 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:14:04 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:14:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:14:04 kjcf05n00 mcfcli[3673891]: %3|1730643244.481|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:14:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730643244}"] Nov 3 08:14:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730643244, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:14:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.909907ms Nov 3 08:14:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.909907ms Nov 3 08:14:04 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:14:04 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:14:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:14:04 kjcf05n07 diskmonitor[19063]: Unable to send RAW command (channel=0x0 netfn=0x3c lun=0x0 cmd=0x33 rsp=0xc1): Invalid command Nov 3 08:14:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730643244}"] Nov 3 08:14:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730643244, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:14:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.068454ms Nov 3 08:14:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.068454ms Nov 3 08:14:04 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:14:04 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:14:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:14:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730643244}"] Nov 3 08:14:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730643244, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:14:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.03972ms Nov 3 08:14:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.03972ms Nov 3 08:14:04 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:14:04 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:14:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:14:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730643244}"] Nov 3 08:14:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730643244, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:14:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.791816ms Nov 3 08:14:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.791816ms Nov 3 08:14:04 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:14:04 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:14:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:14:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730643244}"] Nov 3 08:14:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730643244, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:14:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.190312ms Nov 3 08:14:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.190312ms Nov 3 08:14:05 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:14:05 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:14:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:14:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730643244}"] Nov 3 08:14:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730643244, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:14:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.282034ms Nov 3 08:14:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.282034ms Nov 3 08:14:05 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:14:05 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:14:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:14:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730643244}"] Nov 3 08:14:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730643244, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:14:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.971903ms Nov 3 08:14:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.971903ms Nov 3 08:14:05 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:14:05 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:14:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:14:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730643244}"] Nov 3 08:14:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730643244, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:14:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.060699ms Nov 3 08:14:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.060699ms Nov 3 08:14:05 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:14:05 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:14:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:14:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730643244}"] Nov 3 08:14:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730643244, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:14:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.755718ms Nov 3 08:14:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.755718ms Nov 3 08:14:05 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:14:05 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:14:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:14:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730643244}"] Nov 3 08:14:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730643244, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:14:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:14:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:14:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:14:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:14:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:14:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:14:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.880182ms Nov 3 08:14:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:14:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.880182ms Nov 3 08:14:05 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:14:05 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:14:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:14:06 kjcf05n00 zabbix-server[1093122]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:14:06 kjcf05n00 zabbix-server[1093122]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46001' Nov 3 08:14:06 kjcf05n00 zabbix-server[1093122]: Filesystem 'kjcf05' has been mounted Nov 3 08:14:07 kjcf05n00 zabbix-server[1093122]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 08:14:07 kjcf05n00 zabbix-server[1093122]: Running puppet on 'None' Nov 3 08:14:08 kjcf05n02 puppet-agent[50338]: Using configured environment 'production' Nov 3 08:14:08 kjcf05n02 puppet-agent[50338]: Retrieving pluginfacts Nov 3 08:14:08 kjcf05n02 puppet-agent[50338]: Retrieving plugin Nov 3 08:14:08 kjcf05n06 puppet-agent[2665715]: Using configured environment 'production' Nov 3 08:14:08 kjcf05n06 puppet-agent[2665715]: Retrieving pluginfacts Nov 3 08:14:08 kjcf05n06 puppet-agent[2665715]: Retrieving plugin Nov 3 08:14:08 kjcf05n03 puppet-agent[162627]: Using configured environment 'production' Nov 3 08:14:08 kjcf05n03 puppet-agent[162627]: Retrieving pluginfacts Nov 3 08:14:08 kjcf05n03 puppet-agent[162627]: Retrieving plugin Nov 3 08:14:09 kjcf05n07 puppet-agent[2663062]: Using configured environment 'production' Nov 3 08:14:09 kjcf05n07 puppet-agent[2663062]: Retrieving pluginfacts Nov 3 08:14:09 kjcf05n07 puppet-agent[2663062]: Retrieving plugin Nov 3 08:14:09 kjcf05n05 puppet-agent[2816881]: Using configured environment 'production' Nov 3 08:14:09 kjcf05n05 puppet-agent[2816881]: Retrieving pluginfacts Nov 3 08:14:09 kjcf05n05 puppet-agent[2816881]: Retrieving plugin Nov 3 08:14:09 kjcf05n05 puppet-agent[2816881]: Loading facts Nov 3 08:14:09 kjcf05n04 puppet-agent[2670711]: Using configured environment 'production' Nov 3 08:14:09 kjcf05n04 puppet-agent[2670711]: Retrieving pluginfacts Nov 3 08:14:09 kjcf05n04 puppet-agent[2670711]: Retrieving plugin Nov 3 08:14:09 kjcf05n04 puppet-agent[2670711]: Loading facts Nov 3 08:14:09 kjcf05n02 puppet-agent[50338]: Loading facts Nov 3 08:14:09 kjcf05n06 puppet-agent[2665715]: Loading facts Nov 3 08:14:09 kjcf05n03 puppet-agent[162627]: Loading facts Nov 3 08:14:09 kjcf05n01 puppet-agent[2986384]: Using configured environment 'production' Nov 3 08:14:09 kjcf05n01 puppet-agent[2986384]: Retrieving pluginfacts Nov 3 08:14:09 kjcf05n01 puppet-agent[2986384]: Retrieving plugin Nov 3 08:14:09 kjcf05n07 puppet-agent[2663062]: Loading facts Nov 3 08:14:09 kjcf05n00 puppet-agent[1093194]: Using configured environment 'production' Nov 3 08:14:09 kjcf05n00 puppet-agent[1093194]: Retrieving pluginfacts Nov 3 08:14:09 kjcf05n00 puppet-agent[1093194]: Retrieving plugin Nov 3 08:14:10 kjcf05n01 puppet-agent[2986384]: Loading facts Nov 3 08:14:10 kjcf05n07 diskmonitor[19063]: read_master_remote: unable to read master status: -1 Nov 3 08:14:10 kjcf05n07 diskmonitor[19063]: run_on_master: ntry=1/10, error getting remote master (2) Nov 3 08:14:09 kjcf05n00 puppet-agent[1093194]: Loading facts Nov 3 08:14:11 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 08:14:12 kjcf05n06 puppet-agent[2665715]: Caching catalog for kjcf05n06 Nov 3 08:14:12 kjcf05n06 puppet-agent[2665715]: Applying configuration version '1730643250' Nov 3 08:14:12 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 08:14:12 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 08:14:13 kjcf05n03 puppet-agent[162627]: Caching catalog for kjcf05n03 Nov 3 08:14:13 kjcf05n03 puppet-agent[162627]: Applying configuration version '1730643250' Nov 3 08:14:13 kjcf05n07 puppet-agent[2663062]: Caching catalog for kjcf05n07 Nov 3 08:14:13 kjcf05n07 puppet-agent[2663062]: Applying configuration version '1730643250' Nov 3 08:14:13 kjcf05n02 puppet-agent[50338]: Caching catalog for kjcf05n02 Nov 3 08:14:13 kjcf05n02 puppet-agent[50338]: Applying configuration version '1730643250' Nov 3 08:14:13 kjcf05n01 puppet-agent[2986384]: Caching catalog for kjcf05n01 Nov 3 08:14:14 kjcf05n01 puppet-agent[2986384]: Applying configuration version '1730643251' Nov 3 08:14:14 kjcf05n06 puppet-agent[2665715]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 08:14:14 kjcf05n06 puppet-agent[2665715]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 08:14:14 kjcf05n06 puppet-agent[2665715]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 08:14:14 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2613355]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 08:14:14 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 08:14:14 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 08:14:14 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 08:14:14 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 08:14:14 kjcf05n06 puppet-agent[2665715]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: Press Ctrl+C to exit. Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: Plugin support version 1.0 Nov 3 08:14:14 kjcf05n06 zabbix_agent2[2666107]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 08:14:14 kjcf05n00 puppet-agent[1093194]: Caching catalog for kjcf05n00 Nov 3 08:14:14 kjcf05n00 puppet-agent[1093194]: Applying configuration version '1730643252' Nov 3 08:14:15 kjcf05n03 puppet-agent[162627]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 08:14:15 kjcf05n03 puppet-agent[162627]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 08:14:15 kjcf05n03 puppet-agent[162627]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 08:14:15 kjcf05n07 puppet-agent[2663062]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 08:14:15 kjcf05n07 puppet-agent[2663062]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 08:14:15 kjcf05n07 puppet-agent[2663062]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 08:14:15 kjcf05n02 puppet-agent[50338]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 08:14:15 kjcf05n02 puppet-agent[50338]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 08:14:15 kjcf05n02 puppet-agent[50338]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 08:14:15 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 08:14:15 kjcf05n03 zabbix_agent2[106945]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 08:14:15 kjcf05n03 zabbix_agent2[3176]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 08:14:15 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 08:14:15 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 08:14:15 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 08:14:15 kjcf05n03 puppet-agent[162627]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: Press Ctrl+C to exit. Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: Plugin support version 1.0 Nov 3 08:14:15 kjcf05n03 zabbix_agent2[162985]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 08:14:15 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 08:14:15 kjcf05n02 zabbix_agent2[5976]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 08:14:15 kjcf05n02 zabbix_agent2[3140]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:14:15 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 08:14:15 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 08:14:15 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 08:14:15 kjcf05n02 puppet-agent[50338]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: Press Ctrl+C to exit. Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: Plugin support version 1.0 Nov 3 08:14:15 kjcf05n02 zabbix_agent2[50721]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 08:14:16 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2610791]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 08:14:16 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 08:14:16 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 08:14:16 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 08:14:16 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 08:14:16 kjcf05n07 puppet-agent[2663062]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: Press Ctrl+C to exit. Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: Plugin support version 1.0 Nov 3 08:14:16 kjcf05n07 zabbix_agent2[2663552]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 08:14:16 kjcf05n06 puppet-agent[2665715]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 08:14:16 kjcf05n06 puppet-agent[2665715]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 08:14:16 kjcf05n06 puppet-agent[2665715]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 08:14:16 kjcf05n01 puppet-agent[2986384]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 08:14:16 kjcf05n01 puppet-agent[2986384]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-07:54:16]/mode) mode changed '0755' to '0750' Nov 3 08:14:16 kjcf05n01 puppet-agent[2986384]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-07:54:16/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 08:14:16 kjcf05n01 puppet-agent[2986384]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-07:54:16/vmcore]/mode) mode changed '0600' to '0640' Nov 3 08:14:16 kjcf05n01 puppet-agent[2986384]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-07:54:16/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 08:14:16 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 08:14:16 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 08:14:16 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 08:14:17 kjcf05n06 puppet-agent[2665715]: Applied catalog in 4.78 seconds Nov 3 08:14:18 kjcf05n01 puppet-agent[2986384]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 08:14:18 kjcf05n01 puppet-agent[2986384]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 08:14:18 kjcf05n01 puppet-agent[2986384]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 08:14:17 kjcf05n00 puppet-agent[1093194]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 08:14:18 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2974359]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 08:14:18 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 08:14:18 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 08:14:18 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 08:14:18 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 08:14:18 kjcf05n01 puppet-agent[2986384]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: Press Ctrl+C to exit. Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: Plugin support version 1.0 Nov 3 08:14:18 kjcf05n01 zabbix_agent2[2986804]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 08:14:18 kjcf05n02 puppet-agent[50338]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 08:14:18 kjcf05n02 puppet-agent[50338]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 08:14:18 kjcf05n02 puppet-agent[50338]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 08:14:18 kjcf05n03 puppet-agent[162627]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 08:14:18 kjcf05n03 puppet-agent[162627]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 08:14:18 kjcf05n03 puppet-agent[162627]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 08:14:19 kjcf05n07 puppet-agent[2663062]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 08:14:19 kjcf05n07 puppet-agent[2663062]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 08:14:19 kjcf05n07 puppet-agent[2663062]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 08:14:19 kjcf05n07 puppet-agent[2663062]: Applied catalog in 6.12 seconds Nov 3 08:14:19 kjcf05n03 puppet-agent[162627]: Applied catalog in 6.21 seconds Nov 3 08:14:19 kjcf05n02 puppet-agent[50338]: Applied catalog in 6.18 seconds Nov 3 08:14:19 kjcf05n00 puppet-agent[1093194]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 08:14:19 kjcf05n00 puppet-agent[1093194]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 08:14:19 kjcf05n00 puppet-agent[1093194]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 08:14:20 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1074743]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 08:14:20 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 08:14:20 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 08:14:20 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 08:14:20 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 08:14:20 kjcf05n00 puppet-agent[1093194]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: Press Ctrl+C to exit. Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: Plugin support version 1.0 Nov 3 08:14:20 kjcf05n00 zabbix_agent2[1093780]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 08:14:20 kjcf05n00 zabbix-server[1093805]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:14:21 kjcf05n01 puppet-agent[2986384]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_080135.log]/mode) mode changed '0644' to '0640' Nov 3 08:14:21 kjcf05n01 puppet-agent[2986384]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_081318.log]/mode) mode changed '0644' to '0640' Nov 3 08:14:21 kjcf05n01 puppet-agent[2986384]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_081318]/mode) mode changed '0755' to '0750' Nov 3 08:14:21 kjcf05n01 puppet-agent[2986384]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_081318/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 08:14:21 kjcf05n00 zabbix-server[1093808]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:14:21 kjcf05n00 zabbix-server[1093816]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:14:22 kjcf05n01 puppet-agent[2986384]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_080135.log]/mode) mode changed '0644' to '0640' Nov 3 08:14:22 kjcf05n01 puppet-agent[2986384]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_081318.log]/mode) mode changed '0644' to '0640' Nov 3 08:14:22 kjcf05n01 puppet-agent[2986384]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 08:14:22 kjcf05n01 puppet-agent[2986384]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 08:14:22 kjcf05n01 puppet-agent[2986384]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 08:14:21 kjcf05n00 zabbix-server[1093818]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:14:22 kjcf05n00 puppet-agent[1093194]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 08:14:23 kjcf05n01 puppet-agent[2986384]: Applied catalog in 9.61 seconds Nov 3 08:14:23 kjcf05n00 puppet-agent[1093194]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 08:14:23 kjcf05n00 puppet-agent[1093194]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 08:14:23 kjcf05n00 puppet-agent[1093194]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 08:14:24 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 08:14:24 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 08:14:24 kjcf05n00 puppet-agent[1093194]: Applied catalog in 9.82 seconds Nov 3 08:14:25 kjcf05n05 puppet-agent[2816881]: Caching catalog for kjcf05n05 Nov 3 08:14:25 kjcf05n05 puppet-agent[2816881]: Applying configuration version '1730643261' Nov 3 08:14:27 kjcf05n05 puppet-agent[2816881]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 08:14:27 kjcf05n05 puppet-agent[2816881]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 08:14:27 kjcf05n05 puppet-agent[2816881]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 08:14:28 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2759695]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 08:14:28 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 08:14:28 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 08:14:28 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 08:14:28 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 08:14:28 kjcf05n05 puppet-agent[2816881]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: Press Ctrl+C to exit. Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: Plugin support version 1.0 Nov 3 08:14:28 kjcf05n05 zabbix_agent2[2817893]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 08:14:30 kjcf05n05 puppet-agent[2816881]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 08:14:30 kjcf05n05 puppet-agent[2816881]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 08:14:30 kjcf05n05 puppet-agent[2816881]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 08:14:30 kjcf05n00 mcfcli[3673891]: %3|1730643270.286|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:14:30 kjcf05n05 puppet-agent[2816881]: Applied catalog in 5.03 seconds Nov 3 08:14:43 kjcf05n00 mcfcli[3673891]: %3|1730643283.007|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:15:00 kjcf05n00 mcfcli[3673891]: %3|1730643300.288|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:15:01 kjcf05n04 puppet-agent[2670711]: Caching catalog for kjcf05n04 Nov 3 08:15:01 kjcf05n04 puppet-agent[2670711]: Applying configuration version '1730643298' Nov 3 08:15:03 kjcf05n04 puppet-agent[2670711]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 08:15:03 kjcf05n04 puppet-agent[2670711]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 08:15:03 kjcf05n04 puppet-agent[2670711]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 08:15:03 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2613081]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 08:15:03 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 08:15:03 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 08:15:03 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 08:15:03 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 08:15:03 kjcf05n04 puppet-agent[2670711]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: Press Ctrl+C to exit. Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: Plugin support version 1.0 Nov 3 08:15:03 kjcf05n04 zabbix_agent2[2672609]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 08:15:05 kjcf05n04 puppet-agent[2670711]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 08:15:05 kjcf05n04 puppet-agent[2670711]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 08:15:05 kjcf05n04 puppet-agent[2670711]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 08:15:05 kjcf05n00 zabbix-server[1093122]: puppet completed status:(0): '' Nov 3 08:15:05 kjcf05n00 zabbix-server[1093122]: Event '46001' acknowledged Nov 3 08:15:05 kjcf05n00 zabbix-server[1093122]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 3 08:15:06 kjcf05n04 puppet-agent[2670711]: Applied catalog in 4.84 seconds Nov 3 08:15:05 kjcf05n00 python3.9[1094322]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 08:15:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730643319', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 08:15:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730643319'} Nov 3 08:15:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:15:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730643319', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 08:15:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730643319'} Nov 3 08:15:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:15:19 kjcf05n00 mcfcli[3673891]: %3|1730643319.245|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:15:30 kjcf05n00 mcfcli[3673891]: %3|1730643330.288|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 08:15:58 kjcf05n00 mcfcli[3673891]: %3|1730643358.339|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:16:00 kjcf05n00 mcfcli[3673891]: %3|1730643360.289|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 08:16:30 kjcf05n00 mcfcli[3673891]: %3|1730643390.289|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 08:16:35 kjcf05n00 mcfcli[3673891]: %3|1730643395.986|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:17:00 kjcf05n00 mcfcli[3673891]: %3|1730643420.290|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:17:15 kjcf05n00 mcfcli[3673891]: %3|1730643435.983|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:17:30 kjcf05n00 mcfcli[3673891]: %3|1730643450.290|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:17:37 kjcf05n02 dwd[5168]: nvme19n1 passed periodic SMART status check Nov 3 08:17:37 kjcf05n02 dwd[5168]: nvme18n1 passed periodic SMART status check Nov 3 08:17:37 kjcf05n02 dwd[5168]: nvme2n1 passed periodic SMART status check Nov 3 08:17:37 kjcf05n02 dwd[5168]: nvme3n1 passed periodic SMART status check Nov 3 08:17:37 kjcf05n02 dwd[5168]: nvme9n1 passed periodic SMART status check Nov 3 08:17:38 kjcf05n02 dwd[5168]: nvme17n1 passed periodic SMART status check Nov 3 08:17:38 kjcf05n02 dwd[5168]: nvme24n1 passed periodic SMART status check Nov 3 08:17:38 kjcf05n02 dwd[5168]: nvme25n1 passed periodic SMART status check Nov 3 08:17:38 kjcf05n02 dwd[5168]: nvme23n1 passed periodic SMART status check Nov 3 08:17:38 kjcf05n02 dwd[5168]: nvme4n1 passed periodic SMART status check Nov 3 08:17:38 kjcf05n02 dwd[5168]: nvme8n1 passed periodic SMART status check Nov 3 08:17:55 kjcf05n00 mcfcli[3673891]: %3|1730643475.980|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:18:00 kjcf05n00 mcfcli[3673891]: %3|1730643480.290|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:18:30 kjcf05n00 mcfcli[3673891]: %3|1730643510.291|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:18:35 kjcf05n00 mcfcli[3673891]: %3|1730643515.918|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:19:00 kjcf05n00 mcfcli[3673891]: %3|1730643540.292|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:19:15 kjcf05n00 mcfcli[3673891]: %3|1730643555.915|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:19:30 kjcf05n00 mcfcli[3673891]: %3|1730643570.292|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:19:53 kjcf05n00 mcfcli[3673891]: %3|1730643593.444|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 08:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 08:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 08:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 08:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 08:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 08:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 08:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 08:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 08:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 08:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 08:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 08:20:00 kjcf05n00 mcfcli[3673891]: %3|1730643600.293|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 08:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 08:20:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 08:20:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:20:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 08:20:06 kjcf05n00 python3.9[1097133]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 08:20:30 kjcf05n00 mcfcli[3673891]: %3|1730643630.293|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 08:20:33 kjcf05n00 mcfcli[3673891]: %3|1730643633.441|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:21:00 kjcf05n00 mcfcli[3673891]: %3|1730643660.294|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:21:11 kjcf05n00 mcfcli[3673891]: %3|1730643671.033|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:21:30 kjcf05n00 mcfcli[3673891]: %3|1730643690.294|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 08:21:49 kjcf05n00 mcfcli[3673891]: %3|1730643709.512|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:22:00 kjcf05n00 mcfcli[3673891]: %3|1730643720.294|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:22:29 kjcf05n00 mcfcli[3673891]: %3|1730643749.324|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:22:30 kjcf05n00 mcfcli[3673891]: %3|1730643750.294|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 08:23:00 kjcf05n00 mcfcli[3673891]: %3|1730643780.295|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:23:06 kjcf05n00 mcfcli[3673891]: %3|1730643786.150|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T14:23:15.868212Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 08:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T14:23:15.868277Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.088ms Nov 3 08:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T08:23:27.253102063-06:00 level=info msg="Completed cleanup jobs" duration=26.176674ms Nov 3 08:23:30 kjcf05n00 mcfcli[3673891]: %3|1730643810.295|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 08:23:40 kjcf05n00 mcfcli[3673891]: %3|1730643820.852|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:24:00 kjcf05n00 mcfcli[3673891]: %3|1730643840.295|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:24:09 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 3 08:24:09 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 8 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007816 sec, idle for 1 hour(s)] Nov 3 08:24:18 kjcf05n00 mcfcli[3673891]: %3|1730643858.672|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:24:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 08:24:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 08:24:23 kjcf05n00 zabbix_server[15764]: Zabbix agent item "vfs.fs.size[/etc/ganesha,total]" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 3 08:24:23 kjcf05n00 zabbix_server[15751]: Zabbix agent item "dcs.lustre.device.discovery[{$LUSTRE_FS_NAME},mdt]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 3 08:24:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 08:24:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 08:24:29 kjcf05n03 fstonithd.py[15381]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 3 08:24:29 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 08:24:29 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 08:24:29 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 08:24:30 kjcf05n00 mcfcli[3673891]: %3|1730643870.296|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:24:31 kjcf05n03 root[179723]: is_enc_ipmi_off starts Nov 3 08:24:31 kjcf05n03 root[179724]: is_viking_off starts Nov 3 08:24:31 kjcf05n03 root[179740]: is_lan_ipmi_off leaves Nov 3 08:24:31 kjcf05n03 root[179742]: is_lan_ipmi_sec_off leaves Nov 3 08:24:31 kjcf05n03 root[179745]: I am master Nov 3 08:24:31 kjcf05n03 root[179748]: I am in slot 1; partner is in slot 0 Nov 3 08:24:36 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='135', error='Connection reset by peer (104)' Nov 3 08:24:36 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='135', client='AF_INET(172.16.2.5:45399)', local='AF_INET(0.0.0.0:601)' Nov 3 08:24:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 08:24:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 08:24:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 08:24:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 08:24:38 kjcf05n03 root[179841]: is_viking_off leaves Nov 3 08:24:38 kjcf05n03 root[179844]: kjcf05n02 not already off look at kdump Nov 3 08:24:38 kjcf05n03 root[179845]: is_kdump_off starts Nov 3 08:24:38 kjcf05n03 fence_kdump[179846]: waiting for message from '172.16.2.5' Nov 3 08:24:38 kjcf05n03 fence_kdump[179846]: received valid message from '172.16.2.5' Nov 3 08:24:38 kjcf05n03 root[179860]: is_kdump_off detected kdump on kjcf05n02 Nov 3 08:24:38 kjcf05n03 root[179861]: kjcf05n02 is kdumping Nov 3 08:24:38 kjcf05n03 root[179958]: is_viking_off starts Nov 3 08:24:38 kjcf05n03 root[179957]: is_enc_ipmi_off starts Nov 3 08:24:38 kjcf05n00 zabbix_server[15718]: Zabbix agent item "vm.memory.size[total]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 08:24:38 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0000,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 08:24:38 kjcf05n03 root[179994]: is_lan_ipmi_off leaves Nov 3 08:24:38 kjcf05n03 root[179998]: I am master Nov 3 08:24:38 kjcf05n03 root[179999]: is_lan_ipmi_sec_off leaves Nov 3 08:24:38 kjcf05n03 root[180002]: I am in slot 1; partner is in slot 0 Nov 3 08:24:45 kjcf05n03 root[180166]: is_viking_off leaves Nov 3 08:24:45 kjcf05n03 root[180169]: kjcf05n02 not already off look at kdump Nov 3 08:24:45 kjcf05n03 root[180170]: is_kdump_off starts Nov 3 08:24:45 kjcf05n03 fence_kdump[180171]: waiting for message from '172.16.2.5' Nov 3 08:24:45 kjcf05n03 fence_kdump[180171]: received valid message from '172.16.2.5' Nov 3 08:24:45 kjcf05n03 root[180189]: is_kdump_off detected kdump on kjcf05n02 Nov 3 08:24:45 kjcf05n03 root[180190]: kjcf05n02 is kdumping Nov 3 08:24:46 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 08:24:46 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 08:24:49 kjcf05n03 systemd-udevd[182505]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182506]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182509]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182510]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182505]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182506]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182509]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182510]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182505]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182506]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182509]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182510]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182505]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182506]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182509]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182510]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182506]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182505]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182525]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182509]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182529]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182510]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182531]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182505]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182506]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182534]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182509]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182525]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182529]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182510]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182505]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182534]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182506]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182509]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182525]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182529]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182505]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182510]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182506]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182509]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182525]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182529]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182505]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182525]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182509]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182529]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182506]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182505]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182529]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182509]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182525]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182506]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182529]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182529]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182525]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182529]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182529]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182525]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182529]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182525]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182529]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182525]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182529]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 systemd-udevd[182529]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:24:49 kjcf05n03 dwd[5195]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 08:24:49 kjcf05n03 dwd[5195]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 08:24:49 kjcf05n03 dwd[5195]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 08:24:49 kjcf05n03 dwd[5195]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 08:24:49 kjcf05n03 dwd[5195]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 08:24:49 kjcf05n03 dwd[5195]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 08:24:49 kjcf05n03 dwd[5195]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 08:24:49 kjcf05n03 dwd[5195]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 08:24:49 kjcf05n03 dwd[5195]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 08:24:49 kjcf05n03 dwd[5195]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 08:24:49 kjcf05n03 dwd[5195]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 08:24:49 kjcf05n03 dwd[5195]: Starting NVME thread for nvme2n1 Nov 3 08:24:50 kjcf05n03 dwd[5195]: Starting NVME thread for nvme8n1 Nov 3 08:24:50 kjcf05n03 dwd[5195]: Starting NVME thread for nvme24n1 Nov 3 08:24:50 kjcf05n03 dwd[5195]: Starting NVME thread for nvme17n1 Nov 3 08:24:50 kjcf05n03 dwd[5195]: Starting NVME thread for nvme3n1 Nov 3 08:24:50 kjcf05n03 dwd[5195]: Starting NVME thread for nvme25n1 Nov 3 08:24:51 kjcf05n03 dwd[5195]: Starting NVME thread for nvme19n1 Nov 3 08:24:51 kjcf05n03 dwd[5195]: Starting NVME thread for nvme4n1 Nov 3 08:24:51 kjcf05n03 dwd[5195]: Starting NVME thread for nvme18n1 Nov 3 08:24:51 kjcf05n03 dwd[5195]: Starting NVME thread for nvme23n1 Nov 3 08:24:51 kjcf05n03 dwd[5195]: Starting NVME thread for nvme9n1 Nov 3 08:24:53 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0002,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 08:24:53 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.localtime" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 08:24:54 kjcf05n00 mcfcli[3673891]: %3|1730643894.110|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:24:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 08:24:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 08:24:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 08:24:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 08:24:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 08:24:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 08:25:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 08:25:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 08:25:00 kjcf05n00 mcfcli[3673891]: %3|1730643900.296|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 08:25:02 kjcf05n03 diskmonitor[17713]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 08:25:04 kjcf05n00 python3.9[1100083]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 08:25:08 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 3 08:25:08 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 3 08:25:15 kjcf05n03 diskmonitor[17713]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 08:25:15 kjcf05n03 diskmonitor[17713]: Scan for ReadErrorMax change for md65 Nov 3 08:25:15 kjcf05n03 diskmonitor[17713]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 08:25:15 kjcf05n03 diskmonitor[17713]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 08:25:15 kjcf05n03 diskmonitor[17713]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.min.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 08:25:15 kjcf05n03 diskmonitor[17713]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.max.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 08:25:15 kjcf05n03 diskmonitor[17713]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 08:25:15 kjcf05n03 diskmonitor[17713]: Set sync_speed_min (10000) for md65 Nov 3 08:25:15 kjcf05n03 diskmonitor[17713]: Set sync_speed_max (200000) for md65 Nov 3 08:25:15 kjcf05n03 diskmonitor[17713]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 08:25:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 08:25:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 08:25:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 08:25:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 08:25:30 kjcf05n00 mcfcli[3673891]: %3|1730643930.297|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 08:25:34 kjcf05n00 mcfcli[3673891]: %3|1730643934.107|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 08:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 08:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 08:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 08:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 08:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 08:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 08:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 08:25:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 08:25:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 08:25:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 08:25:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 08:26:00 kjcf05n00 mcfcli[3673891]: %3|1730643960.298|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 08:26:00 kjcf05n03 nslcd[6947]: ldap_result() failed: Can't contact LDAP server Nov 3 08:26:14 kjcf05n00 mcfcli[3673891]: %3|1730643974.104|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:26:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 08:26:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 08:26:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 08:26:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 08:26:30 kjcf05n00 mcfcli[3673891]: %3|1730643990.298|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 08:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 08:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 08:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 08:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 08:26:49 kjcf05n00 mcfcli[3673891]: %3|1730644009.098|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 08:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 08:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 08:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 08:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 08:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 08:26:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 08:26:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 08:27:00 kjcf05n00 mcfcli[3673891]: %3|1730644020.300|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 08:27:11 kjcf05n00 zabbix-server[1101590]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:27:11 kjcf05n00 zabbix-server[1101590]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 08:27:11 kjcf05n00 log_interesting_event.py[1101590]: Event '46004' acknowledged Nov 3 08:27:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 08:27:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 08:27:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 08:27:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 08:27:29 kjcf05n00 mcfcli[3673891]: %3|1730644049.021|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:27:30 kjcf05n00 mcfcli[3673891]: %3|1730644050.300|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 08:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 08:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 08:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 08:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 08:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 08:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 08:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 08:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 08:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 08:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 08:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 08:28:00 kjcf05n00 mcfcli[3673891]: %3|1730644080.300|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:28:08 kjcf05n00 mcfcli[3673891]: %3|1730644088.408|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:28:16 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 3 08:28:16 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 08:28:20 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 08:28:20 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 3 08:28:20 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 3 08:28:20 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 08:28:20 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 08:28:20 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 3 08:28:20 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 3 08:28:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 08:28:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 08:28:23 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 3 08:28:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 08:28:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 08:28:30 kjcf05n00 mcfcli[3673891]: %3|1730644110.300|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:28:31 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 3 08:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 08:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 08:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 08:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 08:28:47 kjcf05n00 mcfcli[3673891]: %3|1730644127.463|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 08:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 08:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 08:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 08:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 08:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 08:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 08:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 08:29:00 kjcf05n00 mcfcli[3673891]: %3|1730644140.300|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:29:18 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:45950). Nov 3 08:29:18 kjcf05n01 rsyncd[2992654]: connect from kjcf05n02 (172.16.2.5) Nov 3 08:29:18 kjcf05n01 rsyncd[2992654]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 08:29:18 kjcf05n01 rsyncd[2992654]: building file list Nov 3 08:29:18 kjcf05n01 rsyncd[2992654]: sent 11450 bytes received 136 bytes total size 10905 Nov 3 08:29:18 kjcf05n01 systemd[1]: rsyncd@611-172.16.2.2:873-172.16.2.5:45950.service: Succeeded. Nov 3 08:29:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 08:29:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 08:29:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 08:29:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 08:29:26 kjcf05n00 mcfcli[3673891]: %3|1730644166.790|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:29:29 kjcf05n03 fstonithd.py[15381]: Listening for kdump packets from partner Nov 3 08:29:30 kjcf05n00 mcfcli[3673891]: %3|1730644170.300|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 08:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 08:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 08:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 08:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 08:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 08:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 08:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 08:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 08:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 08:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 08:30:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 08:30:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 08:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 08:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 08:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 08:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 08:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 08:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 08:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 08:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 08:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 08:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 08:30:00 kjcf05n00 mcfcli[3673891]: %3|1730644200.302|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 08:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 08:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 08:30:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 08:30:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:30:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 08:30:02 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 08:30:04 kjcf05n03 dwd[5195]: nvme2n1 passed periodic SMART status check Nov 3 08:30:04 kjcf05n00 mcfcli[3673891]: %3|1730644204.337|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:30:05 kjcf05n03 dwd[5195]: nvme8n1 passed periodic SMART status check Nov 3 08:30:05 kjcf05n03 dwd[5195]: nvme3n1 passed periodic SMART status check Nov 3 08:30:05 kjcf05n03 dwd[5195]: nvme24n1 passed periodic SMART status check Nov 3 08:30:05 kjcf05n03 dwd[5195]: nvme25n1 passed periodic SMART status check Nov 3 08:30:05 kjcf05n03 dwd[5195]: nvme17n1 passed periodic SMART status check Nov 3 08:30:06 kjcf05n03 dwd[5195]: nvme4n1 passed periodic SMART status check Nov 3 08:30:06 kjcf05n03 dwd[5195]: nvme18n1 passed periodic SMART status check Nov 3 08:30:06 kjcf05n03 dwd[5195]: nvme19n1 passed periodic SMART status check Nov 3 08:30:06 kjcf05n03 dwd[5195]: nvme9n1 passed periodic SMART status check Nov 3 08:30:06 kjcf05n03 dwd[5195]: nvme23n1 passed periodic SMART status check Nov 3 08:30:06 kjcf05n00 python3.9[1103066]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 08:30:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730644219', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 08:30:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730644219'} Nov 3 08:30:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:30:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730644219', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 08:30:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730644219'} Nov 3 08:30:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:30:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 08:30:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 08:30:25 kjcf05n01 diskmonitor[1331407]: leaving test state: 1 next state: 2 Nov 3 08:30:25 kjcf05n01 diskmonitor[1331407]: lock req: no timeout Nov 3 08:30:25 kjcf05n01 diskmonitor[1331407]: leaving test state: 2 next state: 4 Nov 3 08:30:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 08:30:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 08:30:27 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 08:30:30 kjcf05n00 mcfcli[3673891]: %3|1730644230.801|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 08:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 08:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 08:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 08:30:43 kjcf05n00 mcfcli[3673891]: %3|1730644243.919|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:30:45 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='13', client='AF_INET(172.16.2.5:34773)', local='AF_INET(0.0.0.0:601)' Nov 3 08:30:45 kjcf05n02 syslog-ng[3159]: Configuration reload request received, reloading configuration; Nov 3 08:30:45 kjcf05n02 syslog-ng[3159]: Configuration reload finished; Nov 3 08:30:45 kjcf05n02 syslog-ng[3159]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 08:30:45 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 3 08:30:45 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 08:30:45 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 3 08:30:45 kjcf05n02 dracut: Self testing crypto algorithms Nov 3 08:30:45 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 3 08:30:45 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 08:30:45 kjcf05n02 Copying live image to RAM... Nov 3 08:30:45 kjcf05n02 (this may take a minute) Nov 3 08:30:45 kjcf05n02 Done copying live image to RAM. Nov 3 08:30:45 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 08:30:45 kjcf05n02 dracut: Checking integrity of kernel Nov 3 08:30:45 kjcf05n02 dracut: All initrd crypto checks done Nov 3 08:30:45 kjcf05n02 dracut: Switching root Nov 3 08:30:45 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 08:30:45 kjcf05n02 systemd: Detected architecture x86-64. Nov 3 08:30:45 kjcf05n02 systemd: Set hostname to . Nov 3 08:30:45 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 08:30:45 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 08:30:45 kjcf05n02 systemd: Listening on Journal Socket (/dev/log). Nov 3 08:30:45 kjcf05n02 systemd: Created slice system-serial\x2dgetty.slice. Nov 3 08:30:45 kjcf05n02 systemd: Reached target rpc_pipefs.target. Nov 3 08:30:45 kjcf05n02 systemd: Listening on Process Core Dump Socket. Nov 3 08:30:45 kjcf05n02 systemd: Listening on udev Control Socket. Nov 3 08:30:45 kjcf05n02 systemd-journald[1538]: Journal started Nov 3 08:30:45 kjcf05n02 systemd-journald[1538]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 08:30:45 kjcf05n02 systemd-modules-load[1523]: Inserted module 'fuse' Nov 3 08:30:45 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Create System Users. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 3 08:30:45 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 08:30:45 kjcf05n02 systemd-sysctl[1556]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 08:30:45 kjcf05n02 systemd-sysctl[1556]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 3 08:30:45 kjcf05n02 systemd-tmpfiles[1559]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 08:30:45 kjcf05n02 systemd-tmpfiles[1559]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 08:30:45 kjcf05n02 systemd-journald[1538]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 3 08:30:45 kjcf05n02 systemd-udevd[1569]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 3 08:30:45 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 3 08:30:45 kjcf05n02 systemd-udevd[1643]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:30:45 kjcf05n02 systemd-udevd[1613]: Using default interface naming scheme 'rhel-8.0'. Nov 3 08:30:45 kjcf05n02 systemd-udevd[1613]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:30:45 kjcf05n02 systemd-udevd[1637]: Using default interface naming scheme 'rhel-8.0'. Nov 3 08:30:45 kjcf05n02 systemd-udevd[1637]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:30:45 kjcf05n02 systemd-udevd[1604]: Using default interface naming scheme 'rhel-8.0'. Nov 3 08:30:45 kjcf05n02 systemd-udevd[1604]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 08:30:45 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 3 08:30:45 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 08:30:45 kjcf05n02 systemd-tmpfiles[1777]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 08:30:45 kjcf05n02 systemd-tmpfiles[1777]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 08:30:45 kjcf05n02 systemd-tmpfiles[1777]: "/var/tmp" already exists and is not a directory. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 08:30:45 kjcf05n02 root[1805]: openibd: running in auto mode Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started RPC Bind. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 08:30:45 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 08:30:45 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 08:30:45 kjcf05n02 systemd-modules-load[1868]: Inserted module 'ib_iser' Nov 3 08:30:45 kjcf05n02 systemd-modules-load[1868]: Inserted module 'ib_isert' Nov 3 08:30:45 kjcf05n02 systemd-modules-load[1868]: Inserted module 'ib_srpt' Nov 3 08:30:45 kjcf05n02 systemd-udevd[1643]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:30:45 kjcf05n02 systemd-udevd[1594]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:30:45 kjcf05n02 systemd-modules-load[1870]: Inserted module 'ib_ipoib' Nov 3 08:30:45 kjcf05n02 systemd-modules-load[1868]: Inserted module 'rdma_ucm' Nov 3 08:30:45 kjcf05n02 systemd-modules-load[1868]: Module 'svcrdma' is blacklisted Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 08:30:45 kjcf05n02 systemd-udevd[1594]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 08:30:45 kjcf05n02 systemd-udevd[1643]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 08:30:45 kjcf05n02 systemd-modules-load[1870]: Inserted module 'ib_umad' Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 08:30:45 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 08:30:45 kjcf05n02 systemd[3159]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:30:45 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 08:30:45 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 3 08:30:45 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 3 08:30:45 kjcf05n02 openibd[1793]: Loading HCA driver and Access Layer:[ OK ] Nov 3 08:30:45 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Update is Completed. Nov 3 08:30:45 kjcf05n02 setup-icl[1772]: Setting LAN IP Address to 203.0.113.3 Nov 3 08:30:45 kjcf05n02 setup-icl[1772]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 08:30:45 kjcf05n02 setup-icl[1772]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 08:30:45 kjcf05n02 setup-icl[1772]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 08:30:45 kjcf05n02 systemd-udevd[1643]: Using default interface naming scheme 'rhel-8.0'. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 08:30:45 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 3 08:30:45 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 08:30:45 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 08:30:45 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 08:30:45 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 08:30:45 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 08:30:45 kjcf05n02 systemd[1]: Reached target Sockets. Nov 3 08:30:45 kjcf05n02 systemd[1]: Reached target Basic System. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 08:30:45 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 3 08:30:45 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 08:30:45 kjcf05n02 nscd[2120]: 2120 monitoring file `/etc/hosts` (1) Nov 3 08:30:45 kjcf05n02 nscd[2120]: 2120 monitoring directory `/etc` (2) Nov 3 08:30:45 kjcf05n02 nscd[2120]: 2120 monitoring file `/etc/resolv.conf` (3) Nov 3 08:30:45 kjcf05n02 nscd[2120]: 2120 monitoring directory `/etc` (2) Nov 3 08:30:45 kjcf05n02 dwd[2113]: dwd: vMay 29 2024 : 15:38:26 Nov 3 08:30:45 kjcf05n02 dwd[2113]: /usr/sbin/dwd -d --standalone=0 Nov 3 08:30:45 kjcf05n02 dwd[2113]: dwd: option Lethal: 0 Nov 3 08:30:45 kjcf05n02 dwd[2113]: dwd: option Interval: 60 Nov 3 08:30:45 kjcf05n02 dwd[2113]: dwd: option abrtlimit: 10 Nov 3 08:30:45 kjcf05n02 dwd[2113]: dwd: option DZPeriod: 604800 Nov 3 08:30:45 kjcf05n02 dwd[2113]: dwd: option SmartPeriod: 43200 Nov 3 08:30:45 kjcf05n02 dwd[2113]: dwd: option SDDEnabled: 1 Nov 3 08:30:45 kjcf05n02 dwd[2113]: dwd: option SDDAwaitScale: 3 Nov 3 08:30:45 kjcf05n02 dwd[2113]: dwd: option SDDAwaitMin: 100 Nov 3 08:30:45 kjcf05n02 dwd[2113]: dwd: option Verbosity: 1 Nov 3 08:30:45 kjcf05n02 dwd[2113]: dwd: option StandAlone: 0 Nov 3 08:30:45 kjcf05n02 dwd[2113]: option Lethal: 0 Nov 3 08:30:45 kjcf05n02 dwd[2113]: option Interval: 60 Nov 3 08:30:45 kjcf05n02 dwd[2113]: option abrtlimit: 10 Nov 3 08:30:45 kjcf05n02 dwd[2113]: option DZPeriod: 604800 Nov 3 08:30:45 kjcf05n02 dwd[2113]: option SmartPeriod: 43200 Nov 3 08:30:45 kjcf05n02 dwd[2113]: option SDDEnabled: 1 Nov 3 08:30:45 kjcf05n02 dwd[2113]: option SDDAwaitScale: 3 Nov 3 08:30:45 kjcf05n02 dwd[2113]: option SDDAwaitMin: 100 Nov 3 08:30:45 kjcf05n02 dwd[2113]: option Verbosity: 1 Nov 3 08:30:45 kjcf05n02 dwd[2113]: option StandAlone: 0 Nov 3 08:30:45 kjcf05n02 mcelog[2115]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 08:30:45 kjcf05n02 mcelog[2115]: CPU is unsupported Nov 3 08:30:45 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[2141]: Setting up Mellanox network interface: ib0 Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 0 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 1 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 2 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 3 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 4 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 5 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 6 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 7 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 8 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 9 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 10 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 11 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 12 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 13 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 14 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 15 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 16 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 17 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 18 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 19 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 20 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 21 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 22 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 23 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 24 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 25 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 26 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 27 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 28 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 29 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 30 Nov 3 08:30:45 kjcf05n02 cpupower[2163]: Setting cpu: 31 Nov 3 08:30:45 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 08:30:45 kjcf05n02 chronyd[2175]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 08:30:45 kjcf05n02 dbus-daemon[2139]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 08:30:45 kjcf05n02 network[2186]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[2185]: Setting up Mellanox network interface: ib1 Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 08:30:45 kjcf05n02 network[2223]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 08:30:45 kjcf05n02 network[2186]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:30:45 kjcf05n02 beSetMlxConfig[2213]: ConnectX-3 multiport not detected Nov 3 08:30:45 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 08:30:45 kjcf05n02 chronyd[2175]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 08:30:45 kjcf05n02 chronyd[2175]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[2228]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 08:30:45 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 08:30:45 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 3 08:30:45 kjcf05n02 network[2258]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:30:45 kjcf05n02 network[2186]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 08:30:45 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 08:30:45 kjcf05n02 mdraid-phy[2233]: no Cutlass to worry about Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 3 08:30:45 kjcf05n02 sssd[sssd][2111]: Starting up Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[2261]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[2270]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 08:30:45 kjcf05n02 network[2271]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 0 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 1 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 2 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 3 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 4 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 5 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 6 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 7 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 8 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 9 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 10 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 11 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 12 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 13 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 14 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 15 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 16 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 17 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 18 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 19 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 20 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 21 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 22 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 23 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 24 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 25 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 26 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 27 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 28 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 29 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 30 Nov 3 08:30:45 kjcf05n02 cpupower[2290]: Idlestate 2 disabled on CPU 31 Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 08:30:45 kjcf05n02 dbus-daemon[2139]: [system] Successfully activated service 'org.freedesktop.systemd1' Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[2288]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[2296]: No configuration found for ib0 Nov 3 08:30:45 kjcf05n02 beSetMlxConfig[2213]: Starting MST (Mellanox Software Tools) driver set Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[2311]: No configuration found for ib1 Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[2317]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 08:30:45 kjcf05n02 beSetMlxConfig[2213]: Loading MST PCI module - Success Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[2326]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 08:30:45 kjcf05n02 beSetMlxConfig[2213]: Loading MST PCI configuration module - Success Nov 3 08:30:45 kjcf05n02 beSetMlxConfig[2213]: Create devices Nov 3 08:30:45 kjcf05n02 mlnx_conf_mgr[2351]: INFO: No configurations found for mlx5_0, skipping. Nov 3 08:30:45 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 08:30:45 kjcf05n02 mlnx_conf_mgr[2372]: INFO: No configurations found for mlx5_1, skipping. Nov 3 08:30:45 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 08:30:45 kjcf05n02 sssd[be[implicit_files]][2310]: Starting up Nov 3 08:30:45 kjcf05n02 sssd[nss][2444]: Starting up Nov 3 08:30:45 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 08:30:45 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Login Service... Nov 3 08:30:45 kjcf05n02 systemd-logind[2549]: New seat seat0. Nov 3 08:30:45 kjcf05n02 systemd-logind[2549]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Login Service. Nov 3 08:30:45 kjcf05n02 python3.9[2195]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 08:30:45 kjcf05n02 python3.9[3159]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 08:30:45 kjcf05n02 systemd-sysctl[2778]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 08:30:45 kjcf05n02 systemd-sysctl[2778]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 08:30:45 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 08:30:45 kjcf05n02 python3.9[2840]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 08:30:45 kjcf05n02 python3.9[3159]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 08:30:45 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 08:30:45 kjcf05n02 network[2186]: Bringing up loopback interface: [ OK ] Nov 3 08:30:45 kjcf05n02 python3.9[3022]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 08:30:45 kjcf05n02 python3.9[3159]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:30:45 kjcf05n02 systemd-sysctl[3103]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 08:30:45 kjcf05n02 systemd-sysctl[3103]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 08:30:45 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 08:30:45 kjcf05n02 systemd[1]: Reached target Network. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 08:30:45 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 08:30:45 kjcf05n02 sm-notify[3158]: Version 2.3.3 starting Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 08:30:45 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 08:30:45 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 3 08:30:45 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 08:30:45 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 3 08:30:45 kjcf05n02 lldpad[3170]: setsockopt nearest_bridge: Invalid argument Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 3 08:30:45 kjcf05n02 lldpad[3170]: setsockopt nearest_bridge: Invalid argument Nov 3 08:30:45 kjcf05n02 python3.9[3198]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 08:30:45 kjcf05n02 python3.9[3159]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:30:45 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 08:30:45 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 08:30:45 kjcf05n02 syslog-ng[3159]: [2024-11-03T14:29:32.158008] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 08:30:45 kjcf05n02 syslog-ng[3159]: [2024-11-03T14:29:32.158306] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 08:30:45 kjcf05n02 syslog-ng[3159]: [2024-11-03T14:29:32.158342] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 08:30:45 kjcf05n02 syslog-ng[3159]: [2024-11-03T14:29:32.158572] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 08:30:45 kjcf05n02 syslog-ng[3159]: [2024-11-03T14:29:32.158762] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 08:30:45 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 08:30:45 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 08:30:45 kjcf05n02 beSetMlxConfig[2213]: Unloading MST PCI module (unused) - Success Nov 3 08:30:45 kjcf05n02 sshd[3226]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 08:30:45 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 08:30:45 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 08:30:45 kjcf05n02 python3.9[3392]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 08:30:45 kjcf05n02 python3.9[3159]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 08:30:45 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 08:30:45 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 08:30:45 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 08:30:45 kjcf05n02 chronyd[2175]: System's initial offset : 0.003388 seconds slow of true (slew) Nov 3 08:30:45 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 08:30:45 kjcf05n02 beSetMlxConfig[2213]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 08:30:45 kjcf05n02 beSetMlxConfig[2213]: ib mode Nov 3 08:30:45 kjcf05n02 root[3462]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 3 08:30:45 kjcf05n02 root[3464]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 3 08:30:45 kjcf05n02 beSetMlxConfig[2213]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 08:30:45 kjcf05n02 beSetMlxConfig[2213]: ib mode Nov 3 08:30:45 kjcf05n02 systemd-udevd[1569]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 08:30:45 kjcf05n02 systemd-udevd[3479]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:30:45 kjcf05n02 systemd-udevd[3478]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:30:45 kjcf05n02 systemd-udevd[3482]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:30:45 kjcf05n02 systemd-udevd[3484]: Using default interface naming scheme 'rhel-8.0'. Nov 3 08:30:45 kjcf05n02 systemd-udevd[3484]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:30:45 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 08:30:45 kjcf05n02 systemd[3159]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:30:45 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[3520]: Setting up Mellanox network interface: ib1 Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[3521]: Setting up Mellanox network interface: ib0 Nov 3 08:30:45 kjcf05n02 systemd-udevd[3481]: Using default interface naming scheme 'rhel-8.0'. Nov 3 08:30:45 kjcf05n02 systemd-udevd[3480]: Using default interface naming scheme 'rhel-8.0'. Nov 3 08:30:45 kjcf05n02 systemd-udevd[3481]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:30:45 kjcf05n02 systemd-udevd[3480]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[3571]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[3573]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[3602]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[3603]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[3605]: No configuration found for ib0 Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[3606]: No configuration found for ib1 Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[3613]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[3614]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 08:30:45 kjcf05n02 mlnx_conf_mgr[3653]: INFO: No configurations found for mlx5_0, skipping. Nov 3 08:30:45 kjcf05n02 mlnx_conf_mgr[3654]: INFO: No configurations found for mlx5_1, skipping. Nov 3 08:30:45 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 08:30:45 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 08:30:45 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 08:30:45 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 3 08:30:45 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 3 08:30:45 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 08:30:45 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 3 08:30:45 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 3 08:30:45 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 08:30:45 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 08:30:45 kjcf05n02 lldpad[3170]: init_ports: Error adding device ib0 Nov 3 08:30:45 kjcf05n02 lldpad[3170]: init_ports: Error adding device ib1 Nov 3 08:30:45 kjcf05n02 lldpad[3170]: Signal 15 received - terminating Nov 3 08:30:45 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 3 08:30:45 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 08:30:45 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 08:30:45 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 3 08:30:45 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 08:30:45 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 3 08:30:45 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 3 08:30:45 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:45 kjcf05n02 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:30:45 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 1 | Nov-03-2024 | 13:59:51 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 2 | Nov-03-2024 | 14:00:42 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 3 | Nov-03-2024 | 14:00:43 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 4 | Nov-03-2024 | 14:01:48 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 5 | Nov-03-2024 | 14:01:49 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 6 | Nov-03-2024 | 14:26:46 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 7 | Nov-03-2024 | 14:26:46 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 8 | Nov-03-2024 | 14:26:46 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 9 | Nov-03-2024 | 14:26:46 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 10 | Nov-03-2024 | 14:26:46 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 11 | Nov-03-2024 | 14:26:46 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 12 | Nov-03-2024 | 14:26:46 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 13 | Nov-03-2024 | 14:26:46 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 14 | Nov-03-2024 | 14:26:46 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 15 | Nov-03-2024 | 14:26:46 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 16 | Nov-03-2024 | 14:26:46 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 17 | Nov-03-2024 | 14:26:46 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 18 | Nov-03-2024 | 14:27:17 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 19 | Nov-03-2024 | 14:27:17 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 20 | Nov-03-2024 | 14:27:17 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 21 | Nov-03-2024 | 14:27:17 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 22 | Nov-03-2024 | 14:27:17 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 23 | Nov-03-2024 | 14:27:17 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 24 | Nov-03-2024 | 14:27:17 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 25 | Nov-03-2024 | 14:27:17 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 26 | Nov-03-2024 | 14:27:17 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 27 | Nov-03-2024 | 14:27:17 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 28 | Nov-03-2024 | 14:27:17 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 08:30:45 kjcf05n02 ipmievd[4000]: 29 | Nov-03-2024 | 14:27:18 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 08:30:45 kjcf05n02 ipmievd[4003]: Reading sensors... Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 3 08:30:45 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:45 kjcf05n02 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 08:30:45 kjcf05n02 nscd[2120]: 2120 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 08:30:45 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 08:30:45 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 3 08:30:45 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 08:30:45 kjcf05n02 beSetMlxConfig[4061]: ConnectX-3 multiport not detected Nov 3 08:30:45 kjcf05n02 beSetMlxConfig[4061]: Starting MST (Mellanox Software Tools) driver set Nov 3 08:30:45 kjcf05n02 beSetMlxConfig[4061]: Loading MST PCI module - Success Nov 3 08:30:45 kjcf05n02 systemd-udevd[1569]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 08:30:45 kjcf05n02 beSetMlxConfig[4061]: [warn] mst_pciconf is already loaded, skipping Nov 3 08:30:45 kjcf05n02 beSetMlxConfig[4061]: Create devices Nov 3 08:30:45 kjcf05n02 beSetMlxConfig[4061]: Unloading MST PCI module (unused) - Success Nov 3 08:30:45 kjcf05n02 ipmievd[4003]: Waiting for events... Nov 3 08:30:45 kjcf05n02 beSetMlxConfig[4061]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 08:30:45 kjcf05n02 beSetMlxConfig[4061]: ib mode Nov 3 08:30:45 kjcf05n02 beSetMlxConfig[4061]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 08:30:45 kjcf05n02 beSetMlxConfig[4061]: ib mode Nov 3 08:30:45 kjcf05n02 systemd-udevd[1569]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 08:30:45 kjcf05n02 systemd-udevd[4963]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:30:45 kjcf05n02 systemd-udevd[4962]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:30:45 kjcf05n02 systemd-udevd[4966]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:30:45 kjcf05n02 systemd-udevd[4968]: Using default interface naming scheme 'rhel-8.0'. Nov 3 08:30:45 kjcf05n02 systemd-udevd[4968]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:30:45 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 08:30:45 kjcf05n02 systemd[3159]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:30:45 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[5004]: Setting up Mellanox network interface: ib1 Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[5005]: Setting up Mellanox network interface: ib0 Nov 3 08:30:45 kjcf05n02 systemd-udevd[4964]: Using default interface naming scheme 'rhel-8.0'. Nov 3 08:30:45 kjcf05n02 systemd-udevd[4964]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[5054]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[5055]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[5071]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[5070]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[5072]: No configuration found for ib0 Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[5073]: No configuration found for ib1 Nov 3 08:30:45 kjcf05n02 systemd-udevd[4965]: Using default interface naming scheme 'rhel-8.0'. Nov 3 08:30:45 kjcf05n02 systemd-udevd[4965]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[5080]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 08:30:45 kjcf05n02 mlnx_interface_mgr[5081]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 08:30:45 kjcf05n02 mlnx_conf_mgr[5135]: INFO: No configurations found for mlx5_0, skipping. Nov 3 08:30:45 kjcf05n02 mlnx_conf_mgr[5136]: INFO: No configurations found for mlx5_1, skipping. Nov 3 08:30:45 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 08:30:45 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}1f75964f698cb33e298a5cc968c5b9ae4bf1a38cc144af25620b5c49a8c3bbc7' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}1f75964f698cb33e298a5cc968c5b9ae4bf1a38cc144af25620b5c49a8c3bbc7' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}026722fc20bf18abc137bc6da68a35c65b0202d67dadf17530688928bede1332' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}026722fc20bf18abc137bc6da68a35c65b0202d67dadf17530688928bede1332' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}394b13262d99191acef971a0ddcc764bada78af9616b17975f45137093d54dbc' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}394b13262d99191acef971a0ddcc764bada78af9616b17975f45137093d54dbc' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}28aef95c35c54b59488340b34bc7bcf96bd509e3eb6d0ce2d3410316c2ca3fe2' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}28aef95c35c54b59488340b34bc7bcf96bd509e3eb6d0ce2d3410316c2ca3fe2' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 08:30:45 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 3 08:30:45 kjcf05n02 chronyd[2175]: chronyd exiting Nov 3 08:30:45 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 3 08:30:45 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 08:30:45 kjcf05n02 chronyd[5170]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 08:30:45 kjcf05n02 chronyd[5170]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 08:30:45 kjcf05n02 chronyd[5170]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 08:30:45 kjcf05n02 chronyd[5170]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 08:30:45 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 08:30:45 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:45 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 08:30:45 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 3 08:30:45 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 08:30:45 kjcf05n02 dwd[5201]: dwd: vMay 29 2024 : 15:38:26 Nov 3 08:30:45 kjcf05n02 dwd[5201]: /usr/sbin/dwd -i 15 -d Nov 3 08:30:45 kjcf05n02 dwd[5201]: dwd: option Lethal: 0 Nov 3 08:30:45 kjcf05n02 dwd[5201]: dwd: option Interval: 15 Nov 3 08:30:45 kjcf05n02 dwd[5201]: dwd: option abrtlimit: 10 Nov 3 08:30:45 kjcf05n02 dwd[5201]: dwd: option DZPeriod: 604800 Nov 3 08:30:45 kjcf05n02 dwd[5201]: dwd: option SmartPeriod: 43200 Nov 3 08:30:45 kjcf05n02 dwd[5201]: dwd: option SDDEnabled: 1 Nov 3 08:30:45 kjcf05n02 dwd[5201]: dwd: option SDDAwaitScale: 3 Nov 3 08:30:45 kjcf05n02 dwd[5201]: dwd: option SDDAwaitMin: 100 Nov 3 08:30:45 kjcf05n02 dwd[5201]: dwd: option Verbosity: 1 Nov 3 08:30:45 kjcf05n02 dwd[5201]: dwd: option StandAlone: 0 Nov 3 08:30:45 kjcf05n02 dwd[5201]: option Lethal: 0 Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 08:30:45 kjcf05n02 dwd[5201]: option Interval: 15 Nov 3 08:30:45 kjcf05n02 dwd[5201]: option abrtlimit: 10 Nov 3 08:30:45 kjcf05n02 dwd[5201]: option DZPeriod: 604800 Nov 3 08:30:45 kjcf05n02 dwd[5201]: option SmartPeriod: 43200 Nov 3 08:30:45 kjcf05n02 dwd[5201]: option SDDEnabled: 1 Nov 3 08:30:45 kjcf05n02 dwd[5201]: option SDDAwaitScale: 3 Nov 3 08:30:45 kjcf05n02 dwd[5201]: option SDDAwaitMin: 100 Nov 3 08:30:45 kjcf05n02 dwd[5201]: option Verbosity: 1 Nov 3 08:30:45 kjcf05n02 dwd[5201]: option StandAlone: 0 Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 08:30:45 kjcf05n02 dwd[5202]: option Lethal now set to 1 Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 08:30:45 kjcf05n02 dwd[5202]: option abrtlimit now set to 1 Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 08:30:45 kjcf05n02 dwd[5202]: option SmartPeriod now set to 86400 Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 08:30:45 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 08:30:45 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:30:45 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:45 kjcf05n02 python3.9[5231]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 08:30:45 kjcf05n02 python3.9[3159]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 08:30:45 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:30:45 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 08:30:45 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:45 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 3 08:30:45 kjcf05n02 sedcpwrkr[5370]: Using config script: /etc/sedcpwrkr.conf Nov 3 08:30:45 kjcf05n02 sedcpwrkr[5370]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 08:30:45 kjcf05n02 sedcpwrkr[5370]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 08:30:45 kjcf05n02 sedcpwrkr[5370]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 08:30:45 kjcf05n02 sedcpwrkr[5370]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 08:30:45 kjcf05n02 sedcpwrkr[5370]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 08:30:45 kjcf05n02 sedcpwrkr[5370]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 08:30:45 kjcf05n02 sedcpwrkr-server[5401]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 08:30:45 kjcf05n02 sedcpwrkr[5370]: celery multi v5.2.7 (dawn-chorus) Nov 3 08:30:45 kjcf05n02 sedcpwrkr[5370]: > Starting nodes... Nov 3 08:30:45 kjcf05n02 sedcpwrkr[5370]: > sedcpwrkr@kjcf05n02: OK Nov 3 08:30:45 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 08:30:45 kjcf05n02 sedcpwrkr-server[5403]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 08:30:45 kjcf05n02 sedcpwrkr-server[5403]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 08:30:45 kjcf05n02 sedcpwrkr-server[5403]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 08:30:45 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 08:30:45 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 3 08:30:45 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 08:30:45 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 08:30:45 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 08:30:45 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:46 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 08:30:46 kjcf05n02 systemd-udevd[1569]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 08:30:46 kjcf05n02 iptables.init[5470]: iptables: Applying firewall rules: [ OK ] Nov 3 08:30:46 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 3 08:30:46 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:46 kjcf05n02 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:30:46 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:30:46 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:30:46 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 08:30:46 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 08:30:46 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 08:30:46 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 08:30:46 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 08:30:46 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 08:30:46 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 08:30:46 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 08:30:46 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 08:30:46 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 08:30:47 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 08:30:47 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 08:30:47 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 08:30:47 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 08:30:47 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 08:30:47 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 08:30:47 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 08:30:47 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 08:30:47 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 08:30:47 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 08:30:47 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 08:30:47 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 08:30:47 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 08:30:47 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 08:30:47 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 08:30:47 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 08:30:47 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 08:30:47 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 08:30:47 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 08:30:47 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 08:30:47 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 08:30:47 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 08:30:47 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 08:30:47 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 08:30:47 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 08:30:47 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 08:30:47 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 08:30:47 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 08:30:47 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 08:30:47 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 08:30:47 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 08:30:47 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 08:30:47 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 08:30:47 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 08:30:47 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 08:30:47 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 08:30:47 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 08:30:47 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 08:30:47 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 08:30:47 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 08:30:47 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:47 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 08:30:47 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5567 which is not our child. We'll most likely not notice when it exits. Nov 3 08:30:47 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 08:30:47 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:47 kjcf05n02 openhpid[5567]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 08:30:47 kjcf05n02 openhpid[5567]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 08:30:47 kjcf05n02 openhpid[5567]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 08:30:47 kjcf05n02 openhpid[5567]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 08:30:48 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:48 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:30:48 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:30:48 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 08:30:48 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 08:30:48 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 08:30:48 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 08:30:48 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:48 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 08:30:48 kjcf05n02 dcs-collectord[5658]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 08:30:48 kjcf05n02 hpi.inv.log[5658]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 08:30:48 kjcf05n02 dcs-collectord[5658]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 08:30:48 kjcf05n02 dcs-collectord[5658]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 08:30:48 kjcf05n02 dcs-collector[5649]: Starting dcs-collector:[ OK ] Nov 3 08:30:48 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 08:30:48 kjcf05n02 dcs-collectord[5661]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 08:30:48 kjcf05n02 dcs-collectord[5661]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 08:30:48 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 08:30:48 kjcf05n02 dcs-collectord[5661]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 08:30:48 kjcf05n02 dcs-collectord[5661]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 08:30:48 kjcf05n02 dcs-collectord[5661]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 08:30:48 kjcf05n02 dcs-collectord[5661]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259342976", "units": "kB"}, {"name": "MemAvailable", "value": "258622828", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821280", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686856", "units": "kB"}, {"name": "Inactive", "value": "961360", "units": "kB"}, {"name": "Active(anon)", "value": "1520692", "units": "kB"}, {"name": "Inactive(anon)", "value": "825200", "units": "kB"}, {"name": "Active(file)", "value": "166164", "units": "kB"}, {"name": "Inactive(file)", "value": "136160", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "753112", "units": "kB"}, {"name": "Mapped", "value": "86136", "units": "kB"}, {"name": "Shmem", "value": "1593404", "units": "kB"}, {"name": "KReclaimable", "value": "109532", "units": "kB"}, {"name": "Slab", "value": "276636", "units": "kB"}, {"name": "SReclaimable", "value": "109532", "units": "kB"}, {"name": "SUnreclaim", "value": "167104", "units": "kB"}, {"name": "KernelStack", "value": "9744", "units": "kB"}, {"name": "PageTables", "value": "19388", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3302684", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11264", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "2048", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "287048", "units": "kB"}, {"name": "DirectMap2M", "value": "24743936", "units": "kB"}, {"name": "DirectMap1G", "value": "243269632", "units": "kB"}]}' Nov 3 08:30:48 kjcf05n02 dcs-collectord[5661]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 08:30:48 kjcf05n02 dcs-collectord[5661]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 08:30:48 kjcf05n02 dcs-collectord[5661]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 08:30:48 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:49 kjcf05n02 dcs-collectord[5661]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 08:30:49 kjcf05n02 dcs-collectord[5661]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730644248.664909], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730644248.9131968], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730644248.5986466, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 08:30:49 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:49 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 08:30:49 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:30:49 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:30:49 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 08:30:49 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 08:30:49 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 08:30:49 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 08:30:49 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:49 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 08:30:49 kjcf05n02 firmware-update-orc[5767]: Using config script: /etc/firmware_update_orc.conf Nov 3 08:30:49 kjcf05n02 firmware-update-orc[5767]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 08:30:49 kjcf05n02 firmware-update-orc[5767]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 08:30:49 kjcf05n02 firmware-update-orc[5767]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 08:30:49 kjcf05n02 firmware-update-orc[5767]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 08:30:49 kjcf05n02 firmware-update-orc[5767]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 08:30:49 kjcf05n02 firmware-update-orc[5767]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 08:30:50 kjcf05n02 firmware-update-orc-server[5804]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 08:30:50 kjcf05n02 firmware-update-orc[5767]: celery multi v5.2.7 (dawn-chorus) Nov 3 08:30:50 kjcf05n02 firmware-update-orc[5767]: > Starting nodes... Nov 3 08:30:50 kjcf05n02 firmware-update-orc[5767]: > worker1@kjcf05n02: OK Nov 3 08:30:50 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 08:30:50 kjcf05n02 firmware-update-orc-server[5807]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 08:30:50 kjcf05n02 firmware-update-orc-server[5807]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 08:30:50 kjcf05n02 firmware-update-orc-server[5807]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 08:30:50 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 08:30:50 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:50 kjcf05n02 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:30:50 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:30:50 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:30:50 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 08:30:50 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 08:30:50 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 08:30:50 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 08:30:50 kjcf05n02 dbus-daemon[2139]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 08:30:50 kjcf05n02 dbus-daemon[2139]: [system] Reloaded configuration Nov 3 08:30:50 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 08:30:50 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 08:30:50 kjcf05n02 dbus-daemon[2139]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 08:30:50 kjcf05n02 dbus-daemon[2139]: [system] Reloaded configuration Nov 3 08:30:50 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 08:30:50 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 08:30:50 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 08:30:50 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 08:30:50 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:50 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 3 08:30:51 kjcf05n02 ras-resource-manager-agent[5923]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 08:30:51 kjcf05n02 ras-resource-manager-agent[5909]: Starting ras-resource-manager-agent:[ OK ] Nov 3 08:30:51 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 08:30:51 kjcf05n02 ras-resource-manager-agent[5925]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 08:30:51 kjcf05n02 ras-resource-manager-client[5925]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 08:30:51 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 3 08:30:51 kjcf05n02 ras-resource-manager-client[5925]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 08:30:51 kjcf05n02 ras-resource-manager-client[5935]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 08:30:51 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:52 kjcf05n02 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:30:52 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:30:52 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:30:52 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 08:30:52 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 08:30:52 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:52 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 08:30:52 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:53 kjcf05n02 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: Press Ctrl+C to exit. Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: Plugin support version 1.0 Nov 3 08:30:53 kjcf05n02 zabbix_agent2[6009]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 08:30:53 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:30:53 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:30:53 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:53 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 08:30:53 kjcf05n02 dcs-notification-sender[6087]: dcs-notification-senderd is stopped Nov 3 08:30:53 kjcf05n02 zabbix-agent2[6101]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 08:30:53 kjcf05n02 dcs-notification-sender[6087]: Starting notification-sender:[ OK ] Nov 3 08:30:53 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 08:30:53 kjcf05n02 zabbix-agent2[6107]: INFO DCS notification agent started. (agent.py:61) Nov 3 08:30:53 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 08:30:53 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:53 kjcf05n02 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:30:53 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:30:53 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:30:54 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:54 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 08:30:54 kjcf05n02 dcs-collectord[6204]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 08:30:54 kjcf05n02 dcs-collectord[6204]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 08:30:54 kjcf05n02 dcs-bulk-data-sender[6204]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 08:30:54 kjcf05n02 dcs-bulk-data-sender[6195]: Starting bulk-data-sender:[ OK ] Nov 3 08:30:54 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 08:30:54 kjcf05n02 dcs-collectord[6206]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 08:30:54 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 08:30:54 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:55 kjcf05n02 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:30:55 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:30:55 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:30:55 kjcf05n02 nscd[2120]: 2120 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 08:30:55 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 08:30:55 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 08:30:55 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 08:30:55 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 08:30:55 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 08:30:55 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 08:30:55 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 08:30:55 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 08:30:55 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 08:30:55 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 08:30:55 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 08:30:55 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 08:30:55 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 08:30:55 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 08:30:55 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 08:30:55 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 08:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 08:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 08:30:55 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 08:30:55 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 08:30:55 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 08:30:55 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 08:30:55 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 3 08:30:55 kjcf05n02 sssd[nss][2444]: Shutting down (status = 0) Nov 3 08:30:55 kjcf05n02 sssd[be[implicit_files]][2310]: Shutting down (status = 0) Nov 3 08:30:55 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 3 08:30:55 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 3 08:30:55 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 08:30:55 kjcf05n02 sssd[sssd][6276]: Starting up Nov 3 08:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 08:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 08:30:56 kjcf05n02 python3.9[5231]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 08:30:56 kjcf05n02 python3.9[3159]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:30:56 kjcf05n02 sssd[be[implicit_files]][6277]: Starting up Nov 3 08:30:56 kjcf05n02 sssd[nss][6293]: Starting up Nov 3 08:30:56 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 08:30:56 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 08:30:56 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 08:30:57 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 08:30:57 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 08:30:57 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 08:30:57 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 08:30:57 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 08:30:57 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 08:30:57 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 08:30:57 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 08:30:57 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 08:30:57 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 08:30:57 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 08:30:57 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 08:30:57 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 08:30:57 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 08:30:57 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 08:30:57 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 08:30:57 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:57 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 08:30:57 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 08:30:58 kjcf05n02 icinga2[6344]: [2024-11-03 08:30:57 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 08:30:58 kjcf05n02 icinga2[6344]: [2024-11-03 08:30:57 -0600] information/cli: Loading configuration file(s). Nov 3 08:30:58 kjcf05n02 icinga2[6344]: [2024-11-03 08:30:57 -0600] information/ConfigItem: Committing config item(s). Nov 3 08:30:58 kjcf05n02 icinga2[6344]: [2024-11-03 08:30:57 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 3 08:30:58 kjcf05n02 icinga2[6344]: [2024-11-03 08:30:57 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 08:30:58 kjcf05n02 icinga2[6344]: [2024-11-03 08:30:57 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 08:30:58 kjcf05n02 icinga2[6344]: [2024-11-03 08:30:57 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 08:30:58 kjcf05n02 icinga2[6344]: [2024-11-03 08:30:57 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 08:30:58 kjcf05n02 icinga2[6344]: [2024-11-03 08:30:57 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 08:30:58 kjcf05n02 icinga2[6344]: [2024-11-03 08:30:57 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 08:30:58 kjcf05n02 icinga2[6344]: [2024-11-03 08:30:57 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 08:30:58 kjcf05n02 icinga2[6344]: [2024-11-03 08:30:57 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 08:30:58 kjcf05n02 icinga2[6344]: [2024-11-03 08:30:57 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 08:30:58 kjcf05n02 icinga2[6344]: [2024-11-03 08:30:57 -0600] information/cli: Closing console log. Nov 3 08:30:58 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 08:30:58 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:58 kjcf05n02 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:30:58 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:30:58 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:30:59 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 08:30:59 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 08:30:59 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:59 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 3 08:30:59 kjcf05n02 systemd[1]: Reloading. Nov 3 08:30:59 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 08:30:59 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:30:59 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 08:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 08:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 08:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 08:31:00 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 08:31:00 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 08:31:00 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 08:31:00 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 08:31:00 kjcf05n02 dcs-bulk-data-sender[6206]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 08:31:00 kjcf05n02 dcs-collectord[6206]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 08:31:00 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 08:31:00 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 08:31:00 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 08:31:00 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 08:31:00 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 08:31:00 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 08:31:00 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 08:31:00 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 08:31:00 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 08:31:00 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 08:31:00 kjcf05n02 systemd[1]: Reloading. Nov 3 08:31:00 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 08:31:00 kjcf05n02 nslcd[6963]: version 0.9.9 starting Nov 3 08:31:00 kjcf05n02 nslcd[6963]: accepting connections Nov 3 08:31:00 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 08:31:00 kjcf05n02 systemd[1]: Reloading. Nov 3 08:31:00 kjcf05n00 mcfcli[3673891]: %3|1730644260.802|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:31:01 kjcf05n02 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:31:01 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:31:01 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:31:01 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 08:31:01 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 08:31:01 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 08:31:01 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 08:31:02 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 08:31:02 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 08:31:02 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 08:31:02 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 08:31:02 kjcf05n02 systemd[1]: Reloading. Nov 3 08:31:02 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 08:31:02 kjcf05n02 dearcpw[7066]: Using config script: /etc/dearcpw.conf Nov 3 08:31:02 kjcf05n02 dearcpw[7066]: - Creating default directory: '/var/log/dearcpw' Nov 3 08:31:02 kjcf05n02 dearcpw[7066]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 08:31:02 kjcf05n02 dearcpw[7066]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 08:31:02 kjcf05n02 dearcpw[7066]: - Creating default directory: '/var/run/dearcpw' Nov 3 08:31:02 kjcf05n02 dearcpw[7066]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 08:31:02 kjcf05n02 dearcpw[7066]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 08:31:03 kjcf05n02 dearcpw-server[7106]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 08:31:03 kjcf05n02 dearcpw[7066]: celery multi v5.2.7 (dawn-chorus) Nov 3 08:31:03 kjcf05n02 dearcpw[7066]: > Starting nodes... Nov 3 08:31:03 kjcf05n02 dearcpw[7066]: > dearcpw@kjcf05n02: OK Nov 3 08:31:03 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 08:31:03 kjcf05n02 dearcpw-server[7108]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 08:31:03 kjcf05n02 dearcpw-server[7108]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 08:31:03 kjcf05n02 dearcpw-server[7108]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 08:31:03 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 3 08:31:03 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:31:03 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:31:03 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 08:31:03 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 08:31:03 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 08:31:03 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 08:31:03 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 08:31:03 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 08:31:03 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 08:31:03 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 08:31:03 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:45984). Nov 3 08:31:03 kjcf05n01 rsyncd[2993365]: connect from kjcf05n02 (172.16.2.5) Nov 3 08:31:03 kjcf05n01 rsyncd[2993365]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 08:31:03 kjcf05n01 rsyncd[2993365]: receiving file list Nov 3 08:31:03 kjcf05n01 rsyncd[2993365]: sent 29 bytes received 325 bytes total size 10905 Nov 3 08:31:03 kjcf05n01 systemd[1]: rsyncd@612-172.16.2.2:873-172.16.2.5:45984.service: Succeeded. Nov 3 08:31:04 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 08:31:04 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 08:31:04 kjcf05n02 puppet[7145]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 3 08:31:04 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 08:31:04 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 08:31:04 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 08:31:04 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 08:31:04 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 08:31:04 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 08:31:04 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 08:31:04 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 08:31:04 kjcf05n02 dcs-collectord[5661]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 08:31:04 kjcf05n02 dcs-collectord[5661]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 08:31:04 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 08:31:04 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 08:31:04 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 08:31:04 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 08:31:04 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 08:31:04 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 08:31:05 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 08:31:05 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 08:31:05 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 08:31:05 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 08:31:06 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 08:31:06 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 08:31:06 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 08:31:06 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 08:31:06 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 08:31:06 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 08:31:06 kjcf05n02 systemd[1]: Reloading. Nov 3 08:31:06 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 08:31:07 kjcf05n02 ipmievd[4003]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 08:31:07 kjcf05n02 ipmievd[4003]: System Event sensor - Timestamp Clock Sync Nov 3 08:31:07 kjcf05n02 ipmievd[3159]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:31:07 kjcf05n02 diskless-swap[7631]: HA_PS_000: recovering journal Nov 3 08:31:07 kjcf05n02 systemd-udevd[1569]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 08:31:07 kjcf05n02 diskless-swap[7631]: HA_PS_000: clean, 2280/6400 files, 7069/25600 blocks Nov 3 08:31:07 kjcf05n02 diskless-swap[7631]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 08:31:07 kjcf05n02 diskless-swap[7631]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 08:31:07 kjcf05n02 diskless-swap[7631]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 08:31:07 kjcf05n02 diskless-swap[7631]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 08:31:07 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 08:31:07 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:31:07 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:31:07 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 08:31:07 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 08:31:07 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 08:31:07 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 08:31:07 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 3 08:31:07 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 3 08:31:07 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 3 08:31:07 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 3 08:31:07 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 3 08:31:07 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 08:31:07 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 08:31:07 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 08:31:07 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 08:31:07 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 08:31:08 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 08:31:08 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 08:31:08 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 08:31:08 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 08:31:08 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 08:31:08 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 08:31:09 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 08:31:09 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 08:31:09 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 08:31:09 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 08:31:10 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 08:31:10 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 08:31:10 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 08:31:10 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 08:31:10 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 08:31:10 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 08:31:10 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 08:31:10 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 08:31:10 kjcf05n02 systemd[1]: Reloading. Nov 3 08:31:11 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 3 08:31:11 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:31:11 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:31:11 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 08:31:11 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 08:31:11 kjcf05n02 systemd[1]: Reloading. Nov 3 08:31:11 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 3 08:31:11 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:31:11 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:31:11 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 08:31:11 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 08:31:11 kjcf05n02 systemd[1]: Reloading. Nov 3 08:31:11 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 3 08:31:11 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:31:11 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:31:11 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 08:31:11 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 08:31:11 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 08:31:11 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 08:31:11 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 08:31:11 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 08:31:11 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 08:31:11 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 08:31:11 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 08:31:11 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 08:31:11 kjcf05n02 systemd[1]: Reloading. Nov 3 08:31:12 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 3 08:31:12 kjcf05n02 kdumpctl[7871]: kdump: No kdump initial ramdisk found. Nov 3 08:31:12 kjcf05n02 kdumpctl[7871]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 08:31:12 kjcf05n02 dracut[7983]: dracut-049-135.git20210121.el8 Nov 3 08:31:12 kjcf05n02 dracut[7985]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 08:31:12 kjcf05n02 dracut[7985]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 08:31:12 kjcf05n02 dracut[7985]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 08:31:12 kjcf05n02 dracut[7985]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 08:31:12 kjcf05n02 dracut[7985]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 08:31:12 kjcf05n02 dracut[7985]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 08:31:12 kjcf05n02 dracut[7985]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 08:31:12 kjcf05n02 dracut[7985]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + is_func check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ type -t check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 0 -ne 0 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check -h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local dev holder Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + require_binaries mdadm expr Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _module_name=90hperaid Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ mdadm = \-\m ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for cmd in "$@" Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + find_binary mdadm Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for cmd in "$@" Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + find_binary expr Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n -h ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for dev in "${!host_fs_types[@]}" Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ nfs != *_raid_member ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + continue Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _ret=255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + ret=255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ 255 = 0 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ 255 = 255 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ module_depends hperaid Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: +++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: +++ set -x Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ depends Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo rootfs-block Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ return 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ _ret=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ return 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for _moddep in $(module_depends $_mod) Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all == *\ hperaid\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + add_dracutmodules+=' rootfs-block ' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ == *\ hperaid\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check_module rootfs-block Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _mod=rootfs-block Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddep Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ == *\ rootfs-block\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n '' ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all == *\ rootfs-block\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + module_check rootfs-block 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _forced=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 2 -eq 2 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _forced=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + is_func check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ type -t check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 0 -ne 0 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check -h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _ret=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + ret=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ 0 = 0 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ module_depends rootfs-block Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: +++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 08:31:13 kjcf05n02 kdumpctl[3159]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ depends Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo fs-lib Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ _ret=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ return 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for _moddep in $(module_depends $_mod) Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all == *\ rootfs-block\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + add_dracutmodules+=' fs-lib ' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ == *\ rootfs-block\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check_module fs-lib Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _mod=fs-lib Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddep Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n '' ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + mods_checked_as_dep+=' fs-lib ' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all == *\ fs-lib\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + module_check fs-lib 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _forced=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 2 -eq 2 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _forced=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + is_func check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ type -t check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 0 -ne 0 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check -h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _ret=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + ret=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ 0 = 0 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ module_depends fs-lib Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: +++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ depends Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ return 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ _ret=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ return 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + mods_to_load+=' fs-lib ' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + mods_to_load+=' rootfs-block ' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + mods_to_load+=' hperaid ' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _mod=90kernel-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _mod=kernel-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check_module kernel-modules 1 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _mod=kernel-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddep Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n 1 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all = all ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + module_check kernel-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _forced=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 1 -eq 2 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + is_func check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ type -t check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 0 -ne 0 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check -h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + true Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _ret=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + ret=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ 0 != 0 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ module_depends kernel-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: +++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ depends Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ true Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ _ret=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ return 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + mods_to_load+=' kernel-modules ' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _mod=90kernel-modules-extra Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _mod=kernel-modules-extra Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check_module kernel-modules-extra 1 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _mod=kernel-modules-extra Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddep Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n 1 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all = all ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + module_check kernel-modules-extra Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _forced=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 1 -eq 2 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + is_func check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ type -t check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 0 -ne 0 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check -h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + true Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _ret=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + ret=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ 0 != 0 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ module_depends kernel-modules-extra Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: +++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ depends Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ true Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ _ret=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ return 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + mods_to_load+=' kernel-modules-extra ' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _mod=90kernel-network-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _mod=kernel-network-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check_module kernel-network-modules 1 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _mod=kernel-network-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddep Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n 1 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all = all ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + module_check kernel-network-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _forced=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 1 -eq 2 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + is_func check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ type -t check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 0 -ne 0 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check -h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _ret=255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + ret=255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ 255 != 0 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n 1 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 1 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _mod=90livenet Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _mod=livenet Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check_module livenet 1 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _mod=livenet Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddep Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n 1 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all = all ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + module_check livenet Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _forced=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 1 -eq 2 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + is_func check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ type -t check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 0 -ne 0 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check -h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _ret=255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + ret=255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ 255 != 0 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n 1 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 1 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _mod=90lvm Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _mod=lvm Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check_module lvm 1 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _mod=lvm Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddep Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n 1 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all = all ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + module_check lvm Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _forced=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 1 -eq 2 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + is_func check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ type -t check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 0 -ne 0 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check -h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + require_binaries lvm Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _module_name=90lvm Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ lvm = \-\m ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for cmd in "$@" Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + find_binary lvm Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n -h ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for fs in "${host_fs_types[@]}" Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ nfs = LVM*_member ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _ret=255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + ret=255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ 255 != 0 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n 1 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 1 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _mod=90mdraid Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _mod=mdraid Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check_module mdraid 1 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _mod=mdraid Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddep Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n 1 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all = all ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + module_check mdraid Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _forced=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 1 -eq 2 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + is_func check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ type -t check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 0 -ne 0 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check -h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _rootdev Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + require_binaries mdadm expr Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _module_name=90mdraid Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ mdadm = \-\m ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for cmd in "$@" Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + find_binary mdadm Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for cmd in "$@" Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + find_binary expr Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n -h ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for dev in "${!host_fs_types[@]}" Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ nfs != *_raid_member ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + continue Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _ret=255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + ret=255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ 255 != 0 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n 1 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 1 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _mod=90multipath Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _mod=multipath Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check_module multipath 1 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _mod=multipath Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddep Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n 1 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all = all ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + module_check multipath Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _forced=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 1 -eq 2 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + is_func check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ type -t check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 0 -ne 0 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check -h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _rootdev Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n -h ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for_each_host_dev_and_slaves is_mpath Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _func=is_mpath Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _dev Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for _dev in "${host_devs[@]}" Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + continue Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 1 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _ret=255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + ret=255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ 255 != 0 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n 1 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 1 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _mod=90qemu Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _mod=qemu Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check_module qemu 1 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _mod=qemu Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddep Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n 1 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all = all ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + module_check qemu Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _forced=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 1 -eq 2 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + is_func check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ type -t check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 0 -ne 0 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check -h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n -h ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + type -P systemd-detect-virt Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ systemd-detect-virt --vm Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + vm=none Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + (( 1 != 0 )) Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _ret=255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + ret=255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ 255 != 0 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n 1 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 1 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _mod=90qemu-net Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _mod=qemu-net Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check_module qemu-net 1 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _mod=qemu-net Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddep Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n 1 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all = all ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + module_check qemu-net Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _forced=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 1 -eq 2 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + is_func check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ type -t check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 0 -ne 0 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check -h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n -h ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + type -P systemd-detect-virt Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ systemd-detect-virt --vm Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + vm= Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + (( 1 != 0 )) Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _ret=255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + ret=255 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ 255 != 0 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n 1 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + return 1 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _mod=90stratis Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + _mod=stratis Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check_module stratis 1 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _mod=stratis Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddep Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -n 1 ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ all = all ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + module_check stratis Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ read a b Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _forced=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _hostonly=-h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 1 -eq 2 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + is_func check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: ++ type -t check Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + '[' 0 -ne 0 ']' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + check -h Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _module_name=90stratis Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + local _ret=0 Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + [[ stratisd-init = \-\m ]] Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + for cmd in "$@" Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + find_binary stratisd-init Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 08:31:13 kjcf05n02 kdumpctl[7871]: + set +x Nov 3 08:31:13 kjcf05n02 dracut[7985]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 08:31:13 kjcf05n02 dracut[7985]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 08:31:13 kjcf05n02 dracut[7985]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 08:31:13 kjcf05n02 dracut[7985]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 08:31:13 kjcf05n02 dracut[7985]: memstrack is available Nov 3 08:31:13 kjcf05n02 dracut[7985]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 08:31:13 kjcf05n02 dracut[7985]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 08:31:13 kjcf05n02 dracut[7985]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 08:31:13 kjcf05n02 dracut[7985]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 08:31:13 kjcf05n02 dracut[7985]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 08:31:13 kjcf05n02 dracut[7985]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 08:31:14 kjcf05n02 dracut[7985]: *** Including module: bash *** Nov 3 08:31:14 kjcf05n02 dracut[7985]: *** Including module: systemd *** Nov 3 08:31:14 kjcf05n02 dracut[7985]: *** Including module: fips *** Nov 3 08:31:15 kjcf05n02 dracut[7985]: *** Including module: systemd-initrd *** Nov 3 08:31:15 kjcf05n02 dracut[7985]: *** Including module: watchdog-modules *** Nov 3 08:31:15 kjcf05n02 dracut[7985]: *** Including module: nss-softokn *** Nov 3 08:31:15 kjcf05n02 dracut[7985]: *** Including module: i18n *** Nov 3 08:31:15 kjcf05n02 dracut[7985]: No KEYMAP configured. Nov 3 08:31:15 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 3 08:31:15 kjcf05n02 dracut[7985]: *** Including module: network-legacy *** Nov 3 08:31:16 kjcf05n02 dracut[7985]: *** Including module: network *** Nov 3 08:31:16 kjcf05n02 dracut[7985]: *** Including module: ib_bonding *** Nov 3 08:31:16 kjcf05n02 dracut[7985]: *** Including module: drm *** Nov 3 08:31:16 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 3 08:31:17 kjcf05n00 zabbix-server[1103999]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:31:17 kjcf05n00 zabbix-server[1103999]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:40\\"}}"' Nov 3 08:31:17 kjcf05n00 log_interesting_event.py[1103999]: Event '46005' acknowledged Nov 3 08:31:19 kjcf05n02 dcs-collectord[5661]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 08:31:19 kjcf05n02 dcs-collectord[5661]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 08:31:19 kjcf05n02 dracut[7985]: *** Including module: hperaid *** Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + install Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + local rule rule_path Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + inst_multiple cat expr Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.ovRPqs/initramfs -a -f cat expr Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + _ret=0 Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + (( 0 != 0 )) Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + : Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + return 0 Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + inst_multiple -o mdmon Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.ovRPqs/initramfs -a -f -o mdmon Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + _ret=0 Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + (( 0 != 0 )) Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + : Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + return 0 Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: ++ command -v partx Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + inst /usr/sbin/partx /sbin/partx Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + local _hostonly_install Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + [[ -e /tmp/dracut.ovRPqs/initramfs//sbin/partx ]] Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.ovRPqs/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + (( 0 != 0 )) Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + : Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: ++ command -v mdadm Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + local _hostonly_install Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + [[ -e /tmp/dracut.ovRPqs/initramfs//sbin/mdadm ]] Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.ovRPqs/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + (( 0 != 0 )) Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + : Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + [[ yes == \y\e\s ]] Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + local _raidconf Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: ++ cmdline Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: ++ local _activated dev line UUID Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: ++ declare -A _activated Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: ++ for dev in "${!host_fs_types[@]}" Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: ++ [[ nfs != *_raid_member ]] Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: ++ continue Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + _raidconf= Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + [[ -n '' ]] Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + inst_rules 64-md-raid.rules Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + local _target=/etc/udev/rules.d _rule _found Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + inst_dir /usr/lib/udev/rules.d Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + [[ -e /tmp/dracut.ovRPqs/initramfs//usr/lib/udev/rules.d ]] Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + return 0 Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + inst_dir /etc/udev/rules.d Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + [[ -e /tmp/dracut.ovRPqs/initramfs//etc/udev/rules.d ]] Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + return 0 Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + for _rule in "$@" Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + continue Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + continue Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + for r in '' $dracutbasedir/rules.d/ Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + [[ 64-md-raid.rules != /* ]] Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + continue Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + for r in '' $dracutbasedir/rules.d/ Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + continue Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + [[ -n '' ]] Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 08:31:19 kjcf05n02 kdumpctl[7871]: + set +x Nov 3 08:31:19 kjcf05n02 dracut[7985]: Skipping udev rule: 64-md-raid.rules Nov 3 08:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730644279', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.4% (3692272 kB) used.'}"] Nov 3 08:31:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.4% (3692272 kB) used.', 'message': 'OK - 1.4% (3692272 kB) used.', 'value': 'ok', 'timestamp': '1730644279'} Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + installkernel Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + instmods =drivers/md Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + local _optional=-o Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + local _silent Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + local _ret Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + [[ '' = yes ]] Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + [[ =drivers/md = \-\c ]] Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + [[ =drivers/md = \-\s ]] Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + (( 1 == 0 )) Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.ovRPqs/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + _ret=0 Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + (( 0 != 0 )) Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + [[ -n '' ]] Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + return 0 Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + _ret=0 Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + unset check depends cmdline install installkernel Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + return 0 Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + modules_loaded+='hperaid ' Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + '[' -n '' ']' Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + _d_mod=90kernel-modules Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + _d_mod=kernel-modules Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + [[ '' = yes ]] Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + dinfo '*** Including module: kernel-modules ***' Nov 3 08:31:20 kjcf05n02 kdumpctl[7871]: + set +x Nov 3 08:31:20 kjcf05n02 dracut[7985]: *** Including module: kernel-modules *** Nov 3 08:31:20 kjcf05n02 dracut[7985]: *** Including module: kernel-modules-extra *** Nov 3 08:31:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:31:20 kjcf05n02 dracut[7985]: *** Including module: kernel-network-modules *** Nov 3 08:31:20 kjcf05n02 dracut[7985]: *** Including module: diskless-mod *** Nov 3 08:31:20 kjcf05n02 dracut[7985]: *** Including module: fstab-sys *** Nov 3 08:31:20 kjcf05n02 dracut[7985]: *** Including module: nfs *** Nov 3 08:31:21 kjcf05n02 dracut[7985]: *** Including module: rootfs-block *** Nov 3 08:31:21 kjcf05n02 dracut[7985]: *** Including module: terminfo *** Nov 3 08:31:21 kjcf05n02 dracut[7985]: *** Including module: udev-rules *** Nov 3 08:31:22 kjcf05n02 dracut[7985]: Skipping udev rule: 91-permissions.rules Nov 3 08:31:22 kjcf05n02 dracut[7985]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 08:31:22 kjcf05n02 dracut[7985]: *** Including module: dracut-systemd *** Nov 3 08:31:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 08:31:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 08:31:22 kjcf05n02 dracut[7985]: *** Including module: usrmount *** Nov 3 08:31:22 kjcf05n02 dracut[7985]: *** Including module: base *** Nov 3 08:31:23 kjcf05n02 dracut[7985]: *** Including module: fs-lib *** Nov 3 08:31:23 kjcf05n02 dracut[7985]: *** Including module: kdumpbase *** Nov 3 08:31:23 kjcf05n02 dracut[7985]: *** Including module: memstrack *** Nov 3 08:31:23 kjcf05n02 dracut[7985]: *** Including module: shutdown *** Nov 3 08:31:23 kjcf05n02 dracut[7985]: *** Including module: squash *** Nov 3 08:31:24 kjcf05n02 dracut[7985]: *** Including modules done *** Nov 3 08:31:24 kjcf05n02 dracut[7985]: *** Installing kernel module dependencies *** Nov 3 08:31:24 kjcf05n02 dracut[7985]: *** Installing kernel module dependencies done *** Nov 3 08:31:24 kjcf05n02 dracut[7985]: *** Resolving executable dependencies *** Nov 3 08:31:23 kjcf05n00 mcfcli[3673891]: %3|1730644283.916|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:31:25 kjcf05n02 dracut[7985]: *** Resolving executable dependencies done*** Nov 3 08:31:25 kjcf05n02 dracut[7985]: *** Hardlinking files *** Nov 3 08:31:25 kjcf05n02 dracut[7985]: *** Hardlinking files done *** Nov 3 08:31:25 kjcf05n02 dracut[7985]: *** Generating early-microcode cpio image *** Nov 3 08:31:25 kjcf05n02 dracut[7985]: *** Constructing AuthenticAMD.bin **** Nov 3 08:31:25 kjcf05n02 dracut[7985]: *** Store current command line parameters *** Nov 3 08:31:25 kjcf05n02 dracut[7985]: Stored kernel commandline: Nov 3 08:31:25 kjcf05n02 dracut[7985]: rd.driver.pre=sd_mod Nov 3 08:31:25 kjcf05n02 dracut[7985]: rd.driver.pre=nvme Nov 3 08:31:25 kjcf05n02 dracut[7985]: rd.driver.pre=ipmi_si Nov 3 08:31:25 kjcf05n02 dracut[7985]: rd.driver.pre=ipmi_devintf Nov 3 08:31:25 kjcf05n02 dracut[7985]: rd.driver.pre=ipmi_msghandler Nov 3 08:31:25 kjcf05n02 dracut[7985]: nameserver=172.16.2.2 Nov 3 08:31:25 kjcf05n02 dracut[7985]: nameserver=127.0.0.1 Nov 3 08:31:25 kjcf05n02 dracut[7985]: nameserver=172.16.2.2 Nov 3 08:31:25 kjcf05n02 dracut[7985]: nameserver=127.0.0.1 Nov 3 08:31:25 kjcf05n02 dracut[7985]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 3 08:31:25 kjcf05n02 dracut[7985]: rd.neednet Nov 3 08:31:25 kjcf05n02 dracut[7985]: kdumpnic=mgmt0 Nov 3 08:31:25 kjcf05n02 dracut[7985]: bootdev=mgmt0 Nov 3 08:31:25 kjcf05n02 dracut[7985]: *** Install squash loader *** Nov 3 08:31:25 kjcf05n02 dracut[7985]: *** Squashing the files inside the initramfs *** Nov 3 08:31:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730644285', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 08:31:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730644285'} Nov 3 08:31:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:31:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 08:31:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 08:31:26 kjcf05n02 dracut[7985]: *** Squashing the files inside the initramfs done *** Nov 3 08:31:26 kjcf05n02 dracut[7985]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 08:31:27 kjcf05n02 dracut[7985]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 08:31:27 kjcf05n02 kdumpctl[7871]: kdump: kexec: loaded kdump kernel Nov 3 08:31:27 kjcf05n02 kdumpctl[7871]: kdump: Starting kdump: [OK] Nov 3 08:31:27 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 3 08:31:27 kjcf05n02 systemd[1]: Reloading. Nov 3 08:31:27 kjcf05n02 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:31:27 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:31:27 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:31:27 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 08:31:27 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 08:31:27 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 08:31:27 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 08:31:27 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 08:31:27 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 08:31:27 kjcf05n02 ifdown[14593]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 08:31:27 kjcf05n02 ifdown[14594]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:31:27 kjcf05n02 ifdown[14595]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:31:28 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 08:31:28 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 08:31:28 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 08:31:28 kjcf05n02 ifup[14655]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 08:31:28 kjcf05n02 ifup[14656]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:31:28 kjcf05n02 ifup[14670]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:31:30 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 08:31:30 kjcf05n00 mcfcli[3673891]: %3|1730644290.802|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:31:32 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 08:31:32 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 08:31:32 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 08:31:32 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:31:32 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:31:32 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:31:32 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:31:32 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 08:31:32 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 08:31:32 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 08:31:32 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 08:31:32 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:31:32 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:31:32 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:31:32 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:31:32 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 08:31:32 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 08:31:32 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 08:31:32 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 08:31:32 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 08:31:32 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 08:31:32 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 08:31:32 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 08:31:32 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 08:31:32 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 08:31:32 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 08:31:32 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 08:31:32 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 08:31:32 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 08:31:32 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 08:31:32 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 08:31:32 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 08:31:32 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 08:31:32 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 08:31:32 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 08:31:32 kjcf05n02 ifdown[14844]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 08:31:32 kjcf05n02 ifdown[14845]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:31:32 kjcf05n02 ifdown[14846]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:31:33 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 08:31:33 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 08:31:33 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 08:31:33 kjcf05n02 ifup[14906]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 08:31:33 kjcf05n02 ifup[14907]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:31:33 kjcf05n02 ifup[14908]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:31:34 kjcf05n02 dcs-collectord[5661]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 08:31:34 kjcf05n02 dcs-collectord[5661]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 08:31:34 kjcf05n01 diskmonitor[1331407]: lock acquired Nov 3 08:31:34 kjcf05n01 diskmonitor[1331407]: leaving test state: 4 next state: 8 Nov 3 08:31:35 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 08:31:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730644296', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 08:31:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730644296', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 08:31:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730644296'} Nov 3 08:31:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:31:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730644296'} Nov 3 08:31:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:31:37 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 08:31:37 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 08:31:37 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 08:31:37 kjcf05n02 systemd[1]: Reloading. Nov 3 08:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 08:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 08:31:38 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 3 08:31:38 kjcf05n02 await_ha_peer[15129]: Waiting for HA peer kjcf05n03 Nov 3 08:31:39 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 08:31:39 kjcf05n02 await_ha_peer[15129]: Peer kjcf05n03 has started, starting HA Nov 3 08:31:39 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 3 08:31:39 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 3 08:31:39 kjcf05n02 fstonithd.py[15179]: Listening for kdump packets from partner Nov 3 08:31:39 kjcf05n02 systemd[1]: Reloading. Nov 3 08:31:40 kjcf05n02 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:31:40 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:31:40 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:31:40 kjcf05n02 systemd[1]: Reloading. Nov 3 08:31:40 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 3 08:31:40 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 08:31:40 kjcf05n02 systemd[1]: Reloading. Nov 3 08:31:40 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 08:31:40 kjcf05n02 puppet-agent[3587]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 08:31:40 kjcf05n02 puppet[3587]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 08:31:40 kjcf05n02 puppet-agent[3587]: Applied catalog in 92.62 seconds Nov 3 08:31:40 kjcf05n02 puppet[3587]: Notice: Applied catalog in 92.62 seconds Nov 3 08:31:40 kjcf05n02 systemd[1]: Started Puppet agent. Nov 3 08:31:40 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 08:31:40 kjcf05n02 systemd[1]: Reached target Timers. Nov 3 08:31:41 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 08:31:41 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 3 08:31:41 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 08:31:41 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 08:31:41 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 08:31:41 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 08:31:41 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 08:31:41 kjcf05n02 wce-disable.sh[15320]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 08:31:41 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 08:31:41 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 08:31:41 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 08:31:41 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 08:31:41 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 3 08:31:41 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 3 08:31:41 kjcf05n02 python3.9[15323]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 08:31:41 kjcf05n02 python3.9[15323]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 08:31:41 kjcf05n02 gateway-ec-node.py[15324]: Starting gateway-ec-node service Nov 3 08:31:41 kjcf05n02 RFSF-API[15322]: INFO[2024-11-03T08:31:41-06:00] Datapath API RESTful Service starting Nov 3 08:31:41 kjcf05n02 dp-api-server-node[15322]: INFO[2024-11-03T08:31:41-06:00] Datapath API RESTful Service starting Nov 3 08:31:41 kjcf05n02 RFSF-API[15322]: INFO[2024-11-03T08:31:41-06:00] Running in production mode, starting dbus event listener Nov 3 08:31:41 kjcf05n02 dp-api-server-node[15322]: INFO[2024-11-03T08:31:41-06:00] Running in production mode, starting dbus event listener Nov 3 08:31:41 kjcf05n02 RFSF-API[15322]: INFO[2024-11-03T08:31:41-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 08:31:41 kjcf05n02 dp-api-server-node[15322]: INFO[2024-11-03T08:31:41-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 08:31:41 kjcf05n02 RFSF-API[15322]: INFO[2024-11-03T08:31:41-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 08:31:41 kjcf05n02 dp-api-server-node[15322]: INFO[2024-11-03T08:31:41-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 08:31:41 kjcf05n02 RFSF-API[15322]: INFO[2024-11-03T08:31:41-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 08:31:41 kjcf05n02 dp-api-server-node[15322]: INFO[2024-11-03T08:31:41-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 08:31:41 kjcf05n02 RFSF-API[15322]: INFO[2024-11-03T08:31:41-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 08:31:41 kjcf05n02 dp-api-server-node[15322]: INFO[2024-11-03T08:31:41-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 08:31:41 kjcf05n02 RFSF-API[15322]: INFO[2024-11-03T08:31:41-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 08:31:41 kjcf05n02 dp-api-server-node[15322]: INFO[2024-11-03T08:31:41-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 08:31:41 kjcf05n02 RFSF-API[15322]: INFO[2024-11-03T08:31:41-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 08:31:41 kjcf05n02 dp-api-server-node[15322]: INFO[2024-11-03T08:31:41-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 08:31:41 kjcf05n02 RFSF-API[15322]: INFO[2024-11-03T08:31:41-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 08:31:41 kjcf05n02 dp-api-server-node[15322]: INFO[2024-11-03T08:31:41-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 08:31:41 kjcf05n02 RFSF-API[15322]: INFO[2024-11-03T08:31:41-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 08:31:41 kjcf05n02 dp-api-server-node[15322]: INFO[2024-11-03T08:31:41-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 08:31:41 kjcf05n02 RFSF-API[15322]: INFO[2024-11-03T08:31:41-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 08:31:41 kjcf05n02 dp-api-server-node[15322]: INFO[2024-11-03T08:31:41-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 08:31:41 kjcf05n02 RFSF-API[15322]: INFO[2024-11-03T08:31:41-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 08:31:41 kjcf05n02 dp-api-server-node[15322]: INFO[2024-11-03T08:31:41-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 08:31:44 kjcf05n01 diskmonitor[1331407]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 3 08:31:44 kjcf05n01 diskmonitor[1331407]: leaving test state: 8 next state: 20 Nov 3 08:31:44 kjcf05n01 diskmonitor[1331407]: leaving test state: 20 next state: 40 Nov 3 08:31:44 kjcf05n01 diskmonitor[1331407]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset 136089a8000 Nov 3 08:31:44 kjcf05n01 diskmonitor[1331407]: leaving test state: 40 next state: 80 Nov 3 08:31:47 kjcf05n02 systemd[1]: Reloading. Nov 3 08:31:48 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 08:31:48 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 08:31:48 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 08:31:49 kjcf05n02 dcs-collectord[5661]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 08:31:49 kjcf05n02 dcs-collectord[5661]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 08:31:49 kjcf05n02 dcs-collectord[5661]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 08:31:49 kjcf05n02 diskmonitor_pre[15881]: Key management is currently disabled.DEAR disabled Nov 3 08:31:49 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 08:31:49 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 17928 (bash) Nov 3 08:31:49 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 08:31:49 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 08:31:49 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 08:31:49 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 08:31:49 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 08:31:50 kjcf05n02 sh[15877]: LNET configured: New Created Nov 3 08:31:50 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 08:31:50 kjcf05n02 LCNmon[18025]: Interface ib0 is up Nov 3 08:31:50 kjcf05n02 LCNmon[18025]: Interface ib1 is up Nov 3 08:31:50 kjcf05n02 LCNmon[18025]: Can ping through interface ib0 Nov 3 08:31:50 kjcf05n00 httpd[902571]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 08:31:51 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 08:31:51 kjcf05n02 LCNmon[18025]: Can ping through interface ib1 Nov 3 08:31:51 kjcf05n02 LCNmon[18025]: NIC ib0, initial state UP Nov 3 08:31:51 kjcf05n02 LCNmon[18025]: NIC ib1, initial state UP Nov 3 08:31:51 kjcf05n02 LCNmon[18025]: LCNstat initial state UP Nov 3 08:31:51 kjcf05n02 LCNmon[18025]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: /var/run/diskmonitor does not exist, creating Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: Creating /var/run/diskmonitor/disk Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: Creating /var/run/diskmonitor/encl Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: Creating /var/run/diskmonitor/cli Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: RAS_Interlocks_enabled: 1 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: add handler for sig: 14 sa_flags: 10000004 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: add handler for sig: 1 sa_flags: 10000004 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: add handler for sig: 2 sa_flags: 00000004 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: add handler for sig: 15 sa_flags: 00000004 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: add handler for sig: 6 sa_flags: 00000004 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: add handler for sig: 3 sa_flags: 00000004 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: add handler for sig: 30 sa_flags: 00000004 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: add handler for sig: 20 sa_flags: 00000004 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: add handler for sig: 10 sa_flags: 10000004 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: add handler for sig: 11 sa_flags: 00000004 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: add handler for sig: 7 sa_flags: 00000004 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: add handler for sig: 4 sa_flags: 00000004 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: add handler for sig: 8 sa_flags: 00000004 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: Using HA Baton locks - key: diskmonitor Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: Baton will be held for at most 570 seconds Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: DMMP Enabled: 0 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: random seed: bcb7734c Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: NVMe Enclosure: 1 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: ZFS Enclosure: 0 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: Dbus, Initialized Connection Successfully Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: int_catcher_thread: thread start Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: Received dbus message 4 org.freedesktop.DBus -> :1.98 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 08:31:53 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 08:31:53 kjcf05n02 openhpid[5567]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 08:31:53 kjcf05n02 openhpid[5567]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 08:31:53 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 3 08:31:53 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 08:31:53 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 08:31:53 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18393 which is not our child. We'll most likely not notice when it exits. Nov 3 08:31:53 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 08:31:53 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 3 08:31:53 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 3 08:31:53 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 08:31:53 kjcf05n02 dcs-collectord[5661]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 08:31:53 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 08:31:53 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 08:31:53 kjcf05n02 systemd[1]: Startup finished in 47.539s (kernel) + 2min 30.369s (userspace) = 3min 17.908s. Nov 3 08:31:53 kjcf05n02 openhpid[18393]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 08:31:53 kjcf05n02 openhpid[18393]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 08:31:53 kjcf05n02 openhpid[18393]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 08:31:53 kjcf05n02 openhpid[18393]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 08:31:54 kjcf05n01 diskmonitor[1331407]: leaving test state: 80 next state: 100 Nov 3 08:31:54 kjcf05n01 diskmonitor[1331407]: lock release: time: Sun Nov 3 08:31:52 2024 Nov 3 08:31:54 kjcf05n01 diskmonitor[1331407]: leaving test state: 100 next state: 1 Nov 3 08:31:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730644314', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(3192.0B/2312.0B), ib1=(2632.0B/2136.0B), icl0=(7.7kB/9.4kB), lo=(1080.0B/1080.0B), meth0=(1541.7MB/8.4MB), mgmt0=(1478.4MB/8.3MB)'}"] Nov 3 08:31:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(3192.0B/2312.0B), ib1=(2632.0B/2136.0B), icl0=(7.7kB/9.4kB), lo=(1080.0B/1080.0B), meth0=(1541.7MB/8.4MB), mgmt0=(1478.4MB/8.3MB)', 'message': 'NET OK - (Rx/Tx) ib0=(3192.0B/2312.0B), ib1=(2632.0B/2136.0B), icl0=(7.7kB/9.4kB), lo=(1080.0B/1080.0B), meth0=(1541.7MB/8.4MB), mgmt0=(1478.4MB/8.3MB)', 'value': 'ok', 'timestamp': '1730644314'} Nov 3 08:31:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:31:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730644315', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 08:31:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730644315'} Nov 3 08:31:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: check_run_sedcmd, No Device name provided Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 08:31:57 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 08:32:00 kjcf05n00 mcfcli[3673891]: %3|1730644320.802|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 08:32:02 kjcf05n00 mcfcli[3673891]: %3|1730644322.083|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:32:04 kjcf05n02 dcs-collectord[5661]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 08:32:04 kjcf05n02 dcs-collectord[5661]: WARNING No data collected (hpi_parser.py:353) Nov 3 08:32:05 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31400 deleted. Nov 3 08:32:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730644325', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 3.00, 2.89, 1.31'}"] Nov 3 08:32:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 3.00, 2.89, 1.31', 'message': 'OK - load average: 3.00, 2.89, 1.31', 'value': 'ok', 'timestamp': '1730644325'} Nov 3 08:32:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:32:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730644326', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 359 processes with STATE = RSZDT '}"] Nov 3 08:32:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 359 processes with STATE = RSZDT ', 'message': 'PROCS OK: 359 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730644326'} Nov 3 08:32:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:32:11 kjcf05n03 nslcd[6947]: [16e9e8] ldap_result() failed: Can't contact LDAP server Nov 3 08:32:17 kjcf05n02 ipmievd[4003]: System Event sensor - Timestamp Clock Sync Nov 3 08:32:19 kjcf05n02 ipmievd[3159]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:32:19 kjcf05n02 dcs-collectord[5661]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 08:32:30 kjcf05n00 mcfcli[3673891]: %3|1730644350.803|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 08:32:32 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 08:32:34 kjcf05n02 dcs-collectord[5661]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 08:32:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730644355', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 08:32:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730644355'} Nov 3 08:32:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:32:39 kjcf05n03 firmware-update-orc-server[5875]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "58521d51-7dfe-4bf9-806b-f4a6cb447830"} (logger.py:65) Nov 3 08:32:39 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 197718 (get_disk_device) Nov 3 08:32:39 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 08:32:39 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 08:32:39 kjcf05n03 ccp-client[197741]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 08:32:39 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '7a4128c8-99f0-11ef-8d4d-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 08:32:39 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '7a4128c8-99f0-11ef-8d4d-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 08:32:39 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '7a4128c8-99f0-11ef-8d4d-00093d0695e3', 'response ID': '7a4b684c-99f0-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 08:32:39 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 7a4b684c-99f0-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 08:32:39 kjcf05n00 mcfcli[3673891]: %3|1730644359.505|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:32:39 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked theIEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 08:32:39 kjcf05n02 ras-resource-manager-agent[5925]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "7a4128c8-99f0-11ef-8d4d-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 08:32:39 kjcf05n02 ras-resource-manager-agent[5925]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '7a4128c8-99f0-11ef-8d4d-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 08:32:39 kjcf05n02 ras-resource-manager-agent[5925]: INFO Submitting new device inserted signal, starting to qualify drive: 7a4128c8-99f0-11ef-8d4d-00093d0695e3 (admin_action.py:110) Nov 3 08:32:40 kjcf05n03 ccp-client[197741]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 08:32:40 kjcf05n03 ccp-client[197750]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 08:32:40 kjcf05n03 ccp-client[197741]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 08:32:40 kjcf05n03 ccp-client[197750]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 08:32:40 kjcf05n03 ccp-client[197750]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 08:32:40 kjcf05n03 ccp-client[197741]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 08:32:39 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '7a943fc2-99f0-11ef-8d4d-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 08:32:39 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '7a943fc2-99f0-11ef-8d4d-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 08:32:39 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '7a943fc2-99f0-11ef-8d4d-00093d0695e3', 'response ID': '7a9b52bc-99f0-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 08:32:39 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 7a9b52bc-99f0-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 08:32:40 kjcf05n02 diskmonitor[17519]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 08:32:40 kjcf05n02 ras-resource-manager-agent[5925]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "7a943fc2-99f0-11ef-8d4d-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 08:32:40 kjcf05n02 ras-resource-manager-agent[5925]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '7a943fc2-99f0-11ef-8d4d-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 08:32:40 kjcf05n02 ras-resource-manager-agent[5925]: INFO Submitting new device inserted signal, starting to qualify drive: 7a943fc2-99f0-11ef-8d4d-00093d0695e3 (admin_action.py:110) Nov 3 08:32:40 kjcf05n02 firmware-update-orc-server[5881]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "6b29eab8-1e98-48bc-84ce-b698a551a89a"} (logger.py:65) Nov 3 08:32:43 kjcf05n03 DRVFW[197862]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 08:32:43 kjcf05n03 ccp-client[197863]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 08:32:43 kjcf05n03 ccp-client[197863]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 08:32:43 kjcf05n03 ccp-client[197863]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 08:32:43 kjcf05n03 ccp-client[197863]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 08:32:43 kjcf05n03 ccp-client[197886]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 08:32:43 kjcf05n03 ccp-client[197886]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 08:32:43 kjcf05n03 ccp-client[197886]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 08:32:43 kjcf05n03 firmware-update-orc-server[5875]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 08:32:44 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 7a4b684c-99f0-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 08:32:44 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '7a4128c8-99f0-11ef-8d4d-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '7a4128c8-99f0-11ef-8d4d-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}}} (logger.py:65) Nov 3 08:32:44 kjcf05n02 ras-resource-manager-agent[5925]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '7a4128c8-99f0-11ef-8d4d-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 08:32:44 kjcf05n02 ras-resource-manager-agent[5925]: INFO Drive qualification complete responding: 7a4128c8-99f0-11ef-8d4d-00093d0695e3 (admin_action.py:205) Nov 3 08:32:44 kjcf05n02 ras-resource-manager-agent[5925]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "7a4128c8-99f0-11ef-8d4d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (interesting_event.py:59) Nov 3 08:32:48 kjcf05n02 diskmonitor[17519]: drive: eui.345950304db009960025384500000004 Nov 3 08:32:48 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 08:32:48 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 08:32:48 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 08:32:48 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 08:32:48 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 08:32:48 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 08:32:48 kjcf05n02 diskmonitor[17519]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 08:32:48 kjcf05n02 diskmonitor[17519]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 08:32:48 kjcf05n02 diskmonitor[17519]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 08:32:48 kjcf05n02 diskmonitor[17519]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 08:32:48 kjcf05n02 diskmonitor[17519]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 08:32:48 kjcf05n02 diskmonitor[17519]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "7a4128c8-99f0-11ef-8d4d-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 08:32:48 kjcf05n02 diskmonitor[17519]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 08:32:48 kjcf05n02 diskmonitor[17519]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 08:32:48 kjcf05n02 diskmonitor[17519]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "7a943fc2-99f0-11ef-8d4d-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 08:32:48 kjcf05n02 diskmonitor[17519]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 08:32:48 kjcf05n02 diskmonitor[17519]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 08:32:50 kjcf05n02 chronyd[5170]: Selected source 172.16.2.1 Nov 3 08:32:50 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 3 08:32:50 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22377 (get_disk_device) Nov 3 08:32:50 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 08:32:50 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 08:32:50 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 08:32:50 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 3 08:32:50 kjcf05n02 ccp-client[22400]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 08:32:50 kjcf05n02 ccp-client[22400]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 08:32:50 kjcf05n02 ccp-client[22409]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 08:32:50 kjcf05n02 ccp-client[22400]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 08:32:50 kjcf05n02 ccp-client[22400]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 08:32:50 kjcf05n02 ccp-client[22409]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 08:32:50 kjcf05n02 ccp-client[22409]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 08:32:53 kjcf05n02 DRVFW[22607]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 08:32:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730644373}"] Nov 3 08:32:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730644373, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:32:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:32:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730644373}"] Nov 3 08:32:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730644373, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:32:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:32:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730644373}"] Nov 3 08:32:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730644373, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:32:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:32:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730644373}"] Nov 3 08:32:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730644373, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:32:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:32:54 kjcf05n02 ccp-client[22618]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 08:32:54 kjcf05n02 ccp-client[22618]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 08:32:54 kjcf05n02 ccp-client[22665]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 08:32:54 kjcf05n02 ccp-client[22618]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 08:32:54 kjcf05n02 ccp-client[22618]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 08:32:54 kjcf05n02 ccp-client[22665]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 08:32:54 kjcf05n02 ccp-client[22665]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 08:32:54 kjcf05n02 firmware-update-orc-server[5881]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 08:32:54 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 7a9b52bc-99f0-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 08:32:54 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '7a943fc2-99f0-11ef-8d4d-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '7a943fc2-99f0-11ef-8d4d-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 13}}}} (logger.py:65) Nov 3 08:32:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730644373}"] Nov 3 08:32:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730644373, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:32:54 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:32:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730644373}"] Nov 3 08:32:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730644373, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:32:54 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:32:54 kjcf05n02 ras-resource-manager-agent[5925]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '7a943fc2-99f0-11ef-8d4d-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 13}}} (resource_admin.py:98) Nov 3 08:32:54 kjcf05n02 ras-resource-manager-agent[5925]: INFO Drive qualification complete responding: 7a943fc2-99f0-11ef-8d4d-00093d0695e3 (admin_action.py:205) Nov 3 08:32:54 kjcf05n02 ras-resource-manager-agent[5925]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "7a943fc2-99f0-11ef-8d4d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 13}}} (interesting_event.py:59) Nov 3 08:32:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730644374}"] Nov 3 08:32:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730644374, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:32:54 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:32:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730644374}"] Nov 3 08:32:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730644374, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:32:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:33:00 kjcf05n00 mcfcli[3673891]: %3|1730644380.804|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 08:33:02 kjcf05n02 python3.9[5231]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 08:33:03 kjcf05n02 python3.9[3159]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:33:03 kjcf05n02 ras-resource-manager-agent[5925]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "7a4128c8-99f0-11ef-8d4d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (service_main_handler.py:66) Nov 3 08:33:03 kjcf05n02 ras-resource-manager-agent[5925]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '7a4128c8-99f0-11ef-8d4d-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 08:33:03 kjcf05n02 ras-resource-manager-agent[5925]: INFO Device qualification response has been acknowledged: 7a4128c8-99f0-11ef-8d4d-00093d0695e3 (admin_action.py:151) Nov 3 08:33:03 kjcf05n02 ras-resource-manager-agent[5925]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "7a943fc2-99f0-11ef-8d4d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 13}}} (service_main_handler.py:66) Nov 3 08:33:03 kjcf05n02 ras-resource-manager-agent[5925]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '7a943fc2-99f0-11ef-8d4d-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 13}}} (resource_admin.py:98) Nov 3 08:33:03 kjcf05n02 ras-resource-manager-agent[5925]: INFO Device qualification response has been acknowledged: 7a943fc2-99f0-11ef-8d4d-00093d0695e3 (admin_action.py:151) Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "7a4128c8-99f0-11ef-8d4d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: Dbus, handle_ingress_ras_signals, uuid: 7a4128c8-99f0-11ef-8d4d-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "7a4128c8-99f0-11ef-8d4d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "7a943fc2-99f0-11ef-8d4d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 13}}} Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: Dbus, handle_ingress_ras_signals, uuid: 7a943fc2-99f0-11ef-8d4d-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "7a943fc2-99f0-11ef-8d4d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 13}}} Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 08:33:05 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 08:33:07 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 08:33:07 kjcf05n02 diskmonitor[17519]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 08:33:12 kjcf05n02 diskmonitor[17519]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 08:33:12 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 08:33:12 kjcf05n02 diskmonitor[17519]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 08:33:12 kjcf05n02 diskmonitor[17519]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 08:33:12 kjcf05n02 diskmonitor[17519]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 08:33:12 kjcf05n02 diskmonitor[17519]: leaving test state: 1 next state: 2 Nov 3 08:33:12 kjcf05n02 diskmonitor[17519]: lock req: no timeout Nov 3 08:33:12 kjcf05n02 diskmonitor[17519]: leaving test state: 2 next state: 4 Nov 3 08:33:12 kjcf05n02 diskmonitor[17519]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 08:33:17 kjcf05n00 mcfcli[3673891]: %3|1730644397.085|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:33:23 kjcf05n00 zabbix-server[1105329]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:33:23 kjcf05n00 zabbix-server[1105329]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 133.13\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 100.24\\"}}"' Nov 3 08:33:23 kjcf05n00 log_interesting_event.py[1105329]: Event '46018' acknowledged Nov 3 08:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T08:33:27.253230373-06:00 level=info msg="Completed cleanup jobs" duration=26.183748ms Nov 3 08:33:30 kjcf05n00 mcfcli[3673891]: %3|1730644410.804|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 08:33:54 kjcf05n00 mcfcli[3673891]: %3|1730644434.745|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:34:00 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 08:34:00 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 08:34:00 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 08:34:00 kjcf05n00 mcfcli[3673891]: %3|1730644440.805|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 08:34:05 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31424 deleted. Nov 3 08:34:11 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 08:34:11 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 08:34:11 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 08:34:14 kjcf05n02 dcs-collectord[5661]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 08:34:23 kjcf05n02 diskmonitor[17519]: lock acquired Nov 3 08:34:23 kjcf05n02 diskmonitor[17519]: leaving test state: 4 next state: 8 Nov 3 08:34:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730644463}"] Nov 3 08:34:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730644463, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:34:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:34:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:34:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:34:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:34:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:34:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:34:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:34:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:34:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:34:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:34:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:34:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:34:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:34:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.106756ms Nov 3 08:34:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:34:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.106756ms Nov 3 08:34:23 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:34:23 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:34:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:34:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730644463}"] Nov 3 08:34:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730644463, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:34:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:34:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:34:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:34:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:34:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:34:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:34:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:34:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:34:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:34:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:34:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:34:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:34:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:34:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.047505ms Nov 3 08:34:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:34:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.047505ms Nov 3 08:34:23 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:34:23 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:34:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:34:30 kjcf05n00 mcfcli[3673891]: %3|1730644470.805|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:34:32 kjcf05n00 mcfcli[3673891]: %3|1730644472.403|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:34:37 kjcf05n02 diskmonitor[17519]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 08:34:37 kjcf05n02 diskmonitor[17519]: leaving test state: 8 next state: 20 Nov 3 08:34:37 kjcf05n02 diskmonitor[17519]: leaving test state: 20 next state: 40 Nov 3 08:34:37 kjcf05n02 diskmonitor[17519]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 2d02de10000 Nov 3 08:34:37 kjcf05n02 diskmonitor[17519]: leaving test state: 40 next state: 80 Nov 3 08:35:01 kjcf05n00 mcfcli[3673891]: %3|1730644501.135|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 08:35:06 kjcf05n00 python3.9[1106268]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 08:35:09 kjcf05n00 zabbix-server[1106582]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:35:09 kjcf05n00 zabbix-server[1106582]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n02' from event '46024' Nov 3 08:35:09 kjcf05n00 zabbix-server[1106582]: Host created 'enclosure_USE26000024VS001' Nov 3 08:35:09 kjcf05n00 zabbix-server[1106582]: Running puppet on 'kjcf05n02' Nov 3 08:35:11 kjcf05n02 puppet-agent[29093]: Using configured environment 'production' Nov 3 08:35:11 kjcf05n02 puppet-agent[29093]: Retrieving pluginfacts Nov 3 08:35:11 kjcf05n02 puppet-agent[29093]: Retrieving plugin Nov 3 08:35:12 kjcf05n02 puppet-agent[29093]: Loading facts Nov 3 08:35:12 kjcf05n00 mcfcli[3673891]: %3|1730644512.400|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:35:14 kjcf05n02 puppet-agent[29093]: Caching catalog for kjcf05n02 Nov 3 08:35:14 kjcf05n02 puppet-agent[29093]: Applying configuration version '1730644512' Nov 3 08:35:16 kjcf05n02 puppet-agent[29093]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 08:35:16 kjcf05n02 puppet-agent[29093]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 08:35:16 kjcf05n02 puppet-agent[29093]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 08:35:17 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 08:35:17 kjcf05n02 zabbix_agent2[6009]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 08:35:17 kjcf05n02 zabbix_agent2[3159]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:35:17 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 08:35:17 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 08:35:17 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 08:35:17 kjcf05n02 puppet-agent[29093]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: Press Ctrl+C to exit. Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: Plugin support version 1.0 Nov 3 08:35:17 kjcf05n02 zabbix_agent2[29466]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 08:35:19 kjcf05n02 puppet-agent[29093]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 08:35:19 kjcf05n02 puppet-agent[29093]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 08:35:19 kjcf05n02 puppet-agent[29093]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 08:35:19 kjcf05n02 puppet-agent[29093]: Applied catalog in 5.14 seconds Nov 3 08:35:19 kjcf05n00 zabbix-server[1106582]: puppet completed status:(0): '' Nov 3 08:35:19 kjcf05n00 zabbix-server[1106582]: Event '46024' acknowledged Nov 3 08:35:19 kjcf05n00 zabbix-server[1106582]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n02"}' Nov 3 08:35:23 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 08:35:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730644219', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 08:35:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730644219'} Nov 3 08:35:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:35:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730644219', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 08:35:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730644219'} Nov 3 08:35:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:35:28 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 08:35:31 kjcf05n00 mcfcli[3673891]: %3|1730644531.135|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 08:35:39 kjcf05n02 diskmonitor[17519]: leaving test state: 80 next state: 100 Nov 3 08:35:39 kjcf05n02 diskmonitor[17519]: lock release: time: Sun Nov 3 08:35:32 2024 Nov 3 08:35:39 kjcf05n02 diskmonitor[17519]: leaving test state: 100 next state: 1 Nov 3 08:35:45 kjcf05n00 mcfcli[3673891]: %3|1730644545.157|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:35:47 kjcf05n00 zabbix-server[1106960]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:35:47 kjcf05n00 zabbix-server[1106960]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 73.16\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 73.28\\"}}"' Nov 3 08:35:47 kjcf05n00 log_interesting_event.py[1106960]: Event '46025' acknowledged Nov 3 08:35:58 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 08:36:01 kjcf05n00 mcfcli[3673891]: %3|1730644561.136|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 08:36:23 kjcf05n00 mcfcli[3673891]: %3|1730644583.176|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:36:31 kjcf05n00 mcfcli[3673891]: %3|1730644591.136|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 08:37:01 kjcf05n00 mcfcli[3673891]: %3|1730644621.136|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 08:37:01 kjcf05n00 mcfcli[3673891]: %3|1730644621.185|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:37:31 kjcf05n00 mcfcli[3673891]: %3|1730644651.136|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:37:39 kjcf05n00 mcfcli[3673891]: %3|1730644659.193|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:38:01 kjcf05n00 mcfcli[3673891]: %3|1730644681.137|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:38:16 kjcf05n00 mcfcli[3673891]: %3|1730644696.876|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:38:31 kjcf05n00 mcfcli[3673891]: %3|1730644711.137|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:38:56 kjcf05n00 mcfcli[3673891]: %3|1730644736.873|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:39:01 kjcf05n00 mcfcli[3673891]: %3|1730644741.137|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:39:31 kjcf05n00 mcfcli[3673891]: %3|1730644771.308|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 08:39:35 kjcf05n00 mcfcli[3673891]: %3|1730644775.494|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:39:48 kjcf05n00 diskmonitor[2758297]: leaving test state: 1 next state: 2 Nov 3 08:39:48 kjcf05n00 diskmonitor[2758297]: lock req: no timeout Nov 3 08:39:48 kjcf05n00 diskmonitor[2758297]: leaving test state: 2 next state: 4 Nov 3 08:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 08:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 08:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 08:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 08:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 08:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 08:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 08:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 08:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 08:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 08:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 08:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 08:40:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 08:40:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:40:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 08:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 08:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 08:40:01 kjcf05n00 mcfcli[3673891]: %3|1730644801.308|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:40:06 kjcf05n00 python3.9[1109309]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 08:40:13 kjcf05n00 mcfcli[3673891]: %3|1730644813.566|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:40:18 kjcf05n00 diskmonitor[2758297]: lock acquired Nov 3 08:40:18 kjcf05n00 diskmonitor[2758297]: leaving test state: 4 next state: 8 Nov 3 08:40:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730644219', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 08:40:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730644219'} Nov 3 08:40:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:40:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730644219', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 08:40:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730644219'} Nov 3 08:40:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:40:21 kjcf05n00 diskmonitor[2758297]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 3 08:40:21 kjcf05n00 diskmonitor[2758297]: leaving test state: 8 next state: 20 Nov 3 08:40:21 kjcf05n00 diskmonitor[2758297]: leaving test state: 20 next state: 40 Nov 3 08:40:21 kjcf05n00 diskmonitor[2758297]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset 2d28bc0000 Nov 3 08:40:21 kjcf05n00 diskmonitor[2758297]: leaving test state: 40 next state: 80 Nov 3 08:40:31 kjcf05n00 mcfcli[3673891]: %3|1730644831.308|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 08:40:51 kjcf05n00 mcfcli[3673891]: %3|1730644851.934|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:41:01 kjcf05n00 mcfcli[3673891]: %3|1730644861.309|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:41:17 kjcf05n00 diskmonitor[2758297]: leaving test state: 80 next state: 100 Nov 3 08:41:17 kjcf05n00 diskmonitor[2758297]: lock release: time: Sun Nov 3 08:41:15 2024 Nov 3 08:41:17 kjcf05n00 diskmonitor[2758297]: leaving test state: 100 next state: 1 Nov 3 08:41:31 kjcf05n00 mcfcli[3673891]: %3|1730644891.310|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:41:31 kjcf05n00 mcfcli[3673891]: %3|1730644891.931|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:42:01 kjcf05n00 mcfcli[3673891]: %3|1730644921.310|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 08:42:09 kjcf05n00 mcfcli[3673891]: %3|1730644929.878|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:42:24 kjcf05n02 root[42155]: failback_xyraid Nov 3 08:42:25 kjcf05n02 root[42277]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 08:42:27 kjcf05n02 root[42435]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 08:42:29 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 3 08:42:31 kjcf05n00 mcfcli[3673891]: %3|1730644951.310|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 08:42:33 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme25n1 Nov 3 08:42:33 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme9n1 Nov 3 08:42:33 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme4n1 Nov 3 08:42:33 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme3n1 Nov 3 08:42:33 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme19n1 Nov 3 08:42:33 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme17n1 Nov 3 08:42:33 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme24n1 Nov 3 08:42:33 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme2n1 Nov 3 08:42:33 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme23n1 Nov 3 08:42:33 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme18n1 Nov 3 08:42:33 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme8n1 Nov 3 08:42:35 kjcf05n02 dwd[5202]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 08:42:35 kjcf05n02 dwd[5202]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 08:42:35 kjcf05n02 dwd[5202]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 08:42:35 kjcf05n02 dwd[5202]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 08:42:35 kjcf05n02 dwd[5202]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 08:42:35 kjcf05n02 dwd[5202]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 08:42:35 kjcf05n02 dwd[5202]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 08:42:35 kjcf05n02 dwd[5202]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 08:42:35 kjcf05n02 dwd[5202]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 08:42:35 kjcf05n02 dwd[5202]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 08:42:35 kjcf05n02 dwd[5202]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 08:42:35 kjcf05n02 dwd[5202]: Starting NVME thread for nvme2n1 Nov 3 08:42:35 kjcf05n02 dwd[5202]: Starting NVME thread for nvme18n1 Nov 3 08:42:36 kjcf05n02 dwd[5202]: Starting NVME thread for nvme19n1 Nov 3 08:42:36 kjcf05n02 dwd[5202]: Starting NVME thread for nvme9n1 Nov 3 08:42:36 kjcf05n02 dwd[5202]: Starting NVME thread for nvme3n1 Nov 3 08:42:36 kjcf05n02 systemd-udevd[45305]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45306]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45307]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45309]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45305]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45306]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45307]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45309]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45307]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45305]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45306]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45309]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45306]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45307]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45305]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45309]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45307]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45306]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45305]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45309]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45330]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45307]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45306]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45305]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45331]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45333]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45309]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45335]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45330]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45306]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45305]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45307]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45331]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45333]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45335]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45330]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45307]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45305]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45306]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45331]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45333]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45330]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45306]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45307]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45305]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45331]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45330]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45307]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45305]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45306]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45305]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45307]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45305]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45307]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45305]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45305]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45307]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45305]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45307]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45305]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45307]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45305]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45307]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 systemd-udevd[45307]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:42:36 kjcf05n02 dwd[5202]: Starting NVME thread for nvme24n1 Nov 3 08:42:37 kjcf05n02 nslcd[6963]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 08:42:37 kjcf05n02 dwd[5202]: Starting NVME thread for nvme4n1 Nov 3 08:42:37 kjcf05n02 dwd[5202]: Starting NVME thread for nvme23n1 Nov 3 08:42:37 kjcf05n02 dwd[5202]: Starting NVME thread for nvme17n1 Nov 3 08:42:37 kjcf05n02 dwd[5202]: Starting NVME thread for nvme25n1 Nov 3 08:42:37 kjcf05n02 dwd[5202]: Starting NVME thread for nvme8n1 Nov 3 08:42:40 kjcf05n02 dcs-bulk-data-sender[6206]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 3 08:42:48 kjcf05n00 mcfcli[3673891]: %3|1730644968.115|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:42:48 kjcf05n02 diskmonitor[17519]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 08:42:55 kjcf05n02 diskmonitor[17519]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 08:42:55 kjcf05n02 diskmonitor[17519]: Scan for ReadErrorMax change for md65 Nov 3 08:42:55 kjcf05n02 diskmonitor[17519]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 08:42:55 kjcf05n02 diskmonitor[17519]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 08:42:55 kjcf05n02 diskmonitor[17519]: read_saved_file: md65 no saved speed Nov 3 08:42:55 kjcf05n02 diskmonitor[17519]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 08:42:55 kjcf05n02 diskmonitor[17519]: Set sync_speed_min (10000) for md65 Nov 3 08:42:55 kjcf05n02 diskmonitor[17519]: Set sync_speed_max (200000) for md65 Nov 3 08:42:55 kjcf05n02 diskmonitor[17519]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 08:43:01 kjcf05n00 mcfcli[3673891]: %3|1730644981.311|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 08:43:14 kjcf05n03 diskmonitor[17713]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 08:43:14 kjcf05n03 diskmonitor[17713]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 08:43:23 kjcf05n00 mcfcli[3673891]: %3|1730645003.574|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T08:43:27.253043318-06:00 level=info msg="Completed cleanup jobs" duration=26.224082ms Nov 3 08:43:31 kjcf05n00 mcfcli[3673891]: %3|1730645011.311|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:43:33 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 48444 (bash) Nov 3 08:43:33 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 08:43:33 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 08:43:38 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 08:43:38 kjcf05n02 systemd-tmpfiles[48738]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 08:43:38 kjcf05n02 systemd-tmpfiles[48738]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 08:43:38 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 08:43:38 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 08:44:01 kjcf05n00 mcfcli[3673891]: %3|1730645041.090|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:44:01 kjcf05n00 mcfcli[3673891]: %3|1730645041.311|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:44:08 kjcf05n00 zabbix-server[1112321]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:44:08 kjcf05n00 zabbix-server[1112321]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46029' Nov 3 08:44:08 kjcf05n00 zabbix-server[1112321]: Filesystem 'kjcf05' has been mounted Nov 3 08:44:09 kjcf05n00 zabbix-server[1112321]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 08:44:09 kjcf05n00 zabbix-server[1112321]: Running puppet on 'None' Nov 3 08:44:11 kjcf05n02 puppet-agent[49921]: Using configured environment 'production' Nov 3 08:44:11 kjcf05n02 puppet-agent[49921]: Retrieving pluginfacts Nov 3 08:44:11 kjcf05n02 puppet-agent[49921]: Retrieving plugin Nov 3 08:44:11 kjcf05n05 puppet-agent[2864948]: Using configured environment 'production' Nov 3 08:44:11 kjcf05n05 puppet-agent[2864948]: Retrieving pluginfacts Nov 3 08:44:11 kjcf05n05 puppet-agent[2864948]: Retrieving plugin Nov 3 08:44:11 kjcf05n05 puppet-agent[2864948]: Loading facts Nov 3 08:44:11 kjcf05n06 puppet-agent[2718398]: Using configured environment 'production' Nov 3 08:44:11 kjcf05n06 puppet-agent[2718398]: Retrieving pluginfacts Nov 3 08:44:11 kjcf05n06 puppet-agent[2718398]: Retrieving plugin Nov 3 08:44:11 kjcf05n03 puppet-agent[218207]: Using configured environment 'production' Nov 3 08:44:11 kjcf05n03 puppet-agent[218207]: Retrieving pluginfacts Nov 3 08:44:11 kjcf05n03 puppet-agent[218207]: Retrieving plugin Nov 3 08:44:11 kjcf05n03 puppet-agent[218207]: Loading facts Nov 3 08:44:11 kjcf05n04 puppet-agent[2717855]: Using configured environment 'production' Nov 3 08:44:11 kjcf05n04 puppet-agent[2717855]: Retrieving pluginfacts Nov 3 08:44:11 kjcf05n04 puppet-agent[2717855]: Retrieving plugin Nov 3 08:44:11 kjcf05n07 puppet-agent[2716221]: Using configured environment 'production' Nov 3 08:44:11 kjcf05n07 puppet-agent[2716221]: Retrieving pluginfacts Nov 3 08:44:11 kjcf05n07 puppet-agent[2716221]: Retrieving plugin Nov 3 08:44:11 kjcf05n07 puppet-agent[2716221]: Loading facts Nov 3 08:44:11 kjcf05n02 puppet-agent[49921]: Loading facts Nov 3 08:44:11 kjcf05n01 puppet-agent[2999225]: Using configured environment 'production' Nov 3 08:44:11 kjcf05n01 puppet-agent[2999225]: Retrieving pluginfacts Nov 3 08:44:11 kjcf05n01 puppet-agent[2999225]: Retrieving plugin Nov 3 08:44:11 kjcf05n01 puppet-agent[2999225]: Loading facts Nov 3 08:44:11 kjcf05n06 puppet-agent[2718398]: Loading facts Nov 3 08:44:11 kjcf05n04 puppet-agent[2717855]: Loading facts Nov 3 08:44:11 kjcf05n00 puppet-agent[1112387]: Using configured environment 'production' Nov 3 08:44:11 kjcf05n00 puppet-agent[1112387]: Retrieving pluginfacts Nov 3 08:44:11 kjcf05n00 puppet-agent[1112387]: Retrieving plugin Nov 3 08:44:11 kjcf05n00 puppet-agent[1112387]: Loading facts Nov 3 08:44:14 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 08:44:14 kjcf05n07 puppet-agent[2716221]: Caching catalog for kjcf05n07 Nov 3 08:44:14 kjcf05n07 puppet-agent[2716221]: Applying configuration version '1730645052' Nov 3 08:44:14 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 08:44:14 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 08:44:15 kjcf05n02 puppet-agent[49921]: Caching catalog for kjcf05n02 Nov 3 08:44:15 kjcf05n02 puppet-agent[49921]: Applying configuration version '1730645052' Nov 3 08:44:15 kjcf05n06 puppet-agent[2718398]: Caching catalog for kjcf05n06 Nov 3 08:44:15 kjcf05n06 puppet-agent[2718398]: Applying configuration version '1730645053' Nov 3 08:44:16 kjcf05n01 puppet-agent[2999225]: Caching catalog for kjcf05n01 Nov 3 08:44:16 kjcf05n03 puppet-agent[218207]: Caching catalog for kjcf05n03 Nov 3 08:44:16 kjcf05n03 puppet-agent[218207]: Applying configuration version '1730645052' Nov 3 08:44:16 kjcf05n01 puppet-agent[2999225]: Applying configuration version '1730645054' Nov 3 08:44:16 kjcf05n07 puppet-agent[2716221]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 08:44:16 kjcf05n07 puppet-agent[2716221]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 08:44:16 kjcf05n07 puppet-agent[2716221]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 08:44:17 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2663552]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 08:44:17 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 08:44:17 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 08:44:17 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 08:44:17 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 08:44:17 kjcf05n07 puppet-agent[2716221]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: Press Ctrl+C to exit. Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: Plugin support version 1.0 Nov 3 08:44:17 kjcf05n07 zabbix_agent2[2716685]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 08:44:17 kjcf05n02 puppet-agent[49921]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 08:44:17 kjcf05n02 puppet-agent[49921]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 08:44:17 kjcf05n02 puppet-agent[49921]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 08:44:17 kjcf05n00 puppet-agent[1112387]: Caching catalog for kjcf05n00 Nov 3 08:44:17 kjcf05n00 puppet-agent[1112387]: Applying configuration version '1730645055' Nov 3 08:44:18 kjcf05n06 puppet-agent[2718398]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 08:44:18 kjcf05n06 puppet-agent[2718398]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 08:44:18 kjcf05n06 puppet-agent[2718398]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 08:44:18 kjcf05n03 puppet-agent[218207]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 08:44:18 kjcf05n03 puppet-agent[218207]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 08:44:18 kjcf05n03 puppet-agent[218207]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 08:44:18 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 08:44:18 kjcf05n02 zabbix_agent2[29466]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 08:44:18 kjcf05n02 zabbix_agent2[3159]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 08:44:18 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 08:44:18 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 08:44:18 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 08:44:18 kjcf05n02 puppet-agent[49921]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: Press Ctrl+C to exit. Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: Plugin support version 1.0 Nov 3 08:44:18 kjcf05n02 zabbix_agent2[50314]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 08:44:18 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2666107]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 08:44:18 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 08:44:18 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 08:44:18 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 08:44:18 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 08:44:18 kjcf05n06 puppet-agent[2718398]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: Press Ctrl+C to exit. Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: Plugin support version 1.0 Nov 3 08:44:18 kjcf05n06 zabbix_agent2[2718835]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 08:44:18 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 08:44:18 kjcf05n03 zabbix_agent2[162985]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 08:44:18 kjcf05n03 zabbix_agent2[3176]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 08:44:18 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 08:44:18 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 08:44:18 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 08:44:18 kjcf05n03 puppet-agent[218207]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: Press Ctrl+C to exit. Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: Plugin support version 1.0 Nov 3 08:44:18 kjcf05n03 zabbix_agent2[218873]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 08:44:19 kjcf05n01 puppet-agent[2999225]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 08:44:19 kjcf05n01 puppet-agent[2999225]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-08:24:29]/mode) mode changed '0755' to '0750' Nov 3 08:44:19 kjcf05n01 puppet-agent[2999225]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-08:24:29/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 08:44:19 kjcf05n01 puppet-agent[2999225]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-08:24:29/vmcore]/mode) mode changed '0600' to '0640' Nov 3 08:44:19 kjcf05n01 puppet-agent[2999225]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-08:24:29/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 08:44:19 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 08:44:19 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 08:44:19 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 08:44:19 kjcf05n07 puppet-agent[2716221]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 08:44:19 kjcf05n07 puppet-agent[2716221]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 08:44:19 kjcf05n07 puppet-agent[2716221]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 08:44:19 kjcf05n07 puppet-agent[2716221]: Applied catalog in 5.15 seconds Nov 3 08:44:20 kjcf05n01 puppet-agent[2999225]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 08:44:20 kjcf05n01 puppet-agent[2999225]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 08:44:20 kjcf05n01 puppet-agent[2999225]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 08:44:20 kjcf05n02 puppet-agent[49921]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 08:44:20 kjcf05n06 puppet-agent[2718398]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 08:44:20 kjcf05n06 puppet-agent[2718398]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 08:44:20 kjcf05n06 puppet-agent[2718398]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 08:44:20 kjcf05n02 puppet-agent[49921]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 08:44:20 kjcf05n02 puppet-agent[49921]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 08:44:20 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2986804]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 08:44:20 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 08:44:20 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 08:44:20 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 08:44:20 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 08:44:20 kjcf05n01 puppet-agent[2999225]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: Press Ctrl+C to exit. Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: Plugin support version 1.0 Nov 3 08:44:20 kjcf05n01 zabbix_agent2[2999574]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 08:44:20 kjcf05n06 puppet-agent[2718398]: Applied catalog in 4.89 seconds Nov 3 08:44:20 kjcf05n03 puppet-agent[218207]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 08:44:20 kjcf05n03 puppet-agent[218207]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 08:44:20 kjcf05n03 puppet-agent[218207]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 08:44:21 kjcf05n02 puppet-agent[49921]: Applied catalog in 5.29 seconds Nov 3 08:44:20 kjcf05n00 puppet-agent[1112387]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 08:44:21 kjcf05n03 puppet-agent[218207]: Applied catalog in 5.20 seconds Nov 3 08:44:21 kjcf05n00 puppet-agent[1112387]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 08:44:21 kjcf05n00 puppet-agent[1112387]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 08:44:21 kjcf05n00 puppet-agent[1112387]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 08:44:22 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1093780]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 08:44:22 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 08:44:22 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 08:44:22 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 08:44:22 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 08:44:22 kjcf05n00 puppet-agent[1112387]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: Press Ctrl+C to exit. Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: Plugin support version 1.0 Nov 3 08:44:22 kjcf05n00 zabbix_agent2[1112909]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 08:44:23 kjcf05n01 puppet-agent[2999225]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_083149.log]/mode) mode changed '0644' to '0640' Nov 3 08:44:23 kjcf05n01 puppet-agent[2999225]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_084333.log]/mode) mode changed '0644' to '0640' Nov 3 08:44:23 kjcf05n01 puppet-agent[2999225]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_084333]/mode) mode changed '0755' to '0750' Nov 3 08:44:23 kjcf05n01 puppet-agent[2999225]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_084333/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 08:44:22 kjcf05n00 zabbix-server[1112932]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:44:23 kjcf05n01 puppet-agent[2999225]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_083148.log]/mode) mode changed '0644' to '0640' Nov 3 08:44:23 kjcf05n01 puppet-agent[2999225]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_084333.log]/mode) mode changed '0644' to '0640' Nov 3 08:44:23 kjcf05n01 puppet-agent[2999225]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 08:44:23 kjcf05n01 puppet-agent[2999225]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 08:44:23 kjcf05n01 puppet-agent[2999225]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 08:44:23 kjcf05n00 zabbix-server[1112937]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:44:23 kjcf05n00 zabbix-server[1112960]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:44:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730645063}"] Nov 3 08:44:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730645063, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:44:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.243291ms Nov 3 08:44:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.243291ms Nov 3 08:44:24 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:44:24 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:44:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:44:24 kjcf05n00 zabbix-server[1112971]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:44:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730645063}"] Nov 3 08:44:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730645063, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:44:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.659811ms Nov 3 08:44:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.659811ms Nov 3 08:44:24 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:44:24 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:44:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:44:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730645063}"] Nov 3 08:44:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730645063, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:44:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.364759ms Nov 3 08:44:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.364759ms Nov 3 08:44:24 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:44:24 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:44:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:44:24 kjcf05n00 puppet-agent[1112387]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 08:44:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730645063}"] Nov 3 08:44:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730645063, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:44:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.208295ms Nov 3 08:44:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.208295ms Nov 3 08:44:24 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:44:24 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:44:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:44:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730645063}"] Nov 3 08:44:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730645063, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:44:24 kjcf05n01 puppet-agent[2999225]: Applied catalog in 8.77 seconds Nov 3 08:44:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.986129ms Nov 3 08:44:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.986129ms Nov 3 08:44:24 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:44:24 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:44:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:44:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730645063}"] Nov 3 08:44:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730645063, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:44:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 3.208098ms Nov 3 08:44:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 3.208098ms Nov 3 08:44:24 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:44:24 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:44:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:44:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730645063}"] Nov 3 08:44:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730645063, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:44:25 kjcf05n04 puppet-agent[2717855]: Caching catalog for kjcf05n04 Nov 3 08:44:25 kjcf05n04 puppet-agent[2717855]: Applying configuration version '1730645062' Nov 3 08:44:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.984937ms Nov 3 08:44:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.984937ms Nov 3 08:44:24 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:44:24 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:44:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:44:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730645063}"] Nov 3 08:44:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730645063, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:44:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.462492ms Nov 3 08:44:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.462492ms Nov 3 08:44:25 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:44:25 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:44:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:44:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730645063}"] Nov 3 08:44:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730645063, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:44:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.150798ms Nov 3 08:44:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.150798ms Nov 3 08:44:25 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:44:25 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:44:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:44:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730645063}"] Nov 3 08:44:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730645063, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:44:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.164774ms Nov 3 08:44:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.164774ms Nov 3 08:44:25 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:44:25 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:44:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:44:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730645063}"] Nov 3 08:44:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730645063, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 08:44:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 08:44:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T08:44:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 08:44:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T08:44:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 08:44:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T08:44:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 3.667639ms Nov 3 08:44:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T08:44:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 3.667639ms Nov 3 08:44:25 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:08:44:25 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 08:44:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:44:25 kjcf05n00 puppet-agent[1112387]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 08:44:25 kjcf05n00 puppet-agent[1112387]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 08:44:25 kjcf05n00 puppet-agent[1112387]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 08:44:26 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 08:44:26 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 08:44:26 kjcf05n00 puppet-agent[1112387]: Applied catalog in 8.62 seconds Nov 3 08:44:27 kjcf05n04 puppet-agent[2717855]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 08:44:27 kjcf05n04 puppet-agent[2717855]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 08:44:27 kjcf05n04 puppet-agent[2717855]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 08:44:27 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2672609]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 08:44:27 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 08:44:27 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 08:44:27 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 08:44:27 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 08:44:27 kjcf05n04 puppet-agent[2717855]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: Press Ctrl+C to exit. Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: Plugin support version 1.0 Nov 3 08:44:27 kjcf05n04 zabbix_agent2[2718943]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 08:44:29 kjcf05n04 puppet-agent[2717855]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 08:44:29 kjcf05n04 puppet-agent[2717855]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 08:44:29 kjcf05n04 puppet-agent[2717855]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 08:44:29 kjcf05n04 puppet-agent[2717855]: Applied catalog in 4.79 seconds Nov 3 08:44:31 kjcf05n00 mcfcli[3673891]: %3|1730645071.312|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 08:44:33 kjcf05n05 puppet-agent[2864948]: Caching catalog for kjcf05n05 Nov 3 08:44:33 kjcf05n05 puppet-agent[2864948]: Applying configuration version '1730645072' Nov 3 08:44:36 kjcf05n05 puppet-agent[2864948]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 08:44:36 kjcf05n05 puppet-agent[2864948]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 08:44:36 kjcf05n05 puppet-agent[2864948]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 08:44:37 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2817893]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 08:44:37 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 08:44:37 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 08:44:37 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 08:44:37 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 08:44:37 kjcf05n05 puppet-agent[2864948]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: Starting Zabbix Agent 2 (6.2.1) Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: Press Ctrl+C to exit. Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: Plugin support version 1.0 Nov 3 08:44:37 kjcf05n05 zabbix_agent2[2866778]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 08:44:37 kjcf05n00 mcfcli[3673891]: %3|1730645077.619|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:44:42 kjcf05n05 puppet-agent[2864948]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 08:44:42 kjcf05n05 puppet-agent[2864948]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 08:44:42 kjcf05n05 puppet-agent[2864948]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 08:44:42 kjcf05n05 puppet-agent[2864948]: Applied catalog in 8.64 seconds Nov 3 08:44:42 kjcf05n00 zabbix-server[1112321]: puppet completed status:(0): '' Nov 3 08:44:42 kjcf05n00 zabbix-server[1112321]: Event '46029' acknowledged Nov 3 08:44:42 kjcf05n00 zabbix-server[1112321]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 3 08:45:01 kjcf05n00 mcfcli[3673891]: %3|1730645101.312|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:45:06 kjcf05n00 python3.9[1113579]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 08:45:16 kjcf05n00 mcfcli[3673891]: %3|1730645116.618|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:45:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730645127', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 08:45:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730645127'} Nov 3 08:45:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:45:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730645127', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 08:45:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730645127'} Nov 3 08:45:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 08:45:31 kjcf05n00 mcfcli[3673891]: %3|1730645131.312|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 08:45:56 kjcf05n00 mcfcli[3673891]: %3|1730645156.615|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:46:01 kjcf05n00 mcfcli[3673891]: %3|1730645161.313|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:46:31 kjcf05n00 mcfcli[3673891]: %3|1730645191.313|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:46:34 kjcf05n00 mcfcli[3673891]: %3|1730645194.205|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:47:01 kjcf05n00 mcfcli[3673891]: %3|1730645221.314|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:47:12 kjcf05n00 mcfcli[3673891]: %3|1730645232.850|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:47:14 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 08:47:31 kjcf05n00 mcfcli[3673891]: %3|1730645251.314|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 08:47:50 kjcf05n02 dwd[5202]: nvme18n1 passed periodic SMART status check Nov 3 08:47:50 kjcf05n02 dwd[5202]: nvme2n1 passed periodic SMART status check Nov 3 08:47:51 kjcf05n02 dwd[5202]: nvme24n1 passed periodic SMART status check Nov 3 08:47:51 kjcf05n02 dwd[5202]: nvme19n1 passed periodic SMART status check Nov 3 08:47:51 kjcf05n02 dwd[5202]: nvme9n1 passed periodic SMART status check Nov 3 08:47:51 kjcf05n02 dwd[5202]: nvme3n1 passed periodic SMART status check Nov 3 08:47:51 kjcf05n00 mcfcli[3673891]: %3|1730645271.293|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:47:52 kjcf05n02 dwd[5202]: nvme23n1 passed periodic SMART status check Nov 3 08:47:52 kjcf05n02 dwd[5202]: nvme25n1 passed periodic SMART status check Nov 3 08:47:52 kjcf05n02 dwd[5202]: nvme17n1 passed periodic SMART status check Nov 3 08:47:52 kjcf05n02 dwd[5202]: nvme8n1 passed periodic SMART status check Nov 3 08:47:52 kjcf05n02 dwd[5202]: nvme4n1 passed periodic SMART status check Nov 3 08:48:01 kjcf05n00 mcfcli[3673891]: %3|1730645281.814|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 08:48:31 kjcf05n00 mcfcli[3673891]: %3|1730645311.290|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:48:31 kjcf05n00 mcfcli[3673891]: %3|1730645311.815|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 08:49:01 kjcf05n00 mcfcli[3673891]: %3|1730645341.815|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 08:49:05 kjcf05n00 mcfcli[3673891]: %3|1730645345.067|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:49:31 kjcf05n00 mcfcli[3673891]: %3|1730645371.816|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 08:49:42 kjcf05n00 mcfcli[3673891]: %3|1730645382.768|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 08:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 08:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 08:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 08:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 08:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 08:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 08:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 08:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 08:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 08:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 08:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 08:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 08:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 08:50:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 08:50:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 08:50:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 08:50:01 kjcf05n00 mcfcli[3673891]: %3|1730645401.817|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 08:50:06 kjcf05n00 python3.9[1116388]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 08:50:21 kjcf05n00 mcfcli[3673891]: %3|1730645421.646|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:50:31 kjcf05n00 mcfcli[3673891]: %3|1730645431.817|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 08:50:56 kjcf05n00 mcfcli[3673891]: %3|1730645456.084|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:51:01 kjcf05n00 mcfcli[3673891]: %3|1730645461.818|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:51:31 kjcf05n00 mcfcli[3673891]: %3|1730645491.818|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:51:35 kjcf05n00 mcfcli[3673891]: %3|1730645495.992|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:52:01 kjcf05n00 mcfcli[3673891]: %3|1730645521.819|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:52:11 kjcf05n03 nslcd[6947]: [0e0f76] ldap_result() failed: Can't contact LDAP server Nov 3 08:52:11 kjcf05n03 nslcd[6947]: [52255a] ldap_result() failed: Can't contact LDAP server Nov 3 08:52:14 kjcf05n00 mcfcli[3673891]: %3|1730645534.608|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:52:31 kjcf05n00 mcfcli[3673891]: %3|1730645551.820|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:52:45 kjcf05n00 zabbix-server[1118041]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:52:45 kjcf05n00 zabbix-server[1118041]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 118.44\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 78.29\\"}}"' Nov 3 08:52:46 kjcf05n00 log_interesting_event.py[1118041]: Event '46030' acknowledged Nov 3 08:52:54 kjcf05n00 mcfcli[3673891]: %3|1730645574.605|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:53:02 kjcf05n00 mcfcli[3673891]: %3|1730645582.143|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 08:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T14:53:15.867786Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 08:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T14:53:15.867874Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.110ms Nov 3 08:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T08:53:27.253801315-06:00 level=info msg="Completed cleanup jobs" duration=27.404222ms Nov 3 08:53:32 kjcf05n00 mcfcli[3673891]: %3|1730645612.144|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 08:53:32 kjcf05n00 mcfcli[3673891]: %3|1730645612.399|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:54:02 kjcf05n00 mcfcli[3673891]: %3|1730645642.144|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 08:54:11 kjcf05n00 mcfcli[3673891]: %3|1730645651.363|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:54:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 08:54:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 08:54:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 08:54:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 08:54:32 kjcf05n00 mcfcli[3673891]: %3|1730645672.144|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 08:54:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 08:54:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 08:54:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 08:54:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 08:54:38 kjcf05n00 zabbix_server[15737]: Zabbix agent item "dcs.lustre.device.discovery[{$LUSTRE_FS_NAME},mdt]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 3 08:54:38 kjcf05n00 zabbix_server[15739]: Zabbix agent item "vm.memory.size[total]" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 3 08:54:44 kjcf05n03 fstonithd.py[15381]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 3 08:54:45 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 08:54:45 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 08:54:45 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 08:54:46 kjcf05n03 root[235713]: is_enc_ipmi_off starts Nov 3 08:54:46 kjcf05n03 root[235714]: is_viking_off starts Nov 3 08:54:46 kjcf05n03 root[235739]: is_lan_ipmi_off leaves Nov 3 08:54:46 kjcf05n03 root[235741]: is_lan_ipmi_sec_off leaves Nov 3 08:54:46 kjcf05n03 root[235744]: I am in slot 1; partner is in slot 0 Nov 3 08:54:47 kjcf05n03 root[235750]: I am master Nov 3 08:54:51 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='13', error='Connection reset by peer (104)' Nov 3 08:54:51 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='13', client='AF_INET(172.16.2.5:34773)', local='AF_INET(0.0.0.0:601)' Nov 3 08:54:51 kjcf05n00 mcfcli[3673891]: %3|1730645691.360|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:54:53 kjcf05n00 zabbix_server[15771]: Zabbix agent item "net.if.in["ib1"]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 08:54:53 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.mdt.name[MDT0001,mdt_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 08:54:54 kjcf05n03 root[236121]: is_viking_off leaves Nov 3 08:54:54 kjcf05n03 root[236132]: kjcf05n02 not already off look at kdump Nov 3 08:54:54 kjcf05n03 root[236139]: is_kdump_off starts Nov 3 08:54:54 kjcf05n03 fence_kdump[236140]: waiting for message from '172.16.2.5' Nov 3 08:54:54 kjcf05n00 zabbix_server[15747]: Zabbix agent item "net.if.in["icl0"]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 08:54:54 kjcf05n03 fence_kdump[236140]: received valid message from '172.16.2.5' Nov 3 08:54:54 kjcf05n03 root[236149]: is_kdump_off detected kdump on kjcf05n02 Nov 3 08:54:54 kjcf05n03 root[236154]: kjcf05n02 is kdumping Nov 3 08:54:54 kjcf05n03 root[236289]: is_enc_ipmi_off starts Nov 3 08:54:54 kjcf05n03 root[236290]: is_viking_off starts Nov 3 08:54:55 kjcf05n03 root[236306]: is_lan_ipmi_off leaves Nov 3 08:54:55 kjcf05n03 root[236308]: is_lan_ipmi_sec_off leaves Nov 3 08:54:55 kjcf05n03 root[236311]: I am in slot 1; partner is in slot 0 Nov 3 08:54:55 kjcf05n03 root[236316]: I am master Nov 3 08:54:55 kjcf05n00 zabbix_server[15751]: Zabbix agent item "net.if.in["mgmt0"]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 08:54:55 kjcf05n00 zabbix_server[15748]: Zabbix agent item "dcs.lustre.device.ost.name[OST0000,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 08:54:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 08:54:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 08:54:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 08:54:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 08:54:56 kjcf05n00 zabbix_server[15768]: Zabbix agent item "dcs.lustre.device.ost.name[OST0001,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 08:54:56 kjcf05n00 zabbix_server[15725]: Zabbix agent item "net.if.in["ib0"]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 08:54:57 kjcf05n00 zabbix_server[15753]: Zabbix agent item "dcs.lustre.device.ost.name[OST0002,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 08:54:57 kjcf05n00 zabbix_server[15735]: Zabbix agent item "net.if.in["meth0"]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 08:54:58 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 08:54:58 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 08:54:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 08:54:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 08:55:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 08:55:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 08:55:02 kjcf05n03 root[236685]: is_viking_off leaves Nov 3 08:55:02 kjcf05n03 root[236688]: kjcf05n02 not already off look at kdump Nov 3 08:55:02 kjcf05n03 root[236689]: is_kdump_off starts Nov 3 08:55:02 kjcf05n03 fence_kdump[236690]: waiting for message from '172.16.2.5' Nov 3 08:55:02 kjcf05n00 mcfcli[3673891]: %3|1730645702.145|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 08:55:02 kjcf05n03 fence_kdump[236690]: received valid message from '172.16.2.5' Nov 3 08:55:02 kjcf05n03 root[236691]: is_kdump_off detected kdump on kjcf05n02 Nov 3 08:55:02 kjcf05n03 root[236692]: kjcf05n02 is kdumping Nov 3 08:55:06 kjcf05n03 systemd-udevd[238906]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:55:06 kjcf05n03 systemd-udevd[238908]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:55:06 kjcf05n03 systemd-udevd[238909]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238911]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238906]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238908]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238909]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238911]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238906]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238908]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238909]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238911]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238906]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238908]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238909]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238911]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238925]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238908]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238927]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238906]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238909]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238911]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238930]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238934]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238925]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238908]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238927]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238909]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238911]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238906]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238925]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238934]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238908]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238927]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238909]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238911]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238925]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238906]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238934]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238908]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238909]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238911]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238925]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238925]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238934]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238909]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238925]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238908]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238934]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238925]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238911]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238934]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238925]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238911]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238925]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238925]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238911]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238925]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238911]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238925]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238911]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238925]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238925]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 systemd-udevd[238925]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 08:55:07 kjcf05n03 dwd[5195]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 08:55:07 kjcf05n03 dwd[5195]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 08:55:07 kjcf05n03 dwd[5195]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 08:55:07 kjcf05n03 dwd[5195]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 08:55:07 kjcf05n03 dwd[5195]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 08:55:07 kjcf05n03 dwd[5195]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 08:55:07 kjcf05n03 dwd[5195]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 08:55:07 kjcf05n03 dwd[5195]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 08:55:07 kjcf05n03 dwd[5195]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 08:55:07 kjcf05n03 dwd[5195]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 08:55:07 kjcf05n03 dwd[5195]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 08:55:07 kjcf05n03 dwd[5195]: Starting NVME thread for nvme4n1 Nov 3 08:55:07 kjcf05n03 dwd[5195]: Starting NVME thread for nvme18n1 Nov 3 08:55:07 kjcf05n03 dwd[5195]: Starting NVME thread for nvme23n1 Nov 3 08:55:07 kjcf05n03 dwd[5195]: Starting NVME thread for nvme2n1 Nov 3 08:55:07 kjcf05n03 dwd[5195]: Starting NVME thread for nvme19n1 Nov 3 08:55:07 kjcf05n03 dwd[5195]: Starting NVME thread for nvme25n1 Nov 3 08:55:07 kjcf05n03 dwd[5195]: Starting NVME thread for nvme3n1 Nov 3 08:55:08 kjcf05n03 dwd[5195]: Starting NVME thread for nvme8n1 Nov 3 08:55:08 kjcf05n03 dwd[5195]: Starting NVME thread for nvme9n1 Nov 3 08:55:08 kjcf05n03 dwd[5195]: Starting NVME thread for nvme24n1 Nov 3 08:55:08 kjcf05n03 dwd[5195]: Starting NVME thread for nvme17n1 Nov 3 08:55:09 kjcf05n00 python3.9[1119261]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 08:55:12 kjcf05n03 diskmonitor[17713]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 08:55:12 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.swap.size[,pfree]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 08:55:12 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0001,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 08:55:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 08:55:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 08:55:23 kjcf05n03 diskmonitor[17713]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 08:55:23 kjcf05n03 diskmonitor[17713]: Scan for ReadErrorMax change for md65 Nov 3 08:55:23 kjcf05n03 diskmonitor[17713]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 08:55:23 kjcf05n03 diskmonitor[17713]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 08:55:23 kjcf05n03 diskmonitor[17713]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.min.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 08:55:23 kjcf05n03 diskmonitor[17713]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.max.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 08:55:23 kjcf05n03 diskmonitor[17713]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 08:55:23 kjcf05n03 diskmonitor[17713]: Set sync_speed_min (10000) for md65 Nov 3 08:55:23 kjcf05n03 diskmonitor[17713]: Set sync_speed_max (200000) for md65 Nov 3 08:55:23 kjcf05n03 diskmonitor[17713]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 08:55:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 08:55:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 08:55:27 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 3 08:55:27 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 3 08:55:30 kjcf05n00 mcfcli[3673891]: %3|1730645730.714|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:55:32 kjcf05n00 mcfcli[3673891]: %3|1730645732.145|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 08:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 08:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 08:55:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 08:55:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 08:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 08:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 08:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 08:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 08:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 08:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 08:55:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 08:55:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 08:56:02 kjcf05n00 mcfcli[3673891]: %3|1730645762.145|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:56:08 kjcf05n00 mcfcli[3673891]: %3|1730645768.535|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:56:15 kjcf05n03 nslcd[6947]: [ed7263] ldap_result() failed: Can't contact LDAP server Nov 3 08:56:15 kjcf05n03 nslcd[6947]: [dcc233] ldap_result() failed: Can't contact LDAP server Nov 3 08:56:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 08:56:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 08:56:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 08:56:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 08:56:32 kjcf05n00 mcfcli[3673891]: %3|1730645792.145|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 08:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 08:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 08:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 08:56:48 kjcf05n00 mcfcli[3673891]: %3|1730645808.532|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 08:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 08:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 08:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 08:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 08:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 08:56:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 08:56:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 08:57:02 kjcf05n00 mcfcli[3673891]: %3|1730645822.146|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:57:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 08:57:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 08:57:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 08:57:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 08:57:26 kjcf05n00 mcfcli[3673891]: %3|1730645846.136|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:57:32 kjcf05n00 mcfcli[3673891]: %3|1730645852.146|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 08:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 08:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 08:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 08:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 08:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 08:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 08:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 08:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 08:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 08:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 08:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 08:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 08:58:02 kjcf05n00 mcfcli[3673891]: %3|1730645882.324|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:58:02 kjcf05n00 mcfcli[3673891]: %3|1730645882.873|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:58:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 08:58:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 08:58:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 08:58:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 08:58:32 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 3 08:58:32 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 08:58:32 kjcf05n00 mcfcli[3673891]: %3|1730645912.324|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 08:58:35 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 08:58:35 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 3 08:58:35 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 3 08:58:35 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 08:58:35 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 08:58:35 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 3 08:58:35 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 3 08:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 08:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 08:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 08:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 08:58:38 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 3 08:58:41 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 3 08:58:42 kjcf05n00 mcfcli[3673891]: %3|1730645922.870|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 08:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 08:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 08:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 08:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 08:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 08:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 08:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 08:59:02 kjcf05n00 mcfcli[3673891]: %3|1730645942.324|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 08:59:11 kjcf05n00 zabbix-server[1122038]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 08:59:11 kjcf05n00 zabbix-server[1122038]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 08:59:11 kjcf05n00 log_interesting_event.py[1122038]: Event '46032' acknowledged Nov 3 08:59:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 08:59:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 08:59:22 kjcf05n00 mcfcli[3673891]: %3|1730645962.651|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 1ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 08:59:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 08:59:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 08:59:28 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:38138). Nov 3 08:59:28 kjcf05n01 rsyncd[3005532]: connect from kjcf05n02 (172.16.2.5) Nov 3 08:59:28 kjcf05n01 rsyncd[3005532]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 08:59:28 kjcf05n01 rsyncd[3005532]: building file list Nov 3 08:59:28 kjcf05n01 rsyncd[3005532]: sent 11450 bytes received 136 bytes total size 10905 Nov 3 08:59:28 kjcf05n01 systemd[1]: rsyncd@613-172.16.2.2:873-172.16.2.5:38138.service: Succeeded. Nov 3 08:59:32 kjcf05n00 mcfcli[3673891]: %3|1730645972.324|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 08:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 08:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 08:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 08:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 08:59:44 kjcf05n03 fstonithd.py[15381]: Listening for kdump packets from partner Nov 3 08:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 08:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 08:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 08:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 08:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 08:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 08:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 08:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 09:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 09:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 09:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 09:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 09:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 09:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 09:00:00 kjcf05n00 mcfcli[3673891]: %3|1730646000.407|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 09:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 09:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 09:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 09:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 09:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 09:00:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 09:00:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:00:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 09:00:02 kjcf05n00 mcfcli[3673891]: %3|1730646002.324|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:00:07 kjcf05n00 python3.9[1122389]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 09:00:15 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 09:00:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 09:00:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 09:00:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 09:00:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 09:00:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730646026', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 09:00:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730646026'} Nov 3 09:00:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:00:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730646026', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 09:00:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730646026'} Nov 3 09:00:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:00:32 kjcf05n00 mcfcli[3673891]: %3|1730646032.324|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:00:32 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 09:00:33 kjcf05n03 dwd[5195]: nvme18n1 passed periodic SMART status check Nov 3 09:00:33 kjcf05n03 dwd[5195]: nvme3n1 passed periodic SMART status check Nov 3 09:00:33 kjcf05n03 dwd[5195]: nvme23n1 passed periodic SMART status check Nov 3 09:00:33 kjcf05n03 dwd[5195]: nvme4n1 passed periodic SMART status check Nov 3 09:00:33 kjcf05n03 dwd[5195]: nvme25n1 passed periodic SMART status check Nov 3 09:00:33 kjcf05n03 dwd[5195]: nvme2n1 passed periodic SMART status check Nov 3 09:00:33 kjcf05n03 dwd[5195]: nvme19n1 passed periodic SMART status check Nov 3 09:00:34 kjcf05n03 dwd[5195]: nvme24n1 passed periodic SMART status check Nov 3 09:00:34 kjcf05n03 dwd[5195]: nvme17n1 passed periodic SMART status check Nov 3 09:00:34 kjcf05n03 dwd[5195]: nvme8n1 passed periodic SMART status check Nov 3 09:00:34 kjcf05n03 dwd[5195]: nvme9n1 passed periodic SMART status check Nov 3 09:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 09:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 09:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 09:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 09:00:38 kjcf05n00 mcfcli[3673891]: %3|1730646038.332|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 09:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 09:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 09:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 09:00:57 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='34', client='AF_INET(172.16.2.5:45437)', local='AF_INET(0.0.0.0:601)' Nov 3 09:00:57 kjcf05n02 syslog-ng[3153]: Configuration reload request received, reloading configuration; Nov 3 09:00:57 kjcf05n02 syslog-ng[3153]: Configuration reload finished; Nov 3 09:00:57 kjcf05n02 syslog-ng[3153]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 09:00:57 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 3 09:00:57 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 09:00:57 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 3 09:00:57 kjcf05n02 dracut: Self testing crypto algorithms Nov 3 09:00:57 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 3 09:00:57 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 09:00:57 kjcf05n02 Copying live image to RAM... Nov 3 09:00:57 kjcf05n02 (this may take a minute) Nov 3 09:00:57 kjcf05n02 Done copying live image to RAM. Nov 3 09:00:57 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 09:00:57 kjcf05n02 dracut: Checking integrity of kernel Nov 3 09:00:57 kjcf05n02 dracut: All initrd crypto checks done Nov 3 09:00:57 kjcf05n02 dracut: Switching root Nov 3 09:00:57 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 09:00:57 kjcf05n02 systemd: Detected architecture x86-64. Nov 3 09:00:57 kjcf05n02 systemd: Set hostname to . Nov 3 09:00:57 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 09:00:57 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 09:00:57 kjcf05n02 systemd: Listening on udev Control Socket. Nov 3 09:00:57 kjcf05n02 systemd: Listening on Device-mapper event daemon FIFOs. Nov 3 09:00:57 kjcf05n02 systemd: Listening on udev Kernel Socket. Nov 3 09:00:57 kjcf05n02 systemd: Reached target ZFS pool import target. Nov 3 09:00:57 kjcf05n02 systemd: Created slice system-serial\x2dgetty.slice. Nov 3 09:00:57 kjcf05n02 systemd-journald[1524]: Journal started Nov 3 09:00:57 kjcf05n02 systemd-journald[1524]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 09:00:57 kjcf05n02 systemd-modules-load[1514]: Inserted module 'fuse' Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Load Kernel Modules. Nov 3 09:00:57 kjcf05n02 systemd[1]: Mounted Kernel Debug File System. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Create list of required static device nodes for the current kernel. Nov 3 09:00:57 kjcf05n02 systemd[1]: Mounted Temporary Directory (/tmp). Nov 3 09:00:57 kjcf05n02 systemd[1]: Mounted Huge Pages File System. Nov 3 09:00:57 kjcf05n02 systemd[1]: Mounting FUSE Control File System... Nov 3 09:00:57 kjcf05n02 systemd[1]: Mounting Kernel Configuration File System... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Apply Kernel Variables... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Load/Save Random Seed... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Rebuild Hardware Database... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Create System Users... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 09:00:57 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 3 09:00:57 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 3 09:00:57 kjcf05n02 systemd-sysctl[1537]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 3 09:00:57 kjcf05n02 systemd-sysctl[1537]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Create System Users. Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 09:00:57 kjcf05n02 systemd-journald[1524]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 09:00:57 kjcf05n02 systemd-tmpfiles[1545]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 09:00:57 kjcf05n02 systemd-tmpfiles[1545]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 3 09:00:57 kjcf05n02 systemd-udevd[1551]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 3 09:00:57 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 3 09:00:57 kjcf05n02 systemd-udevd[1585]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:00:57 kjcf05n02 systemd-udevd[1552]: Using default interface naming scheme 'rhel-8.0'. Nov 3 09:00:57 kjcf05n02 systemd-udevd[1552]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:00:57 kjcf05n02 systemd-udevd[1570]: Using default interface naming scheme 'rhel-8.0'. Nov 3 09:00:57 kjcf05n02 systemd-udevd[1570]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:00:57 kjcf05n02 systemd-udevd[1588]: Using default interface naming scheme 'rhel-8.0'. Nov 3 09:00:57 kjcf05n02 systemd-udevd[1588]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 09:00:57 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 3 09:00:57 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 09:00:57 kjcf05n02 systemd-tmpfiles[1790]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 09:00:57 kjcf05n02 systemd-tmpfiles[1790]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 09:00:57 kjcf05n02 root[1800]: openibd: running in auto mode Nov 3 09:00:57 kjcf05n02 systemd-tmpfiles[1790]: "/var/tmp" already exists and is not a directory. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 09:00:57 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 09:00:57 kjcf05n02 systemd[1]: Started RPC Bind. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 09:00:57 kjcf05n02 systemd-modules-load[1839]: Inserted module 'ib_iser' Nov 3 09:00:57 kjcf05n02 systemd-modules-load[1839]: Inserted module 'ib_isert' Nov 3 09:00:57 kjcf05n02 systemd-modules-load[1839]: Inserted module 'ib_srpt' Nov 3 09:00:57 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 09:00:57 kjcf05n02 systemd-modules-load[1829]: Inserted module 'ib_ipoib' Nov 3 09:00:57 kjcf05n02 systemd-udevd[1594]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:00:57 kjcf05n02 systemd-udevd[1601]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:00:57 kjcf05n02 systemd-modules-load[1839]: Inserted module 'rdma_ucm' Nov 3 09:00:57 kjcf05n02 systemd-modules-load[1839]: Module 'svcrdma' is blacklisted Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 09:00:57 kjcf05n02 systemd-udevd[1601]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 09:00:57 kjcf05n02 systemd-udevd[1594]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 09:00:57 kjcf05n02 systemd-modules-load[1829]: Inserted module 'ib_umad' Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 09:00:57 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 3 09:00:57 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 3 09:00:57 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 09:00:57 kjcf05n02 systemd[3153]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:00:57 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 09:00:57 kjcf05n02 openibd[1783]: Loading HCA driver and Access Layer:[ OK ] Nov 3 09:00:57 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Update is Completed. Nov 3 09:00:57 kjcf05n02 setup-icl[1754]: Setting LAN IP Address to 203.0.113.3 Nov 3 09:00:57 kjcf05n02 setup-icl[1754]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 09:00:57 kjcf05n02 setup-icl[1754]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 09:00:57 kjcf05n02 setup-icl[1754]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 09:00:57 kjcf05n02 systemd-udevd[1594]: Using default interface naming scheme 'rhel-8.0'. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 09:00:57 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 3 09:00:57 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 09:00:57 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 09:00:57 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 09:00:57 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 09:00:57 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 09:00:57 kjcf05n02 systemd[1]: Reached target Sockets. Nov 3 09:00:57 kjcf05n02 systemd[1]: Reached target Basic System. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 3 09:00:57 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 0 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 1 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 2 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 3 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 4 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 5 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 6 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 7 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 8 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 9 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 10 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 11 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 12 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 13 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 14 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 15 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 16 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 17 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 18 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 19 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 20 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 21 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 22 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 23 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 24 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 25 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 26 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 27 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 28 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 29 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 30 Nov 3 09:00:57 kjcf05n02 cpupower[2120]: Setting cpu: 31 Nov 3 09:00:57 kjcf05n02 nscd[2124]: 2124 monitoring file `/etc/hosts` (1) Nov 3 09:00:57 kjcf05n02 nscd[2124]: 2124 monitoring directory `/etc` (2) Nov 3 09:00:57 kjcf05n02 nscd[2124]: 2124 monitoring file `/etc/resolv.conf` (3) Nov 3 09:00:57 kjcf05n02 nscd[2124]: 2124 monitoring directory `/etc` (2) Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[2143]: Setting up Mellanox network interface: ib1 Nov 3 09:00:57 kjcf05n02 dbus-daemon[2119]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 09:00:57 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 09:00:57 kjcf05n02 dwd[2144]: dwd: vMay 29 2024 : 15:38:26 Nov 3 09:00:57 kjcf05n02 dwd[2144]: /usr/sbin/dwd -d --standalone=0 Nov 3 09:00:57 kjcf05n02 dwd[2144]: dwd: option Lethal: 0 Nov 3 09:00:57 kjcf05n02 dwd[2144]: dwd: option Interval: 60 Nov 3 09:00:57 kjcf05n02 dwd[2144]: dwd: option abrtlimit: 10 Nov 3 09:00:57 kjcf05n02 dwd[2144]: dwd: option DZPeriod: 604800 Nov 3 09:00:57 kjcf05n02 dwd[2144]: dwd: option SmartPeriod: 43200 Nov 3 09:00:57 kjcf05n02 dwd[2144]: dwd: option SDDEnabled: 1 Nov 3 09:00:57 kjcf05n02 dwd[2144]: dwd: option SDDAwaitScale: 3 Nov 3 09:00:57 kjcf05n02 dwd[2144]: dwd: option SDDAwaitMin: 100 Nov 3 09:00:57 kjcf05n02 dwd[2144]: dwd: option Verbosity: 1 Nov 3 09:00:57 kjcf05n02 dwd[2144]: dwd: option StandAlone: 0 Nov 3 09:00:57 kjcf05n02 dwd[2144]: option Lethal: 0 Nov 3 09:00:57 kjcf05n02 dwd[2144]: option Interval: 60 Nov 3 09:00:57 kjcf05n02 dwd[2144]: option abrtlimit: 10 Nov 3 09:00:57 kjcf05n02 dwd[2144]: option DZPeriod: 604800 Nov 3 09:00:57 kjcf05n02 dwd[2144]: option SmartPeriod: 43200 Nov 3 09:00:57 kjcf05n02 dwd[2144]: option SDDEnabled: 1 Nov 3 09:00:57 kjcf05n02 dwd[2144]: option SDDAwaitScale: 3 Nov 3 09:00:57 kjcf05n02 dwd[2144]: option SDDAwaitMin: 100 Nov 3 09:00:57 kjcf05n02 dwd[2144]: option Verbosity: 1 Nov 3 09:00:57 kjcf05n02 dwd[2144]: option StandAlone: 0 Nov 3 09:00:57 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 09:00:57 kjcf05n02 network[2151]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 09:00:57 kjcf05n02 mcelog[2202]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 09:00:57 kjcf05n02 mcelog[2202]: CPU is unsupported Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[2183]: Setting up Mellanox network interface: ib0 Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 09:00:57 kjcf05n02 network[2196]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 09:00:57 kjcf05n02 network[2151]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 09:00:57 kjcf05n02 mdraid-phy[2229]: no Cutlass to worry about Nov 3 09:00:57 kjcf05n02 network[2231]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:00:57 kjcf05n02 network[2151]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 09:00:57 kjcf05n02 chronyd[2262]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[2239]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 0 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 1 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 2 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 3 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 4 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 5 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 6 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 7 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 8 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 9 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 10 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 11 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 12 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 13 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 14 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 15 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 16 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 17 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 18 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 19 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 20 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 21 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 22 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 23 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 24 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 25 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 26 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 27 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 28 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 29 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 30 Nov 3 09:00:57 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 31 Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 3 09:00:57 kjcf05n02 network[2258]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[2259]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 09:00:57 kjcf05n02 beSetMlxConfig[2260]: ConnectX-3 multiport not detected Nov 3 09:00:57 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[2278]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 09:00:57 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 09:00:57 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 09:00:57 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[2295]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[2301]: No configuration found for ib1 Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 09:00:57 kjcf05n02 chronyd[2262]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 09:00:57 kjcf05n02 chronyd[2262]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[2303]: No configuration found for ib0 Nov 3 09:00:57 kjcf05n02 sssd[sssd][2145]: Starting up Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[2315]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 09:00:57 kjcf05n02 beSetMlxConfig[2260]: Starting MST (Mellanox Software Tools) driver set Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[2327]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 09:00:57 kjcf05n02 mlnx_conf_mgr[2355]: INFO: No configurations found for mlx5_1, skipping. Nov 3 09:00:57 kjcf05n02 beSetMlxConfig[2260]: Loading MST PCI module - Success Nov 3 09:00:57 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 09:00:57 kjcf05n02 mlnx_conf_mgr[2377]: INFO: No configurations found for mlx5_0, skipping. Nov 3 09:00:57 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 09:00:57 kjcf05n02 beSetMlxConfig[2260]: Loading MST PCI configuration module - Success Nov 3 09:00:57 kjcf05n02 beSetMlxConfig[2260]: Create devices Nov 3 09:00:57 kjcf05n02 sssd[be[implicit_files]][2356]: Starting up Nov 3 09:00:57 kjcf05n02 sssd[nss][2457]: Starting up Nov 3 09:00:57 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 09:00:57 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Login Service... Nov 3 09:00:57 kjcf05n02 systemd-logind[2568]: New seat seat0. Nov 3 09:00:57 kjcf05n02 systemd-logind[2568]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Login Service. Nov 3 09:00:57 kjcf05n02 python3.9[2210]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 09:00:57 kjcf05n02 python3.9[3153]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 09:00:57 kjcf05n02 systemd-sysctl[2758]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 09:00:57 kjcf05n02 systemd-sysctl[2758]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 09:00:57 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 09:00:57 kjcf05n02 python3.9[2866]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 09:00:57 kjcf05n02 python3.9[3153]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 09:00:57 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 09:00:57 kjcf05n02 network[2151]: Bringing up loopback interface: [ OK ] Nov 3 09:00:57 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 09:00:57 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 09:00:57 kjcf05n02 systemd-sysctl[3088]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 09:00:57 kjcf05n02 systemd-sysctl[3088]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 09:00:57 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 3 09:00:57 kjcf05n02 systemd[1]: Reached target Network. Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 09:00:57 kjcf05n02 python3.9[3044]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 09:00:57 kjcf05n02 python3.9[3153]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 09:00:57 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 09:00:57 kjcf05n02 sm-notify[3163]: Version 2.3.3 starting Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 3 09:00:57 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 3 09:00:57 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 09:00:57 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 3 09:00:57 kjcf05n02 sshd[3172]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 3 09:00:57 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 09:00:57 kjcf05n02 lldpad[3139]: setsockopt nearest_bridge: Invalid argument Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 3 09:00:57 kjcf05n02 lldpad[3139]: setsockopt nearest_bridge: Invalid argument Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 09:00:57 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 3 09:00:57 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 3 09:00:57 kjcf05n02 syslog-ng[3153]: [2024-11-03T14:59:41.800501] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 09:00:57 kjcf05n02 syslog-ng[3153]: [2024-11-03T14:59:41.800785] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 09:00:57 kjcf05n02 syslog-ng[3153]: [2024-11-03T14:59:41.800823] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 09:00:57 kjcf05n02 syslog-ng[3153]: [2024-11-03T14:59:41.801408] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 09:00:57 kjcf05n02 syslog-ng[3153]: [2024-11-03T14:59:41.801728] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 09:00:57 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 3 09:00:57 kjcf05n02 python3.9[3217]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 09:00:57 kjcf05n02 python3.9[3153]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 09:00:57 kjcf05n02 beSetMlxConfig[2260]: Unloading MST PCI module (unused) - Success Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 09:00:57 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 09:00:57 kjcf05n02 python3.9[3450]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 09:00:57 kjcf05n02 python3.9[3153]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 09:00:57 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 09:00:57 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 09:00:57 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 09:00:57 kjcf05n02 chronyd[2262]: System's initial offset : 0.003048 seconds slow of true (slew) Nov 3 09:00:57 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 09:00:57 kjcf05n02 beSetMlxConfig[2260]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 09:00:57 kjcf05n02 beSetMlxConfig[2260]: ib mode Nov 3 09:00:57 kjcf05n02 root[3471]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 3 09:00:57 kjcf05n02 root[3473]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 3 09:00:57 kjcf05n02 beSetMlxConfig[2260]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 09:00:57 kjcf05n02 beSetMlxConfig[2260]: ib mode Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 09:00:57 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 09:00:57 kjcf05n02 systemd-udevd[1551]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 09:00:57 kjcf05n02 systemd-udevd[3491]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:00:57 kjcf05n02 systemd-udevd[3492]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:00:57 kjcf05n02 systemd-udevd[3495]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:00:57 kjcf05n02 systemd-udevd[3500]: Using default interface naming scheme 'rhel-8.0'. Nov 3 09:00:57 kjcf05n02 systemd-udevd[3500]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:00:57 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 09:00:57 kjcf05n02 systemd[3153]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:00:57 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[3534]: Setting up Mellanox network interface: ib0 Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[3533]: Setting up Mellanox network interface: ib1 Nov 3 09:00:57 kjcf05n02 systemd-udevd[3494]: Using default interface naming scheme 'rhel-8.0'. Nov 3 09:00:57 kjcf05n02 systemd-udevd[3493]: Using default interface naming scheme 'rhel-8.0'. Nov 3 09:00:57 kjcf05n02 systemd-udevd[3494]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:00:57 kjcf05n02 systemd-udevd[3493]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[3587]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[3586]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[3614]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[3615]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[3616]: No configuration found for ib0 Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[3617]: No configuration found for ib1 Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[3624]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[3625]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 09:00:57 kjcf05n02 mlnx_conf_mgr[3661]: INFO: No configurations found for mlx5_0, skipping. Nov 3 09:00:57 kjcf05n02 mlnx_conf_mgr[3665]: INFO: No configurations found for mlx5_1, skipping. Nov 3 09:00:57 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 09:00:57 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 09:00:57 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 3 09:00:57 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 3 09:00:57 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 09:00:57 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 3 09:00:57 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 3 09:00:57 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 09:00:57 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 09:00:57 kjcf05n02 lldpad[3139]: init_ports: Error adding device ib0 Nov 3 09:00:57 kjcf05n02 lldpad[3139]: init_ports: Error adding device ib1 Nov 3 09:00:57 kjcf05n02 lldpad[3139]: Signal 15 received - terminating Nov 3 09:00:57 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 3 09:00:57 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 09:00:57 kjcf05n02 systemd[1]: Reloading. Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 09:00:57 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 3 09:00:57 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 09:00:57 kjcf05n02 systemd[1]: Reloading. Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 3 09:00:57 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 3 09:00:57 kjcf05n02 systemd[1]: Reloading. Nov 3 09:00:57 kjcf05n02 systemd[3153]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:00:57 kjcf05n02 systemd[1]: Reloading. Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 1 | Nov-03-2024 | 14:30:11 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 2 | Nov-03-2024 | 14:31:03 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 3 | Nov-03-2024 | 14:31:03 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 4 | Nov-03-2024 | 14:32:09 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 5 | Nov-03-2024 | 14:32:09 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 6 | Nov-03-2024 | 14:57:01 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 7 | Nov-03-2024 | 14:57:01 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 8 | Nov-03-2024 | 14:57:01 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 9 | Nov-03-2024 | 14:57:01 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 10 | Nov-03-2024 | 14:57:01 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 11 | Nov-03-2024 | 14:57:01 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 12 | Nov-03-2024 | 14:57:01 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 13 | Nov-03-2024 | 14:57:01 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 14 | Nov-03-2024 | 14:57:01 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 15 | Nov-03-2024 | 14:57:01 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 16 | Nov-03-2024 | 14:57:01 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 17 | Nov-03-2024 | 14:57:01 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 18 | Nov-03-2024 | 14:57:31 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 19 | Nov-03-2024 | 14:57:31 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 20 | Nov-03-2024 | 14:57:31 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 21 | Nov-03-2024 | 14:57:31 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 22 | Nov-03-2024 | 14:57:31 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 23 | Nov-03-2024 | 14:57:31 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 24 | Nov-03-2024 | 14:57:31 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 25 | Nov-03-2024 | 14:57:31 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 26 | Nov-03-2024 | 14:57:31 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 27 | Nov-03-2024 | 14:57:31 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 28 | Nov-03-2024 | 14:57:31 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 29 | Nov-03-2024 | 14:57:31 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 30 | Nov-03-2024 | 14:57:31 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 31 | Nov-03-2024 | 14:57:31 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 32 | Nov-03-2024 | 14:57:31 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 33 | Nov-03-2024 | 14:57:31 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 34 | Nov-03-2024 | 14:57:31 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 35 | Nov-03-2024 | 14:57:31 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 36 | Nov-03-2024 | 14:57:31 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 37 | Nov-03-2024 | 14:57:31 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 38 | Nov-03-2024 | 14:57:31 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 39 | Nov-03-2024 | 14:57:31 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 40 | Nov-03-2024 | 14:57:32 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 41 | Nov-03-2024 | 14:57:32 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 42 | Nov-03-2024 | 14:57:32 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 43 | Nov-03-2024 | 14:57:32 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 44 | Nov-03-2024 | 14:57:32 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 45 | Nov-03-2024 | 14:57:32 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 46 | Nov-03-2024 | 14:57:32 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 47 | Nov-03-2024 | 14:57:32 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 48 | Nov-03-2024 | 14:57:32 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4008]: 49 | Nov-03-2024 | 14:57:32 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:00:57 kjcf05n02 ipmievd[4011]: Reading sensors... Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 3 09:00:57 kjcf05n02 systemd[1]: Reloading. Nov 3 09:00:57 kjcf05n02 systemd[3153]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 09:00:57 kjcf05n02 nscd[2124]: 2124 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 09:00:57 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 09:00:57 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 3 09:00:57 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 09:00:57 kjcf05n02 beSetMlxConfig[4067]: ConnectX-3 multiport not detected Nov 3 09:00:57 kjcf05n02 beSetMlxConfig[4067]: Starting MST (Mellanox Software Tools) driver set Nov 3 09:00:57 kjcf05n02 beSetMlxConfig[4067]: Loading MST PCI module - Success Nov 3 09:00:57 kjcf05n02 systemd-udevd[1551]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 09:00:57 kjcf05n02 beSetMlxConfig[4067]: [warn] mst_pciconf is already loaded, skipping Nov 3 09:00:57 kjcf05n02 beSetMlxConfig[4067]: Create devices Nov 3 09:00:57 kjcf05n02 beSetMlxConfig[4067]: Unloading MST PCI module (unused) - Success Nov 3 09:00:57 kjcf05n02 ipmievd[4011]: Waiting for events... Nov 3 09:00:57 kjcf05n02 beSetMlxConfig[4067]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 09:00:57 kjcf05n02 beSetMlxConfig[4067]: ib mode Nov 3 09:00:57 kjcf05n02 beSetMlxConfig[4067]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 09:00:57 kjcf05n02 beSetMlxConfig[4067]: ib mode Nov 3 09:00:57 kjcf05n02 systemd-udevd[1551]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 09:00:57 kjcf05n02 systemd-udevd[4968]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:00:57 kjcf05n02 systemd-udevd[4969]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:00:57 kjcf05n02 systemd-udevd[4972]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:00:57 kjcf05n02 systemd-udevd[4975]: Using default interface naming scheme 'rhel-8.0'. Nov 3 09:00:57 kjcf05n02 systemd-udevd[4975]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:00:57 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 09:00:57 kjcf05n02 systemd[3153]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:00:57 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[5010]: Setting up Mellanox network interface: ib0 Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[5011]: Setting up Mellanox network interface: ib1 Nov 3 09:00:57 kjcf05n02 systemd-udevd[4970]: Using default interface naming scheme 'rhel-8.0'. Nov 3 09:00:57 kjcf05n02 systemd-udevd[4971]: Using default interface naming scheme 'rhel-8.0'. Nov 3 09:00:57 kjcf05n02 systemd-udevd[4970]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:00:57 kjcf05n02 systemd-udevd[4971]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[5060]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[5061]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[5090]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[5092]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[5093]: No configuration found for ib0 Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[5094]: No configuration found for ib1 Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[5101]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 09:00:57 kjcf05n02 mlnx_interface_mgr[5102]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 09:00:57 kjcf05n02 mlnx_conf_mgr[5140]: INFO: No configurations found for mlx5_0, skipping. Nov 3 09:00:57 kjcf05n02 mlnx_conf_mgr[5142]: INFO: No configurations found for mlx5_1, skipping. Nov 3 09:00:57 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 09:00:57 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}2bc99388365dbd721c4bba5f9dc68b0d1a4fcdabcd4b365d47d32c0ba4bd6abc' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}2bc99388365dbd721c4bba5f9dc68b0d1a4fcdabcd4b365d47d32c0ba4bd6abc' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}cfd084037b09c978da7c517abcabf28bee70f600f5749af7b9aaedf96d05c080' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}cfd084037b09c978da7c517abcabf28bee70f600f5749af7b9aaedf96d05c080' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}443b69055d68b1eb2d90818529146e74a96894e8e4efbe344e35322ce6602168' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}443b69055d68b1eb2d90818529146e74a96894e8e4efbe344e35322ce6602168' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}57b84e8d351cfe6f75e0c345f32229b7e6fd90d73f07921154206ddba91c84a4' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}57b84e8d351cfe6f75e0c345f32229b7e6fd90d73f07921154206ddba91c84a4' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 09:00:57 kjcf05n02 chronyd[2262]: chronyd exiting Nov 3 09:00:57 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 3 09:00:57 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 3 09:00:57 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 09:00:57 kjcf05n02 chronyd[5178]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 09:00:57 kjcf05n02 chronyd[5178]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 09:00:57 kjcf05n02 chronyd[5178]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 09:00:57 kjcf05n02 chronyd[5178]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 09:00:57 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 09:00:57 kjcf05n02 systemd[1]: Reloading. Nov 3 09:00:57 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 09:00:57 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 3 09:00:57 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 09:00:57 kjcf05n02 dwd[5209]: dwd: vMay 29 2024 : 15:38:26 Nov 3 09:00:57 kjcf05n02 dwd[5209]: /usr/sbin/dwd -i 15 -d Nov 3 09:00:57 kjcf05n02 dwd[5209]: dwd: option Lethal: 0 Nov 3 09:00:57 kjcf05n02 dwd[5209]: dwd: option Interval: 15 Nov 3 09:00:57 kjcf05n02 dwd[5209]: dwd: option abrtlimit: 10 Nov 3 09:00:57 kjcf05n02 dwd[5209]: dwd: option DZPeriod: 604800 Nov 3 09:00:57 kjcf05n02 dwd[5209]: dwd: option SmartPeriod: 43200 Nov 3 09:00:57 kjcf05n02 dwd[5209]: dwd: option SDDEnabled: 1 Nov 3 09:00:57 kjcf05n02 dwd[5209]: dwd: option SDDAwaitScale: 3 Nov 3 09:00:57 kjcf05n02 dwd[5209]: dwd: option SDDAwaitMin: 100 Nov 3 09:00:57 kjcf05n02 dwd[5209]: dwd: option Verbosity: 1 Nov 3 09:00:57 kjcf05n02 dwd[5209]: dwd: option StandAlone: 0 Nov 3 09:00:57 kjcf05n02 dwd[5209]: option Lethal: 0 Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 09:00:57 kjcf05n02 dwd[5209]: option Interval: 15 Nov 3 09:00:57 kjcf05n02 dwd[5209]: option abrtlimit: 10 Nov 3 09:00:57 kjcf05n02 dwd[5209]: option DZPeriod: 604800 Nov 3 09:00:57 kjcf05n02 dwd[5209]: option SmartPeriod: 43200 Nov 3 09:00:57 kjcf05n02 dwd[5209]: option SDDEnabled: 1 Nov 3 09:00:57 kjcf05n02 dwd[5209]: option SDDAwaitScale: 3 Nov 3 09:00:57 kjcf05n02 dwd[5209]: option SDDAwaitMin: 100 Nov 3 09:00:57 kjcf05n02 dwd[5209]: option Verbosity: 1 Nov 3 09:00:57 kjcf05n02 dwd[5209]: option StandAlone: 0 Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 09:00:57 kjcf05n02 dwd[5210]: option Lethal now set to 1 Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 09:00:57 kjcf05n02 dwd[5210]: option abrtlimit now set to 1 Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 09:00:57 kjcf05n02 dwd[5210]: option SmartPeriod now set to 86400 Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 09:00:57 kjcf05n02 systemd[1]: Reloading. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 09:00:57 kjcf05n02 systemd[1]: Reloading. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:00:57 kjcf05n02 systemd[1]: Reloading. Nov 3 09:00:57 kjcf05n02 python3.9[5239]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 09:00:57 kjcf05n02 python3.9[3153]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 09:00:57 kjcf05n02 systemd[1]: Reloading. Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:00:57 kjcf05n02 systemd[1]: Reloading. Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 09:00:57 kjcf05n02 systemd[1]: Reloading. Nov 3 09:00:57 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 3 09:00:57 kjcf05n02 sedcpwrkr[5376]: Using config script: /etc/sedcpwrkr.conf Nov 3 09:00:57 kjcf05n02 sedcpwrkr[5376]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 09:00:57 kjcf05n02 sedcpwrkr[5376]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 09:00:57 kjcf05n02 sedcpwrkr[5376]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 09:00:57 kjcf05n02 sedcpwrkr[5376]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 09:00:57 kjcf05n02 sedcpwrkr[5376]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 09:00:57 kjcf05n02 sedcpwrkr[5376]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 09:00:57 kjcf05n02 sedcpwrkr-server[5407]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 09:00:57 kjcf05n02 sedcpwrkr[5376]: celery multi v5.2.7 (dawn-chorus) Nov 3 09:00:57 kjcf05n02 sedcpwrkr[5376]: > Starting nodes... Nov 3 09:00:57 kjcf05n02 sedcpwrkr[5376]: > sedcpwrkr@kjcf05n02: OK Nov 3 09:00:57 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 09:00:57 kjcf05n02 sedcpwrkr-server[5409]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 09:00:57 kjcf05n02 sedcpwrkr-server[5409]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 09:00:57 kjcf05n02 sedcpwrkr-server[5409]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 09:00:57 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 09:00:57 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 3 09:00:57 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 09:00:57 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 09:00:57 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 09:00:58 kjcf05n02 systemd[1]: Reloading. Nov 3 09:00:58 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 09:00:58 kjcf05n02 systemd-udevd[1551]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 09:00:58 kjcf05n02 iptables.init[5476]: iptables: Applying firewall rules: [ OK ] Nov 3 09:00:58 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 3 09:00:58 kjcf05n02 systemd[1]: Reloading. Nov 3 09:00:59 kjcf05n02 systemd[3153]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 09:00:59 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 09:00:59 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 09:00:59 kjcf05n02 systemd[1]: Reloading. Nov 3 09:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 09:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 09:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 09:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 09:01:00 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 09:01:00 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5573 which is not our child. We'll most likely not notice when it exits. Nov 3 09:01:00 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 09:01:00 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:00 kjcf05n02 openhpid[5573]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 09:01:00 kjcf05n02 openhpid[5573]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 09:01:00 kjcf05n02 openhpid[5573]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 09:01:00 kjcf05n02 openhpid[5573]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 09:01:00 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:00 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:01:00 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:01:00 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 09:01:00 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 09:01:00 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 09:01:00 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 09:01:00 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:01 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 09:01:01 kjcf05n02 dcs-collectord[5664]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 09:01:01 kjcf05n02 hpi.inv.log[5664]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 09:01:01 kjcf05n02 dcs-collectord[5664]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 09:01:01 kjcf05n02 dcs-collectord[5664]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 09:01:01 kjcf05n02 dcs-collector[5655]: Starting dcs-collector:[ OK ] Nov 3 09:01:01 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 09:01:01 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 09:01:01 kjcf05n02 dcs-collectord[5667]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 09:01:01 kjcf05n02 dcs-collectord[5667]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 09:01:01 kjcf05n02 dcs-collectord[5667]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 09:01:01 kjcf05n02 dcs-collectord[5667]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 09:01:01 kjcf05n02 dcs-collectord[5667]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 09:01:01 kjcf05n02 dcs-collectord[5667]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 09:01:01 kjcf05n02 dcs-collectord[5667]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 09:01:01 kjcf05n02 dcs-collectord[5667]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259346376", "units": "kB"}, {"name": "MemAvailable", "value": "258625852", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1820932", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686824", "units": "kB"}, {"name": "Inactive", "value": "960964", "units": "kB"}, {"name": "Active(anon)", "value": "1520784", "units": "kB"}, {"name": "Inactive(anon)", "value": "824848", "units": "kB"}, {"name": "Active(file)", "value": "166040", "units": "kB"}, {"name": "Inactive(file)", "value": "136116", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "751492", "units": "kB"}, {"name": "Mapped", "value": "85964", "units": "kB"}, {"name": "Shmem", "value": "1593228", "units": "kB"}, {"name": "KReclaimable", "value": "108960", "units": "kB"}, {"name": "Slab", "value": "276300", "units": "kB"}, {"name": "SReclaimable", "value": "108960", "units": "kB"}, {"name": "SUnreclaim", "value": "167340", "units": "kB"}, {"name": "KernelStack", "value": "9616", "units": "kB"}, {"name": "PageTables", "value": "20756", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3210884", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11392", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "6144", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "311624", "units": "kB"}, {"name": "DirectMap2M", "value": "23670784", "units": "kB"}, {"name": "DirectMap1G", "value": "244318208", "units": "kB"}]}' Nov 3 09:01:01 kjcf05n02 dcs-collectord[5667]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 09:01:01 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:01 kjcf05n02 systemd[3153]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:01:01 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:01:01 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:01:01 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 09:01:01 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 09:01:01 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 09:01:01 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 09:01:01 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:02 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 09:01:02 kjcf05n02 firmware-update-orc[5761]: Using config script: /etc/firmware_update_orc.conf Nov 3 09:01:02 kjcf05n02 firmware-update-orc[5761]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 09:01:02 kjcf05n02 firmware-update-orc[5761]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 09:01:02 kjcf05n02 firmware-update-orc[5761]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 09:01:02 kjcf05n02 firmware-update-orc[5761]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 09:01:02 kjcf05n02 firmware-update-orc[5761]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 09:01:02 kjcf05n02 firmware-update-orc[5761]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 09:01:02 kjcf05n02 dcs-collectord[5667]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 09:01:02 kjcf05n02 dcs-collectord[5667]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730646061.1819644], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730646062.3561463], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730646061.114925, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 09:01:02 kjcf05n02 firmware-update-orc-server[5798]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 09:01:02 kjcf05n02 firmware-update-orc[5761]: celery multi v5.2.7 (dawn-chorus) Nov 3 09:01:02 kjcf05n02 firmware-update-orc[5761]: > Starting nodes... Nov 3 09:01:02 kjcf05n02 firmware-update-orc[5761]: > worker1@kjcf05n02: OK Nov 3 09:01:02 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 09:01:02 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 09:01:02 kjcf05n02 firmware-update-orc-server[5826]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 09:01:02 kjcf05n00 mcfcli[3673891]: %3|1730646062.325|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 09:01:02 kjcf05n02 firmware-update-orc-server[5826]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 09:01:02 kjcf05n02 firmware-update-orc-server[5826]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 09:01:02 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 09:01:02 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:03 kjcf05n02 systemd[3153]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:01:03 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:01:03 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:01:03 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 09:01:03 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 09:01:03 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 09:01:03 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 09:01:03 kjcf05n02 dbus-daemon[2119]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 09:01:03 kjcf05n02 dbus-daemon[2119]: [system] Reloaded configuration Nov 3 09:01:03 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 09:01:03 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 09:01:03 kjcf05n02 dbus-daemon[2119]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 09:01:03 kjcf05n02 dbus-daemon[2119]: [system] Reloaded configuration Nov 3 09:01:03 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 09:01:03 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 09:01:03 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 09:01:03 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 09:01:03 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:03 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 3 09:01:03 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 09:01:04 kjcf05n02 ras-resource-manager-agent[5942]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 09:01:04 kjcf05n02 ras-resource-manager-agent[5928]: Starting ras-resource-manager-agent:[ OK ] Nov 3 09:01:04 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 09:01:04 kjcf05n02 ras-resource-manager-agent[5944]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 09:01:04 kjcf05n02 ras-resource-manager-client[5944]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 09:01:04 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 3 09:01:04 kjcf05n02 ras-resource-manager-client[5944]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 09:01:04 kjcf05n02 ras-resource-manager-client[5954]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 09:01:04 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:04 kjcf05n02 systemd[3153]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:01:04 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:01:04 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:01:04 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 09:01:04 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 09:01:04 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:04 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 09:01:04 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:05 kjcf05n02 systemd[3153]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: Press Ctrl+C to exit. Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: Plugin support version 1.0 Nov 3 09:01:05 kjcf05n02 zabbix_agent2[6028]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 09:01:05 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:01:05 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:01:05 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:05 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 09:01:05 kjcf05n02 dcs-notification-sender[6104]: dcs-notification-senderd is stopped Nov 3 09:01:05 kjcf05n02 zabbix-agent2[6118]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 09:01:05 kjcf05n02 dcs-notification-sender[6104]: Starting notification-sender:[ OK ] Nov 3 09:01:05 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 09:01:06 kjcf05n02 zabbix-agent2[6120]: INFO DCS notification agent started. (agent.py:61) Nov 3 09:01:06 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 09:01:06 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:06 kjcf05n02 systemd[3153]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:01:06 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:01:06 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:01:06 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:06 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 09:01:07 kjcf05n02 dcs-collectord[6210]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 09:01:07 kjcf05n02 dcs-collectord[6210]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 09:01:07 kjcf05n02 dcs-bulk-data-sender[6210]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 09:01:07 kjcf05n02 dcs-bulk-data-sender[6201]: Starting bulk-data-sender:[ OK ] Nov 3 09:01:07 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 09:01:07 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 09:01:07 kjcf05n02 dcs-collectord[6216]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 09:01:07 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:07 kjcf05n02 systemd[3153]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:01:07 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:01:07 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:01:07 kjcf05n02 nscd[2124]: 2124 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 09:01:07 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 09:01:07 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 09:01:07 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 09:01:07 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 09:01:07 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 09:01:07 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 09:01:07 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 09:01:07 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 09:01:07 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 09:01:07 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 09:01:07 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 09:01:07 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 09:01:07 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 09:01:07 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 09:01:08 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 09:01:08 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 09:01:08 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 09:01:08 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 09:01:08 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 09:01:08 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 09:01:08 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 3 09:01:08 kjcf05n02 sssd[nss][2457]: Shutting down (status = 0) Nov 3 09:01:08 kjcf05n02 sssd[be[implicit_files]][2356]: Shutting down (status = 0) Nov 3 09:01:08 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 3 09:01:08 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 3 09:01:08 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 09:01:08 kjcf05n02 python3.9[5239]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 09:01:08 kjcf05n02 python3.9[3153]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:01:08 kjcf05n02 sssd[sssd][6299]: Starting up Nov 3 09:01:08 kjcf05n02 sssd[be[implicit_files]][6300]: Starting up Nov 3 09:01:09 kjcf05n02 sssd[nss][6301]: Starting up Nov 3 09:01:09 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 09:01:09 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:01:09 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:10 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 09:01:10 kjcf05n02 icinga2[6359]: [2024-11-03 09:01:10 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 09:01:10 kjcf05n02 icinga2[6359]: [2024-11-03 09:01:10 -0600] information/cli: Loading configuration file(s). Nov 3 09:01:10 kjcf05n02 icinga2[6359]: [2024-11-03 09:01:10 -0600] information/ConfigItem: Committing config item(s). Nov 3 09:01:10 kjcf05n02 icinga2[6359]: [2024-11-03 09:01:10 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 3 09:01:10 kjcf05n02 icinga2[6359]: [2024-11-03 09:01:10 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 09:01:10 kjcf05n02 icinga2[6359]: [2024-11-03 09:01:10 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 09:01:10 kjcf05n02 icinga2[6359]: [2024-11-03 09:01:10 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 09:01:10 kjcf05n02 icinga2[6359]: [2024-11-03 09:01:10 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 09:01:10 kjcf05n02 icinga2[6359]: [2024-11-03 09:01:10 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 09:01:10 kjcf05n02 icinga2[6359]: [2024-11-03 09:01:10 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 09:01:10 kjcf05n02 icinga2[6359]: [2024-11-03 09:01:10 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 09:01:10 kjcf05n02 icinga2[6359]: [2024-11-03 09:01:10 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 09:01:10 kjcf05n02 icinga2[6359]: [2024-11-03 09:01:10 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 09:01:10 kjcf05n02 icinga2[6359]: [2024-11-03 09:01:10 -0600] information/cli: Closing console log. Nov 3 09:01:10 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 09:01:10 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:11 kjcf05n02 systemd[3153]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:01:11 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:01:11 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:01:11 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 09:01:11 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 09:01:11 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:12 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 3 09:01:12 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:12 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 09:01:12 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:01:12 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:01:12 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 09:01:12 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 09:01:12 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 09:01:12 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 09:01:12 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 09:01:12 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 09:01:12 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 09:01:12 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 09:01:12 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 09:01:12 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 09:01:12 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 09:01:12 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 09:01:12 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 09:01:12 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 09:01:13 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:13 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 09:01:13 kjcf05n02 nslcd[6978]: version 0.9.9 starting Nov 3 09:01:13 kjcf05n02 nslcd[6978]: accepting connections Nov 3 09:01:13 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 09:01:13 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:13 kjcf05n02 systemd[3153]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:01:13 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:01:13 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:01:13 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 09:01:13 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 09:01:14 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 09:01:14 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 09:01:14 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 09:01:14 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 09:01:14 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 09:01:14 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 09:01:14 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:15 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 09:01:15 kjcf05n02 dcs-bulk-data-sender[6216]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 09:01:15 kjcf05n02 dcs-collectord[6216]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 09:01:15 kjcf05n02 dearcpw[7216]: Using config script: /etc/dearcpw.conf Nov 3 09:01:15 kjcf05n02 dearcpw[7216]: - Creating default directory: '/var/log/dearcpw' Nov 3 09:01:15 kjcf05n02 dearcpw[7216]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 09:01:15 kjcf05n02 dearcpw[7216]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 09:01:15 kjcf05n02 dearcpw[7216]: - Creating default directory: '/var/run/dearcpw' Nov 3 09:01:15 kjcf05n02 dearcpw[7216]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 09:01:15 kjcf05n02 dearcpw[7216]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 09:01:15 kjcf05n02 dearcpw-server[7259]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 09:01:15 kjcf05n02 dearcpw[7216]: celery multi v5.2.7 (dawn-chorus) Nov 3 09:01:15 kjcf05n02 dearcpw[7216]: > Starting nodes... Nov 3 09:01:15 kjcf05n02 dearcpw[7216]: > dearcpw@kjcf05n02: OK Nov 3 09:01:15 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 09:01:15 kjcf05n02 dearcpw-server[7261]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 09:01:15 kjcf05n02 dearcpw-server[7261]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 09:01:15 kjcf05n02 dearcpw-server[7261]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 09:01:15 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 3 09:01:15 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:01:15 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:01:15 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 09:01:15 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 09:01:15 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 09:01:15 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 09:01:15 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 09:01:15 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 09:01:15 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 09:01:15 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 09:01:16 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:38172). Nov 3 09:01:16 kjcf05n01 rsyncd[3006245]: connect from kjcf05n02 (172.16.2.5) Nov 3 09:01:16 kjcf05n01 rsyncd[3006245]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 09:01:16 kjcf05n01 rsyncd[3006245]: receiving file list Nov 3 09:01:16 kjcf05n01 rsyncd[3006245]: sent 29 bytes received 332 bytes total size 10905 Nov 3 09:01:16 kjcf05n01 systemd[1]: rsyncd@614-172.16.2.2:873-172.16.2.5:38172.service: Succeeded. Nov 3 09:01:16 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 09:01:16 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 09:01:16 kjcf05n02 puppet[7451]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 3 09:01:16 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 09:01:16 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 09:01:16 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 09:01:16 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 09:01:16 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 09:01:16 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 09:01:16 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 09:01:16 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 09:01:16 kjcf05n02 dcs-collectord[5667]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 09:01:16 kjcf05n02 dcs-collectord[5667]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 09:01:16 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 09:01:16 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 09:01:16 kjcf05n00 mcfcli[3673891]: %3|1730646076.679|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:01:17 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 09:01:17 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 09:01:17 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 09:01:17 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 09:01:17 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 09:01:17 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 09:01:17 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 09:01:17 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 09:01:18 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 09:01:18 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 09:01:18 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 09:01:18 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 09:01:19 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 09:01:19 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 09:01:19 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:19 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 09:01:19 kjcf05n02 ipmievd[4011]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 09:01:19 kjcf05n02 diskless-swap[7644]: HA_PS_000: recovering journal Nov 3 09:01:19 kjcf05n02 systemd-udevd[1551]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 09:01:19 kjcf05n02 diskless-swap[7644]: HA_PS_000: clean, 2280/6400 files, 7068/25600 blocks Nov 3 09:01:19 kjcf05n02 ipmievd[4011]: System Event sensor - Timestamp Clock Sync Nov 3 09:01:19 kjcf05n02 ipmievd[3153]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:01:19 kjcf05n02 diskless-swap[7644]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 09:01:19 kjcf05n02 diskless-swap[7644]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 09:01:19 kjcf05n02 diskless-swap[7644]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 09:01:19 kjcf05n02 diskless-swap[7644]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 09:01:19 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 09:01:19 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:01:19 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:01:19 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 09:01:19 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 09:01:19 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 09:01:19 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 09:01:19 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 3 09:01:20 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 3 09:01:20 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 3 09:01:20 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 3 09:01:20 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 3 09:01:20 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 09:01:20 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 09:01:20 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 09:01:20 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 09:01:20 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 09:01:20 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 09:01:20 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 09:01:21 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 09:01:21 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 09:01:21 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 09:01:21 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 09:01:21 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 09:01:21 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 09:01:21 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 09:01:21 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 09:01:22 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib0 Nov 3 09:01:22 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib0 Nov 3 09:01:22 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 09:01:22 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 09:01:22 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 09:01:22 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 09:01:23 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 09:01:23 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 09:01:23 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 09:01:23 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 09:01:23 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:23 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 3 09:01:23 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:01:23 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:01:23 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 09:01:23 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 09:01:23 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:24 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 3 09:01:24 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:01:24 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:01:24 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 09:01:24 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 09:01:24 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:24 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 3 09:01:24 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:01:24 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:01:24 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 09:01:24 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 09:01:24 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 09:01:24 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 09:01:24 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 09:01:24 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 09:01:24 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 09:01:24 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 09:01:24 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 09:01:24 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 09:01:24 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:24 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 3 09:01:24 kjcf05n02 kdumpctl[7878]: kdump: No kdump initial ramdisk found. Nov 3 09:01:24 kjcf05n02 kdumpctl[7878]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 09:01:24 kjcf05n02 dracut[7990]: dracut-049-135.git20210121.el8 Nov 3 09:01:25 kjcf05n02 dracut[7992]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 09:01:25 kjcf05n02 dracut[7992]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 09:01:25 kjcf05n02 dracut[7992]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 09:01:25 kjcf05n02 dracut[7992]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 09:01:25 kjcf05n02 dracut[7992]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 09:01:25 kjcf05n02 dracut[7992]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 09:01:25 kjcf05n02 dracut[7992]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 09:01:25 kjcf05n02 dracut[7992]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + is_func check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ type -t check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 0 -ne 0 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check -h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local dev holder Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + require_binaries mdadm expr Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _module_name=90hperaid Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ mdadm = \-\m ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for cmd in "$@" Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + find_binary mdadm Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for cmd in "$@" Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + find_binary expr Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n -h ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for dev in "${!host_fs_types[@]}" Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ nfs != *_raid_member ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + continue Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _ret=255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + ret=255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ 255 = 0 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ 255 = 255 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ module_depends hperaid Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: +++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: +++ set -x Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ depends Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo rootfs-block Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ return 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ _ret=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ return 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for _moddep in $(module_depends $_mod) Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all == *\ hperaid\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + add_dracutmodules+=' rootfs-block ' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ == *\ hperaid\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check_module rootfs-block Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _mod=rootfs-block Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddep Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ == *\ rootfs-block\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n '' ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all == *\ rootfs-block\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + module_check rootfs-block 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _forced=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 2 -eq 2 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _forced=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + is_func check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ type -t check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 0 -ne 0 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check -h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _ret=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + ret=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ 0 = 0 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ module_depends rootfs-block Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: +++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 09:01:25 kjcf05n02 kdumpctl[3153]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ depends Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo fs-lib Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ _ret=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ return 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for _moddep in $(module_depends $_mod) Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all == *\ rootfs-block\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + add_dracutmodules+=' fs-lib ' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ == *\ rootfs-block\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check_module fs-lib Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _mod=fs-lib Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddep Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n '' ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + mods_checked_as_dep+=' fs-lib ' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all == *\ fs-lib\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + module_check fs-lib 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _forced=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 2 -eq 2 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _forced=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + is_func check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ type -t check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 0 -ne 0 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check -h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _ret=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + ret=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ 0 = 0 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ module_depends fs-lib Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: +++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ depends Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ return 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ _ret=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ return 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + mods_to_load+=' fs-lib ' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + mods_to_load+=' rootfs-block ' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + mods_to_load+=' hperaid ' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _mod=90kernel-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _mod=kernel-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check_module kernel-modules 1 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _mod=kernel-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddep Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n 1 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all = all ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + module_check kernel-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _forced=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 1 -eq 2 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + is_func check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ type -t check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 0 -ne 0 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check -h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + true Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _ret=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + ret=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ 0 != 0 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ module_depends kernel-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: +++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ depends Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ true Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ _ret=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ return 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + mods_to_load+=' kernel-modules ' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _mod=90kernel-modules-extra Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _mod=kernel-modules-extra Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check_module kernel-modules-extra 1 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _mod=kernel-modules-extra Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddep Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n 1 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all = all ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + module_check kernel-modules-extra Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _forced=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 1 -eq 2 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + is_func check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ type -t check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 0 -ne 0 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check -h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + true Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _ret=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + ret=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ 0 != 0 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ module_depends kernel-modules-extra Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: +++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ depends Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ true Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ _ret=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ return 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + mods_to_load+=' kernel-modules-extra ' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _mod=90kernel-network-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _mod=kernel-network-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check_module kernel-network-modules 1 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _mod=kernel-network-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddep Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n 1 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all = all ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + module_check kernel-network-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _forced=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 1 -eq 2 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + is_func check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ type -t check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 0 -ne 0 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check -h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _ret=255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + ret=255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ 255 != 0 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n 1 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 1 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _mod=90livenet Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _mod=livenet Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check_module livenet 1 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _mod=livenet Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddep Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n 1 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all = all ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + module_check livenet Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _forced=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 1 -eq 2 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + is_func check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ type -t check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 0 -ne 0 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check -h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _ret=255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + ret=255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ 255 != 0 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n 1 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 1 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _mod=90lvm Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _mod=lvm Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check_module lvm 1 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _mod=lvm Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddep Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n 1 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all = all ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + module_check lvm Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _forced=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 1 -eq 2 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + is_func check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ type -t check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 0 -ne 0 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check -h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + require_binaries lvm Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _module_name=90lvm Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ lvm = \-\m ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for cmd in "$@" Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + find_binary lvm Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n -h ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for fs in "${host_fs_types[@]}" Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ nfs = LVM*_member ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _ret=255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + ret=255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ 255 != 0 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n 1 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 1 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _mod=90mdraid Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _mod=mdraid Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check_module mdraid 1 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _mod=mdraid Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddep Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n 1 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all = all ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + module_check mdraid Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _forced=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 1 -eq 2 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + is_func check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ type -t check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 0 -ne 0 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check -h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _rootdev Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + require_binaries mdadm expr Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _module_name=90mdraid Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ mdadm = \-\m ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for cmd in "$@" Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + find_binary mdadm Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for cmd in "$@" Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + find_binary expr Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n -h ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for dev in "${!host_fs_types[@]}" Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ nfs != *_raid_member ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + continue Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _ret=255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + ret=255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ 255 != 0 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n 1 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 1 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _mod=90multipath Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _mod=multipath Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check_module multipath 1 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _mod=multipath Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddep Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n 1 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all = all ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + module_check multipath Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _forced=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 1 -eq 2 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + is_func check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ type -t check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 0 -ne 0 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check -h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _rootdev Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n -h ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for_each_host_dev_and_slaves is_mpath Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _func=is_mpath Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _dev Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for _dev in "${host_devs[@]}" Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + continue Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 1 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _ret=255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + ret=255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ 255 != 0 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n 1 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 1 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _mod=90qemu Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _mod=qemu Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check_module qemu 1 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _mod=qemu Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddep Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n 1 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all = all ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + module_check qemu Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _forced=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 1 -eq 2 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + is_func check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ type -t check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 0 -ne 0 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check -h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n -h ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + type -P systemd-detect-virt Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ systemd-detect-virt --vm Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + vm=none Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + (( 1 != 0 )) Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _ret=255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + ret=255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ 255 != 0 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n 1 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 1 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _mod=90qemu-net Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _mod=qemu-net Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check_module qemu-net 1 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _mod=qemu-net Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddep Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n 1 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all = all ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + module_check qemu-net Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _forced=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 1 -eq 2 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + is_func check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ type -t check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 0 -ne 0 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check -h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n -h ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + type -P systemd-detect-virt Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ systemd-detect-virt --vm Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + vm= Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + (( 1 != 0 )) Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _ret=255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + ret=255 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ 255 != 0 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n 1 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + return 1 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _mod=90stratis Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + _mod=stratis Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check_module stratis 1 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _mod=stratis Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddep Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -n 1 ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ all = all ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + module_check stratis Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ read a b Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _forced=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _hostonly=-h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 1 -eq 2 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + is_func check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: ++ type -t check Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + '[' 0 -ne 0 ']' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + check -h Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _module_name=90stratis Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + local _ret=0 Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + [[ stratisd-init = \-\m ]] Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + for cmd in "$@" Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + find_binary stratisd-init Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 09:01:25 kjcf05n02 kdumpctl[7878]: + set +x Nov 3 09:01:25 kjcf05n02 dracut[7992]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 09:01:26 kjcf05n02 dracut[7992]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 09:01:26 kjcf05n02 dracut[7992]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 09:01:26 kjcf05n02 dracut[7992]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 09:01:26 kjcf05n02 dracut[7992]: memstrack is available Nov 3 09:01:26 kjcf05n02 dracut[7992]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 09:01:26 kjcf05n03 LCNmon[18114]: 10.16.100.52 is unreachable via ib1 Nov 3 09:01:26 kjcf05n03 LCNmon[18114]: 10.16.100.58 is unreachable via ib1 Nov 3 09:01:26 kjcf05n02 dracut[7992]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 09:01:26 kjcf05n02 dracut[7992]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 09:01:26 kjcf05n02 dracut[7992]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 09:01:26 kjcf05n02 dracut[7992]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 09:01:26 kjcf05n02 dracut[7992]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 09:01:26 kjcf05n02 dracut[7992]: *** Including module: bash *** Nov 3 09:01:26 kjcf05n02 dracut[7992]: *** Including module: systemd *** Nov 3 09:01:27 kjcf05n02 dracut[7992]: *** Including module: fips *** Nov 3 09:01:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730646087', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 09:01:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730646087'} Nov 3 09:01:27 kjcf05n02 dracut[7992]: *** Including module: systemd-initrd *** Nov 3 09:01:27 kjcf05n02 dracut[7992]: *** Including module: watchdog-modules *** Nov 3 09:01:27 kjcf05n02 dracut[7992]: *** Including module: nss-softokn *** Nov 3 09:01:27 kjcf05n02 dracut[7992]: *** Including module: i18n *** Nov 3 09:01:27 kjcf05n02 dracut[7992]: No KEYMAP configured. Nov 3 09:01:27 kjcf05n02 dracut[7992]: *** Including module: network-legacy *** Nov 3 09:01:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:01:28 kjcf05n02 dracut[7992]: *** Including module: network *** Nov 3 09:01:28 kjcf05n02 dracut[7992]: *** Including module: ib_bonding *** Nov 3 09:01:28 kjcf05n02 dracut[7992]: *** Including module: drm *** Nov 3 09:01:31 kjcf05n02 dcs-collectord[5667]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 09:01:31 kjcf05n02 dcs-collectord[5667]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 09:01:32 kjcf05n02 dracut[7992]: *** Including module: hperaid *** Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + install Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + local rule rule_path Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + inst_multiple cat expr Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.dPoRbn/initramfs -a -f cat expr Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + _ret=0 Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + (( 0 != 0 )) Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + : Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + return 0 Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + inst_multiple -o mdmon Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.dPoRbn/initramfs -a -f -o mdmon Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + _ret=0 Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + (( 0 != 0 )) Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + : Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + return 0 Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: ++ command -v partx Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + inst /usr/sbin/partx /sbin/partx Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + local _hostonly_install Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + [[ -e /tmp/dracut.dPoRbn/initramfs//sbin/partx ]] Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.dPoRbn/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + (( 0 != 0 )) Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + : Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: ++ command -v mdadm Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + local _hostonly_install Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + [[ -e /tmp/dracut.dPoRbn/initramfs//sbin/mdadm ]] Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.dPoRbn/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + (( 0 != 0 )) Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + : Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + [[ yes == \y\e\s ]] Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + local _raidconf Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: ++ cmdline Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: ++ local _activated dev line UUID Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: ++ declare -A _activated Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: ++ for dev in "${!host_fs_types[@]}" Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: ++ [[ nfs != *_raid_member ]] Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: ++ continue Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + _raidconf= Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + [[ -n '' ]] Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + inst_rules 64-md-raid.rules Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + local _target=/etc/udev/rules.d _rule _found Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + inst_dir /usr/lib/udev/rules.d Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + [[ -e /tmp/dracut.dPoRbn/initramfs//usr/lib/udev/rules.d ]] Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + return 0 Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + inst_dir /etc/udev/rules.d Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + [[ -e /tmp/dracut.dPoRbn/initramfs//etc/udev/rules.d ]] Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + return 0 Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + for _rule in "$@" Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + continue Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + continue Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + for r in '' $dracutbasedir/rules.d/ Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + [[ 64-md-raid.rules != /* ]] Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + continue Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + for r in '' $dracutbasedir/rules.d/ Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + continue Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + [[ -n '' ]] Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + set +x Nov 3 09:01:32 kjcf05n02 dracut[7992]: Skipping udev rule: 64-md-raid.rules Nov 3 09:01:32 kjcf05n00 mcfcli[3673891]: %3|1730646092.325|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + installkernel Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + instmods =drivers/md Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + local _optional=-o Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + local _silent Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + local _ret Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + [[ '' = yes ]] Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + [[ =drivers/md = \-\c ]] Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + [[ =drivers/md = \-\s ]] Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + (( 1 == 0 )) Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.dPoRbn/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + _ret=0 Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + (( 0 != 0 )) Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + [[ -n '' ]] Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + return 0 Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + _ret=0 Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + unset check depends cmdline install installkernel Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + return 0 Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + modules_loaded+='hperaid ' Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + '[' -n '' ']' Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + _d_mod=90kernel-modules Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + _d_mod=kernel-modules Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + [[ '' = yes ]] Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + dinfo '*** Including module: kernel-modules ***' Nov 3 09:01:32 kjcf05n02 kdumpctl[7878]: + set +x Nov 3 09:01:32 kjcf05n02 dracut[7992]: *** Including module: kernel-modules *** Nov 3 09:01:32 kjcf05n02 dracut[7992]: *** Including module: kernel-modules-extra *** Nov 3 09:01:33 kjcf05n02 dracut[7992]: *** Including module: kernel-network-modules *** Nov 3 09:01:33 kjcf05n02 dracut[7992]: *** Including module: diskless-mod *** Nov 3 09:01:33 kjcf05n02 dracut[7992]: *** Including module: fstab-sys *** Nov 3 09:01:33 kjcf05n02 dracut[7992]: *** Including module: nfs *** Nov 3 09:01:33 kjcf05n02 dracut[7992]: *** Including module: rootfs-block *** Nov 3 09:01:33 kjcf05n02 dracut[7992]: *** Including module: terminfo *** Nov 3 09:01:33 kjcf05n02 dracut[7992]: *** Including module: udev-rules *** Nov 3 09:01:34 kjcf05n02 dracut[7992]: Skipping udev rule: 91-permissions.rules Nov 3 09:01:34 kjcf05n02 dracut[7992]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 09:01:34 kjcf05n02 dracut[7992]: *** Including module: dracut-systemd *** Nov 3 09:01:34 kjcf05n02 dracut[7992]: *** Including module: usrmount *** Nov 3 09:01:34 kjcf05n02 dracut[7992]: *** Including module: base *** Nov 3 09:01:35 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 3 09:01:35 kjcf05n02 dracut[7992]: *** Including module: fs-lib *** Nov 3 09:01:35 kjcf05n02 dracut[7992]: *** Including module: kdumpbase *** Nov 3 09:01:35 kjcf05n00 zabbix-server[1123510]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 09:01:35 kjcf05n00 zabbix-server[1123510]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:52\\"}}"' Nov 3 09:01:35 kjcf05n00 log_interesting_event.py[1123510]: Event '46033' acknowledged Nov 3 09:01:36 kjcf05n02 dracut[7992]: *** Including module: memstrack *** Nov 3 09:01:36 kjcf05n02 dracut[7992]: *** Including module: shutdown *** Nov 3 09:01:36 kjcf05n02 dracut[7992]: *** Including module: squash *** Nov 3 09:01:36 kjcf05n02 dracut[7992]: *** Including modules done *** Nov 3 09:01:36 kjcf05n02 dracut[7992]: *** Installing kernel module dependencies *** Nov 3 09:01:36 kjcf05n02 dracut[7992]: *** Installing kernel module dependencies done *** Nov 3 09:01:36 kjcf05n02 dracut[7992]: *** Resolving executable dependencies *** Nov 3 09:01:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730646096', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 09:01:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730646096', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 09:01:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730646096'} Nov 3 09:01:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:01:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730646096'} Nov 3 09:01:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 09:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 09:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 09:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 09:01:37 kjcf05n02 dracut[7992]: *** Resolving executable dependencies done*** Nov 3 09:01:37 kjcf05n02 dracut[7992]: *** Hardlinking files *** Nov 3 09:01:37 kjcf05n02 dracut[7992]: *** Hardlinking files done *** Nov 3 09:01:37 kjcf05n02 dracut[7992]: *** Generating early-microcode cpio image *** Nov 3 09:01:37 kjcf05n02 dracut[7992]: *** Constructing AuthenticAMD.bin **** Nov 3 09:01:37 kjcf05n02 dracut[7992]: *** Store current command line parameters *** Nov 3 09:01:37 kjcf05n02 dracut[7992]: Stored kernel commandline: Nov 3 09:01:37 kjcf05n02 dracut[7992]: rd.driver.pre=sd_mod Nov 3 09:01:37 kjcf05n02 dracut[7992]: rd.driver.pre=nvme Nov 3 09:01:37 kjcf05n02 dracut[7992]: rd.driver.pre=ipmi_si Nov 3 09:01:37 kjcf05n02 dracut[7992]: rd.driver.pre=ipmi_devintf Nov 3 09:01:37 kjcf05n02 dracut[7992]: rd.driver.pre=ipmi_msghandler Nov 3 09:01:37 kjcf05n02 dracut[7992]: nameserver=172.16.2.2 Nov 3 09:01:37 kjcf05n02 dracut[7992]: nameserver=127.0.0.1 Nov 3 09:01:37 kjcf05n02 dracut[7992]: nameserver=172.16.2.2 Nov 3 09:01:37 kjcf05n02 dracut[7992]: nameserver=127.0.0.1 Nov 3 09:01:37 kjcf05n02 dracut[7992]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 3 09:01:37 kjcf05n02 dracut[7992]: rd.neednet Nov 3 09:01:37 kjcf05n02 dracut[7992]: kdumpnic=mgmt0 Nov 3 09:01:37 kjcf05n02 dracut[7992]: bootdev=mgmt0 Nov 3 09:01:37 kjcf05n02 dracut[7992]: *** Install squash loader *** Nov 3 09:01:38 kjcf05n02 dracut[7992]: *** Squashing the files inside the initramfs *** Nov 3 09:01:39 kjcf05n02 dracut[7992]: *** Squashing the files inside the initramfs done *** Nov 3 09:01:39 kjcf05n02 dracut[7992]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 09:01:39 kjcf05n02 dracut[7992]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 09:01:39 kjcf05n02 kdumpctl[7878]: kdump: kexec: loaded kdump kernel Nov 3 09:01:39 kjcf05n02 kdumpctl[7878]: kdump: Starting kdump: [OK] Nov 3 09:01:39 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 3 09:01:39 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:40 kjcf05n02 systemd[3153]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:01:40 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:01:40 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:01:40 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 09:01:40 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 09:01:40 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 09:01:40 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 09:01:40 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 09:01:40 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 09:01:40 kjcf05n02 ifdown[14577]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 09:01:40 kjcf05n02 ifdown[14581]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:01:40 kjcf05n02 ifdown[14582]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:01:40 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 09:01:40 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 09:01:40 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 09:01:40 kjcf05n02 ifup[14642]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 09:01:40 kjcf05n02 ifup[14643]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:01:40 kjcf05n02 ifup[14644]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:01:42 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 09:01:42 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31425 deleted. Nov 3 09:01:44 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 09:01:45 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 09:01:45 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:01:45 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 09:01:45 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:01:45 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:01:45 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:01:45 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 09:01:45 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 09:01:45 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 09:01:45 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 09:01:45 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:01:45 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:01:45 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:01:45 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:01:45 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 09:01:45 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 09:01:45 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 09:01:45 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 09:01:45 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 09:01:45 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 09:01:45 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 09:01:45 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 09:01:45 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 09:01:45 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 09:01:45 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 09:01:45 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 09:01:45 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 09:01:45 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 09:01:45 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 09:01:45 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 09:01:45 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 09:01:45 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 09:01:45 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 09:01:45 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 09:01:45 kjcf05n02 ifdown[14811]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 09:01:45 kjcf05n02 ifdown[14825]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:01:45 kjcf05n02 ifdown[14829]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:01:45 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 09:01:45 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 09:01:45 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 09:01:45 kjcf05n02 ifup[14890]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 09:01:45 kjcf05n02 ifup[14891]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:01:45 kjcf05n02 ifup[14892]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:01:45 kjcf05n00 zabbix-server[1123620]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 09:01:45 kjcf05n00 zabbix-server[1123620]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 127.55\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 134.26\\"}}"' Nov 3 09:01:45 kjcf05n00 log_interesting_event.py[1123620]: Event '46045' acknowledged Nov 3 09:01:46 kjcf05n00 zabbix-server[1123621]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 09:01:46 kjcf05n00 zabbix-server[1123621]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 3 09:01:46 kjcf05n00 log_interesting_event.py[1123621]: Event '46046' acknowledged Nov 3 09:01:46 kjcf05n02 dcs-collectord[5667]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 09:01:46 kjcf05n02 dcs-collectord[5667]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 09:01:47 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 09:01:49 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 3 09:01:49 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 09:01:50 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 09:01:50 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 09:01:50 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:50 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 3 09:01:50 kjcf05n02 await_ha_peer[15105]: Waiting for HA peer kjcf05n03 Nov 3 09:01:51 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 09:01:51 kjcf05n02 await_ha_peer[15105]: Peer kjcf05n03 has started, starting HA Nov 3 09:01:52 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 3 09:01:52 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 3 09:01:52 kjcf05n02 fstonithd.py[15145]: Listening for kdump packets from partner Nov 3 09:01:52 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:52 kjcf05n02 systemd[3153]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:01:52 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:01:52 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:01:52 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:52 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 3 09:01:52 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 09:01:52 kjcf05n02 systemd[1]: Reloading. Nov 3 09:01:53 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 09:01:53 kjcf05n02 puppet-agent[3599]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:01:53 kjcf05n02 puppet[3599]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:01:53 kjcf05n02 puppet-agent[3599]: Applied catalog in 92.83 seconds Nov 3 09:01:53 kjcf05n02 puppet[3599]: Notice: Applied catalog in 92.83 seconds Nov 3 09:01:53 kjcf05n02 systemd[1]: Started Puppet agent. Nov 3 09:01:53 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 09:01:53 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 09:01:53 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 09:01:53 kjcf05n02 systemd[1]: Reached target Timers. Nov 3 09:01:53 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 3 09:01:53 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 09:01:53 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 09:01:53 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 09:01:53 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 09:01:53 kjcf05n02 wce-disable.sh[15298]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 09:01:53 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 09:01:53 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 09:01:53 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 09:01:53 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 09:01:53 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 3 09:01:53 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 3 09:01:53 kjcf05n02 python3.9[15304]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 09:01:53 kjcf05n02 python3.9[15304]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 09:01:53 kjcf05n02 gateway-ec-node.py[15303]: Starting gateway-ec-node service Nov 3 09:01:53 kjcf05n02 RFSF-API[15302]: INFO[2024-11-03T09:01:53-06:00] Datapath API RESTful Service starting Nov 3 09:01:53 kjcf05n02 dp-api-server-node[15302]: INFO[2024-11-03T09:01:53-06:00] Datapath API RESTful Service starting Nov 3 09:01:53 kjcf05n02 RFSF-API[15302]: INFO[2024-11-03T09:01:53-06:00] Running in production mode, starting dbus event listener Nov 3 09:01:53 kjcf05n02 dp-api-server-node[15302]: INFO[2024-11-03T09:01:53-06:00] Running in production mode, starting dbus event listener Nov 3 09:01:53 kjcf05n02 RFSF-API[15302]: INFO[2024-11-03T09:01:53-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 09:01:53 kjcf05n02 dp-api-server-node[15302]: INFO[2024-11-03T09:01:53-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 09:01:53 kjcf05n02 RFSF-API[15302]: INFO[2024-11-03T09:01:53-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 09:01:53 kjcf05n02 dp-api-server-node[15302]: INFO[2024-11-03T09:01:53-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 09:01:53 kjcf05n02 RFSF-API[15302]: INFO[2024-11-03T09:01:53-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 09:01:53 kjcf05n02 dp-api-server-node[15302]: INFO[2024-11-03T09:01:53-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 09:01:53 kjcf05n02 RFSF-API[15302]: INFO[2024-11-03T09:01:53-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 09:01:53 kjcf05n02 dp-api-server-node[15302]: INFO[2024-11-03T09:01:53-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 09:01:53 kjcf05n02 RFSF-API[15302]: INFO[2024-11-03T09:01:53-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 09:01:53 kjcf05n02 dp-api-server-node[15302]: INFO[2024-11-03T09:01:53-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 09:01:53 kjcf05n02 RFSF-API[15302]: INFO[2024-11-03T09:01:53-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 09:01:53 kjcf05n02 dp-api-server-node[15302]: INFO[2024-11-03T09:01:53-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 09:01:53 kjcf05n02 RFSF-API[15302]: INFO[2024-11-03T09:01:53-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 09:01:53 kjcf05n02 dp-api-server-node[15302]: INFO[2024-11-03T09:01:53-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 09:01:53 kjcf05n02 RFSF-API[15302]: INFO[2024-11-03T09:01:53-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 09:01:53 kjcf05n02 dp-api-server-node[15302]: INFO[2024-11-03T09:01:53-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 09:01:53 kjcf05n02 RFSF-API[15302]: INFO[2024-11-03T09:01:53-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 09:01:53 kjcf05n02 dp-api-server-node[15302]: INFO[2024-11-03T09:01:53-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 09:01:53 kjcf05n02 RFSF-API[15302]: INFO[2024-11-03T09:01:53-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 09:01:53 kjcf05n02 dp-api-server-node[15302]: INFO[2024-11-03T09:01:53-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 09:01:56 kjcf05n00 mcfcli[3673891]: %3|1730646116.171|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:01:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730646118', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(1344.0B/1192.0B), ib1=(1064.0B/1192.0B), icl0=(7.2kB/8.9kB), lo=(600.0B/600.0B), meth0=(1541.2MB/7.7MB), mgmt0=(1477.9MB/7.7MB)'}"] Nov 3 09:01:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(1344.0B/1192.0B), ib1=(1064.0B/1192.0B), icl0=(7.2kB/8.9kB), lo=(600.0B/600.0B), meth0=(1541.2MB/7.7MB), mgmt0=(1477.9MB/7.7MB)', 'message': 'NET OK - (Rx/Tx) ib0=(1344.0B/1192.0B), ib1=(1064.0B/1192.0B), icl0=(7.2kB/8.9kB), lo=(600.0B/600.0B), meth0=(1541.2MB/7.7MB), mgmt0=(1477.9MB/7.7MB)', 'value': 'ok', 'timestamp': '1730646118'} Nov 3 09:01:58 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:01:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730646119', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 09:01:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730646119'} Nov 3 09:01:59 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:02:00 kjcf05n02 systemd[1]: Reloading. Nov 3 09:02:00 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 09:02:00 kjcf05n02 systemd[1]: Reloading. Nov 3 09:02:01 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 09:02:01 kjcf05n02 dcs-collectord[5667]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 09:02:01 kjcf05n02 dcs-collectord[5667]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 09:02:01 kjcf05n02 dcs-collectord[5667]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 09:02:01 kjcf05n02 diskmonitor_pre[15787]: Key management is currently disabled.DEAR disabled Nov 3 09:02:01 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 09:02:02 kjcf05n00 mcfcli[3673891]: %3|1730646122.326|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 09:02:03 kjcf05n00 httpd[902566]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 09:02:03 kjcf05n02 sh[15848]: LNET configured: New Created Nov 3 09:02:03 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 09:02:03 kjcf05n02 LCNmon[17892]: Interface ib0 is up Nov 3 09:02:03 kjcf05n02 LCNmon[17892]: Interface ib1 is up Nov 3 09:02:03 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 09:02:03 kjcf05n02 LCNmon[17892]: Can ping through interface ib0 Nov 3 09:02:03 kjcf05n02 LCNmon[17892]: Can ping through interface ib1 Nov 3 09:02:03 kjcf05n02 LCNmon[17892]: NIC ib0, initial state UP Nov 3 09:02:03 kjcf05n02 LCNmon[17892]: NIC ib1, initial state UP Nov 3 09:02:03 kjcf05n02 LCNmon[17892]: LCNstat initial state UP Nov 3 09:02:04 kjcf05n02 LCNmon[17892]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 3 09:02:05 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18118 (bash) Nov 3 09:02:05 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: /var/run/diskmonitor does not exist, creating Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: Creating /var/run/diskmonitor/disk Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: Creating /var/run/diskmonitor/encl Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: Creating /var/run/diskmonitor/cli Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: RAS_Interlocks_enabled: 1 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: add handler for sig: 14 sa_flags: 10000004 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: add handler for sig: 1 sa_flags: 10000004 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: add handler for sig: 2 sa_flags: 00000004 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: add handler for sig: 15 sa_flags: 00000004 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: add handler for sig: 6 sa_flags: 00000004 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: add handler for sig: 3 sa_flags: 00000004 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: add handler for sig: 30 sa_flags: 00000004 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: add handler for sig: 20 sa_flags: 00000004 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: add handler for sig: 10 sa_flags: 10000004 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: add handler for sig: 11 sa_flags: 00000004 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: add handler for sig: 7 sa_flags: 00000004 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: add handler for sig: 4 sa_flags: 00000004 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: add handler for sig: 8 sa_flags: 00000004 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: Using HA Baton locks - key: diskmonitor Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: Baton will be held for at most 570 seconds Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: DMMP Enabled: 0 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: random seed: 52494c1e Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: NVMe Enclosure: 1 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: ZFS Enclosure: 0 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: Dbus, Initialized Connection Successfully Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: int_catcher_thread: thread start Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: Received dbus message 4 org.freedesktop.DBus -> :1.94 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 09:02:05 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 09:02:05 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 09:02:05 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 09:02:05 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 09:02:05 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 09:02:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730646125', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 3.10, 2.21, 0.98'}"] Nov 3 09:02:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 3.10, 2.21, 0.98', 'message': 'OK - load average: 3.10, 2.21, 0.98', 'value': 'ok', 'timestamp': '1730646125'} Nov 3 09:02:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:02:07 kjcf05n02 openhpid[5573]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 09:02:07 kjcf05n02 openhpid[5573]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 09:02:07 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 3 09:02:07 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 09:02:07 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 09:02:07 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18442 which is not our child. We'll most likely not notice when it exits. Nov 3 09:02:07 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 09:02:07 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 3 09:02:07 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 3 09:02:07 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 09:02:07 kjcf05n02 dcs-collectord[5667]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 09:02:07 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 09:02:07 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 09:02:07 kjcf05n02 systemd[1]: Startup finished in 50.129s (kernel) + 2min 33.943s (userspace) = 3min 24.073s. Nov 3 09:02:07 kjcf05n02 openhpid[18442]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 09:02:07 kjcf05n02 openhpid[18442]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 09:02:07 kjcf05n02 openhpid[18442]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 09:02:07 kjcf05n02 openhpid[18442]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 09:02:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730646129', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 360 processes with STATE = RSZDT '}"] Nov 3 09:02:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 360 processes with STATE = RSZDT ', 'message': 'PROCS OK: 360 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730646129'} Nov 3 09:02:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 09:02:11 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 09:02:16 kjcf05n02 dcs-collectord[5667]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 09:02:16 kjcf05n02 dcs-collectord[5667]: WARNING No data collected (hpi_parser.py:353) Nov 3 09:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730646139', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.7% (4387988 kB) used.'}"] Nov 3 09:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.7% (4387988 kB) used.', 'message': 'OK - 1.7% (4387988 kB) used.', 'value': 'ok', 'timestamp': '1730646139'} Nov 3 09:02:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:02:29 kjcf05n02 ipmievd[4011]: System Event sensor - Timestamp Clock Sync Nov 3 09:02:31 kjcf05n02 ipmievd[3153]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:02:31 kjcf05n02 dcs-collectord[5667]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 09:02:32 kjcf05n00 mcfcli[3673891]: %3|1730646152.326|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:02:34 kjcf05n00 mcfcli[3673891]: %3|1730646154.933|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:02:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730646162', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 09:02:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730646162'} Nov 3 09:02:42 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 09:02:43 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 09:02:46 kjcf05n02 dcs-collectord[5667]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 09:02:51 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 09:02:51 kjcf05n02 ras-resource-manager-agent[5944]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "b263400c-99f4-11ef-98ec-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 09:02:51 kjcf05n02 ras-resource-manager-agent[5944]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'b263400c-99f4-11ef-98ec-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 09:02:51 kjcf05n02 ras-resource-manager-agent[5944]: INFO Submitting new device inserted signal, starting to qualify drive: b263400c-99f4-11ef-98ec-00093d0695e3 (admin_action.py:110) Nov 3 09:02:52 kjcf05n03 firmware-update-orc-server[5875]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "851548f3-d022-4e98-ae79-6d004692203f"} (logger.py:65) Nov 3 09:02:52 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 254228 (get_disk_device) Nov 3 09:02:52 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 09:02:52 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 09:02:52 kjcf05n03 ccp-client[254249]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 09:02:52 kjcf05n02 diskmonitor[17293]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 09:02:52 kjcf05n02 ras-resource-manager-agent[5944]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "b2b5746c-99f4-11ef-98ec-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 09:02:52 kjcf05n02 ras-resource-manager-agent[5944]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'b2b5746c-99f4-11ef-98ec-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 09:02:52 kjcf05n02 ras-resource-manager-agent[5944]: INFO Submitting new device inserted signal, starting to qualify drive: b2b5746c-99f4-11ef-98ec-00093d0695e3 (admin_action.py:110) Nov 3 09:02:52 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'b2b5746c-99f4-11ef-98ec-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 09:02:52 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'b2b5746c-99f4-11ef-98ec-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 09:02:52 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': 'b2b5746c-99f4-11ef-98ec-00093d0695e3', 'response ID': 'b2be4dee-99f4-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 09:02:52 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: b2be4dee-99f4-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 09:02:52 kjcf05n03 ccp-client[254249]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 09:02:52 kjcf05n03 ccp-client[254258]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 09:02:52 kjcf05n03 ccp-client[254249]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 09:02:52 kjcf05n03 ccp-client[254249]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 09:02:52 kjcf05n03 ccp-client[254258]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 09:02:52 kjcf05n03 ccp-client[254258]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 09:02:52 kjcf05n02 firmware-update-orc-server[5900]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "4618d249-b454-4276-91ea-b1ef5c91a82e"} (logger.py:65) Nov 3 09:02:52 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'b263400c-99f4-11ef-98ec-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 09:02:52 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'b263400c-99f4-11ef-98ec-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 09:02:52 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': 'b263400c-99f4-11ef-98ec-00093d0695e3', 'response ID': 'b30820ea-99f4-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 09:02:52 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: b30820ea-99f4-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 09:02:55 kjcf05n03 DRVFW[254366]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 09:02:55 kjcf05n03 ccp-client[254367]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 09:02:55 kjcf05n03 ccp-client[254367]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 09:02:55 kjcf05n03 ccp-client[254376]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 09:02:55 kjcf05n03 ccp-client[254367]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 09:02:55 kjcf05n03 ccp-client[254367]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 09:02:55 kjcf05n03 ccp-client[254376]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 09:02:55 kjcf05n03 ccp-client[254376]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 09:02:55 kjcf05n03 firmware-update-orc-server[5875]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 09:02:56 kjcf05n02 ras-resource-manager-agent[5944]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'b2b5746c-99f4-11ef-98ec-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 09:02:56 kjcf05n02 ras-resource-manager-agent[5944]: INFO Drive qualification complete responding: b2b5746c-99f4-11ef-98ec-00093d0695e3 (admin_action.py:205) Nov 3 09:02:56 kjcf05n02 ras-resource-manager-agent[5944]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "b2b5746c-99f4-11ef-98ec-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (interesting_event.py:59) Nov 3 09:02:56 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: b2be4dee-99f4-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 09:02:56 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': 'b2b5746c-99f4-11ef-98ec-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': 'b2b5746c-99f4-11ef-98ec-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}}} (logger.py:65) Nov 3 09:02:59 kjcf05n02 diskmonitor[17293]: 024VS001, slot: 11 Nov 3 09:02:59 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 09:02:59 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 09:02:59 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 09:02:59 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 09:02:59 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 09:02:59 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 3 09:02:59 kjcf05n02 diskmonitor[17293]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 09:02:59 kjcf05n02 diskmonitor[17293]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 09:02:59 kjcf05n02 diskmonitor[17293]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 09:02:59 kjcf05n02 diskmonitor[17293]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 09:02:59 kjcf05n02 diskmonitor[17293]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 09:02:59 kjcf05n02 diskmonitor[17293]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "b263400c-99f4-11ef-98ec-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 09:02:59 kjcf05n02 diskmonitor[17293]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 09:02:59 kjcf05n02 diskmonitor[17293]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 09:02:59 kjcf05n02 diskmonitor[17293]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "b2b5746c-99f4-11ef-98ec-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 09:02:59 kjcf05n02 diskmonitor[17293]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 09:02:59 kjcf05n02 diskmonitor[17293]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 09:03:02 kjcf05n00 mcfcli[3673891]: %3|1730646182.328|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:03:03 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22357 (get_disk_device) Nov 3 09:03:03 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 09:03:03 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 09:03:03 kjcf05n02 ccp-client[22378]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 09:03:03 kjcf05n02 ccp-client[22378]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 09:03:03 kjcf05n02 ccp-client[22387]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 09:03:03 kjcf05n02 ccp-client[22378]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 09:03:03 kjcf05n02 ccp-client[22378]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 09:03:03 kjcf05n02 ccp-client[22387]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 09:03:03 kjcf05n02 ccp-client[22387]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 09:03:03 kjcf05n02 chronyd[5178]: Selected source 172.16.2.1 Nov 3 09:03:06 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 3 09:03:06 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 09:03:06 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 3 09:03:06 kjcf05n02 DRVFW[22548]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 09:03:06 kjcf05n02 ccp-client[22550]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 09:03:06 kjcf05n02 ccp-client[22550]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 09:03:06 kjcf05n02 ccp-client[22550]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 09:03:06 kjcf05n02 ccp-client[22550]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 09:03:06 kjcf05n02 ccp-client[22561]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 09:03:06 kjcf05n02 ccp-client[22561]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 09:03:06 kjcf05n02 ccp-client[22561]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 09:03:06 kjcf05n02 firmware-update-orc-server[5900]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 09:03:07 kjcf05n02 ras-resource-manager-agent[5944]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'b263400c-99f4-11ef-98ec-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}} (resource_admin.py:98) Nov 3 09:03:07 kjcf05n02 ras-resource-manager-agent[5944]: INFO Drive qualification complete responding: b263400c-99f4-11ef-98ec-00093d0695e3 (admin_action.py:205) Nov 3 09:03:07 kjcf05n02 ras-resource-manager-agent[5944]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "b263400c-99f4-11ef-98ec-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (interesting_event.py:59) Nov 3 09:03:07 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: b30820ea-99f4-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 09:03:07 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': 'b263400c-99f4-11ef-98ec-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': 'b263400c-99f4-11ef-98ec-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}}} (logger.py:65) Nov 3 09:03:08 kjcf05n02 ras-resource-manager-agent[5944]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "b2b5746c-99f4-11ef-98ec-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (service_main_handler.py:66) Nov 3 09:03:08 kjcf05n02 ras-resource-manager-agent[5944]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'b2b5746c-99f4-11ef-98ec-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 09:03:08 kjcf05n02 ras-resource-manager-agent[5944]: INFO Device qualification response has been acknowledged: b2b5746c-99f4-11ef-98ec-00093d0695e3 (admin_action.py:151) Nov 3 09:03:08 kjcf05n02 ras-resource-manager-agent[5944]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "b263400c-99f4-11ef-98ec-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (service_main_handler.py:66) Nov 3 09:03:08 kjcf05n02 ras-resource-manager-agent[5944]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'b263400c-99f4-11ef-98ec-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}} (resource_admin.py:98) Nov 3 09:03:08 kjcf05n02 ras-resource-manager-agent[5944]: INFO Device qualification response has been acknowledged: b263400c-99f4-11ef-98ec-00093d0695e3 (admin_action.py:151) Nov 3 09:03:10 kjcf05n02 python3.9[5239]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 09:03:11 kjcf05n02 python3.9[3153]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "b2b5746c-99f4-11ef-98ec-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: Dbus, handle_ingress_ras_signals, uuid: b2b5746c-99f4-11ef-98ec-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "b2b5746c-99f4-11ef-98ec-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "b263400c-99f4-11ef-98ec-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: Dbus, handle_ingress_ras_signals, uuid: b263400c-99f4-11ef-98ec-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "b263400c-99f4-11ef-98ec-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 09:03:11 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 09:03:12 kjcf05n00 mcfcli[3673891]: %3|1730646192.190|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:03:13 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 09:03:13 kjcf05n02 diskmonitor[17293]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 09:03:18 kjcf05n02 diskmonitor[17293]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 09:03:18 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 09:03:18 kjcf05n02 diskmonitor[17293]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 09:03:18 kjcf05n02 diskmonitor[17293]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 09:03:18 kjcf05n02 diskmonitor[17293]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 09:03:18 kjcf05n02 diskmonitor[17293]: leaving test state: 1 next state: 2 Nov 3 09:03:18 kjcf05n02 diskmonitor[17293]: lock req: no timeout Nov 3 09:03:18 kjcf05n02 diskmonitor[17293]: leaving test state: 2 next state: 4 Nov 3 09:03:18 kjcf05n02 diskmonitor[17293]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 09:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T09:03:27.253037831-06:00 level=info msg="Completed cleanup jobs" duration=26.521479ms Nov 3 09:03:32 kjcf05n00 mcfcli[3673891]: %3|1730646212.328|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 09:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730646216}"] Nov 3 09:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730646216, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:03:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730646216}"] Nov 3 09:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730646216, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:03:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730646216}"] Nov 3 09:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730646216, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:03:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:03:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730646217}"] Nov 3 09:03:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730646217, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:03:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:03:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730646217}"] Nov 3 09:03:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730646217, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:03:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:03:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730646217}"] Nov 3 09:03:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730646217, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:03:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:03:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730646217}"] Nov 3 09:03:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730646217, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:03:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:03:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730646217}"] Nov 3 09:03:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730646217, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:03:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:03:50 kjcf05n00 mcfcli[3673891]: %3|1730646230.053|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:04:02 kjcf05n00 mcfcli[3673891]: %3|1730646242.328|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:04:13 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 09:04:13 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 09:04:13 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 09:04:23 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 09:04:23 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 09:04:23 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 09:04:28 kjcf05n02 dcs-collectord[5667]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 09:04:29 kjcf05n00 mcfcli[3673891]: %3|1730646269.021|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:04:29 kjcf05n02 diskmonitor[17293]: lock acquired Nov 3 09:04:29 kjcf05n02 diskmonitor[17293]: leaving test state: 4 next state: 8 Nov 3 09:04:32 kjcf05n00 mcfcli[3673891]: %3|1730646272.328|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:04:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730646276}"] Nov 3 09:04:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730646276, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:04:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:04:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:04:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:04:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:04:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:04:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:04:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:04:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:04:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:04:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:04:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:04:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:04:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:04:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.076239ms Nov 3 09:04:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:04:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.076239ms Nov 3 09:04:37 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:04:37 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:04:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:04:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730646277}"] Nov 3 09:04:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730646277, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:04:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:04:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:04:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:04:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:04:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:04:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:04:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:04:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:04:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:04:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:04:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:04:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:04:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:04:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.175415ms Nov 3 09:04:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:04:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.175415ms Nov 3 09:04:37 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:04:37 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:04:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:04:42 kjcf05n02 diskmonitor[17293]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 09:04:42 kjcf05n02 diskmonitor[17293]: leaving test state: 8 next state: 20 Nov 3 09:04:42 kjcf05n02 diskmonitor[17293]: leaving test state: 20 next state: 40 Nov 3 09:04:42 kjcf05n02 diskmonitor[17293]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 23134890000 Nov 3 09:04:42 kjcf05n02 diskmonitor[17293]: leaving test state: 40 next state: 80 Nov 3 09:04:42 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31426 deleted. Nov 3 09:05:02 kjcf05n00 mcfcli[3673891]: %3|1730646302.328|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:05:06 kjcf05n00 python3.9[1125671]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 09:05:07 kjcf05n00 diskmonitor[2758297]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 09:05:08 kjcf05n00 mcfcli[3673891]: %3|1730646308.349|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:05:11 kjcf05n00 zabbix-server[1126082]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 09:05:11 kjcf05n00 zabbix-server[1126082]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n02' from event '46050' Nov 3 09:05:11 kjcf05n00 zabbix-server[1126082]: Host created 'enclosure_USE26000024VS001' Nov 3 09:05:11 kjcf05n00 zabbix-server[1126082]: Running puppet on 'kjcf05n02' Nov 3 09:05:13 kjcf05n02 puppet-agent[28899]: Using configured environment 'production' Nov 3 09:05:13 kjcf05n02 puppet-agent[28899]: Retrieving pluginfacts Nov 3 09:05:13 kjcf05n02 puppet-agent[28899]: Retrieving plugin Nov 3 09:05:13 kjcf05n02 puppet-agent[28899]: Loading facts Nov 3 09:05:16 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 09:05:17 kjcf05n02 puppet-agent[28899]: Caching catalog for kjcf05n02 Nov 3 09:05:17 kjcf05n02 puppet-agent[28899]: Applying configuration version '1730646315' Nov 3 09:05:19 kjcf05n02 puppet-agent[28899]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 09:05:19 kjcf05n02 puppet-agent[28899]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 09:05:19 kjcf05n02 puppet-agent[28899]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 09:05:19 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 09:05:19 kjcf05n02 zabbix_agent2[6028]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 09:05:19 kjcf05n02 zabbix_agent2[3153]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:05:19 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 09:05:19 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 09:05:19 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 09:05:19 kjcf05n02 puppet-agent[28899]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: Press Ctrl+C to exit. Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: Plugin support version 1.0 Nov 3 09:05:19 kjcf05n02 zabbix_agent2[29263]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 09:05:21 kjcf05n02 puppet-agent[28899]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 09:05:21 kjcf05n02 puppet-agent[28899]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 09:05:21 kjcf05n02 puppet-agent[28899]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 09:05:22 kjcf05n02 puppet-agent[28899]: Applied catalog in 5.11 seconds Nov 3 09:05:22 kjcf05n00 zabbix-server[1126082]: puppet completed status:(0): '' Nov 3 09:05:22 kjcf05n00 zabbix-server[1126082]: Event '46050' acknowledged Nov 3 09:05:22 kjcf05n00 zabbix-server[1126082]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n02"}' Nov 3 09:05:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730646026', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 09:05:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730646026'} Nov 3 09:05:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:05:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730646026', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 09:05:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730646026'} Nov 3 09:05:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:05:26 kjcf05n02 diskmonitor[17293]: leaving test state: 80 next state: 100 Nov 3 09:05:26 kjcf05n02 diskmonitor[17293]: lock release: time: Sun Nov 3 09:05:20 2024 Nov 3 09:05:26 kjcf05n02 diskmonitor[17293]: leaving test state: 100 next state: 1 Nov 3 09:05:32 kjcf05n00 mcfcli[3673891]: %3|1730646332.328|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 09:05:33 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 09:05:48 kjcf05n00 mcfcli[3673891]: %3|1730646348.346|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:06:02 kjcf05n00 mcfcli[3673891]: %3|1730646362.329|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 09:06:04 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 09:06:27 kjcf05n00 mcfcli[3673891]: %3|1730646387.161|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:06:32 kjcf05n00 mcfcli[3673891]: %3|1730646392.329|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 09:06:54 kjcf05n01 diskmonitor[1331407]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 09:07:02 kjcf05n00 mcfcli[3673891]: %3|1730646422.330|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 09:07:02 kjcf05n00 mcfcli[3673891]: %3|1730646422.438|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:07:21 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 3 09:07:25 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 3 09:07:25 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 3 09:07:25 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 3 09:07:32 kjcf05n00 mcfcli[3673891]: %3|1730646452.331|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 09:07:38 kjcf05n00 mcfcli[3673891]: %3|1730646458.993|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:07:49 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 3 09:07:49 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 3 09:08:01 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 09:08:01 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 09:08:01 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 09:08:02 kjcf05n00 mcfcli[3673891]: %3|1730646482.331|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:08:17 kjcf05n00 mcfcli[3673891]: %3|1730646497.219|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:08:31 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 09:08:31 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 09:08:31 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 09:08:32 kjcf05n00 mcfcli[3673891]: %3|1730646512.331|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:08:55 kjcf05n00 mcfcli[3673891]: %3|1730646535.446|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:09:02 kjcf05n00 mcfcli[3673891]: %3|1730646542.332|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:09:32 kjcf05n00 mcfcli[3673891]: %3|1730646572.332|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:09:35 kjcf05n00 mcfcli[3673891]: %3|1730646575.443|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:09:39 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 3 09:09:39 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 3 09:09:39 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 3 09:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 09:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 09:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 09:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 09:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 09:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 09:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 09:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 09:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 09:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 09:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 09:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 09:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 09:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 09:10:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 09:10:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:10:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 09:10:02 kjcf05n00 mcfcli[3673891]: %3|1730646602.333|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:10:06 kjcf05n00 python3.9[1128508]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 09:10:12 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 3 09:10:13 kjcf05n00 mcfcli[3673891]: %3|1730646613.049|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:10:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730646026', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 09:10:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730646026'} Nov 3 09:10:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:10:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730646026', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 09:10:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730646026'} Nov 3 09:10:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:10:32 kjcf05n00 mcfcli[3673891]: %3|1730646632.334|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 09:10:40 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 3 09:10:40 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 3 09:10:50 kjcf05n00 mcfcli[3673891]: %3|1730646650.569|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:11:02 kjcf05n00 mcfcli[3673891]: %3|1730646662.334|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:11:30 kjcf05n00 mcfcli[3673891]: %3|1730646690.566|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:11:32 kjcf05n00 mcfcli[3673891]: %3|1730646692.334|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:12:02 kjcf05n00 mcfcli[3673891]: %3|1730646722.334|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 09:12:09 kjcf05n00 mcfcli[3673891]: %3|1730646729.364|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:12:11 kjcf05n03 nslcd[6947]: [a7c4c9] ldap_result() failed: Can't contact LDAP server Nov 3 09:12:11 kjcf05n03 nslcd[6947]: [68079a] ldap_result() failed: Can't contact LDAP server Nov 3 09:12:32 kjcf05n00 mcfcli[3673891]: %3|1730646752.335|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 09:12:39 kjcf05n02 root[42137]: failback_xyraid Nov 3 09:12:41 kjcf05n02 root[42253]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 09:12:42 kjcf05n02 root[42408]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 09:12:45 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 3 09:12:48 kjcf05n00 mcfcli[3673891]: %3|1730646768.205|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:12:49 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme19n1 Nov 3 09:12:49 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme4n1 Nov 3 09:12:49 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme8n1 Nov 3 09:12:49 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme3n1 Nov 3 09:12:49 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme9n1 Nov 3 09:12:49 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme17n1 Nov 3 09:12:49 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme24n1 Nov 3 09:12:49 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme2n1 Nov 3 09:12:49 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme23n1 Nov 3 09:12:49 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme25n1 Nov 3 09:12:49 kjcf05n03 dwd[5195]: Drive path is missing, purging: nvme18n1 Nov 3 09:12:50 kjcf05n02 dwd[5210]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 09:12:50 kjcf05n02 dwd[5210]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 09:12:50 kjcf05n02 dwd[5210]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 09:12:50 kjcf05n02 dwd[5210]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 09:12:50 kjcf05n02 dwd[5210]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 09:12:50 kjcf05n02 dwd[5210]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 09:12:50 kjcf05n02 dwd[5210]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 09:12:50 kjcf05n02 dwd[5210]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 09:12:50 kjcf05n02 dwd[5210]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 09:12:50 kjcf05n02 dwd[5210]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 09:12:50 kjcf05n02 dwd[5210]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 09:12:51 kjcf05n02 dwd[5210]: Starting NVME thread for nvme2n1 Nov 3 09:12:51 kjcf05n02 dwd[5210]: Starting NVME thread for nvme18n1 Nov 3 09:12:51 kjcf05n02 dwd[5210]: Starting NVME thread for nvme19n1 Nov 3 09:12:51 kjcf05n02 dwd[5210]: Starting NVME thread for nvme9n1 Nov 3 09:12:51 kjcf05n02 dwd[5210]: Starting NVME thread for nvme3n1 Nov 3 09:12:51 kjcf05n02 systemd-udevd[45204]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45206]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45205]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45204]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45206]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45205]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45206]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45205]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45204]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45206]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45204]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45205]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45206]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45205]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45204]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45206]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45205]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45230]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45204]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45231]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45206]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45235]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45237]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45205]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45204]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45230]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45206]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45235]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45237]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45231]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45204]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45230]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45235]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45204]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45204]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45237]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45204]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45235]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45206]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45204]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45204]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45237]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45204]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45237]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45204]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45204]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 09:12:51 kjcf05n02 systemd-udevd[45237]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:12:52 kjcf05n02 systemd-udevd[45204]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 09:12:52 kjcf05n02 systemd-udevd[45237]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 09:12:52 kjcf05n02 systemd-udevd[45204]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:12:52 kjcf05n02 systemd-udevd[45237]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 09:12:52 kjcf05n02 systemd-udevd[45204]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:12:52 kjcf05n02 systemd-udevd[45237]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:12:52 kjcf05n02 systemd-udevd[45237]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:12:52 kjcf05n02 dwd[5210]: Starting NVME thread for nvme24n1 Nov 3 09:12:52 kjcf05n02 dwd[5210]: Starting NVME thread for nvme4n1 Nov 3 09:12:52 kjcf05n02 dwd[5210]: Starting NVME thread for nvme23n1 Nov 3 09:12:52 kjcf05n02 dwd[5210]: Starting NVME thread for nvme17n1 Nov 3 09:12:52 kjcf05n02 dwd[5210]: Starting NVME thread for nvme25n1 Nov 3 09:12:52 kjcf05n02 dwd[5210]: Starting NVME thread for nvme8n1 Nov 3 09:12:52 kjcf05n02 nslcd[6978]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 09:12:55 kjcf05n02 dcs-bulk-data-sender[6216]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 3 09:12:56 kjcf05n02 diskmonitor[17293]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 09:13:02 kjcf05n00 mcfcli[3673891]: %3|1730646782.335|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 09:13:04 kjcf05n02 diskmonitor[17293]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 09:13:04 kjcf05n02 diskmonitor[17293]: Scan for ReadErrorMax change for md65 Nov 3 09:13:04 kjcf05n02 diskmonitor[17293]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 09:13:04 kjcf05n02 diskmonitor[17293]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 09:13:04 kjcf05n02 diskmonitor[17293]: read_saved_file: md65 no saved speed Nov 3 09:13:04 kjcf05n02 diskmonitor[17293]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 09:13:04 kjcf05n02 diskmonitor[17293]: Set sync_speed_min (10000) for md65 Nov 3 09:13:04 kjcf05n02 diskmonitor[17293]: Set sync_speed_max (200000) for md65 Nov 3 09:13:04 kjcf05n02 diskmonitor[17293]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 09:13:17 kjcf05n03 diskmonitor[17713]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 09:13:17 kjcf05n03 diskmonitor[17713]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 09:13:26 kjcf05n00 mcfcli[3673891]: %3|1730646806.996|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T09:13:27.25297617-06:00 level=info msg="Completed cleanup jobs" duration=26.113676ms Nov 3 09:13:32 kjcf05n00 mcfcli[3673891]: %3|1730646812.335|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:13:45 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 09:13:45 kjcf05n02 systemd-tmpfiles[47956]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 09:13:45 kjcf05n02 systemd-tmpfiles[47956]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 09:13:45 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 09:13:45 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 09:13:48 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 48203 (bash) Nov 3 09:13:48 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 09:13:48 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 09:14:02 kjcf05n00 mcfcli[3673891]: %3|1730646842.336|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:14:05 kjcf05n00 mcfcli[3673891]: %3|1730646845.014|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:14:11 kjcf05n00 zabbix-server[1130996]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 09:14:11 kjcf05n00 zabbix-server[1130996]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46052' Nov 3 09:14:11 kjcf05n00 zabbix-server[1130996]: Filesystem 'kjcf05' has been mounted Nov 3 09:14:12 kjcf05n00 zabbix-server[1130996]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 09:14:12 kjcf05n00 zabbix-server[1130996]: Running puppet on 'None' Nov 3 09:14:14 kjcf05n02 puppet-agent[49329]: Using configured environment 'production' Nov 3 09:14:14 kjcf05n02 puppet-agent[49329]: Retrieving pluginfacts Nov 3 09:14:14 kjcf05n02 puppet-agent[49329]: Retrieving plugin Nov 3 09:14:14 kjcf05n02 puppet-agent[49329]: Loading facts Nov 3 09:14:14 kjcf05n04 puppet-agent[2776237]: Using configured environment 'production' Nov 3 09:14:14 kjcf05n04 puppet-agent[2776237]: Retrieving pluginfacts Nov 3 09:14:14 kjcf05n04 puppet-agent[2776237]: Retrieving plugin Nov 3 09:14:14 kjcf05n06 puppet-agent[2771094]: Using configured environment 'production' Nov 3 09:14:14 kjcf05n06 puppet-agent[2771094]: Retrieving pluginfacts Nov 3 09:14:14 kjcf05n06 puppet-agent[2771094]: Retrieving plugin Nov 3 09:14:14 kjcf05n03 puppet-agent[274537]: Using configured environment 'production' Nov 3 09:14:14 kjcf05n03 puppet-agent[274537]: Retrieving pluginfacts Nov 3 09:14:14 kjcf05n03 puppet-agent[274537]: Retrieving plugin Nov 3 09:14:14 kjcf05n07 puppet-agent[2769016]: Using configured environment 'production' Nov 3 09:14:14 kjcf05n07 puppet-agent[2769016]: Retrieving pluginfacts Nov 3 09:14:14 kjcf05n07 puppet-agent[2769016]: Retrieving plugin Nov 3 09:14:14 kjcf05n05 puppet-agent[2924090]: Using configured environment 'production' Nov 3 09:14:14 kjcf05n05 puppet-agent[2924090]: Retrieving pluginfacts Nov 3 09:14:14 kjcf05n05 puppet-agent[2924090]: Retrieving plugin Nov 3 09:14:14 kjcf05n05 puppet-agent[2924090]: Loading facts Nov 3 09:14:14 kjcf05n04 puppet-agent[2776237]: Loading facts Nov 3 09:14:14 kjcf05n06 puppet-agent[2771094]: Loading facts Nov 3 09:14:14 kjcf05n03 puppet-agent[274537]: Loading facts Nov 3 09:14:15 kjcf05n01 puppet-agent[3011314]: Using configured environment 'production' Nov 3 09:14:15 kjcf05n01 puppet-agent[3011314]: Retrieving pluginfacts Nov 3 09:14:15 kjcf05n01 puppet-agent[3011314]: Retrieving plugin Nov 3 09:14:15 kjcf05n07 puppet-agent[2769016]: Loading facts Nov 3 09:14:14 kjcf05n00 puppet-agent[1131058]: Using configured environment 'production' Nov 3 09:14:14 kjcf05n00 puppet-agent[1131058]: Retrieving pluginfacts Nov 3 09:14:14 kjcf05n00 puppet-agent[1131058]: Retrieving plugin Nov 3 09:14:15 kjcf05n01 puppet-agent[3011314]: Loading facts Nov 3 09:14:15 kjcf05n00 puppet-agent[1131058]: Loading facts Nov 3 09:14:17 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 09:14:18 kjcf05n06 puppet-agent[2771094]: Caching catalog for kjcf05n06 Nov 3 09:14:18 kjcf05n06 puppet-agent[2771094]: Applying configuration version '1730646856' Nov 3 09:14:18 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 09:14:18 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 09:14:19 kjcf05n01 puppet-agent[3011314]: Caching catalog for kjcf05n01 Nov 3 09:14:20 kjcf05n02 puppet-agent[49329]: Caching catalog for kjcf05n02 Nov 3 09:14:20 kjcf05n02 puppet-agent[49329]: Applying configuration version '1730646855' Nov 3 09:14:20 kjcf05n01 puppet-agent[3011314]: Applying configuration version '1730646857' Nov 3 09:14:20 kjcf05n03 puppet-agent[274537]: Caching catalog for kjcf05n03 Nov 3 09:14:20 kjcf05n03 puppet-agent[274537]: Applying configuration version '1730646856' Nov 3 09:14:21 kjcf05n00 puppet-agent[1131058]: Caching catalog for kjcf05n00 Nov 3 09:14:21 kjcf05n00 puppet-agent[1131058]: Applying configuration version '1730646859' Nov 3 09:14:21 kjcf05n07 puppet-agent[2769016]: Caching catalog for kjcf05n07 Nov 3 09:14:21 kjcf05n07 puppet-agent[2769016]: Applying configuration version '1730646856' Nov 3 09:14:21 kjcf05n06 puppet-agent[2771094]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 09:14:21 kjcf05n06 puppet-agent[2771094]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 09:14:21 kjcf05n06 puppet-agent[2771094]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 09:14:22 kjcf05n02 puppet-agent[49329]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 09:14:22 kjcf05n02 puppet-agent[49329]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 09:14:22 kjcf05n02 puppet-agent[49329]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 09:14:22 kjcf05n05 puppet-agent[2924090]: Caching catalog for kjcf05n05 Nov 3 09:14:22 kjcf05n05 puppet-agent[2924090]: Applying configuration version '1730646859' Nov 3 09:14:22 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2718835]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 09:14:22 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 09:14:22 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 09:14:22 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 09:14:22 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 09:14:22 kjcf05n06 puppet-agent[2771094]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: Press Ctrl+C to exit. Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: Plugin support version 1.0 Nov 3 09:14:22 kjcf05n06 zabbix_agent2[2771538]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 09:14:22 kjcf05n03 puppet-agent[274537]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 09:14:22 kjcf05n03 puppet-agent[274537]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 09:14:22 kjcf05n03 puppet-agent[274537]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 09:14:22 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 09:14:22 kjcf05n02 zabbix_agent2[29263]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 09:14:22 kjcf05n02 zabbix_agent2[3153]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:14:22 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 09:14:22 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 09:14:22 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 09:14:22 kjcf05n02 puppet-agent[49329]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: Press Ctrl+C to exit. Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: Plugin support version 1.0 Nov 3 09:14:22 kjcf05n02 zabbix_agent2[49741]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 09:14:23 kjcf05n01 puppet-agent[3011314]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 09:14:23 kjcf05n01 puppet-agent[3011314]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-08:54:45]/mode) mode changed '0755' to '0750' Nov 3 09:14:23 kjcf05n01 puppet-agent[3011314]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-08:54:45/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 09:14:23 kjcf05n01 puppet-agent[3011314]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-08:54:45/vmcore]/mode) mode changed '0600' to '0640' Nov 3 09:14:23 kjcf05n01 puppet-agent[3011314]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-08:54:45/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 09:14:23 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 09:14:23 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 09:14:23 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 09:14:23 kjcf05n07 puppet-agent[2769016]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 09:14:23 kjcf05n07 puppet-agent[2769016]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 09:14:23 kjcf05n07 puppet-agent[2769016]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 09:14:23 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 09:14:23 kjcf05n03 zabbix_agent2[218873]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 09:14:23 kjcf05n03 zabbix_agent2[3176]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:14:23 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 09:14:23 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 09:14:23 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 09:14:23 kjcf05n03 puppet-agent[274537]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: Press Ctrl+C to exit. Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: Plugin support version 1.0 Nov 3 09:14:23 kjcf05n03 zabbix_agent2[275319]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 09:14:24 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2716685]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 09:14:24 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 09:14:24 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 09:14:24 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 09:14:24 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 09:14:24 kjcf05n07 puppet-agent[2769016]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: Press Ctrl+C to exit. Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: Plugin support version 1.0 Nov 3 09:14:24 kjcf05n07 zabbix_agent2[2769475]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 09:14:24 kjcf05n06 puppet-agent[2771094]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 09:14:24 kjcf05n06 puppet-agent[2771094]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 09:14:24 kjcf05n06 puppet-agent[2771094]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 09:14:24 kjcf05n01 puppet-agent[3011314]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 09:14:24 kjcf05n01 puppet-agent[3011314]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 09:14:24 kjcf05n01 puppet-agent[3011314]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 09:14:23 kjcf05n00 puppet-agent[1131058]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 09:14:24 kjcf05n05 puppet-agent[2924090]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 09:14:24 kjcf05n05 puppet-agent[2924090]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 09:14:24 kjcf05n05 puppet-agent[2924090]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 09:14:24 kjcf05n06 puppet-agent[2771094]: Applied catalog in 6.44 seconds Nov 3 09:14:24 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 09:14:24 kjcf05n01 zabbix_agent2[2999574]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 09:14:24 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 09:14:24 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 09:14:24 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 09:14:24 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 09:14:24 kjcf05n01 puppet-agent[3011314]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: Press Ctrl+C to exit. Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: Plugin support version 1.0 Nov 3 09:14:24 kjcf05n01 zabbix_agent2[3011666]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 09:14:25 kjcf05n02 puppet-agent[49329]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 09:14:25 kjcf05n02 puppet-agent[49329]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 09:14:25 kjcf05n02 puppet-agent[49329]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 09:14:25 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2866778]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 09:14:25 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 09:14:25 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 09:14:25 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 09:14:25 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 09:14:25 kjcf05n05 puppet-agent[2924090]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: Press Ctrl+C to exit. Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: Plugin support version 1.0 Nov 3 09:14:25 kjcf05n05 zabbix_agent2[2925145]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 09:14:25 kjcf05n00 puppet-agent[1131058]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 09:14:25 kjcf05n00 puppet-agent[1131058]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 09:14:25 kjcf05n00 puppet-agent[1131058]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 09:14:25 kjcf05n02 puppet-agent[49329]: Applied catalog in 5.19 seconds Nov 3 09:14:25 kjcf05n03 puppet-agent[274537]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 09:14:25 kjcf05n03 puppet-agent[274537]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 09:14:25 kjcf05n03 puppet-agent[274537]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 09:14:25 kjcf05n07 puppet-agent[2769016]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 09:14:25 kjcf05n07 puppet-agent[2769016]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 09:14:25 kjcf05n07 puppet-agent[2769016]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 09:14:25 kjcf05n07 puppet-agent[2769016]: Applied catalog in 4.92 seconds Nov 3 09:14:25 kjcf05n03 puppet-agent[274537]: Applied catalog in 5.12 seconds Nov 3 09:14:25 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1112909]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 09:14:26 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 09:14:25 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 09:14:25 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 09:14:25 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 09:14:25 kjcf05n00 puppet-agent[1131058]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: Press Ctrl+C to exit. Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: Plugin support version 1.0 Nov 3 09:14:25 kjcf05n00 zabbix_agent2[1131607]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 09:14:26 kjcf05n00 zabbix-server[1131632]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 09:14:26 kjcf05n01 puppet-agent[3011314]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_090205.log]/mode) mode changed '0644' to '0640' Nov 3 09:14:26 kjcf05n01 puppet-agent[3011314]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_091348.log]/mode) mode changed '0644' to '0640' Nov 3 09:14:26 kjcf05n01 puppet-agent[3011314]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_091348]/mode) mode changed '0755' to '0750' Nov 3 09:14:26 kjcf05n01 puppet-agent[3011314]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_091348/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 09:14:26 kjcf05n00 zabbix-server[1131634]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 09:14:26 kjcf05n05 puppet-agent[2924090]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 09:14:26 kjcf05n05 puppet-agent[2924090]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 09:14:26 kjcf05n05 puppet-agent[2924090]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 09:14:26 kjcf05n00 zabbix-server[1131640]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 09:14:27 kjcf05n05 puppet-agent[2924090]: Applied catalog in 4.81 seconds Nov 3 09:14:27 kjcf05n01 puppet-agent[3011314]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_090203.log]/mode) mode changed '0644' to '0640' Nov 3 09:14:27 kjcf05n01 puppet-agent[3011314]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_091348.log]/mode) mode changed '0644' to '0640' Nov 3 09:14:27 kjcf05n01 puppet-agent[3011314]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 09:14:27 kjcf05n01 puppet-agent[3011314]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 09:14:27 kjcf05n01 puppet-agent[3011314]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 09:14:27 kjcf05n00 zabbix-server[1131642]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 09:14:27 kjcf05n00 puppet-agent[1131058]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 09:14:28 kjcf05n01 puppet-agent[3011314]: Applied catalog in 8.84 seconds Nov 3 09:14:28 kjcf05n00 puppet-agent[1131058]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 09:14:28 kjcf05n00 puppet-agent[1131058]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 09:14:28 kjcf05n00 puppet-agent[1131058]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 09:14:29 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 09:14:29 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 09:14:29 kjcf05n00 puppet-agent[1131058]: Applied catalog in 8.44 seconds Nov 3 09:14:32 kjcf05n00 mcfcli[3673891]: %3|1730646872.837|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:14:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730646876}"] Nov 3 09:14:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730646876, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:14:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.54184ms Nov 3 09:14:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.54184ms Nov 3 09:14:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:14:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:14:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:14:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730646876}"] Nov 3 09:14:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730646876, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:14:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.133986ms Nov 3 09:14:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.133986ms Nov 3 09:14:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:14:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:14:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:14:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730646876}"] Nov 3 09:14:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730646876, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:14:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.951745ms Nov 3 09:14:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.951745ms Nov 3 09:14:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:14:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:14:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:14:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730646876}"] Nov 3 09:14:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730646876, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:14:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.982924ms Nov 3 09:14:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.982924ms Nov 3 09:14:37 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:14:37 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:14:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:14:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730646876}"] Nov 3 09:14:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730646876, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:14:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.405656ms Nov 3 09:14:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.405656ms Nov 3 09:14:37 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:14:37 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:14:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:14:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730646876}"] Nov 3 09:14:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730646876, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:14:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.128366ms Nov 3 09:14:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.128366ms Nov 3 09:14:37 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:14:37 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:14:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:14:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730646876}"] Nov 3 09:14:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730646876, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:14:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.10351ms Nov 3 09:14:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.10351ms Nov 3 09:14:37 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:14:37 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:14:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:14:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730646876}"] Nov 3 09:14:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730646876, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:14:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.825409ms Nov 3 09:14:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.825409ms Nov 3 09:14:37 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:14:37 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:14:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:14:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730646876}"] Nov 3 09:14:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730646876, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:14:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.571473ms Nov 3 09:14:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.571473ms Nov 3 09:14:37 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:14:37 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:14:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:14:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730646876}"] Nov 3 09:14:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730646876, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:14:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.704642ms Nov 3 09:14:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.704642ms Nov 3 09:14:37 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:14:37 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:14:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:14:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730646876}"] Nov 3 09:14:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730646876, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:14:38 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:38-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:38 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:38-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:14:38 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:38-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:38 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:14:38-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:38 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:38-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:14:38 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:14:38-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:14:38 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:14:38-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.567258ms Nov 3 09:14:38 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:14:38-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.567258ms Nov 3 09:14:38 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:14:38 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:14:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:14:42 kjcf05n00 mcfcli[3673891]: %3|1730646882.299|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:14:50 kjcf05n04 puppet-agent[2776237]: Caching catalog for kjcf05n04 Nov 3 09:14:50 kjcf05n04 puppet-agent[2776237]: Applying configuration version '1730646888' Nov 3 09:14:52 kjcf05n04 puppet-agent[2776237]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 09:14:52 kjcf05n04 puppet-agent[2776237]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 09:14:52 kjcf05n04 puppet-agent[2776237]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 09:14:52 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2718943]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 09:14:52 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 09:14:52 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 09:14:52 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 09:14:52 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 09:14:52 kjcf05n04 puppet-agent[2776237]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: Press Ctrl+C to exit. Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: Plugin support version 1.0 Nov 3 09:14:52 kjcf05n04 zabbix_agent2[2777733]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 09:14:54 kjcf05n04 puppet-agent[2776237]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 09:14:54 kjcf05n04 puppet-agent[2776237]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 09:14:54 kjcf05n04 puppet-agent[2776237]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 09:14:54 kjcf05n04 puppet-agent[2776237]: Applied catalog in 4.74 seconds Nov 3 09:14:54 kjcf05n00 zabbix-server[1130996]: puppet completed status:(0): '' Nov 3 09:14:54 kjcf05n00 zabbix-server[1130996]: Event '46052' acknowledged Nov 3 09:14:54 kjcf05n00 zabbix-server[1130996]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 3 09:15:03 kjcf05n00 mcfcli[3673891]: %3|1730646903.154|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 09:15:06 kjcf05n00 python3.9[1132127]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 09:15:20 kjcf05n00 mcfcli[3673891]: %3|1730646920.785|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:15:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730646921', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 09:15:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730646921'} Nov 3 09:15:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:15:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730646921', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 09:15:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730646921'} Nov 3 09:15:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:15:33 kjcf05n00 mcfcli[3673891]: %3|1730646933.154|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:16:00 kjcf05n00 mcfcli[3673891]: %3|1730646960.782|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:16:03 kjcf05n00 mcfcli[3673891]: %3|1730646963.339|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 09:16:33 kjcf05n00 mcfcli[3673891]: %3|1730646993.339|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:16:38 kjcf05n00 mcfcli[3673891]: %3|1730646998.626|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:17:03 kjcf05n00 mcfcli[3673891]: %3|1730647023.339|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:17:16 kjcf05n00 mcfcli[3673891]: %3|1730647036.772|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:17:33 kjcf05n00 mcfcli[3673891]: %3|1730647053.339|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 09:17:56 kjcf05n00 mcfcli[3673891]: %3|1730647076.754|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:18:03 kjcf05n00 mcfcli[3673891]: %3|1730647083.340|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:18:06 kjcf05n02 dwd[5210]: nvme19n1 passed periodic SMART status check Nov 3 09:18:06 kjcf05n02 dwd[5210]: nvme2n1 passed periodic SMART status check Nov 3 09:18:06 kjcf05n02 dwd[5210]: nvme18n1 passed periodic SMART status check Nov 3 09:18:06 kjcf05n02 dwd[5210]: nvme9n1 passed periodic SMART status check Nov 3 09:18:06 kjcf05n02 dwd[5210]: nvme3n1 passed periodic SMART status check Nov 3 09:18:07 kjcf05n02 dwd[5210]: nvme23n1 passed periodic SMART status check Nov 3 09:18:07 kjcf05n02 dwd[5210]: nvme17n1 passed periodic SMART status check Nov 3 09:18:07 kjcf05n02 dwd[5210]: nvme4n1 passed periodic SMART status check Nov 3 09:18:07 kjcf05n02 dwd[5210]: nvme8n1 passed periodic SMART status check Nov 3 09:18:07 kjcf05n02 dwd[5210]: nvme24n1 passed periodic SMART status check Nov 3 09:18:07 kjcf05n02 dwd[5210]: nvme25n1 passed periodic SMART status check Nov 3 09:18:33 kjcf05n00 mcfcli[3673891]: %3|1730647113.340|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:18:34 kjcf05n00 mcfcli[3673891]: %3|1730647114.641|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:19:03 kjcf05n00 mcfcli[3673891]: %3|1730647143.340|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 09:19:11 kjcf05n00 mcfcli[3673891]: %3|1730647151.276|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:19:33 kjcf05n00 mcfcli[3673891]: %3|1730647173.342|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:19:51 kjcf05n00 mcfcli[3673891]: %3|1730647191.273|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 09:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 09:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 09:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 09:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 09:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 09:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 09:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 09:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 09:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 09:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 09:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 09:20:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 09:20:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:20:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 09:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 09:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 09:20:03 kjcf05n00 mcfcli[3673891]: %3|1730647203.342|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:20:07 kjcf05n00 python3.9[1135117]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 09:20:23 kjcf05n00 zabbix-server[1135484]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 09:20:23 kjcf05n00 zabbix-server[1135484]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 244.61\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 86.57\\"}}"' Nov 3 09:20:23 kjcf05n00 log_interesting_event.py[1135484]: Event '46053' acknowledged Nov 3 09:20:30 kjcf05n00 mcfcli[3673891]: %3|1730647230.979|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:20:33 kjcf05n00 mcfcli[3673891]: %3|1730647233.343|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 09:21:03 kjcf05n00 mcfcli[3673891]: %3|1730647263.343|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:21:05 kjcf05n00 mcfcli[3673891]: %3|1730647265.780|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:21:33 kjcf05n00 mcfcli[3673891]: %3|1730647293.343|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:21:45 kjcf05n00 mcfcli[3673891]: %3|1730647305.777|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:22:03 kjcf05n00 mcfcli[3673891]: %3|1730647323.344|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:22:25 kjcf05n00 mcfcli[3673891]: %3|1730647345.597|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:22:33 kjcf05n00 mcfcli[3673891]: %3|1730647353.344|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:23:03 kjcf05n00 mcfcli[3673891]: %3|1730647383.344|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:23:04 kjcf05n00 mcfcli[3673891]: %3|1730647384.519|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T15:23:15.868505Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 09:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T15:23:15.868573Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.088ms Nov 3 09:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T09:23:27.253040632-06:00 level=info msg="Completed cleanup jobs" duration=26.467057ms Nov 3 09:23:33 kjcf05n00 mcfcli[3673891]: %3|1730647413.344|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:23:44 kjcf05n00 mcfcli[3673891]: %3|1730647424.516|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:24:03 kjcf05n00 mcfcli[3673891]: %3|1730647443.346|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 09:24:09 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 3 09:24:09 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 14 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007992 sec, idle for 1 hour(s)] Nov 3 09:24:18 kjcf05n00 mcfcli[3673891]: %3|1730647458.345|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:24:33 kjcf05n00 mcfcli[3673891]: %3|1730647473.346|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 09:24:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 09:24:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 09:24:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 09:24:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 09:24:54 kjcf05n00 zabbix_server[15726]: Zabbix agent item "net.if.out["icl0"]" on host "kjcf05n03" failed: first network error, wait for 15 seconds Nov 3 09:24:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 09:24:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 09:24:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 09:24:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 09:24:58 kjcf05n00 mcfcli[3673891]: %3|1730647498.342|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:25:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 09:25:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 09:25:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 09:25:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 09:25:00 kjcf05n02 fstonithd.py[15145]: My partner 172.16.2.6 is kdumping. Forcing HA into GATHER state. Nov 3 09:25:00 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 09:25:00 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 09:25:00 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 09:25:01 kjcf05n02 root[68238]: is_viking_off starts Nov 3 09:25:01 kjcf05n02 root[68237]: is_enc_ipmi_off starts Nov 3 09:25:01 kjcf05n02 root[68257]: is_lan_ipmi_off leaves Nov 3 09:25:01 kjcf05n02 root[68259]: is_lan_ipmi_sec_off leaves Nov 3 09:25:01 kjcf05n02 root[68262]: I am in slot 0; partner is in slot 1 Nov 3 09:25:01 kjcf05n02 root[68266]: I am not master; I will get master Nov 3 09:25:03 kjcf05n00 mcfcli[3673891]: %3|1730647503.346|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 09:25:07 kjcf05n02 root[68389]: I am now master Nov 3 09:25:07 kjcf05n00 python3.9[1138100]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 09:25:08 kjcf05n02 LCNmon[17892]: 10.16.100.53 is unreachable via ib0 Nov 3 09:25:08 kjcf05n02 LCNmon[17892]: 10.16.100.59 is unreachable via ib0 Nov 3 09:25:08 kjcf05n02 root[68464]: is_viking_off leaves Nov 3 09:25:08 kjcf05n02 root[68467]: kjcf05n03 not already off look at kdump Nov 3 09:25:08 kjcf05n02 root[68468]: is_kdump_off starts Nov 3 09:25:08 kjcf05n02 fence_kdump[68469]: waiting for message from '172.16.2.6' Nov 3 09:25:08 kjcf05n02 fence_kdump[68469]: received valid message from '172.16.2.6' Nov 3 09:25:08 kjcf05n02 root[68470]: is_kdump_off detected kdump on kjcf05n03 Nov 3 09:25:08 kjcf05n02 root[68471]: kjcf05n03 is kdumping Nov 3 09:25:09 kjcf05n00 zabbix_server[15725]: Zabbix agent item "vfs.fs.inode[/mnt/persistent_ha_data,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 09:25:09 kjcf05n02 root[68579]: is_enc_ipmi_off starts Nov 3 09:25:09 kjcf05n02 root[68578]: is_viking_off starts Nov 3 09:25:09 kjcf05n02 root[68603]: is_lan_ipmi_off leaves Nov 3 09:25:09 kjcf05n02 root[68605]: is_lan_ipmi_sec_off leaves Nov 3 09:25:09 kjcf05n02 root[68608]: I am master Nov 3 09:25:09 kjcf05n02 root[68611]: I am in slot 0; partner is in slot 1 Nov 3 09:25:10 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 09:25:10 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 09:25:10 kjcf05n00 zabbix_server[15753]: Zabbix agent item "vfs.fs.inode[/var/lib/pacemaker,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 09:25:11 kjcf05n00 zabbix_server[15777]: Zabbix agent item "vfs.fs.inode[/var/lib/mdraidscripts,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 09:25:12 kjcf05n00 zabbix_server[15724]: Zabbix agent item "vfs.fs.inode[/var/lib/reboot_cnt,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 09:25:12 kjcf05n02 LCNmon[17892]: 10.16.100.53 is unreachable via ib1 Nov 3 09:25:12 kjcf05n02 LCNmon[17892]: 10.16.100.59 is unreachable via ib1 Nov 3 09:25:13 kjcf05n00 zabbix_server[15745]: Zabbix agent item "vfs.fs.inode[/etc/ganesha,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 09:25:15 kjcf05n02 root[68787]: is_viking_off leaves Nov 3 09:25:15 kjcf05n02 root[68790]: kjcf05n03 not already off look at kdump Nov 3 09:25:15 kjcf05n02 root[68791]: is_kdump_off starts Nov 3 09:25:15 kjcf05n02 fence_kdump[68792]: waiting for message from '172.16.2.6' Nov 3 09:25:16 kjcf05n02 fence_kdump[68792]: received valid message from '172.16.2.6' Nov 3 09:25:16 kjcf05n02 root[68793]: is_kdump_off detected kdump on kjcf05n03 Nov 3 09:25:16 kjcf05n02 root[68794]: kjcf05n03 is kdumping Nov 3 09:25:20 kjcf05n02 dwd[5210]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 09:25:20 kjcf05n02 dwd[5210]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 09:25:20 kjcf05n02 dwd[5210]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 09:25:20 kjcf05n02 dwd[5210]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 09:25:20 kjcf05n02 dwd[5210]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 09:25:20 kjcf05n02 dwd[5210]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 09:25:20 kjcf05n02 dwd[5210]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 09:25:20 kjcf05n02 dwd[5210]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 09:25:20 kjcf05n02 dwd[5210]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 09:25:20 kjcf05n02 dwd[5210]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 09:25:20 kjcf05n02 dwd[5210]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 09:25:20 kjcf05n02 dwd[5210]: Starting NVME thread for nvme16n1 Nov 3 09:25:20 kjcf05n02 diskmonitor[17293]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 09:25:21 kjcf05n02 dwd[5210]: Starting NVME thread for nvme22n1 Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71427]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71429]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71427]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71429]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71427]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71429]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71427]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71429]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71427]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71429]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71427]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71429]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71427]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71429]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71427]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71472]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71476]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71478]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71482]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71472]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71476]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71429]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71472]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71476]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71472]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71472]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71476]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71476]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71476]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71476]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71476]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71476]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71476]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 systemd-udevd[71425]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:25:21 kjcf05n02 dwd[5210]: Starting NVME thread for nvme15n1 Nov 3 09:25:21 kjcf05n02 dwd[5210]: Starting NVME thread for nvme6n1 Nov 3 09:25:21 kjcf05n02 dwd[5210]: Starting NVME thread for nvme11n1 Nov 3 09:25:21 kjcf05n02 dwd[5210]: Starting NVME thread for nvme7n1 Nov 3 09:25:21 kjcf05n02 dwd[5210]: Starting NVME thread for nvme10n1 Nov 3 09:25:21 kjcf05n02 dwd[5210]: Starting NVME thread for nvme20n1 Nov 3 09:25:21 kjcf05n02 dwd[5210]: Starting NVME thread for nvme21n1 Nov 3 09:25:22 kjcf05n02 dwd[5210]: Starting NVME thread for nvme5n1 Nov 3 09:25:22 kjcf05n02 dwd[5210]: Starting NVME thread for nvme12n1 Nov 3 09:25:24 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='39', error='Connection reset by peer (104)' Nov 3 09:25:24 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='39', client='AF_INET(172.16.2.6:36645)', local='AF_INET(0.0.0.0:601)' Nov 3 09:25:28 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.cpu.intr" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 09:25:30 kjcf05n02 diskmonitor[17293]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 09:25:30 kjcf05n02 diskmonitor[17293]: Scan for ReadErrorMax change for md66 Nov 3 09:25:30 kjcf05n02 diskmonitor[17293]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 09:25:30 kjcf05n02 diskmonitor[17293]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 09:25:30 kjcf05n02 diskmonitor[17293]: read_saved_file: md66 no saved speed Nov 3 09:25:30 kjcf05n02 diskmonitor[17293]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 09:25:30 kjcf05n02 diskmonitor[17293]: Set sync_speed_min (10000) for md66 Nov 3 09:25:30 kjcf05n02 diskmonitor[17293]: Set sync_speed_max (200000) for md66 Nov 3 09:25:30 kjcf05n02 diskmonitor[17293]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 09:25:33 kjcf05n00 mcfcli[3673891]: %3|1730647533.347|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 09:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 09:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 09:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 09:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 09:25:38 kjcf05n00 mcfcli[3673891]: %3|1730647538.339|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:25:43 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n03": interface unavailable Nov 3 09:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 09:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 09:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 09:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 09:26:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 09:26:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 09:26:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 09:26:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 09:26:03 kjcf05n00 mcfcli[3673891]: %3|1730647563.347|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 09:26:08 kjcf05n02 LCNmon[17892]: 10.16.100.53 is unreachable via ib0 Nov 3 09:26:08 kjcf05n02 LCNmon[17892]: 10.16.100.59 is unreachable via ib0 Nov 3 09:26:12 kjcf05n02 LCNmon[17892]: 10.16.100.53 is unreachable via ib1 Nov 3 09:26:12 kjcf05n02 LCNmon[17892]: 10.16.100.59 is unreachable via ib1 Nov 3 09:26:16 kjcf05n00 mcfcli[3673891]: %3|1730647576.948|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:26:31 kjcf05n02 nslcd[6978]: (re)loading /etc/nsswitch.conf Nov 3 09:26:31 kjcf05n02 nslcd[6978]: [b0dc51] ldap_result() failed: Can't contact LDAP server Nov 3 09:26:33 kjcf05n00 mcfcli[3673891]: %3|1730647593.348|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 09:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 09:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 09:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 09:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 09:26:55 kjcf05n00 mcfcli[3673891]: %3|1730647615.054|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 09:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 09:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 09:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 09:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 09:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 09:27:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 09:27:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 09:27:03 kjcf05n00 mcfcli[3673891]: %3|1730647623.349|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:27:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730647627}"] Nov 3 09:27:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730647627, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:27:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.470366ms Nov 3 09:27:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.470366ms Nov 3 09:27:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:27:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:27:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:27:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730647627}"] Nov 3 09:27:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730647627, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:27:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.928342ms Nov 3 09:27:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.928342ms Nov 3 09:27:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:27:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:27:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:27:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730647627}"] Nov 3 09:27:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730647627, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:27:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.30169ms Nov 3 09:27:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.30169ms Nov 3 09:27:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:27:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:27:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:27:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730647627}"] Nov 3 09:27:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730647627, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:27:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.167961ms Nov 3 09:27:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.167961ms Nov 3 09:27:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:27:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:27:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:27:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730647627}"] Nov 3 09:27:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730647627, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:27:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.042786ms Nov 3 09:27:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.042786ms Nov 3 09:27:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:27:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:27:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:27:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730647627}"] Nov 3 09:27:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730647627, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:27:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.523947ms Nov 3 09:27:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.523947ms Nov 3 09:27:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:27:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:27:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:27:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730647627}"] Nov 3 09:27:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730647627, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:27:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.784412ms Nov 3 09:27:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.784412ms Nov 3 09:27:08 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:27:08 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:27:08 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:27:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730647627}"] Nov 3 09:27:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730647627, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:27:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.402529ms Nov 3 09:27:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.402529ms Nov 3 09:27:08 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:27:08 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:27:08 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:27:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730647627}"] Nov 3 09:27:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730647627, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:27:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.823385ms Nov 3 09:27:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.823385ms Nov 3 09:27:08 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:27:08 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:27:08 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:27:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730647627}"] Nov 3 09:27:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730647627, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:27:08 kjcf05n02 LCNmon[17892]: 10.16.100.53 is unreachable via ib0 Nov 3 09:27:08 kjcf05n02 LCNmon[17892]: 10.16.100.59 is unreachable via ib0 Nov 3 09:27:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.793148ms Nov 3 09:27:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.793148ms Nov 3 09:27:08 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:27:08 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:27:08 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:27:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730647627}"] Nov 3 09:27:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730647627, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:27:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:27:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:27:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:27:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:27:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:27:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:27:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.75692ms Nov 3 09:27:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:27:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.75692ms Nov 3 09:27:08 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:27:08 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:27:08 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:27:12 kjcf05n02 LCNmon[17892]: 10.16.100.53 is unreachable via ib1 Nov 3 09:27:12 kjcf05n02 LCNmon[17892]: 10.16.100.59 is unreachable via ib1 Nov 3 09:27:33 kjcf05n00 mcfcli[3673891]: %3|1730647653.349|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:27:35 kjcf05n00 mcfcli[3673891]: %3|1730647655.051|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 09:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 09:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 09:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 09:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 09:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 09:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 09:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 09:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 09:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 09:28:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 09:28:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 09:28:03 kjcf05n00 mcfcli[3673891]: %3|1730647683.349|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 09:28:08 kjcf05n02 LCNmon[17892]: 10.16.100.53 is unreachable via ib0 Nov 3 09:28:08 kjcf05n02 LCNmon[17892]: 10.16.100.59 is unreachable via ib0 Nov 3 09:28:11 kjcf05n00 mcfcli[3673891]: %3|1730647691.520|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:28:12 kjcf05n02 LCNmon[17892]: 10.16.100.53 is unreachable via ib1 Nov 3 09:28:12 kjcf05n02 LCNmon[17892]: 10.16.100.59 is unreachable via ib1 Nov 3 09:28:32 kjcf05n00 zabbix-server[1140322]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 09:28:32 kjcf05n00 zabbix-server[1140322]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n03:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 09:28:32 kjcf05n00 log_interesting_event.py[1140322]: Event '46056' acknowledged Nov 3 09:28:33 kjcf05n00 mcfcli[3673891]: %3|1730647713.351|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 09:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 09:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 09:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 09:28:46 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:9a:1a Nov 3 09:28:46 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 09:28:49 kjcf05n00 mcfcli[3673891]: %3|1730647729.690|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:28:50 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 09:28:50 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a kjcf05n03 Nov 3 09:28:50 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.6 Nov 3 09:28:50 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 09:28:50 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 09:28:50 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.6 Nov 3 09:28:50 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/pxelinux.cfg to 172.16.2.6 Nov 3 09:28:53 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/vmlinuz_diskless to 172.16.2.6 Nov 3 09:28:55 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/initramfs-diskless.img to 172.16.2.6 Nov 3 09:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 09:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 09:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 09:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 09:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 09:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 09:29:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 09:29:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 09:29:03 kjcf05n00 mcfcli[3673891]: %3|1730647743.351|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:29:08 kjcf05n02 LCNmon[17892]: 10.16.100.53 is unreachable via ib0 Nov 3 09:29:08 kjcf05n02 LCNmon[17892]: 10.16.100.59 is unreachable via ib0 Nov 3 09:29:12 kjcf05n02 LCNmon[17892]: 10.16.100.53 is unreachable via ib1 Nov 3 09:29:12 kjcf05n02 LCNmon[17892]: 10.16.100.59 is unreachable via ib1 Nov 3 09:29:25 kjcf05n00 mcfcli[3673891]: %3|1730647765.686|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:29:33 kjcf05n00 mcfcli[3673891]: %3|1730647773.351|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 09:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 09:29:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 09:29:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 09:29:43 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:45630). Nov 3 09:29:43 kjcf05n01 rsyncd[3017798]: connect from kjcf05n03 (172.16.2.6) Nov 3 09:29:43 kjcf05n01 rsyncd[3017798]: rsync on puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 09:29:43 kjcf05n01 rsyncd[3017798]: building file list Nov 3 09:29:43 kjcf05n01 rsyncd[3017798]: sent 11446 bytes received 136 bytes total size 10901 Nov 3 09:29:43 kjcf05n01 systemd[1]: rsyncd@615-172.16.2.2:873-172.16.2.6:45630.service: Succeeded. Nov 3 09:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 09:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 09:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 09:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 09:30:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 09:30:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 09:30:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 09:30:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 09:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 09:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 09:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 09:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 09:30:00 kjcf05n02 fstonithd.py[15145]: Listening for kdump packets from partner Nov 3 09:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 09:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 09:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 09:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 09:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 09:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 09:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 09:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 09:30:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 09:30:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:30:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 09:30:02 kjcf05n00 mcfcli[3673891]: %3|1730647802.800|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:30:03 kjcf05n00 mcfcli[3673891]: %3|1730647803.351|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 09:30:08 kjcf05n02 LCNmon[17892]: 10.16.100.53 is unreachable via ib0 Nov 3 09:30:08 kjcf05n02 LCNmon[17892]: 10.16.100.59 is unreachable via ib0 Nov 3 09:30:09 kjcf05n00 python3.9[1141271]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 09:30:12 kjcf05n02 LCNmon[17892]: 10.16.100.53 is unreachable via ib1 Nov 3 09:30:12 kjcf05n02 LCNmon[17892]: 10.16.100.59 is unreachable via ib1 Nov 3 09:30:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730647823', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 09:30:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730647823'} Nov 3 09:30:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:30:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730647823', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 09:30:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730647823'} Nov 3 09:30:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:30:33 kjcf05n00 mcfcli[3673891]: %3|1730647833.352|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 09:30:35 kjcf05n02 dwd[5210]: nvme22n1 passed periodic SMART status check Nov 3 09:30:35 kjcf05n02 dwd[5210]: nvme16n1 passed periodic SMART status check Nov 3 09:30:36 kjcf05n02 dwd[5210]: nvme7n1 passed periodic SMART status check Nov 3 09:30:36 kjcf05n02 dwd[5210]: nvme20n1 passed periodic SMART status check Nov 3 09:30:36 kjcf05n02 dwd[5210]: nvme10n1 passed periodic SMART status check Nov 3 09:30:36 kjcf05n02 dwd[5210]: nvme11n1 passed periodic SMART status check Nov 3 09:30:36 kjcf05n02 dwd[5210]: nvme15n1 passed periodic SMART status check Nov 3 09:30:36 kjcf05n02 dwd[5210]: nvme6n1 passed periodic SMART status check Nov 3 09:30:37 kjcf05n02 dwd[5210]: nvme21n1 passed periodic SMART status check Nov 3 09:30:37 kjcf05n02 dwd[5210]: nvme12n1 passed periodic SMART status check Nov 3 09:30:37 kjcf05n02 dwd[5210]: nvme5n1 passed periodic SMART status check Nov 3 09:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 09:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 09:30:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 09:30:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 09:30:39 kjcf05n00 mcfcli[3673891]: %3|1730647839.721|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 09:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 09:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 09:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 09:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 09:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 09:31:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 09:31:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 09:31:03 kjcf05n00 mcfcli[3673891]: %3|1730647863.353|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:31:08 kjcf05n02 LCNmon[17892]: 10.16.100.53 is unreachable via ib0 Nov 3 09:31:08 kjcf05n02 LCNmon[17892]: 10.16.100.59 is unreachable via ib0 Nov 3 09:31:09 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='30', client='AF_INET(172.16.2.6:45913)', local='AF_INET(0.0.0.0:601)' Nov 3 09:31:09 kjcf05n03 syslog-ng[3192]: Configuration reload request received, reloading configuration; Nov 3 09:31:09 kjcf05n03 syslog-ng[3192]: Configuration reload finished; Nov 3 09:31:09 kjcf05n03 syslog-ng[3192]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 09:31:09 kjcf05n03 dracut: dracut-049-135.git20210121.el8 Nov 3 09:31:09 kjcf05n03 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 09:31:09 kjcf05n03 dracut: Loading and integrity checking all crypto modules Nov 3 09:31:09 kjcf05n03 dracut: Self testing crypto algorithms Nov 3 09:31:09 kjcf05n03 dracut: rd.md=0: removing MD RAID activation Nov 3 09:31:09 kjcf05n03 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 09:31:09 kjcf05n03 Copying live image to RAM... Nov 3 09:31:09 kjcf05n03 (this may take a minute) Nov 3 09:31:09 kjcf05n03 Done copying live image to RAM. Nov 3 09:31:09 kjcf05n03 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 09:31:09 kjcf05n03 dracut: Checking integrity of kernel Nov 3 09:31:09 kjcf05n03 dracut: All initrd crypto checks done Nov 3 09:31:09 kjcf05n03 dracut: Switching root Nov 3 09:31:09 kjcf05n03 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 09:31:09 kjcf05n03 systemd: Detected architecture x86-64. Nov 3 09:31:09 kjcf05n03 systemd: Set hostname to . Nov 3 09:31:09 kjcf05n03 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 09:31:09 kjcf05n03 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 09:31:09 kjcf05n03 systemd: Listening on udev Control Socket. Nov 3 09:31:09 kjcf05n03 systemd: Listening on Process Core Dump Socket. Nov 3 09:31:09 kjcf05n03 systemd: Listening on Device-mapper event daemon FIFOs. Nov 3 09:31:09 kjcf05n03 systemd: Set up automount Arbitrary Executable File Formats File System Automount Point. Nov 3 09:31:09 kjcf05n03 systemd: Created slice User and Session Slice. Nov 3 09:31:09 kjcf05n03 systemd-journald[1507]: Journal started Nov 3 09:31:09 kjcf05n03 systemd-journald[1507]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 09:31:09 kjcf05n03 systemd-modules-load[1524]: Inserted module 'fuse' Nov 3 09:31:09 kjcf05n03 systemd[1]: Mounted Temporary Directory (/tmp). Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Load Kernel Modules. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Remount Root and Kernel File Systems. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Create list of required static device nodes for the current kernel. Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Create System Users... Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Load/Save Random Seed... Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Rebuild Hardware Database... Nov 3 09:31:09 kjcf05n03 systemd[1]: Mounting Kernel Configuration File System... Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Apply Kernel Variables... Nov 3 09:31:09 kjcf05n03 systemd[1]: Mounting FUSE Control File System... Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 09:31:09 kjcf05n03 systemd[1]: Mounted Kernel Configuration File System. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Create System Users. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Load/Save Random Seed. Nov 3 09:31:09 kjcf05n03 systemd[1]: Mounted FUSE Control File System. Nov 3 09:31:09 kjcf05n03 systemd-sysctl[1543]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 09:31:09 kjcf05n03 systemd-sysctl[1543]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Apply Kernel Variables. Nov 3 09:31:09 kjcf05n03 systemd-journald[1507]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started udev Coldplug all Devices. Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 09:31:09 kjcf05n03 systemd-tmpfiles[1549]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 09:31:09 kjcf05n03 systemd-tmpfiles[1549]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Rebuild Hardware Database. Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting udev Kernel Device Manager... Nov 3 09:31:09 kjcf05n03 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started udev Kernel Device Manager. Nov 3 09:31:09 kjcf05n03 systemd[1]: Found device /dev/ttyS0. Nov 3 09:31:09 kjcf05n03 systemd-udevd[1586]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:31:09 kjcf05n03 systemd-udevd[1601]: Using default interface naming scheme 'rhel-8.0'. Nov 3 09:31:09 kjcf05n03 systemd-udevd[1601]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:31:09 kjcf05n03 systemd-udevd[1587]: Using default interface naming scheme 'rhel-8.0'. Nov 3 09:31:09 kjcf05n03 systemd-udevd[1587]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:31:09 kjcf05n03 systemd-udevd[1573]: Using default interface naming scheme 'rhel-8.0'. Nov 3 09:31:09 kjcf05n03 systemd-udevd[1573]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 09:31:09 kjcf05n03 systemd[1]: Reached target Local File Systems (Pre). Nov 3 09:31:09 kjcf05n03 systemd[1]: Reached target Local File Systems. Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 09:31:09 kjcf05n03 root[1785]: openibd: running in auto mode Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 09:31:09 kjcf05n03 systemd-tmpfiles[1784]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 09:31:09 kjcf05n03 systemd-tmpfiles[1784]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 09:31:09 kjcf05n03 systemd-tmpfiles[1784]: "/var/tmp" already exists and is not a directory. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Create Volatile Files and Directories. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Rebuild Journal Catalog. Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting RPC Bind... Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 09:31:09 kjcf05n03 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 09:31:09 kjcf05n03 systemd[1]: Started RDMA Node Description Daemon. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started RPC Bind. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 09:31:09 kjcf05n03 systemd-modules-load[1853]: Inserted module 'ib_iser' Nov 3 09:31:09 kjcf05n03 systemd-modules-load[1853]: Inserted module 'ib_isert' Nov 3 09:31:09 kjcf05n03 systemd-modules-load[1853]: Inserted module 'ib_srpt' Nov 3 09:31:09 kjcf05n03 systemd-udevd[1598]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:31:09 kjcf05n03 systemd-modules-load[1848]: Inserted module 'ib_ipoib' Nov 3 09:31:09 kjcf05n03 systemd-udevd[1609]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:31:09 kjcf05n03 systemd-udevd[1598]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 09:31:09 kjcf05n03 systemd-udevd[1609]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 09:31:09 kjcf05n03 systemd-modules-load[1853]: Inserted module 'rdma_ucm' Nov 3 09:31:09 kjcf05n03 systemd-modules-load[1853]: Module 'svcrdma' is blacklisted Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 09:31:09 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 09:31:09 kjcf05n03 systemd-modules-load[1848]: Inserted module 'ib_umad' Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 09:31:09 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 09:31:09 kjcf05n03 systemd[1]: Reached target RDMA Hardware. Nov 3 09:31:09 kjcf05n03 systemd[1]: Reached target Network (Pre). Nov 3 09:31:09 kjcf05n03 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 09:31:09 kjcf05n03 openibd[1766]: Loading HCA driver and Access Layer:[ OK ] Nov 3 09:31:09 kjcf05n03 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Update is Completed... Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Update is Completed. Nov 3 09:31:09 kjcf05n03 setup-icl[1759]: Setting LAN IP Address to 203.0.113.4 Nov 3 09:31:09 kjcf05n03 setup-icl[1759]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 09:31:09 kjcf05n03 setup-icl[1759]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 09:31:09 kjcf05n03 setup-icl[1759]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 09:31:09 kjcf05n03 systemd-udevd[1598]: Using default interface naming scheme 'rhel-8.0'. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 09:31:09 kjcf05n03 systemd[1]: Reached target System Initialization. Nov 3 09:31:09 kjcf05n03 systemd[1]: Listening on lldpad.socket. Nov 3 09:31:09 kjcf05n03 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 09:31:09 kjcf05n03 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 09:31:09 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 09:31:09 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 09:31:09 kjcf05n03 systemd[1]: Reached target Sockets. Nov 3 09:31:09 kjcf05n03 systemd[1]: Reached target Basic System. Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 09:31:09 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 0 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 1 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 2 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 3 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 4 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 5 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 6 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 7 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 8 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 9 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 10 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 11 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 12 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 13 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 14 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 15 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 16 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 17 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 18 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 19 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 20 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 21 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 22 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 23 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 24 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 25 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 26 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 27 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 28 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 29 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 30 Nov 3 09:31:09 kjcf05n03 cpupower[2104]: Setting cpu: 31 Nov 3 09:31:09 kjcf05n03 systemd[1]: Started irqbalance daemon. Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 09:31:09 kjcf05n03 mcelog[2121]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 09:31:09 kjcf05n03 mcelog[2121]: CPU is unsupported Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[2117]: Setting up Mellanox network interface: ib0 Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 09:31:09 kjcf05n03 systemd[1]: Started D-Bus System Message Bus. Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[2144]: Setting up Mellanox network interface: ib1 Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 09:31:09 kjcf05n03 network[2173]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 09:31:09 kjcf05n03 dwd[2158]: dwd: vMay 29 2024 : 15:38:26 Nov 3 09:31:09 kjcf05n03 dwd[2158]: /usr/sbin/dwd -d --standalone=0 Nov 3 09:31:09 kjcf05n03 dwd[2158]: dwd: option Lethal: 0 Nov 3 09:31:09 kjcf05n03 dwd[2158]: dwd: option Interval: 60 Nov 3 09:31:09 kjcf05n03 dwd[2158]: dwd: option abrtlimit: 10 Nov 3 09:31:09 kjcf05n03 dwd[2158]: dwd: option DZPeriod: 604800 Nov 3 09:31:09 kjcf05n03 dwd[2158]: dwd: option SmartPeriod: 43200 Nov 3 09:31:09 kjcf05n03 dwd[2158]: dwd: option SDDEnabled: 1 Nov 3 09:31:09 kjcf05n03 dwd[2158]: dwd: option SDDAwaitScale: 3 Nov 3 09:31:09 kjcf05n03 dwd[2158]: dwd: option SDDAwaitMin: 100 Nov 3 09:31:09 kjcf05n03 dwd[2158]: dwd: option Verbosity: 1 Nov 3 09:31:09 kjcf05n03 dwd[2158]: dwd: option StandAlone: 0 Nov 3 09:31:09 kjcf05n03 dwd[2158]: option Lethal: 0 Nov 3 09:31:09 kjcf05n03 dwd[2158]: option Interval: 60 Nov 3 09:31:09 kjcf05n03 dwd[2158]: option abrtlimit: 10 Nov 3 09:31:09 kjcf05n03 dwd[2158]: option DZPeriod: 604800 Nov 3 09:31:09 kjcf05n03 dwd[2158]: option SmartPeriod: 43200 Nov 3 09:31:09 kjcf05n03 dwd[2158]: option SDDEnabled: 1 Nov 3 09:31:09 kjcf05n03 dwd[2158]: option SDDAwaitScale: 3 Nov 3 09:31:09 kjcf05n03 dwd[2158]: option SDDAwaitMin: 100 Nov 3 09:31:09 kjcf05n03 dwd[2158]: option Verbosity: 1 Nov 3 09:31:09 kjcf05n03 dwd[2158]: option StandAlone: 0 Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 09:31:09 kjcf05n03 network[2217]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 09:31:09 kjcf05n03 network[2173]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 09:31:09 kjcf05n03 dbus-daemon[2163]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Name Service Cache Daemon... Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[2220]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Resets System Activity Logs... Nov 3 09:31:09 kjcf05n03 nscd[2242]: 2242 monitoring file `/etc/hosts` (1) Nov 3 09:31:09 kjcf05n03 nscd[2242]: 2242 monitoring directory `/etc` (2) Nov 3 09:31:09 kjcf05n03 nscd[2242]: 2242 monitoring file `/etc/resolv.conf` (3) Nov 3 09:31:09 kjcf05n03 nscd[2242]: 2242 monitoring directory `/etc` (2) Nov 3 09:31:09 kjcf05n03 beSetMlxConfig[2221]: ConnectX-3 multiport not detected Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[2227]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 09:31:09 kjcf05n03 network[2229]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:31:09 kjcf05n03 network[2173]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[2243]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 09:31:09 kjcf05n03 chronyd[2274]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 09:31:09 kjcf05n03 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 0 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 1 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 2 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 3 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 4 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 5 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 6 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 7 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 8 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 9 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 10 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 11 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 12 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 13 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 14 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 15 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 16 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 17 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 18 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 19 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 20 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 21 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 22 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 23 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 24 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 25 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 26 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 27 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 28 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 29 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 30 Nov 3 09:31:09 kjcf05n03 cpupower[2275]: Idlestate 2 disabled on CPU 31 Nov 3 09:31:09 kjcf05n03 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 09:31:09 kjcf05n03 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 09:31:09 kjcf05n03 network[2263]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 09:31:09 kjcf05n03 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[2265]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 09:31:09 kjcf05n03 mdraid-phy[2266]: no Cutlass to worry about Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[2272]: No configuration found for ib0 Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Name Service Cache Daemon. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Resets System Activity Logs. Nov 3 09:31:09 kjcf05n03 beSetMlxConfig[2221]: Starting MST (Mellanox Software Tools) driver set Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Manage Cutlass PHYs. Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[2289]: No configuration found for ib1 Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[2301]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[2310]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 09:31:09 kjcf05n03 chronyd[2274]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 09:31:09 kjcf05n03 chronyd[2274]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 09:31:09 kjcf05n03 beSetMlxConfig[2221]: Loading MST PCI module - Success Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 09:31:09 kjcf05n03 mlnx_conf_mgr[2339]: INFO: No configurations found for mlx5_0, skipping. Nov 3 09:31:09 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 09:31:09 kjcf05n03 mlnx_conf_mgr[2364]: INFO: No configurations found for mlx5_1, skipping. Nov 3 09:31:09 kjcf05n03 beSetMlxConfig[2221]: Loading MST PCI configuration module - Success Nov 3 09:31:09 kjcf05n03 beSetMlxConfig[2221]: Create devices Nov 3 09:31:09 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 09:31:09 kjcf05n03 sssd[sssd][2228]: Starting up Nov 3 09:31:09 kjcf05n03 sssd[be[implicit_files]][2430]: Starting up Nov 3 09:31:09 kjcf05n03 sssd[nss][2520]: Starting up Nov 3 09:31:09 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 09:31:09 kjcf05n03 systemd[1]: Reached target User and Group Name Lookups. Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Login Service... Nov 3 09:31:09 kjcf05n03 systemd-logind[2619]: New seat seat0. Nov 3 09:31:09 kjcf05n03 systemd-logind[2619]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Login Service. Nov 3 09:31:09 kjcf05n03 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 09:31:09 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 09:31:09 kjcf05n03 python3.9[2270]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 09:31:09 kjcf05n03 python3.9[3192]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 09:31:09 kjcf05n03 systemd-sysctl[2775]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 09:31:09 kjcf05n03 systemd-sysctl[2775]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 09:31:09 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 09:31:09 kjcf05n03 network[2173]: Bringing up loopback interface: [ OK ] Nov 3 09:31:09 kjcf05n03 systemd-sysctl[3114]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 09:31:09 kjcf05n03 systemd-sysctl[3114]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 09:31:09 kjcf05n03 systemd[1]: Started LSB: Bring up/down networking. Nov 3 09:31:09 kjcf05n03 systemd[1]: Reached target Network. Nov 3 09:31:09 kjcf05n03 python3.9[3045]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 09:31:09 kjcf05n03 python3.9[3192]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 09:31:09 kjcf05n03 systemd[1]: Reached target Network is Online. Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 09:31:09 kjcf05n03 sm-notify[3182]: Version 2.3.3 starting Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting System Logger Daemon... Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 09:31:09 kjcf05n03 sshd[3168]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 09:31:09 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Notify NFS peers of a restart. Nov 3 09:31:09 kjcf05n03 systemd[1]: Reached target NFS client services. Nov 3 09:31:09 kjcf05n03 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 09:31:09 kjcf05n03 systemd[1]: Reached target Remote File Systems. Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Permit User Sessions... Nov 3 09:31:09 kjcf05n03 lldpad[3159]: setsockopt nearest_bridge: Invalid argument Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Permit User Sessions. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Getty on tty1. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 09:31:09 kjcf05n03 lldpad[3159]: setsockopt nearest_bridge: Invalid argument Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Serial Getty on ttyS0. Nov 3 09:31:09 kjcf05n03 systemd[1]: Reached target Login Prompts. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 09:31:09 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 09:31:09 kjcf05n03 beSetMlxConfig[2221]: Unloading MST PCI module (unused) - Success Nov 3 09:31:09 kjcf05n03 syslog-ng[3192]: [2024-11-03T15:29:56.679877] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 09:31:09 kjcf05n03 syslog-ng[3192]: [2024-11-03T15:29:56.680181] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 09:31:09 kjcf05n03 syslog-ng[3192]: [2024-11-03T15:29:56.680216] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 09:31:09 kjcf05n03 syslog-ng[3192]: [2024-11-03T15:29:56.680784] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 09:31:09 kjcf05n03 syslog-ng[3192]: [2024-11-03T15:29:56.680981] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 09:31:09 kjcf05n03 systemd[1]: Started System Logger Daemon. Nov 3 09:31:09 kjcf05n03 python3.9[3208]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 09:31:09 kjcf05n03 python3.9[3192]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 09:31:09 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 09:31:09 kjcf05n03 python3.9[3430]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 09:31:09 kjcf05n03 python3.9[3192]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 09:31:09 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 09:31:09 kjcf05n03 python3.9[3433]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 09:31:09 kjcf05n03 python3.9[3192]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 09:31:09 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 09:31:09 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 09:31:09 kjcf05n03 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 09:31:09 kjcf05n03 chronyd[2274]: System's initial offset : 0.002758 seconds slow of true (slew) Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 09:31:09 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 09:31:09 kjcf05n03 beSetMlxConfig[2221]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 09:31:09 kjcf05n03 beSetMlxConfig[2221]: ib mode Nov 3 09:31:09 kjcf05n03 root[3457]: openibd: Set node_desc for mlx5_0: kjcf05n03 HCA-1 Nov 3 09:31:09 kjcf05n03 root[3459]: openibd: Set node_desc for mlx5_1: kjcf05n03 HCA-2 Nov 3 09:31:09 kjcf05n03 beSetMlxConfig[2221]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 09:31:09 kjcf05n03 beSetMlxConfig[2221]: ib mode Nov 3 09:31:09 kjcf05n03 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 09:31:09 kjcf05n03 systemd-udevd[3474]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:31:09 kjcf05n03 systemd-udevd[3475]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:31:09 kjcf05n03 systemd-udevd[3478]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:31:09 kjcf05n03 systemd-udevd[3479]: Using default interface naming scheme 'rhel-8.0'. Nov 3 09:31:09 kjcf05n03 systemd-udevd[3479]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:31:09 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 09:31:09 kjcf05n03 systemd[3192]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:09 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[3516]: Setting up Mellanox network interface: ib0 Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[3517]: Setting up Mellanox network interface: ib1 Nov 3 09:31:09 kjcf05n03 systemd-udevd[3477]: Using default interface naming scheme 'rhel-8.0'. Nov 3 09:31:09 kjcf05n03 systemd-udevd[3476]: Using default interface naming scheme 'rhel-8.0'. Nov 3 09:31:09 kjcf05n03 systemd-udevd[3477]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:31:09 kjcf05n03 systemd-udevd[3476]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Puppet agent... Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[3566]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[3567]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[3596]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[3598]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[3599]: No configuration found for ib0 Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[3600]: No configuration found for ib1 Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[3606]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[3608]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 09:31:09 kjcf05n03 mlnx_conf_mgr[3647]: INFO: No configurations found for mlx5_0, skipping. Nov 3 09:31:09 kjcf05n03 mlnx_conf_mgr[3648]: INFO: No configurations found for mlx5_1, skipping. Nov 3 09:31:09 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 09:31:09 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 09:31:09 kjcf05n03 systemd[1]: Stopping Command Scheduler... Nov 3 09:31:09 kjcf05n03 systemd[1]: crond.service: Succeeded. Nov 3 09:31:09 kjcf05n03 systemd[1]: Stopped Command Scheduler. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 09:31:09 kjcf05n03 systemd[1]: Stopping Job spooling tools... Nov 3 09:31:09 kjcf05n03 systemd[1]: atd.service: Succeeded. Nov 3 09:31:09 kjcf05n03 systemd[1]: Stopped Job spooling tools. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 09:31:09 kjcf05n03 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 09:31:09 kjcf05n03 lldpad[3159]: init_ports: Error adding device ib0 Nov 3 09:31:09 kjcf05n03 lldpad[3159]: init_ports: Error adding device ib1 Nov 3 09:31:09 kjcf05n03 lldpad[3159]: Signal 15 received - terminating Nov 3 09:31:09 kjcf05n03 systemd[1]: lldpad.service: Succeeded. Nov 3 09:31:09 kjcf05n03 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 09:31:09 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 09:31:09 kjcf05n03 systemd[1]: lldpad.socket: Succeeded. Nov 3 09:31:09 kjcf05n03 systemd[1]: Closed lldpad.socket. Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 09:31:09 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting IPMI Driver... Nov 3 09:31:09 kjcf05n03 systemd[1]: Started IPMI Driver. Nov 3 09:31:09 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:09 kjcf05n03 systemd[3192]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:09 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Ipmievd Daemon... Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 1 | Nov-03-2024 | 12:59:41 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 2 | Nov-03-2024 | 13:00:32 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 3 | Nov-03-2024 | 13:00:33 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 4 | Nov-03-2024 | 13:01:38 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 5 | Nov-03-2024 | 13:01:39 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 6 | Nov-03-2024 | 15:27:17 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 7 | Nov-03-2024 | 15:27:17 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 8 | Nov-03-2024 | 15:27:17 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 9 | Nov-03-2024 | 15:27:17 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 10 | Nov-03-2024 | 15:27:17 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 11 | Nov-03-2024 | 15:27:17 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 12 | Nov-03-2024 | 15:27:17 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 13 | Nov-03-2024 | 15:27:17 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 14 | Nov-03-2024 | 15:27:17 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 15 | Nov-03-2024 | 15:27:17 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 16 | Nov-03-2024 | 15:27:17 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 17 | Nov-03-2024 | 15:27:17 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 18 | Nov-03-2024 | 15:27:47 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 19 | Nov-03-2024 | 15:27:47 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 20 | Nov-03-2024 | 15:27:47 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 21 | Nov-03-2024 | 15:27:47 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 22 | Nov-03-2024 | 15:27:47 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 23 | Nov-03-2024 | 15:27:47 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 24 | Nov-03-2024 | 15:27:47 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 25 | Nov-03-2024 | 15:27:47 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 26 | Nov-03-2024 | 15:27:47 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 27 | Nov-03-2024 | 15:27:47 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 28 | Nov-03-2024 | 15:27:47 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 29 | Nov-03-2024 | 15:27:47 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 30 | Nov-03-2024 | 15:27:47 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 31 | Nov-03-2024 | 15:27:47 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 32 | Nov-03-2024 | 15:27:47 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 33 | Nov-03-2024 | 15:27:47 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 34 | Nov-03-2024 | 15:27:47 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 35 | Nov-03-2024 | 15:27:47 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 36 | Nov-03-2024 | 15:27:47 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 37 | Nov-03-2024 | 15:27:47 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 38 | Nov-03-2024 | 15:27:47 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 39 | Nov-03-2024 | 15:27:47 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 40 | Nov-03-2024 | 15:27:49 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 41 | Nov-03-2024 | 15:27:49 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 42 | Nov-03-2024 | 15:27:49 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 43 | Nov-03-2024 | 15:27:49 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 44 | Nov-03-2024 | 15:27:49 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 45 | Nov-03-2024 | 15:27:49 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 46 | Nov-03-2024 | 15:27:49 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 47 | Nov-03-2024 | 15:27:49 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 48 | Nov-03-2024 | 15:27:49 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3991]: 49 | Nov-03-2024 | 15:27:49 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 09:31:09 kjcf05n03 ipmievd[3994]: Reading sensors... Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Ipmievd Daemon. Nov 3 09:31:09 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:09 kjcf05n03 systemd[3192]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 09:31:09 kjcf05n03 nscd[2242]: 2242 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 09:31:09 kjcf05n03 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 09:31:09 kjcf05n03 systemd[1]: Stopped Set Mellanox configuration. Nov 3 09:31:09 kjcf05n03 systemd[1]: Stopping Set Mellanox configuration... Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 09:31:09 kjcf05n03 beSetMlxConfig[4052]: ConnectX-3 multiport not detected Nov 3 09:31:09 kjcf05n03 beSetMlxConfig[4052]: Starting MST (Mellanox Software Tools) driver set Nov 3 09:31:09 kjcf05n03 beSetMlxConfig[4052]: Loading MST PCI module - Success Nov 3 09:31:09 kjcf05n03 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 09:31:09 kjcf05n03 beSetMlxConfig[4052]: [warn] mst_pciconf is already loaded, skipping Nov 3 09:31:09 kjcf05n03 beSetMlxConfig[4052]: Create devices Nov 3 09:31:09 kjcf05n03 beSetMlxConfig[4052]: Unloading MST PCI module (unused) - Success Nov 3 09:31:09 kjcf05n03 ipmievd[3994]: Waiting for events... Nov 3 09:31:09 kjcf05n03 beSetMlxConfig[4052]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 09:31:09 kjcf05n03 beSetMlxConfig[4052]: ib mode Nov 3 09:31:09 kjcf05n03 beSetMlxConfig[4052]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 09:31:09 kjcf05n03 beSetMlxConfig[4052]: ib mode Nov 3 09:31:09 kjcf05n03 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 09:31:09 kjcf05n03 systemd-udevd[4953]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:31:09 kjcf05n03 systemd-udevd[4952]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:31:09 kjcf05n03 systemd-udevd[4956]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:31:09 kjcf05n03 systemd-udevd[4958]: Using default interface naming scheme 'rhel-8.0'. Nov 3 09:31:09 kjcf05n03 systemd-udevd[4958]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:31:09 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 09:31:09 kjcf05n03 systemd[3192]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:09 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[4994]: Setting up Mellanox network interface: ib0 Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[4995]: Setting up Mellanox network interface: ib1 Nov 3 09:31:09 kjcf05n03 systemd-udevd[4954]: Using default interface naming scheme 'rhel-8.0'. Nov 3 09:31:09 kjcf05n03 systemd-udevd[4955]: Using default interface naming scheme 'rhel-8.0'. Nov 3 09:31:09 kjcf05n03 systemd-udevd[4954]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:31:09 kjcf05n03 systemd-udevd[4955]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[5044]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[5045]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[5074]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[5076]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[5077]: No configuration found for ib0 Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[5078]: No configuration found for ib1 Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[5082]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 09:31:09 kjcf05n03 mlnx_interface_mgr[5086]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 09:31:09 kjcf05n03 mlnx_conf_mgr[5119]: INFO: No configurations found for mlx5_0, skipping. Nov 3 09:31:09 kjcf05n03 mlnx_conf_mgr[5126]: INFO: No configurations found for mlx5_1, skipping. Nov 3 09:31:09 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 09:31:09 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}12c50682d36d261b8abdcf824befd7359965a91e5391e023211a613c674b7ff1' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}12c50682d36d261b8abdcf824befd7359965a91e5391e023211a613c674b7ff1' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}1828756480dfd9cecbfe0965b5acfeac2581f5c36699cba42227dfefecd912d4' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}1828756480dfd9cecbfe0965b5acfeac2581f5c36699cba42227dfefecd912d4' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}b04b7df4750ebb624fa3bc09100840000e63dab16ebedecf60a68eba5ceec63d' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}b04b7df4750ebb624fa3bc09100840000e63dab16ebedecf60a68eba5ceec63d' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}cce43d1f4b6c2d96a278f23c8af8dadc6fc8434b41bc1e5e1e079b4e7e6aa057' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}cce43d1f4b6c2d96a278f23c8af8dadc6fc8434b41bc1e5e1e079b4e7e6aa057' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 09:31:09 kjcf05n03 systemd[1]: Stopping NTP client/server... Nov 3 09:31:09 kjcf05n03 chronyd[2274]: chronyd exiting Nov 3 09:31:09 kjcf05n03 systemd[1]: chronyd.service: Succeeded. Nov 3 09:31:09 kjcf05n03 systemd[1]: Stopped NTP client/server. Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 09:31:09 kjcf05n03 chronyd[5161]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 09:31:09 kjcf05n03 chronyd[5161]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 09:31:09 kjcf05n03 chronyd[5161]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 09:31:09 kjcf05n03 chronyd[5161]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 09:31:09 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 09:31:09 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:09 kjcf05n03 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 09:31:09 kjcf05n03 systemd[1]: dwd.service: Succeeded. Nov 3 09:31:09 kjcf05n03 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 09:31:09 kjcf05n03 dwd[5192]: dwd: vMay 29 2024 : 15:38:26 Nov 3 09:31:09 kjcf05n03 dwd[5192]: /usr/sbin/dwd -i 15 -d Nov 3 09:31:09 kjcf05n03 dwd[5192]: dwd: option Lethal: 0 Nov 3 09:31:09 kjcf05n03 dwd[5192]: dwd: option Interval: 15 Nov 3 09:31:09 kjcf05n03 dwd[5192]: dwd: option abrtlimit: 10 Nov 3 09:31:09 kjcf05n03 dwd[5192]: dwd: option DZPeriod: 604800 Nov 3 09:31:09 kjcf05n03 dwd[5192]: dwd: option SmartPeriod: 43200 Nov 3 09:31:09 kjcf05n03 dwd[5192]: dwd: option SDDEnabled: 1 Nov 3 09:31:09 kjcf05n03 dwd[5192]: dwd: option SDDAwaitScale: 3 Nov 3 09:31:09 kjcf05n03 dwd[5192]: dwd: option SDDAwaitMin: 100 Nov 3 09:31:09 kjcf05n03 dwd[5192]: dwd: option Verbosity: 1 Nov 3 09:31:09 kjcf05n03 dwd[5192]: dwd: option StandAlone: 0 Nov 3 09:31:09 kjcf05n03 dwd[5192]: option Lethal: 0 Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 09:31:09 kjcf05n03 dwd[5192]: option Interval: 15 Nov 3 09:31:09 kjcf05n03 dwd[5192]: option abrtlimit: 10 Nov 3 09:31:09 kjcf05n03 dwd[5192]: option DZPeriod: 604800 Nov 3 09:31:09 kjcf05n03 dwd[5192]: option SmartPeriod: 43200 Nov 3 09:31:09 kjcf05n03 dwd[5192]: option SDDEnabled: 1 Nov 3 09:31:09 kjcf05n03 dwd[5192]: option SDDAwaitScale: 3 Nov 3 09:31:09 kjcf05n03 dwd[5192]: option SDDAwaitMin: 100 Nov 3 09:31:09 kjcf05n03 dwd[5192]: option Verbosity: 1 Nov 3 09:31:09 kjcf05n03 dwd[5192]: option StandAlone: 0 Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 09:31:09 kjcf05n03 dwd[5194]: option Lethal now set to 1 Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 09:31:09 kjcf05n03 dwd[5194]: option abrtlimit now set to 1 Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 09:31:09 kjcf05n03 dwd[5194]: option SmartPeriod now set to 86400 Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 09:31:09 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 09:31:09 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Discard unused blocks. Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:09 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:09 kjcf05n03 python3.9[5223]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 09:31:09 kjcf05n03 python3.9[3192]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 09:31:09 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Periodic ZFS scrub. Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:09 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 09:31:09 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting Sed Control Plane worker process... Nov 3 09:31:09 kjcf05n03 sedcpwrkr[5362]: Using config script: /etc/sedcpwrkr.conf Nov 3 09:31:09 kjcf05n03 sedcpwrkr[5362]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 09:31:09 kjcf05n03 sedcpwrkr[5362]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 09:31:09 kjcf05n03 sedcpwrkr[5362]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 09:31:09 kjcf05n03 sedcpwrkr[5362]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 09:31:09 kjcf05n03 sedcpwrkr[5362]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 09:31:09 kjcf05n03 sedcpwrkr[5362]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 09:31:09 kjcf05n03 sedcpwrkr-server[5393]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 09:31:09 kjcf05n03 sedcpwrkr[5362]: celery multi v5.2.7 (dawn-chorus) Nov 3 09:31:09 kjcf05n03 sedcpwrkr[5362]: > Starting nodes... Nov 3 09:31:09 kjcf05n03 sedcpwrkr[5362]: > sedcpwrkr@kjcf05n03: OK Nov 3 09:31:09 kjcf05n03 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 09:31:09 kjcf05n03 sedcpwrkr-server[5395]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 09:31:09 kjcf05n03 sedcpwrkr-server[5395]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 09:31:09 kjcf05n03 sedcpwrkr-server[5395]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 09:31:09 kjcf05n03 systemd[1]: Started Sed Control Plane worker process. Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 09:31:09 kjcf05n03 systemd[1]: Reloading System Logger Daemon. Nov 3 09:31:09 kjcf05n03 systemd[1]: Reloaded System Logger Daemon. Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 09:31:09 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 09:31:09 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 09:31:09 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:09 kjcf05n03 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 09:31:09 kjcf05n03 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 09:31:09 kjcf05n03 iptables.init[5462]: iptables: Applying firewall rules: [ OK ] Nov 3 09:31:09 kjcf05n03 systemd[1]: Started IPv4 firewall with iptables. Nov 3 09:31:09 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:10 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 09:31:10 kjcf05n03 systemd[3192]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:10 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:10 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:10 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 09:31:10 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 09:31:10 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 09:31:10 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 09:31:10 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 09:31:10 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 09:31:10 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 09:31:10 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 09:31:10 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 09:31:10 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 09:31:11 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 09:31:11 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 09:31:11 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 09:31:11 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 09:31:11 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 09:31:11 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 09:31:11 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 09:31:11 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 09:31:11 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 09:31:11 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 09:31:11 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 09:31:11 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 09:31:11 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 09:31:11 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 09:31:11 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 09:31:11 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 09:31:11 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 09:31:11 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 09:31:11 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 09:31:11 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 09:31:11 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 09:31:11 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 09:31:11 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 09:31:11 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 09:31:11 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 09:31:11 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 09:31:11 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 09:31:11 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 09:31:11 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 09:31:11 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 09:31:11 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 09:31:11 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 09:31:11 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 09:31:11 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 09:31:11 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 09:31:11 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 09:31:11 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 09:31:11 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 09:31:11 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 09:31:11 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 09:31:11 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:11 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 09:31:11 kjcf05n03 systemd[1]: openhpid.service: Supervising process 5559 which is not our child. We'll most likely not notice when it exits. Nov 3 09:31:11 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 09:31:11 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:11 kjcf05n03 openhpid[5559]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 09:31:11 kjcf05n03 openhpid[5559]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 09:31:11 kjcf05n03 openhpid[5559]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 09:31:11 kjcf05n03 openhpid[5559]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 09:31:11 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:12 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:12 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:12 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 09:31:12 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 09:31:12 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 09:31:12 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 09:31:12 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:12 kjcf05n03 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 09:31:12 kjcf05n02 LCNmon[17892]: 10.16.100.53 is unreachable via ib1 Nov 3 09:31:12 kjcf05n02 LCNmon[17892]: 10.16.100.59 is unreachable via ib1 Nov 3 09:31:12 kjcf05n03 dcs-collectord[5650]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 09:31:12 kjcf05n03 hpi.inv.log[5650]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 09:31:12 kjcf05n03 dcs-collectord[5650]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 09:31:12 kjcf05n03 dcs-collectord[5650]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 09:31:12 kjcf05n03 dcs-collector[5641]: Starting dcs-collector:[ OK ] Nov 3 09:31:12 kjcf05n03 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 09:31:12 kjcf05n03 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 09:31:12 kjcf05n03 dcs-collectord[5653]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 09:31:12 kjcf05n03 dcs-collectord[5653]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 09:31:12 kjcf05n03 dcs-collectord[5653]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 09:31:12 kjcf05n03 dcs-collectord[5653]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 09:31:12 kjcf05n03 dcs-collectord[5653]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 09:31:12 kjcf05n03 dcs-collectord[5653]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 09:31:12 kjcf05n03 dcs-collectord[5653]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 09:31:12 kjcf05n03 dcs-collectord[5653]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259344344", "units": "kB"}, {"name": "MemAvailable", "value": "258623812", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821328", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686848", "units": "kB"}, {"name": "Inactive", "value": "963540", "units": "kB"}, {"name": "Active(anon)", "value": "1520780", "units": "kB"}, {"name": "Inactive(anon)", "value": "827280", "units": "kB"}, {"name": "Active(file)", "value": "166068", "units": "kB"}, {"name": "Inactive(file)", "value": "136260", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "754220", "units": "kB"}, {"name": "Mapped", "value": "86284", "units": "kB"}, {"name": "Shmem", "value": "1593452", "units": "kB"}, {"name": "KReclaimable", "value": "108776", "units": "kB"}, {"name": "Slab", "value": "275716", "units": "kB"}, {"name": "SReclaimable", "value": "108776", "units": "kB"}, {"name": "SUnreclaim", "value": "166940", "units": "kB"}, {"name": "KernelStack", "value": "9696", "units": "kB"}, {"name": "PageTables", "value": "20540", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3226832", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11264", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "6144", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "256328", "units": "kB"}, {"name": "DirectMap2M", "value": "21628928", "units": "kB"}, {"name": "DirectMap1G", "value": "246415360", "units": "kB"}]}' Nov 3 09:31:12 kjcf05n03 dcs-collectord[5653]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 09:31:12 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:13 kjcf05n03 systemd[3192]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:13 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:13 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:13 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 09:31:13 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 09:31:13 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 09:31:13 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 09:31:13 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:13 kjcf05n03 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 09:31:13 kjcf05n03 firmware-update-orc[5734]: Using config script: /etc/firmware_update_orc.conf Nov 3 09:31:13 kjcf05n03 firmware-update-orc[5734]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 09:31:13 kjcf05n03 firmware-update-orc[5734]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 09:31:13 kjcf05n03 firmware-update-orc[5734]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 09:31:13 kjcf05n03 firmware-update-orc[5734]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 09:31:13 kjcf05n03 firmware-update-orc[5734]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 09:31:13 kjcf05n03 firmware-update-orc[5734]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 09:31:13 kjcf05n03 dcs-collectord[5653]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 09:31:13 kjcf05n03 dcs-collectord[5653]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730647872.5296583], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730647873.7005088], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730647872.46185, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 09:31:13 kjcf05n03 firmware-update-orc-server[5770]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 09:31:13 kjcf05n03 firmware-update-orc[5734]: celery multi v5.2.7 (dawn-chorus) Nov 3 09:31:13 kjcf05n03 firmware-update-orc[5734]: > Starting nodes... Nov 3 09:31:13 kjcf05n03 firmware-update-orc[5734]: > worker1@kjcf05n03: OK Nov 3 09:31:13 kjcf05n03 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 09:31:13 kjcf05n03 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 09:31:13 kjcf05n03 firmware-update-orc-server[5799]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 09:31:14 kjcf05n03 firmware-update-orc-server[5799]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 09:31:14 kjcf05n03 firmware-update-orc-server[5799]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 09:31:14 kjcf05n03 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 09:31:14 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:14 kjcf05n03 systemd[3192]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:14 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:14 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:14 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 09:31:14 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 09:31:14 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 09:31:14 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 09:31:14 kjcf05n03 dbus-daemon[2163]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 09:31:14 kjcf05n03 dbus-daemon[2163]: [system] Reloaded configuration Nov 3 09:31:14 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 09:31:14 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 09:31:14 kjcf05n03 dbus-daemon[2163]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 09:31:14 kjcf05n03 dbus-daemon[2163]: [system] Reloaded configuration Nov 3 09:31:14 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 09:31:14 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 09:31:14 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 09:31:14 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 09:31:14 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:14 kjcf05n03 systemd[1]: Starting Manages hardware resources... Nov 3 09:31:15 kjcf05n03 ras-resource-manager-agent[5915]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 09:31:15 kjcf05n03 ras-resource-manager-agent[5901]: Starting ras-resource-manager-agent:[ OK ] Nov 3 09:31:15 kjcf05n03 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 09:31:15 kjcf05n03 ras-resource-manager-agent[5917]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 09:31:15 kjcf05n03 ras-resource-manager-client[5917]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 09:31:15 kjcf05n03 systemd[1]: Started Manages hardware resources. Nov 3 09:31:15 kjcf05n03 ras-resource-manager-client[5917]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 09:31:15 kjcf05n03 ras-resource-manager-client[5927]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 09:31:15 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:15 kjcf05n03 systemd[3192]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:15 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:15 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:15 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 09:31:15 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 09:31:15 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:16 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 09:31:16 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:16 kjcf05n03 systemd[3192]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: Press Ctrl+C to exit. Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: Plugin support version 1.0 Nov 3 09:31:16 kjcf05n03 zabbix_agent2[6001]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 09:31:16 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:16 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:16 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:17 kjcf05n03 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 09:31:17 kjcf05n03 dcs-notification-sender[6076]: dcs-notification-senderd is stopped Nov 3 09:31:17 kjcf05n03 zabbix-agent2[6090]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 09:31:17 kjcf05n03 dcs-notification-sender[6076]: Starting notification-sender:[ OK ] Nov 3 09:31:17 kjcf05n03 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 09:31:17 kjcf05n03 zabbix-agent2[6096]: INFO DCS notification agent started. (agent.py:61) Nov 3 09:31:17 kjcf05n03 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 09:31:17 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:17 kjcf05n03 systemd[3192]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:17 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:17 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:17 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:18 kjcf05n03 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 09:31:17 kjcf05n00 mcfcli[3673891]: %3|1730647877.965|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:31:18 kjcf05n03 dcs-collectord[6180]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 09:31:18 kjcf05n03 dcs-collectord[6180]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 09:31:18 kjcf05n03 dcs-bulk-data-sender[6180]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 09:31:18 kjcf05n03 dcs-bulk-data-sender[6171]: Starting bulk-data-sender:[ OK ] Nov 3 09:31:18 kjcf05n03 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 09:31:18 kjcf05n03 dcs-collectord[6204]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 09:31:18 kjcf05n03 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 09:31:18 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:18 kjcf05n03 systemd[3192]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:18 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:18 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:18 kjcf05n03 nscd[2242]: 2242 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 09:31:18 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 09:31:18 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 09:31:18 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 09:31:18 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 09:31:18 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 09:31:18 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 09:31:18 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 09:31:18 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 09:31:18 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 09:31:18 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 09:31:18 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 09:31:18 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 09:31:18 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 09:31:18 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 09:31:19 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 09:31:19 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 09:31:19 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 09:31:19 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 09:31:19 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 09:31:19 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 09:31:19 kjcf05n03 systemd[1]: Stopping System Security Services Daemon... Nov 3 09:31:19 kjcf05n03 sssd[nss][2520]: Shutting down (status = 0) Nov 3 09:31:19 kjcf05n03 sssd[be[implicit_files]][2430]: Shutting down (status = 0) Nov 3 09:31:19 kjcf05n03 systemd[1]: sssd.service: Succeeded. Nov 3 09:31:19 kjcf05n03 systemd[1]: Stopped System Security Services Daemon. Nov 3 09:31:19 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 09:31:19 kjcf05n03 sssd[sssd][6269]: Starting up Nov 3 09:31:20 kjcf05n03 python3.9[5223]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 09:31:20 kjcf05n03 python3.9[3192]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:20 kjcf05n03 sssd[be[implicit_files]][6270]: Starting up Nov 3 09:31:20 kjcf05n03 sssd[nss][6271]: Starting up Nov 3 09:31:20 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 09:31:20 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 09:31:20 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 09:31:21 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure) defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 09:31:21 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure: defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 09:31:21 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure) defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 09:31:21 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure: defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 09:31:21 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 09:31:21 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 09:31:21 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 09:31:21 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 09:31:21 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 09:31:21 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 09:31:21 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:21 kjcf05n03 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 09:31:22 kjcf05n03 icinga2[6335]: [2024-11-03 09:31:21 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 09:31:22 kjcf05n03 icinga2[6335]: [2024-11-03 09:31:21 -0600] information/cli: Loading configuration file(s). Nov 3 09:31:22 kjcf05n03 icinga2[6335]: [2024-11-03 09:31:21 -0600] information/ConfigItem: Committing config item(s). Nov 3 09:31:22 kjcf05n03 icinga2[6335]: [2024-11-03 09:31:21 -0600] information/ApiListener: My API identity: kjcf05n03 Nov 3 09:31:22 kjcf05n03 icinga2[6335]: [2024-11-03 09:31:21 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 09:31:22 kjcf05n03 icinga2[6335]: [2024-11-03 09:31:21 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 09:31:22 kjcf05n03 icinga2[6335]: [2024-11-03 09:31:21 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 09:31:22 kjcf05n03 icinga2[6335]: [2024-11-03 09:31:21 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 09:31:22 kjcf05n03 icinga2[6335]: [2024-11-03 09:31:21 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 09:31:22 kjcf05n03 icinga2[6335]: [2024-11-03 09:31:21 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 09:31:22 kjcf05n03 icinga2[6335]: [2024-11-03 09:31:21 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 09:31:22 kjcf05n03 icinga2[6335]: [2024-11-03 09:31:21 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 09:31:22 kjcf05n03 icinga2[6335]: [2024-11-03 09:31:21 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 09:31:22 kjcf05n03 icinga2[6335]: [2024-11-03 09:31:21 -0600] information/cli: Closing console log. Nov 3 09:31:22 kjcf05n03 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 09:31:22 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:22 kjcf05n03 systemd[3192]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:22 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:22 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:22 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 09:31:22 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 09:31:22 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:22 kjcf05n03 systemd[1]: Started Icinga2 network monitor. Nov 3 09:31:23 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:23 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 09:31:23 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:23 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:23 kjcf05n00 zabbix-server[1142254]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 09:31:23 kjcf05n00 zabbix-server[1142254]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 273.34\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 168.76\\"}}"' Nov 3 09:31:23 kjcf05n00 log_interesting_event.py[1142254]: Event '46057' acknowledged Nov 3 09:31:24 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 09:31:24 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 09:31:24 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 09:31:24 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 09:31:24 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 09:31:24 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 09:31:24 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 09:31:24 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 09:31:24 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 09:31:24 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 09:31:24 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 09:31:24 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 09:31:24 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 09:31:24 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 09:31:24 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:24 kjcf05n03 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 09:31:24 kjcf05n03 nslcd[7088]: version 0.9.9 starting Nov 3 09:31:24 kjcf05n03 nslcd[7088]: accepting connections Nov 3 09:31:24 kjcf05n03 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 09:31:24 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:25 kjcf05n03 systemd[3192]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:25 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:25 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:25 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 09:31:25 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 09:31:25 kjcf05n03 dcs-bulk-data-sender[6204]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 09:31:25 kjcf05n03 dcs-collectord[6204]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 09:31:25 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 09:31:25 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 09:31:25 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 09:31:25 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 09:31:26 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 09:31:26 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 09:31:26 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:26 kjcf05n03 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 09:31:26 kjcf05n03 dearcpw[7192]: Using config script: /etc/dearcpw.conf Nov 3 09:31:26 kjcf05n03 dearcpw[7192]: - Creating default directory: '/var/log/dearcpw' Nov 3 09:31:26 kjcf05n03 dearcpw[7192]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 09:31:26 kjcf05n03 dearcpw[7192]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 09:31:26 kjcf05n03 dearcpw[7192]: - Creating default directory: '/var/run/dearcpw' Nov 3 09:31:26 kjcf05n03 dearcpw[7192]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 09:31:26 kjcf05n03 dearcpw[7192]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 09:31:26 kjcf05n03 dearcpw-server[7232]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 09:31:26 kjcf05n03 dearcpw[7192]: celery multi v5.2.7 (dawn-chorus) Nov 3 09:31:26 kjcf05n03 dearcpw[7192]: > Starting nodes... Nov 3 09:31:26 kjcf05n03 dearcpw[7192]: > dearcpw@kjcf05n03: OK Nov 3 09:31:26 kjcf05n03 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 09:31:26 kjcf05n03 dearcpw-server[7234]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 09:31:26 kjcf05n03 dearcpw-server[7234]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 09:31:26 kjcf05n03 dearcpw-server[7234]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 09:31:27 kjcf05n03 systemd[1]: Started DEAR Control Plane worker process. Nov 3 09:31:27 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:27 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:27 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 09:31:27 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 09:31:27 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 09:31:27 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 09:31:27 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 09:31:27 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 09:31:27 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 09:31:27 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 09:31:27 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 09:31:27 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 09:31:27 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:45664). Nov 3 09:31:27 kjcf05n01 rsyncd[3018333]: connect from kjcf05n03 (172.16.2.6) Nov 3 09:31:27 kjcf05n01 rsyncd[3018333]: rsync to puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 09:31:27 kjcf05n01 rsyncd[3018333]: receiving file list Nov 3 09:31:27 kjcf05n01 rsyncd[3018333]: sent 29 bytes received 333 bytes total size 10901 Nov 3 09:31:27 kjcf05n01 systemd[1]: rsyncd@616-172.16.2.2:873-172.16.2.6:45664.service: Succeeded. Nov 3 09:31:27 kjcf05n03 puppet[7437]: IEC: 017000000: Node is up and running: { "node": "kjcf05n03" } Nov 3 09:31:27 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 09:31:27 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 09:31:27 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 09:31:27 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 09:31:27 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 09:31:27 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 09:31:27 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 09:31:27 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 09:31:27 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 09:31:27 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 09:31:27 kjcf05n03 dcs-collectord[5653]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 09:31:27 kjcf05n03 dcs-collectord[5653]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 09:31:28 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 09:31:28 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 09:31:28 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 09:31:28 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 09:31:29 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 09:31:29 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 09:31:29 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 09:31:29 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 09:31:29 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 09:31:29 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 09:31:29 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 09:31:29 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 09:31:30 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 09:31:30 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 09:31:30 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:30 kjcf05n03 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 09:31:30 kjcf05n03 diskless-swap[7618]: HA_PS_000: recovering journal Nov 3 09:31:30 kjcf05n03 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 09:31:30 kjcf05n03 diskless-swap[7618]: HA_PS_000: clean, 2272/6400 files, 7039/25600 blocks Nov 3 09:31:30 kjcf05n03 diskless-swap[7618]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 09:31:30 kjcf05n03 diskless-swap[7618]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 09:31:30 kjcf05n03 diskless-swap[7618]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 09:31:30 kjcf05n03 diskless-swap[7618]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 09:31:30 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 09:31:30 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:30 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:30 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 09:31:30 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 09:31:30 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 09:31:30 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 09:31:30 kjcf05n03 systemd[1]: Stopping OpenSSH server daemon... Nov 3 09:31:31 kjcf05n03 systemd[1]: sshd.service: Succeeded. Nov 3 09:31:31 kjcf05n03 systemd[1]: Stopped OpenSSH server daemon. Nov 3 09:31:31 kjcf05n03 systemd[1]: Stopped target sshd-keygen.target. Nov 3 09:31:31 kjcf05n03 systemd[1]: Stopping sshd-keygen.target. Nov 3 09:31:31 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 09:31:31 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 09:31:31 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 09:31:31 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 09:31:31 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 09:31:31 kjcf05n03 ipmievd[3994]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 09:31:31 kjcf05n03 ipmievd[3994]: System Event sensor - Timestamp Clock Sync Nov 3 09:31:31 kjcf05n03 ipmievd[3192]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:31 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 09:31:31 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 09:31:32 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 09:31:32 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 09:31:32 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 09:31:32 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 09:31:32 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 09:31:32 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 09:31:32 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 09:31:32 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 09:31:33 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 09:31:33 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 09:31:33 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 09:31:33 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 09:31:33 kjcf05n00 mcfcli[3673891]: %3|1730647893.353|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 09:31:34 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 09:31:34 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 09:31:34 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 09:31:34 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 09:31:34 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:34 kjcf05n03 systemd[1]: Set up automount opt-firmware.automount. Nov 3 09:31:34 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:34 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:34 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 09:31:34 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 09:31:34 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:35 kjcf05n03 systemd[1]: Set up automount mnt-llog.automount. Nov 3 09:31:35 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:35 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:35 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 09:31:35 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 09:31:35 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:35 kjcf05n03 systemd[1]: Set up automount usr-share-man.automount. Nov 3 09:31:35 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:35 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:35 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 09:31:35 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 09:31:35 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 09:31:35 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 09:31:35 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 09:31:35 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 09:31:35 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 09:31:35 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 09:31:35 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 09:31:35 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 09:31:35 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:35 kjcf05n03 systemd[1]: Starting Crash recovery kernel arming... Nov 3 09:31:35 kjcf05n03 kdumpctl[7847]: kdump: No kdump initial ramdisk found. Nov 3 09:31:35 kjcf05n03 kdumpctl[7847]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 09:31:36 kjcf05n03 dracut[7959]: dracut-049-135.git20210121.el8 Nov 3 09:31:36 kjcf05n03 dracut[7961]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 09:31:36 kjcf05n03 dracut[7961]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 09:31:36 kjcf05n03 dracut[7961]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 09:31:36 kjcf05n03 dracut[7961]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 09:31:36 kjcf05n03 dracut[7961]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 09:31:36 kjcf05n03 dracut[7961]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 09:31:36 kjcf05n03 dracut[7961]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 09:31:36 kjcf05n03 dracut[7961]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local dev holder Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + require_binaries mdadm expr Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _module_name=90hperaid Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ mdadm = \-\m ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for cmd in "$@" Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + find_binary mdadm Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for cmd in "$@" Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + find_binary expr Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n -h ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for dev in "${!host_fs_types[@]}" Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ nfs != *_raid_member ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + continue Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _ret=255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + ret=255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ 255 = 0 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ 255 = 255 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ module_depends hperaid Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: +++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: +++ set -x Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ depends Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo rootfs-block Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ return 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ _ret=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ return 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for _moddep in $(module_depends $_mod) Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all == *\ hperaid\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + add_dracutmodules+=' rootfs-block ' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ == *\ hperaid\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check_module rootfs-block Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _mod=rootfs-block Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ == *\ rootfs-block\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n '' ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all == *\ rootfs-block\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + module_check rootfs-block 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 2 -eq 2 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _forced=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _ret=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + ret=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ 0 = 0 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ module_depends rootfs-block Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: +++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 09:31:36 kjcf05n03 kdumpctl[3192]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ depends Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo fs-lib Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ _ret=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ return 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for _moddep in $(module_depends $_mod) Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all == *\ rootfs-block\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + add_dracutmodules+=' fs-lib ' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ == *\ rootfs-block\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check_module fs-lib Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _mod=fs-lib Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n '' ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + mods_checked_as_dep+=' fs-lib ' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all == *\ fs-lib\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + module_check fs-lib 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 2 -eq 2 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _forced=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _ret=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + ret=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ 0 = 0 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ module_depends fs-lib Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: +++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ depends Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ return 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ _ret=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ return 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + mods_to_load+=' fs-lib ' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + mods_to_load+=' rootfs-block ' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + mods_to_load+=' hperaid ' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _mod=90kernel-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _mod=kernel-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check_module kernel-modules 1 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _mod=kernel-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all = all ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + module_check kernel-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 1 -eq 2 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + true Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _ret=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + ret=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ 0 != 0 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ module_depends kernel-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: +++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ depends Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ true Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ _ret=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ return 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + mods_to_load+=' kernel-modules ' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _mod=90kernel-modules-extra Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _mod=kernel-modules-extra Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check_module kernel-modules-extra 1 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _mod=kernel-modules-extra Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all = all ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + module_check kernel-modules-extra Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 1 -eq 2 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + true Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _ret=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + ret=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ 0 != 0 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ module_depends kernel-modules-extra Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: +++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ depends Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ true Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ _ret=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ return 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + mods_to_load+=' kernel-modules-extra ' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _mod=90kernel-network-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _mod=kernel-network-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check_module kernel-network-modules 1 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _mod=kernel-network-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all = all ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + module_check kernel-network-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 1 -eq 2 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _ret=255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + ret=255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ 255 != 0 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 1 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _mod=90livenet Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _mod=livenet Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check_module livenet 1 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _mod=livenet Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all = all ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + module_check livenet Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 1 -eq 2 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _ret=255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + ret=255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ 255 != 0 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 1 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _mod=90lvm Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _mod=lvm Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check_module lvm 1 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _mod=lvm Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 09:31:36 kjcf05n03 kdumpctl[3192]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all = all ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + module_check lvm Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 1 -eq 2 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + require_binaries lvm Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _module_name=90lvm Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ lvm = \-\m ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for cmd in "$@" Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + find_binary lvm Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n -h ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for fs in "${host_fs_types[@]}" Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ nfs = LVM*_member ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _ret=255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + ret=255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ 255 != 0 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 1 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _mod=90mdraid Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _mod=mdraid Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check_module mdraid 1 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _mod=mdraid Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all = all ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + module_check mdraid Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 1 -eq 2 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _rootdev Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + require_binaries mdadm expr Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _module_name=90mdraid Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ mdadm = \-\m ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for cmd in "$@" Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + find_binary mdadm Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for cmd in "$@" Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + find_binary expr Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n -h ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for dev in "${!host_fs_types[@]}" Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ nfs != *_raid_member ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + continue Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _ret=255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + ret=255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ 255 != 0 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 1 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _mod=90multipath Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _mod=multipath Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check_module multipath 1 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _mod=multipath Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all = all ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + module_check multipath Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 1 -eq 2 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _rootdev Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n -h ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for_each_host_dev_and_slaves is_mpath Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _func=is_mpath Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _dev Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for _dev in "${host_devs[@]}" Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + continue Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 1 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _ret=255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + ret=255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ 255 != 0 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 1 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _mod=90qemu Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _mod=qemu Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check_module qemu 1 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _mod=qemu Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all = all ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + module_check qemu Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 1 -eq 2 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n -h ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + type -P systemd-detect-virt Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ systemd-detect-virt --vm Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + vm=none Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + (( 1 != 0 )) Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _ret=255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + ret=255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ 255 != 0 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 1 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _mod=90qemu-net Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _mod=qemu-net Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check_module qemu-net 1 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _mod=qemu-net Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all = all ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + module_check qemu-net Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 1 -eq 2 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n -h ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + type -P systemd-detect-virt Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ systemd-detect-virt --vm Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + vm= Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + (( 1 != 0 )) Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _ret=255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + ret=255 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ 255 != 0 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + return 1 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _mod=90stratis Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + _mod=stratis Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check_module stratis 1 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _mod=stratis Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ all = all ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + module_check stratis Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 1 -eq 2 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _module_name=90stratis Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + local _ret=0 Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + [[ stratisd-init = \-\m ]] Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + for cmd in "$@" Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + find_binary stratisd-init Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 09:31:36 kjcf05n03 kdumpctl[7847]: + set +x Nov 3 09:31:36 kjcf05n03 dracut[7961]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 09:31:36 kjcf05n03 dracut[7961]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 09:31:36 kjcf05n03 dracut[7961]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 09:31:36 kjcf05n03 dracut[7961]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 09:31:37 kjcf05n03 dracut[7961]: memstrack is available Nov 3 09:31:37 kjcf05n03 dracut[7961]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 09:31:37 kjcf05n03 dracut[7961]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 09:31:37 kjcf05n03 dracut[7961]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 09:31:37 kjcf05n03 dracut[7961]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 09:31:37 kjcf05n03 dracut[7961]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 09:31:37 kjcf05n03 dracut[7961]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 09:31:37 kjcf05n03 dracut[7961]: *** Including module: bash *** Nov 3 09:31:37 kjcf05n03 dracut[7961]: *** Including module: systemd *** Nov 3 09:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 09:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 09:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 09:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 09:31:38 kjcf05n03 dracut[7961]: *** Including module: fips *** Nov 3 09:31:38 kjcf05n03 dracut[7961]: *** Including module: systemd-initrd *** Nov 3 09:31:38 kjcf05n03 dracut[7961]: *** Including module: watchdog-modules *** Nov 3 09:31:38 kjcf05n03 dracut[7961]: *** Including module: nss-softokn *** Nov 3 09:31:38 kjcf05n03 dracut[7961]: *** Including module: i18n *** Nov 3 09:31:38 kjcf05n03 dracut[7961]: No KEYMAP configured. Nov 3 09:31:38 kjcf05n03 dracut[7961]: *** Including module: network-legacy *** Nov 3 09:31:39 kjcf05n03 dracut[7961]: *** Including module: network *** Nov 3 09:31:39 kjcf05n03 dracut[7961]: *** Including module: ib_bonding *** Nov 3 09:31:39 kjcf05n03 dracut[7961]: *** Including module: drm *** Nov 3 09:31:42 kjcf05n03 dracut[7961]: *** Including module: hperaid *** Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + install Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + local rule rule_path Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + inst_multiple cat expr Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.SYJQ3c/initramfs -a -f cat expr Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + _ret=0 Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + (( 0 != 0 )) Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + : Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + inst_multiple -o mdmon Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.SYJQ3c/initramfs -a -f -o mdmon Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + _ret=0 Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + (( 0 != 0 )) Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + : Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: ++ command -v partx Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + inst /usr/sbin/partx /sbin/partx Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + local _hostonly_install Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + [[ -e /tmp/dracut.SYJQ3c/initramfs//sbin/partx ]] Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.SYJQ3c/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + (( 0 != 0 )) Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + : Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: ++ command -v mdadm Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + local _hostonly_install Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + [[ -e /tmp/dracut.SYJQ3c/initramfs//sbin/mdadm ]] Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.SYJQ3c/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + (( 0 != 0 )) Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + : Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + [[ yes == \y\e\s ]] Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + local _raidconf Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: ++ cmdline Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: ++ local _activated dev line UUID Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: ++ declare -A _activated Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: ++ for dev in "${!host_fs_types[@]}" Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: ++ [[ nfs != *_raid_member ]] Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: ++ continue Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + _raidconf= Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + [[ -n '' ]] Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + inst_rules 64-md-raid.rules Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + local _target=/etc/udev/rules.d _rule _found Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + inst_dir /usr/lib/udev/rules.d Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + [[ -e /tmp/dracut.SYJQ3c/initramfs//usr/lib/udev/rules.d ]] Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + inst_dir /etc/udev/rules.d Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + [[ -e /tmp/dracut.SYJQ3c/initramfs//etc/udev/rules.d ]] Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + for _rule in "$@" Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + continue Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + continue Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + for r in '' $dracutbasedir/rules.d/ Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + [[ 64-md-raid.rules != /* ]] Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + continue Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + for r in '' $dracutbasedir/rules.d/ Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + continue Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + [[ -n '' ]] Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 09:31:42 kjcf05n03 kdumpctl[7847]: + set +x Nov 3 09:31:42 kjcf05n03 dracut[7961]: Skipping udev rule: 64-md-raid.rules Nov 3 09:31:42 kjcf05n03 dcs-collectord[5653]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 09:31:42 kjcf05n03 dcs-collectord[5653]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + installkernel Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + instmods =drivers/md Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + local _optional=-o Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + local _silent Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + [[ '' = yes ]] Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + [[ =drivers/md = \-\c ]] Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + [[ =drivers/md = \-\s ]] Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + (( 1 == 0 )) Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.SYJQ3c/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + _ret=0 Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + (( 0 != 0 )) Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + [[ -n '' ]] Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + _ret=0 Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + modules_loaded+='hperaid ' Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + '[' -n '' ']' Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + _d_mod=90kernel-modules Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + _d_mod=kernel-modules Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + [[ '' = yes ]] Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + dinfo '*** Including module: kernel-modules ***' Nov 3 09:31:43 kjcf05n03 kdumpctl[7847]: + set +x Nov 3 09:31:43 kjcf05n03 dracut[7961]: *** Including module: kernel-modules *** Nov 3 09:31:43 kjcf05n03 dracut[7961]: *** Including module: kernel-modules-extra *** Nov 3 09:31:44 kjcf05n03 dracut[7961]: *** Including module: kernel-network-modules *** Nov 3 09:31:44 kjcf05n03 dracut[7961]: *** Including module: diskless-mod *** Nov 3 09:31:44 kjcf05n03 dracut[7961]: *** Including module: fstab-sys *** Nov 3 09:31:44 kjcf05n03 dracut[7961]: *** Including module: nfs *** Nov 3 09:31:44 kjcf05n03 dracut[7961]: *** Including module: rootfs-block *** Nov 3 09:31:44 kjcf05n03 dracut[7961]: *** Including module: terminfo *** Nov 3 09:31:44 kjcf05n03 dracut[7961]: *** Including module: udev-rules *** Nov 3 09:31:44 kjcf05n03 dracut[7961]: Skipping udev rule: 91-permissions.rules Nov 3 09:31:44 kjcf05n03 dracut[7961]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 09:31:44 kjcf05n03 dracut[7961]: *** Including module: dracut-systemd *** Nov 3 09:31:44 kjcf05n00 zabbix-server[1142278]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 09:31:44 kjcf05n00 zabbix-server[1142278]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 114.25\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 102.97\\"}}"' Nov 3 09:31:44 kjcf05n00 log_interesting_event.py[1142278]: Event '46058' acknowledged Nov 3 09:31:45 kjcf05n03 dracut[7961]: *** Including module: usrmount *** Nov 3 09:31:45 kjcf05n03 dracut[7961]: *** Including module: base *** Nov 3 09:31:45 kjcf05n03 dracut[7961]: *** Including module: fs-lib *** Nov 3 09:31:45 kjcf05n03 dracut[7961]: *** Including module: kdumpbase *** Nov 3 09:31:46 kjcf05n03 dracut[7961]: *** Including module: memstrack *** Nov 3 09:31:46 kjcf05n03 dracut[7961]: *** Including module: shutdown *** Nov 3 09:31:46 kjcf05n03 dracut[7961]: *** Including module: squash *** Nov 3 09:31:46 kjcf05n03 dracut[7961]: *** Including modules done *** Nov 3 09:31:46 kjcf05n03 dracut[7961]: *** Installing kernel module dependencies *** Nov 3 09:31:47 kjcf05n03 dracut[7961]: *** Installing kernel module dependencies done *** Nov 3 09:31:47 kjcf05n03 dracut[7961]: *** Resolving executable dependencies *** Nov 3 09:31:48 kjcf05n03 dracut[7961]: *** Resolving executable dependencies done*** Nov 3 09:31:48 kjcf05n03 dracut[7961]: *** Hardlinking files *** Nov 3 09:31:48 kjcf05n03 dracut[7961]: *** Hardlinking files done *** Nov 3 09:31:48 kjcf05n03 dracut[7961]: *** Generating early-microcode cpio image *** Nov 3 09:31:48 kjcf05n03 dracut[7961]: *** Constructing AuthenticAMD.bin **** Nov 3 09:31:48 kjcf05n03 dracut[7961]: *** Store current command line parameters *** Nov 3 09:31:48 kjcf05n03 dracut[7961]: Stored kernel commandline: Nov 3 09:31:48 kjcf05n03 dracut[7961]: rd.driver.pre=sd_mod Nov 3 09:31:48 kjcf05n03 dracut[7961]: rd.driver.pre=nvme Nov 3 09:31:48 kjcf05n03 dracut[7961]: rd.driver.pre=ipmi_si Nov 3 09:31:48 kjcf05n03 dracut[7961]: rd.driver.pre=ipmi_devintf Nov 3 09:31:48 kjcf05n03 dracut[7961]: rd.driver.pre=ipmi_msghandler Nov 3 09:31:48 kjcf05n03 dracut[7961]: nameserver=172.16.2.2 Nov 3 09:31:48 kjcf05n03 dracut[7961]: nameserver=127.0.0.1 Nov 3 09:31:48 kjcf05n03 dracut[7961]: nameserver=172.16.2.2 Nov 3 09:31:48 kjcf05n03 dracut[7961]: nameserver=127.0.0.1 Nov 3 09:31:48 kjcf05n03 dracut[7961]: ifname=kdump-meth0:00:09:3d:06:9a:1a team=mgmt0:kdump-meth0 Nov 3 09:31:48 kjcf05n03 dracut[7961]: rd.neednet Nov 3 09:31:48 kjcf05n03 dracut[7961]: kdumpnic=mgmt0 Nov 3 09:31:48 kjcf05n03 dracut[7961]: bootdev=mgmt0 Nov 3 09:31:48 kjcf05n03 dracut[7961]: *** Install squash loader *** Nov 3 09:31:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730647908', 'host':'kjcf05n03', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.4% (3682552 kB) used.'}"] Nov 3 09:31:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'RAM usage', 'description': 'OK - 1.4% (3682552 kB) used.', 'message': 'OK - 1.4% (3682552 kB) used.', 'value': 'ok', 'timestamp': '1730647908'} Nov 3 09:31:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:31:48 kjcf05n03 dracut[7961]: *** Squashing the files inside the initramfs *** Nov 3 09:31:49 kjcf05n03 dracut[7961]: *** Squashing the files inside the initramfs done *** Nov 3 09:31:49 kjcf05n03 dracut[7961]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 09:31:49 kjcf05n03 dracut[7961]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 09:31:50 kjcf05n03 kdumpctl[7847]: kdump: kexec: loaded kdump kernel Nov 3 09:31:50 kjcf05n03 kdumpctl[7847]: kdump: Starting kdump: [OK] Nov 3 09:31:50 kjcf05n03 systemd[1]: Started Crash recovery kernel arming. Nov 3 09:31:50 kjcf05n03 systemd[1]: Reloading. Nov 3 09:31:50 kjcf05n03 systemd[3192]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:31:50 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:31:50 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:31:50 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 09:31:50 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 09:31:50 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 09:31:50 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 09:31:50 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 09:31:50 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 09:31:50 kjcf05n03 ifdown[14538]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 09:31:50 kjcf05n03 ifdown[14539]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:31:50 kjcf05n03 ifdown[14540]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:31:50 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 09:31:50 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 09:31:50 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 09:31:51 kjcf05n03 ifup[14600]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 09:31:51 kjcf05n03 ifup[14601]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:31:51 kjcf05n03 ifup[14602]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:31:52 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 09:31:55 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 09:31:55 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 09:31:55 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 09:31:55 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:31:55 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:31:55 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:31:55 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:31:55 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 09:31:55 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 09:31:55 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 09:31:55 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 09:31:55 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:31:55 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:31:55 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:31:55 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:31:55 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 09:31:55 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 09:31:55 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 09:31:55 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 09:31:55 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 09:31:55 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 09:31:55 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 09:31:55 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 09:31:55 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 09:31:55 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 09:31:55 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 09:31:55 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 09:31:55 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 09:31:55 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 09:31:55 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 09:31:55 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 09:31:55 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 09:31:55 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 09:31:55 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 09:31:55 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 09:31:55 kjcf05n03 ifdown[14781]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 09:31:55 kjcf05n03 ifdown[14782]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:31:55 kjcf05n03 ifdown[14783]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:31:55 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 09:31:55 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 09:31:55 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 09:31:55 kjcf05n03 ifup[14843]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 09:31:55 kjcf05n03 ifup[14844]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:31:55 kjcf05n03 ifup[14845]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 09:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 09:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 09:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 09:31:55 kjcf05n00 mcfcli[3673891]: %3|1730647915.927|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:31:57 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 09:31:57 kjcf05n03 dcs-collectord[5653]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 09:31:57 kjcf05n03 dcs-collectord[5653]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 09:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 09:31:59 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 09:32:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 09:32:00 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 09:32:00 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 09:32:00 kjcf05n03 systemd[1]: Reloading. Nov 3 09:32:00 kjcf05n03 systemd[1]: Starting Corosync Cluster Engine... Nov 3 09:32:00 kjcf05n03 await_ha_peer[15053]: Waiting for HA peer kjcf05n02 Nov 3 09:32:01 kjcf05n03 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 09:32:01 kjcf05n03 await_ha_peer[15053]: Peer kjcf05n02 has started, starting HA Nov 3 09:32:02 kjcf05n03 systemd[1]: Started Corosync Cluster Engine. Nov 3 09:32:02 kjcf05n03 systemd[1]: Started Fast STONITH daemon. Nov 3 09:32:02 kjcf05n03 fstonithd.py[15106]: Listening for kdump packets from partner Nov 3 09:32:02 kjcf05n03 systemd[1]: Reloading. Nov 3 09:32:02 kjcf05n03 systemd[3192]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:32:02 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:32:02 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:32:02 kjcf05n03 systemd[1]: Reloading. Nov 3 09:32:02 kjcf05n03 systemd[1]: Reached target resource-agents dependencies. Nov 3 09:32:02 kjcf05n03 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 09:32:02 kjcf05n03 systemd[1]: Reloading. Nov 3 09:32:03 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 09:32:03 kjcf05n03 puppet-agent[3582]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 09:32:03 kjcf05n03 puppet[3582]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 09:32:03 kjcf05n03 puppet-agent[3582]: Applied catalog in 91.21 seconds Nov 3 09:32:03 kjcf05n03 puppet[3582]: Notice: Applied catalog in 91.21 seconds Nov 3 09:32:03 kjcf05n03 systemd[1]: Started Puppet agent. Nov 3 09:32:03 kjcf05n03 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 09:32:03 kjcf05n03 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 09:32:03 kjcf05n03 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 09:32:03 kjcf05n03 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 09:32:03 kjcf05n03 systemd[1]: Starting Set absolute GEM time... Nov 3 09:32:03 kjcf05n03 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 09:32:03 kjcf05n03 systemd[1]: Reached target Timers. Nov 3 09:32:03 kjcf05n03 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 09:32:03 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 09:32:03 kjcf05n03 wce-disable.sh[15250]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 09:32:03 kjcf05n03 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 09:32:03 kjcf05n03 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 09:32:03 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 09:32:03 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 09:32:03 kjcf05n03 systemd[1]: set_gem_time.service: Succeeded. Nov 3 09:32:03 kjcf05n03 systemd[1]: Started Set absolute GEM time. Nov 3 09:32:03 kjcf05n00 mcfcli[3673891]: %3|1730647923.354|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:32:04 kjcf05n03 python3.9[15249]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 09:32:04 kjcf05n03 python3.9[15249]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 09:32:04 kjcf05n03 gateway-ec-node.py[15248]: Starting gateway-ec-node service Nov 3 09:32:04 kjcf05n03 RFSF-API[15247]: INFO[2024-11-03T09:32:03-06:00] Datapath API RESTful Service starting Nov 3 09:32:04 kjcf05n03 dp-api-server-node[15247]: INFO[2024-11-03T09:32:03-06:00] Datapath API RESTful Service starting Nov 3 09:32:04 kjcf05n03 RFSF-API[15247]: INFO[2024-11-03T09:32:03-06:00] Running in production mode, starting dbus event listener Nov 3 09:32:04 kjcf05n03 dp-api-server-node[15247]: INFO[2024-11-03T09:32:03-06:00] Running in production mode, starting dbus event listener Nov 3 09:32:04 kjcf05n03 RFSF-API[15247]: INFO[2024-11-03T09:32:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 09:32:04 kjcf05n03 dp-api-server-node[15247]: INFO[2024-11-03T09:32:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 09:32:04 kjcf05n03 RFSF-API[15247]: INFO[2024-11-03T09:32:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 09:32:04 kjcf05n03 dp-api-server-node[15247]: INFO[2024-11-03T09:32:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 09:32:04 kjcf05n03 RFSF-API[15247]: INFO[2024-11-03T09:32:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 09:32:04 kjcf05n03 dp-api-server-node[15247]: INFO[2024-11-03T09:32:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 09:32:04 kjcf05n03 RFSF-API[15247]: INFO[2024-11-03T09:32:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 09:32:04 kjcf05n03 dp-api-server-node[15247]: INFO[2024-11-03T09:32:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 09:32:04 kjcf05n03 RFSF-API[15247]: INFO[2024-11-03T09:32:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 09:32:04 kjcf05n03 dp-api-server-node[15247]: INFO[2024-11-03T09:32:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 09:32:04 kjcf05n03 RFSF-API[15247]: INFO[2024-11-03T09:32:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 09:32:04 kjcf05n03 dp-api-server-node[15247]: INFO[2024-11-03T09:32:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 09:32:04 kjcf05n03 RFSF-API[15247]: INFO[2024-11-03T09:32:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 09:32:04 kjcf05n03 dp-api-server-node[15247]: INFO[2024-11-03T09:32:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 09:32:04 kjcf05n03 RFSF-API[15247]: INFO[2024-11-03T09:32:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 09:32:04 kjcf05n03 dp-api-server-node[15247]: INFO[2024-11-03T09:32:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 09:32:04 kjcf05n03 RFSF-API[15247]: INFO[2024-11-03T09:32:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 09:32:04 kjcf05n03 dp-api-server-node[15247]: INFO[2024-11-03T09:32:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 09:32:04 kjcf05n03 RFSF-API[15247]: INFO[2024-11-03T09:32:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 09:32:04 kjcf05n03 dp-api-server-node[15247]: INFO[2024-11-03T09:32:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 09:32:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730647925', 'host':'kjcf05n03', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 09:32:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730647925'} Nov 3 09:32:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:32:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730647925', 'host':'kjcf05n03', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 09:32:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730647925'} Nov 3 09:32:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:32:09 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n03": interface became available Nov 3 09:32:09 kjcf05n03 systemd[1]: Reloading. Nov 3 09:32:09 kjcf05n03 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 09:32:09 kjcf05n03 systemd[1]: Reloading. Nov 3 09:32:09 kjcf05n03 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 09:32:10 kjcf05n03 diskmonitor_pre[15622]: Key management is currently disabled.DEAR disabled Nov 3 09:32:10 kjcf05n03 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 09:32:11 kjcf05n00 zabbix-server[1142519]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 09:32:11 kjcf05n00 zabbix-server[1142519]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n03 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n03:system.uptime): 00:03:12\\"}}"' Nov 3 09:32:11 kjcf05n00 log_interesting_event.py[1142519]: Event '46059' acknowledged Nov 3 09:32:12 kjcf05n03 sh[15681]: LNET configured: New Created Nov 3 09:32:12 kjcf05n03 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 09:32:12 kjcf05n03 LCNmon[17772]: Interface ib0 is up Nov 3 09:32:12 kjcf05n03 LCNmon[17772]: Interface ib1 is up Nov 3 09:32:12 kjcf05n03 LCNmon[17772]: Can ping through interface ib0 Nov 3 09:32:12 kjcf05n03 LCNmon[17772]: Can ping through interface ib1 Nov 3 09:32:12 kjcf05n03 LCNmon[17772]: NIC ib0, initial state UP Nov 3 09:32:12 kjcf05n03 LCNmon[17772]: NIC ib1, initial state UP Nov 3 09:32:12 kjcf05n03 LCNmon[17772]: LCNstat initial state UP Nov 3 09:32:12 kjcf05n03 LCNmon[17772]: LCNmon monitoring hosts kjcf05n03 and kjcf05n02 Nov 3 09:32:13 kjcf05n03 dcs-collectord[5653]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 09:32:13 kjcf05n03 dcs-collectord[5653]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 09:32:13 kjcf05n03 dcs-collectord[5653]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 09:32:14 kjcf05n00 httpd[902571]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-B): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n03', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: /var/run/diskmonitor does not exist, creating Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: Creating /var/run/diskmonitor/disk Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: Creating /var/run/diskmonitor/encl Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: Creating /var/run/diskmonitor/cli Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: RAS_Interlocks_enabled: 1 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: add handler for sig: 14 sa_flags: 10000004 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: add handler for sig: 1 sa_flags: 10000004 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: add handler for sig: 2 sa_flags: 00000004 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: add handler for sig: 15 sa_flags: 00000004 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: add handler for sig: 6 sa_flags: 00000004 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: add handler for sig: 3 sa_flags: 00000004 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: add handler for sig: 30 sa_flags: 00000004 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: add handler for sig: 20 sa_flags: 00000004 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: add handler for sig: 10 sa_flags: 10000004 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: add handler for sig: 11 sa_flags: 00000004 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: add handler for sig: 7 sa_flags: 00000004 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: add handler for sig: 4 sa_flags: 00000004 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: add handler for sig: 8 sa_flags: 00000004 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: Using HA Baton locks - key: diskmonitor Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: Baton will be held for at most 570 seconds Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: DMMP Enabled: 0 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: random seed: 8a2ac793 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: NVMe Enclosure: 1 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: ZFS Enclosure: 0 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: Dbus, Initialized Connection Successfully Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: int_catcher_thread: thread start Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: Received dbus message 4 org.freedesktop.DBus -> :1.92 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b07bec_S4EUNF0MA05386M encl_slot: 0 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b07bed_S4EUNF0MA05387D encl_slot: 0 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 09:32:14 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 09:32:14 kjcf05n03 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 09:32:17 kjcf05n03 openhpid[5559]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 09:32:17 kjcf05n03 openhpid[5559]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 09:32:17 kjcf05n03 systemd[1]: openhpid.service: Succeeded. Nov 3 09:32:17 kjcf05n03 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 09:32:17 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 09:32:17 kjcf05n03 systemd[1]: openhpid.service: Supervising process 18468 which is not our child. We'll most likely not notice when it exits. Nov 3 09:32:17 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 09:32:17 kjcf05n03 systemd[1]: Reached target Multi-User System. Nov 3 09:32:17 kjcf05n03 systemd[1]: Reached target Graphical Interface. Nov 3 09:32:17 kjcf05n03 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 09:32:17 kjcf05n03 dcs-collectord[5653]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 09:32:17 kjcf05n03 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 09:32:17 kjcf05n03 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 09:32:17 kjcf05n03 systemd[1]: Startup finished in 50.567s (kernel) + 2min 29.158s (userspace) = 3min 19.726s. Nov 3 09:32:17 kjcf05n03 openhpid[18468]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 09:32:17 kjcf05n03 openhpid[18468]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 09:32:17 kjcf05n03 openhpid[18468]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 09:32:17 kjcf05n03 openhpid[18468]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b07bed_S4EUNF0MA05387D encl_sn: USE26000024VS001, slot: 2 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: check_run_sedcmd, No Device name provided Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 09:32:18 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 09:32:18 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18572 (bash) Nov 3 09:32:19 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 09:32:19 kjcf05n03 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 09:32:19 kjcf05n03 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 09:32:19 kjcf05n03 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 09:32:19 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 09:32:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730647939', 'host':'kjcf05n03', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 09:32:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730647939', 'host':'kjcf05n03', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 09:32:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730647939'} Nov 3 09:32:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730647939'} Nov 3 09:32:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:32:19 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 09:32:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730647939', 'host':'kjcf05n03', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.96, 2.03, 0.93'}"] Nov 3 09:32:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Load', 'description': 'OK - load average: 1.96, 2.03, 0.93', 'message': 'OK - load average: 1.96, 2.03, 0.93', 'value': 'ok', 'timestamp': '1730647939'} Nov 3 09:32:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:32:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730647939', 'host':'kjcf05n03', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 358 processes with STATE = RSZDT '}"] Nov 3 09:32:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Total Processes', 'description': 'PROCS OK: 358 processes with STATE = RSZDT ', 'message': 'PROCS OK: 358 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730647939'} Nov 3 09:32:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:32:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730647941', 'host':'kjcf05n03', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(4032.0B/2376.0B), ib1=(2800.0B/2560.0B), icl0=(7.9kB/9.5kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.0MB), mgmt0=(1478.3MB/8.0MB)'}"] Nov 3 09:32:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730647941', 'host':'kjcf05n03', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 09:32:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(4032.0B/2376.0B), ib1=(2800.0B/2560.0B), icl0=(7.9kB/9.5kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.0MB), mgmt0=(1478.3MB/8.0MB)', 'message': 'NET OK - (Rx/Tx) ib0=(4032.0B/2376.0B), ib1=(2800.0B/2560.0B), icl0=(7.9kB/9.5kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.0MB), mgmt0=(1478.3MB/8.0MB)', 'value': 'ok', 'timestamp': '1730647941'} Nov 3 09:32:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730647941'} Nov 3 09:32:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:32:28 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 09:32:28 kjcf05n03 dcs-collectord[5653]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 09:32:28 kjcf05n03 dcs-collectord[5653]: WARNING No data collected (hpi_parser.py:353) Nov 3 09:32:33 kjcf05n00 mcfcli[3673891]: %3|1730647953.242|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:32:33 kjcf05n00 mcfcli[3673891]: %3|1730647953.355|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 09:32:41 kjcf05n03 ipmievd[3994]: System Event sensor - Timestamp Clock Sync Nov 3 09:32:43 kjcf05n03 ipmievd[3192]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:32:43 kjcf05n03 dcs-collectord[5653]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b07bec_S4EUNF0MA05386M encl_sn: USE26000024VS001, slot: 1 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 09:32:53 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 09:32:55 kjcf05n02 nslcd[6978]: [e8944a] ldap_result() failed: Can't contact LDAP server Nov 3 09:32:55 kjcf05n02 nslcd[6978]: [5558ec] ldap_result() failed: Can't contact LDAP server Nov 3 09:32:58 kjcf05n03 dcs-collectord[5653]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 09:33:01 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 09:33:01 kjcf05n03 ras-resource-manager-agent[5917]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "e8c0e6d2-99f8-11ef-a061-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 09:33:01 kjcf05n03 ras-resource-manager-agent[5917]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'e8c0e6d2-99f8-11ef-a061-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 09:33:01 kjcf05n03 ras-resource-manager-agent[5917]: INFO Submitting new device inserted signal, starting to qualify drive: e8c0e6d2-99f8-11ef-a061-00093d069a1b (admin_action.py:110) Nov 3 09:33:01 kjcf05n02 firmware-update-orc-server[5900]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "34a6e72e-8428-4da3-bedd-90b07ca91ead"} (logger.py:65) Nov 3 09:33:01 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 86817 (get_disk_device) Nov 3 09:33:01 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 09:33:01 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 09:33:01 kjcf05n02 ccp-client[86852]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 09:33:00 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'e8c0e6d2-99f8-11ef-a061-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 09:33:00 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'e8c0e6d2-99f8-11ef-a061-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 09:33:00 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': 'e8c0e6d2-99f8-11ef-a061-00093d069a1b', 'response ID': 'e8cb83b2-99f8-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 09:33:00 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: e8cb83b2-99f8-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 09:33:01 kjcf05n02 ccp-client[86852]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 09:33:01 kjcf05n02 ccp-client[86861]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 09:33:01 kjcf05n02 ccp-client[86852]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 09:33:01 kjcf05n02 ccp-client[86852]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 09:33:01 kjcf05n02 ccp-client[86861]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 09:33:01 kjcf05n02 ccp-client[86861]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 09:33:01 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'e911ce44-99f8-11ef-a061-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 09:33:01 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'e911ce44-99f8-11ef-a061-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 09:33:01 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': 'e911ce44-99f8-11ef-a061-00093d069a1b', 'response ID': 'e919430e-99f8-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 09:33:01 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: e919430e-99f8-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 09:33:01 kjcf05n03 diskmonitor[17376]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 09:33:01 kjcf05n03 ras-resource-manager-agent[5917]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "e911ce44-99f8-11ef-a061-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 09:33:01 kjcf05n03 ras-resource-manager-agent[5917]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'e911ce44-99f8-11ef-a061-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 09:33:01 kjcf05n03 ras-resource-manager-agent[5917]: INFO Submitting new device inserted signal, starting to qualify drive: e911ce44-99f8-11ef-a061-00093d069a1b (admin_action.py:110) Nov 3 09:33:01 kjcf05n03 firmware-update-orc-server[5876]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "1de414a5-6628-4f8b-ba38-60bb7cab8668"} (logger.py:65) Nov 3 09:33:03 kjcf05n00 mcfcli[3673891]: %3|1730647983.356|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:33:04 kjcf05n02 DRVFW[86989]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 09:33:04 kjcf05n02 ccp-client[87002]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 09:33:04 kjcf05n02 ccp-client[87002]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 09:33:04 kjcf05n02 ccp-client[87012]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 09:33:04 kjcf05n02 ccp-client[87002]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 09:33:04 kjcf05n02 ccp-client[87002]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 09:33:04 kjcf05n02 ccp-client[87012]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 09:33:04 kjcf05n02 ccp-client[87012]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 09:33:04 kjcf05n02 firmware-update-orc-server[5900]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 09:33:05 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: e8cb83b2-99f8-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 09:33:05 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': 'e8c0e6d2-99f8-11ef-a061-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'e8c0e6d2-99f8-11ef-a061-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}}} (logger.py:65) Nov 3 09:33:06 kjcf05n03 ras-resource-manager-agent[5917]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'e8c0e6d2-99f8-11ef-a061-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 09:33:06 kjcf05n03 ras-resource-manager-agent[5917]: INFO Drive qualification complete responding: e8c0e6d2-99f8-11ef-a061-00093d069a1b (admin_action.py:205) Nov 3 09:33:06 kjcf05n03 ras-resource-manager-agent[5917]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "e8c0e6d2-99f8-11ef-a061-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (interesting_event.py:59) Nov 3 09:33:11 kjcf05n03 diskmonitor[17376]: drive: eui.345950304e3006430025384500000003 Nov 3 09:33:11 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 09:33:11 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 09:33:11 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 09:33:11 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 09:33:11 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 09:33:11 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 09:33:11 kjcf05n03 diskmonitor[17376]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 09:33:11 kjcf05n03 diskmonitor[17376]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 09:33:11 kjcf05n03 diskmonitor[17376]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 09:33:11 kjcf05n03 diskmonitor[17376]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 09:33:11 kjcf05n03 diskmonitor[17376]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 09:33:11 kjcf05n03 diskmonitor[17376]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "e8c0e6d2-99f8-11ef-a061-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 09:33:11 kjcf05n03 diskmonitor[17376]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 09:33:11 kjcf05n03 diskmonitor[17376]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 09:33:11 kjcf05n03 diskmonitor[17376]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "e911ce44-99f8-11ef-a061-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 09:33:11 kjcf05n03 diskmonitor[17376]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 09:33:11 kjcf05n03 diskmonitor[17376]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 09:33:12 kjcf05n00 mcfcli[3673891]: %3|1730647992.339|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:33:14 kjcf05n03 chronyd[5161]: Selected source 172.16.2.1 Nov 3 09:33:16 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22311 (get_disk_device) Nov 3 09:33:16 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 09:33:16 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 09:33:17 kjcf05n03 ccp-client[22334]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 09:33:17 kjcf05n03 ccp-client[22334]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 09:33:17 kjcf05n03 ccp-client[22355]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 09:33:17 kjcf05n03 ccp-client[22334]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 09:33:17 kjcf05n03 ccp-client[22334]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 09:33:17 kjcf05n03 ccp-client[22355]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 09:33:17 kjcf05n03 ccp-client[22355]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 09:33:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730647997}"] Nov 3 09:33:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730647997, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:33:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:33:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730647998}"] Nov 3 09:33:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730647998, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:33:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730647998}"] Nov 3 09:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730647998, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:33:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730647999}"] Nov 3 09:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730647999, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:33:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:33:20 kjcf05n03 systemd[1]: Unmounting /mnt/llog... Nov 3 09:33:20 kjcf05n03 DRVFW[22491]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 09:33:20 kjcf05n03 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 09:33:20 kjcf05n03 systemd[1]: Unmounted /mnt/llog. Nov 3 09:33:20 kjcf05n03 ccp-client[22494]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 09:33:20 kjcf05n03 ccp-client[22494]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 09:33:20 kjcf05n03 ccp-client[22503]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 09:33:20 kjcf05n03 ccp-client[22494]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 09:33:20 kjcf05n03 ccp-client[22494]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 09:33:20 kjcf05n03 ccp-client[22503]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 09:33:20 kjcf05n03 ccp-client[22503]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 09:33:20 kjcf05n03 firmware-update-orc-server[5876]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 09:33:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730647999}"] Nov 3 09:33:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730647999, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:33:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:33:21 kjcf05n03 ras-resource-manager-agent[5917]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "e8c0e6d2-99f8-11ef-a061-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (service_main_handler.py:66) Nov 3 09:33:21 kjcf05n03 ras-resource-manager-agent[5917]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'e8c0e6d2-99f8-11ef-a061-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 09:33:21 kjcf05n03 ras-resource-manager-agent[5917]: INFO Device qualification response has been acknowledged: e8c0e6d2-99f8-11ef-a061-00093d069a1b (admin_action.py:151) Nov 3 09:33:21 kjcf05n03 ras-resource-manager-agent[5917]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'e911ce44-99f8-11ef-a061-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 09:33:21 kjcf05n03 ras-resource-manager-agent[5917]: INFO Drive qualification complete responding: e911ce44-99f8-11ef-a061-00093d069a1b (admin_action.py:205) Nov 3 09:33:21 kjcf05n03 ras-resource-manager-agent[5917]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "e911ce44-99f8-11ef-a061-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (interesting_event.py:59) Nov 3 09:33:21 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: e919430e-99f8-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 09:33:21 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': 'e911ce44-99f8-11ef-a061-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'e911ce44-99f8-11ef-a061-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}}} (logger.py:65) Nov 3 09:33:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730648001}"] Nov 3 09:33:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730648001, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:33:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:33:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730648002}"] Nov 3 09:33:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730648002, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:33:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:33:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730648002}"] Nov 3 09:33:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730648002, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:33:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:33:25 kjcf05n03 diskmonitor[17376]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 09:33:25 kjcf05n03 python3.9[5223]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 09:33:25 kjcf05n03 python3.9[3192]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:33:25 kjcf05n03 diskmonitor[17376]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 09:33:25 kjcf05n03 ras-resource-manager-agent[5917]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "f7784670-99f8-11ef-a061-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 09:33:25 kjcf05n03 ras-resource-manager-agent[5917]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'f7784670-99f8-11ef-a061-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 09:33:25 kjcf05n03 ras-resource-manager-agent[5917]: INFO Requests ['e911ce44-99f8-11ef-a061-00093d069a1b', 'f7784670-99f8-11ef-a061-00093d069a1b'] already in progress (admin_action.py:99) Nov 3 09:33:25 kjcf05n03 ras-resource-manager-agent[5917]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'f7784670-99f8-11ef-a061-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 09:33:25 kjcf05n03 ras-resource-manager-agent[5917]: INFO Drive qualification complete responding: f7784670-99f8-11ef-a061-00093d069a1b (admin_action.py:205) Nov 3 09:33:25 kjcf05n03 ras-resource-manager-agent[5917]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "e911ce44-99f8-11ef-a061-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (interesting_event.py:59) Nov 3 09:33:25 kjcf05n03 ras-resource-manager-agent[5917]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "f7784670-99f8-11ef-a061-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (interesting_event.py:59) Nov 3 09:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T09:33:27.252992305-06:00 level=info msg="Completed cleanup jobs" duration=26.549683ms Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "e8c0e6d2-99f8-11ef-a061-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: Dbus, handle_ingress_ras_signals, uuid: e8c0e6d2-99f8-11ef-a061-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "e8c0e6d2-99f8-11ef-a061-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: main: Pending firmware leveling requests exist, rescanning disks Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "f7784670-99f8-11ef-a061-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: leaving test state: 1 next state: 2 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: lock req: no timeout Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: leaving test state: 2 next state: 4 Nov 3 09:33:31 kjcf05n03 diskmonitor[17376]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 09:33:33 kjcf05n00 mcfcli[3673891]: %3|1730648013.356|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 09:33:50 kjcf05n00 mcfcli[3673891]: %3|1730648030.736|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:34:03 kjcf05n00 mcfcli[3673891]: %3|1730648043.856|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 09:34:05 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31422 deleted. Nov 3 09:34:21 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 09:34:22 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 09:34:22 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 09:34:26 kjcf05n03 ras-resource-manager-agent[5917]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "e911ce44-99f8-11ef-a061-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 09:34:26 kjcf05n03 ras-resource-manager-agent[5917]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'e911ce44-99f8-11ef-a061-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 09:34:26 kjcf05n03 ras-resource-manager-agent[5917]: INFO Device qualification response has been acknowledged: e911ce44-99f8-11ef-a061-00093d069a1b (admin_action.py:151) Nov 3 09:34:26 kjcf05n03 ras-resource-manager-agent[5917]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "e911ce44-99f8-11ef-a061-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 09:34:26 kjcf05n03 ras-resource-manager-agent[5917]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'e911ce44-99f8-11ef-a061-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 09:34:26 kjcf05n03 ras-resource-manager-agent[5917]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "f7784670-99f8-11ef-a061-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 09:34:26 kjcf05n03 ras-resource-manager-agent[5917]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'f7784670-99f8-11ef-a061-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 09:34:26 kjcf05n03 ras-resource-manager-agent[5917]: INFO Device qualification response has been acknowledged: f7784670-99f8-11ef-a061-00093d069a1b (admin_action.py:151) Nov 3 09:34:26 kjcf05n03 diskmonitor[17376]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 09:34:26 kjcf05n00 mcfcli[3673891]: %3|1730648066.094|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:34:33 kjcf05n00 mcfcli[3673891]: %3|1730648073.857|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:34:37 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 09:34:37 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 09:34:37 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 09:34:38 kjcf05n03 dcs-collectord[5653]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 09:34:44 kjcf05n03 diskmonitor[17376]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "e911ce44-99f8-11ef-a061-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 3 09:34:44 kjcf05n03 diskmonitor[17376]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 09:34:44 kjcf05n03 diskmonitor[17376]: Dbus, handle_ingress_ras_signals, uuid: e911ce44-99f8-11ef-a061-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 09:34:44 kjcf05n03 diskmonitor[17376]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 09:34:44 kjcf05n03 diskmonitor[17376]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "e911ce44-99f8-11ef-a061-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 3 09:34:44 kjcf05n03 diskmonitor[17376]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "e911ce44-99f8-11ef-a061-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 3 09:34:44 kjcf05n03 diskmonitor[17376]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 09:34:44 kjcf05n03 diskmonitor[17376]: Dbus, handle_ingress_ras_signals, uuid: e911ce44-99f8-11ef-a061-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 09:34:44 kjcf05n03 diskmonitor[17376]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "e911ce44-99f8-11ef-a061-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 3 09:34:44 kjcf05n03 diskmonitor[17376]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "f7784670-99f8-11ef-a061-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 3 09:34:44 kjcf05n03 diskmonitor[17376]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 09:34:44 kjcf05n03 diskmonitor[17376]: Dbus, handle_ingress_ras_signals, uuid: f7784670-99f8-11ef-a061-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 09:34:44 kjcf05n03 diskmonitor[17376]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "f7784670-99f8-11ef-a061-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 3 09:34:44 kjcf05n03 diskmonitor[17376]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 09:34:44 kjcf05n03 diskmonitor[17376]: lock acquired Nov 3 09:34:44 kjcf05n03 diskmonitor[17376]: leaving test state: 4 next state: 8 Nov 3 09:34:44 kjcf05n03 diskmonitor[17376]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 09:34:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730648087}"] Nov 3 09:34:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730648087, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:34:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:34:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:34:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:34:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:34:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:34:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:34:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:34:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:34:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:34:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:34:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:34:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:34:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:34:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.17295ms Nov 3 09:34:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:34:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.17295ms Nov 3 09:34:47 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:34:47 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:34:47 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:34:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Inactive', 'timestamp': 1730648090}"] Nov 3 09:34:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730648090, 'value': 'Inactive', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:34:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:34:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:34:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:34:50-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:34:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:34:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:34:50 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:34:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:34:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:34:50-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:34:50 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:34:50-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:34:50 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:34:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.318042ms Nov 3 09:34:50 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:34:50-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.318042ms Nov 3 09:34:50 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:34:50 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:34:57 kjcf05n03 diskmonitor[17376]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 09:34:57 kjcf05n03 diskmonitor[17376]: leaving test state: 8 next state: 20 Nov 3 09:34:57 kjcf05n03 diskmonitor[17376]: leaving test state: 20 next state: 40 Nov 3 09:34:57 kjcf05n03 diskmonitor[17376]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset a9de718000 Nov 3 09:34:57 kjcf05n03 diskmonitor[17376]: leaving test state: 40 next state: 80 Nov 3 09:35:03 kjcf05n00 mcfcli[3673891]: %3|1730648103.858|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:35:06 kjcf05n00 mcfcli[3673891]: %3|1730648106.091|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:35:07 kjcf05n00 python3.9[1144637]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 09:35:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730647823', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 09:35:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730647823'} Nov 3 09:35:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:35:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730647823', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 09:35:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730647823'} Nov 3 09:35:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:35:33 kjcf05n00 mcfcli[3673891]: %3|1730648133.859|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 09:35:46 kjcf05n00 mcfcli[3673891]: %3|1730648146.033|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:35:53 kjcf05n03 diskmonitor[17376]: leaving test state: 80 next state: 100 Nov 3 09:35:53 kjcf05n03 diskmonitor[17376]: lock release: time: Sun Nov 3 09:35:47 2024 Nov 3 09:35:53 kjcf05n03 diskmonitor[17376]: leaving test state: 100 next state: 1 Nov 3 09:36:04 kjcf05n00 mcfcli[3673891]: %3|1730648164.166|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 09:36:11 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 09:36:26 kjcf05n00 mcfcli[3673891]: %3|1730648186.030|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:36:34 kjcf05n00 mcfcli[3673891]: %3|1730648194.166|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:37:03 kjcf05n00 mcfcli[3673891]: %3|1730648223.024|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:37:04 kjcf05n00 mcfcli[3673891]: %3|1730648224.360|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 09:37:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730648237}"] Nov 3 09:37:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730648237, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:37:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:37:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:37:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:37:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:37:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:37:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:37:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:37:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:37:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:37:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:37:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:37:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:37:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:37:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.307091ms Nov 3 09:37:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:37:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.307091ms Nov 3 09:37:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:37:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:37:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:37:34 kjcf05n00 mcfcli[3673891]: %3|1730648254.360|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 09:37:39 kjcf05n00 mcfcli[3673891]: %3|1730648259.562|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:38:04 kjcf05n00 mcfcli[3673891]: %3|1730648284.361|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:38:19 kjcf05n00 mcfcli[3673891]: %3|1730648299.559|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:38:34 kjcf05n00 mcfcli[3673891]: %3|1730648314.362|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:38:56 kjcf05n00 mcfcli[3673891]: %3|1730648336.327|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:39:04 kjcf05n00 mcfcli[3673891]: %3|1730648344.362|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 09:39:31 kjcf05n00 mcfcli[3673891]: %3|1730648371.651|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:39:34 kjcf05n00 mcfcli[3673891]: %3|1730648374.362|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 09:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 09:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 09:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 09:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 09:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 09:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 09:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 09:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 09:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 09:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 09:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 09:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 09:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 09:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 09:40:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 09:40:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:40:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 09:40:04 kjcf05n00 mcfcli[3673891]: %3|1730648404.363|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:40:08 kjcf05n00 mcfcli[3673891]: %3|1730648408.740|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:40:08 kjcf05n00 python3.9[1147709]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 09:40:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730647823', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 09:40:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730647823'} Nov 3 09:40:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:40:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730647823', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 09:40:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730647823'} Nov 3 09:40:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:40:34 kjcf05n00 mcfcli[3673891]: %3|1730648434.364|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 09:40:47 kjcf05n00 mcfcli[3673891]: %3|1730648447.949|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:41:04 kjcf05n00 mcfcli[3673891]: %3|1730648464.364|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 09:41:23 kjcf05n00 mcfcli[3673891]: %3|1730648483.411|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:41:34 kjcf05n00 mcfcli[3673891]: %3|1730648494.364|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 09:41:59 kjcf05n00 mcfcli[3673891]: %3|1730648519.983|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:42:04 kjcf05n00 mcfcli[3673891]: %3|1730648524.364|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:42:34 kjcf05n00 mcfcli[3673891]: %3|1730648554.364|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 09:42:35 kjcf05n00 mcfcli[3673891]: %3|1730648555.766|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:42:53 kjcf05n03 root[41110]: failback_xyraid Nov 3 09:42:55 kjcf05n03 root[41274]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 09:42:56 kjcf05n03 root[41361]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 09:42:59 kjcf05n02 systemd[1]: data-kjcf05n03:md66.mount: Succeeded. Nov 3 09:43:03 kjcf05n02 dwd[5210]: Drive path is missing, purging: nvme21n1 Nov 3 09:43:03 kjcf05n02 dwd[5210]: Drive path is missing, purging: nvme5n1 Nov 3 09:43:03 kjcf05n02 dwd[5210]: Drive path is missing, purging: nvme20n1 Nov 3 09:43:03 kjcf05n02 dwd[5210]: Drive path is missing, purging: nvme6n1 Nov 3 09:43:03 kjcf05n02 dwd[5210]: Drive path is missing, purging: nvme11n1 Nov 3 09:43:03 kjcf05n02 dwd[5210]: Drive path is missing, purging: nvme7n1 Nov 3 09:43:03 kjcf05n02 dwd[5210]: Drive path is missing, purging: nvme16n1 Nov 3 09:43:03 kjcf05n02 dwd[5210]: Drive path is missing, purging: nvme10n1 Nov 3 09:43:03 kjcf05n02 dwd[5210]: Drive path is missing, purging: nvme12n1 Nov 3 09:43:03 kjcf05n02 dwd[5210]: Drive path is missing, purging: nvme22n1 Nov 3 09:43:03 kjcf05n02 dwd[5210]: Drive path is missing, purging: nvme15n1 Nov 3 09:43:04 kjcf05n00 mcfcli[3673891]: %3|1730648584.365|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:43:05 kjcf05n03 dwd[5194]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 09:43:05 kjcf05n03 dwd[5194]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 09:43:05 kjcf05n03 dwd[5194]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 09:43:05 kjcf05n03 dwd[5194]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 09:43:05 kjcf05n03 dwd[5194]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 09:43:05 kjcf05n03 dwd[5194]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 09:43:05 kjcf05n03 dwd[5194]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 09:43:05 kjcf05n03 dwd[5194]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 09:43:05 kjcf05n03 dwd[5194]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 09:43:05 kjcf05n03 dwd[5194]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 09:43:05 kjcf05n03 dwd[5194]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 09:43:06 kjcf05n03 dwd[5194]: Starting NVME thread for nvme10n1 Nov 3 09:43:06 kjcf05n03 dwd[5194]: Starting NVME thread for nvme15n1 Nov 3 09:43:06 kjcf05n03 dwd[5194]: Starting NVME thread for nvme21n1 Nov 3 09:43:06 kjcf05n03 dwd[5194]: Starting NVME thread for nvme11n1 Nov 3 09:43:06 kjcf05n03 dwd[5194]: Starting NVME thread for nvme20n1 Nov 3 09:43:07 kjcf05n03 dwd[5194]: Starting NVME thread for nvme12n1 Nov 3 09:43:07 kjcf05n03 systemd-udevd[44392]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44396]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44393]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44398]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44392]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44396]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44393]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44398]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44392]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44393]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44396]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44398]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44392]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44393]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44396]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44398]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44392]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44393]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44396]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44398]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44392]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44393]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44396]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44398]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44392]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44393]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44396]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44392]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44398]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44393]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44396]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44398]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44430]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44434]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44432]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44436]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44430]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44434]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44436]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44430]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44432]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44429]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44436]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44430]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44430]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44436]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44430]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44429]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44430]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44436]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44430]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44436]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44430]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44436]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44430]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44430]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44436]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44430]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44436]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44430]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44436]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44430]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44430]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 systemd-udevd[44430]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:43:07 kjcf05n03 dwd[5194]: Starting NVME thread for nvme7n1 Nov 3 09:43:07 kjcf05n03 nslcd[7088]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 09:43:07 kjcf05n03 dwd[5194]: Starting NVME thread for nvme6n1 Nov 3 09:43:07 kjcf05n03 dwd[5194]: Starting NVME thread for nvme5n1 Nov 3 09:43:07 kjcf05n03 dwd[5194]: Starting NVME thread for nvme16n1 Nov 3 09:43:07 kjcf05n03 dwd[5194]: Starting NVME thread for nvme22n1 Nov 3 09:43:10 kjcf05n03 dcs-bulk-data-sender[6204]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 141}' Nov 3 09:43:10 kjcf05n03 diskmonitor[17376]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 09:43:15 kjcf05n00 mcfcli[3673891]: %3|1730648595.763|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:43:17 kjcf05n03 diskmonitor[17376]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 09:43:17 kjcf05n03 diskmonitor[17376]: Scan for ReadErrorMax change for md66 Nov 3 09:43:17 kjcf05n03 diskmonitor[17376]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 09:43:17 kjcf05n03 diskmonitor[17376]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 09:43:17 kjcf05n03 diskmonitor[17376]: read_saved_file: md66 no saved speed Nov 3 09:43:17 kjcf05n03 diskmonitor[17376]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 09:43:17 kjcf05n03 diskmonitor[17376]: Set sync_speed_min (10000) for md66 Nov 3 09:43:17 kjcf05n03 diskmonitor[17376]: Set sync_speed_max (200000) for md66 Nov 3 09:43:17 kjcf05n03 diskmonitor[17376]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 09:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T09:43:27.267994433-06:00 level=info msg="Completed cleanup jobs" duration=41.371433ms Nov 3 09:43:34 kjcf05n00 mcfcli[3673891]: %3|1730648614.366|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 09:43:52 kjcf05n02 diskmonitor[17293]: Removed MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 09:43:52 kjcf05n02 diskmonitor[17293]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 09:43:53 kjcf05n00 mcfcli[3673891]: %3|1730648633.862|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:43:57 kjcf05n03 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 09:43:57 kjcf05n03 systemd-tmpfiles[47127]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 09:43:57 kjcf05n03 systemd-tmpfiles[47127]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 09:43:57 kjcf05n03 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 09:43:57 kjcf05n03 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 09:44:02 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47378 (bash) Nov 3 09:44:02 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 09:44:02 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 09:44:04 kjcf05n00 mcfcli[3673891]: %3|1730648644.366|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 09:44:33 kjcf05n00 mcfcli[3673891]: %3|1730648673.534|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:44:34 kjcf05n00 mcfcli[3673891]: %3|1730648674.366|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 09:44:41 kjcf05n00 zabbix-server[1150554]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 09:44:41 kjcf05n00 zabbix-server[1150554]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n03' from event '46078' Nov 3 09:44:41 kjcf05n00 zabbix-server[1150554]: Filesystem 'kjcf05' has been mounted Nov 3 09:44:42 kjcf05n00 zabbix-server[1150554]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 09:44:42 kjcf05n00 zabbix-server[1150554]: Running puppet on 'None' Nov 3 09:44:44 kjcf05n02 puppet-agent[108629]: Using configured environment 'production' Nov 3 09:44:44 kjcf05n02 puppet-agent[108629]: Retrieving pluginfacts Nov 3 09:44:44 kjcf05n02 puppet-agent[108629]: Retrieving plugin Nov 3 09:44:44 kjcf05n05 puppet-agent[2973702]: Using configured environment 'production' Nov 3 09:44:44 kjcf05n05 puppet-agent[2973702]: Retrieving pluginfacts Nov 3 09:44:44 kjcf05n05 puppet-agent[2973702]: Retrieving plugin Nov 3 09:44:44 kjcf05n06 puppet-agent[2824361]: Using configured environment 'production' Nov 3 09:44:44 kjcf05n06 puppet-agent[2824361]: Retrieving pluginfacts Nov 3 09:44:44 kjcf05n06 puppet-agent[2824361]: Retrieving plugin Nov 3 09:44:44 kjcf05n04 puppet-agent[2823746]: Using configured environment 'production' Nov 3 09:44:44 kjcf05n04 puppet-agent[2823746]: Retrieving pluginfacts Nov 3 09:44:44 kjcf05n04 puppet-agent[2823746]: Retrieving plugin Nov 3 09:44:44 kjcf05n03 puppet-agent[48709]: Using configured environment 'production' Nov 3 09:44:44 kjcf05n03 puppet-agent[48709]: Retrieving pluginfacts Nov 3 09:44:44 kjcf05n03 puppet-agent[48709]: Retrieving plugin Nov 3 09:44:44 kjcf05n07 puppet-agent[2822812]: Using configured environment 'production' Nov 3 09:44:44 kjcf05n07 puppet-agent[2822812]: Retrieving pluginfacts Nov 3 09:44:44 kjcf05n07 puppet-agent[2822812]: Retrieving plugin Nov 3 09:44:44 kjcf05n07 puppet-agent[2822812]: Loading facts Nov 3 09:44:44 kjcf05n02 puppet-agent[108629]: Loading facts Nov 3 09:44:44 kjcf05n05 puppet-agent[2973702]: Loading facts Nov 3 09:44:44 kjcf05n06 puppet-agent[2824361]: Loading facts Nov 3 09:44:44 kjcf05n01 puppet-agent[3023661]: Using configured environment 'production' Nov 3 09:44:44 kjcf05n01 puppet-agent[3023661]: Retrieving pluginfacts Nov 3 09:44:44 kjcf05n01 puppet-agent[3023661]: Retrieving plugin Nov 3 09:44:44 kjcf05n01 puppet-agent[3023661]: Loading facts Nov 3 09:44:45 kjcf05n04 puppet-agent[2823746]: Loading facts Nov 3 09:44:45 kjcf05n03 puppet-agent[48709]: Loading facts Nov 3 09:44:44 kjcf05n00 puppet-agent[1150616]: Using configured environment 'production' Nov 3 09:44:44 kjcf05n00 puppet-agent[1150616]: Retrieving pluginfacts Nov 3 09:44:44 kjcf05n00 puppet-agent[1150616]: Retrieving plugin Nov 3 09:44:45 kjcf05n00 puppet-agent[1150616]: Loading facts Nov 3 09:44:47 kjcf05n06 puppet-agent[2824361]: Caching catalog for kjcf05n06 Nov 3 09:44:47 kjcf05n06 puppet-agent[2824361]: Applying configuration version '1730648686' Nov 3 09:44:47 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 09:44:47 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 09:44:47 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 09:44:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730648687}"] Nov 3 09:44:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730648687, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:44:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.338761ms Nov 3 09:44:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.338761ms Nov 3 09:44:47 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:44:47 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:44:47 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:44:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730648687}"] Nov 3 09:44:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730648687, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:44:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.837774ms Nov 3 09:44:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.837774ms Nov 3 09:44:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:44:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:44:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:44:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730648687}"] Nov 3 09:44:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730648687, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:44:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.834659ms Nov 3 09:44:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.834659ms Nov 3 09:44:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:44:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:44:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:44:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730648687}"] Nov 3 09:44:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730648687, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:44:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.490464ms Nov 3 09:44:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.490464ms Nov 3 09:44:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:44:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:44:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:44:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730648687}"] Nov 3 09:44:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730648687, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:44:48 kjcf05n02 puppet-agent[108629]: Caching catalog for kjcf05n02 Nov 3 09:44:48 kjcf05n02 puppet-agent[108629]: Applying configuration version '1730648685' Nov 3 09:44:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.249353ms Nov 3 09:44:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.249353ms Nov 3 09:44:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:44:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:44:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:44:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730648687}"] Nov 3 09:44:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730648687, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:44:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 3.50243ms Nov 3 09:44:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 3.50243ms Nov 3 09:44:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:44:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:44:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:44:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730648687}"] Nov 3 09:44:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730648687, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:44:48 kjcf05n03 puppet-agent[48709]: Caching catalog for kjcf05n03 Nov 3 09:44:48 kjcf05n03 puppet-agent[48709]: Applying configuration version '1730648685' Nov 3 09:44:49 kjcf05n01 puppet-agent[3023661]: Caching catalog for kjcf05n01 Nov 3 09:44:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.42444ms Nov 3 09:44:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.42444ms Nov 3 09:44:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:44:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:44:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:44:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730648687}"] Nov 3 09:44:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730648687, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:44:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.13089ms Nov 3 09:44:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.13089ms Nov 3 09:44:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:44:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:44:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:44:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730648687}"] Nov 3 09:44:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730648687, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:44:49 kjcf05n07 puppet-agent[2822812]: Caching catalog for kjcf05n07 Nov 3 09:44:49 kjcf05n07 puppet-agent[2822812]: Applying configuration version '1730648686' Nov 3 09:44:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.677896ms Nov 3 09:44:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.677896ms Nov 3 09:44:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:44:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:44:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:44:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730648687}"] Nov 3 09:44:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730648687, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:44:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.58979ms Nov 3 09:44:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.58979ms Nov 3 09:44:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:44:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:44:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:44:49 kjcf05n01 puppet-agent[3023661]: Applying configuration version '1730648687' Nov 3 09:44:49 kjcf05n06 puppet-agent[2824361]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 09:44:49 kjcf05n06 puppet-agent[2824361]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 09:44:49 kjcf05n06 puppet-agent[2824361]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 09:44:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730648687}"] Nov 3 09:44:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730648687, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:44:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:44:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:44:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:44:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:44:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:44:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:44:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.516303ms Nov 3 09:44:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:44:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.516303ms Nov 3 09:44:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:44:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:44:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:44:49 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 09:44:50 kjcf05n00 ipmievd[15617]: Last message 'Memory sensor - Corr' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 09:44:50 kjcf05n00 puppet-agent[1150616]: Caching catalog for kjcf05n00 Nov 3 09:44:50 kjcf05n00 puppet-agent[1150616]: Applying configuration version '1730648688' Nov 3 09:44:50 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2771538]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 09:44:50 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 09:44:50 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 09:44:50 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 09:44:50 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 09:44:50 kjcf05n06 puppet-agent[2824361]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: Press Ctrl+C to exit. Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: Plugin support version 1.0 Nov 3 09:44:50 kjcf05n06 zabbix_agent2[2825196]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 09:44:50 kjcf05n03 puppet-agent[48709]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 09:44:50 kjcf05n03 puppet-agent[48709]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 09:44:50 kjcf05n03 puppet-agent[48709]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 09:44:50 kjcf05n02 puppet-agent[108629]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 09:44:50 kjcf05n02 puppet-agent[108629]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 09:44:50 kjcf05n02 puppet-agent[108629]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 09:44:51 kjcf05n07 puppet-agent[2822812]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 09:44:51 kjcf05n07 puppet-agent[2822812]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 09:44:51 kjcf05n07 puppet-agent[2822812]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 09:44:51 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 09:44:51 kjcf05n02 zabbix_agent2[49741]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 09:44:51 kjcf05n02 zabbix_agent2[3153]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 09:44:51 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 09:44:51 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 09:44:51 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 09:44:51 kjcf05n02 puppet-agent[108629]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: Press Ctrl+C to exit. Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: Plugin support version 1.0 Nov 3 09:44:51 kjcf05n02 zabbix_agent2[109202]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 09:44:51 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 09:44:51 kjcf05n03 zabbix_agent2[6001]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 09:44:51 kjcf05n03 zabbix_agent2[3192]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 09:44:51 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 09:44:51 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 09:44:51 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 09:44:51 kjcf05n03 puppet-agent[48709]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: Press Ctrl+C to exit. Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: Plugin support version 1.0 Nov 3 09:44:51 kjcf05n03 zabbix_agent2[49102]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 09:44:51 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2769475]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 09:44:51 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 09:44:51 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 09:44:51 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 09:44:51 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 09:44:51 kjcf05n07 puppet-agent[2822812]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: Press Ctrl+C to exit. Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: Plugin support version 1.0 Nov 3 09:44:51 kjcf05n07 zabbix_agent2[2823245]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 09:44:52 kjcf05n06 puppet-agent[2824361]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 09:44:52 kjcf05n06 puppet-agent[2824361]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 09:44:52 kjcf05n06 puppet-agent[2824361]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 09:44:52 kjcf05n06 puppet-agent[2824361]: Applied catalog in 4.72 seconds Nov 3 09:44:52 kjcf05n01 puppet-agent[3023661]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 09:44:52 kjcf05n01 puppet-agent[3023661]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-09:24:59]/mode) mode changed '0755' to '0750' Nov 3 09:44:52 kjcf05n01 puppet-agent[3023661]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-09:24:59/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 09:44:52 kjcf05n01 puppet-agent[3023661]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-09:24:59/vmcore]/mode) mode changed '0600' to '0640' Nov 3 09:44:52 kjcf05n01 puppet-agent[3023661]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-09:24:59/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 09:44:52 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 09:44:52 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 09:44:52 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 09:44:53 kjcf05n01 puppet-agent[3023661]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 09:44:53 kjcf05n01 puppet-agent[3023661]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 09:44:53 kjcf05n01 puppet-agent[3023661]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 09:44:52 kjcf05n00 puppet-agent[1150616]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 09:44:53 kjcf05n03 puppet-agent[48709]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 09:44:53 kjcf05n03 puppet-agent[48709]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 09:44:53 kjcf05n03 puppet-agent[48709]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 09:44:53 kjcf05n07 puppet-agent[2822812]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 09:44:53 kjcf05n07 puppet-agent[2822812]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 09:44:53 kjcf05n07 puppet-agent[2822812]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 09:44:53 kjcf05n07 puppet-agent[2822812]: Applied catalog in 4.93 seconds Nov 3 09:44:53 kjcf05n02 puppet-agent[108629]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 09:44:53 kjcf05n02 puppet-agent[108629]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 09:44:53 kjcf05n02 puppet-agent[108629]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 09:44:53 kjcf05n02 puppet-agent[108629]: Applied catalog in 5.26 seconds Nov 3 09:44:53 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3011666]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 09:44:53 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 09:44:53 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 09:44:53 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 09:44:53 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 09:44:53 kjcf05n01 puppet-agent[3023661]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: Press Ctrl+C to exit. Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: Plugin support version 1.0 Nov 3 09:44:53 kjcf05n01 zabbix_agent2[3024076]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 09:44:54 kjcf05n03 puppet-agent[48709]: Applied catalog in 5.07 seconds Nov 3 09:44:54 kjcf05n00 puppet-agent[1150616]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 09:44:54 kjcf05n00 puppet-agent[1150616]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 09:44:54 kjcf05n00 puppet-agent[1150616]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 09:44:54 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1131607]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 09:44:55 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 09:44:54 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 09:44:54 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 09:44:54 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 09:44:54 kjcf05n00 puppet-agent[1150616]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: Press Ctrl+C to exit. Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: Plugin support version 1.0 Nov 3 09:44:54 kjcf05n00 zabbix_agent2[1151234]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 09:44:55 kjcf05n00 zabbix-server[1151271]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 09:44:56 kjcf05n01 puppet-agent[3023661]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_093218.log]/mode) mode changed '0644' to '0640' Nov 3 09:44:56 kjcf05n01 puppet-agent[3023661]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_094402.log]/mode) mode changed '0644' to '0640' Nov 3 09:44:55 kjcf05n00 zabbix-server[1151274]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 09:44:56 kjcf05n00 zabbix-server[1151281]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 09:44:56 kjcf05n01 puppet-agent[3023661]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_093218.log]/mode) mode changed '0644' to '0640' Nov 3 09:44:56 kjcf05n01 puppet-agent[3023661]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_094402.log]/mode) mode changed '0644' to '0640' Nov 3 09:44:56 kjcf05n01 puppet-agent[3023661]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_094402]/mode) mode changed '0755' to '0750' Nov 3 09:44:56 kjcf05n01 puppet-agent[3023661]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_094402/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 09:44:56 kjcf05n01 puppet-agent[3023661]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 09:44:56 kjcf05n01 puppet-agent[3023661]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 09:44:56 kjcf05n01 puppet-agent[3023661]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 09:44:56 kjcf05n00 zabbix-server[1151286]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 09:44:56 kjcf05n00 puppet-agent[1150616]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 09:44:57 kjcf05n04 puppet-agent[2823746]: Caching catalog for kjcf05n04 Nov 3 09:44:57 kjcf05n04 puppet-agent[2823746]: Applying configuration version '1730648694' Nov 3 09:44:58 kjcf05n01 puppet-agent[3023661]: Applied catalog in 9.03 seconds Nov 3 09:44:58 kjcf05n00 puppet-agent[1150616]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 09:44:58 kjcf05n00 puppet-agent[1150616]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 09:44:58 kjcf05n00 puppet-agent[1150616]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 09:44:59 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 09:44:59 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 09:44:59 kjcf05n00 puppet-agent[1150616]: Applied catalog in 9.27 seconds Nov 3 09:45:00 kjcf05n04 puppet-agent[2823746]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 09:45:00 kjcf05n04 puppet-agent[2823746]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 09:45:00 kjcf05n04 puppet-agent[2823746]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 09:45:00 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2777733]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 09:45:00 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 09:45:00 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 09:45:00 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 09:45:00 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 09:45:00 kjcf05n04 puppet-agent[2823746]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: Press Ctrl+C to exit. Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: Plugin support version 1.0 Nov 3 09:45:00 kjcf05n04 zabbix_agent2[2824649]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 09:45:02 kjcf05n04 puppet-agent[2823746]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 09:45:02 kjcf05n04 puppet-agent[2823746]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 09:45:02 kjcf05n04 puppet-agent[2823746]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 09:45:03 kjcf05n04 puppet-agent[2823746]: Applied catalog in 5.32 seconds Nov 3 09:45:04 kjcf05n00 mcfcli[3673891]: %3|1730648704.366|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:45:07 kjcf05n00 python3.9[1151373]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 09:45:13 kjcf05n00 mcfcli[3673891]: %3|1730648713.280|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:45:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730648720', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 09:45:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730648720'} Nov 3 09:45:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:45:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730648720', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 09:45:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730648720'} Nov 3 09:45:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:45:34 kjcf05n00 mcfcli[3673891]: %3|1730648734.367|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 09:45:40 kjcf05n05 puppet-agent[2973702]: Caching catalog for kjcf05n05 Nov 3 09:45:40 kjcf05n05 puppet-agent[2973702]: Applying configuration version '1730648738' Nov 3 09:45:42 kjcf05n05 puppet-agent[2973702]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 09:45:42 kjcf05n05 puppet-agent[2973702]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 09:45:42 kjcf05n05 puppet-agent[2973702]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 09:45:43 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2925145]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 09:45:43 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 09:45:43 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 09:45:43 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 09:45:43 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 09:45:43 kjcf05n05 puppet-agent[2973702]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: Starting Zabbix Agent 2 (6.2.1) Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: Press Ctrl+C to exit. Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: Plugin support version 1.0 Nov 3 09:45:43 kjcf05n05 zabbix_agent2[2975850]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 09:45:45 kjcf05n05 puppet-agent[2973702]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 09:45:45 kjcf05n05 puppet-agent[2973702]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 09:45:45 kjcf05n05 puppet-agent[2973702]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 09:45:45 kjcf05n05 puppet-agent[2973702]: Applied catalog in 4.78 seconds Nov 3 09:45:45 kjcf05n00 zabbix-server[1150554]: puppet completed status:(0): '' Nov 3 09:45:45 kjcf05n00 zabbix-server[1150554]: Event '46078' acknowledged Nov 3 09:45:45 kjcf05n00 zabbix-server[1150554]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n03"}' Nov 3 09:45:53 kjcf05n00 mcfcli[3673891]: %3|1730648753.276|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:46:04 kjcf05n00 mcfcli[3673891]: %3|1730648764.367|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:46:32 kjcf05n00 mcfcli[3673891]: %3|1730648792.053|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:46:34 kjcf05n00 mcfcli[3673891]: %3|1730648794.368|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:47:04 kjcf05n00 mcfcli[3673891]: %3|1730648824.368|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 09:47:09 kjcf05n00 mcfcli[3673891]: %3|1730648829.306|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:47:29 kjcf05n04 diskmonitor[39342]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 09:47:34 kjcf05n00 mcfcli[3673891]: %3|1730648854.369|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:47:45 kjcf05n00 mcfcli[3673891]: %3|1730648865.807|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:47:57 kjcf05n06 diskmonitor[19372]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 09:48:04 kjcf05n00 mcfcli[3673891]: %3|1730648884.369|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 09:48:21 kjcf05n03 dwd[5194]: nvme10n1 passed periodic SMART status check Nov 3 09:48:21 kjcf05n03 dwd[5194]: nvme11n1 passed periodic SMART status check Nov 3 09:48:21 kjcf05n03 dwd[5194]: nvme21n1 passed periodic SMART status check Nov 3 09:48:21 kjcf05n03 dwd[5194]: nvme20n1 passed periodic SMART status check Nov 3 09:48:21 kjcf05n03 dwd[5194]: nvme15n1 passed periodic SMART status check Nov 3 09:48:21 kjcf05n00 mcfcli[3673891]: %3|1730648901.238|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:48:22 kjcf05n03 dwd[5194]: nvme22n1 passed periodic SMART status check Nov 3 09:48:22 kjcf05n03 dwd[5194]: nvme16n1 passed periodic SMART status check Nov 3 09:48:22 kjcf05n03 dwd[5194]: nvme7n1 passed periodic SMART status check Nov 3 09:48:22 kjcf05n03 dwd[5194]: nvme6n1 passed periodic SMART status check Nov 3 09:48:22 kjcf05n03 dwd[5194]: nvme5n1 passed periodic SMART status check Nov 3 09:48:22 kjcf05n03 dwd[5194]: nvme12n1 passed periodic SMART status check Nov 3 09:48:34 kjcf05n00 mcfcli[3673891]: %3|1730648914.369|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 09:48:59 kjcf05n00 mcfcli[3673891]: %3|1730648939.827|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:49:00 kjcf05n07 diskmonitor[19063]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 09:49:04 kjcf05n00 mcfcli[3673891]: %3|1730648944.370|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 09:49:34 kjcf05n00 mcfcli[3673891]: %3|1730648974.370|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 09:49:37 kjcf05n05 diskmonitor[40540]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 09:49:39 kjcf05n00 mcfcli[3673891]: %3|1730648979.749|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 09:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 09:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 09:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 09:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 09:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 09:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 09:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 09:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 09:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 09:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 09:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 09:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 09:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 09:50:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 09:50:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 09:50:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 09:50:04 kjcf05n00 mcfcli[3673891]: %3|1730649004.372|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 09:50:07 kjcf05n00 python3.9[1154349]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 09:50:17 kjcf05n00 mcfcli[3673891]: %3|1730649017.215|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:50:34 kjcf05n00 mcfcli[3673891]: %3|1730649034.372|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 09:50:53 kjcf05n00 mcfcli[3673891]: %3|1730649053.551|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:51:04 kjcf05n00 mcfcli[3673891]: %3|1730649064.372|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 09:51:31 kjcf05n00 mcfcli[3673891]: %3|1730649091.881|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:51:34 kjcf05n00 mcfcli[3673891]: %3|1730649094.372|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 09:52:04 kjcf05n00 mcfcli[3673891]: %3|1730649124.374|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 09:52:11 kjcf05n00 mcfcli[3673891]: %3|1730649131.878|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:52:28 kjcf05n07 chronyd[5456]: Selected source 16.110.135.123 Nov 3 09:52:34 kjcf05n00 mcfcli[3673891]: %3|1730649154.374|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 09:52:48 kjcf05n00 mcfcli[3673891]: %3|1730649168.288|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:53:04 kjcf05n00 mcfcli[3673891]: %3|1730649184.375|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 09:53:05 kjcf05n02 nslcd[6978]: [e87ccd] ldap_result() failed: Can't contact LDAP server Nov 3 09:53:05 kjcf05n02 nslcd[6978]: [1b58ba] ldap_result() failed: Can't contact LDAP server Nov 3 09:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T15:53:15.868455Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 09:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T15:53:15.868513Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.081ms Nov 3 09:53:24 kjcf05n00 mcfcli[3673891]: %3|1730649204.811|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T09:53:27.338159928-06:00 level=info msg="Completed cleanup jobs" duration=111.720512ms Nov 3 09:53:34 kjcf05n00 mcfcli[3673891]: %3|1730649214.376|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:54:03 kjcf05n00 mcfcli[3673891]: %3|1730649243.290|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:54:04 kjcf05n00 mcfcli[3673891]: %3|1730649244.376|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 09:54:34 kjcf05n00 mcfcli[3673891]: %3|1730649274.376|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 09:54:40 kjcf05n00 mcfcli[3673891]: %3|1730649280.351|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:54:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 09:54:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 09:54:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 09:54:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 09:54:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 09:54:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 09:55:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 09:55:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 09:55:04 kjcf05n00 mcfcli[3673891]: %3|1730649304.376|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 09:55:08 kjcf05n00 zabbix_server[15761]: Zabbix agent item "xrtx.enclosure.serial_number[USE26000024VS001]" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 3 09:55:08 kjcf05n00 zabbix_server[15748]: Zabbix agent item "dcs.lustre.device.discovery[{$LUSTRE_FS_NAME},mdt]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 3 09:55:13 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 09:55:13 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 09:55:13 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 09:55:13 kjcf05n03 fstonithd.py[15106]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 3 09:55:14 kjcf05n03 root[66225]: is_enc_ipmi_off starts Nov 3 09:55:14 kjcf05n03 root[66226]: is_viking_off starts Nov 3 09:55:14 kjcf05n03 root[66242]: is_lan_ipmi_off leaves Nov 3 09:55:14 kjcf05n03 root[66244]: is_lan_ipmi_sec_off leaves Nov 3 09:55:14 kjcf05n03 root[66247]: I am in slot 1; partner is in slot 0 Nov 3 09:55:14 kjcf05n03 root[66251]: I am not master; I will get master Nov 3 09:55:16 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='34', error='Connection reset by peer (104)' Nov 3 09:55:16 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='34', client='AF_INET(172.16.2.5:45437)', local='AF_INET(0.0.0.0:601)' Nov 3 09:55:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 09:55:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 09:55:17 kjcf05n00 mcfcli[3673891]: %3|1730649317.897|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:55:19 kjcf05n03 root[66424]: I am now master Nov 3 09:55:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 09:55:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 09:55:21 kjcf05n03 root[66467]: is_viking_off leaves Nov 3 09:55:21 kjcf05n03 root[66470]: kjcf05n02 not already off look at kdump Nov 3 09:55:21 kjcf05n03 root[66471]: is_kdump_off starts Nov 3 09:55:21 kjcf05n03 fence_kdump[66472]: waiting for message from '172.16.2.5' Nov 3 09:55:22 kjcf05n03 fence_kdump[66472]: received valid message from '172.16.2.5' Nov 3 09:55:22 kjcf05n03 root[66490]: is_kdump_off detected kdump on kjcf05n02 Nov 3 09:55:22 kjcf05n03 root[66491]: kjcf05n02 is kdumping Nov 3 09:55:22 kjcf05n03 root[66580]: is_viking_off starts Nov 3 09:55:22 kjcf05n03 root[66579]: is_enc_ipmi_off starts Nov 3 09:55:22 kjcf05n03 root[66596]: is_lan_ipmi_off leaves Nov 3 09:55:22 kjcf05n03 root[66598]: is_lan_ipmi_sec_off leaves Nov 3 09:55:22 kjcf05n03 root[66601]: I am master Nov 3 09:55:22 kjcf05n03 root[66607]: I am in slot 1; partner is in slot 0 Nov 3 09:55:23 kjcf05n00 zabbix_server[15760]: Zabbix agent item "vfs.fs.size[/etc/ganesha,total]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 09:55:23 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.mdt.name[MDT0000,mdt_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 09:55:24 kjcf05n00 zabbix_server[15718]: Zabbix agent item "vfs.fs.size[/mnt/persistent_ha_data,used]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 09:55:25 kjcf05n00 zabbix_server[15743]: Zabbix agent item "vfs.fs.size[/var/lib/pacemaker,used]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 09:55:26 kjcf05n00 zabbix_server[15752]: Zabbix agent item "system.swap.size[,free]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 09:55:27 kjcf05n00 python3.9[1157206]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 09:55:29 kjcf05n03 root[66809]: is_viking_off leaves Nov 3 09:55:29 kjcf05n03 root[66812]: kjcf05n02 not already off look at kdump Nov 3 09:55:29 kjcf05n03 root[66813]: is_kdump_off starts Nov 3 09:55:29 kjcf05n03 fence_kdump[66814]: waiting for message from '172.16.2.5' Nov 3 09:55:30 kjcf05n03 fence_kdump[66814]: received valid message from '172.16.2.5' Nov 3 09:55:30 kjcf05n03 root[66831]: is_kdump_off detected kdump on kjcf05n02 Nov 3 09:55:30 kjcf05n03 root[66832]: kjcf05n02 is kdumping Nov 3 09:55:32 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 09:55:32 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 09:55:34 kjcf05n03 systemd-udevd[69157]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69158]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69160]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69162]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69157]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69160]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69158]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69162]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69157]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69160]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69158]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69162]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69157]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69160]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69158]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69157]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69160]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69162]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69158]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69157]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69160]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69162]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69158]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69160]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69157]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69185]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69162]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69158]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69188]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69157]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69190]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69160]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69194]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69185]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69162]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69158]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69194]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69185]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69190]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69188]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69194]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69190]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69194]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69190]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69194]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69194]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69185]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69158]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69188]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69194]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69185]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69190]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69194]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69185]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69194]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69194]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69190]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69194]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69194]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69190]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69194]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69190]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69194]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n03 systemd-udevd[69194]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 09:55:34 kjcf05n00 mcfcli[3673891]: %3|1730649334.376|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 09:55:34 kjcf05n03 dwd[5194]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 09:55:34 kjcf05n03 dwd[5194]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 09:55:34 kjcf05n03 dwd[5194]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 09:55:34 kjcf05n03 dwd[5194]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 09:55:34 kjcf05n03 dwd[5194]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 09:55:34 kjcf05n03 dwd[5194]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 09:55:34 kjcf05n03 dwd[5194]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 09:55:34 kjcf05n03 dwd[5194]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 09:55:34 kjcf05n03 dwd[5194]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 09:55:34 kjcf05n03 dwd[5194]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 09:55:34 kjcf05n03 dwd[5194]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 09:55:34 kjcf05n03 dwd[5194]: Starting NVME thread for nvme25n1 Nov 3 09:55:35 kjcf05n03 dwd[5194]: Starting NVME thread for nvme8n1 Nov 3 09:55:35 kjcf05n03 dwd[5194]: Starting NVME thread for nvme18n1 Nov 3 09:55:35 kjcf05n03 dwd[5194]: Starting NVME thread for nvme23n1 Nov 3 09:55:35 kjcf05n03 dwd[5194]: Starting NVME thread for nvme9n1 Nov 3 09:55:35 kjcf05n03 dwd[5194]: Starting NVME thread for nvme4n1 Nov 3 09:55:35 kjcf05n03 dwd[5194]: Starting NVME thread for nvme2n1 Nov 3 09:55:36 kjcf05n03 dwd[5194]: Starting NVME thread for nvme3n1 Nov 3 09:55:36 kjcf05n03 dwd[5194]: Starting NVME thread for nvme19n1 Nov 3 09:55:36 kjcf05n03 dwd[5194]: Starting NVME thread for nvme17n1 Nov 3 09:55:36 kjcf05n03 dwd[5194]: Starting NVME thread for nvme24n1 Nov 3 09:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 09:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 09:55:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 09:55:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 09:55:38 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.mdt.name[MDT0001,mdt_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 09:55:41 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.cpu.load[all,avg1]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 09:55:44 kjcf05n03 diskmonitor[17376]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 09:55:52 kjcf05n03 diskmonitor[17376]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 09:55:52 kjcf05n03 diskmonitor[17376]: Scan for ReadErrorMax change for md65 Nov 3 09:55:52 kjcf05n03 diskmonitor[17376]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 09:55:52 kjcf05n03 diskmonitor[17376]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 09:55:52 kjcf05n03 diskmonitor[17376]: read_saved_file: md65 no saved speed Nov 3 09:55:52 kjcf05n03 diskmonitor[17376]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 09:55:52 kjcf05n03 diskmonitor[17376]: Set sync_speed_min (10000) for md65 Nov 3 09:55:52 kjcf05n03 diskmonitor[17376]: Set sync_speed_max (200000) for md65 Nov 3 09:55:52 kjcf05n03 diskmonitor[17376]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 09:55:53 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 3 09:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 09:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 09:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 09:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 09:55:55 kjcf05n00 mcfcli[3673891]: %3|1730649355.845|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:55:56 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 3 09:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 09:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 09:55:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 09:55:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 09:56:04 kjcf05n00 mcfcli[3673891]: %3|1730649364.377|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 09:56:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 09:56:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 09:56:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 09:56:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 09:56:32 kjcf05n00 mcfcli[3673891]: %3|1730649392.809|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:56:34 kjcf05n00 mcfcli[3673891]: %3|1730649394.377|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 09:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 09:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 09:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 09:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 09:56:45 kjcf05n03 nslcd[7088]: (re)loading /etc/nsswitch.conf Nov 3 09:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 09:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 09:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 09:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 09:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 09:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 09:56:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 09:56:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 09:57:04 kjcf05n00 mcfcli[3673891]: %3|1730649424.377|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:57:10 kjcf05n00 mcfcli[3673891]: %3|1730649430.942|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:57:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 09:57:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 09:57:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730649438}"] Nov 3 09:57:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730649438, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:57:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.252088ms Nov 3 09:57:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.252088ms Nov 3 09:57:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:57:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:57:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:57:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730649438}"] Nov 3 09:57:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730649438, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:57:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.82626ms Nov 3 09:57:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.82626ms Nov 3 09:57:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:57:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:57:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:57:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730649438}"] Nov 3 09:57:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730649438, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:57:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.664527ms Nov 3 09:57:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.664527ms Nov 3 09:57:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:57:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:57:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:57:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730649438}"] Nov 3 09:57:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730649438, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:57:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.510068ms Nov 3 09:57:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.510068ms Nov 3 09:57:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:57:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:57:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:57:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730649438}"] Nov 3 09:57:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730649438, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:57:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.368516ms Nov 3 09:57:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.368516ms Nov 3 09:57:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:57:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:57:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:57:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730649438}"] Nov 3 09:57:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730649438, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:57:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.661425ms Nov 3 09:57:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.661425ms Nov 3 09:57:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:57:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:57:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:57:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730649438}"] Nov 3 09:57:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730649438, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:57:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.981642ms Nov 3 09:57:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.981642ms Nov 3 09:57:19 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:57:19 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:57:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:57:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730649438}"] Nov 3 09:57:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730649438, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:57:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.811322ms Nov 3 09:57:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.811322ms Nov 3 09:57:19 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:57:19 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:57:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:57:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730649438}"] Nov 3 09:57:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730649438, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:57:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.606168ms Nov 3 09:57:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.606168ms Nov 3 09:57:19 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:57:19 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:57:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:57:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730649438}"] Nov 3 09:57:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730649438, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:57:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.23201ms Nov 3 09:57:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.23201ms Nov 3 09:57:19 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:57:19 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:57:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:57:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730649438}"] Nov 3 09:57:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730649438, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 09:57:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 09:57:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T09:57:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 09:57:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T09:57:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 09:57:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T09:57:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.741141ms Nov 3 09:57:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T09:57:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.741141ms Nov 3 09:57:19 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:09:57:19 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 09:57:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 09:57:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 09:57:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 09:57:34 kjcf05n00 mcfcli[3673891]: %3|1730649454.379|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 09:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 09:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 09:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 09:57:48 kjcf05n00 mcfcli[3673891]: %3|1730649468.508|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 09:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 09:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 09:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 09:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 09:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 09:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 09:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 09:58:04 kjcf05n00 mcfcli[3673891]: %3|1730649484.379|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:58:09 kjcf05n00 zabbix-server[1159176]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 09:58:09 kjcf05n00 zabbix-server[1159176]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 09:58:10 kjcf05n00 log_interesting_event.py[1159176]: Event '46081' acknowledged Nov 3 09:58:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 09:58:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 09:58:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 09:58:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 09:58:28 kjcf05n00 mcfcli[3673891]: %3|1730649508.505|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:58:34 kjcf05n00 mcfcli[3673891]: %3|1730649514.379|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 09:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 09:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 09:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 09:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 09:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 09:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 09:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 09:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 09:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 09:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 09:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 09:59:00 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 3 09:59:00 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 09:59:04 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 09:59:04 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 3 09:59:04 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 3 09:59:04 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 09:59:04 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 09:59:04 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 3 09:59:04 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 3 09:59:04 kjcf05n00 mcfcli[3673891]: %3|1730649544.379|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:59:06 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 3 09:59:06 kjcf05n00 mcfcli[3673891]: %3|1730649546.717|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:59:09 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 3 09:59:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 09:59:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 09:59:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 09:59:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 09:59:34 kjcf05n00 mcfcli[3673891]: %3|1730649574.380|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 09:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 09:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 09:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 09:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 09:59:43 kjcf05n00 mcfcli[3673891]: %3|1730649583.986|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 09:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 09:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 09:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 09:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 09:59:56 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:38880). Nov 3 09:59:56 kjcf05n01 rsyncd[3029927]: connect from kjcf05n02 (172.16.2.5) Nov 3 09:59:56 kjcf05n01 rsyncd[3029927]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 09:59:56 kjcf05n01 rsyncd[3029927]: building file list Nov 3 09:59:56 kjcf05n01 rsyncd[3029927]: sent 11449 bytes received 136 bytes total size 10905 Nov 3 09:59:56 kjcf05n01 systemd[1]: rsyncd@617-172.16.2.2:873-172.16.2.5:38880.service: Succeeded. Nov 3 09:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 09:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 09:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 09:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 10:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 10:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 10:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 10:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 10:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 10:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 10:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 10:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 10:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 10:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 10:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 10:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 10:00:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 10:00:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:00:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 10:00:04 kjcf05n00 mcfcli[3673891]: %3|1730649604.380|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 10:00:07 kjcf05n00 python3.9[1160141]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 10:00:13 kjcf05n03 fstonithd.py[15106]: Listening for kdump packets from partner Nov 3 10:00:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 10:00:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 10:00:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 10:00:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 10:00:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730649622', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 10:00:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730649622'} Nov 3 10:00:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:00:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730649622', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 10:00:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730649622'} Nov 3 10:00:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:00:22 kjcf05n00 mcfcli[3673891]: %3|1730649622.432|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:00:34 kjcf05n00 mcfcli[3673891]: %3|1730649634.380|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 10:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 10:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 10:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 10:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 10:00:42 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 10:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 10:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 10:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 10:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 10:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 10:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 10:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 10:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 10:01:00 kjcf05n03 dwd[5194]: nvme25n1 passed periodic SMART status check Nov 3 10:01:00 kjcf05n00 mcfcli[3673891]: %3|1730649660.684|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:01:01 kjcf05n03 dwd[5194]: nvme4n1 passed periodic SMART status check Nov 3 10:01:01 kjcf05n03 dwd[5194]: nvme9n1 passed periodic SMART status check Nov 3 10:01:01 kjcf05n03 dwd[5194]: nvme23n1 passed periodic SMART status check Nov 3 10:01:01 kjcf05n03 dwd[5194]: nvme18n1 passed periodic SMART status check Nov 3 10:01:01 kjcf05n03 dwd[5194]: nvme2n1 passed periodic SMART status check Nov 3 10:01:01 kjcf05n03 dwd[5194]: nvme8n1 passed periodic SMART status check Nov 3 10:01:02 kjcf05n03 dwd[5194]: nvme17n1 passed periodic SMART status check Nov 3 10:01:02 kjcf05n03 dwd[5194]: nvme19n1 passed periodic SMART status check Nov 3 10:01:02 kjcf05n03 dwd[5194]: nvme3n1 passed periodic SMART status check Nov 3 10:01:02 kjcf05n03 dwd[5194]: nvme24n1 passed periodic SMART status check Nov 3 10:01:04 kjcf05n00 mcfcli[3673891]: %3|1730649664.381|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:01:16 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 10:01:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 10:01:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 10:01:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 10:01:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 10:01:21 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 10:01:22 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='39', client='AF_INET(172.16.2.5:41723)', local='AF_INET(0.0.0.0:601)' Nov 3 10:01:22 kjcf05n02 syslog-ng[3225]: Configuration reload request received, reloading configuration; Nov 3 10:01:22 kjcf05n02 syslog-ng[3225]: Configuration reload finished; Nov 3 10:01:22 kjcf05n02 syslog-ng[3225]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 10:01:22 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 3 10:01:22 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 10:01:22 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 3 10:01:22 kjcf05n02 dracut: Self testing crypto algorithms Nov 3 10:01:22 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 3 10:01:22 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 10:01:22 kjcf05n02 Copying live image to RAM... Nov 3 10:01:22 kjcf05n02 (this may take a minute) Nov 3 10:01:22 kjcf05n02 Done copying live image to RAM. Nov 3 10:01:22 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 10:01:22 kjcf05n02 dracut: Checking integrity of kernel Nov 3 10:01:22 kjcf05n02 dracut: All initrd crypto checks done Nov 3 10:01:22 kjcf05n02 dracut: Switching root Nov 3 10:01:22 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 10:01:22 kjcf05n02 systemd: Detected architecture x86-64. Nov 3 10:01:22 kjcf05n02 systemd: Set hostname to . Nov 3 10:01:22 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 10:01:22 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 10:01:22 kjcf05n02 systemd: Created slice system-getty.slice. Nov 3 10:01:22 kjcf05n02 systemd: Listening on RPCbind Server Activation Socket. Nov 3 10:01:22 kjcf05n02 systemd: Listening on Journal Socket. Nov 3 10:01:22 kjcf05n02 systemd: Mounting /mnt... Nov 3 10:01:22 kjcf05n02 systemd: Mounting Kernel Debug File System... Nov 3 10:01:22 kjcf05n02 systemd-journald[1553]: Journal started Nov 3 10:01:22 kjcf05n02 systemd-journald[1553]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 10:01:22 kjcf05n02 systemd-modules-load[1550]: Inserted module 'fuse' Nov 3 10:01:22 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 3 10:01:22 kjcf05n02 systemd-sysctl[1559]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 10:01:22 kjcf05n02 systemd-sysctl[1559]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 3 10:01:22 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Create System Users. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 10:01:22 kjcf05n02 systemd-journald[1553]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 10:01:22 kjcf05n02 systemd-tmpfiles[1573]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 10:01:22 kjcf05n02 systemd-tmpfiles[1573]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 3 10:01:22 kjcf05n02 systemd-udevd[1579]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 3 10:01:22 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 3 10:01:22 kjcf05n02 systemd-udevd[1627]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:01:22 kjcf05n02 systemd-udevd[1616]: Using default interface naming scheme 'rhel-8.0'. Nov 3 10:01:22 kjcf05n02 systemd-udevd[1616]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:01:22 kjcf05n02 systemd-udevd[1587]: Using default interface naming scheme 'rhel-8.0'. Nov 3 10:01:22 kjcf05n02 systemd-udevd[1587]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:01:22 kjcf05n02 systemd-udevd[1624]: Using default interface naming scheme 'rhel-8.0'. Nov 3 10:01:22 kjcf05n02 systemd-udevd[1624]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 10:01:22 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 3 10:01:22 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 10:01:22 kjcf05n02 systemd-tmpfiles[1805]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 10:01:22 kjcf05n02 systemd-tmpfiles[1805]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 10:01:22 kjcf05n02 systemd-tmpfiles[1805]: "/var/tmp" already exists and is not a directory. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 3 10:01:22 kjcf05n02 root[1825]: openibd: running in auto mode Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 10:01:22 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 10:01:22 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started RPC Bind. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 10:01:22 kjcf05n02 systemd-modules-load[1868]: Inserted module 'ib_iser' Nov 3 10:01:22 kjcf05n02 systemd-modules-load[1868]: Inserted module 'ib_isert' Nov 3 10:01:22 kjcf05n02 systemd-modules-load[1868]: Inserted module 'ib_srpt' Nov 3 10:01:22 kjcf05n02 systemd-udevd[1586]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:01:22 kjcf05n02 systemd-modules-load[1855]: Inserted module 'ib_ipoib' Nov 3 10:01:22 kjcf05n02 systemd-udevd[1637]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:01:22 kjcf05n02 systemd-modules-load[1868]: Inserted module 'rdma_ucm' Nov 3 10:01:22 kjcf05n02 systemd-modules-load[1868]: Module 'svcrdma' is blacklisted Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 10:01:22 kjcf05n02 systemd-udevd[1586]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 10:01:22 kjcf05n02 systemd-udevd[1637]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 10:01:22 kjcf05n02 systemd-modules-load[1855]: Inserted module 'ib_umad' Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 10:01:22 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 3 10:01:22 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 3 10:01:22 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 10:01:22 kjcf05n02 systemd[3225]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:22 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 10:01:22 kjcf05n02 openibd[1808]: Loading HCA driver and Access Layer:[ OK ] Nov 3 10:01:22 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Update is Completed. Nov 3 10:01:22 kjcf05n02 setup-icl[1775]: Setting LAN IP Address to 203.0.113.3 Nov 3 10:01:22 kjcf05n02 setup-icl[1775]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 10:01:22 kjcf05n02 setup-icl[1775]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 10:01:22 kjcf05n02 setup-icl[1775]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 10:01:22 kjcf05n02 systemd-udevd[1586]: Using default interface naming scheme 'rhel-8.0'. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 10:01:22 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 3 10:01:22 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 10:01:22 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 10:01:22 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 10:01:22 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 3 10:01:22 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 10:01:22 kjcf05n02 systemd[1]: Reached target Sockets. Nov 3 10:01:22 kjcf05n02 systemd[1]: Reached target Basic System. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 10:01:22 kjcf05n02 mcelog[2145]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 10:01:22 kjcf05n02 mcelog[2145]: CPU is unsupported Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 0 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 1 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 2 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 3 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 4 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 5 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 6 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 7 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 8 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 9 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 10 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 11 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 12 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 13 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 14 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 15 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 16 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 17 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 18 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 19 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 20 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 21 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 22 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 23 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 24 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 25 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 26 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 27 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 28 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 29 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 30 Nov 3 10:01:22 kjcf05n02 cpupower[2149]: Setting cpu: 31 Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 3 10:01:22 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 10:01:22 kjcf05n02 nscd[2156]: 2156 monitoring file `/etc/hosts` (1) Nov 3 10:01:22 kjcf05n02 nscd[2156]: 2156 monitoring directory `/etc` (2) Nov 3 10:01:22 kjcf05n02 nscd[2156]: 2156 monitoring file `/etc/resolv.conf` (3) Nov 3 10:01:22 kjcf05n02 nscd[2156]: 2156 monitoring directory `/etc` (2) Nov 3 10:01:22 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[2173]: Setting up Mellanox network interface: ib0 Nov 3 10:01:22 kjcf05n02 beSetMlxConfig[2174]: ConnectX-3 multiport not detected Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 10:01:22 kjcf05n02 chronyd[2217]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 10:01:22 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 10:01:22 kjcf05n02 dbus-daemon[2171]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 10:01:22 kjcf05n02 dwd[2203]: dwd: vMay 29 2024 : 15:38:26 Nov 3 10:01:22 kjcf05n02 dwd[2203]: /usr/sbin/dwd -d --standalone=0 Nov 3 10:01:22 kjcf05n02 dwd[2203]: dwd: option Lethal: 0 Nov 3 10:01:22 kjcf05n02 dwd[2203]: dwd: option Interval: 60 Nov 3 10:01:22 kjcf05n02 dwd[2203]: dwd: option abrtlimit: 10 Nov 3 10:01:22 kjcf05n02 dwd[2203]: dwd: option DZPeriod: 604800 Nov 3 10:01:22 kjcf05n02 dwd[2203]: dwd: option SmartPeriod: 43200 Nov 3 10:01:22 kjcf05n02 dwd[2203]: dwd: option SDDEnabled: 1 Nov 3 10:01:22 kjcf05n02 dwd[2203]: dwd: option SDDAwaitScale: 3 Nov 3 10:01:22 kjcf05n02 dwd[2203]: dwd: option SDDAwaitMin: 100 Nov 3 10:01:22 kjcf05n02 dwd[2203]: dwd: option Verbosity: 1 Nov 3 10:01:22 kjcf05n02 dwd[2203]: dwd: option StandAlone: 0 Nov 3 10:01:22 kjcf05n02 dwd[2203]: option Lethal: 0 Nov 3 10:01:22 kjcf05n02 dwd[2203]: option Interval: 60 Nov 3 10:01:22 kjcf05n02 dwd[2203]: option abrtlimit: 10 Nov 3 10:01:22 kjcf05n02 dwd[2203]: option DZPeriod: 604800 Nov 3 10:01:22 kjcf05n02 dwd[2203]: option SmartPeriod: 43200 Nov 3 10:01:22 kjcf05n02 dwd[2203]: option SDDEnabled: 1 Nov 3 10:01:22 kjcf05n02 dwd[2203]: option SDDAwaitScale: 3 Nov 3 10:01:22 kjcf05n02 dwd[2203]: option SDDAwaitMin: 100 Nov 3 10:01:22 kjcf05n02 dwd[2203]: option Verbosity: 1 Nov 3 10:01:22 kjcf05n02 dwd[2203]: option StandAlone: 0 Nov 3 10:01:22 kjcf05n02 network[2240]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[2238]: Setting up Mellanox network interface: ib1 Nov 3 10:01:22 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 10:01:22 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 10:01:22 kjcf05n02 beSetMlxConfig[2174]: Starting MST (Mellanox Software Tools) driver set Nov 3 10:01:22 kjcf05n02 network[2275]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 10:01:22 kjcf05n02 network[2240]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:01:22 kjcf05n02 mdraid-phy[2278]: no Cutlass to worry about Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[2277]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 0 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 1 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 2 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 3 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 4 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 5 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 6 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 7 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 8 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 9 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 10 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 11 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 12 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 13 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 14 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 15 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 16 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 17 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 18 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 19 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 20 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 21 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 22 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 23 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 24 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 25 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 26 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 27 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 28 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 29 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 30 Nov 3 10:01:22 kjcf05n02 cpupower[2318]: Idlestate 2 disabled on CPU 31 Nov 3 10:01:22 kjcf05n02 chronyd[2217]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 10:01:22 kjcf05n02 chronyd[2217]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 10:01:22 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 10:01:22 kjcf05n02 beSetMlxConfig[2174]: Loading MST PCI module - Success Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 3 10:01:22 kjcf05n02 network[2314]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[2315]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 10:01:22 kjcf05n02 network[2240]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 10:01:22 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[2326]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 10:01:22 kjcf05n02 beSetMlxConfig[2174]: Loading MST PCI configuration module - Success Nov 3 10:01:22 kjcf05n02 beSetMlxConfig[2174]: Create devices Nov 3 10:01:22 kjcf05n02 network[2333]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[2340]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[2342]: No configuration found for ib0 Nov 3 10:01:22 kjcf05n02 sssd[sssd][2180]: Starting up Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[2349]: No configuration found for ib1 Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[2369]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[2386]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 10:01:22 kjcf05n02 mlnx_conf_mgr[2422]: INFO: No configurations found for mlx5_0, skipping. Nov 3 10:01:22 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 10:01:22 kjcf05n02 mlnx_conf_mgr[2449]: INFO: No configurations found for mlx5_1, skipping. Nov 3 10:01:22 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 10:01:22 kjcf05n02 sssd[be[implicit_files]][2395]: Starting up Nov 3 10:01:22 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 10:01:22 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 10:01:22 kjcf05n02 sssd[nss][2550]: Starting up Nov 3 10:01:22 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 10:01:22 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Login Service... Nov 3 10:01:22 kjcf05n02 systemd-logind[2653]: New seat seat0. Nov 3 10:01:22 kjcf05n02 systemd-logind[2653]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Login Service. Nov 3 10:01:22 kjcf05n02 python3.9[2260]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 10:01:22 kjcf05n02 python3.9[3225]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 10:01:22 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 10:01:22 kjcf05n02 systemd-sysctl[2876]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 10:01:22 kjcf05n02 systemd-sysctl[2876]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 10:01:22 kjcf05n02 python3.9[2901]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 10:01:22 kjcf05n02 python3.9[3225]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 10:01:22 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 10:01:22 kjcf05n02 network[2240]: Bringing up loopback interface: [ OK ] Nov 3 10:01:22 kjcf05n02 python3.9[3109]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 10:01:22 kjcf05n02 python3.9[3225]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 10:01:22 kjcf05n02 systemd-sysctl[3212]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 10:01:22 kjcf05n02 systemd-sysctl[3212]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 10:01:22 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 3 10:01:22 kjcf05n02 systemd[1]: Reached target Network. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 10:01:22 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 10:01:22 kjcf05n02 sm-notify[3230]: Version 2.3.3 starting Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 10:01:22 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 10:01:22 kjcf05n02 sshd[3222]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 10:01:22 kjcf05n02 beSetMlxConfig[2174]: Unloading MST PCI module (unused) - Success Nov 3 10:01:22 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 3 10:01:22 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 10:01:22 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 3 10:01:22 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 10:01:22 kjcf05n02 lldpad[3221]: setsockopt nearest_bridge: Invalid argument Nov 3 10:01:22 kjcf05n02 lldpad[3225]: Last message 'setsockopt nearest_b' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 3 10:01:22 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 3 10:01:22 kjcf05n02 python3.9[3243]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 10:01:22 kjcf05n02 python3.9[3225]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 10:01:22 kjcf05n02 syslog-ng[3225]: [2024-11-03T16:00:10.635072] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 10:01:22 kjcf05n02 syslog-ng[3225]: [2024-11-03T16:00:10.635338] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 10:01:22 kjcf05n02 syslog-ng[3225]: [2024-11-03T16:00:10.635373] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 10:01:22 kjcf05n02 syslog-ng[3225]: [2024-11-03T16:00:10.635913] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 10:01:22 kjcf05n02 syslog-ng[3225]: [2024-11-03T16:00:10.636085] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 10:01:22 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 10:01:22 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 10:01:22 kjcf05n02 python3.9[3471]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 10:01:22 kjcf05n02 python3.9[3225]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 10:01:22 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 10:01:22 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 10:01:22 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 10:01:22 kjcf05n02 chronyd[2217]: System's initial offset : 0.004268 seconds slow of true (slew) Nov 3 10:01:22 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 10:01:22 kjcf05n02 beSetMlxConfig[2174]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 10:01:22 kjcf05n02 beSetMlxConfig[2174]: ib mode Nov 3 10:01:22 kjcf05n02 root[3492]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 3 10:01:22 kjcf05n02 root[3494]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 3 10:01:22 kjcf05n02 beSetMlxConfig[2174]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 10:01:22 kjcf05n02 beSetMlxConfig[2174]: ib mode Nov 3 10:01:22 kjcf05n02 systemd-udevd[1579]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 10:01:22 kjcf05n02 systemd-udevd[3510]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:01:22 kjcf05n02 systemd-udevd[3511]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:01:22 kjcf05n02 systemd-udevd[3514]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:01:22 kjcf05n02 systemd-udevd[3515]: Using default interface naming scheme 'rhel-8.0'. Nov 3 10:01:22 kjcf05n02 systemd-udevd[3515]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:01:22 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 10:01:22 kjcf05n02 systemd[3225]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:22 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[3552]: Setting up Mellanox network interface: ib0 Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[3553]: Setting up Mellanox network interface: ib1 Nov 3 10:01:22 kjcf05n02 systemd-udevd[3513]: Using default interface naming scheme 'rhel-8.0'. Nov 3 10:01:22 kjcf05n02 systemd-udevd[3512]: Using default interface naming scheme 'rhel-8.0'. Nov 3 10:01:22 kjcf05n02 systemd-udevd[3513]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:01:22 kjcf05n02 systemd-udevd[3512]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[3602]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[3603]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[3634]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[3633]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[3635]: No configuration found for ib1 Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[3636]: No configuration found for ib0 Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[3644]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[3643]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 10:01:22 kjcf05n02 mlnx_conf_mgr[3684]: INFO: No configurations found for mlx5_1, skipping. Nov 3 10:01:22 kjcf05n02 mlnx_conf_mgr[3683]: INFO: No configurations found for mlx5_0, skipping. Nov 3 10:01:22 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 10:01:22 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 10:01:22 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 3 10:01:22 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 3 10:01:22 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 10:01:22 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 3 10:01:22 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 3 10:01:22 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 10:01:22 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 10:01:22 kjcf05n02 lldpad[3221]: init_ports: Error adding device ib0 Nov 3 10:01:22 kjcf05n02 lldpad[3221]: init_ports: Error adding device ib1 Nov 3 10:01:22 kjcf05n02 lldpad[3221]: Signal 15 received - terminating Nov 3 10:01:22 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 3 10:01:22 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 10:01:22 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 10:01:22 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 3 10:01:22 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 10:01:22 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 3 10:01:22 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 3 10:01:22 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:22 kjcf05n02 systemd[3225]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:22 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 1 | Nov-03-2024 | 15:00:23 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 2 | Nov-03-2024 | 15:01:15 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 3 | Nov-03-2024 | 15:01:16 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 4 | Nov-03-2024 | 15:02:21 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 5 | Nov-03-2024 | 15:02:22 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 6 | Nov-03-2024 | 15:57:30 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 7 | Nov-03-2024 | 15:57:30 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 8 | Nov-03-2024 | 15:57:30 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 9 | Nov-03-2024 | 15:57:30 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 10 | Nov-03-2024 | 15:57:30 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 11 | Nov-03-2024 | 15:57:30 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 12 | Nov-03-2024 | 15:57:30 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 13 | Nov-03-2024 | 15:57:30 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 14 | Nov-03-2024 | 15:57:30 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 15 | Nov-03-2024 | 15:57:30 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 16 | Nov-03-2024 | 15:57:30 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 17 | Nov-03-2024 | 15:57:30 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 18 | Nov-03-2024 | 15:58:00 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 19 | Nov-03-2024 | 15:58:00 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 20 | Nov-03-2024 | 15:58:00 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 21 | Nov-03-2024 | 15:58:00 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 22 | Nov-03-2024 | 15:58:00 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 23 | Nov-03-2024 | 15:58:00 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 24 | Nov-03-2024 | 15:58:00 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 25 | Nov-03-2024 | 15:58:00 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 26 | Nov-03-2024 | 15:58:00 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 27 | Nov-03-2024 | 15:58:00 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 28 | Nov-03-2024 | 15:58:00 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 10:01:22 kjcf05n02 ipmievd[4026]: 29 | Nov-03-2024 | 15:58:00 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 10:01:22 kjcf05n02 ipmievd[4029]: Reading sensors... Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 3 10:01:22 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:22 kjcf05n02 systemd[3225]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 10:01:22 kjcf05n02 nscd[2156]: 2156 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 10:01:22 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 10:01:22 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 3 10:01:22 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 10:01:22 kjcf05n02 beSetMlxConfig[4087]: ConnectX-3 multiport not detected Nov 3 10:01:22 kjcf05n02 beSetMlxConfig[4087]: Starting MST (Mellanox Software Tools) driver set Nov 3 10:01:22 kjcf05n02 beSetMlxConfig[4087]: Loading MST PCI module - Success Nov 3 10:01:22 kjcf05n02 systemd-udevd[1579]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 10:01:22 kjcf05n02 beSetMlxConfig[4087]: [warn] mst_pciconf is already loaded, skipping Nov 3 10:01:22 kjcf05n02 beSetMlxConfig[4087]: Create devices Nov 3 10:01:22 kjcf05n02 beSetMlxConfig[4087]: Unloading MST PCI module (unused) - Success Nov 3 10:01:22 kjcf05n02 ipmievd[4029]: Waiting for events... Nov 3 10:01:22 kjcf05n02 beSetMlxConfig[4087]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 10:01:22 kjcf05n02 beSetMlxConfig[4087]: ib mode Nov 3 10:01:22 kjcf05n02 beSetMlxConfig[4087]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 10:01:22 kjcf05n02 beSetMlxConfig[4087]: ib mode Nov 3 10:01:22 kjcf05n02 systemd-udevd[1579]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 10:01:22 kjcf05n02 systemd-udevd[5001]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:01:22 kjcf05n02 systemd-udevd[5002]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:01:22 kjcf05n02 systemd-udevd[5005]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:01:22 kjcf05n02 systemd-udevd[5007]: Using default interface naming scheme 'rhel-8.0'. Nov 3 10:01:22 kjcf05n02 systemd-udevd[5007]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:01:22 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 10:01:22 kjcf05n02 systemd[3225]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:22 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[5043]: Setting up Mellanox network interface: ib0 Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[5044]: Setting up Mellanox network interface: ib1 Nov 3 10:01:22 kjcf05n02 systemd-udevd[5003]: Using default interface naming scheme 'rhel-8.0'. Nov 3 10:01:22 kjcf05n02 systemd-udevd[5003]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:01:22 kjcf05n02 systemd-udevd[5004]: Using default interface naming scheme 'rhel-8.0'. Nov 3 10:01:22 kjcf05n02 systemd-udevd[5004]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[5093]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[5094]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[5123]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[5125]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[5126]: No configuration found for ib0 Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[5127]: No configuration found for ib1 Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[5134]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 10:01:22 kjcf05n02 mlnx_interface_mgr[5135]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 10:01:22 kjcf05n02 mlnx_conf_mgr[5174]: INFO: No configurations found for mlx5_0, skipping. Nov 3 10:01:22 kjcf05n02 mlnx_conf_mgr[5175]: INFO: No configurations found for mlx5_1, skipping. Nov 3 10:01:22 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 10:01:22 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}4da9bfef537b50547283987d5306103df3359447ab46ab26c176be756f49fb58' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}4da9bfef537b50547283987d5306103df3359447ab46ab26c176be756f49fb58' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}96de2f5a0b64bbac5df867fb9c1332a375e801f6ff1da1ef0ea5594f62d76672' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}96de2f5a0b64bbac5df867fb9c1332a375e801f6ff1da1ef0ea5594f62d76672' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}2cdd20bc243a9c40292d98bff0be060e22ab178915cd55a6f2b6916c45140bd8' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}2cdd20bc243a9c40292d98bff0be060e22ab178915cd55a6f2b6916c45140bd8' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}de2b517de77ddc59acac0a87a502b37490d64556afc96ac6bef1d56f5aec19cb' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}de2b517de77ddc59acac0a87a502b37490d64556afc96ac6bef1d56f5aec19cb' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 10:01:22 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 3 10:01:22 kjcf05n02 chronyd[2217]: chronyd exiting Nov 3 10:01:22 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 3 10:01:22 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 10:01:22 kjcf05n02 chronyd[5209]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 10:01:22 kjcf05n02 chronyd[5209]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 10:01:22 kjcf05n02 chronyd[5209]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 10:01:22 kjcf05n02 chronyd[5209]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 10:01:22 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 10:01:22 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:22 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 10:01:22 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 3 10:01:22 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 10:01:22 kjcf05n02 dwd[5240]: dwd: vMay 29 2024 : 15:38:26 Nov 3 10:01:22 kjcf05n02 dwd[5240]: /usr/sbin/dwd -i 15 -d Nov 3 10:01:22 kjcf05n02 dwd[5240]: dwd: option Lethal: 0 Nov 3 10:01:22 kjcf05n02 dwd[5240]: dwd: option Interval: 15 Nov 3 10:01:22 kjcf05n02 dwd[5240]: dwd: option abrtlimit: 10 Nov 3 10:01:22 kjcf05n02 dwd[5240]: dwd: option DZPeriod: 604800 Nov 3 10:01:22 kjcf05n02 dwd[5240]: dwd: option SmartPeriod: 43200 Nov 3 10:01:22 kjcf05n02 dwd[5240]: dwd: option SDDEnabled: 1 Nov 3 10:01:22 kjcf05n02 dwd[5240]: dwd: option SDDAwaitScale: 3 Nov 3 10:01:22 kjcf05n02 dwd[5240]: dwd: option SDDAwaitMin: 100 Nov 3 10:01:22 kjcf05n02 dwd[5240]: dwd: option Verbosity: 1 Nov 3 10:01:22 kjcf05n02 dwd[5240]: dwd: option StandAlone: 0 Nov 3 10:01:22 kjcf05n02 dwd[5240]: option Lethal: 0 Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 10:01:22 kjcf05n02 dwd[5240]: option Interval: 15 Nov 3 10:01:22 kjcf05n02 dwd[5240]: option abrtlimit: 10 Nov 3 10:01:22 kjcf05n02 dwd[5240]: option DZPeriod: 604800 Nov 3 10:01:22 kjcf05n02 dwd[5240]: option SmartPeriod: 43200 Nov 3 10:01:22 kjcf05n02 dwd[5240]: option SDDEnabled: 1 Nov 3 10:01:22 kjcf05n02 dwd[5240]: option SDDAwaitScale: 3 Nov 3 10:01:22 kjcf05n02 dwd[5240]: option SDDAwaitMin: 100 Nov 3 10:01:22 kjcf05n02 dwd[5240]: option Verbosity: 1 Nov 3 10:01:22 kjcf05n02 dwd[5240]: option StandAlone: 0 Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 10:01:22 kjcf05n02 dwd[5242]: option Lethal now set to 1 Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 10:01:22 kjcf05n02 dwd[5242]: option abrtlimit now set to 1 Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 10:01:22 kjcf05n02 dwd[5242]: option SmartPeriod now set to 86400 Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 10:01:22 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 10:01:22 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:22 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:22 kjcf05n02 python3.9[5271]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 10:01:22 kjcf05n02 python3.9[3225]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 10:01:22 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:22 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 10:01:22 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:22 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 3 10:01:22 kjcf05n02 sedcpwrkr[5410]: Using config script: /etc/sedcpwrkr.conf Nov 3 10:01:22 kjcf05n02 sedcpwrkr[5410]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 10:01:22 kjcf05n02 sedcpwrkr[5410]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 10:01:22 kjcf05n02 sedcpwrkr[5410]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 10:01:22 kjcf05n02 sedcpwrkr[5410]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 10:01:22 kjcf05n02 sedcpwrkr[5410]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 10:01:22 kjcf05n02 sedcpwrkr[5410]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 10:01:22 kjcf05n02 sedcpwrkr-server[5441]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 10:01:22 kjcf05n02 sedcpwrkr[5410]: celery multi v5.2.7 (dawn-chorus) Nov 3 10:01:22 kjcf05n02 sedcpwrkr[5410]: > Starting nodes... Nov 3 10:01:22 kjcf05n02 sedcpwrkr[5410]: > sedcpwrkr@kjcf05n02: OK Nov 3 10:01:22 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 10:01:22 kjcf05n02 sedcpwrkr-server[5443]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 10:01:22 kjcf05n02 sedcpwrkr-server[5443]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 10:01:22 kjcf05n02 sedcpwrkr-server[5443]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 10:01:22 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 10:01:22 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 3 10:01:22 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 10:01:22 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 10:01:22 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 10:01:23 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:23 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 10:01:23 kjcf05n02 systemd-udevd[1579]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 10:01:23 kjcf05n02 iptables.init[5510]: iptables: Applying firewall rules: [ OK ] Nov 3 10:01:23 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 3 10:01:23 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:24 kjcf05n02 systemd[3225]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 10:01:24 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 10:01:24 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 10:01:24 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:25 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 10:01:25 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5608 which is not our child. We'll most likely not notice when it exits. Nov 3 10:01:25 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 10:01:25 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:25 kjcf05n02 openhpid[5608]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 10:01:25 kjcf05n02 openhpid[5608]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 10:01:25 kjcf05n02 openhpid[5608]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 10:01:25 kjcf05n02 openhpid[5608]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 10:01:25 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:25 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:25 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:25 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 10:01:25 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 10:01:25 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 10:01:25 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 10:01:25 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:25 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 10:01:26 kjcf05n02 dcs-collectord[5699]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 10:01:26 kjcf05n02 hpi.inv.log[5699]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 10:01:26 kjcf05n02 dcs-collectord[5699]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 10:01:26 kjcf05n02 dcs-collectord[5699]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 10:01:26 kjcf05n02 dcs-collector[5690]: Starting dcs-collector:[ OK ] Nov 3 10:01:26 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 10:01:26 kjcf05n02 dcs-collectord[5702]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 10:01:26 kjcf05n02 dcs-collectord[5702]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 10:01:26 kjcf05n02 dcs-collectord[5702]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 10:01:26 kjcf05n02 dcs-collectord[5702]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 10:01:26 kjcf05n02 dcs-collectord[5702]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 10:01:26 kjcf05n02 dcs-collectord[5702]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 10:01:26 kjcf05n02 dcs-collectord[5702]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 10:01:26 kjcf05n02 dcs-collectord[5702]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259342352", "units": "kB"}, {"name": "MemAvailable", "value": "258622156", "units": "kB"}, {"name": "Buffers", "value": "84336", "units": "kB"}, {"name": "Cached", "value": "1821336", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1687776", "units": "kB"}, {"name": "Inactive", "value": "964732", "units": "kB"}, {"name": "Active(anon)", "value": "1520944", "units": "kB"}, {"name": "Inactive(anon)", "value": "829104", "units": "kB"}, {"name": "Active(file)", "value": "166832", "units": "kB"}, {"name": "Inactive(file)", "value": "135628", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "755372", "units": "kB"}, {"name": "Mapped", "value": "85968", "units": "kB"}, {"name": "Shmem", "value": "1593400", "units": "kB"}, {"name": "KReclaimable", "value": "109304", "units": "kB"}, {"name": "Slab", "value": "276800", "units": "kB"}, {"name": "SReclaimable", "value": "109304", "units": "kB"}, {"name": "SUnreclaim", "value": "167496", "units": "kB"}, {"name": "KernelStack", "value": "9792", "units": "kB"}, {"name": "PageTables", "value": "19448", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3182824", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11392", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "4096", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "293192", "units": "kB"}, {"name": "DirectMap2M", "value": "22640640", "units": "kB"}, {"name": "DirectMap1G", "value": "245366784", "units": "kB"}]}' Nov 3 10:01:26 kjcf05n02 dcs-collectord[5702]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 10:01:26 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 10:01:26 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:26 kjcf05n02 dcs-collectord[5702]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 10:01:26 kjcf05n02 dcs-collectord[5702]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730649686.138379], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730649686.3749518], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730649686.0711975, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 10:01:26 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:26 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 10:01:26 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:26 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:26 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 10:01:26 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 10:01:26 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 10:01:26 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 10:01:27 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:27 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 10:01:27 kjcf05n02 firmware-update-orc[5808]: Using config script: /etc/firmware_update_orc.conf Nov 3 10:01:27 kjcf05n02 firmware-update-orc[5808]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 10:01:27 kjcf05n02 firmware-update-orc[5808]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 10:01:27 kjcf05n02 firmware-update-orc[5808]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 10:01:27 kjcf05n02 firmware-update-orc[5808]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 10:01:27 kjcf05n02 firmware-update-orc[5808]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 10:01:27 kjcf05n02 firmware-update-orc[5808]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 10:01:27 kjcf05n02 firmware-update-orc-server[5844]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 10:01:27 kjcf05n02 firmware-update-orc[5808]: celery multi v5.2.7 (dawn-chorus) Nov 3 10:01:27 kjcf05n02 firmware-update-orc[5808]: > Starting nodes... Nov 3 10:01:27 kjcf05n02 firmware-update-orc[5808]: > worker1@kjcf05n02: OK Nov 3 10:01:27 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 10:01:27 kjcf05n02 firmware-update-orc-server[5848]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 10:01:27 kjcf05n02 firmware-update-orc-server[5848]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 10:01:27 kjcf05n02 firmware-update-orc-server[5848]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 10:01:27 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 10:01:27 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:28 kjcf05n02 systemd[3225]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:28 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:28 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:28 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 10:01:28 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 10:01:28 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 10:01:28 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 10:01:28 kjcf05n02 dbus-daemon[2171]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 10:01:28 kjcf05n02 dbus-daemon[2171]: [system] Reloaded configuration Nov 3 10:01:28 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 10:01:28 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 10:01:28 kjcf05n02 dbus-daemon[2171]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 10:01:28 kjcf05n02 dbus-daemon[2171]: [system] Reloaded configuration Nov 3 10:01:28 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 10:01:28 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 10:01:28 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 10:01:28 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 10:01:28 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:28 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 3 10:01:29 kjcf05n02 ras-resource-manager-agent[5964]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 10:01:29 kjcf05n02 ras-resource-manager-agent[5950]: Starting ras-resource-manager-agent:[ OK ] Nov 3 10:01:29 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 10:01:29 kjcf05n02 ras-resource-manager-agent[5966]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 10:01:29 kjcf05n02 ras-resource-manager-client[5966]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 10:01:29 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 3 10:01:29 kjcf05n02 ras-resource-manager-client[5966]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 10:01:29 kjcf05n02 ras-resource-manager-client[5976]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 10:01:29 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:29 kjcf05n02 systemd[3225]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:29 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:29 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:29 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 10:01:29 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 10:01:29 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:29 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 10:01:29 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:30 kjcf05n02 systemd[3225]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: Press Ctrl+C to exit. Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: Plugin support version 1.0 Nov 3 10:01:30 kjcf05n02 zabbix_agent2[6050]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 10:01:30 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:30 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:30 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:30 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 10:01:30 kjcf05n02 dcs-notification-sender[6127]: dcs-notification-senderd is stopped Nov 3 10:01:30 kjcf05n02 zabbix-agent2[6141]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 10:01:30 kjcf05n02 dcs-notification-sender[6127]: Starting notification-sender:[ OK ] Nov 3 10:01:30 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 10:01:30 kjcf05n02 zabbix-agent2[6143]: INFO DCS notification agent started. (agent.py:61) Nov 3 10:01:30 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 10:01:30 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:31 kjcf05n02 systemd[3225]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:31 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:31 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:31 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:31 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 10:01:31 kjcf05n02 dcs-collectord[6248]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 10:01:31 kjcf05n02 dcs-collectord[6248]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 10:01:31 kjcf05n02 dcs-bulk-data-sender[6248]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 10:01:31 kjcf05n02 dcs-bulk-data-sender[6239]: Starting bulk-data-sender:[ OK ] Nov 3 10:01:31 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 10:01:31 kjcf05n02 dcs-collectord[6250]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 10:01:31 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 10:01:31 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:32 kjcf05n02 systemd[3225]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:32 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:32 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:32 kjcf05n02 nscd[2156]: 2156 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 10:01:32 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 10:01:32 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 10:01:32 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 10:01:32 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 10:01:32 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 10:01:32 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 10:01:32 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 10:01:32 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 10:01:32 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 10:01:32 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 10:01:32 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 10:01:32 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 10:01:32 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 10:01:32 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 10:01:32 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 10:01:32 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 10:01:33 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 3 10:01:33 kjcf05n02 sssd[nss][2550]: Shutting down (status = 0) Nov 3 10:01:33 kjcf05n02 sssd[be[implicit_files]][2395]: Shutting down (status = 0) Nov 3 10:01:33 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 3 10:01:33 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 3 10:01:33 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 10:01:33 kjcf05n02 sssd[sssd][6337]: Starting up Nov 3 10:01:33 kjcf05n02 sssd[be[implicit_files]][6338]: Starting up Nov 3 10:01:33 kjcf05n02 python3.9[5271]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 10:01:33 kjcf05n02 python3.9[3225]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:33 kjcf05n02 sssd[nss][6339]: Starting up Nov 3 10:01:33 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 10:01:33 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 10:01:33 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 10:01:34 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 10:01:34 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 10:01:34 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 10:01:34 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 10:01:34 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 10:01:34 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 10:01:34 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 10:01:34 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 10:01:34 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 10:01:34 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 10:01:34 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 10:01:34 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 10:01:34 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 10:01:34 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 10:01:34 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:01:34 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:01:34 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:34 kjcf05n00 mcfcli[3673891]: %3|1730649694.382|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 10:01:35 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 10:01:35 kjcf05n02 icinga2[6384]: [2024-11-03 10:01:35 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 10:01:35 kjcf05n02 icinga2[6384]: [2024-11-03 10:01:35 -0600] information/cli: Loading configuration file(s). Nov 3 10:01:35 kjcf05n02 icinga2[6384]: [2024-11-03 10:01:35 -0600] information/ConfigItem: Committing config item(s). Nov 3 10:01:35 kjcf05n02 icinga2[6384]: [2024-11-03 10:01:35 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 3 10:01:35 kjcf05n02 icinga2[6384]: [2024-11-03 10:01:35 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 10:01:35 kjcf05n02 icinga2[6384]: [2024-11-03 10:01:35 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 10:01:35 kjcf05n02 icinga2[6384]: [2024-11-03 10:01:35 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 10:01:35 kjcf05n02 icinga2[6384]: [2024-11-03 10:01:35 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 10:01:35 kjcf05n02 icinga2[6384]: [2024-11-03 10:01:35 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 10:01:35 kjcf05n02 icinga2[6384]: [2024-11-03 10:01:35 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 10:01:35 kjcf05n02 icinga2[6384]: [2024-11-03 10:01:35 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 10:01:35 kjcf05n02 icinga2[6384]: [2024-11-03 10:01:35 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 10:01:35 kjcf05n02 icinga2[6384]: [2024-11-03 10:01:35 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 10:01:35 kjcf05n02 icinga2[6384]: [2024-11-03 10:01:35 -0600] information/cli: Closing console log. Nov 3 10:01:35 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 10:01:35 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:35 kjcf05n02 systemd[3225]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:35 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:35 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:36 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 10:01:36 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 10:01:36 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:36 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 3 10:01:36 kjcf05n00 mcfcli[3673891]: %3|1730649696.171|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:01:36 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:36 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 10:01:36 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:36 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:37 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 10:01:37 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 10:01:37 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 10:01:37 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 10:01:37 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 10:01:37 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 10:01:37 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 10:01:37 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 10:01:37 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 10:01:37 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 10:01:37 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 10:01:37 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 10:01:37 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 10:01:37 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 10:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 10:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 10:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 10:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 10:01:37 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:37 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 10:01:37 kjcf05n02 nslcd[6994]: version 0.9.9 starting Nov 3 10:01:37 kjcf05n02 nslcd[6994]: accepting connections Nov 3 10:01:37 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 10:01:37 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:38 kjcf05n02 systemd[3225]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:38 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:38 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:38 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 10:01:38 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 10:01:38 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 10:01:38 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 10:01:39 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 10:01:39 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 10:01:39 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 10:01:39 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 10:01:39 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:39 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 10:01:39 kjcf05n02 dearcpw[7090]: Using config script: /etc/dearcpw.conf Nov 3 10:01:39 kjcf05n02 dearcpw[7090]: - Creating default directory: '/var/log/dearcpw' Nov 3 10:01:39 kjcf05n02 dearcpw[7090]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 10:01:39 kjcf05n02 dearcpw[7090]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 10:01:39 kjcf05n02 dearcpw[7090]: - Creating default directory: '/var/run/dearcpw' Nov 3 10:01:39 kjcf05n02 dearcpw[7090]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 10:01:39 kjcf05n02 dearcpw[7090]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 10:01:40 kjcf05n02 dearcpw-server[7130]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 10:01:40 kjcf05n02 dearcpw[7090]: celery multi v5.2.7 (dawn-chorus) Nov 3 10:01:40 kjcf05n02 dearcpw[7090]: > Starting nodes... Nov 3 10:01:40 kjcf05n02 dearcpw[7090]: > dearcpw@kjcf05n02: OK Nov 3 10:01:40 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 10:01:40 kjcf05n02 dcs-bulk-data-sender[6250]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 10:01:40 kjcf05n02 dcs-collectord[6250]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 10:01:40 kjcf05n02 dearcpw-server[7132]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 10:01:40 kjcf05n02 dearcpw-server[7132]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 10:01:40 kjcf05n02 dearcpw-server[7132]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 10:01:40 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 3 10:01:40 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:40 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:40 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 10:01:40 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 10:01:40 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 10:01:40 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 10:01:40 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 10:01:40 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 10:01:40 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 10:01:40 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 10:01:40 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 10:01:40 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 10:01:40 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:38914). Nov 3 10:01:40 kjcf05n01 rsyncd[3030505]: connect from kjcf05n02 (172.16.2.5) Nov 3 10:01:40 kjcf05n01 rsyncd[3030505]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 10:01:40 kjcf05n01 rsyncd[3030505]: receiving file list Nov 3 10:01:40 kjcf05n01 rsyncd[3030505]: sent 29 bytes received 333 bytes total size 10905 Nov 3 10:01:40 kjcf05n01 systemd[1]: rsyncd@618-172.16.2.2:873-172.16.2.5:38914.service: Succeeded. Nov 3 10:01:40 kjcf05n02 puppet[7173]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 3 10:01:40 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 10:01:40 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 10:01:40 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 10:01:40 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 10:01:40 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 10:01:40 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 10:01:40 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 10:01:40 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 10:01:41 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 10:01:41 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 10:01:41 kjcf05n02 dcs-collectord[5702]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 10:01:41 kjcf05n02 dcs-collectord[5702]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 10:01:41 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 10:01:41 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 10:01:41 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 10:01:41 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 10:01:42 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 10:01:42 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 10:01:42 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 10:01:42 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 10:01:43 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 10:01:43 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 10:01:43 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 10:01:43 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 10:01:43 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 10:01:43 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 10:01:43 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:43 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 10:01:44 kjcf05n02 diskless-swap[7263]: HA_PS_000: recovering journal Nov 3 10:01:44 kjcf05n02 systemd-udevd[1579]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 10:01:44 kjcf05n02 diskless-swap[7263]: HA_PS_000: clean, 2281/6400 files, 7071/25600 blocks Nov 3 10:01:44 kjcf05n02 diskless-swap[7263]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 10:01:44 kjcf05n02 diskless-swap[7263]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 10:01:44 kjcf05n02 diskless-swap[7263]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 10:01:44 kjcf05n02 diskless-swap[7263]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 10:01:44 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 10:01:44 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:44 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:44 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 10:01:44 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 10:01:44 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 10:01:44 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 10:01:44 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 3 10:01:44 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 3 10:01:44 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 3 10:01:44 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 3 10:01:44 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 3 10:01:44 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 10:01:44 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 10:01:44 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 10:01:44 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 10:01:44 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 10:01:44 kjcf05n02 ipmievd[4029]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 10:01:44 kjcf05n02 ipmievd[4029]: System Event sensor - Timestamp Clock Sync Nov 3 10:01:44 kjcf05n02 ipmievd[3225]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:44 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 10:01:44 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 10:01:45 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 10:01:45 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 10:01:45 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 10:01:45 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 10:01:45 kjcf05n00 zabbix-server[1161270]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 10:01:45 kjcf05n00 zabbix-server[1161270]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 154.39\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 128.65\\"}}"' Nov 3 10:01:45 kjcf05n00 log_interesting_event.py[1161270]: Event '46082' acknowledged Nov 3 10:01:46 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 10:01:46 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 10:01:46 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 10:01:46 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 10:01:46 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 10:01:46 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 10:01:46 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 10:01:46 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 10:01:47 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 10:01:47 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 10:01:47 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 10:01:47 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 10:01:47 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:48 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 3 10:01:48 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:48 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:48 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 10:01:48 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 10:01:48 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:48 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 3 10:01:48 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:48 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:48 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 10:01:48 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 10:01:48 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:48 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 3 10:01:48 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:01:48 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:01:48 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 10:01:48 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 10:01:48 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 10:01:48 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 10:01:48 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 10:01:48 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 10:01:48 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 10:01:48 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 10:01:48 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 10:01:48 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 10:01:48 kjcf05n02 systemd[1]: Reloading. Nov 3 10:01:49 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: kdump: No kdump initial ramdisk found. Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 10:01:49 kjcf05n02 dracut[8014]: dracut-049-135.git20210121.el8 Nov 3 10:01:49 kjcf05n02 dracut[8016]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 10:01:49 kjcf05n02 dracut[8016]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 10:01:49 kjcf05n02 dracut[8016]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 10:01:49 kjcf05n02 dracut[8016]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 10:01:49 kjcf05n02 dracut[8016]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 10:01:49 kjcf05n02 dracut[8016]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 10:01:49 kjcf05n02 dracut[8016]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 10:01:49 kjcf05n02 dracut[8016]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + is_func check Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ type -t check Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + '[' 0 -ne 0 ']' Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + check -h Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + local dev holder Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + require_binaries mdadm expr Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + local _module_name=90hperaid Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + local _ret=0 Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ mdadm = \-\m ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + for cmd in "$@" Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + find_binary mdadm Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + for cmd in "$@" Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + find_binary expr Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + return 0 Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ -n -h ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + for dev in "${!host_fs_types[@]}" Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ nfs != *_raid_member ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + continue Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + return 255 Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + _ret=255 Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + hostonly=-h Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + return 255 Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + ret=255 Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ 255 = 0 ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ 255 = 255 ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ module_depends hperaid Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: +++ read a b Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ local _ret Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ unset check depends cmdline install installkernel Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: +++ set -x Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ depends Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ echo rootfs-block Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ return 0 Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ _ret=0 Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ unset check depends cmdline install installkernel Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ return 0 Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + for _moddep in $(module_depends $_mod) Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ all == *\ hperaid\ * ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + add_dracutmodules+=' rootfs-block ' Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ == *\ hperaid\ * ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + check_module rootfs-block Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + local _mod=rootfs-block Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + local _moddep Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ == *\ rootfs-block\ * ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ -n '' ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ all == *\ rootfs-block\ * ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + module_check rootfs-block 0 Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + local _forced=0 Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + local _hostonly=-h Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + '[' 2 -eq 2 ']' Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + _forced=0 Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + is_func check Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ type -t check Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + '[' 0 -ne 0 ']' Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + check -h Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + return 0 Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + _ret=0 Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + hostonly=-h Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + return 0 Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + ret=0 Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ 0 = 0 ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ module_depends rootfs-block Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: +++ read a b Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 10:01:49 kjcf05n02 kdumpctl[3225]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ local _ret Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ unset check depends cmdline install installkernel Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ depends Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ echo fs-lib Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ _ret=0 Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ unset check depends cmdline install installkernel Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ return 0 Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + for _moddep in $(module_depends $_mod) Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ all == *\ rootfs-block\ * ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + add_dracutmodules+=' fs-lib ' Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ == *\ rootfs-block\ * ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + check_module fs-lib Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + local _mod=fs-lib Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + local _moddep Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ -n '' ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + mods_checked_as_dep+=' fs-lib ' Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + [[ all == *\ fs-lib\ * ]] Nov 3 10:01:49 kjcf05n02 kdumpctl[7902]: + module_check fs-lib 0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 10:01:50 kjcf05n02 kdumpctl[3225]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _forced=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _hostonly=-h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 2 -eq 2 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _forced=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + is_func check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ type -t check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 0 -ne 0 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + check -h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _ret=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + hostonly=-h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + ret=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ 0 = 0 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ module_depends fs-lib Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: +++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ depends Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ return 0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ _ret=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ return 0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + mods_to_load+=' fs-lib ' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + mods_to_load+=' rootfs-block ' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + mods_to_load+=' hperaid ' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _mod=90kernel-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _mod=kernel-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + check_module kernel-modules 1 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _mod=kernel-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddep Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n 1 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ all = all ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + module_check kernel-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _forced=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _hostonly=-h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 1 -eq 2 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + is_func check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ type -t check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 0 -ne 0 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + check -h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + true Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _ret=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + hostonly=-h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + ret=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ 0 != 0 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ module_depends kernel-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: +++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ depends Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ true Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ _ret=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ return 0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + mods_to_load+=' kernel-modules ' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _mod=90kernel-modules-extra Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _mod=kernel-modules-extra Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + check_module kernel-modules-extra 1 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _mod=kernel-modules-extra Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddep Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n 1 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ all = all ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + module_check kernel-modules-extra Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _forced=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _hostonly=-h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 1 -eq 2 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + is_func check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ type -t check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 0 -ne 0 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + check -h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + true Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _ret=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + hostonly=-h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + ret=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ 0 != 0 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ module_depends kernel-modules-extra Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: +++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ depends Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ true Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ _ret=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ return 0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + mods_to_load+=' kernel-modules-extra ' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _mod=90kernel-network-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _mod=kernel-network-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + check_module kernel-network-modules 1 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _mod=kernel-network-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddep Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n 1 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ all = all ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + module_check kernel-network-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _forced=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _hostonly=-h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 1 -eq 2 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + is_func check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ type -t check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 0 -ne 0 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + check -h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _ret=255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + hostonly=-h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + ret=255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ 255 != 0 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n 1 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 1 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _mod=90livenet Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _mod=livenet Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + check_module livenet 1 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _mod=livenet Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddep Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n 1 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ all = all ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + module_check livenet Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _forced=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _hostonly=-h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 1 -eq 2 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + is_func check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ type -t check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 0 -ne 0 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + check -h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _ret=255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + hostonly=-h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + ret=255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ 255 != 0 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n 1 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 1 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _mod=90lvm Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _mod=lvm Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + check_module lvm 1 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _mod=lvm Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddep Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n 1 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ all = all ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + module_check lvm Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _forced=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _hostonly=-h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 1 -eq 2 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + is_func check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ type -t check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 0 -ne 0 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + check -h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + require_binaries lvm Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _module_name=90lvm Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ lvm = \-\m ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + for cmd in "$@" Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + find_binary lvm Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n -h ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + for fs in "${host_fs_types[@]}" Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ nfs = LVM*_member ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _ret=255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + hostonly=-h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + ret=255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ 255 != 0 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n 1 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 1 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _mod=90mdraid Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _mod=mdraid Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + check_module mdraid 1 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _mod=mdraid Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddep Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n 1 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ all = all ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + module_check mdraid Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _forced=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _hostonly=-h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 1 -eq 2 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + is_func check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ type -t check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 0 -ne 0 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + check -h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _rootdev Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + require_binaries mdadm expr Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _module_name=90mdraid Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ mdadm = \-\m ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + for cmd in "$@" Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + find_binary mdadm Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + for cmd in "$@" Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + find_binary expr Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n -h ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + for dev in "${!host_fs_types[@]}" Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ nfs != *_raid_member ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + continue Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _ret=255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + hostonly=-h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + ret=255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ 255 != 0 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n 1 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 1 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _mod=90multipath Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _mod=multipath Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + check_module multipath 1 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _mod=multipath Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddep Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n 1 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ all = all ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + module_check multipath Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _forced=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _hostonly=-h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 1 -eq 2 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + is_func check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ type -t check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 0 -ne 0 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + check -h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _rootdev Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n -h ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + for_each_host_dev_and_slaves is_mpath Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _func=is_mpath Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _dev Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + for _dev in "${host_devs[@]}" Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + continue Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 1 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _ret=255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + hostonly=-h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + ret=255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ 255 != 0 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n 1 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 1 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _mod=90qemu Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _mod=qemu Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + check_module qemu 1 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _mod=qemu Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddep Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n 1 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ all = all ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + module_check qemu Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _forced=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _hostonly=-h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 1 -eq 2 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + is_func check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ type -t check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 0 -ne 0 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + check -h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n -h ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + type -P systemd-detect-virt Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ systemd-detect-virt --vm Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + vm=none Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + (( 1 != 0 )) Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _ret=255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + hostonly=-h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + ret=255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ 255 != 0 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n 1 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 1 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _mod=90qemu-net Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _mod=qemu-net Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + check_module qemu-net 1 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _mod=qemu-net Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddep Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n 1 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ all = all ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + module_check qemu-net Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _forced=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _hostonly=-h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 1 -eq 2 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + is_func check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ type -t check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 0 -ne 0 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + check -h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n -h ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + type -P systemd-detect-virt Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ systemd-detect-virt --vm Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + vm= Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + (( 1 != 0 )) Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _ret=255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + hostonly=-h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + ret=255 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ 255 != 0 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n 1 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + return 1 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _mod=90stratis Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + _mod=stratis Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + check_module stratis 1 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _mod=stratis Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddep Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -n 1 ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ all = all ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + module_check stratis Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ read a b Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _forced=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _hostonly=-h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 1 -eq 2 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + is_func check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: ++ type -t check Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + '[' 0 -ne 0 ']' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + check -h Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _module_name=90stratis Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + local _ret=0 Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + [[ stratisd-init = \-\m ]] Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + for cmd in "$@" Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + find_binary stratisd-init Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 10:01:50 kjcf05n02 kdumpctl[7902]: + set +x Nov 3 10:01:50 kjcf05n02 dracut[8016]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 10:01:50 kjcf05n02 dracut[8016]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 10:01:50 kjcf05n02 dracut[8016]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 10:01:50 kjcf05n02 dracut[8016]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 10:01:50 kjcf05n02 dracut[8016]: memstrack is available Nov 3 10:01:50 kjcf05n02 dracut[8016]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 10:01:50 kjcf05n02 dracut[8016]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 10:01:50 kjcf05n02 dracut[8016]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 10:01:50 kjcf05n02 dracut[8016]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 10:01:50 kjcf05n02 dracut[8016]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 10:01:50 kjcf05n02 dracut[8016]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 10:01:50 kjcf05n02 dracut[8016]: *** Including module: bash *** Nov 3 10:01:50 kjcf05n02 dracut[8016]: *** Including module: systemd *** Nov 3 10:01:51 kjcf05n02 dracut[8016]: *** Including module: fips *** Nov 3 10:01:52 kjcf05n02 dracut[8016]: *** Including module: systemd-initrd *** Nov 3 10:01:52 kjcf05n02 dracut[8016]: *** Including module: watchdog-modules *** Nov 3 10:01:52 kjcf05n02 dracut[8016]: *** Including module: nss-softokn *** Nov 3 10:01:52 kjcf05n02 dracut[8016]: *** Including module: i18n *** Nov 3 10:01:52 kjcf05n02 dracut[8016]: No KEYMAP configured. Nov 3 10:01:52 kjcf05n02 dracut[8016]: *** Including module: network-legacy *** Nov 3 10:01:52 kjcf05n02 dracut[8016]: *** Including module: network *** Nov 3 10:01:52 kjcf05n02 dracut[8016]: *** Including module: ib_bonding *** Nov 3 10:01:52 kjcf05n02 dracut[8016]: *** Including module: drm *** Nov 3 10:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 10:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 10:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 10:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 10:01:56 kjcf05n02 dracut[8016]: *** Including module: hperaid *** Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + install Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + local rule rule_path Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + inst_multiple cat expr Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.7YPn3q/initramfs -a -f cat expr Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + _ret=0 Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + (( 0 != 0 )) Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + : Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + return 0 Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + inst_multiple -o mdmon Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.7YPn3q/initramfs -a -f -o mdmon Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + _ret=0 Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + (( 0 != 0 )) Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + : Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + return 0 Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: ++ command -v partx Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + inst /usr/sbin/partx /sbin/partx Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + local _hostonly_install Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + [[ -e /tmp/dracut.7YPn3q/initramfs//sbin/partx ]] Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.7YPn3q/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + (( 0 != 0 )) Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + : Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: ++ command -v mdadm Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + local _hostonly_install Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + [[ -e /tmp/dracut.7YPn3q/initramfs//sbin/mdadm ]] Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.7YPn3q/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + (( 0 != 0 )) Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + : Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + [[ yes == \y\e\s ]] Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + local _raidconf Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: ++ cmdline Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: ++ local _activated dev line UUID Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: ++ declare -A _activated Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: ++ for dev in "${!host_fs_types[@]}" Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: ++ [[ nfs != *_raid_member ]] Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: ++ continue Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + _raidconf= Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + [[ -n '' ]] Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + inst_rules 64-md-raid.rules Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + local _target=/etc/udev/rules.d _rule _found Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + inst_dir /usr/lib/udev/rules.d Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + [[ -e /tmp/dracut.7YPn3q/initramfs//usr/lib/udev/rules.d ]] Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + return 0 Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + inst_dir /etc/udev/rules.d Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + [[ -e /tmp/dracut.7YPn3q/initramfs//etc/udev/rules.d ]] Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + return 0 Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + for _rule in "$@" Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + continue Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + continue Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + for r in '' $dracutbasedir/rules.d/ Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + [[ 64-md-raid.rules != /* ]] Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + continue Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + for r in '' $dracutbasedir/rules.d/ Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + continue Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + [[ -n '' ]] Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + set +x Nov 3 10:01:56 kjcf05n02 dracut[8016]: Skipping udev rule: 64-md-raid.rules Nov 3 10:01:56 kjcf05n02 dcs-collectord[5702]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 10:01:56 kjcf05n02 dcs-collectord[5702]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + installkernel Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + instmods =drivers/md Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + local _optional=-o Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + local _silent Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + local _ret Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + [[ '' = yes ]] Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + [[ =drivers/md = \-\c ]] Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + [[ =drivers/md = \-\s ]] Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + (( 1 == 0 )) Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.7YPn3q/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + _ret=0 Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + (( 0 != 0 )) Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + [[ -n '' ]] Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + return 0 Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + _ret=0 Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + unset check depends cmdline install installkernel Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + return 0 Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + modules_loaded+='hperaid ' Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + '[' -n '' ']' Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + _d_mod=90kernel-modules Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + _d_mod=kernel-modules Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + [[ '' = yes ]] Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + dinfo '*** Including module: kernel-modules ***' Nov 3 10:01:56 kjcf05n02 kdumpctl[7902]: + set +x Nov 3 10:01:56 kjcf05n02 dracut[8016]: *** Including module: kernel-modules *** Nov 3 10:01:56 kjcf05n02 dracut[8016]: *** Including module: kernel-modules-extra *** Nov 3 10:01:56 kjcf05n02 dracut[8016]: *** Including module: kernel-network-modules *** Nov 3 10:01:57 kjcf05n02 dracut[8016]: *** Including module: diskless-mod *** Nov 3 10:01:57 kjcf05n02 dracut[8016]: *** Including module: fstab-sys *** Nov 3 10:01:57 kjcf05n02 dracut[8016]: *** Including module: nfs *** Nov 3 10:01:57 kjcf05n02 dracut[8016]: *** Including module: rootfs-block *** Nov 3 10:01:57 kjcf05n02 dracut[8016]: *** Including module: terminfo *** Nov 3 10:01:57 kjcf05n02 dracut[8016]: *** Including module: udev-rules *** Nov 3 10:01:58 kjcf05n02 dracut[8016]: Skipping udev rule: 91-permissions.rules Nov 3 10:01:58 kjcf05n02 dracut[8016]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 10:01:58 kjcf05n02 dracut[8016]: *** Including module: dracut-systemd *** Nov 3 10:01:58 kjcf05n02 dracut[8016]: *** Including module: usrmount *** Nov 3 10:01:58 kjcf05n02 dracut[8016]: *** Including module: base *** Nov 3 10:01:58 kjcf05n02 dracut[8016]: *** Including module: fs-lib *** Nov 3 10:01:59 kjcf05n02 dracut[8016]: *** Including module: kdumpbase *** Nov 3 10:01:59 kjcf05n02 dracut[8016]: *** Including module: memstrack *** Nov 3 10:01:59 kjcf05n02 dracut[8016]: *** Including module: shutdown *** Nov 3 10:01:59 kjcf05n02 dracut[8016]: *** Including module: squash *** Nov 3 10:01:59 kjcf05n02 dracut[8016]: *** Including modules done *** Nov 3 10:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 10:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 10:01:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 10:01:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 10:02:00 kjcf05n02 dracut[8016]: *** Installing kernel module dependencies *** Nov 3 10:02:00 kjcf05n02 dracut[8016]: *** Installing kernel module dependencies done *** Nov 3 10:02:00 kjcf05n02 dracut[8016]: *** Resolving executable dependencies *** Nov 3 10:02:00 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 3 10:02:01 kjcf05n02 dracut[8016]: *** Resolving executable dependencies done*** Nov 3 10:02:01 kjcf05n02 dracut[8016]: *** Hardlinking files *** Nov 3 10:02:01 kjcf05n02 dracut[8016]: *** Hardlinking files done *** Nov 3 10:02:01 kjcf05n02 dracut[8016]: *** Generating early-microcode cpio image *** Nov 3 10:02:01 kjcf05n02 dracut[8016]: *** Constructing AuthenticAMD.bin **** Nov 3 10:02:01 kjcf05n02 dracut[8016]: *** Store current command line parameters *** Nov 3 10:02:01 kjcf05n02 dracut[8016]: Stored kernel commandline: Nov 3 10:02:01 kjcf05n02 dracut[8016]: rd.driver.pre=sd_mod Nov 3 10:02:01 kjcf05n02 dracut[8016]: rd.driver.pre=nvme Nov 3 10:02:01 kjcf05n02 dracut[8016]: rd.driver.pre=ipmi_si Nov 3 10:02:01 kjcf05n02 dracut[8016]: rd.driver.pre=ipmi_devintf Nov 3 10:02:01 kjcf05n02 dracut[8016]: rd.driver.pre=ipmi_msghandler Nov 3 10:02:01 kjcf05n02 dracut[8016]: nameserver=172.16.2.2 Nov 3 10:02:01 kjcf05n02 dracut[8016]: nameserver=127.0.0.1 Nov 3 10:02:01 kjcf05n02 dracut[8016]: nameserver=172.16.2.2 Nov 3 10:02:01 kjcf05n02 dracut[8016]: nameserver=127.0.0.1 Nov 3 10:02:01 kjcf05n02 dracut[8016]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 3 10:02:01 kjcf05n02 dracut[8016]: rd.neednet Nov 3 10:02:01 kjcf05n02 dracut[8016]: kdumpnic=mgmt0 Nov 3 10:02:01 kjcf05n02 dracut[8016]: bootdev=mgmt0 Nov 3 10:02:01 kjcf05n02 dracut[8016]: *** Install squash loader *** Nov 3 10:02:01 kjcf05n02 dracut[8016]: *** Squashing the files inside the initramfs *** Nov 3 10:02:02 kjcf05n02 dracut[8016]: *** Squashing the files inside the initramfs done *** Nov 3 10:02:02 kjcf05n02 dracut[8016]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 10:02:02 kjcf05n02 dracut[8016]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 10:02:03 kjcf05n02 kdumpctl[7902]: kdump: kexec: loaded kdump kernel Nov 3 10:02:03 kjcf05n02 kdumpctl[7902]: kdump: Starting kdump: [OK] Nov 3 10:02:03 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 3 10:02:03 kjcf05n02 systemd[1]: Reloading. Nov 3 10:02:03 kjcf05n02 systemd[3225]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:02:03 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:02:03 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:02:03 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 10:02:03 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 10:02:03 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 10:02:03 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 10:02:03 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 10:02:03 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 10:02:03 kjcf05n02 ifdown[14573]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 10:02:03 kjcf05n02 ifdown[14574]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:02:03 kjcf05n02 ifdown[14575]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:02:03 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 10:02:03 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 10:02:03 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 10:02:03 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 3 10:02:04 kjcf05n02 ifup[14640]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 10:02:04 kjcf05n02 ifup[14641]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:02:04 kjcf05n02 ifup[14642]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:02:04 kjcf05n00 mcfcli[3673891]: %3|1730649724.382|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 10:02:06 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 10:02:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730649725', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 2.46, 2.04, 0.89'}"] Nov 3 10:02:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 2.46, 2.04, 0.89', 'message': 'OK - load average: 2.46, 2.04, 0.89', 'value': 'ok', 'timestamp': '1730649725'} Nov 3 10:02:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:02:06 kjcf05n00 zabbix-server[1161512]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 10:02:06 kjcf05n00 zabbix-server[1161512]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:54\\"}}"' Nov 3 10:02:06 kjcf05n00 log_interesting_event.py[1161512]: Event '46084' acknowledged Nov 3 10:02:06 kjcf05n00 zabbix-server[1161519]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 10:02:06 kjcf05n00 zabbix-server[1161519]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 3 10:02:06 kjcf05n00 log_interesting_event.py[1161519]: Event '46085' acknowledged Nov 3 10:02:08 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 10:02:08 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 10:02:08 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 10:02:08 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:02:08 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:02:08 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:02:08 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:02:08 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 10:02:08 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 10:02:08 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 10:02:08 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 10:02:08 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:02:08 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:02:08 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:02:08 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:02:08 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 10:02:08 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 10:02:08 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 10:02:08 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 10:02:08 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 10:02:08 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 10:02:08 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 10:02:08 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 10:02:08 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 10:02:08 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 10:02:08 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 10:02:08 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 10:02:08 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 10:02:08 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 10:02:08 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 10:02:08 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 10:02:08 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 10:02:08 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 10:02:08 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 10:02:08 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 10:02:08 kjcf05n02 ifdown[14841]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 10:02:08 kjcf05n02 ifdown[14842]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:02:08 kjcf05n02 ifdown[14843]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:02:08 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 10:02:08 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 10:02:08 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 10:02:09 kjcf05n02 ifup[14906]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 10:02:09 kjcf05n02 ifup[14907]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:02:09 kjcf05n02 ifup[14908]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:02:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730649729', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 330 processes with STATE = RSZDT '}"] Nov 3 10:02:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 330 processes with STATE = RSZDT ', 'message': 'PROCS OK: 330 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730649729'} Nov 3 10:02:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:02:10 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 10:02:11 kjcf05n02 dcs-collectord[5702]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 10:02:11 kjcf05n02 dcs-collectord[5702]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 10:02:13 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 10:02:13 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 10:02:13 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 10:02:13 kjcf05n02 systemd[1]: Reloading. Nov 3 10:02:13 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 3 10:02:13 kjcf05n02 await_ha_peer[15123]: Waiting for HA peer kjcf05n03 Nov 3 10:02:13 kjcf05n00 mcfcli[3673891]: %3|1730649733.906|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:02:15 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 10:02:15 kjcf05n02 await_ha_peer[15123]: Peer kjcf05n03 has started, starting HA Nov 3 10:02:15 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 3 10:02:15 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 3 10:02:15 kjcf05n02 fstonithd.py[15174]: Listening for kdump packets from partner Nov 3 10:02:15 kjcf05n02 systemd[1]: Reloading. Nov 3 10:02:15 kjcf05n02 systemd[3225]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:02:15 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:02:15 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:02:15 kjcf05n02 systemd[1]: Reloading. Nov 3 10:02:16 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 3 10:02:16 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 10:02:16 kjcf05n02 systemd[1]: Reloading. Nov 3 10:02:16 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 10:02:16 kjcf05n02 puppet-agent[3618]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:02:16 kjcf05n02 puppet[3618]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:02:16 kjcf05n02 puppet-agent[3618]: Applied catalog in 90.41 seconds Nov 3 10:02:16 kjcf05n02 puppet[3618]: Notice: Applied catalog in 90.41 seconds Nov 3 10:02:16 kjcf05n02 systemd[1]: Started Puppet agent. Nov 3 10:02:16 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 10:02:16 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 10:02:16 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 10:02:16 kjcf05n02 systemd[1]: Reached target Timers. Nov 3 10:02:16 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 3 10:02:16 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 10:02:16 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 10:02:16 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 10:02:16 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 10:02:16 kjcf05n02 wce-disable.sh[15316]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 10:02:16 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 10:02:16 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 10:02:16 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 10:02:16 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 10:02:16 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 3 10:02:16 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 3 10:02:16 kjcf05n02 python3.9[15318]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 10:02:17 kjcf05n02 python3.9[15318]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 10:02:17 kjcf05n02 gateway-ec-node.py[15319]: Starting gateway-ec-node service Nov 3 10:02:17 kjcf05n02 RFSF-API[15317]: INFO[2024-11-03T10:02:16-06:00] Datapath API RESTful Service starting Nov 3 10:02:17 kjcf05n02 dp-api-server-node[15317]: INFO[2024-11-03T10:02:16-06:00] Datapath API RESTful Service starting Nov 3 10:02:17 kjcf05n02 RFSF-API[15317]: INFO[2024-11-03T10:02:16-06:00] Running in production mode, starting dbus event listener Nov 3 10:02:17 kjcf05n02 dp-api-server-node[15317]: INFO[2024-11-03T10:02:16-06:00] Running in production mode, starting dbus event listener Nov 3 10:02:17 kjcf05n02 RFSF-API[15317]: INFO[2024-11-03T10:02:16-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 10:02:17 kjcf05n02 dp-api-server-node[15317]: INFO[2024-11-03T10:02:16-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 10:02:17 kjcf05n02 RFSF-API[15317]: INFO[2024-11-03T10:02:16-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 10:02:17 kjcf05n02 dp-api-server-node[15317]: INFO[2024-11-03T10:02:16-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 10:02:17 kjcf05n02 RFSF-API[15317]: INFO[2024-11-03T10:02:16-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 10:02:17 kjcf05n02 dp-api-server-node[15317]: INFO[2024-11-03T10:02:16-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 10:02:17 kjcf05n02 RFSF-API[15317]: INFO[2024-11-03T10:02:16-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 10:02:17 kjcf05n02 dp-api-server-node[15317]: INFO[2024-11-03T10:02:16-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 10:02:17 kjcf05n02 RFSF-API[15317]: INFO[2024-11-03T10:02:16-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 10:02:17 kjcf05n02 dp-api-server-node[15317]: INFO[2024-11-03T10:02:16-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 10:02:17 kjcf05n02 RFSF-API[15317]: INFO[2024-11-03T10:02:16-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 10:02:17 kjcf05n02 dp-api-server-node[15317]: INFO[2024-11-03T10:02:16-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 10:02:17 kjcf05n02 RFSF-API[15317]: INFO[2024-11-03T10:02:16-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 10:02:17 kjcf05n02 dp-api-server-node[15317]: INFO[2024-11-03T10:02:16-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 10:02:17 kjcf05n02 RFSF-API[15317]: INFO[2024-11-03T10:02:16-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 10:02:17 kjcf05n02 dp-api-server-node[15317]: INFO[2024-11-03T10:02:16-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 10:02:17 kjcf05n02 RFSF-API[15317]: INFO[2024-11-03T10:02:16-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 10:02:17 kjcf05n02 dp-api-server-node[15317]: INFO[2024-11-03T10:02:16-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 10:02:17 kjcf05n02 RFSF-API[15317]: INFO[2024-11-03T10:02:16-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 10:02:17 kjcf05n02 dp-api-server-node[15317]: INFO[2024-11-03T10:02:16-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 10:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730649739', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 10:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730649739'} Nov 3 10:02:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730649739', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 10:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730649739'} Nov 3 10:02:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730649739', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.5% (3886512 kB) used.'}"] Nov 3 10:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.5% (3886512 kB) used.', 'message': 'OK - 1.5% (3886512 kB) used.', 'value': 'ok', 'timestamp': '1730649739'} Nov 3 10:02:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:02:22 kjcf05n00 zabbix-server[1161585]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 10:02:22 kjcf05n00 zabbix-server[1161585]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 120.5\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 124.24\\"}}"' Nov 3 10:02:22 kjcf05n00 log_interesting_event.py[1161585]: Event '46089' acknowledged Nov 3 10:02:22 kjcf05n02 systemd[1]: Reloading. Nov 3 10:02:22 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 10:02:22 kjcf05n02 systemd[1]: Reloading. Nov 3 10:02:22 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 10:02:22 kjcf05n02 diskmonitor_pre[15701]: Key management is currently disabled.DEAR disabled Nov 3 10:02:23 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 10:02:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730649743', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(840.0B/776.0B), ib1=(700.0B/716.0B), icl0=(7.0kB/8.7kB), lo=(600.0B/600.0B), meth0=(1541.4MB/8.0MB), mgmt0=(1478.2MB/7.9MB)'}"] Nov 3 10:02:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(840.0B/776.0B), ib1=(700.0B/716.0B), icl0=(7.0kB/8.7kB), lo=(600.0B/600.0B), meth0=(1541.4MB/8.0MB), mgmt0=(1478.2MB/7.9MB)', 'message': 'NET OK - (Rx/Tx) ib0=(840.0B/776.0B), ib1=(700.0B/716.0B), icl0=(7.0kB/8.7kB), lo=(600.0B/600.0B), meth0=(1541.4MB/8.0MB), mgmt0=(1478.2MB/7.9MB)', 'value': 'ok', 'timestamp': '1730649743'} Nov 3 10:02:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730649743', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 10:02:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:02:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730649743'} Nov 3 10:02:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:02:24 kjcf05n02 sh[15768]: LNET configured: New Created Nov 3 10:02:24 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 10:02:24 kjcf05n02 LCNmon[17869]: Interface ib0 is up Nov 3 10:02:24 kjcf05n02 LCNmon[17869]: Interface ib1 is up Nov 3 10:02:24 kjcf05n02 LCNmon[17869]: Can ping through interface ib0 Nov 3 10:02:24 kjcf05n02 LCNmon[17869]: Can ping through interface ib1 Nov 3 10:02:24 kjcf05n02 LCNmon[17869]: NIC ib0, initial state UP Nov 3 10:02:24 kjcf05n02 LCNmon[17869]: NIC ib1, initial state UP Nov 3 10:02:24 kjcf05n02 LCNmon[17869]: LCNstat initial state UP Nov 3 10:02:25 kjcf05n02 LCNmon[17869]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 3 10:02:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730649745', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 10:02:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730649745'} Nov 3 10:02:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:02:26 kjcf05n02 dcs-collectord[5702]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 10:02:26 kjcf05n02 dcs-collectord[5702]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 10:02:26 kjcf05n02 dcs-collectord[5702]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 10:02:26 kjcf05n00 httpd[902565]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 10:02:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730649746', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 10:02:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730649746'} Nov 3 10:02:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:02:26 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: /var/run/diskmonitor does not exist, creating Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: Creating /var/run/diskmonitor/disk Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: Creating /var/run/diskmonitor/encl Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: Creating /var/run/diskmonitor/cli Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: RAS_Interlocks_enabled: 1 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: add handler for sig: 14 sa_flags: 10000004 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: add handler for sig: 1 sa_flags: 10000004 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: add handler for sig: 2 sa_flags: 00000004 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: add handler for sig: 15 sa_flags: 00000004 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: add handler for sig: 6 sa_flags: 00000004 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: add handler for sig: 3 sa_flags: 00000004 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: add handler for sig: 30 sa_flags: 00000004 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: add handler for sig: 20 sa_flags: 00000004 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: add handler for sig: 10 sa_flags: 10000004 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: add handler for sig: 11 sa_flags: 00000004 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: add handler for sig: 7 sa_flags: 00000004 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: add handler for sig: 4 sa_flags: 00000004 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: add handler for sig: 8 sa_flags: 00000004 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: Using HA Baton locks - key: diskmonitor Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: Baton will be held for at most 570 seconds Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: DMMP Enabled: 0 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: random seed: 987f95b2 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: NVMe Enclosure: 1 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: ZFS Enclosure: 0 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: Dbus, Initialized Connection Successfully Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: int_catcher_thread: thread start Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: Received dbus message 4 org.freedesktop.DBus -> :1.91 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 10:02:27 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 10:02:31 kjcf05n02 openhpid[5608]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 10:02:31 kjcf05n02 openhpid[5608]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 10:02:31 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 3 10:02:31 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 10:02:31 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 10:02:31 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18495 which is not our child. We'll most likely not notice when it exits. Nov 3 10:02:31 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 10:02:31 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 3 10:02:31 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 3 10:02:31 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 10:02:31 kjcf05n02 dcs-collectord[5702]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 10:02:31 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 10:02:31 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 10:02:31 kjcf05n02 systemd[1]: Startup finished in 50.806s (kernel) + 2min 28.940s (userspace) = 3min 19.747s. Nov 3 10:02:31 kjcf05n02 openhpid[18495]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 10:02:31 kjcf05n02 openhpid[18495]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 10:02:31 kjcf05n02 openhpid[18495]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 10:02:31 kjcf05n02 openhpid[18495]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 10:02:33 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 10:02:34 kjcf05n00 mcfcli[3673891]: %3|1730649754.382|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 10:02:34 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18768 (bash) Nov 3 10:02:34 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 10:02:34 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 10:02:34 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 10:02:34 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 10:02:34 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 10:02:41 kjcf05n02 dcs-collectord[5702]: WARNING No data collected (hpi_parser.py:353) Nov 3 10:02:41 kjcf05n02 dcs-collectord[5702]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 10:02:45 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31427 deleted. Nov 3 10:02:53 kjcf05n00 mcfcli[3673891]: %3|1730649773.745|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:02:55 kjcf05n02 ipmievd[4029]: System Event sensor - Timestamp Clock Sync Nov 3 10:02:56 kjcf05n02 ipmievd[3225]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:02:56 kjcf05n02 dcs-collectord[5702]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 10:03:04 kjcf05n00 mcfcli[3673891]: %3|1730649784.382|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 10:03:06 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 10:03:07 kjcf05n03 nslcd[7088]: [e8944a] ldap_result() failed: Can't contact LDAP server Nov 3 10:03:11 kjcf05n02 dcs-collectord[5702]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 10:03:14 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e300643002538450000000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 10:03:14 kjcf05n02 ras-resource-manager-agent[5966]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "21c861b8-99fd-11ef-8b53-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 10:03:14 kjcf05n02 ras-resource-manager-agent[5966]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '21c861b8-99fd-11ef-8b53-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 10:03:14 kjcf05n02 ras-resource-manager-agent[5966]: INFO Submitting new device inserted signal, starting to qualify drive: 21c861b8-99fd-11ef-8b53-00093d0695e3 (admin_action.py:110) Nov 3 10:03:14 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '21c861b8-99fd-11ef-8b53-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 10:03:14 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '21c861b8-99fd-11ef-8b53-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 10:03:14 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '21c861b8-99fd-11ef-8b53-00093d0695e3', 'response ID': '21d264ba-99fd-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 10:03:14 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 21d264ba-99fd-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 10:03:14 kjcf05n03 firmware-update-orc-server[5876]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "3167291d-db91-42c5-8d2f-bff4d578c1bf"} (logger.py:65) Nov 3 10:03:14 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 84322 (get_disk_device) Nov 3 10:03:14 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 10:03:14 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 10:03:14 kjcf05n03 ccp-client[84343]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 10:03:15 kjcf05n03 ccp-client[84343]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 10:03:15 kjcf05n03 ccp-client[84356]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 10:03:15 kjcf05n03 ccp-client[84343]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 10:03:15 kjcf05n03 ccp-client[84343]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 10:03:15 kjcf05n03 ccp-client[84356]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 10:03:15 kjcf05n03 ccp-client[84356]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 10:03:14 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '2218068c-99fd-11ef-8b53-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 10:03:14 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '2218068c-99fd-11ef-8b53-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 10:03:15 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '2218068c-99fd-11ef-8b53-00093d0695e3', 'response ID': '221ea94c-99fd-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 10:03:15 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 221ea94c-99fd-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 10:03:15 kjcf05n02 diskmonitor[17464]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 10:03:15 kjcf05n02 ras-resource-manager-agent[5966]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "2218068c-99fd-11ef-8b53-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 10:03:15 kjcf05n02 ras-resource-manager-agent[5966]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '2218068c-99fd-11ef-8b53-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 10:03:15 kjcf05n02 ras-resource-manager-agent[5966]: INFO Submitting new device inserted signal, starting to qualify drive: 2218068c-99fd-11ef-8b53-00093d0695e3 (admin_action.py:110) Nov 3 10:03:15 kjcf05n02 firmware-update-orc-server[5923]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "7c31b804-5e2f-4d2a-81d9-c8bf7de12fc9"} (logger.py:65) Nov 3 10:03:18 kjcf05n03 DRVFW[84468]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 10:03:18 kjcf05n03 ccp-client[84469]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 10:03:18 kjcf05n03 ccp-client[84469]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 10:03:18 kjcf05n03 ccp-client[84492]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 10:03:18 kjcf05n03 ccp-client[84469]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 10:03:18 kjcf05n03 ccp-client[84469]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 10:03:18 kjcf05n03 ccp-client[84492]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 10:03:18 kjcf05n03 ccp-client[84492]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 10:03:18 kjcf05n03 firmware-update-orc-server[5876]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 10:03:19 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 21d264ba-99fd-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 10:03:19 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '21c861b8-99fd-11ef-8b53-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '21c861b8-99fd-11ef-8b53-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}}} (logger.py:65) Nov 3 10:03:19 kjcf05n02 ras-resource-manager-agent[5966]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '21c861b8-99fd-11ef-8b53-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 10:03:19 kjcf05n02 ras-resource-manager-agent[5966]: INFO Drive qualification complete responding: 21c861b8-99fd-11ef-8b53-00093d0695e3 (admin_action.py:205) Nov 3 10:03:19 kjcf05n02 ras-resource-manager-agent[5966]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "21c861b8-99fd-11ef-8b53-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (interesting_event.py:59) Nov 3 10:03:21 kjcf05n02 diskmonitor[17464]: 3 Nov 3 10:03:21 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 10:03:21 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 10:03:21 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 10:03:21 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 10:03:21 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 10:03:21 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 10:03:21 kjcf05n02 diskmonitor[17464]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 10:03:21 kjcf05n02 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 10:03:21 kjcf05n02 diskmonitor[17464]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 10:03:21 kjcf05n02 diskmonitor[17464]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 10:03:21 kjcf05n02 diskmonitor[17464]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 10:03:21 kjcf05n02 diskmonitor[17464]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "21c861b8-99fd-11ef-8b53-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 10:03:21 kjcf05n02 diskmonitor[17464]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 10:03:21 kjcf05n02 diskmonitor[17464]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 10:03:21 kjcf05n02 diskmonitor[17464]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "2218068c-99fd-11ef-8b53-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 10:03:21 kjcf05n02 diskmonitor[17464]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 10:03:21 kjcf05n02 diskmonitor[17464]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 10:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T10:03:27.267802371-06:00 level=info msg="Completed cleanup jobs" duration=41.362477ms Nov 3 10:03:28 kjcf05n02 chronyd[5209]: Selected source 172.16.2.1 Nov 3 10:03:30 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22478 (get_disk_device) Nov 3 10:03:30 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 10:03:30 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 10:03:30 kjcf05n02 ccp-client[22499]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 10:03:30 kjcf05n00 mcfcli[3673891]: %3|1730649810.155|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:03:30 kjcf05n02 ccp-client[22499]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 10:03:30 kjcf05n02 ccp-client[22509]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 10:03:30 kjcf05n02 ccp-client[22499]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 10:03:30 kjcf05n02 ccp-client[22499]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 10:03:30 kjcf05n02 ccp-client[22509]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 10:03:30 kjcf05n02 ccp-client[22509]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 10:03:30 kjcf05n02 ras-resource-manager-agent[5966]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "21c861b8-99fd-11ef-8b53-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (service_main_handler.py:66) Nov 3 10:03:30 kjcf05n02 ras-resource-manager-agent[5966]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '21c861b8-99fd-11ef-8b53-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 10:03:30 kjcf05n02 ras-resource-manager-agent[5966]: INFO Device qualification response has been acknowledged: 21c861b8-99fd-11ef-8b53-00093d0695e3 (admin_action.py:151) Nov 3 10:03:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730649810}"] Nov 3 10:03:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730649810, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:03:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:03:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730649810}"] Nov 3 10:03:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730649810, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:03:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:03:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730649810}"] Nov 3 10:03:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730649810, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:03:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:03:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730649810}"] Nov 3 10:03:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730649810, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:03:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:03:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730649810}"] Nov 3 10:03:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730649810, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:03:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:03:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730649810}"] Nov 3 10:03:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730649810, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:03:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:03:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730649810}"] Nov 3 10:03:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730649810, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:03:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:03:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730649810}"] Nov 3 10:03:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730649810, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:03:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:03:33 kjcf05n02 DRVFW[23145]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 10:03:33 kjcf05n02 ccp-client[23146]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 10:03:33 kjcf05n02 ccp-client[23146]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 10:03:33 kjcf05n02 ccp-client[23166]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 10:03:33 kjcf05n02 ccp-client[23146]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 10:03:33 kjcf05n02 ccp-client[23146]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 10:03:33 kjcf05n02 ccp-client[23166]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 10:03:33 kjcf05n02 ccp-client[23166]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 10:03:33 kjcf05n02 firmware-update-orc-server[5923]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 10:03:34 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 221ea94c-99fd-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 10:03:34 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '2218068c-99fd-11ef-8b53-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '2218068c-99fd-11ef-8b53-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 18}}}} (logger.py:65) Nov 3 10:03:34 kjcf05n02 ras-resource-manager-agent[5966]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '2218068c-99fd-11ef-8b53-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 10:03:34 kjcf05n02 ras-resource-manager-agent[5966]: INFO Drive qualification complete responding: 2218068c-99fd-11ef-8b53-00093d0695e3 (admin_action.py:205) Nov 3 10:03:34 kjcf05n02 ras-resource-manager-agent[5966]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "2218068c-99fd-11ef-8b53-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} (interesting_event.py:59) Nov 3 10:03:34 kjcf05n00 mcfcli[3673891]: %3|1730649814.382|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 10:03:34 kjcf05n02 diskmonitor[17464]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 10:03:34 kjcf05n02 python3.9[5271]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 10:03:35 kjcf05n02 python3.9[3225]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:03:35 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 3 10:03:35 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 10:03:35 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 3 10:03:35 kjcf05n02 diskmonitor[17464]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 10:03:35 kjcf05n02 ras-resource-manager-agent[5966]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "2e17c53a-99fd-11ef-8b53-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 10:03:35 kjcf05n02 ras-resource-manager-agent[5966]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '2e17c53a-99fd-11ef-8b53-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 10:03:35 kjcf05n02 ras-resource-manager-agent[5966]: INFO Requests ['2218068c-99fd-11ef-8b53-00093d0695e3', '2e17c53a-99fd-11ef-8b53-00093d0695e3'] already in progress (admin_action.py:99) Nov 3 10:03:35 kjcf05n02 ras-resource-manager-agent[5966]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '2e17c53a-99fd-11ef-8b53-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 10:03:35 kjcf05n02 ras-resource-manager-agent[5966]: INFO Drive qualification complete responding: 2e17c53a-99fd-11ef-8b53-00093d0695e3 (admin_action.py:205) Nov 3 10:03:35 kjcf05n02 ras-resource-manager-agent[5966]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "2218068c-99fd-11ef-8b53-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} (interesting_event.py:59) Nov 3 10:03:35 kjcf05n02 ras-resource-manager-agent[5966]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "2e17c53a-99fd-11ef-8b53-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} (interesting_event.py:59) Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "21c861b8-99fd-11ef-8b53-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: Dbus, handle_ingress_ras_signals, uuid: 21c861b8-99fd-11ef-8b53-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "21c861b8-99fd-11ef-8b53-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: main: Pending firmware leveling requests exist, rescanning disks Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "2e17c53a-99fd-11ef-8b53-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: leaving test state: 1 next state: 2 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: lock req: no timeout Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: leaving test state: 2 next state: 4 Nov 3 10:03:40 kjcf05n02 diskmonitor[17464]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 10:03:55 kjcf05n03 nslcd[7088]: [8e1f29] ldap_result() failed: Can't contact LDAP server Nov 3 10:04:04 kjcf05n00 mcfcli[3673891]: %3|1730649844.384|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 10:04:06 kjcf05n00 mcfcli[3673891]: %3|1730649846.283|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:04:08 kjcf05n02 ras-resource-manager-agent[5966]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2218068c-99fd-11ef-8b53-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} (service_main_handler.py:66) Nov 3 10:04:08 kjcf05n02 ras-resource-manager-agent[5966]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '2218068c-99fd-11ef-8b53-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 10:04:08 kjcf05n02 ras-resource-manager-agent[5966]: INFO Device qualification response has been acknowledged: 2218068c-99fd-11ef-8b53-00093d0695e3 (admin_action.py:151) Nov 3 10:04:08 kjcf05n02 ras-resource-manager-agent[5966]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2218068c-99fd-11ef-8b53-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} (service_main_handler.py:66) Nov 3 10:04:08 kjcf05n02 ras-resource-manager-agent[5966]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '2218068c-99fd-11ef-8b53-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 10:04:08 kjcf05n02 ras-resource-manager-agent[5966]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2e17c53a-99fd-11ef-8b53-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} (service_main_handler.py:66) Nov 3 10:04:08 kjcf05n02 ras-resource-manager-agent[5966]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '2e17c53a-99fd-11ef-8b53-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 10:04:08 kjcf05n02 ras-resource-manager-agent[5966]: INFO Device qualification response has been acknowledged: 2e17c53a-99fd-11ef-8b53-00093d0695e3 (admin_action.py:151) Nov 3 10:04:09 kjcf05n02 diskmonitor[17464]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 10:04:26 kjcf05n02 diskmonitor[17464]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "2218068c-99fd-11ef-8b53-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} Nov 3 10:04:26 kjcf05n02 diskmonitor[17464]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 10:04:26 kjcf05n02 diskmonitor[17464]: Dbus, handle_ingress_ras_signals, uuid: 2218068c-99fd-11ef-8b53-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 10:04:26 kjcf05n02 diskmonitor[17464]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 10:04:26 kjcf05n02 diskmonitor[17464]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2218068c-99fd-11ef-8b53-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} Nov 3 10:04:26 kjcf05n02 diskmonitor[17464]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "2218068c-99fd-11ef-8b53-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} Nov 3 10:04:26 kjcf05n02 diskmonitor[17464]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 10:04:26 kjcf05n02 diskmonitor[17464]: Dbus, handle_ingress_ras_signals, uuid: 2218068c-99fd-11ef-8b53-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 10:04:26 kjcf05n02 diskmonitor[17464]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2218068c-99fd-11ef-8b53-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} Nov 3 10:04:26 kjcf05n02 diskmonitor[17464]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "2e17c53a-99fd-11ef-8b53-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} Nov 3 10:04:26 kjcf05n02 diskmonitor[17464]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 10:04:26 kjcf05n02 diskmonitor[17464]: Dbus, handle_ingress_ras_signals, uuid: 2e17c53a-99fd-11ef-8b53-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 10:04:26 kjcf05n02 diskmonitor[17464]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2e17c53a-99fd-11ef-8b53-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} Nov 3 10:04:26 kjcf05n02 diskmonitor[17464]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 10:04:26 kjcf05n02 diskmonitor[17464]: lock acquired Nov 3 10:04:26 kjcf05n02 diskmonitor[17464]: leaving test state: 4 next state: 8 Nov 3 10:04:26 kjcf05n02 diskmonitor[17464]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 10:04:34 kjcf05n00 mcfcli[3673891]: %3|1730649874.384|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:04:35 kjcf05n02 diskmonitor[17464]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 10:04:35 kjcf05n02 diskmonitor[17464]: leaving test state: 8 next state: 20 Nov 3 10:04:35 kjcf05n02 diskmonitor[17464]: leaving test state: 20 next state: 40 Nov 3 10:04:35 kjcf05n02 diskmonitor[17464]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset bb7a968000 Nov 3 10:04:35 kjcf05n02 diskmonitor[17464]: leaving test state: 40 next state: 80 Nov 3 10:04:35 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 10:04:35 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 10:04:35 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 10:04:45 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31428 deleted. Nov 3 10:04:46 kjcf05n00 mcfcli[3673891]: %3|1730649886.281|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:04:50 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 10:04:50 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 10:04:50 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 10:04:52 kjcf05n02 dcs-collectord[5702]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 10:05:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730649900}"] Nov 3 10:05:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730649900, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:05:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:05:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:05:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:05:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:05:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:05:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:05:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:05:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:05:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:05:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:05:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:05:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:05:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:05:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.968527ms Nov 3 10:05:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:05:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.968527ms Nov 3 10:05:01 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:05:01 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:05:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:05:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730649901}"] Nov 3 10:05:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730649901, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:05:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:05:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:05:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:05:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:05:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:05:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:05:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:05:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:05:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:05:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:05:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:05:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:05:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:05:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.214799ms Nov 3 10:05:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:05:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.214799ms Nov 3 10:05:01 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:05:01 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:05:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:05:04 kjcf05n00 mcfcli[3673891]: %3|1730649904.385|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:05:07 kjcf05n00 python3.9[1163414]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 10:05:26 kjcf05n00 mcfcli[3673891]: %3|1730649926.278|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:05:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730649622', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 10:05:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730649622'} Nov 3 10:05:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:05:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730649622', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 10:05:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730649622'} Nov 3 10:05:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:05:34 kjcf05n02 diskmonitor[17464]: leaving test state: 80 next state: 100 Nov 3 10:05:34 kjcf05n02 diskmonitor[17464]: lock release: time: Sun Nov 3 10:05:29 2024 Nov 3 10:05:34 kjcf05n02 diskmonitor[17464]: leaving test state: 100 next state: 1 Nov 3 10:05:34 kjcf05n00 mcfcli[3673891]: %3|1730649934.386|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 10:05:43 kjcf05n00 zabbix-server[1163889]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 10:05:43 kjcf05n00 zabbix-server[1163889]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n02' from event '46100' Nov 3 10:05:43 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 10:05:43 kjcf05n00 zabbix-server[1163889]: Host created 'enclosure_USE26000024VS001' Nov 3 10:05:43 kjcf05n00 zabbix-server[1163889]: Running puppet on 'kjcf05n02' Nov 3 10:05:45 kjcf05n02 puppet-agent[30634]: Using configured environment 'production' Nov 3 10:05:45 kjcf05n02 puppet-agent[30634]: Retrieving pluginfacts Nov 3 10:05:45 kjcf05n02 puppet-agent[30634]: Retrieving plugin Nov 3 10:05:45 kjcf05n02 puppet-agent[30634]: Loading facts Nov 3 10:05:48 kjcf05n02 puppet-agent[30634]: Caching catalog for kjcf05n02 Nov 3 10:05:48 kjcf05n02 puppet-agent[30634]: Applying configuration version '1730649947' Nov 3 10:05:50 kjcf05n02 puppet-agent[30634]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 10:05:50 kjcf05n02 puppet-agent[30634]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 10:05:50 kjcf05n02 puppet-agent[30634]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 10:05:51 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 10:05:51 kjcf05n02 zabbix_agent2[6050]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 10:05:51 kjcf05n02 zabbix_agent2[3225]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:05:51 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 10:05:51 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 10:05:51 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 10:05:51 kjcf05n02 puppet-agent[30634]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: Press Ctrl+C to exit. Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: Plugin support version 1.0 Nov 3 10:05:51 kjcf05n02 zabbix_agent2[31114]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 10:05:53 kjcf05n02 puppet-agent[30634]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 10:05:53 kjcf05n02 puppet-agent[30634]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 10:05:53 kjcf05n02 puppet-agent[30634]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 10:05:53 kjcf05n02 puppet-agent[30634]: Applied catalog in 4.92 seconds Nov 3 10:05:53 kjcf05n00 zabbix-server[1163889]: puppet completed status:(0): '' Nov 3 10:05:53 kjcf05n00 zabbix-server[1163889]: Event '46100' acknowledged Nov 3 10:05:53 kjcf05n00 zabbix-server[1163889]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n02"}' Nov 3 10:06:04 kjcf05n00 mcfcli[3673891]: %3|1730649964.386|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 10:06:04 kjcf05n00 mcfcli[3673891]: %3|1730649964.885|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:06:17 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 10:06:34 kjcf05n00 mcfcli[3673891]: %3|1730649994.386|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:06:38 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 10:06:43 kjcf05n00 mcfcli[3673891]: %3|1730650003.664|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:07:04 kjcf05n00 mcfcli[3673891]: %3|1730650024.386|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:07:20 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 3 10:07:20 kjcf05n00 mcfcli[3673891]: %3|1730650040.876|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:07:34 kjcf05n00 mcfcli[3673891]: %3|1730650054.388|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 10:07:48 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 3 10:07:48 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 3 10:08:00 kjcf05n00 mcfcli[3673891]: %3|1730650080.873|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:08:04 kjcf05n00 mcfcli[3673891]: %3|1730650084.388|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 10:08:21 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 10:08:21 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 10:08:21 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 10:08:34 kjcf05n00 mcfcli[3673891]: %3|1730650114.388|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 10:08:39 kjcf05n00 mcfcli[3673891]: %3|1730650119.381|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:08:45 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 10:08:45 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 10:08:45 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 10:09:04 kjcf05n00 mcfcli[3673891]: %3|1730650144.388|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 10:09:17 kjcf05n00 mcfcli[3673891]: %3|1730650157.464|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:09:34 kjcf05n00 mcfcli[3673891]: %3|1730650174.389|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:09:57 kjcf05n00 mcfcli[3673891]: %3|1730650197.461|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:09:58 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 3 10:09:58 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 3 10:09:58 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 3 10:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 10:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 10:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 10:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 10:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 10:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 10:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 10:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 10:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 10:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 10:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 10:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 10:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 10:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 10:10:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 10:10:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:10:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 10:10:04 kjcf05n00 mcfcli[3673891]: %3|1730650204.389|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:10:07 kjcf05n00 python3.9[1166310]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 10:10:13 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 3 10:10:13 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 3 10:10:13 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 3 10:10:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730649622', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 10:10:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730649622'} Nov 3 10:10:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:10:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730649622', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 10:10:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730649622'} Nov 3 10:10:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:10:27 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 3 10:10:34 kjcf05n00 mcfcli[3673891]: %3|1730650234.389|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:10:35 kjcf05n00 mcfcli[3673891]: %3|1730650235.881|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:10:55 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 3 10:10:55 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 3 10:11:04 kjcf05n00 mcfcli[3673891]: %3|1730650264.391|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 10:11:13 kjcf05n00 mcfcli[3673891]: %3|1730650273.646|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:11:34 kjcf05n00 mcfcli[3673891]: %3|1730650294.391|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:11:51 kjcf05n00 mcfcli[3673891]: %3|1730650311.971|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:12:04 kjcf05n00 mcfcli[3673891]: %3|1730650324.391|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:12:31 kjcf05n00 mcfcli[3673891]: %3|1730650351.824|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:12:34 kjcf05n00 mcfcli[3673891]: %3|1730650354.391|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:12:46 kjcf05n00 zabbix-server[1167825]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 10:12:46 kjcf05n00 zabbix-server[1167825]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 180.04\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 104.16\\"}}"' Nov 3 10:12:46 kjcf05n00 log_interesting_event.py[1167825]: Event '46103' acknowledged Nov 3 10:13:04 kjcf05n00 mcfcli[3673891]: %3|1730650384.392|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 10:13:09 kjcf05n02 root[42416]: failback_xyraid Nov 3 10:13:09 kjcf05n00 mcfcli[3673891]: %3|1730650389.411|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:13:10 kjcf05n02 root[42547]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 10:13:11 kjcf05n02 root[42705]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 10:13:14 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 3 10:13:18 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme9n1 Nov 3 10:13:18 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme18n1 Nov 3 10:13:18 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme23n1 Nov 3 10:13:18 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme8n1 Nov 3 10:13:18 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme2n1 Nov 3 10:13:18 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme24n1 Nov 3 10:13:18 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme25n1 Nov 3 10:13:18 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme4n1 Nov 3 10:13:18 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme3n1 Nov 3 10:13:18 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme17n1 Nov 3 10:13:18 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme19n1 Nov 3 10:13:20 kjcf05n02 dwd[5242]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 10:13:20 kjcf05n02 dwd[5242]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 10:13:20 kjcf05n02 dwd[5242]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 10:13:20 kjcf05n02 dwd[5242]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 10:13:20 kjcf05n02 dwd[5242]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 10:13:20 kjcf05n02 dwd[5242]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 10:13:20 kjcf05n02 dwd[5242]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 10:13:20 kjcf05n02 dwd[5242]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 10:13:20 kjcf05n02 dwd[5242]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 10:13:20 kjcf05n02 dwd[5242]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 10:13:20 kjcf05n02 dwd[5242]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 10:13:20 kjcf05n02 dcs-bulk-data-sender[6250]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 3 10:13:20 kjcf05n02 dwd[5242]: Starting NVME thread for nvme2n1 Nov 3 10:13:20 kjcf05n02 dwd[5242]: Starting NVME thread for nvme18n1 Nov 3 10:13:20 kjcf05n02 dwd[5242]: Starting NVME thread for nvme19n1 Nov 3 10:13:20 kjcf05n02 dwd[5242]: Starting NVME thread for nvme9n1 Nov 3 10:13:21 kjcf05n02 dwd[5242]: Starting NVME thread for nvme3n1 Nov 3 10:13:21 kjcf05n02 systemd-udevd[45434]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45435]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45433]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45438]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45434]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45433]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45438]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45435]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45434]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45433]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45438]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45435]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45434]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45433]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45438]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45435]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45434]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45433]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45438]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45435]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45434]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45433]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45438]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45435]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45461]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45463]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45435]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45434]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45438]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45433]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45465]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45461]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45468]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45435]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45438]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45463]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45434]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45465]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45433]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45461]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45465]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45435]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45434]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45434]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45465]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45463]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45434]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45438]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45465]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45435]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45434]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45465]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45434]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45465]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45434]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45434]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45465]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45434]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45465]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45434]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45465]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45434]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45465]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 systemd-udevd[45465]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:13:21 kjcf05n02 dwd[5242]: Starting NVME thread for nvme24n1 Nov 3 10:13:21 kjcf05n02 diskmonitor[17464]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 10:13:21 kjcf05n02 dwd[5242]: Starting NVME thread for nvme4n1 Nov 3 10:13:21 kjcf05n02 dwd[5242]: Starting NVME thread for nvme23n1 Nov 3 10:13:21 kjcf05n02 dwd[5242]: Starting NVME thread for nvme17n1 Nov 3 10:13:22 kjcf05n02 dwd[5242]: Starting NVME thread for nvme25n1 Nov 3 10:13:22 kjcf05n02 dwd[5242]: Starting NVME thread for nvme8n1 Nov 3 10:13:24 kjcf05n02 nslcd[6994]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 10:13:27 kjcf05n02 diskmonitor[17464]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 10:13:27 kjcf05n02 diskmonitor[17464]: Scan for ReadErrorMax change for md65 Nov 3 10:13:27 kjcf05n02 diskmonitor[17464]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 10:13:27 kjcf05n02 diskmonitor[17464]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 10:13:27 kjcf05n02 diskmonitor[17464]: read_saved_file: md65 no saved speed Nov 3 10:13:27 kjcf05n02 diskmonitor[17464]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 10:13:27 kjcf05n02 diskmonitor[17464]: Set sync_speed_min (10000) for md65 Nov 3 10:13:27 kjcf05n02 diskmonitor[17464]: Set sync_speed_max (200000) for md65 Nov 3 10:13:27 kjcf05n02 diskmonitor[17464]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 10:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T10:13:27.254287304-06:00 level=info msg="Completed cleanup jobs" duration=27.188481ms Nov 3 10:13:34 kjcf05n00 mcfcli[3673891]: %3|1730650414.392|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 10:13:48 kjcf05n00 mcfcli[3673891]: %3|1730650428.956|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:14:04 kjcf05n00 mcfcli[3673891]: %3|1730650444.392|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:14:12 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 10:14:12 kjcf05n02 systemd-tmpfiles[48848]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 10:14:12 kjcf05n02 systemd-tmpfiles[48848]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 10:14:12 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 10:14:12 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 10:14:13 kjcf05n03 diskmonitor[17376]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 10:14:13 kjcf05n03 diskmonitor[17376]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 10:14:17 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 49340 (bash) Nov 3 10:14:17 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 10:14:17 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 10:14:27 kjcf05n00 mcfcli[3673891]: %3|1730650467.094|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:14:34 kjcf05n00 mcfcli[3673891]: %3|1730650474.393|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:14:43 kjcf05n00 zabbix-server[1168998]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 10:14:43 kjcf05n00 zabbix-server[1168998]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46104' Nov 3 10:14:43 kjcf05n00 zabbix-server[1168998]: Filesystem 'kjcf05' has been mounted Nov 3 10:14:43 kjcf05n00 zabbix-server[1168998]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 10:14:43 kjcf05n00 zabbix-server[1168998]: Running puppet on 'None' Nov 3 10:14:45 kjcf05n04 puppet-agent[2881949]: Using configured environment 'production' Nov 3 10:14:45 kjcf05n04 puppet-agent[2881949]: Retrieving pluginfacts Nov 3 10:14:45 kjcf05n04 puppet-agent[2881949]: Retrieving plugin Nov 3 10:14:45 kjcf05n03 puppet-agent[104885]: Using configured environment 'production' Nov 3 10:14:45 kjcf05n03 puppet-agent[104885]: Retrieving pluginfacts Nov 3 10:14:45 kjcf05n03 puppet-agent[104885]: Retrieving plugin Nov 3 10:14:45 kjcf05n02 puppet-agent[50387]: Using configured environment 'production' Nov 3 10:14:45 kjcf05n02 puppet-agent[50387]: Retrieving pluginfacts Nov 3 10:14:45 kjcf05n02 puppet-agent[50387]: Retrieving plugin Nov 3 10:14:45 kjcf05n05 puppet-agent[3032951]: Using configured environment 'production' Nov 3 10:14:45 kjcf05n05 puppet-agent[3032951]: Retrieving pluginfacts Nov 3 10:14:45 kjcf05n05 puppet-agent[3032951]: Retrieving plugin Nov 3 10:14:45 kjcf05n06 puppet-agent[2877608]: Using configured environment 'production' Nov 3 10:14:45 kjcf05n06 puppet-agent[2877608]: Retrieving pluginfacts Nov 3 10:14:45 kjcf05n06 puppet-agent[2877608]: Retrieving plugin Nov 3 10:14:46 kjcf05n07 puppet-agent[2875534]: Using configured environment 'production' Nov 3 10:14:46 kjcf05n07 puppet-agent[2875534]: Retrieving pluginfacts Nov 3 10:14:46 kjcf05n07 puppet-agent[2875534]: Retrieving plugin Nov 3 10:14:46 kjcf05n07 puppet-agent[2875534]: Loading facts Nov 3 10:14:46 kjcf05n04 puppet-agent[2881949]: Loading facts Nov 3 10:14:46 kjcf05n02 puppet-agent[50387]: Loading facts Nov 3 10:14:46 kjcf05n01 puppet-agent[3035568]: Using configured environment 'production' Nov 3 10:14:46 kjcf05n01 puppet-agent[3035568]: Retrieving pluginfacts Nov 3 10:14:46 kjcf05n01 puppet-agent[3035568]: Retrieving plugin Nov 3 10:14:46 kjcf05n01 puppet-agent[3035568]: Loading facts Nov 3 10:14:46 kjcf05n05 puppet-agent[3032951]: Loading facts Nov 3 10:14:46 kjcf05n06 puppet-agent[2877608]: Loading facts Nov 3 10:14:46 kjcf05n03 puppet-agent[104885]: Loading facts Nov 3 10:14:46 kjcf05n00 puppet-agent[1169070]: Using configured environment 'production' Nov 3 10:14:46 kjcf05n00 puppet-agent[1169070]: Retrieving pluginfacts Nov 3 10:14:46 kjcf05n00 puppet-agent[1169070]: Retrieving plugin Nov 3 10:14:46 kjcf05n00 puppet-agent[1169070]: Loading facts Nov 3 10:14:49 kjcf05n03 puppet-agent[104885]: Caching catalog for kjcf05n03 Nov 3 10:14:49 kjcf05n03 puppet-agent[104885]: Applying configuration version '1730650487' Nov 3 10:14:49 kjcf05n07 puppet-agent[2875534]: Caching catalog for kjcf05n07 Nov 3 10:14:49 kjcf05n07 puppet-agent[2875534]: Applying configuration version '1730650487' Nov 3 10:14:49 kjcf05n02 puppet-agent[50387]: Caching catalog for kjcf05n02 Nov 3 10:14:49 kjcf05n02 puppet-agent[50387]: Applying configuration version '1730650487' Nov 3 10:14:49 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 10:14:49 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 10:14:49 kjcf05n06 puppet-agent[2877608]: Caching catalog for kjcf05n06 Nov 3 10:14:49 kjcf05n06 puppet-agent[2877608]: Applying configuration version '1730650487' Nov 3 10:14:53 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 10:14:53 kjcf05n01 puppet-agent[3035568]: Caching catalog for kjcf05n01 Nov 3 10:14:53 kjcf05n03 puppet-agent[104885]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 10:14:53 kjcf05n03 puppet-agent[104885]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 10:14:53 kjcf05n03 puppet-agent[104885]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 10:14:53 kjcf05n07 puppet-agent[2875534]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 10:14:53 kjcf05n07 puppet-agent[2875534]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 10:14:53 kjcf05n07 puppet-agent[2875534]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 10:14:53 kjcf05n02 puppet-agent[50387]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 10:14:53 kjcf05n02 puppet-agent[50387]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 10:14:53 kjcf05n02 puppet-agent[50387]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 10:14:53 kjcf05n06 puppet-agent[2877608]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 10:14:53 kjcf05n06 puppet-agent[2877608]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 10:14:53 kjcf05n06 puppet-agent[2877608]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 10:14:54 kjcf05n01 puppet-agent[3035568]: Applying configuration version '1730650488' Nov 3 10:14:54 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 10:14:54 kjcf05n02 zabbix_agent2[31114]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 10:14:54 kjcf05n02 zabbix_agent2[3225]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:14:54 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 10:14:54 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 10:14:54 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 10:14:54 kjcf05n02 puppet-agent[50387]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: Press Ctrl+C to exit. Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: Plugin support version 1.0 Nov 3 10:14:54 kjcf05n02 zabbix_agent2[50793]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 10:14:54 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 10:14:54 kjcf05n03 zabbix_agent2[49102]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 10:14:54 kjcf05n03 zabbix_agent2[3192]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 10:14:54 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 10:14:54 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 10:14:54 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 10:14:54 kjcf05n03 puppet-agent[104885]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: Press Ctrl+C to exit. Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: Plugin support version 1.0 Nov 3 10:14:54 kjcf05n03 zabbix_agent2[105305]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 10:14:54 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2823245]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 10:14:54 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 10:14:54 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 10:14:54 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 10:14:54 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 10:14:54 kjcf05n07 puppet-agent[2875534]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: Press Ctrl+C to exit. Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: Plugin support version 1.0 Nov 3 10:14:54 kjcf05n07 zabbix_agent2[2876013]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 10:14:54 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2825196]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 10:14:54 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 10:14:54 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 10:14:54 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 10:14:54 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 10:14:54 kjcf05n06 puppet-agent[2877608]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: Press Ctrl+C to exit. Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: Plugin support version 1.0 Nov 3 10:14:54 kjcf05n06 zabbix_agent2[2879244]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 10:14:54 kjcf05n00 puppet-agent[1169070]: Caching catalog for kjcf05n00 Nov 3 10:14:54 kjcf05n00 puppet-agent[1169070]: Applying configuration version '1730650488' Nov 3 10:14:56 kjcf05n07 puppet-agent[2875534]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 10:14:56 kjcf05n07 puppet-agent[2875534]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 10:14:56 kjcf05n07 puppet-agent[2875534]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 10:14:56 kjcf05n07 puppet-agent[2875534]: Applied catalog in 7.79 seconds Nov 3 10:14:56 kjcf05n06 puppet-agent[2877608]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 10:14:56 kjcf05n06 puppet-agent[2877608]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 10:14:56 kjcf05n06 puppet-agent[2877608]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 10:14:56 kjcf05n06 puppet-agent[2877608]: Applied catalog in 7.32 seconds Nov 3 10:14:56 kjcf05n03 puppet-agent[104885]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 10:14:56 kjcf05n03 puppet-agent[104885]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 10:14:56 kjcf05n03 puppet-agent[104885]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 10:14:56 kjcf05n03 puppet-agent[104885]: Applied catalog in 7.95 seconds Nov 3 10:14:57 kjcf05n02 puppet-agent[50387]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 10:14:57 kjcf05n02 puppet-agent[50387]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 10:14:57 kjcf05n02 puppet-agent[50387]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 10:14:57 kjcf05n02 puppet-agent[50387]: Applied catalog in 7.97 seconds Nov 3 10:14:57 kjcf05n01 puppet-agent[3035568]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 10:14:57 kjcf05n01 puppet-agent[3035568]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-09:55:12]/mode) mode changed '0755' to '0750' Nov 3 10:14:57 kjcf05n01 puppet-agent[3035568]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-09:55:12/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 10:14:57 kjcf05n01 puppet-agent[3035568]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-09:55:12/vmcore]/mode) mode changed '0600' to '0640' Nov 3 10:14:57 kjcf05n01 puppet-agent[3035568]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-09:55:12/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 10:14:57 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 10:14:57 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 10:14:57 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 10:14:58 kjcf05n01 puppet-agent[3035568]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 10:14:58 kjcf05n01 puppet-agent[3035568]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 10:14:58 kjcf05n01 puppet-agent[3035568]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 10:14:57 kjcf05n00 puppet-agent[1169070]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 10:14:59 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3024076]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 10:14:59 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 10:14:59 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 10:14:59 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 10:14:59 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 10:14:59 kjcf05n01 puppet-agent[3035568]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: Press Ctrl+C to exit. Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: Plugin support version 1.0 Nov 3 10:14:59 kjcf05n01 zabbix_agent2[3035993]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 10:14:59 kjcf05n00 puppet-agent[1169070]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 10:14:59 kjcf05n00 puppet-agent[1169070]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 10:14:59 kjcf05n00 puppet-agent[1169070]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 10:14:59 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1151234]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 10:15:00 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 10:14:59 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 10:14:59 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 10:14:59 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 10:14:59 kjcf05n00 puppet-agent[1169070]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: Press Ctrl+C to exit. Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: Plugin support version 1.0 Nov 3 10:14:59 kjcf05n00 zabbix_agent2[1169711]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 10:15:00 kjcf05n00 zabbix-server[1169742]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 10:15:00 kjcf05n00 zabbix-server[1169766]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 10:15:01 kjcf05n00 zabbix-server[1169773]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 10:15:01 kjcf05n01 puppet-agent[3035568]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_100234.log]/mode) mode changed '0644' to '0640' Nov 3 10:15:01 kjcf05n01 puppet-agent[3035568]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_101417.log]/mode) mode changed '0644' to '0640' Nov 3 10:15:01 kjcf05n01 puppet-agent[3035568]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_101418]/mode) mode changed '0755' to '0750' Nov 3 10:15:01 kjcf05n01 puppet-agent[3035568]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_101418/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 10:15:01 kjcf05n05 puppet-agent[3032951]: Caching catalog for kjcf05n05 Nov 3 10:15:01 kjcf05n05 puppet-agent[3032951]: Applying configuration version '1730650497' Nov 3 10:15:01 kjcf05n00 zabbix-server[1169782]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 10:15:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730650501}"] Nov 3 10:15:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730650501, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:15:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.359599ms Nov 3 10:15:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.359599ms Nov 3 10:15:01 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:15:01 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:15:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:15:01 kjcf05n01 puppet-agent[3035568]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_100232.log]/mode) mode changed '0644' to '0640' Nov 3 10:15:01 kjcf05n01 puppet-agent[3035568]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_101417.log]/mode) mode changed '0644' to '0640' Nov 3 10:15:01 kjcf05n01 puppet-agent[3035568]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 10:15:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730650501}"] Nov 3 10:15:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730650501, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:15:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.375259ms Nov 3 10:15:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.375259ms Nov 3 10:15:01 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:15:01 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:15:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:15:01 kjcf05n00 puppet-agent[1169070]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 10:15:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730650501}"] Nov 3 10:15:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730650501, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:15:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.202315ms Nov 3 10:15:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.202315ms Nov 3 10:15:01 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:15:01 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:15:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:15:01 kjcf05n01 puppet-agent[3035568]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 10:15:01 kjcf05n01 puppet-agent[3035568]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 10:15:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730650501}"] Nov 3 10:15:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730650501, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:15:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 3.113231ms Nov 3 10:15:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 3.113231ms Nov 3 10:15:01 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:15:01 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:15:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:15:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730650501}"] Nov 3 10:15:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730650501, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:15:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.169293ms Nov 3 10:15:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.169293ms Nov 3 10:15:01 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:15:01 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:15:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730650501}"] Nov 3 10:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730650501, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.841912ms Nov 3 10:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.841912ms Nov 3 10:15:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:15:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:15:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730650501}"] Nov 3 10:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730650501, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.294387ms Nov 3 10:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.294387ms Nov 3 10:15:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:15:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:15:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730650501}"] Nov 3 10:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730650501, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.725835ms Nov 3 10:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.725835ms Nov 3 10:15:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:15:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:15:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730650501}"] Nov 3 10:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730650501, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.93817ms Nov 3 10:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.93817ms Nov 3 10:15:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:15:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:15:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730650501}"] Nov 3 10:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730650501, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.514309ms Nov 3 10:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.514309ms Nov 3 10:15:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:15:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:15:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:15:02 kjcf05n00 puppet-agent[1169070]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 10:15:03 kjcf05n01 puppet-agent[3035568]: Applied catalog in 9.32 seconds Nov 3 10:15:02 kjcf05n00 puppet-agent[1169070]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 10:15:02 kjcf05n00 puppet-agent[1169070]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 10:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730650501}"] Nov 3 10:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730650501, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.526061ms Nov 3 10:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.526061ms Nov 3 10:15:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:15:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:15:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:15:03 kjcf05n05 puppet-agent[3032951]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 10:15:03 kjcf05n05 puppet-agent[3032951]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 10:15:03 kjcf05n05 puppet-agent[3032951]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 10:15:03 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 10:15:03 kjcf05n00 mcfcli[3673891]: %3|1730650503.600|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:15:03 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 10:15:04 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 10:15:03 kjcf05n00 puppet-agent[1169070]: Applied catalog in 9.06 seconds Nov 3 10:15:04 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 10:15:04 kjcf05n05 zabbix_agent2[2975850]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 10:15:04 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 10:15:04 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 10:15:04 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 10:15:04 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 10:15:04 kjcf05n05 puppet-agent[3032951]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: Press Ctrl+C to exit. Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: Plugin support version 1.0 Nov 3 10:15:04 kjcf05n05 zabbix_agent2[3033705]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 10:15:04 kjcf05n00 mcfcli[3673891]: %3|1730650504.394|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 10:15:05 kjcf05n05 puppet-agent[3032951]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 10:15:05 kjcf05n05 puppet-agent[3032951]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 10:15:05 kjcf05n05 puppet-agent[3032951]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 10:15:06 kjcf05n05 puppet-agent[3032951]: Applied catalog in 4.90 seconds Nov 3 10:15:09 kjcf05n04 puppet-agent[2881949]: Caching catalog for kjcf05n04 Nov 3 10:15:09 kjcf05n04 puppet-agent[2881949]: Applying configuration version '1730650505' Nov 3 10:15:11 kjcf05n04 puppet-agent[2881949]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 10:15:11 kjcf05n04 puppet-agent[2881949]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 10:15:11 kjcf05n04 puppet-agent[2881949]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 10:15:11 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2824649]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 10:15:11 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 10:15:11 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 10:15:11 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 10:15:11 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 10:15:11 kjcf05n04 puppet-agent[2881949]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: Press Ctrl+C to exit. Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: Plugin support version 1.0 Nov 3 10:15:11 kjcf05n04 zabbix_agent2[2882964]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 10:15:13 kjcf05n04 puppet-agent[2881949]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 10:15:13 kjcf05n04 puppet-agent[2881949]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 10:15:13 kjcf05n04 puppet-agent[2881949]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 10:15:13 kjcf05n04 puppet-agent[2881949]: Applied catalog in 4.80 seconds Nov 3 10:15:13 kjcf05n00 zabbix-server[1168998]: puppet completed status:(0): '' Nov 3 10:15:13 kjcf05n00 zabbix-server[1168998]: Event '46104' acknowledged Nov 3 10:15:13 kjcf05n00 zabbix-server[1168998]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 3 10:15:14 kjcf05n00 python3.9[1169779]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 10:15:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730650527', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 10:15:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730650527'} Nov 3 10:15:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:15:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730650527', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 10:15:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730650527'} Nov 3 10:15:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:15:34 kjcf05n00 mcfcli[3673891]: %3|1730650534.394|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 10:15:39 kjcf05n00 mcfcli[3673891]: %3|1730650539.920|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:16:04 kjcf05n00 mcfcli[3673891]: %3|1730650564.394|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 10:16:18 kjcf05n00 mcfcli[3673891]: %3|1730650578.683|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:16:34 kjcf05n00 mcfcli[3673891]: %3|1730650594.394|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:16:56 kjcf05n00 mcfcli[3673891]: %3|1730650616.621|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:17:04 kjcf05n00 mcfcli[3673891]: %3|1730650624.394|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:17:34 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 10:17:33 kjcf05n00 mcfcli[3673891]: %3|1730650653.888|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:17:34 kjcf05n00 mcfcli[3673891]: %3|1730650654.394|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 10:18:04 kjcf05n00 mcfcli[3673891]: %3|1730650684.396|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:18:09 kjcf05n00 mcfcli[3673891]: %3|1730650689.420|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:18:34 kjcf05n00 mcfcli[3673891]: %3|1730650714.396|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 10:18:35 kjcf05n02 dwd[5242]: nvme9n1 passed periodic SMART status check Nov 3 10:18:35 kjcf05n02 dwd[5242]: nvme19n1 passed periodic SMART status check Nov 3 10:18:35 kjcf05n02 dwd[5242]: nvme18n1 passed periodic SMART status check Nov 3 10:18:35 kjcf05n02 dwd[5242]: nvme2n1 passed periodic SMART status check Nov 3 10:18:36 kjcf05n02 dwd[5242]: nvme23n1 passed periodic SMART status check Nov 3 10:18:36 kjcf05n02 dwd[5242]: nvme4n1 passed periodic SMART status check Nov 3 10:18:36 kjcf05n02 dwd[5242]: nvme8n1 passed periodic SMART status check Nov 3 10:18:36 kjcf05n02 dwd[5242]: nvme25n1 passed periodic SMART status check Nov 3 10:18:36 kjcf05n02 dwd[5242]: nvme24n1 passed periodic SMART status check Nov 3 10:18:36 kjcf05n02 dwd[5242]: nvme17n1 passed periodic SMART status check Nov 3 10:18:36 kjcf05n02 dwd[5242]: nvme3n1 passed periodic SMART status check Nov 3 10:18:46 kjcf05n00 mcfcli[3673891]: %3|1730650726.990|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:19:04 kjcf05n00 mcfcli[3673891]: %3|1730650744.396|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:19:25 kjcf05n00 mcfcli[3673891]: %3|1730650765.683|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:19:34 kjcf05n00 mcfcli[3673891]: %3|1730650774.396|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 10:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 10:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 10:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 10:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 10:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 10:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 10:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 10:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 10:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 10:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 10:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 10:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 10:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 10:20:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 10:20:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:20:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 10:20:03 kjcf05n00 mcfcli[3673891]: %3|1730650803.917|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:20:04 kjcf05n00 mcfcli[3673891]: %3|1730650804.396|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 10:20:08 kjcf05n00 python3.9[1172677]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 10:20:34 kjcf05n00 mcfcli[3673891]: %3|1730650834.398|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 10:20:40 kjcf05n00 mcfcli[3673891]: %3|1730650840.571|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:21:04 kjcf05n00 mcfcli[3673891]: %3|1730650864.398|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:21:20 kjcf05n00 mcfcli[3673891]: %3|1730650880.548|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:21:34 kjcf05n00 mcfcli[3673891]: %3|1730650894.398|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:22:00 kjcf05n00 mcfcli[3673891]: %3|1730650920.444|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:22:04 kjcf05n00 mcfcli[3673891]: %3|1730650924.398|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 10:22:34 kjcf05n00 mcfcli[3673891]: %3|1730650954.398|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:22:38 kjcf05n00 mcfcli[3673891]: %3|1730650958.057|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:23:04 kjcf05n00 mcfcli[3673891]: %3|1730650984.399|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 10:23:09 kjcf05n03 nslcd[7088]: [e87ccd] ldap_result() failed: Can't contact LDAP server Nov 3 10:23:12 kjcf05n00 mcfcli[3673891]: %3|1730650992.670|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T16:23:15.867476Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 10:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T16:23:15.867565Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.110ms Nov 3 10:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T10:23:27.268254985-06:00 level=info msg="Completed cleanup jobs" duration=41.653282ms Nov 3 10:23:34 kjcf05n00 mcfcli[3673891]: %3|1730651014.399|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:23:52 kjcf05n00 mcfcli[3673891]: %3|1730651032.301|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:23:58 kjcf05n03 nslcd[7088]: [7ed7ab] ldap_result() failed: Can't contact LDAP server Nov 3 10:24:04 kjcf05n00 mcfcli[3673891]: %3|1730651044.399|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:24:09 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 3 10:24:09 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 8 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007479 sec, idle for 1 hour(s)] Nov 3 10:24:30 kjcf05n00 mcfcli[3673891]: %3|1730651070.810|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:24:34 kjcf05n00 mcfcli[3673891]: %3|1730651074.400|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:25:03 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 10:25:04 kjcf05n00 mcfcli[3673891]: %3|1730651104.401|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 10:25:07 kjcf05n00 mcfcli[3673891]: %3|1730651107.380|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:25:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 10:25:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 10:25:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 10:25:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 10:25:23 kjcf05n00 zabbix_server[15738]: Zabbix agent item "vfs.fs.size[/etc/ganesha,total]" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 3 10:25:23 kjcf05n00 zabbix_server[15770]: Zabbix agent item "dcs.lustre.device.discovery[{$LUSTRE_FS_NAME},mdt]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 3 10:25:26 kjcf05n00 python3.9[1175793]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 10:25:28 kjcf05n03 fstonithd.py[15106]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 3 10:25:29 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 10:25:29 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 10:25:29 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 10:25:30 kjcf05n03 root[122848]: is_viking_off starts Nov 3 10:25:30 kjcf05n03 root[122846]: is_enc_ipmi_off starts Nov 3 10:25:30 kjcf05n03 root[122864]: is_lan_ipmi_off leaves Nov 3 10:25:30 kjcf05n03 root[122866]: is_lan_ipmi_sec_off leaves Nov 3 10:25:30 kjcf05n03 root[122871]: I am master Nov 3 10:25:30 kjcf05n03 root[122872]: I am in slot 1; partner is in slot 0 Nov 3 10:25:32 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='39', error='Connection reset by peer (104)' Nov 3 10:25:32 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='39', client='AF_INET(172.16.2.5:41723)', local='AF_INET(0.0.0.0:601)' Nov 3 10:25:34 kjcf05n00 mcfcli[3673891]: %3|1730651134.401|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 10:25:37 kjcf05n03 root[122977]: is_viking_off leaves Nov 3 10:25:37 kjcf05n03 root[122980]: kjcf05n02 not already off look at kdump Nov 3 10:25:37 kjcf05n03 root[122981]: is_kdump_off starts Nov 3 10:25:37 kjcf05n03 fence_kdump[122982]: waiting for message from '172.16.2.5' Nov 3 10:25:37 kjcf05n03 fence_kdump[122982]: received valid message from '172.16.2.5' Nov 3 10:25:37 kjcf05n03 root[122983]: is_kdump_off detected kdump on kjcf05n02 Nov 3 10:25:37 kjcf05n03 root[122984]: kjcf05n02 is kdumping Nov 3 10:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 10:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 10:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 10:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 10:25:37 kjcf05n03 root[123081]: is_viking_off starts Nov 3 10:25:37 kjcf05n03 root[123080]: is_enc_ipmi_off starts Nov 3 10:25:38 kjcf05n03 root[123097]: is_lan_ipmi_off leaves Nov 3 10:25:38 kjcf05n03 root[123099]: is_lan_ipmi_sec_off leaves Nov 3 10:25:38 kjcf05n03 root[123102]: I am in slot 1; partner is in slot 0 Nov 3 10:25:38 kjcf05n03 root[123105]: I am master Nov 3 10:25:38 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0000,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 10:25:38 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.cpu.intr" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 10:25:44 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 10:25:44 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 10:25:45 kjcf05n03 root[123303]: is_viking_off leaves Nov 3 10:25:45 kjcf05n03 root[123306]: kjcf05n02 not already off look at kdump Nov 3 10:25:45 kjcf05n03 root[123307]: is_kdump_off starts Nov 3 10:25:45 kjcf05n03 fence_kdump[123308]: waiting for message from '172.16.2.5' Nov 3 10:25:45 kjcf05n03 fence_kdump[123308]: received valid message from '172.16.2.5' Nov 3 10:25:45 kjcf05n03 root[123328]: is_kdump_off detected kdump on kjcf05n02 Nov 3 10:25:45 kjcf05n03 root[123329]: kjcf05n02 is kdumping Nov 3 10:25:47 kjcf05n00 mcfcli[3673891]: %3|1730651147.377|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:25:50 kjcf05n03 systemd-udevd[125537]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125538]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125539]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125541]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125537]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125538]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125541]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125539]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125537]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125538]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125539]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125541]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125537]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125538]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125539]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125541]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125537]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125538]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125539]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125537]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125541]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125539]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125538]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125537]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125541]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125539]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125538]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125567]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125537]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125570]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125541]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125572]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125539]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125567]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125575]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125538]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125570]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125541]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125539]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125537]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125541]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125539]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125539]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125539]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125570]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125539]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125541]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125537]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125575]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125539]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125541]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125537]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125570]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125539]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125570]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125570]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125539]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125570]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125539]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125570]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125539]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125570]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125570]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 systemd-udevd[125570]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:25:50 kjcf05n03 dwd[5194]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 10:25:50 kjcf05n03 dwd[5194]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 10:25:50 kjcf05n03 dwd[5194]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 10:25:50 kjcf05n03 dwd[5194]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 10:25:50 kjcf05n03 dwd[5194]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 10:25:50 kjcf05n03 dwd[5194]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 10:25:50 kjcf05n03 dwd[5194]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 10:25:50 kjcf05n03 dwd[5194]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 10:25:50 kjcf05n03 dwd[5194]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 10:25:50 kjcf05n03 dwd[5194]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 10:25:50 kjcf05n03 dwd[5194]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 10:25:50 kjcf05n03 dwd[5194]: Starting NVME thread for nvme23n1 Nov 3 10:25:50 kjcf05n03 dwd[5194]: Starting NVME thread for nvme18n1 Nov 3 10:25:50 kjcf05n03 dwd[5194]: Starting NVME thread for nvme25n1 Nov 3 10:25:50 kjcf05n03 dwd[5194]: Starting NVME thread for nvme17n1 Nov 3 10:25:50 kjcf05n03 dwd[5194]: Starting NVME thread for nvme3n1 Nov 3 10:25:51 kjcf05n03 dwd[5194]: Starting NVME thread for nvme9n1 Nov 3 10:25:51 kjcf05n03 dwd[5194]: Starting NVME thread for nvme8n1 Nov 3 10:25:51 kjcf05n03 dwd[5194]: Starting NVME thread for nvme19n1 Nov 3 10:25:51 kjcf05n03 dwd[5194]: Starting NVME thread for nvme24n1 Nov 3 10:25:51 kjcf05n03 dwd[5194]: Starting NVME thread for nvme2n1 Nov 3 10:25:52 kjcf05n03 dwd[5194]: Starting NVME thread for nvme4n1 Nov 3 10:25:53 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.cpu.load[all,avg5]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 10:25:53 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0002,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 10:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 10:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 10:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 10:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 10:25:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 10:25:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 10:25:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 10:25:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 10:26:02 kjcf05n03 diskmonitor[17376]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 10:26:04 kjcf05n00 mcfcli[3673891]: %3|1730651164.401|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 10:26:08 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 3 10:26:08 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 3 10:26:12 kjcf05n03 diskmonitor[17376]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 10:26:12 kjcf05n03 diskmonitor[17376]: Scan for ReadErrorMax change for md65 Nov 3 10:26:12 kjcf05n03 diskmonitor[17376]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 10:26:12 kjcf05n03 diskmonitor[17376]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 10:26:12 kjcf05n03 diskmonitor[17376]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.min.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 10:26:12 kjcf05n03 diskmonitor[17376]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.max.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 10:26:12 kjcf05n03 diskmonitor[17376]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 10:26:12 kjcf05n03 diskmonitor[17376]: Set sync_speed_min (10000) for md65 Nov 3 10:26:12 kjcf05n03 diskmonitor[17376]: Set sync_speed_max (200000) for md65 Nov 3 10:26:12 kjcf05n03 diskmonitor[17376]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 10:26:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 10:26:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 10:26:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 10:26:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 10:26:25 kjcf05n00 mcfcli[3673891]: %3|1730651185.401|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:26:34 kjcf05n00 mcfcli[3673891]: %3|1730651194.402|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 10:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 10:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 10:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 10:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 10:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 10:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 10:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 10:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 10:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 10:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 10:26:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 10:26:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 10:27:00 kjcf05n03 nslcd[7088]: [b141f2] ldap_result() failed: Can't contact LDAP server Nov 3 10:27:01 kjcf05n03 nslcd[7088]: [b71efb] ldap_result() failed: Can't contact LDAP server Nov 3 10:27:02 kjcf05n00 mcfcli[3673891]: %3|1730651222.846|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:27:04 kjcf05n00 mcfcli[3673891]: %3|1730651224.402|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 10:27:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 10:27:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 10:27:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 10:27:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 10:27:34 kjcf05n00 mcfcli[3673891]: %3|1730651254.402|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 10:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 10:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 10:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 10:27:40 kjcf05n00 mcfcli[3673891]: %3|1730651260.023|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 10:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 10:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 10:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 10:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 10:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 10:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 10:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 10:28:04 kjcf05n00 mcfcli[3673891]: %3|1730651284.403|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:28:11 kjcf05n00 zabbix-server[1177462]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 10:28:11 kjcf05n00 zabbix-server[1177462]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 10:28:11 kjcf05n00 log_interesting_event.py[1177462]: Event '46107' acknowledged Nov 3 10:28:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 10:28:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 10:28:20 kjcf05n00 mcfcli[3673891]: %3|1730651300.020|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:28:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 10:28:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 10:28:29 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 10:28:34 kjcf05n00 mcfcli[3673891]: %3|1730651314.403|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 10:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 10:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 10:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 10:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 10:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 10:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 10:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 10:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 10:28:57 kjcf05n00 mcfcli[3673891]: %3|1730651337.833|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 10:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 10:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 10:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 10:29:04 kjcf05n00 mcfcli[3673891]: %3|1730651344.404|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 10:29:17 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 3 10:29:17 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 10:29:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 10:29:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 10:29:21 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 10:29:21 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 3 10:29:21 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 3 10:29:21 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 10:29:21 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 10:29:21 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 3 10:29:21 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 3 10:29:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 10:29:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 10:29:23 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 3 10:29:26 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 3 10:29:34 kjcf05n00 mcfcli[3673891]: %3|1730651374.405|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:29:35 kjcf05n00 mcfcli[3673891]: %3|1730651375.365|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 10:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 10:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 10:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 10:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 10:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 10:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 10:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 10:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 10:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 10:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 10:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 10:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 10:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 10:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 10:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 10:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 10:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 10:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 10:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 10:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 10:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 10:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 10:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 10:30:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 10:30:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:30:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 10:30:04 kjcf05n00 mcfcli[3673891]: %3|1730651404.405|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 10:30:08 kjcf05n00 python3.9[1178870]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 10:30:12 kjcf05n00 mcfcli[3673891]: %3|1730651412.195|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:30:13 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:53184). Nov 3 10:30:13 kjcf05n01 rsyncd[3042137]: connect from kjcf05n02 (172.16.2.5) Nov 3 10:30:13 kjcf05n01 rsyncd[3042137]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 10:30:13 kjcf05n01 rsyncd[3042137]: building file list Nov 3 10:30:13 kjcf05n01 rsyncd[3042137]: sent 11450 bytes received 136 bytes total size 10905 Nov 3 10:30:13 kjcf05n01 systemd[1]: rsyncd@619-172.16.2.2:873-172.16.2.5:53184.service: Succeeded. Nov 3 10:30:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 10:30:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 10:30:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 10:30:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 10:30:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730651423', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 10:30:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730651423'} Nov 3 10:30:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:30:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730651423', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 10:30:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730651423'} Nov 3 10:30:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:30:29 kjcf05n03 fstonithd.py[15106]: Listening for kdump packets from partner Nov 3 10:30:34 kjcf05n00 mcfcli[3673891]: %3|1730651434.906|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 10:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 10:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 10:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 10:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 10:30:47 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 10:30:49 kjcf05n00 mcfcli[3673891]: %3|1730651449.150|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:30:54 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 10:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 10:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 10:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 10:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 10:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 10:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 10:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 10:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 10:31:05 kjcf05n00 mcfcli[3673891]: %3|1730651465.190|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 10:31:16 kjcf05n03 dwd[5194]: nvme3n1 passed periodic SMART status check Nov 3 10:31:16 kjcf05n03 dwd[5194]: nvme17n1 passed periodic SMART status check Nov 3 10:31:16 kjcf05n03 dwd[5194]: nvme25n1 passed periodic SMART status check Nov 3 10:31:16 kjcf05n03 dwd[5194]: nvme18n1 passed periodic SMART status check Nov 3 10:31:16 kjcf05n03 dwd[5194]: nvme23n1 passed periodic SMART status check Nov 3 10:31:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 10:31:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 10:31:17 kjcf05n03 dwd[5194]: nvme19n1 passed periodic SMART status check Nov 3 10:31:17 kjcf05n03 dwd[5194]: nvme24n1 passed periodic SMART status check Nov 3 10:31:17 kjcf05n03 dwd[5194]: nvme8n1 passed periodic SMART status check Nov 3 10:31:17 kjcf05n03 dwd[5194]: nvme2n1 passed periodic SMART status check Nov 3 10:31:17 kjcf05n03 dwd[5194]: nvme9n1 passed periodic SMART status check Nov 3 10:31:18 kjcf05n03 dwd[5194]: nvme4n1 passed periodic SMART status check Nov 3 10:31:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 10:31:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 10:31:22 kjcf05n00 zabbix-server[1179804]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 10:31:22 kjcf05n00 zabbix-server[1179804]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 96.78\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 130.53\\"}}"' Nov 3 10:31:22 kjcf05n00 log_interesting_event.py[1179804]: Event '46108' acknowledged Nov 3 10:31:23 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 10:31:27 kjcf05n00 mcfcli[3673891]: %3|1730651487.659|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:31:35 kjcf05n00 mcfcli[3673891]: %3|1730651495.191|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 10:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 10:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 10:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 10:31:38 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='39', client='AF_INET(172.16.2.5:45377)', local='AF_INET(0.0.0.0:601)' Nov 3 10:31:38 kjcf05n02 syslog-ng[3186]: Configuration reload request received, reloading configuration; Nov 3 10:31:38 kjcf05n02 syslog-ng[3186]: Configuration reload finished; Nov 3 10:31:38 kjcf05n02 syslog-ng[3186]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 10:31:38 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 3 10:31:38 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 10:31:38 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 3 10:31:38 kjcf05n02 dracut: Self testing crypto algorithms Nov 3 10:31:38 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 3 10:31:38 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 10:31:38 kjcf05n02 Copying live image to RAM... Nov 3 10:31:38 kjcf05n02 (this may take a minute) Nov 3 10:31:38 kjcf05n02 Done copying live image to RAM. Nov 3 10:31:38 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 10:31:38 kjcf05n02 dracut: Checking integrity of kernel Nov 3 10:31:38 kjcf05n02 dracut: All initrd crypto checks done Nov 3 10:31:38 kjcf05n02 dracut: Switching root Nov 3 10:31:38 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 10:31:38 kjcf05n02 systemd: Detected architecture x86-64. Nov 3 10:31:38 kjcf05n02 systemd: Set hostname to . Nov 3 10:31:38 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 10:31:38 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 10:31:38 kjcf05n02 systemd: Created slice system-sshd\x2dkeygen.slice. Nov 3 10:31:38 kjcf05n02 systemd: Started Dispatch Password Requests to Console Directory Watch. Nov 3 10:31:38 kjcf05n02 systemd: Reached target rpc_pipefs.target. Nov 3 10:31:38 kjcf05n02 systemd: Listening on RPCbind Server Activation Socket. Nov 3 10:31:38 kjcf05n02 systemd: Listening on LVM2 poll daemon socket. Nov 3 10:31:38 kjcf05n02 systemd-journald[1515]: Journal started Nov 3 10:31:38 kjcf05n02 systemd-journald[1515]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Create list of required static device nodes for the current kernel. Nov 3 10:31:38 kjcf05n02 systemd[1]: Mounted /WIBS. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 3 10:31:38 kjcf05n02 systemd-modules-load[1526]: Inserted module 'fuse' Nov 3 10:31:38 kjcf05n02 systemd[1]: Mounted Kernel Debug File System. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Remount Root and Kernel File Systems. Nov 3 10:31:38 kjcf05n02 systemd[1]: Mounted Temporary Directory (/tmp). Nov 3 10:31:38 kjcf05n02 systemd[1]: Mounted POSIX Message Queue File System. Nov 3 10:31:38 kjcf05n02 systemd[1]: Mounted /mnt. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Load Kernel Modules. Nov 3 10:31:38 kjcf05n02 systemd[1]: Mounted Huge Pages File System. Nov 3 10:31:38 kjcf05n02 systemd[1]: Mounted /data. Nov 3 10:31:38 kjcf05n02 systemd[1]: Mounting FUSE Control File System... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Apply Kernel Variables... Nov 3 10:31:38 kjcf05n02 systemd[1]: Mounting Kernel Configuration File System... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Rebuild Hardware Database... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Create System Users... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Load/Save Random Seed... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 10:31:38 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 3 10:31:38 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 3 10:31:38 kjcf05n02 systemd-sysctl[1538]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 10:31:38 kjcf05n02 systemd-sysctl[1538]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Create System Users. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 10:31:38 kjcf05n02 systemd-journald[1515]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 10:31:38 kjcf05n02 systemd-tmpfiles[1550]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 10:31:38 kjcf05n02 systemd-tmpfiles[1550]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 3 10:31:38 kjcf05n02 systemd-udevd[1559]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 3 10:31:38 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 3 10:31:38 kjcf05n02 systemd-udevd[1587]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:31:38 kjcf05n02 systemd-udevd[1623]: Using default interface naming scheme 'rhel-8.0'. Nov 3 10:31:38 kjcf05n02 systemd-udevd[1623]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:31:38 kjcf05n02 systemd-udevd[1583]: Using default interface naming scheme 'rhel-8.0'. Nov 3 10:31:38 kjcf05n02 systemd-udevd[1583]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:31:38 kjcf05n02 systemd-udevd[1585]: Using default interface naming scheme 'rhel-8.0'. Nov 3 10:31:38 kjcf05n02 systemd-udevd[1585]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 10:31:38 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 3 10:31:38 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 10:31:38 kjcf05n02 root[1796]: openibd: running in auto mode Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 10:31:38 kjcf05n02 systemd-tmpfiles[1806]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 10:31:38 kjcf05n02 systemd-tmpfiles[1806]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 10:31:38 kjcf05n02 systemd-tmpfiles[1806]: "/var/tmp" already exists and is not a directory. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 3 10:31:38 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 3 10:31:38 kjcf05n02 systemd-modules-load[1852]: Inserted module 'ib_iser' Nov 3 10:31:38 kjcf05n02 systemd[1]: Started RPC Bind. Nov 3 10:31:38 kjcf05n02 systemd-modules-load[1852]: Inserted module 'ib_isert' Nov 3 10:31:38 kjcf05n02 systemd-modules-load[1852]: Inserted module 'ib_srpt' Nov 3 10:31:38 kjcf05n02 systemd-udevd[1623]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:31:38 kjcf05n02 systemd-udevd[1573]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:31:38 kjcf05n02 systemd-modules-load[1853]: Inserted module 'ib_ipoib' Nov 3 10:31:38 kjcf05n02 systemd-modules-load[1852]: Inserted module 'rdma_ucm' Nov 3 10:31:38 kjcf05n02 systemd-modules-load[1852]: Module 'svcrdma' is blacklisted Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 10:31:38 kjcf05n02 systemd-udevd[1623]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 10:31:38 kjcf05n02 systemd-udevd[1573]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 10:31:38 kjcf05n02 systemd-modules-load[1853]: Inserted module 'ib_umad' Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 10:31:38 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 3 10:31:38 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 3 10:31:38 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 10:31:38 kjcf05n02 systemd[3186]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:31:38 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 10:31:38 kjcf05n02 openibd[1776]: Loading HCA driver and Access Layer:[ OK ] Nov 3 10:31:38 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Update is Completed. Nov 3 10:31:38 kjcf05n02 setup-icl[1764]: Setting LAN IP Address to 203.0.113.3 Nov 3 10:31:38 kjcf05n02 setup-icl[1764]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 10:31:38 kjcf05n02 setup-icl[1764]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 10:31:38 kjcf05n02 setup-icl[1764]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 10:31:38 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 10:31:38 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 3 10:31:38 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 10:31:38 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 10:31:38 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 10:31:38 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 3 10:31:38 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 10:31:38 kjcf05n02 systemd[1]: Reached target Sockets. Nov 3 10:31:38 kjcf05n02 systemd[1]: Reached target Basic System. Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 10:31:38 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 0 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 1 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 2 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 3 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 4 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 5 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 6 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 7 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 8 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 9 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 10 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 11 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 12 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 13 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 14 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 15 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 16 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 17 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 18 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 19 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 20 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 21 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 22 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 23 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 24 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 25 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 26 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 27 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 28 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 29 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 30 Nov 3 10:31:38 kjcf05n02 cpupower[2111]: Setting cpu: 31 Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 10:31:38 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 10:31:38 kjcf05n02 network[2126]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 10:31:38 kjcf05n02 chronyd[2163]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 10:31:38 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[2129]: Setting up Mellanox network interface: ib1 Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 10:31:38 kjcf05n02 beSetMlxConfig[2139]: ConnectX-3 multiport not detected Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 10:31:38 kjcf05n02 network[2164]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 10:31:38 kjcf05n02 network[2126]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[2165]: Setting up Mellanox network interface: ib0 Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 10:31:38 kjcf05n02 nscd[2240]: 2240 monitoring file `/etc/hosts` (1) Nov 3 10:31:38 kjcf05n02 nscd[2240]: 2240 monitoring directory `/etc` (2) Nov 3 10:31:38 kjcf05n02 nscd[2240]: 2240 monitoring file `/etc/resolv.conf` (3) Nov 3 10:31:38 kjcf05n02 nscd[2240]: 2240 monitoring directory `/etc` (2) Nov 3 10:31:38 kjcf05n02 network[2190]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:31:38 kjcf05n02 network[2126]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 10:31:38 kjcf05n02 mdraid-phy[2204]: no Cutlass to worry about Nov 3 10:31:38 kjcf05n02 dbus-daemon[2167]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 10:31:38 kjcf05n02 chronyd[2163]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 10:31:38 kjcf05n02 chronyd[2163]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 10:31:38 kjcf05n02 network[2255]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 10:31:38 kjcf05n02 beSetMlxConfig[2139]: Starting MST (Mellanox Software Tools) driver set Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[2258]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[2260]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 10:31:38 kjcf05n02 mcelog[2289]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 10:31:38 kjcf05n02 mcelog[2289]: CPU is unsupported Nov 3 10:31:38 kjcf05n02 dwd[2261]: dwd: vMay 29 2024 : 15:38:26 Nov 3 10:31:38 kjcf05n02 dwd[2261]: /usr/sbin/dwd -d --standalone=0 Nov 3 10:31:38 kjcf05n02 dwd[2261]: dwd: option Lethal: 0 Nov 3 10:31:38 kjcf05n02 dwd[2261]: dwd: option Interval: 60 Nov 3 10:31:38 kjcf05n02 dwd[2261]: dwd: option abrtlimit: 10 Nov 3 10:31:38 kjcf05n02 dwd[2261]: dwd: option DZPeriod: 604800 Nov 3 10:31:38 kjcf05n02 dwd[2261]: dwd: option SmartPeriod: 43200 Nov 3 10:31:38 kjcf05n02 dwd[2261]: dwd: option SDDEnabled: 1 Nov 3 10:31:38 kjcf05n02 dwd[2261]: dwd: option SDDAwaitScale: 3 Nov 3 10:31:38 kjcf05n02 dwd[2261]: dwd: option SDDAwaitMin: 100 Nov 3 10:31:38 kjcf05n02 dwd[2261]: dwd: option Verbosity: 1 Nov 3 10:31:38 kjcf05n02 dwd[2261]: dwd: option StandAlone: 0 Nov 3 10:31:38 kjcf05n02 dwd[2261]: option Lethal: 0 Nov 3 10:31:38 kjcf05n02 dwd[2261]: option Interval: 60 Nov 3 10:31:38 kjcf05n02 dwd[2261]: option abrtlimit: 10 Nov 3 10:31:38 kjcf05n02 dwd[2261]: option DZPeriod: 604800 Nov 3 10:31:38 kjcf05n02 dwd[2261]: option SmartPeriod: 43200 Nov 3 10:31:38 kjcf05n02 dwd[2261]: option SDDEnabled: 1 Nov 3 10:31:38 kjcf05n02 dwd[2261]: option SDDAwaitScale: 3 Nov 3 10:31:38 kjcf05n02 dwd[2261]: option SDDAwaitMin: 100 Nov 3 10:31:38 kjcf05n02 dwd[2261]: option Verbosity: 1 Nov 3 10:31:38 kjcf05n02 dwd[2261]: option StandAlone: 0 Nov 3 10:31:38 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 3 10:31:38 kjcf05n02 beSetMlxConfig[2139]: Loading MST PCI module - Success Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[2288]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 10:31:38 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 0 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 1 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 2 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 3 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 4 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 5 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 6 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 7 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 8 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 9 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 10 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 11 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 12 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 13 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 14 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 15 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 16 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 17 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 18 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 19 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 20 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 21 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 22 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 23 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 24 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 25 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 26 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 27 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 28 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 29 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 30 Nov 3 10:31:38 kjcf05n02 cpupower[2312]: Idlestate 2 disabled on CPU 31 Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[2302]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 3 10:31:38 kjcf05n02 beSetMlxConfig[2139]: Loading MST PCI configuration module - Success Nov 3 10:31:38 kjcf05n02 beSetMlxConfig[2139]: Create devices Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[2311]: No configuration found for ib1 Nov 3 10:31:38 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[2316]: No configuration found for ib0 Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 3 10:31:38 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 10:31:38 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[2323]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[2328]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 10:31:38 kjcf05n02 sssd[sssd][2189]: Starting up Nov 3 10:31:38 kjcf05n02 mlnx_conf_mgr[2391]: INFO: No configurations found for mlx5_1, skipping. Nov 3 10:31:38 kjcf05n02 mlnx_conf_mgr[2401]: INFO: No configurations found for mlx5_0, skipping. Nov 3 10:31:38 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 10:31:38 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 10:31:38 kjcf05n02 sssd[be[implicit_files]][2442]: Starting up Nov 3 10:31:38 kjcf05n02 sssd[nss][2542]: Starting up Nov 3 10:31:38 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 10:31:38 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Login Service... Nov 3 10:31:38 kjcf05n02 systemd-logind[2671]: New seat seat0. Nov 3 10:31:38 kjcf05n02 systemd-logind[2671]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Login Service. Nov 3 10:31:38 kjcf05n02 python3.9[2299]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 10:31:38 kjcf05n02 python3.9[3186]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:31:38 kjcf05n02 systemd-sysctl[2796]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 10:31:38 kjcf05n02 systemd-sysctl[2796]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 10:31:38 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 10:31:38 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 10:31:38 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 10:31:38 kjcf05n02 python3.9[2953]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 10:31:38 kjcf05n02 python3.9[3186]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 10:31:38 kjcf05n02 network[2126]: Bringing up loopback interface: [ OK ] Nov 3 10:31:38 kjcf05n02 systemd-sysctl[3156]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 10:31:38 kjcf05n02 systemd-sysctl[3156]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 10:31:38 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 10:31:38 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 10:31:38 kjcf05n02 systemd[1]: Reached target Network. Nov 3 10:31:38 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 10:31:38 kjcf05n02 sm-notify[3182]: Version 2.3.3 starting Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 10:31:38 kjcf05n02 python3.9[3181]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 10:31:38 kjcf05n02 python3.9[3186]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:31:38 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 3 10:31:38 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 10:31:38 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 3 10:31:38 kjcf05n02 sshd[3190]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 3 10:31:38 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 10:31:38 kjcf05n02 beSetMlxConfig[2139]: Unloading MST PCI module (unused) - Success Nov 3 10:31:38 kjcf05n02 lldpad[3189]: setsockopt nearest_bridge: Invalid argument Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 3 10:31:38 kjcf05n02 lldpad[3189]: setsockopt nearest_bridge: Invalid argument Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 3 10:31:38 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 3 10:31:38 kjcf05n02 syslog-ng[3186]: [2024-11-03T16:30:25.266309] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 10:31:38 kjcf05n02 syslog-ng[3186]: [2024-11-03T16:30:25.266590] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 10:31:38 kjcf05n02 syslog-ng[3186]: [2024-11-03T16:30:25.266628] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 10:31:38 kjcf05n02 syslog-ng[3186]: [2024-11-03T16:30:25.267207] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 10:31:38 kjcf05n02 syslog-ng[3186]: [2024-11-03T16:30:25.267497] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 10:31:38 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 10:31:38 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 10:31:38 kjcf05n02 python3.9[3402]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 10:31:38 kjcf05n02 python3.9[3186]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 10:31:38 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 10:31:38 kjcf05n02 python3.9[3443]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 10:31:38 kjcf05n02 python3.9[3186]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 10:31:38 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 10:31:38 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 10:31:38 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 10:31:38 kjcf05n02 chronyd[2163]: System's initial offset : 0.003814 seconds slow of true (slew) Nov 3 10:31:38 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 10:31:38 kjcf05n02 beSetMlxConfig[2139]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 10:31:38 kjcf05n02 beSetMlxConfig[2139]: ib mode Nov 3 10:31:38 kjcf05n02 beSetMlxConfig[2139]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 10:31:38 kjcf05n02 root[3466]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 3 10:31:38 kjcf05n02 root[3468]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 3 10:31:38 kjcf05n02 beSetMlxConfig[2139]: ib mode Nov 3 10:31:38 kjcf05n02 systemd-udevd[1559]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 10:31:38 kjcf05n02 systemd-udevd[3480]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:31:38 kjcf05n02 systemd-udevd[3481]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:31:38 kjcf05n02 systemd-udevd[3485]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:31:38 kjcf05n02 systemd-udevd[3487]: Using default interface naming scheme 'rhel-8.0'. Nov 3 10:31:38 kjcf05n02 systemd-udevd[3487]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:31:38 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 10:31:38 kjcf05n02 systemd[3186]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:31:38 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[3522]: Setting up Mellanox network interface: ib0 Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[3523]: Setting up Mellanox network interface: ib1 Nov 3 10:31:38 kjcf05n02 systemd-udevd[3482]: Using default interface naming scheme 'rhel-8.0'. Nov 3 10:31:38 kjcf05n02 systemd-udevd[3483]: Using default interface naming scheme 'rhel-8.0'. Nov 3 10:31:38 kjcf05n02 systemd-udevd[3482]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:31:38 kjcf05n02 systemd-udevd[3483]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[3572]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[3573]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[3603]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[3604]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[3605]: No configuration found for ib0 Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[3606]: No configuration found for ib1 Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[3613]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[3614]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 10:31:38 kjcf05n02 mlnx_conf_mgr[3654]: INFO: No configurations found for mlx5_1, skipping. Nov 3 10:31:38 kjcf05n02 mlnx_conf_mgr[3653]: INFO: No configurations found for mlx5_0, skipping. Nov 3 10:31:38 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 10:31:38 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 10:31:38 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 3 10:31:38 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 3 10:31:38 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 10:31:38 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 3 10:31:38 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 3 10:31:38 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 10:31:38 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 10:31:38 kjcf05n02 lldpad[3189]: init_ports: Error adding device ib0 Nov 3 10:31:38 kjcf05n02 lldpad[3189]: init_ports: Error adding device ib1 Nov 3 10:31:38 kjcf05n02 lldpad[3189]: Signal 15 received - terminating Nov 3 10:31:38 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 3 10:31:38 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 10:31:38 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 10:31:38 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 3 10:31:38 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 10:31:38 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 3 10:31:38 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 3 10:31:38 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:38 kjcf05n02 systemd[3186]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:31:38 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 1 | Nov-03-2024 | 16:00:48 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 2 | Nov-03-2024 | 16:01:39 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 3 | Nov-03-2024 | 16:01:40 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 4 | Nov-03-2024 | 16:02:45 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 5 | Nov-03-2024 | 16:02:46 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 6 | Nov-03-2024 | 16:27:45 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 7 | Nov-03-2024 | 16:27:45 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 8 | Nov-03-2024 | 16:27:45 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 9 | Nov-03-2024 | 16:27:45 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 10 | Nov-03-2024 | 16:27:45 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 11 | Nov-03-2024 | 16:27:45 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 12 | Nov-03-2024 | 16:27:45 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 13 | Nov-03-2024 | 16:27:45 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 14 | Nov-03-2024 | 16:27:45 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 15 | Nov-03-2024 | 16:27:45 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 16 | Nov-03-2024 | 16:27:45 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 17 | Nov-03-2024 | 16:27:45 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 18 | Nov-03-2024 | 16:27:45 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 19 | Nov-03-2024 | 16:27:45 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 20 | Nov-03-2024 | 16:27:45 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 21 | Nov-03-2024 | 16:27:45 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 22 | Nov-03-2024 | 16:27:45 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 23 | Nov-03-2024 | 16:27:45 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 24 | Nov-03-2024 | 16:27:45 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 25 | Nov-03-2024 | 16:27:45 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 26 | Nov-03-2024 | 16:27:45 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 27 | Nov-03-2024 | 16:27:45 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 28 | Nov-03-2024 | 16:27:47 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 29 | Nov-03-2024 | 16:27:47 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 30 | Nov-03-2024 | 16:27:47 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 31 | Nov-03-2024 | 16:27:47 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 32 | Nov-03-2024 | 16:27:47 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 33 | Nov-03-2024 | 16:27:47 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 34 | Nov-03-2024 | 16:27:47 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 35 | Nov-03-2024 | 16:27:47 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 36 | Nov-03-2024 | 16:27:47 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 37 | Nov-03-2024 | 16:27:47 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 38 | Nov-03-2024 | 16:28:16 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 39 | Nov-03-2024 | 16:28:16 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 40 | Nov-03-2024 | 16:28:16 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 41 | Nov-03-2024 | 16:28:16 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 42 | Nov-03-2024 | 16:28:16 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 43 | Nov-03-2024 | 16:28:16 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 44 | Nov-03-2024 | 16:28:16 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 45 | Nov-03-2024 | 16:28:16 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 46 | Nov-03-2024 | 16:28:16 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 47 | Nov-03-2024 | 16:28:16 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 48 | Nov-03-2024 | 16:28:16 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 10:31:38 kjcf05n02 ipmievd[3998]: 49 | Nov-03-2024 | 16:28:16 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 10:31:38 kjcf05n02 ipmievd[4003]: Reading sensors... Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 3 10:31:38 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:38 kjcf05n02 systemd[3186]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 10:31:38 kjcf05n02 nscd[2240]: 2240 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 10:31:38 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 10:31:38 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 3 10:31:38 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 10:31:38 kjcf05n02 beSetMlxConfig[4059]: ConnectX-3 multiport not detected Nov 3 10:31:38 kjcf05n02 beSetMlxConfig[4059]: Starting MST (Mellanox Software Tools) driver set Nov 3 10:31:38 kjcf05n02 beSetMlxConfig[4059]: Loading MST PCI module - Success Nov 3 10:31:38 kjcf05n02 systemd-udevd[1559]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 10:31:38 kjcf05n02 beSetMlxConfig[4059]: [warn] mst_pciconf is already loaded, skipping Nov 3 10:31:38 kjcf05n02 beSetMlxConfig[4059]: Create devices Nov 3 10:31:38 kjcf05n02 beSetMlxConfig[4059]: Unloading MST PCI module (unused) - Success Nov 3 10:31:38 kjcf05n02 ipmievd[4003]: Waiting for events... Nov 3 10:31:38 kjcf05n02 beSetMlxConfig[4059]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 10:31:38 kjcf05n02 beSetMlxConfig[4059]: ib mode Nov 3 10:31:38 kjcf05n02 beSetMlxConfig[4059]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 10:31:38 kjcf05n02 beSetMlxConfig[4059]: ib mode Nov 3 10:31:38 kjcf05n02 systemd-udevd[1559]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 10:31:38 kjcf05n02 systemd-udevd[4962]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:31:38 kjcf05n02 systemd-udevd[4963]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:31:38 kjcf05n02 systemd-udevd[4966]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:31:38 kjcf05n02 systemd-udevd[4969]: Using default interface naming scheme 'rhel-8.0'. Nov 3 10:31:38 kjcf05n02 systemd-udevd[4969]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:31:38 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 10:31:38 kjcf05n02 systemd[3186]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:31:38 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[5004]: Setting up Mellanox network interface: ib1 Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[5005]: Setting up Mellanox network interface: ib0 Nov 3 10:31:38 kjcf05n02 systemd-udevd[4965]: Using default interface naming scheme 'rhel-8.0'. Nov 3 10:31:38 kjcf05n02 systemd-udevd[4965]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[5054]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[5055]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[5071]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[5070]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[5072]: No configuration found for ib1 Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[5073]: No configuration found for ib0 Nov 3 10:31:38 kjcf05n02 systemd-udevd[4964]: Using default interface naming scheme 'rhel-8.0'. Nov 3 10:31:38 kjcf05n02 systemd-udevd[4964]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[5080]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 10:31:38 kjcf05n02 mlnx_interface_mgr[5081]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 10:31:38 kjcf05n02 mlnx_conf_mgr[5136]: INFO: No configurations found for mlx5_1, skipping. Nov 3 10:31:38 kjcf05n02 mlnx_conf_mgr[5137]: INFO: No configurations found for mlx5_0, skipping. Nov 3 10:31:38 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 10:31:38 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}1761015520a7c9a97cc3f306e9a37c1baf62e5d5ad97bdb54197cbfc835b9a57' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}1761015520a7c9a97cc3f306e9a37c1baf62e5d5ad97bdb54197cbfc835b9a57' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}f284a4ce715779ffdde0da0301e8df850386dbbd196cadae092c835e32bb1906' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}f284a4ce715779ffdde0da0301e8df850386dbbd196cadae092c835e32bb1906' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}0d61c831f742967cc7f2a1141a35793c869da336cee2b157614d6babb63b425b' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}0d61c831f742967cc7f2a1141a35793c869da336cee2b157614d6babb63b425b' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}e264e024dc9920751fdb9c31572994c40d0448b4df97cb9db3fb4bbcc5898656' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}e264e024dc9920751fdb9c31572994c40d0448b4df97cb9db3fb4bbcc5898656' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 10:31:38 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 3 10:31:38 kjcf05n02 chronyd[2163]: chronyd exiting Nov 3 10:31:38 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 3 10:31:38 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 10:31:38 kjcf05n02 chronyd[5171]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 10:31:38 kjcf05n02 chronyd[5171]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 10:31:38 kjcf05n02 chronyd[5171]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 10:31:38 kjcf05n02 chronyd[5171]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 10:31:38 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 10:31:38 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:38 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 10:31:38 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 3 10:31:38 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 10:31:38 kjcf05n02 dwd[5202]: dwd: vMay 29 2024 : 15:38:26 Nov 3 10:31:38 kjcf05n02 dwd[5202]: /usr/sbin/dwd -i 15 -d Nov 3 10:31:38 kjcf05n02 dwd[5202]: dwd: option Lethal: 0 Nov 3 10:31:38 kjcf05n02 dwd[5202]: dwd: option Interval: 15 Nov 3 10:31:38 kjcf05n02 dwd[5202]: dwd: option abrtlimit: 10 Nov 3 10:31:38 kjcf05n02 dwd[5202]: dwd: option DZPeriod: 604800 Nov 3 10:31:38 kjcf05n02 dwd[5202]: dwd: option SmartPeriod: 43200 Nov 3 10:31:38 kjcf05n02 dwd[5202]: dwd: option SDDEnabled: 1 Nov 3 10:31:38 kjcf05n02 dwd[5202]: dwd: option SDDAwaitScale: 3 Nov 3 10:31:38 kjcf05n02 dwd[5202]: dwd: option SDDAwaitMin: 100 Nov 3 10:31:38 kjcf05n02 dwd[5202]: dwd: option Verbosity: 1 Nov 3 10:31:38 kjcf05n02 dwd[5202]: dwd: option StandAlone: 0 Nov 3 10:31:38 kjcf05n02 dwd[5202]: option Lethal: 0 Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 10:31:38 kjcf05n02 dwd[5202]: option Interval: 15 Nov 3 10:31:38 kjcf05n02 dwd[5202]: option abrtlimit: 10 Nov 3 10:31:38 kjcf05n02 dwd[5202]: option DZPeriod: 604800 Nov 3 10:31:38 kjcf05n02 dwd[5202]: option SmartPeriod: 43200 Nov 3 10:31:38 kjcf05n02 dwd[5202]: option SDDEnabled: 1 Nov 3 10:31:38 kjcf05n02 dwd[5202]: option SDDAwaitScale: 3 Nov 3 10:31:38 kjcf05n02 dwd[5202]: option SDDAwaitMin: 100 Nov 3 10:31:38 kjcf05n02 dwd[5202]: option Verbosity: 1 Nov 3 10:31:38 kjcf05n02 dwd[5202]: option StandAlone: 0 Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 10:31:38 kjcf05n02 dwd[5204]: option Lethal now set to 1 Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 10:31:38 kjcf05n02 dwd[5204]: option abrtlimit now set to 1 Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 10:31:38 kjcf05n02 dwd[5204]: option SmartPeriod now set to 86400 Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 10:31:38 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 10:31:38 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:31:38 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:38 kjcf05n02 python3.9[5233]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 10:31:38 kjcf05n02 python3.9[3186]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 10:31:38 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:31:38 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 10:31:38 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:38 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 3 10:31:38 kjcf05n02 sedcpwrkr[5372]: Using config script: /etc/sedcpwrkr.conf Nov 3 10:31:38 kjcf05n02 sedcpwrkr[5372]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 10:31:38 kjcf05n02 sedcpwrkr[5372]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 10:31:38 kjcf05n02 sedcpwrkr[5372]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 10:31:38 kjcf05n02 sedcpwrkr[5372]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 10:31:38 kjcf05n02 sedcpwrkr[5372]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 10:31:38 kjcf05n02 sedcpwrkr[5372]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 10:31:38 kjcf05n02 sedcpwrkr-server[5403]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 10:31:38 kjcf05n02 sedcpwrkr[5372]: celery multi v5.2.7 (dawn-chorus) Nov 3 10:31:38 kjcf05n02 sedcpwrkr[5372]: > Starting nodes... Nov 3 10:31:38 kjcf05n02 sedcpwrkr[5372]: > sedcpwrkr@kjcf05n02: OK Nov 3 10:31:38 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 10:31:38 kjcf05n02 sedcpwrkr-server[5405]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 10:31:38 kjcf05n02 sedcpwrkr-server[5405]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 10:31:38 kjcf05n02 sedcpwrkr-server[5405]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 10:31:38 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 10:31:38 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 3 10:31:38 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 10:31:38 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 10:31:38 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 10:31:39 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:39 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 10:31:39 kjcf05n02 systemd-udevd[1559]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 10:31:39 kjcf05n02 iptables.init[5472]: iptables: Applying firewall rules: [ OK ] Nov 3 10:31:39 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 3 10:31:39 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:40 kjcf05n02 systemd[3186]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 10:31:40 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 10:31:40 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 10:31:40 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:40 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 10:31:40 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5570 which is not our child. We'll most likely not notice when it exits. Nov 3 10:31:40 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 10:31:40 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:41 kjcf05n02 openhpid[5570]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 10:31:41 kjcf05n02 openhpid[5570]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 10:31:41 kjcf05n02 openhpid[5570]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 10:31:41 kjcf05n02 openhpid[5570]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 10:31:41 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:41 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:31:41 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:31:41 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 10:31:41 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 10:31:41 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 10:31:41 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 10:31:41 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:41 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 10:31:42 kjcf05n02 dcs-collectord[5661]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 10:31:42 kjcf05n02 hpi.inv.log[5661]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 10:31:42 kjcf05n02 dcs-collectord[5661]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 10:31:42 kjcf05n02 dcs-collectord[5661]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 10:31:42 kjcf05n02 dcs-collector[5652]: Starting dcs-collector:[ OK ] Nov 3 10:31:42 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 10:31:42 kjcf05n02 dcs-collectord[5664]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 10:31:42 kjcf05n02 dcs-collectord[5664]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 10:31:42 kjcf05n02 dcs-collectord[5664]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 10:31:42 kjcf05n02 dcs-collectord[5664]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 10:31:42 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 10:31:42 kjcf05n02 dcs-collectord[5664]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 10:31:42 kjcf05n02 dcs-collectord[5664]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 10:31:42 kjcf05n02 dcs-collectord[5664]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 10:31:42 kjcf05n02 dcs-collectord[5664]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259348640", "units": "kB"}, {"name": "MemAvailable", "value": "258628452", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821280", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686940", "units": "kB"}, {"name": "Inactive", "value": "958712", "units": "kB"}, {"name": "Active(anon)", "value": "1520632", "units": "kB"}, {"name": "Inactive(anon)", "value": "822692", "units": "kB"}, {"name": "Active(file)", "value": "166308", "units": "kB"}, {"name": "Inactive(file)", "value": "136020", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "749624", "units": "kB"}, {"name": "Mapped", "value": "86708", "units": "kB"}, {"name": "Shmem", "value": "1593404", "units": "kB"}, {"name": "KReclaimable", "value": "109464", "units": "kB"}, {"name": "Slab", "value": "275576", "units": "kB"}, {"name": "SReclaimable", "value": "109464", "units": "kB"}, {"name": "SUnreclaim", "value": "166112", "units": "kB"}, {"name": "KernelStack", "value": "9728", "units": "kB"}, {"name": "PageTables", "value": "21040", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3227064", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11264", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "4096", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "254280", "units": "kB"}, {"name": "DirectMap2M", "value": "22679552", "units": "kB"}, {"name": "DirectMap1G", "value": "245366784", "units": "kB"}]}' Nov 3 10:31:42 kjcf05n02 dcs-collectord[5664]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 10:31:42 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:42 kjcf05n02 dcs-collectord[5664]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 10:31:42 kjcf05n02 dcs-collectord[5664]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730651501.9618068], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730651502.1979027], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730651501.895756, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 10:31:42 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:42 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 10:31:42 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:31:42 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:31:42 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 10:31:42 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 10:31:42 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 10:31:42 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 10:31:42 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:42 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 10:31:42 kjcf05n02 firmware-update-orc[5770]: Using config script: /etc/firmware_update_orc.conf Nov 3 10:31:42 kjcf05n02 firmware-update-orc[5770]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 10:31:42 kjcf05n02 firmware-update-orc[5770]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 10:31:42 kjcf05n02 firmware-update-orc[5770]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 10:31:42 kjcf05n02 firmware-update-orc[5770]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 10:31:42 kjcf05n02 firmware-update-orc[5770]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 10:31:42 kjcf05n02 firmware-update-orc[5770]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 10:31:43 kjcf05n02 firmware-update-orc-server[5806]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 10:31:43 kjcf05n02 firmware-update-orc[5770]: celery multi v5.2.7 (dawn-chorus) Nov 3 10:31:43 kjcf05n02 firmware-update-orc[5770]: > Starting nodes... Nov 3 10:31:43 kjcf05n02 firmware-update-orc[5770]: > worker1@kjcf05n02: OK Nov 3 10:31:43 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 10:31:43 kjcf05n02 firmware-update-orc-server[5810]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 10:31:43 kjcf05n02 firmware-update-orc-server[5810]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 10:31:43 kjcf05n02 firmware-update-orc-server[5810]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 10:31:43 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 10:31:43 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:44 kjcf05n02 systemd[3186]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:31:44 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:31:44 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:31:44 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 10:31:44 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 10:31:44 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 10:31:44 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 10:31:44 kjcf05n02 dbus-daemon[2167]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 10:31:44 kjcf05n02 dbus-daemon[2167]: [system] Reloaded configuration Nov 3 10:31:44 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 10:31:44 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 10:31:44 kjcf05n02 dbus-daemon[2167]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 10:31:44 kjcf05n02 dbus-daemon[2167]: [system] Reloaded configuration Nov 3 10:31:44 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 10:31:44 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 10:31:44 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 10:31:44 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 10:31:44 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:44 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 3 10:31:44 kjcf05n02 ras-resource-manager-agent[5926]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 10:31:44 kjcf05n02 ras-resource-manager-agent[5912]: Starting ras-resource-manager-agent:[ OK ] Nov 3 10:31:44 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 10:31:44 kjcf05n02 ras-resource-manager-agent[5928]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 10:31:44 kjcf05n02 ras-resource-manager-client[5928]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 10:31:44 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 3 10:31:44 kjcf05n02 ras-resource-manager-client[5928]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 10:31:44 kjcf05n02 ras-resource-manager-client[5938]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 10:31:44 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:45 kjcf05n02 systemd[3186]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:31:45 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:31:45 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:31:45 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 10:31:45 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 10:31:45 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:45 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 10:31:45 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:46 kjcf05n02 systemd[3186]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: Press Ctrl+C to exit. Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: Plugin support version 1.0 Nov 3 10:31:46 kjcf05n02 zabbix_agent2[6012]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 10:31:46 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:31:46 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:31:46 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:46 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 10:31:46 kjcf05n02 dcs-notification-sender[6087]: dcs-notification-senderd is stopped Nov 3 10:31:46 kjcf05n02 zabbix-agent2[6101]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 10:31:46 kjcf05n02 dcs-notification-sender[6087]: Starting notification-sender:[ OK ] Nov 3 10:31:46 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 10:31:46 kjcf05n02 zabbix-agent2[6103]: INFO DCS notification agent started. (agent.py:61) Nov 3 10:31:46 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 10:31:46 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:46 kjcf05n00 zabbix-server[1179830]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 10:31:46 kjcf05n00 zabbix-server[1179830]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 169.15\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 178.24\\"}}"' Nov 3 10:31:46 kjcf05n00 log_interesting_event.py[1179830]: Event '46109' acknowledged Nov 3 10:31:47 kjcf05n02 systemd[3186]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:31:47 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:31:47 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:31:47 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:47 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 10:31:47 kjcf05n02 dcs-collectord[6213]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 10:31:47 kjcf05n02 dcs-collectord[6213]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 10:31:47 kjcf05n02 dcs-bulk-data-sender[6213]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 10:31:47 kjcf05n02 dcs-bulk-data-sender[6204]: Starting bulk-data-sender:[ OK ] Nov 3 10:31:47 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 10:31:47 kjcf05n02 dcs-collectord[6215]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 10:31:47 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 10:31:47 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:48 kjcf05n02 systemd[3186]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:31:48 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:31:48 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:31:48 kjcf05n02 nscd[2240]: 2240 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 10:31:48 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 10:31:48 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 10:31:48 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 10:31:48 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 10:31:48 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 10:31:48 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 10:31:48 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 10:31:48 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 10:31:48 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 10:31:48 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 10:31:48 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 10:31:48 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 10:31:48 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 10:31:48 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 10:31:48 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 10:31:48 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 10:31:49 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 3 10:31:49 kjcf05n02 sssd[nss][2542]: Shutting down (status = 0) Nov 3 10:31:49 kjcf05n02 sssd[be[implicit_files]][2442]: Shutting down (status = 0) Nov 3 10:31:49 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 3 10:31:49 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 3 10:31:49 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 10:31:49 kjcf05n02 sssd[sssd][6286]: Starting up Nov 3 10:31:49 kjcf05n02 sssd[be[implicit_files]][6297]: Starting up Nov 3 10:31:49 kjcf05n02 python3.9[5233]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 10:31:49 kjcf05n02 python3.9[3186]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:31:49 kjcf05n02 sssd[nss][6298]: Starting up Nov 3 10:31:49 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 10:31:49 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 10:31:49 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 10:31:50 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 10:31:50 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 10:31:50 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 10:31:50 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 10:31:50 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 10:31:50 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 10:31:50 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 10:31:50 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 10:31:50 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 10:31:50 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 10:31:50 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 10:31:50 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 10:31:50 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 10:31:50 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 10:31:50 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 10:31:50 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 10:31:50 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:50 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 10:31:51 kjcf05n02 icinga2[6345]: [2024-11-03 10:31:50 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 10:31:51 kjcf05n02 icinga2[6345]: [2024-11-03 10:31:50 -0600] information/cli: Loading configuration file(s). Nov 3 10:31:51 kjcf05n02 icinga2[6345]: [2024-11-03 10:31:50 -0600] information/ConfigItem: Committing config item(s). Nov 3 10:31:51 kjcf05n02 icinga2[6345]: [2024-11-03 10:31:51 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 3 10:31:51 kjcf05n02 icinga2[6345]: [2024-11-03 10:31:51 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 10:31:51 kjcf05n02 icinga2[6345]: [2024-11-03 10:31:51 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 10:31:51 kjcf05n02 icinga2[6345]: [2024-11-03 10:31:51 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 10:31:51 kjcf05n02 icinga2[6345]: [2024-11-03 10:31:51 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 10:31:51 kjcf05n02 icinga2[6345]: [2024-11-03 10:31:51 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 10:31:51 kjcf05n02 icinga2[6345]: [2024-11-03 10:31:51 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 10:31:51 kjcf05n02 icinga2[6345]: [2024-11-03 10:31:51 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 10:31:51 kjcf05n02 icinga2[6345]: [2024-11-03 10:31:51 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 10:31:51 kjcf05n02 icinga2[6345]: [2024-11-03 10:31:51 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 10:31:51 kjcf05n02 icinga2[6345]: [2024-11-03 10:31:51 -0600] information/cli: Closing console log. Nov 3 10:31:51 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 10:31:51 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:51 kjcf05n02 systemd[3186]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:31:51 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:31:51 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:31:52 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 10:31:52 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 10:31:52 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:52 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 3 10:31:52 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:52 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 10:31:52 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:31:52 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:31:53 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 10:31:53 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 10:31:53 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 10:31:53 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 10:31:53 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 10:31:53 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 10:31:53 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 10:31:53 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 10:31:53 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 10:31:53 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 10:31:53 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 10:31:53 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 10:31:53 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 10:31:53 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 10:31:53 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:53 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 10:31:53 kjcf05n02 nslcd[6960]: version 0.9.9 starting Nov 3 10:31:53 kjcf05n02 nslcd[6960]: accepting connections Nov 3 10:31:53 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 10:31:53 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:54 kjcf05n02 systemd[3186]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:31:54 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:31:54 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:31:54 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 10:31:54 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 10:31:54 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 10:31:54 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 10:31:54 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 10:31:54 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 10:31:55 kjcf05n02 dcs-bulk-data-sender[6215]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 10:31:55 kjcf05n02 dcs-collectord[6215]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 10:31:55 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 10:31:55 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 10:31:55 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 10:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 10:31:55 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 10:31:55 kjcf05n02 dearcpw[7201]: Using config script: /etc/dearcpw.conf Nov 3 10:31:55 kjcf05n02 dearcpw[7201]: - Creating default directory: '/var/log/dearcpw' Nov 3 10:31:55 kjcf05n02 dearcpw[7201]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 10:31:55 kjcf05n02 dearcpw[7201]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 10:31:55 kjcf05n02 dearcpw[7201]: - Creating default directory: '/var/run/dearcpw' Nov 3 10:31:55 kjcf05n02 dearcpw[7201]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 10:31:55 kjcf05n02 dearcpw[7201]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 10:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 10:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 10:31:56 kjcf05n02 dearcpw-server[7241]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 10:31:56 kjcf05n02 dearcpw[7201]: celery multi v5.2.7 (dawn-chorus) Nov 3 10:31:56 kjcf05n02 dearcpw[7201]: > Starting nodes... Nov 3 10:31:56 kjcf05n02 dearcpw[7201]: > dearcpw@kjcf05n02: OK Nov 3 10:31:56 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 10:31:56 kjcf05n02 dearcpw-server[7243]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 10:31:56 kjcf05n02 dearcpw-server[7243]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 10:31:56 kjcf05n02 dearcpw-server[7243]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 10:31:56 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 3 10:31:56 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:31:56 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:31:56 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 10:31:56 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 10:31:56 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 10:31:56 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 10:31:56 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 10:31:56 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 10:31:56 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 10:31:56 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 10:31:56 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 10:31:56 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 10:31:56 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:53218). Nov 3 10:31:56 kjcf05n01 rsyncd[3042863]: connect from kjcf05n02 (172.16.2.5) Nov 3 10:31:56 kjcf05n01 rsyncd[3042863]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 10:31:56 kjcf05n01 rsyncd[3042863]: receiving file list Nov 3 10:31:56 kjcf05n01 rsyncd[3042863]: sent 29 bytes received 333 bytes total size 10905 Nov 3 10:31:56 kjcf05n01 systemd[1]: rsyncd@620-172.16.2.2:873-172.16.2.5:53218.service: Succeeded. Nov 3 10:31:56 kjcf05n02 puppet[7441]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 3 10:31:56 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 10:31:56 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 10:31:56 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 10:31:56 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 10:31:56 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 10:31:56 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 10:31:56 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 10:31:56 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 10:31:57 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 10:31:57 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 10:31:57 kjcf05n02 dcs-collectord[5664]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 10:31:57 kjcf05n02 dcs-collectord[5664]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 10:31:57 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 10:31:57 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 10:31:57 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 10:31:57 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 10:31:58 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 10:31:58 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 10:31:58 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 10:31:58 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 10:31:59 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 10:31:59 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 10:31:59 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 10:31:59 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 10:31:59 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 10:31:59 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 10:31:59 kjcf05n02 systemd[1]: Reloading. Nov 3 10:31:59 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 10:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 10:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 10:31:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 10:31:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 10:32:00 kjcf05n02 diskless-swap[7628]: HA_PS_000: recovering journal Nov 3 10:32:00 kjcf05n02 systemd-udevd[1559]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 10:32:00 kjcf05n02 diskless-swap[7628]: HA_PS_000: clean, 2281/6400 files, 7071/25600 blocks Nov 3 10:32:00 kjcf05n02 diskless-swap[7628]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 10:32:00 kjcf05n02 diskless-swap[7628]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 10:32:00 kjcf05n02 diskless-swap[7628]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 10:32:00 kjcf05n02 diskless-swap[7628]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 10:32:00 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 10:32:00 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:32:00 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:32:00 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 10:32:00 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 10:32:00 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 10:32:00 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 10:32:00 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 3 10:32:00 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 3 10:32:00 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 3 10:32:00 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 3 10:32:00 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 3 10:32:00 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 10:32:00 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 10:32:00 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 10:32:00 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 10:32:00 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 10:32:00 kjcf05n02 ipmievd[4003]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 10:32:00 kjcf05n02 ipmievd[4003]: System Event sensor - Timestamp Clock Sync Nov 3 10:32:01 kjcf05n02 ipmievd[3186]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:32:01 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 10:32:01 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 10:32:01 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 10:32:01 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 10:32:01 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 10:32:01 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 10:32:02 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 10:32:02 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 10:32:02 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 10:32:02 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 10:32:02 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 10:32:02 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 10:32:02 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 10:32:02 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 10:32:03 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 10:32:03 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 10:32:03 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 10:32:03 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 10:32:03 kjcf05n02 systemd[1]: Reloading. Nov 3 10:32:04 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 3 10:32:04 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:32:04 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:32:04 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 10:32:04 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 10:32:04 kjcf05n02 systemd[1]: Reloading. Nov 3 10:32:04 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 3 10:32:04 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:32:04 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:32:04 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 10:32:04 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 10:32:04 kjcf05n02 systemd[1]: Reloading. Nov 3 10:32:04 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 3 10:32:04 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:32:04 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:32:04 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 10:32:04 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 10:32:04 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 10:32:04 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 10:32:04 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 10:32:04 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 10:32:04 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 10:32:04 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 10:32:04 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 10:32:04 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 10:32:04 kjcf05n02 systemd[1]: Reloading. Nov 3 10:32:05 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: kdump: No kdump initial ramdisk found. Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 10:32:05 kjcf05n02 dracut[7990]: dracut-049-135.git20210121.el8 Nov 3 10:32:05 kjcf05n00 mcfcli[3673891]: %3|1730651525.191|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:32:05 kjcf05n02 dracut[7992]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 10:32:05 kjcf05n02 dracut[7992]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 10:32:05 kjcf05n02 dracut[7992]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 10:32:05 kjcf05n02 dracut[7992]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 10:32:05 kjcf05n02 dracut[7992]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 10:32:05 kjcf05n02 dracut[7992]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 10:32:05 kjcf05n02 dracut[7992]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 10:32:05 kjcf05n02 dracut[7992]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + is_func check Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ type -t check Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + '[' 0 -ne 0 ']' Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + check -h Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + local dev holder Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + require_binaries mdadm expr Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + local _module_name=90hperaid Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + local _ret=0 Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ mdadm = \-\m ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + for cmd in "$@" Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + find_binary mdadm Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + for cmd in "$@" Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + find_binary expr Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + return 0 Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ -n -h ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + for dev in "${!host_fs_types[@]}" Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ nfs != *_raid_member ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + continue Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + return 255 Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + _ret=255 Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + hostonly=-h Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + return 255 Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + ret=255 Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ 255 = 0 ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ 255 = 255 ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ module_depends hperaid Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: +++ read a b Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ local _ret Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ unset check depends cmdline install installkernel Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: +++ set -x Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ depends Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ echo rootfs-block Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ return 0 Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ _ret=0 Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ unset check depends cmdline install installkernel Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ return 0 Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + for _moddep in $(module_depends $_mod) Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ all == *\ hperaid\ * ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + add_dracutmodules+=' rootfs-block ' Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ == *\ hperaid\ * ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + check_module rootfs-block Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + local _mod=rootfs-block Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + local _moddep Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ == *\ rootfs-block\ * ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ -n '' ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ all == *\ rootfs-block\ * ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + module_check rootfs-block 0 Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + local _forced=0 Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + local _hostonly=-h Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + '[' 2 -eq 2 ']' Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + _forced=0 Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + is_func check Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ type -t check Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + '[' 0 -ne 0 ']' Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + check -h Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + return 0 Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + _ret=0 Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + hostonly=-h Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + return 0 Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + ret=0 Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ 0 = 0 ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ module_depends rootfs-block Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: +++ read a b Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 10:32:05 kjcf05n02 kdumpctl[3186]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ local _ret Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ unset check depends cmdline install installkernel Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ depends Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ echo fs-lib Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ _ret=0 Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ unset check depends cmdline install installkernel Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ return 0 Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + for _moddep in $(module_depends $_mod) Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ all == *\ rootfs-block\ * ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + add_dracutmodules+=' fs-lib ' Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ == *\ rootfs-block\ * ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + check_module fs-lib Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + local _mod=fs-lib Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + local _moddep Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ -n '' ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + mods_checked_as_dep+=' fs-lib ' Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + [[ all == *\ fs-lib\ * ]] Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: + module_check fs-lib 0 Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 10:32:05 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _forced=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _hostonly=-h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 2 -eq 2 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _forced=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + is_func check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ type -t check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 0 -ne 0 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + check -h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _ret=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + hostonly=-h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + ret=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ 0 = 0 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ module_depends fs-lib Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: +++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ depends Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ return 0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ _ret=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ return 0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + mods_to_load+=' fs-lib ' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + mods_to_load+=' rootfs-block ' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + mods_to_load+=' hperaid ' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _mod=90kernel-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _mod=kernel-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + check_module kernel-modules 1 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _mod=kernel-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddep Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n 1 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ all = all ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + module_check kernel-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _forced=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _hostonly=-h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 1 -eq 2 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + is_func check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ type -t check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 0 -ne 0 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + check -h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + true Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _ret=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + hostonly=-h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + ret=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ 0 != 0 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ module_depends kernel-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: +++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ depends Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ true Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ _ret=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ return 0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + mods_to_load+=' kernel-modules ' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _mod=90kernel-modules-extra Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _mod=kernel-modules-extra Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + check_module kernel-modules-extra 1 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _mod=kernel-modules-extra Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddep Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n 1 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ all = all ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + module_check kernel-modules-extra Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _forced=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _hostonly=-h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 1 -eq 2 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + is_func check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ type -t check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 0 -ne 0 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + check -h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + true Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _ret=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + hostonly=-h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + ret=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ 0 != 0 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ module_depends kernel-modules-extra Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: +++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ depends Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ true Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ _ret=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ return 0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + mods_to_load+=' kernel-modules-extra ' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _mod=90kernel-network-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _mod=kernel-network-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + check_module kernel-network-modules 1 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _mod=kernel-network-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddep Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n 1 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ all = all ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + module_check kernel-network-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _forced=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _hostonly=-h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 1 -eq 2 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + is_func check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ type -t check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 0 -ne 0 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + check -h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _ret=255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + hostonly=-h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + ret=255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ 255 != 0 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n 1 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 1 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _mod=90livenet Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _mod=livenet Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + check_module livenet 1 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _mod=livenet Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddep Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n 1 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ all = all ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + module_check livenet Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _forced=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _hostonly=-h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 1 -eq 2 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + is_func check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ type -t check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 0 -ne 0 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + check -h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _ret=255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + hostonly=-h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + ret=255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ 255 != 0 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n 1 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 1 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _mod=90lvm Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _mod=lvm Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + check_module lvm 1 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _mod=lvm Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddep Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n 1 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ all = all ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + module_check lvm Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _forced=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _hostonly=-h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 1 -eq 2 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + is_func check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ type -t check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 0 -ne 0 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + check -h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + require_binaries lvm Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _module_name=90lvm Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ lvm = \-\m ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + for cmd in "$@" Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + find_binary lvm Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n -h ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + for fs in "${host_fs_types[@]}" Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ nfs = LVM*_member ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _ret=255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + hostonly=-h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + ret=255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ 255 != 0 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n 1 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 1 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _mod=90mdraid Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _mod=mdraid Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + check_module mdraid 1 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _mod=mdraid Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddep Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n 1 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ all = all ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + module_check mdraid Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _forced=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _hostonly=-h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 1 -eq 2 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + is_func check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ type -t check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 0 -ne 0 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + check -h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _rootdev Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + require_binaries mdadm expr Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _module_name=90mdraid Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ mdadm = \-\m ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + for cmd in "$@" Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + find_binary mdadm Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + for cmd in "$@" Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + find_binary expr Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n -h ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + for dev in "${!host_fs_types[@]}" Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ nfs != *_raid_member ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + continue Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _ret=255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + hostonly=-h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + ret=255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ 255 != 0 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n 1 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 1 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _mod=90multipath Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _mod=multipath Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + check_module multipath 1 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _mod=multipath Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddep Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n 1 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ all = all ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + module_check multipath Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _forced=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _hostonly=-h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 1 -eq 2 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + is_func check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ type -t check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 0 -ne 0 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + check -h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _rootdev Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n -h ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + for_each_host_dev_and_slaves is_mpath Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _func=is_mpath Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _dev Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + for _dev in "${host_devs[@]}" Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + continue Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 1 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _ret=255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + hostonly=-h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + ret=255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ 255 != 0 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n 1 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 1 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _mod=90qemu Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _mod=qemu Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + check_module qemu 1 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _mod=qemu Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddep Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n 1 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ all = all ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + module_check qemu Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _forced=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _hostonly=-h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 1 -eq 2 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + is_func check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ type -t check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 0 -ne 0 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + check -h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n -h ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + type -P systemd-detect-virt Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ systemd-detect-virt --vm Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + vm=none Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + (( 1 != 0 )) Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _ret=255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + hostonly=-h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + ret=255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ 255 != 0 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n 1 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 1 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _mod=90qemu-net Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _mod=qemu-net Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + check_module qemu-net 1 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _mod=qemu-net Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddep Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n 1 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ all = all ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + module_check qemu-net Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _forced=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _hostonly=-h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 1 -eq 2 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + is_func check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ type -t check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 0 -ne 0 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + check -h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n -h ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + type -P systemd-detect-virt Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ systemd-detect-virt --vm Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + vm= Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + (( 1 != 0 )) Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _ret=255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + hostonly=-h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + ret=255 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ 255 != 0 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n 1 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + return 1 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _mod=90stratis Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + _mod=stratis Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + check_module stratis 1 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _mod=stratis Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddep Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -n 1 ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ all = all ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + module_check stratis Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ read a b Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _forced=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _hostonly=-h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 1 -eq 2 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + is_func check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: ++ type -t check Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + '[' 0 -ne 0 ']' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + check -h Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _module_name=90stratis Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + local _ret=0 Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + [[ stratisd-init = \-\m ]] Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + for cmd in "$@" Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + find_binary stratisd-init Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 10:32:06 kjcf05n02 kdumpctl[7863]: + set +x Nov 3 10:32:06 kjcf05n02 dracut[7992]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 10:32:06 kjcf05n02 dracut[7992]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 10:32:06 kjcf05n02 dracut[7992]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 10:32:06 kjcf05n02 dracut[7992]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 10:32:05 kjcf05n00 mcfcli[3673891]: %3|1730651525.613|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:32:06 kjcf05n02 dracut[7992]: memstrack is available Nov 3 10:32:06 kjcf05n02 dracut[7992]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 10:32:06 kjcf05n02 dracut[7992]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 10:32:06 kjcf05n02 dracut[7992]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 10:32:06 kjcf05n02 dracut[7992]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 10:32:06 kjcf05n02 dracut[7992]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 10:32:06 kjcf05n02 dracut[7992]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 10:32:06 kjcf05n02 dracut[7992]: *** Including module: bash *** Nov 3 10:32:06 kjcf05n02 dracut[7992]: *** Including module: systemd *** Nov 3 10:32:07 kjcf05n02 dracut[7992]: *** Including module: fips *** Nov 3 10:32:08 kjcf05n02 dracut[7992]: *** Including module: systemd-initrd *** Nov 3 10:32:08 kjcf05n02 dracut[7992]: *** Including module: watchdog-modules *** Nov 3 10:32:08 kjcf05n02 dracut[7992]: *** Including module: nss-softokn *** Nov 3 10:32:08 kjcf05n02 dracut[7992]: *** Including module: i18n *** Nov 3 10:32:08 kjcf05n02 dracut[7992]: No KEYMAP configured. Nov 3 10:32:08 kjcf05n02 dracut[7992]: *** Including module: network-legacy *** Nov 3 10:32:08 kjcf05n02 dracut[7992]: *** Including module: network *** Nov 3 10:32:08 kjcf05n02 dracut[7992]: *** Including module: ib_bonding *** Nov 3 10:32:08 kjcf05n02 dracut[7992]: *** Including module: drm *** Nov 3 10:32:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730651529', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 331 processes with STATE = RSZDT '}"] Nov 3 10:32:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 331 processes with STATE = RSZDT ', 'message': 'PROCS OK: 331 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730651529'} Nov 3 10:32:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:32:12 kjcf05n02 dracut[7992]: *** Including module: hperaid *** Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + install Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + local rule rule_path Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + inst_multiple cat expr Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.yNxmWN/initramfs -a -f cat expr Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + _ret=0 Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + (( 0 != 0 )) Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + : Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + return 0 Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + inst_multiple -o mdmon Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.yNxmWN/initramfs -a -f -o mdmon Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + _ret=0 Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + (( 0 != 0 )) Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + : Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + return 0 Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: ++ command -v partx Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + inst /usr/sbin/partx /sbin/partx Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + local _hostonly_install Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + [[ -e /tmp/dracut.yNxmWN/initramfs//sbin/partx ]] Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.yNxmWN/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + (( 0 != 0 )) Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + : Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: ++ command -v mdadm Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + local _hostonly_install Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + [[ -e /tmp/dracut.yNxmWN/initramfs//sbin/mdadm ]] Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.yNxmWN/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + (( 0 != 0 )) Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + : Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + [[ yes == \y\e\s ]] Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + local _raidconf Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: ++ cmdline Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: ++ local _activated dev line UUID Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: ++ declare -A _activated Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: ++ for dev in "${!host_fs_types[@]}" Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: ++ [[ nfs != *_raid_member ]] Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: ++ continue Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + _raidconf= Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + [[ -n '' ]] Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + inst_rules 64-md-raid.rules Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + local _target=/etc/udev/rules.d _rule _found Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + inst_dir /usr/lib/udev/rules.d Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + [[ -e /tmp/dracut.yNxmWN/initramfs//usr/lib/udev/rules.d ]] Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + return 0 Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + inst_dir /etc/udev/rules.d Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + [[ -e /tmp/dracut.yNxmWN/initramfs//etc/udev/rules.d ]] Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + return 0 Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + for _rule in "$@" Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + continue Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + continue Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + for r in '' $dracutbasedir/rules.d/ Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + [[ 64-md-raid.rules != /* ]] Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + continue Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + for r in '' $dracutbasedir/rules.d/ Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + continue Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + [[ -n '' ]] Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + set +x Nov 3 10:32:12 kjcf05n02 dracut[7992]: Skipping udev rule: 64-md-raid.rules Nov 3 10:32:12 kjcf05n02 dcs-collectord[5664]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 10:32:12 kjcf05n02 dcs-collectord[5664]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + installkernel Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + instmods =drivers/md Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + local _optional=-o Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + local _silent Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + local _ret Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + [[ '' = yes ]] Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + [[ =drivers/md = \-\c ]] Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + [[ =drivers/md = \-\s ]] Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + (( 1 == 0 )) Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.yNxmWN/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + _ret=0 Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + (( 0 != 0 )) Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + [[ -n '' ]] Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + return 0 Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + _ret=0 Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + unset check depends cmdline install installkernel Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + return 0 Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + modules_loaded+='hperaid ' Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + '[' -n '' ']' Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + _d_mod=90kernel-modules Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + _d_mod=kernel-modules Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + [[ '' = yes ]] Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + dinfo '*** Including module: kernel-modules ***' Nov 3 10:32:12 kjcf05n02 kdumpctl[7863]: + set +x Nov 3 10:32:12 kjcf05n02 dracut[7992]: *** Including module: kernel-modules *** Nov 3 10:32:12 kjcf05n02 dracut[7992]: *** Including module: kernel-modules-extra *** Nov 3 10:32:12 kjcf05n02 dracut[7992]: *** Including module: kernel-network-modules *** Nov 3 10:32:13 kjcf05n02 dracut[7992]: *** Including module: diskless-mod *** Nov 3 10:32:13 kjcf05n02 dracut[7992]: *** Including module: fstab-sys *** Nov 3 10:32:13 kjcf05n02 dracut[7992]: *** Including module: nfs *** Nov 3 10:32:13 kjcf05n02 dracut[7992]: *** Including module: rootfs-block *** Nov 3 10:32:13 kjcf05n02 dracut[7992]: *** Including module: terminfo *** Nov 3 10:32:13 kjcf05n02 dracut[7992]: *** Including module: udev-rules *** Nov 3 10:32:14 kjcf05n02 dracut[7992]: Skipping udev rule: 91-permissions.rules Nov 3 10:32:14 kjcf05n02 dracut[7992]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 10:32:14 kjcf05n02 dracut[7992]: *** Including module: dracut-systemd *** Nov 3 10:32:13 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 3 10:32:14 kjcf05n02 dracut[7992]: *** Including module: usrmount *** Nov 3 10:32:14 kjcf05n02 dracut[7992]: *** Including module: base *** Nov 3 10:32:14 kjcf05n02 dracut[7992]: *** Including module: fs-lib *** Nov 3 10:32:15 kjcf05n02 dracut[7992]: *** Including module: kdumpbase *** Nov 3 10:32:15 kjcf05n02 dracut[7992]: *** Including module: memstrack *** Nov 3 10:32:15 kjcf05n02 dracut[7992]: *** Including module: shutdown *** Nov 3 10:32:15 kjcf05n02 dracut[7992]: *** Including module: squash *** Nov 3 10:32:15 kjcf05n02 dracut[7992]: *** Including modules done *** Nov 3 10:32:15 kjcf05n02 dracut[7992]: *** Installing kernel module dependencies *** Nov 3 10:32:15 kjcf05n02 dracut[7992]: *** Installing kernel module dependencies done *** Nov 3 10:32:16 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 3 10:32:16 kjcf05n02 dracut[7992]: *** Resolving executable dependencies *** Nov 3 10:32:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 10:32:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 10:32:16 kjcf05n00 zabbix-server[1180206]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 10:32:16 kjcf05n00 zabbix-server[1180206]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:45\\"}}"' Nov 3 10:32:17 kjcf05n00 log_interesting_event.py[1180206]: Event '46111' acknowledged Nov 3 10:32:17 kjcf05n02 dracut[7992]: *** Resolving executable dependencies done*** Nov 3 10:32:17 kjcf05n02 dracut[7992]: *** Hardlinking files *** Nov 3 10:32:17 kjcf05n02 dracut[7992]: *** Hardlinking files done *** Nov 3 10:32:17 kjcf05n02 dracut[7992]: *** Generating early-microcode cpio image *** Nov 3 10:32:17 kjcf05n02 dracut[7992]: *** Constructing AuthenticAMD.bin **** Nov 3 10:32:17 kjcf05n02 dracut[7992]: *** Store current command line parameters *** Nov 3 10:32:17 kjcf05n02 dracut[7992]: Stored kernel commandline: Nov 3 10:32:17 kjcf05n02 dracut[7992]: rd.driver.pre=sd_mod Nov 3 10:32:17 kjcf05n02 dracut[7992]: rd.driver.pre=nvme Nov 3 10:32:17 kjcf05n02 dracut[7992]: rd.driver.pre=ipmi_si Nov 3 10:32:17 kjcf05n02 dracut[7992]: rd.driver.pre=ipmi_devintf Nov 3 10:32:17 kjcf05n02 dracut[7992]: rd.driver.pre=ipmi_msghandler Nov 3 10:32:17 kjcf05n02 dracut[7992]: nameserver=172.16.2.2 Nov 3 10:32:17 kjcf05n02 dracut[7992]: nameserver=127.0.0.1 Nov 3 10:32:17 kjcf05n02 dracut[7992]: nameserver=172.16.2.2 Nov 3 10:32:17 kjcf05n02 dracut[7992]: nameserver=127.0.0.1 Nov 3 10:32:17 kjcf05n02 dracut[7992]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 3 10:32:17 kjcf05n02 dracut[7992]: rd.neednet Nov 3 10:32:17 kjcf05n02 dracut[7992]: kdumpnic=mgmt0 Nov 3 10:32:17 kjcf05n02 dracut[7992]: bootdev=mgmt0 Nov 3 10:32:17 kjcf05n02 dracut[7992]: *** Install squash loader *** Nov 3 10:32:17 kjcf05n02 dracut[7992]: *** Squashing the files inside the initramfs *** Nov 3 10:32:18 kjcf05n02 dracut[7992]: *** Squashing the files inside the initramfs done *** Nov 3 10:32:18 kjcf05n02 dracut[7992]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 10:32:18 kjcf05n02 dracut[7992]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 10:32:19 kjcf05n02 kdumpctl[7863]: kdump: kexec: loaded kdump kernel Nov 3 10:32:19 kjcf05n02 kdumpctl[7863]: kdump: Starting kdump: [OK] Nov 3 10:32:19 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 3 10:32:19 kjcf05n02 systemd[1]: Reloading. Nov 3 10:32:19 kjcf05n02 systemd[3186]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:32:19 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:32:19 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:32:19 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 10:32:19 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 10:32:19 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 10:32:19 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 10:32:19 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 10:32:19 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 10:32:19 kjcf05n02 ifdown[14560]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 10:32:19 kjcf05n02 ifdown[14561]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:32:19 kjcf05n02 ifdown[14562]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:32:19 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 10:32:19 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 10:32:19 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 10:32:20 kjcf05n02 ifup[14631]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 10:32:20 kjcf05n02 ifup[14632]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:32:20 kjcf05n02 ifup[14633]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:32:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730651539', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.4% (3695064 kB) used.'}"] Nov 3 10:32:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.4% (3695064 kB) used.', 'message': 'OK - 1.4% (3695064 kB) used.', 'value': 'ok', 'timestamp': '1730651539'} Nov 3 10:32:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:32:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 10:32:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 10:32:21 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 10:32:24 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 10:32:24 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 10:32:24 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 10:32:24 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:32:24 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:32:24 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:32:24 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:32:24 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 10:32:24 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 10:32:24 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 10:32:24 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 10:32:24 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:32:24 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:32:24 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:32:24 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:32:24 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 10:32:24 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 10:32:24 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 10:32:24 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 10:32:24 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 10:32:24 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 10:32:24 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 10:32:24 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 10:32:24 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 10:32:24 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 10:32:24 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 10:32:24 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 10:32:24 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 10:32:24 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 10:32:24 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 10:32:24 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 10:32:24 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 10:32:24 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 10:32:24 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 10:32:24 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 10:32:24 kjcf05n02 ifdown[14821]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 10:32:24 kjcf05n02 ifdown[14822]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:32:24 kjcf05n02 ifdown[14823]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:32:24 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 10:32:24 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 10:32:24 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 10:32:25 kjcf05n02 ifup[14883]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 10:32:25 kjcf05n02 ifup[14884]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:32:25 kjcf05n02 ifup[14885]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:32:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730651545', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 10:32:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730651545'} Nov 3 10:32:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:32:27 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 10:32:27 kjcf05n02 dcs-collectord[5664]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 10:32:27 kjcf05n02 dcs-collectord[5664]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 10:32:29 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 10:32:29 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 10:32:29 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 10:32:29 kjcf05n02 systemd[1]: Reloading. Nov 3 10:32:29 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 3 10:32:29 kjcf05n02 await_ha_peer[15101]: Waiting for HA peer kjcf05n03 Nov 3 10:32:31 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 10:32:31 kjcf05n02 await_ha_peer[15101]: Peer kjcf05n03 has started, starting HA Nov 3 10:32:31 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 3 10:32:31 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 3 10:32:31 kjcf05n02 fstonithd.py[15153]: Listening for kdump packets from partner Nov 3 10:32:31 kjcf05n02 systemd[1]: Reloading. Nov 3 10:32:31 kjcf05n02 systemd[3186]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:32:31 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:32:31 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:32:31 kjcf05n02 systemd[1]: Reloading. Nov 3 10:32:32 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 3 10:32:32 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 10:32:32 kjcf05n02 systemd[1]: Reloading. Nov 3 10:32:32 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 10:32:32 kjcf05n02 puppet-agent[3588]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 10:32:32 kjcf05n02 puppet[3588]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 10:32:32 kjcf05n02 puppet-agent[3588]: Applied catalog in 90.95 seconds Nov 3 10:32:32 kjcf05n02 puppet[3588]: Notice: Applied catalog in 90.95 seconds Nov 3 10:32:32 kjcf05n02 systemd[1]: Started Puppet agent. Nov 3 10:32:32 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 3 10:32:32 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 10:32:32 kjcf05n02 systemd[1]: Reached target Timers. Nov 3 10:32:32 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 10:32:32 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 10:32:32 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 10:32:32 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 10:32:32 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 10:32:32 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 10:32:32 kjcf05n02 wce-disable.sh[15294]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 10:32:32 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 10:32:32 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 10:32:32 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 10:32:32 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 10:32:32 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 3 10:32:32 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 3 10:32:33 kjcf05n02 python3.9[15297]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 10:32:33 kjcf05n02 python3.9[15297]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 10:32:33 kjcf05n02 gateway-ec-node.py[15298]: Starting gateway-ec-node service Nov 3 10:32:33 kjcf05n02 RFSF-API[15296]: INFO[2024-11-03T10:32:32-06:00] Datapath API RESTful Service starting Nov 3 10:32:33 kjcf05n02 dp-api-server-node[15296]: INFO[2024-11-03T10:32:32-06:00] Datapath API RESTful Service starting Nov 3 10:32:33 kjcf05n02 RFSF-API[15296]: INFO[2024-11-03T10:32:32-06:00] Running in production mode, starting dbus event listener Nov 3 10:32:33 kjcf05n02 dp-api-server-node[15296]: INFO[2024-11-03T10:32:32-06:00] Running in production mode, starting dbus event listener Nov 3 10:32:33 kjcf05n02 RFSF-API[15296]: INFO[2024-11-03T10:32:32-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 10:32:33 kjcf05n02 dp-api-server-node[15296]: INFO[2024-11-03T10:32:32-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 10:32:33 kjcf05n02 RFSF-API[15296]: INFO[2024-11-03T10:32:32-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 10:32:33 kjcf05n02 dp-api-server-node[15296]: INFO[2024-11-03T10:32:32-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 10:32:33 kjcf05n02 RFSF-API[15296]: INFO[2024-11-03T10:32:32-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 10:32:33 kjcf05n02 dp-api-server-node[15296]: INFO[2024-11-03T10:32:32-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 10:32:33 kjcf05n02 RFSF-API[15296]: INFO[2024-11-03T10:32:32-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 10:32:33 kjcf05n02 dp-api-server-node[15296]: INFO[2024-11-03T10:32:32-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 10:32:33 kjcf05n02 RFSF-API[15296]: INFO[2024-11-03T10:32:32-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 10:32:33 kjcf05n02 dp-api-server-node[15296]: INFO[2024-11-03T10:32:32-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 10:32:33 kjcf05n02 RFSF-API[15296]: INFO[2024-11-03T10:32:32-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 10:32:33 kjcf05n02 dp-api-server-node[15296]: INFO[2024-11-03T10:32:32-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 10:32:33 kjcf05n02 RFSF-API[15296]: INFO[2024-11-03T10:32:32-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 10:32:33 kjcf05n02 dp-api-server-node[15296]: INFO[2024-11-03T10:32:32-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 10:32:33 kjcf05n02 RFSF-API[15296]: INFO[2024-11-03T10:32:32-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 10:32:33 kjcf05n02 dp-api-server-node[15296]: INFO[2024-11-03T10:32:32-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 10:32:33 kjcf05n02 RFSF-API[15296]: INFO[2024-11-03T10:32:32-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 10:32:33 kjcf05n02 dp-api-server-node[15296]: INFO[2024-11-03T10:32:32-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 10:32:33 kjcf05n02 RFSF-API[15296]: INFO[2024-11-03T10:32:32-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 10:32:33 kjcf05n02 dp-api-server-node[15296]: INFO[2024-11-03T10:32:32-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 10:32:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730651553', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 10:32:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730651553'} Nov 3 10:32:33 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:32:35 kjcf05n00 mcfcli[3673891]: %3|1730651555.191|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:32:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730651556', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 10:32:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730651556', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 10:32:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730651556'} Nov 3 10:32:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730651556'} Nov 3 10:32:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:32:39 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 10:32:39 kjcf05n02 systemd[1]: Reloading. Nov 3 10:32:40 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 10:32:40 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 10:32:40 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 10:32:40 kjcf05n02 diskmonitor_pre[15840]: Key management is currently disabled.DEAR disabled Nov 3 10:32:40 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 10:32:42 kjcf05n02 dcs-collectord[5664]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 10:32:42 kjcf05n02 dcs-collectord[5664]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 10:32:42 kjcf05n02 dcs-collectord[5664]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 10:32:42 kjcf05n02 sh[15837]: LNET configured: New Created Nov 3 10:32:42 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 10:32:42 kjcf05n02 LCNmon[17865]: Interface ib0 is up Nov 3 10:32:42 kjcf05n02 LCNmon[17865]: Interface ib1 is up Nov 3 10:32:42 kjcf05n02 LCNmon[17865]: Can ping through interface ib0 Nov 3 10:32:42 kjcf05n00 httpd[902566]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 10:32:43 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: /var/run/diskmonitor does not exist, creating Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: Creating /var/run/diskmonitor/disk Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: Creating /var/run/diskmonitor/encl Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: Creating /var/run/diskmonitor/cli Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: RAS_Interlocks_enabled: 1 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: add handler for sig: 14 sa_flags: 10000004 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: add handler for sig: 1 sa_flags: 10000004 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: add handler for sig: 2 sa_flags: 00000004 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: add handler for sig: 15 sa_flags: 00000004 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: add handler for sig: 6 sa_flags: 00000004 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: add handler for sig: 3 sa_flags: 00000004 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: add handler for sig: 30 sa_flags: 00000004 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: add handler for sig: 20 sa_flags: 00000004 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: add handler for sig: 10 sa_flags: 10000004 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: add handler for sig: 11 sa_flags: 00000004 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: add handler for sig: 7 sa_flags: 00000004 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: add handler for sig: 4 sa_flags: 00000004 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: add handler for sig: 8 sa_flags: 00000004 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: Using HA Baton locks - key: diskmonitor Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: Baton will be held for at most 570 seconds Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: DMMP Enabled: 0 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: random seed: 2a537b14 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: NVMe Enclosure: 1 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: ZFS Enclosure: 0 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: Dbus, Initialized Connection Successfully Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: int_catcher_thread: thread start Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: Received dbus message 4 org.freedesktop.DBus -> :1.92 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 10:32:44 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 10:32:45 kjcf05n00 mcfcli[3673891]: %3|1730651565.609|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:32:46 kjcf05n02 LCNmon[17865]: 10.16.100.60 is unreachable via ib1 Nov 3 10:32:46 kjcf05n02 LCNmon[17865]: Can ping through interface ib1 Nov 3 10:32:46 kjcf05n02 LCNmon[17865]: NIC ib0, initial state UP Nov 3 10:32:46 kjcf05n02 LCNmon[17865]: NIC ib1, initial state UP Nov 3 10:32:46 kjcf05n02 LCNmon[17865]: LCNstat initial state UP Nov 3 10:32:46 kjcf05n02 openhpid[5570]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 10:32:46 kjcf05n02 openhpid[5570]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 10:32:46 kjcf05n02 LCNmon[17865]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 3 10:32:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730651566', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 2.37, 2.03, 0.91'}"] Nov 3 10:32:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 2.37, 2.03, 0.91', 'message': 'OK - load average: 2.37, 2.03, 0.91', 'value': 'ok', 'timestamp': '1730651566'} Nov 3 10:32:46 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:32:47 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 3 10:32:47 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 10:32:47 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 10:32:47 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18405 which is not our child. We'll most likely not notice when it exits. Nov 3 10:32:47 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 10:32:47 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 3 10:32:47 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 3 10:32:47 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 10:32:47 kjcf05n02 dcs-collectord[5664]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 10:32:47 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 10:32:47 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 10:32:47 kjcf05n02 systemd[1]: Startup finished in 50.079s (kernel) + 2min 28.651s (userspace) = 3min 18.731s. Nov 3 10:32:47 kjcf05n02 openhpid[18405]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 10:32:47 kjcf05n02 openhpid[18405]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 10:32:47 kjcf05n02 openhpid[18405]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 10:32:47 kjcf05n02 openhpid[18405]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 10:32:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730651568', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(2800.0B/2200.0B), ib1=(2436.0B/2704.0B), icl0=(7.7kB/9.5kB), lo=(800.0B/800.0B), meth0=(1541.7MB/8.1MB), mgmt0=(1478.4MB/8.1MB)'}"] Nov 3 10:32:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(2800.0B/2200.0B), ib1=(2436.0B/2704.0B), icl0=(7.7kB/9.5kB), lo=(800.0B/800.0B), meth0=(1541.7MB/8.1MB), mgmt0=(1478.4MB/8.1MB)', 'message': 'NET OK - (Rx/Tx) ib0=(2800.0B/2200.0B), ib1=(2436.0B/2704.0B), icl0=(7.7kB/9.5kB), lo=(800.0B/800.0B), meth0=(1541.7MB/8.1MB), mgmt0=(1478.4MB/8.1MB)', 'value': 'ok', 'timestamp': '1730651568'} Nov 3 10:32:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:32:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730651568', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 10:32:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730651568'} Nov 3 10:32:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:32:50 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18622 (bash) Nov 3 10:32:50 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 10:32:50 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 10:32:50 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 10:32:50 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 10:32:50 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 10:32:50 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 10:32:57 kjcf05n02 dcs-collectord[5664]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 10:32:57 kjcf05n02 dcs-collectord[5664]: WARNING No data collected (hpi_parser.py:353) Nov 3 10:33:05 kjcf05n00 mcfcli[3673891]: %3|1730651585.407|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 10:33:10 kjcf05n02 ipmievd[4003]: System Event sensor - Timestamp Clock Sync Nov 3 10:33:12 kjcf05n02 ipmievd[3186]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:33:12 kjcf05n02 dcs-collectord[5664]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 10:33:20 kjcf05n00 mcfcli[3673891]: %3|1730651600.667|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 10:33:22 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 10:33:27 kjcf05n02 dcs-collectord[5664]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 10:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T10:33:27.252991668-06:00 level=info msg="Completed cleanup jobs" duration=26.148241ms Nov 3 10:33:30 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '5c5a4946-9a01-11ef-9a2f-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 10:33:30 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '5c5a4946-9a01-11ef-9a2f-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 10:33:30 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '5c5a4946-9a01-11ef-9a2f-00093d0695e3', 'response ID': '5c646b24-9a01-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 10:33:30 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 5c646b24-9a01-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 10:33:31 kjcf05n03 firmware-update-orc-server[5876]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "5b9d588b-3306-4c07-b636-ba35d59d9b37"} (logger.py:65) Nov 3 10:33:31 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 140741 (get_disk_device) Nov 3 10:33:31 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 10:33:31 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 10:33:31 kjcf05n03 ccp-client[140762]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 10:33:31 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE260000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 10:33:31 kjcf05n02 ras-resource-manager-agent[5928]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "5c5a4946-9a01-11ef-9a2f-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 10:33:31 kjcf05n02 ras-resource-manager-agent[5928]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '5c5a4946-9a01-11ef-9a2f-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 10:33:31 kjcf05n02 ras-resource-manager-agent[5928]: INFO Submitting new device inserted signal, starting to qualify drive: 5c5a4946-9a01-11ef-9a2f-00093d0695e3 (admin_action.py:110) Nov 3 10:33:31 kjcf05n03 ccp-client[140762]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 10:33:31 kjcf05n03 ccp-client[140784]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 10:33:31 kjcf05n03 ccp-client[140762]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 10:33:31 kjcf05n03 ccp-client[140784]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 10:33:31 kjcf05n03 ccp-client[140784]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 10:33:31 kjcf05n03 ccp-client[140762]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 10:33:31 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '5caa9144-9a01-11ef-9a2f-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 10:33:31 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '5caa9144-9a01-11ef-9a2f-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 10:33:31 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '5caa9144-9a01-11ef-9a2f-00093d0695e3', 'response ID': '5cb18896-9a01-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 10:33:31 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 5cb18896-9a01-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 10:33:31 kjcf05n02 diskmonitor[17476]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 10:33:31 kjcf05n02 ras-resource-manager-agent[5928]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "5caa9144-9a01-11ef-9a2f-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 10:33:31 kjcf05n02 ras-resource-manager-agent[5928]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '5caa9144-9a01-11ef-9a2f-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 10:33:31 kjcf05n02 ras-resource-manager-agent[5928]: INFO Submitting new device inserted signal, starting to qualify drive: 5caa9144-9a01-11ef-9a2f-00093d0695e3 (admin_action.py:110) Nov 3 10:33:31 kjcf05n02 firmware-update-orc-server[5884]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "0033d69e-0a09-4ed2-87e4-9ab8819d7d7b"} (logger.py:65) Nov 3 10:33:34 kjcf05n03 DRVFW[140892]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 10:33:34 kjcf05n03 ccp-client[140893]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 10:33:34 kjcf05n03 ccp-client[140893]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 10:33:34 kjcf05n03 ccp-client[140902]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 10:33:34 kjcf05n03 ccp-client[140893]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 10:33:34 kjcf05n03 ccp-client[140902]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 10:33:34 kjcf05n03 ccp-client[140902]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 10:33:34 kjcf05n03 ccp-client[140893]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 10:33:34 kjcf05n03 firmware-update-orc-server[5876]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 10:33:35 kjcf05n02 ras-resource-manager-agent[5928]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '5c5a4946-9a01-11ef-9a2f-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 10:33:35 kjcf05n02 ras-resource-manager-agent[5928]: INFO Drive qualification complete responding: 5c5a4946-9a01-11ef-9a2f-00093d0695e3 (admin_action.py:205) Nov 3 10:33:35 kjcf05n02 ras-resource-manager-agent[5928]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "5c5a4946-9a01-11ef-9a2f-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (interesting_event.py:59) Nov 3 10:33:34 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 5c646b24-9a01-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 10:33:34 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '5c5a4946-9a01-11ef-9a2f-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '5c5a4946-9a01-11ef-9a2f-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}}} (logger.py:65) Nov 3 10:33:35 kjcf05n00 mcfcli[3673891]: %3|1730651615.407|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 10:33:38 kjcf05n02 diskmonitor[17476]: 24VS001, slot: 8 Nov 3 10:33:38 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 10:33:38 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 10:33:38 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 10:33:38 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 3 10:33:38 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 10:33:38 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 10:33:38 kjcf05n02 diskmonitor[17476]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 10:33:38 kjcf05n02 diskmonitor[17476]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 10:33:38 kjcf05n02 diskmonitor[17476]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 10:33:38 kjcf05n02 diskmonitor[17476]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 10:33:38 kjcf05n02 diskmonitor[17476]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 10:33:38 kjcf05n02 diskmonitor[17476]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "5c5a4946-9a01-11ef-9a2f-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 10:33:38 kjcf05n02 diskmonitor[17476]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 10:33:38 kjcf05n02 diskmonitor[17476]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 10:33:38 kjcf05n02 diskmonitor[17476]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "5caa9144-9a01-11ef-9a2f-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 10:33:38 kjcf05n02 diskmonitor[17476]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 10:33:38 kjcf05n02 diskmonitor[17476]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 10:33:40 kjcf05n02 ras-resource-manager-agent[5928]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "5c5a4946-9a01-11ef-9a2f-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (service_main_handler.py:66) Nov 3 10:33:40 kjcf05n02 ras-resource-manager-agent[5928]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '5c5a4946-9a01-11ef-9a2f-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 10:33:40 kjcf05n02 ras-resource-manager-agent[5928]: INFO Device qualification response has been acknowledged: 5c5a4946-9a01-11ef-9a2f-00093d0695e3 (admin_action.py:151) Nov 3 10:33:44 kjcf05n02 chronyd[5171]: Selected source 172.16.2.1 Nov 3 10:33:44 kjcf05n02 diskmonitor[17476]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 10:33:44 kjcf05n02 diskmonitor[17476]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 10:33:44 kjcf05n02 ras-resource-manager-agent[5928]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "64a0d8f4-9a01-11ef-9a2f-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 10:33:44 kjcf05n02 ras-resource-manager-agent[5928]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '64a0d8f4-9a01-11ef-9a2f-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 10:33:44 kjcf05n02 ras-resource-manager-agent[5928]: INFO Requests ['5caa9144-9a01-11ef-9a2f-00093d0695e3', '64a0d8f4-9a01-11ef-9a2f-00093d0695e3'] already in progress (admin_action.py:99) Nov 3 10:33:46 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 23740 (get_disk_device) Nov 3 10:33:46 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 10:33:46 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 10:33:47 kjcf05n02 ccp-client[23765]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 10:33:47 kjcf05n02 ccp-client[23765]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 10:33:47 kjcf05n02 ccp-client[23786]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 10:33:47 kjcf05n02 ccp-client[23765]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 10:33:47 kjcf05n02 ccp-client[23765]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 10:33:47 kjcf05n02 ccp-client[23786]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 10:33:47 kjcf05n02 ccp-client[23786]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 10:33:49 kjcf05n02 DRVFW[24106]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 10:33:50 kjcf05n02 ccp-client[24110]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 10:33:50 kjcf05n02 ccp-client[24110]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 10:33:50 kjcf05n02 ccp-client[24126]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 10:33:50 kjcf05n02 ccp-client[24110]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 10:33:50 kjcf05n02 ccp-client[24110]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 10:33:50 kjcf05n02 ccp-client[24126]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 10:33:50 kjcf05n02 ccp-client[24126]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 10:33:50 kjcf05n02 firmware-update-orc-server[5884]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 10:33:50 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 3 10:33:50 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 10:33:50 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 3 10:33:51 kjcf05n02 ras-resource-manager-agent[5928]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '5caa9144-9a01-11ef-9a2f-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 10:33:51 kjcf05n02 ras-resource-manager-agent[5928]: INFO Drive qualification complete responding: 5caa9144-9a01-11ef-9a2f-00093d0695e3 (admin_action.py:205) Nov 3 10:33:51 kjcf05n02 ras-resource-manager-agent[5928]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "5caa9144-9a01-11ef-9a2f-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} (interesting_event.py:59) Nov 3 10:33:51 kjcf05n02 ras-resource-manager-agent[5928]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "64a0d8f4-9a01-11ef-9a2f-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} (interesting_event.py:59) Nov 3 10:33:51 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 5cb18896-9a01-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 10:33:51 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '5caa9144-9a01-11ef-9a2f-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '5caa9144-9a01-11ef-9a2f-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 18}}}} (logger.py:65) Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "5c5a4946-9a01-11ef-9a2f-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: Dbus, handle_ingress_ras_signals, uuid: 5c5a4946-9a01-11ef-9a2f-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "5c5a4946-9a01-11ef-9a2f-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: main: Pending firmware leveling requests exist, rescanning disks Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "64a0d8f4-9a01-11ef-9a2f-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: leaving test state: 1 next state: 2 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: lock req: no timeout Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: leaving test state: 2 next state: 4 Nov 3 10:33:52 kjcf05n02 diskmonitor[17476]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 10:33:56 kjcf05n02 python3.9[5233]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 10:33:58 kjcf05n00 mcfcli[3673891]: %3|1730651638.353|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:34:02 kjcf05n02 python3.9[3186]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:34:05 kjcf05n00 mcfcli[3673891]: %3|1730651645.407|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:34:13 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31431 deleted. Nov 3 10:34:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730651656}"] Nov 3 10:34:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730651656, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:34:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:34:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730651656}"] Nov 3 10:34:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730651656, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:34:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730651656}"] Nov 3 10:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730651656, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:34:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730651656}"] Nov 3 10:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730651656, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:34:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730651656}"] Nov 3 10:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730651656, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:34:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730651656}"] Nov 3 10:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730651656, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:34:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730651656}"] Nov 3 10:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730651656, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:34:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730651657}"] Nov 3 10:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730651657, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:34:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:34:35 kjcf05n00 mcfcli[3673891]: %3|1730651675.407|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:34:38 kjcf05n00 mcfcli[3673891]: %3|1730651678.286|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:34:50 kjcf05n02 ras-resource-manager-agent[5928]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "5caa9144-9a01-11ef-9a2f-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} (service_main_handler.py:66) Nov 3 10:34:50 kjcf05n02 ras-resource-manager-agent[5928]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '5caa9144-9a01-11ef-9a2f-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 10:34:50 kjcf05n02 ras-resource-manager-agent[5928]: INFO Device qualification response has been acknowledged: 5caa9144-9a01-11ef-9a2f-00093d0695e3 (admin_action.py:151) Nov 3 10:34:50 kjcf05n02 ras-resource-manager-agent[5928]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "64a0d8f4-9a01-11ef-9a2f-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} (service_main_handler.py:66) Nov 3 10:34:50 kjcf05n02 ras-resource-manager-agent[5928]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '64a0d8f4-9a01-11ef-9a2f-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 10:34:50 kjcf05n02 ras-resource-manager-agent[5928]: INFO Device qualification response has been acknowledged: 64a0d8f4-9a01-11ef-9a2f-00093d0695e3 (admin_action.py:151) Nov 3 10:34:52 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 10:34:52 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 10:34:52 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "5caa9144-9a01-11ef-9a2f-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: Dbus, handle_ingress_ras_signals, uuid: 5caa9144-9a01-11ef-9a2f-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "5caa9144-9a01-11ef-9a2f-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "64a0d8f4-9a01-11ef-9a2f-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: Dbus, handle_ingress_ras_signals, uuid: 64a0d8f4-9a01-11ef-9a2f-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "64a0d8f4-9a01-11ef-9a2f-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 10:34:52 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 10:34:54 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 10:35:05 kjcf05n00 mcfcli[3673891]: %3|1730651705.409|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 10:35:07 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 10:35:07 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 10:35:07 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 10:35:08 kjcf05n02 dcs-collectord[5664]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 10:35:08 kjcf05n00 python3.9[1181935]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 10:35:11 kjcf05n02 diskmonitor[17476]: vme24n1 in enclosure slot: 10 Nov 3 10:35:11 kjcf05n02 diskmonitor[17476]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 10:35:11 kjcf05n02 diskmonitor[17476]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 10:35:11 kjcf05n02 diskmonitor[17476]: lock acquired Nov 3 10:35:11 kjcf05n02 diskmonitor[17476]: leaving test state: 4 next state: 8 Nov 3 10:35:11 kjcf05n02 diskmonitor[17476]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 10:35:12 kjcf05n00 mcfcli[3673891]: %3|1730651712.847|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:35:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730651716}"] Nov 3 10:35:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730651716, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:35:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:35:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:35:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:35:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:35:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:35:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:35:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:35:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:35:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:35:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:35:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:35:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:35:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:35:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.234665ms Nov 3 10:35:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:35:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.234665ms Nov 3 10:35:16 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:35:16 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:35:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:35:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Inactive', 'timestamp': 1730651716}"] Nov 3 10:35:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730651716, 'value': 'Inactive', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:35:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:35:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:35:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:35:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:35:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:35:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:35:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:35:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:35:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:35:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:35:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:35:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:35:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:35:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.04519ms Nov 3 10:35:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:35:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.04519ms Nov 3 10:35:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:35:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:35:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730651423', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 10:35:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730651423'} Nov 3 10:35:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:35:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730651423', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 10:35:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730651423'} Nov 3 10:35:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:35:29 kjcf05n02 diskmonitor[17476]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 10:35:29 kjcf05n02 diskmonitor[17476]: leaving test state: 8 next state: 20 Nov 3 10:35:29 kjcf05n02 diskmonitor[17476]: leaving test state: 20 next state: 40 Nov 3 10:35:29 kjcf05n02 diskmonitor[17476]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 325d5280000 Nov 3 10:35:29 kjcf05n02 diskmonitor[17476]: leaving test state: 40 next state: 80 Nov 3 10:35:35 kjcf05n00 mcfcli[3673891]: %3|1730651735.409|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 10:35:48 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 10:35:51 kjcf05n00 mcfcli[3673891]: %3|1730651751.117|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:36:05 kjcf05n00 mcfcli[3673891]: %3|1730651765.410|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 10:36:24 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 10:36:28 kjcf05n02 diskmonitor[17476]: leaving test state: 80 next state: 100 Nov 3 10:36:28 kjcf05n02 diskmonitor[17476]: lock release: time: Sun Nov 3 10:36:23 2024 Nov 3 10:36:28 kjcf05n02 diskmonitor[17476]: leaving test state: 100 next state: 1 Nov 3 10:36:28 kjcf05n00 mcfcli[3673891]: %3|1730651788.758|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:36:35 kjcf05n00 mcfcli[3673891]: %3|1730651795.410|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:37:05 kjcf05n00 mcfcli[3673891]: %3|1730651825.410|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 10:37:06 kjcf05n00 mcfcli[3673891]: %3|1730651826.447|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:37:35 kjcf05n00 mcfcli[3673891]: %3|1730651855.411|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 10:37:45 kjcf05n00 mcfcli[3673891]: %3|1730651865.332|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:37:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730651866}"] Nov 3 10:37:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730651866, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:37:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:37:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:37:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:37:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:37:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:37:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:37:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:37:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:37:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:37:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:37:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:37:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:37:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:37:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.044429ms Nov 3 10:37:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:37:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.044429ms Nov 3 10:37:47 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:37:47 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:37:47 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:38:05 kjcf05n00 mcfcli[3673891]: %3|1730651885.411|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:38:23 kjcf05n00 mcfcli[3673891]: %3|1730651903.030|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:38:35 kjcf05n00 mcfcli[3673891]: %3|1730651915.412|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:39:03 kjcf05n00 mcfcli[3673891]: %3|1730651943.027|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:39:05 kjcf05n00 mcfcli[3673891]: %3|1730651945.412|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:39:35 kjcf05n00 mcfcli[3673891]: %3|1730651975.412|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:39:41 kjcf05n00 mcfcli[3673891]: %3|1730651981.349|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 10:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 10:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 10:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 10:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 10:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 10:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 10:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 10:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 10:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 10:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 10:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 10:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 10:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 10:40:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 10:40:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:40:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 10:40:05 kjcf05n00 mcfcli[3673891]: %3|1730652005.413|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:40:08 kjcf05n00 python3.9[1184757]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 10:40:17 kjcf05n00 mcfcli[3673891]: %3|1730652017.659|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:40:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730651423', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 10:40:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730651423'} Nov 3 10:40:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:40:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730651423', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 10:40:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730651423'} Nov 3 10:40:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:40:35 kjcf05n00 mcfcli[3673891]: %3|1730652035.413|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 10:40:54 kjcf05n00 mcfcli[3673891]: %3|1730652054.734|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:41:05 kjcf05n00 mcfcli[3673891]: %3|1730652065.414|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:41:32 kjcf05n00 mcfcli[3673891]: %3|1730652092.898|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:41:35 kjcf05n00 mcfcli[3673891]: %3|1730652095.415|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 10:42:05 kjcf05n00 mcfcli[3673891]: %3|1730652125.415|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 10:42:09 kjcf05n00 mcfcli[3673891]: %3|1730652129.597|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:42:22 kjcf05n03 chronyd[5161]: Selected source 16.110.135.123 Nov 3 10:42:35 kjcf05n00 mcfcli[3673891]: %3|1730652155.415|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:42:48 kjcf05n00 mcfcli[3673891]: %3|1730652168.456|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:43:05 kjcf05n00 mcfcli[3673891]: %3|1730652185.416|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 10:43:12 kjcf05n03 nslcd[7088]: [45e146] ldap_result() failed: Can't contact LDAP server Nov 3 10:43:24 kjcf05n02 root[42806]: failback_xyraid Nov 3 10:43:25 kjcf05n02 root[42928]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 10:43:26 kjcf05n00 mcfcli[3673891]: %3|1730652206.376|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:43:27 kjcf05n02 root[43066]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 10:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T10:43:27.253710157-06:00 level=info msg="Completed cleanup jobs" duration=27.078503ms Nov 3 10:43:29 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 3 10:43:35 kjcf05n00 mcfcli[3673891]: %3|1730652215.416|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 10:43:36 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme19n1 Nov 3 10:43:36 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme3n1 Nov 3 10:43:36 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme4n1 Nov 3 10:43:36 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme24n1 Nov 3 10:43:36 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme25n1 Nov 3 10:43:36 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme2n1 Nov 3 10:43:36 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme17n1 Nov 3 10:43:36 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme23n1 Nov 3 10:43:36 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme18n1 Nov 3 10:43:36 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme8n1 Nov 3 10:43:36 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme9n1 Nov 3 10:43:38 kjcf05n02 dwd[5204]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 10:43:38 kjcf05n02 dwd[5204]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 10:43:38 kjcf05n02 dwd[5204]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 10:43:38 kjcf05n02 dwd[5204]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 10:43:38 kjcf05n02 dwd[5204]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 10:43:38 kjcf05n02 dwd[5204]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 10:43:38 kjcf05n02 dwd[5204]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 10:43:38 kjcf05n02 dwd[5204]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 10:43:38 kjcf05n02 dwd[5204]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 10:43:38 kjcf05n02 dwd[5204]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 10:43:38 kjcf05n02 dwd[5204]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 10:43:38 kjcf05n02 dwd[5204]: Starting NVME thread for nvme2n1 Nov 3 10:43:38 kjcf05n02 dwd[5204]: Starting NVME thread for nvme18n1 Nov 3 10:43:38 kjcf05n02 dwd[5204]: Starting NVME thread for nvme19n1 Nov 3 10:43:38 kjcf05n02 dwd[5204]: Starting NVME thread for nvme9n1 Nov 3 10:43:39 kjcf05n02 dwd[5204]: Starting NVME thread for nvme3n1 Nov 3 10:43:39 kjcf05n02 systemd-udevd[45971]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45972]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45973]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45975]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45971]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45972]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45973]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45975]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45971]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45972]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45973]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45975]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45971]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45972]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45973]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45975]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45971]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45972]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45973]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45975]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45971]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45972]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45973]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45975]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45972]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46001]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45971]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46002]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45973]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46001]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45972]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45971]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45975]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46005]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46002]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46009]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45973]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45971]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45972]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46009]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46005]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45971]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45972]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45971]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46002]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46005]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45972]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45971]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45972]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45972]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45972]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[45972]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 systemd-udevd[46009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:43:39 kjcf05n02 dwd[5204]: Starting NVME thread for nvme24n1 Nov 3 10:43:39 kjcf05n02 dwd[5204]: Starting NVME thread for nvme4n1 Nov 3 10:43:39 kjcf05n02 dwd[5204]: Starting NVME thread for nvme23n1 Nov 3 10:43:39 kjcf05n02 dwd[5204]: Starting NVME thread for nvme17n1 Nov 3 10:43:39 kjcf05n02 dwd[5204]: Starting NVME thread for nvme25n1 Nov 3 10:43:39 kjcf05n02 dwd[5204]: Starting NVME thread for nvme8n1 Nov 3 10:43:40 kjcf05n02 dcs-bulk-data-sender[6215]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 141}' Nov 3 10:43:41 kjcf05n02 nslcd[6960]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 10:43:41 kjcf05n02 diskmonitor[17476]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 10:43:48 kjcf05n02 diskmonitor[17476]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 10:43:48 kjcf05n02 diskmonitor[17476]: Scan for ReadErrorMax change for md65 Nov 3 10:43:48 kjcf05n02 diskmonitor[17476]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 10:43:48 kjcf05n02 diskmonitor[17476]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 10:43:48 kjcf05n02 diskmonitor[17476]: read_saved_file: md65 no saved speed Nov 3 10:43:48 kjcf05n02 diskmonitor[17476]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 10:43:48 kjcf05n02 diskmonitor[17476]: Set sync_speed_min (10000) for md65 Nov 3 10:43:48 kjcf05n02 diskmonitor[17476]: Set sync_speed_max (200000) for md65 Nov 3 10:43:48 kjcf05n02 diskmonitor[17476]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 10:44:04 kjcf05n00 mcfcli[3673891]: %3|1730652244.657|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:44:05 kjcf05n00 mcfcli[3673891]: %3|1730652245.416|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 10:44:22 kjcf05n03 diskmonitor[17376]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 10:44:22 kjcf05n03 diskmonitor[17376]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 10:44:28 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 10:44:28 kjcf05n02 systemd-tmpfiles[48595]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 10:44:28 kjcf05n02 systemd-tmpfiles[48595]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 10:44:28 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 10:44:28 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 10:44:33 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 48868 (bash) Nov 3 10:44:33 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 10:44:33 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 10:44:35 kjcf05n00 mcfcli[3673891]: %3|1730652275.416|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:44:44 kjcf05n00 mcfcli[3673891]: %3|1730652284.559|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:44:46 kjcf05n00 zabbix-server[1187591]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 10:44:46 kjcf05n00 zabbix-server[1187591]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46125' Nov 3 10:44:46 kjcf05n00 zabbix-server[1187591]: Filesystem 'kjcf05' has been mounted Nov 3 10:44:47 kjcf05n00 zabbix-server[1187591]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 10:44:47 kjcf05n00 zabbix-server[1187591]: Running puppet on 'None' Nov 3 10:44:49 kjcf05n05 puppet-agent[3081368]: Using configured environment 'production' Nov 3 10:44:49 kjcf05n05 puppet-agent[3081368]: Retrieving pluginfacts Nov 3 10:44:49 kjcf05n05 puppet-agent[3081368]: Retrieving plugin Nov 3 10:44:49 kjcf05n03 puppet-agent[161038]: Using configured environment 'production' Nov 3 10:44:49 kjcf05n03 puppet-agent[161038]: Retrieving pluginfacts Nov 3 10:44:49 kjcf05n03 puppet-agent[161038]: Retrieving plugin Nov 3 10:44:49 kjcf05n02 puppet-agent[49679]: Using configured environment 'production' Nov 3 10:44:49 kjcf05n02 puppet-agent[49679]: Retrieving pluginfacts Nov 3 10:44:49 kjcf05n02 puppet-agent[49679]: Retrieving plugin Nov 3 10:44:49 kjcf05n07 puppet-agent[2928344]: Using configured environment 'production' Nov 3 10:44:49 kjcf05n07 puppet-agent[2928344]: Retrieving pluginfacts Nov 3 10:44:49 kjcf05n07 puppet-agent[2928344]: Retrieving plugin Nov 3 10:44:49 kjcf05n04 puppet-agent[2928941]: Using configured environment 'production' Nov 3 10:44:49 kjcf05n04 puppet-agent[2928941]: Retrieving pluginfacts Nov 3 10:44:49 kjcf05n04 puppet-agent[2928941]: Retrieving plugin Nov 3 10:44:49 kjcf05n04 puppet-agent[2928941]: Loading facts Nov 3 10:44:49 kjcf05n06 puppet-agent[2930959]: Using configured environment 'production' Nov 3 10:44:49 kjcf05n06 puppet-agent[2930959]: Retrieving pluginfacts Nov 3 10:44:49 kjcf05n06 puppet-agent[2930959]: Retrieving plugin Nov 3 10:44:49 kjcf05n06 puppet-agent[2930959]: Loading facts Nov 3 10:44:49 kjcf05n05 puppet-agent[3081368]: Loading facts Nov 3 10:44:49 kjcf05n01 puppet-agent[3047650]: Using configured environment 'production' Nov 3 10:44:49 kjcf05n01 puppet-agent[3047650]: Retrieving pluginfacts Nov 3 10:44:49 kjcf05n01 puppet-agent[3047650]: Retrieving plugin Nov 3 10:44:49 kjcf05n03 puppet-agent[161038]: Loading facts Nov 3 10:44:49 kjcf05n02 puppet-agent[49679]: Loading facts Nov 3 10:44:49 kjcf05n07 puppet-agent[2928344]: Loading facts Nov 3 10:44:49 kjcf05n00 puppet-agent[1187768]: Using configured environment 'production' Nov 3 10:44:49 kjcf05n00 puppet-agent[1187768]: Retrieving pluginfacts Nov 3 10:44:49 kjcf05n00 puppet-agent[1187768]: Retrieving plugin Nov 3 10:44:50 kjcf05n01 puppet-agent[3047650]: Loading facts Nov 3 10:44:50 kjcf05n00 puppet-agent[1187768]: Loading facts Nov 3 10:44:52 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 10:44:53 kjcf05n03 puppet-agent[161038]: Caching catalog for kjcf05n03 Nov 3 10:44:53 kjcf05n03 puppet-agent[161038]: Applying configuration version '1730652290' Nov 3 10:44:53 kjcf05n07 puppet-agent[2928344]: Caching catalog for kjcf05n07 Nov 3 10:44:53 kjcf05n07 puppet-agent[2928344]: Applying configuration version '1730652291' Nov 3 10:44:52 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 10:44:52 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 10:44:54 kjcf05n06 puppet-agent[2930959]: Caching catalog for kjcf05n06 Nov 3 10:44:54 kjcf05n06 puppet-agent[2930959]: Applying configuration version '1730652291' Nov 3 10:44:54 kjcf05n01 puppet-agent[3047650]: Caching catalog for kjcf05n01 Nov 3 10:44:54 kjcf05n01 puppet-agent[3047650]: Applying configuration version '1730652292' Nov 3 10:44:54 kjcf05n00 puppet-agent[1187768]: Caching catalog for kjcf05n00 Nov 3 10:44:54 kjcf05n00 puppet-agent[1187768]: Applying configuration version '1730652292' Nov 3 10:44:55 kjcf05n02 puppet-agent[49679]: Caching catalog for kjcf05n02 Nov 3 10:44:55 kjcf05n02 puppet-agent[49679]: Applying configuration version '1730652290' Nov 3 10:44:55 kjcf05n03 puppet-agent[161038]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 10:44:55 kjcf05n03 puppet-agent[161038]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 10:44:55 kjcf05n03 puppet-agent[161038]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 10:44:55 kjcf05n07 puppet-agent[2928344]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 10:44:55 kjcf05n07 puppet-agent[2928344]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 10:44:55 kjcf05n07 puppet-agent[2928344]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 10:44:55 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 10:44:55 kjcf05n03 zabbix_agent2[105305]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 10:44:55 kjcf05n03 zabbix_agent2[3192]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 10:44:55 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 10:44:55 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 10:44:55 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 10:44:55 kjcf05n03 puppet-agent[161038]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: Press Ctrl+C to exit. Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: Plugin support version 1.0 Nov 3 10:44:55 kjcf05n03 zabbix_agent2[161398]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 10:44:55 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2876013]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 10:44:55 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 10:44:55 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 10:44:55 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 10:44:55 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 10:44:55 kjcf05n07 puppet-agent[2928344]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: Press Ctrl+C to exit. Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: Plugin support version 1.0 Nov 3 10:44:55 kjcf05n07 zabbix_agent2[2928787]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 10:44:55 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 10:44:56 kjcf05n00 ipmievd[15617]: Last message 'Memory sensor - Corr' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 10:44:56 kjcf05n06 puppet-agent[2930959]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 10:44:56 kjcf05n06 puppet-agent[2930959]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 10:44:56 kjcf05n06 puppet-agent[2930959]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 10:44:56 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2879244]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 10:44:56 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 10:44:56 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 10:44:56 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 10:44:56 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 10:44:56 kjcf05n06 puppet-agent[2930959]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: Press Ctrl+C to exit. Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: Plugin support version 1.0 Nov 3 10:44:56 kjcf05n06 zabbix_agent2[2932499]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 10:44:57 kjcf05n02 puppet-agent[49679]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 10:44:57 kjcf05n02 puppet-agent[49679]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 10:44:57 kjcf05n02 puppet-agent[49679]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 10:44:57 kjcf05n00 puppet-agent[1187768]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 10:44:57 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 10:44:57 kjcf05n02 zabbix_agent2[6012]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 10:44:57 kjcf05n02 zabbix_agent2[3186]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 10:44:57 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 10:44:57 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 10:44:57 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 10:44:57 kjcf05n02 puppet-agent[49679]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: Press Ctrl+C to exit. Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: Plugin support version 1.0 Nov 3 10:44:57 kjcf05n02 zabbix_agent2[50373]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 10:44:57 kjcf05n07 puppet-agent[2928344]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 10:44:57 kjcf05n07 puppet-agent[2928344]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 10:44:57 kjcf05n07 puppet-agent[2928344]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 10:44:57 kjcf05n07 puppet-agent[2928344]: Applied catalog in 5.01 seconds Nov 3 10:44:57 kjcf05n01 puppet-agent[3047650]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 10:44:57 kjcf05n01 puppet-agent[3047650]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-10:25:27]/mode) mode changed '0755' to '0750' Nov 3 10:44:57 kjcf05n01 puppet-agent[3047650]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-10:25:27/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 10:44:57 kjcf05n01 puppet-agent[3047650]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-10:25:27/vmcore]/mode) mode changed '0600' to '0640' Nov 3 10:44:57 kjcf05n01 puppet-agent[3047650]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-10:25:27/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 10:44:57 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 10:44:57 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 10:44:57 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 10:44:57 kjcf05n03 puppet-agent[161038]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 10:44:57 kjcf05n03 puppet-agent[161038]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 10:44:57 kjcf05n03 puppet-agent[161038]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 10:44:57 kjcf05n03 puppet-agent[161038]: Applied catalog in 5.34 seconds Nov 3 10:44:58 kjcf05n00 puppet-agent[1187768]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 10:44:58 kjcf05n00 puppet-agent[1187768]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 10:44:58 kjcf05n00 puppet-agent[1187768]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 10:44:58 kjcf05n06 puppet-agent[2930959]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 10:44:58 kjcf05n06 puppet-agent[2930959]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 10:44:58 kjcf05n06 puppet-agent[2930959]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 10:44:58 kjcf05n06 puppet-agent[2930959]: Applied catalog in 4.84 seconds Nov 3 10:44:58 kjcf05n01 puppet-agent[3047650]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 10:44:58 kjcf05n01 puppet-agent[3047650]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 10:44:58 kjcf05n01 puppet-agent[3047650]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 10:44:59 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3035993]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 10:44:59 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 10:44:59 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 10:44:59 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 10:44:59 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 10:44:59 kjcf05n01 puppet-agent[3047650]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: Press Ctrl+C to exit. Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: Plugin support version 1.0 Nov 3 10:44:59 kjcf05n01 zabbix_agent2[3048081]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 10:44:58 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1169711]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 10:44:59 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 10:44:58 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 10:44:58 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 10:44:58 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 10:44:58 kjcf05n00 puppet-agent[1187768]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: Press Ctrl+C to exit. Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: Plugin support version 1.0 Nov 3 10:44:58 kjcf05n00 zabbix_agent2[1188304]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 10:44:59 kjcf05n02 puppet-agent[49679]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 10:44:59 kjcf05n02 puppet-agent[49679]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 10:44:59 kjcf05n02 puppet-agent[49679]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 10:44:59 kjcf05n00 zabbix-server[1188336]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 10:45:00 kjcf05n02 puppet-agent[49679]: Applied catalog in 5.05 seconds Nov 3 10:44:59 kjcf05n00 zabbix-server[1188352]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 10:45:00 kjcf05n00 zabbix-server[1188367]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 10:45:00 kjcf05n00 zabbix-server[1188377]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 10:45:00 kjcf05n00 puppet-agent[1187768]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 10:45:01 kjcf05n01 puppet-agent[3047650]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_103249.log]/mode) mode changed '0644' to '0640' Nov 3 10:45:01 kjcf05n01 puppet-agent[3047650]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_104432.log]/mode) mode changed '0644' to '0640' Nov 3 10:45:01 kjcf05n01 puppet-agent[3047650]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_104433]/mode) mode changed '0755' to '0750' Nov 3 10:45:01 kjcf05n01 puppet-agent[3047650]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_104433/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 10:45:02 kjcf05n01 puppet-agent[3047650]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_103248.log]/mode) mode changed '0644' to '0640' Nov 3 10:45:02 kjcf05n01 puppet-agent[3047650]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_104432.log]/mode) mode changed '0644' to '0640' Nov 3 10:45:02 kjcf05n01 puppet-agent[3047650]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 10:45:02 kjcf05n01 puppet-agent[3047650]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 10:45:02 kjcf05n01 puppet-agent[3047650]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 10:45:01 kjcf05n00 puppet-agent[1187768]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 10:45:01 kjcf05n00 puppet-agent[1187768]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 10:45:01 kjcf05n00 puppet-agent[1187768]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 10:45:02 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 10:45:03 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 10:45:02 kjcf05n00 puppet-agent[1187768]: Applied catalog in 8.34 seconds Nov 3 10:45:03 kjcf05n01 puppet-agent[3047650]: Applied catalog in 8.69 seconds Nov 3 10:45:04 kjcf05n04 puppet-agent[2928941]: Caching catalog for kjcf05n04 Nov 3 10:45:04 kjcf05n04 puppet-agent[2928941]: Applying configuration version '1730652302' Nov 3 10:45:05 kjcf05n00 mcfcli[3673891]: %3|1730652305.416|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 10:45:06 kjcf05n04 puppet-agent[2928941]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 10:45:06 kjcf05n04 puppet-agent[2928941]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 10:45:06 kjcf05n04 puppet-agent[2928941]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 10:45:07 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2882964]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 10:45:07 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 10:45:07 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 10:45:07 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 10:45:07 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 10:45:07 kjcf05n04 puppet-agent[2928941]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: Press Ctrl+C to exit. Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: Plugin support version 1.0 Nov 3 10:45:07 kjcf05n04 zabbix_agent2[2929874]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 10:45:08 kjcf05n00 python3.9[1188413]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 10:45:08 kjcf05n04 puppet-agent[2928941]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 10:45:08 kjcf05n04 puppet-agent[2928941]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 10:45:08 kjcf05n04 puppet-agent[2928941]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 10:45:08 kjcf05n04 puppet-agent[2928941]: Applied catalog in 4.79 seconds Nov 3 10:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730652317}"] Nov 3 10:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730652317, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.422837ms Nov 3 10:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.422837ms Nov 3 10:45:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:45:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:45:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730652317}"] Nov 3 10:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730652317, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.121944ms Nov 3 10:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.121944ms Nov 3 10:45:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:45:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:45:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730652317}"] Nov 3 10:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730652317, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.175774ms Nov 3 10:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.175774ms Nov 3 10:45:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:45:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:45:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730652317}"] Nov 3 10:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730652317, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.935054ms Nov 3 10:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.935054ms Nov 3 10:45:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:45:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:45:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730652317}"] Nov 3 10:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730652317, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.820669ms Nov 3 10:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.820669ms Nov 3 10:45:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:45:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:45:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730652317}"] Nov 3 10:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730652317, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:45:17 kjcf05n05 puppet-agent[3081368]: Caching catalog for kjcf05n05 Nov 3 10:45:17 kjcf05n05 puppet-agent[3081368]: Applying configuration version '1730652316' Nov 3 10:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.203377ms Nov 3 10:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.203377ms Nov 3 10:45:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:45:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:45:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730652317}"] Nov 3 10:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730652317, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.808887ms Nov 3 10:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.808887ms Nov 3 10:45:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:45:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:45:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730652317}"] Nov 3 10:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730652317, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.711966ms Nov 3 10:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.711966ms Nov 3 10:45:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:45:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:45:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730652317}"] Nov 3 10:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730652317, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.901731ms Nov 3 10:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.901731ms Nov 3 10:45:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:45:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:45:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730652317}"] Nov 3 10:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730652317, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.999495ms Nov 3 10:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.999495ms Nov 3 10:45:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:45:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:45:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730652317}"] Nov 3 10:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730652317, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 10:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 10:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T10:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 10:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T10:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 10:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T10:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.741201ms Nov 3 10:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T10:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.741201ms Nov 3 10:45:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:10:45:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 10:45:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:45:20 kjcf05n05 puppet-agent[3081368]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 10:45:20 kjcf05n05 puppet-agent[3081368]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 10:45:20 kjcf05n05 puppet-agent[3081368]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 10:45:20 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3033705]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 10:45:20 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 10:45:20 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 10:45:20 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 10:45:20 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 10:45:20 kjcf05n05 puppet-agent[3081368]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: Starting Zabbix Agent 2 (6.2.1) Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: Press Ctrl+C to exit. Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: Plugin support version 1.0 Nov 3 10:45:20 kjcf05n05 zabbix_agent2[3082611]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 10:45:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730652321', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 10:45:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730652321'} Nov 3 10:45:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:45:22 kjcf05n05 puppet-agent[3081368]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 10:45:22 kjcf05n05 puppet-agent[3081368]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 10:45:22 kjcf05n05 puppet-agent[3081368]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 10:45:22 kjcf05n00 zabbix-server[1187591]: puppet completed status:(0): '' Nov 3 10:45:22 kjcf05n00 zabbix-server[1187591]: Event '46125' acknowledged Nov 3 10:45:22 kjcf05n00 zabbix-server[1187591]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 3 10:45:22 kjcf05n05 puppet-agent[3081368]: Applied catalog in 4.77 seconds Nov 3 10:45:22 kjcf05n00 mcfcli[3673891]: %3|1730652322.931|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:45:35 kjcf05n00 mcfcli[3673891]: %3|1730652335.416|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 10:46:01 kjcf05n00 mcfcli[3673891]: %3|1730652361.351|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:46:05 kjcf05n00 mcfcli[3673891]: %3|1730652365.418|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:46:35 kjcf05n00 mcfcli[3673891]: %3|1730652395.418|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:46:39 kjcf05n00 mcfcli[3673891]: %3|1730652399.115|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:47:05 kjcf05n00 mcfcli[3673891]: %3|1730652425.419|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:47:15 kjcf05n00 mcfcli[3673891]: %3|1730652435.149|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:47:35 kjcf05n00 mcfcli[3673891]: %3|1730652455.419|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 10:47:52 kjcf05n00 mcfcli[3673891]: %3|1730652472.275|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:48:05 kjcf05n00 mcfcli[3673891]: %3|1730652485.420|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:48:32 kjcf05n00 mcfcli[3673891]: %3|1730652512.272|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:48:35 kjcf05n00 mcfcli[3673891]: %3|1730652515.420|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:48:53 kjcf05n02 dwd[5204]: nvme2n1 passed periodic SMART status check Nov 3 10:48:53 kjcf05n02 dwd[5204]: nvme19n1 passed periodic SMART status check Nov 3 10:48:53 kjcf05n02 dwd[5204]: nvme9n1 passed periodic SMART status check Nov 3 10:48:53 kjcf05n02 dwd[5204]: nvme3n1 passed periodic SMART status check Nov 3 10:48:53 kjcf05n02 dwd[5204]: nvme18n1 passed periodic SMART status check Nov 3 10:48:54 kjcf05n02 dwd[5204]: nvme25n1 passed periodic SMART status check Nov 3 10:48:54 kjcf05n02 dwd[5204]: nvme4n1 passed periodic SMART status check Nov 3 10:48:54 kjcf05n02 dwd[5204]: nvme24n1 passed periodic SMART status check Nov 3 10:48:54 kjcf05n02 dwd[5204]: nvme8n1 passed periodic SMART status check Nov 3 10:48:54 kjcf05n02 dwd[5204]: nvme17n1 passed periodic SMART status check Nov 3 10:48:54 kjcf05n02 dwd[5204]: nvme23n1 passed periodic SMART status check Nov 3 10:49:05 kjcf05n00 mcfcli[3673891]: %3|1730652545.421|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:49:11 kjcf05n00 mcfcli[3673891]: %3|1730652551.686|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:49:35 kjcf05n00 mcfcli[3673891]: %3|1730652575.422|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:49:51 kjcf05n00 mcfcli[3673891]: %3|1730652591.683|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 10:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 10:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 10:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 10:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 10:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 10:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 10:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 10:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 10:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 10:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 10:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 10:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 10:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 10:50:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 10:50:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 10:50:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 10:50:05 kjcf05n00 mcfcli[3673891]: %3|1730652605.422|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:50:11 kjcf05n00 python3.9[1191352]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 10:50:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730652631', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 10:50:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730652631'} Nov 3 10:50:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 10:50:31 kjcf05n00 mcfcli[3673891]: %3|1730652631.680|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:50:35 kjcf05n00 mcfcli[3673891]: %3|1730652635.422|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 10:51:05 kjcf05n00 mcfcli[3673891]: %3|1730652665.422|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:51:10 kjcf05n00 mcfcli[3673891]: %3|1730652670.518|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:51:35 kjcf05n00 mcfcli[3673891]: %3|1730652695.423|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:51:45 kjcf05n00 mcfcli[3673891]: %3|1730652705.646|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:52:05 kjcf05n00 mcfcli[3673891]: %3|1730652725.423|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 10:52:21 kjcf05n00 mcfcli[3673891]: %3|1730652741.199|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:52:35 kjcf05n00 mcfcli[3673891]: %3|1730652755.423|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 10:52:58 kjcf05n00 mcfcli[3673891]: %3|1730652778.689|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:53:05 kjcf05n00 mcfcli[3673891]: %3|1730652785.424|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T16:53:15.868147Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 10:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T16:53:15.868218Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.093ms Nov 3 10:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T10:53:27.268089626-06:00 level=info msg="Completed cleanup jobs" duration=41.500473ms Nov 3 10:53:35 kjcf05n00 mcfcli[3673891]: %3|1730652815.425|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 10:53:37 kjcf05n00 mcfcli[3673891]: %3|1730652817.538|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:54:05 kjcf05n00 mcfcli[3673891]: %3|1730652845.425|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:54:15 kjcf05n00 mcfcli[3673891]: %3|1730652855.958|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:54:35 kjcf05n00 mcfcli[3673891]: %3|1730652875.425|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 10:54:51 kjcf05n00 mcfcli[3673891]: %3|1730652891.188|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:55:05 kjcf05n00 mcfcli[3673891]: %3|1730652905.427|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 10:55:10 kjcf05n00 python3.9[1194178]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 10:55:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 10:55:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 10:55:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 10:55:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 10:55:28 kjcf05n00 mcfcli[3673891]: %3|1730652928.159|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:55:35 kjcf05n00 mcfcli[3673891]: %3|1730652935.427|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:55:37 kjcf05n00 zabbix_server[15769]: Zabbix agent item "proc.num[,,run]" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 3 10:55:37 kjcf05n00 zabbix_server[15761]: Zabbix agent item "dcs.lustre.device.ost.name[OST0002,ost_name]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 3 10:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 10:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 10:55:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 10:55:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 10:55:43 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='39', error='Connection reset by peer (104)' Nov 3 10:55:43 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='39', client='AF_INET(172.16.2.5:45377)', local='AF_INET(0.0.0.0:601)' Nov 3 10:55:44 kjcf05n03 fstonithd.py[15106]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 3 10:55:44 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 10:55:44 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 10:55:44 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 10:55:45 kjcf05n03 root[179082]: is_viking_off starts Nov 3 10:55:45 kjcf05n03 root[179083]: is_enc_ipmi_off starts Nov 3 10:55:45 kjcf05n03 root[179099]: is_lan_ipmi_off leaves Nov 3 10:55:45 kjcf05n03 root[179101]: is_lan_ipmi_sec_off leaves Nov 3 10:55:45 kjcf05n03 root[179123]: I am in slot 1; partner is in slot 0 Nov 3 10:55:45 kjcf05n03 root[179126]: I am master Nov 3 10:55:52 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.cpu.load[all,avg5]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 10:55:52 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0002,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 10:55:55 kjcf05n03 root[179414]: is_viking_off leaves Nov 3 10:55:55 kjcf05n03 root[179417]: kjcf05n02 not already off look at kdump Nov 3 10:55:55 kjcf05n03 root[179418]: is_kdump_off starts Nov 3 10:55:55 kjcf05n03 fence_kdump[179419]: waiting for message from '172.16.2.5' Nov 3 10:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 10:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 10:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 10:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 10:55:56 kjcf05n03 fence_kdump[179419]: received valid message from '172.16.2.5' Nov 3 10:55:56 kjcf05n03 root[179420]: is_kdump_off detected kdump on kjcf05n02 Nov 3 10:55:56 kjcf05n03 root[179421]: kjcf05n02 is kdumping Nov 3 10:55:55 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 10:55:55 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 10:55:56 kjcf05n03 root[179529]: is_enc_ipmi_off starts Nov 3 10:55:56 kjcf05n03 root[179531]: is_viking_off starts Nov 3 10:55:56 kjcf05n03 root[179548]: is_lan_ipmi_off leaves Nov 3 10:55:56 kjcf05n03 root[179550]: is_lan_ipmi_sec_off leaves Nov 3 10:55:56 kjcf05n03 root[179553]: I am master Nov 3 10:55:56 kjcf05n03 root[179556]: I am in slot 1; partner is in slot 0 Nov 3 10:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 10:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 10:56:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 10:56:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 10:56:04 kjcf05n00 mcfcli[3673891]: %3|1730652964.163|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:56:05 kjcf05n00 mcfcli[3673891]: %3|1730652965.427|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 10:56:07 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vfs.fs.size[/etc/ganesha,pused]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 10:56:07 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.mdt.name[MDT0001,mdt_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 10:56:10 kjcf05n03 root[179790]: is_viking_off leaves Nov 3 10:56:10 kjcf05n03 root[179794]: kjcf05n02 not already off look at kdump Nov 3 10:56:10 kjcf05n03 root[179796]: is_kdump_off starts Nov 3 10:56:10 kjcf05n03 fence_kdump[179797]: waiting for message from '172.16.2.5' Nov 3 10:56:11 kjcf05n03 fence_kdump[179797]: received valid message from '172.16.2.5' Nov 3 10:56:11 kjcf05n03 root[179973]: is_kdump_off detected kdump on kjcf05n02 Nov 3 10:56:11 kjcf05n03 root[179975]: kjcf05n02 is kdumping Nov 3 10:56:15 kjcf05n03 systemd-udevd[182370]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182371]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182374]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182375]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182370]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182374]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182371]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182375]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182370]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182371]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182374]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182375]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182370]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182371]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182375]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182374]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182370]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182371]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182375]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182374]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182370]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182375]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182374]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182371]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182370]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182375]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182413]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182371]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182374]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182418]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182370]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182371]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182375]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182374]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182420]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182421]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182418]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182371]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182420]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182370]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182371]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182420]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182418]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182418]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182420]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182418]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182370]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182421]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182420]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182418]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182371]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182420]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182418]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182418]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182420]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182418]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182418]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182420]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182418]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182420]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182418]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182420]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182418]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 systemd-udevd[182418]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 10:56:15 kjcf05n03 dwd[5194]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 10:56:15 kjcf05n03 dwd[5194]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 10:56:15 kjcf05n03 dwd[5194]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 10:56:15 kjcf05n03 dwd[5194]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 10:56:15 kjcf05n03 dwd[5194]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 10:56:15 kjcf05n03 dwd[5194]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 10:56:15 kjcf05n03 dwd[5194]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 10:56:15 kjcf05n03 dwd[5194]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 10:56:15 kjcf05n03 dwd[5194]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 10:56:15 kjcf05n03 dwd[5194]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 10:56:15 kjcf05n03 dwd[5194]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 10:56:15 kjcf05n03 dwd[5194]: Starting NVME thread for nvme2n1 Nov 3 10:56:16 kjcf05n03 dwd[5194]: Starting NVME thread for nvme8n1 Nov 3 10:56:16 kjcf05n03 dwd[5194]: Starting NVME thread for nvme24n1 Nov 3 10:56:16 kjcf05n03 dwd[5194]: Starting NVME thread for nvme17n1 Nov 3 10:56:16 kjcf05n03 dwd[5194]: Starting NVME thread for nvme3n1 Nov 3 10:56:16 kjcf05n03 dwd[5194]: Starting NVME thread for nvme25n1 Nov 3 10:56:16 kjcf05n03 dwd[5194]: Starting NVME thread for nvme19n1 Nov 3 10:56:16 kjcf05n03 dwd[5194]: Starting NVME thread for nvme4n1 Nov 3 10:56:16 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 10:56:16 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 10:56:16 kjcf05n03 dwd[5194]: Starting NVME thread for nvme18n1 Nov 3 10:56:17 kjcf05n03 dwd[5194]: Starting NVME thread for nvme23n1 Nov 3 10:56:17 kjcf05n03 dwd[5194]: Starting NVME thread for nvme9n1 Nov 3 10:56:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 10:56:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 10:56:22 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 3 10:56:22 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 3 10:56:35 kjcf05n03 diskmonitor[17376]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 10:56:35 kjcf05n00 mcfcli[3673891]: %3|1730652995.427|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 10:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 10:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 10:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 10:56:40 kjcf05n00 mcfcli[3673891]: %3|1730653000.124|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:56:43 kjcf05n03 diskmonitor[17376]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 10:56:43 kjcf05n03 diskmonitor[17376]: Scan for ReadErrorMax change for md65 Nov 3 10:56:43 kjcf05n03 diskmonitor[17376]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 10:56:43 kjcf05n03 diskmonitor[17376]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 10:56:43 kjcf05n03 diskmonitor[17376]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.min.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 10:56:43 kjcf05n03 diskmonitor[17376]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.max.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 10:56:43 kjcf05n03 diskmonitor[17376]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 10:56:43 kjcf05n03 diskmonitor[17376]: Set sync_speed_min (10000) for md65 Nov 3 10:56:43 kjcf05n03 diskmonitor[17376]: Set sync_speed_max (200000) for md65 Nov 3 10:56:43 kjcf05n03 diskmonitor[17376]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 10:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 10:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 10:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 10:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 10:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 10:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 10:56:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 10:56:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 10:57:05 kjcf05n00 mcfcli[3673891]: %3|1730653025.428|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:57:16 kjcf05n03 nslcd[7088]: ldap_result() failed: Can't contact LDAP server Nov 3 10:57:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 10:57:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 10:57:20 kjcf05n00 mcfcli[3673891]: %3|1730653040.121|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:57:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 10:57:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 10:57:34 kjcf05n03 nslcd[7088]: [16231b] ldap_result() failed: Can't contact LDAP server Nov 3 10:57:35 kjcf05n00 mcfcli[3673891]: %3|1730653055.429|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 10:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 10:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 10:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 10:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 10:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 10:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 10:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 10:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 10:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 10:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 10:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 10:58:00 kjcf05n00 mcfcli[3673891]: %3|1730653080.118|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:58:05 kjcf05n00 mcfcli[3673891]: %3|1730653085.429|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:58:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 10:58:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 10:58:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 10:58:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 10:58:35 kjcf05n00 mcfcli[3673891]: %3|1730653115.429|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 10:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 10:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 10:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 10:58:40 kjcf05n00 mcfcli[3673891]: %3|1730653120.115|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 10:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 10:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 10:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 10:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 10:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 10:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 10:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 10:59:05 kjcf05n00 mcfcli[3673891]: %3|1730653145.429|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 10:59:13 kjcf05n00 zabbix-server[1196876]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 10:59:13 kjcf05n00 zabbix-server[1196876]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 10:59:13 kjcf05n00 log_interesting_event.py[1196876]: Event '46127' acknowledged Nov 3 10:59:16 kjcf05n00 mcfcli[3673891]: %3|1730653156.270|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:59:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 10:59:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 10:59:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 10:59:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 10:59:31 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 3 10:59:31 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 10:59:35 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 10:59:35 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 3 10:59:35 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 3 10:59:35 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 10:59:35 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 10:59:35 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 3 10:59:35 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 3 10:59:35 kjcf05n00 mcfcli[3673891]: %3|1730653175.430|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 10:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 10:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 10:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 10:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 10:59:38 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 3 10:59:40 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 3 10:59:48 kjcf05n00 mcfcli[3673891]: %3|1730653188.970|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 10:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 10:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 10:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 10:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 10:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 10:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 11:00:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 11:00:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 11:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 11:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 11:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 11:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 11:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 11:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 11:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 11:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 11:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 11:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 11:00:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 11:00:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:00:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 11:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 11:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 11:00:05 kjcf05n00 mcfcli[3673891]: %3|1730653205.430|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 11:00:11 kjcf05n00 python3.9[1197430]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 11:00:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 11:00:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 11:00:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 11:00:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 11:00:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730653225', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 11:00:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730653225'} Nov 3 11:00:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:00:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730653225', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 11:00:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730653225'} Nov 3 11:00:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:00:27 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:35958). Nov 3 11:00:27 kjcf05n01 rsyncd[3054233]: connect from kjcf05n02 (172.16.2.5) Nov 3 11:00:27 kjcf05n01 rsyncd[3054233]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 11:00:27 kjcf05n01 rsyncd[3054233]: building file list Nov 3 11:00:27 kjcf05n01 rsyncd[3054233]: sent 11450 bytes received 136 bytes total size 10905 Nov 3 11:00:27 kjcf05n01 systemd[1]: rsyncd@621-172.16.2.2:873-172.16.2.5:35958.service: Succeeded. Nov 3 11:00:27 kjcf05n00 mcfcli[3673891]: %3|1730653227.914|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:00:35 kjcf05n00 mcfcli[3673891]: %3|1730653235.430|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 11:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 11:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 11:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 11:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 11:00:44 kjcf05n03 fstonithd.py[15106]: Listening for kdump packets from partner Nov 3 11:00:52 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 11:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 11:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 11:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 11:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 11:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 11:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 11:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 11:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 11:01:04 kjcf05n00 mcfcli[3673891]: %3|1730653264.971|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:01:05 kjcf05n00 mcfcli[3673891]: %3|1730653265.430|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:01:15 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 11:01:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 11:01:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 11:01:17 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 11:01:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 11:01:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 11:01:29 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 11:01:35 kjcf05n00 mcfcli[3673891]: %3|1730653295.431|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 11:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 11:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 11:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 11:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 11:01:41 kjcf05n03 dwd[5194]: nvme8n1 passed periodic SMART status check Nov 3 11:01:41 kjcf05n03 dwd[5194]: nvme2n1 passed periodic SMART status check Nov 3 11:01:41 kjcf05n03 dwd[5194]: nvme24n1 passed periodic SMART status check Nov 3 11:01:42 kjcf05n03 dwd[5194]: nvme4n1 passed periodic SMART status check Nov 3 11:01:42 kjcf05n03 dwd[5194]: nvme17n1 passed periodic SMART status check Nov 3 11:01:42 kjcf05n03 dwd[5194]: nvme19n1 passed periodic SMART status check Nov 3 11:01:42 kjcf05n03 dwd[5194]: nvme3n1 passed periodic SMART status check Nov 3 11:01:42 kjcf05n03 dwd[5194]: nvme25n1 passed periodic SMART status check Nov 3 11:01:43 kjcf05n03 dwd[5194]: nvme23n1 passed periodic SMART status check Nov 3 11:01:43 kjcf05n03 dwd[5194]: nvme18n1 passed periodic SMART status check Nov 3 11:01:43 kjcf05n03 dwd[5194]: nvme9n1 passed periodic SMART status check Nov 3 11:01:44 kjcf05n00 mcfcli[3673891]: %3|1730653304.968|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:01:53 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='15', client='AF_INET(172.16.2.5:36039)', local='AF_INET(0.0.0.0:601)' Nov 3 11:01:53 kjcf05n02 syslog-ng[3127]: Configuration reload request received, reloading configuration; Nov 3 11:01:53 kjcf05n02 syslog-ng[3127]: Configuration reload finished; Nov 3 11:01:53 kjcf05n02 syslog-ng[3127]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 11:01:53 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 3 11:01:53 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 11:01:53 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 3 11:01:53 kjcf05n02 dracut: Self testing crypto algorithms Nov 3 11:01:53 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 3 11:01:53 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 11:01:53 kjcf05n02 Copying live image to RAM... Nov 3 11:01:53 kjcf05n02 (this may take a minute) Nov 3 11:01:53 kjcf05n02 Done copying live image to RAM. Nov 3 11:01:53 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 11:01:53 kjcf05n02 dracut: Checking integrity of kernel Nov 3 11:01:53 kjcf05n02 dracut: All initrd crypto checks done Nov 3 11:01:53 kjcf05n02 dracut: Switching root Nov 3 11:01:53 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 11:01:53 kjcf05n02 systemd: Detected architecture x86-64. Nov 3 11:01:53 kjcf05n02 systemd: Set hostname to . Nov 3 11:01:53 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 11:01:53 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 11:01:53 kjcf05n02 systemd: Listening on LVM2 poll daemon socket. Nov 3 11:01:53 kjcf05n02 systemd: Reached target Swap. Nov 3 11:01:53 kjcf05n02 systemd: Created slice system-getty.slice. Nov 3 11:01:53 kjcf05n02 systemd: Listening on udev Kernel Socket. Nov 3 11:01:53 kjcf05n02 systemd: Listening on Journal Socket. Nov 3 11:01:53 kjcf05n02 systemd-journald[1525]: Journal started Nov 3 11:01:53 kjcf05n02 systemd-journald[1525]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 11:01:53 kjcf05n02 systemd[1]: Mounted Kernel Debug File System. Nov 3 11:01:53 kjcf05n02 systemd[1]: Mounted /mnt. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Create list of required static device nodes for the current kernel. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Remount Root and Kernel File Systems. Nov 3 11:01:53 kjcf05n02 systemd[1]: Mounted /WIBS. Nov 3 11:01:53 kjcf05n02 systemd[1]: Mounted /data. Nov 3 11:01:53 kjcf05n02 systemd-modules-load[1537]: Inserted module 'fuse' Nov 3 11:01:53 kjcf05n02 systemd[1]: Mounted POSIX Message Queue File System. Nov 3 11:01:53 kjcf05n02 systemd[1]: Mounted Huge Pages File System. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 3 11:01:53 kjcf05n02 systemd[1]: Mounted Temporary Directory (/tmp). Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Load Kernel Modules. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Apply Kernel Variables... Nov 3 11:01:53 kjcf05n02 systemd[1]: Mounting FUSE Control File System... Nov 3 11:01:53 kjcf05n02 systemd[1]: Mounting Kernel Configuration File System... Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Rebuild Hardware Database... Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Load/Save Random Seed... Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Create System Users... Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 11:01:53 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 3 11:01:53 kjcf05n02 systemd-sysctl[1543]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 11:01:53 kjcf05n02 systemd-sysctl[1543]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 3 11:01:53 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Create System Users. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 11:01:53 kjcf05n02 systemd-journald[1525]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 11:01:53 kjcf05n02 systemd-tmpfiles[1557]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 11:01:53 kjcf05n02 systemd-tmpfiles[1557]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 3 11:01:53 kjcf05n02 systemd-udevd[1564]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 3 11:01:53 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 3 11:01:53 kjcf05n02 systemd-udevd[1575]: Using default interface naming scheme 'rhel-8.0'. Nov 3 11:01:53 kjcf05n02 systemd-udevd[1575]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:01:53 kjcf05n02 systemd-udevd[1600]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:01:53 kjcf05n02 systemd-udevd[1615]: Using default interface naming scheme 'rhel-8.0'. Nov 3 11:01:53 kjcf05n02 systemd-udevd[1615]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 11:01:53 kjcf05n02 systemd-udevd[1573]: Using default interface naming scheme 'rhel-8.0'. Nov 3 11:01:53 kjcf05n02 systemd-udevd[1573]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:01:53 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 3 11:01:53 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 11:01:53 kjcf05n02 systemd-tmpfiles[1759]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 11:01:53 kjcf05n02 systemd-tmpfiles[1759]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 11:01:53 kjcf05n02 root[1772]: openibd: running in auto mode Nov 3 11:01:53 kjcf05n02 systemd-tmpfiles[1759]: "/var/tmp" already exists and is not a directory. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started RPC Bind. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 11:01:53 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 11:01:53 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 11:01:53 kjcf05n02 systemd-modules-load[1917]: Inserted module 'ib_iser' Nov 3 11:01:53 kjcf05n02 systemd-modules-load[1917]: Inserted module 'ib_isert' Nov 3 11:01:53 kjcf05n02 systemd-modules-load[1917]: Inserted module 'ib_srpt' Nov 3 11:01:53 kjcf05n02 systemd-udevd[1608]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:01:53 kjcf05n02 systemd-modules-load[1916]: Inserted module 'ib_ipoib' Nov 3 11:01:53 kjcf05n02 systemd-udevd[1600]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:01:53 kjcf05n02 systemd-modules-load[1917]: Inserted module 'rdma_ucm' Nov 3 11:01:53 kjcf05n02 systemd-modules-load[1917]: Module 'svcrdma' is blacklisted Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 11:01:53 kjcf05n02 systemd-udevd[1608]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 11:01:53 kjcf05n02 systemd-udevd[1600]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 11:01:53 kjcf05n02 systemd-modules-load[1916]: Inserted module 'ib_umad' Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 11:01:53 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 3 11:01:53 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 3 11:01:53 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 11:01:53 kjcf05n02 systemd[3127]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:01:53 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 11:01:53 kjcf05n02 openibd[1758]: Loading HCA driver and Access Layer:[ OK ] Nov 3 11:01:53 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Update is Completed. Nov 3 11:01:53 kjcf05n02 setup-icl[1747]: Setting LAN IP Address to 203.0.113.3 Nov 3 11:01:53 kjcf05n02 setup-icl[1747]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 11:01:53 kjcf05n02 setup-icl[1747]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 11:01:53 kjcf05n02 setup-icl[1747]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 11:01:53 kjcf05n02 systemd-udevd[1608]: Using default interface naming scheme 'rhel-8.0'. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 11:01:53 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 3 11:01:53 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 11:01:53 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 11:01:53 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 11:01:53 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 11:01:53 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 11:01:53 kjcf05n02 systemd[1]: Reached target Sockets. Nov 3 11:01:53 kjcf05n02 systemd[1]: Reached target Basic System. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 11:01:53 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 11:01:53 kjcf05n02 beSetMlxConfig[2052]: ConnectX-3 multiport not detected Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 11:01:53 kjcf05n02 network[2070]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 11:01:53 kjcf05n02 nscd[2091]: 2091 monitoring file `/etc/hosts` (1) Nov 3 11:01:53 kjcf05n02 nscd[2091]: 2091 monitoring directory `/etc` (2) Nov 3 11:01:53 kjcf05n02 nscd[2091]: 2091 monitoring file `/etc/resolv.conf` (3) Nov 3 11:01:53 kjcf05n02 nscd[2091]: 2091 monitoring directory `/etc` (2) Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[2071]: Setting up Mellanox network interface: ib0 Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 11:01:53 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 11:01:53 kjcf05n02 network[2090]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 11:01:53 kjcf05n02 network[2070]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 11:01:53 kjcf05n02 chronyd[2133]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 11:01:53 kjcf05n02 dwd[2101]: dwd: vMay 29 2024 : 15:38:26 Nov 3 11:01:53 kjcf05n02 dwd[2101]: /usr/sbin/dwd -d --standalone=0 Nov 3 11:01:53 kjcf05n02 dwd[2101]: dwd: option Lethal: 0 Nov 3 11:01:53 kjcf05n02 dwd[2101]: dwd: option Interval: 60 Nov 3 11:01:53 kjcf05n02 dwd[2101]: dwd: option abrtlimit: 10 Nov 3 11:01:53 kjcf05n02 dwd[2101]: dwd: option DZPeriod: 604800 Nov 3 11:01:53 kjcf05n02 dwd[2101]: dwd: option SmartPeriod: 43200 Nov 3 11:01:53 kjcf05n02 dwd[2101]: dwd: option SDDEnabled: 1 Nov 3 11:01:53 kjcf05n02 dwd[2101]: dwd: option SDDAwaitScale: 3 Nov 3 11:01:53 kjcf05n02 dwd[2101]: dwd: option SDDAwaitMin: 100 Nov 3 11:01:53 kjcf05n02 dwd[2101]: dwd: option Verbosity: 1 Nov 3 11:01:53 kjcf05n02 dwd[2101]: dwd: option StandAlone: 0 Nov 3 11:01:53 kjcf05n02 dwd[2101]: option Lethal: 0 Nov 3 11:01:53 kjcf05n02 dwd[2101]: option Interval: 60 Nov 3 11:01:53 kjcf05n02 dwd[2101]: option abrtlimit: 10 Nov 3 11:01:53 kjcf05n02 dwd[2101]: option DZPeriod: 604800 Nov 3 11:01:53 kjcf05n02 dwd[2101]: option SmartPeriod: 43200 Nov 3 11:01:53 kjcf05n02 dwd[2101]: option SDDEnabled: 1 Nov 3 11:01:53 kjcf05n02 dwd[2101]: option SDDAwaitScale: 3 Nov 3 11:01:53 kjcf05n02 dwd[2101]: option SDDAwaitMin: 100 Nov 3 11:01:53 kjcf05n02 dwd[2101]: option Verbosity: 1 Nov 3 11:01:53 kjcf05n02 dwd[2101]: option StandAlone: 0 Nov 3 11:01:53 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 0 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 1 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 2 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 3 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 4 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 5 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 6 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 7 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 8 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 9 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 10 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 11 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 12 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 13 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 14 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 15 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 16 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 17 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 18 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 19 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 20 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 21 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 22 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 23 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 24 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 25 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 26 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 27 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 28 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 29 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 30 Nov 3 11:01:53 kjcf05n02 cpupower[2130]: Setting cpu: 31 Nov 3 11:01:53 kjcf05n02 network[2123]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:01:53 kjcf05n02 network[2070]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 11:01:53 kjcf05n02 beSetMlxConfig[2052]: Starting MST (Mellanox Software Tools) driver set Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 11:01:53 kjcf05n02 dbus-daemon[2107]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 11:01:53 kjcf05n02 network[2149]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 11:01:53 kjcf05n02 mcelog[2166]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 11:01:53 kjcf05n02 mcelog[2166]: CPU is unsupported Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[2155]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 11:01:53 kjcf05n02 beSetMlxConfig[2052]: Loading MST PCI module - Success Nov 3 11:01:53 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 11:01:53 kjcf05n02 chronyd[2133]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 11:01:53 kjcf05n02 chronyd[2133]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[2194]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 11:01:53 kjcf05n02 beSetMlxConfig[2052]: Loading MST PCI configuration module - Success Nov 3 11:01:53 kjcf05n02 beSetMlxConfig[2052]: Create devices Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[2208]: Setting up Mellanox network interface: ib1 Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[2211]: No configuration found for ib0 Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 11:01:53 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 11:01:53 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 0 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 1 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 2 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 3 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 4 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 5 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 6 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 7 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 8 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 9 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 10 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 11 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 12 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 13 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 14 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 15 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 16 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 17 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 18 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 19 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 20 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 21 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 22 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 23 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 24 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 25 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 26 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 27 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 28 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 29 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 30 Nov 3 11:01:53 kjcf05n02 cpupower[2280]: Idlestate 2 disabled on CPU 31 Nov 3 11:01:53 kjcf05n02 mdraid-phy[2217]: no Cutlass to worry about Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[2268]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 11:01:53 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 11:01:53 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[2275]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 11:01:53 kjcf05n02 mlnx_conf_mgr[2310]: INFO: No configurations found for mlx5_0, skipping. Nov 3 11:01:53 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[2326]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[2353]: No configuration found for ib1 Nov 3 11:01:53 kjcf05n02 sssd[sssd][2182]: Starting up Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[2372]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 11:01:53 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 11:01:53 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 11:01:53 kjcf05n02 mlnx_conf_mgr[2416]: INFO: No configurations found for mlx5_1, skipping. Nov 3 11:01:53 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 11:01:53 kjcf05n02 sssd[be[implicit_files]][2417]: Starting up Nov 3 11:01:53 kjcf05n02 sssd[nss][2527]: Starting up Nov 3 11:01:53 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 11:01:53 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Login Service... Nov 3 11:01:53 kjcf05n02 systemd-logind[2657]: New seat seat0. Nov 3 11:01:53 kjcf05n02 systemd-logind[2657]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Login Service. Nov 3 11:01:53 kjcf05n02 systemd-sysctl[2737]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 11:01:53 kjcf05n02 systemd-sysctl[2737]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 11:01:53 kjcf05n02 python3.9[2213]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 11:01:53 kjcf05n02 python3.9[3127]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 11:01:53 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 11:01:53 kjcf05n02 python3.9[2933]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 11:01:53 kjcf05n02 python3.9[3127]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 11:01:53 kjcf05n02 network[2070]: Bringing up loopback interface: [ OK ] Nov 3 11:01:53 kjcf05n02 systemd-sysctl[3080]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 11:01:53 kjcf05n02 systemd-sysctl[3080]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 11:01:53 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 3 11:01:53 kjcf05n02 systemd[1]: Reached target Network. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 11:01:53 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 11:01:53 kjcf05n02 sm-notify[3129]: Version 2.3.3 starting Nov 3 11:01:53 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 3 11:01:53 kjcf05n02 sshd[3115]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 11:01:53 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 11:01:53 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 11:01:53 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 3 11:01:53 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 11:01:53 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 3 11:01:53 kjcf05n02 lldpad[3120]: setsockopt nearest_bridge: Invalid argument Nov 3 11:01:53 kjcf05n02 lldpad[3127]: Last message 'setsockopt nearest_b' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 11:01:53 kjcf05n02 beSetMlxConfig[2052]: Unloading MST PCI module (unused) - Success Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 3 11:01:53 kjcf05n02 python3.9[3143]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 11:01:53 kjcf05n02 python3.9[3127]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 3 11:01:53 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 11:01:53 kjcf05n02 syslog-ng[3127]: [2024-11-03T17:00:40.374462] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 11:01:53 kjcf05n02 syslog-ng[3127]: [2024-11-03T17:00:40.374739] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 11:01:53 kjcf05n02 syslog-ng[3127]: [2024-11-03T17:00:40.374775] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 11:01:53 kjcf05n02 syslog-ng[3127]: [2024-11-03T17:00:40.375044] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 11:01:53 kjcf05n02 syslog-ng[3127]: [2024-11-03T17:00:40.375350] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 11:01:53 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 11:01:53 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 11:01:53 kjcf05n02 python3.9[3379]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 11:01:53 kjcf05n02 python3.9[3127]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 11:01:53 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 11:01:53 kjcf05n02 python3.9[3382]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 11:01:53 kjcf05n02 python3.9[3127]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 11:01:53 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 11:01:53 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 11:01:53 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 11:01:53 kjcf05n02 chronyd[2133]: System's initial offset : 0.003601 seconds slow of true (slew) Nov 3 11:01:53 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 11:01:53 kjcf05n02 beSetMlxConfig[2052]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 11:01:53 kjcf05n02 beSetMlxConfig[2052]: ib mode Nov 3 11:01:53 kjcf05n02 root[3404]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 3 11:01:53 kjcf05n02 beSetMlxConfig[2052]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 11:01:53 kjcf05n02 root[3406]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 3 11:01:53 kjcf05n02 beSetMlxConfig[2052]: ib mode Nov 3 11:01:53 kjcf05n02 systemd-udevd[1564]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 11:01:53 kjcf05n02 systemd-udevd[3433]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:01:53 kjcf05n02 systemd-udevd[3434]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:01:53 kjcf05n02 systemd-udevd[3437]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:01:53 kjcf05n02 systemd-udevd[3440]: Using default interface naming scheme 'rhel-8.0'. Nov 3 11:01:53 kjcf05n02 systemd-udevd[3440]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:01:53 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 11:01:53 kjcf05n02 systemd[3127]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:01:53 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[3475]: Setting up Mellanox network interface: ib0 Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[3476]: Setting up Mellanox network interface: ib1 Nov 3 11:01:53 kjcf05n02 systemd-udevd[3435]: Using default interface naming scheme 'rhel-8.0'. Nov 3 11:01:53 kjcf05n02 systemd-udevd[3436]: Using default interface naming scheme 'rhel-8.0'. Nov 3 11:01:53 kjcf05n02 systemd-udevd[3435]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:01:53 kjcf05n02 systemd-udevd[3436]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[3525]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[3526]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[3556]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[3557]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[3558]: No configuration found for ib1 Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[3559]: No configuration found for ib0 Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[3566]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[3567]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 11:01:53 kjcf05n02 mlnx_conf_mgr[3606]: INFO: No configurations found for mlx5_0, skipping. Nov 3 11:01:53 kjcf05n02 mlnx_conf_mgr[3607]: INFO: No configurations found for mlx5_1, skipping. Nov 3 11:01:53 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 11:01:53 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 11:01:53 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 3 11:01:53 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 3 11:01:53 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 3 11:01:53 kjcf05n02 systemd[1]: crond.service: Found left-over process 3426 (anacron) in control group while starting unit. Ignoring. Nov 3 11:01:53 kjcf05n02 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 11:01:53 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 3 11:01:53 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 3 11:01:53 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 11:01:53 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 11:01:53 kjcf05n02 lldpad[3120]: init_ports: Error adding device ib0 Nov 3 11:01:53 kjcf05n02 lldpad[3120]: init_ports: Error adding device ib1 Nov 3 11:01:53 kjcf05n02 lldpad[3120]: Signal 15 received - terminating Nov 3 11:01:53 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 3 11:01:53 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 11:01:53 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 11:01:53 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 3 11:01:53 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 11:01:53 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 3 11:01:53 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 3 11:01:53 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:53 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:01:53 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 1 | Nov-03-2024 | 16:31:04 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 2 | Nov-03-2024 | 16:31:55 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 3 | Nov-03-2024 | 16:31:56 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 4 | Nov-03-2024 | 16:33:02 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 5 | Nov-03-2024 | 16:33:02 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 6 | Nov-03-2024 | 16:58:00 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 7 | Nov-03-2024 | 16:58:00 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 8 | Nov-03-2024 | 16:58:00 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 9 | Nov-03-2024 | 16:58:00 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 10 | Nov-03-2024 | 16:58:00 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 11 | Nov-03-2024 | 16:58:00 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 12 | Nov-03-2024 | 16:58:00 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 13 | Nov-03-2024 | 16:58:00 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 14 | Nov-03-2024 | 16:58:00 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 15 | Nov-03-2024 | 16:58:00 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 16 | Nov-03-2024 | 16:58:00 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 17 | Nov-03-2024 | 16:58:00 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 18 | Nov-03-2024 | 16:58:00 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 19 | Nov-03-2024 | 16:58:00 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 20 | Nov-03-2024 | 16:58:00 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 21 | Nov-03-2024 | 16:58:00 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 22 | Nov-03-2024 | 16:58:00 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 23 | Nov-03-2024 | 16:58:00 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 24 | Nov-03-2024 | 16:58:00 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 25 | Nov-03-2024 | 16:58:00 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 26 | Nov-03-2024 | 16:58:00 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 27 | Nov-03-2024 | 16:58:00 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 28 | Nov-03-2024 | 16:58:02 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 29 | Nov-03-2024 | 16:58:02 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 30 | Nov-03-2024 | 16:58:02 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 31 | Nov-03-2024 | 16:58:02 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 32 | Nov-03-2024 | 16:58:02 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 33 | Nov-03-2024 | 16:58:02 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 34 | Nov-03-2024 | 16:58:02 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 35 | Nov-03-2024 | 16:58:02 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 36 | Nov-03-2024 | 16:58:02 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 37 | Nov-03-2024 | 16:58:02 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 38 | Nov-03-2024 | 16:58:31 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 39 | Nov-03-2024 | 16:58:31 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 40 | Nov-03-2024 | 16:58:31 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 41 | Nov-03-2024 | 16:58:31 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 42 | Nov-03-2024 | 16:58:31 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 43 | Nov-03-2024 | 16:58:31 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 44 | Nov-03-2024 | 16:58:31 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 45 | Nov-03-2024 | 16:58:31 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 46 | Nov-03-2024 | 16:58:31 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 47 | Nov-03-2024 | 16:58:31 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 48 | Nov-03-2024 | 16:58:31 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 11:01:53 kjcf05n02 ipmievd[3949]: 49 | Nov-03-2024 | 16:58:31 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 11:01:53 kjcf05n02 ipmievd[3952]: Reading sensors... Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 3 11:01:53 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:53 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 11:01:53 kjcf05n02 nscd[2091]: 2091 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 11:01:53 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 11:01:53 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 3 11:01:53 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 11:01:53 kjcf05n02 beSetMlxConfig[4010]: ConnectX-3 multiport not detected Nov 3 11:01:53 kjcf05n02 beSetMlxConfig[4010]: Starting MST (Mellanox Software Tools) driver set Nov 3 11:01:53 kjcf05n02 beSetMlxConfig[4010]: Loading MST PCI module - Success Nov 3 11:01:53 kjcf05n02 systemd-udevd[1564]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 11:01:53 kjcf05n02 beSetMlxConfig[4010]: [warn] mst_pciconf is already loaded, skipping Nov 3 11:01:53 kjcf05n02 beSetMlxConfig[4010]: Create devices Nov 3 11:01:53 kjcf05n02 beSetMlxConfig[4010]: Unloading MST PCI module (unused) - Success Nov 3 11:01:53 kjcf05n02 ipmievd[3952]: Waiting for events... Nov 3 11:01:53 kjcf05n02 beSetMlxConfig[4010]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 11:01:53 kjcf05n02 beSetMlxConfig[4010]: ib mode Nov 3 11:01:53 kjcf05n02 beSetMlxConfig[4010]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 11:01:53 kjcf05n02 beSetMlxConfig[4010]: ib mode Nov 3 11:01:53 kjcf05n02 systemd-udevd[1564]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 11:01:53 kjcf05n02 systemd-udevd[4911]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:01:53 kjcf05n02 systemd-udevd[4912]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:01:53 kjcf05n02 systemd-udevd[4915]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:01:53 kjcf05n02 systemd-udevd[4918]: Using default interface naming scheme 'rhel-8.0'. Nov 3 11:01:53 kjcf05n02 systemd-udevd[4918]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:01:53 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 11:01:53 kjcf05n02 systemd[3127]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:01:53 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[4953]: Setting up Mellanox network interface: ib1 Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[4954]: Setting up Mellanox network interface: ib0 Nov 3 11:01:53 kjcf05n02 systemd-udevd[4913]: Using default interface naming scheme 'rhel-8.0'. Nov 3 11:01:53 kjcf05n02 systemd-udevd[4913]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:01:53 kjcf05n02 systemd-udevd[4914]: Using default interface naming scheme 'rhel-8.0'. Nov 3 11:01:53 kjcf05n02 systemd-udevd[4914]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[5003]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[5004]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[5034]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[5036]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[5037]: No configuration found for ib1 Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[5038]: No configuration found for ib0 Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[5046]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 11:01:53 kjcf05n02 mlnx_interface_mgr[5045]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 11:01:53 kjcf05n02 mlnx_conf_mgr[5085]: INFO: No configurations found for mlx5_1, skipping. Nov 3 11:01:53 kjcf05n02 mlnx_conf_mgr[5086]: INFO: No configurations found for mlx5_0, skipping. Nov 3 11:01:53 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 11:01:53 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}8453bfc5c2986caaef9a60e9bfa53fa68523dfae69f0a8f35d9d1db08f4bc702' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}8453bfc5c2986caaef9a60e9bfa53fa68523dfae69f0a8f35d9d1db08f4bc702' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}61354b612e4d2cab0c77f9c8fd16fcc9af7a66ee9230cc748e26a7ceb65f425e' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}61354b612e4d2cab0c77f9c8fd16fcc9af7a66ee9230cc748e26a7ceb65f425e' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}757309a99fd9f1fa6189c66d07eee23b3720ae245593990b2695bb2f5cd99fb5' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}757309a99fd9f1fa6189c66d07eee23b3720ae245593990b2695bb2f5cd99fb5' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}b990c9a487aeff40e382a6a5769dea89a77f310ecc7660f276b41d765502cf0b' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}b990c9a487aeff40e382a6a5769dea89a77f310ecc7660f276b41d765502cf0b' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 11:01:53 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 3 11:01:53 kjcf05n02 chronyd[2133]: chronyd exiting Nov 3 11:01:53 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 3 11:01:53 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 11:01:53 kjcf05n02 chronyd[5120]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 11:01:53 kjcf05n02 chronyd[5120]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 11:01:53 kjcf05n02 chronyd[5120]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 11:01:53 kjcf05n02 chronyd[5120]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 11:01:53 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 11:01:53 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:53 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 11:01:53 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 3 11:01:53 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 11:01:53 kjcf05n02 dwd[5151]: dwd: vMay 29 2024 : 15:38:26 Nov 3 11:01:53 kjcf05n02 dwd[5151]: /usr/sbin/dwd -i 15 -d Nov 3 11:01:53 kjcf05n02 dwd[5151]: dwd: option Lethal: 0 Nov 3 11:01:53 kjcf05n02 dwd[5151]: dwd: option Interval: 15 Nov 3 11:01:53 kjcf05n02 dwd[5151]: dwd: option abrtlimit: 10 Nov 3 11:01:53 kjcf05n02 dwd[5151]: dwd: option DZPeriod: 604800 Nov 3 11:01:53 kjcf05n02 dwd[5151]: dwd: option SmartPeriod: 43200 Nov 3 11:01:53 kjcf05n02 dwd[5151]: dwd: option SDDEnabled: 1 Nov 3 11:01:53 kjcf05n02 dwd[5151]: dwd: option SDDAwaitScale: 3 Nov 3 11:01:53 kjcf05n02 dwd[5151]: dwd: option SDDAwaitMin: 100 Nov 3 11:01:53 kjcf05n02 dwd[5151]: dwd: option Verbosity: 1 Nov 3 11:01:53 kjcf05n02 dwd[5151]: dwd: option StandAlone: 0 Nov 3 11:01:53 kjcf05n02 dwd[5151]: option Lethal: 0 Nov 3 11:01:53 kjcf05n02 dwd[5151]: option Interval: 15 Nov 3 11:01:53 kjcf05n02 dwd[5151]: option abrtlimit: 10 Nov 3 11:01:53 kjcf05n02 dwd[5151]: option DZPeriod: 604800 Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 11:01:53 kjcf05n02 dwd[5151]: option SmartPeriod: 43200 Nov 3 11:01:53 kjcf05n02 dwd[5151]: option SDDEnabled: 1 Nov 3 11:01:53 kjcf05n02 dwd[5151]: option SDDAwaitScale: 3 Nov 3 11:01:53 kjcf05n02 dwd[5151]: option SDDAwaitMin: 100 Nov 3 11:01:53 kjcf05n02 dwd[5151]: option Verbosity: 1 Nov 3 11:01:53 kjcf05n02 dwd[5151]: option StandAlone: 0 Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 11:01:53 kjcf05n02 dwd[5152]: option Lethal now set to 1 Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 11:01:53 kjcf05n02 dwd[5152]: option abrtlimit now set to 1 Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 11:01:53 kjcf05n02 dwd[5152]: option SmartPeriod now set to 86400 Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 11:01:53 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 11:01:53 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:01:53 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:53 kjcf05n02 python3.9[5181]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 11:01:53 kjcf05n02 python3.9[3127]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 11:01:53 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:01:53 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 11:01:53 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:53 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 3 11:01:53 kjcf05n02 sedcpwrkr[5318]: Using config script: /etc/sedcpwrkr.conf Nov 3 11:01:53 kjcf05n02 sedcpwrkr[5318]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 11:01:53 kjcf05n02 sedcpwrkr[5318]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 11:01:53 kjcf05n02 sedcpwrkr[5318]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 11:01:53 kjcf05n02 sedcpwrkr[5318]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 11:01:53 kjcf05n02 sedcpwrkr[5318]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 11:01:53 kjcf05n02 sedcpwrkr[5318]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 11:01:53 kjcf05n02 sedcpwrkr-server[5349]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 11:01:53 kjcf05n02 sedcpwrkr[5318]: celery multi v5.2.7 (dawn-chorus) Nov 3 11:01:53 kjcf05n02 sedcpwrkr[5318]: > Starting nodes... Nov 3 11:01:53 kjcf05n02 sedcpwrkr[5318]: > sedcpwrkr@kjcf05n02: OK Nov 3 11:01:53 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 11:01:53 kjcf05n02 sedcpwrkr-server[5351]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 11:01:53 kjcf05n02 sedcpwrkr-server[5351]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 11:01:53 kjcf05n02 sedcpwrkr-server[5351]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 11:01:53 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 11:01:53 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 3 11:01:53 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 11:01:53 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 11:01:53 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 11:01:53 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:54 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 11:01:54 kjcf05n02 systemd-udevd[1564]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 11:01:54 kjcf05n02 iptables.init[5418]: iptables: Applying firewall rules: [ OK ] Nov 3 11:01:54 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 3 11:01:54 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:54 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:01:54 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:01:54 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:01:54 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 11:01:54 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 11:01:54 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 11:01:54 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 11:01:54 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 11:01:54 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 11:01:54 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 11:01:54 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 11:01:54 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 11:01:54 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 11:01:54 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 11:01:54 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 11:01:55 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 11:01:55 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 11:01:55 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 11:01:55 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 11:01:55 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 11:01:55 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 11:01:55 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 11:01:55 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 11:01:55 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 11:01:55 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 11:01:55 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 11:01:55 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 11:01:55 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 11:01:55 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 11:01:55 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 11:01:55 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 11:01:55 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 11:01:55 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 11:01:55 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 11:01:55 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 11:01:55 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 11:01:55 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 11:01:55 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 11:01:55 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 11:01:55 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 11:01:55 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 11:01:55 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 11:01:55 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 11:01:55 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 11:01:55 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 11:01:55 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 11:01:55 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 11:01:55 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 11:01:55 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 11:01:55 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 11:01:55 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 11:01:55 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 11:01:55 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 11:01:55 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:55 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 11:01:55 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5515 which is not our child. We'll most likely not notice when it exits. Nov 3 11:01:55 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 11:01:55 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:55 kjcf05n02 openhpid[5515]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 11:01:55 kjcf05n02 openhpid[5515]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 11:01:55 kjcf05n02 openhpid[5515]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 11:01:55 kjcf05n02 openhpid[5515]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 11:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 11:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 11:01:55 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 11:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 11:01:56 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:01:56 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:01:56 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 11:01:56 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 11:01:56 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 11:01:56 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 11:01:56 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:56 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 11:01:56 kjcf05n02 dcs-collectord[5606]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 11:01:56 kjcf05n02 hpi.inv.log[5606]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 11:01:56 kjcf05n02 dcs-collectord[5606]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 11:01:56 kjcf05n02 dcs-collectord[5606]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 11:01:56 kjcf05n02 dcs-collector[5597]: Starting dcs-collector:[ OK ] Nov 3 11:01:56 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 11:01:56 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 11:01:56 kjcf05n02 dcs-collectord[5609]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 11:01:56 kjcf05n02 dcs-collectord[5609]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 11:01:56 kjcf05n02 dcs-collectord[5609]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 11:01:56 kjcf05n02 dcs-collectord[5609]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 11:01:56 kjcf05n02 dcs-collectord[5609]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 11:01:56 kjcf05n02 dcs-collectord[5609]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 11:01:56 kjcf05n02 dcs-collectord[5609]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 11:01:56 kjcf05n02 dcs-collectord[5609]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452752", "units": "kB"}, {"name": "MemFree", "value": "259349432", "units": "kB"}, {"name": "MemAvailable", "value": "258628908", "units": "kB"}, {"name": "Buffers", "value": "84336", "units": "kB"}, {"name": "Cached", "value": "1820984", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1687444", "units": "kB"}, {"name": "Inactive", "value": "959580", "units": "kB"}, {"name": "Active(anon)", "value": "1520868", "units": "kB"}, {"name": "Inactive(anon)", "value": "823868", "units": "kB"}, {"name": "Active(file)", "value": "166576", "units": "kB"}, {"name": "Inactive(file)", "value": "135712", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "750976", "units": "kB"}, {"name": "Mapped", "value": "86908", "units": "kB"}, {"name": "Shmem", "value": "1593220", "units": "kB"}, {"name": "KReclaimable", "value": "108832", "units": "kB"}, {"name": "Slab", "value": "274036", "units": "kB"}, {"name": "SReclaimable", "value": "108832", "units": "kB"}, {"name": "SUnreclaim", "value": "165204", "units": "kB"}, {"name": "KernelStack", "value": "9680", "units": "kB"}, {"name": "PageTables", "value": "20076", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3211416", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11392", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "6144", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "278856", "units": "kB"}, {"name": "DirectMap2M", "value": "23703552", "units": "kB"}, {"name": "DirectMap1G", "value": "244318208", "units": "kB"}]}' Nov 3 11:01:56 kjcf05n02 dcs-collectord[5609]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 11:01:56 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:57 kjcf05n02 dcs-collectord[5609]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 11:01:57 kjcf05n02 dcs-collectord[5609]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730653316.7220178], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730653316.968469], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730653316.6543946, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 11:01:57 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:57 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 11:01:57 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:01:57 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:01:57 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 11:01:57 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 11:01:57 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 11:01:57 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 11:01:57 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:57 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 11:01:57 kjcf05n02 firmware-update-orc[5715]: Using config script: /etc/firmware_update_orc.conf Nov 3 11:01:57 kjcf05n02 firmware-update-orc[5715]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 11:01:57 kjcf05n02 firmware-update-orc[5715]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 11:01:57 kjcf05n02 firmware-update-orc[5715]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 11:01:57 kjcf05n02 firmware-update-orc[5715]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 11:01:57 kjcf05n02 firmware-update-orc[5715]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 11:01:57 kjcf05n02 firmware-update-orc[5715]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 11:01:58 kjcf05n02 firmware-update-orc-server[5752]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 11:01:58 kjcf05n02 firmware-update-orc[5715]: celery multi v5.2.7 (dawn-chorus) Nov 3 11:01:58 kjcf05n02 firmware-update-orc[5715]: > Starting nodes... Nov 3 11:01:58 kjcf05n02 firmware-update-orc[5715]: > worker1@kjcf05n02: OK Nov 3 11:01:58 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 11:01:58 kjcf05n02 firmware-update-orc-server[5755]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 11:01:58 kjcf05n02 firmware-update-orc-server[5755]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 11:01:58 kjcf05n02 firmware-update-orc-server[5755]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 11:01:58 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 11:01:58 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:58 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:01:58 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:01:58 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:01:58 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 11:01:58 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 11:01:58 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 11:01:58 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 11:01:58 kjcf05n02 dbus-daemon[2107]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 11:01:58 kjcf05n02 dbus-daemon[2107]: [system] Reloaded configuration Nov 3 11:01:58 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 11:01:58 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 11:01:58 kjcf05n02 dbus-daemon[2107]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 11:01:58 kjcf05n02 dbus-daemon[2107]: [system] Reloaded configuration Nov 3 11:01:58 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 11:01:58 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 11:01:58 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 11:01:58 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 11:01:58 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:59 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 3 11:01:59 kjcf05n02 ras-resource-manager-agent[5871]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 11:01:59 kjcf05n02 ras-resource-manager-agent[5857]: Starting ras-resource-manager-agent:[ OK ] Nov 3 11:01:59 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 11:01:59 kjcf05n02 ras-resource-manager-agent[5873]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 11:01:59 kjcf05n02 ras-resource-manager-client[5873]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 11:01:59 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 3 11:01:59 kjcf05n02 ras-resource-manager-client[5873]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 11:01:59 kjcf05n02 ras-resource-manager-client[5883]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 11:01:59 kjcf05n02 systemd[1]: Reloading. Nov 3 11:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 11:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 11:01:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 11:01:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 11:02:00 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:02:00 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:02:00 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:02:00 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 11:02:00 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 11:02:00 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:00 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 11:02:00 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:01 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: Press Ctrl+C to exit. Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: Plugin support version 1.0 Nov 3 11:02:01 kjcf05n02 zabbix_agent2[5957]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 11:02:01 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:02:01 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:02:01 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:01 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 11:02:01 kjcf05n02 dcs-notification-sender[6034]: dcs-notification-senderd is stopped Nov 3 11:02:01 kjcf05n02 zabbix-agent2[6049]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 11:02:01 kjcf05n02 dcs-notification-sender[6034]: Starting notification-sender:[ OK ] Nov 3 11:02:01 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 11:02:01 kjcf05n02 zabbix-agent2[6054]: INFO DCS notification agent started. (agent.py:61) Nov 3 11:02:01 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 11:02:01 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:02 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:02:02 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:02:02 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:02:02 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:02 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 11:02:02 kjcf05n02 dcs-collectord[6157]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 11:02:02 kjcf05n02 dcs-collectord[6157]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 11:02:02 kjcf05n02 dcs-bulk-data-sender[6157]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 11:02:02 kjcf05n02 dcs-bulk-data-sender[6148]: Starting bulk-data-sender:[ OK ] Nov 3 11:02:02 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 11:02:02 kjcf05n02 dcs-collectord[6159]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 11:02:02 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 11:02:02 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:03 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:02:03 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:02:03 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:02:03 kjcf05n02 nscd[2091]: 2091 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 11:02:03 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 11:02:03 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 11:02:03 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 11:02:03 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 11:02:03 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 11:02:03 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 11:02:03 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 11:02:03 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 11:02:03 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 11:02:03 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 11:02:03 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 11:02:03 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 11:02:03 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 11:02:03 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 11:02:03 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 11:02:03 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 11:02:03 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 11:02:03 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 11:02:03 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 11:02:03 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 11:02:03 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 3 11:02:03 kjcf05n02 sssd[nss][2527]: Shutting down (status = 0) Nov 3 11:02:03 kjcf05n02 sssd[be[implicit_files]][2417]: Shutting down (status = 0) Nov 3 11:02:03 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 3 11:02:03 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 3 11:02:03 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 11:02:04 kjcf05n02 python3.9[5181]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 11:02:04 kjcf05n02 python3.9[3127]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:02:04 kjcf05n02 sssd[sssd][6231]: Starting up Nov 3 11:02:04 kjcf05n02 sssd[be[implicit_files]][6244]: Starting up Nov 3 11:02:04 kjcf05n02 sssd[nss][6245]: Starting up Nov 3 11:02:04 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 11:02:04 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 11:02:04 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 11:02:05 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 11:02:05 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 11:02:05 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 11:02:05 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 11:02:05 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 11:02:05 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 11:02:05 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 11:02:05 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 11:02:05 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 11:02:05 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 11:02:05 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 11:02:05 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 11:02:05 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 11:02:05 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 11:02:05 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:02:05 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:02:05 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:05 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 11:02:05 kjcf05n00 mcfcli[3673891]: %3|1730653325.432|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 11:02:06 kjcf05n02 icinga2[6291]: [2024-11-03 11:02:05 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 11:02:06 kjcf05n02 icinga2[6291]: [2024-11-03 11:02:05 -0600] information/cli: Loading configuration file(s). Nov 3 11:02:06 kjcf05n02 icinga2[6291]: [2024-11-03 11:02:06 -0600] information/ConfigItem: Committing config item(s). Nov 3 11:02:06 kjcf05n02 icinga2[6291]: [2024-11-03 11:02:06 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 3 11:02:06 kjcf05n02 icinga2[6291]: [2024-11-03 11:02:06 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 11:02:06 kjcf05n02 icinga2[6291]: [2024-11-03 11:02:06 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 11:02:06 kjcf05n02 icinga2[6291]: [2024-11-03 11:02:06 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 11:02:06 kjcf05n02 icinga2[6291]: [2024-11-03 11:02:06 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 11:02:06 kjcf05n02 icinga2[6291]: [2024-11-03 11:02:06 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 11:02:06 kjcf05n02 icinga2[6291]: [2024-11-03 11:02:06 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 11:02:06 kjcf05n02 icinga2[6291]: [2024-11-03 11:02:06 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 11:02:06 kjcf05n02 icinga2[6291]: [2024-11-03 11:02:06 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 11:02:06 kjcf05n02 icinga2[6291]: [2024-11-03 11:02:06 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 11:02:06 kjcf05n02 icinga2[6291]: [2024-11-03 11:02:06 -0600] information/cli: Closing console log. Nov 3 11:02:06 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 11:02:06 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:06 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:02:06 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:02:06 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:02:07 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 11:02:07 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 11:02:07 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:07 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 3 11:02:07 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:07 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 11:02:07 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:02:07 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:02:08 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 11:02:08 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 11:02:08 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 11:02:08 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 11:02:08 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 11:02:08 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 11:02:08 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 11:02:08 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 11:02:08 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 11:02:08 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 11:02:08 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 11:02:08 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 11:02:08 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 11:02:08 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 11:02:08 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:08 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 11:02:08 kjcf05n02 nslcd[6903]: version 0.9.9 starting Nov 3 11:02:08 kjcf05n02 nslcd[6903]: accepting connections Nov 3 11:02:08 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 11:02:08 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:09 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:02:09 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:02:09 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:02:09 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 11:02:09 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 11:02:09 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 11:02:09 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 11:02:09 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 11:02:09 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 11:02:10 kjcf05n02 dcs-bulk-data-sender[6159]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 11:02:10 kjcf05n02 dcs-collectord[6159]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 11:02:10 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 11:02:10 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 11:02:10 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:10 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 11:02:10 kjcf05n02 dearcpw[7006]: Using config script: /etc/dearcpw.conf Nov 3 11:02:10 kjcf05n02 dearcpw[7006]: - Creating default directory: '/var/log/dearcpw' Nov 3 11:02:10 kjcf05n02 dearcpw[7006]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 11:02:10 kjcf05n02 dearcpw[7006]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 11:02:10 kjcf05n02 dearcpw[7006]: - Creating default directory: '/var/run/dearcpw' Nov 3 11:02:10 kjcf05n02 dearcpw[7006]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 11:02:10 kjcf05n02 dearcpw[7006]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 11:02:11 kjcf05n02 dearcpw-server[7046]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 11:02:11 kjcf05n02 dearcpw[7006]: celery multi v5.2.7 (dawn-chorus) Nov 3 11:02:11 kjcf05n02 dearcpw[7006]: > Starting nodes... Nov 3 11:02:11 kjcf05n02 dearcpw[7006]: > dearcpw@kjcf05n02: OK Nov 3 11:02:11 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 11:02:11 kjcf05n02 dearcpw-server[7048]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 11:02:11 kjcf05n02 dearcpw-server[7048]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 11:02:11 kjcf05n02 dearcpw-server[7048]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 11:02:11 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 3 11:02:11 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:02:11 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:02:11 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 11:02:11 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 11:02:11 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 11:02:11 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 11:02:11 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 11:02:11 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 11:02:11 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 11:02:11 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 11:02:11 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 11:02:11 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 11:02:11 kjcf05n02 puppet[7088]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 3 11:02:11 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 11:02:11 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 11:02:11 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 11:02:11 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 11:02:11 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 11:02:11 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 11:02:11 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 11:02:11 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 11:02:11 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:35992). Nov 3 11:02:11 kjcf05n01 rsyncd[3055128]: connect from kjcf05n02 (172.16.2.5) Nov 3 11:02:11 kjcf05n01 rsyncd[3055128]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 11:02:11 kjcf05n01 rsyncd[3055128]: receiving file list Nov 3 11:02:11 kjcf05n01 rsyncd[3055128]: sent 29 bytes received 325 bytes total size 10905 Nov 3 11:02:11 kjcf05n01 systemd[1]: rsyncd@622-172.16.2.2:873-172.16.2.5:35992.service: Succeeded. Nov 3 11:02:12 kjcf05n02 dcs-collectord[5609]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 11:02:12 kjcf05n02 dcs-collectord[5609]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 11:02:12 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 11:02:12 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 11:02:12 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 11:02:12 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 11:02:12 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 11:02:12 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 11:02:13 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 11:02:13 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 11:02:13 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 11:02:13 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 11:02:14 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 11:02:14 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 11:02:14 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 11:02:14 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 11:02:14 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 11:02:14 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 11:02:14 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:14 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 11:02:15 kjcf05n02 ipmievd[3952]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 11:02:15 kjcf05n02 ipmievd[3952]: System Event sensor - Timestamp Clock Sync Nov 3 11:02:15 kjcf05n02 ipmievd[3127]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:02:15 kjcf05n02 diskless-swap[7315]: HA_PS_000: recovering journal Nov 3 11:02:15 kjcf05n02 systemd-udevd[1564]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 11:02:15 kjcf05n02 diskless-swap[7315]: HA_PS_000: clean, 2281/6400 files, 7071/25600 blocks Nov 3 11:02:15 kjcf05n02 diskless-swap[7315]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 11:02:15 kjcf05n02 diskless-swap[7315]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 11:02:15 kjcf05n02 diskless-swap[7315]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 11:02:15 kjcf05n02 diskless-swap[7315]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 11:02:15 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 11:02:15 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:02:15 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:02:15 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 11:02:15 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 11:02:15 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 11:02:15 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 11:02:15 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 3 11:02:15 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 3 11:02:15 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 3 11:02:15 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 3 11:02:15 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 3 11:02:15 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 11:02:15 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 11:02:15 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 11:02:15 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 11:02:15 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 11:02:16 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 11:02:16 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 11:02:16 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 11:02:16 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 11:02:16 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 11:02:16 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 11:02:17 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib0 Nov 3 11:02:17 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib0 Nov 3 11:02:17 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 11:02:17 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 11:02:17 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 11:02:17 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 11:02:17 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 11:02:17 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 11:02:17 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 11:02:17 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 11:02:18 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 11:02:18 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 11:02:18 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 11:02:18 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 11:02:18 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:19 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 3 11:02:19 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:02:19 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:02:19 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 11:02:19 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 11:02:19 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:19 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 3 11:02:19 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:02:19 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:02:19 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 11:02:19 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 11:02:19 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:19 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 3 11:02:19 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:02:19 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:02:19 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 11:02:19 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 11:02:19 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 11:02:19 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 11:02:19 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 11:02:19 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 11:02:19 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 11:02:19 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 11:02:19 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 11:02:19 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 11:02:19 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:20 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 3 11:02:20 kjcf05n02 kdumpctl[7819]: kdump: No kdump initial ramdisk found. Nov 3 11:02:20 kjcf05n02 kdumpctl[7819]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 11:02:20 kjcf05n02 dracut[7931]: dracut-049-135.git20210121.el8 Nov 3 11:02:20 kjcf05n02 dracut[7933]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 11:02:20 kjcf05n02 dracut[7933]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 11:02:20 kjcf05n02 dracut[7933]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 11:02:20 kjcf05n02 dracut[7933]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 11:02:20 kjcf05n02 dracut[7933]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 11:02:20 kjcf05n02 dracut[7933]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 11:02:20 kjcf05n02 dracut[7933]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 11:02:20 kjcf05n02 dracut[7933]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 11:02:20 kjcf05n02 kdumpctl[7819]: + is_func check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ type -t check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 0 -ne 0 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check -h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local dev holder Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + require_binaries mdadm expr Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _module_name=90hperaid Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ mdadm = \-\m ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for cmd in "$@" Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + find_binary mdadm Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for cmd in "$@" Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + find_binary expr Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n -h ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for dev in "${!host_fs_types[@]}" Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ nfs != *_raid_member ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + continue Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _ret=255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + ret=255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ 255 = 0 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ 255 = 255 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ module_depends hperaid Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: +++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: +++ set -x Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ depends Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo rootfs-block Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ return 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ _ret=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ return 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for _moddep in $(module_depends $_mod) Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all == *\ hperaid\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + add_dracutmodules+=' rootfs-block ' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ == *\ hperaid\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check_module rootfs-block Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _mod=rootfs-block Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddep Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ == *\ rootfs-block\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n '' ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all == *\ rootfs-block\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + module_check rootfs-block 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _forced=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 2 -eq 2 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _forced=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + is_func check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ type -t check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 0 -ne 0 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check -h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _ret=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + ret=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ 0 = 0 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ module_depends rootfs-block Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: +++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 11:02:21 kjcf05n02 kdumpctl[3127]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ depends Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo fs-lib Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ _ret=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ return 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for _moddep in $(module_depends $_mod) Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all == *\ rootfs-block\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + add_dracutmodules+=' fs-lib ' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ == *\ rootfs-block\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check_module fs-lib Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _mod=fs-lib Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddep Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n '' ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + mods_checked_as_dep+=' fs-lib ' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all == *\ fs-lib\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + module_check fs-lib 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _forced=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 2 -eq 2 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _forced=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + is_func check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ type -t check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 0 -ne 0 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check -h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _ret=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + ret=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ 0 = 0 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ module_depends fs-lib Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: +++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ depends Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ return 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ _ret=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ return 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + mods_to_load+=' fs-lib ' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + mods_to_load+=' rootfs-block ' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + mods_to_load+=' hperaid ' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _mod=90kernel-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _mod=kernel-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check_module kernel-modules 1 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _mod=kernel-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddep Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n 1 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all = all ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + module_check kernel-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _forced=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 1 -eq 2 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + is_func check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ type -t check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 0 -ne 0 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check -h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + true Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _ret=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + ret=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ 0 != 0 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ module_depends kernel-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: +++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ depends Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ true Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ _ret=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ return 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + mods_to_load+=' kernel-modules ' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _mod=90kernel-modules-extra Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _mod=kernel-modules-extra Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check_module kernel-modules-extra 1 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _mod=kernel-modules-extra Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddep Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n 1 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all = all ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + module_check kernel-modules-extra Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _forced=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 1 -eq 2 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + is_func check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ type -t check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 0 -ne 0 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check -h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + true Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _ret=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + ret=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ 0 != 0 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ module_depends kernel-modules-extra Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: +++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ depends Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ true Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ _ret=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ return 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + mods_to_load+=' kernel-modules-extra ' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _mod=90kernel-network-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _mod=kernel-network-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check_module kernel-network-modules 1 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _mod=kernel-network-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddep Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n 1 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all = all ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + module_check kernel-network-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _forced=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 1 -eq 2 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + is_func check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ type -t check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 0 -ne 0 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check -h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _ret=255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + ret=255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ 255 != 0 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n 1 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 1 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _mod=90livenet Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _mod=livenet Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check_module livenet 1 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _mod=livenet Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddep Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n 1 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all = all ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + module_check livenet Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _forced=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 1 -eq 2 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + is_func check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ type -t check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 0 -ne 0 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check -h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _ret=255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + ret=255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ 255 != 0 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n 1 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 1 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _mod=90lvm Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _mod=lvm Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check_module lvm 1 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _mod=lvm Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddep Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n 1 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all = all ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + module_check lvm Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 11:02:21 kjcf05n02 kdumpctl[3127]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _forced=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 1 -eq 2 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + is_func check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ type -t check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 0 -ne 0 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check -h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + require_binaries lvm Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _module_name=90lvm Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ lvm = \-\m ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for cmd in "$@" Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + find_binary lvm Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n -h ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for fs in "${host_fs_types[@]}" Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ nfs = LVM*_member ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _ret=255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + ret=255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ 255 != 0 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n 1 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 1 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _mod=90mdraid Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _mod=mdraid Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check_module mdraid 1 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _mod=mdraid Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddep Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n 1 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all = all ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + module_check mdraid Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _forced=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 1 -eq 2 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + is_func check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ type -t check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 0 -ne 0 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check -h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _rootdev Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + require_binaries mdadm expr Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _module_name=90mdraid Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ mdadm = \-\m ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for cmd in "$@" Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + find_binary mdadm Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for cmd in "$@" Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + find_binary expr Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n -h ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for dev in "${!host_fs_types[@]}" Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ nfs != *_raid_member ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + continue Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _ret=255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + ret=255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ 255 != 0 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n 1 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 1 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _mod=90multipath Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _mod=multipath Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check_module multipath 1 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _mod=multipath Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddep Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n 1 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all = all ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + module_check multipath Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _forced=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 1 -eq 2 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + is_func check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ type -t check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 0 -ne 0 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check -h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _rootdev Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n -h ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for_each_host_dev_and_slaves is_mpath Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _func=is_mpath Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _dev Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for _dev in "${host_devs[@]}" Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + continue Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 1 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _ret=255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + ret=255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ 255 != 0 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n 1 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 1 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _mod=90qemu Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _mod=qemu Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check_module qemu 1 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _mod=qemu Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 11:02:21 kjcf05n02 kdumpctl[3127]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddep Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n 1 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all = all ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + module_check qemu Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _forced=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 1 -eq 2 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + is_func check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ type -t check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 0 -ne 0 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check -h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n -h ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + type -P systemd-detect-virt Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ systemd-detect-virt --vm Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + vm=none Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + (( 1 != 0 )) Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _ret=255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + ret=255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ 255 != 0 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n 1 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 1 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _mod=90qemu-net Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _mod=qemu-net Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check_module qemu-net 1 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _mod=qemu-net Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddep Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n 1 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all = all ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + module_check qemu-net Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _forced=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 1 -eq 2 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + is_func check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ type -t check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 0 -ne 0 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check -h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n -h ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + type -P systemd-detect-virt Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ systemd-detect-virt --vm Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + vm= Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + (( 1 != 0 )) Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _ret=255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + ret=255 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ 255 != 0 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n 1 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + return 1 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _mod=90stratis Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + _mod=stratis Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check_module stratis 1 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _mod=stratis Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddep Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -n 1 ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ all = all ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + module_check stratis Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ read a b Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _forced=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _hostonly=-h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 1 -eq 2 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + is_func check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: ++ type -t check Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + '[' 0 -ne 0 ']' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + check -h Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _module_name=90stratis Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + local _ret=0 Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + [[ stratisd-init = \-\m ]] Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + for cmd in "$@" Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + find_binary stratisd-init Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 11:02:21 kjcf05n02 kdumpctl[7819]: + set +x Nov 3 11:02:21 kjcf05n02 dracut[7933]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 11:02:21 kjcf05n02 dracut[7933]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 11:02:21 kjcf05n02 dracut[7933]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 11:02:21 kjcf05n03 LCNmon[17772]: 10.16.100.52 is unreachable via ib1 Nov 3 11:02:21 kjcf05n03 LCNmon[17772]: 10.16.100.58 is unreachable via ib1 Nov 3 11:02:21 kjcf05n02 dracut[7933]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 11:02:21 kjcf05n02 dracut[7933]: memstrack is available Nov 3 11:02:21 kjcf05n02 dracut[7933]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 11:02:21 kjcf05n02 dracut[7933]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 11:02:21 kjcf05n02 dracut[7933]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 11:02:21 kjcf05n02 dracut[7933]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 11:02:21 kjcf05n02 dracut[7933]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 11:02:21 kjcf05n02 dracut[7933]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 11:02:22 kjcf05n02 dracut[7933]: *** Including module: bash *** Nov 3 11:02:22 kjcf05n02 dracut[7933]: *** Including module: systemd *** Nov 3 11:02:22 kjcf05n02 dracut[7933]: *** Including module: fips *** Nov 3 11:02:23 kjcf05n02 dracut[7933]: *** Including module: systemd-initrd *** Nov 3 11:02:23 kjcf05n02 dracut[7933]: *** Including module: watchdog-modules *** Nov 3 11:02:23 kjcf05n02 dracut[7933]: *** Including module: nss-softokn *** Nov 3 11:02:23 kjcf05n02 dracut[7933]: *** Including module: i18n *** Nov 3 11:02:23 kjcf05n02 dracut[7933]: No KEYMAP configured. Nov 3 11:02:23 kjcf05n02 dracut[7933]: *** Including module: network-legacy *** Nov 3 11:02:23 kjcf05n02 dracut[7933]: *** Including module: network *** Nov 3 11:02:23 kjcf05n02 dracut[7933]: *** Including module: ib_bonding *** Nov 3 11:02:23 kjcf05n02 dracut[7933]: *** Including module: drm *** Nov 3 11:02:23 kjcf05n00 mcfcli[3673891]: %3|1730653343.663|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:02:27 kjcf05n02 dcs-collectord[5609]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 11:02:27 kjcf05n02 dcs-collectord[5609]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 11:02:27 kjcf05n02 dracut[7933]: *** Including module: hperaid *** Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + install Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + local rule rule_path Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + inst_multiple cat expr Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.bTdleF/initramfs -a -f cat expr Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + _ret=0 Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + (( 0 != 0 )) Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + : Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + return 0 Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + inst_multiple -o mdmon Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.bTdleF/initramfs -a -f -o mdmon Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + _ret=0 Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + (( 0 != 0 )) Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + : Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + return 0 Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: ++ command -v partx Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + inst /usr/sbin/partx /sbin/partx Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + local _hostonly_install Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + [[ -e /tmp/dracut.bTdleF/initramfs//sbin/partx ]] Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.bTdleF/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + (( 0 != 0 )) Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + : Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: ++ command -v mdadm Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + local _hostonly_install Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + [[ -e /tmp/dracut.bTdleF/initramfs//sbin/mdadm ]] Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.bTdleF/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + (( 0 != 0 )) Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + : Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + [[ yes == \y\e\s ]] Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + local _raidconf Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: ++ cmdline Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: ++ local _activated dev line UUID Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: ++ declare -A _activated Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: ++ for dev in "${!host_fs_types[@]}" Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: ++ [[ nfs != *_raid_member ]] Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: ++ continue Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + _raidconf= Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + [[ -n '' ]] Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + inst_rules 64-md-raid.rules Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + local _target=/etc/udev/rules.d _rule _found Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + inst_dir /usr/lib/udev/rules.d Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + [[ -e /tmp/dracut.bTdleF/initramfs//usr/lib/udev/rules.d ]] Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + return 0 Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + inst_dir /etc/udev/rules.d Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + [[ -e /tmp/dracut.bTdleF/initramfs//etc/udev/rules.d ]] Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + return 0 Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + for _rule in "$@" Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + continue Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + continue Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + for r in '' $dracutbasedir/rules.d/ Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + [[ 64-md-raid.rules != /* ]] Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + continue Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + for r in '' $dracutbasedir/rules.d/ Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + continue Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + [[ -n '' ]] Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + set +x Nov 3 11:02:27 kjcf05n02 dracut[7933]: Skipping udev rule: 64-md-raid.rules Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + installkernel Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + instmods =drivers/md Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + local _optional=-o Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + local _silent Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + local _ret Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + [[ '' = yes ]] Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + [[ =drivers/md = \-\c ]] Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + [[ =drivers/md = \-\s ]] Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + (( 1 == 0 )) Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.bTdleF/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + _ret=0 Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + (( 0 != 0 )) Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + [[ -n '' ]] Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + return 0 Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + _ret=0 Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + unset check depends cmdline install installkernel Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + return 0 Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + modules_loaded+='hperaid ' Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + '[' -n '' ']' Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + _d_mod=90kernel-modules Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + _d_mod=kernel-modules Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + [[ '' = yes ]] Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + dinfo '*** Including module: kernel-modules ***' Nov 3 11:02:27 kjcf05n02 kdumpctl[7819]: + set +x Nov 3 11:02:27 kjcf05n02 dracut[7933]: *** Including module: kernel-modules *** Nov 3 11:02:27 kjcf05n02 dracut[7933]: *** Including module: kernel-modules-extra *** Nov 3 11:02:27 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 3 11:02:28 kjcf05n02 dracut[7933]: *** Including module: kernel-network-modules *** Nov 3 11:02:28 kjcf05n02 dracut[7933]: *** Including module: diskless-mod *** Nov 3 11:02:28 kjcf05n02 dracut[7933]: *** Including module: fstab-sys *** Nov 3 11:02:28 kjcf05n02 dracut[7933]: *** Including module: nfs *** Nov 3 11:02:29 kjcf05n02 dracut[7933]: *** Including module: rootfs-block *** Nov 3 11:02:29 kjcf05n02 dracut[7933]: *** Including module: terminfo *** Nov 3 11:02:29 kjcf05n02 dracut[7933]: *** Including module: udev-rules *** Nov 3 11:02:29 kjcf05n02 dracut[7933]: Skipping udev rule: 91-permissions.rules Nov 3 11:02:29 kjcf05n02 dracut[7933]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 11:02:29 kjcf05n02 dracut[7933]: *** Including module: dracut-systemd *** Nov 3 11:02:29 kjcf05n00 zabbix-server[1198953]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 11:02:29 kjcf05n00 zabbix-server[1198953]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:47\\"}}"' Nov 3 11:02:29 kjcf05n00 log_interesting_event.py[1198953]: Event '46128' acknowledged Nov 3 11:02:30 kjcf05n02 dracut[7933]: *** Including module: usrmount *** Nov 3 11:02:30 kjcf05n02 dracut[7933]: *** Including module: base *** Nov 3 11:02:30 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 3 11:02:30 kjcf05n02 dracut[7933]: *** Including module: fs-lib *** Nov 3 11:02:30 kjcf05n02 dracut[7933]: *** Including module: kdumpbase *** Nov 3 11:02:31 kjcf05n02 dracut[7933]: *** Including module: memstrack *** Nov 3 11:02:31 kjcf05n02 dracut[7933]: *** Including module: shutdown *** Nov 3 11:02:31 kjcf05n02 dracut[7933]: *** Including module: squash *** Nov 3 11:02:31 kjcf05n02 dracut[7933]: *** Including modules done *** Nov 3 11:02:31 kjcf05n02 dracut[7933]: *** Installing kernel module dependencies *** Nov 3 11:02:32 kjcf05n02 dracut[7933]: *** Installing kernel module dependencies done *** Nov 3 11:02:32 kjcf05n02 dracut[7933]: *** Resolving executable dependencies *** Nov 3 11:02:33 kjcf05n02 dracut[7933]: *** Resolving executable dependencies done*** Nov 3 11:02:33 kjcf05n02 dracut[7933]: *** Hardlinking files *** Nov 3 11:02:33 kjcf05n02 dracut[7933]: *** Hardlinking files done *** Nov 3 11:02:33 kjcf05n02 dracut[7933]: *** Generating early-microcode cpio image *** Nov 3 11:02:33 kjcf05n02 dracut[7933]: *** Constructing AuthenticAMD.bin **** Nov 3 11:02:33 kjcf05n02 dracut[7933]: *** Store current command line parameters *** Nov 3 11:02:33 kjcf05n02 dracut[7933]: Stored kernel commandline: Nov 3 11:02:33 kjcf05n02 dracut[7933]: rd.driver.pre=sd_mod Nov 3 11:02:33 kjcf05n02 dracut[7933]: rd.driver.pre=nvme Nov 3 11:02:33 kjcf05n02 dracut[7933]: rd.driver.pre=ipmi_si Nov 3 11:02:33 kjcf05n02 dracut[7933]: rd.driver.pre=ipmi_devintf Nov 3 11:02:33 kjcf05n02 dracut[7933]: rd.driver.pre=ipmi_msghandler Nov 3 11:02:33 kjcf05n02 dracut[7933]: nameserver=172.16.2.2 Nov 3 11:02:33 kjcf05n02 dracut[7933]: nameserver=127.0.0.1 Nov 3 11:02:33 kjcf05n02 dracut[7933]: nameserver=172.16.2.2 Nov 3 11:02:33 kjcf05n02 dracut[7933]: nameserver=127.0.0.1 Nov 3 11:02:33 kjcf05n02 dracut[7933]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 3 11:02:33 kjcf05n02 dracut[7933]: rd.neednet Nov 3 11:02:33 kjcf05n02 dracut[7933]: kdumpnic=mgmt0 Nov 3 11:02:33 kjcf05n02 dracut[7933]: bootdev=mgmt0 Nov 3 11:02:33 kjcf05n02 dracut[7933]: *** Install squash loader *** Nov 3 11:02:33 kjcf05n02 dracut[7933]: *** Squashing the files inside the initramfs *** Nov 3 11:02:34 kjcf05n02 dracut[7933]: *** Squashing the files inside the initramfs done *** Nov 3 11:02:34 kjcf05n02 dracut[7933]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 11:02:34 kjcf05n02 dracut[7933]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 11:02:35 kjcf05n02 kdumpctl[7819]: kdump: kexec: loaded kdump kernel Nov 3 11:02:35 kjcf05n02 kdumpctl[7819]: kdump: Starting kdump: [OK] Nov 3 11:02:35 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 3 11:02:35 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:35 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:02:35 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:02:35 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:02:35 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 11:02:35 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 11:02:35 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 11:02:35 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 11:02:35 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 11:02:35 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 11:02:35 kjcf05n02 ifdown[14497]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 11:02:35 kjcf05n02 ifdown[14498]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:02:35 kjcf05n02 ifdown[14499]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:02:35 kjcf05n00 mcfcli[3673891]: %3|1730653355.432|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:02:35 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 11:02:35 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 11:02:35 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 11:02:36 kjcf05n02 ifup[14559]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 11:02:36 kjcf05n02 ifup[14560]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:02:36 kjcf05n02 ifup[14561]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:02:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730653356', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 11:02:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730653356', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 11:02:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730653356'} Nov 3 11:02:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:02:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730653356'} Nov 3 11:02:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 11:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 11:02:37 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 11:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 11:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 11:02:40 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 11:02:40 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 11:02:40 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 11:02:40 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:02:40 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:02:40 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:02:40 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:02:40 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 11:02:40 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 11:02:40 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 11:02:40 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 11:02:40 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:02:40 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:02:40 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:02:40 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:02:40 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 11:02:40 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 11:02:40 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 11:02:40 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 11:02:40 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 11:02:40 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 11:02:40 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 11:02:40 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 11:02:40 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 11:02:40 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 11:02:40 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 11:02:40 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 11:02:40 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 11:02:40 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 11:02:40 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 11:02:40 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 11:02:40 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 11:02:40 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 11:02:40 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 11:02:40 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 11:02:40 kjcf05n02 ifdown[14762]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 11:02:40 kjcf05n02 ifdown[14763]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:02:40 kjcf05n02 ifdown[14764]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:02:40 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 11:02:40 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 11:02:40 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 11:02:40 kjcf05n02 ifup[14824]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 11:02:40 kjcf05n02 ifup[14825]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:02:40 kjcf05n02 ifup[14826]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:02:42 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 11:02:42 kjcf05n02 dcs-collectord[5609]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 11:02:42 kjcf05n02 dcs-collectord[5609]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 11:02:45 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 11:02:45 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 11:02:45 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 11:02:45 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:45 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 3 11:02:45 kjcf05n02 await_ha_peer[15039]: Waiting for HA peer kjcf05n03 Nov 3 11:02:47 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 11:02:47 kjcf05n02 await_ha_peer[15039]: Peer kjcf05n03 has started, starting HA Nov 3 11:02:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730653366', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.63, 1.82, 0.82'}"] Nov 3 11:02:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 1.63, 1.82, 0.82', 'message': 'OK - load average: 1.63, 1.82, 0.82', 'value': 'ok', 'timestamp': '1730653366'} Nov 3 11:02:46 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:02:47 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 3 11:02:47 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 3 11:02:47 kjcf05n02 fstonithd.py[15099]: Listening for kdump packets from partner Nov 3 11:02:47 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:47 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:02:47 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:02:47 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:02:47 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:48 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 3 11:02:48 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 11:02:48 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:48 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 11:02:48 kjcf05n02 puppet-agent[3541]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:02:48 kjcf05n02 puppet[3541]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:02:48 kjcf05n02 puppet-agent[3541]: Applied catalog in 92.42 seconds Nov 3 11:02:48 kjcf05n02 puppet[3541]: Notice: Applied catalog in 92.42 seconds Nov 3 11:02:48 kjcf05n02 systemd[1]: Started Puppet agent. Nov 3 11:02:48 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 3 11:02:48 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 11:02:48 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 11:02:48 kjcf05n02 systemd[1]: Reached target Timers. Nov 3 11:02:48 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 11:02:48 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 11:02:48 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 11:02:48 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 11:02:48 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 11:02:48 kjcf05n02 wce-disable.sh[15258]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 11:02:48 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 11:02:48 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 11:02:48 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 11:02:48 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 11:02:48 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 3 11:02:48 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 3 11:02:49 kjcf05n02 python3.9[15260]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 11:02:49 kjcf05n02 python3.9[15260]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 11:02:49 kjcf05n02 gateway-ec-node.py[15261]: Starting gateway-ec-node service Nov 3 11:02:49 kjcf05n02 RFSF-API[15259]: INFO[2024-11-03T11:02:48-06:00] Datapath API RESTful Service starting Nov 3 11:02:49 kjcf05n02 dp-api-server-node[15259]: INFO[2024-11-03T11:02:48-06:00] Datapath API RESTful Service starting Nov 3 11:02:49 kjcf05n02 RFSF-API[15259]: INFO[2024-11-03T11:02:48-06:00] Running in production mode, starting dbus event listener Nov 3 11:02:49 kjcf05n02 dp-api-server-node[15259]: INFO[2024-11-03T11:02:48-06:00] Running in production mode, starting dbus event listener Nov 3 11:02:49 kjcf05n02 RFSF-API[15259]: INFO[2024-11-03T11:02:48-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 11:02:49 kjcf05n02 dp-api-server-node[15259]: INFO[2024-11-03T11:02:48-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 11:02:49 kjcf05n02 RFSF-API[15259]: INFO[2024-11-03T11:02:48-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 11:02:49 kjcf05n02 dp-api-server-node[15259]: INFO[2024-11-03T11:02:48-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 11:02:49 kjcf05n02 RFSF-API[15259]: INFO[2024-11-03T11:02:48-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 11:02:49 kjcf05n02 dp-api-server-node[15259]: INFO[2024-11-03T11:02:48-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 11:02:49 kjcf05n02 RFSF-API[15259]: INFO[2024-11-03T11:02:48-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 11:02:49 kjcf05n02 dp-api-server-node[15259]: INFO[2024-11-03T11:02:48-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 11:02:49 kjcf05n02 RFSF-API[15259]: INFO[2024-11-03T11:02:48-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 11:02:49 kjcf05n02 dp-api-server-node[15259]: INFO[2024-11-03T11:02:48-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 11:02:49 kjcf05n02 RFSF-API[15259]: INFO[2024-11-03T11:02:48-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 11:02:49 kjcf05n02 dp-api-server-node[15259]: INFO[2024-11-03T11:02:48-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 11:02:49 kjcf05n02 RFSF-API[15259]: INFO[2024-11-03T11:02:48-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 11:02:49 kjcf05n02 dp-api-server-node[15259]: INFO[2024-11-03T11:02:48-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 11:02:49 kjcf05n02 RFSF-API[15259]: INFO[2024-11-03T11:02:48-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 11:02:49 kjcf05n02 dp-api-server-node[15259]: INFO[2024-11-03T11:02:48-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 11:02:49 kjcf05n02 RFSF-API[15259]: INFO[2024-11-03T11:02:48-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 11:02:49 kjcf05n02 dp-api-server-node[15259]: INFO[2024-11-03T11:02:48-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 11:02:49 kjcf05n02 RFSF-API[15259]: INFO[2024-11-03T11:02:48-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 11:02:49 kjcf05n02 dp-api-server-node[15259]: INFO[2024-11-03T11:02:48-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 11:02:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730653371', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(868.0B/716.0B), ib1=(504.0B/656.0B), icl0=(5.5kB/8.6kB), lo=(600.0B/600.0B), meth0=(1541.1MB/7.7MB), mgmt0=(1477.9MB/7.7MB)'}"] Nov 3 11:02:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(868.0B/716.0B), ib1=(504.0B/656.0B), icl0=(5.5kB/8.6kB), lo=(600.0B/600.0B), meth0=(1541.1MB/7.7MB), mgmt0=(1477.9MB/7.7MB)', 'message': 'NET OK - (Rx/Tx) ib0=(868.0B/716.0B), ib1=(504.0B/656.0B), icl0=(5.5kB/8.6kB), lo=(600.0B/600.0B), meth0=(1541.1MB/7.7MB), mgmt0=(1477.9MB/7.7MB)', 'value': 'ok', 'timestamp': '1730653371'} Nov 3 11:02:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:02:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730653371', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 11:02:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730653371'} Nov 3 11:02:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:02:54 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:54 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 11:02:54 kjcf05n02 systemd[1]: Reloading. Nov 3 11:02:54 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 11:02:54 kjcf05n02 diskmonitor_pre[15817]: Key management is currently disabled.DEAR disabled Nov 3 11:02:54 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 11:02:56 kjcf05n02 sh[15867]: LNET configured: New Created Nov 3 11:02:56 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 11:02:56 kjcf05n02 LCNmon[17882]: Interface ib0 is up Nov 3 11:02:56 kjcf05n02 LCNmon[17882]: Interface ib1 is up Nov 3 11:02:56 kjcf05n02 LCNmon[17882]: Can ping through interface ib0 Nov 3 11:02:56 kjcf05n02 LCNmon[17882]: Can ping through interface ib1 Nov 3 11:02:56 kjcf05n02 LCNmon[17882]: NIC ib0, initial state UP Nov 3 11:02:56 kjcf05n02 LCNmon[17882]: NIC ib1, initial state UP Nov 3 11:02:56 kjcf05n02 LCNmon[17882]: LCNstat initial state UP Nov 3 11:02:56 kjcf05n02 dcs-collectord[5609]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 11:02:56 kjcf05n02 dcs-collectord[5609]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 11:02:56 kjcf05n02 dcs-collectord[5609]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 11:02:56 kjcf05n02 LCNmon[17882]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 3 11:02:57 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730653377', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 366 processes with STATE = RSZDT '}"] Nov 3 11:02:57 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 366 processes with STATE = RSZDT ', 'message': 'PROCS OK: 366 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730653377'} Nov 3 11:02:57 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: /var/run/diskmonitor does not exist, creating Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: Creating /var/run/diskmonitor/disk Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: Creating /var/run/diskmonitor/encl Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: Creating /var/run/diskmonitor/cli Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: RAS_Interlocks_enabled: 1 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: add handler for sig: 14 sa_flags: 10000004 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: add handler for sig: 1 sa_flags: 10000004 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: add handler for sig: 2 sa_flags: 00000004 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: add handler for sig: 15 sa_flags: 00000004 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: add handler for sig: 6 sa_flags: 00000004 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: add handler for sig: 3 sa_flags: 00000004 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: add handler for sig: 30 sa_flags: 00000004 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: add handler for sig: 20 sa_flags: 00000004 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: add handler for sig: 10 sa_flags: 10000004 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: add handler for sig: 11 sa_flags: 00000004 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: add handler for sig: 7 sa_flags: 00000004 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: add handler for sig: 4 sa_flags: 00000004 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: add handler for sig: 8 sa_flags: 00000004 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: Using HA Baton locks - key: diskmonitor Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: Baton will be held for at most 570 seconds Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: DMMP Enabled: 0 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: random seed: 18272a48 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: NVMe Enclosure: 1 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: ZFS Enclosure: 0 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: Dbus, Initialized Connection Successfully Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: int_catcher_thread: thread start Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: Received dbus message 4 org.freedesktop.DBus -> :1.99 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 11:02:58 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 11:02:59 kjcf05n00 httpd[902570]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 11:03:00 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 11:03:01 kjcf05n02 openhpid[5515]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 11:03:01 kjcf05n02 openhpid[5515]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 11:03:01 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 3 11:03:01 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 11:03:01 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 11:03:01 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18472 which is not our child. We'll most likely not notice when it exits. Nov 3 11:03:01 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 11:03:01 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 3 11:03:01 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 3 11:03:01 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 11:03:01 kjcf05n02 dcs-collectord[5609]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 11:03:01 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 11:03:01 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 11:03:01 kjcf05n02 systemd[1]: Startup finished in 50.612s (kernel) + 2min 28.380s (userspace) = 3min 18.993s. Nov 3 11:03:01 kjcf05n02 openhpid[18472]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 11:03:01 kjcf05n02 openhpid[18472]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 11:03:01 kjcf05n02 openhpid[18472]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 11:03:01 kjcf05n02 openhpid[18472]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 11:03:03 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18614 (bash) Nov 3 11:03:03 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 11:03:03 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 11:03:03 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 11:03:03 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 11:03:03 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 11:03:03 kjcf05n00 mcfcli[3673891]: %3|1730653383.660|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 11:03:04 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 11:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730653384', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 11:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730653384'} Nov 3 11:03:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:03:05 kjcf05n00 mcfcli[3673891]: %3|1730653385.432|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:03:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730653386', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.7% (4387596 kB) used.'}"] Nov 3 11:03:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.7% (4387596 kB) used.', 'message': 'OK - 1.7% (4387596 kB) used.', 'value': 'ok', 'timestamp': '1730653386'} Nov 3 11:03:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:03:12 kjcf05n02 dcs-collectord[5609]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 11:03:12 kjcf05n02 dcs-collectord[5609]: WARNING No data collected (hpi_parser.py:353) Nov 3 11:03:12 kjcf05n03 nslcd[7088]: [16e9e8] ldap_result() failed: Can't contact LDAP server Nov 3 11:03:25 kjcf05n02 ipmievd[3952]: System Event sensor - Timestamp Clock Sync Nov 3 11:03:27 kjcf05n02 ipmievd[3127]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:03:27 kjcf05n02 dcs-collectord[5609]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 11:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T11:03:27.253046786-06:00 level=info msg="Completed cleanup jobs" duration=26.194407ms Nov 3 11:03:35 kjcf05n00 mcfcli[3673891]: %3|1730653415.433|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 11:03:37 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 11:03:40 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730653419', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 11:03:40 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730653419'} Nov 3 11:03:40 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:03:40 kjcf05n00 mcfcli[3673891]: %3|1730653420.042|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:03:42 kjcf05n02 dcs-collectord[5609]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 11:03:45 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db00994002538450000000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 11:03:45 kjcf05n02 ras-resource-manager-agent[5873]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "95aa021e-9a05-11ef-bfca-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 11:03:45 kjcf05n02 ras-resource-manager-agent[5873]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '95aa021e-9a05-11ef-bfca-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 11:03:45 kjcf05n02 ras-resource-manager-agent[5873]: INFO Submitting new device inserted signal, starting to qualify drive: 95aa021e-9a05-11ef-bfca-00093d0695e3 (admin_action.py:110) Nov 3 11:03:45 kjcf05n03 firmware-update-orc-server[5876]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "3118980a-6cbe-4d2e-baa1-c9d80a8c1ec7"} (logger.py:65) Nov 3 11:03:45 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 196843 (get_disk_device) Nov 3 11:03:45 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 11:03:45 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 11:03:45 kjcf05n03 ccp-client[196881]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 11:03:44 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '95aa021e-9a05-11ef-bfca-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 11:03:44 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '95aa021e-9a05-11ef-bfca-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 11:03:44 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '95aa021e-9a05-11ef-bfca-00093d0695e3', 'response ID': '95b41484-9a05-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 11:03:44 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 95b41484-9a05-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 11:03:45 kjcf05n03 ccp-client[196881]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 11:03:45 kjcf05n03 ccp-client[196891]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 11:03:45 kjcf05n03 ccp-client[196881]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 11:03:45 kjcf05n03 ccp-client[196881]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 11:03:45 kjcf05n03 ccp-client[196891]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 11:03:45 kjcf05n03 ccp-client[196891]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 11:03:45 kjcf05n02 diskmonitor[17396]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 11:03:45 kjcf05n02 ras-resource-manager-agent[5873]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "95faee36-9a05-11ef-bfca-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 11:03:45 kjcf05n02 ras-resource-manager-agent[5873]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '95faee36-9a05-11ef-bfca-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 11:03:45 kjcf05n02 ras-resource-manager-agent[5873]: INFO Submitting new device inserted signal, starting to qualify drive: 95faee36-9a05-11ef-bfca-00093d0695e3 (admin_action.py:110) Nov 3 11:03:45 kjcf05n02 firmware-update-orc-server[5831]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "b584784b-b511-4225-93b1-d770764571e1"} (logger.py:65) Nov 3 11:03:45 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '95faee36-9a05-11ef-bfca-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 11:03:45 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '95faee36-9a05-11ef-bfca-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 11:03:45 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '95faee36-9a05-11ef-bfca-00093d0695e3', 'response ID': '9601f2ee-9a05-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 11:03:45 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 9601f2ee-9a05-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 11:03:48 kjcf05n03 DRVFW[197017]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 11:03:48 kjcf05n03 ccp-client[197018]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 11:03:48 kjcf05n03 ccp-client[197018]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 11:03:48 kjcf05n03 ccp-client[197027]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 11:03:48 kjcf05n03 ccp-client[197018]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 11:03:48 kjcf05n03 ccp-client[197018]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 11:03:48 kjcf05n03 ccp-client[197027]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 11:03:48 kjcf05n03 ccp-client[197027]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 11:03:48 kjcf05n03 firmware-update-orc-server[5876]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 11:03:49 kjcf05n02 ras-resource-manager-agent[5873]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '95aa021e-9a05-11ef-bfca-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 11:03:49 kjcf05n02 ras-resource-manager-agent[5873]: INFO Drive qualification complete responding: 95aa021e-9a05-11ef-bfca-00093d0695e3 (admin_action.py:205) Nov 3 11:03:49 kjcf05n02 ras-resource-manager-agent[5873]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "95aa021e-9a05-11ef-bfca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (interesting_event.py:59) Nov 3 11:03:48 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 95b41484-9a05-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 11:03:48 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '95aa021e-9a05-11ef-bfca-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '95aa021e-9a05-11ef-bfca-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}}} (logger.py:65) Nov 3 11:03:53 kjcf05n02 diskmonitor[17396]: 4 Nov 3 11:03:53 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 11:03:53 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 11:03:53 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 11:03:53 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 11:03:53 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 11:03:53 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 11:03:53 kjcf05n02 diskmonitor[17396]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 11:03:53 kjcf05n02 diskmonitor[17396]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 11:03:53 kjcf05n02 diskmonitor[17396]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 11:03:53 kjcf05n02 diskmonitor[17396]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 11:03:53 kjcf05n02 diskmonitor[17396]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 11:03:53 kjcf05n02 diskmonitor[17396]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "95aa021e-9a05-11ef-bfca-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 11:03:53 kjcf05n02 diskmonitor[17396]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 11:03:53 kjcf05n02 diskmonitor[17396]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 11:03:53 kjcf05n02 diskmonitor[17396]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "95faee36-9a05-11ef-bfca-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 11:03:53 kjcf05n02 diskmonitor[17396]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 11:03:53 kjcf05n02 diskmonitor[17396]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 11:03:58 kjcf05n02 chronyd[5120]: Selected source 172.16.2.1 Nov 3 11:04:00 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22475 (get_disk_device) Nov 3 11:04:00 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 11:04:00 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 11:04:01 kjcf05n02 ccp-client[22497]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 11:04:01 kjcf05n02 ccp-client[22497]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 11:04:01 kjcf05n02 ccp-client[22506]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 11:04:01 kjcf05n02 ccp-client[22497]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 11:04:01 kjcf05n02 ccp-client[22497]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 11:04:01 kjcf05n02 ccp-client[22506]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 11:04:01 kjcf05n02 ccp-client[22506]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 11:04:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730653441}"] Nov 3 11:04:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730653441, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:04:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:04:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730653441}"] Nov 3 11:04:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730653441, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:04:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:04:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730653441}"] Nov 3 11:04:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730653441, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:04:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:04:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730653441}"] Nov 3 11:04:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730653441, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:04:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:04:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730653441}"] Nov 3 11:04:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730653441, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:04:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:04:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730653441}"] Nov 3 11:04:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730653441, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:04:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:04:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730653441}"] Nov 3 11:04:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730653441, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:04:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:04:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730653441}"] Nov 3 11:04:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730653441, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:04:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:04:03 kjcf05n02 ras-resource-manager-agent[5873]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "95aa021e-9a05-11ef-bfca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (service_main_handler.py:66) Nov 3 11:04:03 kjcf05n02 ras-resource-manager-agent[5873]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '95aa021e-9a05-11ef-bfca-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 11:04:03 kjcf05n02 ras-resource-manager-agent[5873]: INFO Device qualification response has been acknowledged: 95aa021e-9a05-11ef-bfca-00093d0695e3 (admin_action.py:151) Nov 3 11:04:04 kjcf05n02 DRVFW[22872]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 11:04:04 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 3 11:04:04 kjcf05n02 ccp-client[22873]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 11:04:04 kjcf05n02 ccp-client[22873]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 11:04:04 kjcf05n02 ccp-client[22931]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 11:04:04 kjcf05n02 ccp-client[22873]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 11:04:04 kjcf05n02 ccp-client[22873]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 11:04:04 kjcf05n02 ccp-client[22931]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 11:04:04 kjcf05n02 ccp-client[22931]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 11:04:04 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 11:04:04 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 3 11:04:04 kjcf05n02 firmware-update-orc-server[5831]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 11:04:05 kjcf05n00 mcfcli[3673891]: %3|1730653445.433|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:04:05 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 9601f2ee-9a05-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 11:04:05 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '95faee36-9a05-11ef-bfca-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '95faee36-9a05-11ef-bfca-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}}} (logger.py:65) Nov 3 11:04:05 kjcf05n02 ras-resource-manager-agent[5873]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '95faee36-9a05-11ef-bfca-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 11:04:05 kjcf05n02 ras-resource-manager-agent[5873]: INFO Drive qualification complete responding: 95faee36-9a05-11ef-bfca-00093d0695e3 (admin_action.py:205) Nov 3 11:04:05 kjcf05n02 ras-resource-manager-agent[5873]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "95faee36-9a05-11ef-bfca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 3 11:04:06 kjcf05n02 python3.9[5181]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 11:04:07 kjcf05n02 python3.9[3127]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:04:07 kjcf05n02 diskmonitor[17396]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 11:04:07 kjcf05n02 diskmonitor[17396]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 11:04:07 kjcf05n02 ras-resource-manager-agent[5873]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "a3198b72-9a05-11ef-bfca-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 11:04:07 kjcf05n02 ras-resource-manager-agent[5873]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'a3198b72-9a05-11ef-bfca-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 11:04:07 kjcf05n02 ras-resource-manager-agent[5873]: INFO Requests ['95faee36-9a05-11ef-bfca-00093d0695e3', 'a3198b72-9a05-11ef-bfca-00093d0695e3'] already in progress (admin_action.py:99) Nov 3 11:04:07 kjcf05n02 ras-resource-manager-agent[5873]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'a3198b72-9a05-11ef-bfca-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 11:04:07 kjcf05n02 ras-resource-manager-agent[5873]: INFO Drive qualification complete responding: a3198b72-9a05-11ef-bfca-00093d0695e3 (admin_action.py:205) Nov 3 11:04:07 kjcf05n02 ras-resource-manager-agent[5873]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "95faee36-9a05-11ef-bfca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 3 11:04:07 kjcf05n02 ras-resource-manager-agent[5873]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "a3198b72-9a05-11ef-bfca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "95aa021e-9a05-11ef-bfca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: Dbus, handle_ingress_ras_signals, uuid: 95aa021e-9a05-11ef-bfca-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "95aa021e-9a05-11ef-bfca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: main: Pending firmware leveling requests exist, rescanning disks Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "a3198b72-9a05-11ef-bfca-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: leaving test state: 1 next state: 2 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: lock req: no timeout Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: leaving test state: 2 next state: 4 Nov 3 11:04:12 kjcf05n02 diskmonitor[17396]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 11:04:20 kjcf05n00 mcfcli[3673891]: %3|1730653460.039|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:04:23 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31432 deleted. Nov 3 11:04:24 kjcf05n02 ras-resource-manager-agent[5873]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "95faee36-9a05-11ef-bfca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 11:04:24 kjcf05n02 ras-resource-manager-agent[5873]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '95faee36-9a05-11ef-bfca-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 11:04:24 kjcf05n02 ras-resource-manager-agent[5873]: INFO Device qualification response has been acknowledged: 95faee36-9a05-11ef-bfca-00093d0695e3 (admin_action.py:151) Nov 3 11:04:24 kjcf05n02 ras-resource-manager-agent[5873]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "95faee36-9a05-11ef-bfca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 11:04:24 kjcf05n02 ras-resource-manager-agent[5873]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '95faee36-9a05-11ef-bfca-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 11:04:24 kjcf05n02 ras-resource-manager-agent[5873]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "a3198b72-9a05-11ef-bfca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 11:04:24 kjcf05n02 ras-resource-manager-agent[5873]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'a3198b72-9a05-11ef-bfca-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 11:04:24 kjcf05n02 ras-resource-manager-agent[5873]: INFO Device qualification response has been acknowledged: a3198b72-9a05-11ef-bfca-00093d0695e3 (admin_action.py:151) Nov 3 11:04:25 kjcf05n02 diskmonitor[17396]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 11:04:35 kjcf05n00 mcfcli[3673891]: %3|1730653475.433|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:04:41 kjcf05n02 diskmonitor[17396]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "95faee36-9a05-11ef-bfca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 11:04:41 kjcf05n02 diskmonitor[17396]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 11:04:41 kjcf05n02 diskmonitor[17396]: Dbus, handle_ingress_ras_signals, uuid: 95faee36-9a05-11ef-bfca-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 11:04:41 kjcf05n02 diskmonitor[17396]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 11:04:41 kjcf05n02 diskmonitor[17396]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "95faee36-9a05-11ef-bfca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 11:04:41 kjcf05n02 diskmonitor[17396]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "95faee36-9a05-11ef-bfca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 11:04:41 kjcf05n02 diskmonitor[17396]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 11:04:41 kjcf05n02 diskmonitor[17396]: Dbus, handle_ingress_ras_signals, uuid: 95faee36-9a05-11ef-bfca-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 11:04:41 kjcf05n02 diskmonitor[17396]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "95faee36-9a05-11ef-bfca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 11:04:41 kjcf05n02 diskmonitor[17396]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "a3198b72-9a05-11ef-bfca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 11:04:41 kjcf05n02 diskmonitor[17396]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 11:04:41 kjcf05n02 diskmonitor[17396]: Dbus, handle_ingress_ras_signals, uuid: a3198b72-9a05-11ef-bfca-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 11:04:41 kjcf05n02 diskmonitor[17396]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "a3198b72-9a05-11ef-bfca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 11:04:41 kjcf05n02 diskmonitor[17396]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 11:04:41 kjcf05n02 diskmonitor[17396]: lock acquired Nov 3 11:04:41 kjcf05n02 diskmonitor[17396]: leaving test state: 4 next state: 8 Nov 3 11:04:41 kjcf05n02 diskmonitor[17396]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 11:04:50 kjcf05n02 diskmonitor[17396]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 11:04:50 kjcf05n02 diskmonitor[17396]: leaving test state: 8 next state: 20 Nov 3 11:04:50 kjcf05n02 diskmonitor[17396]: leaving test state: 20 next state: 40 Nov 3 11:04:50 kjcf05n02 diskmonitor[17396]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 6c592b0000 Nov 3 11:04:50 kjcf05n02 diskmonitor[17396]: leaving test state: 40 next state: 80 Nov 3 11:04:57 kjcf05n00 mcfcli[3673891]: %3|1730653497.868|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:05:05 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 11:05:05 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 11:05:05 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 11:05:05 kjcf05n00 mcfcli[3673891]: %3|1730653505.434|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:05:08 kjcf05n00 python3.9[1200482]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 11:05:21 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 11:05:21 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 11:05:21 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 11:05:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730653225', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 11:05:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730653225'} Nov 3 11:05:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:05:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730653225', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 11:05:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730653225'} Nov 3 11:05:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:05:23 kjcf05n02 dcs-collectord[5609]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 11:05:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730653531}"] Nov 3 11:05:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730653531, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:05:31 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:05:31-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:05:31 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:05:31-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:05:31 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:05:31-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:05:31 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:05:31-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:05:31 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:05:31-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:05:31 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:05:31-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:05:31 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:05:31-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.341886ms Nov 3 11:05:31 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:05:31-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.341886ms Nov 3 11:05:31 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:05:31 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:05:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:05:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730653531}"] Nov 3 11:05:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730653531, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:05:31 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:05:31-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:05:31 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:05:31-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:05:31 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:05:31-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:05:31 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:05:31-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:05:31 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:05:31-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:05:31 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:05:31-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:05:31 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:05:31-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.047625ms Nov 3 11:05:31 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:05:31-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.047625ms Nov 3 11:05:31 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:05:31 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:05:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:05:35 kjcf05n00 mcfcli[3673891]: %3|1730653535.435|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 11:05:36 kjcf05n00 mcfcli[3673891]: %3|1730653536.608|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:05:45 kjcf05n02 diskmonitor[17396]: leaving test state: 80 next state: 100 Nov 3 11:05:45 kjcf05n02 diskmonitor[17396]: lock release: time: Sun Nov 3 11:05:40 2024 Nov 3 11:05:45 kjcf05n02 diskmonitor[17396]: leaving test state: 100 next state: 1 Nov 3 11:05:53 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 11:06:05 kjcf05n00 mcfcli[3673891]: %3|1730653565.435|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:06:13 kjcf05n00 mcfcli[3673891]: %3|1730653573.561|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:06:30 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 11:06:35 kjcf05n00 mcfcli[3673891]: %3|1730653595.435|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 11:06:53 kjcf05n00 mcfcli[3673891]: %3|1730653613.248|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:07:01 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 11:07:01 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 11:07:01 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 11:07:05 kjcf05n00 mcfcli[3673891]: %3|1730653625.436|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 11:07:31 kjcf05n00 mcfcli[3673891]: %3|1730653651.559|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:07:35 kjcf05n00 mcfcli[3673891]: %3|1730653655.437|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:07:52 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 3 11:08:01 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 3 11:08:05 kjcf05n00 mcfcli[3673891]: %3|1730653685.438|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:08:10 kjcf05n00 mcfcli[3673891]: %3|1730653690.643|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:08:21 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 3 11:08:21 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 3 11:08:34 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 3 11:08:34 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 3 11:08:35 kjcf05n00 mcfcli[3673891]: %3|1730653715.438|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:08:50 kjcf05n00 mcfcli[3673891]: %3|1730653730.640|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:09:05 kjcf05n00 mcfcli[3673891]: %3|1730653745.438|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:09:20 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 3 11:09:20 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 3 11:09:20 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 3 11:09:26 kjcf05n00 mcfcli[3673891]: %3|1730653766.670|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:09:35 kjcf05n00 mcfcli[3673891]: %3|1730653775.440|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 11:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 11:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 11:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 11:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 11:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 11:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 11:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 11:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 11:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 11:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 11:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 11:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 11:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 11:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 11:10:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 11:10:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:10:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 11:10:04 kjcf05n00 mcfcli[3673891]: %3|1730653804.850|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:10:05 kjcf05n00 mcfcli[3673891]: %3|1730653805.440|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:10:08 kjcf05n00 python3.9[1203519]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 11:10:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730653225', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 11:10:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730653225'} Nov 3 11:10:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:10:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730653225', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 11:10:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730653225'} Nov 3 11:10:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:10:35 kjcf05n00 mcfcli[3673891]: %3|1730653835.440|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 11:10:44 kjcf05n00 mcfcli[3673891]: %3|1730653844.003|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:11:05 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 3 11:11:05 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 3 11:11:05 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 3 11:11:05 kjcf05n00 mcfcli[3673891]: %3|1730653865.440|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 11:11:20 kjcf05n00 mcfcli[3673891]: %3|1730653880.943|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:11:35 kjcf05n00 mcfcli[3673891]: %3|1730653895.441|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 11:11:49 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 11:11:49 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 11:11:49 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 11:11:59 kjcf05n00 mcfcli[3673891]: %3|1730653919.184|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:12:05 kjcf05n00 mcfcli[3673891]: %3|1730653925.441|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 11:12:22 kjcf05n00 zabbix-server[1204958]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 11:12:22 kjcf05n00 zabbix-server[1204958]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 66.66\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 63.03\\"}}"' Nov 3 11:12:23 kjcf05n00 log_interesting_event.py[1204958]: Event '46141' acknowledged Nov 3 11:12:35 kjcf05n00 mcfcli[3673891]: %3|1730653955.441|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:12:37 kjcf05n00 mcfcli[3673891]: %3|1730653957.335|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:13:05 kjcf05n00 mcfcli[3673891]: %3|1730653985.442|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:13:13 kjcf05n00 mcfcli[3673891]: %3|1730653993.717|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T11:13:27.253340926-06:00 level=info msg="Completed cleanup jobs" duration=26.519647ms Nov 3 11:13:35 kjcf05n00 mcfcli[3673891]: %3|1730654015.442|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:13:38 kjcf05n02 root[42229]: failback_xyraid Nov 3 11:13:39 kjcf05n02 root[42358]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 11:13:40 kjcf05n02 root[42500]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 11:13:43 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 3 11:13:46 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme3n1 Nov 3 11:13:46 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme4n1 Nov 3 11:13:46 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme19n1 Nov 3 11:13:46 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme23n1 Nov 3 11:13:46 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme17n1 Nov 3 11:13:46 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme25n1 Nov 3 11:13:46 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme9n1 Nov 3 11:13:46 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme24n1 Nov 3 11:13:46 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme18n1 Nov 3 11:13:46 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme8n1 Nov 3 11:13:46 kjcf05n03 dwd[5194]: Drive path is missing, purging: nvme2n1 Nov 3 11:13:48 kjcf05n02 dwd[5152]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 11:13:48 kjcf05n02 dwd[5152]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 11:13:48 kjcf05n02 dwd[5152]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 11:13:48 kjcf05n02 dwd[5152]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 11:13:48 kjcf05n02 dwd[5152]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 11:13:48 kjcf05n02 dwd[5152]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 11:13:48 kjcf05n02 dwd[5152]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 11:13:48 kjcf05n02 dwd[5152]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 11:13:48 kjcf05n02 dwd[5152]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 11:13:48 kjcf05n02 dwd[5152]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 11:13:48 kjcf05n02 dwd[5152]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 11:13:48 kjcf05n02 dwd[5152]: Starting NVME thread for nvme2n1 Nov 3 11:13:48 kjcf05n02 dwd[5152]: Starting NVME thread for nvme18n1 Nov 3 11:13:49 kjcf05n02 dwd[5152]: Starting NVME thread for nvme19n1 Nov 3 11:13:49 kjcf05n02 dwd[5152]: Starting NVME thread for nvme9n1 Nov 3 11:13:49 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45209]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45210]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45213]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45209]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45210]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45213]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45209]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45210]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45213]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45210]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45209]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45213]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45229]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45210]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45213]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45209]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45231]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45233]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45238]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45229]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45210]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45209]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45213]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45231]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45238]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45210]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45229]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45209]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45213]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45231]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 dwd[5152]: Starting NVME thread for nvme3n1 Nov 3 11:13:49 kjcf05n02 systemd-udevd[45238]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45229]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45209]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45213]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45229]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45229]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45231]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45229]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45238]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45213]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45231]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45213]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45229]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45213]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45213]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45213]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45213]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45208]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45213]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45213]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 systemd-udevd[45213]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:13:49 kjcf05n02 dwd[5152]: Starting NVME thread for nvme24n1 Nov 3 11:13:49 kjcf05n02 nslcd[6903]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 11:13:50 kjcf05n02 dcs-bulk-data-sender[6159]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 3 11:13:50 kjcf05n02 dwd[5152]: Starting NVME thread for nvme4n1 Nov 3 11:13:50 kjcf05n02 dwd[5152]: Starting NVME thread for nvme23n1 Nov 3 11:13:50 kjcf05n02 dwd[5152]: Starting NVME thread for nvme17n1 Nov 3 11:13:50 kjcf05n02 dwd[5152]: Starting NVME thread for nvme25n1 Nov 3 11:13:50 kjcf05n02 dwd[5152]: Starting NVME thread for nvme8n1 Nov 3 11:13:51 kjcf05n00 mcfcli[3673891]: %3|1730654031.861|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:13:54 kjcf05n02 diskmonitor[17396]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 11:14:00 kjcf05n02 diskmonitor[17396]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 11:14:00 kjcf05n02 diskmonitor[17396]: Scan for ReadErrorMax change for md65 Nov 3 11:14:00 kjcf05n02 diskmonitor[17396]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 11:14:00 kjcf05n02 diskmonitor[17396]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 11:14:00 kjcf05n02 diskmonitor[17396]: read_saved_file: md65 no saved speed Nov 3 11:14:00 kjcf05n02 diskmonitor[17396]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 11:14:00 kjcf05n02 diskmonitor[17396]: Set sync_speed_min (10000) for md65 Nov 3 11:14:00 kjcf05n02 diskmonitor[17396]: Set sync_speed_max (200000) for md65 Nov 3 11:14:00 kjcf05n02 diskmonitor[17396]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 11:14:05 kjcf05n00 mcfcli[3673891]: %3|1730654045.442|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 11:14:18 kjcf05n03 diskmonitor[17376]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 11:14:18 kjcf05n03 diskmonitor[17376]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 11:14:27 kjcf05n00 mcfcli[3673891]: %3|1730654067.663|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:14:30 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 48208 (bash) Nov 3 11:14:30 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 11:14:30 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 11:14:35 kjcf05n00 mcfcli[3673891]: %3|1730654075.442|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 11:14:43 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 11:14:43 kjcf05n02 systemd-tmpfiles[49089]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 11:14:43 kjcf05n02 systemd-tmpfiles[49089]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 11:14:43 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 11:14:43 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 11:15:05 kjcf05n00 mcfcli[3673891]: %3|1730654105.398|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:15:05 kjcf05n00 mcfcli[3673891]: %3|1730654105.943|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:15:08 kjcf05n00 python3.9[1206496]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 11:15:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730654122', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 11:15:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730654122'} Nov 3 11:15:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:15:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730654122', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 11:15:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730654122'} Nov 3 11:15:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:15:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730654132}"] Nov 3 11:15:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654132, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:15:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.040351ms Nov 3 11:15:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.040351ms Nov 3 11:15:32 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:15:32 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:15:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:15:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730654132}"] Nov 3 11:15:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654132, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:15:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.930646ms Nov 3 11:15:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.930646ms Nov 3 11:15:32 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:15:32 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:15:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:15:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730654132}"] Nov 3 11:15:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654132, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:15:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.797006ms Nov 3 11:15:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.797006ms Nov 3 11:15:32 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:15:32 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:15:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:15:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730654132}"] Nov 3 11:15:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654132, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:15:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.761178ms Nov 3 11:15:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.761178ms Nov 3 11:15:32 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:15:32 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:15:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:15:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730654132}"] Nov 3 11:15:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654132, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:15:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.385126ms Nov 3 11:15:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.385126ms Nov 3 11:15:32 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:15:32 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:15:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:15:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730654132}"] Nov 3 11:15:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654132, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:15:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.699382ms Nov 3 11:15:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.699382ms Nov 3 11:15:32 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:15:32 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:15:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:15:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730654132}"] Nov 3 11:15:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654132, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:15:33 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:33-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:33 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:33-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:33 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:33-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:33 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:33-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:33 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:33-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:33 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:33-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:33 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:33-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.136161ms Nov 3 11:15:33 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:33-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.136161ms Nov 3 11:15:33 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:15:33 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:15:33 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:15:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730654132}"] Nov 3 11:15:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654132, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:15:33 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:33-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:33 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:33-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:33 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:33-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:33 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:33-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:33 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:33-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:33 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:33-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:33 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:33-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.946425ms Nov 3 11:15:33 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:33-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.946425ms Nov 3 11:15:33 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:15:33 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:15:33 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:15:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730654132}"] Nov 3 11:15:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654132, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:15:33 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:33-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:33 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:33-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:33 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:33-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:33 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:33-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:33 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:33-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:33 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:33-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:33 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:33-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.713369ms Nov 3 11:15:33 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:33-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.713369ms Nov 3 11:15:33 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:15:33 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:15:33 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:15:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730654132}"] Nov 3 11:15:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654132, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:15:33 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:33-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:33 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:33-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:33 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:33-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:33 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:33-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:33 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:33-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:33 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:33-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:33 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:33-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.997762ms Nov 3 11:15:33 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:33-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.997762ms Nov 3 11:15:33 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:15:33 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:15:33 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:15:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730654132}"] Nov 3 11:15:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654132, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:15:33 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:33-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:33 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:33-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:15:33 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:33-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:33 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:15:33-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:33 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:33-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:15:33 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:15:33-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:15:33 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:15:33-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.080837ms Nov 3 11:15:33 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:15:33-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.080837ms Nov 3 11:15:33 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:15:33 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:15:33 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:15:35 kjcf05n00 mcfcli[3673891]: %3|1730654135.944|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 11:15:45 kjcf05n00 mcfcli[3673891]: %3|1730654145.395|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:16:06 kjcf05n00 mcfcli[3673891]: %3|1730654166.215|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:16:25 kjcf05n00 mcfcli[3673891]: %3|1730654185.392|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:16:36 kjcf05n00 mcfcli[3673891]: %3|1730654196.215|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:17:04 kjcf05n00 mcfcli[3673891]: %3|1730654224.742|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:17:06 kjcf05n00 mcfcli[3673891]: %3|1730654226.215|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:17:36 kjcf05n00 mcfcli[3673891]: %3|1730654256.216|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:17:42 kjcf05n00 mcfcli[3673891]: %3|1730654262.083|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:18:06 kjcf05n00 mcfcli[3673891]: %3|1730654286.216|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 11:18:17 kjcf05n00 mcfcli[3673891]: %3|1730654297.599|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:18:36 kjcf05n00 mcfcli[3673891]: %3|1730654316.216|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:18:55 kjcf05n00 mcfcli[3673891]: %3|1730654335.938|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:19:03 kjcf05n02 dwd[5152]: nvme18n1 passed periodic SMART status check Nov 3 11:19:03 kjcf05n02 dwd[5152]: nvme2n1 passed periodic SMART status check Nov 3 11:19:04 kjcf05n02 dwd[5152]: nvme24n1 passed periodic SMART status check Nov 3 11:19:04 kjcf05n02 dwd[5152]: nvme19n1 passed periodic SMART status check Nov 3 11:19:04 kjcf05n02 dwd[5152]: nvme9n1 passed periodic SMART status check Nov 3 11:19:04 kjcf05n02 dwd[5152]: nvme3n1 passed periodic SMART status check Nov 3 11:19:05 kjcf05n02 dwd[5152]: nvme25n1 passed periodic SMART status check Nov 3 11:19:05 kjcf05n02 dwd[5152]: nvme23n1 passed periodic SMART status check Nov 3 11:19:05 kjcf05n02 dwd[5152]: nvme4n1 passed periodic SMART status check Nov 3 11:19:05 kjcf05n02 dwd[5152]: nvme8n1 passed periodic SMART status check Nov 3 11:19:05 kjcf05n02 dwd[5152]: nvme17n1 passed periodic SMART status check Nov 3 11:19:06 kjcf05n00 mcfcli[3673891]: %3|1730654346.217|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 11:19:33 kjcf05n00 mcfcli[3673891]: %3|1730654373.716|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:19:36 kjcf05n00 mcfcli[3673891]: %3|1730654376.217|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 11:19:46 kjcf05n00 zabbix-server[1209253]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 11:19:46 kjcf05n00 zabbix-server[1209253]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46143' Nov 3 11:19:46 kjcf05n00 zabbix-server[1209253]: Filesystem 'kjcf05' has been mounted Nov 3 11:19:47 kjcf05n00 zabbix-server[1209253]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 11:19:47 kjcf05n00 zabbix-server[1209253]: Running puppet on 'None' Nov 3 11:19:49 kjcf05n05 puppet-agent[3149361]: Using configured environment 'production' Nov 3 11:19:49 kjcf05n05 puppet-agent[3149361]: Retrieving pluginfacts Nov 3 11:19:49 kjcf05n05 puppet-agent[3149361]: Retrieving plugin Nov 3 11:19:49 kjcf05n06 puppet-agent[2992141]: Using configured environment 'production' Nov 3 11:19:49 kjcf05n06 puppet-agent[2992141]: Retrieving pluginfacts Nov 3 11:19:49 kjcf05n06 puppet-agent[2992141]: Retrieving plugin Nov 3 11:19:49 kjcf05n04 puppet-agent[2994656]: Using configured environment 'production' Nov 3 11:19:49 kjcf05n04 puppet-agent[2994656]: Retrieving pluginfacts Nov 3 11:19:49 kjcf05n04 puppet-agent[2994656]: Retrieving plugin Nov 3 11:19:49 kjcf05n03 puppet-agent[224784]: Using configured environment 'production' Nov 3 11:19:49 kjcf05n03 puppet-agent[224784]: Retrieving pluginfacts Nov 3 11:19:49 kjcf05n03 puppet-agent[224784]: Retrieving plugin Nov 3 11:19:49 kjcf05n07 puppet-agent[2990013]: Using configured environment 'production' Nov 3 11:19:49 kjcf05n07 puppet-agent[2990013]: Retrieving pluginfacts Nov 3 11:19:49 kjcf05n07 puppet-agent[2990013]: Retrieving plugin Nov 3 11:19:49 kjcf05n07 puppet-agent[2990013]: Loading facts Nov 3 11:19:49 kjcf05n02 puppet-agent[57932]: Using configured environment 'production' Nov 3 11:19:49 kjcf05n02 puppet-agent[57932]: Retrieving pluginfacts Nov 3 11:19:49 kjcf05n02 puppet-agent[57932]: Retrieving plugin Nov 3 11:19:49 kjcf05n05 puppet-agent[3149361]: Loading facts Nov 3 11:19:49 kjcf05n06 puppet-agent[2992141]: Loading facts Nov 3 11:19:49 kjcf05n04 puppet-agent[2994656]: Loading facts Nov 3 11:19:49 kjcf05n01 puppet-agent[3061714]: Using configured environment 'production' Nov 3 11:19:49 kjcf05n01 puppet-agent[3061714]: Retrieving pluginfacts Nov 3 11:19:49 kjcf05n01 puppet-agent[3061714]: Retrieving plugin Nov 3 11:19:49 kjcf05n01 puppet-agent[3061714]: Loading facts Nov 3 11:19:49 kjcf05n03 puppet-agent[224784]: Loading facts Nov 3 11:19:49 kjcf05n02 puppet-agent[57932]: Loading facts Nov 3 11:19:49 kjcf05n00 puppet-agent[1209316]: Using configured environment 'production' Nov 3 11:19:49 kjcf05n00 puppet-agent[1209316]: Retrieving pluginfacts Nov 3 11:19:49 kjcf05n00 puppet-agent[1209316]: Retrieving plugin Nov 3 11:19:50 kjcf05n00 puppet-agent[1209316]: Loading facts Nov 3 11:19:51 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 11:19:51 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 11:19:52 kjcf05n03 puppet-agent[224784]: Caching catalog for kjcf05n03 Nov 3 11:19:52 kjcf05n03 puppet-agent[224784]: Applying configuration version '1730654390' Nov 3 11:19:52 kjcf05n07 puppet-agent[2990013]: Caching catalog for kjcf05n07 Nov 3 11:19:52 kjcf05n07 puppet-agent[2990013]: Applying configuration version '1730654390' Nov 3 11:19:52 kjcf05n06 puppet-agent[2992141]: Caching catalog for kjcf05n06 Nov 3 11:19:52 kjcf05n06 puppet-agent[2992141]: Applying configuration version '1730654390' Nov 3 11:19:52 kjcf05n02 puppet-agent[57932]: Caching catalog for kjcf05n02 Nov 3 11:19:52 kjcf05n02 puppet-agent[57932]: Applying configuration version '1730654390' Nov 3 11:19:53 kjcf05n01 puppet-agent[3061714]: Caching catalog for kjcf05n01 Nov 3 11:19:53 kjcf05n01 puppet-agent[3061714]: Applying configuration version '1730654391' Nov 3 11:19:53 kjcf05n00 puppet-agent[1209316]: Caching catalog for kjcf05n00 Nov 3 11:19:53 kjcf05n00 puppet-agent[1209316]: Applying configuration version '1730654391' Nov 3 11:19:54 kjcf05n03 puppet-agent[224784]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 11:19:54 kjcf05n03 puppet-agent[224784]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 11:19:54 kjcf05n03 puppet-agent[224784]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 11:19:54 kjcf05n07 puppet-agent[2990013]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 11:19:54 kjcf05n07 puppet-agent[2990013]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 11:19:54 kjcf05n07 puppet-agent[2990013]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 11:19:54 kjcf05n02 puppet-agent[57932]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 11:19:54 kjcf05n02 puppet-agent[57932]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 11:19:54 kjcf05n02 puppet-agent[57932]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 11:19:54 kjcf05n06 puppet-agent[2992141]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 11:19:54 kjcf05n06 puppet-agent[2992141]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 11:19:54 kjcf05n06 puppet-agent[2992141]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 11:19:54 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 11:19:54 kjcf05n03 zabbix_agent2[161398]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 11:19:54 kjcf05n03 zabbix_agent2[3192]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:19:54 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 11:19:54 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 11:19:54 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 11:19:54 kjcf05n03 puppet-agent[224784]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: Press Ctrl+C to exit. Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: Plugin support version 1.0 Nov 3 11:19:54 kjcf05n03 zabbix_agent2[225129]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 11:19:55 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2928787]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 11:19:55 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 11:19:55 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 11:19:55 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 11:19:55 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 11:19:55 kjcf05n07 puppet-agent[2990013]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: Press Ctrl+C to exit. Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: Plugin support version 1.0 Nov 3 11:19:55 kjcf05n07 zabbix_agent2[2990436]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 11:19:55 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2932499]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 11:19:55 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 11:19:55 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 11:19:55 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 11:19:55 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 11:19:55 kjcf05n06 puppet-agent[2992141]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: Press Ctrl+C to exit. Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: Plugin support version 1.0 Nov 3 11:19:55 kjcf05n06 zabbix_agent2[2993323]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 11:19:55 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 11:19:55 kjcf05n02 zabbix_agent2[5957]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 11:19:55 kjcf05n02 zabbix_agent2[3127]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:19:55 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 11:19:55 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 11:19:55 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 11:19:55 kjcf05n02 puppet-agent[57932]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: Press Ctrl+C to exit. Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: Plugin support version 1.0 Nov 3 11:19:55 kjcf05n02 zabbix_agent2[58263]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 11:19:56 kjcf05n01 puppet-agent[3061714]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 11:19:56 kjcf05n01 puppet-agent[3061714]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-10:55:42]/mode) mode changed '0755' to '0750' Nov 3 11:19:56 kjcf05n01 puppet-agent[3061714]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-10:55:42/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 11:19:56 kjcf05n01 puppet-agent[3061714]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-10:55:42/vmcore]/mode) mode changed '0600' to '0640' Nov 3 11:19:56 kjcf05n01 puppet-agent[3061714]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-10:55:42/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 11:19:56 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 11:19:56 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 11:19:56 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 11:19:56 kjcf05n00 puppet-agent[1209316]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 11:19:56 kjcf05n03 puppet-agent[224784]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 11:19:56 kjcf05n03 puppet-agent[224784]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 11:19:56 kjcf05n03 puppet-agent[224784]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 11:19:56 kjcf05n07 puppet-agent[2990013]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 11:19:56 kjcf05n07 puppet-agent[2990013]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 11:19:56 kjcf05n07 puppet-agent[2990013]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 11:19:56 kjcf05n06 puppet-agent[2992141]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 11:19:56 kjcf05n06 puppet-agent[2992141]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 11:19:56 kjcf05n06 puppet-agent[2992141]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 11:19:56 kjcf05n06 puppet-agent[2992141]: Applied catalog in 4.73 seconds Nov 3 11:19:57 kjcf05n03 puppet-agent[224784]: Applied catalog in 5.01 seconds Nov 3 11:19:57 kjcf05n07 puppet-agent[2990013]: Applied catalog in 4.86 seconds Nov 3 11:19:57 kjcf05n05 puppet-agent[3149361]: Caching catalog for kjcf05n05 Nov 3 11:19:57 kjcf05n05 puppet-agent[3149361]: Applying configuration version '1730654395' Nov 3 11:19:57 kjcf05n01 puppet-agent[3061714]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 11:19:57 kjcf05n01 puppet-agent[3061714]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 11:19:57 kjcf05n01 puppet-agent[3061714]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 11:19:57 kjcf05n02 puppet-agent[57932]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 11:19:57 kjcf05n02 puppet-agent[57932]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 11:19:57 kjcf05n02 puppet-agent[57932]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 11:19:57 kjcf05n02 puppet-agent[57932]: Applied catalog in 5.31 seconds Nov 3 11:19:57 kjcf05n00 puppet-agent[1209316]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 11:19:57 kjcf05n00 puppet-agent[1209316]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 11:19:57 kjcf05n00 puppet-agent[1209316]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 11:19:58 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3048081]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 11:19:58 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 11:19:58 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 11:19:58 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 11:19:58 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 11:19:58 kjcf05n01 puppet-agent[3061714]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: Press Ctrl+C to exit. Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: Plugin support version 1.0 Nov 3 11:19:58 kjcf05n01 zabbix_agent2[3062180]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 11:19:58 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1188304]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 11:19:58 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 11:19:58 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 11:19:58 kjcf05n00 zabbix_server[15769]: Zabbix agent item "vfs.file.contents["/sys/class/net/pub2/operstate"]" on host "kjcf05n00" failed: first network error, wait for 15 seconds Nov 3 11:19:58 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 11:19:58 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 11:19:58 kjcf05n00 puppet-agent[1209316]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: Press Ctrl+C to exit. Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: Plugin support version 1.0 Nov 3 11:19:58 kjcf05n00 zabbix_agent2[1209766]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 11:19:58 kjcf05n00 zabbix-server[1209791]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 11:19:58 kjcf05n00 zabbix-server[1209792]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 11:19:59 kjcf05n05 puppet-agent[3149361]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 11:19:59 kjcf05n05 puppet-agent[3149361]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 11:19:59 kjcf05n05 puppet-agent[3149361]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 11:19:59 kjcf05n00 zabbix-server[1209802]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 11:19:59 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 11:19:59 kjcf05n00 zabbix-server[1209810]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 11:20:00 kjcf05n01 puppet-agent[3061714]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_110303.log]/mode) mode changed '0644' to '0640' Nov 3 11:20:00 kjcf05n01 puppet-agent[3061714]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_111430.log]/mode) mode changed '0644' to '0640' Nov 3 11:20:00 kjcf05n01 puppet-agent[3061714]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_111431]/mode) mode changed '0755' to '0750' Nov 3 11:20:00 kjcf05n01 puppet-agent[3061714]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_111431/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 11:20:00 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3082611]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 11:20:00 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 11:20:00 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 11:20:00 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 11:20:00 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 11:20:00 kjcf05n05 puppet-agent[3149361]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: Press Ctrl+C to exit. Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: Plugin support version 1.0 Nov 3 11:20:00 kjcf05n05 zabbix_agent2[3150003]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 11:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 11:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 11:19:59 kjcf05n00 puppet-agent[1209316]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 11:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 11:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 11:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 11:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 11:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 11:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 11:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 11:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 11:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 11:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 11:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 11:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 11:20:00 kjcf05n01 puppet-agent[3061714]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_110303.log]/mode) mode changed '0644' to '0640' Nov 3 11:20:00 kjcf05n01 puppet-agent[3061714]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_111430.log]/mode) mode changed '0644' to '0640' Nov 3 11:20:00 kjcf05n01 puppet-agent[3061714]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 11:20:00 kjcf05n01 puppet-agent[3061714]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 11:20:00 kjcf05n01 puppet-agent[3061714]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 11:20:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 11:20:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:20:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 11:20:00 kjcf05n00 puppet-agent[1209316]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 11:20:00 kjcf05n00 puppet-agent[1209316]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 11:20:00 kjcf05n00 puppet-agent[1209316]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 11:20:01 kjcf05n05 puppet-agent[3149361]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 11:20:01 kjcf05n05 puppet-agent[3149361]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 11:20:01 kjcf05n05 puppet-agent[3149361]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 11:20:01 kjcf05n05 puppet-agent[3149361]: Applied catalog in 4.77 seconds Nov 3 11:20:02 kjcf05n01 puppet-agent[3061714]: Applied catalog in 8.67 seconds Nov 3 11:20:01 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 11:20:02 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 11:20:01 kjcf05n00 puppet-agent[1209316]: Applied catalog in 8.42 seconds Nov 3 11:20:06 kjcf05n00 mcfcli[3673891]: %3|1730654406.448|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:20:08 kjcf05n00 python3.9[1209988]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 11:20:11 kjcf05n00 mcfcli[3673891]: %3|1730654411.147|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:20:15 kjcf05n00 zabbix_server[15783]: resuming Zabbix agent checks on host "kjcf05n00": connection restored Nov 3 11:20:36 kjcf05n00 mcfcli[3673891]: %3|1730654436.448|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 11:20:40 kjcf05n04 puppet-agent[2994656]: Caching catalog for kjcf05n04 Nov 3 11:20:40 kjcf05n04 puppet-agent[2994656]: Applying configuration version '1730654439' Nov 3 11:20:43 kjcf05n04 puppet-agent[2994656]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 11:20:43 kjcf05n04 puppet-agent[2994656]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 11:20:43 kjcf05n04 puppet-agent[2994656]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 11:20:43 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2929874]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 11:20:43 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 11:20:43 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 11:20:43 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 11:20:43 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 11:20:43 kjcf05n04 puppet-agent[2994656]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: Press Ctrl+C to exit. Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: Plugin support version 1.0 Nov 3 11:20:43 kjcf05n04 zabbix_agent2[2996425]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 11:20:45 kjcf05n04 puppet-agent[2994656]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 11:20:45 kjcf05n04 puppet-agent[2994656]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 11:20:45 kjcf05n04 puppet-agent[2994656]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 11:20:45 kjcf05n04 puppet-agent[2994656]: Applied catalog in 4.71 seconds Nov 3 11:20:45 kjcf05n00 zabbix-server[1209253]: puppet completed status:(0): '' Nov 3 11:20:45 kjcf05n00 zabbix-server[1209253]: Event '46143' acknowledged Nov 3 11:20:45 kjcf05n00 zabbix-server[1209253]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 3 11:20:45 kjcf05n00 zabbix-server[1210595]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 11:20:45 kjcf05n00 zabbix-server[1210595]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 64.43\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 87.73\\"}}"' Nov 3 11:20:45 kjcf05n00 log_interesting_event.py[1210595]: Event '46144' acknowledged Nov 3 11:20:49 kjcf05n00 mcfcli[3673891]: %3|1730654449.029|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:21:06 kjcf05n00 mcfcli[3673891]: %3|1730654466.448|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:21:28 kjcf05n00 mcfcli[3673891]: %3|1730654488.408|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:21:36 kjcf05n00 mcfcli[3673891]: %3|1730654496.448|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 11:22:06 kjcf05n00 mcfcli[3673891]: %3|1730654526.448|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 11:22:07 kjcf05n00 mcfcli[3673891]: %3|1730654527.159|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:22:36 kjcf05n00 mcfcli[3673891]: %3|1730654556.449|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 11:22:42 kjcf05n00 mcfcli[3673891]: %3|1730654562.854|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:23:06 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 11:23:06 kjcf05n00 mcfcli[3673891]: %3|1730654586.449|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:23:13 kjcf05n03 nslcd[7088]: [0e0f76] ldap_result() failed: Can't contact LDAP server Nov 3 11:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T17:23:15.867518Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 11:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T17:23:15.867614Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.115ms Nov 3 11:23:22 kjcf05n00 mcfcli[3673891]: %3|1730654602.851|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T11:23:27.254161896-06:00 level=info msg="Completed cleanup jobs" duration=27.633346ms Nov 3 11:23:36 kjcf05n00 mcfcli[3673891]: %3|1730654616.449|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:23:59 kjcf05n00 mcfcli[3673891]: %3|1730654639.149|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:24:06 kjcf05n00 mcfcli[3673891]: %3|1730654646.449|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 11:24:10 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 3 11:24:10 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 11 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007582 sec, idle for 1 hour(s)] Nov 3 11:24:36 kjcf05n00 mcfcli[3673891]: %3|1730654676.451|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:24:39 kjcf05n00 mcfcli[3673891]: %3|1730654679.146|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:25:06 kjcf05n00 mcfcli[3673891]: %3|1730654706.451|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:25:08 kjcf05n00 python3.9[1212918]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 11:25:19 kjcf05n00 mcfcli[3673891]: %3|1730654719.143|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:25:36 kjcf05n00 zabbix_server[15728]: Zabbix agent item "system.cpu.util[,interrupt]" on host "kjcf05n03" failed: first network error, wait for 15 seconds Nov 3 11:25:36 kjcf05n00 mcfcli[3673891]: %3|1730654736.451|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 11:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 11:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 11:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 11:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 11:25:42 kjcf05n02 fstonithd.py[15099]: My partner 172.16.2.6 is kdumping. Forcing HA into GATHER state. Nov 3 11:25:42 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 11:25:42 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 11:25:42 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 11:25:43 kjcf05n02 root[68372]: is_enc_ipmi_off starts Nov 3 11:25:43 kjcf05n02 root[68373]: is_viking_off starts Nov 3 11:25:43 kjcf05n02 root[68407]: is_lan_ipmi_sec_off leaves Nov 3 11:25:43 kjcf05n02 root[68409]: is_lan_ipmi_off leaves Nov 3 11:25:43 kjcf05n02 root[68417]: I am in slot 0; partner is in slot 1 Nov 3 11:25:43 kjcf05n02 root[68421]: I am not master; I will get master Nov 3 11:25:49 kjcf05n02 root[68548]: I am now master Nov 3 11:25:50 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='30', error='Connection reset by peer (104)' Nov 3 11:25:50 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='30', client='AF_INET(172.16.2.6:45913)', local='AF_INET(0.0.0.0:601)' Nov 3 11:25:51 kjcf05n00 zabbix_server[15783]: Zabbix agent item "xrtx.enclosure.discovery" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 11:25:52 kjcf05n00 zabbix_server[15762]: Zabbix agent item "system.uptime" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 11:25:53 kjcf05n02 root[68723]: is_viking_off leaves Nov 3 11:25:53 kjcf05n02 root[68726]: kjcf05n03 not already off look at kdump Nov 3 11:25:53 kjcf05n02 root[68727]: is_kdump_off starts Nov 3 11:25:53 kjcf05n02 fence_kdump[68728]: waiting for message from '172.16.2.6' Nov 3 11:25:53 kjcf05n00 zabbix_server[15729]: Zabbix agent item "system.users.num" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 11:25:53 kjcf05n00 mcfcli[3673891]: %3|1730654753.544|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:25:54 kjcf05n02 fence_kdump[68728]: received valid message from '172.16.2.6' Nov 3 11:25:54 kjcf05n02 root[68729]: is_kdump_off detected kdump on kjcf05n03 Nov 3 11:25:54 kjcf05n02 root[68730]: kjcf05n03 is kdumping Nov 3 11:25:54 kjcf05n02 root[68830]: is_enc_ipmi_off starts Nov 3 11:25:54 kjcf05n02 root[68831]: is_viking_off starts Nov 3 11:25:54 kjcf05n02 root[68848]: is_lan_ipmi_off leaves Nov 3 11:25:54 kjcf05n02 root[68850]: is_lan_ipmi_sec_off leaves Nov 3 11:25:54 kjcf05n02 root[68853]: I am master Nov 3 11:25:54 kjcf05n02 root[68856]: I am in slot 0; partner is in slot 1 Nov 3 11:25:55 kjcf05n00 zabbix_server[15781]: Zabbix agent item "vm.memory.size[available]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 11:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 11:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 11:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 11:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 11:25:57 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 11:25:57 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 11:26:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 11:26:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 11:26:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 11:26:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 11:26:01 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib0 Nov 3 11:26:01 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib0 Nov 3 11:26:05 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib1 Nov 3 11:26:05 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib1 Nov 3 11:26:06 kjcf05n00 mcfcli[3673891]: %3|1730654766.451|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 11:26:07 kjcf05n02 root[69145]: is_viking_off leaves Nov 3 11:26:07 kjcf05n02 root[69150]: kjcf05n03 not already off look at kdump Nov 3 11:26:07 kjcf05n02 root[69151]: is_kdump_off starts Nov 3 11:26:07 kjcf05n02 fence_kdump[69153]: waiting for message from '172.16.2.6' Nov 3 11:26:08 kjcf05n02 fence_kdump[69153]: received valid message from '172.16.2.6' Nov 3 11:26:08 kjcf05n02 root[69190]: is_kdump_off detected kdump on kjcf05n03 Nov 3 11:26:08 kjcf05n02 root[69192]: kjcf05n03 is kdumping Nov 3 11:26:10 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vfs.fs.size[/var/lib/pacemaker,used]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 11:26:12 kjcf05n02 dwd[5152]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 11:26:12 kjcf05n02 dwd[5152]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 11:26:12 kjcf05n02 dwd[5152]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 11:26:12 kjcf05n02 dwd[5152]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 11:26:12 kjcf05n02 dwd[5152]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 11:26:12 kjcf05n02 dwd[5152]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 11:26:12 kjcf05n02 dwd[5152]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 11:26:12 kjcf05n02 dwd[5152]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 11:26:12 kjcf05n02 dwd[5152]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 11:26:12 kjcf05n02 dwd[5152]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 11:26:12 kjcf05n02 dwd[5152]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 11:26:12 kjcf05n02 dwd[5152]: Starting NVME thread for nvme16n1 Nov 3 11:26:13 kjcf05n02 systemd-udevd[71563]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71564]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71566]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71563]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71569]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71564]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71566]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71563]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71569]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71564]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71566]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71563]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71569]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71564]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71566]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71563]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71569]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71566]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71564]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71563]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71569]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71564]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71566]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71569]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71563]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71564]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71566]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71569]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71563]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71566]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71564]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71563]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71599]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71569]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71601]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71604]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71566]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71599]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71563]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71604]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71566]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71599]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71604]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71566]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71599]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71566]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71564]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71566]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71564]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71566]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71564]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71566]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71564]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71566]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71566]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71564]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71566]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71564]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71566]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71564]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71566]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71564]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71564]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 systemd-udevd[71564]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:26:13 kjcf05n02 dwd[5152]: Starting NVME thread for nvme22n1 Nov 3 11:26:13 kjcf05n02 dwd[5152]: Starting NVME thread for nvme15n1 Nov 3 11:26:13 kjcf05n02 dwd[5152]: Starting NVME thread for nvme6n1 Nov 3 11:26:13 kjcf05n02 dwd[5152]: Starting NVME thread for nvme11n1 Nov 3 11:26:13 kjcf05n02 dwd[5152]: Starting NVME thread for nvme7n1 Nov 3 11:26:13 kjcf05n02 dwd[5152]: Starting NVME thread for nvme10n1 Nov 3 11:26:13 kjcf05n02 dwd[5152]: Starting NVME thread for nvme20n1 Nov 3 11:26:13 kjcf05n02 dwd[5152]: Starting NVME thread for nvme21n1 Nov 3 11:26:14 kjcf05n02 dwd[5152]: Starting NVME thread for nvme5n1 Nov 3 11:26:14 kjcf05n02 dwd[5152]: Starting NVME thread for nvme12n1 Nov 3 11:26:24 kjcf05n02 diskmonitor[17396]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 11:26:25 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n03": interface unavailable Nov 3 11:26:29 kjcf05n00 mcfcli[3673891]: %3|1730654789.284|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:26:33 kjcf05n02 diskmonitor[17396]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 11:26:33 kjcf05n02 diskmonitor[17396]: Scan for ReadErrorMax change for md66 Nov 3 11:26:33 kjcf05n02 diskmonitor[17396]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 11:26:33 kjcf05n02 diskmonitor[17396]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 11:26:33 kjcf05n02 diskmonitor[17396]: read_saved_file: md66 no saved speed Nov 3 11:26:33 kjcf05n02 diskmonitor[17396]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 11:26:33 kjcf05n02 diskmonitor[17396]: Set sync_speed_min (10000) for md66 Nov 3 11:26:33 kjcf05n02 diskmonitor[17396]: Set sync_speed_max (200000) for md66 Nov 3 11:26:33 kjcf05n02 diskmonitor[17396]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 11:26:36 kjcf05n00 mcfcli[3673891]: %3|1730654796.451|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 11:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 11:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 11:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 11:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 11:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 11:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 11:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 11:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 11:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 11:27:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 11:27:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 11:27:01 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib0 Nov 3 11:27:01 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib0 Nov 3 11:27:05 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib1 Nov 3 11:27:05 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib1 Nov 3 11:27:06 kjcf05n00 mcfcli[3673891]: %3|1730654826.452|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:27:07 kjcf05n00 mcfcli[3673891]: %3|1730654827.032|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:27:12 kjcf05n02 nslcd[6903]: (re)loading /etc/nsswitch.conf Nov 3 11:27:12 kjcf05n02 nslcd[6903]: [b0dc51] ldap_result() failed: Can't contact LDAP server Nov 3 11:27:36 kjcf05n00 mcfcli[3673891]: %3|1730654856.952|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 11:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 11:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 11:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 11:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 11:27:44 kjcf05n00 mcfcli[3673891]: %3|1730654864.667|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 11:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 11:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 11:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 11:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 11:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 11:28:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 11:28:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 11:28:01 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib0 Nov 3 11:28:01 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib0 Nov 3 11:28:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730654882}"] Nov 3 11:28:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654882, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:28:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.126924ms Nov 3 11:28:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.126924ms Nov 3 11:28:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:28:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:28:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:28:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730654882}"] Nov 3 11:28:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654882, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:28:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.830388ms Nov 3 11:28:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.830388ms Nov 3 11:28:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:28:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:28:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:28:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730654882}"] Nov 3 11:28:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654882, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:28:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.94347ms Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.94347ms Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:28:03 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:28:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:28:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730654882}"] Nov 3 11:28:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654882, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:28:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.066461ms Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.066461ms Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:28:03 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:28:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:28:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730654882}"] Nov 3 11:28:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654882, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:28:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.010406ms Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.010406ms Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:28:03 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:28:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:28:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730654882}"] Nov 3 11:28:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654882, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:28:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.22654ms Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.22654ms Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:28:03 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:28:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:28:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730654882}"] Nov 3 11:28:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654882, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:28:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.894969ms Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.894969ms Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:28:03 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:28:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:28:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730654882}"] Nov 3 11:28:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654882, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:28:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.127455ms Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.127455ms Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:28:03 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:28:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:28:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730654882}"] Nov 3 11:28:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654882, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:28:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.046864ms Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.046864ms Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:28:03 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:28:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:28:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730654882}"] Nov 3 11:28:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654882, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:28:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.172729ms Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.172729ms Nov 3 11:28:03 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:28:03 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:28:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:28:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730654882}"] Nov 3 11:28:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730654882, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:28:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:28:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:28:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:28:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:28:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:28:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:28:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.144236ms Nov 3 11:28:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:28:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.144236ms Nov 3 11:28:04 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:28:04 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:28:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:28:05 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib1 Nov 3 11:28:05 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib1 Nov 3 11:28:06 kjcf05n00 mcfcli[3673891]: %3|1730654886.952|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:28:24 kjcf05n00 mcfcli[3673891]: %3|1730654904.664|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:28:32 kjcf05n00 zabbix-server[1215142]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 11:28:32 kjcf05n00 zabbix-server[1215142]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n03:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 11:28:32 kjcf05n00 log_interesting_event.py[1215142]: Event '46146' acknowledged Nov 3 11:28:36 kjcf05n00 mcfcli[3673891]: %3|1730654916.952|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 11:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 11:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 11:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 11:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 11:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 11:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 11:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 11:29:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 11:29:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 11:29:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 11:29:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 11:29:01 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib0 Nov 3 11:29:01 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib0 Nov 3 11:29:03 kjcf05n00 mcfcli[3673891]: %3|1730654943.546|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:29:05 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib1 Nov 3 11:29:05 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib1 Nov 3 11:29:06 kjcf05n00 mcfcli[3673891]: %3|1730654946.954|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:29:30 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:9a:1a Nov 3 11:29:30 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 11:29:34 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 11:29:34 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a kjcf05n03 Nov 3 11:29:34 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.6 Nov 3 11:29:34 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 11:29:34 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 11:29:34 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.6 Nov 3 11:29:34 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/pxelinux.cfg to 172.16.2.6 Nov 3 11:29:37 kjcf05n00 mcfcli[3673891]: %3|1730654977.222|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 11:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 11:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 11:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 11:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 11:29:38 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/vmlinuz_diskless to 172.16.2.6 Nov 3 11:29:40 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/initramfs-diskless.img to 172.16.2.6 Nov 3 11:29:43 kjcf05n00 mcfcli[3673891]: %3|1730654983.448|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 11:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 11:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 11:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 11:30:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 11:30:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 11:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 11:30:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 11:30:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 11:30:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 11:30:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:30:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 11:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 11:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 11:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 11:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 11:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 11:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 11:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 11:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 11:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 11:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 11:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 11:30:01 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib0 Nov 3 11:30:01 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib0 Nov 3 11:30:05 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib1 Nov 3 11:30:05 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib1 Nov 3 11:30:07 kjcf05n00 mcfcli[3673891]: %3|1730655007.222|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 11:30:23 kjcf05n00 mcfcli[3673891]: %3|1730655023.447|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 1ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:30:25 kjcf05n00 python3.9[1216165]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 11:30:28 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:36766). Nov 3 11:30:28 kjcf05n01 rsyncd[3066329]: connect from kjcf05n03 (172.16.2.6) Nov 3 11:30:28 kjcf05n01 rsyncd[3066329]: rsync on puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 11:30:28 kjcf05n01 rsyncd[3066329]: building file list Nov 3 11:30:28 kjcf05n01 rsyncd[3066329]: sent 11446 bytes received 136 bytes total size 10901 Nov 3 11:30:28 kjcf05n01 systemd[1]: rsyncd@623-172.16.2.2:873-172.16.2.6:36766.service: Succeeded. Nov 3 11:30:37 kjcf05n00 mcfcli[3673891]: %3|1730655037.222|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 11:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 11:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 11:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 11:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 11:30:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730655037', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 11:30:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730655037'} Nov 3 11:30:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:30:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730655037', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 11:30:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730655037'} Nov 3 11:30:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:30:42 kjcf05n02 fstonithd.py[15099]: Listening for kdump packets from partner Nov 3 11:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 11:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 11:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 11:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 11:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 11:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 11:31:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 11:31:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 11:31:01 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib0 Nov 3 11:31:01 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib0 Nov 3 11:31:03 kjcf05n00 mcfcli[3673891]: %3|1730655063.050|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:31:05 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib1 Nov 3 11:31:05 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib1 Nov 3 11:31:07 kjcf05n00 mcfcli[3673891]: %3|1730655067.455|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 11:31:20 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 11:31:27 kjcf05n02 dwd[5152]: nvme16n1 passed periodic SMART status check Nov 3 11:31:27 kjcf05n02 dwd[5152]: nvme6n1 passed periodic SMART status check Nov 3 11:31:27 kjcf05n02 dwd[5152]: nvme22n1 passed periodic SMART status check Nov 3 11:31:27 kjcf05n02 dwd[5152]: nvme15n1 passed periodic SMART status check Nov 3 11:31:28 kjcf05n02 dwd[5152]: nvme21n1 passed periodic SMART status check Nov 3 11:31:28 kjcf05n02 dwd[5152]: nvme5n1 passed periodic SMART status check Nov 3 11:31:28 kjcf05n02 dwd[5152]: nvme20n1 passed periodic SMART status check Nov 3 11:31:28 kjcf05n02 dwd[5152]: nvme11n1 passed periodic SMART status check Nov 3 11:31:28 kjcf05n02 dwd[5152]: nvme10n1 passed periodic SMART status check Nov 3 11:31:28 kjcf05n02 dwd[5152]: nvme7n1 passed periodic SMART status check Nov 3 11:31:29 kjcf05n02 dwd[5152]: nvme12n1 passed periodic SMART status check Nov 3 11:31:35 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 11:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 11:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 11:31:37 kjcf05n00 mcfcli[3673891]: %3|1730655097.455|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:31:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 11:31:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 11:31:41 kjcf05n00 mcfcli[3673891]: %3|1730655101.537|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:31:52 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='39', client='AF_INET(172.16.2.6:36605)', local='AF_INET(0.0.0.0:601)' Nov 3 11:31:52 kjcf05n03 syslog-ng[3161]: Configuration reload request received, reloading configuration; Nov 3 11:31:52 kjcf05n03 syslog-ng[3161]: Configuration reload finished; Nov 3 11:31:52 kjcf05n03 syslog-ng[3161]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 11:31:52 kjcf05n03 dracut: dracut-049-135.git20210121.el8 Nov 3 11:31:52 kjcf05n03 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 11:31:52 kjcf05n03 dracut: Loading and integrity checking all crypto modules Nov 3 11:31:52 kjcf05n03 dracut: Self testing crypto algorithms Nov 3 11:31:52 kjcf05n03 dracut: rd.md=0: removing MD RAID activation Nov 3 11:31:52 kjcf05n03 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 11:31:52 kjcf05n03 Copying live image to RAM... Nov 3 11:31:52 kjcf05n03 (this may take a minute) Nov 3 11:31:52 kjcf05n03 Done copying live image to RAM. Nov 3 11:31:52 kjcf05n03 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 11:31:52 kjcf05n03 dracut: Checking integrity of kernel Nov 3 11:31:52 kjcf05n03 dracut: All initrd crypto checks done Nov 3 11:31:52 kjcf05n03 dracut: Switching root Nov 3 11:31:52 kjcf05n03 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 11:31:52 kjcf05n03 systemd: Detected architecture x86-64. Nov 3 11:31:52 kjcf05n03 systemd: Set hostname to . Nov 3 11:31:52 kjcf05n03 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 11:31:52 kjcf05n03 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 11:31:52 kjcf05n03 systemd: Listening on Journal Socket (/dev/log). Nov 3 11:31:52 kjcf05n03 systemd: Created slice User and Session Slice. Nov 3 11:31:52 kjcf05n03 systemd: Started Forward Password Requests to Wall Directory Watch. Nov 3 11:31:52 kjcf05n03 systemd: Created slice system-getty.slice. Nov 3 11:31:52 kjcf05n03 systemd: Reached target Slices. Nov 3 11:31:52 kjcf05n03 systemd-journald[1537]: Journal started Nov 3 11:31:52 kjcf05n03 systemd-journald[1537]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 11:31:52 kjcf05n03 systemd-modules-load[1528]: Inserted module 'fuse' Nov 3 11:31:52 kjcf05n03 systemd[1]: Mounted /WIBS. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Remount Root and Kernel File Systems. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Load Kernel Modules. Nov 3 11:31:52 kjcf05n03 systemd[1]: Mounted /data. Nov 3 11:31:52 kjcf05n03 systemd[1]: Mounted /mnt. Nov 3 11:31:52 kjcf05n03 systemd[1]: Mounted Temporary Directory (/tmp). Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 3 11:31:52 kjcf05n03 systemd[1]: Mounted Kernel Debug File System. Nov 3 11:31:52 kjcf05n03 systemd[1]: Mounted POSIX Message Queue File System. Nov 3 11:31:52 kjcf05n03 systemd[1]: Mounted Huge Pages File System. Nov 3 11:31:52 kjcf05n03 systemd[1]: Mounting FUSE Control File System... Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Apply Kernel Variables... Nov 3 11:31:52 kjcf05n03 systemd[1]: Mounting Kernel Configuration File System... Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Rebuild Hardware Database... Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Create System Users... Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Load/Save Random Seed... Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 11:31:52 kjcf05n03 systemd[1]: Mounted FUSE Control File System. Nov 3 11:31:52 kjcf05n03 systemd[1]: Mounted Kernel Configuration File System. Nov 3 11:31:52 kjcf05n03 systemd-sysctl[1554]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 11:31:52 kjcf05n03 systemd-sysctl[1554]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Apply Kernel Variables. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Create System Users. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Load/Save Random Seed. Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 11:31:52 kjcf05n03 systemd-journald[1537]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 11:31:52 kjcf05n03 systemd-tmpfiles[1565]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 11:31:52 kjcf05n03 systemd-tmpfiles[1565]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started udev Coldplug all Devices. Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Rebuild Hardware Database. Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting udev Kernel Device Manager... Nov 3 11:31:52 kjcf05n03 systemd-udevd[1573]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started udev Kernel Device Manager. Nov 3 11:31:52 kjcf05n03 systemd[1]: Found device /dev/ttyS0. Nov 3 11:31:52 kjcf05n03 systemd-udevd[1582]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:31:52 kjcf05n03 systemd-udevd[1593]: Using default interface naming scheme 'rhel-8.0'. Nov 3 11:31:52 kjcf05n03 systemd-udevd[1593]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:31:52 kjcf05n03 systemd-udevd[1636]: Using default interface naming scheme 'rhel-8.0'. Nov 3 11:31:52 kjcf05n03 systemd-udevd[1636]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:31:52 kjcf05n03 systemd-udevd[1595]: Using default interface naming scheme 'rhel-8.0'. Nov 3 11:31:52 kjcf05n03 systemd-udevd[1595]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 11:31:52 kjcf05n03 systemd[1]: Reached target Local File Systems (Pre). Nov 3 11:31:52 kjcf05n03 systemd[1]: Reached target Local File Systems. Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 11:31:52 kjcf05n03 root[1790]: openibd: running in auto mode Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 11:31:52 kjcf05n03 systemd-tmpfiles[1802]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 11:31:52 kjcf05n03 systemd-tmpfiles[1802]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 11:31:52 kjcf05n03 systemd-tmpfiles[1802]: "/var/tmp" already exists and is not a directory. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Rebuild Journal Catalog. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Create Volatile Files and Directories. Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting RPC Bind... Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 11:31:52 kjcf05n03 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 11:31:52 kjcf05n03 systemd[1]: Started RPC Bind. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started RDMA Node Description Daemon. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 11:31:52 kjcf05n03 systemd-modules-load[1869]: Inserted module 'ib_iser' Nov 3 11:31:52 kjcf05n03 systemd-modules-load[1869]: Inserted module 'ib_isert' Nov 3 11:31:52 kjcf05n03 systemd-modules-load[1869]: Inserted module 'ib_srpt' Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 11:31:52 kjcf05n03 systemd-udevd[1587]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:31:52 kjcf05n03 systemd-udevd[1610]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:31:52 kjcf05n03 systemd-modules-load[1874]: Inserted module 'ib_ipoib' Nov 3 11:31:52 kjcf05n03 systemd-modules-load[1869]: Inserted module 'rdma_ucm' Nov 3 11:31:52 kjcf05n03 systemd-modules-load[1869]: Module 'svcrdma' is blacklisted Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 11:31:52 kjcf05n03 systemd-udevd[1587]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 11:31:52 kjcf05n03 systemd-udevd[1610]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 11:31:52 kjcf05n03 systemd-modules-load[1874]: Inserted module 'ib_umad' Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 11:31:52 kjcf05n03 systemd[1]: Reached target RDMA Hardware. Nov 3 11:31:52 kjcf05n03 systemd[1]: Reached target Network (Pre). Nov 3 11:31:52 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 11:31:52 kjcf05n03 systemd[3161]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:31:52 kjcf05n03 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 11:31:52 kjcf05n03 openibd[1776]: Loading HCA driver and Access Layer:[ OK ] Nov 3 11:31:52 kjcf05n03 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Update is Completed... Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Update is Completed. Nov 3 11:31:52 kjcf05n03 setup-icl[1770]: Setting LAN IP Address to 203.0.113.4 Nov 3 11:31:52 kjcf05n03 setup-icl[1770]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 11:31:52 kjcf05n03 setup-icl[1770]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 11:31:52 kjcf05n03 setup-icl[1770]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 11:31:52 kjcf05n03 systemd-udevd[1587]: Using default interface naming scheme 'rhel-8.0'. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 11:31:52 kjcf05n03 systemd[1]: Reached target System Initialization. Nov 3 11:31:52 kjcf05n03 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 11:31:52 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 11:31:52 kjcf05n03 systemd[1]: Listening on lldpad.socket. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 11:31:52 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 11:31:52 kjcf05n03 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 11:31:52 kjcf05n03 systemd[1]: Reached target Sockets. Nov 3 11:31:52 kjcf05n03 systemd[1]: Reached target Basic System. Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 11:31:52 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 0 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 1 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 2 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 3 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 4 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 5 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 6 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 7 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 8 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 9 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 10 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 11 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 12 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 13 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 14 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 15 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 16 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 17 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 18 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 19 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 20 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 21 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 22 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 23 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 24 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 25 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 26 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 27 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 28 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 29 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 30 Nov 3 11:31:52 kjcf05n03 cpupower[2097]: Setting cpu: 31 Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[2094]: Setting up Mellanox network interface: ib1 Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Resets System Activity Logs... Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 11:31:52 kjcf05n03 dwd[2098]: dwd: vMay 29 2024 : 15:38:26 Nov 3 11:31:52 kjcf05n03 dwd[2098]: dwd: option Lethal: 0 Nov 3 11:31:52 kjcf05n03 dwd[2098]: dwd: option Interval: 60 Nov 3 11:31:52 kjcf05n03 dwd[2098]: dwd: option abrtlimit: 10 Nov 3 11:31:52 kjcf05n03 dwd[2098]: dwd: option DZPeriod: 604800 Nov 3 11:31:52 kjcf05n03 dwd[2098]: dwd: option SmartPeriod: 43200 Nov 3 11:31:52 kjcf05n03 dwd[2098]: dwd: option SDDEnabled: 1 Nov 3 11:31:52 kjcf05n03 dwd[2098]: dwd: option SDDAwaitScale: 3 Nov 3 11:31:52 kjcf05n03 dwd[2098]: dwd: option SDDAwaitMin: 100 Nov 3 11:31:52 kjcf05n03 dwd[2098]: dwd: option Verbosity: 1 Nov 3 11:31:52 kjcf05n03 dwd[2098]: dwd: option StandAlone: 0 Nov 3 11:31:52 kjcf05n03 dwd[2098]: /usr/sbin/dwd -d --standalone=0 Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 11:31:52 kjcf05n03 dwd[2098]: option Lethal: 0 Nov 3 11:31:52 kjcf05n03 dwd[2098]: option Interval: 60 Nov 3 11:31:52 kjcf05n03 dwd[2098]: option abrtlimit: 10 Nov 3 11:31:52 kjcf05n03 dwd[2098]: option DZPeriod: 604800 Nov 3 11:31:52 kjcf05n03 dwd[2098]: option SmartPeriod: 43200 Nov 3 11:31:52 kjcf05n03 dwd[2098]: option SDDEnabled: 1 Nov 3 11:31:52 kjcf05n03 dwd[2098]: option SDDAwaitScale: 3 Nov 3 11:31:52 kjcf05n03 dwd[2098]: option SDDAwaitMin: 100 Nov 3 11:31:52 kjcf05n03 dwd[2098]: option Verbosity: 1 Nov 3 11:31:52 kjcf05n03 dwd[2098]: option StandAlone: 0 Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 11:31:52 kjcf05n03 network[2127]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 11:31:52 kjcf05n03 chronyd[2167]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 11:31:52 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 11:31:52 kjcf05n03 beSetMlxConfig[2136]: ConnectX-3 multiport not detected Nov 3 11:31:52 kjcf05n03 network[2165]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 11:31:52 kjcf05n03 network[2127]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started D-Bus System Message Bus. Nov 3 11:31:52 kjcf05n03 mcelog[2183]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 11:31:52 kjcf05n03 mcelog[2183]: CPU is unsupported Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[2168]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Name Service Cache Daemon... Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[2182]: Setting up Mellanox network interface: ib0 Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 11:31:52 kjcf05n03 network[2186]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:31:52 kjcf05n03 network[2127]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 11:31:52 kjcf05n03 nscd[2227]: 2227 monitoring file `/etc/hosts` (1) Nov 3 11:31:52 kjcf05n03 nscd[2227]: 2227 monitoring directory `/etc` (2) Nov 3 11:31:52 kjcf05n03 nscd[2227]: 2227 monitoring file `/etc/resolv.conf` (3) Nov 3 11:31:52 kjcf05n03 nscd[2227]: 2227 monitoring directory `/etc` (2) Nov 3 11:31:52 kjcf05n03 systemd[1]: Started irqbalance daemon. Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[2200]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 11:31:52 kjcf05n03 network[2223]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 11:31:52 kjcf05n03 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 11:31:52 kjcf05n03 dbus-daemon[2187]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 11:31:52 kjcf05n03 beSetMlxConfig[2136]: Starting MST (Mellanox Software Tools) driver set Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 0 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 1 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 2 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 3 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 4 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 5 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 6 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 7 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 8 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 9 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 10 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 11 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 12 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 13 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 14 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 15 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 16 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 17 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 18 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 19 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 20 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 21 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 22 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 23 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 24 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 25 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 26 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 27 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 28 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 29 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 30 Nov 3 11:31:52 kjcf05n03 cpupower[2264]: Idlestate 2 disabled on CPU 31 Nov 3 11:31:52 kjcf05n03 mdraid-phy[2245]: no Cutlass to worry about Nov 3 11:31:52 kjcf05n03 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[2246]: No configuration found for ib1 Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[2247]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Resets System Activity Logs. Nov 3 11:31:52 kjcf05n03 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 11:31:52 kjcf05n03 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Name Service Cache Daemon. Nov 3 11:31:52 kjcf05n03 chronyd[2167]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 11:31:52 kjcf05n03 chronyd[2167]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Manage Cutlass PHYs. Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[2277]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 11:31:52 kjcf05n03 beSetMlxConfig[2136]: Loading MST PCI module - Success Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[2285]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[2293]: No configuration found for ib0 Nov 3 11:31:52 kjcf05n03 beSetMlxConfig[2136]: Loading MST PCI configuration module - Success Nov 3 11:31:52 kjcf05n03 beSetMlxConfig[2136]: Create devices Nov 3 11:31:52 kjcf05n03 mlnx_conf_mgr[2312]: INFO: No configurations found for mlx5_1, skipping. Nov 3 11:31:52 kjcf05n03 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 11:31:52 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 11:31:52 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[2318]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 11:31:52 kjcf05n03 mlnx_conf_mgr[2374]: INFO: No configurations found for mlx5_0, skipping. Nov 3 11:31:52 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 11:31:52 kjcf05n03 sssd[sssd][2214]: Starting up Nov 3 11:31:52 kjcf05n03 sssd[be[implicit_files]][2424]: Starting up Nov 3 11:31:52 kjcf05n03 sssd[nss][2513]: Starting up Nov 3 11:31:52 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 11:31:52 kjcf05n03 systemd[1]: Reached target User and Group Name Lookups. Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Login Service... Nov 3 11:31:52 kjcf05n03 systemd-logind[2622]: New seat seat0. Nov 3 11:31:52 kjcf05n03 systemd-logind[2622]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Login Service. Nov 3 11:31:52 kjcf05n03 python3.9[2189]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 11:31:52 kjcf05n03 python3.9[3161]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 11:31:52 kjcf05n03 systemd-sysctl[2744]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 11:31:52 kjcf05n03 systemd-sysctl[2744]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 11:31:52 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 11:31:52 kjcf05n03 python3.9[2917]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 11:31:52 kjcf05n03 python3.9[3161]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 11:31:52 kjcf05n03 network[2127]: Bringing up loopback interface: [ OK ] Nov 3 11:31:52 kjcf05n03 systemd-sysctl[3082]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 11:31:52 kjcf05n03 systemd-sysctl[3082]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 11:31:52 kjcf05n03 systemd[1]: Started LSB: Bring up/down networking. Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 11:31:52 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 11:31:52 kjcf05n03 systemd[1]: Reached target Network. Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 11:31:52 kjcf05n03 systemd[1]: Reached target Network is Online. Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting System Logger Daemon... Nov 3 11:31:52 kjcf05n03 sm-notify[3151]: Version 2.3.3 starting Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 11:31:52 kjcf05n03 python3.9[3117]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 11:31:52 kjcf05n03 python3.9[3161]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Notify NFS peers of a restart. Nov 3 11:31:52 kjcf05n03 sshd[3136]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 11:31:52 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 11:31:52 kjcf05n03 systemd[1]: Reached target NFS client services. Nov 3 11:31:52 kjcf05n03 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 11:31:52 kjcf05n03 systemd[1]: Reached target Remote File Systems. Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Permit User Sessions... Nov 3 11:31:52 kjcf05n03 lldpad[3137]: setsockopt nearest_bridge: Invalid argument Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Permit User Sessions. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Getty on tty1. Nov 3 11:31:52 kjcf05n03 lldpad[3137]: setsockopt nearest_bridge: Invalid argument Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Serial Getty on ttyS0. Nov 3 11:31:52 kjcf05n03 systemd[1]: Reached target Login Prompts. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 11:31:52 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 11:31:52 kjcf05n03 beSetMlxConfig[2136]: Unloading MST PCI module (unused) - Success Nov 3 11:31:52 kjcf05n03 syslog-ng[3161]: [2024-11-03T17:30:40.257786] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 11:31:52 kjcf05n03 syslog-ng[3161]: [2024-11-03T17:30:40.258068] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 11:31:52 kjcf05n03 syslog-ng[3161]: [2024-11-03T17:30:40.258105] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 11:31:52 kjcf05n03 syslog-ng[3161]: [2024-11-03T17:30:40.258687] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 11:31:52 kjcf05n03 syslog-ng[3161]: [2024-11-03T17:30:40.258979] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 11:31:52 kjcf05n03 systemd[1]: Started System Logger Daemon. Nov 3 11:31:52 kjcf05n03 python3.9[3185]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 11:31:52 kjcf05n03 python3.9[3161]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 11:31:52 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 11:31:52 kjcf05n03 python3.9[3409]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 11:31:52 kjcf05n03 python3.9[3161]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 11:31:52 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 11:31:52 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 11:31:52 kjcf05n03 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 11:31:52 kjcf05n03 chronyd[2167]: System's initial offset : 0.006746 seconds slow of true (slew) Nov 3 11:31:52 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 11:31:52 kjcf05n03 beSetMlxConfig[2136]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 11:31:52 kjcf05n03 beSetMlxConfig[2136]: ib mode Nov 3 11:31:52 kjcf05n03 beSetMlxConfig[2136]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 11:31:52 kjcf05n03 root[3432]: openibd: Set node_desc for mlx5_0: kjcf05n03 HCA-1 Nov 3 11:31:52 kjcf05n03 root[3434]: openibd: Set node_desc for mlx5_1: kjcf05n03 HCA-2 Nov 3 11:31:52 kjcf05n03 beSetMlxConfig[2136]: ib mode Nov 3 11:31:52 kjcf05n03 systemd-udevd[1573]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 11:31:52 kjcf05n03 systemd-udevd[3446]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:31:52 kjcf05n03 systemd-udevd[3447]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:31:52 kjcf05n03 systemd-udevd[3450]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:31:52 kjcf05n03 systemd-udevd[3451]: Using default interface naming scheme 'rhel-8.0'. Nov 3 11:31:52 kjcf05n03 systemd-udevd[3451]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:31:52 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 11:31:52 kjcf05n03 systemd[3161]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:31:52 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[3488]: Setting up Mellanox network interface: ib1 Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[3489]: Setting up Mellanox network interface: ib0 Nov 3 11:31:52 kjcf05n03 systemd-udevd[3448]: Using default interface naming scheme 'rhel-8.0'. Nov 3 11:31:52 kjcf05n03 systemd-udevd[3449]: Using default interface naming scheme 'rhel-8.0'. Nov 3 11:31:52 kjcf05n03 systemd-udevd[3448]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:31:52 kjcf05n03 systemd-udevd[3449]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Puppet agent... Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[3538]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[3539]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[3569]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[3570]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[3571]: No configuration found for ib1 Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[3572]: No configuration found for ib0 Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[3579]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[3580]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 11:31:52 kjcf05n03 mlnx_conf_mgr[3617]: INFO: No configurations found for mlx5_1, skipping. Nov 3 11:31:52 kjcf05n03 mlnx_conf_mgr[3620]: INFO: No configurations found for mlx5_0, skipping. Nov 3 11:31:52 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 11:31:52 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 11:31:52 kjcf05n03 systemd[1]: Stopping Command Scheduler... Nov 3 11:31:52 kjcf05n03 systemd[1]: crond.service: Succeeded. Nov 3 11:31:52 kjcf05n03 systemd[1]: Stopped Command Scheduler. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 11:31:52 kjcf05n03 systemd[1]: Stopping Job spooling tools... Nov 3 11:31:52 kjcf05n03 systemd[1]: atd.service: Succeeded. Nov 3 11:31:52 kjcf05n03 systemd[1]: Stopped Job spooling tools. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 11:31:52 kjcf05n03 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 11:31:52 kjcf05n03 lldpad[3137]: init_ports: Error adding device ib0 Nov 3 11:31:52 kjcf05n03 lldpad[3137]: init_ports: Error adding device ib1 Nov 3 11:31:52 kjcf05n03 lldpad[3137]: Signal 15 received - terminating Nov 3 11:31:52 kjcf05n03 systemd[1]: lldpad.service: Succeeded. Nov 3 11:31:52 kjcf05n03 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 11:31:52 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 11:31:52 kjcf05n03 systemd[1]: lldpad.socket: Succeeded. Nov 3 11:31:52 kjcf05n03 systemd[1]: Closed lldpad.socket. Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 11:31:52 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting IPMI Driver... Nov 3 11:31:52 kjcf05n03 systemd[1]: Started IPMI Driver. Nov 3 11:31:52 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:52 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:31:52 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Ipmievd Daemon... Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 1 | Nov-03-2024 | 15:30:35 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 2 | Nov-03-2024 | 15:31:26 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 3 | Nov-03-2024 | 15:31:26 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 4 | Nov-03-2024 | 15:32:32 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 5 | Nov-03-2024 | 15:32:32 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 6 | Nov-03-2024 | 17:27:58 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 7 | Nov-03-2024 | 17:27:58 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 8 | Nov-03-2024 | 17:27:58 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 9 | Nov-03-2024 | 17:27:58 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 10 | Nov-03-2024 | 17:27:58 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 11 | Nov-03-2024 | 17:27:58 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 12 | Nov-03-2024 | 17:27:58 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 13 | Nov-03-2024 | 17:27:58 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 14 | Nov-03-2024 | 17:27:58 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 15 | Nov-03-2024 | 17:27:58 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 16 | Nov-03-2024 | 17:27:58 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 17 | Nov-03-2024 | 17:27:58 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 18 | Nov-03-2024 | 17:28:28 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 19 | Nov-03-2024 | 17:28:28 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 20 | Nov-03-2024 | 17:28:28 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 21 | Nov-03-2024 | 17:28:28 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 22 | Nov-03-2024 | 17:28:28 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 23 | Nov-03-2024 | 17:28:28 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 24 | Nov-03-2024 | 17:28:28 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 25 | Nov-03-2024 | 17:28:28 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 26 | Nov-03-2024 | 17:28:28 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 27 | Nov-03-2024 | 17:28:28 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 28 | Nov-03-2024 | 17:28:28 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 29 | Nov-03-2024 | 17:28:28 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 30 | Nov-03-2024 | 17:28:28 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 31 | Nov-03-2024 | 17:28:28 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 32 | Nov-03-2024 | 17:28:28 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 33 | Nov-03-2024 | 17:28:28 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 34 | Nov-03-2024 | 17:28:28 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 35 | Nov-03-2024 | 17:28:28 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 36 | Nov-03-2024 | 17:28:28 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 37 | Nov-03-2024 | 17:28:28 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 38 | Nov-03-2024 | 17:28:28 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 39 | Nov-03-2024 | 17:28:28 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 40 | Nov-03-2024 | 17:28:29 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 41 | Nov-03-2024 | 17:28:29 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 42 | Nov-03-2024 | 17:28:30 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 43 | Nov-03-2024 | 17:28:30 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 44 | Nov-03-2024 | 17:28:30 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 45 | Nov-03-2024 | 17:28:30 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 46 | Nov-03-2024 | 17:28:30 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 47 | Nov-03-2024 | 17:28:30 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 48 | Nov-03-2024 | 17:28:30 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3964]: 49 | Nov-03-2024 | 17:28:30 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 11:31:52 kjcf05n03 ipmievd[3967]: Reading sensors... Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Ipmievd Daemon. Nov 3 11:31:52 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:52 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 11:31:52 kjcf05n03 nscd[2227]: 2227 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 11:31:52 kjcf05n03 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 11:31:52 kjcf05n03 systemd[1]: Stopped Set Mellanox configuration. Nov 3 11:31:52 kjcf05n03 systemd[1]: Stopping Set Mellanox configuration... Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 11:31:52 kjcf05n03 beSetMlxConfig[4024]: ConnectX-3 multiport not detected Nov 3 11:31:52 kjcf05n03 beSetMlxConfig[4024]: Starting MST (Mellanox Software Tools) driver set Nov 3 11:31:52 kjcf05n03 beSetMlxConfig[4024]: Loading MST PCI module - Success Nov 3 11:31:52 kjcf05n03 systemd-udevd[1573]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 11:31:52 kjcf05n03 beSetMlxConfig[4024]: [warn] mst_pciconf is already loaded, skipping Nov 3 11:31:52 kjcf05n03 beSetMlxConfig[4024]: Create devices Nov 3 11:31:52 kjcf05n03 beSetMlxConfig[4024]: Unloading MST PCI module (unused) - Success Nov 3 11:31:52 kjcf05n03 ipmievd[3967]: Waiting for events... Nov 3 11:31:52 kjcf05n03 beSetMlxConfig[4024]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 11:31:52 kjcf05n03 beSetMlxConfig[4024]: ib mode Nov 3 11:31:52 kjcf05n03 beSetMlxConfig[4024]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 11:31:52 kjcf05n03 beSetMlxConfig[4024]: ib mode Nov 3 11:31:52 kjcf05n03 systemd-udevd[1573]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 11:31:52 kjcf05n03 systemd-udevd[4924]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:31:52 kjcf05n03 systemd-udevd[4925]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:31:52 kjcf05n03 systemd-udevd[4928]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:31:52 kjcf05n03 systemd-udevd[4931]: Using default interface naming scheme 'rhel-8.0'. Nov 3 11:31:52 kjcf05n03 systemd-udevd[4931]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:31:52 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 11:31:52 kjcf05n03 systemd[3161]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:31:52 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[4966]: Setting up Mellanox network interface: ib1 Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[4967]: Setting up Mellanox network interface: ib0 Nov 3 11:31:52 kjcf05n03 systemd-udevd[4926]: Using default interface naming scheme 'rhel-8.0'. Nov 3 11:31:52 kjcf05n03 systemd-udevd[4927]: Using default interface naming scheme 'rhel-8.0'. Nov 3 11:31:52 kjcf05n03 systemd-udevd[4926]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:31:52 kjcf05n03 systemd-udevd[4927]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[5017]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[5020]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[5047]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[5048]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[5049]: No configuration found for ib0 Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[5050]: No configuration found for ib1 Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[5057]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 11:31:52 kjcf05n03 mlnx_interface_mgr[5058]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 11:31:52 kjcf05n03 mlnx_conf_mgr[5097]: INFO: No configurations found for mlx5_0, skipping. Nov 3 11:31:52 kjcf05n03 mlnx_conf_mgr[5098]: INFO: No configurations found for mlx5_1, skipping. Nov 3 11:31:52 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 11:31:52 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}3cd719190669f10f2b332ff3a3dcc23afc1e3ddf7654033768e71bf6d08ef27e' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}3cd719190669f10f2b332ff3a3dcc23afc1e3ddf7654033768e71bf6d08ef27e' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}07109f36b2d0c6b1036da23df2a1c57c7e35027f991cd30575824299a434a20a' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}07109f36b2d0c6b1036da23df2a1c57c7e35027f991cd30575824299a434a20a' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}5f9852d7cdc9910418255296c0bcd1d51a4b82384b81f98b0a94ed20cb5e420e' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}5f9852d7cdc9910418255296c0bcd1d51a4b82384b81f98b0a94ed20cb5e420e' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}ce0bb777d0c048f748d6bfdb2552f1305fd13ea61ae8d7a0797671e5597d9d21' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}ce0bb777d0c048f748d6bfdb2552f1305fd13ea61ae8d7a0797671e5597d9d21' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 11:31:52 kjcf05n03 systemd[1]: Stopping NTP client/server... Nov 3 11:31:52 kjcf05n03 chronyd[2167]: chronyd exiting Nov 3 11:31:52 kjcf05n03 systemd[1]: chronyd.service: Succeeded. Nov 3 11:31:52 kjcf05n03 systemd[1]: Stopped NTP client/server. Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 11:31:52 kjcf05n03 chronyd[5133]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 11:31:52 kjcf05n03 chronyd[5133]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 11:31:52 kjcf05n03 chronyd[5133]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 11:31:52 kjcf05n03 chronyd[5133]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 11:31:52 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 11:31:52 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:52 kjcf05n03 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 11:31:52 kjcf05n03 systemd[1]: dwd.service: Succeeded. Nov 3 11:31:52 kjcf05n03 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 11:31:52 kjcf05n03 dwd[5165]: dwd: vMay 29 2024 : 15:38:26 Nov 3 11:31:52 kjcf05n03 dwd[5165]: /usr/sbin/dwd -i 15 -d Nov 3 11:31:52 kjcf05n03 dwd[5165]: dwd: option Lethal: 0 Nov 3 11:31:52 kjcf05n03 dwd[5165]: dwd: option Interval: 15 Nov 3 11:31:52 kjcf05n03 dwd[5165]: dwd: option abrtlimit: 10 Nov 3 11:31:52 kjcf05n03 dwd[5165]: dwd: option DZPeriod: 604800 Nov 3 11:31:52 kjcf05n03 dwd[5165]: dwd: option SmartPeriod: 43200 Nov 3 11:31:52 kjcf05n03 dwd[5165]: dwd: option SDDEnabled: 1 Nov 3 11:31:52 kjcf05n03 dwd[5165]: dwd: option SDDAwaitScale: 3 Nov 3 11:31:52 kjcf05n03 dwd[5165]: dwd: option SDDAwaitMin: 100 Nov 3 11:31:52 kjcf05n03 dwd[5165]: dwd: option Verbosity: 1 Nov 3 11:31:52 kjcf05n03 dwd[5165]: dwd: option StandAlone: 0 Nov 3 11:31:52 kjcf05n03 dwd[5165]: option Lethal: 0 Nov 3 11:31:52 kjcf05n03 dwd[5165]: option Interval: 15 Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 11:31:52 kjcf05n03 dwd[5165]: option abrtlimit: 10 Nov 3 11:31:52 kjcf05n03 dwd[5165]: option DZPeriod: 604800 Nov 3 11:31:52 kjcf05n03 dwd[5165]: option SmartPeriod: 43200 Nov 3 11:31:52 kjcf05n03 dwd[5165]: option SDDEnabled: 1 Nov 3 11:31:52 kjcf05n03 dwd[5165]: option SDDAwaitScale: 3 Nov 3 11:31:52 kjcf05n03 dwd[5165]: option SDDAwaitMin: 100 Nov 3 11:31:52 kjcf05n03 dwd[5165]: option Verbosity: 1 Nov 3 11:31:52 kjcf05n03 dwd[5165]: option StandAlone: 0 Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 11:31:52 kjcf05n03 dwd[5166]: option Lethal now set to 1 Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 11:31:52 kjcf05n03 dwd[5166]: option abrtlimit now set to 1 Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 11:31:52 kjcf05n03 dwd[5166]: option SmartPeriod now set to 86400 Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 11:31:52 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 11:31:52 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Discard unused blocks. Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:31:52 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:52 kjcf05n03 python3.9[5196]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 11:31:52 kjcf05n03 python3.9[3161]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 11:31:52 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Periodic ZFS scrub. Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:31:52 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 11:31:52 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:52 kjcf05n03 systemd[1]: Starting Sed Control Plane worker process... Nov 3 11:31:52 kjcf05n03 sedcpwrkr[5335]: Using config script: /etc/sedcpwrkr.conf Nov 3 11:31:52 kjcf05n03 sedcpwrkr[5335]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 11:31:52 kjcf05n03 sedcpwrkr[5335]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 11:31:52 kjcf05n03 sedcpwrkr[5335]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 11:31:52 kjcf05n03 sedcpwrkr[5335]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 11:31:52 kjcf05n03 sedcpwrkr[5335]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 11:31:52 kjcf05n03 sedcpwrkr[5335]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 11:31:52 kjcf05n03 sedcpwrkr-server[5366]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 11:31:52 kjcf05n03 sedcpwrkr[5335]: celery multi v5.2.7 (dawn-chorus) Nov 3 11:31:52 kjcf05n03 sedcpwrkr[5335]: > Starting nodes... Nov 3 11:31:52 kjcf05n03 sedcpwrkr[5335]: > sedcpwrkr@kjcf05n03: OK Nov 3 11:31:52 kjcf05n03 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 11:31:52 kjcf05n03 sedcpwrkr-server[5368]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 11:31:52 kjcf05n03 sedcpwrkr-server[5368]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 11:31:52 kjcf05n03 sedcpwrkr-server[5368]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 11:31:52 kjcf05n03 systemd[1]: Started Sed Control Plane worker process. Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 11:31:52 kjcf05n03 systemd[1]: Reloading System Logger Daemon. Nov 3 11:31:52 kjcf05n03 systemd[1]: Reloaded System Logger Daemon. Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 11:31:52 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 11:31:52 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 11:31:52 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:53 kjcf05n03 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 11:31:53 kjcf05n03 systemd-udevd[1573]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 11:31:53 kjcf05n03 iptables.init[5435]: iptables: Applying firewall rules: [ OK ] Nov 3 11:31:53 kjcf05n03 systemd[1]: Started IPv4 firewall with iptables. Nov 3 11:31:53 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:53 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:31:53 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:31:53 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:31:53 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 11:31:53 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 11:31:53 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 11:31:53 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 11:31:53 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 11:31:53 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 11:31:53 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 11:31:53 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 11:31:53 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 11:31:53 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 11:31:54 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 11:31:54 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 11:31:54 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 11:31:54 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 11:31:54 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 11:31:54 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 11:31:54 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 11:31:54 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 11:31:54 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 11:31:54 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 11:31:54 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 11:31:54 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 11:31:54 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 11:31:54 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 11:31:54 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 11:31:54 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 11:31:54 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 11:31:54 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 11:31:54 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 11:31:54 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 11:31:54 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 11:31:54 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 11:31:54 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 11:31:54 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 11:31:54 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 11:31:54 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 11:31:54 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 11:31:54 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 11:31:54 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 11:31:54 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 11:31:54 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 11:31:54 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 11:31:54 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 11:31:54 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 11:31:54 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 11:31:54 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 11:31:54 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 11:31:54 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 11:31:54 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 11:31:54 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 11:31:54 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:54 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 11:31:54 kjcf05n03 systemd[1]: openhpid.service: Supervising process 5532 which is not our child. We'll most likely not notice when it exits. Nov 3 11:31:54 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 11:31:54 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:55 kjcf05n03 openhpid[5532]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 11:31:55 kjcf05n03 openhpid[5532]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 11:31:55 kjcf05n03 openhpid[5532]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 11:31:55 kjcf05n03 openhpid[5532]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 11:31:55 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:55 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:31:55 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:31:55 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 11:31:55 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 11:31:55 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 11:31:55 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 11:31:55 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 11:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 11:31:55 kjcf05n03 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 11:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 11:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 11:31:56 kjcf05n03 dcs-collectord[5623]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 11:31:56 kjcf05n03 hpi.inv.log[5623]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 11:31:56 kjcf05n03 dcs-collectord[5623]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 11:31:56 kjcf05n03 dcs-collectord[5623]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 11:31:56 kjcf05n03 dcs-collector[5614]: Starting dcs-collector:[ OK ] Nov 3 11:31:56 kjcf05n03 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 11:31:56 kjcf05n03 dcs-collectord[5626]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 11:31:56 kjcf05n03 dcs-collectord[5626]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 11:31:56 kjcf05n03 dcs-collectord[5626]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 11:31:56 kjcf05n03 dcs-collectord[5626]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 11:31:56 kjcf05n03 dcs-collectord[5626]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 11:31:56 kjcf05n03 dcs-collectord[5626]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 11:31:56 kjcf05n03 dcs-collectord[5626]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 11:31:56 kjcf05n03 dcs-collectord[5626]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259347124", "units": "kB"}, {"name": "MemAvailable", "value": "258627264", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821328", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686836", "units": "kB"}, {"name": "Inactive", "value": "960676", "units": "kB"}, {"name": "Active(anon)", "value": "1520672", "units": "kB"}, {"name": "Inactive(anon)", "value": "824512", "units": "kB"}, {"name": "Active(file)", "value": "166164", "units": "kB"}, {"name": "Inactive(file)", "value": "136164", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "751828", "units": "kB"}, {"name": "Mapped", "value": "86052", "units": "kB"}, {"name": "Shmem", "value": "1593452", "units": "kB"}, {"name": "KReclaimable", "value": "109776", "units": "kB"}, {"name": "Slab", "value": "275548", "units": "kB"}, {"name": "SReclaimable", "value": "109776", "units": "kB"}, {"name": "SUnreclaim", "value": "165772", "units": "kB"}, {"name": "KernelStack", "value": "9728", "units": "kB"}, {"name": "PageTables", "value": "18996", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3205388", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11264", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "2048", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "278856", "units": "kB"}, {"name": "DirectMap2M", "value": "23703552", "units": "kB"}, {"name": "DirectMap1G", "value": "244318208", "units": "kB"}]}' Nov 3 11:31:56 kjcf05n03 dcs-collectord[5626]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 11:31:56 kjcf05n03 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 11:31:56 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:56 kjcf05n03 dcs-collectord[5626]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 11:31:56 kjcf05n03 dcs-collectord[5626]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730655115.991672], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730655116.2368274], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730655115.9214509, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 11:31:56 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:56 kjcf05n03 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 11:31:56 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:31:56 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:31:56 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 11:31:56 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 11:31:56 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 11:31:56 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 11:31:56 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:56 kjcf05n03 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 11:31:57 kjcf05n03 firmware-update-orc[5732]: Using config script: /etc/firmware_update_orc.conf Nov 3 11:31:57 kjcf05n03 firmware-update-orc[5732]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 11:31:57 kjcf05n03 firmware-update-orc[5732]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 11:31:57 kjcf05n03 firmware-update-orc[5732]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 11:31:57 kjcf05n03 firmware-update-orc[5732]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 11:31:57 kjcf05n03 firmware-update-orc[5732]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 11:31:57 kjcf05n03 firmware-update-orc[5732]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 11:31:57 kjcf05n03 firmware-update-orc-server[5770]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 11:31:57 kjcf05n03 firmware-update-orc[5732]: celery multi v5.2.7 (dawn-chorus) Nov 3 11:31:57 kjcf05n03 firmware-update-orc[5732]: > Starting nodes... Nov 3 11:31:57 kjcf05n03 firmware-update-orc[5732]: > worker1@kjcf05n03: OK Nov 3 11:31:57 kjcf05n03 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 11:31:57 kjcf05n03 firmware-update-orc-server[5772]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 11:31:57 kjcf05n03 firmware-update-orc-server[5772]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 11:31:57 kjcf05n03 firmware-update-orc-server[5772]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 11:31:57 kjcf05n03 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 11:31:57 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:58 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:31:58 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:31:58 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:31:58 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 11:31:58 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 11:31:58 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 11:31:58 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 11:31:58 kjcf05n03 dbus-daemon[2187]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 11:31:58 kjcf05n03 dbus-daemon[2187]: [system] Reloaded configuration Nov 3 11:31:58 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 11:31:58 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 11:31:58 kjcf05n03 dbus-daemon[2187]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 11:31:58 kjcf05n03 dbus-daemon[2187]: [system] Reloaded configuration Nov 3 11:31:58 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 11:31:58 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 11:31:58 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 11:31:58 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 11:31:58 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:58 kjcf05n03 systemd[1]: Starting Manages hardware resources... Nov 3 11:31:59 kjcf05n03 ras-resource-manager-agent[5888]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 11:31:59 kjcf05n03 ras-resource-manager-agent[5874]: Starting ras-resource-manager-agent:[ OK ] Nov 3 11:31:59 kjcf05n03 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 11:31:59 kjcf05n03 ras-resource-manager-agent[5890]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 11:31:59 kjcf05n03 ras-resource-manager-client[5890]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 11:31:59 kjcf05n03 systemd[1]: Started Manages hardware resources. Nov 3 11:31:59 kjcf05n03 ras-resource-manager-client[5890]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 11:31:59 kjcf05n03 ras-resource-manager-client[5900]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 11:31:59 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:59 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:31:59 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:31:59 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:31:59 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 11:31:59 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 11:31:59 kjcf05n03 systemd[1]: Reloading. Nov 3 11:31:59 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 11:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 11:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 11:32:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 11:32:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 11:32:00 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:00 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: Press Ctrl+C to exit. Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: Plugin support version 1.0 Nov 3 11:32:00 kjcf05n03 zabbix_agent2[5974]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 11:32:00 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:32:00 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:32:00 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:00 kjcf05n03 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 11:32:00 kjcf05n03 dcs-notification-sender[6049]: dcs-notification-senderd is stopped Nov 3 11:32:00 kjcf05n03 zabbix-agent2[6067]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 11:32:00 kjcf05n03 dcs-notification-sender[6049]: Starting notification-sender:[ OK ] Nov 3 11:32:00 kjcf05n03 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 11:32:01 kjcf05n03 zabbix-agent2[6069]: INFO DCS notification agent started. (agent.py:61) Nov 3 11:32:01 kjcf05n03 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 11:32:01 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:01 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib0 Nov 3 11:32:01 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib0 Nov 3 11:32:01 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:32:01 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:32:01 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:32:01 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:01 kjcf05n03 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 11:32:01 kjcf05n03 dcs-collectord[6155]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 11:32:01 kjcf05n03 dcs-collectord[6155]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 11:32:01 kjcf05n03 dcs-bulk-data-sender[6155]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 11:32:01 kjcf05n03 dcs-bulk-data-sender[6146]: Starting bulk-data-sender:[ OK ] Nov 3 11:32:01 kjcf05n03 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 11:32:01 kjcf05n03 dcs-collectord[6157]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 11:32:01 kjcf05n03 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 11:32:01 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:02 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:32:02 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:32:02 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:32:02 kjcf05n03 nscd[2227]: 2227 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 11:32:02 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 11:32:02 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 11:32:02 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 11:32:02 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 11:32:02 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 11:32:02 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 11:32:02 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 11:32:02 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 11:32:02 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 11:32:02 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 11:32:02 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 11:32:02 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 11:32:02 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 11:32:02 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 11:32:02 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 11:32:02 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 11:32:02 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 11:32:02 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 11:32:03 kjcf05n03 systemd[1]: Stopping System Security Services Daemon... Nov 3 11:32:03 kjcf05n03 sssd[nss][2513]: Shutting down (status = 0) Nov 3 11:32:03 kjcf05n03 sssd[be[implicit_files]][2424]: Shutting down (status = 0) Nov 3 11:32:03 kjcf05n03 systemd[1]: sssd.service: Succeeded. Nov 3 11:32:03 kjcf05n03 systemd[1]: Stopped System Security Services Daemon. Nov 3 11:32:03 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 11:32:03 kjcf05n03 python3.9[5196]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 11:32:03 kjcf05n03 python3.9[3161]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:32:03 kjcf05n03 sssd[sssd][6250]: Starting up Nov 3 11:32:03 kjcf05n03 sssd[be[implicit_files]][6252]: Starting up Nov 3 11:32:03 kjcf05n03 sssd[nss][6253]: Starting up Nov 3 11:32:03 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 11:32:03 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 11:32:03 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 11:32:04 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 11:32:04 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 11:32:04 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 11:32:04 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 11:32:04 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 11:32:04 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 11:32:04 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure) defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 11:32:04 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure: defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 11:32:04 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure) defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 11:32:04 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure: defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 11:32:04 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 11:32:04 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 11:32:04 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 11:32:04 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 11:32:04 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 11:32:04 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 11:32:04 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:04 kjcf05n03 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 11:32:05 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib1 Nov 3 11:32:05 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib1 Nov 3 11:32:05 kjcf05n03 icinga2[6299]: [2024-11-03 11:32:05 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 11:32:05 kjcf05n03 icinga2[6299]: [2024-11-03 11:32:05 -0600] information/cli: Loading configuration file(s). Nov 3 11:32:05 kjcf05n03 icinga2[6299]: [2024-11-03 11:32:05 -0600] information/ConfigItem: Committing config item(s). Nov 3 11:32:05 kjcf05n03 icinga2[6299]: [2024-11-03 11:32:05 -0600] information/ApiListener: My API identity: kjcf05n03 Nov 3 11:32:05 kjcf05n03 icinga2[6299]: [2024-11-03 11:32:05 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 11:32:05 kjcf05n03 icinga2[6299]: [2024-11-03 11:32:05 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 11:32:05 kjcf05n03 icinga2[6299]: [2024-11-03 11:32:05 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 11:32:05 kjcf05n03 icinga2[6299]: [2024-11-03 11:32:05 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 11:32:05 kjcf05n03 icinga2[6299]: [2024-11-03 11:32:05 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 11:32:05 kjcf05n03 icinga2[6299]: [2024-11-03 11:32:05 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 11:32:05 kjcf05n03 icinga2[6299]: [2024-11-03 11:32:05 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 11:32:05 kjcf05n03 icinga2[6299]: [2024-11-03 11:32:05 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 11:32:05 kjcf05n03 icinga2[6299]: [2024-11-03 11:32:05 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 11:32:05 kjcf05n03 icinga2[6299]: [2024-11-03 11:32:05 -0600] information/cli: Closing console log. Nov 3 11:32:05 kjcf05n03 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 11:32:05 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:05 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:32:05 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:32:05 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:32:06 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 11:32:06 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 11:32:06 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:06 kjcf05n03 systemd[1]: Started Icinga2 network monitor. Nov 3 11:32:06 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:07 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 11:32:07 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:32:07 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:32:07 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 11:32:07 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 11:32:07 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 11:32:07 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 11:32:07 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 11:32:07 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 11:32:07 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 11:32:07 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 11:32:07 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 11:32:07 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 11:32:07 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 11:32:07 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 11:32:07 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 11:32:07 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 11:32:07 kjcf05n00 mcfcli[3673891]: %3|1730655127.455|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:32:08 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:08 kjcf05n03 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 11:32:08 kjcf05n03 nslcd[6923]: version 0.9.9 starting Nov 3 11:32:08 kjcf05n03 nslcd[6923]: accepting connections Nov 3 11:32:08 kjcf05n03 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 11:32:08 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:08 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:32:08 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:32:08 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:32:08 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 11:32:08 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 11:32:08 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 11:32:08 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 11:32:09 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 11:32:09 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 11:32:09 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 11:32:09 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 11:32:09 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:09 kjcf05n03 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 11:32:10 kjcf05n03 dearcpw[7007]: Using config script: /etc/dearcpw.conf Nov 3 11:32:10 kjcf05n03 dearcpw[7007]: - Creating default directory: '/var/log/dearcpw' Nov 3 11:32:10 kjcf05n03 dearcpw[7007]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 11:32:10 kjcf05n03 dearcpw[7007]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 11:32:10 kjcf05n03 dearcpw[7007]: - Creating default directory: '/var/run/dearcpw' Nov 3 11:32:10 kjcf05n03 dearcpw[7007]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 11:32:10 kjcf05n03 dearcpw[7007]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 11:32:10 kjcf05n03 dcs-bulk-data-sender[6157]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 11:32:10 kjcf05n03 dcs-collectord[6157]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 11:32:10 kjcf05n03 dearcpw-server[7066]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 11:32:10 kjcf05n03 dearcpw[7007]: celery multi v5.2.7 (dawn-chorus) Nov 3 11:32:10 kjcf05n03 dearcpw[7007]: > Starting nodes... Nov 3 11:32:10 kjcf05n03 dearcpw[7007]: > dearcpw@kjcf05n03: OK Nov 3 11:32:10 kjcf05n03 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 11:32:10 kjcf05n03 dearcpw-server[7068]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 11:32:10 kjcf05n03 dearcpw-server[7068]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 11:32:10 kjcf05n03 dearcpw-server[7068]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 11:32:10 kjcf05n03 systemd[1]: Started DEAR Control Plane worker process. Nov 3 11:32:10 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:32:10 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:32:10 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 11:32:10 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 11:32:10 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 11:32:10 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 11:32:10 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 11:32:10 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 11:32:10 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 11:32:10 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 11:32:10 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 11:32:10 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 11:32:11 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:36800). Nov 3 11:32:11 kjcf05n01 rsyncd[3067122]: connect from kjcf05n03 (172.16.2.6) Nov 3 11:32:11 kjcf05n01 rsyncd[3067122]: rsync to puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 11:32:11 kjcf05n01 rsyncd[3067122]: receiving file list Nov 3 11:32:11 kjcf05n01 rsyncd[3067122]: sent 29 bytes received 325 bytes total size 10901 Nov 3 11:32:11 kjcf05n01 systemd[1]: rsyncd@624-172.16.2.2:873-172.16.2.6:36800.service: Succeeded. Nov 3 11:32:11 kjcf05n03 puppet[7095]: IEC: 017000000: Node is up and running: { "node": "kjcf05n03" } Nov 3 11:32:11 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 11:32:11 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 11:32:11 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 11:32:11 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 11:32:11 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 11:32:11 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 11:32:11 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 11:32:11 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 11:32:11 kjcf05n03 dcs-collectord[5626]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 11:32:11 kjcf05n03 dcs-collectord[5626]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 11:32:11 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 11:32:11 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 11:32:11 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 11:32:11 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 11:32:11 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 11:32:11 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 11:32:12 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 11:32:12 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 11:32:12 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 11:32:12 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 11:32:13 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 11:32:13 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 11:32:13 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 11:32:13 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 11:32:14 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 11:32:14 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 11:32:14 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:14 kjcf05n03 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 11:32:14 kjcf05n03 diskless-swap[7191]: HA_PS_000: recovering journal Nov 3 11:32:14 kjcf05n03 systemd-udevd[1573]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 11:32:14 kjcf05n03 diskless-swap[7191]: HA_PS_000: clean, 2275/6400 files, 7041/25600 blocks Nov 3 11:32:14 kjcf05n03 diskless-swap[7191]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 11:32:14 kjcf05n03 ipmievd[3967]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 11:32:14 kjcf05n03 diskless-swap[7191]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 11:32:14 kjcf05n03 diskless-swap[7191]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 11:32:14 kjcf05n03 diskless-swap[7191]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 11:32:14 kjcf05n03 ipmievd[3967]: System Event sensor - Timestamp Clock Sync Nov 3 11:32:14 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 11:32:14 kjcf05n03 ipmievd[3967]: System Event sensor - Timestamp Clock Sync Nov 3 11:32:14 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:32:14 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:32:14 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 11:32:14 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 11:32:14 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 11:32:14 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 11:32:15 kjcf05n03 systemd[1]: Stopping OpenSSH server daemon... Nov 3 11:32:15 kjcf05n03 systemd[1]: sshd.service: Succeeded. Nov 3 11:32:15 kjcf05n03 systemd[1]: Stopped OpenSSH server daemon. Nov 3 11:32:15 kjcf05n03 systemd[1]: Stopped target sshd-keygen.target. Nov 3 11:32:15 kjcf05n03 systemd[1]: Stopping sshd-keygen.target. Nov 3 11:32:15 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 11:32:15 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 11:32:15 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 11:32:15 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 11:32:15 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 11:32:15 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 11:32:15 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 11:32:15 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 11:32:15 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 11:32:15 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 11:32:15 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 11:32:16 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 11:32:16 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 11:32:16 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 11:32:16 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 11:32:17 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 11:32:17 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 11:32:17 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 11:32:17 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 11:32:17 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 11:32:17 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 11:32:17 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 11:32:17 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 11:32:17 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:18 kjcf05n03 systemd[1]: Set up automount opt-firmware.automount. Nov 3 11:32:18 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:32:18 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:32:18 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 11:32:18 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 11:32:18 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:18 kjcf05n03 systemd[1]: Set up automount mnt-llog.automount. Nov 3 11:32:18 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:32:18 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:32:18 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 11:32:18 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 11:32:18 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:19 kjcf05n03 systemd[1]: Set up automount usr-share-man.automount. Nov 3 11:32:19 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:32:19 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:32:19 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 11:32:19 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 11:32:19 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 11:32:19 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 11:32:19 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 11:32:19 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 11:32:19 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 11:32:19 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 11:32:19 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 11:32:19 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 11:32:19 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:19 kjcf05n03 systemd[1]: Starting Crash recovery kernel arming... Nov 3 11:32:19 kjcf05n03 kdumpctl[7832]: kdump: No kdump initial ramdisk found. Nov 3 11:32:19 kjcf05n03 kdumpctl[7832]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 11:32:19 kjcf05n03 dracut[7944]: dracut-049-135.git20210121.el8 Nov 3 11:32:19 kjcf05n00 mcfcli[3673891]: %3|1730655139.549|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:32:20 kjcf05n03 dracut[7946]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 11:32:20 kjcf05n03 dracut[7946]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 11:32:20 kjcf05n03 dracut[7946]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 11:32:20 kjcf05n03 dracut[7946]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 11:32:20 kjcf05n03 dracut[7946]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 11:32:20 kjcf05n03 dracut[7946]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 11:32:20 kjcf05n03 dracut[7946]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 11:32:20 kjcf05n03 dracut[7946]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + is_func check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ type -t check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check -h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local dev holder Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + require_binaries mdadm expr Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _module_name=90hperaid Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ mdadm = \-\m ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for cmd in "$@" Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + find_binary mdadm Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for cmd in "$@" Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + find_binary expr Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n -h ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for dev in "${!host_fs_types[@]}" Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ nfs != *_raid_member ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + continue Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _ret=255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + ret=255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ 255 = 0 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ 255 = 255 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ module_depends hperaid Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: +++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: +++ set -x Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ depends Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo rootfs-block Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ return 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ _ret=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ return 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for _moddep in $(module_depends $_mod) Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all == *\ hperaid\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + add_dracutmodules+=' rootfs-block ' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ == *\ hperaid\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check_module rootfs-block Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _mod=rootfs-block Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddep Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ == *\ rootfs-block\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n '' ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all == *\ rootfs-block\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + module_check rootfs-block 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _forced=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 2 -eq 2 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _forced=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + is_func check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ type -t check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check -h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _ret=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + ret=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ 0 = 0 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ module_depends rootfs-block Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: +++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 11:32:20 kjcf05n03 kdumpctl[3161]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ depends Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo fs-lib Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ _ret=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ return 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for _moddep in $(module_depends $_mod) Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all == *\ rootfs-block\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + add_dracutmodules+=' fs-lib ' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ == *\ rootfs-block\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check_module fs-lib Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _mod=fs-lib Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddep Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n '' ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + mods_checked_as_dep+=' fs-lib ' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all == *\ fs-lib\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + module_check fs-lib 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _forced=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 2 -eq 2 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _forced=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + is_func check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ type -t check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check -h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _ret=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + ret=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ 0 = 0 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ module_depends fs-lib Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: +++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ depends Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ return 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ _ret=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ return 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + mods_to_load+=' fs-lib ' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + mods_to_load+=' rootfs-block ' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + mods_to_load+=' hperaid ' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _mod=90kernel-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _mod=kernel-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check_module kernel-modules 1 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _mod=kernel-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddep Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all = all ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + module_check kernel-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _forced=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 1 -eq 2 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + is_func check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ type -t check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check -h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + true Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _ret=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + ret=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ 0 != 0 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ module_depends kernel-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: +++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ depends Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ true Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ _ret=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ return 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + mods_to_load+=' kernel-modules ' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _mod=90kernel-modules-extra Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _mod=kernel-modules-extra Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check_module kernel-modules-extra 1 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _mod=kernel-modules-extra Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddep Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all = all ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + module_check kernel-modules-extra Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _forced=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 1 -eq 2 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + is_func check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ type -t check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check -h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + true Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _ret=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + ret=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ 0 != 0 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ module_depends kernel-modules-extra Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: +++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ depends Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ true Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ _ret=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ return 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + mods_to_load+=' kernel-modules-extra ' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _mod=90kernel-network-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _mod=kernel-network-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check_module kernel-network-modules 1 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _mod=kernel-network-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddep Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all = all ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + module_check kernel-network-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _forced=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 1 -eq 2 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + is_func check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ type -t check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check -h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _ret=255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + ret=255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ 255 != 0 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 1 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _mod=90livenet Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _mod=livenet Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check_module livenet 1 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _mod=livenet Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddep Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all = all ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + module_check livenet Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _forced=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 1 -eq 2 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + is_func check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ type -t check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check -h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _ret=255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + ret=255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ 255 != 0 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 1 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _mod=90lvm Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _mod=lvm Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check_module lvm 1 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _mod=lvm Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddep Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all = all ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + module_check lvm Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _forced=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 1 -eq 2 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + is_func check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ type -t check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check -h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + require_binaries lvm Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _module_name=90lvm Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ lvm = \-\m ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for cmd in "$@" Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + find_binary lvm Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n -h ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for fs in "${host_fs_types[@]}" Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ nfs = LVM*_member ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _ret=255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + ret=255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ 255 != 0 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 1 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _mod=90mdraid Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _mod=mdraid Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check_module mdraid 1 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _mod=mdraid Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddep Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all = all ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + module_check mdraid Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _forced=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 1 -eq 2 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + is_func check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ type -t check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check -h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _rootdev Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + require_binaries mdadm expr Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _module_name=90mdraid Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ mdadm = \-\m ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for cmd in "$@" Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + find_binary mdadm Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for cmd in "$@" Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + find_binary expr Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n -h ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for dev in "${!host_fs_types[@]}" Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ nfs != *_raid_member ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + continue Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _ret=255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + ret=255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ 255 != 0 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 1 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _mod=90multipath Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _mod=multipath Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check_module multipath 1 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _mod=multipath Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddep Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all = all ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + module_check multipath Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _forced=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 1 -eq 2 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + is_func check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ type -t check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check -h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _rootdev Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n -h ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for_each_host_dev_and_slaves is_mpath Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _func=is_mpath Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _dev Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for _dev in "${host_devs[@]}" Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + continue Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 1 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _ret=255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + ret=255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ 255 != 0 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 1 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _mod=90qemu Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _mod=qemu Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check_module qemu 1 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _mod=qemu Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddep Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all = all ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + module_check qemu Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _forced=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 1 -eq 2 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + is_func check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ type -t check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check -h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n -h ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + type -P systemd-detect-virt Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ systemd-detect-virt --vm Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + vm=none Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + (( 1 != 0 )) Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _ret=255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + ret=255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ 255 != 0 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 1 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _mod=90qemu-net Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _mod=qemu-net Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check_module qemu-net 1 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _mod=qemu-net Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddep Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all = all ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + module_check qemu-net Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _forced=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 1 -eq 2 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + is_func check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ type -t check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check -h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n -h ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + type -P systemd-detect-virt Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ systemd-detect-virt --vm Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + vm= Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + (( 1 != 0 )) Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _ret=255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + ret=255 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ 255 != 0 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + return 1 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _mod=90stratis Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + _mod=stratis Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check_module stratis 1 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _mod=stratis Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddep Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -n 1 ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ all = all ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + module_check stratis Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ read a b Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _forced=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _hostonly=-h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 1 -eq 2 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + is_func check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: ++ type -t check Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + '[' 0 -ne 0 ']' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + check -h Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _module_name=90stratis Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + local _ret=0 Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + [[ stratisd-init = \-\m ]] Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + for cmd in "$@" Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + find_binary stratisd-init Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 11:32:20 kjcf05n03 kdumpctl[7832]: + set +x Nov 3 11:32:20 kjcf05n03 dracut[7946]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 11:32:20 kjcf05n03 dracut[7946]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 11:32:20 kjcf05n03 dracut[7946]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 11:32:20 kjcf05n03 dracut[7946]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 11:32:20 kjcf05n03 dracut[7946]: memstrack is available Nov 3 11:32:20 kjcf05n03 dracut[7946]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 11:32:21 kjcf05n03 dracut[7946]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 11:32:21 kjcf05n03 dracut[7946]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 11:32:21 kjcf05n03 dracut[7946]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 11:32:21 kjcf05n03 dracut[7946]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 11:32:21 kjcf05n03 dracut[7946]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 11:32:21 kjcf05n03 dracut[7946]: *** Including module: bash *** Nov 3 11:32:21 kjcf05n03 dracut[7946]: *** Including module: systemd *** Nov 3 11:32:21 kjcf05n03 dracut[7946]: *** Including module: fips *** Nov 3 11:32:22 kjcf05n03 dracut[7946]: *** Including module: systemd-initrd *** Nov 3 11:32:22 kjcf05n03 dracut[7946]: *** Including module: watchdog-modules *** Nov 3 11:32:22 kjcf05n03 dracut[7946]: *** Including module: nss-softokn *** Nov 3 11:32:22 kjcf05n03 dracut[7946]: *** Including module: i18n *** Nov 3 11:32:22 kjcf05n03 dracut[7946]: No KEYMAP configured. Nov 3 11:32:22 kjcf05n03 dracut[7946]: *** Including module: network-legacy *** Nov 3 11:32:23 kjcf05n03 dracut[7946]: *** Including module: network *** Nov 3 11:32:23 kjcf05n03 dracut[7946]: *** Including module: ib_bonding *** Nov 3 11:32:23 kjcf05n03 dracut[7946]: *** Including module: drm *** Nov 3 11:32:23 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 11:32:23 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 11:32:23 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 11:32:23 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running Nov 3 11:32:23 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 11:32:26 kjcf05n03 dcs-collectord[5626]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 11:32:26 kjcf05n03 dcs-collectord[5626]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 11:32:26 kjcf05n03 dracut[7946]: *** Including module: hperaid *** Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + install Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + local rule rule_path Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + inst_multiple cat expr Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.2FutGQ/initramfs -a -f cat expr Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + _ret=0 Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + (( 0 != 0 )) Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + : Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + return 0 Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + inst_multiple -o mdmon Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.2FutGQ/initramfs -a -f -o mdmon Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + _ret=0 Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + (( 0 != 0 )) Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + : Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + return 0 Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: ++ command -v partx Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + inst /usr/sbin/partx /sbin/partx Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + local _hostonly_install Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + [[ -e /tmp/dracut.2FutGQ/initramfs//sbin/partx ]] Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.2FutGQ/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + (( 0 != 0 )) Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + : Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: ++ command -v mdadm Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + local _hostonly_install Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + [[ -e /tmp/dracut.2FutGQ/initramfs//sbin/mdadm ]] Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.2FutGQ/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + (( 0 != 0 )) Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + : Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + [[ yes == \y\e\s ]] Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + local _raidconf Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: ++ cmdline Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: ++ local _activated dev line UUID Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: ++ declare -A _activated Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: ++ for dev in "${!host_fs_types[@]}" Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: ++ [[ nfs != *_raid_member ]] Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: ++ continue Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + _raidconf= Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + [[ -n '' ]] Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + inst_rules 64-md-raid.rules Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + local _target=/etc/udev/rules.d _rule _found Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + inst_dir /usr/lib/udev/rules.d Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + [[ -e /tmp/dracut.2FutGQ/initramfs//usr/lib/udev/rules.d ]] Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + return 0 Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + inst_dir /etc/udev/rules.d Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + [[ -e /tmp/dracut.2FutGQ/initramfs//etc/udev/rules.d ]] Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + return 0 Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + for _rule in "$@" Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + continue Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + continue Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + for r in '' $dracutbasedir/rules.d/ Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + [[ 64-md-raid.rules != /* ]] Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + continue Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + for r in '' $dracutbasedir/rules.d/ Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + continue Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + [[ -n '' ]] Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 11:32:26 kjcf05n03 kdumpctl[7832]: + set +x Nov 3 11:32:26 kjcf05n03 dracut[7946]: Skipping udev rule: 64-md-raid.rules Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + installkernel Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + instmods =drivers/md Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + local _optional=-o Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + local _silent Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + local _ret Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + [[ '' = yes ]] Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + [[ =drivers/md = \-\c ]] Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + [[ =drivers/md = \-\s ]] Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + (( 1 == 0 )) Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.2FutGQ/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + _ret=0 Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + (( 0 != 0 )) Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + [[ -n '' ]] Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + return 0 Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + _ret=0 Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + unset check depends cmdline install installkernel Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + return 0 Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + modules_loaded+='hperaid ' Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + '[' -n '' ']' Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + _d_mod=90kernel-modules Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + _d_mod=kernel-modules Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + [[ '' = yes ]] Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + dinfo '*** Including module: kernel-modules ***' Nov 3 11:32:27 kjcf05n03 kdumpctl[7832]: + set +x Nov 3 11:32:27 kjcf05n03 dracut[7946]: *** Including module: kernel-modules *** Nov 3 11:32:27 kjcf05n03 dracut[7946]: *** Including module: kernel-modules-extra *** Nov 3 11:32:28 kjcf05n03 dracut[7946]: *** Including module: kernel-network-modules *** Nov 3 11:32:28 kjcf05n03 dracut[7946]: *** Including module: diskless-mod *** Nov 3 11:32:28 kjcf05n03 dracut[7946]: *** Including module: fstab-sys *** Nov 3 11:32:28 kjcf05n03 dracut[7946]: *** Including module: nfs *** Nov 3 11:32:28 kjcf05n03 dracut[7946]: *** Including module: rootfs-block *** Nov 3 11:32:28 kjcf05n03 dracut[7946]: *** Including module: terminfo *** Nov 3 11:32:28 kjcf05n03 dracut[7946]: *** Including module: udev-rules *** Nov 3 11:32:29 kjcf05n03 dracut[7946]: Skipping udev rule: 91-permissions.rules Nov 3 11:32:29 kjcf05n03 dracut[7946]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 11:32:29 kjcf05n03 dracut[7946]: *** Including module: dracut-systemd *** Nov 3 11:32:29 kjcf05n03 dracut[7946]: *** Including module: usrmount *** Nov 3 11:32:29 kjcf05n03 dracut[7946]: *** Including module: base *** Nov 3 11:32:30 kjcf05n03 dracut[7946]: *** Including module: fs-lib *** Nov 3 11:32:30 kjcf05n03 dracut[7946]: *** Including module: kdumpbase *** Nov 3 11:32:30 kjcf05n03 dracut[7946]: *** Including module: memstrack *** Nov 3 11:32:30 kjcf05n03 dracut[7946]: *** Including module: shutdown *** Nov 3 11:32:30 kjcf05n03 dracut[7946]: *** Including module: squash *** Nov 3 11:32:30 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n03": interface became available Nov 3 11:32:31 kjcf05n03 dracut[7946]: *** Including modules done *** Nov 3 11:32:31 kjcf05n03 dracut[7946]: *** Installing kernel module dependencies *** Nov 3 11:32:31 kjcf05n03 dracut[7946]: *** Installing kernel module dependencies done *** Nov 3 11:32:31 kjcf05n03 dracut[7946]: *** Resolving executable dependencies *** Nov 3 11:32:31 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 11:32:31 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 11:32:31 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 11:32:31 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running Nov 3 11:32:31 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 11:32:32 kjcf05n03 dracut[7946]: *** Resolving executable dependencies done*** Nov 3 11:32:32 kjcf05n03 dracut[7946]: *** Hardlinking files *** Nov 3 11:32:32 kjcf05n03 dracut[7946]: *** Hardlinking files done *** Nov 3 11:32:32 kjcf05n03 dracut[7946]: *** Generating early-microcode cpio image *** Nov 3 11:32:32 kjcf05n03 dracut[7946]: *** Constructing AuthenticAMD.bin **** Nov 3 11:32:32 kjcf05n03 dracut[7946]: *** Store current command line parameters *** Nov 3 11:32:32 kjcf05n03 dracut[7946]: Stored kernel commandline: Nov 3 11:32:32 kjcf05n03 dracut[7946]: rd.driver.pre=sd_mod Nov 3 11:32:32 kjcf05n03 dracut[7946]: rd.driver.pre=nvme Nov 3 11:32:32 kjcf05n03 dracut[7946]: rd.driver.pre=ipmi_si Nov 3 11:32:32 kjcf05n03 dracut[7946]: rd.driver.pre=ipmi_devintf Nov 3 11:32:32 kjcf05n03 dracut[7946]: rd.driver.pre=ipmi_msghandler Nov 3 11:32:32 kjcf05n03 dracut[7946]: nameserver=172.16.2.2 Nov 3 11:32:32 kjcf05n03 dracut[7946]: nameserver=127.0.0.1 Nov 3 11:32:32 kjcf05n03 dracut[7946]: nameserver=172.16.2.2 Nov 3 11:32:32 kjcf05n03 dracut[7946]: nameserver=127.0.0.1 Nov 3 11:32:32 kjcf05n03 dracut[7946]: ifname=kdump-meth0:00:09:3d:06:9a:1a team=mgmt0:kdump-meth0 Nov 3 11:32:32 kjcf05n03 dracut[7946]: rd.neednet Nov 3 11:32:32 kjcf05n03 dracut[7946]: kdumpnic=mgmt0 Nov 3 11:32:32 kjcf05n03 dracut[7946]: bootdev=mgmt0 Nov 3 11:32:32 kjcf05n03 dracut[7946]: *** Install squash loader *** Nov 3 11:32:33 kjcf05n03 dracut[7946]: *** Squashing the files inside the initramfs *** Nov 3 11:32:33 kjcf05n03 dracut[7946]: *** Squashing the files inside the initramfs done *** Nov 3 11:32:33 kjcf05n03 dracut[7946]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 11:32:33 kjcf05n03 dracut[7946]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 11:32:34 kjcf05n03 kdumpctl[7832]: kdump: kexec: loaded kdump kernel Nov 3 11:32:34 kjcf05n03 kdumpctl[7832]: kdump: Starting kdump: [OK] Nov 3 11:32:34 kjcf05n03 systemd[1]: Started Crash recovery kernel arming. Nov 3 11:32:34 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:34 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:32:34 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:32:34 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:32:34 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 11:32:34 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 11:32:34 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 11:32:34 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 11:32:34 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 11:32:34 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 11:32:34 kjcf05n03 ifdown[14666]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 11:32:34 kjcf05n03 ifdown[14667]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:32:34 kjcf05n03 ifdown[14668]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:32:35 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 11:32:35 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 11:32:35 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 11:32:35 kjcf05n00 zabbix-server[1217787]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 11:32:35 kjcf05n00 zabbix-server[1217787]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n03 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n03:system.uptime): 00:02:50\\"}}"' Nov 3 11:32:35 kjcf05n00 log_interesting_event.py[1217787]: Event '46148' acknowledged Nov 3 11:32:35 kjcf05n03 ifup[14743]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 11:32:35 kjcf05n03 ifup[14744]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:32:35 kjcf05n03 ifup[14745]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:32:35 kjcf05n00 zabbix-server[1217788]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 11:32:35 kjcf05n00 zabbix-server[1217788]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 3 11:32:35 kjcf05n00 log_interesting_event.py[1217788]: Event '46149' acknowledged Nov 3 11:32:35 kjcf05n00 zabbix-server[1217789]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 11:32:35 kjcf05n00 zabbix-server[1217789]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 3 11:32:36 kjcf05n00 log_interesting_event.py[1217789]: Event '46150' acknowledged Nov 3 11:32:37 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 11:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 11:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 11:32:37 kjcf05n00 mcfcli[3673891]: %3|1730655157.455|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:32:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 11:32:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 11:32:39 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 11:32:39 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 11:32:39 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 11:32:39 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:32:39 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:32:39 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:32:39 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:32:39 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 11:32:39 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 11:32:39 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 11:32:39 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 11:32:39 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:32:39 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:32:39 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:32:39 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:32:39 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 11:32:39 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 11:32:39 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 11:32:39 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 11:32:39 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 11:32:39 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 11:32:39 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 11:32:39 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 11:32:39 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 11:32:39 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 11:32:39 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 11:32:39 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 11:32:39 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 11:32:39 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 11:32:39 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 11:32:39 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 11:32:39 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 11:32:39 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 11:32:39 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 11:32:39 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 11:32:39 kjcf05n03 ifdown[14944]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 11:32:39 kjcf05n03 ifdown[14945]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:32:39 kjcf05n03 ifdown[14946]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:32:40 kjcf05n03 ifup[15036]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 11:32:40 kjcf05n03 ifup[15037]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:32:40 kjcf05n03 ifup[15038]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:32:40 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 11:32:40 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 11:32:40 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 11:32:41 kjcf05n03 dcs-collectord[5626]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 11:32:41 kjcf05n03 dcs-collectord[5626]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 11:32:41 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 11:32:41 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 11:32:41 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 11:32:41 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running Nov 3 11:32:41 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 11:32:43 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 11:32:44 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 11:32:44 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 11:32:44 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 11:32:44 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:45 kjcf05n03 systemd[1]: Starting Corosync Cluster Engine... Nov 3 11:32:45 kjcf05n03 await_ha_peer[15269]: Waiting for HA peer kjcf05n02 Nov 3 11:32:45 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31421 deleted. Nov 3 11:32:46 kjcf05n03 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 11:32:46 kjcf05n03 await_ha_peer[15269]: Peer kjcf05n02 has started, starting HA Nov 3 11:32:46 kjcf05n03 systemd[1]: Started Corosync Cluster Engine. Nov 3 11:32:46 kjcf05n03 systemd[1]: Started Fast STONITH daemon. Nov 3 11:32:46 kjcf05n03 fstonithd.py[15307]: Listening for kdump packets from partner Nov 3 11:32:46 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:47 kjcf05n03 systemd[3161]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:32:47 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:32:47 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:32:47 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:47 kjcf05n03 systemd[1]: Reached target resource-agents dependencies. Nov 3 11:32:47 kjcf05n03 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 11:32:47 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:48 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 11:32:48 kjcf05n03 puppet-agent[3554]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 11:32:48 kjcf05n03 puppet[3554]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 11:32:48 kjcf05n03 puppet-agent[3554]: Applied catalog in 92.64 seconds Nov 3 11:32:48 kjcf05n03 puppet[3554]: Notice: Applied catalog in 92.64 seconds Nov 3 11:32:48 kjcf05n03 systemd[1]: Started Puppet agent. Nov 3 11:32:48 kjcf05n03 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 11:32:48 kjcf05n03 systemd[1]: Reached target Timers. Nov 3 11:32:48 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 11:32:48 kjcf05n03 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 11:32:48 kjcf05n03 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 11:32:48 kjcf05n03 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 11:32:48 kjcf05n03 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 11:32:48 kjcf05n03 systemd[1]: Starting Set absolute GEM time... Nov 3 11:32:48 kjcf05n03 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 11:32:48 kjcf05n03 wce-disable.sh[15473]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 11:32:48 kjcf05n03 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 11:32:48 kjcf05n03 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 11:32:48 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 11:32:48 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 11:32:48 kjcf05n03 systemd[1]: set_gem_time.service: Succeeded. Nov 3 11:32:48 kjcf05n03 systemd[1]: Started Set absolute GEM time. Nov 3 11:32:48 kjcf05n03 RFSF-API[15468]: INFO[2024-11-03T11:32:48-06:00] Datapath API RESTful Service starting Nov 3 11:32:48 kjcf05n03 dp-api-server-node[15468]: INFO[2024-11-03T11:32:48-06:00] Datapath API RESTful Service starting Nov 3 11:32:48 kjcf05n03 RFSF-API[15468]: INFO[2024-11-03T11:32:48-06:00] Running in production mode, starting dbus event listener Nov 3 11:32:48 kjcf05n03 dp-api-server-node[15468]: INFO[2024-11-03T11:32:48-06:00] Running in production mode, starting dbus event listener Nov 3 11:32:48 kjcf05n03 RFSF-API[15468]: INFO[2024-11-03T11:32:48-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 11:32:48 kjcf05n03 dp-api-server-node[15468]: INFO[2024-11-03T11:32:48-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 11:32:48 kjcf05n03 RFSF-API[15468]: INFO[2024-11-03T11:32:48-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 11:32:48 kjcf05n03 dp-api-server-node[15468]: INFO[2024-11-03T11:32:48-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 11:32:48 kjcf05n03 RFSF-API[15468]: INFO[2024-11-03T11:32:48-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 11:32:48 kjcf05n03 dp-api-server-node[15468]: INFO[2024-11-03T11:32:48-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 11:32:48 kjcf05n03 RFSF-API[15468]: INFO[2024-11-03T11:32:48-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 11:32:48 kjcf05n03 dp-api-server-node[15468]: INFO[2024-11-03T11:32:48-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 11:32:48 kjcf05n03 RFSF-API[15468]: INFO[2024-11-03T11:32:48-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 11:32:48 kjcf05n03 dp-api-server-node[15468]: INFO[2024-11-03T11:32:48-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 11:32:48 kjcf05n03 RFSF-API[15468]: INFO[2024-11-03T11:32:48-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 11:32:48 kjcf05n03 dp-api-server-node[15468]: INFO[2024-11-03T11:32:48-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 11:32:48 kjcf05n03 RFSF-API[15468]: INFO[2024-11-03T11:32:48-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 11:32:48 kjcf05n03 dp-api-server-node[15468]: INFO[2024-11-03T11:32:48-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 11:32:48 kjcf05n03 RFSF-API[15468]: INFO[2024-11-03T11:32:48-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 11:32:48 kjcf05n03 dp-api-server-node[15468]: INFO[2024-11-03T11:32:48-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 11:32:48 kjcf05n03 RFSF-API[15468]: INFO[2024-11-03T11:32:48-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 11:32:48 kjcf05n03 dp-api-server-node[15468]: INFO[2024-11-03T11:32:48-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 11:32:48 kjcf05n03 RFSF-API[15468]: INFO[2024-11-03T11:32:48-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 11:32:48 kjcf05n03 dp-api-server-node[15468]: INFO[2024-11-03T11:32:48-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 11:32:48 kjcf05n03 gateway-ec-node.py[15470]: Starting gateway-ec-node service Nov 3 11:32:48 kjcf05n03 python3.9[15469]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 11:32:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730655168', 'host':'kjcf05n03', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.5% (3834152 kB) used.'}"] Nov 3 11:32:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'RAM usage', 'description': 'OK - 1.5% (3834152 kB) used.', 'message': 'OK - 1.5% (3834152 kB) used.', 'value': 'ok', 'timestamp': '1730655168'} Nov 3 11:32:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:32:48 kjcf05n03 python3.9[15469]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 11:32:55 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:54 kjcf05n00 mcfcli[3673891]: %3|1730655174.930|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:32:55 kjcf05n03 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 11:32:55 kjcf05n03 systemd[1]: Reloading. Nov 3 11:32:55 kjcf05n03 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 11:32:56 kjcf05n03 dcs-collectord[5626]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 11:32:56 kjcf05n03 dcs-collectord[5626]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 11:32:56 kjcf05n03 dcs-collectord[5626]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 11:32:56 kjcf05n03 diskmonitor_pre[15951]: Key management is currently disabled.DEAR disabled Nov 3 11:32:56 kjcf05n03 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 11:32:57 kjcf05n00 httpd[902564]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-B): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n03', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 11:32:58 kjcf05n03 sh[16018]: LNET configured: New Created Nov 3 11:32:58 kjcf05n03 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 11:32:58 kjcf05n03 LCNmon[18101]: Interface ib0 is up Nov 3 11:32:58 kjcf05n03 LCNmon[18101]: Interface ib1 is up Nov 3 11:32:58 kjcf05n03 LCNmon[18101]: Can ping through interface ib0 Nov 3 11:32:58 kjcf05n03 LCNmon[18101]: Can ping through interface ib1 Nov 3 11:32:58 kjcf05n03 LCNmon[18101]: NIC ib0, initial state UP Nov 3 11:32:58 kjcf05n03 LCNmon[18101]: NIC ib1, initial state UP Nov 3 11:32:58 kjcf05n03 LCNmon[18101]: LCNstat initial state UP Nov 3 11:32:58 kjcf05n03 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 11:32:58 kjcf05n03 LCNmon[18101]: LCNmon monitoring hosts kjcf05n03 and kjcf05n02 Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: /var/run/diskmonitor does not exist, creating Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: Creating /var/run/diskmonitor/disk Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: Creating /var/run/diskmonitor/encl Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: Creating /var/run/diskmonitor/cli Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: RAS_Interlocks_enabled: 1 Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: add handler for sig: 14 sa_flags: 10000004 Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: add handler for sig: 1 sa_flags: 10000004 Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: add handler for sig: 2 sa_flags: 00000004 Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: add handler for sig: 15 sa_flags: 00000004 Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: add handler for sig: 6 sa_flags: 00000004 Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: add handler for sig: 3 sa_flags: 00000004 Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: add handler for sig: 30 sa_flags: 00000004 Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: add handler for sig: 20 sa_flags: 00000004 Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: add handler for sig: 10 sa_flags: 10000004 Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: add handler for sig: 11 sa_flags: 00000004 Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: add handler for sig: 7 sa_flags: 00000004 Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: add handler for sig: 4 sa_flags: 00000004 Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: add handler for sig: 8 sa_flags: 00000004 Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: Using HA Baton locks - key: diskmonitor Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: Baton will be held for at most 570 seconds Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: DMMP Enabled: 0 Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: random seed: 7364fc9 Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: NVMe Enclosure: 1 Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: ZFS Enclosure: 0 Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: Dbus, Initialized Connection Successfully Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: int_catcher_thread: thread start Nov 3 11:32:59 kjcf05n03 diskmonitor[17705]: Received dbus message 4 org.freedesktop.DBus -> :1.116 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 11:33:00 kjcf05n03 diskmonitor[17705]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 11:33:00 kjcf05n03 diskmonitor[17705]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 11:33:00 kjcf05n03 diskmonitor[17705]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 11:33:00 kjcf05n03 diskmonitor[17705]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 11:33:00 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 11:33:00 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b07bec_S4EUNF0MA05386M encl_slot: 0 Nov 3 11:33:00 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 11:33:00 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b07bed_S4EUNF0MA05387D encl_slot: 0 Nov 3 11:33:00 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 11:33:00 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 11:33:00 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 11:33:00 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 11:33:00 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 11:33:00 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 11:33:00 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 11:33:00 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 11:33:00 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 11:33:00 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 11:33:00 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 11:33:00 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 11:33:00 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 11:33:00 kjcf05n03 openhpid[5532]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 11:33:00 kjcf05n03 openhpid[5532]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 11:33:01 kjcf05n03 systemd[1]: openhpid.service: Succeeded. Nov 3 11:33:01 kjcf05n03 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 11:33:01 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 11:33:01 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18511 (bash) Nov 3 11:33:01 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 11:33:01 kjcf05n03 systemd[1]: openhpid.service: Supervising process 18522 which is not our child. We'll most likely not notice when it exits. Nov 3 11:33:01 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 11:33:01 kjcf05n03 systemd[1]: Reached target Multi-User System. Nov 3 11:33:01 kjcf05n03 systemd[1]: Reached target Graphical Interface. Nov 3 11:33:01 kjcf05n03 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 11:33:01 kjcf05n03 dcs-collectord[5626]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 11:33:01 kjcf05n03 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 11:33:01 kjcf05n03 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 11:33:01 kjcf05n03 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 11:33:01 kjcf05n03 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 11:33:01 kjcf05n03 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 11:33:01 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 11:33:01 kjcf05n03 systemd[1]: Startup finished in 50.435s (kernel) + 2min 27.743s (userspace) = 3min 18.179s. Nov 3 11:33:01 kjcf05n03 openhpid[18522]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 11:33:01 kjcf05n03 openhpid[18522]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 11:33:01 kjcf05n03 openhpid[18522]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 11:33:01 kjcf05n03 openhpid[18522]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 11:33:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730655185', 'host':'kjcf05n03', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 11:33:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730655185'} Nov 3 11:33:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:33:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730655185', 'host':'kjcf05n03', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 11:33:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730655185'} Nov 3 11:33:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 11:33:06 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 11:33:07 kjcf05n00 mcfcli[3673891]: %3|1730655187.455|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:33:11 kjcf05n03 dcs-collectord[5626]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 11:33:11 kjcf05n03 dcs-collectord[5626]: WARNING No data collected (hpi_parser.py:353) Nov 3 11:33:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730655196', 'host':'kjcf05n03', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 11:33:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730655196', 'host':'kjcf05n03', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 11:33:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730655196'} Nov 3 11:33:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730655196'} Nov 3 11:33:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:33:16 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 11:33:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730655196', 'host':'kjcf05n03', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.85, 1.96, 0.91'}"] Nov 3 11:33:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Load', 'description': 'OK - load average: 1.85, 1.96, 0.91', 'message': 'OK - load average: 1.85, 1.96, 0.91', 'value': 'ok', 'timestamp': '1730655196'} Nov 3 11:33:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:33:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730655196', 'host':'kjcf05n03', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 362 processes with STATE = RSZDT '}"] Nov 3 11:33:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Total Processes', 'description': 'PROCS OK: 362 processes with STATE = RSZDT ', 'message': 'PROCS OK: 362 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730655196'} Nov 3 11:33:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:33:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730655201', 'host':'kjcf05n03', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(3304.0B/2612.0B), ib1=(2912.0B/2852.0B), icl0=(10.6kB/12.3kB), lo=(1688.0B/1688.0B), meth0=(1541.8MB/8.4MB), mgmt0=(1478.6MB/8.4MB)'}"] Nov 3 11:33:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(3304.0B/2612.0B), ib1=(2912.0B/2852.0B), icl0=(10.6kB/12.3kB), lo=(1688.0B/1688.0B), meth0=(1541.8MB/8.4MB), mgmt0=(1478.6MB/8.4MB)', 'message': 'NET OK - (Rx/Tx) ib0=(3304.0B/2612.0B), ib1=(2912.0B/2852.0B), icl0=(10.6kB/12.3kB), lo=(1688.0B/1688.0B), meth0=(1541.8MB/8.4MB), mgmt0=(1478.6MB/8.4MB)', 'value': 'ok', 'timestamp': '1730655201'} Nov 3 11:33:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730655201', 'host':'kjcf05n03', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 11:33:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730655201'} Nov 3 11:33:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:33:24 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 11:33:24 kjcf05n03 ipmievd[3967]: System Event sensor - Timestamp Clock Sync Nov 3 11:33:25 kjcf05n00 zabbix-server[1218459]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 11:33:25 kjcf05n00 zabbix-server[1218459]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 214.66\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 153.27\\"}}"' Nov 3 11:33:25 kjcf05n00 log_interesting_event.py[1218459]: Event '46162' acknowledged Nov 3 11:33:26 kjcf05n03 ipmievd[3161]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:33:26 kjcf05n03 dcs-collectord[5626]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 11:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T11:33:27.253008441-06:00 level=info msg="Completed cleanup jobs" duration=26.578129ms Nov 3 11:33:33 kjcf05n00 mcfcli[3673891]: %3|1730655213.751|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:33:37 kjcf05n00 mcfcli[3673891]: %3|1730655217.457|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b07bed_S4EUNF0MA05387D encl_sn: USE26000024VS001, slot: 2 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b07bec_S4EUNF0MA05386M encl_sn: USE26000024VS001, slot: 1 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 11:33:38 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 11:33:41 kjcf05n03 dcs-collectord[5626]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 11:33:46 kjcf05n02 firmware-update-orc-server[5831]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "cedf27b5-fac4-462c-8ace-61acc1995287"} (logger.py:65) Nov 3 11:33:46 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 86091 (get_disk_device) Nov 3 11:33:46 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 11:33:46 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 11:33:46 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e300614002538450000000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 11:33:46 kjcf05n03 ras-resource-manager-agent[5890]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "c7293234-9a09-11ef-8de2-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 11:33:46 kjcf05n03 ras-resource-manager-agent[5890]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'c7293234-9a09-11ef-8de2-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 11:33:46 kjcf05n03 ras-resource-manager-agent[5890]: INFO Submitting new device inserted signal, starting to qualify drive: c7293234-9a09-11ef-8de2-00093d069a1b (admin_action.py:110) Nov 3 11:33:45 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'c7293234-9a09-11ef-8de2-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 11:33:45 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'c7293234-9a09-11ef-8de2-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 11:33:45 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': 'c7293234-9a09-11ef-8de2-00093d069a1b', 'response ID': 'c7330f98-9a09-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 11:33:45 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: c7330f98-9a09-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 11:33:46 kjcf05n02 ccp-client[86131]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 11:33:46 kjcf05n02 ccp-client[86131]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 11:33:46 kjcf05n02 ccp-client[86194]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 11:33:46 kjcf05n02 ccp-client[86131]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 11:33:46 kjcf05n02 ccp-client[86131]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 11:33:46 kjcf05n02 ccp-client[86194]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 11:33:46 kjcf05n02 ccp-client[86194]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 11:33:46 kjcf05n03 diskmonitor[17705]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 11:33:46 kjcf05n03 ras-resource-manager-agent[5890]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "c778bb06-9a09-11ef-8de2-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 11:33:46 kjcf05n03 ras-resource-manager-agent[5890]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'c778bb06-9a09-11ef-8de2-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 11:33:46 kjcf05n03 ras-resource-manager-agent[5890]: INFO Submitting new device inserted signal, starting to qualify drive: c778bb06-9a09-11ef-8de2-00093d069a1b (admin_action.py:110) Nov 3 11:33:46 kjcf05n03 firmware-update-orc-server[5849]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "2966335b-025a-41ce-997e-32ff1828d2d1"} (logger.py:65) Nov 3 11:33:46 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'c778bb06-9a09-11ef-8de2-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 11:33:46 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'c778bb06-9a09-11ef-8de2-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 11:33:46 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': 'c778bb06-9a09-11ef-8de2-00093d069a1b', 'response ID': 'c77f980e-9a09-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 11:33:46 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: c77f980e-9a09-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 11:33:49 kjcf05n02 DRVFW[86329]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 11:33:49 kjcf05n02 ccp-client[86334]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 11:33:49 kjcf05n02 ccp-client[86334]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 11:33:49 kjcf05n02 ccp-client[86343]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 11:33:49 kjcf05n02 ccp-client[86334]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 11:33:49 kjcf05n02 ccp-client[86334]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 11:33:49 kjcf05n02 ccp-client[86343]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 11:33:49 kjcf05n02 ccp-client[86343]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 11:33:49 kjcf05n02 firmware-update-orc-server[5831]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 11:33:49 kjcf05n02 nslcd[6903]: [5558ec] ldap_result() failed: Can't contact LDAP server Nov 3 11:33:51 kjcf05n03 ras-resource-manager-agent[5890]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'c7293234-9a09-11ef-8de2-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 11:33:51 kjcf05n03 ras-resource-manager-agent[5890]: INFO Drive qualification complete responding: c7293234-9a09-11ef-8de2-00093d069a1b (admin_action.py:205) Nov 3 11:33:51 kjcf05n03 ras-resource-manager-agent[5890]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "c7293234-9a09-11ef-8de2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (interesting_event.py:59) Nov 3 11:33:50 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: c7330f98-9a09-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 11:33:50 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': 'c7293234-9a09-11ef-8de2-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'c7293234-9a09-11ef-8de2-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}}} (logger.py:65) Nov 3 11:33:53 kjcf05n03 diskmonitor[17705]: 3 Nov 3 11:33:53 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 11:33:53 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 11:33:53 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 11:33:53 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 11:33:53 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 11:33:53 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 11:33:53 kjcf05n03 diskmonitor[17705]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 11:33:53 kjcf05n03 diskmonitor[17705]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 11:33:53 kjcf05n03 diskmonitor[17705]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 11:33:53 kjcf05n03 diskmonitor[17705]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 11:33:53 kjcf05n03 diskmonitor[17705]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 11:33:53 kjcf05n03 diskmonitor[17705]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "c7293234-9a09-11ef-8de2-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 11:33:53 kjcf05n03 diskmonitor[17705]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 11:33:53 kjcf05n03 diskmonitor[17705]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 11:33:53 kjcf05n03 diskmonitor[17705]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "c778bb06-9a09-11ef-8de2-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 11:33:53 kjcf05n03 diskmonitor[17705]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 11:33:53 kjcf05n03 diskmonitor[17705]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 11:33:56 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22414 (get_disk_device) Nov 3 11:33:56 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 11:33:56 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 11:33:56 kjcf05n03 ccp-client[22435]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 11:33:57 kjcf05n03 ccp-client[22435]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 11:33:57 kjcf05n03 ccp-client[22444]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 11:33:57 kjcf05n03 ccp-client[22435]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 11:33:57 kjcf05n03 ccp-client[22435]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 11:33:57 kjcf05n03 ccp-client[22444]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 11:33:57 kjcf05n03 ccp-client[22444]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 11:33:57 kjcf05n03 chronyd[5133]: Selected source 172.16.2.1 Nov 3 11:34:00 kjcf05n03 DRVFW[22619]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 11:34:00 kjcf05n03 ccp-client[22620]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 11:34:00 kjcf05n03 ccp-client[22620]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 11:34:00 kjcf05n03 ccp-client[22659]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 11:34:00 kjcf05n03 ccp-client[22620]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 11:34:00 kjcf05n03 ccp-client[22620]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 11:34:00 kjcf05n03 ccp-client[22659]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 11:34:00 kjcf05n03 ccp-client[22659]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 11:34:00 kjcf05n03 firmware-update-orc-server[5849]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 11:34:00 kjcf05n03 ras-resource-manager-agent[5890]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'c778bb06-9a09-11ef-8de2-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 3 11:34:00 kjcf05n03 ras-resource-manager-agent[5890]: INFO Drive qualification complete responding: c778bb06-9a09-11ef-8de2-00093d069a1b (admin_action.py:205) Nov 3 11:34:00 kjcf05n03 ras-resource-manager-agent[5890]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "c778bb06-9a09-11ef-8de2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (interesting_event.py:59) Nov 3 11:34:00 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: c77f980e-9a09-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 11:34:00 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': 'c778bb06-9a09-11ef-8de2-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'c778bb06-9a09-11ef-8de2-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}}} (logger.py:65) Nov 3 11:34:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730655240}"] Nov 3 11:34:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730655240, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:34:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:34:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730655240}"] Nov 3 11:34:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730655240, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:34:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:34:01 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 11:34:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730655240}"] Nov 3 11:34:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730655240, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:34:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:34:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730655240}"] Nov 3 11:34:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730655240, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:34:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:34:01 kjcf05n03 systemd[1]: Unmounting /mnt/llog... Nov 3 11:34:01 kjcf05n03 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 11:34:01 kjcf05n03 systemd[1]: Unmounted /mnt/llog. Nov 3 11:34:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730655240}"] Nov 3 11:34:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730655240, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:34:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:34:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730655240}"] Nov 3 11:34:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730655240, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:34:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:34:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730655240}"] Nov 3 11:34:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730655240, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:34:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:34:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730655240}"] Nov 3 11:34:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730655240, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:34:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:34:05 kjcf05n03 python3.9[5196]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 11:34:05 kjcf05n03 python3.9[3161]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:34:05 kjcf05n03 ras-resource-manager-agent[5890]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "c7293234-9a09-11ef-8de2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (service_main_handler.py:66) Nov 3 11:34:05 kjcf05n03 ras-resource-manager-agent[5890]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'c7293234-9a09-11ef-8de2-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 11:34:05 kjcf05n03 ras-resource-manager-agent[5890]: INFO Device qualification response has been acknowledged: c7293234-9a09-11ef-8de2-00093d069a1b (admin_action.py:151) Nov 3 11:34:05 kjcf05n03 ras-resource-manager-agent[5890]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "c778bb06-9a09-11ef-8de2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (service_main_handler.py:66) Nov 3 11:34:05 kjcf05n03 ras-resource-manager-agent[5890]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'c778bb06-9a09-11ef-8de2-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 3 11:34:05 kjcf05n03 ras-resource-manager-agent[5890]: INFO Device qualification response has been acknowledged: c778bb06-9a09-11ef-8de2-00093d069a1b (admin_action.py:151) Nov 3 11:34:07 kjcf05n00 mcfcli[3673891]: %3|1730655247.457|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "c7293234-9a09-11ef-8de2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: Dbus, handle_ingress_ras_signals, uuid: c7293234-9a09-11ef-8de2-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "c7293234-9a09-11ef-8de2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "c778bb06-9a09-11ef-8de2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: Dbus, handle_ingress_ras_signals, uuid: c778bb06-9a09-11ef-8de2-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "c778bb06-9a09-11ef-8de2-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 11:34:07 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 11:34:09 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 11:34:10 kjcf05n03 diskmonitor[17705]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 11:34:09 kjcf05n00 mcfcli[3673891]: %3|1730655249.838|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:34:14 kjcf05n03 diskmonitor[17705]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 11:34:14 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 11:34:14 kjcf05n03 diskmonitor[17705]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 11:34:14 kjcf05n03 diskmonitor[17705]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 11:34:14 kjcf05n03 diskmonitor[17705]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 11:34:14 kjcf05n03 diskmonitor[17705]: leaving test state: 1 next state: 2 Nov 3 11:34:14 kjcf05n03 diskmonitor[17705]: lock req: no timeout Nov 3 11:34:14 kjcf05n03 diskmonitor[17705]: leaving test state: 2 next state: 4 Nov 3 11:34:14 kjcf05n03 diskmonitor[17705]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 11:34:37 kjcf05n00 mcfcli[3673891]: %3|1730655277.457|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 11:34:45 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31429 deleted. Nov 3 11:34:48 kjcf05n00 mcfcli[3673891]: %3|1730655288.842|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:35:07 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 11:35:07 kjcf05n00 mcfcli[3673891]: %3|1730655307.457|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:35:07 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 11:35:07 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 11:35:12 kjcf05n00 python3.9[1219360]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 11:35:17 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 11:35:17 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 11:35:17 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 11:35:22 kjcf05n03 diskmonitor[17705]: lock acquired Nov 3 11:35:22 kjcf05n03 diskmonitor[17705]: leaving test state: 4 next state: 8 Nov 3 11:35:22 kjcf05n03 dcs-collectord[5626]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 11:35:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730655037', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 11:35:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730655037'} Nov 3 11:35:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:35:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730655037', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 11:35:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730655037'} Nov 3 11:35:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:35:26 kjcf05n00 mcfcli[3673891]: %3|1730655326.595|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:35:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730655330}"] Nov 3 11:35:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730655330, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:35:31 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:35:31-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:35:31 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:35:31-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:35:31 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:35:31-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:35:31 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:35:31-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:35:31 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:35:31-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:35:31 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:35:31-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:35:31 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:35:31-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.398993ms Nov 3 11:35:31 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:35:31-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.398993ms Nov 3 11:35:31 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:35:31 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:35:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:35:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730655331}"] Nov 3 11:35:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730655331, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:35:31 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:35:31-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:35:31 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:35:31-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:35:31 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:35:31-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:35:31 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:35:31-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:35:31 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:35:31-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:35:31 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:35:31-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:35:31 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:35:31-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.448776ms Nov 3 11:35:31 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:35:31-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.448776ms Nov 3 11:35:31 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:35:31 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:35:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:35:35 kjcf05n03 diskmonitor[17705]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 11:35:35 kjcf05n03 diskmonitor[17705]: leaving test state: 8 next state: 20 Nov 3 11:35:35 kjcf05n03 diskmonitor[17705]: leaving test state: 20 next state: 40 Nov 3 11:35:35 kjcf05n03 diskmonitor[17705]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 366e3fd0000 Nov 3 11:35:35 kjcf05n03 diskmonitor[17705]: leaving test state: 40 next state: 80 Nov 3 11:35:37 kjcf05n00 mcfcli[3673891]: %3|1730655337.457|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 11:36:05 kjcf05n00 mcfcli[3673891]: %3|1730655365.610|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:36:07 kjcf05n00 mcfcli[3673891]: %3|1730655367.458|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:36:29 kjcf05n03 diskmonitor[17705]: leaving test state: 80 next state: 100 Nov 3 11:36:29 kjcf05n03 diskmonitor[17705]: lock release: time: Sun Nov 3 11:36:25 2024 Nov 3 11:36:29 kjcf05n03 diskmonitor[17705]: leaving test state: 100 next state: 1 Nov 3 11:36:37 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 11:36:37 kjcf05n00 mcfcli[3673891]: %3|1730655397.459|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:36:43 kjcf05n00 mcfcli[3673891]: %3|1730655403.561|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:36:48 kjcf05n00 zabbix-server[1220657]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 11:36:48 kjcf05n00 zabbix-server[1220657]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n03' from event '46170' Nov 3 11:36:48 kjcf05n00 zabbix-server[1220657]: Host created 'enclosure_USE26000024VS001' Nov 3 11:36:48 kjcf05n00 zabbix-server[1220657]: Running puppet on 'kjcf05n03' Nov 3 11:36:50 kjcf05n03 puppet-agent[31473]: Using configured environment 'production' Nov 3 11:36:50 kjcf05n03 puppet-agent[31473]: Retrieving pluginfacts Nov 3 11:36:50 kjcf05n03 puppet-agent[31473]: Retrieving plugin Nov 3 11:36:50 kjcf05n03 puppet-agent[31473]: Loading facts Nov 3 11:36:53 kjcf05n03 puppet-agent[31473]: Caching catalog for kjcf05n03 Nov 3 11:36:53 kjcf05n03 puppet-agent[31473]: Applying configuration version '1730655412' Nov 3 11:36:55 kjcf05n03 puppet-agent[31473]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 11:36:55 kjcf05n03 puppet-agent[31473]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 11:36:55 kjcf05n03 puppet-agent[31473]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 11:36:56 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 11:36:56 kjcf05n03 zabbix_agent2[5974]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 11:36:56 kjcf05n03 zabbix_agent2[3161]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:36:56 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 11:36:56 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 11:36:56 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 11:36:56 kjcf05n03 puppet-agent[31473]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: Press Ctrl+C to exit. Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: Plugin support version 1.0 Nov 3 11:36:56 kjcf05n03 zabbix_agent2[31788]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 11:36:58 kjcf05n03 puppet-agent[31473]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 11:36:58 kjcf05n03 puppet-agent[31473]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 11:36:58 kjcf05n03 puppet-agent[31473]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 11:36:58 kjcf05n03 puppet-agent[31473]: Applied catalog in 5.01 seconds Nov 3 11:36:58 kjcf05n00 zabbix-server[1220657]: puppet completed status:(0): '' Nov 3 11:36:58 kjcf05n00 zabbix-server[1220657]: Event '46170' acknowledged Nov 3 11:36:58 kjcf05n00 zabbix-server[1220657]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n03"}' Nov 3 11:37:01 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 11:37:07 kjcf05n00 mcfcli[3673891]: %3|1730655427.459|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:37:19 kjcf05n00 mcfcli[3673891]: %3|1730655439.027|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:37:37 kjcf05n00 mcfcli[3673891]: %3|1730655457.459|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:37:59 kjcf05n00 mcfcli[3673891]: %3|1730655479.024|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:38:07 kjcf05n00 mcfcli[3673891]: %3|1730655487.459|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:38:37 kjcf05n00 mcfcli[3673891]: %3|1730655517.459|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:38:38 kjcf05n00 mcfcli[3673891]: %3|1730655518.643|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:39:07 kjcf05n00 mcfcli[3673891]: %3|1730655547.459|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:39:18 kjcf05n00 mcfcli[3673891]: %3|1730655558.640|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:39:37 kjcf05n00 mcfcli[3673891]: %3|1730655577.460|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:39:58 kjcf05n00 mcfcli[3673891]: %3|1730655598.118|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 11:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 11:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 11:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 11:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 11:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 11:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 11:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 11:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 11:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 11:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 11:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 11:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 11:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 11:40:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 11:40:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:40:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 11:40:07 kjcf05n00 mcfcli[3673891]: %3|1730655607.460|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:40:09 kjcf05n00 python3.9[1222464]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 11:40:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730655037', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 11:40:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730655037'} Nov 3 11:40:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:40:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730655037', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 11:40:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730655037'} Nov 3 11:40:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:40:36 kjcf05n00 mcfcli[3673891]: %3|1730655636.311|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:40:37 kjcf05n00 mcfcli[3673891]: %3|1730655637.460|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 11:41:07 kjcf05n00 mcfcli[3673891]: %3|1730655667.462|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:41:12 kjcf05n00 mcfcli[3673891]: %3|1730655672.781|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:41:37 kjcf05n00 mcfcli[3673891]: %3|1730655697.462|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:41:45 kjcf05n00 zabbix-server[1223596]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 11:41:45 kjcf05n00 zabbix-server[1223596]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 163.31\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 132.72\\"}}"' Nov 3 11:41:45 kjcf05n00 log_interesting_event.py[1223596]: Event '46172' acknowledged Nov 3 11:41:50 kjcf05n00 mcfcli[3673891]: %3|1730655710.393|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:42:07 kjcf05n00 mcfcli[3673891]: %3|1730655727.462|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:42:30 kjcf05n00 mcfcli[3673891]: %3|1730655750.390|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:42:37 kjcf05n00 mcfcli[3673891]: %3|1730655757.462|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:43:07 kjcf05n00 mcfcli[3673891]: %3|1730655787.463|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:43:10 kjcf05n00 mcfcli[3673891]: %3|1730655790.073|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T11:43:27.268151984-06:00 level=info msg="Completed cleanup jobs" duration=41.189414ms Nov 3 11:43:35 kjcf05n03 root[41540]: failback_xyraid Nov 3 11:43:37 kjcf05n03 root[41648]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 11:43:37 kjcf05n00 mcfcli[3673891]: %3|1730655817.464|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:43:37 kjcf05n03 root[41729]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 11:43:41 kjcf05n02 systemd[1]: data-kjcf05n03:md66.mount: Succeeded. Nov 3 11:43:45 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme7n1 Nov 3 11:43:45 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme20n1 Nov 3 11:43:45 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme22n1 Nov 3 11:43:45 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme6n1 Nov 3 11:43:45 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme16n1 Nov 3 11:43:45 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme11n1 Nov 3 11:43:45 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme21n1 Nov 3 11:43:45 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme5n1 Nov 3 11:43:45 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme15n1 Nov 3 11:43:45 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme10n1 Nov 3 11:43:45 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme12n1 Nov 3 11:43:47 kjcf05n03 dwd[5166]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 11:43:47 kjcf05n03 dwd[5166]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 11:43:47 kjcf05n03 dwd[5166]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 11:43:47 kjcf05n03 dwd[5166]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 11:43:47 kjcf05n03 dwd[5166]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 11:43:47 kjcf05n03 dwd[5166]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 11:43:47 kjcf05n03 dwd[5166]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 11:43:47 kjcf05n03 dwd[5166]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 11:43:47 kjcf05n03 dwd[5166]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 11:43:47 kjcf05n03 dwd[5166]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 11:43:47 kjcf05n03 dwd[5166]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 11:43:47 kjcf05n03 dwd[5166]: Starting NVME thread for nvme10n1 Nov 3 11:43:47 kjcf05n03 dwd[5166]: Starting NVME thread for nvme15n1 Nov 3 11:43:47 kjcf05n03 dwd[5166]: Starting NVME thread for nvme21n1 Nov 3 11:43:47 kjcf05n00 mcfcli[3673891]: %3|1730655827.759|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:43:48 kjcf05n03 dwd[5166]: Starting NVME thread for nvme11n1 Nov 3 11:43:48 kjcf05n03 dwd[5166]: Starting NVME thread for nvme20n1 Nov 3 11:43:48 kjcf05n03 systemd-udevd[44748]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44750]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44751]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44752]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44748]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44750]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44752]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44751]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44748]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44750]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44751]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44752]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44748]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44750]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44752]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44751]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44748]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44750]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44752]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44751]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44748]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44750]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44752]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44748]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44751]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44750]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44752]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44748]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44751]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44750]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44751]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44748]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44786]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44788]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44790]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44792]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44786]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44790]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44788]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44786]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44792]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44788]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44790]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44785]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44785]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44790]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44785]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44788]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44788]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44790]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44788]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44790]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44788]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44790]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44788]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44788]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44790]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44788]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44790]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44788]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44790]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44788]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44788]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 systemd-udevd[44788]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:43:48 kjcf05n03 dwd[5166]: Starting NVME thread for nvme12n1 Nov 3 11:43:49 kjcf05n03 nslcd[6923]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 11:43:49 kjcf05n03 dwd[5166]: Starting NVME thread for nvme7n1 Nov 3 11:43:49 kjcf05n03 dwd[5166]: Starting NVME thread for nvme6n1 Nov 3 11:43:49 kjcf05n03 dwd[5166]: Starting NVME thread for nvme5n1 Nov 3 11:43:49 kjcf05n03 dwd[5166]: Starting NVME thread for nvme16n1 Nov 3 11:43:49 kjcf05n03 dwd[5166]: Starting NVME thread for nvme22n1 Nov 3 11:43:50 kjcf05n03 dcs-bulk-data-sender[6157]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 3 11:43:52 kjcf05n03 diskmonitor[17705]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 11:43:58 kjcf05n03 diskmonitor[17705]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 11:43:58 kjcf05n03 diskmonitor[17705]: Scan for ReadErrorMax change for md66 Nov 3 11:43:58 kjcf05n03 diskmonitor[17705]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 11:43:58 kjcf05n03 diskmonitor[17705]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 11:43:58 kjcf05n03 diskmonitor[17705]: read_saved_file: md66 no saved speed Nov 3 11:43:58 kjcf05n03 diskmonitor[17705]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 11:43:58 kjcf05n03 diskmonitor[17705]: Set sync_speed_min (10000) for md66 Nov 3 11:43:58 kjcf05n03 diskmonitor[17705]: Set sync_speed_max (200000) for md66 Nov 3 11:43:58 kjcf05n03 diskmonitor[17705]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 11:44:07 kjcf05n00 mcfcli[3673891]: %3|1730655847.464|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 11:44:09 kjcf05n02 diskmonitor[17396]: Removed MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 11:44:09 kjcf05n02 diskmonitor[17396]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 11:44:26 kjcf05n00 mcfcli[3673891]: %3|1730655866.409|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:44:37 kjcf05n00 mcfcli[3673891]: %3|1730655877.464|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:44:43 kjcf05n03 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 11:44:43 kjcf05n03 systemd-tmpfiles[47518]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 11:44:43 kjcf05n03 systemd-tmpfiles[47518]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 11:44:43 kjcf05n03 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 11:44:43 kjcf05n03 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 11:44:44 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47662 (bash) Nov 3 11:44:44 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 11:44:44 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 11:44:49 kjcf05n00 zabbix-server[1225319]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 11:44:49 kjcf05n00 zabbix-server[1225319]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n03' from event '46173' Nov 3 11:44:49 kjcf05n00 zabbix-server[1225319]: Filesystem 'kjcf05' has been mounted Nov 3 11:44:49 kjcf05n00 zabbix-server[1225319]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 11:44:49 kjcf05n00 zabbix-server[1225319]: Running puppet on 'None' Nov 3 11:44:51 kjcf05n05 puppet-agent[3190026]: Using configured environment 'production' Nov 3 11:44:51 kjcf05n05 puppet-agent[3190026]: Retrieving pluginfacts Nov 3 11:44:51 kjcf05n05 puppet-agent[3190026]: Retrieving plugin Nov 3 11:44:51 kjcf05n03 puppet-agent[48189]: Using configured environment 'production' Nov 3 11:44:51 kjcf05n03 puppet-agent[48189]: Retrieving pluginfacts Nov 3 11:44:51 kjcf05n03 puppet-agent[48189]: Retrieving plugin Nov 3 11:44:51 kjcf05n03 puppet-agent[48189]: Loading facts Nov 3 11:44:51 kjcf05n07 puppet-agent[3034480]: Using configured environment 'production' Nov 3 11:44:51 kjcf05n07 puppet-agent[3034480]: Retrieving pluginfacts Nov 3 11:44:51 kjcf05n07 puppet-agent[3034480]: Retrieving plugin Nov 3 11:44:51 kjcf05n06 puppet-agent[3036976]: Using configured environment 'production' Nov 3 11:44:51 kjcf05n06 puppet-agent[3036976]: Retrieving pluginfacts Nov 3 11:44:51 kjcf05n06 puppet-agent[3036976]: Retrieving plugin Nov 3 11:44:51 kjcf05n06 puppet-agent[3036976]: Loading facts Nov 3 11:44:51 kjcf05n04 puppet-agent[3034266]: Using configured environment 'production' Nov 3 11:44:51 kjcf05n04 puppet-agent[3034266]: Retrieving pluginfacts Nov 3 11:44:51 kjcf05n04 puppet-agent[3034266]: Retrieving plugin Nov 3 11:44:51 kjcf05n04 puppet-agent[3034266]: Loading facts Nov 3 11:44:52 kjcf05n02 puppet-agent[108062]: Using configured environment 'production' Nov 3 11:44:52 kjcf05n02 puppet-agent[108062]: Retrieving pluginfacts Nov 3 11:44:52 kjcf05n02 puppet-agent[108062]: Retrieving plugin Nov 3 11:44:52 kjcf05n02 puppet-agent[108062]: Loading facts Nov 3 11:44:52 kjcf05n05 puppet-agent[3190026]: Loading facts Nov 3 11:44:52 kjcf05n01 puppet-agent[3072142]: Using configured environment 'production' Nov 3 11:44:52 kjcf05n01 puppet-agent[3072142]: Retrieving pluginfacts Nov 3 11:44:52 kjcf05n01 puppet-agent[3072142]: Retrieving plugin Nov 3 11:44:52 kjcf05n07 puppet-agent[3034480]: Loading facts Nov 3 11:44:52 kjcf05n00 puppet-agent[1225382]: Using configured environment 'production' Nov 3 11:44:52 kjcf05n00 puppet-agent[1225382]: Retrieving pluginfacts Nov 3 11:44:52 kjcf05n00 puppet-agent[1225382]: Retrieving plugin Nov 3 11:44:52 kjcf05n01 puppet-agent[3072142]: Loading facts Nov 3 11:44:52 kjcf05n00 puppet-agent[1225382]: Loading facts Nov 3 11:44:54 kjcf05n03 puppet-agent[48189]: Caching catalog for kjcf05n03 Nov 3 11:44:54 kjcf05n03 puppet-agent[48189]: Applying configuration version '1730655893' Nov 3 11:44:55 kjcf05n07 puppet-agent[3034480]: Caching catalog for kjcf05n07 Nov 3 11:44:55 kjcf05n07 puppet-agent[3034480]: Applying configuration version '1730655893' Nov 3 11:44:54 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 11:44:54 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 11:44:55 kjcf05n06 puppet-agent[3036976]: Caching catalog for kjcf05n06 Nov 3 11:44:55 kjcf05n06 puppet-agent[3036976]: Applying configuration version '1730655893' Nov 3 11:44:55 kjcf05n02 puppet-agent[108062]: Caching catalog for kjcf05n02 Nov 3 11:44:55 kjcf05n02 puppet-agent[108062]: Applying configuration version '1730655893' Nov 3 11:44:56 kjcf05n01 puppet-agent[3072142]: Caching catalog for kjcf05n01 Nov 3 11:44:56 kjcf05n01 puppet-agent[3072142]: Applying configuration version '1730655894' Nov 3 11:44:56 kjcf05n00 puppet-agent[1225382]: Caching catalog for kjcf05n00 Nov 3 11:44:56 kjcf05n00 puppet-agent[1225382]: Applying configuration version '1730655894' Nov 3 11:44:56 kjcf05n03 puppet-agent[48189]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 11:44:56 kjcf05n03 puppet-agent[48189]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 11:44:56 kjcf05n03 puppet-agent[48189]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 11:44:57 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 11:44:57 kjcf05n07 puppet-agent[3034480]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 11:44:57 kjcf05n07 puppet-agent[3034480]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 11:44:57 kjcf05n07 puppet-agent[3034480]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 11:44:57 kjcf05n02 puppet-agent[108062]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 11:44:57 kjcf05n02 puppet-agent[108062]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 11:44:57 kjcf05n02 puppet-agent[108062]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 11:44:57 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 11:44:57 kjcf05n03 zabbix_agent2[31788]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 11:44:57 kjcf05n03 zabbix_agent2[3161]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 11:44:57 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 11:44:57 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 11:44:57 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 11:44:57 kjcf05n03 puppet-agent[48189]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: Press Ctrl+C to exit. Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: Plugin support version 1.0 Nov 3 11:44:57 kjcf05n03 zabbix_agent2[48822]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 11:44:57 kjcf05n06 puppet-agent[3036976]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 11:44:57 kjcf05n06 puppet-agent[3036976]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 11:44:57 kjcf05n06 puppet-agent[3036976]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 11:44:57 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 11:44:57 kjcf05n07 zabbix_agent2[2990436]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 11:44:57 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 11:44:57 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 11:44:57 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 11:44:57 kjcf05n07 puppet-agent[3034480]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: Press Ctrl+C to exit. Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: Plugin support version 1.0 Nov 3 11:44:57 kjcf05n07 zabbix_agent2[3034914]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 11:44:57 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 11:44:57 kjcf05n02 zabbix_agent2[58263]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 11:44:57 kjcf05n02 zabbix_agent2[3127]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 11:44:57 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 11:44:57 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 11:44:57 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 11:44:57 kjcf05n02 puppet-agent[108062]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: Press Ctrl+C to exit. Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: Plugin support version 1.0 Nov 3 11:44:57 kjcf05n02 zabbix_agent2[108461]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 11:44:57 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 11:44:57 kjcf05n06 zabbix_agent2[2993323]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 11:44:57 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 11:44:57 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 11:44:57 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 11:44:57 kjcf05n06 puppet-agent[3036976]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: Press Ctrl+C to exit. Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: Plugin support version 1.0 Nov 3 11:44:57 kjcf05n06 zabbix_agent2[3038231]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 11:44:58 kjcf05n05 puppet-agent[3190026]: Caching catalog for kjcf05n05 Nov 3 11:44:58 kjcf05n05 puppet-agent[3190026]: Applying configuration version '1730655896' Nov 3 11:44:59 kjcf05n01 puppet-agent[3072142]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 11:44:59 kjcf05n01 puppet-agent[3072142]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-11:25:41]/mode) mode changed '0755' to '0750' Nov 3 11:44:59 kjcf05n01 puppet-agent[3072142]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-11:25:41/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 11:44:59 kjcf05n01 puppet-agent[3072142]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-11:25:41/vmcore]/mode) mode changed '0600' to '0640' Nov 3 11:44:59 kjcf05n01 puppet-agent[3072142]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-11:25:41/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 11:44:59 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 11:44:59 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 11:44:58 kjcf05n00 puppet-agent[1225382]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 11:44:59 kjcf05n03 puppet-agent[48189]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 11:44:59 kjcf05n03 puppet-agent[48189]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 11:44:59 kjcf05n03 puppet-agent[48189]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 11:44:59 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 11:44:59 kjcf05n07 puppet-agent[3034480]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 11:44:59 kjcf05n07 puppet-agent[3034480]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 11:44:59 kjcf05n07 puppet-agent[3034480]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 11:44:59 kjcf05n06 puppet-agent[3036976]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 11:44:59 kjcf05n06 puppet-agent[3036976]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 11:44:59 kjcf05n06 puppet-agent[3036976]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 11:44:59 kjcf05n03 puppet-agent[48189]: Applied catalog in 5.08 seconds Nov 3 11:45:00 kjcf05n02 puppet-agent[108062]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 11:45:00 kjcf05n02 puppet-agent[108062]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 11:45:00 kjcf05n02 puppet-agent[108062]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 11:45:00 kjcf05n06 puppet-agent[3036976]: Applied catalog in 4.78 seconds Nov 3 11:45:00 kjcf05n07 puppet-agent[3034480]: Applied catalog in 4.89 seconds Nov 3 11:45:00 kjcf05n05 puppet-agent[3190026]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 11:45:00 kjcf05n05 puppet-agent[3190026]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 11:45:00 kjcf05n05 puppet-agent[3190026]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 11:45:00 kjcf05n01 puppet-agent[3072142]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 11:45:00 kjcf05n01 puppet-agent[3072142]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 11:45:00 kjcf05n01 puppet-agent[3072142]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 11:45:00 kjcf05n02 puppet-agent[108062]: Applied catalog in 5.15 seconds Nov 3 11:45:00 kjcf05n00 puppet-agent[1225382]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 11:45:00 kjcf05n00 puppet-agent[1225382]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 11:45:00 kjcf05n00 puppet-agent[1225382]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 11:45:00 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 11:45:00 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3150003]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 11:45:00 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 11:45:00 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 11:45:00 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 11:45:00 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 11:45:00 kjcf05n05 puppet-agent[3190026]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: Press Ctrl+C to exit. Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: Plugin support version 1.0 Nov 3 11:45:00 kjcf05n05 zabbix_agent2[3190809]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 11:45:00 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3062180]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 11:45:00 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 11:45:00 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 11:45:00 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 11:45:00 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 11:45:00 kjcf05n01 puppet-agent[3072142]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: Press Ctrl+C to exit. Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: Plugin support version 1.0 Nov 3 11:45:00 kjcf05n01 zabbix_agent2[3072495]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1209766]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 11:45:01 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 11:45:00 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 11:45:00 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 11:45:00 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 11:45:00 kjcf05n00 puppet-agent[1225382]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: Press Ctrl+C to exit. Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: Plugin support version 1.0 Nov 3 11:45:00 kjcf05n00 zabbix_agent2[1225960]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 11:45:01 kjcf05n00 zabbix-server[1225996]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 11:45:01 kjcf05n00 zabbix-server[1226019]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 11:45:01 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 11:45:01 kjcf05n00 zabbix-server[1226023]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 11:45:02 kjcf05n05 puppet-agent[3190026]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 11:45:02 kjcf05n05 puppet-agent[3190026]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 11:45:02 kjcf05n05 puppet-agent[3190026]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 11:45:02 kjcf05n05 puppet-agent[3190026]: Applied catalog in 4.78 seconds Nov 3 11:45:02 kjcf05n00 zabbix-server[1226031]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 11:45:02 kjcf05n01 puppet-agent[3072142]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_113300.log]/mode) mode changed '0644' to '0640' Nov 3 11:45:02 kjcf05n01 puppet-agent[3072142]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_114444.log]/mode) mode changed '0644' to '0640' Nov 3 11:45:02 kjcf05n00 puppet-agent[1225382]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 11:45:03 kjcf05n01 puppet-agent[3072142]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_113300.log]/mode) mode changed '0644' to '0640' Nov 3 11:45:03 kjcf05n01 puppet-agent[3072142]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_114444.log]/mode) mode changed '0644' to '0640' Nov 3 11:45:03 kjcf05n01 puppet-agent[3072142]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_114444]/mode) mode changed '0755' to '0750' Nov 3 11:45:03 kjcf05n01 puppet-agent[3072142]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_114444/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 11:45:03 kjcf05n01 puppet-agent[3072142]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 11:45:03 kjcf05n01 puppet-agent[3072142]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 11:45:03 kjcf05n01 puppet-agent[3072142]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 11:45:03 kjcf05n00 mcfcli[3673891]: %3|1730655903.565|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:45:03 kjcf05n00 puppet-agent[1225382]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 11:45:03 kjcf05n00 puppet-agent[1225382]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 11:45:03 kjcf05n00 puppet-agent[1225382]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 11:45:04 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 11:45:04 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 11:45:04 kjcf05n00 puppet-agent[1225382]: Applied catalog in 8.29 seconds Nov 3 11:45:04 kjcf05n01 puppet-agent[3072142]: Applied catalog in 8.77 seconds Nov 3 11:45:07 kjcf05n04 puppet-agent[3034266]: Caching catalog for kjcf05n04 Nov 3 11:45:07 kjcf05n04 puppet-agent[3034266]: Applying configuration version '1730655905' Nov 3 11:45:07 kjcf05n00 mcfcli[3673891]: %3|1730655907.465|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:45:09 kjcf05n04 puppet-agent[3034266]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 11:45:09 kjcf05n04 puppet-agent[3034266]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 11:45:09 kjcf05n04 puppet-agent[3034266]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 11:45:09 kjcf05n00 python3.9[1226037]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 11:45:10 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 11:45:10 kjcf05n04 zabbix_agent2[2996425]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 11:45:10 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 11:45:10 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 11:45:10 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 11:45:10 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 11:45:10 kjcf05n04 puppet-agent[3034266]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: Starting Zabbix Agent 2 (6.2.1) Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: Press Ctrl+C to exit. Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: Plugin support version 1.0 Nov 3 11:45:10 kjcf05n04 zabbix_agent2[3035110]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 11:45:11 kjcf05n04 puppet-agent[3034266]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 11:45:11 kjcf05n04 puppet-agent[3034266]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 11:45:11 kjcf05n04 puppet-agent[3034266]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 11:45:11 kjcf05n04 puppet-agent[3034266]: Applied catalog in 4.78 seconds Nov 3 11:45:11 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 11:45:11 kjcf05n00 zabbix-server[1225319]: puppet completed status:(0): '' Nov 3 11:45:12 kjcf05n00 zabbix-server[1225319]: Event '46173' acknowledged Nov 3 11:45:12 kjcf05n00 zabbix-server[1225319]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n03"}' Nov 3 11:45:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730655924', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 11:45:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730655924'} Nov 3 11:45:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:45:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730655924', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 11:45:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730655924'} Nov 3 11:45:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:45:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730655931}"] Nov 3 11:45:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730655931, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:45:31 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:31-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:31 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:31-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:31 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:31-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:31 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:31-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:31 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:31-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:31 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:31-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:31 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:31-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.957947ms Nov 3 11:45:31 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:31-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.957947ms Nov 3 11:45:31 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:45:31 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:45:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:45:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730655931}"] Nov 3 11:45:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730655931, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:45:31 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:31-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:31 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:31-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:31 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:31-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:31 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:31-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:31 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:31-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:31 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:31-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:31 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:31-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.256386ms Nov 3 11:45:31 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:31-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.256386ms Nov 3 11:45:31 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:45:31 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:45:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:45:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730655931}"] Nov 3 11:45:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730655931, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:45:31 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:31-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:31 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:31-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:31 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:31-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:31 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:31-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:31 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:31-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:31 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:31-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:31 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:31-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.224707ms Nov 3 11:45:31 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:31-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.224707ms Nov 3 11:45:31 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:45:31 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:45:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:45:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730655931}"] Nov 3 11:45:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730655931, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:45:31 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:31-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:31 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:31-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:31 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:31-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:31 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:31-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:31 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:31-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:31 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:31-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:31 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:31-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.926549ms Nov 3 11:45:31 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:31-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.926549ms Nov 3 11:45:31 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:45:31 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:45:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:45:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730655931}"] Nov 3 11:45:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730655931, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:45:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.260855ms Nov 3 11:45:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.260855ms Nov 3 11:45:32 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:45:32 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:45:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:45:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730655931}"] Nov 3 11:45:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730655931, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:45:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.394775ms Nov 3 11:45:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.394775ms Nov 3 11:45:32 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:45:32 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:45:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:45:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730655931}"] Nov 3 11:45:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730655931, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:45:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.365911ms Nov 3 11:45:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.365911ms Nov 3 11:45:32 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:45:32 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:45:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:45:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730655931}"] Nov 3 11:45:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730655931, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:45:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.30108ms Nov 3 11:45:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.30108ms Nov 3 11:45:32 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:45:32 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:45:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:45:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730655931}"] Nov 3 11:45:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730655931, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:45:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.079074ms Nov 3 11:45:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.079074ms Nov 3 11:45:32 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:45:32 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:45:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:45:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730655931}"] Nov 3 11:45:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730655931, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:45:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.897684ms Nov 3 11:45:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.897684ms Nov 3 11:45:32 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:45:32 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:45:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:45:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730655931}"] Nov 3 11:45:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730655931, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 11:45:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 11:45:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 11:45:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T11:45:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T11:45:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 11:45:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T11:45:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.054418ms Nov 3 11:45:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T11:45:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.054418ms Nov 3 11:45:32 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:11:45:32 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 11:45:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 11:45:37 kjcf05n00 mcfcli[3673891]: %3|1730655937.465|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 11:45:43 kjcf05n00 mcfcli[3673891]: %3|1730655943.562|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:46:07 kjcf05n00 mcfcli[3673891]: %3|1730655967.465|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:46:20 kjcf05n00 mcfcli[3673891]: %3|1730655980.209|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:46:37 kjcf05n00 mcfcli[3673891]: %3|1730655997.466|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 11:46:58 kjcf05n00 mcfcli[3673891]: %3|1730656018.466|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:47:07 kjcf05n00 mcfcli[3673891]: %3|1730656027.466|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 11:47:36 kjcf05n00 mcfcli[3673891]: %3|1730656056.764|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:47:37 kjcf05n00 mcfcli[3673891]: %3|1730656057.466|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 11:48:07 kjcf05n00 mcfcli[3673891]: %3|1730656087.467|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:48:12 kjcf05n00 mcfcli[3673891]: %3|1730656092.866|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:48:37 kjcf05n00 mcfcli[3673891]: %3|1730656117.467|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:48:52 kjcf05n00 mcfcli[3673891]: %3|1730656132.486|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:49:02 kjcf05n03 dwd[5166]: nvme10n1 passed periodic SMART status check Nov 3 11:49:02 kjcf05n03 dwd[5166]: nvme15n1 passed periodic SMART status check Nov 3 11:49:02 kjcf05n03 dwd[5166]: nvme21n1 passed periodic SMART status check Nov 3 11:49:03 kjcf05n03 dwd[5166]: nvme11n1 passed periodic SMART status check Nov 3 11:49:03 kjcf05n03 dwd[5166]: nvme20n1 passed periodic SMART status check Nov 3 11:49:03 kjcf05n03 dwd[5166]: nvme12n1 passed periodic SMART status check Nov 3 11:49:04 kjcf05n03 dwd[5166]: nvme7n1 passed periodic SMART status check Nov 3 11:49:04 kjcf05n03 dwd[5166]: nvme6n1 passed periodic SMART status check Nov 3 11:49:04 kjcf05n03 dwd[5166]: nvme16n1 passed periodic SMART status check Nov 3 11:49:04 kjcf05n03 dwd[5166]: nvme22n1 passed periodic SMART status check Nov 3 11:49:04 kjcf05n03 dwd[5166]: nvme5n1 passed periodic SMART status check Nov 3 11:49:07 kjcf05n00 mcfcli[3673891]: %3|1730656147.467|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 11:49:29 kjcf05n00 mcfcli[3673891]: %3|1730656169.692|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:49:37 kjcf05n00 mcfcli[3673891]: %3|1730656177.467|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 11:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 11:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 11:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 11:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 11:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 11:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 11:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 11:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 11:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 11:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 11:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 11:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 11:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 11:50:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 11:50:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 11:50:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 11:50:07 kjcf05n00 mcfcli[3673891]: %3|1730656207.469|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 11:50:09 kjcf05n00 mcfcli[3673891]: %3|1730656209.223|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:50:10 kjcf05n00 python3.9[1228847]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 11:50:37 kjcf05n00 mcfcli[3673891]: %3|1730656237.469|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 11:50:46 kjcf05n00 mcfcli[3673891]: %3|1730656246.521|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:51:07 kjcf05n00 mcfcli[3673891]: %3|1730656267.469|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:51:24 kjcf05n00 mcfcli[3673891]: %3|1730656284.292|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:51:37 kjcf05n00 mcfcli[3673891]: %3|1730656297.469|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:52:04 kjcf05n00 mcfcli[3673891]: %3|1730656324.289|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:52:07 kjcf05n00 mcfcli[3673891]: %3|1730656327.470|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:52:37 kjcf05n00 mcfcli[3673891]: %3|1730656357.471|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:52:44 kjcf05n00 mcfcli[3673891]: %3|1730656364.286|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:53:07 kjcf05n00 mcfcli[3673891]: %3|1730656387.471|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T17:53:15.868209Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 11:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T17:53:15.868272Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.081ms Nov 3 11:53:21 kjcf05n00 mcfcli[3673891]: %3|1730656401.783|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T11:53:27.262178338-06:00 level=info msg="Completed cleanup jobs" duration=35.781212ms Nov 3 11:53:37 kjcf05n00 mcfcli[3673891]: %3|1730656417.471|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:53:50 kjcf05n02 nslcd[6903]: [e87ccd] ldap_result() failed: Can't contact LDAP server Nov 3 11:53:58 kjcf05n00 mcfcli[3673891]: %3|1730656438.870|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:54:07 kjcf05n00 mcfcli[3673891]: %3|1730656447.471|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:54:35 kjcf05n00 mcfcli[3673891]: %3|1730656475.879|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:54:37 kjcf05n00 mcfcli[3673891]: %3|1730656477.472|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 11:55:07 kjcf05n00 mcfcli[3673891]: %3|1730656507.472|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:55:09 kjcf05n00 python3.9[1231805]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 11:55:15 kjcf05n00 mcfcli[3673891]: %3|1730656515.277|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 11:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 11:55:37 kjcf05n00 mcfcli[3673891]: %3|1730656537.472|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 11:55:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 11:55:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 11:55:49 kjcf05n00 zabbix_server[15726]: Zabbix agent item "system.swap.size[,pfree]" on host "kjcf05n03" failed: first network error, wait for 15 seconds Nov 3 11:55:54 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='39', error='Connection reset by peer (104)' Nov 3 11:55:54 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='39', client='AF_INET(172.16.2.6:36605)', local='AF_INET(0.0.0.0:601)' Nov 3 11:55:54 kjcf05n00 mcfcli[3673891]: %3|1730656554.984|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 11:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 11:55:55 kjcf05n02 fstonithd.py[15099]: My partner 172.16.2.6 is kdumping. Forcing HA into GATHER state. Nov 3 11:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 11:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 11:55:56 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 11:55:56 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 11:55:56 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 11:55:58 kjcf05n02 root[127159]: is_enc_ipmi_off starts Nov 3 11:55:58 kjcf05n02 root[127160]: is_viking_off starts Nov 3 11:55:58 kjcf05n02 root[127177]: I am master Nov 3 11:55:58 kjcf05n02 root[127180]: I am in slot 0; partner is in slot 1 Nov 3 11:55:58 kjcf05n02 root[127182]: is_lan_ipmi_off leaves Nov 3 11:55:58 kjcf05n02 root[127190]: is_lan_ipmi_sec_off leaves Nov 3 11:55:59 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 11:55:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 11:56:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 11:56:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 11:56:01 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib0 Nov 3 11:56:01 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib0 Nov 3 11:56:04 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vfs.fs.size[/mnt/persistent_ha_data,total]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 11:56:04 kjcf05n02 root[127352]: is_viking_off leaves Nov 3 11:56:04 kjcf05n02 root[127355]: kjcf05n03 not already off look at kdump Nov 3 11:56:04 kjcf05n02 root[127356]: is_kdump_off starts Nov 3 11:56:04 kjcf05n02 fence_kdump[127357]: waiting for message from '172.16.2.6' Nov 3 11:56:05 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib1 Nov 3 11:56:05 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib1 Nov 3 11:56:05 kjcf05n02 fence_kdump[127357]: received valid message from '172.16.2.6' Nov 3 11:56:05 kjcf05n02 root[127423]: is_kdump_off detected kdump on kjcf05n03 Nov 3 11:56:05 kjcf05n02 root[127429]: kjcf05n03 is kdumping Nov 3 11:56:05 kjcf05n02 root[127531]: is_enc_ipmi_off starts Nov 3 11:56:05 kjcf05n02 root[127532]: is_viking_off starts Nov 3 11:56:05 kjcf05n02 root[127575]: is_lan_ipmi_off leaves Nov 3 11:56:06 kjcf05n02 root[127577]: is_lan_ipmi_sec_off leaves Nov 3 11:56:06 kjcf05n02 root[127595]: I am master Nov 3 11:56:06 kjcf05n02 root[127594]: I am in slot 0; partner is in slot 1 Nov 3 11:56:07 kjcf05n00 mcfcli[3673891]: %3|1730656567.472|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 11:56:09 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 11:56:09 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 11:56:12 kjcf05n02 root[127787]: is_viking_off leaves Nov 3 11:56:12 kjcf05n02 root[127790]: kjcf05n03 not already off look at kdump Nov 3 11:56:12 kjcf05n02 root[127791]: is_kdump_off starts Nov 3 11:56:12 kjcf05n02 fence_kdump[127792]: waiting for message from '172.16.2.6' Nov 3 11:56:13 kjcf05n02 fence_kdump[127792]: received valid message from '172.16.2.6' Nov 3 11:56:13 kjcf05n02 root[127813]: is_kdump_off detected kdump on kjcf05n03 Nov 3 11:56:13 kjcf05n02 root[127814]: kjcf05n03 is kdumping Nov 3 11:56:18 kjcf05n02 dwd[5152]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 11:56:18 kjcf05n02 dwd[5152]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 11:56:18 kjcf05n02 dwd[5152]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 11:56:18 kjcf05n02 dwd[5152]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 11:56:18 kjcf05n02 dwd[5152]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 11:56:18 kjcf05n02 dwd[5152]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 11:56:18 kjcf05n02 dwd[5152]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 11:56:18 kjcf05n02 dwd[5152]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 11:56:18 kjcf05n02 dwd[5152]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 11:56:18 kjcf05n02 dwd[5152]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 11:56:18 kjcf05n02 dwd[5152]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 11:56:18 kjcf05n02 systemd-udevd[130058]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130059]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130060]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130063]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130058]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130060]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130059]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130063]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130058]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130060]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130063]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130059]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130058]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130059]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130060]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130063]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130058]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130060]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130059]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130063]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130060]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130058]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130063]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130059]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130060]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130058]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130059]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130063]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130060]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130063]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130058]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130059]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130098]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130096]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130101]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130103]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130098]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130096]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130101]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130103]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130095]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130098]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130103]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130095]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130095]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130103]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130098]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130095]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130098]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130095]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130098]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130095]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130098]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130095]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130095]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130098]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130095]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130098]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130095]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130098]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130095]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130095]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130095]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 systemd-udevd[130095]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 11:56:18 kjcf05n02 dwd[5152]: Starting NVME thread for nvme6n1 Nov 3 11:56:19 kjcf05n02 dwd[5152]: Starting NVME thread for nvme15n1 Nov 3 11:56:19 kjcf05n02 dwd[5152]: Starting NVME thread for nvme16n1 Nov 3 11:56:19 kjcf05n02 dwd[5152]: Starting NVME thread for nvme5n1 Nov 3 11:56:19 kjcf05n02 dwd[5152]: Starting NVME thread for nvme20n1 Nov 3 11:56:19 kjcf05n02 dwd[5152]: Starting NVME thread for nvme11n1 Nov 3 11:56:19 kjcf05n02 dwd[5152]: Starting NVME thread for nvme22n1 Nov 3 11:56:19 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vfs.fs.size[/var/lib/pacemaker,used]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 11:56:20 kjcf05n02 dwd[5152]: Starting NVME thread for nvme21n1 Nov 3 11:56:20 kjcf05n02 dwd[5152]: Starting NVME thread for nvme12n1 Nov 3 11:56:20 kjcf05n02 dwd[5152]: Starting NVME thread for nvme10n1 Nov 3 11:56:20 kjcf05n02 dwd[5152]: Starting NVME thread for nvme7n1 Nov 3 11:56:23 kjcf05n02 diskmonitor[17396]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 11:56:31 kjcf05n02 diskmonitor[17396]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 11:56:31 kjcf05n02 diskmonitor[17396]: Scan for ReadErrorMax change for md66 Nov 3 11:56:31 kjcf05n02 diskmonitor[17396]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 11:56:31 kjcf05n02 diskmonitor[17396]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 11:56:31 kjcf05n02 diskmonitor[17396]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.min.76c05c063fa0949b68ee86c1978c2ca8 file Nov 3 11:56:31 kjcf05n02 diskmonitor[17396]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.max.76c05c063fa0949b68ee86c1978c2ca8 file Nov 3 11:56:31 kjcf05n02 diskmonitor[17396]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 11:56:31 kjcf05n02 diskmonitor[17396]: Set sync_speed_min (10000) for md66 Nov 3 11:56:31 kjcf05n02 diskmonitor[17396]: Set sync_speed_max (200000) for md66 Nov 3 11:56:31 kjcf05n02 diskmonitor[17396]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 11:56:34 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n03": interface unavailable Nov 3 11:56:34 kjcf05n00 mcfcli[3673891]: %3|1730656594.981|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:56:37 kjcf05n00 mcfcli[3673891]: %3|1730656597.473|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 11:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 11:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 11:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 11:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 11:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 11:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 11:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 11:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 11:57:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 11:57:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 11:57:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 11:57:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 11:57:01 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib0 Nov 3 11:57:01 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib0 Nov 3 11:57:05 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib1 Nov 3 11:57:05 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib1 Nov 3 11:57:07 kjcf05n00 mcfcli[3673891]: %3|1730656627.473|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 11:57:14 kjcf05n00 mcfcli[3673891]: %3|1730656634.978|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:57:26 kjcf05n02 nslcd[6903]: [b141f2] ldap_result() failed: Can't contact LDAP server Nov 3 11:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 11:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 11:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 11:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 11:57:37 kjcf05n00 mcfcli[3673891]: %3|1730656657.474|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 11:57:53 kjcf05n00 mcfcli[3673891]: %3|1730656673.905|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 11:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 11:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 11:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 11:58:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 11:58:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 11:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 11:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 11:58:01 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib0 Nov 3 11:58:01 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib0 Nov 3 11:58:05 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib1 Nov 3 11:58:05 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib1 Nov 3 11:58:07 kjcf05n00 mcfcli[3673891]: %3|1730656687.474|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:58:29 kjcf05n00 mcfcli[3673891]: %3|1730656709.530|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 11:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 11:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 11:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 11:58:37 kjcf05n00 mcfcli[3673891]: %3|1730656717.475|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 11:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 11:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 11:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 11:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 11:59:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 11:59:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 11:59:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 11:59:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 11:59:01 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib0 Nov 3 11:59:01 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib0 Nov 3 11:59:05 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib1 Nov 3 11:59:05 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib1 Nov 3 11:59:07 kjcf05n00 mcfcli[3673891]: %3|1730656747.476|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:59:09 kjcf05n00 mcfcli[3673891]: %3|1730656749.045|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:59:33 kjcf05n00 zabbix-server[1234529]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 11:59:33 kjcf05n00 zabbix-server[1234529]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n03:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 11:59:33 kjcf05n00 log_interesting_event.py[1234529]: Event '46176' acknowledged Nov 3 11:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 11:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 11:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 11:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 11:59:37 kjcf05n00 mcfcli[3673891]: %3|1730656777.476|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 11:59:46 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:9a:1a Nov 3 11:59:46 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 11:59:48 kjcf05n00 mcfcli[3673891]: %3|1730656788.365|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 11:59:50 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 11:59:50 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a kjcf05n03 Nov 3 11:59:50 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.6 Nov 3 11:59:50 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 11:59:50 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 11:59:50 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.6 Nov 3 11:59:50 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/pxelinux.cfg to 172.16.2.6 Nov 3 11:59:53 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/vmlinuz_diskless to 172.16.2.6 Nov 3 11:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 11:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 11:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 11:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 12:00:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 12:00:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 12:00:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 12:00:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 12:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 12:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 12:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 12:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 12:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 12:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 12:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 12:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 12:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 12:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 12:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 12:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 12:00:01 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib0 Nov 3 12:00:01 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib0 Nov 3 12:00:01 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/initramfs-diskless.img to 172.16.2.6 Nov 3 12:00:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 12:00:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:00:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 12:00:05 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib1 Nov 3 12:00:05 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib1 Nov 3 12:00:07 kjcf05n00 mcfcli[3673891]: %3|1730656807.476|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:00:28 kjcf05n00 mcfcli[3673891]: %3|1730656828.171|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:00:32 kjcf05n00 python3.9[1235012]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 12:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 12:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 12:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 12:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 12:00:37 kjcf05n00 mcfcli[3673891]: %3|1730656837.476|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 12:00:49 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:37096). Nov 3 12:00:49 kjcf05n01 rsyncd[3078564]: connect from kjcf05n03 (172.16.2.6) Nov 3 12:00:49 kjcf05n01 rsyncd[3078564]: rsync on puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 12:00:49 kjcf05n01 rsyncd[3078564]: building file list Nov 3 12:00:49 kjcf05n01 rsyncd[3078564]: sent 11446 bytes received 136 bytes total size 10901 Nov 3 12:00:49 kjcf05n01 systemd[1]: rsyncd@625-172.16.2.2:873-172.16.2.6:37096.service: Succeeded. Nov 3 12:00:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730656851', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 12:00:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730656851'} Nov 3 12:00:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:00:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730656851', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 12:00:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730656851'} Nov 3 12:00:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 12:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 12:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 12:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 12:00:56 kjcf05n02 fstonithd.py[15099]: Listening for kdump packets from partner Nov 3 12:01:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 12:01:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 12:01:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 12:01:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 12:01:01 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib0 Nov 3 12:01:01 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib0 Nov 3 12:01:05 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib1 Nov 3 12:01:05 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib1 Nov 3 12:01:06 kjcf05n00 mcfcli[3673891]: %3|1730656866.986|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:01:07 kjcf05n00 mcfcli[3673891]: %3|1730656867.477|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 12:01:33 kjcf05n02 dwd[5152]: nvme6n1 passed periodic SMART status check Nov 3 12:01:33 kjcf05n02 dwd[5152]: nvme16n1 passed periodic SMART status check Nov 3 12:01:33 kjcf05n02 dwd[5152]: nvme5n1 passed periodic SMART status check Nov 3 12:01:33 kjcf05n02 dwd[5152]: nvme15n1 passed periodic SMART status check Nov 3 12:01:33 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 12:01:34 kjcf05n02 dwd[5152]: nvme11n1 passed periodic SMART status check Nov 3 12:01:34 kjcf05n02 dwd[5152]: nvme20n1 passed periodic SMART status check Nov 3 12:01:34 kjcf05n02 dwd[5152]: nvme22n1 passed periodic SMART status check Nov 3 12:01:34 kjcf05n02 dwd[5152]: nvme21n1 passed periodic SMART status check Nov 3 12:01:34 kjcf05n02 dwd[5152]: nvme10n1 passed periodic SMART status check Nov 3 12:01:34 kjcf05n02 dwd[5152]: nvme12n1 passed periodic SMART status check Nov 3 12:01:35 kjcf05n02 dwd[5152]: nvme7n1 passed periodic SMART status check Nov 3 12:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 12:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 12:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 12:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 12:01:37 kjcf05n00 mcfcli[3673891]: %3|1730656897.508|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 12:01:42 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 12:01:46 kjcf05n00 mcfcli[3673891]: %3|1730656906.263|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 12:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 12:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 12:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 12:02:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 12:02:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 12:02:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 12:02:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 12:02:00 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib0 Nov 3 12:02:00 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib0 Nov 3 12:02:05 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib1 Nov 3 12:02:05 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib1 Nov 3 12:02:07 kjcf05n00 mcfcli[3673891]: %3|1730656927.508|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 12:02:14 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='39', client='AF_INET(172.16.2.6:45607)', local='AF_INET(0.0.0.0:601)' Nov 3 12:02:14 kjcf05n03 syslog-ng[3189]: Configuration reload request received, reloading configuration; Nov 3 12:02:14 kjcf05n03 syslog-ng[3189]: Configuration reload finished; Nov 3 12:02:14 kjcf05n03 syslog-ng[3189]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 12:02:14 kjcf05n03 dracut: dracut-049-135.git20210121.el8 Nov 3 12:02:14 kjcf05n03 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 12:02:14 kjcf05n03 dracut: Loading and integrity checking all crypto modules Nov 3 12:02:14 kjcf05n03 dracut: Self testing crypto algorithms Nov 3 12:02:14 kjcf05n03 dracut: rd.md=0: removing MD RAID activation Nov 3 12:02:14 kjcf05n03 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 12:02:14 kjcf05n03 Copying live image to RAM... Nov 3 12:02:14 kjcf05n03 (this may take a minute) Nov 3 12:02:14 kjcf05n03 Done copying live image to RAM. Nov 3 12:02:14 kjcf05n03 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 12:02:14 kjcf05n03 dracut: Checking integrity of kernel Nov 3 12:02:14 kjcf05n03 dracut: All initrd crypto checks done Nov 3 12:02:14 kjcf05n03 dracut: Switching root Nov 3 12:02:14 kjcf05n03 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 12:02:14 kjcf05n03 systemd: Detected architecture x86-64. Nov 3 12:02:14 kjcf05n03 systemd: Set hostname to . Nov 3 12:02:14 kjcf05n03 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 12:02:14 kjcf05n03 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 12:02:14 kjcf05n03 systemd: Listening on udev Kernel Socket. Nov 3 12:02:14 kjcf05n03 systemd: Created slice system-serial\x2dgetty.slice. Nov 3 12:02:14 kjcf05n03 systemd: Listening on RPCbind Server Activation Socket. Nov 3 12:02:14 kjcf05n03 systemd: Reached target RPC Port Mapper. Nov 3 12:02:14 kjcf05n03 systemd: Listening on initctl Compatibility Named Pipe. Nov 3 12:02:14 kjcf05n03 systemd-journald[1519]: Journal started Nov 3 12:02:14 kjcf05n03 systemd-journald[1519]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 12:02:14 kjcf05n03 systemd-modules-load[1506]: Inserted module 'fuse' Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Load Kernel Modules. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 3 12:02:14 kjcf05n03 systemd[1]: Mounted /data. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Remount Root and Kernel File Systems. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Create list of required static device nodes for the current kernel. Nov 3 12:02:14 kjcf05n03 systemd[1]: Mounted /WIBS. Nov 3 12:02:14 kjcf05n03 systemd[1]: Mounted POSIX Message Queue File System. Nov 3 12:02:14 kjcf05n03 systemd[1]: Mounted /mnt. Nov 3 12:02:14 kjcf05n03 systemd[1]: Mounted Huge Pages File System. Nov 3 12:02:14 kjcf05n03 systemd[1]: Mounted Temporary Directory (/tmp). Nov 3 12:02:14 kjcf05n03 systemd[1]: Mounted Kernel Debug File System. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Rebuild Hardware Database... Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Load/Save Random Seed... Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Create System Users... Nov 3 12:02:14 kjcf05n03 systemd[1]: Mounting Kernel Configuration File System... Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Apply Kernel Variables... Nov 3 12:02:14 kjcf05n03 systemd[1]: Mounting FUSE Control File System... Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 12:02:14 kjcf05n03 systemd[1]: Mounted Kernel Configuration File System. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Load/Save Random Seed. Nov 3 12:02:14 kjcf05n03 systemd[1]: Mounted FUSE Control File System. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Create System Users. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 12:02:14 kjcf05n03 systemd-sysctl[1542]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 12:02:14 kjcf05n03 systemd-sysctl[1542]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Apply Kernel Variables. Nov 3 12:02:14 kjcf05n03 systemd-journald[1519]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 12:02:14 kjcf05n03 systemd-tmpfiles[1548]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 12:02:14 kjcf05n03 systemd-tmpfiles[1548]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started udev Coldplug all Devices. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Rebuild Hardware Database. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting udev Kernel Device Manager... Nov 3 12:02:14 kjcf05n03 systemd-udevd[1557]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started udev Kernel Device Manager. Nov 3 12:02:14 kjcf05n03 systemd[1]: Found device /dev/ttyS0. Nov 3 12:02:14 kjcf05n03 systemd-udevd[1576]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:02:14 kjcf05n03 systemd-udevd[1597]: Using default interface naming scheme 'rhel-8.0'. Nov 3 12:02:14 kjcf05n03 systemd-udevd[1597]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:02:14 kjcf05n03 systemd-udevd[1606]: Using default interface naming scheme 'rhel-8.0'. Nov 3 12:02:14 kjcf05n03 systemd-udevd[1606]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:02:14 kjcf05n03 systemd-udevd[1624]: Using default interface naming scheme 'rhel-8.0'. Nov 3 12:02:14 kjcf05n03 systemd-udevd[1624]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 12:02:14 kjcf05n03 systemd[1]: Reached target Local File Systems (Pre). Nov 3 12:02:14 kjcf05n03 systemd[1]: Reached target Local File Systems. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 12:02:14 kjcf05n03 systemd-tmpfiles[1767]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 12:02:14 kjcf05n03 systemd-tmpfiles[1767]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 12:02:14 kjcf05n03 root[1780]: openibd: running in auto mode Nov 3 12:02:14 kjcf05n03 systemd-tmpfiles[1767]: "/var/tmp" already exists and is not a directory. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Create Volatile Files and Directories. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Rebuild Journal Catalog. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting RPC Bind... Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 12:02:14 kjcf05n03 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 12:02:14 kjcf05n03 systemd[1]: Started RPC Bind. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started RDMA Node Description Daemon. Nov 3 12:02:14 kjcf05n03 systemd-modules-load[1856]: Inserted module 'ib_iser' Nov 3 12:02:14 kjcf05n03 systemd-modules-load[1856]: Inserted module 'ib_isert' Nov 3 12:02:14 kjcf05n03 systemd-modules-load[1856]: Inserted module 'ib_srpt' Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 12:02:14 kjcf05n03 systemd-modules-load[1863]: Inserted module 'ib_ipoib' Nov 3 12:02:14 kjcf05n03 systemd-udevd[1603]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:02:14 kjcf05n03 systemd-udevd[1576]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:02:14 kjcf05n03 systemd-modules-load[1856]: Inserted module 'rdma_ucm' Nov 3 12:02:14 kjcf05n03 systemd-modules-load[1856]: Module 'svcrdma' is blacklisted Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 12:02:14 kjcf05n03 systemd-udevd[1576]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 12:02:14 kjcf05n03 systemd-udevd[1603]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 12:02:14 kjcf05n03 systemd-modules-load[1863]: Inserted module 'ib_umad' Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 12:02:14 kjcf05n03 systemd[1]: Reached target RDMA Hardware. Nov 3 12:02:14 kjcf05n03 systemd[1]: Reached target Network (Pre). Nov 3 12:02:14 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 12:02:14 kjcf05n03 systemd[3189]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:14 kjcf05n03 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 12:02:14 kjcf05n03 openibd[1765]: Loading HCA driver and Access Layer:[ OK ] Nov 3 12:02:14 kjcf05n03 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Update is Completed... Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Update is Completed. Nov 3 12:02:14 kjcf05n03 setup-icl[1757]: Setting LAN IP Address to 203.0.113.4 Nov 3 12:02:14 kjcf05n03 setup-icl[1757]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 12:02:14 kjcf05n03 setup-icl[1757]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 12:02:14 kjcf05n03 setup-icl[1757]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 12:02:14 kjcf05n03 systemd-udevd[1603]: Using default interface naming scheme 'rhel-8.0'. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 12:02:14 kjcf05n03 systemd[1]: Reached target System Initialization. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 12:02:14 kjcf05n03 systemd[1]: Listening on lldpad.socket. Nov 3 12:02:14 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 12:02:14 kjcf05n03 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 12:02:14 kjcf05n03 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 12:02:14 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 12:02:14 kjcf05n03 systemd[1]: Reached target Sockets. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 12:02:14 kjcf05n03 systemd[1]: Reached target Basic System. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 12:02:14 kjcf05n03 chronyd[2113]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 12:02:14 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 12:02:14 kjcf05n03 mcelog[2110]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 12:02:14 kjcf05n03 mcelog[2110]: CPU is unsupported Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Resets System Activity Logs... Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 0 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 1 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 2 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 3 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 4 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 5 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 6 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 7 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 8 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 9 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 10 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 11 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 12 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 13 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 14 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 15 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 16 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 17 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 18 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 19 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 20 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 21 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 22 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 23 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 24 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 25 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 26 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 27 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 28 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 29 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 30 Nov 3 12:02:14 kjcf05n03 cpupower[2137]: Setting cpu: 31 Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 12:02:14 kjcf05n03 beSetMlxConfig[2128]: ConnectX-3 multiport not detected Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[2130]: Setting up Mellanox network interface: ib1 Nov 3 12:02:14 kjcf05n03 systemd[1]: Started D-Bus System Message Bus. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 12:02:14 kjcf05n03 network[2140]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Name Service Cache Daemon... Nov 3 12:02:14 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 12:02:14 kjcf05n03 dwd[2145]: dwd: vMay 29 2024 : 15:38:26 Nov 3 12:02:14 kjcf05n03 dwd[2145]: /usr/sbin/dwd -d --standalone=0 Nov 3 12:02:14 kjcf05n03 dwd[2145]: dwd: option Lethal: 0 Nov 3 12:02:14 kjcf05n03 dwd[2145]: dwd: option Interval: 60 Nov 3 12:02:14 kjcf05n03 dwd[2145]: dwd: option abrtlimit: 10 Nov 3 12:02:14 kjcf05n03 dwd[2145]: dwd: option DZPeriod: 604800 Nov 3 12:02:14 kjcf05n03 dwd[2145]: dwd: option SmartPeriod: 43200 Nov 3 12:02:14 kjcf05n03 dwd[2145]: dwd: option SDDEnabled: 1 Nov 3 12:02:14 kjcf05n03 dwd[2145]: dwd: option SDDAwaitScale: 3 Nov 3 12:02:14 kjcf05n03 dwd[2145]: dwd: option SDDAwaitMin: 100 Nov 3 12:02:14 kjcf05n03 dwd[2145]: dwd: option Verbosity: 1 Nov 3 12:02:14 kjcf05n03 dwd[2145]: dwd: option StandAlone: 0 Nov 3 12:02:14 kjcf05n03 dwd[2145]: option Lethal: 0 Nov 3 12:02:14 kjcf05n03 dwd[2145]: option Interval: 60 Nov 3 12:02:14 kjcf05n03 dwd[2145]: option abrtlimit: 10 Nov 3 12:02:14 kjcf05n03 dwd[2145]: option DZPeriod: 604800 Nov 3 12:02:14 kjcf05n03 dwd[2145]: option SmartPeriod: 43200 Nov 3 12:02:14 kjcf05n03 dwd[2145]: option SDDEnabled: 1 Nov 3 12:02:14 kjcf05n03 dwd[2145]: option SDDAwaitScale: 3 Nov 3 12:02:14 kjcf05n03 dwd[2145]: option SDDAwaitMin: 100 Nov 3 12:02:14 kjcf05n03 dwd[2145]: option Verbosity: 1 Nov 3 12:02:14 kjcf05n03 dwd[2145]: option StandAlone: 0 Nov 3 12:02:14 kjcf05n03 nscd[2190]: 2190 monitoring file `/etc/hosts` (1) Nov 3 12:02:14 kjcf05n03 nscd[2190]: 2190 monitoring directory `/etc` (2) Nov 3 12:02:14 kjcf05n03 nscd[2190]: 2190 monitoring file `/etc/resolv.conf` (3) Nov 3 12:02:14 kjcf05n03 nscd[2190]: 2190 monitoring directory `/etc` (2) Nov 3 12:02:14 kjcf05n03 chronyd[2113]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 12:02:14 kjcf05n03 chronyd[2113]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 12:02:14 kjcf05n03 mdraid-phy[2170]: no Cutlass to worry about Nov 3 12:02:14 kjcf05n03 systemd[1]: Started irqbalance daemon. Nov 3 12:02:14 kjcf05n03 network[2172]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 12:02:14 kjcf05n03 network[2140]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[2213]: Setting up Mellanox network interface: ib0 Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 12:02:14 kjcf05n03 dbus-daemon[2159]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 12:02:14 kjcf05n03 network[2222]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:02:14 kjcf05n03 network[2140]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 12:02:14 kjcf05n03 beSetMlxConfig[2128]: Starting MST (Mellanox Software Tools) driver set Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[2225]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 12:02:14 kjcf05n03 network[2256]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 12:02:14 kjcf05n03 beSetMlxConfig[2128]: Loading MST PCI module - Success Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[2274]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 12:02:14 kjcf05n03 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 12:02:14 kjcf05n03 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Resets System Activity Logs. Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[2284]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 0 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 1 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 2 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 3 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 4 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 5 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 6 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 7 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 8 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 9 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 10 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 11 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 12 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 13 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 14 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 15 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 16 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 17 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 18 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 19 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 20 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 21 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 22 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 23 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 24 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 25 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 26 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 27 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 28 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 29 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 30 Nov 3 12:02:14 kjcf05n03 cpupower[2310]: Idlestate 2 disabled on CPU 31 Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Manage Cutlass PHYs. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Name Service Cache Daemon. Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[2308]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[2309]: No configuration found for ib1 Nov 3 12:02:14 kjcf05n03 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 12:02:14 kjcf05n03 beSetMlxConfig[2128]: Loading MST PCI configuration module - Success Nov 3 12:02:14 kjcf05n03 beSetMlxConfig[2128]: Create devices Nov 3 12:02:14 kjcf05n03 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 12:02:14 kjcf05n03 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[2314]: No configuration found for ib0 Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[2321]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 12:02:14 kjcf05n03 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 12:02:14 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[2340]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 12:02:14 kjcf05n03 sssd[sssd][2174]: Starting up Nov 3 12:02:14 kjcf05n03 mlnx_conf_mgr[2379]: INFO: No configurations found for mlx5_1, skipping. Nov 3 12:02:14 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 12:02:14 kjcf05n03 mlnx_conf_mgr[2414]: INFO: No configurations found for mlx5_0, skipping. Nov 3 12:02:14 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 12:02:14 kjcf05n03 sssd[be[implicit_files]][2430]: Starting up Nov 3 12:02:14 kjcf05n03 sssd[nss][2536]: Starting up Nov 3 12:02:14 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 12:02:14 kjcf05n03 systemd[1]: Reached target User and Group Name Lookups. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Login Service... Nov 3 12:02:14 kjcf05n03 systemd-logind[2645]: New seat seat0. Nov 3 12:02:14 kjcf05n03 systemd-logind[2645]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Login Service. Nov 3 12:02:14 kjcf05n03 python3.9[2292]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 12:02:14 kjcf05n03 python3.9[3189]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 12:02:14 kjcf05n03 systemd-sysctl[2800]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 12:02:14 kjcf05n03 systemd-sysctl[2800]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 12:02:14 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 12:02:14 kjcf05n03 python3.9[3003]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 12:02:14 kjcf05n03 python3.9[3189]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 12:02:14 kjcf05n03 network[2140]: Bringing up loopback interface: [ OK ] Nov 3 12:02:14 kjcf05n03 systemd-sysctl[3135]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 12:02:14 kjcf05n03 systemd-sysctl[3135]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 12:02:14 kjcf05n03 systemd[1]: Started LSB: Bring up/down networking. Nov 3 12:02:14 kjcf05n03 systemd[1]: Reached target Network. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 12:02:14 kjcf05n03 systemd[1]: Reached target Network is Online. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 12:02:14 kjcf05n03 sm-notify[3181]: Version 2.3.3 starting Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting System Logger Daemon... Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Notify NFS peers of a restart. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 12:02:14 kjcf05n03 sshd[3176]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 12:02:14 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 12:02:14 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 12:02:14 kjcf05n03 systemd[1]: Reached target NFS client services. Nov 3 12:02:14 kjcf05n03 lldpad[3172]: setsockopt nearest_bridge: Invalid argument Nov 3 12:02:14 kjcf05n03 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 12:02:14 kjcf05n03 systemd[1]: Reached target Remote File Systems. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Permit User Sessions... Nov 3 12:02:14 kjcf05n03 lldpad[3172]: setsockopt nearest_bridge: Invalid argument Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Permit User Sessions. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Serial Getty on ttyS0. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 12:02:14 kjcf05n03 python3.9[3199]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 12:02:14 kjcf05n03 python3.9[3189]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:14 kjcf05n03 beSetMlxConfig[2128]: Unloading MST PCI module (unused) - Success Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Getty on tty1. Nov 3 12:02:14 kjcf05n03 systemd[1]: Reached target Login Prompts. Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 12:02:14 kjcf05n03 syslog-ng[3189]: [2024-11-03T18:01:01.877256] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 12:02:14 kjcf05n03 syslog-ng[3189]: [2024-11-03T18:01:01.877538] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 12:02:14 kjcf05n03 syslog-ng[3189]: [2024-11-03T18:01:01.877575] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 12:02:14 kjcf05n03 syslog-ng[3189]: [2024-11-03T18:01:01.878197] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 12:02:14 kjcf05n03 syslog-ng[3189]: [2024-11-03T18:01:01.878502] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 12:02:14 kjcf05n03 systemd[1]: Started System Logger Daemon. Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 12:02:14 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 12:02:14 kjcf05n03 python3.9[3434]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 12:02:14 kjcf05n03 python3.9[3189]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 12:02:14 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 12:02:14 kjcf05n03 python3.9[3437]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 12:02:14 kjcf05n03 python3.9[3189]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 12:02:14 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 12:02:14 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 12:02:14 kjcf05n03 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 12:02:14 kjcf05n03 chronyd[2113]: System's initial offset : 0.000283 seconds slow of true (slew) Nov 3 12:02:14 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 12:02:14 kjcf05n03 beSetMlxConfig[2128]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 12:02:14 kjcf05n03 beSetMlxConfig[2128]: ib mode Nov 3 12:02:14 kjcf05n03 root[3457]: openibd: Set node_desc for mlx5_0: kjcf05n03 HCA-1 Nov 3 12:02:14 kjcf05n03 root[3459]: openibd: Set node_desc for mlx5_1: kjcf05n03 HCA-2 Nov 3 12:02:14 kjcf05n03 beSetMlxConfig[2128]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 12:02:14 kjcf05n03 beSetMlxConfig[2128]: ib mode Nov 3 12:02:14 kjcf05n03 systemd-udevd[1557]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 12:02:14 kjcf05n03 systemd-udevd[3476]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:02:14 kjcf05n03 systemd-udevd[3477]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:02:14 kjcf05n03 systemd-udevd[3480]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:02:14 kjcf05n03 systemd-udevd[3483]: Using default interface naming scheme 'rhel-8.0'. Nov 3 12:02:14 kjcf05n03 systemd-udevd[3483]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:02:14 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 12:02:14 kjcf05n03 systemd[3189]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:14 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[3518]: Setting up Mellanox network interface: ib1 Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[3519]: Setting up Mellanox network interface: ib0 Nov 3 12:02:14 kjcf05n03 systemd-udevd[3478]: Using default interface naming scheme 'rhel-8.0'. Nov 3 12:02:14 kjcf05n03 systemd-udevd[3478]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[3568]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[3569]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[3583]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[3585]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[3586]: No configuration found for ib1 Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[3587]: No configuration found for ib0 Nov 3 12:02:14 kjcf05n03 systemd-udevd[3479]: Using default interface naming scheme 'rhel-8.0'. Nov 3 12:02:14 kjcf05n03 systemd-udevd[3479]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Puppet agent... Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[3594]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[3595]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 12:02:14 kjcf05n03 mlnx_conf_mgr[3649]: INFO: No configurations found for mlx5_1, skipping. Nov 3 12:02:14 kjcf05n03 mlnx_conf_mgr[3650]: INFO: No configurations found for mlx5_0, skipping. Nov 3 12:02:14 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 12:02:14 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 12:02:14 kjcf05n03 systemd[1]: Stopping Command Scheduler... Nov 3 12:02:14 kjcf05n03 systemd[1]: crond.service: Succeeded. Nov 3 12:02:14 kjcf05n03 systemd[1]: Stopped Command Scheduler. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 12:02:14 kjcf05n03 systemd[1]: Stopping Job spooling tools... Nov 3 12:02:14 kjcf05n03 systemd[1]: atd.service: Succeeded. Nov 3 12:02:14 kjcf05n03 systemd[1]: Stopped Job spooling tools. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 12:02:14 kjcf05n03 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 12:02:14 kjcf05n03 lldpad[3172]: init_ports: Error adding device ib0 Nov 3 12:02:14 kjcf05n03 lldpad[3172]: init_ports: Error adding device ib1 Nov 3 12:02:14 kjcf05n03 lldpad[3172]: Signal 15 received - terminating Nov 3 12:02:14 kjcf05n03 systemd[1]: lldpad.service: Succeeded. Nov 3 12:02:14 kjcf05n03 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 12:02:14 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 12:02:14 kjcf05n03 systemd[1]: lldpad.socket: Succeeded. Nov 3 12:02:14 kjcf05n03 systemd[1]: Closed lldpad.socket. Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 12:02:14 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting IPMI Driver... Nov 3 12:02:14 kjcf05n03 systemd[1]: Started IPMI Driver. Nov 3 12:02:14 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:14 kjcf05n03 systemd[3189]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:14 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Ipmievd Daemon... Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 1 | Nov-03-2024 | 17:31:18 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 2 | Nov-03-2024 | 17:32:09 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 3 | Nov-03-2024 | 17:32:10 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 4 | Nov-03-2024 | 17:33:16 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 5 | Nov-03-2024 | 17:33:16 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 6 | Nov-03-2024 | 17:58:17 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 7 | Nov-03-2024 | 17:58:17 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 8 | Nov-03-2024 | 17:58:17 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 9 | Nov-03-2024 | 17:58:17 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 10 | Nov-03-2024 | 17:58:17 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 11 | Nov-03-2024 | 17:58:17 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 12 | Nov-03-2024 | 17:58:17 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 13 | Nov-03-2024 | 17:58:17 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 14 | Nov-03-2024 | 17:58:17 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 15 | Nov-03-2024 | 17:58:17 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 16 | Nov-03-2024 | 17:58:17 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 17 | Nov-03-2024 | 17:58:17 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 18 | Nov-03-2024 | 17:58:48 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 19 | Nov-03-2024 | 17:58:48 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 20 | Nov-03-2024 | 17:58:48 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 21 | Nov-03-2024 | 17:58:48 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 22 | Nov-03-2024 | 17:58:48 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 23 | Nov-03-2024 | 17:58:48 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 24 | Nov-03-2024 | 17:58:48 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 25 | Nov-03-2024 | 17:58:48 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 26 | Nov-03-2024 | 17:58:48 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 27 | Nov-03-2024 | 17:58:48 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 28 | Nov-03-2024 | 17:58:48 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 12:02:14 kjcf05n03 ipmievd[3991]: 29 | Nov-03-2024 | 17:58:48 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 12:02:14 kjcf05n03 ipmievd[3994]: Reading sensors... Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Ipmievd Daemon. Nov 3 12:02:14 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:14 kjcf05n03 systemd[3189]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 12:02:14 kjcf05n03 nscd[2190]: 2190 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 12:02:14 kjcf05n03 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 12:02:14 kjcf05n03 systemd[1]: Stopped Set Mellanox configuration. Nov 3 12:02:14 kjcf05n03 systemd[1]: Stopping Set Mellanox configuration... Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 12:02:14 kjcf05n03 beSetMlxConfig[4052]: ConnectX-3 multiport not detected Nov 3 12:02:14 kjcf05n03 beSetMlxConfig[4052]: Starting MST (Mellanox Software Tools) driver set Nov 3 12:02:14 kjcf05n03 beSetMlxConfig[4052]: Loading MST PCI module - Success Nov 3 12:02:14 kjcf05n03 systemd-udevd[1557]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 12:02:14 kjcf05n03 beSetMlxConfig[4052]: [warn] mst_pciconf is already loaded, skipping Nov 3 12:02:14 kjcf05n03 beSetMlxConfig[4052]: Create devices Nov 3 12:02:14 kjcf05n03 beSetMlxConfig[4052]: Unloading MST PCI module (unused) - Success Nov 3 12:02:14 kjcf05n03 ipmievd[3994]: Waiting for events... Nov 3 12:02:14 kjcf05n03 beSetMlxConfig[4052]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 12:02:14 kjcf05n03 beSetMlxConfig[4052]: ib mode Nov 3 12:02:14 kjcf05n03 beSetMlxConfig[4052]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 12:02:14 kjcf05n03 beSetMlxConfig[4052]: ib mode Nov 3 12:02:14 kjcf05n03 systemd-udevd[1557]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 12:02:14 kjcf05n03 systemd-udevd[4954]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:02:14 kjcf05n03 systemd-udevd[4955]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:02:14 kjcf05n03 systemd-udevd[4958]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:02:14 kjcf05n03 systemd-udevd[4961]: Using default interface naming scheme 'rhel-8.0'. Nov 3 12:02:14 kjcf05n03 systemd-udevd[4961]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:02:14 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 12:02:14 kjcf05n03 systemd[3189]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:14 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[4996]: Setting up Mellanox network interface: ib1 Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[4997]: Setting up Mellanox network interface: ib0 Nov 3 12:02:14 kjcf05n03 systemd-udevd[4956]: Using default interface naming scheme 'rhel-8.0'. Nov 3 12:02:14 kjcf05n03 systemd-udevd[4957]: Using default interface naming scheme 'rhel-8.0'. Nov 3 12:02:14 kjcf05n03 systemd-udevd[4956]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:02:14 kjcf05n03 systemd-udevd[4957]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[5046]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[5047]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[5078]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[5079]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[5080]: No configuration found for ib0 Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[5081]: No configuration found for ib1 Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[5088]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 12:02:14 kjcf05n03 mlnx_interface_mgr[5089]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 12:02:14 kjcf05n03 mlnx_conf_mgr[5128]: INFO: No configurations found for mlx5_0, skipping. Nov 3 12:02:14 kjcf05n03 mlnx_conf_mgr[5129]: INFO: No configurations found for mlx5_1, skipping. Nov 3 12:02:14 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 12:02:14 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}956bef099a39882a6c23d559718760ff5194205d13c96e98861429270255c65b' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}956bef099a39882a6c23d559718760ff5194205d13c96e98861429270255c65b' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}632c49b0177d3141ffc4a7cce28c3c340990c71f801c279202639d2ad263f7bd' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}632c49b0177d3141ffc4a7cce28c3c340990c71f801c279202639d2ad263f7bd' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}c79a2db306929d59f2dd578fc726bce167750f32da2a116a60f362ee125b75a8' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}c79a2db306929d59f2dd578fc726bce167750f32da2a116a60f362ee125b75a8' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}63be400fccb106b835a1ca7730e59a90fccb828e6d745f6eec5d6303fb45eee6' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}63be400fccb106b835a1ca7730e59a90fccb828e6d745f6eec5d6303fb45eee6' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 12:02:14 kjcf05n03 systemd[1]: Stopping NTP client/server... Nov 3 12:02:14 kjcf05n03 chronyd[2113]: chronyd exiting Nov 3 12:02:14 kjcf05n03 systemd[1]: chronyd.service: Succeeded. Nov 3 12:02:14 kjcf05n03 systemd[1]: Stopped NTP client/server. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 12:02:14 kjcf05n03 chronyd[5163]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 12:02:14 kjcf05n03 chronyd[5163]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 12:02:14 kjcf05n03 chronyd[5163]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 12:02:14 kjcf05n03 chronyd[5163]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 12:02:14 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 12:02:14 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:14 kjcf05n03 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 12:02:14 kjcf05n03 systemd[1]: dwd.service: Succeeded. Nov 3 12:02:14 kjcf05n03 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 12:02:14 kjcf05n03 dwd[5194]: dwd: vMay 29 2024 : 15:38:26 Nov 3 12:02:14 kjcf05n03 dwd[5194]: /usr/sbin/dwd -i 15 -d Nov 3 12:02:14 kjcf05n03 dwd[5194]: dwd: option Lethal: 0 Nov 3 12:02:14 kjcf05n03 dwd[5194]: dwd: option Interval: 15 Nov 3 12:02:14 kjcf05n03 dwd[5194]: dwd: option abrtlimit: 10 Nov 3 12:02:14 kjcf05n03 dwd[5194]: dwd: option DZPeriod: 604800 Nov 3 12:02:14 kjcf05n03 dwd[5194]: dwd: option SmartPeriod: 43200 Nov 3 12:02:14 kjcf05n03 dwd[5194]: dwd: option SDDEnabled: 1 Nov 3 12:02:14 kjcf05n03 dwd[5194]: dwd: option SDDAwaitScale: 3 Nov 3 12:02:14 kjcf05n03 dwd[5194]: dwd: option SDDAwaitMin: 100 Nov 3 12:02:14 kjcf05n03 dwd[5194]: dwd: option Verbosity: 1 Nov 3 12:02:14 kjcf05n03 dwd[5194]: dwd: option StandAlone: 0 Nov 3 12:02:14 kjcf05n03 dwd[5194]: option Lethal: 0 Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 12:02:14 kjcf05n03 dwd[5194]: option Interval: 15 Nov 3 12:02:14 kjcf05n03 dwd[5194]: option abrtlimit: 10 Nov 3 12:02:14 kjcf05n03 dwd[5194]: option DZPeriod: 604800 Nov 3 12:02:14 kjcf05n03 dwd[5194]: option SmartPeriod: 43200 Nov 3 12:02:14 kjcf05n03 dwd[5194]: option SDDEnabled: 1 Nov 3 12:02:14 kjcf05n03 dwd[5194]: option SDDAwaitScale: 3 Nov 3 12:02:14 kjcf05n03 dwd[5194]: option SDDAwaitMin: 100 Nov 3 12:02:14 kjcf05n03 dwd[5194]: option Verbosity: 1 Nov 3 12:02:14 kjcf05n03 dwd[5194]: option StandAlone: 0 Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 12:02:14 kjcf05n03 dwd[5196]: option Lethal now set to 1 Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 12:02:14 kjcf05n03 dwd[5196]: option abrtlimit now set to 1 Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 12:02:14 kjcf05n03 dwd[5196]: option SmartPeriod now set to 86400 Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 12:02:14 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 12:02:14 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Discard unused blocks. Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:14 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:14 kjcf05n03 python3.9[5225]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 12:02:14 kjcf05n03 python3.9[3189]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 12:02:14 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Periodic ZFS scrub. Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:14 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 12:02:14 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting Sed Control Plane worker process... Nov 3 12:02:14 kjcf05n03 sedcpwrkr[5363]: Using config script: /etc/sedcpwrkr.conf Nov 3 12:02:14 kjcf05n03 sedcpwrkr[5363]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 12:02:14 kjcf05n03 sedcpwrkr[5363]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 12:02:14 kjcf05n03 sedcpwrkr[5363]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 12:02:14 kjcf05n03 sedcpwrkr[5363]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 12:02:14 kjcf05n03 sedcpwrkr[5363]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 12:02:14 kjcf05n03 sedcpwrkr[5363]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 12:02:14 kjcf05n03 sedcpwrkr-server[5394]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 12:02:14 kjcf05n03 sedcpwrkr[5363]: celery multi v5.2.7 (dawn-chorus) Nov 3 12:02:14 kjcf05n03 sedcpwrkr[5363]: > Starting nodes... Nov 3 12:02:14 kjcf05n03 sedcpwrkr[5363]: > sedcpwrkr@kjcf05n03: OK Nov 3 12:02:14 kjcf05n03 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 12:02:14 kjcf05n03 sedcpwrkr-server[5396]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 12:02:14 kjcf05n03 sedcpwrkr-server[5396]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 12:02:14 kjcf05n03 sedcpwrkr-server[5396]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 12:02:14 kjcf05n03 systemd[1]: Started Sed Control Plane worker process. Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 12:02:14 kjcf05n03 systemd[1]: Reloading System Logger Daemon. Nov 3 12:02:14 kjcf05n03 systemd[1]: Reloaded System Logger Daemon. Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 12:02:14 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 12:02:14 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 12:02:14 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:14 kjcf05n03 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 12:02:14 kjcf05n03 systemd-udevd[1557]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 12:02:14 kjcf05n03 iptables.init[5463]: iptables: Applying firewall rules: [ OK ] Nov 3 12:02:14 kjcf05n03 systemd[1]: Started IPv4 firewall with iptables. Nov 3 12:02:14 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:15 kjcf05n03 systemd[3189]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 12:02:15 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 12:02:15 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 12:02:15 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:16 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 12:02:16 kjcf05n03 systemd[1]: openhpid.service: Supervising process 5561 which is not our child. We'll most likely not notice when it exits. Nov 3 12:02:16 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 12:02:16 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:16 kjcf05n03 openhpid[5561]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 12:02:16 kjcf05n03 openhpid[5561]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 12:02:16 kjcf05n03 openhpid[5561]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 12:02:16 kjcf05n03 openhpid[5561]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 12:02:16 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:16 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:16 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:16 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 12:02:16 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 12:02:16 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 12:02:16 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 12:02:16 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:17 kjcf05n03 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 12:02:17 kjcf05n03 dcs-collectord[5652]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 12:02:17 kjcf05n03 hpi.inv.log[5652]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 12:02:17 kjcf05n03 dcs-collectord[5652]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 12:02:17 kjcf05n03 dcs-collectord[5652]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 12:02:17 kjcf05n03 dcs-collector[5643]: Starting dcs-collector:[ OK ] Nov 3 12:02:17 kjcf05n03 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 12:02:17 kjcf05n03 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 12:02:17 kjcf05n03 dcs-collectord[5655]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 12:02:17 kjcf05n03 dcs-collectord[5655]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 12:02:17 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 12:02:17 kjcf05n03 dcs-collectord[5655]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 12:02:17 kjcf05n03 dcs-collectord[5655]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 12:02:17 kjcf05n03 dcs-collectord[5655]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 12:02:17 kjcf05n03 dcs-collectord[5655]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 12:02:17 kjcf05n03 dcs-collectord[5655]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259349932", "units": "kB"}, {"name": "MemAvailable", "value": "258629652", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821324", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686884", "units": "kB"}, {"name": "Inactive", "value": "958556", "units": "kB"}, {"name": "Active(anon)", "value": "1520800", "units": "kB"}, {"name": "Inactive(anon)", "value": "822312", "units": "kB"}, {"name": "Active(file)", "value": "166084", "units": "kB"}, {"name": "Inactive(file)", "value": "136244", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "749300", "units": "kB"}, {"name": "Mapped", "value": "85976", "units": "kB"}, {"name": "Shmem", "value": "1593448", "units": "kB"}, {"name": "KReclaimable", "value": "109280", "units": "kB"}, {"name": "Slab", "value": "274376", "units": "kB"}, {"name": "SReclaimable", "value": "109280", "units": "kB"}, {"name": "SUnreclaim", "value": "165096", "units": "kB"}, {"name": "KernelStack", "value": "9648", "units": "kB"}, {"name": "PageTables", "value": "19396", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3173324", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11136", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "4096", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "254280", "units": "kB"}, {"name": "DirectMap2M", "value": "20582400", "units": "kB"}, {"name": "DirectMap1G", "value": "247463936", "units": "kB"}]}' Nov 3 12:02:17 kjcf05n03 dcs-collectord[5655]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 12:02:17 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:17 kjcf05n03 dcs-collectord[5655]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 12:02:17 kjcf05n03 dcs-collectord[5655]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730656937.3644106], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730656937.6031694], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730656937.2976093, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 12:02:17 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:17 kjcf05n03 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 12:02:17 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:17 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:17 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 12:02:17 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 12:02:17 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 12:02:17 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 12:02:18 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:18 kjcf05n03 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 12:02:18 kjcf05n03 firmware-update-orc[5761]: Using config script: /etc/firmware_update_orc.conf Nov 3 12:02:18 kjcf05n03 firmware-update-orc[5761]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 12:02:18 kjcf05n03 firmware-update-orc[5761]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 12:02:18 kjcf05n03 firmware-update-orc[5761]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 12:02:18 kjcf05n03 firmware-update-orc[5761]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 12:02:18 kjcf05n03 firmware-update-orc[5761]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 12:02:18 kjcf05n03 firmware-update-orc[5761]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 12:02:18 kjcf05n03 firmware-update-orc-server[5797]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 12:02:18 kjcf05n03 firmware-update-orc[5761]: celery multi v5.2.7 (dawn-chorus) Nov 3 12:02:18 kjcf05n03 firmware-update-orc[5761]: > Starting nodes... Nov 3 12:02:18 kjcf05n03 firmware-update-orc[5761]: > worker1@kjcf05n03: OK Nov 3 12:02:18 kjcf05n03 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 12:02:18 kjcf05n03 firmware-update-orc-server[5801]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 12:02:19 kjcf05n03 firmware-update-orc-server[5801]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 12:02:19 kjcf05n03 firmware-update-orc-server[5801]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 12:02:19 kjcf05n03 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 12:02:19 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:19 kjcf05n03 systemd[3189]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:19 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:19 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:19 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 12:02:19 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 12:02:19 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 12:02:19 kjcf05n03 dbus-daemon[2159]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 12:02:19 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 12:02:19 kjcf05n03 dbus-daemon[2159]: [system] Reloaded configuration Nov 3 12:02:19 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 12:02:19 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 12:02:19 kjcf05n03 dbus-daemon[2159]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 12:02:19 kjcf05n03 dbus-daemon[2159]: [system] Reloaded configuration Nov 3 12:02:19 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 12:02:19 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 12:02:19 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 12:02:19 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 12:02:19 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:19 kjcf05n03 systemd[1]: Starting Manages hardware resources... Nov 3 12:02:20 kjcf05n03 ras-resource-manager-agent[5917]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 12:02:20 kjcf05n03 ras-resource-manager-agent[5903]: Starting ras-resource-manager-agent:[ OK ] Nov 3 12:02:20 kjcf05n03 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 12:02:20 kjcf05n03 ras-resource-manager-agent[5919]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 12:02:20 kjcf05n03 ras-resource-manager-client[5919]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 12:02:20 kjcf05n03 systemd[1]: Started Manages hardware resources. Nov 3 12:02:20 kjcf05n03 ras-resource-manager-client[5919]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 12:02:20 kjcf05n03 ras-resource-manager-client[5929]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 12:02:20 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:20 kjcf05n03 systemd[3189]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:20 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:20 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:20 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 12:02:20 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 12:02:20 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:20 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 12:02:20 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:21 kjcf05n03 systemd[3189]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: Press Ctrl+C to exit. Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: Plugin support version 1.0 Nov 3 12:02:21 kjcf05n03 zabbix_agent2[6003]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 12:02:21 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:21 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:21 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:21 kjcf05n03 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 12:02:21 kjcf05n03 dcs-notification-sender[6079]: dcs-notification-senderd is stopped Nov 3 12:02:21 kjcf05n03 zabbix-agent2[6093]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 12:02:21 kjcf05n03 dcs-notification-sender[6079]: Starting notification-sender:[ OK ] Nov 3 12:02:21 kjcf05n03 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 12:02:22 kjcf05n03 zabbix-agent2[6095]: INFO DCS notification agent started. (agent.py:61) Nov 3 12:02:22 kjcf05n03 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 12:02:22 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:22 kjcf05n03 systemd[3189]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:22 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:22 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:22 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:22 kjcf05n03 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 12:02:23 kjcf05n03 dcs-collectord[6183]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 12:02:23 kjcf05n03 dcs-collectord[6183]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 12:02:23 kjcf05n03 dcs-bulk-data-sender[6183]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 12:02:23 kjcf05n03 dcs-bulk-data-sender[6174]: Starting bulk-data-sender:[ OK ] Nov 3 12:02:23 kjcf05n03 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 12:02:23 kjcf05n03 dcs-collectord[6185]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 12:02:23 kjcf05n03 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 12:02:23 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:23 kjcf05n03 systemd[3189]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:23 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:23 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:23 kjcf05n03 nscd[2190]: 2190 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 12:02:23 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 12:02:23 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 12:02:23 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 12:02:23 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 12:02:23 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 12:02:23 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 12:02:23 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 12:02:23 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 12:02:23 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 12:02:23 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 12:02:23 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 12:02:23 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 12:02:23 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 12:02:23 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 12:02:23 kjcf05n00 mcfcli[3673891]: %3|1730656943.396|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:02:24 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 12:02:24 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 12:02:24 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 12:02:24 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 12:02:24 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 12:02:24 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 12:02:24 kjcf05n03 systemd[1]: Stopping System Security Services Daemon... Nov 3 12:02:24 kjcf05n03 sssd[nss][2536]: Shutting down (status = 0) Nov 3 12:02:24 kjcf05n03 sssd[be[implicit_files]][2430]: Shutting down (status = 0) Nov 3 12:02:24 kjcf05n03 systemd[1]: sssd.service: Succeeded. Nov 3 12:02:24 kjcf05n03 systemd[1]: Stopped System Security Services Daemon. Nov 3 12:02:24 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 12:02:24 kjcf05n03 sssd[sssd][6270]: Starting up Nov 3 12:02:24 kjcf05n03 sssd[be[implicit_files]][6271]: Starting up Nov 3 12:02:24 kjcf05n03 python3.9[5225]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 12:02:25 kjcf05n03 python3.9[3189]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:25 kjcf05n03 sssd[nss][6272]: Starting up Nov 3 12:02:25 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 12:02:25 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 12:02:25 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 12:02:26 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 12:02:26 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 12:02:26 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure) defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 12:02:26 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure: defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 12:02:26 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure) defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 12:02:26 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure: defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 12:02:26 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 12:02:26 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 12:02:26 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 12:02:26 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 12:02:26 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:02:26 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:02:26 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:26 kjcf05n03 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 12:02:26 kjcf05n03 icinga2[6332]: [2024-11-03 12:02:26 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 12:02:26 kjcf05n03 icinga2[6332]: [2024-11-03 12:02:26 -0600] information/cli: Loading configuration file(s). Nov 3 12:02:26 kjcf05n03 icinga2[6332]: [2024-11-03 12:02:26 -0600] information/ConfigItem: Committing config item(s). Nov 3 12:02:26 kjcf05n03 icinga2[6332]: [2024-11-03 12:02:26 -0600] information/ApiListener: My API identity: kjcf05n03 Nov 3 12:02:26 kjcf05n03 icinga2[6332]: [2024-11-03 12:02:26 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 12:02:26 kjcf05n03 icinga2[6332]: [2024-11-03 12:02:26 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 12:02:26 kjcf05n03 icinga2[6332]: [2024-11-03 12:02:26 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 12:02:26 kjcf05n03 icinga2[6332]: [2024-11-03 12:02:26 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 12:02:26 kjcf05n03 icinga2[6332]: [2024-11-03 12:02:26 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 12:02:26 kjcf05n03 icinga2[6332]: [2024-11-03 12:02:26 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 12:02:26 kjcf05n03 icinga2[6332]: [2024-11-03 12:02:26 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 12:02:26 kjcf05n03 icinga2[6332]: [2024-11-03 12:02:26 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 12:02:26 kjcf05n03 icinga2[6332]: [2024-11-03 12:02:26 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 12:02:26 kjcf05n03 icinga2[6332]: [2024-11-03 12:02:26 -0600] information/cli: Closing console log. Nov 3 12:02:26 kjcf05n03 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 12:02:26 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:27 kjcf05n03 systemd[3189]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:27 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:27 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:27 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 12:02:27 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 12:02:27 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:28 kjcf05n03 systemd[1]: Started Icinga2 network monitor. Nov 3 12:02:28 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:28 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 12:02:28 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:28 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:28 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 12:02:28 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 12:02:28 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 12:02:28 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 12:02:28 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 12:02:28 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 12:02:28 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 12:02:28 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 12:02:28 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 12:02:28 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 12:02:28 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 12:02:28 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 12:02:28 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 12:02:28 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 12:02:29 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:29 kjcf05n03 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 12:02:29 kjcf05n03 nslcd[6943]: version 0.9.9 starting Nov 3 12:02:29 kjcf05n03 nslcd[6943]: accepting connections Nov 3 12:02:29 kjcf05n03 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 12:02:29 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:29 kjcf05n03 systemd[3189]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:29 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:29 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:29 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 12:02:29 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 12:02:29 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 12:02:29 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 12:02:30 kjcf05n03 dcs-bulk-data-sender[6185]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 12:02:30 kjcf05n03 dcs-collectord[6185]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 12:02:30 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 12:02:30 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 12:02:30 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 12:02:30 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 12:02:30 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:31 kjcf05n03 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 12:02:31 kjcf05n03 dearcpw[7036]: Using config script: /etc/dearcpw.conf Nov 3 12:02:31 kjcf05n03 dearcpw[7036]: - Creating default directory: '/var/log/dearcpw' Nov 3 12:02:31 kjcf05n03 dearcpw[7036]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 12:02:31 kjcf05n03 dearcpw[7036]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 12:02:31 kjcf05n03 dearcpw[7036]: - Creating default directory: '/var/run/dearcpw' Nov 3 12:02:31 kjcf05n03 dearcpw[7036]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 12:02:31 kjcf05n03 dearcpw[7036]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 12:02:31 kjcf05n03 dearcpw-server[7089]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 12:02:31 kjcf05n03 dearcpw[7036]: celery multi v5.2.7 (dawn-chorus) Nov 3 12:02:31 kjcf05n03 dearcpw[7036]: > Starting nodes... Nov 3 12:02:31 kjcf05n03 dearcpw[7036]: > dearcpw@kjcf05n03: OK Nov 3 12:02:31 kjcf05n03 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 12:02:31 kjcf05n03 dearcpw-server[7091]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 12:02:31 kjcf05n03 dearcpw-server[7091]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 12:02:31 kjcf05n03 dearcpw-server[7091]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 12:02:31 kjcf05n03 systemd[1]: Started DEAR Control Plane worker process. Nov 3 12:02:31 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:31 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:31 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 12:02:31 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 12:02:31 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 12:02:31 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 12:02:31 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 12:02:31 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 12:02:31 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 12:02:31 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 12:02:31 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 12:02:31 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 12:02:32 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:37130). Nov 3 12:02:32 kjcf05n01 rsyncd[3079413]: connect from kjcf05n03 (172.16.2.6) Nov 3 12:02:32 kjcf05n01 rsyncd[3079413]: rsync to puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 12:02:32 kjcf05n01 rsyncd[3079413]: receiving file list Nov 3 12:02:32 kjcf05n01 rsyncd[3079413]: sent 29 bytes received 324 bytes total size 10901 Nov 3 12:02:32 kjcf05n01 systemd[1]: rsyncd@626-172.16.2.2:873-172.16.2.6:37130.service: Succeeded. Nov 3 12:02:32 kjcf05n03 puppet[7117]: IEC: 017000000: Node is up and running: { "node": "kjcf05n03" } Nov 3 12:02:32 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 12:02:32 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 12:02:32 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 12:02:32 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 12:02:32 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 12:02:32 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 12:02:32 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 12:02:32 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 12:02:32 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 12:02:32 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 12:02:32 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 12:02:32 kjcf05n03 dcs-collectord[5655]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 12:02:33 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 12:02:33 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 12:02:33 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 12:02:33 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 12:02:33 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 12:02:33 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 12:02:33 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 12:02:33 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 12:02:34 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 12:02:34 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 12:02:34 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 12:02:34 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 12:02:35 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 12:02:35 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 12:02:35 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:35 kjcf05n03 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 12:02:35 kjcf05n03 diskless-swap[7354]: HA_PS_000: recovering journal Nov 3 12:02:35 kjcf05n03 systemd-udevd[1557]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 12:02:35 kjcf05n03 diskless-swap[7354]: HA_PS_000: clean, 2275/6400 files, 7041/25600 blocks Nov 3 12:02:35 kjcf05n03 diskless-swap[7354]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 12:02:35 kjcf05n03 diskless-swap[7354]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 12:02:35 kjcf05n03 diskless-swap[7354]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 12:02:35 kjcf05n03 diskless-swap[7354]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 12:02:35 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 12:02:35 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:35 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:35 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 12:02:35 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 12:02:35 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 12:02:35 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 12:02:35 kjcf05n03 systemd[1]: Stopping OpenSSH server daemon... Nov 3 12:02:36 kjcf05n03 systemd[1]: sshd.service: Succeeded. Nov 3 12:02:36 kjcf05n03 systemd[1]: Stopped OpenSSH server daemon. Nov 3 12:02:36 kjcf05n03 systemd[1]: Stopped target sshd-keygen.target. Nov 3 12:02:36 kjcf05n03 systemd[1]: Stopping sshd-keygen.target. Nov 3 12:02:36 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 12:02:36 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 12:02:36 kjcf05n03 ipmievd[3994]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 12:02:36 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 12:02:36 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 12:02:36 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 12:02:36 kjcf05n03 ipmievd[3994]: System Event sensor - Timestamp Clock Sync Nov 3 12:02:36 kjcf05n03 ipmievd[3189]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:36 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 12:02:36 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 12:02:36 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 12:02:36 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 12:02:36 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 12:02:36 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 12:02:37 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 12:02:37 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 12:02:37 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 12:02:37 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 12:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 12:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 12:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 12:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 12:02:37 kjcf05n00 mcfcli[3673891]: %3|1730656957.508|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:02:37 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n03": interface became available Nov 3 12:02:38 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 12:02:38 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 12:02:38 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 12:02:38 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 12:02:38 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 12:02:38 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 12:02:38 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 12:02:38 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 12:02:39 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:39 kjcf05n03 systemd[1]: Set up automount opt-firmware.automount. Nov 3 12:02:39 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:39 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:39 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 12:02:39 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 12:02:39 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:39 kjcf05n03 systemd[1]: Set up automount mnt-llog.automount. Nov 3 12:02:39 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:39 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:39 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 12:02:39 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 12:02:39 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:39 kjcf05n00 zabbix-server[1236419]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:02:39 kjcf05n00 zabbix-server[1236419]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n03 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n03:system.uptime): 00:02:36\\"}}"' Nov 3 12:02:40 kjcf05n00 log_interesting_event.py[1236419]: Event '46180' acknowledged Nov 3 12:02:40 kjcf05n03 systemd[1]: Set up automount usr-share-man.automount. Nov 3 12:02:40 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:40 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:40 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 12:02:40 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 12:02:40 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 12:02:40 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 12:02:40 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 12:02:40 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 12:02:40 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 12:02:40 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 12:02:40 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 12:02:40 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 12:02:40 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:40 kjcf05n00 zabbix-server[1236420]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:02:40 kjcf05n00 zabbix-server[1236420]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 3 12:02:40 kjcf05n00 log_interesting_event.py[1236420]: Event '46178' acknowledged Nov 3 12:02:40 kjcf05n00 zabbix-server[1236421]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:02:40 kjcf05n03 systemd[1]: Starting Crash recovery kernel arming... Nov 3 12:02:40 kjcf05n03 kdumpctl[7847]: kdump: No kdump initial ramdisk found. Nov 3 12:02:40 kjcf05n03 kdumpctl[7847]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 12:02:40 kjcf05n00 zabbix-server[1236421]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 3 12:02:40 kjcf05n00 log_interesting_event.py[1236421]: Event '46181' acknowledged Nov 3 12:02:41 kjcf05n03 dracut[7959]: dracut-049-135.git20210121.el8 Nov 3 12:02:41 kjcf05n03 dracut[7961]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 12:02:41 kjcf05n03 dracut[7961]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 12:02:41 kjcf05n03 dracut[7961]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 12:02:41 kjcf05n03 dracut[7961]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 12:02:41 kjcf05n03 dracut[7961]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 12:02:41 kjcf05n03 dracut[7961]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 12:02:41 kjcf05n03 dracut[7961]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 12:02:41 kjcf05n03 dracut[7961]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local dev holder Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + require_binaries mdadm expr Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _module_name=90hperaid Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ mdadm = \-\m ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for cmd in "$@" Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + find_binary mdadm Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for cmd in "$@" Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + find_binary expr Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n -h ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for dev in "${!host_fs_types[@]}" Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ nfs != *_raid_member ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + continue Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _ret=255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + ret=255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ 255 = 0 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ 255 = 255 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ module_depends hperaid Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: +++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: +++ set -x Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ depends Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo rootfs-block Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ return 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ _ret=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ return 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for _moddep in $(module_depends $_mod) Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all == *\ hperaid\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + add_dracutmodules+=' rootfs-block ' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ == *\ hperaid\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check_module rootfs-block Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _mod=rootfs-block Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ == *\ rootfs-block\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n '' ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all == *\ rootfs-block\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + module_check rootfs-block 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 12:02:41 kjcf05n03 kdumpctl[3189]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 2 -eq 2 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _forced=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _ret=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + ret=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ 0 = 0 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ module_depends rootfs-block Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: +++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 12:02:41 kjcf05n03 kdumpctl[3189]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ depends Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo fs-lib Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ _ret=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ return 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for _moddep in $(module_depends $_mod) Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all == *\ rootfs-block\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + add_dracutmodules+=' fs-lib ' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ == *\ rootfs-block\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check_module fs-lib Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _mod=fs-lib Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n '' ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + mods_checked_as_dep+=' fs-lib ' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all == *\ fs-lib\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + module_check fs-lib 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 2 -eq 2 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _forced=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _ret=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + ret=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ 0 = 0 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ module_depends fs-lib Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: +++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ depends Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ return 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ _ret=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ return 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + mods_to_load+=' fs-lib ' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + mods_to_load+=' rootfs-block ' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + mods_to_load+=' hperaid ' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _mod=90kernel-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _mod=kernel-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check_module kernel-modules 1 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _mod=kernel-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all = all ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + module_check kernel-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 1 -eq 2 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + true Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _ret=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + ret=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ 0 != 0 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ module_depends kernel-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: +++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ depends Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ true Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ _ret=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ return 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + mods_to_load+=' kernel-modules ' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _mod=90kernel-modules-extra Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _mod=kernel-modules-extra Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check_module kernel-modules-extra 1 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _mod=kernel-modules-extra Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all = all ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + module_check kernel-modules-extra Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 1 -eq 2 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + true Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _ret=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + ret=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ 0 != 0 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ module_depends kernel-modules-extra Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: +++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ depends Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ true Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ _ret=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ return 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + mods_to_load+=' kernel-modules-extra ' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _mod=90kernel-network-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _mod=kernel-network-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check_module kernel-network-modules 1 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _mod=kernel-network-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all = all ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + module_check kernel-network-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 1 -eq 2 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _ret=255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + ret=255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ 255 != 0 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 1 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _mod=90livenet Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _mod=livenet Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check_module livenet 1 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _mod=livenet Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all = all ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + module_check livenet Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 1 -eq 2 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _ret=255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + ret=255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ 255 != 0 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 1 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _mod=90lvm Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _mod=lvm Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check_module lvm 1 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _mod=lvm Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all = all ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + module_check lvm Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 12:02:41 kjcf05n03 kdumpctl[3189]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 1 -eq 2 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + require_binaries lvm Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _module_name=90lvm Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ lvm = \-\m ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for cmd in "$@" Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + find_binary lvm Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n -h ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for fs in "${host_fs_types[@]}" Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ nfs = LVM*_member ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _ret=255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + ret=255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ 255 != 0 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 1 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _mod=90mdraid Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _mod=mdraid Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check_module mdraid 1 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _mod=mdraid Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all = all ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + module_check mdraid Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 1 -eq 2 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _rootdev Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + require_binaries mdadm expr Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _module_name=90mdraid Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ mdadm = \-\m ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for cmd in "$@" Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + find_binary mdadm Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for cmd in "$@" Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + find_binary expr Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n -h ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for dev in "${!host_fs_types[@]}" Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ nfs != *_raid_member ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + continue Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _ret=255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + ret=255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ 255 != 0 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 1 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _mod=90multipath Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _mod=multipath Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check_module multipath 1 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _mod=multipath Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all = all ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + module_check multipath Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 1 -eq 2 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _rootdev Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n -h ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for_each_host_dev_and_slaves is_mpath Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _func=is_mpath Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _dev Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for _dev in "${host_devs[@]}" Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + continue Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 1 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _ret=255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + ret=255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ 255 != 0 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 1 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _mod=90qemu Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _mod=qemu Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check_module qemu 1 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _mod=qemu Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all = all ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + module_check qemu Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 1 -eq 2 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n -h ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + type -P systemd-detect-virt Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ systemd-detect-virt --vm Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + vm=none Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + (( 1 != 0 )) Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _ret=255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + ret=255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ 255 != 0 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 1 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _mod=90qemu-net Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _mod=qemu-net Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check_module qemu-net 1 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _mod=qemu-net Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all = all ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + module_check qemu-net Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 1 -eq 2 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n -h ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + type -P systemd-detect-virt Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ systemd-detect-virt --vm Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + vm= Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + (( 1 != 0 )) Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _ret=255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + ret=255 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ 255 != 0 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + return 1 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _mod=90stratis Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + _mod=stratis Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check_module stratis 1 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _mod=stratis Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddep Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -n 1 ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ all = all ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + module_check stratis Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ read a b Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _forced=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _hostonly=-h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 1 -eq 2 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + is_func check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: ++ type -t check Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + '[' 0 -ne 0 ']' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + check -h Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _module_name=90stratis Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + local _ret=0 Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + [[ stratisd-init = \-\m ]] Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + for cmd in "$@" Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + find_binary stratisd-init Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 12:02:41 kjcf05n03 kdumpctl[7847]: + set +x Nov 3 12:02:41 kjcf05n03 dracut[7961]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 12:02:41 kjcf05n03 dracut[7961]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 12:02:41 kjcf05n03 dracut[7961]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 12:02:41 kjcf05n03 dracut[7961]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 12:02:41 kjcf05n03 dracut[7961]: memstrack is available Nov 3 12:02:41 kjcf05n03 dracut[7961]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 12:02:41 kjcf05n03 dracut[7961]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 12:02:42 kjcf05n03 dracut[7961]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 12:02:42 kjcf05n03 dracut[7961]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 12:02:42 kjcf05n03 dracut[7961]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 12:02:42 kjcf05n03 dracut[7961]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 12:02:42 kjcf05n03 dracut[7961]: *** Including module: bash *** Nov 3 12:02:42 kjcf05n03 dracut[7961]: *** Including module: systemd *** Nov 3 12:02:43 kjcf05n03 dracut[7961]: *** Including module: fips *** Nov 3 12:02:43 kjcf05n03 dracut[7961]: *** Including module: systemd-initrd *** Nov 3 12:02:43 kjcf05n03 dracut[7961]: *** Including module: watchdog-modules *** Nov 3 12:02:43 kjcf05n03 dracut[7961]: *** Including module: nss-softokn *** Nov 3 12:02:43 kjcf05n03 dracut[7961]: *** Including module: i18n *** Nov 3 12:02:43 kjcf05n03 dracut[7961]: No KEYMAP configured. Nov 3 12:02:43 kjcf05n03 dracut[7961]: *** Including module: network-legacy *** Nov 3 12:02:44 kjcf05n03 dracut[7961]: *** Including module: network *** Nov 3 12:02:44 kjcf05n03 dracut[7961]: *** Including module: ib_bonding *** Nov 3 12:02:44 kjcf05n03 dracut[7961]: *** Including module: drm *** Nov 3 12:02:47 kjcf05n03 dcs-collectord[5655]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 12:02:47 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 12:02:47 kjcf05n03 dracut[7961]: *** Including module: hperaid *** Nov 3 12:02:47 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 12:02:47 kjcf05n03 kdumpctl[7847]: + install Nov 3 12:02:47 kjcf05n03 kdumpctl[7847]: + local rule rule_path Nov 3 12:02:47 kjcf05n03 kdumpctl[7847]: + inst_multiple cat expr Nov 3 12:02:47 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:47 kjcf05n03 kdumpctl[7847]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.2uqqCI/initramfs -a -f cat expr Nov 3 12:02:47 kjcf05n03 kdumpctl[7847]: + _ret=0 Nov 3 12:02:47 kjcf05n03 kdumpctl[7847]: + (( 0 != 0 )) Nov 3 12:02:47 kjcf05n03 kdumpctl[7847]: + : Nov 3 12:02:47 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 12:02:47 kjcf05n03 kdumpctl[7847]: + inst_multiple -o mdmon Nov 3 12:02:47 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:47 kjcf05n03 kdumpctl[7847]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.2uqqCI/initramfs -a -f -o mdmon Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + _ret=0 Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + (( 0 != 0 )) Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + : Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: ++ command -v partx Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + inst /usr/sbin/partx /sbin/partx Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + local _hostonly_install Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + [[ -e /tmp/dracut.2uqqCI/initramfs//sbin/partx ]] Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.2uqqCI/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + (( 0 != 0 )) Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + : Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: ++ command -v mdadm Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + local _hostonly_install Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + [[ -e /tmp/dracut.2uqqCI/initramfs//sbin/mdadm ]] Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.2uqqCI/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + (( 0 != 0 )) Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + : Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + [[ yes == \y\e\s ]] Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + local _raidconf Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: ++ cmdline Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: ++ local _activated dev line UUID Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: ++ declare -A _activated Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: ++ for dev in "${!host_fs_types[@]}" Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: ++ [[ nfs != *_raid_member ]] Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: ++ continue Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + _raidconf= Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + [[ -n '' ]] Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + inst_rules 64-md-raid.rules Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + local _target=/etc/udev/rules.d _rule _found Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + inst_dir /usr/lib/udev/rules.d Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + [[ -e /tmp/dracut.2uqqCI/initramfs//usr/lib/udev/rules.d ]] Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + inst_dir /etc/udev/rules.d Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + [[ -e /tmp/dracut.2uqqCI/initramfs//etc/udev/rules.d ]] Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + for _rule in "$@" Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + continue Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + continue Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + for r in '' $dracutbasedir/rules.d/ Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + [[ 64-md-raid.rules != /* ]] Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + continue Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + for r in '' $dracutbasedir/rules.d/ Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + continue Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + [[ -n '' ]] Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + set +x Nov 3 12:02:48 kjcf05n03 dracut[7961]: Skipping udev rule: 64-md-raid.rules Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + installkernel Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + instmods =drivers/md Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + local _optional=-o Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + local _silent Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + local _ret Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + [[ '' = yes ]] Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + [[ =drivers/md = \-\c ]] Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + [[ =drivers/md = \-\s ]] Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + (( 1 == 0 )) Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.2uqqCI/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + _ret=0 Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + (( 0 != 0 )) Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + [[ -n '' ]] Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + _ret=0 Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + unset check depends cmdline install installkernel Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + return 0 Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + modules_loaded+='hperaid ' Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + '[' -n '' ']' Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + _d_mod=90kernel-modules Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + _d_mod=kernel-modules Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + [[ '' = yes ]] Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + dinfo '*** Including module: kernel-modules ***' Nov 3 12:02:48 kjcf05n03 kdumpctl[7847]: + set +x Nov 3 12:02:48 kjcf05n03 dracut[7961]: *** Including module: kernel-modules *** Nov 3 12:02:48 kjcf05n03 dracut[7961]: *** Including module: kernel-modules-extra *** Nov 3 12:02:48 kjcf05n03 dracut[7961]: *** Including module: kernel-network-modules *** Nov 3 12:02:49 kjcf05n03 dracut[7961]: *** Including module: diskless-mod *** Nov 3 12:02:49 kjcf05n03 dracut[7961]: *** Including module: fstab-sys *** Nov 3 12:02:49 kjcf05n03 dracut[7961]: *** Including module: nfs *** Nov 3 12:02:49 kjcf05n03 dracut[7961]: *** Including module: rootfs-block *** Nov 3 12:02:49 kjcf05n03 dracut[7961]: *** Including module: terminfo *** Nov 3 12:02:49 kjcf05n03 dracut[7961]: *** Including module: udev-rules *** Nov 3 12:02:50 kjcf05n03 dracut[7961]: Skipping udev rule: 91-permissions.rules Nov 3 12:02:50 kjcf05n03 dracut[7961]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 12:02:50 kjcf05n03 dracut[7961]: *** Including module: dracut-systemd *** Nov 3 12:02:50 kjcf05n03 dracut[7961]: *** Including module: usrmount *** Nov 3 12:02:50 kjcf05n03 dracut[7961]: *** Including module: base *** Nov 3 12:02:51 kjcf05n03 dracut[7961]: *** Including module: fs-lib *** Nov 3 12:02:51 kjcf05n03 dracut[7961]: *** Including module: kdumpbase *** Nov 3 12:02:51 kjcf05n03 dracut[7961]: *** Including module: memstrack *** Nov 3 12:02:51 kjcf05n03 dracut[7961]: *** Including module: shutdown *** Nov 3 12:02:51 kjcf05n03 dracut[7961]: *** Including module: squash *** Nov 3 12:02:52 kjcf05n03 dracut[7961]: *** Including modules done *** Nov 3 12:02:52 kjcf05n03 dracut[7961]: *** Installing kernel module dependencies *** Nov 3 12:02:52 kjcf05n03 dracut[7961]: *** Installing kernel module dependencies done *** Nov 3 12:02:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730656971', 'host':'kjcf05n03', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.4% (3698360 kB) used.'}"] Nov 3 12:02:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'RAM usage', 'description': 'OK - 1.4% (3698360 kB) used.', 'message': 'OK - 1.4% (3698360 kB) used.', 'value': 'ok', 'timestamp': '1730656971'} Nov 3 12:02:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:02:52 kjcf05n03 dracut[7961]: *** Resolving executable dependencies *** Nov 3 12:02:53 kjcf05n03 dracut[7961]: *** Resolving executable dependencies done*** Nov 3 12:02:53 kjcf05n03 dracut[7961]: *** Hardlinking files *** Nov 3 12:02:53 kjcf05n03 dracut[7961]: *** Hardlinking files done *** Nov 3 12:02:53 kjcf05n03 dracut[7961]: *** Generating early-microcode cpio image *** Nov 3 12:02:53 kjcf05n03 dracut[7961]: *** Constructing AuthenticAMD.bin **** Nov 3 12:02:53 kjcf05n03 dracut[7961]: *** Store current command line parameters *** Nov 3 12:02:53 kjcf05n03 dracut[7961]: Stored kernel commandline: Nov 3 12:02:53 kjcf05n03 dracut[7961]: rd.driver.pre=sd_mod Nov 3 12:02:53 kjcf05n03 dracut[7961]: rd.driver.pre=nvme Nov 3 12:02:53 kjcf05n03 dracut[7961]: rd.driver.pre=ipmi_si Nov 3 12:02:53 kjcf05n03 dracut[7961]: rd.driver.pre=ipmi_devintf Nov 3 12:02:53 kjcf05n03 dracut[7961]: rd.driver.pre=ipmi_msghandler Nov 3 12:02:53 kjcf05n03 dracut[7961]: nameserver=172.16.2.2 Nov 3 12:02:53 kjcf05n03 dracut[7961]: nameserver=127.0.0.1 Nov 3 12:02:53 kjcf05n03 dracut[7961]: nameserver=172.16.2.2 Nov 3 12:02:53 kjcf05n03 dracut[7961]: nameserver=127.0.0.1 Nov 3 12:02:53 kjcf05n03 dracut[7961]: ifname=kdump-meth0:00:09:3d:06:9a:1a team=mgmt0:kdump-meth0 Nov 3 12:02:53 kjcf05n03 dracut[7961]: rd.neednet Nov 3 12:02:53 kjcf05n03 dracut[7961]: kdumpnic=mgmt0 Nov 3 12:02:53 kjcf05n03 dracut[7961]: bootdev=mgmt0 Nov 3 12:02:53 kjcf05n03 dracut[7961]: *** Install squash loader *** Nov 3 12:02:54 kjcf05n03 dracut[7961]: *** Squashing the files inside the initramfs *** Nov 3 12:02:54 kjcf05n03 dracut[7961]: *** Squashing the files inside the initramfs done *** Nov 3 12:02:54 kjcf05n03 dracut[7961]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 12:02:54 kjcf05n03 dracut[7961]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 12:02:55 kjcf05n03 kdumpctl[7847]: kdump: kexec: loaded kdump kernel Nov 3 12:02:55 kjcf05n03 kdumpctl[7847]: kdump: Starting kdump: [OK] Nov 3 12:02:55 kjcf05n03 systemd[1]: Started Crash recovery kernel arming. Nov 3 12:02:55 kjcf05n03 systemd[1]: Reloading. Nov 3 12:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 12:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 12:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 12:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 12:02:56 kjcf05n03 systemd[3189]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:02:56 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:02:56 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:02:56 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 12:02:56 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 12:02:56 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 12:02:56 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 12:02:56 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 12:02:56 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 12:02:56 kjcf05n03 ifdown[14556]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 12:02:56 kjcf05n03 ifdown[14557]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:02:56 kjcf05n03 ifdown[14558]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:02:56 kjcf05n03 ifup[14631]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 12:02:56 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 12:02:56 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 12:02:56 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 12:02:56 kjcf05n03 ifup[14632]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:02:56 kjcf05n03 ifup[14633]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:02:58 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 12:02:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730656978', 'host':'kjcf05n03', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(672.0B/180.0B), ib1=(0.0B/0.0B), icl0=(4.7kB/6.3kB), lo=(500.0B/500.0B), meth0=(1541.0MB/7.6MB), mgmt0=(1477.8MB/7.5MB)'}"] Nov 3 12:02:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(672.0B/180.0B), ib1=(0.0B/0.0B), icl0=(4.7kB/6.3kB), lo=(500.0B/500.0B), meth0=(1541.0MB/7.6MB), mgmt0=(1477.8MB/7.5MB)', 'message': 'NET OK - (Rx/Tx) ib0=(672.0B/180.0B), ib1=(0.0B/0.0B), icl0=(4.7kB/6.3kB), lo=(500.0B/500.0B), meth0=(1541.0MB/7.6MB), mgmt0=(1477.8MB/7.5MB)', 'value': 'ok', 'timestamp': '1730656978'} Nov 3 12:02:58 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:02:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730656978', 'host':'kjcf05n03', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 12:02:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730656978'} Nov 3 12:02:58 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:03:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 12:03:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 12:03:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 12:03:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 12:03:00 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 12:03:00 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 12:03:00 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 12:03:00 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:03:00 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:03:00 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:03:00 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:03:00 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 12:03:00 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 12:03:00 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 12:03:00 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 12:03:00 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:03:00 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:03:00 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:03:00 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:03:00 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 12:03:00 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 12:03:00 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 12:03:00 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 12:03:00 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 12:03:00 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 12:03:00 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 12:03:00 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 12:03:00 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 12:03:00 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 12:03:00 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 12:03:00 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 12:03:00 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 12:03:00 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 12:03:00 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 12:03:00 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 12:03:00 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 12:03:00 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 12:03:00 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 12:03:00 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 12:03:00 kjcf05n03 ifdown[14816]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 12:03:00 kjcf05n03 ifdown[14817]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:03:00 kjcf05n03 ifdown[14818]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:03:01 kjcf05n02 LCNmon[17882]: 10.16.100.53 is unreachable via ib0 Nov 3 12:03:01 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib0 Nov 3 12:03:01 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 12:03:01 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 12:03:01 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 12:03:00 kjcf05n00 mcfcli[3673891]: %3|1730656980.948|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:03:01 kjcf05n03 ifup[14893]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 12:03:01 kjcf05n03 ifup[14894]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:03:01 kjcf05n03 ifup[14895]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:03:02 kjcf05n03 dcs-collectord[5655]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 12:03:02 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 12:03:04 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 12:03:05 kjcf05n02 LCNmon[17882]: 10.16.100.59 is unreachable via ib1 Nov 3 12:03:05 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 12:03:05 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 12:03:05 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 12:03:05 kjcf05n03 systemd[1]: Reloading. Nov 3 12:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730656985', 'host':'kjcf05n03', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 12:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730656985'} Nov 3 12:03:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730656985', 'host':'kjcf05n03', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 12:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730656985'} Nov 3 12:03:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:03:06 kjcf05n03 systemd[1]: Starting Corosync Cluster Engine... Nov 3 12:03:06 kjcf05n03 await_ha_peer[15109]: Waiting for HA peer kjcf05n02 Nov 3 12:03:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730656986', 'host':'kjcf05n03', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 12:03:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730656986'} Nov 3 12:03:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:03:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730656986', 'host':'kjcf05n03', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 332 processes with STATE = RSZDT '}"] Nov 3 12:03:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Total Processes', 'description': 'PROCS OK: 332 processes with STATE = RSZDT ', 'message': 'PROCS OK: 332 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730656986'} Nov 3 12:03:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:03:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730656986', 'host':'kjcf05n03', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.65, 1.81, 0.82'}"] Nov 3 12:03:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Load', 'description': 'OK - load average: 1.65, 1.81, 0.82', 'message': 'OK - load average: 1.65, 1.81, 0.82', 'value': 'ok', 'timestamp': '1730656986'} Nov 3 12:03:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:03:07 kjcf05n03 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 12:03:07 kjcf05n03 await_ha_peer[15109]: Peer kjcf05n02 has started, starting HA Nov 3 12:03:07 kjcf05n00 mcfcli[3673891]: %3|1730656987.508|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:03:07 kjcf05n03 systemd[1]: Started Corosync Cluster Engine. Nov 3 12:03:07 kjcf05n03 systemd[1]: Started Fast STONITH daemon. Nov 3 12:03:07 kjcf05n03 fstonithd.py[15172]: Listening for kdump packets from partner Nov 3 12:03:07 kjcf05n03 systemd[1]: Reloading. Nov 3 12:03:08 kjcf05n03 systemd[3189]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:03:08 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:03:08 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:03:08 kjcf05n03 systemd[1]: Reloading. Nov 3 12:03:08 kjcf05n03 systemd[1]: Reached target resource-agents dependencies. Nov 3 12:03:08 kjcf05n03 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 12:03:08 kjcf05n03 systemd[1]: Reloading. Nov 3 12:03:09 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 12:03:09 kjcf05n03 puppet-agent[3610]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:03:09 kjcf05n03 puppet[3610]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:03:09 kjcf05n03 puppet-agent[3610]: Applied catalog in 91.61 seconds Nov 3 12:03:09 kjcf05n03 puppet[3610]: Notice: Applied catalog in 91.61 seconds Nov 3 12:03:09 kjcf05n03 systemd[1]: Started Puppet agent. Nov 3 12:03:09 kjcf05n03 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 12:03:09 kjcf05n03 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 12:03:09 kjcf05n03 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 12:03:09 kjcf05n03 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 12:03:09 kjcf05n03 systemd[1]: Reached target Timers. Nov 3 12:03:09 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 12:03:09 kjcf05n03 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 12:03:09 kjcf05n03 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 12:03:09 kjcf05n03 systemd[1]: Starting Set absolute GEM time... Nov 3 12:03:09 kjcf05n03 wce-disable.sh[15315]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 12:03:09 kjcf05n03 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 12:03:09 kjcf05n03 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 12:03:09 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 12:03:09 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 12:03:09 kjcf05n03 systemd[1]: set_gem_time.service: Succeeded. Nov 3 12:03:09 kjcf05n03 systemd[1]: Started Set absolute GEM time. Nov 3 12:03:09 kjcf05n03 gateway-ec-node.py[15312]: Starting gateway-ec-node service Nov 3 12:03:09 kjcf05n03 python3.9[15313]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 12:03:09 kjcf05n03 python3.9[15313]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 12:03:09 kjcf05n03 RFSF-API[15311]: INFO[2024-11-03T12:03:09-06:00] Datapath API RESTful Service starting Nov 3 12:03:09 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-03T12:03:09-06:00] Datapath API RESTful Service starting Nov 3 12:03:09 kjcf05n03 RFSF-API[15311]: INFO[2024-11-03T12:03:09-06:00] Running in production mode, starting dbus event listener Nov 3 12:03:09 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-03T12:03:09-06:00] Running in production mode, starting dbus event listener Nov 3 12:03:09 kjcf05n03 RFSF-API[15311]: INFO[2024-11-03T12:03:09-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 12:03:09 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-03T12:03:09-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 12:03:09 kjcf05n03 RFSF-API[15311]: INFO[2024-11-03T12:03:09-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 12:03:09 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-03T12:03:09-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 12:03:09 kjcf05n03 RFSF-API[15311]: INFO[2024-11-03T12:03:09-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 12:03:09 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-03T12:03:09-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 12:03:09 kjcf05n03 RFSF-API[15311]: INFO[2024-11-03T12:03:09-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 12:03:09 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-03T12:03:09-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 12:03:09 kjcf05n03 RFSF-API[15311]: INFO[2024-11-03T12:03:09-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 12:03:09 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-03T12:03:09-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 12:03:09 kjcf05n03 RFSF-API[15311]: INFO[2024-11-03T12:03:09-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 12:03:09 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-03T12:03:09-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 12:03:09 kjcf05n03 RFSF-API[15311]: INFO[2024-11-03T12:03:09-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 12:03:09 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-03T12:03:09-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 12:03:09 kjcf05n03 RFSF-API[15311]: INFO[2024-11-03T12:03:09-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 12:03:09 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-03T12:03:09-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 12:03:09 kjcf05n03 RFSF-API[15311]: INFO[2024-11-03T12:03:09-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 12:03:09 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-03T12:03:09-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 12:03:09 kjcf05n03 RFSF-API[15311]: INFO[2024-11-03T12:03:09-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 12:03:09 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-03T12:03:09-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 12:03:12 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31434 deleted. Nov 3 12:03:15 kjcf05n03 systemd[1]: Reloading. Nov 3 12:03:16 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 12:03:16 kjcf05n03 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 12:03:16 kjcf05n03 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 12:03:16 kjcf05n03 diskmonitor_pre[15924]: Key management is currently disabled.DEAR disabled Nov 3 12:03:16 kjcf05n03 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 12:03:17 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 12:03:17 kjcf05n03 dcs-collectord[5655]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 12:03:17 kjcf05n03 dcs-collectord[5655]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 12:03:18 kjcf05n03 sh[15921]: LNET configured: New Created Nov 3 12:03:18 kjcf05n03 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 12:03:18 kjcf05n03 LCNmon[17957]: Interface ib0 is up Nov 3 12:03:18 kjcf05n03 LCNmon[17957]: Interface ib1 is up Nov 3 12:03:18 kjcf05n03 LCNmon[17957]: Can ping through interface ib0 Nov 3 12:03:18 kjcf05n00 httpd[902564]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-B): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n03', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 12:03:19 kjcf05n03 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 12:03:20 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18130 (bash) Nov 3 12:03:20 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 12:03:20 kjcf05n03 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 12:03:20 kjcf05n03 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 12:03:20 kjcf05n03 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 12:03:20 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: /var/run/diskmonitor does not exist, creating Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: Creating /var/run/diskmonitor/disk Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: Creating /var/run/diskmonitor/encl Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: Creating /var/run/diskmonitor/cli Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: RAS_Interlocks_enabled: 1 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: add handler for sig: 14 sa_flags: 10000004 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: add handler for sig: 1 sa_flags: 10000004 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: add handler for sig: 2 sa_flags: 00000004 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: add handler for sig: 15 sa_flags: 00000004 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: add handler for sig: 6 sa_flags: 00000004 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: add handler for sig: 3 sa_flags: 00000004 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: add handler for sig: 30 sa_flags: 00000004 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: add handler for sig: 20 sa_flags: 00000004 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: add handler for sig: 10 sa_flags: 10000004 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: add handler for sig: 11 sa_flags: 00000004 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: add handler for sig: 7 sa_flags: 00000004 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: add handler for sig: 4 sa_flags: 00000004 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: add handler for sig: 8 sa_flags: 00000004 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: Using HA Baton locks - key: diskmonitor Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: Baton will be held for at most 570 seconds Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: DMMP Enabled: 0 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: random seed: 2dc5b307 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: NVMe Enclosure: 1 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: ZFS Enclosure: 0 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: Dbus, Initialized Connection Successfully Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: int_catcher_thread: thread start Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: Received dbus message 4 org.freedesktop.DBus -> :1.98 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b07bec_S4EUNF0MA05386M encl_slot: 0 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b07bed_S4EUNF0MA05387D encl_slot: 0 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 12:03:20 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 12:03:22 kjcf05n03 openhpid[5561]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 12:03:22 kjcf05n03 openhpid[5561]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 12:03:22 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib1 Nov 3 12:03:22 kjcf05n03 LCNmon[17957]: Can ping through interface ib1 Nov 3 12:03:22 kjcf05n03 LCNmon[17957]: NIC ib0, initial state UP Nov 3 12:03:22 kjcf05n03 LCNmon[17957]: NIC ib1, initial state UP Nov 3 12:03:22 kjcf05n03 LCNmon[17957]: LCNstat initial state UP Nov 3 12:03:22 kjcf05n03 systemd[1]: openhpid.service: Succeeded. Nov 3 12:03:22 kjcf05n03 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 12:03:22 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 12:03:22 kjcf05n03 systemd[1]: openhpid.service: Supervising process 18524 which is not our child. We'll most likely not notice when it exits. Nov 3 12:03:22 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 12:03:22 kjcf05n03 systemd[1]: Reached target Multi-User System. Nov 3 12:03:22 kjcf05n03 systemd[1]: Reached target Graphical Interface. Nov 3 12:03:22 kjcf05n03 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 12:03:22 kjcf05n03 dcs-collectord[5655]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 12:03:22 kjcf05n03 LCNmon[17957]: LCNmon monitoring hosts kjcf05n03 and kjcf05n02 Nov 3 12:03:22 kjcf05n03 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 12:03:22 kjcf05n03 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 12:03:22 kjcf05n03 systemd[1]: Startup finished in 50.646s (kernel) + 2min 28.176s (userspace) = 3min 18.822s. Nov 3 12:03:22 kjcf05n03 openhpid[18524]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 12:03:22 kjcf05n03 openhpid[18524]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 12:03:22 kjcf05n03 openhpid[18524]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 12:03:22 kjcf05n03 openhpid[18524]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b07bed_S4EUNF0MA05387D encl_sn: USE26000024VS001, slot: 2 Nov 3 12:03:26 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 12:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T12:03:27.252927836-06:00 level=info msg="Completed cleanup jobs" duration=26.203094ms Nov 3 12:03:32 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 12:03:32 kjcf05n03 dcs-collectord[5655]: WARNING No data collected (hpi_parser.py:353) Nov 3 12:03:37 kjcf05n00 mcfcli[3673891]: %3|1730657017.508|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:03:40 kjcf05n00 mcfcli[3673891]: %3|1730657020.945|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:03:46 kjcf05n03 ipmievd[3994]: System Event sensor - Timestamp Clock Sync Nov 3 12:03:47 kjcf05n03 ipmievd[3189]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:03:47 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b07bec_S4EUNF0MA05386M encl_sn: USE26000024VS001, slot: 1 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 12:03:59 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 12:04:02 kjcf05n03 dcs-collectord[5655]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 12:04:06 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '0451c58c-9a0e-11ef-8056-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 12:04:06 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '0451c58c-9a0e-11ef-8056-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 12:04:06 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '0451c58c-9a0e-11ef-8056-00093d069a1b', 'response ID': '045ceebc-9a0e-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 12:04:06 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 045ceebc-9a0e-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 12:04:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730657046', 'host':'kjcf05n03', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 12:04:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730657046'} Nov 3 12:04:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:04:06 kjcf05n02 firmware-update-orc-server[5831]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "d29ff557-8c53-453c-82fa-213368771a19"} (logger.py:65) Nov 3 12:04:06 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 145291 (get_disk_device) Nov 3 12:04:06 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 12:04:06 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 12:04:06 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db01007002538450000000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 12:04:06 kjcf05n03 ras-resource-manager-agent[5919]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "0451c58c-9a0e-11ef-8056-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 12:04:06 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '0451c58c-9a0e-11ef-8056-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 12:04:06 kjcf05n03 ras-resource-manager-agent[5919]: INFO Submitting new device inserted signal, starting to qualify drive: 0451c58c-9a0e-11ef-8056-00093d069a1b (admin_action.py:110) Nov 3 12:04:07 kjcf05n02 ccp-client[145316]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 12:04:07 kjcf05n02 ccp-client[145316]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 12:04:07 kjcf05n02 ccp-client[145325]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 12:04:07 kjcf05n02 ccp-client[145316]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 12:04:07 kjcf05n02 ccp-client[145316]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 12:04:07 kjcf05n02 ccp-client[145325]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 12:04:07 kjcf05n02 ccp-client[145325]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 12:04:06 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '049e0c4e-9a0e-11ef-8056-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 12:04:06 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '049e0c4e-9a0e-11ef-8056-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 12:04:07 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '049e0c4e-9a0e-11ef-8056-00093d069a1b', 'response ID': '04a60548-9a0e-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 12:04:07 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 04a60548-9a0e-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 12:04:07 kjcf05n03 diskmonitor[17569]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 12:04:07 kjcf05n03 ras-resource-manager-agent[5919]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "049e0c4e-9a0e-11ef-8056-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 12:04:07 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '049e0c4e-9a0e-11ef-8056-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 12:04:07 kjcf05n03 ras-resource-manager-agent[5919]: INFO Submitting new device inserted signal, starting to qualify drive: 049e0c4e-9a0e-11ef-8056-00093d069a1b (admin_action.py:110) Nov 3 12:04:07 kjcf05n03 firmware-update-orc-server[5875]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "a0767825-a5a9-4d38-8ff6-2a13e9dc267e"} (logger.py:65) Nov 3 12:04:07 kjcf05n00 mcfcli[3673891]: %3|1730657047.509|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 12:04:10 kjcf05n02 DRVFW[145436]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 12:04:10 kjcf05n02 ccp-client[145437]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 12:04:10 kjcf05n02 ccp-client[145437]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 12:04:10 kjcf05n02 ccp-client[145462]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 12:04:10 kjcf05n02 ccp-client[145437]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 12:04:10 kjcf05n02 ccp-client[145437]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 12:04:10 kjcf05n02 ccp-client[145462]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 12:04:10 kjcf05n02 ccp-client[145462]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 12:04:10 kjcf05n02 firmware-update-orc-server[5831]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 12:04:10 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 045ceebc-9a0e-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 12:04:10 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '0451c58c-9a0e-11ef-8056-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': '0451c58c-9a0e-11ef-8056-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}}} (logger.py:65) Nov 3 12:04:10 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '0451c58c-9a0e-11ef-8056-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 12:04:10 kjcf05n03 ras-resource-manager-agent[5919]: INFO Drive qualification complete responding: 0451c58c-9a0e-11ef-8056-00093d069a1b (admin_action.py:205) Nov 3 12:04:10 kjcf05n03 ras-resource-manager-agent[5919]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "0451c58c-9a0e-11ef-8056-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (interesting_event.py:59) Nov 3 12:04:12 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31435 deleted. Nov 3 12:04:14 kjcf05n03 diskmonitor[17569]: 4 Nov 3 12:04:14 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 12:04:14 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 12:04:14 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 12:04:14 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 12:04:14 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 12:04:14 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 12:04:14 kjcf05n03 diskmonitor[17569]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 12:04:14 kjcf05n03 diskmonitor[17569]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 12:04:14 kjcf05n03 diskmonitor[17569]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 12:04:14 kjcf05n03 diskmonitor[17569]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 12:04:14 kjcf05n03 diskmonitor[17569]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 12:04:14 kjcf05n03 diskmonitor[17569]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "0451c58c-9a0e-11ef-8056-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 12:04:14 kjcf05n03 diskmonitor[17569]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 12:04:14 kjcf05n03 diskmonitor[17569]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 12:04:14 kjcf05n03 diskmonitor[17569]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "049e0c4e-9a0e-11ef-8056-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 12:04:14 kjcf05n03 diskmonitor[17569]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 12:04:14 kjcf05n03 diskmonitor[17569]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 12:04:19 kjcf05n00 mcfcli[3673891]: %3|1730657059.501|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:04:19 kjcf05n03 chronyd[5163]: Selected source 172.16.2.1 Nov 3 12:04:20 kjcf05n03 systemd[1]: Unmounting /mnt/llog... Nov 3 12:04:20 kjcf05n03 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 12:04:20 kjcf05n03 systemd[1]: Unmounted /mnt/llog. Nov 3 12:04:22 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22376 (get_disk_device) Nov 3 12:04:22 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 12:04:22 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 12:04:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730657062}"] Nov 3 12:04:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730657062, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:04:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:04:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730657062}"] Nov 3 12:04:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730657062, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:04:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:04:22 kjcf05n03 ccp-client[22430]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 12:04:22 kjcf05n03 ccp-client[22430]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 12:04:22 kjcf05n03 ccp-client[22483]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 12:04:22 kjcf05n03 ccp-client[22430]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 12:04:22 kjcf05n03 ccp-client[22430]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 12:04:22 kjcf05n03 ccp-client[22483]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 12:04:22 kjcf05n03 ccp-client[22483]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 12:04:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730657062}"] Nov 3 12:04:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730657062, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:04:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:04:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730657062}"] Nov 3 12:04:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730657062, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:04:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:04:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730657062}"] Nov 3 12:04:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730657062, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:04:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:04:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730657062}"] Nov 3 12:04:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730657062, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:04:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:04:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730657062}"] Nov 3 12:04:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730657062, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:04:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:04:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730657062}"] Nov 3 12:04:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730657062, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:04:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:04:24 kjcf05n03 ras-resource-manager-agent[5919]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "0451c58c-9a0e-11ef-8056-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (service_main_handler.py:66) Nov 3 12:04:24 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '0451c58c-9a0e-11ef-8056-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 12:04:24 kjcf05n03 ras-resource-manager-agent[5919]: INFO Device qualification response has been acknowledged: 0451c58c-9a0e-11ef-8056-00093d069a1b (admin_action.py:151) Nov 3 12:04:25 kjcf05n03 DRVFW[22873]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 12:04:25 kjcf05n03 ccp-client[22874]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 12:04:25 kjcf05n03 ccp-client[22874]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 12:04:25 kjcf05n03 ccp-client[22911]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 12:04:25 kjcf05n03 ccp-client[22874]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 12:04:25 kjcf05n03 ccp-client[22874]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 12:04:25 kjcf05n03 ccp-client[22911]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 12:04:25 kjcf05n03 ccp-client[22911]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 12:04:25 kjcf05n03 firmware-update-orc-server[5875]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 12:04:25 kjcf05n03 python3.9[5225]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 12:04:27 kjcf05n03 python3.9[3189]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:04:27 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '049e0c4e-9a0e-11ef-8056-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 12:04:27 kjcf05n03 ras-resource-manager-agent[5919]: INFO Drive qualification complete responding: 049e0c4e-9a0e-11ef-8056-00093d069a1b (admin_action.py:205) Nov 3 12:04:27 kjcf05n03 ras-resource-manager-agent[5919]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "049e0c4e-9a0e-11ef-8056-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (interesting_event.py:59) Nov 3 12:04:27 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 04a60548-9a0e-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 12:04:27 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '049e0c4e-9a0e-11ef-8056-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': '049e0c4e-9a0e-11ef-8056-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}}} (logger.py:65) Nov 3 12:04:28 kjcf05n03 diskmonitor[17569]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 12:04:29 kjcf05n03 diskmonitor[17569]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 12:04:29 kjcf05n03 ras-resource-manager-agent[5919]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "11b99b82-9a0e-11ef-8056-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 12:04:29 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '11b99b82-9a0e-11ef-8056-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 12:04:29 kjcf05n03 ras-resource-manager-agent[5919]: INFO Requests ['049e0c4e-9a0e-11ef-8056-00093d069a1b', '11b99b82-9a0e-11ef-8056-00093d069a1b'] already in progress (admin_action.py:99) Nov 3 12:04:29 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '11b99b82-9a0e-11ef-8056-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 12:04:29 kjcf05n03 ras-resource-manager-agent[5919]: INFO Drive qualification complete responding: 11b99b82-9a0e-11ef-8056-00093d069a1b (admin_action.py:205) Nov 3 12:04:29 kjcf05n03 ras-resource-manager-agent[5919]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "049e0c4e-9a0e-11ef-8056-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (interesting_event.py:59) Nov 3 12:04:29 kjcf05n03 ras-resource-manager-agent[5919]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "11b99b82-9a0e-11ef-8056-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (interesting_event.py:59) Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "0451c58c-9a0e-11ef-8056-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: Dbus, handle_ingress_ras_signals, uuid: 0451c58c-9a0e-11ef-8056-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "0451c58c-9a0e-11ef-8056-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: main: Pending firmware leveling requests exist, rescanning disks Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "11b99b82-9a0e-11ef-8056-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: leaving test state: 1 next state: 2 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: lock req: no timeout Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: leaving test state: 2 next state: 4 Nov 3 12:04:34 kjcf05n03 diskmonitor[17569]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 12:04:37 kjcf05n00 mcfcli[3673891]: %3|1730657077.509|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 12:04:43 kjcf05n00 zabbix-server[1237709]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:04:43 kjcf05n00 zabbix-server[1237709]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 59.83\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 81.52\\"}}"' Nov 3 12:04:43 kjcf05n00 log_interesting_event.py[1237709]: Event '46195' acknowledged Nov 3 12:04:53 kjcf05n03 ras-resource-manager-agent[5919]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "049e0c4e-9a0e-11ef-8056-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (service_main_handler.py:66) Nov 3 12:04:53 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '049e0c4e-9a0e-11ef-8056-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 12:04:53 kjcf05n03 ras-resource-manager-agent[5919]: INFO Device qualification response has been acknowledged: 049e0c4e-9a0e-11ef-8056-00093d069a1b (admin_action.py:151) Nov 3 12:04:53 kjcf05n03 ras-resource-manager-agent[5919]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "049e0c4e-9a0e-11ef-8056-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (service_main_handler.py:66) Nov 3 12:04:53 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '049e0c4e-9a0e-11ef-8056-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 12:04:53 kjcf05n03 ras-resource-manager-agent[5919]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "11b99b82-9a0e-11ef-8056-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (service_main_handler.py:66) Nov 3 12:04:53 kjcf05n03 ras-resource-manager-agent[5919]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '11b99b82-9a0e-11ef-8056-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 12:04:53 kjcf05n03 ras-resource-manager-agent[5919]: INFO Device qualification response has been acknowledged: 11b99b82-9a0e-11ef-8056-00093d069a1b (admin_action.py:151) Nov 3 12:04:54 kjcf05n03 diskmonitor[17569]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 12:04:55 kjcf05n00 mcfcli[3673891]: %3|1730657095.473|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:05:07 kjcf05n00 mcfcli[3673891]: %3|1730657107.510|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 12:05:09 kjcf05n00 python3.9[1237867]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 12:05:11 kjcf05n03 diskmonitor[17569]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "049e0c4e-9a0e-11ef-8056-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 3 12:05:11 kjcf05n03 diskmonitor[17569]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 12:05:11 kjcf05n03 diskmonitor[17569]: Dbus, handle_ingress_ras_signals, uuid: 049e0c4e-9a0e-11ef-8056-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 12:05:11 kjcf05n03 diskmonitor[17569]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 12:05:11 kjcf05n03 diskmonitor[17569]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "049e0c4e-9a0e-11ef-8056-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 3 12:05:11 kjcf05n03 diskmonitor[17569]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "049e0c4e-9a0e-11ef-8056-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 3 12:05:11 kjcf05n03 diskmonitor[17569]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 12:05:11 kjcf05n03 diskmonitor[17569]: Dbus, handle_ingress_ras_signals, uuid: 049e0c4e-9a0e-11ef-8056-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 12:05:11 kjcf05n03 diskmonitor[17569]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "049e0c4e-9a0e-11ef-8056-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 3 12:05:11 kjcf05n03 diskmonitor[17569]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "11b99b82-9a0e-11ef-8056-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 3 12:05:11 kjcf05n03 diskmonitor[17569]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 12:05:11 kjcf05n03 diskmonitor[17569]: Dbus, handle_ingress_ras_signals, uuid: 11b99b82-9a0e-11ef-8056-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 12:05:11 kjcf05n03 diskmonitor[17569]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "11b99b82-9a0e-11ef-8056-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 3 12:05:11 kjcf05n03 diskmonitor[17569]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 12:05:11 kjcf05n03 diskmonitor[17569]: lock acquired Nov 3 12:05:11 kjcf05n03 diskmonitor[17569]: leaving test state: 4 next state: 8 Nov 3 12:05:11 kjcf05n03 diskmonitor[17569]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 12:05:20 kjcf05n03 diskmonitor[17569]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 12:05:20 kjcf05n03 diskmonitor[17569]: leaving test state: 8 next state: 20 Nov 3 12:05:20 kjcf05n03 diskmonitor[17569]: leaving test state: 20 next state: 40 Nov 3 12:05:20 kjcf05n03 diskmonitor[17569]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset e64f5a0000 Nov 3 12:05:20 kjcf05n03 diskmonitor[17569]: leaving test state: 40 next state: 80 Nov 3 12:05:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730656851', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 12:05:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730656851'} Nov 3 12:05:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:05:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730656851', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 12:05:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730656851'} Nov 3 12:05:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:05:27 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 12:05:28 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 12:05:28 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 12:05:32 kjcf05n00 mcfcli[3673891]: %3|1730657132.890|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:05:37 kjcf05n00 mcfcli[3673891]: %3|1730657137.510|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 12:05:43 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 12:05:43 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 12:05:43 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 12:05:43 kjcf05n03 dcs-collectord[5655]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 12:05:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730657153}"] Nov 3 12:05:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730657153, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:05:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:05:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:05:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:05:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:05:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:05:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:05:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:05:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:05:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:05:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:05:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:05:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:05:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:05:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.116615ms Nov 3 12:05:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:05:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.116615ms Nov 3 12:05:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:05:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:05:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:05:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730657154}"] Nov 3 12:05:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730657154, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:05:54 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:05:54-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:05:54 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:05:54-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:05:54 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:05:54-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:05:54 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:05:54-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:05:54 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:05:54-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:05:54 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:05:54-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:05:54 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:05:54-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.334752ms Nov 3 12:05:54 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:05:54-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.334752ms Nov 3 12:05:54 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:05:54 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:05:54 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:06:07 kjcf05n00 mcfcli[3673891]: %3|1730657167.511|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 12:06:10 kjcf05n00 mcfcli[3673891]: %3|1730657170.960|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:06:19 kjcf05n03 diskmonitor[17569]: leaving test state: 80 next state: 100 Nov 3 12:06:19 kjcf05n03 diskmonitor[17569]: lock release: time: Sun Nov 3 12:06:14 2024 Nov 3 12:06:19 kjcf05n03 diskmonitor[17569]: leaving test state: 100 next state: 1 Nov 3 12:06:37 kjcf05n00 mcfcli[3673891]: %3|1730657197.511|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:06:43 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 12:06:47 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 12:06:48 kjcf05n00 zabbix-server[1239185]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:06:48 kjcf05n00 zabbix-server[1239185]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n03' from event '46197' Nov 3 12:06:48 kjcf05n00 zabbix-server[1239185]: Host created 'enclosure_USE26000024VS001' Nov 3 12:06:48 kjcf05n00 zabbix-server[1239185]: Running puppet on 'kjcf05n03' Nov 3 12:06:48 kjcf05n00 mcfcli[3673891]: %3|1730657208.920|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:06:50 kjcf05n03 puppet-agent[30758]: Using configured environment 'production' Nov 3 12:06:50 kjcf05n03 puppet-agent[30758]: Retrieving pluginfacts Nov 3 12:06:50 kjcf05n03 puppet-agent[30758]: Retrieving plugin Nov 3 12:06:50 kjcf05n03 puppet-agent[30758]: Loading facts Nov 3 12:06:53 kjcf05n03 puppet-agent[30758]: Caching catalog for kjcf05n03 Nov 3 12:06:53 kjcf05n03 puppet-agent[30758]: Applying configuration version '1730657211' Nov 3 12:06:54 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 12:06:55 kjcf05n03 puppet-agent[30758]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 12:06:55 kjcf05n03 puppet-agent[30758]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 12:06:55 kjcf05n03 puppet-agent[30758]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 12:06:55 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 12:06:55 kjcf05n03 zabbix_agent2[6003]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 12:06:55 kjcf05n03 zabbix_agent2[3189]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:06:55 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 12:06:55 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 12:06:55 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 12:06:55 kjcf05n03 puppet-agent[30758]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: Press Ctrl+C to exit. Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: Plugin support version 1.0 Nov 3 12:06:55 kjcf05n03 zabbix_agent2[31074]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 12:06:58 kjcf05n03 puppet-agent[30758]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 12:06:58 kjcf05n03 puppet-agent[30758]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 12:06:58 kjcf05n03 puppet-agent[30758]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 12:06:58 kjcf05n03 puppet-agent[30758]: Applied catalog in 5.02 seconds Nov 3 12:06:58 kjcf05n00 zabbix-server[1239185]: puppet completed status:(0): '' Nov 3 12:06:58 kjcf05n00 zabbix-server[1239185]: Event '46197' acknowledged Nov 3 12:06:58 kjcf05n00 zabbix-server[1239185]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n03"}' Nov 3 12:07:03 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 3 12:07:07 kjcf05n00 mcfcli[3673891]: %3|1730657227.512|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:07:28 kjcf05n00 mcfcli[3673891]: %3|1730657248.917|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:07:31 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 3 12:07:31 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 3 12:07:37 kjcf05n00 mcfcli[3673891]: %3|1730657257.512|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:08:05 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 12:08:05 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 12:08:05 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 12:08:06 kjcf05n00 mcfcli[3673891]: %3|1730657286.233|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:08:07 kjcf05n00 mcfcli[3673891]: %3|1730657287.512|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:08:37 kjcf05n00 mcfcli[3673891]: %3|1730657317.513|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 12:08:43 kjcf05n00 mcfcli[3673891]: %3|1730657323.165|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:09:07 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 3 12:09:07 kjcf05n00 mcfcli[3673891]: %3|1730657347.513|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:09:09 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 3 12:09:09 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 3 12:09:09 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 3 12:09:20 kjcf05n00 mcfcli[3673891]: %3|1730657360.107|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:09:25 kjcf05n00 zabbix-server[1240540]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:09:25 kjcf05n00 zabbix-server[1240540]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 189.41\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 116.31\\"}}"' Nov 3 12:09:25 kjcf05n00 log_interesting_event.py[1240540]: Event '46198' acknowledged Nov 3 12:09:35 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 3 12:09:35 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 3 12:09:37 kjcf05n00 mcfcli[3673891]: %3|1730657377.515|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 12:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 12:10:00 kjcf05n00 mcfcli[3673891]: %3|1730657400.104|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 12:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 12:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 12:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 12:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 12:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 12:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 12:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 12:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 12:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 12:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 12:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 12:10:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 12:10:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:10:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 12:10:07 kjcf05n00 mcfcli[3673891]: %3|1730657407.515|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:10:10 kjcf05n00 python3.9[1240746]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 12:10:19 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 3 12:10:19 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 3 12:10:19 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 3 12:10:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730656851', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 12:10:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730656851'} Nov 3 12:10:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:10:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730656851', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 12:10:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730656851'} Nov 3 12:10:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:10:37 kjcf05n00 mcfcli[3673891]: %3|1730657437.515|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 12:10:39 kjcf05n00 mcfcli[3673891]: %3|1730657439.654|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:11:07 kjcf05n00 mcfcli[3673891]: %3|1730657467.515|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:11:19 kjcf05n00 mcfcli[3673891]: %3|1730657479.651|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:11:24 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 12:11:24 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 12:11:24 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 12:11:38 kjcf05n00 mcfcli[3673891]: %3|1730657498.016|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 12:11:45 kjcf05n00 zabbix-server[1242020]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:11:45 kjcf05n00 zabbix-server[1242020]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 73.84\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 88.94\\"}}"' Nov 3 12:11:45 kjcf05n00 log_interesting_event.py[1242020]: Event '46200' acknowledged Nov 3 12:11:59 kjcf05n00 mcfcli[3673891]: %3|1730657519.345|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:12:08 kjcf05n00 mcfcli[3673891]: %3|1730657528.242|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 12:12:38 kjcf05n00 mcfcli[3673891]: %3|1730657558.243|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:12:39 kjcf05n00 mcfcli[3673891]: %3|1730657559.342|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:13:08 kjcf05n00 mcfcli[3673891]: %3|1730657588.243|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:13:19 kjcf05n00 mcfcli[3673891]: %3|1730657599.339|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T12:13:27.254266373-06:00 level=info msg="Completed cleanup jobs" duration=27.665583ms Nov 3 12:13:38 kjcf05n00 mcfcli[3673891]: %3|1730657618.518|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:13:51 kjcf05n02 nslcd[6903]: [45e146] ldap_result() failed: Can't contact LDAP server Nov 3 12:13:51 kjcf05n02 nslcd[6903]: [5f007c] ldap_result() failed: Can't contact LDAP server Nov 3 12:13:53 kjcf05n03 root[41381]: failback_xyraid Nov 3 12:13:55 kjcf05n03 root[41510]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 12:13:54 kjcf05n00 mcfcli[3673891]: %3|1730657634.982|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:13:55 kjcf05n03 root[41587]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 12:14:00 kjcf05n02 systemd[1]: data-kjcf05n03:md66.mount: Succeeded. Nov 3 12:14:03 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme20n1 Nov 3 12:14:03 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme15n1 Nov 3 12:14:03 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme6n1 Nov 3 12:14:03 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme16n1 Nov 3 12:14:03 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme10n1 Nov 3 12:14:03 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme21n1 Nov 3 12:14:03 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme11n1 Nov 3 12:14:03 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme7n1 Nov 3 12:14:03 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme5n1 Nov 3 12:14:03 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme12n1 Nov 3 12:14:03 kjcf05n02 dwd[5152]: Drive path is missing, purging: nvme22n1 Nov 3 12:14:05 kjcf05n03 dwd[5196]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 12:14:05 kjcf05n03 dwd[5196]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 12:14:05 kjcf05n03 dwd[5196]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 12:14:05 kjcf05n03 dwd[5196]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 12:14:05 kjcf05n03 dwd[5196]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 12:14:05 kjcf05n03 dwd[5196]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 12:14:05 kjcf05n03 dwd[5196]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 12:14:05 kjcf05n03 dwd[5196]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 12:14:05 kjcf05n03 dwd[5196]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 12:14:05 kjcf05n03 dwd[5196]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 12:14:05 kjcf05n03 dwd[5196]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 12:14:05 kjcf05n03 dwd[5196]: Starting NVME thread for nvme10n1 Nov 3 12:14:05 kjcf05n03 dwd[5196]: Starting NVME thread for nvme15n1 Nov 3 12:14:06 kjcf05n03 dwd[5196]: Starting NVME thread for nvme21n1 Nov 3 12:14:06 kjcf05n03 dwd[5196]: Starting NVME thread for nvme11n1 Nov 3 12:14:06 kjcf05n03 dwd[5196]: Starting NVME thread for nvme20n1 Nov 3 12:14:06 kjcf05n03 systemd-udevd[44549]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44551]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44553]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44554]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44549]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44551]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44553]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44554]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44549]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44551]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44553]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44554]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44549]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44551]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44553]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44554]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44549]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44551]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44553]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44554]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44549]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44551]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44553]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44554]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44549]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44551]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44553]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44554]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44549]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44551]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44553]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44554]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44591]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44594]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44595]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44597]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44591]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44595]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44594]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44597]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44591]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44595]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44594]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44590]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44594]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44590]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44595]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44590]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44595]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44590]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44595]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44590]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44595]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44590]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44590]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44590]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44595]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44590]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44595]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44590]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44595]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44590]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44595]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 systemd-udevd[44595]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:14:06 kjcf05n03 dwd[5196]: Starting NVME thread for nvme12n1 Nov 3 12:14:07 kjcf05n03 dwd[5196]: Starting NVME thread for nvme7n1 Nov 3 12:14:07 kjcf05n03 dwd[5196]: Starting NVME thread for nvme6n1 Nov 3 12:14:07 kjcf05n03 dwd[5196]: Starting NVME thread for nvme5n1 Nov 3 12:14:07 kjcf05n03 dwd[5196]: Starting NVME thread for nvme16n1 Nov 3 12:14:07 kjcf05n03 dwd[5196]: Starting NVME thread for nvme22n1 Nov 3 12:14:08 kjcf05n03 nslcd[6943]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 12:14:08 kjcf05n00 mcfcli[3673891]: %3|1730657648.518|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 12:14:10 kjcf05n03 dcs-bulk-data-sender[6185]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 3 12:14:20 kjcf05n03 diskmonitor[17569]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 12:14:26 kjcf05n03 diskmonitor[17569]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 12:14:26 kjcf05n03 diskmonitor[17569]: Scan for ReadErrorMax change for md66 Nov 3 12:14:26 kjcf05n03 diskmonitor[17569]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 12:14:26 kjcf05n03 diskmonitor[17569]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 12:14:26 kjcf05n03 diskmonitor[17569]: read_saved_file: md66 no saved speed Nov 3 12:14:26 kjcf05n03 diskmonitor[17569]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 12:14:26 kjcf05n03 diskmonitor[17569]: Set sync_speed_min (10000) for md66 Nov 3 12:14:26 kjcf05n03 diskmonitor[17569]: Set sync_speed_max (200000) for md66 Nov 3 12:14:26 kjcf05n03 diskmonitor[17569]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 12:14:32 kjcf05n00 mcfcli[3673891]: %3|1730657672.482|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:14:34 kjcf05n02 diskmonitor[17396]: Removed MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 12:14:34 kjcf05n02 diskmonitor[17396]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 12:14:38 kjcf05n00 mcfcli[3673891]: %3|1730657678.518|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 12:14:45 kjcf05n02 nslcd[6903]: [d062c2] ldap_result() failed: Can't contact LDAP server Nov 3 12:15:02 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 48198 (bash) Nov 3 12:15:02 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 12:15:02 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 12:15:04 kjcf05n03 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 12:15:04 kjcf05n03 systemd-tmpfiles[48417]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 12:15:04 kjcf05n03 systemd-tmpfiles[48417]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 12:15:04 kjcf05n03 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 12:15:04 kjcf05n03 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 12:15:08 kjcf05n00 mcfcli[3673891]: %3|1730657708.518|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 12:15:09 kjcf05n00 python3.9[1243887]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 12:15:10 kjcf05n00 mcfcli[3673891]: %3|1730657710.187|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:15:38 kjcf05n00 mcfcli[3673891]: %3|1730657738.519|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 12:15:46 kjcf05n00 mcfcli[3673891]: %3|1730657746.955|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:15:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730657752}"] Nov 3 12:15:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730657752, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:15:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.009153ms Nov 3 12:15:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.009153ms Nov 3 12:15:52 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:15:52 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:15:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:15:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730657752}"] Nov 3 12:15:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730657752, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:15:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.010405ms Nov 3 12:15:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.010405ms Nov 3 12:15:52 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:15:52 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:15:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:15:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730657752}"] Nov 3 12:15:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730657752, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:15:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.489383ms Nov 3 12:15:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.489383ms Nov 3 12:15:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:15:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:15:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:15:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730657752}"] Nov 3 12:15:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730657752, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:15:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.044449ms Nov 3 12:15:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.044449ms Nov 3 12:15:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:15:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:15:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:15:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730657752}"] Nov 3 12:15:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730657752, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:15:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.110172ms Nov 3 12:15:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.110172ms Nov 3 12:15:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:15:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:15:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:15:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730657752}"] Nov 3 12:15:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730657752, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:15:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.383845ms Nov 3 12:15:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.383845ms Nov 3 12:15:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:15:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:15:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:15:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730657752}"] Nov 3 12:15:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730657752, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:15:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.139136ms Nov 3 12:15:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.139136ms Nov 3 12:15:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:15:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:15:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:15:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730657752}"] Nov 3 12:15:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730657752, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:15:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.953628ms Nov 3 12:15:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.953628ms Nov 3 12:15:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:15:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:15:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:15:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730657752}"] Nov 3 12:15:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730657752, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:15:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.807094ms Nov 3 12:15:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.807094ms Nov 3 12:15:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:15:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:15:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:15:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730657752}"] Nov 3 12:15:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730657752, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:15:54 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:54-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:54 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:54-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:54 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:54-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:54 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:54-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:54 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:54-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:54 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:54-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:54 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:54-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.13552ms Nov 3 12:15:54 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:54-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.13552ms Nov 3 12:15:54 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:15:54 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:15:54 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:15:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730657752}"] Nov 3 12:15:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730657752, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:15:54 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:54-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:54 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:54-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:15:54 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:54-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:54 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:15:54-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:54 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:54-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:15:54 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:15:54-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:15:54 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:15:54-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.045491ms Nov 3 12:15:54 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:15:54-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.045491ms Nov 3 12:15:54 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:15:54 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:15:54 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:16:08 kjcf05n00 mcfcli[3673891]: %3|1730657768.520|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:16:26 kjcf05n00 mcfcli[3673891]: %3|1730657786.952|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:16:38 kjcf05n00 mcfcli[3673891]: %3|1730657798.520|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:17:05 kjcf05n00 mcfcli[3673891]: %3|1730657825.411|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:17:08 kjcf05n00 mcfcli[3673891]: %3|1730657828.520|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:17:38 kjcf05n00 mcfcli[3673891]: %3|1730657858.520|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 12:17:45 kjcf05n00 mcfcli[3673891]: %3|1730657865.225|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:18:08 kjcf05n00 mcfcli[3673891]: %3|1730657888.521|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 12:18:25 kjcf05n00 mcfcli[3673891]: %3|1730657905.133|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:18:38 kjcf05n00 mcfcli[3673891]: %3|1730657918.521|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 12:19:02 kjcf05n00 mcfcli[3673891]: %3|1730657942.392|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:19:08 kjcf05n00 mcfcli[3673891]: %3|1730657948.522|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 12:19:20 kjcf05n03 dwd[5196]: nvme10n1 passed periodic SMART status check Nov 3 12:19:20 kjcf05n03 dwd[5196]: nvme15n1 passed periodic SMART status check Nov 3 12:19:21 kjcf05n03 dwd[5196]: nvme20n1 passed periodic SMART status check Nov 3 12:19:21 kjcf05n03 dwd[5196]: nvme21n1 passed periodic SMART status check Nov 3 12:19:21 kjcf05n03 dwd[5196]: nvme12n1 passed periodic SMART status check Nov 3 12:19:21 kjcf05n03 dwd[5196]: nvme11n1 passed periodic SMART status check Nov 3 12:19:22 kjcf05n03 dwd[5196]: nvme5n1 passed periodic SMART status check Nov 3 12:19:22 kjcf05n03 dwd[5196]: nvme6n1 passed periodic SMART status check Nov 3 12:19:22 kjcf05n03 dwd[5196]: nvme7n1 passed periodic SMART status check Nov 3 12:19:22 kjcf05n03 dwd[5196]: nvme16n1 passed periodic SMART status check Nov 3 12:19:22 kjcf05n03 dwd[5196]: nvme22n1 passed periodic SMART status check Nov 3 12:19:38 kjcf05n00 mcfcli[3673891]: %3|1730657978.523|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 12:19:39 kjcf05n00 mcfcli[3673891]: %3|1730657979.308|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:19:51 kjcf05n00 zabbix-server[1246675]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:19:51 kjcf05n00 zabbix-server[1246675]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n03' from event '46201' Nov 3 12:19:51 kjcf05n00 zabbix-server[1246675]: Filesystem 'kjcf05' has been mounted Nov 3 12:19:52 kjcf05n00 zabbix-server[1246675]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 12:19:52 kjcf05n00 zabbix-server[1246675]: Running puppet on 'None' Nov 3 12:19:53 kjcf05n04 puppet-agent[3100422]: Using configured environment 'production' Nov 3 12:19:53 kjcf05n04 puppet-agent[3100422]: Retrieving pluginfacts Nov 3 12:19:53 kjcf05n04 puppet-agent[3100422]: Retrieving plugin Nov 3 12:19:54 kjcf05n03 puppet-agent[55678]: Using configured environment 'production' Nov 3 12:19:54 kjcf05n03 puppet-agent[55678]: Retrieving pluginfacts Nov 3 12:19:54 kjcf05n03 puppet-agent[55678]: Retrieving plugin Nov 3 12:19:54 kjcf05n03 puppet-agent[55678]: Loading facts Nov 3 12:19:54 kjcf05n07 puppet-agent[3095652]: Using configured environment 'production' Nov 3 12:19:54 kjcf05n07 puppet-agent[3095652]: Retrieving pluginfacts Nov 3 12:19:54 kjcf05n07 puppet-agent[3095652]: Retrieving plugin Nov 3 12:19:54 kjcf05n06 puppet-agent[3098355]: Using configured environment 'production' Nov 3 12:19:54 kjcf05n06 puppet-agent[3098355]: Retrieving pluginfacts Nov 3 12:19:54 kjcf05n06 puppet-agent[3098355]: Retrieving plugin Nov 3 12:19:54 kjcf05n06 puppet-agent[3098355]: Loading facts Nov 3 12:19:54 kjcf05n05 puppet-agent[3256917]: Using configured environment 'production' Nov 3 12:19:54 kjcf05n05 puppet-agent[3256917]: Retrieving pluginfacts Nov 3 12:19:54 kjcf05n05 puppet-agent[3256917]: Retrieving plugin Nov 3 12:19:54 kjcf05n05 puppet-agent[3256917]: Loading facts Nov 3 12:19:54 kjcf05n04 puppet-agent[3100422]: Loading facts Nov 3 12:19:54 kjcf05n02 puppet-agent[174890]: Using configured environment 'production' Nov 3 12:19:54 kjcf05n02 puppet-agent[174890]: Retrieving pluginfacts Nov 3 12:19:54 kjcf05n02 puppet-agent[174890]: Retrieving plugin Nov 3 12:19:54 kjcf05n02 puppet-agent[174890]: Loading facts Nov 3 12:19:54 kjcf05n01 puppet-agent[3086076]: Using configured environment 'production' Nov 3 12:19:54 kjcf05n01 puppet-agent[3086076]: Retrieving pluginfacts Nov 3 12:19:54 kjcf05n01 puppet-agent[3086076]: Retrieving plugin Nov 3 12:19:54 kjcf05n07 puppet-agent[3095652]: Loading facts Nov 3 12:19:54 kjcf05n00 puppet-agent[1246737]: Using configured environment 'production' Nov 3 12:19:54 kjcf05n00 puppet-agent[1246737]: Retrieving pluginfacts Nov 3 12:19:54 kjcf05n00 puppet-agent[1246737]: Retrieving plugin Nov 3 12:19:54 kjcf05n00 puppet-agent[1246737]: Loading facts Nov 3 12:19:55 kjcf05n01 puppet-agent[3086076]: Loading facts Nov 3 12:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 12:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 12:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 12:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 12:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 12:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 12:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 12:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 12:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 12:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 12:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 12:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 12:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 12:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 12:20:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 12:20:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:20:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 12:20:02 kjcf05n03 puppet-agent[55678]: Caching catalog for kjcf05n03 Nov 3 12:20:02 kjcf05n03 puppet-agent[55678]: Applying configuration version '1730657995' Nov 3 12:20:02 kjcf05n07 puppet-agent[3095652]: Caching catalog for kjcf05n07 Nov 3 12:20:02 kjcf05n07 puppet-agent[3095652]: Applying configuration version '1730657995' Nov 3 12:20:04 kjcf05n02 puppet-agent[174890]: Caching catalog for kjcf05n02 Nov 3 12:20:04 kjcf05n02 puppet-agent[174890]: Applying configuration version '1730657995' Nov 3 12:20:04 kjcf05n06 puppet-agent[3098355]: Caching catalog for kjcf05n06 Nov 3 12:20:04 kjcf05n06 puppet-agent[3098355]: Applying configuration version '1730657995' Nov 3 12:20:05 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 12:20:05 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 12:20:05 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 12:20:07 kjcf05n07 puppet-agent[3095652]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 12:20:07 kjcf05n07 puppet-agent[3095652]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 12:20:07 kjcf05n07 puppet-agent[3095652]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 12:20:07 kjcf05n03 puppet-agent[55678]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 12:20:07 kjcf05n03 puppet-agent[55678]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 12:20:07 kjcf05n03 puppet-agent[55678]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 12:20:08 kjcf05n06 puppet-agent[3098355]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 12:20:08 kjcf05n06 puppet-agent[3098355]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 12:20:08 kjcf05n06 puppet-agent[3098355]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 12:20:08 kjcf05n01 puppet-agent[3086076]: Caching catalog for kjcf05n01 Nov 3 12:20:08 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3034914]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 12:20:08 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 12:20:08 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 12:20:08 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 12:20:08 kjcf05n07 puppet-agent[3095652]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: Press Ctrl+C to exit. Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: Plugin support version 1.0 Nov 3 12:20:08 kjcf05n07 zabbix_agent2[3096187]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 12:20:08 kjcf05n02 puppet-agent[174890]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 12:20:08 kjcf05n02 puppet-agent[174890]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 12:20:08 kjcf05n02 puppet-agent[174890]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 12:20:08 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 12:20:08 kjcf05n03 zabbix_agent2[31074]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 12:20:08 kjcf05n03 zabbix_agent2[3189]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:20:08 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 12:20:08 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 12:20:08 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 12:20:08 kjcf05n03 puppet-agent[55678]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: Press Ctrl+C to exit. Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: Plugin support version 1.0 Nov 3 12:20:08 kjcf05n03 zabbix_agent2[57042]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 12:20:08 kjcf05n01 puppet-agent[3086076]: Applying configuration version '1730658002' Nov 3 12:20:08 kjcf05n00 mcfcli[3673891]: %3|1730658008.523|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 12:20:08 kjcf05n05 puppet-agent[3256917]: Caching catalog for kjcf05n05 Nov 3 12:20:08 kjcf05n05 puppet-agent[3256917]: Applying configuration version '1730658004' Nov 3 12:20:08 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3038231]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 12:20:08 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 12:20:08 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 12:20:08 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 12:20:08 kjcf05n06 puppet-agent[3098355]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: Press Ctrl+C to exit. Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: Plugin support version 1.0 Nov 3 12:20:08 kjcf05n06 zabbix_agent2[3099623]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 12:20:09 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 12:20:09 kjcf05n02 zabbix_agent2[108461]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 12:20:09 kjcf05n02 zabbix_agent2[3127]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:20:09 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 12:20:09 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 12:20:09 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 12:20:09 kjcf05n02 puppet-agent[174890]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: Press Ctrl+C to exit. Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: Plugin support version 1.0 Nov 3 12:20:09 kjcf05n02 zabbix_agent2[175573]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 12:20:08 kjcf05n00 puppet-agent[1246737]: Caching catalog for kjcf05n00 Nov 3 12:20:08 kjcf05n00 puppet-agent[1246737]: Applying configuration version '1730658002' Nov 3 12:20:10 kjcf05n07 puppet-agent[3095652]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 12:20:10 kjcf05n07 puppet-agent[3095652]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 12:20:10 kjcf05n07 puppet-agent[3095652]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 12:20:11 kjcf05n07 puppet-agent[3095652]: Applied catalog in 8.48 seconds Nov 3 12:20:11 kjcf05n03 puppet-agent[55678]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 12:20:11 kjcf05n03 puppet-agent[55678]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 12:20:11 kjcf05n03 puppet-agent[55678]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 12:20:11 kjcf05n03 puppet-agent[55678]: Applied catalog in 9.43 seconds Nov 3 12:20:11 kjcf05n06 puppet-agent[3098355]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 12:20:11 kjcf05n06 puppet-agent[3098355]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 12:20:11 kjcf05n06 puppet-agent[3098355]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 12:20:11 kjcf05n06 puppet-agent[3098355]: Applied catalog in 7.30 seconds Nov 3 12:20:11 kjcf05n05 puppet-agent[3256917]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 12:20:11 kjcf05n05 puppet-agent[3256917]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 12:20:11 kjcf05n05 puppet-agent[3256917]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 12:20:11 kjcf05n02 puppet-agent[174890]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 12:20:11 kjcf05n02 puppet-agent[174890]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 12:20:11 kjcf05n02 puppet-agent[174890]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 12:20:11 kjcf05n01 puppet-agent[3086076]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 12:20:11 kjcf05n01 puppet-agent[3086076]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-11:55:55]/mode) mode changed '0755' to '0750' Nov 3 12:20:11 kjcf05n01 puppet-agent[3086076]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-11:55:55/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 12:20:11 kjcf05n01 puppet-agent[3086076]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-11:55:55/vmcore]/mode) mode changed '0600' to '0640' Nov 3 12:20:11 kjcf05n01 puppet-agent[3086076]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-11:55:55/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 12:20:11 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3190809]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 12:20:11 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 12:20:11 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 12:20:11 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 12:20:11 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 12:20:11 kjcf05n05 puppet-agent[3256917]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: Press Ctrl+C to exit. Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: Plugin support version 1.0 Nov 3 12:20:11 kjcf05n05 zabbix_agent2[3257902]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 12:20:12 kjcf05n02 puppet-agent[174890]: Applied catalog in 7.67 seconds Nov 3 12:20:12 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 12:20:12 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 12:20:12 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 12:20:12 kjcf05n00 puppet-agent[1246737]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 12:20:13 kjcf05n01 puppet-agent[3086076]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 12:20:13 kjcf05n01 puppet-agent[3086076]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 12:20:13 kjcf05n01 puppet-agent[3086076]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 12:20:13 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3072495]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 12:20:13 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 12:20:13 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 12:20:13 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 12:20:13 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 12:20:13 kjcf05n01 puppet-agent[3086076]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: Press Ctrl+C to exit. Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: Plugin support version 1.0 Nov 3 12:20:13 kjcf05n01 zabbix_agent2[3086497]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 12:20:13 kjcf05n00 puppet-agent[1246737]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 12:20:13 kjcf05n00 puppet-agent[1246737]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 12:20:13 kjcf05n00 puppet-agent[1246737]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 12:20:14 kjcf05n05 puppet-agent[3256917]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 12:20:14 kjcf05n05 puppet-agent[3256917]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 12:20:14 kjcf05n05 puppet-agent[3256917]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 12:20:14 kjcf05n05 puppet-agent[3256917]: Applied catalog in 5.60 seconds Nov 3 12:20:14 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1225960]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 12:20:14 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 12:20:14 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 12:20:14 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 12:20:14 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 12:20:14 kjcf05n00 puppet-agent[1246737]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: Press Ctrl+C to exit. Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: Plugin support version 1.0 Nov 3 12:20:14 kjcf05n00 zabbix_agent2[1247390]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 12:20:14 kjcf05n00 zabbix-server[1247413]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:20:14 kjcf05n00 python3.9[1247162]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 12:20:15 kjcf05n00 zabbix-server[1247468]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:20:15 kjcf05n00 zabbix-server[1247485]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:20:15 kjcf05n01 puppet-agent[3086076]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_120319.log]/mode) mode changed '0644' to '0640' Nov 3 12:20:15 kjcf05n01 puppet-agent[3086076]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_121502.log]/mode) mode changed '0644' to '0640' Nov 3 12:20:15 kjcf05n00 zabbix-server[1247507]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:20:15 kjcf05n00 puppet-agent[1246737]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 12:20:16 kjcf05n00 mcfcli[3673891]: %3|1730658016.130|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:20:16 kjcf05n01 puppet-agent[3086076]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_120319.log]/mode) mode changed '0644' to '0640' Nov 3 12:20:16 kjcf05n01 puppet-agent[3086076]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_121502.log]/mode) mode changed '0644' to '0640' Nov 3 12:20:16 kjcf05n01 puppet-agent[3086076]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_121502]/mode) mode changed '0755' to '0750' Nov 3 12:20:16 kjcf05n01 puppet-agent[3086076]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_121502/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 12:20:16 kjcf05n01 puppet-agent[3086076]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 12:20:16 kjcf05n01 puppet-agent[3086076]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 12:20:16 kjcf05n01 puppet-agent[3086076]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 12:20:17 kjcf05n00 puppet-agent[1246737]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 12:20:17 kjcf05n00 puppet-agent[1246737]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 12:20:17 kjcf05n00 puppet-agent[1246737]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 12:20:17 kjcf05n01 puppet-agent[3086076]: Applied catalog in 9.51 seconds Nov 3 12:20:17 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 12:20:18 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 12:20:17 kjcf05n00 puppet-agent[1246737]: Applied catalog in 9.12 seconds Nov 3 12:20:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730658028', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 12:20:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730658028'} Nov 3 12:20:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:20:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730658028', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 12:20:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730658028'} Nov 3 12:20:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:20:38 kjcf05n00 mcfcli[3673891]: %3|1730658038.523|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 12:20:50 kjcf05n04 puppet-agent[3100422]: Caching catalog for kjcf05n04 Nov 3 12:20:50 kjcf05n04 puppet-agent[3100422]: Applying configuration version '1730658048' Nov 3 12:20:52 kjcf05n04 puppet-agent[3100422]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 12:20:52 kjcf05n04 puppet-agent[3100422]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 12:20:52 kjcf05n04 puppet-agent[3100422]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 12:20:52 kjcf05n00 mcfcli[3673891]: %3|1730658052.784|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:20:53 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3035110]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 12:20:53 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 12:20:53 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 12:20:53 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 12:20:53 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 12:20:53 kjcf05n04 puppet-agent[3100422]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: Press Ctrl+C to exit. Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: Plugin support version 1.0 Nov 3 12:20:53 kjcf05n04 zabbix_agent2[3102392]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 12:20:55 kjcf05n04 puppet-agent[3100422]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 12:20:55 kjcf05n04 puppet-agent[3100422]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 12:20:55 kjcf05n04 puppet-agent[3100422]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 12:20:55 kjcf05n00 zabbix-server[1246675]: puppet completed status:(0): '' Nov 3 12:20:55 kjcf05n00 zabbix-server[1246675]: Event '46201' acknowledged Nov 3 12:20:55 kjcf05n00 zabbix-server[1246675]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n03"}' Nov 3 12:20:55 kjcf05n04 puppet-agent[3100422]: Applied catalog in 4.80 seconds Nov 3 12:21:08 kjcf05n00 mcfcli[3673891]: %3|1730658068.524|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:21:28 kjcf05n00 mcfcli[3673891]: %3|1730658088.053|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:21:38 kjcf05n00 mcfcli[3673891]: %3|1730658098.524|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 12:22:05 kjcf05n00 mcfcli[3673891]: %3|1730658125.390|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:22:08 kjcf05n00 mcfcli[3673891]: %3|1730658128.524|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:22:38 kjcf05n00 mcfcli[3673891]: %3|1730658158.525|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:22:41 kjcf05n00 mcfcli[3673891]: %3|1730658161.433|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:23:08 kjcf05n00 mcfcli[3673891]: %3|1730658188.525|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:23:10 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 12:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T18:23:15.868521Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 12:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T18:23:15.868592Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.103ms Nov 3 12:23:21 kjcf05n00 mcfcli[3673891]: %3|1730658201.384|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T12:23:27.247076725-06:00 level=info msg="Completed cleanup jobs" duration=20.654672ms Nov 3 12:23:38 kjcf05n00 mcfcli[3673891]: %3|1730658218.526|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:23:59 kjcf05n00 mcfcli[3673891]: %3|1730658239.906|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:24:08 kjcf05n00 mcfcli[3673891]: %3|1730658248.526|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:24:10 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 3 12:24:10 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 6 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007735 sec, idle for 1 hour(s)] Nov 3 12:24:37 kjcf05n00 mcfcli[3673891]: %3|1730658277.706|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:24:38 kjcf05n00 mcfcli[3673891]: %3|1730658278.526|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 12:25:08 kjcf05n00 mcfcli[3673891]: %3|1730658308.526|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:25:09 kjcf05n00 python3.9[1250187]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 12:25:15 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 12:25:17 kjcf05n00 mcfcli[3673891]: %3|1730658317.325|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:25:22 kjcf05n00 zabbix-server[1250693]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:25:22 kjcf05n00 zabbix-server[1250693]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 270.37\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 201.66\\"}}"' Nov 3 12:25:22 kjcf05n00 log_interesting_event.py[1250693]: Event '46204' acknowledged Nov 3 12:25:38 kjcf05n00 mcfcli[3673891]: %3|1730658338.527|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 12:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 12:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 12:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 12:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 12:25:57 kjcf05n00 mcfcli[3673891]: %3|1730658357.109|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:25:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 12:25:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 12:25:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 12:25:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 12:26:08 kjcf05n00 zabbix_server[15723]: Zabbix agent item "dcs.lustre.device.discovery[{$LUSTRE_FS_NAME},mdt]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 3 12:26:08 kjcf05n00 zabbix_server[15778]: Zabbix agent item "system.cpu.load[all,avg5]" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 3 12:26:08 kjcf05n00 mcfcli[3673891]: %3|1730658368.527|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:26:13 kjcf05n03 fstonithd.py[15172]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 3 12:26:13 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 12:26:13 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 12:26:13 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 12:26:14 kjcf05n03 root[67056]: is_enc_ipmi_off starts Nov 3 12:26:14 kjcf05n03 root[67058]: is_viking_off starts Nov 3 12:26:14 kjcf05n03 root[67084]: I am not master; I will get master Nov 3 12:26:14 kjcf05n03 root[67087]: I am in slot 1; partner is in slot 0 Nov 3 12:26:14 kjcf05n03 root[67089]: is_lan_ipmi_off leaves Nov 3 12:26:14 kjcf05n03 root[67094]: is_lan_ipmi_sec_off leaves Nov 3 12:26:19 kjcf05n03 root[67232]: I am now master Nov 3 12:26:20 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='15', error='Connection reset by peer (104)' Nov 3 12:26:20 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='15', client='AF_INET(172.16.2.5:36039)', local='AF_INET(0.0.0.0:601)' Nov 3 12:26:21 kjcf05n03 root[67270]: is_viking_off leaves Nov 3 12:26:21 kjcf05n03 root[67273]: kjcf05n02 not already off look at kdump Nov 3 12:26:21 kjcf05n03 root[67274]: is_kdump_off starts Nov 3 12:26:21 kjcf05n03 fence_kdump[67275]: waiting for message from '172.16.2.5' Nov 3 12:26:22 kjcf05n03 fence_kdump[67275]: received valid message from '172.16.2.5' Nov 3 12:26:22 kjcf05n03 root[67290]: is_kdump_off detected kdump on kjcf05n02 Nov 3 12:26:22 kjcf05n03 root[67291]: kjcf05n02 is kdumping Nov 3 12:26:22 kjcf05n03 root[67380]: is_enc_ipmi_off starts Nov 3 12:26:22 kjcf05n03 root[67382]: is_viking_off starts Nov 3 12:26:22 kjcf05n03 root[67399]: I am master Nov 3 12:26:22 kjcf05n03 root[67402]: I am in slot 1; partner is in slot 0 Nov 3 12:26:22 kjcf05n03 root[67404]: is_lan_ipmi_off leaves Nov 3 12:26:22 kjcf05n03 root[67412]: is_lan_ipmi_sec_off leaves Nov 3 12:26:23 kjcf05n00 zabbix_server[15754]: Zabbix agent item "vfs.fs.size[/etc/ganesha,total]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 12:26:23 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.mdt.name[MDT0000,mdt_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 12:26:24 kjcf05n00 zabbix_server[15771]: Zabbix agent item "vfs.fs.size[/mnt/persistent_ha_data,used]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 12:26:25 kjcf05n00 zabbix_server[15737]: Zabbix agent item "vfs.fs.size[/var/lib/pacemaker,used]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 12:26:26 kjcf05n00 zabbix_server[15763]: Zabbix agent item "vfs.fs.size[/var/lib/mdraidscripts,used]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 12:26:27 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib0 Nov 3 12:26:27 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib0 Nov 3 12:26:29 kjcf05n03 root[67622]: is_viking_off leaves Nov 3 12:26:29 kjcf05n03 root[67625]: kjcf05n02 not already off look at kdump Nov 3 12:26:29 kjcf05n03 root[67626]: is_kdump_off starts Nov 3 12:26:29 kjcf05n03 fence_kdump[67627]: waiting for message from '172.16.2.5' Nov 3 12:26:29 kjcf05n03 fence_kdump[67627]: received valid message from '172.16.2.5' Nov 3 12:26:29 kjcf05n03 root[67638]: is_kdump_off detected kdump on kjcf05n02 Nov 3 12:26:29 kjcf05n03 root[67639]: kjcf05n02 is kdumping Nov 3 12:26:31 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib1 Nov 3 12:26:31 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib1 Nov 3 12:26:31 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 12:26:31 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 12:26:33 kjcf05n03 dwd[5196]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 12:26:33 kjcf05n03 dwd[5196]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 12:26:33 kjcf05n03 dwd[5196]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 12:26:33 kjcf05n03 dwd[5196]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 12:26:33 kjcf05n03 dwd[5196]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 12:26:33 kjcf05n03 dwd[5196]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 12:26:33 kjcf05n03 dwd[5196]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 12:26:33 kjcf05n03 dwd[5196]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 12:26:33 kjcf05n03 dwd[5196]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 12:26:33 kjcf05n03 dwd[5196]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 12:26:33 kjcf05n03 dwd[5196]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 12:26:33 kjcf05n03 dwd[5196]: Starting NVME thread for nvme25n1 Nov 3 12:26:33 kjcf05n03 systemd-udevd[69939]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69940]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69942]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69944]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69939]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69942]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69940]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69944]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69939]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69942]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69940]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69944]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69942]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69940]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69939]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69944]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69939]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69940]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69942]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69944]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69939]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69940]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69944]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69942]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69968]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69939]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69969]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69944]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69971]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69976]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69968]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69942]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69940]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69939]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69944]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69969]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69971]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69976]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69940]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69942]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69944]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69976]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69976]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69969]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69976]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69969]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69944]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69939]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69940]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69969]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69976]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69944]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69969]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69976]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 12:26:33 kjcf05n03 systemd-udevd[69969]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 12:26:34 kjcf05n03 systemd-udevd[69969]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 12:26:34 kjcf05n03 systemd-udevd[69976]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:26:34 kjcf05n03 systemd-udevd[69969]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 12:26:34 kjcf05n03 systemd-udevd[69976]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 12:26:34 kjcf05n03 systemd-udevd[69969]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:26:34 kjcf05n03 systemd-udevd[69976]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 12:26:34 kjcf05n03 systemd-udevd[69969]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:26:34 kjcf05n03 systemd-udevd[69969]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:26:34 kjcf05n03 systemd-udevd[69969]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:26:34 kjcf05n03 dwd[5196]: Starting NVME thread for nvme8n1 Nov 3 12:26:34 kjcf05n03 dwd[5196]: Starting NVME thread for nvme18n1 Nov 3 12:26:34 kjcf05n03 dwd[5196]: Starting NVME thread for nvme23n1 Nov 3 12:26:34 kjcf05n03 dwd[5196]: Starting NVME thread for nvme9n1 Nov 3 12:26:34 kjcf05n03 dwd[5196]: Starting NVME thread for nvme4n1 Nov 3 12:26:34 kjcf05n03 dwd[5196]: Starting NVME thread for nvme2n1 Nov 3 12:26:35 kjcf05n03 dwd[5196]: Starting NVME thread for nvme3n1 Nov 3 12:26:35 kjcf05n03 dwd[5196]: Starting NVME thread for nvme19n1 Nov 3 12:26:35 kjcf05n03 dwd[5196]: Starting NVME thread for nvme17n1 Nov 3 12:26:35 kjcf05n03 dwd[5196]: Starting NVME thread for nvme24n1 Nov 3 12:26:37 kjcf05n00 mcfcli[3673891]: %3|1730658397.106|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 12:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 12:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 12:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 12:26:38 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.mdt.name[MDT0001,mdt_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 12:26:38 kjcf05n00 mcfcli[3673891]: %3|1730658398.528|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:26:41 kjcf05n00 zabbix_server[15783]: Zabbix agent item "proc.num" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 12:26:43 kjcf05n03 diskmonitor[17569]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 12:26:53 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 3 12:26:54 kjcf05n03 diskmonitor[17569]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 12:26:54 kjcf05n03 diskmonitor[17569]: Scan for ReadErrorMax change for md65 Nov 3 12:26:54 kjcf05n03 diskmonitor[17569]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 12:26:54 kjcf05n03 diskmonitor[17569]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 12:26:54 kjcf05n03 diskmonitor[17569]: read_saved_file: md65 no saved speed Nov 3 12:26:54 kjcf05n03 diskmonitor[17569]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 12:26:54 kjcf05n03 diskmonitor[17569]: Set sync_speed_min (10000) for md65 Nov 3 12:26:54 kjcf05n03 diskmonitor[17569]: Set sync_speed_max (200000) for md65 Nov 3 12:26:54 kjcf05n03 diskmonitor[17569]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 12:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 12:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 12:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 12:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 12:26:56 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 3 12:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 12:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 12:26:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 12:26:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 12:27:08 kjcf05n00 mcfcli[3673891]: %3|1730658428.528|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:27:17 kjcf05n00 mcfcli[3673891]: %3|1730658437.103|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:27:27 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib0 Nov 3 12:27:27 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib0 Nov 3 12:27:31 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib1 Nov 3 12:27:31 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib1 Nov 3 12:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 12:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 12:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 12:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 12:27:38 kjcf05n00 mcfcli[3673891]: %3|1730658458.529|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:27:44 kjcf05n03 nslcd[6943]: ldap_result() failed: Can't contact LDAP server Nov 3 12:27:44 kjcf05n03 nslcd[6943]: (re)loading /etc/nsswitch.conf Nov 3 12:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 12:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 12:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 12:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 12:27:56 kjcf05n00 mcfcli[3673891]: %3|1730658476.415|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 12:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 12:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 12:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 12:28:08 kjcf05n00 mcfcli[3673891]: %3|1730658488.529|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:28:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730658503}"] Nov 3 12:28:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730658503, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:28:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.93831ms Nov 3 12:28:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.93831ms Nov 3 12:28:23 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:28:23 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:28:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:28:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730658503}"] Nov 3 12:28:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730658503, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:28:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.972905ms Nov 3 12:28:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.972905ms Nov 3 12:28:23 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:28:23 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:28:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:28:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730658503}"] Nov 3 12:28:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730658503, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:28:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.799189ms Nov 3 12:28:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.799189ms Nov 3 12:28:23 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:28:23 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:28:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:28:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730658503}"] Nov 3 12:28:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730658503, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:28:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.989987ms Nov 3 12:28:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.989987ms Nov 3 12:28:23 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:28:23 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:28:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:28:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730658503}"] Nov 3 12:28:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730658503, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:28:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.357355ms Nov 3 12:28:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.357355ms Nov 3 12:28:23 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:28:23 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:28:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:28:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730658503}"] Nov 3 12:28:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730658503, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:28:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.739771ms Nov 3 12:28:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.739771ms Nov 3 12:28:23 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:28:23 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:28:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:28:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730658503}"] Nov 3 12:28:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730658503, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:28:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.902873ms Nov 3 12:28:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.902873ms Nov 3 12:28:24 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:28:24 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:28:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:28:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730658503}"] Nov 3 12:28:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730658503, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:28:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.017388ms Nov 3 12:28:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.017388ms Nov 3 12:28:24 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:28:24 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:28:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:28:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730658503}"] Nov 3 12:28:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730658503, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:28:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.170795ms Nov 3 12:28:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.170795ms Nov 3 12:28:24 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:28:24 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:28:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:28:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730658503}"] Nov 3 12:28:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730658503, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:28:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.986581ms Nov 3 12:28:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.986581ms Nov 3 12:28:24 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:28:24 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:28:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:28:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730658503}"] Nov 3 12:28:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730658503, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:28:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:24-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:28:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:24 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:28:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:24-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:28:24 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:28:24-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:28:24 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:28:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.120641ms Nov 3 12:28:24 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:28:24-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.120641ms Nov 3 12:28:24 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:28:24 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:28:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:28:27 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib0 Nov 3 12:28:27 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib0 Nov 3 12:28:31 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib1 Nov 3 12:28:31 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib1 Nov 3 12:28:31 kjcf05n00 mcfcli[3673891]: %3|1730658511.458|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 12:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 12:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 12:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 12:28:38 kjcf05n00 mcfcli[3673891]: %3|1730658518.529|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 12:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 12:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 12:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 12:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 12:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 12:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 12:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 12:29:08 kjcf05n00 mcfcli[3673891]: %3|1730658548.530|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:29:10 kjcf05n00 zabbix-server[1252867]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:29:10 kjcf05n00 zabbix-server[1252867]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 12:29:10 kjcf05n00 log_interesting_event.py[1252867]: Event '46205' acknowledged Nov 3 12:29:11 kjcf05n00 mcfcli[3673891]: %3|1730658551.455|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:29:27 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib0 Nov 3 12:29:27 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib0 Nov 3 12:29:31 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib1 Nov 3 12:29:31 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib1 Nov 3 12:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 12:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 12:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 12:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 12:29:38 kjcf05n00 mcfcli[3673891]: %3|1730658578.530|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:29:50 kjcf05n00 mcfcli[3673891]: %3|1730658590.013|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 12:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 12:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 12:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 12:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 12:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 12:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 12:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 12:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 12:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 12:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 12:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 12:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 12:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 12:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 12:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 12:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 12:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 12:30:00 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 3 12:30:00 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 12:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 12:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 12:30:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 12:30:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:30:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 12:30:04 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 12:30:04 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 3 12:30:04 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 3 12:30:04 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 12:30:04 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 12:30:04 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 3 12:30:04 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 3 12:30:08 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 3 12:30:08 kjcf05n00 mcfcli[3673891]: %3|1730658608.531|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 12:30:10 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 3 12:30:13 kjcf05n03 chronyd[5163]: Selected source 16.110.135.123 Nov 3 12:30:20 kjcf05n00 python3.9[1253517]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 12:30:27 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib0 Nov 3 12:30:27 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib0 Nov 3 12:30:30 kjcf05n00 mcfcli[3673891]: %3|1730658630.010|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:30:31 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib1 Nov 3 12:30:31 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib1 Nov 3 12:30:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730658634', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 12:30:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730658634'} Nov 3 12:30:34 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:30:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730658634', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 12:30:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730658634'} Nov 3 12:30:34 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 12:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 12:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 12:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 12:30:38 kjcf05n00 mcfcli[3673891]: %3|1730658638.531|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 12:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 12:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 12:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 12:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 12:30:58 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:52956). Nov 3 12:30:58 kjcf05n01 rsyncd[3090602]: connect from kjcf05n02 (172.16.2.5) Nov 3 12:30:58 kjcf05n01 rsyncd[3090602]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 12:30:58 kjcf05n01 rsyncd[3090602]: building file list Nov 3 12:30:58 kjcf05n01 rsyncd[3090602]: sent 11450 bytes received 136 bytes total size 10905 Nov 3 12:30:58 kjcf05n01 systemd[1]: rsyncd@627-172.16.2.2:873-172.16.2.5:52956.service: Succeeded. Nov 3 12:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 12:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 12:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 12:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 12:31:08 kjcf05n00 mcfcli[3673891]: %3|1730658668.024|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:31:08 kjcf05n00 mcfcli[3673891]: %3|1730658668.531|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:31:12 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 12:31:13 kjcf05n03 fstonithd.py[15172]: Listening for kdump packets from partner Nov 3 12:31:27 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib0 Nov 3 12:31:27 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib0 Nov 3 12:31:31 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib1 Nov 3 12:31:31 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib1 Nov 3 12:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 12:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 12:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 12:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 12:31:38 kjcf05n00 mcfcli[3673891]: %3|1730658698.531|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 12:31:45 kjcf05n00 mcfcli[3673891]: %3|1730658705.054|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:31:46 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 12:31:48 kjcf05n03 dwd[5196]: nvme25n1 passed periodic SMART status check Nov 3 12:31:48 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 12:31:49 kjcf05n03 dwd[5196]: nvme9n1 passed periodic SMART status check Nov 3 12:31:49 kjcf05n03 dwd[5196]: nvme23n1 passed periodic SMART status check Nov 3 12:31:49 kjcf05n03 dwd[5196]: nvme18n1 passed periodic SMART status check Nov 3 12:31:49 kjcf05n03 dwd[5196]: nvme4n1 passed periodic SMART status check Nov 3 12:31:49 kjcf05n03 dwd[5196]: nvme8n1 passed periodic SMART status check Nov 3 12:31:49 kjcf05n03 dwd[5196]: nvme2n1 passed periodic SMART status check Nov 3 12:31:50 kjcf05n03 dwd[5196]: nvme3n1 passed periodic SMART status check Nov 3 12:31:50 kjcf05n03 dwd[5196]: nvme17n1 passed periodic SMART status check Nov 3 12:31:50 kjcf05n03 dwd[5196]: nvme24n1 passed periodic SMART status check Nov 3 12:31:50 kjcf05n03 dwd[5196]: nvme19n1 passed periodic SMART status check Nov 3 12:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 12:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 12:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 12:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 12:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 12:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 12:31:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 12:31:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 12:32:08 kjcf05n00 mcfcli[3673891]: %3|1730658728.532|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 12:32:22 kjcf05n00 mcfcli[3673891]: %3|1730658742.109|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:32:24 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='34', client='AF_INET(172.16.2.5:45165)', local='AF_INET(0.0.0.0:601)' Nov 3 12:32:24 kjcf05n02 syslog-ng[3156]: Configuration reload request received, reloading configuration; Nov 3 12:32:24 kjcf05n02 syslog-ng[3156]: Configuration reload finished; Nov 3 12:32:24 kjcf05n02 syslog-ng[3156]: Syslog connection established; fd='18', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 12:32:24 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 3 12:32:24 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 12:32:24 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 3 12:32:24 kjcf05n02 dracut: Self testing crypto algorithms Nov 3 12:32:24 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 3 12:32:24 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 12:32:24 kjcf05n02 Copying live image to RAM... Nov 3 12:32:24 kjcf05n02 (this may take a minute) Nov 3 12:32:24 kjcf05n02 Done copying live image to RAM. Nov 3 12:32:24 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 12:32:24 kjcf05n02 dracut: Checking integrity of kernel Nov 3 12:32:24 kjcf05n02 dracut: All initrd crypto checks done Nov 3 12:32:24 kjcf05n02 dracut: Switching root Nov 3 12:32:24 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 12:32:24 kjcf05n02 systemd: Detected architecture x86-64. Nov 3 12:32:24 kjcf05n02 systemd: Set hostname to . Nov 3 12:32:24 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 12:32:24 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 12:32:24 kjcf05n02 systemd: Reached target rpc_pipefs.target. Nov 3 12:32:24 kjcf05n02 systemd: Reached target ZFS pool import target. Nov 3 12:32:24 kjcf05n02 systemd: Started Forward Password Requests to Wall Directory Watch. Nov 3 12:32:24 kjcf05n02 systemd: Created slice system-serial\x2dgetty.slice. Nov 3 12:32:24 kjcf05n02 systemd: Started Dispatch Password Requests to Console Directory Watch. Nov 3 12:32:24 kjcf05n02 systemd-journald[1519]: Journal started Nov 3 12:32:24 kjcf05n02 systemd-journald[1519]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 12:32:24 kjcf05n02 systemd-modules-load[1510]: Inserted module 'fuse' Nov 3 12:32:24 kjcf05n02 systemd[1]: Mounted /WIBS. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Load Kernel Modules. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 3 12:32:24 kjcf05n02 systemd[1]: Mounted POSIX Message Queue File System. Nov 3 12:32:24 kjcf05n02 systemd[1]: Mounted /data. Nov 3 12:32:24 kjcf05n02 systemd[1]: Mounted /mnt. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Remount Root and Kernel File Systems. Nov 3 12:32:24 kjcf05n02 systemd[1]: Mounted Huge Pages File System. Nov 3 12:32:24 kjcf05n02 systemd[1]: Mounted Kernel Debug File System. Nov 3 12:32:24 kjcf05n02 systemd[1]: Mounted Temporary Directory (/tmp). Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Rebuild Hardware Database... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Load/Save Random Seed... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Create System Users... Nov 3 12:32:24 kjcf05n02 systemd[1]: Mounting Kernel Configuration File System... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Apply Kernel Variables... Nov 3 12:32:24 kjcf05n02 systemd[1]: Mounting FUSE Control File System... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 12:32:24 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 3 12:32:24 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Create System Users. Nov 3 12:32:24 kjcf05n02 systemd-sysctl[1547]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 12:32:24 kjcf05n02 systemd-sysctl[1547]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 3 12:32:24 kjcf05n02 systemd-journald[1519]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 12:32:24 kjcf05n02 systemd-tmpfiles[1553]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 12:32:24 kjcf05n02 systemd-tmpfiles[1553]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 3 12:32:24 kjcf05n02 systemd-udevd[1560]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 3 12:32:24 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 3 12:32:24 kjcf05n02 systemd-udevd[1598]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:32:24 kjcf05n02 systemd-udevd[1613]: Using default interface naming scheme 'rhel-8.0'. Nov 3 12:32:24 kjcf05n02 systemd-udevd[1613]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:32:24 kjcf05n02 systemd-udevd[1619]: Using default interface naming scheme 'rhel-8.0'. Nov 3 12:32:24 kjcf05n02 systemd-udevd[1619]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:32:24 kjcf05n02 systemd-udevd[1617]: Using default interface naming scheme 'rhel-8.0'. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 12:32:24 kjcf05n02 systemd-udevd[1617]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:32:24 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 3 12:32:24 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 12:32:24 kjcf05n02 systemd-tmpfiles[1777]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 12:32:24 kjcf05n02 systemd-tmpfiles[1777]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 12:32:24 kjcf05n02 systemd-tmpfiles[1777]: "/var/tmp" already exists and is not a directory. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 12:32:24 kjcf05n02 root[1797]: openibd: running in auto mode Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started RPC Bind. Nov 3 12:32:24 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 12:32:24 kjcf05n02 systemd-modules-load[1868]: Inserted module 'ib_iser' Nov 3 12:32:24 kjcf05n02 systemd-modules-load[1868]: Inserted module 'ib_isert' Nov 3 12:32:24 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 3 12:32:24 kjcf05n02 systemd-modules-load[1868]: Inserted module 'ib_srpt' Nov 3 12:32:24 kjcf05n02 systemd-udevd[1567]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:32:24 kjcf05n02 systemd-udevd[1579]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:32:24 kjcf05n02 systemd-modules-load[1871]: Inserted module 'ib_ipoib' Nov 3 12:32:24 kjcf05n02 systemd-modules-load[1868]: Inserted module 'rdma_ucm' Nov 3 12:32:24 kjcf05n02 systemd-modules-load[1868]: Module 'svcrdma' is blacklisted Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 12:32:24 kjcf05n02 systemd-udevd[1579]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 12:32:24 kjcf05n02 systemd-udevd[1567]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 12:32:24 kjcf05n02 systemd-modules-load[1871]: Inserted module 'ib_umad' Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 12:32:24 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 3 12:32:24 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 3 12:32:24 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 12:32:24 kjcf05n02 systemd[3156]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:24 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 12:32:24 kjcf05n02 openibd[1781]: Loading HCA driver and Access Layer:[ OK ] Nov 3 12:32:24 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Update is Completed. Nov 3 12:32:24 kjcf05n02 setup-icl[1762]: Setting LAN IP Address to 203.0.113.3 Nov 3 12:32:24 kjcf05n02 setup-icl[1762]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 12:32:24 kjcf05n02 setup-icl[1762]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 12:32:24 kjcf05n02 setup-icl[1762]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 12:32:24 kjcf05n02 systemd-udevd[1567]: Using default interface naming scheme 'rhel-8.0'. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 12:32:24 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 12:32:24 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 12:32:24 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 12:32:24 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 12:32:24 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 12:32:24 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 3 12:32:24 kjcf05n02 systemd[1]: Reached target Sockets. Nov 3 12:32:24 kjcf05n02 systemd[1]: Reached target Basic System. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 12:32:24 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 0 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 1 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 2 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 3 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 4 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 5 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 6 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 7 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 8 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 9 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 10 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 11 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 12 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 13 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 14 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 15 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 16 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 17 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 18 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 19 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 20 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 21 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 22 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 23 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 24 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 25 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 26 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 27 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 28 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 29 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 30 Nov 3 12:32:24 kjcf05n02 cpupower[2078]: Setting cpu: 31 Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 12:32:24 kjcf05n02 mcelog[2085]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 12:32:24 kjcf05n02 mcelog[2085]: CPU is unsupported Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 12:32:24 kjcf05n02 mdraid-phy[2080]: no Cutlass to worry about Nov 3 12:32:24 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 12:32:24 kjcf05n02 chronyd[2095]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 12:32:24 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[2108]: Setting up Mellanox network interface: ib0 Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 3 12:32:24 kjcf05n02 beSetMlxConfig[2122]: ConnectX-3 multiport not detected Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[2121]: Setting up Mellanox network interface: ib1 Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 12:32:24 kjcf05n02 network[2131]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 12:32:24 kjcf05n02 nscd[2177]: 2177 monitoring file `/etc/hosts` (1) Nov 3 12:32:24 kjcf05n02 nscd[2177]: 2177 monitoring directory `/etc` (2) Nov 3 12:32:24 kjcf05n02 nscd[2177]: 2177 monitoring file `/etc/resolv.conf` (3) Nov 3 12:32:24 kjcf05n02 nscd[2177]: 2177 monitoring directory `/etc` (2) Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 12:32:24 kjcf05n02 chronyd[2095]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 12:32:24 kjcf05n02 chronyd[2095]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 12:32:24 kjcf05n02 dbus-daemon[2105]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 12:32:24 kjcf05n02 network[2176]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 12:32:24 kjcf05n02 network[2131]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:32:24 kjcf05n02 dwd[2192]: dwd: vMay 29 2024 : 15:38:26 Nov 3 12:32:24 kjcf05n02 dwd[2192]: dwd: option Lethal: 0 Nov 3 12:32:24 kjcf05n02 dwd[2192]: dwd: option Interval: 60 Nov 3 12:32:24 kjcf05n02 dwd[2192]: dwd: option abrtlimit: 10 Nov 3 12:32:24 kjcf05n02 dwd[2192]: dwd: option DZPeriod: 604800 Nov 3 12:32:24 kjcf05n02 dwd[2192]: dwd: option SmartPeriod: 43200 Nov 3 12:32:24 kjcf05n02 dwd[2192]: dwd: option SDDEnabled: 1 Nov 3 12:32:24 kjcf05n02 dwd[2192]: dwd: option SDDAwaitScale: 3 Nov 3 12:32:24 kjcf05n02 dwd[2192]: dwd: option SDDAwaitMin: 100 Nov 3 12:32:24 kjcf05n02 dwd[2192]: dwd: option Verbosity: 1 Nov 3 12:32:24 kjcf05n02 dwd[2192]: dwd: option StandAlone: 0 Nov 3 12:32:24 kjcf05n02 dwd[2192]: /usr/sbin/dwd -d --standalone=0 Nov 3 12:32:24 kjcf05n02 dwd[2192]: option Lethal: 0 Nov 3 12:32:24 kjcf05n02 dwd[2192]: option Interval: 60 Nov 3 12:32:24 kjcf05n02 dwd[2192]: option abrtlimit: 10 Nov 3 12:32:24 kjcf05n02 dwd[2192]: option DZPeriod: 604800 Nov 3 12:32:24 kjcf05n02 dwd[2192]: option SmartPeriod: 43200 Nov 3 12:32:24 kjcf05n02 dwd[2192]: option SDDEnabled: 1 Nov 3 12:32:24 kjcf05n02 dwd[2192]: option SDDAwaitScale: 3 Nov 3 12:32:24 kjcf05n02 dwd[2192]: option SDDAwaitMin: 100 Nov 3 12:32:24 kjcf05n02 dwd[2192]: option Verbosity: 1 Nov 3 12:32:24 kjcf05n02 dwd[2192]: option StandAlone: 0 Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 0 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 1 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 2 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 3 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 4 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 5 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 6 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 7 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 8 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 9 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 10 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 11 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 12 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 13 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 14 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 15 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 16 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 17 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 18 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 19 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 20 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 21 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 22 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 23 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 24 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 25 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 26 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 27 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 28 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 29 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 30 Nov 3 12:32:24 kjcf05n02 cpupower[2241]: Idlestate 2 disabled on CPU 31 Nov 3 12:32:24 kjcf05n02 network[2224]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:32:24 kjcf05n02 network[2131]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 12:32:24 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 12:32:24 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 12:32:24 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[2228]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 3 12:32:24 kjcf05n02 beSetMlxConfig[2122]: Starting MST (Mellanox Software Tools) driver set Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[2236]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 12:32:24 kjcf05n02 network[2244]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 12:32:24 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[2256]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 12:32:24 kjcf05n02 sssd[sssd][2079]: Starting up Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[2266]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 12:32:24 kjcf05n02 beSetMlxConfig[2122]: Loading MST PCI module - Success Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 12:32:24 kjcf05n02 dbus-daemon[2105]: [system] Successfully activated service 'org.freedesktop.systemd1' Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[2282]: No configuration found for ib0 Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[2285]: No configuration found for ib1 Nov 3 12:32:24 kjcf05n02 beSetMlxConfig[2122]: Loading MST PCI configuration module - Success Nov 3 12:32:24 kjcf05n02 beSetMlxConfig[2122]: Create devices Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[2294]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[2299]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 12:32:24 kjcf05n02 mlnx_conf_mgr[2337]: INFO: No configurations found for mlx5_0, skipping. Nov 3 12:32:24 kjcf05n02 mlnx_conf_mgr[2356]: INFO: No configurations found for mlx5_1, skipping. Nov 3 12:32:24 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 12:32:24 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 12:32:24 kjcf05n02 sssd[be[implicit_files]][2290]: Starting up Nov 3 12:32:24 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 12:32:24 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 12:32:24 kjcf05n02 sssd[nss][2449]: Starting up Nov 3 12:32:24 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 12:32:24 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Login Service... Nov 3 12:32:24 kjcf05n02 systemd-logind[2567]: New seat seat0. Nov 3 12:32:24 kjcf05n02 systemd-logind[2567]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Login Service. Nov 3 12:32:24 kjcf05n02 python3.9[2219]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 12:32:24 kjcf05n02 python3.9[3156]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 12:32:24 kjcf05n02 systemd-sysctl[2785]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 12:32:24 kjcf05n02 systemd-sysctl[2785]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 12:32:24 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 12:32:24 kjcf05n02 python3.9[2928]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 12:32:24 kjcf05n02 python3.9[3156]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 12:32:24 kjcf05n02 network[2131]: Bringing up loopback interface: [ OK ] Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 12:32:24 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 12:32:24 kjcf05n02 systemd-sysctl[3136]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 12:32:24 kjcf05n02 systemd-sysctl[3136]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 12:32:24 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 3 12:32:24 kjcf05n02 systemd[1]: Reached target Network. Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 12:32:24 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 12:32:24 kjcf05n02 sm-notify[3167]: Version 2.3.3 starting Nov 3 12:32:24 kjcf05n02 python3.9[3139]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 12:32:24 kjcf05n02 python3.9[3156]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 3 12:32:24 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 3 12:32:24 kjcf05n02 sshd[3153]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 12:32:24 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 12:32:24 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 3 12:32:24 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 12:32:24 kjcf05n02 beSetMlxConfig[2122]: Unloading MST PCI module (unused) - Success Nov 3 12:32:24 kjcf05n02 lldpad[3152]: setsockopt nearest_bridge: Invalid argument Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 12:32:24 kjcf05n02 lldpad[3152]: setsockopt nearest_bridge: Invalid argument Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 3 12:32:24 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 12:32:24 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 12:32:24 kjcf05n02 syslog-ng[3156]: [2024-11-03T18:31:10.843742] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 12:32:24 kjcf05n02 syslog-ng[3156]: [2024-11-03T18:31:10.844035] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 12:32:24 kjcf05n02 syslog-ng[3156]: [2024-11-03T18:31:10.844072] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 12:32:24 kjcf05n02 syslog-ng[3156]: [2024-11-03T18:31:10.844647] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 12:32:24 kjcf05n02 syslog-ng[3156]: [2024-11-03T18:31:10.844918] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 12:32:24 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 3 12:32:24 kjcf05n02 python3.9[3322]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 12:32:24 kjcf05n02 python3.9[3156]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 12:32:24 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 12:32:24 kjcf05n02 python3.9[3408]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 12:32:24 kjcf05n02 python3.9[3156]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 12:32:24 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 12:32:24 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 12:32:24 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 12:32:24 kjcf05n02 chronyd[2095]: System's initial offset : 0.004419 seconds slow of true (slew) Nov 3 12:32:24 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 12:32:24 kjcf05n02 beSetMlxConfig[2122]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 12:32:24 kjcf05n02 beSetMlxConfig[2122]: ib mode Nov 3 12:32:24 kjcf05n02 root[3428]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 3 12:32:24 kjcf05n02 root[3430]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 3 12:32:24 kjcf05n02 beSetMlxConfig[2122]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 12:32:24 kjcf05n02 beSetMlxConfig[2122]: ib mode Nov 3 12:32:24 kjcf05n02 systemd-udevd[1560]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 12:32:24 kjcf05n02 systemd-udevd[3444]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:32:24 kjcf05n02 systemd-udevd[3445]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:32:24 kjcf05n02 systemd-udevd[3448]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:32:24 kjcf05n02 systemd-udevd[3451]: Using default interface naming scheme 'rhel-8.0'. Nov 3 12:32:24 kjcf05n02 systemd-udevd[3451]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:32:24 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 12:32:24 kjcf05n02 systemd[3156]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:24 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[3486]: Setting up Mellanox network interface: ib0 Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[3487]: Setting up Mellanox network interface: ib1 Nov 3 12:32:24 kjcf05n02 systemd-udevd[3447]: Using default interface naming scheme 'rhel-8.0'. Nov 3 12:32:24 kjcf05n02 systemd-udevd[3446]: Using default interface naming scheme 'rhel-8.0'. Nov 3 12:32:24 kjcf05n02 systemd-udevd[3447]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:32:24 kjcf05n02 systemd-udevd[3446]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[3536]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[3537]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[3568]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[3569]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[3570]: No configuration found for ib0 Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[3571]: No configuration found for ib1 Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[3576]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[3579]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 12:32:24 kjcf05n02 mlnx_conf_mgr[3618]: INFO: No configurations found for mlx5_0, skipping. Nov 3 12:32:24 kjcf05n02 mlnx_conf_mgr[3619]: INFO: No configurations found for mlx5_1, skipping. Nov 3 12:32:24 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 12:32:24 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 12:32:24 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 3 12:32:24 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 3 12:32:24 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 12:32:24 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 3 12:32:24 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 3 12:32:24 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 12:32:24 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 12:32:24 kjcf05n02 lldpad[3152]: init_ports: Error adding device ib0 Nov 3 12:32:24 kjcf05n02 lldpad[3152]: init_ports: Error adding device ib1 Nov 3 12:32:24 kjcf05n02 lldpad[3152]: Signal 15 received - terminating Nov 3 12:32:24 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 3 12:32:24 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 12:32:24 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 12:32:24 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 3 12:32:24 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 12:32:24 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 3 12:32:24 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 3 12:32:24 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:24 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:24 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 1 | Nov-03-2024 | 17:01:18 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 2 | Nov-03-2024 | 17:02:10 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 3 | Nov-03-2024 | 17:02:11 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 4 | Nov-03-2024 | 17:03:16 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 5 | Nov-03-2024 | 17:03:17 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 6 | Nov-03-2024 | 18:28:17 | Sensor #1 (Generator ID 20h) | Voltage | Assertion Event | Lower Non-critical - going low ; Sensor Reading = 7Bh ; Threshold = AFh Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 7 | Nov-03-2024 | 18:28:17 | Sensor #1 (Generator ID 20h) | Voltage | Assertion Event | Lower Critical - going low ; Sensor Reading = 7Bh ; Threshold = A7h Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 8 | Nov-03-2024 | 18:28:17 | Sensor #1 (Generator ID 20h) | Voltage | Assertion Event | Lower Non-recoverable - going low ; Sensor Reading = 7Bh ; Threshold = 96h Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 9 | Nov-03-2024 | 18:28:30 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 10 | Nov-03-2024 | 18:28:30 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 11 | Nov-03-2024 | 18:28:30 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 12 | Nov-03-2024 | 18:28:30 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 13 | Nov-03-2024 | 18:28:30 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 14 | Nov-03-2024 | 18:28:30 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 15 | Nov-03-2024 | 18:28:30 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 16 | Nov-03-2024 | 18:28:30 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 17 | Nov-03-2024 | 18:28:30 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 18 | Nov-03-2024 | 18:28:30 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 19 | Nov-03-2024 | 18:28:30 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 20 | Nov-03-2024 | 18:28:30 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 21 | Nov-03-2024 | 18:28:30 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 22 | Nov-03-2024 | 18:28:30 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 23 | Nov-03-2024 | 18:28:30 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 24 | Nov-03-2024 | 18:28:30 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 25 | Nov-03-2024 | 18:28:30 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 26 | Nov-03-2024 | 18:28:30 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 27 | Nov-03-2024 | 18:28:30 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 28 | Nov-03-2024 | 18:28:30 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 29 | Nov-03-2024 | 18:28:30 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 30 | Nov-03-2024 | 18:28:30 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 31 | Nov-03-2024 | 18:28:31 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 32 | Nov-03-2024 | 18:28:31 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 33 | Nov-03-2024 | 18:28:31 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 34 | Nov-03-2024 | 18:28:31 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 35 | Nov-03-2024 | 18:28:31 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 36 | Nov-03-2024 | 18:28:31 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 37 | Nov-03-2024 | 18:28:31 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 38 | Nov-03-2024 | 18:28:31 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 39 | Nov-03-2024 | 18:28:31 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 40 | Nov-03-2024 | 18:28:31 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 41 | Nov-03-2024 | 18:29:00 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 42 | Nov-03-2024 | 18:29:00 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 43 | Nov-03-2024 | 18:29:00 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 44 | Nov-03-2024 | 18:29:00 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 45 | Nov-03-2024 | 18:29:00 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 46 | Nov-03-2024 | 18:29:00 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 47 | Nov-03-2024 | 18:29:00 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 48 | Nov-03-2024 | 18:29:00 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 49 | Nov-03-2024 | 18:29:00 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 50 | Nov-03-2024 | 18:29:00 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 51 | Nov-03-2024 | 18:29:00 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 52 | Nov-03-2024 | 18:29:00 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 53 | Nov-03-2024 | 18:29:00 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 54 | Nov-03-2024 | 18:29:00 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 55 | Nov-03-2024 | 18:29:00 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 56 | Nov-03-2024 | 18:29:00 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 57 | Nov-03-2024 | 18:29:00 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 58 | Nov-03-2024 | 18:29:00 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 59 | Nov-03-2024 | 18:29:00 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 60 | Nov-03-2024 | 18:29:00 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 61 | Nov-03-2024 | 18:29:00 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 62 | Nov-03-2024 | 18:29:00 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 63 | Nov-03-2024 | 18:29:02 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 64 | Nov-03-2024 | 18:29:02 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 65 | Nov-03-2024 | 18:29:02 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 66 | Nov-03-2024 | 18:29:02 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 67 | Nov-03-2024 | 18:29:02 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 68 | Nov-03-2024 | 18:29:02 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 69 | Nov-03-2024 | 18:29:02 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 70 | Nov-03-2024 | 18:29:02 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 71 | Nov-03-2024 | 18:29:02 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3963]: 72 | Nov-03-2024 | 18:29:02 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 12:32:24 kjcf05n02 ipmievd[3968]: Reading sensors... Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 3 12:32:24 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:24 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 12:32:24 kjcf05n02 nscd[2177]: 2177 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 12:32:24 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 12:32:24 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 3 12:32:24 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 12:32:24 kjcf05n02 beSetMlxConfig[4024]: ConnectX-3 multiport not detected Nov 3 12:32:24 kjcf05n02 beSetMlxConfig[4024]: Starting MST (Mellanox Software Tools) driver set Nov 3 12:32:24 kjcf05n02 beSetMlxConfig[4024]: Loading MST PCI module - Success Nov 3 12:32:24 kjcf05n02 systemd-udevd[1560]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 12:32:24 kjcf05n02 beSetMlxConfig[4024]: [warn] mst_pciconf is already loaded, skipping Nov 3 12:32:24 kjcf05n02 beSetMlxConfig[4024]: Create devices Nov 3 12:32:24 kjcf05n02 beSetMlxConfig[4024]: Unloading MST PCI module (unused) - Success Nov 3 12:32:24 kjcf05n02 ipmievd[3968]: Waiting for events... Nov 3 12:32:24 kjcf05n02 beSetMlxConfig[4024]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 12:32:24 kjcf05n02 beSetMlxConfig[4024]: ib mode Nov 3 12:32:24 kjcf05n02 beSetMlxConfig[4024]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 12:32:24 kjcf05n02 beSetMlxConfig[4024]: ib mode Nov 3 12:32:24 kjcf05n02 systemd-udevd[1560]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 12:32:24 kjcf05n02 systemd-udevd[4923]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:32:24 kjcf05n02 systemd-udevd[4924]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:32:24 kjcf05n02 systemd-udevd[4927]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:32:24 kjcf05n02 systemd-udevd[4930]: Using default interface naming scheme 'rhel-8.0'. Nov 3 12:32:24 kjcf05n02 systemd-udevd[4930]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:32:24 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 12:32:24 kjcf05n02 systemd[3156]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:24 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[4965]: Setting up Mellanox network interface: ib1 Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[4966]: Setting up Mellanox network interface: ib0 Nov 3 12:32:24 kjcf05n02 systemd-udevd[4925]: Using default interface naming scheme 'rhel-8.0'. Nov 3 12:32:24 kjcf05n02 systemd-udevd[4925]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:32:24 kjcf05n02 systemd-udevd[4926]: Using default interface naming scheme 'rhel-8.0'. Nov 3 12:32:24 kjcf05n02 systemd-udevd[4926]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[5016]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[5015]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[5047]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[5046]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[5048]: No configuration found for ib0 Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[5049]: No configuration found for ib1 Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[5056]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 12:32:24 kjcf05n02 mlnx_interface_mgr[5057]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 12:32:24 kjcf05n02 mlnx_conf_mgr[5096]: INFO: No configurations found for mlx5_0, skipping. Nov 3 12:32:24 kjcf05n02 mlnx_conf_mgr[5097]: INFO: No configurations found for mlx5_1, skipping. Nov 3 12:32:24 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 12:32:24 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}a01669fb0dcb523e58b2fbfb8900398f7a8c8d772561b7838a185b1251298798' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}a01669fb0dcb523e58b2fbfb8900398f7a8c8d772561b7838a185b1251298798' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}af89927a4162590f08f466e480b6ee9467e32ce39a69185735ba4d946dc2836b' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}af89927a4162590f08f466e480b6ee9467e32ce39a69185735ba4d946dc2836b' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}4ace4d1e0b09b8e0a98f1fbd40943bc074a9cd9bb17625ac9ac50c13833bb534' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}4ace4d1e0b09b8e0a98f1fbd40943bc074a9cd9bb17625ac9ac50c13833bb534' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}e94ee7fc462f7b75eb2bcded3af806c275514deb0895fd61435dc94852747e59' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}e94ee7fc462f7b75eb2bcded3af806c275514deb0895fd61435dc94852747e59' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 12:32:24 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 3 12:32:24 kjcf05n02 chronyd[2095]: chronyd exiting Nov 3 12:32:24 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 3 12:32:24 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 12:32:24 kjcf05n02 chronyd[5131]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 12:32:24 kjcf05n02 chronyd[5131]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 12:32:24 kjcf05n02 chronyd[5131]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 12:32:24 kjcf05n02 chronyd[5131]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 12:32:24 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 12:32:24 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:24 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 12:32:24 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 3 12:32:24 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 12:32:24 kjcf05n02 dwd[5164]: dwd: vMay 29 2024 : 15:38:26 Nov 3 12:32:24 kjcf05n02 dwd[5164]: /usr/sbin/dwd -i 15 -d Nov 3 12:32:24 kjcf05n02 dwd[5164]: dwd: option Lethal: 0 Nov 3 12:32:24 kjcf05n02 dwd[5164]: dwd: option Interval: 15 Nov 3 12:32:24 kjcf05n02 dwd[5164]: dwd: option abrtlimit: 10 Nov 3 12:32:24 kjcf05n02 dwd[5164]: dwd: option DZPeriod: 604800 Nov 3 12:32:24 kjcf05n02 dwd[5164]: dwd: option SmartPeriod: 43200 Nov 3 12:32:24 kjcf05n02 dwd[5164]: dwd: option SDDEnabled: 1 Nov 3 12:32:24 kjcf05n02 dwd[5164]: dwd: option SDDAwaitScale: 3 Nov 3 12:32:24 kjcf05n02 dwd[5164]: dwd: option SDDAwaitMin: 100 Nov 3 12:32:24 kjcf05n02 dwd[5164]: dwd: option Verbosity: 1 Nov 3 12:32:24 kjcf05n02 dwd[5164]: dwd: option StandAlone: 0 Nov 3 12:32:24 kjcf05n02 dwd[5164]: option Lethal: 0 Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 12:32:24 kjcf05n02 dwd[5164]: option Interval: 15 Nov 3 12:32:24 kjcf05n02 dwd[5164]: option abrtlimit: 10 Nov 3 12:32:24 kjcf05n02 dwd[5164]: option DZPeriod: 604800 Nov 3 12:32:24 kjcf05n02 dwd[5164]: option SmartPeriod: 43200 Nov 3 12:32:24 kjcf05n02 dwd[5164]: option SDDEnabled: 1 Nov 3 12:32:24 kjcf05n02 dwd[5164]: option SDDAwaitScale: 3 Nov 3 12:32:24 kjcf05n02 dwd[5164]: option SDDAwaitMin: 100 Nov 3 12:32:24 kjcf05n02 dwd[5164]: option Verbosity: 1 Nov 3 12:32:24 kjcf05n02 dwd[5164]: option StandAlone: 0 Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 12:32:24 kjcf05n02 dwd[5165]: option Lethal now set to 1 Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 12:32:24 kjcf05n02 dwd[5165]: option abrtlimit now set to 1 Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 12:32:24 kjcf05n02 dwd[5165]: option SmartPeriod now set to 86400 Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 12:32:24 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 12:32:24 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:24 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:24 kjcf05n02 python3.9[5194]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 12:32:24 kjcf05n02 python3.9[3156]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 12:32:24 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:24 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 12:32:24 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:24 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 3 12:32:24 kjcf05n02 sedcpwrkr[5331]: Using config script: /etc/sedcpwrkr.conf Nov 3 12:32:24 kjcf05n02 sedcpwrkr[5331]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 12:32:24 kjcf05n02 sedcpwrkr[5331]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 12:32:24 kjcf05n02 sedcpwrkr[5331]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 12:32:24 kjcf05n02 sedcpwrkr[5331]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 12:32:24 kjcf05n02 sedcpwrkr[5331]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 12:32:24 kjcf05n02 sedcpwrkr[5331]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 12:32:24 kjcf05n02 sedcpwrkr-server[5362]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 12:32:24 kjcf05n02 sedcpwrkr[5331]: celery multi v5.2.7 (dawn-chorus) Nov 3 12:32:24 kjcf05n02 sedcpwrkr[5331]: > Starting nodes... Nov 3 12:32:24 kjcf05n02 sedcpwrkr[5331]: > sedcpwrkr@kjcf05n02: OK Nov 3 12:32:24 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 12:32:24 kjcf05n02 sedcpwrkr-server[5364]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 12:32:24 kjcf05n02 sedcpwrkr-server[5364]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 12:32:24 kjcf05n02 sedcpwrkr-server[5364]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 12:32:24 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 12:32:24 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 3 12:32:24 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 12:32:24 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 12:32:24 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 12:32:25 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:25 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 12:32:25 kjcf05n02 systemd-udevd[1560]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 12:32:25 kjcf05n02 iptables.init[5432]: iptables: Applying firewall rules: [ OK ] Nov 3 12:32:25 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 3 12:32:25 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:26 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 12:32:26 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 12:32:26 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 12:32:26 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:26 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 12:32:27 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5529 which is not our child. We'll most likely not notice when it exits. Nov 3 12:32:27 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 12:32:27 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:27 kjcf05n02 openhpid[5529]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 12:32:27 kjcf05n02 openhpid[5529]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 12:32:27 kjcf05n02 openhpid[5529]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 12:32:27 kjcf05n02 openhpid[5529]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 12:32:27 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib0 Nov 3 12:32:27 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib0 Nov 3 12:32:27 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:27 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:27 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:27 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 12:32:27 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 12:32:27 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 12:32:27 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 12:32:27 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:27 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 12:32:28 kjcf05n02 dcs-collectord[5620]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 12:32:28 kjcf05n02 hpi.inv.log[5620]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 12:32:28 kjcf05n02 dcs-collectord[5620]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 12:32:28 kjcf05n02 dcs-collectord[5620]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 12:32:28 kjcf05n02 dcs-collector[5611]: Starting dcs-collector:[ OK ] Nov 3 12:32:28 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 12:32:28 kjcf05n02 dcs-collectord[5623]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 12:32:28 kjcf05n02 dcs-collectord[5623]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 12:32:28 kjcf05n02 dcs-collectord[5623]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 12:32:28 kjcf05n02 dcs-collectord[5623]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 12:32:28 kjcf05n02 dcs-collectord[5623]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 12:32:28 kjcf05n02 dcs-collectord[5623]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 12:32:28 kjcf05n02 dcs-collectord[5623]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 12:32:28 kjcf05n02 dcs-collectord[5623]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259342020", "units": "kB"}, {"name": "MemAvailable", "value": "258621928", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821280", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686980", "units": "kB"}, {"name": "Inactive", "value": "961724", "units": "kB"}, {"name": "Active(anon)", "value": "1520796", "units": "kB"}, {"name": "Inactive(anon)", "value": "825580", "units": "kB"}, {"name": "Active(file)", "value": "166184", "units": "kB"}, {"name": "Inactive(file)", "value": "136144", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "753152", "units": "kB"}, {"name": "Mapped", "value": "85844", "units": "kB"}, {"name": "Shmem", "value": "1593404", "units": "kB"}, {"name": "KReclaimable", "value": "109656", "units": "kB"}, {"name": "Slab", "value": "275408", "units": "kB"}, {"name": "SReclaimable", "value": "109656", "units": "kB"}, {"name": "SUnreclaim", "value": "165752", "units": "kB"}, {"name": "KernelStack", "value": "9760", "units": "kB"}, {"name": "PageTables", "value": "20396", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3253656", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11264", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "4096", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "305480", "units": "kB"}, {"name": "DirectMap2M", "value": "25774080", "units": "kB"}, {"name": "DirectMap1G", "value": "242221056", "units": "kB"}]}' Nov 3 12:32:28 kjcf05n02 dcs-collectord[5623]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 12:32:28 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 12:32:28 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:28 kjcf05n02 dcs-collectord[5623]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 12:32:28 kjcf05n02 dcs-collectord[5623]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730658748.0972757], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730658748.3388658], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730658748.0223012, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 12:32:28 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:28 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 12:32:28 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:28 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:28 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 12:32:28 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 12:32:28 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 12:32:28 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 12:32:28 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:29 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 12:32:29 kjcf05n02 firmware-update-orc[5729]: Using config script: /etc/firmware_update_orc.conf Nov 3 12:32:29 kjcf05n02 firmware-update-orc[5729]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 12:32:29 kjcf05n02 firmware-update-orc[5729]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 12:32:29 kjcf05n02 firmware-update-orc[5729]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 12:32:29 kjcf05n02 firmware-update-orc[5729]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 12:32:29 kjcf05n02 firmware-update-orc[5729]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 12:32:29 kjcf05n02 firmware-update-orc[5729]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 12:32:29 kjcf05n02 firmware-update-orc-server[5765]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 12:32:29 kjcf05n02 firmware-update-orc[5729]: celery multi v5.2.7 (dawn-chorus) Nov 3 12:32:29 kjcf05n02 firmware-update-orc[5729]: > Starting nodes... Nov 3 12:32:29 kjcf05n02 firmware-update-orc[5729]: > worker1@kjcf05n02: OK Nov 3 12:32:29 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 12:32:29 kjcf05n02 firmware-update-orc-server[5769]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 12:32:29 kjcf05n02 firmware-update-orc-server[5769]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 12:32:29 kjcf05n02 firmware-update-orc-server[5769]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 12:32:29 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 12:32:29 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:30 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:30 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:30 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:30 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 12:32:30 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 12:32:30 kjcf05n02 dbus-daemon[2105]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 12:32:30 kjcf05n02 dbus-daemon[2105]: [system] Reloaded configuration Nov 3 12:32:30 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 12:32:30 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 12:32:30 kjcf05n02 dbus-daemon[2105]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 12:32:30 kjcf05n02 dbus-daemon[2105]: [system] Reloaded configuration Nov 3 12:32:30 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 12:32:30 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 12:32:30 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 12:32:30 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 12:32:30 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 12:32:30 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 12:32:30 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:30 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 3 12:32:31 kjcf05n02 ras-resource-manager-agent[5885]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 12:32:31 kjcf05n02 ras-resource-manager-agent[5871]: Starting ras-resource-manager-agent:[ OK ] Nov 3 12:32:31 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 12:32:31 kjcf05n02 ras-resource-manager-agent[5887]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 12:32:31 kjcf05n02 ras-resource-manager-client[5887]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 12:32:31 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 3 12:32:31 kjcf05n02 ras-resource-manager-client[5887]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 12:32:31 kjcf05n02 ras-resource-manager-client[5897]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 12:32:31 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:31 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib1 Nov 3 12:32:31 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib1 Nov 3 12:32:31 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:31 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:31 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:31 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 12:32:31 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 12:32:31 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:31 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 12:32:31 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:32 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: Press Ctrl+C to exit. Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: Plugin support version 1.0 Nov 3 12:32:32 kjcf05n02 zabbix_agent2[5971]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 12:32:32 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:32 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:32 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:32 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 12:32:32 kjcf05n02 dcs-notification-sender[6048]: dcs-notification-senderd is stopped Nov 3 12:32:32 kjcf05n02 zabbix-agent2[6062]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 12:32:32 kjcf05n02 dcs-notification-sender[6048]: Starting notification-sender:[ OK ] Nov 3 12:32:32 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 12:32:32 kjcf05n02 zabbix-agent2[6064]: INFO DCS notification agent started. (agent.py:61) Nov 3 12:32:32 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 12:32:32 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:33 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:33 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:33 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:33 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:33 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 12:32:33 kjcf05n02 dcs-collectord[6170]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 12:32:33 kjcf05n02 dcs-collectord[6170]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 12:32:33 kjcf05n02 dcs-bulk-data-sender[6170]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 12:32:33 kjcf05n02 dcs-bulk-data-sender[6161]: Starting bulk-data-sender:[ OK ] Nov 3 12:32:33 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 12:32:33 kjcf05n02 dcs-collectord[6172]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 12:32:33 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 12:32:33 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:34 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:34 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:34 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:34 kjcf05n02 nscd[2177]: 2177 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 12:32:34 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 12:32:34 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 12:32:34 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 12:32:34 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 12:32:34 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 12:32:34 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 12:32:34 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 12:32:34 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 12:32:34 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 12:32:34 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 12:32:34 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 12:32:34 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 12:32:34 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 12:32:34 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 12:32:34 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 12:32:34 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 12:32:35 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 3 12:32:35 kjcf05n02 sssd[nss][2449]: Shutting down (status = 0) Nov 3 12:32:35 kjcf05n02 sssd[be[implicit_files]][2290]: Shutting down (status = 0) Nov 3 12:32:35 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 3 12:32:35 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 3 12:32:35 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 12:32:35 kjcf05n02 sssd[sssd][6250]: Starting up Nov 3 12:32:35 kjcf05n02 sssd[be[implicit_files]][6251]: Starting up Nov 3 12:32:35 kjcf05n02 python3.9[5194]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 12:32:35 kjcf05n02 python3.9[3156]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:35 kjcf05n02 sssd[nss][6252]: Starting up Nov 3 12:32:35 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 12:32:35 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 12:32:35 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 12:32:36 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 12:32:36 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 12:32:36 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 12:32:36 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 12:32:36 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 12:32:36 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 12:32:36 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 12:32:36 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 12:32:36 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 12:32:36 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 12:32:36 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 12:32:36 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 12:32:36 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 12:32:36 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 12:32:36 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 12:32:36 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 12:32:36 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:37 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 12:32:37 kjcf05n02 icinga2[6300]: [2024-11-03 12:32:37 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 12:32:37 kjcf05n02 icinga2[6300]: [2024-11-03 12:32:37 -0600] information/cli: Loading configuration file(s). Nov 3 12:32:37 kjcf05n02 icinga2[6300]: [2024-11-03 12:32:37 -0600] information/ConfigItem: Committing config item(s). Nov 3 12:32:37 kjcf05n02 icinga2[6300]: [2024-11-03 12:32:37 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 3 12:32:37 kjcf05n02 icinga2[6300]: [2024-11-03 12:32:37 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 12:32:37 kjcf05n02 icinga2[6300]: [2024-11-03 12:32:37 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 12:32:37 kjcf05n02 icinga2[6300]: [2024-11-03 12:32:37 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 12:32:37 kjcf05n02 icinga2[6300]: [2024-11-03 12:32:37 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 12:32:37 kjcf05n02 icinga2[6300]: [2024-11-03 12:32:37 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 12:32:37 kjcf05n02 icinga2[6300]: [2024-11-03 12:32:37 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 12:32:37 kjcf05n02 icinga2[6300]: [2024-11-03 12:32:37 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 12:32:37 kjcf05n02 icinga2[6300]: [2024-11-03 12:32:37 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 12:32:37 kjcf05n02 icinga2[6300]: [2024-11-03 12:32:37 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 12:32:37 kjcf05n02 icinga2[6300]: [2024-11-03 12:32:37 -0600] information/cli: Closing console log. Nov 3 12:32:37 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 12:32:37 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 12:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 12:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 12:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 12:32:38 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:38 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:38 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:38 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 12:32:38 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 12:32:38 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:38 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 3 12:32:38 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:38 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 12:32:38 kjcf05n00 mcfcli[3673891]: %3|1730658758.532|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:32:39 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:39 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:39 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 12:32:39 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 12:32:39 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 12:32:39 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 12:32:39 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 12:32:39 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 12:32:39 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 12:32:39 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 12:32:39 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 12:32:39 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 12:32:39 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 12:32:39 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 12:32:39 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 12:32:39 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 12:32:39 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:39 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 12:32:39 kjcf05n02 nslcd[6909]: version 0.9.9 starting Nov 3 12:32:39 kjcf05n02 nslcd[6909]: accepting connections Nov 3 12:32:39 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 12:32:39 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:40 kjcf05n02 dcs-bulk-data-sender[6172]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 12:32:40 kjcf05n02 dcs-collectord[6172]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 12:32:40 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:40 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:40 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:40 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 12:32:40 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 12:32:40 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 12:32:40 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 12:32:40 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 12:32:40 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 12:32:41 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 12:32:41 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 12:32:41 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:41 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 12:32:42 kjcf05n02 dearcpw[7014]: Using config script: /etc/dearcpw.conf Nov 3 12:32:42 kjcf05n02 dearcpw[7014]: - Creating default directory: '/var/log/dearcpw' Nov 3 12:32:42 kjcf05n02 dearcpw[7014]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 12:32:42 kjcf05n02 dearcpw[7014]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 12:32:42 kjcf05n02 dearcpw[7014]: - Creating default directory: '/var/run/dearcpw' Nov 3 12:32:42 kjcf05n02 dearcpw[7014]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 12:32:42 kjcf05n02 dearcpw[7014]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 12:32:42 kjcf05n02 dearcpw-server[7054]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 12:32:42 kjcf05n02 dearcpw[7014]: celery multi v5.2.7 (dawn-chorus) Nov 3 12:32:42 kjcf05n02 dearcpw[7014]: > Starting nodes... Nov 3 12:32:42 kjcf05n02 dearcpw[7014]: > dearcpw@kjcf05n02: OK Nov 3 12:32:42 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 12:32:42 kjcf05n02 dearcpw-server[7070]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 12:32:42 kjcf05n02 dearcpw-server[7070]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 12:32:42 kjcf05n02 dearcpw-server[7070]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 12:32:42 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 3 12:32:42 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:42 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:42 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 12:32:42 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 12:32:42 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 12:32:42 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 12:32:42 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 12:32:42 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 12:32:42 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 12:32:42 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 12:32:42 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 12:32:42 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 12:32:42 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:52990). Nov 3 12:32:42 kjcf05n01 rsyncd[3091447]: connect from kjcf05n02 (172.16.2.5) Nov 3 12:32:42 kjcf05n01 rsyncd[3091447]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 12:32:42 kjcf05n01 rsyncd[3091447]: receiving file list Nov 3 12:32:42 kjcf05n01 rsyncd[3091447]: sent 29 bytes received 324 bytes total size 10905 Nov 3 12:32:42 kjcf05n01 systemd[1]: rsyncd@628-172.16.2.2:873-172.16.2.5:52990.service: Succeeded. Nov 3 12:32:43 kjcf05n02 puppet[7097]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 3 12:32:43 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 12:32:43 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 12:32:43 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 12:32:43 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 12:32:43 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 12:32:43 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 12:32:43 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 12:32:43 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 12:32:43 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 12:32:43 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 12:32:43 kjcf05n02 dcs-collectord[5623]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 12:32:43 kjcf05n02 dcs-collectord[5623]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 12:32:43 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 12:32:43 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 12:32:43 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 12:32:43 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 12:32:44 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 12:32:44 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 12:32:44 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 12:32:44 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 12:32:45 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 12:32:45 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 12:32:45 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 12:32:45 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 12:32:46 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 12:32:46 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 12:32:46 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:46 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 12:32:46 kjcf05n02 diskless-swap[7595]: HA_PS_000: recovering journal Nov 3 12:32:46 kjcf05n02 systemd-udevd[1560]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 12:32:46 kjcf05n02 diskless-swap[7595]: HA_PS_000: clean, 2283/6400 files, 7073/25600 blocks Nov 3 12:32:46 kjcf05n02 diskless-swap[7595]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 12:32:46 kjcf05n02 diskless-swap[7595]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 12:32:46 kjcf05n02 diskless-swap[7595]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 12:32:46 kjcf05n02 diskless-swap[7595]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 12:32:46 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 12:32:46 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:46 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:46 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 12:32:46 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 12:32:46 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 12:32:46 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 12:32:46 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 3 12:32:47 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 3 12:32:47 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 3 12:32:47 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 3 12:32:47 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 3 12:32:47 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 12:32:47 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 12:32:47 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 12:32:47 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 12:32:47 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 12:32:47 kjcf05n02 ipmievd[3968]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 12:32:47 kjcf05n02 ipmievd[3968]: System Event sensor - Timestamp Clock Sync Nov 3 12:32:47 kjcf05n02 ipmievd[3156]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:47 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 12:32:47 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 12:32:47 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 12:32:47 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 12:32:47 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 12:32:47 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 12:32:48 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 12:32:48 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 12:32:48 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 12:32:48 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 12:32:49 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 12:32:49 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 12:32:49 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 12:32:49 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 12:32:49 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 12:32:49 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 12:32:50 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 12:32:50 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 12:32:50 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:50 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 3 12:32:50 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:50 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:50 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 12:32:50 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 12:32:50 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:50 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 3 12:32:50 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:50 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:50 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 12:32:50 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 12:32:50 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:51 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 3 12:32:51 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:32:51 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:32:51 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 12:32:51 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 12:32:51 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 12:32:51 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 12:32:51 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 12:32:51 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 12:32:51 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 12:32:51 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 12:32:51 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 12:32:51 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 12:32:51 kjcf05n02 systemd[1]: Reloading. Nov 3 12:32:51 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 3 12:32:51 kjcf05n02 kdumpctl[7825]: kdump: No kdump initial ramdisk found. Nov 3 12:32:51 kjcf05n02 kdumpctl[7825]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 12:32:51 kjcf05n02 dracut[7937]: dracut-049-135.git20210121.el8 Nov 3 12:32:52 kjcf05n02 dracut[7939]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 12:32:52 kjcf05n02 dracut[7939]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 12:32:52 kjcf05n02 dracut[7939]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 12:32:52 kjcf05n02 dracut[7939]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 12:32:52 kjcf05n02 dracut[7939]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 12:32:52 kjcf05n02 dracut[7939]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 12:32:52 kjcf05n02 dracut[7939]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 12:32:52 kjcf05n02 dracut[7939]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local dev holder Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + require_binaries mdadm expr Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _module_name=90hperaid Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ mdadm = \-\m ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for cmd in "$@" Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + find_binary mdadm Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for cmd in "$@" Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + find_binary expr Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n -h ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for dev in "${!host_fs_types[@]}" Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ nfs != *_raid_member ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + continue Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _ret=255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + ret=255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ 255 = 0 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ 255 = 255 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ module_depends hperaid Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: +++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: +++ set -x Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ depends Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo rootfs-block Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ return 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ _ret=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ return 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for _moddep in $(module_depends $_mod) Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all == *\ hperaid\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + add_dracutmodules+=' rootfs-block ' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ == *\ hperaid\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check_module rootfs-block Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _mod=rootfs-block Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ == *\ rootfs-block\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n '' ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all == *\ rootfs-block\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + module_check rootfs-block 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 12:32:52 kjcf05n02 kdumpctl[3156]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 2 -eq 2 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _forced=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _ret=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + ret=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ 0 = 0 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ module_depends rootfs-block Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: +++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 12:32:52 kjcf05n02 kdumpctl[3156]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ depends Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo fs-lib Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ _ret=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ return 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for _moddep in $(module_depends $_mod) Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all == *\ rootfs-block\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + add_dracutmodules+=' fs-lib ' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ == *\ rootfs-block\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check_module fs-lib Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _mod=fs-lib Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n '' ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + mods_checked_as_dep+=' fs-lib ' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all == *\ fs-lib\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + module_check fs-lib 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 2 -eq 2 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _forced=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _ret=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + ret=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ 0 = 0 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ module_depends fs-lib Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: +++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ depends Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ return 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ _ret=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ return 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + mods_to_load+=' fs-lib ' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + mods_to_load+=' rootfs-block ' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + mods_to_load+=' hperaid ' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _mod=90kernel-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _mod=kernel-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check_module kernel-modules 1 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _mod=kernel-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all = all ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + module_check kernel-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 1 -eq 2 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + true Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _ret=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + ret=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ 0 != 0 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ module_depends kernel-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: +++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ depends Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ true Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ _ret=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ return 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + mods_to_load+=' kernel-modules ' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _mod=90kernel-modules-extra Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _mod=kernel-modules-extra Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check_module kernel-modules-extra 1 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _mod=kernel-modules-extra Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all = all ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + module_check kernel-modules-extra Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 1 -eq 2 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + true Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _ret=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + ret=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ 0 != 0 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ module_depends kernel-modules-extra Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: +++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ depends Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ true Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ _ret=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ return 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + mods_to_load+=' kernel-modules-extra ' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _mod=90kernel-network-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _mod=kernel-network-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check_module kernel-network-modules 1 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _mod=kernel-network-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all = all ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + module_check kernel-network-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 1 -eq 2 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _ret=255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + ret=255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ 255 != 0 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 1 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _mod=90livenet Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _mod=livenet Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check_module livenet 1 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _mod=livenet Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all = all ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + module_check livenet Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 1 -eq 2 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _ret=255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + ret=255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ 255 != 0 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 1 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _mod=90lvm Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _mod=lvm Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check_module lvm 1 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _mod=lvm Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all = all ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + module_check lvm Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 1 -eq 2 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + require_binaries lvm Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _module_name=90lvm Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ lvm = \-\m ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for cmd in "$@" Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + find_binary lvm Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n -h ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for fs in "${host_fs_types[@]}" Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ nfs = LVM*_member ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _ret=255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + ret=255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ 255 != 0 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 1 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _mod=90mdraid Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _mod=mdraid Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check_module mdraid 1 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _mod=mdraid Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all = all ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + module_check mdraid Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 1 -eq 2 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _rootdev Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + require_binaries mdadm expr Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _module_name=90mdraid Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ mdadm = \-\m ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for cmd in "$@" Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + find_binary mdadm Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for cmd in "$@" Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + find_binary expr Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n -h ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for dev in "${!host_fs_types[@]}" Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ nfs != *_raid_member ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + continue Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _ret=255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + ret=255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ 255 != 0 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 1 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _mod=90multipath Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _mod=multipath Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check_module multipath 1 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _mod=multipath Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all = all ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + module_check multipath Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 1 -eq 2 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _rootdev Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n -h ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for_each_host_dev_and_slaves is_mpath Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _func=is_mpath Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _dev Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for _dev in "${host_devs[@]}" Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + continue Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 1 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _ret=255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + ret=255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ 255 != 0 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 1 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _mod=90qemu Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _mod=qemu Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check_module qemu 1 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _mod=qemu Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all = all ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + module_check qemu Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 1 -eq 2 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n -h ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + type -P systemd-detect-virt Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ systemd-detect-virt --vm Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + vm=none Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + (( 1 != 0 )) Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _ret=255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + ret=255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ 255 != 0 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 1 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _mod=90qemu-net Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _mod=qemu-net Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check_module qemu-net 1 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _mod=qemu-net Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all = all ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + module_check qemu-net Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 1 -eq 2 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n -h ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + type -P systemd-detect-virt Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ systemd-detect-virt --vm Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + vm= Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + (( 1 != 0 )) Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _ret=255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + ret=255 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ 255 != 0 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + return 1 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _mod=90stratis Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + _mod=stratis Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check_module stratis 1 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _mod=stratis Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddep Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -n 1 ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ all = all ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + module_check stratis Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ read a b Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _forced=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _hostonly=-h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 1 -eq 2 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + is_func check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: ++ type -t check Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + '[' 0 -ne 0 ']' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + check -h Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _module_name=90stratis Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + local _ret=0 Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + [[ stratisd-init = \-\m ]] Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + for cmd in "$@" Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + find_binary stratisd-init Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 12:32:52 kjcf05n02 kdumpctl[7825]: + set +x Nov 3 12:32:52 kjcf05n02 dracut[7939]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 12:32:52 kjcf05n02 dracut[7939]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 12:32:52 kjcf05n02 dracut[7939]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 12:32:52 kjcf05n02 dracut[7939]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 12:32:52 kjcf05n02 dracut[7939]: memstrack is available Nov 3 12:32:52 kjcf05n02 dracut[7939]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 12:32:52 kjcf05n02 dracut[7939]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 12:32:52 kjcf05n02 dracut[7939]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 12:32:52 kjcf05n02 dracut[7939]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 12:32:52 kjcf05n02 dracut[7939]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 12:32:52 kjcf05n02 dracut[7939]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 12:32:53 kjcf05n02 dracut[7939]: *** Including module: bash *** Nov 3 12:32:53 kjcf05n02 dracut[7939]: *** Including module: systemd *** Nov 3 12:32:53 kjcf05n02 dracut[7939]: *** Including module: fips *** Nov 3 12:32:54 kjcf05n02 dracut[7939]: *** Including module: systemd-initrd *** Nov 3 12:32:54 kjcf05n02 dracut[7939]: *** Including module: watchdog-modules *** Nov 3 12:32:54 kjcf05n02 dracut[7939]: *** Including module: nss-softokn *** Nov 3 12:32:54 kjcf05n02 dracut[7939]: *** Including module: i18n *** Nov 3 12:32:54 kjcf05n02 dracut[7939]: No KEYMAP configured. Nov 3 12:32:54 kjcf05n02 dracut[7939]: *** Including module: network-legacy *** Nov 3 12:32:54 kjcf05n02 dracut[7939]: *** Including module: network *** Nov 3 12:32:55 kjcf05n02 dracut[7939]: *** Including module: ib_bonding *** Nov 3 12:32:55 kjcf05n02 dracut[7939]: *** Including module: drm *** Nov 3 12:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 12:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 12:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 12:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 12:32:57 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 3 12:32:58 kjcf05n02 dracut[7939]: *** Including module: hperaid *** Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + install Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + local rule rule_path Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + inst_multiple cat expr Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.GO3fHx/initramfs -a -f cat expr Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + _ret=0 Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + (( 0 != 0 )) Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + : Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + inst_multiple -o mdmon Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.GO3fHx/initramfs -a -f -o mdmon Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + _ret=0 Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + (( 0 != 0 )) Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + : Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: ++ command -v partx Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + inst /usr/sbin/partx /sbin/partx Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + local _hostonly_install Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + [[ -e /tmp/dracut.GO3fHx/initramfs//sbin/partx ]] Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.GO3fHx/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + (( 0 != 0 )) Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + : Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: ++ command -v mdadm Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + local _hostonly_install Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + [[ -e /tmp/dracut.GO3fHx/initramfs//sbin/mdadm ]] Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.GO3fHx/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + (( 0 != 0 )) Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + : Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + [[ yes == \y\e\s ]] Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + local _raidconf Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: ++ cmdline Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: ++ local _activated dev line UUID Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: ++ declare -A _activated Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: ++ for dev in "${!host_fs_types[@]}" Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: ++ [[ nfs != *_raid_member ]] Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: ++ continue Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + _raidconf= Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + [[ -n '' ]] Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + inst_rules 64-md-raid.rules Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + local _target=/etc/udev/rules.d _rule _found Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + inst_dir /usr/lib/udev/rules.d Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + [[ -e /tmp/dracut.GO3fHx/initramfs//usr/lib/udev/rules.d ]] Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + inst_dir /etc/udev/rules.d Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + [[ -e /tmp/dracut.GO3fHx/initramfs//etc/udev/rules.d ]] Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + for _rule in "$@" Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + continue Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + continue Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + for r in '' $dracutbasedir/rules.d/ Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + [[ 64-md-raid.rules != /* ]] Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + continue Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + for r in '' $dracutbasedir/rules.d/ Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + continue Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + [[ -n '' ]] Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + set +x Nov 3 12:32:58 kjcf05n02 dracut[7939]: Skipping udev rule: 64-md-raid.rules Nov 3 12:32:58 kjcf05n02 dcs-collectord[5623]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 12:32:58 kjcf05n02 dcs-collectord[5623]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + installkernel Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + instmods =drivers/md Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + local _optional=-o Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + local _silent Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + local _ret Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + [[ '' = yes ]] Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + [[ =drivers/md = \-\c ]] Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + [[ =drivers/md = \-\s ]] Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + (( 1 == 0 )) Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.GO3fHx/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + _ret=0 Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + (( 0 != 0 )) Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + [[ -n '' ]] Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + _ret=0 Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + unset check depends cmdline install installkernel Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + return 0 Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + modules_loaded+='hperaid ' Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + '[' -n '' ']' Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + _d_mod=90kernel-modules Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + _d_mod=kernel-modules Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + [[ '' = yes ]] Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + dinfo '*** Including module: kernel-modules ***' Nov 3 12:32:58 kjcf05n02 kdumpctl[7825]: + set +x Nov 3 12:32:58 kjcf05n02 dracut[7939]: *** Including module: kernel-modules *** Nov 3 12:32:58 kjcf05n02 dracut[7939]: *** Including module: kernel-modules-extra *** Nov 3 12:32:59 kjcf05n02 dracut[7939]: *** Including module: kernel-network-modules *** Nov 3 12:32:59 kjcf05n00 mcfcli[3673891]: %3|1730658779.033|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:32:59 kjcf05n02 dracut[7939]: *** Including module: diskless-mod *** Nov 3 12:32:59 kjcf05n02 dracut[7939]: *** Including module: fstab-sys *** Nov 3 12:32:59 kjcf05n02 dracut[7939]: *** Including module: nfs *** Nov 3 12:32:59 kjcf05n02 dracut[7939]: *** Including module: rootfs-block *** Nov 3 12:32:59 kjcf05n02 dracut[7939]: *** Including module: terminfo *** Nov 3 12:32:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 12:32:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 12:32:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 12:32:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 12:33:00 kjcf05n02 dracut[7939]: *** Including module: udev-rules *** Nov 3 12:33:00 kjcf05n02 dracut[7939]: Skipping udev rule: 91-permissions.rules Nov 3 12:33:00 kjcf05n02 dracut[7939]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 12:33:00 kjcf05n02 dracut[7939]: *** Including module: dracut-systemd *** Nov 3 12:33:00 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 3 12:33:01 kjcf05n02 dracut[7939]: *** Including module: usrmount *** Nov 3 12:33:01 kjcf05n02 dracut[7939]: *** Including module: base *** Nov 3 12:33:01 kjcf05n02 dracut[7939]: *** Including module: fs-lib *** Nov 3 12:33:01 kjcf05n02 dracut[7939]: *** Including module: kdumpbase *** Nov 3 12:33:02 kjcf05n02 dracut[7939]: *** Including module: memstrack *** Nov 3 12:33:02 kjcf05n02 dracut[7939]: *** Including module: shutdown *** Nov 3 12:33:02 kjcf05n02 dracut[7939]: *** Including module: squash *** Nov 3 12:33:02 kjcf05n00 zabbix-server[1255057]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:33:02 kjcf05n00 zabbix-server[1255057]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:47\\"}}"' Nov 3 12:33:02 kjcf05n00 log_interesting_event.py[1255057]: Event '46206' acknowledged Nov 3 12:33:02 kjcf05n00 zabbix-server[1255058]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:33:02 kjcf05n02 dracut[7939]: *** Including modules done *** Nov 3 12:33:02 kjcf05n02 dracut[7939]: *** Installing kernel module dependencies *** Nov 3 12:33:02 kjcf05n02 dracut[7939]: *** Installing kernel module dependencies done *** Nov 3 12:33:02 kjcf05n00 zabbix-server[1255058]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 3 12:33:02 kjcf05n00 log_interesting_event.py[1255058]: Event '46207' acknowledged Nov 3 12:33:02 kjcf05n02 dracut[7939]: *** Resolving executable dependencies *** Nov 3 12:33:03 kjcf05n02 dracut[7939]: *** Resolving executable dependencies done*** Nov 3 12:33:03 kjcf05n02 dracut[7939]: *** Hardlinking files *** Nov 3 12:33:03 kjcf05n02 dracut[7939]: *** Hardlinking files done *** Nov 3 12:33:03 kjcf05n02 dracut[7939]: *** Generating early-microcode cpio image *** Nov 3 12:33:03 kjcf05n02 dracut[7939]: *** Constructing AuthenticAMD.bin **** Nov 3 12:33:03 kjcf05n02 dracut[7939]: *** Store current command line parameters *** Nov 3 12:33:03 kjcf05n02 dracut[7939]: Stored kernel commandline: Nov 3 12:33:03 kjcf05n02 dracut[7939]: rd.driver.pre=sd_mod Nov 3 12:33:03 kjcf05n02 dracut[7939]: rd.driver.pre=nvme Nov 3 12:33:03 kjcf05n02 dracut[7939]: rd.driver.pre=ipmi_si Nov 3 12:33:03 kjcf05n02 dracut[7939]: rd.driver.pre=ipmi_devintf Nov 3 12:33:03 kjcf05n02 dracut[7939]: rd.driver.pre=ipmi_msghandler Nov 3 12:33:03 kjcf05n02 dracut[7939]: nameserver=172.16.2.2 Nov 3 12:33:03 kjcf05n02 dracut[7939]: nameserver=127.0.0.1 Nov 3 12:33:03 kjcf05n02 dracut[7939]: nameserver=172.16.2.2 Nov 3 12:33:03 kjcf05n02 dracut[7939]: nameserver=127.0.0.1 Nov 3 12:33:03 kjcf05n02 dracut[7939]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 3 12:33:03 kjcf05n02 dracut[7939]: rd.neednet Nov 3 12:33:03 kjcf05n02 dracut[7939]: kdumpnic=mgmt0 Nov 3 12:33:03 kjcf05n02 dracut[7939]: bootdev=mgmt0 Nov 3 12:33:03 kjcf05n02 dracut[7939]: *** Install squash loader *** Nov 3 12:33:04 kjcf05n02 dracut[7939]: *** Squashing the files inside the initramfs *** Nov 3 12:33:04 kjcf05n02 dracut[7939]: *** Squashing the files inside the initramfs done *** Nov 3 12:33:04 kjcf05n02 dracut[7939]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 12:33:05 kjcf05n02 dracut[7939]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 12:33:05 kjcf05n02 kdumpctl[7825]: kdump: kexec: loaded kdump kernel Nov 3 12:33:05 kjcf05n02 kdumpctl[7825]: kdump: Starting kdump: [OK] Nov 3 12:33:05 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 3 12:33:05 kjcf05n02 systemd[1]: Reloading. Nov 3 12:33:05 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:33:05 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:33:05 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:33:05 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 12:33:05 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 12:33:05 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 12:33:05 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 12:33:05 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 12:33:05 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 12:33:05 kjcf05n02 ifdown[14507]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 12:33:05 kjcf05n02 ifdown[14515]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:33:05 kjcf05n02 ifdown[14516]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:33:05 kjcf05n00 zabbix-server[1255064]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:33:05 kjcf05n00 zabbix-server[1255064]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 3 12:33:05 kjcf05n00 log_interesting_event.py[1255064]: Event '46211' acknowledged Nov 3 12:33:06 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 12:33:06 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 12:33:06 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 12:33:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730658785', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 2.16, 1.98, 0.87'}"] Nov 3 12:33:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 2.16, 1.98, 0.87', 'message': 'OK - load average: 2.16, 1.98, 0.87', 'value': 'ok', 'timestamp': '1730658785'} Nov 3 12:33:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:33:06 kjcf05n02 ifup[14592]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 12:33:06 kjcf05n02 ifup[14594]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:33:06 kjcf05n02 ifup[14595]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:33:08 kjcf05n00 mcfcli[3673891]: %3|1730658788.533|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 12:33:08 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 12:33:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730658789', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 327 processes with STATE = RSZDT '}"] Nov 3 12:33:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 327 processes with STATE = RSZDT ', 'message': 'PROCS OK: 327 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730658789'} Nov 3 12:33:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:33:10 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 12:33:11 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 12:33:11 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 12:33:11 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:33:11 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:33:11 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:33:11 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:33:11 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 12:33:11 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 12:33:11 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 12:33:11 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 12:33:11 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:33:11 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:33:11 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:33:11 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:33:11 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 12:33:11 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 12:33:11 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 12:33:11 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 12:33:11 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 12:33:11 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 12:33:11 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 12:33:11 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 12:33:11 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 12:33:11 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 12:33:11 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 12:33:11 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 12:33:11 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 12:33:11 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 12:33:11 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 12:33:11 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 12:33:11 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 12:33:11 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 12:33:11 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 12:33:11 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 12:33:11 kjcf05n02 ifdown[14777]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 12:33:11 kjcf05n02 ifdown[14778]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:33:11 kjcf05n02 ifdown[14779]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:33:11 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 12:33:11 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 12:33:11 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 12:33:11 kjcf05n02 ifup[14852]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 12:33:11 kjcf05n02 ifup[14853]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:33:11 kjcf05n02 ifup[14855]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:33:13 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 12:33:13 kjcf05n02 dcs-collectord[5623]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 12:33:13 kjcf05n02 dcs-collectord[5623]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 12:33:15 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 12:33:15 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 12:33:15 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 12:33:15 kjcf05n02 systemd[1]: Reloading. Nov 3 12:33:16 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 3 12:33:16 kjcf05n02 await_ha_peer[15053]: Waiting for HA peer kjcf05n03 Nov 3 12:33:17 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 12:33:17 kjcf05n02 await_ha_peer[15053]: Peer kjcf05n03 has started, starting HA Nov 3 12:33:17 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 3 12:33:17 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 3 12:33:17 kjcf05n02 fstonithd.py[15108]: Listening for kdump packets from partner Nov 3 12:33:17 kjcf05n02 systemd[1]: Reloading. Nov 3 12:33:18 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:33:18 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:33:18 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:33:18 kjcf05n02 systemd[1]: Reloading. Nov 3 12:33:18 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 3 12:33:18 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 12:33:18 kjcf05n02 systemd[1]: Reloading. Nov 3 12:33:19 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 12:33:19 kjcf05n02 puppet-agent[3553]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 12:33:19 kjcf05n02 puppet[3553]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 12:33:19 kjcf05n02 puppet-agent[3553]: Applied catalog in 91.40 seconds Nov 3 12:33:19 kjcf05n02 puppet[3553]: Notice: Applied catalog in 91.40 seconds Nov 3 12:33:19 kjcf05n02 systemd[1]: Started Puppet agent. Nov 3 12:33:19 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 12:33:19 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 12:33:19 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 12:33:19 kjcf05n02 systemd[1]: Reached target Timers. Nov 3 12:33:19 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 12:33:19 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 12:33:19 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 12:33:19 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 12:33:19 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 3 12:33:19 kjcf05n02 wce-disable.sh[15249]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 12:33:19 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 12:33:19 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 12:33:19 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 12:33:19 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 12:33:19 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 3 12:33:19 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 3 12:33:19 kjcf05n02 python3.9[15253]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 12:33:19 kjcf05n02 python3.9[15253]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 12:33:19 kjcf05n02 gateway-ec-node.py[15252]: Starting gateway-ec-node service Nov 3 12:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730658799', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.5% (3881912 kB) used.'}"] Nov 3 12:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.5% (3881912 kB) used.', 'message': 'OK - 1.5% (3881912 kB) used.', 'value': 'ok', 'timestamp': '1730658799'} Nov 3 12:33:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:33:19 kjcf05n02 RFSF-API[15251]: INFO[2024-11-03T12:33:19-06:00] Datapath API RESTful Service starting Nov 3 12:33:19 kjcf05n02 dp-api-server-node[15251]: INFO[2024-11-03T12:33:19-06:00] Datapath API RESTful Service starting Nov 3 12:33:19 kjcf05n02 RFSF-API[15251]: INFO[2024-11-03T12:33:19-06:00] Running in production mode, starting dbus event listener Nov 3 12:33:19 kjcf05n02 dp-api-server-node[15251]: INFO[2024-11-03T12:33:19-06:00] Running in production mode, starting dbus event listener Nov 3 12:33:19 kjcf05n02 RFSF-API[15251]: INFO[2024-11-03T12:33:19-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 12:33:19 kjcf05n02 dp-api-server-node[15251]: INFO[2024-11-03T12:33:19-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 12:33:19 kjcf05n02 RFSF-API[15251]: INFO[2024-11-03T12:33:19-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 12:33:19 kjcf05n02 dp-api-server-node[15251]: INFO[2024-11-03T12:33:19-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 12:33:19 kjcf05n02 RFSF-API[15251]: INFO[2024-11-03T12:33:19-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 12:33:19 kjcf05n02 dp-api-server-node[15251]: INFO[2024-11-03T12:33:19-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 12:33:19 kjcf05n02 RFSF-API[15251]: INFO[2024-11-03T12:33:19-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 12:33:19 kjcf05n02 dp-api-server-node[15251]: INFO[2024-11-03T12:33:19-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 12:33:19 kjcf05n02 RFSF-API[15251]: INFO[2024-11-03T12:33:19-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 12:33:19 kjcf05n02 dp-api-server-node[15251]: INFO[2024-11-03T12:33:19-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 12:33:19 kjcf05n02 RFSF-API[15251]: INFO[2024-11-03T12:33:19-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 12:33:19 kjcf05n02 dp-api-server-node[15251]: INFO[2024-11-03T12:33:19-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 12:33:19 kjcf05n02 RFSF-API[15251]: INFO[2024-11-03T12:33:19-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 12:33:19 kjcf05n02 dp-api-server-node[15251]: INFO[2024-11-03T12:33:19-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 12:33:19 kjcf05n02 RFSF-API[15251]: INFO[2024-11-03T12:33:19-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 12:33:19 kjcf05n02 dp-api-server-node[15251]: INFO[2024-11-03T12:33:19-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 12:33:19 kjcf05n02 RFSF-API[15251]: INFO[2024-11-03T12:33:19-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 12:33:19 kjcf05n02 dp-api-server-node[15251]: INFO[2024-11-03T12:33:19-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 12:33:19 kjcf05n02 RFSF-API[15251]: INFO[2024-11-03T12:33:19-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 12:33:19 kjcf05n02 dp-api-server-node[15251]: INFO[2024-11-03T12:33:19-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 12:33:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730658801', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 12:33:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730658801'} Nov 3 12:33:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:33:23 kjcf05n02 systemd[1]: Reloading. Nov 3 12:33:23 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 12:33:23 kjcf05n02 systemd[1]: Reloading. Nov 3 12:33:23 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 12:33:24 kjcf05n02 diskmonitor_pre[15619]: Key management is currently disabled.DEAR disabled Nov 3 12:33:24 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 12:33:25 kjcf05n02 sh[15683]: LNET configured: New Created Nov 3 12:33:25 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 12:33:25 kjcf05n02 LCNmon[17773]: Interface ib0 is up Nov 3 12:33:25 kjcf05n02 LCNmon[17773]: Interface ib1 is up Nov 3 12:33:25 kjcf05n02 LCNmon[17773]: Can ping through interface ib0 Nov 3 12:33:25 kjcf05n02 LCNmon[17773]: Can ping through interface ib1 Nov 3 12:33:25 kjcf05n02 LCNmon[17773]: NIC ib0, initial state UP Nov 3 12:33:25 kjcf05n02 LCNmon[17773]: NIC ib1, initial state UP Nov 3 12:33:25 kjcf05n02 LCNmon[17773]: LCNstat initial state UP Nov 3 12:33:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730658805', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 12:33:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730658805'} Nov 3 12:33:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:33:26 kjcf05n02 LCNmon[17773]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 3 12:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T12:33:27.253524451-06:00 level=info msg="Completed cleanup jobs" duration=26.608372ms Nov 3 12:33:28 kjcf05n02 dcs-collectord[5623]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 12:33:28 kjcf05n02 dcs-collectord[5623]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 12:33:28 kjcf05n02 dcs-collectord[5623]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: /var/run/diskmonitor does not exist, creating Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: Creating /var/run/diskmonitor/disk Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: Creating /var/run/diskmonitor/encl Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: Creating /var/run/diskmonitor/cli Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: RAS_Interlocks_enabled: 1 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: add handler for sig: 14 sa_flags: 10000004 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: add handler for sig: 1 sa_flags: 10000004 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: add handler for sig: 2 sa_flags: 00000004 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: add handler for sig: 15 sa_flags: 00000004 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: add handler for sig: 6 sa_flags: 00000004 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: add handler for sig: 3 sa_flags: 00000004 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: add handler for sig: 30 sa_flags: 00000004 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: add handler for sig: 20 sa_flags: 00000004 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: add handler for sig: 10 sa_flags: 10000004 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: add handler for sig: 11 sa_flags: 00000004 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: add handler for sig: 7 sa_flags: 00000004 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: add handler for sig: 4 sa_flags: 00000004 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: add handler for sig: 8 sa_flags: 00000004 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: Using HA Baton locks - key: diskmonitor Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: Baton will be held for at most 570 seconds Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: DMMP Enabled: 0 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: random seed: 4ec0193a Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: NVMe Enclosure: 1 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: ZFS Enclosure: 0 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: Dbus, Initialized Connection Successfully Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: int_catcher_thread: thread start Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: Received dbus message 4 org.freedesktop.DBus -> :1.89 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 12:33:28 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 12:33:29 kjcf05n00 httpd[902568]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 12:33:30 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 12:33:32 kjcf05n02 openhpid[5529]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 12:33:33 kjcf05n02 openhpid[5529]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 12:33:33 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 3 12:33:33 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 12:33:33 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 12:33:33 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18467 which is not our child. We'll most likely not notice when it exits. Nov 3 12:33:33 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 12:33:33 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 3 12:33:33 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 3 12:33:33 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 12:33:33 kjcf05n02 dcs-collectord[5623]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 12:33:33 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 12:33:33 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 12:33:33 kjcf05n02 systemd[1]: Startup finished in 50.272s (kernel) + 2min 29.882s (userspace) = 3min 20.155s. Nov 3 12:33:33 kjcf05n02 openhpid[18467]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 12:33:33 kjcf05n02 openhpid[18467]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 12:33:33 kjcf05n02 openhpid[18467]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 12:33:33 kjcf05n02 openhpid[18467]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 12:33:34 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 12:33:34 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18602 (bash) Nov 3 12:33:34 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 12:33:34 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 12:33:34 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 12:33:34 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 12:33:34 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 12:33:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730658816', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 12:33:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730658816', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 12:33:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730658816'} Nov 3 12:33:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730658816'} Nov 3 12:33:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:33:38 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 12:33:38 kjcf05n00 mcfcli[3673891]: %3|1730658818.533|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:33:38 kjcf05n00 mcfcli[3673891]: %3|1730658818.760|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:33:43 kjcf05n02 dcs-collectord[5623]: WARNING No data collected (hpi_parser.py:353) Nov 3 12:33:43 kjcf05n02 dcs-collectord[5623]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 12:33:46 kjcf05n00 zabbix-server[1255612]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:33:46 kjcf05n00 zabbix-server[1255612]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 103.39\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 132.3\\"}}"' Nov 3 12:33:47 kjcf05n00 log_interesting_event.py[1255612]: Event '46222' acknowledged Nov 3 12:33:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730658828', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(2968.0B/2316.0B), ib1=(2744.0B/2676.0B), icl0=(8.8kB/10.5kB), lo=(1688.0B/1688.0B), meth0=(1541.8MB/8.2MB), mgmt0=(1478.6MB/8.1MB)'}"] Nov 3 12:33:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(2968.0B/2316.0B), ib1=(2744.0B/2676.0B), icl0=(8.8kB/10.5kB), lo=(1688.0B/1688.0B), meth0=(1541.8MB/8.2MB), mgmt0=(1478.6MB/8.1MB)', 'message': 'NET OK - (Rx/Tx) ib0=(2968.0B/2316.0B), ib1=(2744.0B/2676.0B), icl0=(8.8kB/10.5kB), lo=(1688.0B/1688.0B), meth0=(1541.8MB/8.2MB), mgmt0=(1478.6MB/8.1MB)', 'value': 'ok', 'timestamp': '1730658828'} Nov 3 12:33:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:33:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730658828', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 12:33:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730658828'} Nov 3 12:33:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:33:56 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31433 deleted. Nov 3 12:33:57 kjcf05n02 ipmievd[3968]: System Event sensor - Timestamp Clock Sync Nov 3 12:33:58 kjcf05n02 ipmievd[3156]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:33:58 kjcf05n02 dcs-collectord[5623]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 12:34:06 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 12:34:07 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 12:34:08 kjcf05n03 nslcd[6943]: [e8944a] ldap_result() failed: Can't contact LDAP server Nov 3 12:34:08 kjcf05n00 mcfcli[3673891]: %3|1730658848.533|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:34:13 kjcf05n02 dcs-collectord[5623]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 12:34:15 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '3a48fb48-9a12-11ef-9f38-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 12:34:15 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '3a48fb48-9a12-11ef-9f38-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 12:34:15 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '3a48fb48-9a12-11ef-9f38-00093d0695e3', 'response ID': '3a530d90-9a12-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 12:34:15 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 3a530d90-9a12-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 12:34:15 kjcf05n00 mcfcli[3673891]: %3|1730658855.221|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:34:15 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db01007002538450000000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 12:34:15 kjcf05n02 ras-resource-manager-agent[5887]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "3a48fb48-9a12-11ef-9f38-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 12:34:15 kjcf05n02 ras-resource-manager-agent[5887]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '3a48fb48-9a12-11ef-9f38-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 12:34:15 kjcf05n02 ras-resource-manager-agent[5887]: INFO Submitting new device inserted signal, starting to qualify drive: 3a48fb48-9a12-11ef-9f38-00093d0695e3 (admin_action.py:110) Nov 3 12:34:15 kjcf05n03 firmware-update-orc-server[5875]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "c2d75c92-f5ce-41e0-b8b8-1c3d56b6eafb"} (logger.py:65) Nov 3 12:34:15 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 84066 (get_disk_device) Nov 3 12:34:15 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 12:34:15 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 12:34:15 kjcf05n03 ccp-client[84088]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 12:34:15 kjcf05n03 ccp-client[84088]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 12:34:15 kjcf05n03 ccp-client[84097]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 12:34:15 kjcf05n03 ccp-client[84088]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 12:34:15 kjcf05n03 ccp-client[84088]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 12:34:15 kjcf05n03 ccp-client[84097]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 12:34:15 kjcf05n03 ccp-client[84097]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 12:34:15 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '3a96295e-9a12-11ef-9f38-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 12:34:15 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '3a96295e-9a12-11ef-9f38-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 12:34:15 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '3a96295e-9a12-11ef-9f38-00093d0695e3', 'response ID': '3a9d015c-9a12-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 12:34:15 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 3a9d015c-9a12-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 12:34:15 kjcf05n02 diskmonitor[17388]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 12:34:15 kjcf05n02 ras-resource-manager-agent[5887]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "3a96295e-9a12-11ef-9f38-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 12:34:15 kjcf05n02 ras-resource-manager-agent[5887]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '3a96295e-9a12-11ef-9f38-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 12:34:15 kjcf05n02 ras-resource-manager-agent[5887]: INFO Submitting new device inserted signal, starting to qualify drive: 3a96295e-9a12-11ef-9f38-00093d0695e3 (admin_action.py:110) Nov 3 12:34:15 kjcf05n02 firmware-update-orc-server[5844]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "13ececcb-857a-44a4-9995-1f3cdd931d1c"} (logger.py:65) Nov 3 12:34:18 kjcf05n03 DRVFW[84208]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 12:34:18 kjcf05n03 ccp-client[84209]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 12:34:18 kjcf05n03 ccp-client[84209]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 12:34:18 kjcf05n03 ccp-client[84218]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 12:34:18 kjcf05n03 ccp-client[84209]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 12:34:18 kjcf05n03 ccp-client[84209]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 12:34:18 kjcf05n03 ccp-client[84218]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 12:34:18 kjcf05n03 ccp-client[84218]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 12:34:18 kjcf05n03 firmware-update-orc-server[5875]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 12:34:20 kjcf05n02 ras-resource-manager-agent[5887]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '3a48fb48-9a12-11ef-9f38-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 12:34:20 kjcf05n02 ras-resource-manager-agent[5887]: INFO Drive qualification complete responding: 3a48fb48-9a12-11ef-9f38-00093d0695e3 (admin_action.py:205) Nov 3 12:34:20 kjcf05n02 ras-resource-manager-agent[5887]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "3a48fb48-9a12-11ef-9f38-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (interesting_event.py:59) Nov 3 12:34:20 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 3a530d90-9a12-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 12:34:20 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '3a48fb48-9a12-11ef-9f38-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '3a48fb48-9a12-11ef-9f38-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}}} (logger.py:65) Nov 3 12:34:23 kjcf05n02 diskmonitor[17388]: 4 Nov 3 12:34:23 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 12:34:23 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 12:34:23 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 12:34:23 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 12:34:23 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 12:34:23 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 12:34:23 kjcf05n02 diskmonitor[17388]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 12:34:23 kjcf05n02 diskmonitor[17388]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 12:34:23 kjcf05n02 diskmonitor[17388]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 12:34:23 kjcf05n02 diskmonitor[17388]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 12:34:23 kjcf05n02 diskmonitor[17388]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 12:34:23 kjcf05n02 diskmonitor[17388]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "3a48fb48-9a12-11ef-9f38-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 12:34:23 kjcf05n02 diskmonitor[17388]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 12:34:23 kjcf05n02 diskmonitor[17388]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 12:34:23 kjcf05n02 diskmonitor[17388]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "3a96295e-9a12-11ef-9f38-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 12:34:23 kjcf05n02 diskmonitor[17388]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 12:34:23 kjcf05n02 diskmonitor[17388]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 12:34:25 kjcf05n02 ras-resource-manager-agent[5887]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "3a48fb48-9a12-11ef-9f38-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (service_main_handler.py:66) Nov 3 12:34:25 kjcf05n02 ras-resource-manager-agent[5887]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '3a48fb48-9a12-11ef-9f38-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 12:34:25 kjcf05n02 ras-resource-manager-agent[5887]: INFO Device qualification response has been acknowledged: 3a48fb48-9a12-11ef-9f38-00093d0695e3 (admin_action.py:151) Nov 3 12:34:29 kjcf05n02 diskmonitor[17388]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 12:34:29 kjcf05n02 diskmonitor[17388]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 12:34:29 kjcf05n02 ras-resource-manager-agent[5887]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "42e9d056-9a12-11ef-9f38-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 12:34:29 kjcf05n02 ras-resource-manager-agent[5887]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '42e9d056-9a12-11ef-9f38-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 12:34:29 kjcf05n02 ras-resource-manager-agent[5887]: INFO Requests ['3a96295e-9a12-11ef-9f38-00093d0695e3', '42e9d056-9a12-11ef-9f38-00093d0695e3'] already in progress (admin_action.py:99) Nov 3 12:34:30 kjcf05n02 chronyd[5131]: Selected source 172.16.2.1 Nov 3 12:34:30 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 23689 (get_disk_device) Nov 3 12:34:30 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 12:34:30 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 12:34:31 kjcf05n02 ccp-client[23714]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 12:34:31 kjcf05n02 ccp-client[23714]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 12:34:31 kjcf05n02 ccp-client[23729]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 12:34:31 kjcf05n02 ccp-client[23714]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 12:34:31 kjcf05n02 ccp-client[23714]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 12:34:31 kjcf05n02 ccp-client[23729]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 12:34:31 kjcf05n02 ccp-client[23729]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 12:34:34 kjcf05n02 DRVFW[24000]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 12:34:34 kjcf05n02 ccp-client[24001]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 12:34:34 kjcf05n02 ccp-client[24001]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 12:34:34 kjcf05n02 ccp-client[24016]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 12:34:34 kjcf05n02 ccp-client[24001]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 12:34:34 kjcf05n02 ccp-client[24001]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 12:34:34 kjcf05n02 ccp-client[24016]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 12:34:34 kjcf05n02 ccp-client[24016]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 12:34:34 kjcf05n02 firmware-update-orc-server[5844]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 12:34:34 kjcf05n02 ras-resource-manager-agent[5887]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '3a96295e-9a12-11ef-9f38-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 12:34:34 kjcf05n02 ras-resource-manager-agent[5887]: INFO Drive qualification complete responding: 3a96295e-9a12-11ef-9f38-00093d0695e3 (admin_action.py:205) Nov 3 12:34:34 kjcf05n02 ras-resource-manager-agent[5887]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "3a96295e-9a12-11ef-9f38-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 3 12:34:34 kjcf05n02 ras-resource-manager-agent[5887]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "42e9d056-9a12-11ef-9f38-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 3 12:34:35 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 3 12:34:35 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 12:34:35 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 3 12:34:34 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 3a9d015c-9a12-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 12:34:34 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '3a96295e-9a12-11ef-9f38-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '3a96295e-9a12-11ef-9f38-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}}} (logger.py:65) Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "3a48fb48-9a12-11ef-9f38-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: Dbus, handle_ingress_ras_signals, uuid: 3a48fb48-9a12-11ef-9f38-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "3a48fb48-9a12-11ef-9f38-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: main: Pending firmware leveling requests exist, rescanning disks Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "42e9d056-9a12-11ef-9f38-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: leaving test state: 1 next state: 2 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: lock req: no timeout Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: leaving test state: 2 next state: 4 Nov 3 12:34:36 kjcf05n02 diskmonitor[17388]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 12:34:38 kjcf05n00 mcfcli[3673891]: %3|1730658878.534|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 12:34:48 kjcf05n02 python3.9[5194]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 12:34:55 kjcf05n00 mcfcli[3673891]: %3|1730658895.218|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:34:56 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31430 deleted. Nov 3 12:34:56 kjcf05n03 nslcd[6943]: [8e1f29] ldap_result() failed: Can't contact LDAP server Nov 3 12:35:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730658902}"] Nov 3 12:35:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730658902, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:35:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:35:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730658902}"] Nov 3 12:35:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730658902, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:35:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:35:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730658902}"] Nov 3 12:35:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730658902, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:35:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:35:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730658902}"] Nov 3 12:35:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730658902, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:35:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:35:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730658902}"] Nov 3 12:35:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730658902, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:35:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:35:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730658902}"] Nov 3 12:35:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730658902, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:35:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:35:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730658903}"] Nov 3 12:35:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730658903, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:35:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:35:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730658903}"] Nov 3 12:35:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730658903, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:35:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:35:08 kjcf05n00 mcfcli[3673891]: %3|1730658908.534|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 12:35:09 kjcf05n00 python3.9[1256363]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 12:35:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730658634', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 12:35:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730658634'} Nov 3 12:35:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:35:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730658634', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 12:35:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730658634'} Nov 3 12:35:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:35:27 kjcf05n02 python3.9[3156]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:35:27 kjcf05n02 ras-resource-manager-agent[5887]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "3a96295e-9a12-11ef-9f38-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 12:35:27 kjcf05n02 ras-resource-manager-agent[5887]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '3a96295e-9a12-11ef-9f38-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 12:35:27 kjcf05n02 ras-resource-manager-agent[5887]: INFO Device qualification response has been acknowledged: 3a96295e-9a12-11ef-9f38-00093d0695e3 (admin_action.py:151) Nov 3 12:35:27 kjcf05n02 ras-resource-manager-agent[5887]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "42e9d056-9a12-11ef-9f38-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 12:35:27 kjcf05n02 ras-resource-manager-agent[5887]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '42e9d056-9a12-11ef-9f38-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 12:35:27 kjcf05n02 ras-resource-manager-agent[5887]: INFO Device qualification response has been acknowledged: 42e9d056-9a12-11ef-9f38-00093d0695e3 (admin_action.py:151) Nov 3 12:35:28 kjcf05n02 diskmonitor[17388]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 12:35:33 kjcf05n00 mcfcli[3673891]: %3|1730658933.382|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:35:36 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 12:35:36 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 12:35:36 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 12:35:38 kjcf05n00 mcfcli[3673891]: %3|1730658938.534|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 12:35:45 kjcf05n02 diskmonitor[17388]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "3a96295e-9a12-11ef-9f38-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 12:35:45 kjcf05n02 diskmonitor[17388]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 12:35:45 kjcf05n02 diskmonitor[17388]: Dbus, handle_ingress_ras_signals, uuid: 3a96295e-9a12-11ef-9f38-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 12:35:45 kjcf05n02 diskmonitor[17388]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 12:35:45 kjcf05n02 diskmonitor[17388]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "3a96295e-9a12-11ef-9f38-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 12:35:45 kjcf05n02 diskmonitor[17388]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "42e9d056-9a12-11ef-9f38-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 12:35:45 kjcf05n02 diskmonitor[17388]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 12:35:45 kjcf05n02 diskmonitor[17388]: Dbus, handle_ingress_ras_signals, uuid: 42e9d056-9a12-11ef-9f38-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 12:35:45 kjcf05n02 diskmonitor[17388]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "42e9d056-9a12-11ef-9f38-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 12:35:45 kjcf05n02 diskmonitor[17388]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 12:35:45 kjcf05n02 diskmonitor[17388]: lock acquired Nov 3 12:35:45 kjcf05n02 diskmonitor[17388]: leaving test state: 4 next state: 8 Nov 3 12:35:45 kjcf05n02 diskmonitor[17388]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 12:35:52 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 12:35:52 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 12:35:52 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 12:35:54 kjcf05n02 dcs-collectord[5623]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 12:35:57 kjcf05n02 diskmonitor[17388]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 12:35:57 kjcf05n02 diskmonitor[17388]: leaving test state: 8 next state: 20 Nov 3 12:35:57 kjcf05n02 diskmonitor[17388]: leaving test state: 20 next state: 40 Nov 3 12:35:57 kjcf05n02 diskmonitor[17388]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 22ecd7e0000 Nov 3 12:35:57 kjcf05n02 diskmonitor[17388]: leaving test state: 40 next state: 80 Nov 3 12:36:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730658962}"] Nov 3 12:36:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730658962, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:36:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:36:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:36:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:36:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:36:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:36:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:36:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:36:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:36:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:36:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:36:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:36:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:36:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:36:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.972253ms Nov 3 12:36:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:36:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.972253ms Nov 3 12:36:03 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:36:03 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:36:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:36:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730658966}"] Nov 3 12:36:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730658966, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:36:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:36:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:36:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:36:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:36:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:36:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:36:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:36:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:36:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:36:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:36:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:36:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:36:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:36:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.858821ms Nov 3 12:36:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:36:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.858821ms Nov 3 12:36:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:36:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:36:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:36:08 kjcf05n00 mcfcli[3673891]: %3|1730658968.534|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 12:36:11 kjcf05n00 mcfcli[3673891]: %3|1730658971.554|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:36:13 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 12:36:38 kjcf05n00 mcfcli[3673891]: %3|1730658998.535|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 12:36:49 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 12:36:51 kjcf05n00 mcfcli[3673891]: %3|1730659011.009|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:37:01 kjcf05n02 diskmonitor[17388]: leaving test state: 80 next state: 100 Nov 3 12:37:01 kjcf05n02 diskmonitor[17388]: lock release: time: Sun Nov 3 12:36:56 2024 Nov 3 12:37:01 kjcf05n02 diskmonitor[17388]: leaving test state: 100 next state: 1 Nov 3 12:37:08 kjcf05n00 mcfcli[3673891]: %3|1730659028.536|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 12:37:29 kjcf05n00 mcfcli[3673891]: %3|1730659049.478|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:37:38 kjcf05n00 mcfcli[3673891]: %3|1730659058.536|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:38:06 kjcf05n00 mcfcli[3673891]: %3|1730659086.184|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:38:08 kjcf05n00 mcfcli[3673891]: %3|1730659088.538|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 12:38:38 kjcf05n00 mcfcli[3673891]: %3|1730659118.538|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:38:44 kjcf05n00 mcfcli[3673891]: %3|1730659124.393|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:38:51 kjcf05n01 diskmonitor[1331407]: leaving test state: 1 next state: 2 Nov 3 12:38:51 kjcf05n01 diskmonitor[1331407]: lock req: no timeout Nov 3 12:38:51 kjcf05n01 diskmonitor[1331407]: leaving test state: 2 next state: 4 Nov 3 12:39:08 kjcf05n00 mcfcli[3673891]: %3|1730659148.539|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:39:21 kjcf05n00 mcfcli[3673891]: %3|1730659161.174|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:39:38 kjcf05n00 mcfcli[3673891]: %3|1730659178.539|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 12:39:50 kjcf05n00 zabbix-server[1259222]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:39:50 kjcf05n00 zabbix-server[1259222]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n02' from event '46226' Nov 3 12:39:50 kjcf05n00 zabbix-server[1259222]: Host created 'enclosure_USE26000024VS001' Nov 3 12:39:50 kjcf05n00 zabbix-server[1259222]: Running puppet on 'kjcf05n02' Nov 3 12:39:52 kjcf05n02 puppet-agent[35644]: Using configured environment 'production' Nov 3 12:39:52 kjcf05n02 puppet-agent[35644]: Retrieving pluginfacts Nov 3 12:39:52 kjcf05n02 puppet-agent[35644]: Retrieving plugin Nov 3 12:39:52 kjcf05n02 puppet-agent[35644]: Loading facts Nov 3 12:39:56 kjcf05n02 puppet-agent[35644]: Caching catalog for kjcf05n02 Nov 3 12:39:56 kjcf05n02 puppet-agent[35644]: Applying configuration version '1730659194' Nov 3 12:39:56 kjcf05n01 diskmonitor[1331407]: lock acquired Nov 3 12:39:56 kjcf05n01 diskmonitor[1331407]: leaving test state: 4 next state: 8 Nov 3 12:39:58 kjcf05n02 puppet-agent[35644]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 12:39:58 kjcf05n02 puppet-agent[35644]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 12:39:58 kjcf05n02 puppet-agent[35644]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 12:39:58 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 12:39:58 kjcf05n02 zabbix_agent2[5971]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 12:39:58 kjcf05n02 zabbix_agent2[3156]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:39:58 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 12:39:58 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 12:39:58 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 12:39:58 kjcf05n02 puppet-agent[35644]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: Press Ctrl+C to exit. Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: Plugin support version 1.0 Nov 3 12:39:58 kjcf05n02 zabbix_agent2[35992]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 12:39:59 kjcf05n00 mcfcli[3673891]: %3|1730659199.494|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 12:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 12:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 12:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 12:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 12:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 12:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 12:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 12:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 12:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 12:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 12:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 12:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 12:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 12:40:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 12:40:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:40:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 12:40:00 kjcf05n02 puppet-agent[35644]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 12:40:00 kjcf05n02 puppet-agent[35644]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 12:40:00 kjcf05n02 puppet-agent[35644]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 12:40:00 kjcf05n02 puppet-agent[35644]: Applied catalog in 5.04 seconds Nov 3 12:40:00 kjcf05n00 zabbix-server[1259222]: puppet completed status:(0): '' Nov 3 12:40:00 kjcf05n00 zabbix-server[1259222]: Event '46226' acknowledged Nov 3 12:40:00 kjcf05n00 zabbix-server[1259222]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n02"}' Nov 3 12:40:05 kjcf05n01 diskmonitor[1331407]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 3 12:40:05 kjcf05n01 diskmonitor[1331407]: leaving test state: 8 next state: 20 Nov 3 12:40:05 kjcf05n01 diskmonitor[1331407]: leaving test state: 20 next state: 40 Nov 3 12:40:05 kjcf05n01 diskmonitor[1331407]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset f676de8000 Nov 3 12:40:05 kjcf05n01 diskmonitor[1331407]: leaving test state: 40 next state: 80 Nov 3 12:40:08 kjcf05n00 mcfcli[3673891]: %3|1730659208.539|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 12:40:09 kjcf05n00 python3.9[1259412]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 12:40:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730658634', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 12:40:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730658634'} Nov 3 12:40:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:40:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730658634', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 12:40:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730658634'} Nov 3 12:40:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:40:38 kjcf05n00 mcfcli[3673891]: %3|1730659238.540|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 12:40:38 kjcf05n00 mcfcli[3673891]: %3|1730659238.546|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:41:02 kjcf05n01 diskmonitor[1331407]: leaving test state: 80 next state: 100 Nov 3 12:41:02 kjcf05n01 diskmonitor[1331407]: lock release: time: Sun Nov 3 12:40:59 2024 Nov 3 12:41:02 kjcf05n01 diskmonitor[1331407]: leaving test state: 100 next state: 1 Nov 3 12:41:08 kjcf05n00 mcfcli[3673891]: %3|1730659268.541|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 12:41:16 kjcf05n00 mcfcli[3673891]: %3|1730659276.622|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:41:38 kjcf05n00 mcfcli[3673891]: %3|1730659298.541|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:41:55 kjcf05n00 mcfcli[3673891]: %3|1730659315.176|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:42:08 kjcf05n00 mcfcli[3673891]: %3|1730659328.541|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:42:34 kjcf05n00 mcfcli[3673891]: %3|1730659354.408|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:42:38 kjcf05n00 mcfcli[3673891]: %3|1730659358.542|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:43:08 kjcf05n00 mcfcli[3673891]: %3|1730659388.543|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:43:14 kjcf05n00 mcfcli[3673891]: %3|1730659394.405|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T12:43:27.268081796-06:00 level=info msg="Completed cleanup jobs" duration=41.245335ms Nov 3 12:43:38 kjcf05n00 mcfcli[3673891]: %3|1730659418.543|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 12:43:51 kjcf05n00 mcfcli[3673891]: %3|1730659431.029|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:44:08 kjcf05n02 root[42746]: failback_xyraid Nov 3 12:44:08 kjcf05n00 mcfcli[3673891]: %3|1730659448.544|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 12:44:10 kjcf05n02 root[42880]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 12:44:11 kjcf05n02 root[43018]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 12:44:14 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 3 12:44:18 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme8n1 Nov 3 12:44:18 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme17n1 Nov 3 12:44:18 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme24n1 Nov 3 12:44:18 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme4n1 Nov 3 12:44:18 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme18n1 Nov 3 12:44:18 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme25n1 Nov 3 12:44:18 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme9n1 Nov 3 12:44:18 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme19n1 Nov 3 12:44:18 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme2n1 Nov 3 12:44:18 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme23n1 Nov 3 12:44:18 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme3n1 Nov 3 12:44:19 kjcf05n02 dwd[5165]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 12:44:19 kjcf05n02 dwd[5165]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 12:44:19 kjcf05n02 dwd[5165]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 12:44:19 kjcf05n02 dwd[5165]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 12:44:19 kjcf05n02 dwd[5165]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 12:44:19 kjcf05n02 dwd[5165]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 12:44:19 kjcf05n02 dwd[5165]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 12:44:19 kjcf05n02 dwd[5165]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 12:44:19 kjcf05n02 dwd[5165]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 12:44:19 kjcf05n02 dwd[5165]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 12:44:19 kjcf05n02 dwd[5165]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 12:44:19 kjcf05n02 dwd[5165]: Starting NVME thread for nvme2n1 Nov 3 12:44:19 kjcf05n02 dwd[5165]: Starting NVME thread for nvme18n1 Nov 3 12:44:20 kjcf05n02 dcs-bulk-data-sender[6172]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 3 12:44:20 kjcf05n02 dwd[5165]: Starting NVME thread for nvme19n1 Nov 3 12:44:20 kjcf05n02 dwd[5165]: Starting NVME thread for nvme9n1 Nov 3 12:44:20 kjcf05n02 systemd-udevd[45726]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45725]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45727]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45729]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45725]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45727]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45726]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45729]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45725]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45727]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45729]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45726]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45725]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45729]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45727]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45726]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 dwd[5165]: Starting NVME thread for nvme3n1 Nov 3 12:44:20 kjcf05n02 systemd-udevd[45725]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45727]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45726]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45729]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45725]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45727]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45726]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45729]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45725]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45726]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45727]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45729]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45725]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45757]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45762]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45726]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45760]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45729]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45727]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45765]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45725]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45757]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45725]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45726]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45757]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45729]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45729]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45725]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45729]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45729]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45729]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45783]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45787]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45790]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45783]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45793]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45787]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45783]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45790]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45787]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45783]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45783]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45783]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45787]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45783]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45787]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45783]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:44:20 kjcf05n02 systemd-udevd[45787]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 12:44:21 kjcf05n02 dwd[5165]: Starting NVME thread for nvme24n1 Nov 3 12:44:21 kjcf05n02 nslcd[6909]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 12:44:21 kjcf05n02 dwd[5165]: Starting NVME thread for nvme4n1 Nov 3 12:44:21 kjcf05n02 dwd[5165]: Starting NVME thread for nvme23n1 Nov 3 12:44:21 kjcf05n02 dwd[5165]: Starting NVME thread for nvme17n1 Nov 3 12:44:21 kjcf05n02 dwd[5165]: Starting NVME thread for nvme25n1 Nov 3 12:44:21 kjcf05n02 dwd[5165]: Starting NVME thread for nvme8n1 Nov 3 12:44:31 kjcf05n00 mcfcli[3673891]: %3|1730659471.026|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:44:31 kjcf05n02 diskmonitor[17388]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 12:44:34 kjcf05n03 diskmonitor[17569]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 12:44:34 kjcf05n03 diskmonitor[17569]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 12:44:38 kjcf05n00 mcfcli[3673891]: %3|1730659478.544|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 12:44:39 kjcf05n02 diskmonitor[17388]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 12:44:39 kjcf05n02 diskmonitor[17388]: Scan for ReadErrorMax change for md65 Nov 3 12:44:39 kjcf05n02 diskmonitor[17388]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 12:44:39 kjcf05n02 diskmonitor[17388]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 12:44:39 kjcf05n02 diskmonitor[17388]: read_saved_file: md65 no saved speed Nov 3 12:44:39 kjcf05n02 diskmonitor[17388]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 12:44:39 kjcf05n02 diskmonitor[17388]: Set sync_speed_min (10000) for md65 Nov 3 12:44:39 kjcf05n02 diskmonitor[17388]: Set sync_speed_max (200000) for md65 Nov 3 12:44:39 kjcf05n02 diskmonitor[17388]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 12:45:01 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 48151 (bash) Nov 3 12:45:01 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 12:45:01 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 12:45:09 kjcf05n00 mcfcli[3673891]: %3|1730659509.044|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 12:45:09 kjcf05n00 python3.9[1262362]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 12:45:10 kjcf05n00 mcfcli[3673891]: %3|1730659510.959|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:45:13 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 12:45:13 kjcf05n02 systemd-tmpfiles[48769]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 12:45:13 kjcf05n02 systemd-tmpfiles[48769]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 12:45:13 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 12:45:13 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 12:45:39 kjcf05n00 mcfcli[3673891]: %3|1730659539.044|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 12:45:49 kjcf05n00 mcfcli[3673891]: %3|1730659549.526|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:46:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730659563}"] Nov 3 12:46:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730659563, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:46:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.062953ms Nov 3 12:46:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.062953ms Nov 3 12:46:03 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:46:03 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:46:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:46:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730659563}"] Nov 3 12:46:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730659563, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:46:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.158001ms Nov 3 12:46:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.158001ms Nov 3 12:46:03 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:46:03 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:46:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:46:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730659563}"] Nov 3 12:46:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730659563, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:46:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.985389ms Nov 3 12:46:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.985389ms Nov 3 12:46:03 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:46:03 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:46:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:46:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730659563}"] Nov 3 12:46:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730659563, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:46:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.880462ms Nov 3 12:46:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.880462ms Nov 3 12:46:03 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:46:03 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:46:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:46:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730659563}"] Nov 3 12:46:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730659563, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:46:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.030352ms Nov 3 12:46:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.030352ms Nov 3 12:46:03 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:46:03 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:46:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:46:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730659563}"] Nov 3 12:46:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730659563, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:46:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.228514ms Nov 3 12:46:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.228514ms Nov 3 12:46:04 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:46:04 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:46:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:46:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730659563}"] Nov 3 12:46:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730659563, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:46:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.277795ms Nov 3 12:46:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.277795ms Nov 3 12:46:04 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:46:04 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:46:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:46:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730659563}"] Nov 3 12:46:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730659563, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:46:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.245445ms Nov 3 12:46:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.245445ms Nov 3 12:46:04 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:46:04 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:46:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:46:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730659564}"] Nov 3 12:46:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730659564, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:46:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.674085ms Nov 3 12:46:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.674085ms Nov 3 12:46:04 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:46:04 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:46:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:46:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730659564}"] Nov 3 12:46:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730659564, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:46:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.477941ms Nov 3 12:46:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.477941ms Nov 3 12:46:04 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:46:04 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:46:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:46:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730659564}"] Nov 3 12:46:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730659564, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 12:46:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 12:46:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T12:46:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 12:46:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T12:46:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 12:46:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T12:46:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.123667ms Nov 3 12:46:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T12:46:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.123667ms Nov 3 12:46:04 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:12:46:04 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 12:46:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:46:09 kjcf05n00 mcfcli[3673891]: %3|1730659569.045|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 12:46:29 kjcf05n00 mcfcli[3673891]: %3|1730659589.299|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:46:39 kjcf05n00 mcfcli[3673891]: %3|1730659599.047|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 12:46:45 kjcf05n00 zabbix-server[1263625]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:46:45 kjcf05n00 zabbix-server[1263625]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 98.39\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 95.05\\"}}"' Nov 3 12:46:45 kjcf05n00 log_interesting_event.py[1263625]: Event '46229' acknowledged Nov 3 12:47:09 kjcf05n00 mcfcli[3673891]: %3|1730659629.257|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 12:47:09 kjcf05n00 mcfcli[3673891]: %3|1730659629.296|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:47:39 kjcf05n00 mcfcli[3673891]: %3|1730659659.257|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:47:46 kjcf05n00 mcfcli[3673891]: %3|1730659666.935|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:48:07 kjcf05n00 diskmonitor[2758297]: leaving test state: 1 next state: 2 Nov 3 12:48:07 kjcf05n00 diskmonitor[2758297]: lock req: no timeout Nov 3 12:48:07 kjcf05n00 diskmonitor[2758297]: leaving test state: 2 next state: 4 Nov 3 12:48:09 kjcf05n00 mcfcli[3673891]: %3|1730659689.257|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:48:26 kjcf05n00 mcfcli[3673891]: %3|1730659706.932|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:48:39 kjcf05n00 mcfcli[3673891]: %3|1730659719.258|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:49:06 kjcf05n00 mcfcli[3673891]: %3|1730659746.611|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:49:09 kjcf05n00 mcfcli[3673891]: %3|1730659749.258|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:49:17 kjcf05n00 diskmonitor[2758297]: lock acquired Nov 3 12:49:17 kjcf05n00 diskmonitor[2758297]: leaving test state: 4 next state: 8 Nov 3 12:49:25 kjcf05n00 diskmonitor[2758297]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 3 12:49:25 kjcf05n00 diskmonitor[2758297]: leaving test state: 8 next state: 20 Nov 3 12:49:25 kjcf05n00 diskmonitor[2758297]: leaving test state: 20 next state: 40 Nov 3 12:49:25 kjcf05n00 diskmonitor[2758297]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset 164ab9d0000 Nov 3 12:49:25 kjcf05n00 diskmonitor[2758297]: leaving test state: 40 next state: 80 Nov 3 12:49:34 kjcf05n02 dwd[5165]: nvme2n1 passed periodic SMART status check Nov 3 12:49:35 kjcf05n02 dwd[5165]: nvme3n1 passed periodic SMART status check Nov 3 12:49:35 kjcf05n02 dwd[5165]: nvme19n1 passed periodic SMART status check Nov 3 12:49:35 kjcf05n02 dwd[5165]: nvme9n1 passed periodic SMART status check Nov 3 12:49:35 kjcf05n02 dwd[5165]: nvme24n1 passed periodic SMART status check Nov 3 12:49:35 kjcf05n02 dwd[5165]: nvme18n1 passed periodic SMART status check Nov 3 12:49:36 kjcf05n02 dwd[5165]: nvme4n1 passed periodic SMART status check Nov 3 12:49:36 kjcf05n02 dwd[5165]: nvme17n1 passed periodic SMART status check Nov 3 12:49:36 kjcf05n02 dwd[5165]: nvme25n1 passed periodic SMART status check Nov 3 12:49:36 kjcf05n02 dwd[5165]: nvme8n1 passed periodic SMART status check Nov 3 12:49:36 kjcf05n02 dwd[5165]: nvme23n1 passed periodic SMART status check Nov 3 12:49:39 kjcf05n00 mcfcli[3673891]: %3|1730659779.258|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:49:45 kjcf05n00 mcfcli[3673891]: %3|1730659785.839|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:49:51 kjcf05n00 zabbix-server[1265599]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:49:51 kjcf05n00 zabbix-server[1265599]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46230' Nov 3 12:49:51 kjcf05n00 zabbix-server[1265599]: Filesystem 'kjcf05' has been mounted Nov 3 12:49:52 kjcf05n00 zabbix-server[1265599]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 12:49:52 kjcf05n00 zabbix-server[1265599]: Running puppet on 'None' Nov 3 12:49:54 kjcf05n05 puppet-agent[3304619]: Using configured environment 'production' Nov 3 12:49:54 kjcf05n05 puppet-agent[3304619]: Retrieving pluginfacts Nov 3 12:49:54 kjcf05n05 puppet-agent[3304619]: Retrieving plugin Nov 3 12:49:54 kjcf05n06 puppet-agent[3150900]: Using configured environment 'production' Nov 3 12:49:54 kjcf05n06 puppet-agent[3150900]: Retrieving pluginfacts Nov 3 12:49:54 kjcf05n06 puppet-agent[3150900]: Retrieving plugin Nov 3 12:49:54 kjcf05n07 puppet-agent[3148204]: Using configured environment 'production' Nov 3 12:49:54 kjcf05n07 puppet-agent[3148204]: Retrieving pluginfacts Nov 3 12:49:54 kjcf05n07 puppet-agent[3148204]: Retrieving plugin Nov 3 12:49:54 kjcf05n04 puppet-agent[3147436]: Using configured environment 'production' Nov 3 12:49:54 kjcf05n04 puppet-agent[3147436]: Retrieving pluginfacts Nov 3 12:49:54 kjcf05n04 puppet-agent[3147436]: Retrieving plugin Nov 3 12:49:54 kjcf05n02 puppet-agent[56801]: Using configured environment 'production' Nov 3 12:49:54 kjcf05n02 puppet-agent[56801]: Retrieving pluginfacts Nov 3 12:49:54 kjcf05n02 puppet-agent[56801]: Retrieving plugin Nov 3 12:49:54 kjcf05n03 puppet-agent[111472]: Using configured environment 'production' Nov 3 12:49:54 kjcf05n03 puppet-agent[111472]: Retrieving pluginfacts Nov 3 12:49:54 kjcf05n03 puppet-agent[111472]: Retrieving plugin Nov 3 12:49:54 kjcf05n06 puppet-agent[3150900]: Loading facts Nov 3 12:49:54 kjcf05n04 puppet-agent[3147436]: Loading facts Nov 3 12:49:54 kjcf05n01 puppet-agent[3098807]: Using configured environment 'production' Nov 3 12:49:54 kjcf05n01 puppet-agent[3098807]: Retrieving pluginfacts Nov 3 12:49:54 kjcf05n01 puppet-agent[3098807]: Retrieving plugin Nov 3 12:49:54 kjcf05n02 puppet-agent[56801]: Loading facts Nov 3 12:49:54 kjcf05n05 puppet-agent[3304619]: Loading facts Nov 3 12:49:54 kjcf05n03 puppet-agent[111472]: Loading facts Nov 3 12:49:55 kjcf05n07 puppet-agent[3148204]: Loading facts Nov 3 12:49:54 kjcf05n00 puppet-agent[1265689]: Using configured environment 'production' Nov 3 12:49:54 kjcf05n00 puppet-agent[1265689]: Retrieving pluginfacts Nov 3 12:49:54 kjcf05n00 puppet-agent[1265689]: Retrieving plugin Nov 3 12:49:55 kjcf05n01 puppet-agent[3098807]: Loading facts Nov 3 12:49:55 kjcf05n00 puppet-agent[1265689]: Loading facts Nov 3 12:49:57 kjcf05n06 puppet-agent[3150900]: Caching catalog for kjcf05n06 Nov 3 12:49:57 kjcf05n06 puppet-agent[3150900]: Applying configuration version '1730659796' Nov 3 12:49:57 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 12:49:57 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 12:49:58 kjcf05n03 puppet-agent[111472]: Caching catalog for kjcf05n03 Nov 3 12:49:58 kjcf05n03 puppet-agent[111472]: Applying configuration version '1730659795' Nov 3 12:49:58 kjcf05n07 puppet-agent[3148204]: Caching catalog for kjcf05n07 Nov 3 12:49:58 kjcf05n07 puppet-agent[3148204]: Applying configuration version '1730659796' Nov 3 12:49:58 kjcf05n02 puppet-agent[56801]: Caching catalog for kjcf05n02 Nov 3 12:49:58 kjcf05n02 puppet-agent[56801]: Applying configuration version '1730659796' Nov 3 12:49:58 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 12:49:59 kjcf05n01 puppet-agent[3098807]: Caching catalog for kjcf05n01 Nov 3 12:49:59 kjcf05n01 puppet-agent[3098807]: Applying configuration version '1730659797' Nov 3 12:49:59 kjcf05n06 puppet-agent[3150900]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 12:49:59 kjcf05n06 puppet-agent[3150900]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 12:49:59 kjcf05n06 puppet-agent[3150900]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 12:49:59 kjcf05n00 puppet-agent[1265689]: Caching catalog for kjcf05n00 Nov 3 12:49:59 kjcf05n00 puppet-agent[1265689]: Applying configuration version '1730659797' Nov 3 12:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 12:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 12:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 12:50:00 kjcf05n02 puppet-agent[56801]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 12:50:00 kjcf05n02 puppet-agent[56801]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 12:50:00 kjcf05n02 puppet-agent[56801]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 12:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 12:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 12:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 12:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 12:50:00 kjcf05n03 puppet-agent[111472]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 12:50:00 kjcf05n03 puppet-agent[111472]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 12:50:00 kjcf05n03 puppet-agent[111472]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 12:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 12:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 12:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 12:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 12:50:00 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3099623]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 12:50:00 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 12:50:00 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 12:50:00 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 12:50:00 kjcf05n06 puppet-agent[3150900]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 12:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: Press Ctrl+C to exit. Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: Plugin support version 1.0 Nov 3 12:50:00 kjcf05n06 zabbix_agent2[3151977]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 12:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 12:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 12:50:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 12:50:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 12:50:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 12:50:00 kjcf05n07 puppet-agent[3148204]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 12:50:00 kjcf05n07 puppet-agent[3148204]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 12:50:00 kjcf05n07 puppet-agent[3148204]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 12:50:01 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 12:50:01 kjcf05n02 zabbix_agent2[35992]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 12:50:01 kjcf05n02 zabbix_agent2[3156]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 12:50:01 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 12:50:01 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 12:50:01 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 12:50:01 kjcf05n02 puppet-agent[56801]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: Press Ctrl+C to exit. Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: Plugin support version 1.0 Nov 3 12:50:01 kjcf05n02 zabbix_agent2[57272]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 12:50:01 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 12:50:01 kjcf05n03 zabbix_agent2[57042]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 12:50:01 kjcf05n03 zabbix_agent2[3189]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 12:50:01 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 12:50:01 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 12:50:01 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 12:50:01 kjcf05n03 puppet-agent[111472]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: Press Ctrl+C to exit. Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: Plugin support version 1.0 Nov 3 12:50:01 kjcf05n03 zabbix_agent2[112285]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 12:50:01 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3096187]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 12:50:01 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 12:50:01 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 12:50:01 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 12:50:01 kjcf05n07 puppet-agent[3148204]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: Press Ctrl+C to exit. Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: Plugin support version 1.0 Nov 3 12:50:01 kjcf05n07 zabbix_agent2[3148740]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 12:50:02 kjcf05n06 puppet-agent[3150900]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 12:50:02 kjcf05n06 puppet-agent[3150900]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 12:50:02 kjcf05n06 puppet-agent[3150900]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 12:50:02 kjcf05n06 puppet-agent[3150900]: Applied catalog in 4.83 seconds Nov 3 12:50:02 kjcf05n01 puppet-agent[3098807]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 12:50:02 kjcf05n01 puppet-agent[3098807]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-12:26:12]/mode) mode changed '0755' to '0750' Nov 3 12:50:02 kjcf05n01 puppet-agent[3098807]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-12:26:12/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 12:50:02 kjcf05n01 puppet-agent[3098807]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-12:26:12/vmcore]/mode) mode changed '0600' to '0640' Nov 3 12:50:02 kjcf05n01 puppet-agent[3098807]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-12:26:12/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 12:50:02 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 12:50:02 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 12:50:02 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 12:50:02 kjcf05n04 puppet-agent[3147436]: Caching catalog for kjcf05n04 Nov 3 12:50:02 kjcf05n04 puppet-agent[3147436]: Applying configuration version '1730659800' Nov 3 12:50:03 kjcf05n01 puppet-agent[3098807]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 12:50:03 kjcf05n01 puppet-agent[3098807]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 12:50:03 kjcf05n01 puppet-agent[3098807]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 12:50:02 kjcf05n00 puppet-agent[1265689]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 12:50:03 kjcf05n07 puppet-agent[3148204]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 12:50:03 kjcf05n07 puppet-agent[3148204]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 12:50:03 kjcf05n07 puppet-agent[3148204]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 12:50:03 kjcf05n03 puppet-agent[111472]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 12:50:03 kjcf05n03 puppet-agent[111472]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 12:50:03 kjcf05n03 puppet-agent[111472]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 12:50:03 kjcf05n02 puppet-agent[56801]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 12:50:03 kjcf05n02 puppet-agent[56801]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 12:50:03 kjcf05n02 puppet-agent[56801]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 12:50:03 kjcf05n02 puppet-agent[56801]: Applied catalog in 5.04 seconds Nov 3 12:50:03 kjcf05n07 puppet-agent[3148204]: Applied catalog in 4.95 seconds Nov 3 12:50:03 kjcf05n03 puppet-agent[111472]: Applied catalog in 5.13 seconds Nov 3 12:50:03 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3086497]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 12:50:03 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 12:50:03 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 12:50:03 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 12:50:03 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 12:50:03 kjcf05n01 puppet-agent[3098807]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: Press Ctrl+C to exit. Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: Plugin support version 1.0 Nov 3 12:50:03 kjcf05n01 zabbix_agent2[3099309]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 12:50:03 kjcf05n00 puppet-agent[1265689]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 12:50:03 kjcf05n00 puppet-agent[1265689]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 12:50:03 kjcf05n00 puppet-agent[1265689]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 12:50:04 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1247390]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 12:50:04 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 12:50:04 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 12:50:04 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 12:50:04 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 12:50:04 kjcf05n00 puppet-agent[1265689]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: Press Ctrl+C to exit. Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: Plugin support version 1.0 Nov 3 12:50:04 kjcf05n00 zabbix_agent2[1266314]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 12:50:05 kjcf05n04 puppet-agent[3147436]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 12:50:05 kjcf05n04 puppet-agent[3147436]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 12:50:05 kjcf05n04 puppet-agent[3147436]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 12:50:05 kjcf05n00 zabbix-server[1266336]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:50:05 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3102392]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 12:50:05 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 12:50:05 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 12:50:05 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 12:50:05 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 12:50:05 kjcf05n04 puppet-agent[3147436]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: Press Ctrl+C to exit. Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: Plugin support version 1.0 Nov 3 12:50:05 kjcf05n04 zabbix_agent2[3148363]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 12:50:05 kjcf05n01 puppet-agent[3098807]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_123334.log]/mode) mode changed '0644' to '0640' Nov 3 12:50:05 kjcf05n01 puppet-agent[3098807]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_124501.log]/mode) mode changed '0644' to '0640' Nov 3 12:50:05 kjcf05n01 puppet-agent[3098807]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_124501]/mode) mode changed '0755' to '0750' Nov 3 12:50:05 kjcf05n01 puppet-agent[3098807]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_124501/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 12:50:05 kjcf05n00 zabbix-server[1266340]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:50:05 kjcf05n00 zabbix-server[1266345]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:50:06 kjcf05n00 zabbix-server[1266349]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:50:06 kjcf05n01 puppet-agent[3098807]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_123332.log]/mode) mode changed '0644' to '0640' Nov 3 12:50:06 kjcf05n01 puppet-agent[3098807]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_124501.log]/mode) mode changed '0644' to '0640' Nov 3 12:50:06 kjcf05n01 puppet-agent[3098807]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 12:50:06 kjcf05n01 puppet-agent[3098807]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 12:50:06 kjcf05n01 puppet-agent[3098807]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 12:50:06 kjcf05n00 puppet-agent[1265689]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 12:50:07 kjcf05n04 puppet-agent[3147436]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 12:50:07 kjcf05n04 puppet-agent[3147436]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 12:50:07 kjcf05n04 puppet-agent[3147436]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 12:50:07 kjcf05n04 puppet-agent[3147436]: Applied catalog in 4.96 seconds Nov 3 12:50:07 kjcf05n01 puppet-agent[3098807]: Applied catalog in 8.79 seconds Nov 3 12:50:07 kjcf05n00 puppet-agent[1265689]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 12:50:07 kjcf05n00 puppet-agent[1265689]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 12:50:07 kjcf05n00 puppet-agent[1265689]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 12:50:08 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 12:50:08 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 12:50:08 kjcf05n00 puppet-agent[1265689]: Applied catalog in 8.57 seconds Nov 3 12:50:09 kjcf05n00 mcfcli[3673891]: %3|1730659809.259|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:50:10 kjcf05n00 python3.9[1266287]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 12:50:11 kjcf05n00 diskmonitor[2758297]: leaving test state: 80 next state: 100 Nov 3 12:50:11 kjcf05n00 diskmonitor[2758297]: lock release: time: Sun Nov 3 12:50:10 2024 Nov 3 12:50:11 kjcf05n00 diskmonitor[2758297]: leaving test state: 100 next state: 1 Nov 3 12:50:15 kjcf05n05 puppet-agent[3304619]: Caching catalog for kjcf05n05 Nov 3 12:50:15 kjcf05n05 puppet-agent[3304619]: Applying configuration version '1730659813' Nov 3 12:50:17 kjcf05n05 puppet-agent[3304619]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 12:50:17 kjcf05n05 puppet-agent[3304619]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 12:50:17 kjcf05n05 puppet-agent[3304619]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 12:50:18 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3257902]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 12:50:18 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 12:50:18 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 12:50:18 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 12:50:18 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 12:50:18 kjcf05n05 puppet-agent[3304619]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: Starting Zabbix Agent 2 (6.2.1) Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: Press Ctrl+C to exit. Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: Plugin support version 1.0 Nov 3 12:50:18 kjcf05n05 zabbix_agent2[3305783]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 12:50:19 kjcf05n05 puppet-agent[3304619]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 12:50:19 kjcf05n05 puppet-agent[3304619]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 12:50:19 kjcf05n05 puppet-agent[3304619]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 12:50:20 kjcf05n00 zabbix-server[1265599]: puppet completed status:(0): '' Nov 3 12:50:20 kjcf05n00 zabbix-server[1265599]: Event '46230' acknowledged Nov 3 12:50:20 kjcf05n00 zabbix-server[1265599]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 3 12:50:20 kjcf05n05 puppet-agent[3304619]: Applied catalog in 4.83 seconds Nov 3 12:50:23 kjcf05n00 zabbix-server[1267152]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:50:23 kjcf05n00 zabbix-server[1267152]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 70.47\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 67.08\\"}}"' Nov 3 12:50:23 kjcf05n00 log_interesting_event.py[1267152]: Event '46231' acknowledged Nov 3 12:50:23 kjcf05n00 mcfcli[3673891]: %3|1730659823.794|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:50:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730659825', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 12:50:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730659825'} Nov 3 12:50:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:50:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730659825', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 12:50:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730659825'} Nov 3 12:50:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 12:50:29 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 12:50:39 kjcf05n00 mcfcli[3673891]: %3|1730659839.549|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 12:51:02 kjcf05n00 mcfcli[3673891]: %3|1730659862.570|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:51:09 kjcf05n00 mcfcli[3673891]: %3|1730659869.549|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 12:51:39 kjcf05n00 mcfcli[3673891]: %3|1730659899.549|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:51:40 kjcf05n00 mcfcli[3673891]: %3|1730659900.134|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:52:09 kjcf05n00 mcfcli[3673891]: %3|1730659929.550|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 12:52:18 kjcf05n00 mcfcli[3673891]: %3|1730659938.435|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:52:39 kjcf05n00 mcfcli[3673891]: %3|1730659959.550|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:52:57 kjcf05n00 mcfcli[3673891]: %3|1730659977.643|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:53:09 kjcf05n00 mcfcli[3673891]: %3|1730659989.550|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T18:53:15.867627Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 12:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T18:53:15.867697Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.090ms Nov 3 12:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T12:53:27.254118642-06:00 level=info msg="Completed cleanup jobs" duration=27.50935ms Nov 3 12:53:36 kjcf05n00 mcfcli[3673891]: %3|1730660016.612|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:53:39 kjcf05n00 mcfcli[3673891]: %3|1730660019.552|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:54:09 kjcf05n00 mcfcli[3673891]: %3|1730660049.552|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:54:15 kjcf05n00 mcfcli[3673891]: %3|1730660055.931|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:54:39 kjcf05n00 mcfcli[3673891]: %3|1730660079.552|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:54:55 kjcf05n00 mcfcli[3673891]: %3|1730660095.928|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:55:09 kjcf05n00 mcfcli[3673891]: %3|1730660109.552|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:55:16 kjcf05n00 python3.9[1269549]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 12:55:33 kjcf05n00 mcfcli[3673891]: %3|1730660133.788|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:55:39 kjcf05n00 mcfcli[3673891]: %3|1730660139.552|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 12:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 12:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 12:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 12:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 12:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 12:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 12:55:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 12:55:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 12:56:07 kjcf05n00 zabbix_server[15780]: Zabbix agent item "dcs.lustre.device.ost.count[{$LUSTRE_FS_NAME}]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 3 12:56:07 kjcf05n00 zabbix_server[15729]: Zabbix agent item "system.cpu.load[all,avg1]" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 3 12:56:09 kjcf05n00 mcfcli[3673891]: %3|1730660169.553|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 12:56:12 kjcf05n03 fstonithd.py[15172]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 3 12:56:12 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 12:56:12 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 12:56:12 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 12:56:13 kjcf05n00 mcfcli[3673891]: %3|1730660173.043|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:56:14 kjcf05n03 root[122801]: is_viking_off starts Nov 3 12:56:14 kjcf05n03 root[122800]: is_enc_ipmi_off starts Nov 3 12:56:14 kjcf05n03 root[122822]: I am master Nov 3 12:56:14 kjcf05n03 root[122825]: I am in slot 1; partner is in slot 0 Nov 3 12:56:14 kjcf05n03 root[122827]: is_lan_ipmi_off leaves Nov 3 12:56:14 kjcf05n03 root[122829]: is_lan_ipmi_sec_off leaves Nov 3 12:56:22 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vm.memory.size[total]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 12:56:22 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.mdt.name[MDT0000,mdt_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 12:56:23 kjcf05n03 root[123184]: is_viking_off leaves Nov 3 12:56:23 kjcf05n03 root[123190]: kjcf05n02 not already off look at kdump Nov 3 12:56:23 kjcf05n03 root[123191]: is_kdump_off starts Nov 3 12:56:23 kjcf05n03 fence_kdump[123200]: waiting for message from '172.16.2.5' Nov 3 12:56:23 kjcf05n03 fence_kdump[123200]: received valid message from '172.16.2.5' Nov 3 12:56:23 kjcf05n03 root[123216]: is_kdump_off detected kdump on kjcf05n02 Nov 3 12:56:23 kjcf05n03 root[123218]: kjcf05n02 is kdumping Nov 3 12:56:23 kjcf05n03 root[123326]: is_viking_off starts Nov 3 12:56:23 kjcf05n03 root[123325]: is_enc_ipmi_off starts Nov 3 12:56:23 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 12:56:23 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 12:56:23 kjcf05n03 root[123344]: is_lan_ipmi_off leaves Nov 3 12:56:23 kjcf05n03 root[123346]: is_lan_ipmi_sec_off leaves Nov 3 12:56:24 kjcf05n03 root[123349]: I am master Nov 3 12:56:24 kjcf05n03 root[123352]: I am in slot 1; partner is in slot 0 Nov 3 12:56:23 kjcf05n00 zabbix_server[15771]: Zabbix agent item "vfs.fs.size[/etc/ganesha,total]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 12:56:25 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='34', error='Connection reset by peer (104)' Nov 3 12:56:25 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='34', client='AF_INET(172.16.2.5:45165)', local='AF_INET(0.0.0.0:601)' Nov 3 12:56:24 kjcf05n00 zabbix_server[15769]: Zabbix agent item "vfs.fs.size[/mnt/persistent_ha_data,used]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 12:56:25 kjcf05n00 zabbix_server[15730]: Zabbix agent item "vfs.fs.size[/var/lib/pacemaker,used]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 12:56:26 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib0 Nov 3 12:56:26 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib0 Nov 3 12:56:31 kjcf05n03 root[123536]: is_viking_off leaves Nov 3 12:56:31 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib1 Nov 3 12:56:31 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib1 Nov 3 12:56:31 kjcf05n03 root[123542]: kjcf05n02 not already off look at kdump Nov 3 12:56:31 kjcf05n03 root[123548]: is_kdump_off starts Nov 3 12:56:31 kjcf05n03 fence_kdump[123549]: waiting for message from '172.16.2.5' Nov 3 12:56:31 kjcf05n03 fence_kdump[123549]: received valid message from '172.16.2.5' Nov 3 12:56:31 kjcf05n03 root[123563]: is_kdump_off detected kdump on kjcf05n02 Nov 3 12:56:31 kjcf05n03 root[123564]: kjcf05n02 is kdumping Nov 3 12:56:36 kjcf05n03 systemd-udevd[125766]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125767]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125770]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125771]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125767]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125766]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125770]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125771]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125767]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125766]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125770]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125771]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125767]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125766]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125770]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125784]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125786]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125771]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125788]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125767]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125792]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125766]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125784]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125770]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125771]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125767]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125788]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125786]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125792]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125784]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125770]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125771]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125767]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125786]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125788]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125792]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125770]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125771]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125784]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125767]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125770]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125792]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125771]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125792]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125770]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125784]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125788]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125792]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125770]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125784]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125792]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125771]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125792]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125771]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125792]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125792]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125771]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125792]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125771]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125792]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125771]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125792]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125771]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 systemd-udevd[125771]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 12:56:36 kjcf05n03 dwd[5196]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 12:56:36 kjcf05n03 dwd[5196]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 12:56:36 kjcf05n03 dwd[5196]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 12:56:36 kjcf05n03 dwd[5196]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 12:56:36 kjcf05n03 dwd[5196]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 12:56:36 kjcf05n03 dwd[5196]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 12:56:36 kjcf05n03 dwd[5196]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 12:56:36 kjcf05n03 dwd[5196]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 12:56:36 kjcf05n03 dwd[5196]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 12:56:36 kjcf05n03 dwd[5196]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 12:56:36 kjcf05n03 dwd[5196]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 12:56:36 kjcf05n03 dwd[5196]: Starting NVME thread for nvme23n1 Nov 3 12:56:36 kjcf05n03 dwd[5196]: Starting NVME thread for nvme18n1 Nov 3 12:56:36 kjcf05n03 dwd[5196]: Starting NVME thread for nvme25n1 Nov 3 12:56:36 kjcf05n03 dwd[5196]: Starting NVME thread for nvme17n1 Nov 3 12:56:36 kjcf05n03 dwd[5196]: Starting NVME thread for nvme3n1 Nov 3 12:56:37 kjcf05n03 dwd[5196]: Starting NVME thread for nvme9n1 Nov 3 12:56:37 kjcf05n03 dwd[5196]: Starting NVME thread for nvme8n1 Nov 3 12:56:37 kjcf05n03 dwd[5196]: Starting NVME thread for nvme19n1 Nov 3 12:56:37 kjcf05n03 dwd[5196]: Starting NVME thread for nvme24n1 Nov 3 12:56:37 kjcf05n03 dwd[5196]: Starting NVME thread for nvme2n1 Nov 3 12:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 12:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 12:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 12:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 12:56:37 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.mdt.name[MDT0001,mdt_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 12:56:38 kjcf05n03 dwd[5196]: Starting NVME thread for nvme4n1 Nov 3 12:56:39 kjcf05n00 mcfcli[3673891]: %3|1730660199.553|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 12:56:40 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.cpu.load[all,avg15]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 12:56:41 kjcf05n03 diskmonitor[17569]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 12:56:49 kjcf05n03 diskmonitor[17569]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 12:56:49 kjcf05n03 diskmonitor[17569]: Scan for ReadErrorMax change for md65 Nov 3 12:56:49 kjcf05n03 diskmonitor[17569]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 12:56:49 kjcf05n03 diskmonitor[17569]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 12:56:49 kjcf05n03 diskmonitor[17569]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.min.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 12:56:49 kjcf05n03 diskmonitor[17569]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.max.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 12:56:49 kjcf05n03 diskmonitor[17569]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 12:56:49 kjcf05n03 diskmonitor[17569]: Set sync_speed_min (10000) for md65 Nov 3 12:56:49 kjcf05n03 diskmonitor[17569]: Set sync_speed_max (200000) for md65 Nov 3 12:56:49 kjcf05n03 diskmonitor[17569]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 12:56:52 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 3 12:56:52 kjcf05n00 mcfcli[3673891]: %3|1730660212.821|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:56:55 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 3 12:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 12:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 12:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 12:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 12:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 12:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 12:56:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 12:56:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 12:57:09 kjcf05n00 mcfcli[3673891]: %3|1730660229.553|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:57:27 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib0 Nov 3 12:57:27 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib0 Nov 3 12:57:31 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib1 Nov 3 12:57:31 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib1 Nov 3 12:57:32 kjcf05n00 mcfcli[3673891]: %3|1730660252.818|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 12:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 12:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 12:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 12:57:39 kjcf05n00 mcfcli[3673891]: %3|1730660259.555|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:57:43 kjcf05n03 nslcd[6943]: [b71efb] ldap_result() failed: Can't contact LDAP server Nov 3 12:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 12:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 12:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 12:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 12:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 12:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 12:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 12:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 12:58:09 kjcf05n00 mcfcli[3673891]: %3|1730660289.289|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:58:10 kjcf05n00 mcfcli[3673891]: %3|1730660290.054|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:58:27 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib0 Nov 3 12:58:27 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib0 Nov 3 12:58:31 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib1 Nov 3 12:58:31 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib1 Nov 3 12:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 12:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 12:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 12:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 12:58:40 kjcf05n00 mcfcli[3673891]: %3|1730660320.055|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 12:58:47 kjcf05n00 mcfcli[3673891]: %3|1730660327.013|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 12:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 12:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 12:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 12:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 12:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 12:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 12:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 12:59:10 kjcf05n00 mcfcli[3673891]: %3|1730660350.056|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 12:59:11 kjcf05n00 zabbix-server[1272219]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 12:59:11 kjcf05n00 zabbix-server[1272219]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 12:59:11 kjcf05n00 log_interesting_event.py[1272219]: Event '46234' acknowledged Nov 3 12:59:24 kjcf05n00 mcfcli[3673891]: %3|1730660364.499|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 12:59:27 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib0 Nov 3 12:59:27 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib0 Nov 3 12:59:31 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib1 Nov 3 12:59:31 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib1 Nov 3 12:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 12:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 12:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 12:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 12:59:40 kjcf05n00 mcfcli[3673891]: %3|1730660380.056|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 12:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 12:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 12:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 12:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 12:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 12:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 12:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 12:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 13:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 13:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 13:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 13:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 13:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 13:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 13:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 13:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 13:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 13:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 13:00:00 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 3 13:00:00 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 13:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 13:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 13:00:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 13:00:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:00:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 13:00:02 kjcf05n00 mcfcli[3673891]: %3|1730660402.277|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:00:04 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 13:00:04 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 3 13:00:04 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 3 13:00:04 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 13:00:04 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 13:00:04 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 3 13:00:04 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 3 13:00:07 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 3 13:00:10 kjcf05n00 mcfcli[3673891]: %3|1730660410.263|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 13:00:15 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 3 13:00:20 kjcf05n00 python3.9[1272870]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 13:00:27 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib0 Nov 3 13:00:27 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib0 Nov 3 13:00:31 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib1 Nov 3 13:00:31 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib1 Nov 3 13:00:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730660434', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 13:00:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730660434'} Nov 3 13:00:34 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:00:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730660434', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 13:00:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730660434'} Nov 3 13:00:34 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 13:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 13:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 13:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 13:00:40 kjcf05n00 mcfcli[3673891]: %3|1730660440.188|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:00:40 kjcf05n00 mcfcli[3673891]: %3|1730660440.264|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 13:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 13:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 13:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 13:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 13:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 13:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 13:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 13:01:02 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:60716). Nov 3 13:01:02 kjcf05n01 rsyncd[3103511]: connect from kjcf05n02 (172.16.2.5) Nov 3 13:01:02 kjcf05n01 rsyncd[3103511]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 13:01:02 kjcf05n01 rsyncd[3103511]: building file list Nov 3 13:01:02 kjcf05n01 rsyncd[3103511]: sent 11449 bytes received 136 bytes total size 10905 Nov 3 13:01:02 kjcf05n01 systemd[1]: rsyncd@629-172.16.2.2:873-172.16.2.5:60716.service: Succeeded. Nov 3 13:01:10 kjcf05n00 mcfcli[3673891]: %3|1730660470.557|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 13:01:12 kjcf05n03 fstonithd.py[15172]: Listening for kdump packets from partner Nov 3 13:01:17 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 13:01:20 kjcf05n00 mcfcli[3673891]: %3|1730660480.186|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:01:27 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib0 Nov 3 13:01:27 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib0 Nov 3 13:01:31 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib1 Nov 3 13:01:31 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib1 Nov 3 13:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 13:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 13:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 13:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 13:01:40 kjcf05n00 mcfcli[3673891]: %3|1730660500.557|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:01:55 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 13:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 13:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 13:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 13:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 13:01:57 kjcf05n00 mcfcli[3673891]: %3|1730660517.892|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 13:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 13:01:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 13:01:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 13:02:02 kjcf05n03 dwd[5196]: nvme9n1 passed periodic SMART status check Nov 3 13:02:02 kjcf05n03 dwd[5196]: nvme25n1 passed periodic SMART status check Nov 3 13:02:02 kjcf05n03 dwd[5196]: nvme23n1 passed periodic SMART status check Nov 3 13:02:02 kjcf05n03 dwd[5196]: nvme17n1 passed periodic SMART status check Nov 3 13:02:02 kjcf05n03 dwd[5196]: nvme18n1 passed periodic SMART status check Nov 3 13:02:02 kjcf05n03 dwd[5196]: nvme3n1 passed periodic SMART status check Nov 3 13:02:03 kjcf05n03 dwd[5196]: nvme24n1 passed periodic SMART status check Nov 3 13:02:03 kjcf05n03 dwd[5196]: nvme4n1 passed periodic SMART status check Nov 3 13:02:03 kjcf05n03 dwd[5196]: nvme8n1 passed periodic SMART status check Nov 3 13:02:03 kjcf05n03 dwd[5196]: nvme2n1 passed periodic SMART status check Nov 3 13:02:03 kjcf05n03 dwd[5196]: nvme19n1 passed periodic SMART status check Nov 3 13:02:10 kjcf05n00 mcfcli[3673891]: %3|1730660530.558|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:02:27 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib0 Nov 3 13:02:27 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib0 Nov 3 13:02:28 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='13', client='AF_INET(172.16.2.5:44201)', local='AF_INET(0.0.0.0:601)' Nov 3 13:02:28 kjcf05n02 syslog-ng[3084]: Configuration reload request received, reloading configuration; Nov 3 13:02:28 kjcf05n02 syslog-ng[3084]: Configuration reload finished; Nov 3 13:02:28 kjcf05n02 syslog-ng[3084]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 13:02:28 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 3 13:02:28 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 13:02:28 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 3 13:02:28 kjcf05n02 dracut: Self testing crypto algorithms Nov 3 13:02:28 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 3 13:02:28 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 13:02:28 kjcf05n02 Copying live image to RAM... Nov 3 13:02:28 kjcf05n02 (this may take a minute) Nov 3 13:02:28 kjcf05n02 Done copying live image to RAM. Nov 3 13:02:28 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 13:02:28 kjcf05n02 dracut: Checking integrity of kernel Nov 3 13:02:28 kjcf05n02 dracut: All initrd crypto checks done Nov 3 13:02:28 kjcf05n02 dracut: Switching root Nov 3 13:02:28 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 13:02:28 kjcf05n02 systemd: Detected architecture x86-64. Nov 3 13:02:28 kjcf05n02 systemd: Set hostname to . Nov 3 13:02:28 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 13:02:28 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 13:02:28 kjcf05n02 systemd: Listening on LVM2 poll daemon socket. Nov 3 13:02:28 kjcf05n02 systemd: Created slice system-sshd\x2dkeygen.slice. Nov 3 13:02:28 kjcf05n02 systemd: Reached target Swap. Nov 3 13:02:28 kjcf05n02 systemd: Listening on Device-mapper event daemon FIFOs. Nov 3 13:02:28 kjcf05n02 systemd: Listening on Journal Socket (/dev/log). Nov 3 13:02:28 kjcf05n02 systemd-journald[1514]: Journal started Nov 3 13:02:28 kjcf05n02 systemd-journald[1514]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 13:02:28 kjcf05n02 systemd-modules-load[1520]: Inserted module 'fuse' Nov 3 13:02:28 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 3 13:02:28 kjcf05n02 systemd-sysctl[1529]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 13:02:28 kjcf05n02 systemd-sysctl[1529]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 3 13:02:28 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Create System Users. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 13:02:28 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 13:02:28 kjcf05n02 systemd-journald[1514]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 13:02:28 kjcf05n02 systemd-tmpfiles[1541]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 13:02:28 kjcf05n02 systemd-tmpfiles[1541]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 3 13:02:28 kjcf05n02 systemd-udevd[1551]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 3 13:02:28 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 3 13:02:28 kjcf05n02 systemd-udevd[1597]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:02:28 kjcf05n02 systemd-udevd[1603]: Using default interface naming scheme 'rhel-8.0'. Nov 3 13:02:28 kjcf05n02 systemd-udevd[1603]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 13:02:28 kjcf05n02 systemd-udevd[1591]: Using default interface naming scheme 'rhel-8.0'. Nov 3 13:02:28 kjcf05n02 systemd-udevd[1591]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:02:28 kjcf05n02 systemd-udevd[1566]: Using default interface naming scheme 'rhel-8.0'. Nov 3 13:02:28 kjcf05n02 systemd-udevd[1566]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:02:28 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 3 13:02:28 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 13:02:28 kjcf05n02 systemd-tmpfiles[1758]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 13:02:28 kjcf05n02 systemd-tmpfiles[1758]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 13:02:28 kjcf05n02 systemd-tmpfiles[1758]: "/var/tmp" already exists and is not a directory. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 3 13:02:28 kjcf05n02 root[1772]: openibd: running in auto mode Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started RPC Bind. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 13:02:28 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 13:02:28 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 13:02:28 kjcf05n02 systemd-modules-load[1885]: Inserted module 'ib_iser' Nov 3 13:02:28 kjcf05n02 systemd-modules-load[1885]: Inserted module 'ib_isert' Nov 3 13:02:28 kjcf05n02 systemd-modules-load[1885]: Inserted module 'ib_srpt' Nov 3 13:02:28 kjcf05n02 systemd-udevd[1624]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:02:28 kjcf05n02 systemd-modules-load[1876]: Inserted module 'ib_ipoib' Nov 3 13:02:28 kjcf05n02 systemd-udevd[1554]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:02:28 kjcf05n02 systemd-modules-load[1885]: Inserted module 'rdma_ucm' Nov 3 13:02:28 kjcf05n02 systemd-modules-load[1885]: Module 'svcrdma' is blacklisted Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 13:02:28 kjcf05n02 systemd-udevd[1554]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 13:02:28 kjcf05n02 systemd-udevd[1624]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 13:02:28 kjcf05n02 systemd-modules-load[1876]: Inserted module 'ib_umad' Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 13:02:28 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 13:02:28 kjcf05n02 systemd[3084]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:28 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 13:02:28 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 3 13:02:28 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 3 13:02:28 kjcf05n02 openibd[1759]: Loading HCA driver and Access Layer:[ OK ] Nov 3 13:02:28 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Update is Completed. Nov 3 13:02:28 kjcf05n02 setup-icl[1746]: Setting LAN IP Address to 203.0.113.3 Nov 3 13:02:28 kjcf05n02 setup-icl[1746]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 13:02:28 kjcf05n02 setup-icl[1746]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 13:02:28 kjcf05n02 setup-icl[1746]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 13:02:28 kjcf05n02 systemd-udevd[1624]: Using default interface naming scheme 'rhel-8.0'. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 13:02:28 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 3 13:02:28 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 13:02:28 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 13:02:28 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 13:02:28 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 13:02:28 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 13:02:28 kjcf05n02 systemd[1]: Reached target Sockets. Nov 3 13:02:28 kjcf05n02 systemd[1]: Reached target Basic System. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 13:02:28 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 3 13:02:28 kjcf05n02 chronyd[2067]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 13:02:28 kjcf05n02 network[2059]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 3 13:02:28 kjcf05n02 mcelog[2070]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 13:02:28 kjcf05n02 mcelog[2070]: CPU is unsupported Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 13:02:28 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 13:02:28 kjcf05n02 network[2079]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 13:02:28 kjcf05n02 network[2059]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 3 13:02:28 kjcf05n02 dwd[2081]: dwd: vMay 29 2024 : 15:38:26 Nov 3 13:02:28 kjcf05n02 dwd[2081]: /usr/sbin/dwd -d --standalone=0 Nov 3 13:02:28 kjcf05n02 dwd[2081]: dwd: option Lethal: 0 Nov 3 13:02:28 kjcf05n02 dwd[2081]: dwd: option Interval: 60 Nov 3 13:02:28 kjcf05n02 dwd[2081]: dwd: option abrtlimit: 10 Nov 3 13:02:28 kjcf05n02 dwd[2081]: dwd: option DZPeriod: 604800 Nov 3 13:02:28 kjcf05n02 dwd[2081]: dwd: option SmartPeriod: 43200 Nov 3 13:02:28 kjcf05n02 dwd[2081]: dwd: option SDDEnabled: 1 Nov 3 13:02:28 kjcf05n02 dwd[2081]: dwd: option SDDAwaitScale: 3 Nov 3 13:02:28 kjcf05n02 dwd[2081]: dwd: option SDDAwaitMin: 100 Nov 3 13:02:28 kjcf05n02 dwd[2081]: dwd: option Verbosity: 1 Nov 3 13:02:28 kjcf05n02 dwd[2081]: dwd: option StandAlone: 0 Nov 3 13:02:28 kjcf05n02 dwd[2081]: option Lethal: 0 Nov 3 13:02:28 kjcf05n02 dwd[2081]: option Interval: 60 Nov 3 13:02:28 kjcf05n02 dwd[2081]: option abrtlimit: 10 Nov 3 13:02:28 kjcf05n02 dwd[2081]: option DZPeriod: 604800 Nov 3 13:02:28 kjcf05n02 dwd[2081]: option SmartPeriod: 43200 Nov 3 13:02:28 kjcf05n02 dwd[2081]: option SDDEnabled: 1 Nov 3 13:02:28 kjcf05n02 dwd[2081]: option SDDAwaitScale: 3 Nov 3 13:02:28 kjcf05n02 dwd[2081]: option SDDAwaitMin: 100 Nov 3 13:02:28 kjcf05n02 dwd[2081]: option Verbosity: 1 Nov 3 13:02:28 kjcf05n02 dwd[2081]: option StandAlone: 0 Nov 3 13:02:28 kjcf05n02 nscd[2105]: 2105 monitoring file `/etc/hosts` (1) Nov 3 13:02:28 kjcf05n02 nscd[2105]: 2105 monitoring directory `/etc` (2) Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 13:02:28 kjcf05n02 nscd[2105]: 2105 monitoring file `/etc/resolv.conf` (3) Nov 3 13:02:28 kjcf05n02 nscd[2105]: 2105 monitoring directory `/etc` (2) Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[2097]: Setting up Mellanox network interface: ib1 Nov 3 13:02:28 kjcf05n02 network[2098]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:02:28 kjcf05n02 network[2059]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 13:02:28 kjcf05n02 chronyd[2067]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 13:02:28 kjcf05n02 chronyd[2067]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 13:02:28 kjcf05n02 mdraid-phy[2100]: no Cutlass to worry about Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 0 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 1 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 2 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 3 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 4 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 5 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 6 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 7 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 8 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 9 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 10 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 11 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 12 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 13 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 14 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 15 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 16 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 17 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 18 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 19 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 20 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 21 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 22 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 23 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 24 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 25 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 26 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 27 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 28 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 29 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 30 Nov 3 13:02:28 kjcf05n02 cpupower[2122]: Setting cpu: 31 Nov 3 13:02:28 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 13:02:28 kjcf05n02 network[2117]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 13:02:28 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 13:02:28 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 13:02:28 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 13:02:28 kjcf05n02 dbus-daemon[2136]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 13:02:28 kjcf05n02 beSetMlxConfig[2186]: ConnectX-3 multiport not detected Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[2181]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[2187]: Setting up Mellanox network interface: ib0 Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 3 13:02:28 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[2226]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 13:02:28 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 0 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 1 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 2 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 3 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 4 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 5 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 6 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 7 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 8 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 9 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 10 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 11 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 12 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 13 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 14 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 15 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 16 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 17 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 18 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 19 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 20 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 21 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 22 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 23 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 24 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 25 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 26 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 27 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 28 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 29 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 30 Nov 3 13:02:28 kjcf05n02 cpupower[2240]: Idlestate 2 disabled on CPU 31 Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[2237]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 13:02:28 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[2238]: No configuration found for ib1 Nov 3 13:02:28 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 13:02:28 kjcf05n02 sssd[sssd][2096]: Starting up Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[2259]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 13:02:28 kjcf05n02 beSetMlxConfig[2186]: Starting MST (Mellanox Software Tools) driver set Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[2268]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[2274]: No configuration found for ib0 Nov 3 13:02:28 kjcf05n02 beSetMlxConfig[2186]: Loading MST PCI module - Success Nov 3 13:02:28 kjcf05n02 mlnx_conf_mgr[2300]: INFO: No configurations found for mlx5_1, skipping. Nov 3 13:02:28 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[2304]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 13:02:28 kjcf05n02 beSetMlxConfig[2186]: Loading MST PCI configuration module - Success Nov 3 13:02:28 kjcf05n02 beSetMlxConfig[2186]: Create devices Nov 3 13:02:28 kjcf05n02 mlnx_conf_mgr[2341]: INFO: No configurations found for mlx5_0, skipping. Nov 3 13:02:28 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 13:02:28 kjcf05n02 sssd[be[implicit_files]][2273]: Starting up Nov 3 13:02:28 kjcf05n02 sssd[nss][2412]: Starting up Nov 3 13:02:28 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 13:02:28 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Login Service... Nov 3 13:02:28 kjcf05n02 systemd-logind[2519]: New seat seat0. Nov 3 13:02:28 kjcf05n02 systemd-logind[2519]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Login Service. Nov 3 13:02:28 kjcf05n02 python3.9[2099]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 13:02:28 kjcf05n02 python3.9[3084]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 13:02:28 kjcf05n02 systemd-sysctl[2668]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 13:02:28 kjcf05n02 systemd-sysctl[2668]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 13:02:28 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 13:02:28 kjcf05n02 python3.9[2731]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 13:02:28 kjcf05n02 python3.9[3084]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 13:02:28 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 13:02:28 kjcf05n02 network[2059]: Bringing up loopback interface: [ OK ] Nov 3 13:02:28 kjcf05n02 python3.9[2914]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 13:02:28 kjcf05n02 python3.9[3084]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:28 kjcf05n02 systemd-sysctl[3007]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 13:02:28 kjcf05n02 systemd-sysctl[3007]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 3 13:02:28 kjcf05n02 systemd[1]: Reached target Network. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 13:02:28 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 3 13:02:28 kjcf05n02 sm-notify[3075]: Version 2.3.3 starting Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 13:02:28 kjcf05n02 sshd[3044]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 13:02:28 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 13:02:28 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 13:02:28 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 3 13:02:28 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 13:02:28 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 3 13:02:28 kjcf05n02 lldpad[3055]: setsockopt nearest_bridge: Invalid argument Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 3 13:02:28 kjcf05n02 lldpad[3055]: setsockopt nearest_bridge: Invalid argument Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 3 13:02:28 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 3 13:02:28 kjcf05n02 python3.9[3137]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 13:02:28 kjcf05n02 python3.9[3084]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 13:02:28 kjcf05n02 syslog-ng[3084]: [2024-11-03T19:01:15.496418] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 13:02:28 kjcf05n02 syslog-ng[3084]: [2024-11-03T19:01:15.496688] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 13:02:28 kjcf05n02 syslog-ng[3084]: [2024-11-03T19:01:15.496723] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 13:02:28 kjcf05n02 syslog-ng[3084]: [2024-11-03T19:01:15.496965] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 13:02:28 kjcf05n02 syslog-ng[3084]: [2024-11-03T19:01:15.497262] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 13:02:28 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 3 13:02:28 kjcf05n02 beSetMlxConfig[2186]: Unloading MST PCI module (unused) - Success Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 13:02:28 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 13:02:28 kjcf05n02 python3.9[3214]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 13:02:28 kjcf05n02 python3.9[3084]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 13:02:28 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 13:02:28 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 13:02:28 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 13:02:28 kjcf05n02 chronyd[2067]: System's initial offset : 0.003233 seconds slow of true (slew) Nov 3 13:02:28 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 13:02:28 kjcf05n02 beSetMlxConfig[2186]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 13:02:28 kjcf05n02 beSetMlxConfig[2186]: ib mode Nov 3 13:02:28 kjcf05n02 root[3406]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 3 13:02:28 kjcf05n02 root[3408]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 3 13:02:28 kjcf05n02 beSetMlxConfig[2186]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 13:02:28 kjcf05n02 beSetMlxConfig[2186]: ib mode Nov 3 13:02:28 kjcf05n02 systemd-udevd[1551]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 13:02:28 kjcf05n02 systemd-udevd[3421]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:02:28 kjcf05n02 systemd-udevd[3422]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:02:28 kjcf05n02 systemd-udevd[3425]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:02:28 kjcf05n02 systemd-udevd[3428]: Using default interface naming scheme 'rhel-8.0'. Nov 3 13:02:28 kjcf05n02 systemd-udevd[3428]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:02:28 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 13:02:28 kjcf05n02 systemd[3084]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:28 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[3464]: Setting up Mellanox network interface: ib1 Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[3463]: Setting up Mellanox network interface: ib0 Nov 3 13:02:28 kjcf05n02 systemd-udevd[3424]: Using default interface naming scheme 'rhel-8.0'. Nov 3 13:02:28 kjcf05n02 systemd-udevd[3423]: Using default interface naming scheme 'rhel-8.0'. Nov 3 13:02:28 kjcf05n02 systemd-udevd[3424]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:02:28 kjcf05n02 systemd-udevd[3423]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[3513]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[3514]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[3544]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[3545]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[3547]: No configuration found for ib1 Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[3546]: No configuration found for ib0 Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[3554]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[3555]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 13:02:28 kjcf05n02 mlnx_conf_mgr[3595]: INFO: No configurations found for mlx5_1, skipping. Nov 3 13:02:28 kjcf05n02 mlnx_conf_mgr[3594]: INFO: No configurations found for mlx5_0, skipping. Nov 3 13:02:28 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 13:02:28 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 13:02:28 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 3 13:02:28 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 3 13:02:28 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 13:02:28 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 3 13:02:28 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 3 13:02:28 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 13:02:28 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 13:02:28 kjcf05n02 lldpad[3055]: init_ports: Error adding device ib0 Nov 3 13:02:28 kjcf05n02 lldpad[3055]: init_ports: Error adding device ib1 Nov 3 13:02:28 kjcf05n02 lldpad[3055]: Signal 15 received - terminating Nov 3 13:02:28 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 3 13:02:28 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 13:02:28 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 13:02:28 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 3 13:02:28 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 13:02:28 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 3 13:02:28 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 3 13:02:28 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:28 kjcf05n02 systemd[3084]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:28 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 1 | Nov-03-2024 | 18:31:50 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 2 | Nov-03-2024 | 18:32:41 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 3 | Nov-03-2024 | 18:32:42 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 4 | Nov-03-2024 | 18:33:48 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 5 | Nov-03-2024 | 18:33:48 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 6 | Nov-03-2024 | 18:58:29 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 7 | Nov-03-2024 | 18:58:29 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 8 | Nov-03-2024 | 18:58:29 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 9 | Nov-03-2024 | 18:58:29 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 10 | Nov-03-2024 | 18:58:29 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 11 | Nov-03-2024 | 18:58:29 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 12 | Nov-03-2024 | 18:58:29 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 13 | Nov-03-2024 | 18:58:29 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 14 | Nov-03-2024 | 18:58:29 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 15 | Nov-03-2024 | 18:58:29 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 16 | Nov-03-2024 | 18:58:29 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 17 | Nov-03-2024 | 18:58:29 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 18 | Nov-03-2024 | 18:58:29 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 19 | Nov-03-2024 | 18:58:29 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 20 | Nov-03-2024 | 18:58:29 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 21 | Nov-03-2024 | 18:58:29 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 22 | Nov-03-2024 | 18:58:29 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 23 | Nov-03-2024 | 18:58:29 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 24 | Nov-03-2024 | 18:58:29 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 25 | Nov-03-2024 | 18:58:29 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 26 | Nov-03-2024 | 18:58:29 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 27 | Nov-03-2024 | 18:58:29 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 28 | Nov-03-2024 | 18:58:31 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 29 | Nov-03-2024 | 18:58:31 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 30 | Nov-03-2024 | 18:58:31 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 31 | Nov-03-2024 | 18:58:31 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 32 | Nov-03-2024 | 18:58:31 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 33 | Nov-03-2024 | 18:58:31 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 34 | Nov-03-2024 | 18:58:31 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 35 | Nov-03-2024 | 18:58:31 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 36 | Nov-03-2024 | 18:58:31 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 37 | Nov-03-2024 | 18:58:31 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 38 | Nov-03-2024 | 18:59:00 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 39 | Nov-03-2024 | 18:59:00 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 40 | Nov-03-2024 | 18:59:00 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 41 | Nov-03-2024 | 18:59:00 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 42 | Nov-03-2024 | 18:59:00 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 43 | Nov-03-2024 | 18:59:00 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 44 | Nov-03-2024 | 18:59:00 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 45 | Nov-03-2024 | 18:59:00 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 46 | Nov-03-2024 | 18:59:00 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 47 | Nov-03-2024 | 18:59:00 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 48 | Nov-03-2024 | 18:59:00 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 13:02:28 kjcf05n02 ipmievd[3939]: 49 | Nov-03-2024 | 18:59:00 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 13:02:28 kjcf05n02 ipmievd[3942]: Reading sensors... Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 3 13:02:28 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:28 kjcf05n02 systemd[3084]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 13:02:28 kjcf05n02 nscd[2105]: 2105 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 13:02:28 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 13:02:28 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 3 13:02:28 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 13:02:28 kjcf05n02 beSetMlxConfig[3999]: ConnectX-3 multiport not detected Nov 3 13:02:28 kjcf05n02 beSetMlxConfig[3999]: Starting MST (Mellanox Software Tools) driver set Nov 3 13:02:28 kjcf05n02 beSetMlxConfig[3999]: Loading MST PCI module - Success Nov 3 13:02:28 kjcf05n02 systemd-udevd[1551]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 13:02:28 kjcf05n02 beSetMlxConfig[3999]: [warn] mst_pciconf is already loaded, skipping Nov 3 13:02:28 kjcf05n02 beSetMlxConfig[3999]: Create devices Nov 3 13:02:28 kjcf05n02 beSetMlxConfig[3999]: Unloading MST PCI module (unused) - Success Nov 3 13:02:28 kjcf05n02 ipmievd[3942]: Waiting for events... Nov 3 13:02:28 kjcf05n02 beSetMlxConfig[3999]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 13:02:28 kjcf05n02 beSetMlxConfig[3999]: ib mode Nov 3 13:02:28 kjcf05n02 beSetMlxConfig[3999]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 13:02:28 kjcf05n02 beSetMlxConfig[3999]: ib mode Nov 3 13:02:28 kjcf05n02 systemd-udevd[1551]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 13:02:28 kjcf05n02 systemd-udevd[4899]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:02:28 kjcf05n02 systemd-udevd[4900]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:02:28 kjcf05n02 systemd-udevd[4903]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:02:28 kjcf05n02 systemd-udevd[4906]: Using default interface naming scheme 'rhel-8.0'. Nov 3 13:02:28 kjcf05n02 systemd-udevd[4906]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:02:28 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 13:02:28 kjcf05n02 systemd[3084]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:28 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[4941]: Setting up Mellanox network interface: ib0 Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[4942]: Setting up Mellanox network interface: ib1 Nov 3 13:02:28 kjcf05n02 systemd-udevd[4902]: Using default interface naming scheme 'rhel-8.0'. Nov 3 13:02:28 kjcf05n02 systemd-udevd[4901]: Using default interface naming scheme 'rhel-8.0'. Nov 3 13:02:28 kjcf05n02 systemd-udevd[4902]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:02:28 kjcf05n02 systemd-udevd[4901]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[4991]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[4992]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[5022]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[5023]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[5026]: No configuration found for ib1 Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[5025]: No configuration found for ib0 Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[5033]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 13:02:28 kjcf05n02 mlnx_interface_mgr[5034]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 13:02:28 kjcf05n02 mlnx_conf_mgr[5074]: INFO: No configurations found for mlx5_0, skipping. Nov 3 13:02:28 kjcf05n02 mlnx_conf_mgr[5073]: INFO: No configurations found for mlx5_1, skipping. Nov 3 13:02:28 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 13:02:28 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}a97cf37943dbce4535ff8211095be1ce9b140473926a227629aa27f43b6aedf5' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}a97cf37943dbce4535ff8211095be1ce9b140473926a227629aa27f43b6aedf5' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}3974b6d34ad9664ac8efe6fba6875bc5c46505f65dc73b66b4c7eca81b6baf0c' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}3974b6d34ad9664ac8efe6fba6875bc5c46505f65dc73b66b4c7eca81b6baf0c' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}15b128d9a4f293f69d7c5f444045f015b108901a7877639b3e900f921bdcbab4' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}15b128d9a4f293f69d7c5f444045f015b108901a7877639b3e900f921bdcbab4' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}f6fb3fc858df0d5562fbdcd80fe9d4e71fa94de33cf641b87b2c99e73fe0c036' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}f6fb3fc858df0d5562fbdcd80fe9d4e71fa94de33cf641b87b2c99e73fe0c036' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 13:02:28 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 3 13:02:28 kjcf05n02 chronyd[2067]: chronyd exiting Nov 3 13:02:28 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 3 13:02:28 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 13:02:28 kjcf05n02 chronyd[5108]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 13:02:28 kjcf05n02 chronyd[5108]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 13:02:28 kjcf05n02 chronyd[5108]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 13:02:28 kjcf05n02 chronyd[5108]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 13:02:28 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 13:02:28 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:28 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 13:02:28 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 3 13:02:28 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 13:02:28 kjcf05n02 dwd[5140]: dwd: vMay 29 2024 : 15:38:26 Nov 3 13:02:28 kjcf05n02 dwd[5140]: /usr/sbin/dwd -i 15 -d Nov 3 13:02:28 kjcf05n02 dwd[5140]: dwd: option Lethal: 0 Nov 3 13:02:28 kjcf05n02 dwd[5140]: dwd: option Interval: 15 Nov 3 13:02:28 kjcf05n02 dwd[5140]: dwd: option abrtlimit: 10 Nov 3 13:02:28 kjcf05n02 dwd[5140]: dwd: option DZPeriod: 604800 Nov 3 13:02:28 kjcf05n02 dwd[5140]: dwd: option SmartPeriod: 43200 Nov 3 13:02:28 kjcf05n02 dwd[5140]: dwd: option SDDEnabled: 1 Nov 3 13:02:28 kjcf05n02 dwd[5140]: dwd: option SDDAwaitScale: 3 Nov 3 13:02:28 kjcf05n02 dwd[5140]: dwd: option SDDAwaitMin: 100 Nov 3 13:02:28 kjcf05n02 dwd[5140]: dwd: option Verbosity: 1 Nov 3 13:02:28 kjcf05n02 dwd[5140]: dwd: option StandAlone: 0 Nov 3 13:02:28 kjcf05n02 dwd[5140]: option Lethal: 0 Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 13:02:28 kjcf05n02 dwd[5140]: option Interval: 15 Nov 3 13:02:28 kjcf05n02 dwd[5140]: option abrtlimit: 10 Nov 3 13:02:28 kjcf05n02 dwd[5140]: option DZPeriod: 604800 Nov 3 13:02:28 kjcf05n02 dwd[5140]: option SmartPeriod: 43200 Nov 3 13:02:28 kjcf05n02 dwd[5140]: option SDDEnabled: 1 Nov 3 13:02:28 kjcf05n02 dwd[5140]: option SDDAwaitScale: 3 Nov 3 13:02:28 kjcf05n02 dwd[5140]: option SDDAwaitMin: 100 Nov 3 13:02:28 kjcf05n02 dwd[5140]: option Verbosity: 1 Nov 3 13:02:28 kjcf05n02 dwd[5140]: option StandAlone: 0 Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 13:02:28 kjcf05n02 dwd[5141]: option Lethal now set to 1 Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 13:02:28 kjcf05n02 dwd[5141]: option abrtlimit now set to 1 Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 13:02:28 kjcf05n02 dwd[5141]: option SmartPeriod now set to 86400 Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 13:02:28 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 13:02:28 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:28 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:28 kjcf05n02 python3.9[5170]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 13:02:28 kjcf05n02 python3.9[3084]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 13:02:28 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:28 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 13:02:28 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 3 13:02:28 kjcf05n02 sedcpwrkr[5309]: Using config script: /etc/sedcpwrkr.conf Nov 3 13:02:28 kjcf05n02 sedcpwrkr[5309]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 13:02:28 kjcf05n02 sedcpwrkr[5309]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 13:02:28 kjcf05n02 sedcpwrkr[5309]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 13:02:28 kjcf05n02 sedcpwrkr[5309]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 13:02:28 kjcf05n02 sedcpwrkr[5309]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 13:02:28 kjcf05n02 sedcpwrkr[5309]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 13:02:28 kjcf05n02 sedcpwrkr-server[5340]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 13:02:28 kjcf05n02 sedcpwrkr[5309]: celery multi v5.2.7 (dawn-chorus) Nov 3 13:02:28 kjcf05n02 sedcpwrkr[5309]: > Starting nodes... Nov 3 13:02:28 kjcf05n02 sedcpwrkr[5309]: > sedcpwrkr@kjcf05n02: OK Nov 3 13:02:28 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 13:02:28 kjcf05n02 sedcpwrkr-server[5342]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 13:02:28 kjcf05n02 sedcpwrkr-server[5342]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 13:02:28 kjcf05n02 sedcpwrkr-server[5342]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 13:02:28 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 13:02:28 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 3 13:02:28 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 13:02:28 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 13:02:28 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 13:02:28 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:28 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 13:02:28 kjcf05n02 systemd-udevd[1551]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 13:02:28 kjcf05n02 iptables.init[5409]: iptables: Applying firewall rules: [ OK ] Nov 3 13:02:28 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 3 13:02:28 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:29 kjcf05n02 systemd[3084]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:29 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:29 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:29 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 13:02:29 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 13:02:29 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 13:02:29 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 13:02:29 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 13:02:29 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 13:02:29 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 13:02:29 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 13:02:29 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 13:02:29 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 13:02:29 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 13:02:30 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:30 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 13:02:30 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5506 which is not our child. We'll most likely not notice when it exits. Nov 3 13:02:30 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 13:02:30 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:30 kjcf05n02 openhpid[5506]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 13:02:30 kjcf05n02 openhpid[5506]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 13:02:30 kjcf05n02 openhpid[5506]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 13:02:30 kjcf05n02 openhpid[5506]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 13:02:30 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 13:02:30 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 13:02:30 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 13:02:30 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:31 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 13:02:31 kjcf05n03 LCNmon[17957]: 10.16.100.52 is unreachable via ib1 Nov 3 13:02:31 kjcf05n03 LCNmon[17957]: 10.16.100.58 is unreachable via ib1 Nov 3 13:02:31 kjcf05n02 dcs-collectord[5597]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 13:02:31 kjcf05n02 hpi.inv.log[5597]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 13:02:31 kjcf05n02 dcs-collectord[5597]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 13:02:31 kjcf05n02 dcs-collectord[5597]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 13:02:31 kjcf05n02 dcs-collector[5588]: Starting dcs-collector:[ OK ] Nov 3 13:02:31 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 13:02:31 kjcf05n02 dcs-collectord[5600]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 13:02:31 kjcf05n02 dcs-collectord[5600]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 13:02:31 kjcf05n02 dcs-collectord[5600]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 13:02:31 kjcf05n02 dcs-collectord[5600]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 13:02:31 kjcf05n02 dcs-collectord[5600]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 13:02:31 kjcf05n02 dcs-collectord[5600]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 13:02:31 kjcf05n02 dcs-collectord[5600]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 13:02:31 kjcf05n02 dcs-collectord[5600]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259338044", "units": "kB"}, {"name": "MemAvailable", "value": "258617748", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821264", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686608", "units": "kB"}, {"name": "Inactive", "value": "970280", "units": "kB"}, {"name": "Active(anon)", "value": "1520772", "units": "kB"}, {"name": "Inactive(anon)", "value": "833788", "units": "kB"}, {"name": "Active(file)", "value": "165836", "units": "kB"}, {"name": "Inactive(file)", "value": "136492", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "759456", "units": "kB"}, {"name": "Mapped", "value": "86324", "units": "kB"}, {"name": "Shmem", "value": "1593388", "units": "kB"}, {"name": "KReclaimable", "value": "109248", "units": "kB"}, {"name": "Slab", "value": "275468", "units": "kB"}, {"name": "SReclaimable", "value": "109248", "units": "kB"}, {"name": "SUnreclaim", "value": "166220", "units": "kB"}, {"name": "KernelStack", "value": "9584", "units": "kB"}, {"name": "PageTables", "value": "20480", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3223144", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11264", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "6144", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "301384", "units": "kB"}, {"name": "DirectMap2M", "value": "20535296", "units": "kB"}, {"name": "DirectMap1G", "value": "247463936", "units": "kB"}]}' Nov 3 13:02:31 kjcf05n02 dcs-collectord[5600]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 13:02:31 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 13:02:31 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:32 kjcf05n02 dcs-collectord[5600]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 13:02:32 kjcf05n02 dcs-collectord[5600]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730660551.39334], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730660551.6297805], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730660551.3257942, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 13:02:32 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:32 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 13:02:32 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:32 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:32 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 13:02:32 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 13:02:32 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 13:02:32 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 13:02:32 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:32 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 13:02:32 kjcf05n02 firmware-update-orc[5706]: Using config script: /etc/firmware_update_orc.conf Nov 3 13:02:32 kjcf05n02 firmware-update-orc[5706]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 13:02:32 kjcf05n02 firmware-update-orc[5706]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 13:02:32 kjcf05n02 firmware-update-orc[5706]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 13:02:32 kjcf05n02 firmware-update-orc[5706]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 13:02:32 kjcf05n02 firmware-update-orc[5706]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 13:02:32 kjcf05n02 firmware-update-orc[5706]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 13:02:32 kjcf05n02 firmware-update-orc-server[5742]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 13:02:32 kjcf05n02 firmware-update-orc[5706]: celery multi v5.2.7 (dawn-chorus) Nov 3 13:02:32 kjcf05n02 firmware-update-orc[5706]: > Starting nodes... Nov 3 13:02:32 kjcf05n02 firmware-update-orc[5706]: > worker1@kjcf05n02: OK Nov 3 13:02:32 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 13:02:32 kjcf05n02 firmware-update-orc-server[5746]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 13:02:33 kjcf05n02 firmware-update-orc-server[5746]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 13:02:33 kjcf05n02 firmware-update-orc-server[5746]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 13:02:33 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 13:02:33 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:33 kjcf05n02 systemd[3084]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:33 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:33 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:33 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 13:02:33 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 13:02:33 kjcf05n02 dbus-daemon[2136]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 13:02:33 kjcf05n02 dbus-daemon[2136]: [system] Reloaded configuration Nov 3 13:02:33 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 13:02:33 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 13:02:33 kjcf05n02 dbus-daemon[2136]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 13:02:33 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 13:02:33 kjcf05n02 dbus-daemon[2136]: [system] Reloaded configuration Nov 3 13:02:33 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 13:02:33 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 13:02:33 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 13:02:33 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 13:02:33 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 13:02:33 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:33 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 3 13:02:34 kjcf05n02 ras-resource-manager-agent[5862]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 13:02:34 kjcf05n02 ras-resource-manager-agent[5848]: Starting ras-resource-manager-agent:[ OK ] Nov 3 13:02:34 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 13:02:34 kjcf05n02 ras-resource-manager-agent[5864]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 13:02:34 kjcf05n02 ras-resource-manager-client[5864]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 13:02:34 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 3 13:02:34 kjcf05n02 ras-resource-manager-client[5864]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 13:02:34 kjcf05n02 ras-resource-manager-client[5874]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 13:02:34 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:34 kjcf05n02 systemd[3084]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:34 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:34 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:34 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 13:02:34 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 13:02:34 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:34 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 13:02:34 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:35 kjcf05n02 systemd[3084]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: Press Ctrl+C to exit. Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: Plugin support version 1.0 Nov 3 13:02:35 kjcf05n02 zabbix_agent2[5948]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 13:02:35 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:35 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:35 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:35 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 13:02:35 kjcf05n02 dcs-notification-sender[6025]: dcs-notification-senderd is stopped Nov 3 13:02:35 kjcf05n02 zabbix-agent2[6039]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 13:02:35 kjcf05n02 dcs-notification-sender[6025]: Starting notification-sender:[ OK ] Nov 3 13:02:35 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 13:02:36 kjcf05n02 zabbix-agent2[6041]: INFO DCS notification agent started. (agent.py:61) Nov 3 13:02:36 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 13:02:36 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:36 kjcf05n02 systemd[3084]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:36 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:36 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:36 kjcf05n00 mcfcli[3673891]: %3|1730660556.313|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:02:36 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:36 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 13:02:37 kjcf05n02 dcs-collectord[6124]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 13:02:37 kjcf05n02 dcs-collectord[6124]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 13:02:37 kjcf05n02 dcs-bulk-data-sender[6124]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 13:02:37 kjcf05n02 dcs-bulk-data-sender[6115]: Starting bulk-data-sender:[ OK ] Nov 3 13:02:37 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 13:02:37 kjcf05n02 dcs-collectord[6126]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 13:02:37 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 13:02:37 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 13:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 13:02:37 kjcf05n02 systemd[3084]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:37 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:37 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:37 kjcf05n02 nscd[2105]: 2105 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 13:02:37 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 13:02:37 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 13:02:37 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 13:02:37 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 13:02:37 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 13:02:37 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 13:02:37 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 13:02:37 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 13:02:37 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 13:02:37 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 13:02:37 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 13:02:37 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 13:02:37 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 13:02:37 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 13:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 13:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 13:02:37 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 13:02:37 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 13:02:38 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 13:02:38 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 13:02:38 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 13:02:38 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 13:02:38 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 3 13:02:38 kjcf05n02 sssd[nss][2412]: Shutting down (status = 0) Nov 3 13:02:38 kjcf05n02 sssd[be[implicit_files]][2273]: Shutting down (status = 0) Nov 3 13:02:38 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 3 13:02:38 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 3 13:02:38 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 13:02:38 kjcf05n02 sssd[sssd][6221]: Starting up Nov 3 13:02:38 kjcf05n02 sssd[be[implicit_files]][6222]: Starting up Nov 3 13:02:38 kjcf05n02 python3.9[5170]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 13:02:38 kjcf05n02 python3.9[3084]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:38 kjcf05n02 sssd[nss][6223]: Starting up Nov 3 13:02:39 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 13:02:39 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 13:02:39 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 13:02:40 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 13:02:40 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 13:02:40 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 13:02:40 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 13:02:40 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 13:02:40 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 13:02:40 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 13:02:40 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 13:02:40 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 13:02:40 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 13:02:40 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:02:40 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:02:40 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:40 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 13:02:40 kjcf05n02 icinga2[6278]: [2024-11-03 13:02:40 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 13:02:40 kjcf05n02 icinga2[6278]: [2024-11-03 13:02:40 -0600] information/cli: Loading configuration file(s). Nov 3 13:02:40 kjcf05n02 icinga2[6278]: [2024-11-03 13:02:40 -0600] information/ConfigItem: Committing config item(s). Nov 3 13:02:40 kjcf05n02 icinga2[6278]: [2024-11-03 13:02:40 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 3 13:02:40 kjcf05n02 icinga2[6278]: [2024-11-03 13:02:40 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 13:02:40 kjcf05n02 icinga2[6278]: [2024-11-03 13:02:40 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 13:02:40 kjcf05n02 icinga2[6278]: [2024-11-03 13:02:40 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 13:02:40 kjcf05n02 icinga2[6278]: [2024-11-03 13:02:40 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 13:02:40 kjcf05n02 icinga2[6278]: [2024-11-03 13:02:40 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 13:02:40 kjcf05n02 icinga2[6278]: [2024-11-03 13:02:40 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 13:02:40 kjcf05n02 icinga2[6278]: [2024-11-03 13:02:40 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 13:02:40 kjcf05n02 icinga2[6278]: [2024-11-03 13:02:40 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 13:02:40 kjcf05n02 icinga2[6278]: [2024-11-03 13:02:40 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 13:02:40 kjcf05n02 icinga2[6278]: [2024-11-03 13:02:40 -0600] information/cli: Closing console log. Nov 3 13:02:40 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 13:02:40 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:40 kjcf05n00 mcfcli[3673891]: %3|1730660560.558|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 13:02:41 kjcf05n02 systemd[3084]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:41 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:41 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:41 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 13:02:41 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 13:02:41 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:41 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 3 13:02:41 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:42 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 13:02:42 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:42 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:42 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 13:02:42 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 13:02:42 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 13:02:42 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 13:02:42 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 13:02:42 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 13:02:42 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 13:02:42 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 13:02:42 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 13:02:42 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 13:02:42 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 13:02:42 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 13:02:42 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 13:02:42 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 13:02:43 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:43 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 13:02:43 kjcf05n02 nslcd[6893]: version 0.9.9 starting Nov 3 13:02:43 kjcf05n02 nslcd[6893]: accepting connections Nov 3 13:02:43 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 13:02:43 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:43 kjcf05n02 systemd[3084]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:43 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:43 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:43 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 13:02:43 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 13:02:44 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 13:02:44 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 13:02:44 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 13:02:44 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 13:02:44 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 13:02:44 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 13:02:44 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:45 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 13:02:45 kjcf05n02 dearcpw[7115]: Using config script: /etc/dearcpw.conf Nov 3 13:02:45 kjcf05n02 dearcpw[7115]: - Creating default directory: '/var/log/dearcpw' Nov 3 13:02:45 kjcf05n02 dearcpw[7115]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 13:02:45 kjcf05n02 dearcpw[7115]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 13:02:45 kjcf05n02 dearcpw[7115]: - Creating default directory: '/var/run/dearcpw' Nov 3 13:02:45 kjcf05n02 dearcpw[7115]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 13:02:45 kjcf05n02 dearcpw[7115]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 13:02:45 kjcf05n02 dcs-bulk-data-sender[6126]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 13:02:45 kjcf05n02 dcs-collectord[6126]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 13:02:45 kjcf05n02 dearcpw-server[7175]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 13:02:45 kjcf05n02 dearcpw[7115]: celery multi v5.2.7 (dawn-chorus) Nov 3 13:02:45 kjcf05n02 dearcpw[7115]: > Starting nodes... Nov 3 13:02:45 kjcf05n02 dearcpw[7115]: > dearcpw@kjcf05n02: OK Nov 3 13:02:45 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 13:02:45 kjcf05n02 dearcpw-server[7177]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 13:02:45 kjcf05n02 dearcpw-server[7177]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 13:02:45 kjcf05n02 dearcpw-server[7177]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 13:02:45 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 3 13:02:45 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:45 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:45 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 13:02:45 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 13:02:45 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 13:02:45 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 13:02:45 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 13:02:45 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 13:02:45 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 13:02:45 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 13:02:45 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 13:02:45 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 13:02:46 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:60750). Nov 3 13:02:46 kjcf05n01 rsyncd[3104368]: connect from kjcf05n02 (172.16.2.5) Nov 3 13:02:46 kjcf05n01 rsyncd[3104368]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 13:02:46 kjcf05n01 rsyncd[3104368]: receiving file list Nov 3 13:02:46 kjcf05n01 rsyncd[3104368]: sent 29 bytes received 325 bytes total size 10905 Nov 3 13:02:46 kjcf05n01 systemd[1]: rsyncd@630-172.16.2.2:873-172.16.2.5:60750.service: Succeeded. Nov 3 13:02:46 kjcf05n02 puppet[7362]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 3 13:02:46 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 13:02:46 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 13:02:46 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 13:02:46 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 13:02:46 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 13:02:46 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 13:02:46 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 13:02:46 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 13:02:46 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 13:02:46 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 13:02:46 kjcf05n02 dcs-collectord[5600]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 13:02:46 kjcf05n02 dcs-collectord[5600]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 13:02:46 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 13:02:47 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 13:02:47 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 13:02:47 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 13:02:47 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 13:02:47 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 13:02:47 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 13:02:47 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 13:02:48 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 13:02:48 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 13:02:48 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 13:02:48 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 13:02:49 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 13:02:49 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 13:02:49 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:49 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 13:02:49 kjcf05n02 diskless-swap[7561]: HA_PS_000: recovering journal Nov 3 13:02:49 kjcf05n02 systemd-udevd[1551]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 13:02:49 kjcf05n02 diskless-swap[7561]: HA_PS_000: clean, 2283/6400 files, 7073/25600 blocks Nov 3 13:02:49 kjcf05n02 diskless-swap[7561]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 13:02:49 kjcf05n02 diskless-swap[7561]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 13:02:49 kjcf05n02 diskless-swap[7561]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 13:02:49 kjcf05n02 diskless-swap[7561]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 13:02:49 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 13:02:49 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:49 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:49 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 13:02:49 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 13:02:49 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 13:02:49 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 13:02:49 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 3 13:02:50 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 3 13:02:50 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 3 13:02:50 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 3 13:02:50 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 3 13:02:50 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 13:02:50 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 13:02:50 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 13:02:50 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 13:02:50 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 13:02:50 kjcf05n02 ipmievd[3942]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 13:02:50 kjcf05n02 ipmievd[3942]: System Event sensor - Timestamp Clock Sync Nov 3 13:02:50 kjcf05n02 ipmievd[3084]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:50 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 13:02:50 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 13:02:51 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 13:02:51 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 13:02:51 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 13:02:51 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 13:02:51 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 13:02:51 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 13:02:51 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 13:02:51 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 13:02:52 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 13:02:52 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 13:02:52 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 13:02:52 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 13:02:52 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 13:02:52 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 13:02:52 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 13:02:52 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 13:02:52 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:53 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 3 13:02:53 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:53 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:53 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 13:02:53 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 13:02:53 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:53 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 3 13:02:53 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:53 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:53 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 13:02:53 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 13:02:53 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:54 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 3 13:02:54 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:02:54 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:02:54 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 13:02:54 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 13:02:54 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 13:02:54 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 13:02:54 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 13:02:54 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 13:02:54 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 13:02:54 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 13:02:54 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 13:02:54 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 13:02:54 kjcf05n02 systemd[1]: Reloading. Nov 3 13:02:54 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 3 13:02:54 kjcf05n02 kdumpctl[7794]: kdump: No kdump initial ramdisk found. Nov 3 13:02:54 kjcf05n02 kdumpctl[7794]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 13:02:55 kjcf05n02 dracut[7906]: dracut-049-135.git20210121.el8 Nov 3 13:02:55 kjcf05n02 dracut[7908]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 13:02:55 kjcf05n02 dracut[7908]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 13:02:55 kjcf05n02 dracut[7908]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 13:02:55 kjcf05n02 dracut[7908]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 13:02:55 kjcf05n02 dracut[7908]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 13:02:55 kjcf05n02 dracut[7908]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 13:02:55 kjcf05n02 dracut[7908]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 13:02:55 kjcf05n02 dracut[7908]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + is_func check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ type -t check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 0 -ne 0 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check -h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local dev holder Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + require_binaries mdadm expr Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _module_name=90hperaid Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ mdadm = \-\m ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for cmd in "$@" Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + find_binary mdadm Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for cmd in "$@" Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + find_binary expr Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n -h ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for dev in "${!host_fs_types[@]}" Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ nfs != *_raid_member ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + continue Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _ret=255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + ret=255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ 255 = 0 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ 255 = 255 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ module_depends hperaid Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: +++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: +++ set -x Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ depends Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo rootfs-block Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ return 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ _ret=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ return 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for _moddep in $(module_depends $_mod) Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all == *\ hperaid\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + add_dracutmodules+=' rootfs-block ' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ == *\ hperaid\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check_module rootfs-block Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _mod=rootfs-block Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddep Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ == *\ rootfs-block\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n '' ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all == *\ rootfs-block\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + module_check rootfs-block 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _forced=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 2 -eq 2 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _forced=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + is_func check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ type -t check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 0 -ne 0 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check -h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _ret=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + ret=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ 0 = 0 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ module_depends rootfs-block Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: +++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 13:02:55 kjcf05n02 kdumpctl[3084]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ depends Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo fs-lib Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ _ret=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ return 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for _moddep in $(module_depends $_mod) Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all == *\ rootfs-block\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + add_dracutmodules+=' fs-lib ' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ == *\ rootfs-block\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check_module fs-lib Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _mod=fs-lib Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddep Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n '' ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + mods_checked_as_dep+=' fs-lib ' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all == *\ fs-lib\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + module_check fs-lib 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _forced=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 2 -eq 2 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _forced=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + is_func check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ type -t check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 0 -ne 0 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check -h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _ret=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + ret=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ 0 = 0 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ module_depends fs-lib Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: +++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ depends Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ return 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ _ret=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ return 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + mods_to_load+=' fs-lib ' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + mods_to_load+=' rootfs-block ' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + mods_to_load+=' hperaid ' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _mod=90kernel-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _mod=kernel-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check_module kernel-modules 1 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _mod=kernel-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddep Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n 1 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all = all ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + module_check kernel-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _forced=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 1 -eq 2 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + is_func check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ type -t check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 0 -ne 0 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check -h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + true Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _ret=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + ret=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ 0 != 0 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ module_depends kernel-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: +++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ depends Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ true Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ _ret=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ return 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + mods_to_load+=' kernel-modules ' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _mod=90kernel-modules-extra Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _mod=kernel-modules-extra Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check_module kernel-modules-extra 1 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _mod=kernel-modules-extra Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddep Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n 1 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all = all ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + module_check kernel-modules-extra Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _forced=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 1 -eq 2 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + is_func check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ type -t check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 0 -ne 0 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check -h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + true Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _ret=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + ret=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ 0 != 0 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ module_depends kernel-modules-extra Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: +++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ depends Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ true Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ _ret=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ return 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + mods_to_load+=' kernel-modules-extra ' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _mod=90kernel-network-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _mod=kernel-network-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check_module kernel-network-modules 1 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _mod=kernel-network-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddep Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n 1 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all = all ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + module_check kernel-network-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _forced=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 1 -eq 2 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + is_func check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ type -t check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 0 -ne 0 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check -h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _ret=255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + ret=255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ 255 != 0 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n 1 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 1 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _mod=90livenet Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _mod=livenet Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check_module livenet 1 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _mod=livenet Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddep Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n 1 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all = all ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + module_check livenet Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _forced=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 1 -eq 2 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + is_func check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ type -t check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 0 -ne 0 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check -h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _ret=255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + ret=255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ 255 != 0 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n 1 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 1 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _mod=90lvm Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _mod=lvm Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check_module lvm 1 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _mod=lvm Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddep Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n 1 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all = all ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + module_check lvm Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _forced=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 1 -eq 2 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + is_func check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ type -t check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 0 -ne 0 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check -h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + require_binaries lvm Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _module_name=90lvm Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ lvm = \-\m ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for cmd in "$@" Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + find_binary lvm Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n -h ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for fs in "${host_fs_types[@]}" Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ nfs = LVM*_member ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _ret=255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + ret=255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ 255 != 0 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n 1 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 1 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _mod=90mdraid Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _mod=mdraid Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check_module mdraid 1 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _mod=mdraid Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddep Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n 1 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all = all ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + module_check mdraid Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _forced=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 1 -eq 2 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + is_func check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ type -t check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 0 -ne 0 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check -h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _rootdev Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + require_binaries mdadm expr Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _module_name=90mdraid Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ mdadm = \-\m ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for cmd in "$@" Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + find_binary mdadm Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for cmd in "$@" Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + find_binary expr Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n -h ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for dev in "${!host_fs_types[@]}" Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ nfs != *_raid_member ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + continue Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _ret=255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + ret=255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ 255 != 0 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n 1 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 1 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _mod=90multipath Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _mod=multipath Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check_module multipath 1 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _mod=multipath Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddep Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n 1 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all = all ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + module_check multipath Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _forced=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 1 -eq 2 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + is_func check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ type -t check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 0 -ne 0 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check -h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _rootdev Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n -h ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for_each_host_dev_and_slaves is_mpath Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _func=is_mpath Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _dev Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for _dev in "${host_devs[@]}" Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + continue Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 1 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _ret=255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + ret=255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ 255 != 0 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n 1 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 1 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _mod=90qemu Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _mod=qemu Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check_module qemu 1 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _mod=qemu Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddep Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n 1 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all = all ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + module_check qemu Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _forced=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 1 -eq 2 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + is_func check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ type -t check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 0 -ne 0 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check -h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n -h ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + type -P systemd-detect-virt Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ systemd-detect-virt --vm Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + vm=none Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + (( 1 != 0 )) Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _ret=255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + ret=255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ 255 != 0 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n 1 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 1 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _mod=90qemu-net Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _mod=qemu-net Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check_module qemu-net 1 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _mod=qemu-net Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddep Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n 1 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all = all ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + module_check qemu-net Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _forced=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 1 -eq 2 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + is_func check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ type -t check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 0 -ne 0 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check -h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n -h ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + type -P systemd-detect-virt Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ systemd-detect-virt --vm Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + vm= Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + (( 1 != 0 )) Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _ret=255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + ret=255 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ 255 != 0 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n 1 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + return 1 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _mod=90stratis Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + _mod=stratis Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check_module stratis 1 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _mod=stratis Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddep Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -n 1 ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ all = all ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + module_check stratis Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ read a b Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _forced=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _hostonly=-h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 1 -eq 2 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + is_func check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: ++ type -t check Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + '[' 0 -ne 0 ']' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + check -h Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _module_name=90stratis Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + local _ret=0 Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + [[ stratisd-init = \-\m ]] Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + for cmd in "$@" Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + find_binary stratisd-init Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 13:02:55 kjcf05n02 kdumpctl[7794]: + set +x Nov 3 13:02:55 kjcf05n02 dracut[7908]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 13:02:55 kjcf05n02 dracut[7908]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 13:02:55 kjcf05n02 dracut[7908]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 13:02:55 kjcf05n02 dracut[7908]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 13:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 13:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 13:02:55 kjcf05n02 dracut[7908]: memstrack is available Nov 3 13:02:55 kjcf05n02 dracut[7908]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 13:02:55 kjcf05n02 dracut[7908]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 13:02:55 kjcf05n02 dracut[7908]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 13:02:55 kjcf05n02 dracut[7908]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 13:02:55 kjcf05n02 dracut[7908]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 13:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 13:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 13:02:56 kjcf05n02 dracut[7908]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 13:02:56 kjcf05n02 dracut[7908]: *** Including module: bash *** Nov 3 13:02:56 kjcf05n02 dracut[7908]: *** Including module: systemd *** Nov 3 13:02:57 kjcf05n02 dracut[7908]: *** Including module: fips *** Nov 3 13:02:57 kjcf05n02 dracut[7908]: *** Including module: systemd-initrd *** Nov 3 13:02:57 kjcf05n02 dracut[7908]: *** Including module: watchdog-modules *** Nov 3 13:02:57 kjcf05n02 dracut[7908]: *** Including module: nss-softokn *** Nov 3 13:02:57 kjcf05n02 dracut[7908]: *** Including module: i18n *** Nov 3 13:02:57 kjcf05n02 dracut[7908]: No KEYMAP configured. Nov 3 13:02:57 kjcf05n02 dracut[7908]: *** Including module: network-legacy *** Nov 3 13:02:57 kjcf05n02 dracut[7908]: *** Including module: network *** Nov 3 13:02:57 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 3 13:02:58 kjcf05n02 dracut[7908]: *** Including module: ib_bonding *** Nov 3 13:02:58 kjcf05n02 dracut[7908]: *** Including module: drm *** Nov 3 13:02:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 13:02:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 13:02:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 13:02:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 13:03:00 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 3 13:03:01 kjcf05n02 dracut[7908]: *** Including module: hperaid *** Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + install Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + local rule rule_path Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + inst_multiple cat expr Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.KFK2cV/initramfs -a -f cat expr Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + _ret=0 Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + (( 0 != 0 )) Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + : Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + return 0 Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + inst_multiple -o mdmon Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.KFK2cV/initramfs -a -f -o mdmon Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + _ret=0 Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + (( 0 != 0 )) Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + : Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + return 0 Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: ++ command -v partx Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + inst /usr/sbin/partx /sbin/partx Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + local _hostonly_install Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + [[ -e /tmp/dracut.KFK2cV/initramfs//sbin/partx ]] Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.KFK2cV/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + (( 0 != 0 )) Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + : Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: ++ command -v mdadm Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + local _hostonly_install Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + [[ -e /tmp/dracut.KFK2cV/initramfs//sbin/mdadm ]] Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.KFK2cV/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + (( 0 != 0 )) Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + : Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + [[ yes == \y\e\s ]] Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + local _raidconf Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: ++ cmdline Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: ++ local _activated dev line UUID Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: ++ declare -A _activated Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: ++ for dev in "${!host_fs_types[@]}" Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: ++ [[ nfs != *_raid_member ]] Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: ++ continue Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + _raidconf= Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + [[ -n '' ]] Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + inst_rules 64-md-raid.rules Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + local _target=/etc/udev/rules.d _rule _found Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + inst_dir /usr/lib/udev/rules.d Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + [[ -e /tmp/dracut.KFK2cV/initramfs//usr/lib/udev/rules.d ]] Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + return 0 Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + inst_dir /etc/udev/rules.d Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + [[ -e /tmp/dracut.KFK2cV/initramfs//etc/udev/rules.d ]] Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + return 0 Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + for _rule in "$@" Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + continue Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + continue Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + for r in '' $dracutbasedir/rules.d/ Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + [[ 64-md-raid.rules != /* ]] Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + continue Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + for r in '' $dracutbasedir/rules.d/ Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + continue Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + [[ -n '' ]] Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + set +x Nov 3 13:03:01 kjcf05n02 dracut[7908]: Skipping udev rule: 64-md-raid.rules Nov 3 13:03:01 kjcf05n02 dcs-collectord[5600]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 13:03:01 kjcf05n02 dcs-collectord[5600]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + installkernel Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + instmods =drivers/md Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + local _optional=-o Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + local _silent Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + local _ret Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + [[ '' = yes ]] Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + [[ =drivers/md = \-\c ]] Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + [[ =drivers/md = \-\s ]] Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + (( 1 == 0 )) Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.KFK2cV/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + _ret=0 Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + (( 0 != 0 )) Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + [[ -n '' ]] Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + return 0 Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + _ret=0 Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + unset check depends cmdline install installkernel Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + return 0 Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + modules_loaded+='hperaid ' Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + '[' -n '' ']' Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + _d_mod=90kernel-modules Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + _d_mod=kernel-modules Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + [[ '' = yes ]] Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + dinfo '*** Including module: kernel-modules ***' Nov 3 13:03:01 kjcf05n02 kdumpctl[7794]: + set +x Nov 3 13:03:01 kjcf05n02 dracut[7908]: *** Including module: kernel-modules *** Nov 3 13:03:02 kjcf05n02 dracut[7908]: *** Including module: kernel-modules-extra *** Nov 3 13:03:02 kjcf05n02 dracut[7908]: *** Including module: kernel-network-modules *** Nov 3 13:03:02 kjcf05n02 dracut[7908]: *** Including module: diskless-mod *** Nov 3 13:03:02 kjcf05n02 dracut[7908]: *** Including module: fstab-sys *** Nov 3 13:03:02 kjcf05n02 dracut[7908]: *** Including module: nfs *** Nov 3 13:03:03 kjcf05n02 dracut[7908]: *** Including module: rootfs-block *** Nov 3 13:03:03 kjcf05n02 dracut[7908]: *** Including module: terminfo *** Nov 3 13:03:03 kjcf05n02 dracut[7908]: *** Including module: udev-rules *** Nov 3 13:03:03 kjcf05n02 dracut[7908]: Skipping udev rule: 91-permissions.rules Nov 3 13:03:03 kjcf05n02 dracut[7908]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 13:03:03 kjcf05n02 dracut[7908]: *** Including module: dracut-systemd *** Nov 3 13:03:04 kjcf05n02 dracut[7908]: *** Including module: usrmount *** Nov 3 13:03:04 kjcf05n02 dracut[7908]: *** Including module: base *** Nov 3 13:03:04 kjcf05n02 dracut[7908]: *** Including module: fs-lib *** Nov 3 13:03:04 kjcf05n02 dracut[7908]: *** Including module: kdumpbase *** Nov 3 13:03:05 kjcf05n02 dracut[7908]: *** Including module: memstrack *** Nov 3 13:03:05 kjcf05n02 dracut[7908]: *** Including module: shutdown *** Nov 3 13:03:05 kjcf05n02 dracut[7908]: *** Including module: squash *** Nov 3 13:03:05 kjcf05n00 zabbix-server[1274546]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 13:03:05 kjcf05n00 zabbix-server[1274546]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:43\\"}}"' Nov 3 13:03:05 kjcf05n00 log_interesting_event.py[1274546]: Event '46237' acknowledged Nov 3 13:03:05 kjcf05n00 zabbix-server[1274547]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 13:03:05 kjcf05n02 dracut[7908]: *** Including modules done *** Nov 3 13:03:05 kjcf05n02 dracut[7908]: *** Installing kernel module dependencies *** Nov 3 13:03:05 kjcf05n00 zabbix-server[1274547]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 3 13:03:05 kjcf05n00 log_interesting_event.py[1274547]: Event '46239' acknowledged Nov 3 13:03:05 kjcf05n00 zabbix-server[1274548]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 13:03:05 kjcf05n02 dracut[7908]: *** Installing kernel module dependencies done *** Nov 3 13:03:05 kjcf05n02 dracut[7908]: *** Resolving executable dependencies *** Nov 3 13:03:05 kjcf05n00 zabbix-server[1274548]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 3 13:03:05 kjcf05n00 log_interesting_event.py[1274548]: Event '46240' acknowledged Nov 3 13:03:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730660585', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 2.86, 2.73, 1.18'}"] Nov 3 13:03:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 2.86, 2.73, 1.18', 'message': 'OK - load average: 2.86, 2.73, 1.18', 'value': 'ok', 'timestamp': '1730660585'} Nov 3 13:03:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:03:06 kjcf05n02 dracut[7908]: *** Resolving executable dependencies done*** Nov 3 13:03:06 kjcf05n02 dracut[7908]: *** Hardlinking files *** Nov 3 13:03:06 kjcf05n02 dracut[7908]: *** Hardlinking files done *** Nov 3 13:03:06 kjcf05n02 dracut[7908]: *** Generating early-microcode cpio image *** Nov 3 13:03:06 kjcf05n02 dracut[7908]: *** Constructing AuthenticAMD.bin **** Nov 3 13:03:06 kjcf05n02 dracut[7908]: *** Store current command line parameters *** Nov 3 13:03:06 kjcf05n02 dracut[7908]: Stored kernel commandline: Nov 3 13:03:06 kjcf05n02 dracut[7908]: rd.driver.pre=sd_mod Nov 3 13:03:06 kjcf05n02 dracut[7908]: rd.driver.pre=nvme Nov 3 13:03:06 kjcf05n02 dracut[7908]: rd.driver.pre=ipmi_si Nov 3 13:03:06 kjcf05n02 dracut[7908]: rd.driver.pre=ipmi_devintf Nov 3 13:03:06 kjcf05n02 dracut[7908]: rd.driver.pre=ipmi_msghandler Nov 3 13:03:06 kjcf05n02 dracut[7908]: nameserver=172.16.2.2 Nov 3 13:03:06 kjcf05n02 dracut[7908]: nameserver=127.0.0.1 Nov 3 13:03:06 kjcf05n02 dracut[7908]: nameserver=172.16.2.2 Nov 3 13:03:06 kjcf05n02 dracut[7908]: nameserver=127.0.0.1 Nov 3 13:03:06 kjcf05n02 dracut[7908]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 3 13:03:06 kjcf05n02 dracut[7908]: rd.neednet Nov 3 13:03:06 kjcf05n02 dracut[7908]: kdumpnic=mgmt0 Nov 3 13:03:06 kjcf05n02 dracut[7908]: bootdev=mgmt0 Nov 3 13:03:06 kjcf05n02 dracut[7908]: *** Install squash loader *** Nov 3 13:03:07 kjcf05n02 dracut[7908]: *** Squashing the files inside the initramfs *** Nov 3 13:03:07 kjcf05n02 dracut[7908]: *** Squashing the files inside the initramfs done *** Nov 3 13:03:07 kjcf05n02 dracut[7908]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 13:03:07 kjcf05n02 dracut[7908]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 13:03:08 kjcf05n02 kdumpctl[7794]: kdump: kexec: loaded kdump kernel Nov 3 13:03:08 kjcf05n02 kdumpctl[7794]: kdump: Starting kdump: [OK] Nov 3 13:03:08 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 3 13:03:08 kjcf05n02 systemd[1]: Reloading. Nov 3 13:03:08 kjcf05n02 systemd[3084]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:03:08 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:03:08 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:03:08 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 13:03:08 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 13:03:08 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 13:03:08 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 13:03:08 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 13:03:08 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 13:03:08 kjcf05n02 ifdown[14491]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 13:03:08 kjcf05n02 ifdown[14492]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:03:08 kjcf05n02 ifdown[14493]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:03:09 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 13:03:09 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 13:03:09 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 13:03:09 kjcf05n02 ifup[14563]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 13:03:09 kjcf05n02 ifup[14564]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:03:09 kjcf05n02 ifup[14565]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:03:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730660589', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 327 processes with STATE = RSZDT '}"] Nov 3 13:03:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 327 processes with STATE = RSZDT ', 'message': 'PROCS OK: 327 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730660589'} Nov 3 13:03:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:03:10 kjcf05n00 mcfcli[3673891]: %3|1730660590.558|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 13:03:12 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 13:03:13 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 13:03:14 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 13:03:14 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 13:03:14 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:03:14 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:03:14 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:03:14 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:03:14 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 13:03:14 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 13:03:14 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 13:03:14 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 13:03:14 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:03:14 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:03:14 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:03:14 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:03:14 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 13:03:14 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 13:03:14 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 13:03:14 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 13:03:14 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 13:03:14 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 13:03:14 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 13:03:14 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 13:03:14 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 13:03:14 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 13:03:14 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 13:03:14 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 13:03:14 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 13:03:14 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 13:03:14 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 13:03:14 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 13:03:14 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 13:03:14 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 13:03:14 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 13:03:14 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 13:03:14 kjcf05n02 ifdown[14749]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 13:03:14 kjcf05n02 ifdown[14750]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:03:14 kjcf05n02 ifdown[14751]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:03:14 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 13:03:14 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 13:03:14 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 13:03:14 kjcf05n02 ifup[14821]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 13:03:14 kjcf05n02 ifup[14822]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:03:14 kjcf05n02 ifup[14823]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:03:14 kjcf05n00 mcfcli[3673891]: %3|1730660594.323|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:03:16 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 13:03:16 kjcf05n02 dcs-collectord[5600]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 13:03:16 kjcf05n02 dcs-collectord[5600]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 13:03:18 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 13:03:18 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 13:03:18 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 13:03:18 kjcf05n02 systemd[1]: Reloading. Nov 3 13:03:19 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 3 13:03:19 kjcf05n02 await_ha_peer[15036]: Waiting for HA peer kjcf05n03 Nov 3 13:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730660599', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 13:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730660599', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 13:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730660599'} Nov 3 13:03:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730660599'} Nov 3 13:03:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730660599', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.4% (3694416 kB) used.'}"] Nov 3 13:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.4% (3694416 kB) used.', 'message': 'OK - 1.4% (3694416 kB) used.', 'value': 'ok', 'timestamp': '1730660599'} Nov 3 13:03:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:03:20 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 13:03:20 kjcf05n02 await_ha_peer[15036]: Peer kjcf05n03 has started, starting HA Nov 3 13:03:20 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 3 13:03:20 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 3 13:03:20 kjcf05n02 fstonithd.py[15105]: Listening for kdump packets from partner Nov 3 13:03:20 kjcf05n02 systemd[1]: Reloading. Nov 3 13:03:21 kjcf05n02 systemd[3084]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:03:21 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:03:21 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:03:21 kjcf05n02 systemd[1]: Reloading. Nov 3 13:03:21 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 3 13:03:21 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 13:03:21 kjcf05n02 systemd[1]: Reloading. Nov 3 13:03:22 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 13:03:22 kjcf05n02 puppet-agent[3529]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:03:22 kjcf05n02 puppet[3529]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:03:22 kjcf05n02 puppet-agent[3529]: Applied catalog in 90.81 seconds Nov 3 13:03:22 kjcf05n02 puppet[3529]: Notice: Applied catalog in 90.81 seconds Nov 3 13:03:22 kjcf05n02 systemd[1]: Started Puppet agent. Nov 3 13:03:22 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 13:03:22 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 13:03:22 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 13:03:22 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 13:03:22 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 13:03:22 kjcf05n02 systemd[1]: Reached target Timers. Nov 3 13:03:22 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 13:03:22 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 3 13:03:22 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 13:03:22 kjcf05n02 wce-disable.sh[15247]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 13:03:22 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 13:03:22 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 13:03:22 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 13:03:22 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 13:03:22 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 3 13:03:22 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 3 13:03:22 kjcf05n02 python3.9[15245]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 13:03:22 kjcf05n02 python3.9[15245]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 13:03:22 kjcf05n02 gateway-ec-node.py[15246]: Starting gateway-ec-node service Nov 3 13:03:22 kjcf05n02 RFSF-API[15244]: INFO[2024-11-03T13:03:22-06:00] Datapath API RESTful Service starting Nov 3 13:03:22 kjcf05n02 dp-api-server-node[15244]: INFO[2024-11-03T13:03:22-06:00] Datapath API RESTful Service starting Nov 3 13:03:22 kjcf05n02 RFSF-API[15244]: INFO[2024-11-03T13:03:22-06:00] Running in production mode, starting dbus event listener Nov 3 13:03:22 kjcf05n02 dp-api-server-node[15244]: INFO[2024-11-03T13:03:22-06:00] Running in production mode, starting dbus event listener Nov 3 13:03:22 kjcf05n02 RFSF-API[15244]: INFO[2024-11-03T13:03:22-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 13:03:22 kjcf05n02 dp-api-server-node[15244]: INFO[2024-11-03T13:03:22-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 13:03:22 kjcf05n02 RFSF-API[15244]: INFO[2024-11-03T13:03:22-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 13:03:22 kjcf05n02 dp-api-server-node[15244]: INFO[2024-11-03T13:03:22-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 13:03:22 kjcf05n02 RFSF-API[15244]: INFO[2024-11-03T13:03:22-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 13:03:22 kjcf05n02 dp-api-server-node[15244]: INFO[2024-11-03T13:03:22-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 13:03:22 kjcf05n02 RFSF-API[15244]: INFO[2024-11-03T13:03:22-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 13:03:22 kjcf05n02 dp-api-server-node[15244]: INFO[2024-11-03T13:03:22-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 13:03:22 kjcf05n02 RFSF-API[15244]: INFO[2024-11-03T13:03:22-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 13:03:22 kjcf05n02 dp-api-server-node[15244]: INFO[2024-11-03T13:03:22-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 13:03:22 kjcf05n02 RFSF-API[15244]: INFO[2024-11-03T13:03:22-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 13:03:22 kjcf05n02 dp-api-server-node[15244]: INFO[2024-11-03T13:03:22-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 13:03:22 kjcf05n02 RFSF-API[15244]: INFO[2024-11-03T13:03:22-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 13:03:22 kjcf05n02 dp-api-server-node[15244]: INFO[2024-11-03T13:03:22-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 13:03:22 kjcf05n02 RFSF-API[15244]: INFO[2024-11-03T13:03:22-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 13:03:22 kjcf05n02 dp-api-server-node[15244]: INFO[2024-11-03T13:03:22-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 13:03:22 kjcf05n02 RFSF-API[15244]: INFO[2024-11-03T13:03:22-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 13:03:22 kjcf05n02 dp-api-server-node[15244]: INFO[2024-11-03T13:03:22-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 13:03:22 kjcf05n02 RFSF-API[15244]: INFO[2024-11-03T13:03:22-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 13:03:22 kjcf05n02 dp-api-server-node[15244]: INFO[2024-11-03T13:03:22-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 13:03:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730660603', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(728.0B/568.0B), ib1=(532.0B/656.0B), icl0=(5.1kB/6.8kB), lo=(600.0B/600.0B), meth0=(1541.1MB/7.7MB), mgmt0=(1477.9MB/7.7MB)'}"] Nov 3 13:03:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(728.0B/568.0B), ib1=(532.0B/656.0B), icl0=(5.1kB/6.8kB), lo=(600.0B/600.0B), meth0=(1541.1MB/7.7MB), mgmt0=(1477.9MB/7.7MB)', 'message': 'NET OK - (Rx/Tx) ib0=(728.0B/568.0B), ib1=(532.0B/656.0B), icl0=(5.1kB/6.8kB), lo=(600.0B/600.0B), meth0=(1541.1MB/7.7MB), mgmt0=(1477.9MB/7.7MB)', 'value': 'ok', 'timestamp': '1730660603'} Nov 3 13:03:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:03:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730660603', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 13:03:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730660603'} Nov 3 13:03:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:03:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730660605', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 13:03:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730660605'} Nov 3 13:03:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T13:03:27.253131119-06:00 level=info msg="Completed cleanup jobs" duration=26.477087ms Nov 3 13:03:29 kjcf05n02 systemd[1]: Reloading. Nov 3 13:03:29 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 13:03:29 kjcf05n02 systemd[1]: Reloading. Nov 3 13:03:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730660609', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 13:03:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730660609'} Nov 3 13:03:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:03:29 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 13:03:30 kjcf05n02 diskmonitor_pre[15856]: Key management is currently disabled.DEAR disabled Nov 3 13:03:30 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 13:03:31 kjcf05n00 httpd[902571]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 13:03:31 kjcf05n02 dcs-collectord[5600]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 13:03:31 kjcf05n02 dcs-collectord[5600]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 13:03:31 kjcf05n02 dcs-collectord[5600]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 13:03:31 kjcf05n02 sh[15917]: LNET configured: New Created Nov 3 13:03:31 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 13:03:31 kjcf05n02 LCNmon[17944]: Interface ib0 is up Nov 3 13:03:31 kjcf05n02 LCNmon[17944]: Interface ib1 is up Nov 3 13:03:32 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 17994 (bash) Nov 3 13:03:32 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 13:03:32 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 13:03:32 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 13:03:32 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 13:03:32 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 13:03:32 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: /var/run/diskmonitor does not exist, creating Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: Creating /var/run/diskmonitor/disk Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: Creating /var/run/diskmonitor/encl Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: Creating /var/run/diskmonitor/cli Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: RAS_Interlocks_enabled: 1 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: add handler for sig: 14 sa_flags: 10000004 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: add handler for sig: 1 sa_flags: 10000004 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: add handler for sig: 2 sa_flags: 00000004 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: add handler for sig: 15 sa_flags: 00000004 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: add handler for sig: 6 sa_flags: 00000004 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: add handler for sig: 3 sa_flags: 00000004 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: add handler for sig: 30 sa_flags: 00000004 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: add handler for sig: 20 sa_flags: 00000004 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: add handler for sig: 10 sa_flags: 10000004 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: add handler for sig: 11 sa_flags: 00000004 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: add handler for sig: 7 sa_flags: 00000004 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: add handler for sig: 4 sa_flags: 00000004 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: add handler for sig: 8 sa_flags: 00000004 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: Using HA Baton locks - key: diskmonitor Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: Baton will be held for at most 570 seconds Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: DMMP Enabled: 0 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: random seed: 96eb1082 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: NVMe Enclosure: 1 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: ZFS Enclosure: 0 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: Dbus, Initialized Connection Successfully Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: int_catcher_thread: thread start Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: Received dbus message 4 org.freedesktop.DBus -> :1.98 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 13:03:34 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 13:03:36 kjcf05n02 LCNmon[17944]: 10.16.100.56 is unreachable via ib0 Nov 3 13:03:36 kjcf05n02 LCNmon[17944]: 10.16.100.57 is unreachable via ib0 Nov 3 13:03:36 kjcf05n02 LCNmon[17944]: Can ping through interface ib0 Nov 3 13:03:36 kjcf05n02 LCNmon[17944]: Can ping through interface ib1 Nov 3 13:03:36 kjcf05n02 LCNmon[17944]: NIC ib0, initial state UP Nov 3 13:03:36 kjcf05n02 LCNmon[17944]: NIC ib1, initial state UP Nov 3 13:03:36 kjcf05n02 LCNmon[17944]: LCNstat initial state UP Nov 3 13:03:36 kjcf05n02 LCNmon[17944]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 3 13:03:36 kjcf05n02 openhpid[5506]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 13:03:36 kjcf05n02 openhpid[5506]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 13:03:36 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 3 13:03:36 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 13:03:36 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 13:03:36 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18548 which is not our child. We'll most likely not notice when it exits. Nov 3 13:03:36 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 13:03:36 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 3 13:03:36 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 3 13:03:36 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 13:03:36 kjcf05n02 dcs-collectord[5600]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 13:03:36 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 13:03:36 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 13:03:36 kjcf05n02 systemd[1]: Startup finished in 48.342s (kernel) + 2min 28.176s (userspace) = 3min 16.518s. Nov 3 13:03:36 kjcf05n02 openhpid[18548]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 13:03:36 kjcf05n02 openhpid[18548]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 13:03:36 kjcf05n02 openhpid[18548]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 13:03:36 kjcf05n02 openhpid[18548]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 13:03:40 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 13:03:40 kjcf05n00 mcfcli[3673891]: %3|1730660620.559|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 13:03:46 kjcf05n02 dcs-collectord[5600]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 13:03:46 kjcf05n02 dcs-collectord[5600]: WARNING No data collected (hpi_parser.py:353) Nov 3 13:03:50 kjcf05n00 mcfcli[3673891]: %3|1730660630.414|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:04:00 kjcf05n02 ipmievd[3942]: System Event sensor - Timestamp Clock Sync Nov 3 13:04:01 kjcf05n02 ipmievd[3084]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:04:01 kjcf05n02 dcs-collectord[5600]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 13:04:11 kjcf05n00 mcfcli[3673891]: %3|1730660651.059|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 13:04:12 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 13:04:16 kjcf05n02 dcs-collectord[5600]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 13:04:19 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '6e1ebed6-9a16-11ef-8406-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 13:04:19 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '6e1ebed6-9a16-11ef-8406-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 13:04:19 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '6e1ebed6-9a16-11ef-8406-00093d0695e3', 'response ID': '6e28f716-9a16-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 13:04:19 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 6e28f716-9a16-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 13:04:20 kjcf05n03 firmware-update-orc-server[5875]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "cd582195-a196-45c3-bf30-024f65135bab"} (logger.py:65) Nov 3 13:04:20 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 139843 (get_disk_device) Nov 3 13:04:20 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 13:04:20 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 13:04:20 kjcf05n03 ccp-client[139864]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 13:04:20 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 13:04:20 kjcf05n02 ras-resource-manager-agent[5864]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "6e1ebed6-9a16-11ef-8406-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 13:04:20 kjcf05n02 ras-resource-manager-agent[5864]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '6e1ebed6-9a16-11ef-8406-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 13:04:20 kjcf05n02 ras-resource-manager-agent[5864]: INFO Submitting new device inserted signal, starting to qualify drive: 6e1ebed6-9a16-11ef-8406-00093d0695e3 (admin_action.py:110) Nov 3 13:04:20 kjcf05n03 ccp-client[139864]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 13:04:20 kjcf05n03 ccp-client[139874]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 13:04:20 kjcf05n03 ccp-client[139864]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 13:04:20 kjcf05n03 ccp-client[139864]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 13:04:20 kjcf05n03 ccp-client[139874]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 13:04:20 kjcf05n03 ccp-client[139874]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 13:04:20 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '6e6b1d08-9a16-11ef-8406-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 13:04:20 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '6e6b1d08-9a16-11ef-8406-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 13:04:20 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '6e6b1d08-9a16-11ef-8406-00093d0695e3', 'response ID': '6e72341c-9a16-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 13:04:20 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 6e72341c-9a16-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 13:04:20 kjcf05n02 diskmonitor[17507]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 13:04:20 kjcf05n02 ras-resource-manager-agent[5864]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "6e6b1d08-9a16-11ef-8406-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 13:04:20 kjcf05n02 ras-resource-manager-agent[5864]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '6e6b1d08-9a16-11ef-8406-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 13:04:20 kjcf05n02 ras-resource-manager-agent[5864]: INFO Submitting new device inserted signal, starting to qualify drive: 6e6b1d08-9a16-11ef-8406-00093d0695e3 (admin_action.py:110) Nov 3 13:04:20 kjcf05n02 firmware-update-orc-server[5820]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "83687707-1f35-4646-ad7a-bcbfa1f0ffbd"} (logger.py:65) Nov 3 13:04:21 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31438 deleted. Nov 3 13:04:21 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31439 deleted. Nov 3 13:04:23 kjcf05n03 DRVFW[140029]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 13:04:23 kjcf05n03 ccp-client[140030]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 13:04:23 kjcf05n03 ccp-client[140030]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 13:04:23 kjcf05n03 ccp-client[140046]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 13:04:23 kjcf05n03 ccp-client[140030]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 13:04:23 kjcf05n03 ccp-client[140030]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 13:04:23 kjcf05n03 ccp-client[140046]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 13:04:23 kjcf05n03 ccp-client[140046]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 13:04:23 kjcf05n03 firmware-update-orc-server[5875]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 13:04:24 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 6e28f716-9a16-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 13:04:24 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '6e1ebed6-9a16-11ef-8406-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '6e1ebed6-9a16-11ef-8406-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}}} (logger.py:65) Nov 3 13:04:24 kjcf05n02 ras-resource-manager-agent[5864]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '6e1ebed6-9a16-11ef-8406-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 13:04:24 kjcf05n02 ras-resource-manager-agent[5864]: INFO Drive qualification complete responding: 6e1ebed6-9a16-11ef-8406-00093d0695e3 (admin_action.py:205) Nov 3 13:04:24 kjcf05n02 ras-resource-manager-agent[5864]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "6e1ebed6-9a16-11ef-8406-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (interesting_event.py:59) Nov 3 13:04:26 kjcf05n00 mcfcli[3673891]: %3|1730660666.820|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:04:28 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 13:04:28 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 13:04:28 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 13:04:28 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 13:04:28 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 13:04:28 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 13:04:28 kjcf05n02 diskmonitor[17507]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 13:04:28 kjcf05n02 diskmonitor[17507]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 13:04:28 kjcf05n02 diskmonitor[17507]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 13:04:28 kjcf05n02 diskmonitor[17507]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 13:04:28 kjcf05n02 diskmonitor[17507]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 13:04:28 kjcf05n02 diskmonitor[17507]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "6e1ebed6-9a16-11ef-8406-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 13:04:28 kjcf05n02 diskmonitor[17507]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 13:04:28 kjcf05n02 diskmonitor[17507]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 13:04:28 kjcf05n02 diskmonitor[17507]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "6e6b1d08-9a16-11ef-8406-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 13:04:28 kjcf05n02 diskmonitor[17507]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 13:04:28 kjcf05n02 diskmonitor[17507]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 13:04:32 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 3 13:04:32 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 13:04:32 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 3 13:04:34 kjcf05n02 chronyd[5108]: Selected source 16.110.135.123 Nov 3 13:04:35 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22452 (get_disk_device) Nov 3 13:04:35 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 13:04:35 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 13:04:35 kjcf05n02 ccp-client[22474]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 13:04:35 kjcf05n02 ccp-client[22474]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 13:04:35 kjcf05n02 ccp-client[22510]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 13:04:35 kjcf05n02 ccp-client[22474]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 13:04:35 kjcf05n02 ccp-client[22474]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 13:04:35 kjcf05n02 ccp-client[22510]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 13:04:35 kjcf05n02 ccp-client[22510]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 13:04:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730660676}"] Nov 3 13:04:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730660676, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:04:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:04:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730660676}"] Nov 3 13:04:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730660676, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:04:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:04:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730660676}"] Nov 3 13:04:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730660676, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:04:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:04:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730660676}"] Nov 3 13:04:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730660676, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:04:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:04:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730660676}"] Nov 3 13:04:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730660676, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:04:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:04:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730660676}"] Nov 3 13:04:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730660676, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:04:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:04:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730660676}"] Nov 3 13:04:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730660676, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:04:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:04:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730660676}"] Nov 3 13:04:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730660676, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:04:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:04:39 kjcf05n02 DRVFW[22777]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 13:04:39 kjcf05n02 ccp-client[22778]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 13:04:39 kjcf05n02 ccp-client[22778]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 13:04:39 kjcf05n02 ccp-client[22798]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 13:04:39 kjcf05n02 ccp-client[22778]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 13:04:39 kjcf05n02 ccp-client[22778]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 13:04:39 kjcf05n02 ccp-client[22798]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 13:04:39 kjcf05n02 ccp-client[22798]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 13:04:39 kjcf05n02 firmware-update-orc-server[5820]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 13:04:40 kjcf05n02 python3.9[5170]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 13:04:40 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 6e72341c-9a16-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 13:04:40 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '6e6b1d08-9a16-11ef-8406-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '6e6b1d08-9a16-11ef-8406-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}}} (logger.py:65) Nov 3 13:04:40 kjcf05n02 python3.9[3084]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:04:40 kjcf05n02 ras-resource-manager-agent[5864]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '6e6b1d08-9a16-11ef-8406-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 13:04:40 kjcf05n02 ras-resource-manager-agent[5864]: INFO Drive qualification complete responding: 6e6b1d08-9a16-11ef-8406-00093d0695e3 (admin_action.py:205) Nov 3 13:04:40 kjcf05n02 ras-resource-manager-agent[5864]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "6e6b1d08-9a16-11ef-8406-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 3 13:04:41 kjcf05n00 mcfcli[3673891]: %3|1730660681.059|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:04:44 kjcf05n02 ras-resource-manager-agent[5864]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "6e1ebed6-9a16-11ef-8406-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (service_main_handler.py:66) Nov 3 13:04:44 kjcf05n02 ras-resource-manager-agent[5864]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '6e1ebed6-9a16-11ef-8406-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 13:04:44 kjcf05n02 ras-resource-manager-agent[5864]: INFO Device qualification response has been acknowledged: 6e1ebed6-9a16-11ef-8406-00093d0695e3 (admin_action.py:151) Nov 3 13:04:44 kjcf05n02 ras-resource-manager-agent[5864]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "6e6b1d08-9a16-11ef-8406-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 13:04:44 kjcf05n02 ras-resource-manager-agent[5864]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '6e6b1d08-9a16-11ef-8406-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 13:04:44 kjcf05n02 ras-resource-manager-agent[5864]: INFO Device qualification response has been acknowledged: 6e6b1d08-9a16-11ef-8406-00093d0695e3 (admin_action.py:151) Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "6e1ebed6-9a16-11ef-8406-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: Dbus, handle_ingress_ras_signals, uuid: 6e1ebed6-9a16-11ef-8406-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "6e1ebed6-9a16-11ef-8406-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "6e6b1d08-9a16-11ef-8406-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: Dbus, handle_ingress_ras_signals, uuid: 6e6b1d08-9a16-11ef-8406-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "6e6b1d08-9a16-11ef-8406-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 13:04:47 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 13:04:48 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 13:04:49 kjcf05n02 diskmonitor[17507]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 13:04:53 kjcf05n02 diskmonitor[17507]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 13:04:53 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 13:04:53 kjcf05n02 diskmonitor[17507]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 13:04:53 kjcf05n02 diskmonitor[17507]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 13:04:53 kjcf05n02 diskmonitor[17507]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 13:04:53 kjcf05n02 diskmonitor[17507]: leaving test state: 1 next state: 2 Nov 3 13:04:53 kjcf05n02 diskmonitor[17507]: lock req: no timeout Nov 3 13:04:53 kjcf05n02 diskmonitor[17507]: leaving test state: 2 next state: 4 Nov 3 13:04:53 kjcf05n02 diskmonitor[17507]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 13:05:04 kjcf05n00 mcfcli[3673891]: %3|1730660704.348|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:05:10 kjcf05n00 python3.9[1275823]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 13:05:11 kjcf05n00 mcfcli[3673891]: %3|1730660711.266|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 13:05:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730660434', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 13:05:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730660434'} Nov 3 13:05:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:05:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730660434', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 13:05:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730660434'} Nov 3 13:05:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:05:37 kjcf05n02 chronyd[5108]: Selected source 172.16.2.1 Nov 3 13:05:41 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 13:05:41 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 13:05:41 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 13:05:41 kjcf05n00 mcfcli[3673891]: %3|1730660741.560|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 13:05:42 kjcf05n00 mcfcli[3673891]: %3|1730660742.742|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:05:56 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 13:05:56 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 13:05:56 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 13:05:57 kjcf05n02 dcs-collectord[5600]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 13:06:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730660766}"] Nov 3 13:06:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730660766, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:06:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:06:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:06:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:06:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:06:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:06:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:06:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:06:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:06:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:06:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:06:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:06:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:06:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:06:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.361813ms Nov 3 13:06:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:06:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.361813ms Nov 3 13:06:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:06:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:06:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:06:09 kjcf05n02 diskmonitor[17507]: lock acquired Nov 3 13:06:09 kjcf05n02 diskmonitor[17507]: leaving test state: 4 next state: 8 Nov 3 13:06:11 kjcf05n00 mcfcli[3673891]: %3|1730660771.560|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 13:06:11 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730660771}"] Nov 3 13:06:11 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730660771, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:06:11 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:06:11-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:06:11 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:06:11-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:06:11 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:06:11-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:06:11 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:06:11-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:06:11 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:06:11-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:06:11 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:06:11-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:06:11 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:06:11-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.373966ms Nov 3 13:06:11 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:06:11-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.373966ms Nov 3 13:06:11 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:06:11 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:06:11 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:06:18 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 13:06:21 kjcf05n00 mcfcli[3673891]: %3|1730660781.086|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:06:21 kjcf05n02 diskmonitor[17507]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 13:06:21 kjcf05n02 diskmonitor[17507]: leaving test state: 8 next state: 20 Nov 3 13:06:21 kjcf05n02 diskmonitor[17507]: leaving test state: 20 next state: 40 Nov 3 13:06:21 kjcf05n02 diskmonitor[17507]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 37b4fe00000 Nov 3 13:06:21 kjcf05n02 diskmonitor[17507]: leaving test state: 40 next state: 80 Nov 3 13:06:41 kjcf05n00 mcfcli[3673891]: %3|1730660801.560|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 13:06:48 kjcf05n02 diskmonitor[17507]: leaving test state: 80 next state: 100 Nov 3 13:06:48 kjcf05n02 diskmonitor[17507]: lock release: time: Sun Nov 3 13:06:42 2024 Nov 3 13:06:48 kjcf05n02 diskmonitor[17507]: leaving test state: 100 next state: 1 Nov 3 13:06:52 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 13:06:56 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 13:06:59 kjcf05n00 mcfcli[3673891]: %3|1730660819.202|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:07:01 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 3 13:07:11 kjcf05n00 mcfcli[3673891]: %3|1730660831.561|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:07:29 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 3 13:07:29 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 3 13:07:38 kjcf05n00 mcfcli[3673891]: %3|1730660858.835|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:07:41 kjcf05n00 mcfcli[3673891]: %3|1730660861.561|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:08:11 kjcf05n00 mcfcli[3673891]: %3|1730660891.562|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:08:12 kjcf05n03 nslcd[6943]: [e2a9e3] ldap_result() failed: Can't contact LDAP server Nov 3 13:08:18 kjcf05n00 mcfcli[3673891]: %3|1730660898.832|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:08:25 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 3 13:08:41 kjcf05n00 mcfcli[3673891]: %3|1730660921.562|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:08:54 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 3 13:08:54 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 3 13:08:58 kjcf05n00 mcfcli[3673891]: %3|1730660938.829|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:09:11 kjcf05n00 mcfcli[3673891]: %3|1730660951.562|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:09:38 kjcf05n00 mcfcli[3673891]: %3|1730660978.826|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:09:41 kjcf05n00 mcfcli[3673891]: %3|1730660981.563|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:09:43 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 13:09:43 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 13:09:43 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 13:09:55 kjcf05n00 zabbix-server[1278647]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 13:09:55 kjcf05n00 zabbix-server[1278647]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n02' from event '46255' Nov 3 13:09:55 kjcf05n00 zabbix-server[1278647]: Host created 'enclosure_USE26000024VS001' Nov 3 13:09:55 kjcf05n00 zabbix-server[1278647]: Running puppet on 'kjcf05n02' Nov 3 13:09:57 kjcf05n02 puppet-agent[35131]: Using configured environment 'production' Nov 3 13:09:57 kjcf05n02 puppet-agent[35131]: Retrieving pluginfacts Nov 3 13:09:57 kjcf05n02 puppet-agent[35131]: Retrieving plugin Nov 3 13:09:57 kjcf05n02 puppet-agent[35131]: Loading facts Nov 3 13:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 13:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 13:10:00 kjcf05n02 puppet-agent[35131]: Caching catalog for kjcf05n02 Nov 3 13:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 13:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 13:10:00 kjcf05n02 puppet-agent[35131]: Applying configuration version '1730660998' Nov 3 13:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 13:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 13:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 13:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 13:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 13:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 13:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 13:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 13:10:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 13:10:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:10:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 13:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 13:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 13:10:02 kjcf05n02 puppet-agent[35131]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 13:10:02 kjcf05n02 puppet-agent[35131]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 13:10:02 kjcf05n02 puppet-agent[35131]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 13:10:03 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 13:10:03 kjcf05n02 zabbix_agent2[5948]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 13:10:03 kjcf05n02 zabbix_agent2[3084]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:10:03 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 13:10:03 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 13:10:03 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 13:10:03 kjcf05n02 puppet-agent[35131]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: Press Ctrl+C to exit. Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: Plugin support version 1.0 Nov 3 13:10:03 kjcf05n02 zabbix_agent2[35534]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 13:10:05 kjcf05n02 puppet-agent[35131]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 13:10:05 kjcf05n02 puppet-agent[35131]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 13:10:05 kjcf05n02 puppet-agent[35131]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 13:10:05 kjcf05n02 puppet-agent[35131]: Applied catalog in 5.03 seconds Nov 3 13:10:05 kjcf05n00 zabbix-server[1278647]: puppet completed status:(0): '' Nov 3 13:10:05 kjcf05n00 zabbix-server[1278647]: Event '46255' acknowledged Nov 3 13:10:05 kjcf05n00 zabbix-server[1278647]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n02"}' Nov 3 13:10:10 kjcf05n00 python3.9[1278817]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 13:10:11 kjcf05n00 mcfcli[3673891]: %3|1730661011.563|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:10:14 kjcf05n00 mcfcli[3673891]: %3|1730661014.588|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:10:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730660434', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 13:10:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730660434'} Nov 3 13:10:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:10:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730660434', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 13:10:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730660434'} Nov 3 13:10:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:10:35 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 3 13:10:35 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 3 13:10:35 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 3 13:10:41 kjcf05n00 mcfcli[3673891]: %3|1730661041.564|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 13:10:52 kjcf05n00 mcfcli[3673891]: %3|1730661052.303|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:11:04 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 3 13:11:04 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 3 13:11:04 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 3 13:11:11 kjcf05n00 mcfcli[3673891]: %3|1730661071.564|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 13:11:16 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 13:11:16 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 13:11:16 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 13:11:31 kjcf05n00 mcfcli[3673891]: %3|1730661091.111|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:11:41 kjcf05n00 mcfcli[3673891]: %3|1730661101.566|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 13:12:08 kjcf05n00 mcfcli[3673891]: %3|1730661128.885|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:12:11 kjcf05n00 mcfcli[3673891]: %3|1730661131.566|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:12:41 kjcf05n00 mcfcli[3673891]: %3|1730661161.566|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 13:12:45 kjcf05n00 mcfcli[3673891]: %3|1730661165.210|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:13:11 kjcf05n00 mcfcli[3673891]: %3|1730661191.567|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:13:24 kjcf05n00 mcfcli[3673891]: %3|1730661204.218|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T13:13:27.252648394-06:00 level=info msg="Completed cleanup jobs" duration=26.21687ms Nov 3 13:13:41 kjcf05n00 mcfcli[3673891]: %3|1730661221.569|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:14:02 kjcf05n00 mcfcli[3673891]: %3|1730661242.352|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:14:06 kjcf05n02 root[42126]: failback_xyraid Nov 3 13:14:08 kjcf05n02 root[42269]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 13:14:09 kjcf05n02 root[42408]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 13:14:11 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 3 13:14:11 kjcf05n00 mcfcli[3673891]: %3|1730661251.569|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 13:14:15 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme4n1 Nov 3 13:14:15 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme25n1 Nov 3 13:14:15 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme18n1 Nov 3 13:14:15 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme17n1 Nov 3 13:14:15 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme19n1 Nov 3 13:14:15 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme2n1 Nov 3 13:14:15 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme23n1 Nov 3 13:14:15 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme9n1 Nov 3 13:14:15 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme24n1 Nov 3 13:14:15 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme8n1 Nov 3 13:14:15 kjcf05n03 dwd[5196]: Drive path is missing, purging: nvme3n1 Nov 3 13:14:17 kjcf05n02 dwd[5141]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 13:14:17 kjcf05n02 dwd[5141]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 13:14:17 kjcf05n02 dwd[5141]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 13:14:17 kjcf05n02 dwd[5141]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 13:14:17 kjcf05n02 dwd[5141]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 13:14:17 kjcf05n02 dwd[5141]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 13:14:17 kjcf05n02 dwd[5141]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 13:14:17 kjcf05n02 dwd[5141]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 13:14:17 kjcf05n02 dwd[5141]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 13:14:17 kjcf05n02 dwd[5141]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 13:14:17 kjcf05n02 dwd[5141]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 13:14:17 kjcf05n02 dwd[5141]: Starting NVME thread for nvme2n1 Nov 3 13:14:17 kjcf05n02 dwd[5141]: Starting NVME thread for nvme18n1 Nov 3 13:14:17 kjcf05n02 dwd[5141]: Starting NVME thread for nvme19n1 Nov 3 13:14:18 kjcf05n02 dwd[5141]: Starting NVME thread for nvme9n1 Nov 3 13:14:18 kjcf05n02 dwd[5141]: Starting NVME thread for nvme3n1 Nov 3 13:14:18 kjcf05n02 systemd-udevd[45126]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45125]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45128]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45130]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45125]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45126]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45128]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45130]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45125]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45126]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45128]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45130]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45125]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45126]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45128]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45130]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45126]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45125]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45128]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45130]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45125]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45126]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45130]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45128]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45126]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45125]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45128]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45130]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45156]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45125]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45126]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45159]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45128]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45164]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45161]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45130]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45156]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45125]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45164]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45159]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45125]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45161]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45161]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45125]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45161]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45161]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45164]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45159]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45130]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45161]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45164]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45125]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45161]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45125]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45161]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45161]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45125]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45161]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45125]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45161]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45161]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45125]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45161]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 systemd-udevd[45161]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:14:18 kjcf05n02 dwd[5141]: Starting NVME thread for nvme24n1 Nov 3 13:14:18 kjcf05n02 dwd[5141]: Starting NVME thread for nvme4n1 Nov 3 13:14:18 kjcf05n02 dwd[5141]: Starting NVME thread for nvme23n1 Nov 3 13:14:18 kjcf05n02 dwd[5141]: Starting NVME thread for nvme17n1 Nov 3 13:14:18 kjcf05n02 dwd[5141]: Starting NVME thread for nvme25n1 Nov 3 13:14:19 kjcf05n02 dwd[5141]: Starting NVME thread for nvme8n1 Nov 3 13:14:20 kjcf05n02 dcs-bulk-data-sender[6126]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 139}' Nov 3 13:14:20 kjcf05n02 nslcd[6893]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 13:14:26 kjcf05n02 diskmonitor[17507]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 13:14:32 kjcf05n02 diskmonitor[17507]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 13:14:32 kjcf05n02 diskmonitor[17507]: Scan for ReadErrorMax change for md65 Nov 3 13:14:32 kjcf05n02 diskmonitor[17507]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 13:14:32 kjcf05n02 diskmonitor[17507]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 13:14:32 kjcf05n02 diskmonitor[17507]: read_saved_file: md65 no saved speed Nov 3 13:14:32 kjcf05n02 diskmonitor[17507]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 13:14:32 kjcf05n02 diskmonitor[17507]: Set sync_speed_min (10000) for md65 Nov 3 13:14:32 kjcf05n02 diskmonitor[17507]: Set sync_speed_max (200000) for md65 Nov 3 13:14:32 kjcf05n02 diskmonitor[17507]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 13:14:39 kjcf05n03 diskmonitor[17569]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 13:14:39 kjcf05n03 diskmonitor[17569]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 13:14:39 kjcf05n00 mcfcli[3673891]: %3|1730661279.516|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:14:41 kjcf05n00 mcfcli[3673891]: %3|1730661281.569|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:14:59 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47528 (bash) Nov 3 13:14:59 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 13:14:59 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 13:15:10 kjcf05n00 python3.9[1281819]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 13:15:11 kjcf05n00 mcfcli[3673891]: %3|1730661311.569|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 13:15:17 kjcf05n00 mcfcli[3673891]: %3|1730661317.576|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:15:20 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 13:15:20 kjcf05n02 systemd-tmpfiles[48514]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 13:15:20 kjcf05n02 systemd-tmpfiles[48514]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 13:15:20 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 13:15:20 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 13:15:41 kjcf05n00 mcfcli[3673891]: %3|1730661341.570|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 13:15:54 kjcf05n00 mcfcli[3673891]: %3|1730661354.565|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:16:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730661366}"] Nov 3 13:16:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730661366, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:16:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.287785ms Nov 3 13:16:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.287785ms Nov 3 13:16:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:16:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:16:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:16:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730661366}"] Nov 3 13:16:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730661366, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:16:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.965501ms Nov 3 13:16:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.965501ms Nov 3 13:16:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:16:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:16:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:16:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730661366}"] Nov 3 13:16:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730661366, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:16:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.353738ms Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.353738ms Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:16:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:16:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:16:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730661366}"] Nov 3 13:16:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730661366, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:16:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.785474ms Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.785474ms Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:16:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:16:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:16:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730661366}"] Nov 3 13:16:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730661366, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:16:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.85801ms Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.85801ms Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:16:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:16:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:16:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730661366}"] Nov 3 13:16:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730661366, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:16:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.542852ms Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.542852ms Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:16:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:16:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:16:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730661366}"] Nov 3 13:16:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730661366, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:16:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.137653ms Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.137653ms Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:16:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:16:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:16:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730661366}"] Nov 3 13:16:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730661366, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:16:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.695996ms Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.695996ms Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:16:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:16:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:16:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730661366}"] Nov 3 13:16:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730661366, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:16:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.482327ms Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.482327ms Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:16:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:16:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:16:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730661366}"] Nov 3 13:16:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730661366, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:16:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.148935ms Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.148935ms Nov 3 13:16:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:16:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:16:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:16:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730661366}"] Nov 3 13:16:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730661366, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:16:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:16:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:16:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:16:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:16:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:16:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:16:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.720472ms Nov 3 13:16:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:16:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.720472ms Nov 3 13:16:08 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:16:08 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:16:08 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:16:11 kjcf05n00 mcfcli[3673891]: %3|1730661371.570|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 13:16:34 kjcf05n00 mcfcli[3673891]: %3|1730661394.407|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:16:41 kjcf05n00 mcfcli[3673891]: %3|1730661401.572|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 13:17:11 kjcf05n00 mcfcli[3673891]: %3|1730661431.572|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:17:12 kjcf05n00 mcfcli[3673891]: %3|1730661432.824|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:17:41 kjcf05n00 mcfcli[3673891]: %3|1730661461.572|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 13:17:51 kjcf05n00 mcfcli[3673891]: %3|1730661471.458|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:18:12 kjcf05n00 mcfcli[3673891]: %3|1730661492.072|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 13:18:30 kjcf05n00 mcfcli[3673891]: %3|1730661510.248|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:18:42 kjcf05n00 mcfcli[3673891]: %3|1730661522.072|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 13:19:10 kjcf05n00 mcfcli[3673891]: %3|1730661550.245|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:19:12 kjcf05n00 mcfcli[3673891]: %3|1730661552.073|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 13:19:33 kjcf05n02 dwd[5141]: nvme4n1 passed periodic SMART status check Nov 3 13:19:35 kjcf05n02 dwd[5141]: nvme18n1 passed periodic SMART status check Nov 3 13:19:38 kjcf05n02 dwd[5141]: nvme17n1 passed periodic SMART status check Nov 3 13:19:38 kjcf05n02 dwd[5141]: nvme9n1 passed periodic SMART status check Nov 3 13:19:38 kjcf05n02 dwd[5141]: nvme2n1 passed periodic SMART status check Nov 3 13:19:38 kjcf05n02 dwd[5141]: nvme24n1 passed periodic SMART status check Nov 3 13:19:38 kjcf05n02 dwd[5141]: nvme25n1 passed periodic SMART status check Nov 3 13:19:39 kjcf05n02 dwd[5141]: nvme3n1 passed periodic SMART status check Nov 3 13:19:39 kjcf05n02 dwd[5141]: nvme8n1 passed periodic SMART status check Nov 3 13:19:39 kjcf05n02 dwd[5141]: nvme23n1 passed periodic SMART status check Nov 3 13:19:40 kjcf05n02 dwd[5141]: nvme19n1 passed periodic SMART status check Nov 3 13:19:42 kjcf05n00 mcfcli[3673891]: %3|1730661582.073|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 13:19:49 kjcf05n00 mcfcli[3673891]: %3|1730661589.706|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:19:54 kjcf05n00 zabbix-server[1284681]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 13:19:54 kjcf05n00 zabbix-server[1284681]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46257' Nov 3 13:19:54 kjcf05n00 zabbix-server[1284681]: Filesystem 'kjcf05' has been mounted Nov 3 13:19:55 kjcf05n00 zabbix-server[1284681]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 13:19:55 kjcf05n00 zabbix-server[1284681]: Running puppet on 'None' Nov 3 13:19:57 kjcf05n02 puppet-agent[56834]: Using configured environment 'production' Nov 3 13:19:57 kjcf05n02 puppet-agent[56834]: Retrieving pluginfacts Nov 3 13:19:57 kjcf05n02 puppet-agent[56834]: Retrieving plugin Nov 3 13:19:57 kjcf05n02 puppet-agent[56834]: Loading facts Nov 3 13:19:57 kjcf05n07 puppet-agent[3201074]: Using configured environment 'production' Nov 3 13:19:57 kjcf05n07 puppet-agent[3201074]: Retrieving pluginfacts Nov 3 13:19:57 kjcf05n07 puppet-agent[3201074]: Retrieving plugin Nov 3 13:19:57 kjcf05n03 puppet-agent[167494]: Using configured environment 'production' Nov 3 13:19:57 kjcf05n03 puppet-agent[167494]: Retrieving pluginfacts Nov 3 13:19:57 kjcf05n03 puppet-agent[167494]: Retrieving plugin Nov 3 13:19:57 kjcf05n03 puppet-agent[167494]: Loading facts Nov 3 13:19:57 kjcf05n06 puppet-agent[3204408]: Using configured environment 'production' Nov 3 13:19:57 kjcf05n06 puppet-agent[3204408]: Retrieving pluginfacts Nov 3 13:19:57 kjcf05n06 puppet-agent[3204408]: Retrieving plugin Nov 3 13:19:57 kjcf05n06 puppet-agent[3204408]: Loading facts Nov 3 13:19:57 kjcf05n05 puppet-agent[3364015]: Using configured environment 'production' Nov 3 13:19:57 kjcf05n05 puppet-agent[3364015]: Retrieving pluginfacts Nov 3 13:19:57 kjcf05n05 puppet-agent[3364015]: Retrieving plugin Nov 3 13:19:57 kjcf05n05 puppet-agent[3364015]: Loading facts Nov 3 13:19:57 kjcf05n04 puppet-agent[3206183]: Using configured environment 'production' Nov 3 13:19:57 kjcf05n04 puppet-agent[3206183]: Retrieving pluginfacts Nov 3 13:19:57 kjcf05n04 puppet-agent[3206183]: Retrieving plugin Nov 3 13:19:57 kjcf05n04 puppet-agent[3206183]: Loading facts Nov 3 13:19:57 kjcf05n07 puppet-agent[3201074]: Loading facts Nov 3 13:19:57 kjcf05n01 puppet-agent[3111044]: Using configured environment 'production' Nov 3 13:19:57 kjcf05n01 puppet-agent[3111044]: Retrieving pluginfacts Nov 3 13:19:57 kjcf05n01 puppet-agent[3111044]: Retrieving plugin Nov 3 13:19:57 kjcf05n01 puppet-agent[3111044]: Loading facts Nov 3 13:19:57 kjcf05n00 puppet-agent[1284747]: Using configured environment 'production' Nov 3 13:19:57 kjcf05n00 puppet-agent[1284747]: Retrieving pluginfacts Nov 3 13:19:57 kjcf05n00 puppet-agent[1284747]: Retrieving plugin Nov 3 13:19:58 kjcf05n00 puppet-agent[1284747]: Loading facts Nov 3 13:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 13:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 13:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 13:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 13:20:00 kjcf05n07 puppet-agent[3201074]: Caching catalog for kjcf05n07 Nov 3 13:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 13:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 13:20:00 kjcf05n02 puppet-agent[56834]: Caching catalog for kjcf05n02 Nov 3 13:20:00 kjcf05n02 puppet-agent[56834]: Applying configuration version '1730661598' Nov 3 13:20:00 kjcf05n03 puppet-agent[167494]: Caching catalog for kjcf05n03 Nov 3 13:20:00 kjcf05n03 puppet-agent[167494]: Applying configuration version '1730661598' Nov 3 13:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 13:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 13:20:00 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 13:20:00 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 13:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 13:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 13:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 13:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 13:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 13:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 13:20:00 kjcf05n07 puppet-agent[3201074]: Applying configuration version '1730661599' Nov 3 13:20:00 kjcf05n06 puppet-agent[3204408]: Caching catalog for kjcf05n06 Nov 3 13:20:00 kjcf05n06 puppet-agent[3204408]: Applying configuration version '1730661599' Nov 3 13:20:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 13:20:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:20:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 13:20:01 kjcf05n01 puppet-agent[3111044]: Caching catalog for kjcf05n01 Nov 3 13:20:02 kjcf05n01 puppet-agent[3111044]: Applying configuration version '1730661599' Nov 3 13:20:02 kjcf05n03 puppet-agent[167494]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 13:20:02 kjcf05n03 puppet-agent[167494]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 13:20:02 kjcf05n03 puppet-agent[167494]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 13:20:01 kjcf05n00 puppet-agent[1284747]: Caching catalog for kjcf05n00 Nov 3 13:20:01 kjcf05n00 puppet-agent[1284747]: Applying configuration version '1730661599' Nov 3 13:20:02 kjcf05n02 puppet-agent[56834]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 13:20:02 kjcf05n02 puppet-agent[56834]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 13:20:02 kjcf05n02 puppet-agent[56834]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 13:20:02 kjcf05n05 puppet-agent[3364015]: Caching catalog for kjcf05n05 Nov 3 13:20:02 kjcf05n05 puppet-agent[3364015]: Applying configuration version '1730661600' Nov 3 13:20:02 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 13:20:02 kjcf05n06 puppet-agent[3204408]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 13:20:02 kjcf05n06 puppet-agent[3204408]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 13:20:02 kjcf05n06 puppet-agent[3204408]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 13:20:02 kjcf05n07 puppet-agent[3201074]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 13:20:02 kjcf05n07 puppet-agent[3201074]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 13:20:02 kjcf05n07 puppet-agent[3201074]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 13:20:02 kjcf05n03 zabbix_agent2[112285]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 13:20:02 kjcf05n03 zabbix_agent2[3189]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:20:02 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 13:20:02 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 13:20:02 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 13:20:02 kjcf05n03 puppet-agent[167494]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: Press Ctrl+C to exit. Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: Plugin support version 1.0 Nov 3 13:20:02 kjcf05n03 zabbix_agent2[168204]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 13:20:02 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 13:20:02 kjcf05n02 zabbix_agent2[35534]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 13:20:02 kjcf05n02 zabbix_agent2[3084]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:20:02 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 13:20:02 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 13:20:02 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 13:20:02 kjcf05n02 puppet-agent[56834]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: Press Ctrl+C to exit. Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: Plugin support version 1.0 Nov 3 13:20:02 kjcf05n02 zabbix_agent2[57305]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 13:20:03 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3148740]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 13:20:03 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 13:20:03 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 13:20:03 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 13:20:03 kjcf05n07 puppet-agent[3201074]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: Press Ctrl+C to exit. Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: Plugin support version 1.0 Nov 3 13:20:03 kjcf05n07 zabbix_agent2[3201493]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 13:20:03 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3151977]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 13:20:03 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 13:20:03 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 13:20:03 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 13:20:03 kjcf05n06 puppet-agent[3204408]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: Press Ctrl+C to exit. Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: Plugin support version 1.0 Nov 3 13:20:03 kjcf05n06 zabbix_agent2[3205380]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 13:20:04 kjcf05n04 puppet-agent[3206183]: Caching catalog for kjcf05n04 Nov 3 13:20:04 kjcf05n04 puppet-agent[3206183]: Applying configuration version '1730661602' Nov 3 13:20:04 kjcf05n05 puppet-agent[3364015]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 13:20:04 kjcf05n05 puppet-agent[3364015]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 13:20:04 kjcf05n05 puppet-agent[3364015]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 13:20:04 kjcf05n01 puppet-agent[3111044]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 13:20:04 kjcf05n01 puppet-agent[3111044]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-12:56:11]/mode) mode changed '0755' to '0750' Nov 3 13:20:04 kjcf05n01 puppet-agent[3111044]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-12:56:11/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 13:20:04 kjcf05n01 puppet-agent[3111044]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-12:56:11/vmcore]/mode) mode changed '0600' to '0640' Nov 3 13:20:04 kjcf05n01 puppet-agent[3111044]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-12:56:11/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 13:20:04 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 13:20:04 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 13:20:04 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 13:20:04 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3305783]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 13:20:04 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 13:20:04 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 13:20:04 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 13:20:04 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 13:20:04 kjcf05n05 puppet-agent[3364015]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: Press Ctrl+C to exit. Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: Plugin support version 1.0 Nov 3 13:20:04 kjcf05n05 zabbix_agent2[3364554]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 13:20:05 kjcf05n02 puppet-agent[56834]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 13:20:05 kjcf05n02 puppet-agent[56834]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 13:20:05 kjcf05n02 puppet-agent[56834]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 13:20:05 kjcf05n03 puppet-agent[167494]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 13:20:05 kjcf05n03 puppet-agent[167494]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 13:20:05 kjcf05n03 puppet-agent[167494]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 13:20:05 kjcf05n07 puppet-agent[3201074]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 13:20:05 kjcf05n07 puppet-agent[3201074]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 13:20:05 kjcf05n07 puppet-agent[3201074]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 13:20:04 kjcf05n00 puppet-agent[1284747]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 13:20:05 kjcf05n06 puppet-agent[3204408]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 13:20:05 kjcf05n06 puppet-agent[3204408]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 13:20:05 kjcf05n06 puppet-agent[3204408]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 13:20:05 kjcf05n06 puppet-agent[3204408]: Applied catalog in 4.77 seconds Nov 3 13:20:05 kjcf05n02 puppet-agent[56834]: Applied catalog in 5.01 seconds Nov 3 13:20:05 kjcf05n07 puppet-agent[3201074]: Applied catalog in 4.82 seconds Nov 3 13:20:05 kjcf05n03 puppet-agent[167494]: Applied catalog in 5.15 seconds Nov 3 13:20:05 kjcf05n01 puppet-agent[3111044]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 13:20:05 kjcf05n01 puppet-agent[3111044]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 13:20:05 kjcf05n01 puppet-agent[3111044]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 13:20:06 kjcf05n04 puppet-agent[3206183]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 13:20:06 kjcf05n04 puppet-agent[3206183]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 13:20:06 kjcf05n04 puppet-agent[3206183]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 13:20:05 kjcf05n00 puppet-agent[1284747]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 13:20:05 kjcf05n00 puppet-agent[1284747]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 13:20:05 kjcf05n00 puppet-agent[1284747]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 13:20:06 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3099309]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 13:20:06 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 13:20:06 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 13:20:06 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 13:20:06 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 13:20:06 kjcf05n01 puppet-agent[3111044]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: Press Ctrl+C to exit. Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: Plugin support version 1.0 Nov 3 13:20:06 kjcf05n01 zabbix_agent2[3111452]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 13:20:06 kjcf05n05 puppet-agent[3364015]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 13:20:06 kjcf05n05 puppet-agent[3364015]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 13:20:06 kjcf05n05 puppet-agent[3364015]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 13:20:06 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3148363]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 13:20:06 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 13:20:06 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 13:20:06 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 13:20:06 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 13:20:06 kjcf05n04 puppet-agent[3206183]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: Press Ctrl+C to exit. Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: Plugin support version 1.0 Nov 3 13:20:06 kjcf05n04 zabbix_agent2[3206693]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 13:20:06 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1266314]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 13:20:06 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 13:20:06 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 13:20:06 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 13:20:06 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 13:20:06 kjcf05n00 puppet-agent[1284747]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: Press Ctrl+C to exit. Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: Plugin support version 1.0 Nov 3 13:20:06 kjcf05n00 zabbix_agent2[1285388]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 13:20:07 kjcf05n05 puppet-agent[3364015]: Applied catalog in 4.76 seconds Nov 3 13:20:06 kjcf05n00 zabbix-server[1285417]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 13:20:07 kjcf05n00 zabbix-server[1285420]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 13:20:07 kjcf05n00 zabbix-server[1285429]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 13:20:08 kjcf05n00 zabbix-server[1285433]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 13:20:08 kjcf05n04 puppet-agent[3206183]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 13:20:08 kjcf05n04 puppet-agent[3206183]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 13:20:08 kjcf05n04 puppet-agent[3206183]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 13:20:08 kjcf05n04 puppet-agent[3206183]: Applied catalog in 4.75 seconds Nov 3 13:20:08 kjcf05n01 puppet-agent[3111044]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_130331.log]/mode) mode changed '0644' to '0640' Nov 3 13:20:08 kjcf05n01 puppet-agent[3111044]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_131459.log]/mode) mode changed '0644' to '0640' Nov 3 13:20:08 kjcf05n01 puppet-agent[3111044]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_131459]/mode) mode changed '0755' to '0750' Nov 3 13:20:08 kjcf05n01 puppet-agent[3111044]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_131459/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 13:20:08 kjcf05n00 puppet-agent[1284747]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 13:20:09 kjcf05n01 puppet-agent[3111044]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_130331.log]/mode) mode changed '0644' to '0640' Nov 3 13:20:09 kjcf05n01 puppet-agent[3111044]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_131459.log]/mode) mode changed '0644' to '0640' Nov 3 13:20:09 kjcf05n01 puppet-agent[3111044]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 13:20:09 kjcf05n01 puppet-agent[3111044]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 13:20:09 kjcf05n01 puppet-agent[3111044]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 13:20:09 kjcf05n00 puppet-agent[1284747]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 13:20:09 kjcf05n00 puppet-agent[1284747]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 13:20:09 kjcf05n00 puppet-agent[1284747]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 13:20:10 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 13:20:10 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 13:20:10 kjcf05n00 puppet-agent[1284747]: Applied catalog in 8.44 seconds Nov 3 13:20:10 kjcf05n01 puppet-agent[3111044]: Applied catalog in 8.83 seconds Nov 3 13:20:10 kjcf05n00 zabbix-server[1284681]: puppet completed status:(0): '' Nov 3 13:20:10 kjcf05n00 zabbix-server[1284681]: Event '46257' acknowledged Nov 3 13:20:10 kjcf05n00 zabbix-server[1284681]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 3 13:20:10 kjcf05n00 python3.9[1285295]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 13:20:12 kjcf05n00 mcfcli[3673891]: %3|1730661612.074|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:20:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730661623', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 13:20:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730661623'} Nov 3 13:20:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:20:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730661623', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 13:20:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730661623'} Nov 3 13:20:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:20:29 kjcf05n00 mcfcli[3673891]: %3|1730661629.491|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:20:42 kjcf05n00 mcfcli[3673891]: %3|1730661642.074|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 13:20:51 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 13:21:09 kjcf05n00 mcfcli[3673891]: %3|1730661669.488|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:21:12 kjcf05n00 mcfcli[3673891]: %3|1730661672.075|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:21:42 kjcf05n00 mcfcli[3673891]: %3|1730661702.075|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 13:21:45 kjcf05n00 mcfcli[3673891]: %3|1730661705.596|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:22:12 kjcf05n00 mcfcli[3673891]: %3|1730661732.075|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 13:22:24 kjcf05n00 mcfcli[3673891]: %3|1730661744.361|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:22:42 kjcf05n00 mcfcli[3673891]: %3|1730661762.077|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 13:23:04 kjcf05n00 mcfcli[3673891]: %3|1730661784.140|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:23:12 kjcf05n00 mcfcli[3673891]: %3|1730661792.274|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 13:23:15 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 13:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T19:23:15.868322Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 13:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T19:23:15.868389Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.091ms Nov 3 13:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T13:23:27.253042925-06:00 level=info msg="Completed cleanup jobs" duration=26.13691ms Nov 3 13:23:42 kjcf05n00 mcfcli[3673891]: %3|1730661822.275|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 13:23:43 kjcf05n00 mcfcli[3673891]: %3|1730661823.264|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:24:10 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 3 13:24:10 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 10 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007905 sec, idle for 1 hour(s)] Nov 3 13:24:12 kjcf05n00 mcfcli[3673891]: %3|1730661852.275|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 13:24:22 kjcf05n00 mcfcli[3673891]: %3|1730661862.813|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:24:42 kjcf05n00 mcfcli[3673891]: %3|1730661882.275|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:25:01 kjcf05n00 mcfcli[3673891]: %3|1730661901.231|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:25:03 kjcf05n03 nslcd[6943]: [45e146] ldap_result() failed: Can't contact LDAP server Nov 3 13:25:10 kjcf05n00 python3.9[1288242]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 13:25:12 kjcf05n00 mcfcli[3673891]: %3|1730661912.579|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 13:25:40 kjcf05n02 LCNmon[17944]: 10.16.100.53 is unreachable via ib0 Nov 3 13:25:40 kjcf05n02 LCNmon[17944]: 10.16.100.59 is unreachable via ib0 Nov 3 13:25:40 kjcf05n00 mcfcli[3673891]: %3|1730661940.512|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:25:42 kjcf05n00 mcfcli[3673891]: %3|1730661942.579|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 13:25:44 kjcf05n02 LCNmon[17944]: 10.16.100.53 is unreachable via ib1 Nov 3 13:25:44 kjcf05n02 LCNmon[17944]: 10.16.100.59 is unreachable via ib1 Nov 3 13:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 13:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 13:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 13:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 13:25:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 13:25:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 13:26:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 13:26:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 13:26:07 kjcf05n00 zabbix_server[15730]: Zabbix agent item "xrtx.enclosure.discovery" on host "kjcf05n03" failed: first network error, wait for 15 seconds Nov 3 13:26:10 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 13:26:10 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 13:26:10 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 13:26:10 kjcf05n02 fstonithd.py[15105]: My partner 172.16.2.6 is kdumping. Forcing HA into GATHER state. Nov 3 13:26:11 kjcf05n02 root[67840]: is_enc_ipmi_off starts Nov 3 13:26:11 kjcf05n02 root[67842]: is_viking_off starts Nov 3 13:26:11 kjcf05n02 root[67860]: I am not master; I will get master Nov 3 13:26:11 kjcf05n02 root[67865]: I am in slot 0; partner is in slot 1 Nov 3 13:26:11 kjcf05n02 root[67864]: is_lan_ipmi_off leaves Nov 3 13:26:11 kjcf05n02 root[67867]: is_lan_ipmi_sec_off leaves Nov 3 13:26:11 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='39', error='Connection reset by peer (104)' Nov 3 13:26:11 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='39', client='AF_INET(172.16.2.6:45607)', local='AF_INET(0.0.0.0:601)' Nov 3 13:26:12 kjcf05n00 mcfcli[3673891]: %3|1730661972.579|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:26:16 kjcf05n02 root[67974]: I am now master Nov 3 13:26:18 kjcf05n02 root[68029]: is_viking_off leaves Nov 3 13:26:18 kjcf05n02 root[68034]: kjcf05n03 not already off look at kdump Nov 3 13:26:18 kjcf05n02 root[68035]: is_kdump_off starts Nov 3 13:26:18 kjcf05n02 fence_kdump[68036]: waiting for message from '172.16.2.6' Nov 3 13:26:18 kjcf05n02 fence_kdump[68036]: received valid message from '172.16.2.6' Nov 3 13:26:18 kjcf05n02 root[68037]: is_kdump_off detected kdump on kjcf05n03 Nov 3 13:26:18 kjcf05n02 root[68038]: kjcf05n03 is kdumping Nov 3 13:26:18 kjcf05n02 root[68126]: is_enc_ipmi_off starts Nov 3 13:26:18 kjcf05n02 root[68127]: is_viking_off starts Nov 3 13:26:18 kjcf05n00 mcfcli[3673891]: %3|1730661978.562|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:26:19 kjcf05n02 root[68143]: is_lan_ipmi_off leaves Nov 3 13:26:19 kjcf05n02 root[68145]: is_lan_ipmi_sec_off leaves Nov 3 13:26:19 kjcf05n02 root[68149]: I am in slot 0; partner is in slot 1 Nov 3 13:26:19 kjcf05n02 root[68151]: I am master Nov 3 13:26:22 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.cpu.util[,iowait]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 13:26:23 kjcf05n00 zabbix_server[15718]: Zabbix agent item "vfs.fs.size[/etc/ganesha,total]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 13:26:25 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 13:26:25 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 13:26:36 kjcf05n02 root[68540]: is_viking_off leaves Nov 3 13:26:36 kjcf05n02 root[68543]: kjcf05n03 not already off look at kdump Nov 3 13:26:36 kjcf05n02 root[68545]: is_kdump_off starts Nov 3 13:26:36 kjcf05n02 fence_kdump[68546]: waiting for message from '172.16.2.6' Nov 3 13:26:36 kjcf05n02 fence_kdump[68546]: received valid message from '172.16.2.6' Nov 3 13:26:36 kjcf05n02 root[68609]: is_kdump_off detected kdump on kjcf05n03 Nov 3 13:26:36 kjcf05n02 root[68610]: kjcf05n03 is kdumping Nov 3 13:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 13:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 13:26:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 13:26:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 13:26:38 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.array.discovery" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 13:26:40 kjcf05n02 LCNmon[17944]: 10.16.100.53 is unreachable via ib0 Nov 3 13:26:40 kjcf05n02 LCNmon[17944]: 10.16.100.59 is unreachable via ib0 Nov 3 13:26:41 kjcf05n02 dwd[5141]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 13:26:41 kjcf05n02 dwd[5141]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 13:26:41 kjcf05n02 dwd[5141]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 13:26:41 kjcf05n02 dwd[5141]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 13:26:41 kjcf05n02 dwd[5141]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 13:26:41 kjcf05n02 dwd[5141]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 13:26:41 kjcf05n02 dwd[5141]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 13:26:41 kjcf05n02 dwd[5141]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 13:26:41 kjcf05n02 dwd[5141]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 13:26:41 kjcf05n02 dwd[5141]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 13:26:41 kjcf05n02 dwd[5141]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 13:26:41 kjcf05n02 dwd[5141]: Starting NVME thread for nvme16n1 Nov 3 13:26:41 kjcf05n02 systemd-udevd[70902]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70904]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70905]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70907]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70902]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70904]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70905]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70907]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70902]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70904]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70905]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70907]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70902]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70904]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70907]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70905]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70902]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70904]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70907]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70905]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70902]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70904]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70905]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70907]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70902]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70904]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70905]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70907]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70902]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70904]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70937]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70905]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70902]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70904]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70907]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70938]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70937]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70904]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70905]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70938]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70937]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70904]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70905]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70938]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70937]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70902]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70938]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70902]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70938]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70902]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70938]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70902]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70938]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70902]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70902]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70938]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70902]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70938]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70902]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70938]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70902]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70902]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70902]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 systemd-udevd[70902]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:26:41 kjcf05n02 dwd[5141]: Starting NVME thread for nvme22n1 Nov 3 13:26:41 kjcf05n02 dwd[5141]: Starting NVME thread for nvme15n1 Nov 3 13:26:41 kjcf05n02 dwd[5141]: Starting NVME thread for nvme6n1 Nov 3 13:26:42 kjcf05n02 dwd[5141]: Starting NVME thread for nvme11n1 Nov 3 13:26:42 kjcf05n02 dwd[5141]: Starting NVME thread for nvme7n1 Nov 3 13:26:42 kjcf05n02 dwd[5141]: Starting NVME thread for nvme10n1 Nov 3 13:26:42 kjcf05n02 dwd[5141]: Starting NVME thread for nvme20n1 Nov 3 13:26:42 kjcf05n02 dwd[5141]: Starting NVME thread for nvme21n1 Nov 3 13:26:42 kjcf05n02 dwd[5141]: Starting NVME thread for nvme5n1 Nov 3 13:26:42 kjcf05n02 dwd[5141]: Starting NVME thread for nvme12n1 Nov 3 13:26:42 kjcf05n00 mcfcli[3673891]: %3|1730662002.579|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 13:26:43 kjcf05n02 diskmonitor[17507]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 13:26:44 kjcf05n02 LCNmon[17944]: 10.16.100.53 is unreachable via ib1 Nov 3 13:26:44 kjcf05n02 LCNmon[17944]: 10.16.100.59 is unreachable via ib1 Nov 3 13:26:50 kjcf05n02 diskmonitor[17507]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 13:26:50 kjcf05n02 diskmonitor[17507]: Scan for ReadErrorMax change for md66 Nov 3 13:26:50 kjcf05n02 diskmonitor[17507]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 13:26:50 kjcf05n02 diskmonitor[17507]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 13:26:50 kjcf05n02 diskmonitor[17507]: read_saved_file: md66 no saved speed Nov 3 13:26:50 kjcf05n02 diskmonitor[17507]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 13:26:50 kjcf05n02 diskmonitor[17507]: Set sync_speed_min (10000) for md66 Nov 3 13:26:50 kjcf05n02 diskmonitor[17507]: Set sync_speed_max (200000) for md66 Nov 3 13:26:50 kjcf05n02 diskmonitor[17507]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 13:26:53 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n03": interface unavailable Nov 3 13:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 13:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 13:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 13:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 13:26:58 kjcf05n00 mcfcli[3673891]: %3|1730662018.559|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 13:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 13:27:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 13:27:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 13:27:12 kjcf05n00 mcfcli[3673891]: %3|1730662032.579|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 13:27:34 kjcf05n00 mcfcli[3673891]: %3|1730662054.910|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 13:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 13:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 13:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 13:27:40 kjcf05n02 LCNmon[17944]: 10.16.100.53 is unreachable via ib0 Nov 3 13:27:40 kjcf05n02 LCNmon[17944]: 10.16.100.59 is unreachable via ib0 Nov 3 13:27:42 kjcf05n00 mcfcli[3673891]: %3|1730662062.580|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 13:27:44 kjcf05n02 LCNmon[17944]: 10.16.100.53 is unreachable via ib1 Nov 3 13:27:44 kjcf05n02 LCNmon[17944]: 10.16.100.59 is unreachable via ib1 Nov 3 13:27:44 kjcf05n02 nslcd[6893]: ldap_result() failed: Can't contact LDAP server Nov 3 13:27:44 kjcf05n02 nslcd[6893]: (re)loading /etc/nsswitch.conf Nov 3 13:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 13:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 13:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 13:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 13:28:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 13:28:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 13:28:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 13:28:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 13:28:12 kjcf05n00 mcfcli[3673891]: %3|1730662092.581|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:28:14 kjcf05n00 mcfcli[3673891]: %3|1730662094.018|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:28:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730662117}"] Nov 3 13:28:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730662117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:28:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.40312ms Nov 3 13:28:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.40312ms Nov 3 13:28:37 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:28:37 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:28:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:28:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730662117}"] Nov 3 13:28:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730662117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:28:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.947898ms Nov 3 13:28:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.947898ms Nov 3 13:28:37 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:28:37 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:28:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:28:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730662117}"] Nov 3 13:28:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730662117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:28:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.280531ms Nov 3 13:28:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.280531ms Nov 3 13:28:37 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:28:37 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:28:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:28:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730662117}"] Nov 3 13:28:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730662117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:28:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 13:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 13:28:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.768974ms Nov 3 13:28:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.768974ms Nov 3 13:28:37 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:28:37 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:28:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:28:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730662117}"] Nov 3 13:28:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730662117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:28:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.577635ms Nov 3 13:28:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.577635ms Nov 3 13:28:37 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:28:37 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:28:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:28:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730662117}"] Nov 3 13:28:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730662117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:28:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 13:28:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 13:28:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.184932ms Nov 3 13:28:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.184932ms Nov 3 13:28:37 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:28:37 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:28:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:28:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730662117}"] Nov 3 13:28:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730662117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:28:38 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:38-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:38 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:38-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:38 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:38-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:38 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:38-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:38 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:38-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:38 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:38-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:38 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:38-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.705914ms Nov 3 13:28:38 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:38-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.705914ms Nov 3 13:28:38 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:28:38 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:28:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:28:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730662117}"] Nov 3 13:28:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730662117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:28:38 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:38-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:38 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:38-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:38 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:38-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:38 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:38-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:38 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:38-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:38 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:38-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:38 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:38-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.083913ms Nov 3 13:28:38 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:38-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.083913ms Nov 3 13:28:38 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:28:38 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:28:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:28:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730662117}"] Nov 3 13:28:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730662117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:28:38 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:38-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:38 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:38-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:38 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:38-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:38 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:38-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:38 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:38-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:38 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:38-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:38 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:38-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.826951ms Nov 3 13:28:38 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:38-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.826951ms Nov 3 13:28:38 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:28:38 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:28:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:28:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730662117}"] Nov 3 13:28:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730662117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:28:38 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:38-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:38 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:38-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:38 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:38-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:38 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:38-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:38 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:38-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:38 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:38-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:38 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:38-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.531398ms Nov 3 13:28:38 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:38-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.531398ms Nov 3 13:28:38 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:28:38 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:28:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:28:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730662117}"] Nov 3 13:28:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730662117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:28:38 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:38-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:38 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:38-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:28:38 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:38-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:38 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:28:38-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:38 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:38-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:28:38 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:28:38-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:28:38 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:28:38-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.832302ms Nov 3 13:28:38 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:28:38-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.832302ms Nov 3 13:28:38 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:28:38 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:28:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:28:40 kjcf05n02 LCNmon[17944]: 10.16.100.53 is unreachable via ib0 Nov 3 13:28:40 kjcf05n02 LCNmon[17944]: 10.16.100.59 is unreachable via ib0 Nov 3 13:28:42 kjcf05n00 mcfcli[3673891]: %3|1730662122.581|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 13:28:44 kjcf05n02 LCNmon[17944]: 10.16.100.53 is unreachable via ib1 Nov 3 13:28:44 kjcf05n02 LCNmon[17944]: 10.16.100.59 is unreachable via ib1 Nov 3 13:28:53 kjcf05n00 mcfcli[3673891]: %3|1730662133.101|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 13:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 13:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 13:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 13:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 13:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 13:29:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 13:29:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 13:29:12 kjcf05n00 mcfcli[3673891]: %3|1730662152.581|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 13:29:31 kjcf05n00 mcfcli[3673891]: %3|1730662171.259|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:29:33 kjcf05n00 zabbix-server[1291260]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 13:29:33 kjcf05n00 zabbix-server[1291260]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n03:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 13:29:34 kjcf05n00 log_interesting_event.py[1291260]: Event '46258' acknowledged Nov 3 13:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 13:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 13:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 13:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 13:29:40 kjcf05n02 LCNmon[17944]: 10.16.100.53 is unreachable via ib0 Nov 3 13:29:40 kjcf05n02 LCNmon[17944]: 10.16.100.59 is unreachable via ib0 Nov 3 13:29:42 kjcf05n00 mcfcli[3673891]: %3|1730662182.582|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 13:29:44 kjcf05n02 LCNmon[17944]: 10.16.100.53 is unreachable via ib1 Nov 3 13:29:44 kjcf05n02 LCNmon[17944]: 10.16.100.59 is unreachable via ib1 Nov 3 13:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 13:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 13:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 13:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 13:29:59 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:9a:1a Nov 3 13:29:59 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 13:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 13:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 13:30:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 13:30:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 13:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 13:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 13:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 13:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 13:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 13:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 13:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 13:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 13:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 13:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 13:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 13:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 13:30:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 13:30:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:30:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 13:30:03 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 13:30:03 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a kjcf05n03 Nov 3 13:30:03 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.6 Nov 3 13:30:03 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 13:30:03 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 13:30:03 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.6 Nov 3 13:30:03 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/pxelinux.cfg to 172.16.2.6 Nov 3 13:30:06 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/vmlinuz_diskless to 172.16.2.6 Nov 3 13:30:08 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/initramfs-diskless.img to 172.16.2.6 Nov 3 13:30:10 kjcf05n00 mcfcli[3673891]: %3|1730662210.635|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:30:12 kjcf05n00 mcfcli[3673891]: %3|1730662212.582|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:30:23 kjcf05n00 python3.9[1291532]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 13:30:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730662236', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 13:30:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730662236'} Nov 3 13:30:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:30:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730662236', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 13:30:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730662236'} Nov 3 13:30:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 13:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 13:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 13:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 13:30:40 kjcf05n02 LCNmon[17944]: 10.16.100.53 is unreachable via ib0 Nov 3 13:30:40 kjcf05n02 LCNmon[17944]: 10.16.100.59 is unreachable via ib0 Nov 3 13:30:42 kjcf05n00 mcfcli[3673891]: %3|1730662242.583|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 13:30:44 kjcf05n02 LCNmon[17944]: 10.16.100.53 is unreachable via ib1 Nov 3 13:30:44 kjcf05n02 LCNmon[17944]: 10.16.100.59 is unreachable via ib1 Nov 3 13:30:50 kjcf05n00 mcfcli[3673891]: %3|1730662250.057|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 13:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 13:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 13:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 13:30:57 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:43020). Nov 3 13:30:57 kjcf05n01 rsyncd[3115630]: connect from kjcf05n03 (172.16.2.6) Nov 3 13:30:57 kjcf05n01 rsyncd[3115630]: rsync on puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 13:30:57 kjcf05n01 rsyncd[3115630]: building file list Nov 3 13:30:57 kjcf05n01 rsyncd[3115630]: sent 11445 bytes received 136 bytes total size 10901 Nov 3 13:30:57 kjcf05n01 systemd[1]: rsyncd@631-172.16.2.2:873-172.16.2.6:43020.service: Succeeded. Nov 3 13:31:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 13:31:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 13:31:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 13:31:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 13:31:10 kjcf05n02 fstonithd.py[15105]: Listening for kdump packets from partner Nov 3 13:31:12 kjcf05n00 mcfcli[3673891]: %3|1730662272.583|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 13:31:29 kjcf05n00 mcfcli[3673891]: %3|1730662289.124|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 13:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 13:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 13:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 13:31:40 kjcf05n02 LCNmon[17944]: 10.16.100.53 is unreachable via ib0 Nov 3 13:31:40 kjcf05n02 LCNmon[17944]: 10.16.100.59 is unreachable via ib0 Nov 3 13:31:42 kjcf05n00 mcfcli[3673891]: %3|1730662302.584|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 13:31:44 kjcf05n02 LCNmon[17944]: 10.16.100.53 is unreachable via ib1 Nov 3 13:31:44 kjcf05n02 LCNmon[17944]: 10.16.100.59 is unreachable via ib1 Nov 3 13:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 13:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 13:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 13:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 13:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 13:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 13:32:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 13:32:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 13:32:03 kjcf05n02 dwd[5141]: nvme16n1 passed periodic SMART status check Nov 3 13:32:03 kjcf05n02 dwd[5141]: nvme15n1 passed periodic SMART status check Nov 3 13:32:03 kjcf05n02 dwd[5141]: nvme22n1 passed periodic SMART status check Nov 3 13:32:03 kjcf05n02 dwd[5141]: nvme7n1 passed periodic SMART status check Nov 3 13:32:03 kjcf05n02 dwd[5141]: nvme21n1 passed periodic SMART status check Nov 3 13:32:03 kjcf05n02 dwd[5141]: nvme10n1 passed periodic SMART status check Nov 3 13:32:03 kjcf05n02 dwd[5141]: nvme5n1 passed periodic SMART status check Nov 3 13:32:03 kjcf05n02 dwd[5141]: nvme12n1 passed periodic SMART status check Nov 3 13:32:03 kjcf05n02 dwd[5141]: nvme11n1 passed periodic SMART status check Nov 3 13:32:03 kjcf05n02 dwd[5141]: nvme20n1 passed periodic SMART status check Nov 3 13:32:03 kjcf05n02 dwd[5141]: nvme6n1 passed periodic SMART status check Nov 3 13:32:07 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 13:32:09 kjcf05n00 mcfcli[3673891]: %3|1730662329.121|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:32:12 kjcf05n00 mcfcli[3673891]: %3|1730662332.584|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 13:32:22 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='15', client='AF_INET(172.16.2.6:39827)', local='AF_INET(0.0.0.0:601)' Nov 3 13:32:22 kjcf05n03 syslog-ng[3072]: Configuration reload request received, reloading configuration; Nov 3 13:32:22 kjcf05n03 syslog-ng[3072]: Configuration reload finished; Nov 3 13:32:22 kjcf05n03 syslog-ng[3072]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 13:32:22 kjcf05n03 dracut: dracut-049-135.git20210121.el8 Nov 3 13:32:22 kjcf05n03 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 13:32:22 kjcf05n03 dracut: Loading and integrity checking all crypto modules Nov 3 13:32:22 kjcf05n03 dracut: Self testing crypto algorithms Nov 3 13:32:22 kjcf05n03 dracut: rd.md=0: removing MD RAID activation Nov 3 13:32:22 kjcf05n03 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 13:32:22 kjcf05n03 Copying live image to RAM... Nov 3 13:32:22 kjcf05n03 (this may take a minute) Nov 3 13:32:22 kjcf05n03 Done copying live image to RAM. Nov 3 13:32:22 kjcf05n03 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 13:32:22 kjcf05n03 dracut: Checking integrity of kernel Nov 3 13:32:22 kjcf05n03 dracut: All initrd crypto checks done Nov 3 13:32:22 kjcf05n03 dracut: Switching root Nov 3 13:32:22 kjcf05n03 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 13:32:22 kjcf05n03 systemd: Detected architecture x86-64. Nov 3 13:32:22 kjcf05n03 systemd: Set hostname to . Nov 3 13:32:22 kjcf05n03 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 13:32:22 kjcf05n03 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 13:32:22 kjcf05n03 systemd: Reached target rpc_pipefs.target. Nov 3 13:32:22 kjcf05n03 systemd: Created slice User and Session Slice. Nov 3 13:32:22 kjcf05n03 systemd: Reached target Swap. Nov 3 13:32:22 kjcf05n03 systemd: Listening on Journal Socket (/dev/log). Nov 3 13:32:22 kjcf05n03 systemd: Reached target Slices. Nov 3 13:32:22 kjcf05n03 systemd-journald[1512]: Journal started Nov 3 13:32:22 kjcf05n03 systemd-journald[1512]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 13:32:22 kjcf05n03 systemd-modules-load[1527]: Inserted module 'fuse' Nov 3 13:32:22 kjcf05n03 systemd[1]: Mounted Temporary Directory (/tmp). Nov 3 13:32:22 kjcf05n03 systemd[1]: Mounted /WIBS. Nov 3 13:32:22 kjcf05n03 systemd[1]: Mounted /mnt. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 3 13:32:22 kjcf05n03 systemd[1]: Mounted Huge Pages File System. Nov 3 13:32:22 kjcf05n03 systemd[1]: Mounted Kernel Debug File System. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Create list of required static device nodes for the current kernel. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Load Kernel Modules. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Remount Root and Kernel File Systems. Nov 3 13:32:22 kjcf05n03 systemd[1]: Mounted /data. Nov 3 13:32:22 kjcf05n03 systemd[1]: Mounted POSIX Message Queue File System. Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Load/Save Random Seed... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Create System Users... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Rebuild Hardware Database... Nov 3 13:32:22 kjcf05n03 systemd[1]: Mounting Kernel Configuration File System... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Apply Kernel Variables... Nov 3 13:32:22 kjcf05n03 systemd[1]: Mounting FUSE Control File System... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 13:32:22 kjcf05n03 systemd[1]: Mounted Kernel Configuration File System. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Load/Save Random Seed. Nov 3 13:32:22 kjcf05n03 systemd[1]: Mounted FUSE Control File System. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Create System Users. Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 13:32:22 kjcf05n03 systemd-sysctl[1550]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 13:32:22 kjcf05n03 systemd-sysctl[1550]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Apply Kernel Variables. Nov 3 13:32:22 kjcf05n03 systemd-journald[1512]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 13:32:22 kjcf05n03 systemd-tmpfiles[1556]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 13:32:22 kjcf05n03 systemd-tmpfiles[1556]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started udev Coldplug all Devices. Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Rebuild Hardware Database. Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting udev Kernel Device Manager... Nov 3 13:32:22 kjcf05n03 systemd-udevd[1563]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started udev Kernel Device Manager. Nov 3 13:32:22 kjcf05n03 systemd[1]: Found device /dev/ttyS0. Nov 3 13:32:22 kjcf05n03 systemd-udevd[1613]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:32:22 kjcf05n03 systemd-udevd[1629]: Using default interface naming scheme 'rhel-8.0'. Nov 3 13:32:22 kjcf05n03 systemd-udevd[1629]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:32:22 kjcf05n03 systemd-udevd[1582]: Using default interface naming scheme 'rhel-8.0'. Nov 3 13:32:22 kjcf05n03 systemd-udevd[1582]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:32:22 kjcf05n03 systemd-udevd[1587]: Using default interface naming scheme 'rhel-8.0'. Nov 3 13:32:22 kjcf05n03 systemd-udevd[1587]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 13:32:22 kjcf05n03 systemd[1]: Reached target Local File Systems (Pre). Nov 3 13:32:22 kjcf05n03 systemd[1]: Reached target Local File Systems. Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Rebuild Journal Catalog. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 13:32:22 kjcf05n03 root[1789]: openibd: running in auto mode Nov 3 13:32:22 kjcf05n03 systemd-tmpfiles[1780]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 13:32:22 kjcf05n03 systemd-tmpfiles[1780]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 13:32:22 kjcf05n03 systemd-tmpfiles[1780]: "/var/tmp" already exists and is not a directory. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Create Volatile Files and Directories. Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting RPC Bind... Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started RPC Bind. Nov 3 13:32:22 kjcf05n03 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 13:32:22 kjcf05n03 systemd-modules-load[1906]: Inserted module 'ib_iser' Nov 3 13:32:22 kjcf05n03 systemd-modules-load[1906]: Inserted module 'ib_isert' Nov 3 13:32:22 kjcf05n03 systemd-modules-load[1906]: Inserted module 'ib_srpt' Nov 3 13:32:22 kjcf05n03 systemd[1]: Started RDMA Node Description Daemon. Nov 3 13:32:22 kjcf05n03 systemd-udevd[1573]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:32:22 kjcf05n03 systemd-udevd[1605]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:32:22 kjcf05n03 systemd-modules-load[1916]: Inserted module 'ib_ipoib' Nov 3 13:32:22 kjcf05n03 systemd-modules-load[1906]: Inserted module 'rdma_ucm' Nov 3 13:32:22 kjcf05n03 systemd-modules-load[1906]: Module 'svcrdma' is blacklisted Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 13:32:22 kjcf05n03 systemd-udevd[1573]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 13:32:22 kjcf05n03 systemd-udevd[1605]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 13:32:22 kjcf05n03 systemd-modules-load[1916]: Inserted module 'ib_umad' Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 13:32:22 kjcf05n03 systemd[1]: Reached target Network (Pre). Nov 3 13:32:22 kjcf05n03 systemd[1]: Reached target RDMA Hardware. Nov 3 13:32:22 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 13:32:22 kjcf05n03 systemd[3072]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:22 kjcf05n03 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 13:32:22 kjcf05n03 openibd[1775]: Loading HCA driver and Access Layer:[ OK ] Nov 3 13:32:22 kjcf05n03 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Update is Completed... Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Update is Completed. Nov 3 13:32:22 kjcf05n03 setup-icl[1766]: Setting LAN IP Address to 203.0.113.4 Nov 3 13:32:22 kjcf05n03 setup-icl[1766]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 13:32:22 kjcf05n03 setup-icl[1766]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 13:32:22 kjcf05n03 setup-icl[1766]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 13:32:22 kjcf05n03 systemd-udevd[1573]: Using default interface naming scheme 'rhel-8.0'. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 13:32:22 kjcf05n03 systemd[1]: Reached target System Initialization. Nov 3 13:32:22 kjcf05n03 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 13:32:22 kjcf05n03 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 13:32:22 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 13:32:22 kjcf05n03 systemd[1]: Listening on lldpad.socket. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 13:32:22 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 13:32:22 kjcf05n03 systemd[1]: Reached target Sockets. Nov 3 13:32:22 kjcf05n03 systemd[1]: Reached target Basic System. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 13:32:22 kjcf05n03 mcelog[2079]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 13:32:22 kjcf05n03 mcelog[2079]: CPU is unsupported Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 13:32:22 kjcf05n03 network[2080]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 13:32:22 kjcf05n03 mdraid-phy[2085]: no Cutlass to worry about Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Resets System Activity Logs... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Name Service Cache Daemon... Nov 3 13:32:22 kjcf05n03 dwd[2092]: dwd: vMay 29 2024 : 15:38:26 Nov 3 13:32:22 kjcf05n03 dwd[2092]: /usr/sbin/dwd -d --standalone=0 Nov 3 13:32:22 kjcf05n03 dwd[2092]: dwd: option Lethal: 0 Nov 3 13:32:22 kjcf05n03 dwd[2092]: dwd: option Interval: 60 Nov 3 13:32:22 kjcf05n03 dwd[2092]: dwd: option abrtlimit: 10 Nov 3 13:32:22 kjcf05n03 dwd[2092]: dwd: option DZPeriod: 604800 Nov 3 13:32:22 kjcf05n03 dwd[2092]: dwd: option SmartPeriod: 43200 Nov 3 13:32:22 kjcf05n03 dwd[2092]: dwd: option SDDEnabled: 1 Nov 3 13:32:22 kjcf05n03 dwd[2092]: dwd: option SDDAwaitScale: 3 Nov 3 13:32:22 kjcf05n03 dwd[2092]: dwd: option SDDAwaitMin: 100 Nov 3 13:32:22 kjcf05n03 dwd[2092]: dwd: option Verbosity: 1 Nov 3 13:32:22 kjcf05n03 dwd[2092]: dwd: option StandAlone: 0 Nov 3 13:32:22 kjcf05n03 dwd[2092]: option Lethal: 0 Nov 3 13:32:22 kjcf05n03 dwd[2092]: option Interval: 60 Nov 3 13:32:22 kjcf05n03 dwd[2092]: option abrtlimit: 10 Nov 3 13:32:22 kjcf05n03 dwd[2092]: option DZPeriod: 604800 Nov 3 13:32:22 kjcf05n03 dwd[2092]: option SmartPeriod: 43200 Nov 3 13:32:22 kjcf05n03 dwd[2092]: option SDDEnabled: 1 Nov 3 13:32:22 kjcf05n03 dwd[2092]: option SDDAwaitScale: 3 Nov 3 13:32:22 kjcf05n03 dwd[2092]: option SDDAwaitMin: 100 Nov 3 13:32:22 kjcf05n03 dwd[2092]: option Verbosity: 1 Nov 3 13:32:22 kjcf05n03 dwd[2092]: option StandAlone: 0 Nov 3 13:32:22 kjcf05n03 systemd[1]: Started D-Bus System Message Bus. Nov 3 13:32:22 kjcf05n03 network[2099]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 13:32:22 kjcf05n03 network[2080]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:32:22 kjcf05n03 nscd[2122]: 2122 monitoring file `/etc/hosts` (1) Nov 3 13:32:22 kjcf05n03 nscd[2122]: 2122 monitoring directory `/etc` (2) Nov 3 13:32:22 kjcf05n03 nscd[2122]: 2122 monitoring file `/etc/resolv.conf` (3) Nov 3 13:32:22 kjcf05n03 nscd[2122]: 2122 monitoring directory `/etc` (2) Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[2116]: Setting up Mellanox network interface: ib1 Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 13:32:22 kjcf05n03 network[2121]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:32:22 kjcf05n03 network[2080]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 13:32:22 kjcf05n03 chronyd[2157]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 13:32:22 kjcf05n03 systemd[1]: Started irqbalance daemon. Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 13:32:22 kjcf05n03 network[2155]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 13:32:22 kjcf05n03 dbus-daemon[2120]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 13:32:22 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 13:32:22 kjcf05n03 beSetMlxConfig[2175]: ConnectX-3 multiport not detected Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 0 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 1 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 2 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 3 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 4 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 5 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 6 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 7 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 8 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 9 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 10 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 11 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 12 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 13 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 14 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 15 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 16 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 17 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 18 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 19 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 20 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 21 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 22 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 23 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 24 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 25 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 26 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 27 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 28 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 29 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 30 Nov 3 13:32:22 kjcf05n03 cpupower[2209]: Setting cpu: 31 Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[2190]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 13:32:22 kjcf05n03 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 13:32:22 kjcf05n03 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Manage Cutlass PHYs. Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[2207]: Setting up Mellanox network interface: ib0 Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 13:32:22 kjcf05n03 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[2228]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Resets System Activity Logs. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Name Service Cache Daemon. Nov 3 13:32:22 kjcf05n03 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[2257]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[2262]: No configuration found for ib1 Nov 3 13:32:22 kjcf05n03 beSetMlxConfig[2175]: Starting MST (Mellanox Software Tools) driver set Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 0 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 1 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 2 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 3 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 4 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 5 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 6 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 7 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 8 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 9 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 10 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 11 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 12 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 13 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 14 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 15 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 16 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 17 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 18 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 19 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 20 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 21 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 22 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 23 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 24 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 25 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 26 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 27 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 28 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 29 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 30 Nov 3 13:32:22 kjcf05n03 cpupower[2282]: Idlestate 2 disabled on CPU 31 Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[2277]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[2284]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 13:32:22 kjcf05n03 beSetMlxConfig[2175]: Loading MST PCI module - Success Nov 3 13:32:22 kjcf05n03 sssd[sssd][2145]: Starting up Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[2292]: No configuration found for ib0 Nov 3 13:32:22 kjcf05n03 mlnx_conf_mgr[2316]: INFO: No configurations found for mlx5_1, skipping. Nov 3 13:32:22 kjcf05n03 beSetMlxConfig[2175]: Loading MST PCI configuration module - Success Nov 3 13:32:22 kjcf05n03 beSetMlxConfig[2175]: Create devices Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[2321]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 13:32:22 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 13:32:22 kjcf05n03 mlnx_conf_mgr[2357]: INFO: No configurations found for mlx5_0, skipping. Nov 3 13:32:22 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 13:32:22 kjcf05n03 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 13:32:22 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 13:32:22 kjcf05n03 sssd[be[implicit_files]][2322]: Starting up Nov 3 13:32:22 kjcf05n03 sssd[nss][2458]: Starting up Nov 3 13:32:22 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 13:32:22 kjcf05n03 systemd[1]: Reached target User and Group Name Lookups. Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Login Service... Nov 3 13:32:22 kjcf05n03 systemd-logind[2558]: New seat seat0. Nov 3 13:32:22 kjcf05n03 systemd-logind[2558]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Login Service. Nov 3 13:32:22 kjcf05n03 python3.9[2213]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 13:32:22 kjcf05n03 python3.9[3072]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 13:32:22 kjcf05n03 systemd-sysctl[2700]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 13:32:22 kjcf05n03 systemd-sysctl[2700]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 13:32:22 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 13:32:22 kjcf05n03 python3.9[2896]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 13:32:22 kjcf05n03 python3.9[3072]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:22 kjcf05n03 network[2080]: Bringing up loopback interface: [ OK ] Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 13:32:22 kjcf05n03 systemd-sysctl[3018]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 13:32:22 kjcf05n03 systemd-sysctl[3018]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 13:32:22 kjcf05n03 systemd[1]: Started LSB: Bring up/down networking. Nov 3 13:32:22 kjcf05n03 systemd[1]: Reached target Network. Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 13:32:22 kjcf05n03 systemd[1]: Reached target Network is Online. Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting System Logger Daemon... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 13:32:22 kjcf05n03 sm-notify[3074]: Version 2.3.3 starting Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 13:32:22 kjcf05n03 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Notify NFS peers of a restart. Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 13:32:22 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 13:32:22 kjcf05n03 systemd[1]: Reached target NFS client services. Nov 3 13:32:22 kjcf05n03 sshd[3100]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 13:32:22 kjcf05n03 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 13:32:22 kjcf05n03 systemd[1]: Reached target Remote File Systems. Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Permit User Sessions... Nov 3 13:32:22 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 13:32:22 kjcf05n03 lldpad[3084]: setsockopt nearest_bridge: Invalid argument Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Permit User Sessions. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Getty on tty1. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 13:32:22 kjcf05n03 lldpad[3084]: setsockopt nearest_bridge: Invalid argument Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Serial Getty on ttyS0. Nov 3 13:32:22 kjcf05n03 systemd[1]: Reached target Login Prompts. Nov 3 13:32:22 kjcf05n03 python3.9[3131]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 13:32:22 kjcf05n03 python3.9[3072]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 13:32:22 kjcf05n03 syslog-ng[3072]: [2024-11-03T19:31:09.458734] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 13:32:22 kjcf05n03 syslog-ng[3072]: [2024-11-03T19:31:09.459031] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 13:32:22 kjcf05n03 syslog-ng[3072]: [2024-11-03T19:31:09.459066] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 13:32:22 kjcf05n03 syslog-ng[3072]: [2024-11-03T19:31:09.459637] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 13:32:22 kjcf05n03 syslog-ng[3072]: [2024-11-03T19:31:09.459937] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 13:32:22 kjcf05n03 systemd[1]: Started System Logger Daemon. Nov 3 13:32:22 kjcf05n03 beSetMlxConfig[2175]: Unloading MST PCI module (unused) - Success Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 13:32:22 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 13:32:22 kjcf05n03 python3.9[3406]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 13:32:22 kjcf05n03 python3.9[3072]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 13:32:22 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 13:32:22 kjcf05n03 python3.9[3409]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 13:32:22 kjcf05n03 python3.9[3072]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 13:32:22 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 13:32:22 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 13:32:22 kjcf05n03 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 13:32:22 kjcf05n03 chronyd[2157]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 13:32:22 kjcf05n03 chronyd[2157]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 13:32:22 kjcf05n03 chronyd[2157]: System's initial offset : 0.005260 seconds slow of true (slew) Nov 3 13:32:22 kjcf05n03 beSetMlxConfig[2175]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 13:32:22 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 13:32:22 kjcf05n03 beSetMlxConfig[2175]: ib mode Nov 3 13:32:22 kjcf05n03 root[3430]: openibd: Set node_desc for mlx5_0: kjcf05n03 HCA-1 Nov 3 13:32:22 kjcf05n03 root[3432]: openibd: Set node_desc for mlx5_1: kjcf05n03 HCA-2 Nov 3 13:32:22 kjcf05n03 beSetMlxConfig[2175]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 13:32:22 kjcf05n03 beSetMlxConfig[2175]: ib mode Nov 3 13:32:22 kjcf05n03 systemd-udevd[1563]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 13:32:22 kjcf05n03 systemd-udevd[3445]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:32:22 kjcf05n03 systemd-udevd[3446]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:32:22 kjcf05n03 systemd-udevd[3449]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:32:22 kjcf05n03 systemd-udevd[3452]: Using default interface naming scheme 'rhel-8.0'. Nov 3 13:32:22 kjcf05n03 systemd-udevd[3452]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:32:22 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 13:32:22 kjcf05n03 systemd[3072]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:22 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[3487]: Setting up Mellanox network interface: ib0 Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[3488]: Setting up Mellanox network interface: ib1 Nov 3 13:32:22 kjcf05n03 systemd-udevd[3448]: Using default interface naming scheme 'rhel-8.0'. Nov 3 13:32:22 kjcf05n03 systemd-udevd[3447]: Using default interface naming scheme 'rhel-8.0'. Nov 3 13:32:22 kjcf05n03 systemd-udevd[3448]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:32:22 kjcf05n03 systemd-udevd[3447]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Puppet agent... Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[3537]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[3538]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[3568]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[3569]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[3571]: No configuration found for ib1 Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[3570]: No configuration found for ib0 Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[3578]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[3579]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 13:32:22 kjcf05n03 mlnx_conf_mgr[3619]: INFO: No configurations found for mlx5_0, skipping. Nov 3 13:32:22 kjcf05n03 mlnx_conf_mgr[3618]: INFO: No configurations found for mlx5_1, skipping. Nov 3 13:32:22 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 13:32:22 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 13:32:22 kjcf05n03 systemd[1]: Stopping Command Scheduler... Nov 3 13:32:22 kjcf05n03 systemd[1]: crond.service: Succeeded. Nov 3 13:32:22 kjcf05n03 systemd[1]: Stopped Command Scheduler. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 13:32:22 kjcf05n03 systemd[1]: Stopping Job spooling tools... Nov 3 13:32:22 kjcf05n03 systemd[1]: atd.service: Succeeded. Nov 3 13:32:22 kjcf05n03 systemd[1]: Stopped Job spooling tools. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 13:32:22 kjcf05n03 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 13:32:22 kjcf05n03 lldpad[3084]: init_ports: Error adding device ib0 Nov 3 13:32:22 kjcf05n03 lldpad[3084]: init_ports: Error adding device ib1 Nov 3 13:32:22 kjcf05n03 lldpad[3084]: Signal 15 received - terminating Nov 3 13:32:22 kjcf05n03 systemd[1]: lldpad.service: Succeeded. Nov 3 13:32:22 kjcf05n03 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 13:32:22 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 13:32:22 kjcf05n03 systemd[1]: lldpad.socket: Succeeded. Nov 3 13:32:22 kjcf05n03 systemd[1]: Closed lldpad.socket. Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 13:32:22 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting IPMI Driver... Nov 3 13:32:22 kjcf05n03 systemd[1]: Started IPMI Driver. Nov 3 13:32:22 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:22 kjcf05n03 systemd[3072]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:22 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Ipmievd Daemon... Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 1 | Nov-03-2024 | 18:01:39 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 2 | Nov-03-2024 | 18:02:31 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 3 | Nov-03-2024 | 18:02:31 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 4 | Nov-03-2024 | 18:03:36 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 5 | Nov-03-2024 | 18:03:37 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 6 | Nov-03-2024 | 19:28:27 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 7 | Nov-03-2024 | 19:28:27 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 8 | Nov-03-2024 | 19:28:27 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 9 | Nov-03-2024 | 19:28:27 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 10 | Nov-03-2024 | 19:28:27 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 11 | Nov-03-2024 | 19:28:27 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 12 | Nov-03-2024 | 19:28:27 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 13 | Nov-03-2024 | 19:28:27 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 14 | Nov-03-2024 | 19:28:27 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 15 | Nov-03-2024 | 19:28:27 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 16 | Nov-03-2024 | 19:28:27 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 17 | Nov-03-2024 | 19:28:27 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 18 | Nov-03-2024 | 19:28:57 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 19 | Nov-03-2024 | 19:28:57 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 20 | Nov-03-2024 | 19:28:57 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 21 | Nov-03-2024 | 19:28:57 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 22 | Nov-03-2024 | 19:28:57 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 23 | Nov-03-2024 | 19:28:57 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 24 | Nov-03-2024 | 19:28:57 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 25 | Nov-03-2024 | 19:28:57 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 26 | Nov-03-2024 | 19:28:57 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 27 | Nov-03-2024 | 19:28:57 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 28 | Nov-03-2024 | 19:28:57 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 29 | Nov-03-2024 | 19:28:57 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 30 | Nov-03-2024 | 19:28:57 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 31 | Nov-03-2024 | 19:28:57 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 32 | Nov-03-2024 | 19:28:57 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 33 | Nov-03-2024 | 19:28:57 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 34 | Nov-03-2024 | 19:28:57 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 35 | Nov-03-2024 | 19:28:57 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 36 | Nov-03-2024 | 19:28:57 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 37 | Nov-03-2024 | 19:28:57 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 38 | Nov-03-2024 | 19:28:57 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 39 | Nov-03-2024 | 19:28:57 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 40 | Nov-03-2024 | 19:28:58 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 41 | Nov-03-2024 | 19:28:58 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 42 | Nov-03-2024 | 19:28:58 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 43 | Nov-03-2024 | 19:28:58 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 44 | Nov-03-2024 | 19:28:58 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 45 | Nov-03-2024 | 19:28:58 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 46 | Nov-03-2024 | 19:28:58 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 47 | Nov-03-2024 | 19:28:58 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 48 | Nov-03-2024 | 19:28:58 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3962]: 49 | Nov-03-2024 | 19:28:58 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 13:32:22 kjcf05n03 ipmievd[3965]: Reading sensors... Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Ipmievd Daemon. Nov 3 13:32:22 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:22 kjcf05n03 systemd[3072]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 13:32:22 kjcf05n03 nscd[2122]: 2122 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 13:32:22 kjcf05n03 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 13:32:22 kjcf05n03 systemd[1]: Stopped Set Mellanox configuration. Nov 3 13:32:22 kjcf05n03 systemd[1]: Stopping Set Mellanox configuration... Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 13:32:22 kjcf05n03 beSetMlxConfig[4023]: ConnectX-3 multiport not detected Nov 3 13:32:22 kjcf05n03 beSetMlxConfig[4023]: Starting MST (Mellanox Software Tools) driver set Nov 3 13:32:22 kjcf05n03 beSetMlxConfig[4023]: Loading MST PCI module - Success Nov 3 13:32:22 kjcf05n03 systemd-udevd[1563]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 13:32:22 kjcf05n03 beSetMlxConfig[4023]: [warn] mst_pciconf is already loaded, skipping Nov 3 13:32:22 kjcf05n03 beSetMlxConfig[4023]: Create devices Nov 3 13:32:22 kjcf05n03 beSetMlxConfig[4023]: Unloading MST PCI module (unused) - Success Nov 3 13:32:22 kjcf05n03 ipmievd[3965]: Waiting for events... Nov 3 13:32:22 kjcf05n03 beSetMlxConfig[4023]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 13:32:22 kjcf05n03 beSetMlxConfig[4023]: ib mode Nov 3 13:32:22 kjcf05n03 beSetMlxConfig[4023]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 13:32:22 kjcf05n03 beSetMlxConfig[4023]: ib mode Nov 3 13:32:22 kjcf05n03 systemd-udevd[1563]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 13:32:22 kjcf05n03 systemd-udevd[4922]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:32:22 kjcf05n03 systemd-udevd[4923]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:32:22 kjcf05n03 systemd-udevd[4926]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:32:22 kjcf05n03 systemd-udevd[4929]: Using default interface naming scheme 'rhel-8.0'. Nov 3 13:32:22 kjcf05n03 systemd-udevd[4929]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:32:22 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 13:32:22 kjcf05n03 systemd[3072]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:22 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[4964]: Setting up Mellanox network interface: ib1 Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[4965]: Setting up Mellanox network interface: ib0 Nov 3 13:32:22 kjcf05n03 systemd-udevd[4924]: Using default interface naming scheme 'rhel-8.0'. Nov 3 13:32:22 kjcf05n03 systemd-udevd[4925]: Using default interface naming scheme 'rhel-8.0'. Nov 3 13:32:22 kjcf05n03 systemd-udevd[4924]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:32:22 kjcf05n03 systemd-udevd[4925]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[5013]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[5017]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[5044]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[5046]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[5047]: No configuration found for ib0 Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[5048]: No configuration found for ib1 Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[5053]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 13:32:22 kjcf05n03 mlnx_interface_mgr[5056]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 13:32:22 kjcf05n03 mlnx_conf_mgr[5092]: INFO: No configurations found for mlx5_0, skipping. Nov 3 13:32:22 kjcf05n03 mlnx_conf_mgr[5096]: INFO: No configurations found for mlx5_1, skipping. Nov 3 13:32:22 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 13:32:22 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}d920fab93d839f4641c29f4908aa0c6329131eff7a082acf66ea5d4ea9813051' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}d920fab93d839f4641c29f4908aa0c6329131eff7a082acf66ea5d4ea9813051' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}c5655ada4c9fa6da224fe6f02109dffb53b4a1d4b69aa82cfa1ec5ec85960a11' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}c5655ada4c9fa6da224fe6f02109dffb53b4a1d4b69aa82cfa1ec5ec85960a11' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}775cd37595deb2d094c5e43fee0c6fdb0ece5508e21f4b22e632cba74f83569d' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}775cd37595deb2d094c5e43fee0c6fdb0ece5508e21f4b22e632cba74f83569d' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}4f7e31daad893dd2399e46ba6819db31050ff4a98dbae917bc117aba1c1d080a' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}4f7e31daad893dd2399e46ba6819db31050ff4a98dbae917bc117aba1c1d080a' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 13:32:22 kjcf05n03 systemd[1]: Stopping NTP client/server... Nov 3 13:32:22 kjcf05n03 chronyd[2157]: chronyd exiting Nov 3 13:32:22 kjcf05n03 systemd[1]: chronyd.service: Succeeded. Nov 3 13:32:22 kjcf05n03 systemd[1]: Stopped NTP client/server. Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 13:32:22 kjcf05n03 chronyd[5130]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 13:32:22 kjcf05n03 chronyd[5130]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 13:32:22 kjcf05n03 chronyd[5130]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 13:32:22 kjcf05n03 chronyd[5130]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 13:32:22 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 13:32:22 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:22 kjcf05n03 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 13:32:22 kjcf05n03 systemd[1]: dwd.service: Succeeded. Nov 3 13:32:22 kjcf05n03 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 13:32:22 kjcf05n03 dwd[5163]: dwd: vMay 29 2024 : 15:38:26 Nov 3 13:32:22 kjcf05n03 dwd[5163]: /usr/sbin/dwd -i 15 -d Nov 3 13:32:22 kjcf05n03 dwd[5163]: dwd: option Lethal: 0 Nov 3 13:32:22 kjcf05n03 dwd[5163]: dwd: option Interval: 15 Nov 3 13:32:22 kjcf05n03 dwd[5163]: dwd: option abrtlimit: 10 Nov 3 13:32:22 kjcf05n03 dwd[5163]: dwd: option DZPeriod: 604800 Nov 3 13:32:22 kjcf05n03 dwd[5163]: dwd: option SmartPeriod: 43200 Nov 3 13:32:22 kjcf05n03 dwd[5163]: dwd: option SDDEnabled: 1 Nov 3 13:32:22 kjcf05n03 dwd[5163]: dwd: option SDDAwaitScale: 3 Nov 3 13:32:22 kjcf05n03 dwd[5163]: dwd: option SDDAwaitMin: 100 Nov 3 13:32:22 kjcf05n03 dwd[5163]: dwd: option Verbosity: 1 Nov 3 13:32:22 kjcf05n03 dwd[5163]: dwd: option StandAlone: 0 Nov 3 13:32:22 kjcf05n03 dwd[5163]: option Lethal: 0 Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 13:32:22 kjcf05n03 dwd[5163]: option Interval: 15 Nov 3 13:32:22 kjcf05n03 dwd[5163]: option abrtlimit: 10 Nov 3 13:32:22 kjcf05n03 dwd[5163]: option DZPeriod: 604800 Nov 3 13:32:22 kjcf05n03 dwd[5163]: option SmartPeriod: 43200 Nov 3 13:32:22 kjcf05n03 dwd[5163]: option SDDEnabled: 1 Nov 3 13:32:22 kjcf05n03 dwd[5163]: option SDDAwaitScale: 3 Nov 3 13:32:22 kjcf05n03 dwd[5163]: option SDDAwaitMin: 100 Nov 3 13:32:22 kjcf05n03 dwd[5163]: option Verbosity: 1 Nov 3 13:32:22 kjcf05n03 dwd[5163]: option StandAlone: 0 Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 13:32:22 kjcf05n03 dwd[5164]: option abrtlimit now set to 1 Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 13:32:22 kjcf05n03 dwd[5164]: option SmartPeriod now set to 86400 Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 13:32:22 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 13:32:22 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Discard unused blocks. Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:22 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:22 kjcf05n03 python3.9[5193]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 13:32:22 kjcf05n03 python3.9[3072]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 13:32:22 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Periodic ZFS scrub. Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:22 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 13:32:22 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:22 kjcf05n03 systemd[1]: Starting Sed Control Plane worker process... Nov 3 13:32:22 kjcf05n03 sedcpwrkr[5331]: Using config script: /etc/sedcpwrkr.conf Nov 3 13:32:22 kjcf05n03 sedcpwrkr[5331]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 13:32:22 kjcf05n03 sedcpwrkr[5331]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 13:32:22 kjcf05n03 sedcpwrkr[5331]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 13:32:22 kjcf05n03 sedcpwrkr[5331]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 13:32:22 kjcf05n03 sedcpwrkr[5331]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 13:32:22 kjcf05n03 sedcpwrkr[5331]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 13:32:22 kjcf05n03 sedcpwrkr-server[5362]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 13:32:22 kjcf05n03 sedcpwrkr[5331]: celery multi v5.2.7 (dawn-chorus) Nov 3 13:32:22 kjcf05n03 sedcpwrkr[5331]: > Starting nodes... Nov 3 13:32:22 kjcf05n03 sedcpwrkr[5331]: > sedcpwrkr@kjcf05n03: OK Nov 3 13:32:22 kjcf05n03 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 13:32:22 kjcf05n03 sedcpwrkr-server[5364]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 13:32:22 kjcf05n03 sedcpwrkr-server[5364]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 13:32:22 kjcf05n03 sedcpwrkr-server[5364]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 13:32:22 kjcf05n03 systemd[1]: Started Sed Control Plane worker process. Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 13:32:22 kjcf05n03 systemd[1]: Reloading System Logger Daemon. Nov 3 13:32:22 kjcf05n03 systemd[1]: Reloaded System Logger Daemon. Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 13:32:22 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 13:32:22 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 13:32:23 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:23 kjcf05n03 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 13:32:23 kjcf05n03 systemd-udevd[1563]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 13:32:23 kjcf05n03 iptables.init[5431]: iptables: Applying firewall rules: [ OK ] Nov 3 13:32:23 kjcf05n03 systemd[1]: Started IPv4 firewall with iptables. Nov 3 13:32:23 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:24 kjcf05n03 systemd[3072]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 13:32:24 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 13:32:24 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 13:32:24 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:25 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 13:32:25 kjcf05n03 systemd[1]: openhpid.service: Supervising process 5530 which is not our child. We'll most likely not notice when it exits. Nov 3 13:32:25 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 13:32:25 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:25 kjcf05n03 openhpid[5530]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 13:32:25 kjcf05n03 openhpid[5530]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 13:32:25 kjcf05n03 openhpid[5530]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 13:32:25 kjcf05n03 openhpid[5530]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 13:32:25 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:25 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:25 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:25 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 13:32:25 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 13:32:25 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 13:32:25 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 13:32:25 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:25 kjcf05n03 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 13:32:26 kjcf05n03 dcs-collectord[5621]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 13:32:26 kjcf05n03 hpi.inv.log[5621]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 13:32:26 kjcf05n03 dcs-collectord[5621]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 13:32:26 kjcf05n03 dcs-collectord[5621]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 13:32:26 kjcf05n03 dcs-collector[5612]: Starting dcs-collector:[ OK ] Nov 3 13:32:26 kjcf05n03 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 13:32:26 kjcf05n03 dcs-collectord[5624]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 13:32:26 kjcf05n03 dcs-collectord[5624]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 13:32:26 kjcf05n03 dcs-collectord[5624]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 13:32:26 kjcf05n03 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 13:32:26 kjcf05n03 dcs-collectord[5624]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259349592", "units": "kB"}, {"name": "MemAvailable", "value": "258629372", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821324", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1687080", "units": "kB"}, {"name": "Inactive", "value": "957572", "units": "kB"}, {"name": "Active(anon)", "value": "1521136", "units": "kB"}, {"name": "Inactive(anon)", "value": "821200", "units": "kB"}, {"name": "Active(file)", "value": "165944", "units": "kB"}, {"name": "Inactive(file)", "value": "136372", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "749076", "units": "kB"}, {"name": "Mapped", "value": "86316", "units": "kB"}, {"name": "Shmem", "value": "1593448", "units": "kB"}, {"name": "KReclaimable", "value": "109060", "units": "kB"}, {"name": "Slab", "value": "276188", "units": "kB"}, {"name": "SReclaimable", "value": "109060", "units": "kB"}, {"name": "SUnreclaim", "value": "167128", "units": "kB"}, {"name": "KernelStack", "value": "9776", "units": "kB"}, {"name": "PageTables", "value": "20208", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3106252", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11264", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "4096", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "293192", "units": "kB"}, {"name": "DirectMap2M", "value": "26834944", "units": "kB"}, {"name": "DirectMap1G", "value": "241172480", "units": "kB"}]}' Nov 3 13:32:26 kjcf05n03 dcs-collectord[5624]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 13:32:26 kjcf05n03 dcs-collectord[5624]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 13:32:26 kjcf05n03 dcs-collectord[5624]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 13:32:26 kjcf05n03 dcs-collectord[5624]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 13:32:26 kjcf05n03 dcs-collectord[5624]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 13:32:26 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:26 kjcf05n03 systemd[3072]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:26 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:26 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:26 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 13:32:26 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 13:32:26 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 13:32:26 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 13:32:27 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:27 kjcf05n03 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 13:32:27 kjcf05n03 firmware-update-orc[5705]: Using config script: /etc/firmware_update_orc.conf Nov 3 13:32:27 kjcf05n03 firmware-update-orc[5705]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 13:32:27 kjcf05n03 firmware-update-orc[5705]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 13:32:27 kjcf05n03 firmware-update-orc[5705]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 13:32:27 kjcf05n03 firmware-update-orc[5705]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 13:32:27 kjcf05n03 firmware-update-orc[5705]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 13:32:27 kjcf05n03 firmware-update-orc[5705]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 13:32:27 kjcf05n03 dcs-collectord[5624]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 13:32:27 kjcf05n03 dcs-collectord[5624]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730662346.2083924], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730662347.3866408], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730662346.142417, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 13:32:27 kjcf05n03 firmware-update-orc-server[5741]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 13:32:27 kjcf05n03 firmware-update-orc[5705]: celery multi v5.2.7 (dawn-chorus) Nov 3 13:32:27 kjcf05n03 firmware-update-orc[5705]: > Starting nodes... Nov 3 13:32:27 kjcf05n03 firmware-update-orc[5705]: > worker1@kjcf05n03: OK Nov 3 13:32:27 kjcf05n03 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 13:32:27 kjcf05n03 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 13:32:27 kjcf05n03 firmware-update-orc-server[5770]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 13:32:27 kjcf05n03 firmware-update-orc-server[5770]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 13:32:27 kjcf05n03 firmware-update-orc-server[5770]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 13:32:27 kjcf05n03 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 13:32:27 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:28 kjcf05n03 systemd[3072]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:28 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:28 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:28 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 13:32:28 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 13:32:28 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 13:32:28 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 13:32:28 kjcf05n03 dbus-daemon[2120]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 13:32:28 kjcf05n03 dbus-daemon[2120]: [system] Reloaded configuration Nov 3 13:32:28 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 13:32:28 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 13:32:28 kjcf05n03 dbus-daemon[2120]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 13:32:28 kjcf05n03 dbus-daemon[2120]: [system] Reloaded configuration Nov 3 13:32:28 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 13:32:28 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 13:32:28 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 13:32:28 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 13:32:28 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:28 kjcf05n03 systemd[1]: Starting Manages hardware resources... Nov 3 13:32:29 kjcf05n03 ras-resource-manager-agent[5886]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 13:32:29 kjcf05n03 ras-resource-manager-agent[5872]: Starting ras-resource-manager-agent:[ OK ] Nov 3 13:32:29 kjcf05n03 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 13:32:29 kjcf05n03 ras-resource-manager-agent[5888]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 13:32:29 kjcf05n03 ras-resource-manager-client[5888]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 13:32:29 kjcf05n03 systemd[1]: Started Manages hardware resources. Nov 3 13:32:29 kjcf05n03 ras-resource-manager-client[5888]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 13:32:29 kjcf05n03 ras-resource-manager-client[5898]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 13:32:29 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:29 kjcf05n03 systemd[3072]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:29 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:29 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:29 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 13:32:29 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 13:32:29 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:29 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 13:32:29 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:30 kjcf05n03 systemd[3072]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: Press Ctrl+C to exit. Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: Plugin support version 1.0 Nov 3 13:32:30 kjcf05n03 zabbix_agent2[5972]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 13:32:30 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:30 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:30 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:30 kjcf05n03 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 13:32:30 kjcf05n03 dcs-notification-sender[6048]: dcs-notification-senderd is stopped Nov 3 13:32:30 kjcf05n03 zabbix-agent2[6062]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 13:32:30 kjcf05n03 dcs-notification-sender[6048]: Starting notification-sender:[ OK ] Nov 3 13:32:30 kjcf05n03 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 13:32:31 kjcf05n03 zabbix-agent2[6068]: INFO DCS notification agent started. (agent.py:61) Nov 3 13:32:31 kjcf05n03 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 13:32:31 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:31 kjcf05n03 systemd[3072]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:31 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:31 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:31 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:31 kjcf05n03 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 13:32:32 kjcf05n03 dcs-collectord[6157]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 13:32:32 kjcf05n03 dcs-collectord[6157]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 13:32:32 kjcf05n03 dcs-bulk-data-sender[6157]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 13:32:32 kjcf05n03 dcs-bulk-data-sender[6148]: Starting bulk-data-sender:[ OK ] Nov 3 13:32:32 kjcf05n03 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 13:32:32 kjcf05n03 dcs-collectord[6159]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 13:32:32 kjcf05n03 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 13:32:32 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:32 kjcf05n03 systemd[3072]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:32 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:32 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:32 kjcf05n03 nscd[2122]: 2122 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 13:32:32 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 13:32:32 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 13:32:32 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 13:32:32 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 13:32:32 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 13:32:32 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 13:32:32 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 13:32:32 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 13:32:32 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 13:32:32 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 13:32:32 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 13:32:32 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 13:32:32 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 13:32:32 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 13:32:33 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 13:32:33 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 13:32:33 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 13:32:33 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 13:32:33 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 13:32:33 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 13:32:33 kjcf05n03 systemd[1]: Stopping System Security Services Daemon... Nov 3 13:32:33 kjcf05n03 sssd[nss][2458]: Shutting down (status = 0) Nov 3 13:32:33 kjcf05n03 sssd[be[implicit_files]][2322]: Shutting down (status = 0) Nov 3 13:32:33 kjcf05n03 systemd[1]: sssd.service: Succeeded. Nov 3 13:32:33 kjcf05n03 systemd[1]: Stopped System Security Services Daemon. Nov 3 13:32:33 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 13:32:33 kjcf05n03 sssd[sssd][6244]: Starting up Nov 3 13:32:33 kjcf05n03 python3.9[5193]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 13:32:33 kjcf05n03 python3.9[3072]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:33 kjcf05n03 sssd[be[implicit_files]][6245]: Starting up Nov 3 13:32:33 kjcf05n03 sssd[nss][6246]: Starting up Nov 3 13:32:34 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 13:32:34 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 13:32:34 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 13:32:35 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 13:32:35 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 13:32:35 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure) defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 13:32:35 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure: defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 13:32:35 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure) defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 13:32:35 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure: defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 13:32:35 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 13:32:35 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 13:32:35 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 13:32:35 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 13:32:35 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 13:32:35 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 13:32:35 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:35 kjcf05n03 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 13:32:35 kjcf05n03 icinga2[6303]: [2024-11-03 13:32:35 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 13:32:35 kjcf05n03 icinga2[6303]: [2024-11-03 13:32:35 -0600] information/cli: Loading configuration file(s). Nov 3 13:32:35 kjcf05n03 icinga2[6303]: [2024-11-03 13:32:35 -0600] information/ConfigItem: Committing config item(s). Nov 3 13:32:35 kjcf05n03 icinga2[6303]: [2024-11-03 13:32:35 -0600] information/ApiListener: My API identity: kjcf05n03 Nov 3 13:32:35 kjcf05n03 icinga2[6303]: [2024-11-03 13:32:35 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 13:32:35 kjcf05n03 icinga2[6303]: [2024-11-03 13:32:35 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 13:32:35 kjcf05n03 icinga2[6303]: [2024-11-03 13:32:35 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 13:32:35 kjcf05n03 icinga2[6303]: [2024-11-03 13:32:35 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 13:32:35 kjcf05n03 icinga2[6303]: [2024-11-03 13:32:35 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 13:32:35 kjcf05n03 icinga2[6303]: [2024-11-03 13:32:35 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 13:32:35 kjcf05n03 icinga2[6303]: [2024-11-03 13:32:35 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 13:32:35 kjcf05n03 icinga2[6303]: [2024-11-03 13:32:35 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 13:32:35 kjcf05n03 icinga2[6303]: [2024-11-03 13:32:35 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 13:32:35 kjcf05n03 icinga2[6303]: [2024-11-03 13:32:35 -0600] information/cli: Closing console log. Nov 3 13:32:35 kjcf05n03 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 13:32:35 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:36 kjcf05n03 systemd[3072]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:36 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:36 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:36 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 13:32:36 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 13:32:36 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:36 kjcf05n03 systemd[1]: Started Icinga2 network monitor. Nov 3 13:32:36 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:37 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 13:32:37 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:37 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 13:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 13:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 13:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 13:32:37 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 13:32:37 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 13:32:37 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 13:32:37 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 13:32:37 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 13:32:37 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 13:32:37 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 13:32:37 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 13:32:37 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 13:32:37 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 13:32:37 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 13:32:37 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 13:32:37 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 13:32:37 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 13:32:37 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:38 kjcf05n03 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 13:32:38 kjcf05n03 nslcd[6915]: version 0.9.9 starting Nov 3 13:32:38 kjcf05n03 nslcd[6915]: accepting connections Nov 3 13:32:38 kjcf05n03 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 13:32:38 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:38 kjcf05n03 systemd[3072]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:38 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:38 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:38 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 13:32:38 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 13:32:38 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 13:32:38 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 13:32:39 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 13:32:39 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 13:32:40 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 13:32:40 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 13:32:40 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:40 kjcf05n03 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 13:32:40 kjcf05n03 dearcpw[7010]: Using config script: /etc/dearcpw.conf Nov 3 13:32:40 kjcf05n03 dearcpw[7010]: - Creating default directory: '/var/log/dearcpw' Nov 3 13:32:40 kjcf05n03 dearcpw[7010]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 13:32:40 kjcf05n03 dearcpw[7010]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 13:32:40 kjcf05n03 dearcpw[7010]: - Creating default directory: '/var/run/dearcpw' Nov 3 13:32:40 kjcf05n03 dearcpw[7010]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 13:32:40 kjcf05n03 dearcpw[7010]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 13:32:40 kjcf05n03 dcs-bulk-data-sender[6159]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 13:32:40 kjcf05n03 dcs-collectord[6159]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 13:32:40 kjcf05n02 LCNmon[17944]: 10.16.100.53 is unreachable via ib0 Nov 3 13:32:40 kjcf05n02 LCNmon[17944]: 10.16.100.59 is unreachable via ib0 Nov 3 13:32:40 kjcf05n03 dearcpw-server[7056]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 13:32:40 kjcf05n03 dearcpw[7010]: celery multi v5.2.7 (dawn-chorus) Nov 3 13:32:40 kjcf05n03 dearcpw[7010]: > Starting nodes... Nov 3 13:32:40 kjcf05n03 dearcpw[7010]: > dearcpw@kjcf05n03: OK Nov 3 13:32:40 kjcf05n03 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 13:32:40 kjcf05n03 dearcpw-server[7058]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 13:32:40 kjcf05n03 dearcpw-server[7058]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 13:32:40 kjcf05n03 dearcpw-server[7058]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 13:32:40 kjcf05n03 systemd[1]: Started DEAR Control Plane worker process. Nov 3 13:32:40 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:40 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:40 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 13:32:40 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 13:32:40 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 13:32:40 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 13:32:40 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 13:32:40 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 13:32:40 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 13:32:40 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 13:32:40 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 13:32:40 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 13:32:41 kjcf05n03 puppet[7085]: IEC: 017000000: Node is up and running: { "node": "kjcf05n03" } Nov 3 13:32:41 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 13:32:41 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 13:32:41 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 13:32:41 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 13:32:41 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 13:32:41 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 13:32:41 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 13:32:41 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 13:32:41 kjcf05n03 dcs-collectord[5624]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 13:32:41 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:43054). Nov 3 13:32:41 kjcf05n01 rsyncd[3116357]: connect from kjcf05n03 (172.16.2.6) Nov 3 13:32:41 kjcf05n01 rsyncd[3116357]: rsync to puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 13:32:41 kjcf05n01 rsyncd[3116357]: receiving file list Nov 3 13:32:41 kjcf05n01 rsyncd[3116357]: sent 29 bytes received 325 bytes total size 10901 Nov 3 13:32:41 kjcf05n01 systemd[1]: rsyncd@632-172.16.2.2:873-172.16.2.6:43054.service: Succeeded. Nov 3 13:32:41 kjcf05n03 dcs-collectord[5624]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 13:32:41 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 13:32:41 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 13:32:42 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 13:32:42 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 13:32:42 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 13:32:42 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 13:32:43 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 13:32:43 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 13:32:43 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 13:32:43 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 13:32:42 kjcf05n00 mcfcli[3673891]: %3|1730662362.585|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:32:43 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 13:32:43 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 13:32:43 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 13:32:43 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 13:32:44 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 13:32:44 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 13:32:44 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:44 kjcf05n02 LCNmon[17944]: 10.16.100.53 is unreachable via ib1 Nov 3 13:32:44 kjcf05n02 LCNmon[17944]: 10.16.100.59 is unreachable via ib1 Nov 3 13:32:44 kjcf05n03 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 13:32:44 kjcf05n03 diskless-swap[7191]: HA_PS_000: recovering journal Nov 3 13:32:44 kjcf05n03 systemd-udevd[1563]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 13:32:44 kjcf05n03 diskless-swap[7191]: HA_PS_000: clean, 2277/6400 files, 7043/25600 blocks Nov 3 13:32:44 kjcf05n03 diskless-swap[7191]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 13:32:44 kjcf05n03 diskless-swap[7191]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 13:32:44 kjcf05n03 diskless-swap[7191]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 13:32:44 kjcf05n03 diskless-swap[7191]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 13:32:44 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 13:32:44 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:44 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:44 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 13:32:44 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 13:32:44 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 13:32:44 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 13:32:44 kjcf05n03 ipmievd[3965]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 13:32:44 kjcf05n03 ipmievd[3965]: System Event sensor - Timestamp Clock Sync Nov 3 13:32:44 kjcf05n03 ipmievd[3072]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:44 kjcf05n03 systemd[1]: Stopping OpenSSH server daemon... Nov 3 13:32:45 kjcf05n03 systemd[1]: sshd.service: Succeeded. Nov 3 13:32:45 kjcf05n03 systemd[1]: Stopped OpenSSH server daemon. Nov 3 13:32:45 kjcf05n03 systemd[1]: Stopped target sshd-keygen.target. Nov 3 13:32:45 kjcf05n03 systemd[1]: Stopping sshd-keygen.target. Nov 3 13:32:45 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 13:32:45 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 13:32:45 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 13:32:45 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 13:32:45 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 13:32:45 kjcf05n00 mcfcli[3673891]: %3|1730662365.052|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:32:45 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 13:32:45 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 13:32:46 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 13:32:46 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 13:32:46 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 13:32:46 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 13:32:46 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 13:32:46 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 13:32:46 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 13:32:46 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 13:32:47 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 13:32:47 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 13:32:47 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 13:32:47 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 13:32:48 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 13:32:48 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 13:32:48 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 13:32:48 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 13:32:48 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:48 kjcf05n03 systemd[1]: Set up automount opt-firmware.automount. Nov 3 13:32:48 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:48 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:48 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 13:32:48 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 13:32:48 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:49 kjcf05n03 systemd[1]: Set up automount mnt-llog.automount. Nov 3 13:32:49 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:49 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:49 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 13:32:49 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 13:32:49 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:49 kjcf05n03 systemd[1]: Set up automount usr-share-man.automount. Nov 3 13:32:49 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:32:49 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:32:49 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 13:32:49 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 13:32:49 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 13:32:49 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 13:32:49 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 13:32:49 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 13:32:49 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 13:32:49 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 13:32:49 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 13:32:49 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 13:32:49 kjcf05n03 systemd[1]: Reloading. Nov 3 13:32:49 kjcf05n03 systemd[1]: Starting Crash recovery kernel arming... Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: kdump: No kdump initial ramdisk found. Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 13:32:50 kjcf05n03 dracut[7932]: dracut-049-135.git20210121.el8 Nov 3 13:32:50 kjcf05n03 dracut[7934]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 13:32:50 kjcf05n03 dracut[7934]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 13:32:50 kjcf05n03 dracut[7934]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 13:32:50 kjcf05n03 dracut[7934]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 13:32:50 kjcf05n03 dracut[7934]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 13:32:50 kjcf05n03 dracut[7934]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 13:32:50 kjcf05n03 dracut[7934]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 13:32:50 kjcf05n03 dracut[7934]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + is_func check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ type -t check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 0 -ne 0 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check -h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local dev holder Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + require_binaries mdadm expr Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _module_name=90hperaid Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ mdadm = \-\m ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for cmd in "$@" Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + find_binary mdadm Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for cmd in "$@" Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + find_binary expr Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n -h ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for dev in "${!host_fs_types[@]}" Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ nfs != *_raid_member ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + continue Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _ret=255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + ret=255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ 255 = 0 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ 255 = 255 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ module_depends hperaid Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: +++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: +++ set -x Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ depends Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo rootfs-block Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ return 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ _ret=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ return 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for _moddep in $(module_depends $_mod) Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all == *\ hperaid\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + add_dracutmodules+=' rootfs-block ' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ == *\ hperaid\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check_module rootfs-block Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _mod=rootfs-block Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddep Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ == *\ rootfs-block\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n '' ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all == *\ rootfs-block\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + module_check rootfs-block 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _forced=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 2 -eq 2 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _forced=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + is_func check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ type -t check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 0 -ne 0 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check -h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _ret=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + ret=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ 0 = 0 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ module_depends rootfs-block Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: +++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 13:32:50 kjcf05n03 kdumpctl[3072]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ depends Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo fs-lib Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ _ret=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ return 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for _moddep in $(module_depends $_mod) Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all == *\ rootfs-block\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + add_dracutmodules+=' fs-lib ' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ == *\ rootfs-block\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check_module fs-lib Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _mod=fs-lib Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddep Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n '' ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + mods_checked_as_dep+=' fs-lib ' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all == *\ fs-lib\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + module_check fs-lib 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _forced=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 2 -eq 2 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _forced=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + is_func check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ type -t check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 0 -ne 0 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check -h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _ret=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + ret=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ 0 = 0 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ module_depends fs-lib Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: +++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ depends Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ return 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ _ret=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ return 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + mods_to_load+=' fs-lib ' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + mods_to_load+=' rootfs-block ' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + mods_to_load+=' hperaid ' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _mod=90kernel-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _mod=kernel-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check_module kernel-modules 1 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _mod=kernel-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddep Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n 1 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all = all ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + module_check kernel-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _forced=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 1 -eq 2 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + is_func check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ type -t check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 0 -ne 0 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check -h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + true Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _ret=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + ret=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ 0 != 0 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ module_depends kernel-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: +++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ depends Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ true Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ _ret=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ return 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + mods_to_load+=' kernel-modules ' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _mod=90kernel-modules-extra Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _mod=kernel-modules-extra Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check_module kernel-modules-extra 1 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _mod=kernel-modules-extra Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddep Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n 1 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all = all ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + module_check kernel-modules-extra Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _forced=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 1 -eq 2 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + is_func check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ type -t check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 0 -ne 0 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check -h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + true Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _ret=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + ret=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ 0 != 0 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ module_depends kernel-modules-extra Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: +++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ depends Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ true Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ _ret=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ return 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + mods_to_load+=' kernel-modules-extra ' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _mod=90kernel-network-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _mod=kernel-network-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check_module kernel-network-modules 1 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _mod=kernel-network-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddep Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n 1 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all = all ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + module_check kernel-network-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _forced=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 1 -eq 2 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + is_func check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ type -t check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 0 -ne 0 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check -h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _ret=255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + ret=255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ 255 != 0 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n 1 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 1 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _mod=90livenet Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _mod=livenet Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check_module livenet 1 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _mod=livenet Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddep Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n 1 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all = all ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + module_check livenet Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _forced=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 1 -eq 2 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + is_func check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ type -t check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 0 -ne 0 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check -h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _ret=255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + ret=255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ 255 != 0 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n 1 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 1 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _mod=90lvm Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _mod=lvm Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check_module lvm 1 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _mod=lvm Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddep Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n 1 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all = all ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + module_check lvm Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _forced=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 1 -eq 2 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + is_func check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ type -t check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 0 -ne 0 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check -h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + require_binaries lvm Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _module_name=90lvm Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ lvm = \-\m ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for cmd in "$@" Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + find_binary lvm Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n -h ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for fs in "${host_fs_types[@]}" Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ nfs = LVM*_member ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _ret=255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + ret=255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ 255 != 0 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n 1 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 1 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _mod=90mdraid Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _mod=mdraid Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check_module mdraid 1 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _mod=mdraid Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddep Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n 1 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all = all ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + module_check mdraid Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _forced=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 1 -eq 2 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + is_func check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ type -t check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 0 -ne 0 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check -h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _rootdev Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + require_binaries mdadm expr Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _module_name=90mdraid Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ mdadm = \-\m ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for cmd in "$@" Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + find_binary mdadm Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for cmd in "$@" Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + find_binary expr Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n -h ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for dev in "${!host_fs_types[@]}" Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ nfs != *_raid_member ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + continue Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _ret=255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + ret=255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ 255 != 0 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n 1 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 1 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _mod=90multipath Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _mod=multipath Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check_module multipath 1 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _mod=multipath Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddep Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n 1 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all = all ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + module_check multipath Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _forced=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 1 -eq 2 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + is_func check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ type -t check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 0 -ne 0 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check -h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _rootdev Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n -h ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for_each_host_dev_and_slaves is_mpath Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _func=is_mpath Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _dev Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for _dev in "${host_devs[@]}" Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + continue Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 1 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _ret=255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + ret=255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ 255 != 0 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n 1 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 1 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _mod=90qemu Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _mod=qemu Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check_module qemu 1 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _mod=qemu Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddep Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n 1 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all = all ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + module_check qemu Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _forced=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 1 -eq 2 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + is_func check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ type -t check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 0 -ne 0 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check -h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n -h ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + type -P systemd-detect-virt Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ systemd-detect-virt --vm Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + vm=none Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + (( 1 != 0 )) Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _ret=255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + ret=255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ 255 != 0 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n 1 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 1 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _mod=90qemu-net Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _mod=qemu-net Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check_module qemu-net 1 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _mod=qemu-net Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddep Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n 1 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all = all ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + module_check qemu-net Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _forced=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 1 -eq 2 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + is_func check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ type -t check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 0 -ne 0 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check -h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n -h ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + type -P systemd-detect-virt Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ systemd-detect-virt --vm Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + vm= Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + (( 1 != 0 )) Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _ret=255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + ret=255 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ 255 != 0 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n 1 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + return 1 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _mod=90stratis Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + _mod=stratis Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check_module stratis 1 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _mod=stratis Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddep Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -n 1 ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ all = all ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + module_check stratis Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ read a b Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _forced=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _hostonly=-h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 1 -eq 2 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + is_func check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: ++ type -t check Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + '[' 0 -ne 0 ']' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + check -h Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _module_name=90stratis Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + local _ret=0 Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + [[ stratisd-init = \-\m ]] Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + for cmd in "$@" Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + find_binary stratisd-init Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 13:32:50 kjcf05n03 kdumpctl[7820]: + set +x Nov 3 13:32:50 kjcf05n03 dracut[7934]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 13:32:50 kjcf05n03 dracut[7934]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 13:32:50 kjcf05n03 dracut[7934]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 13:32:51 kjcf05n03 dracut[7934]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 13:32:51 kjcf05n03 dracut[7934]: memstrack is available Nov 3 13:32:51 kjcf05n03 dracut[7934]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 13:32:51 kjcf05n03 dracut[7934]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 13:32:51 kjcf05n03 dracut[7934]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 13:32:51 kjcf05n03 dracut[7934]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 13:32:51 kjcf05n03 dracut[7934]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 13:32:51 kjcf05n03 dracut[7934]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 13:32:51 kjcf05n03 dracut[7934]: *** Including module: bash *** Nov 3 13:32:51 kjcf05n03 dracut[7934]: *** Including module: systemd *** Nov 3 13:32:52 kjcf05n03 dracut[7934]: *** Including module: fips *** Nov 3 13:32:52 kjcf05n03 dracut[7934]: *** Including module: systemd-initrd *** Nov 3 13:32:52 kjcf05n03 dracut[7934]: *** Including module: watchdog-modules *** Nov 3 13:32:52 kjcf05n03 dracut[7934]: *** Including module: nss-softokn *** Nov 3 13:32:52 kjcf05n03 dracut[7934]: *** Including module: i18n *** Nov 3 13:32:52 kjcf05n03 dracut[7934]: No KEYMAP configured. Nov 3 13:32:52 kjcf05n03 dracut[7934]: *** Including module: network-legacy *** Nov 3 13:32:53 kjcf05n03 dracut[7934]: *** Including module: network *** Nov 3 13:32:53 kjcf05n03 dracut[7934]: *** Including module: ib_bonding *** Nov 3 13:32:53 kjcf05n03 dracut[7934]: *** Including module: drm *** Nov 3 13:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 13:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 13:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 13:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 13:32:56 kjcf05n03 dcs-collectord[5624]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 13:32:56 kjcf05n03 dcs-collectord[5624]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 13:32:57 kjcf05n03 dracut[7934]: *** Including module: hperaid *** Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + install Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + local rule rule_path Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + inst_multiple cat expr Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.XuDC5l/initramfs -a -f cat expr Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + _ret=0 Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + (( 0 != 0 )) Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + : Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + return 0 Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + inst_multiple -o mdmon Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.XuDC5l/initramfs -a -f -o mdmon Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + _ret=0 Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + (( 0 != 0 )) Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + : Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + return 0 Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: ++ command -v partx Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + inst /usr/sbin/partx /sbin/partx Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + local _hostonly_install Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + [[ -e /tmp/dracut.XuDC5l/initramfs//sbin/partx ]] Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.XuDC5l/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + (( 0 != 0 )) Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + : Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: ++ command -v mdadm Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + local _hostonly_install Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + [[ -e /tmp/dracut.XuDC5l/initramfs//sbin/mdadm ]] Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.XuDC5l/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + (( 0 != 0 )) Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + : Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + [[ yes == \y\e\s ]] Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + local _raidconf Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: ++ cmdline Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: ++ local _activated dev line UUID Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: ++ declare -A _activated Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: ++ for dev in "${!host_fs_types[@]}" Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: ++ [[ nfs != *_raid_member ]] Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: ++ continue Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + _raidconf= Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + [[ -n '' ]] Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + inst_rules 64-md-raid.rules Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + local _target=/etc/udev/rules.d _rule _found Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + inst_dir /usr/lib/udev/rules.d Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + [[ -e /tmp/dracut.XuDC5l/initramfs//usr/lib/udev/rules.d ]] Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + return 0 Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + inst_dir /etc/udev/rules.d Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + [[ -e /tmp/dracut.XuDC5l/initramfs//etc/udev/rules.d ]] Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + return 0 Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + for _rule in "$@" Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + continue Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + continue Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + for r in '' $dracutbasedir/rules.d/ Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + [[ 64-md-raid.rules != /* ]] Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + continue Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + for r in '' $dracutbasedir/rules.d/ Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + continue Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + [[ -n '' ]] Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + set +x Nov 3 13:32:57 kjcf05n03 dracut[7934]: Skipping udev rule: 64-md-raid.rules Nov 3 13:32:57 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n03": interface became available Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + installkernel Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + instmods =drivers/md Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + local _optional=-o Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + local _silent Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + local _ret Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + [[ '' = yes ]] Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + [[ =drivers/md = \-\c ]] Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + [[ =drivers/md = \-\s ]] Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + (( 1 == 0 )) Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.XuDC5l/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + _ret=0 Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + (( 0 != 0 )) Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + [[ -n '' ]] Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + return 0 Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + _ret=0 Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + unset check depends cmdline install installkernel Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + return 0 Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + modules_loaded+='hperaid ' Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + '[' -n '' ']' Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + _d_mod=90kernel-modules Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + _d_mod=kernel-modules Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + [[ '' = yes ]] Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + dinfo '*** Including module: kernel-modules ***' Nov 3 13:32:57 kjcf05n03 kdumpctl[7820]: + set +x Nov 3 13:32:57 kjcf05n03 dracut[7934]: *** Including module: kernel-modules *** Nov 3 13:32:57 kjcf05n03 dracut[7934]: *** Including module: kernel-modules-extra *** Nov 3 13:32:58 kjcf05n03 dracut[7934]: *** Including module: kernel-network-modules *** Nov 3 13:32:58 kjcf05n03 dracut[7934]: *** Including module: diskless-mod *** Nov 3 13:32:58 kjcf05n03 dracut[7934]: *** Including module: fstab-sys *** Nov 3 13:32:58 kjcf05n03 dracut[7934]: *** Including module: nfs *** Nov 3 13:32:59 kjcf05n03 dracut[7934]: *** Including module: rootfs-block *** Nov 3 13:32:59 kjcf05n03 dracut[7934]: *** Including module: terminfo *** Nov 3 13:32:59 kjcf05n03 dracut[7934]: *** Including module: udev-rules *** Nov 3 13:32:59 kjcf05n03 dracut[7934]: Skipping udev rule: 91-permissions.rules Nov 3 13:32:59 kjcf05n03 dracut[7934]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 13:32:59 kjcf05n03 dracut[7934]: *** Including module: dracut-systemd *** Nov 3 13:32:59 kjcf05n03 dracut[7934]: *** Including module: usrmount *** Nov 3 13:32:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 13:32:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 13:33:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 13:33:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 13:33:00 kjcf05n03 dracut[7934]: *** Including module: base *** Nov 3 13:33:00 kjcf05n03 dracut[7934]: *** Including module: fs-lib *** Nov 3 13:33:00 kjcf05n03 dracut[7934]: *** Including module: kdumpbase *** Nov 3 13:33:00 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 13:33:00 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 13:33:00 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 13:33:00 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running Nov 3 13:33:00 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 13:33:01 kjcf05n00 zabbix-server[1293272]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 13:33:01 kjcf05n00 zabbix-server[1293272]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n03 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n03:system.uptime): 00:02:49\\"}}"' Nov 3 13:33:01 kjcf05n03 dracut[7934]: *** Including module: memstrack *** Nov 3 13:33:01 kjcf05n03 dracut[7934]: *** Including module: shutdown *** Nov 3 13:33:01 kjcf05n03 dracut[7934]: *** Including module: squash *** Nov 3 13:33:01 kjcf05n03 dracut[7934]: *** Including modules done *** Nov 3 13:33:01 kjcf05n03 dracut[7934]: *** Installing kernel module dependencies *** Nov 3 13:33:01 kjcf05n03 dracut[7934]: *** Installing kernel module dependencies done *** Nov 3 13:33:01 kjcf05n00 log_interesting_event.py[1293272]: Event '46260' acknowledged Nov 3 13:33:02 kjcf05n03 dracut[7934]: *** Resolving executable dependencies *** Nov 3 13:33:03 kjcf05n03 dracut[7934]: *** Resolving executable dependencies done*** Nov 3 13:33:03 kjcf05n03 dracut[7934]: *** Hardlinking files *** Nov 3 13:33:03 kjcf05n03 dracut[7934]: *** Hardlinking files done *** Nov 3 13:33:03 kjcf05n03 dracut[7934]: *** Generating early-microcode cpio image *** Nov 3 13:33:03 kjcf05n03 dracut[7934]: *** Constructing AuthenticAMD.bin **** Nov 3 13:33:03 kjcf05n03 dracut[7934]: *** Store current command line parameters *** Nov 3 13:33:03 kjcf05n03 dracut[7934]: Stored kernel commandline: Nov 3 13:33:03 kjcf05n03 dracut[7934]: rd.driver.pre=sd_mod Nov 3 13:33:03 kjcf05n03 dracut[7934]: rd.driver.pre=nvme Nov 3 13:33:03 kjcf05n03 dracut[7934]: rd.driver.pre=ipmi_si Nov 3 13:33:03 kjcf05n03 dracut[7934]: rd.driver.pre=ipmi_devintf Nov 3 13:33:03 kjcf05n03 dracut[7934]: rd.driver.pre=ipmi_msghandler Nov 3 13:33:03 kjcf05n03 dracut[7934]: nameserver=172.16.2.2 Nov 3 13:33:03 kjcf05n03 dracut[7934]: nameserver=127.0.0.1 Nov 3 13:33:03 kjcf05n03 dracut[7934]: nameserver=172.16.2.2 Nov 3 13:33:03 kjcf05n03 dracut[7934]: nameserver=127.0.0.1 Nov 3 13:33:03 kjcf05n03 dracut[7934]: ifname=kdump-meth0:00:09:3d:06:9a:1a team=mgmt0:kdump-meth0 Nov 3 13:33:03 kjcf05n03 dracut[7934]: rd.neednet Nov 3 13:33:03 kjcf05n03 dracut[7934]: kdumpnic=mgmt0 Nov 3 13:33:03 kjcf05n03 dracut[7934]: bootdev=mgmt0 Nov 3 13:33:03 kjcf05n03 dracut[7934]: *** Install squash loader *** Nov 3 13:33:03 kjcf05n03 dracut[7934]: *** Squashing the files inside the initramfs *** Nov 3 13:33:04 kjcf05n03 dracut[7934]: *** Squashing the files inside the initramfs done *** Nov 3 13:33:04 kjcf05n03 dracut[7934]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 13:33:04 kjcf05n03 dracut[7934]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 13:33:05 kjcf05n03 kdumpctl[7820]: kdump: kexec: loaded kdump kernel Nov 3 13:33:05 kjcf05n03 kdumpctl[7820]: kdump: Starting kdump: [OK] Nov 3 13:33:05 kjcf05n03 systemd[1]: Started Crash recovery kernel arming. Nov 3 13:33:05 kjcf05n03 systemd[1]: Reloading. Nov 3 13:33:05 kjcf05n03 systemd[3072]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:33:05 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:33:05 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:33:05 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 13:33:05 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 13:33:05 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 13:33:05 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 13:33:05 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 13:33:05 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 13:33:05 kjcf05n03 ifdown[14609]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 13:33:05 kjcf05n03 ifdown[14610]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:33:05 kjcf05n03 ifdown[14611]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:33:05 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 13:33:05 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 13:33:05 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 13:33:06 kjcf05n03 ifup[14671]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 13:33:06 kjcf05n03 ifup[14672]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:33:06 kjcf05n03 ifup[14673]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:33:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730662385', 'host':'kjcf05n03', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 13:33:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730662385', 'host':'kjcf05n03', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 13:33:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730662385'} Nov 3 13:33:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730662385'} Nov 3 13:33:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:33:07 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 13:33:07 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 13:33:09 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 13:33:09 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 13:33:09 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 13:33:09 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running Nov 3 13:33:09 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 13:33:10 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 13:33:10 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 13:33:10 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 13:33:10 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:33:10 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:33:10 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:33:10 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:33:10 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 13:33:10 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 13:33:10 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 13:33:10 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 13:33:10 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:33:10 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:33:10 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:33:10 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:33:10 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 13:33:10 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 13:33:10 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 13:33:10 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 13:33:10 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 13:33:10 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 13:33:10 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 13:33:10 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 13:33:10 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 13:33:10 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 13:33:10 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 13:33:10 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 13:33:10 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 13:33:10 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 13:33:10 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 13:33:10 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 13:33:10 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 13:33:10 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 13:33:10 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 13:33:10 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 13:33:10 kjcf05n03 ifdown[14951]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 13:33:10 kjcf05n03 ifdown[14952]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:33:10 kjcf05n03 ifdown[14953]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:33:10 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 13:33:10 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 13:33:10 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 13:33:11 kjcf05n03 ifup[15013]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 13:33:11 kjcf05n03 ifup[15014]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:33:11 kjcf05n03 ifup[15015]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:33:11 kjcf05n03 dcs-collectord[5624]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 13:33:11 kjcf05n03 dcs-collectord[5624]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 13:33:12 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 13:33:12 kjcf05n00 mcfcli[3673891]: %3|1730662392.585|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 13:33:15 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 13:33:15 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 13:33:15 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 13:33:15 kjcf05n03 systemd[1]: Reloading. Nov 3 13:33:15 kjcf05n03 systemd[1]: Starting Corosync Cluster Engine... Nov 3 13:33:15 kjcf05n03 await_ha_peer[15214]: Waiting for HA peer kjcf05n02 Nov 3 13:33:16 kjcf05n03 await_ha_peer[15214]: Peer kjcf05n02 has started, starting HA Nov 3 13:33:17 kjcf05n03 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 13:33:17 kjcf05n03 systemd[1]: Started Corosync Cluster Engine. Nov 3 13:33:17 kjcf05n03 systemd[1]: Started Fast STONITH daemon. Nov 3 13:33:17 kjcf05n03 fstonithd.py[15308]: Listening for kdump packets from partner Nov 3 13:33:17 kjcf05n03 systemd[1]: Reloading. Nov 3 13:33:17 kjcf05n03 systemd[3072]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:33:17 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:33:17 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:33:18 kjcf05n03 systemd[1]: Reloading. Nov 3 13:33:18 kjcf05n03 systemd[1]: Reached target resource-agents dependencies. Nov 3 13:33:18 kjcf05n03 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 13:33:18 kjcf05n03 systemd[1]: Reloading. Nov 3 13:33:18 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 13:33:18 kjcf05n03 puppet-agent[3553]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 13:33:18 kjcf05n03 puppet[3553]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 13:33:18 kjcf05n03 puppet-agent[3553]: Applied catalog in 92.94 seconds Nov 3 13:33:18 kjcf05n03 puppet[3553]: Notice: Applied catalog in 92.94 seconds Nov 3 13:33:18 kjcf05n03 systemd[1]: Started Puppet agent. Nov 3 13:33:18 kjcf05n03 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 13:33:18 kjcf05n03 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 13:33:18 kjcf05n03 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 13:33:18 kjcf05n03 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 13:33:18 kjcf05n03 systemd[1]: Starting Set absolute GEM time... Nov 3 13:33:18 kjcf05n03 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 13:33:18 kjcf05n03 systemd[1]: Reached target Timers. Nov 3 13:33:18 kjcf05n03 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 13:33:18 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 13:33:18 kjcf05n03 wce-disable.sh[15498]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 13:33:18 kjcf05n03 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 13:33:18 kjcf05n03 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 13:33:18 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 13:33:18 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 13:33:18 kjcf05n03 systemd[1]: set_gem_time.service: Succeeded. Nov 3 13:33:18 kjcf05n03 systemd[1]: Started Set absolute GEM time. Nov 3 13:33:18 kjcf05n03 python3.9[15496]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 13:33:18 kjcf05n03 gateway-ec-node.py[15495]: Starting gateway-ec-node service Nov 3 13:33:18 kjcf05n03 python3.9[15496]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 13:33:18 kjcf05n03 RFSF-API[15494]: INFO[2024-11-03T13:33:18-06:00] Datapath API RESTful Service starting Nov 3 13:33:18 kjcf05n03 dp-api-server-node[15494]: INFO[2024-11-03T13:33:18-06:00] Datapath API RESTful Service starting Nov 3 13:33:18 kjcf05n03 RFSF-API[15494]: INFO[2024-11-03T13:33:18-06:00] Running in production mode, starting dbus event listener Nov 3 13:33:18 kjcf05n03 dp-api-server-node[15494]: INFO[2024-11-03T13:33:18-06:00] Running in production mode, starting dbus event listener Nov 3 13:33:18 kjcf05n03 RFSF-API[15494]: INFO[2024-11-03T13:33:18-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 13:33:18 kjcf05n03 dp-api-server-node[15494]: INFO[2024-11-03T13:33:18-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 13:33:18 kjcf05n03 RFSF-API[15494]: INFO[2024-11-03T13:33:18-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 13:33:18 kjcf05n03 dp-api-server-node[15494]: INFO[2024-11-03T13:33:18-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 13:33:18 kjcf05n03 RFSF-API[15494]: INFO[2024-11-03T13:33:18-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 13:33:18 kjcf05n03 dp-api-server-node[15494]: INFO[2024-11-03T13:33:18-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 13:33:18 kjcf05n03 RFSF-API[15494]: INFO[2024-11-03T13:33:18-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 13:33:18 kjcf05n03 dp-api-server-node[15494]: INFO[2024-11-03T13:33:18-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 13:33:18 kjcf05n03 RFSF-API[15494]: INFO[2024-11-03T13:33:18-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 13:33:18 kjcf05n03 dp-api-server-node[15494]: INFO[2024-11-03T13:33:18-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 13:33:18 kjcf05n03 RFSF-API[15494]: INFO[2024-11-03T13:33:18-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 13:33:18 kjcf05n03 dp-api-server-node[15494]: INFO[2024-11-03T13:33:18-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 13:33:18 kjcf05n03 RFSF-API[15494]: INFO[2024-11-03T13:33:18-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 13:33:18 kjcf05n03 dp-api-server-node[15494]: INFO[2024-11-03T13:33:18-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 13:33:18 kjcf05n03 RFSF-API[15494]: INFO[2024-11-03T13:33:18-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 13:33:18 kjcf05n03 RFSF-API[15494]: INFO[2024-11-03T13:33:18-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 13:33:18 kjcf05n03 dp-api-server-node[15494]: INFO[2024-11-03T13:33:18-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 13:33:18 kjcf05n03 dp-api-server-node[15494]: INFO[2024-11-03T13:33:18-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 13:33:18 kjcf05n03 dp-api-server-node[15494]: INFO[2024-11-03T13:33:18-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 13:33:18 kjcf05n03 RFSF-API[15494]: INFO[2024-11-03T13:33:18-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 13:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730662399', 'host':'kjcf05n03', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 13:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730662399', 'host':'kjcf05n03', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 13:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730662399'} Nov 3 13:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730662399'} Nov 3 13:33:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:33:19 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 13:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730662399', 'host':'kjcf05n03', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.63, 1.82, 0.83'}"] Nov 3 13:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Load', 'description': 'OK - load average: 1.63, 1.82, 0.83', 'message': 'OK - load average: 1.63, 1.82, 0.83', 'value': 'ok', 'timestamp': '1730662399'} Nov 3 13:33:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730662399', 'host':'kjcf05n03', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 346 processes with STATE = RSZDT '}"] Nov 3 13:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Total Processes', 'description': 'PROCS OK: 346 processes with STATE = RSZDT ', 'message': 'PROCS OK: 346 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730662399'} Nov 3 13:33:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:33:21 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31436 deleted. Nov 3 13:33:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730662402', 'host':'kjcf05n03', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 13:33:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730662402'} Nov 3 13:33:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:33:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730662402', 'host':'kjcf05n03', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(336.0B/360.0B), ib1=(56.0B/360.0B), icl0=(5.6kB/8.8kB), lo=(600.0B/600.0B), meth0=(1541.2MB/7.8MB), mgmt0=(1478.0MB/7.8MB)'}"] Nov 3 13:33:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(336.0B/360.0B), ib1=(56.0B/360.0B), icl0=(5.6kB/8.8kB), lo=(600.0B/600.0B), meth0=(1541.2MB/7.8MB), mgmt0=(1478.0MB/7.8MB)', 'message': 'NET OK - (Rx/Tx) ib0=(336.0B/360.0B), ib1=(56.0B/360.0B), icl0=(5.6kB/8.8kB), lo=(600.0B/600.0B), meth0=(1541.2MB/7.8MB), mgmt0=(1478.0MB/7.8MB)', 'value': 'ok', 'timestamp': '1730662402'} Nov 3 13:33:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:33:22 kjcf05n00 mcfcli[3673891]: %3|1730662402.551|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:33:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730662403', 'host':'kjcf05n03', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.5% (3901092 kB) used.'}"] Nov 3 13:33:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'RAM usage', 'description': 'OK - 1.5% (3901092 kB) used.', 'message': 'OK - 1.5% (3901092 kB) used.', 'value': 'ok', 'timestamp': '1730662403'} Nov 3 13:33:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:33:25 kjcf05n03 systemd[1]: Reloading. Nov 3 13:33:25 kjcf05n03 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 13:33:25 kjcf05n03 systemd[1]: Reloading. Nov 3 13:33:26 kjcf05n03 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 13:33:26 kjcf05n03 dcs-collectord[5624]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 13:33:26 kjcf05n03 dcs-collectord[5624]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 13:33:26 kjcf05n03 dcs-collectord[5624]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 13:33:26 kjcf05n03 diskmonitor_pre[15951]: Key management is currently disabled.DEAR disabled Nov 3 13:33:26 kjcf05n03 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 13:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T13:33:27.253065348-06:00 level=info msg="Completed cleanup jobs" duration=26.312308ms Nov 3 13:33:28 kjcf05n03 sh[16020]: LNET configured: New Created Nov 3 13:33:28 kjcf05n03 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 13:33:28 kjcf05n03 LCNmon[18111]: Interface ib0 is up Nov 3 13:33:28 kjcf05n03 LCNmon[18111]: Interface ib1 is up Nov 3 13:33:28 kjcf05n03 LCNmon[18111]: Can ping through interface ib0 Nov 3 13:33:28 kjcf05n03 LCNmon[18111]: Can ping through interface ib1 Nov 3 13:33:28 kjcf05n03 LCNmon[18111]: NIC ib0, initial state UP Nov 3 13:33:28 kjcf05n03 LCNmon[18111]: NIC ib1, initial state UP Nov 3 13:33:28 kjcf05n03 LCNmon[18111]: LCNstat initial state UP Nov 3 13:33:28 kjcf05n00 httpd[902572]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-B): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n03', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 13:33:28 kjcf05n03 LCNmon[18111]: LCNmon monitoring hosts kjcf05n03 and kjcf05n02 Nov 3 13:33:29 kjcf05n03 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 13:33:29 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18225 (bash) Nov 3 13:33:29 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 13:33:29 kjcf05n03 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 13:33:29 kjcf05n03 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 13:33:29 kjcf05n03 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 13:33:29 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: /var/run/diskmonitor does not exist, creating Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: Creating /var/run/diskmonitor/disk Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: Creating /var/run/diskmonitor/encl Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: Creating /var/run/diskmonitor/cli Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: RAS_Interlocks_enabled: 1 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: add handler for sig: 14 sa_flags: 10000004 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: add handler for sig: 1 sa_flags: 10000004 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: add handler for sig: 2 sa_flags: 00000004 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: add handler for sig: 15 sa_flags: 00000004 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: add handler for sig: 6 sa_flags: 00000004 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: add handler for sig: 3 sa_flags: 00000004 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: add handler for sig: 30 sa_flags: 00000004 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: add handler for sig: 20 sa_flags: 00000004 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: add handler for sig: 10 sa_flags: 10000004 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: add handler for sig: 11 sa_flags: 00000004 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: add handler for sig: 7 sa_flags: 00000004 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: add handler for sig: 4 sa_flags: 00000004 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: add handler for sig: 8 sa_flags: 00000004 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: Using HA Baton locks - key: diskmonitor Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: Baton will be held for at most 570 seconds Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: DMMP Enabled: 0 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: random seed: 3a1a9939 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: NVMe Enclosure: 1 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: ZFS Enclosure: 0 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: Dbus, Initialized Connection Successfully Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: int_catcher_thread: thread start Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: Received dbus message 4 org.freedesktop.DBus -> :1.111 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b07bec_S4EUNF0MA05386M encl_slot: 0 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b07bed_S4EUNF0MA05387D encl_slot: 0 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 13:33:30 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 13:33:31 kjcf05n03 openhpid[5530]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 13:33:31 kjcf05n03 openhpid[5530]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 13:33:31 kjcf05n03 systemd[1]: openhpid.service: Succeeded. Nov 3 13:33:31 kjcf05n03 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 13:33:31 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 13:33:31 kjcf05n03 systemd[1]: openhpid.service: Supervising process 18526 which is not our child. We'll most likely not notice when it exits. Nov 3 13:33:31 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 13:33:31 kjcf05n03 systemd[1]: Reached target Multi-User System. Nov 3 13:33:31 kjcf05n03 systemd[1]: Reached target Graphical Interface. Nov 3 13:33:31 kjcf05n03 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 13:33:31 kjcf05n03 dcs-collectord[5624]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 13:33:31 kjcf05n03 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 13:33:31 kjcf05n03 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 13:33:31 kjcf05n03 systemd[1]: Startup finished in 51.551s (kernel) + 2min 28.848s (userspace) = 3min 20.399s. Nov 3 13:33:31 kjcf05n03 openhpid[18526]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 13:33:31 kjcf05n03 openhpid[18526]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 13:33:31 kjcf05n03 openhpid[18526]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 13:33:31 kjcf05n03 openhpid[18526]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b07bed_S4EUNF0MA05387D encl_sn: USE26000024VS001, slot: 2 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: check_run_sedcmd, No Device name provided Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 13:33:35 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 13:33:41 kjcf05n03 dcs-collectord[5624]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 13:33:41 kjcf05n03 dcs-collectord[5624]: WARNING No data collected (hpi_parser.py:353) Nov 3 13:33:42 kjcf05n00 mcfcli[3673891]: %3|1730662422.585|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 13:33:55 kjcf05n03 ipmievd[3965]: System Event sensor - Timestamp Clock Sync Nov 3 13:33:56 kjcf05n03 ipmievd[3072]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:33:56 kjcf05n03 dcs-collectord[5624]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 13:33:57 kjcf05n00 mcfcli[3673891]: %3|1730662437.321|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b07bec_S4EUNF0MA05386M encl_sn: USE26000024VS001, slot: 1 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 13:34:09 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 13:34:11 kjcf05n03 dcs-collectord[5624]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 13:34:12 kjcf05n00 mcfcli[3673891]: %3|1730662452.585|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 13:34:17 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked thIEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 13:34:17 kjcf05n03 ras-resource-manager-agent[5888]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "9d450590-9a1a-11ef-85a7-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 13:34:17 kjcf05n03 ras-resource-manager-agent[5888]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '9d450590-9a1a-11ef-85a7-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 13:34:17 kjcf05n03 ras-resource-manager-agent[5888]: INFO Submitting new device inserted signal, starting to qualify drive: 9d450590-9a1a-11ef-85a7-00093d069a1b (admin_action.py:110) Nov 3 13:34:17 kjcf05n02 firmware-update-orc-server[5820]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "cc7944ec-e0d9-4538-8fe7-09c391e6c8f9"} (logger.py:65) Nov 3 13:34:17 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 86588 (get_disk_device) Nov 3 13:34:17 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 13:34:17 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 13:34:17 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '9d450590-9a1a-11ef-85a7-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 13:34:17 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '9d450590-9a1a-11ef-85a7-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 13:34:17 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '9d450590-9a1a-11ef-85a7-00093d069a1b', 'response ID': '9d4f37fe-9a1a-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 13:34:17 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 9d4f37fe-9a1a-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 13:34:17 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '9d977c58-9a1a-11ef-85a7-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 13:34:17 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '9d977c58-9a1a-11ef-85a7-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 13:34:17 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '9d977c58-9a1a-11ef-85a7-00093d069a1b', 'response ID': '9d9e86c4-9a1a-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 13:34:17 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 9d9e86c4-9a1a-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 13:34:17 kjcf05n02 ccp-client[86609]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 13:34:17 kjcf05n02 ccp-client[86609]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 13:34:17 kjcf05n02 ccp-client[86618]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 13:34:17 kjcf05n02 ccp-client[86609]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 13:34:17 kjcf05n02 ccp-client[86609]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 13:34:17 kjcf05n02 ccp-client[86618]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 13:34:17 kjcf05n02 ccp-client[86618]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 13:34:18 kjcf05n03 diskmonitor[17700]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 13:34:18 kjcf05n03 ras-resource-manager-agent[5888]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "9d977c58-9a1a-11ef-85a7-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 13:34:18 kjcf05n03 ras-resource-manager-agent[5888]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '9d977c58-9a1a-11ef-85a7-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 13:34:18 kjcf05n03 ras-resource-manager-agent[5888]: INFO Submitting new device inserted signal, starting to qualify drive: 9d977c58-9a1a-11ef-85a7-00093d069a1b (admin_action.py:110) Nov 3 13:34:18 kjcf05n03 firmware-update-orc-server[5844]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "297bcca3-535c-4262-af54-09cfd2657ae6"} (logger.py:65) Nov 3 13:34:20 kjcf05n02 DRVFW[86787]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 13:34:20 kjcf05n02 ccp-client[86788]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 13:34:20 kjcf05n02 ccp-client[86788]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 13:34:20 kjcf05n02 ccp-client[86797]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 13:34:20 kjcf05n02 ccp-client[86788]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 13:34:20 kjcf05n02 ccp-client[86788]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 13:34:20 kjcf05n02 ccp-client[86797]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 13:34:20 kjcf05n02 ccp-client[86797]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 13:34:20 kjcf05n02 firmware-update-orc-server[5820]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 13:34:21 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31437 deleted. Nov 3 13:34:22 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 9d4f37fe-9a1a-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 13:34:22 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '9d450590-9a1a-11ef-85a7-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': '9d450590-9a1a-11ef-85a7-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}}} (logger.py:65) Nov 3 13:34:22 kjcf05n03 ras-resource-manager-agent[5888]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '9d450590-9a1a-11ef-85a7-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 13:34:22 kjcf05n03 ras-resource-manager-agent[5888]: INFO Drive qualification complete responding: 9d450590-9a1a-11ef-85a7-00093d069a1b (admin_action.py:205) Nov 3 13:34:22 kjcf05n03 ras-resource-manager-agent[5888]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "9d450590-9a1a-11ef-85a7-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} (interesting_event.py:59) Nov 3 13:34:24 kjcf05n03 diskmonitor[17700]: e drive: eui.345950304db010260025384500000004 Nov 3 13:34:24 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 13:34:24 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 13:34:24 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 13:34:24 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 13:34:24 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 13:34:24 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 13:34:24 kjcf05n03 diskmonitor[17700]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 13:34:24 kjcf05n03 diskmonitor[17700]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 13:34:24 kjcf05n03 diskmonitor[17700]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 13:34:24 kjcf05n03 diskmonitor[17700]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 13:34:24 kjcf05n03 diskmonitor[17700]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 13:34:24 kjcf05n03 diskmonitor[17700]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "9d450590-9a1a-11ef-85a7-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 13:34:24 kjcf05n03 diskmonitor[17700]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 13:34:24 kjcf05n03 diskmonitor[17700]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 13:34:24 kjcf05n03 diskmonitor[17700]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "9d977c58-9a1a-11ef-85a7-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 13:34:24 kjcf05n03 diskmonitor[17700]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 13:34:24 kjcf05n03 diskmonitor[17700]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 13:34:27 kjcf05n02 nslcd[6893]: [e8944a] ldap_result() failed: Can't contact LDAP server Nov 3 13:34:27 kjcf05n02 nslcd[6893]: [5558ec] ldap_result() failed: Can't contact LDAP server Nov 3 13:34:27 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22443 (get_disk_device) Nov 3 13:34:27 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 13:34:27 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 13:34:28 kjcf05n03 ccp-client[22464]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 13:34:28 kjcf05n03 ccp-client[22464]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 13:34:28 kjcf05n03 ccp-client[22498]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 13:34:28 kjcf05n03 ccp-client[22464]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 13:34:28 kjcf05n03 ccp-client[22464]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 13:34:28 kjcf05n03 ccp-client[22498]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 13:34:28 kjcf05n03 ccp-client[22498]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 13:34:28 kjcf05n03 chronyd[5130]: Selected source 172.16.2.1 Nov 3 13:34:30 kjcf05n03 systemd[1]: Unmounting /mnt/llog... Nov 3 13:34:30 kjcf05n03 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 13:34:30 kjcf05n03 systemd[1]: Unmounted /mnt/llog. Nov 3 13:34:31 kjcf05n03 DRVFW[22703]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 13:34:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730662470}"] Nov 3 13:34:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730662470, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:34:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:34:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730662470}"] Nov 3 13:34:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730662470, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:34:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:34:31 kjcf05n03 ccp-client[22715]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 13:34:31 kjcf05n03 ccp-client[22715]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 13:34:31 kjcf05n03 ccp-client[22755]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 13:34:31 kjcf05n03 ccp-client[22715]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 13:34:31 kjcf05n03 ccp-client[22755]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 13:34:31 kjcf05n03 ccp-client[22755]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 13:34:31 kjcf05n03 ccp-client[22715]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 13:34:31 kjcf05n03 firmware-update-orc-server[5844]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 13:34:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730662470}"] Nov 3 13:34:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730662470, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:34:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:34:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730662470}"] Nov 3 13:34:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730662470, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:34:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:34:31 kjcf05n03 ras-resource-manager-agent[5888]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '9d977c58-9a1a-11ef-85a7-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 3 13:34:31 kjcf05n03 ras-resource-manager-agent[5888]: INFO Drive qualification complete responding: 9d977c58-9a1a-11ef-85a7-00093d069a1b (admin_action.py:205) Nov 3 13:34:31 kjcf05n03 ras-resource-manager-agent[5888]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "9d977c58-9a1a-11ef-85a7-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (interesting_event.py:59) Nov 3 13:34:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730662471}"] Nov 3 13:34:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730662471, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:34:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:34:31 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 9d9e86c4-9a1a-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 13:34:31 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '9d977c58-9a1a-11ef-85a7-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': '9d977c58-9a1a-11ef-85a7-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}}} (logger.py:65) Nov 3 13:34:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730662471}"] Nov 3 13:34:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730662471, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:34:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:34:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730662471}"] Nov 3 13:34:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730662471, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:34:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:34:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730662471}"] Nov 3 13:34:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730662471, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:34:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:34:35 kjcf05n03 python3.9[5193]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 13:34:35 kjcf05n00 mcfcli[3673891]: %3|1730662475.269|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:34:35 kjcf05n03 python3.9[3072]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:34:35 kjcf05n03 ras-resource-manager-agent[5888]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "9d450590-9a1a-11ef-85a7-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} (service_main_handler.py:66) Nov 3 13:34:35 kjcf05n03 ras-resource-manager-agent[5888]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '9d450590-9a1a-11ef-85a7-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 13:34:35 kjcf05n03 ras-resource-manager-agent[5888]: INFO Device qualification response has been acknowledged: 9d450590-9a1a-11ef-85a7-00093d069a1b (admin_action.py:151) Nov 3 13:34:35 kjcf05n03 ras-resource-manager-agent[5888]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "9d977c58-9a1a-11ef-85a7-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (service_main_handler.py:66) Nov 3 13:34:35 kjcf05n03 ras-resource-manager-agent[5888]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '9d977c58-9a1a-11ef-85a7-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 3 13:34:35 kjcf05n03 ras-resource-manager-agent[5888]: INFO Device qualification response has been acknowledged: 9d977c58-9a1a-11ef-85a7-00093d069a1b (admin_action.py:151) Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "9d450590-9a1a-11ef-85a7-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: Dbus, handle_ingress_ras_signals, uuid: 9d450590-9a1a-11ef-85a7-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "9d450590-9a1a-11ef-85a7-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "9d977c58-9a1a-11ef-85a7-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: Dbus, handle_ingress_ras_signals, uuid: 9d977c58-9a1a-11ef-85a7-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "9d977c58-9a1a-11ef-85a7-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 13:34:38 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 13:34:39 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 13:34:40 kjcf05n03 diskmonitor[17700]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 13:34:42 kjcf05n00 mcfcli[3673891]: %3|1730662482.585|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 13:34:44 kjcf05n03 diskmonitor[17700]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 13:34:44 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 13:34:44 kjcf05n03 diskmonitor[17700]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 13:34:44 kjcf05n03 diskmonitor[17700]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 13:34:44 kjcf05n03 diskmonitor[17700]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 13:34:44 kjcf05n03 diskmonitor[17700]: leaving test state: 1 next state: 2 Nov 3 13:34:44 kjcf05n03 diskmonitor[17700]: lock req: no timeout Nov 3 13:34:44 kjcf05n03 diskmonitor[17700]: leaving test state: 2 next state: 4 Nov 3 13:34:44 kjcf05n03 diskmonitor[17700]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 13:35:07 kjcf05n00 mcfcli[3673891]: %3|1730662507.803|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:35:10 kjcf05n00 python3.9[1294903]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 13:35:12 kjcf05n00 mcfcli[3673891]: %3|1730662512.586|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 13:35:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730662236', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 13:35:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730662236'} Nov 3 13:35:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:35:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730662236', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 13:35:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730662236'} Nov 3 13:35:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:35:38 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 13:35:38 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 13:35:38 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 13:35:42 kjcf05n00 mcfcli[3673891]: %3|1730662542.587|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:35:47 kjcf05n00 mcfcli[3673891]: %3|1730662547.800|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:35:48 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 13:35:48 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 13:35:48 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 13:35:52 kjcf05n03 dcs-collectord[5624]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 13:35:55 kjcf05n03 diskmonitor[17700]: lock acquired Nov 3 13:35:55 kjcf05n03 diskmonitor[17700]: leaving test state: 4 next state: 8 Nov 3 13:36:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730662561}"] Nov 3 13:36:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730662561, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:36:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:36:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:36:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:36:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:36:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:36:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:36:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:36:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:36:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:36:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:36:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:36:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:36:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:36:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.064106ms Nov 3 13:36:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:36:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.064106ms Nov 3 13:36:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:36:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:36:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:36:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730662564}"] Nov 3 13:36:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730662564, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:36:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:36:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:36:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:36:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:36:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:36:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:36:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:36:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:36:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:36:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:36:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:36:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:36:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:36:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.912862ms Nov 3 13:36:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:36:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.912862ms Nov 3 13:36:04 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:36:04 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:36:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:36:12 kjcf05n00 mcfcli[3673891]: %3|1730662572.587|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:36:16 kjcf05n03 diskmonitor[17700]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 13:36:16 kjcf05n03 diskmonitor[17700]: leaving test state: 8 next state: 20 Nov 3 13:36:16 kjcf05n03 diskmonitor[17700]: leaving test state: 20 next state: 40 Nov 3 13:36:16 kjcf05n03 diskmonitor[17700]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset bf71e48000 Nov 3 13:36:16 kjcf05n03 diskmonitor[17700]: leaving test state: 40 next state: 80 Nov 3 13:36:27 kjcf05n00 mcfcli[3673891]: %3|1730662587.797|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:36:42 kjcf05n00 mcfcli[3673891]: %3|1730662602.587|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:36:54 kjcf05n00 zabbix-server[1296202]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 13:36:54 kjcf05n00 zabbix-server[1296202]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n03' from event '46273' Nov 3 13:36:54 kjcf05n00 zabbix-server[1296202]: Host created 'enclosure_USE26000024VS001' Nov 3 13:36:54 kjcf05n00 zabbix-server[1296202]: Running puppet on 'kjcf05n03' Nov 3 13:36:56 kjcf05n03 puppet-agent[29142]: Using configured environment 'production' Nov 3 13:36:56 kjcf05n03 puppet-agent[29142]: Retrieving pluginfacts Nov 3 13:36:56 kjcf05n03 puppet-agent[29142]: Retrieving plugin Nov 3 13:36:56 kjcf05n03 puppet-agent[29142]: Loading facts Nov 3 13:37:00 kjcf05n03 puppet-agent[29142]: Caching catalog for kjcf05n03 Nov 3 13:37:00 kjcf05n03 puppet-agent[29142]: Applying configuration version '1730662618' Nov 3 13:37:02 kjcf05n03 puppet-agent[29142]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 13:37:02 kjcf05n03 puppet-agent[29142]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 13:37:02 kjcf05n03 puppet-agent[29142]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 13:37:02 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 13:37:02 kjcf05n03 zabbix_agent2[5972]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 13:37:02 kjcf05n03 zabbix_agent2[3072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:37:02 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 13:37:02 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 13:37:02 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 13:37:02 kjcf05n03 puppet-agent[29142]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: Press Ctrl+C to exit. Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: Plugin support version 1.0 Nov 3 13:37:02 kjcf05n03 zabbix_agent2[29498]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 13:37:04 kjcf05n03 puppet-agent[29142]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 13:37:04 kjcf05n03 puppet-agent[29142]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 13:37:04 kjcf05n03 puppet-agent[29142]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 13:37:05 kjcf05n03 puppet-agent[29142]: Applied catalog in 5.19 seconds Nov 3 13:37:04 kjcf05n00 zabbix-server[1296202]: puppet completed status:(0): '' Nov 3 13:37:05 kjcf05n00 zabbix-server[1296202]: Event '46273' acknowledged Nov 3 13:37:05 kjcf05n00 zabbix-server[1296202]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n03"}' Nov 3 13:37:06 kjcf05n00 mcfcli[3673891]: %3|1730662626.440|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:37:09 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 13:37:12 kjcf05n00 mcfcli[3673891]: %3|1730662632.588|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:37:13 kjcf05n03 diskmonitor[17700]: leaving test state: 80 next state: 100 Nov 3 13:37:13 kjcf05n03 diskmonitor[17700]: lock release: time: Sun Nov 3 13:37:07 2024 Nov 3 13:37:13 kjcf05n03 diskmonitor[17700]: leaving test state: 100 next state: 1 Nov 3 13:37:42 kjcf05n00 mcfcli[3673891]: %3|1730662662.588|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:37:46 kjcf05n00 mcfcli[3673891]: %3|1730662666.437|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:38:12 kjcf05n00 mcfcli[3673891]: %3|1730662692.588|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:38:25 kjcf05n00 mcfcli[3673891]: %3|1730662705.722|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:38:42 kjcf05n00 mcfcli[3673891]: %3|1730662722.589|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:39:05 kjcf05n00 mcfcli[3673891]: %3|1730662745.719|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:39:12 kjcf05n00 mcfcli[3673891]: %3|1730662752.589|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:39:42 kjcf05n00 mcfcli[3673891]: %3|1730662782.287|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:39:42 kjcf05n00 mcfcli[3673891]: %3|1730662782.589|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 13:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 13:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 13:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 13:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 13:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 13:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 13:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 13:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 13:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 13:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 13:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 13:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 13:40:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 13:40:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:40:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 13:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 13:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 13:40:10 kjcf05n00 python3.9[1297773]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 13:40:12 kjcf05n00 mcfcli[3673891]: %3|1730662812.589|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 13:40:20 kjcf05n00 mcfcli[3673891]: %3|1730662820.034|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:40:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730662236', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 13:40:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730662236'} Nov 3 13:40:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:40:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730662236', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 13:40:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730662236'} Nov 3 13:40:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:40:42 kjcf05n00 mcfcli[3673891]: %3|1730662842.590|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:40:57 kjcf05n00 mcfcli[3673891]: %3|1730662857.980|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:41:12 kjcf05n00 mcfcli[3673891]: %3|1730662872.591|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:41:37 kjcf05n00 mcfcli[3673891]: %3|1730662897.977|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:41:42 kjcf05n00 mcfcli[3673891]: %3|1730662902.591|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:42:12 kjcf05n00 mcfcli[3673891]: %3|1730662932.591|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:42:17 kjcf05n00 mcfcli[3673891]: %3|1730662937.974|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:42:42 kjcf05n00 mcfcli[3673891]: %3|1730662962.591|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:42:50 kjcf05n00 mcfcli[3673891]: %3|1730662970.746|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:43:13 kjcf05n00 mcfcli[3673891]: %3|1730662993.091|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 13:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T13:43:27.252746477-06:00 level=info msg="Completed cleanup jobs" duration=26.219784ms Nov 3 13:43:30 kjcf05n00 mcfcli[3673891]: %3|1730663010.376|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:43:43 kjcf05n00 mcfcli[3673891]: %3|1730663023.091|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:44:04 kjcf05n03 root[41662]: failback_xyraid Nov 3 13:44:05 kjcf05n03 root[41804]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 13:44:06 kjcf05n03 root[41877]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 13:44:07 kjcf05n00 mcfcli[3673891]: %3|1730663047.499|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:44:10 kjcf05n02 systemd[1]: data-kjcf05n03:md66.mount: Succeeded. Nov 3 13:44:13 kjcf05n00 mcfcli[3673891]: %3|1730663053.091|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:44:14 kjcf05n02 dwd[5141]: Drive path is missing, purging: nvme12n1 Nov 3 13:44:14 kjcf05n02 dwd[5141]: Drive path is missing, purging: nvme7n1 Nov 3 13:44:14 kjcf05n02 dwd[5141]: Drive path is missing, purging: nvme20n1 Nov 3 13:44:14 kjcf05n02 dwd[5141]: Drive path is missing, purging: nvme16n1 Nov 3 13:44:14 kjcf05n02 dwd[5141]: Drive path is missing, purging: nvme5n1 Nov 3 13:44:14 kjcf05n02 dwd[5141]: Drive path is missing, purging: nvme22n1 Nov 3 13:44:14 kjcf05n02 dwd[5141]: Drive path is missing, purging: nvme6n1 Nov 3 13:44:14 kjcf05n02 dwd[5141]: Drive path is missing, purging: nvme11n1 Nov 3 13:44:14 kjcf05n02 dwd[5141]: Drive path is missing, purging: nvme21n1 Nov 3 13:44:14 kjcf05n02 dwd[5141]: Drive path is missing, purging: nvme10n1 Nov 3 13:44:14 kjcf05n02 dwd[5141]: Drive path is missing, purging: nvme15n1 Nov 3 13:44:15 kjcf05n03 dwd[5164]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 13:44:15 kjcf05n03 dwd[5164]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 13:44:15 kjcf05n03 dwd[5164]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 13:44:15 kjcf05n03 dwd[5164]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 13:44:15 kjcf05n03 dwd[5164]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 13:44:15 kjcf05n03 dwd[5164]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 13:44:15 kjcf05n03 dwd[5164]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 13:44:15 kjcf05n03 dwd[5164]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 13:44:15 kjcf05n03 dwd[5164]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 13:44:15 kjcf05n03 dwd[5164]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 13:44:15 kjcf05n03 dwd[5164]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 13:44:16 kjcf05n03 dwd[5164]: Starting NVME thread for nvme10n1 Nov 3 13:44:16 kjcf05n03 dwd[5164]: Starting NVME thread for nvme15n1 Nov 3 13:44:16 kjcf05n03 dwd[5164]: Starting NVME thread for nvme21n1 Nov 3 13:44:16 kjcf05n03 dwd[5164]: Starting NVME thread for nvme11n1 Nov 3 13:44:16 kjcf05n03 dwd[5164]: Starting NVME thread for nvme20n1 Nov 3 13:44:16 kjcf05n03 systemd-udevd[44642]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44643]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44642]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44646]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44649]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44643]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44642]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44646]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44649]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44643]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44646]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44642]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44649]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44643]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44642]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44646]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44649]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44643]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44642]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44646]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44649]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44643]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44649]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44643]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44642]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:44:16 kjcf05n03 systemd-udevd[44646]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44649]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44646]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44642]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44643]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44649]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44642]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44680]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44682]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44684]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44686]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44680]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44682]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44684]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44686]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44679]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44684]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44680]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44679]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44680]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44679]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44684]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44679]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44684]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44679]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44684]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 dwd[5164]: Starting NVME thread for nvme12n1 Nov 3 13:44:17 kjcf05n03 systemd-udevd[44679]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44684]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44679]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44679]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44684]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44679]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44684]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44679]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44684]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44679]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44679]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44679]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 systemd-udevd[44679]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:44:17 kjcf05n03 dwd[5164]: Starting NVME thread for nvme7n1 Nov 3 13:44:17 kjcf05n03 dwd[5164]: Starting NVME thread for nvme6n1 Nov 3 13:44:17 kjcf05n03 dwd[5164]: Starting NVME thread for nvme5n1 Nov 3 13:44:17 kjcf05n03 dwd[5164]: Starting NVME thread for nvme16n1 Nov 3 13:44:17 kjcf05n03 dwd[5164]: Starting NVME thread for nvme22n1 Nov 3 13:44:20 kjcf05n03 dcs-bulk-data-sender[6159]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 3 13:44:22 kjcf05n03 nslcd[6915]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 13:44:25 kjcf05n03 diskmonitor[17700]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 13:44:31 kjcf05n03 diskmonitor[17700]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 13:44:31 kjcf05n03 diskmonitor[17700]: Scan for ReadErrorMax change for md66 Nov 3 13:44:31 kjcf05n03 diskmonitor[17700]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 13:44:31 kjcf05n03 diskmonitor[17700]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 13:44:31 kjcf05n03 diskmonitor[17700]: read_saved_file: md66 no saved speed Nov 3 13:44:31 kjcf05n03 diskmonitor[17700]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 13:44:31 kjcf05n03 diskmonitor[17700]: Set sync_speed_min (10000) for md66 Nov 3 13:44:31 kjcf05n03 diskmonitor[17700]: Set sync_speed_max (200000) for md66 Nov 3 13:44:31 kjcf05n03 diskmonitor[17700]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 13:44:42 kjcf05n00 mcfcli[3673891]: %3|1730663082.970|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:44:43 kjcf05n00 mcfcli[3673891]: %3|1730663083.093|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 13:45:10 kjcf05n00 python3.9[1300849]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 13:45:11 kjcf05n03 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 13:45:11 kjcf05n03 systemd-tmpfiles[47511]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 13:45:11 kjcf05n03 systemd-tmpfiles[47511]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 13:45:11 kjcf05n03 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 13:45:11 kjcf05n03 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 13:45:13 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47652 (bash) Nov 3 13:45:13 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 13:45:13 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 13:45:13 kjcf05n00 mcfcli[3673891]: %3|1730663113.284|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 13:45:16 kjcf05n02 diskmonitor[17507]: Removed MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 13:45:16 kjcf05n02 diskmonitor[17507]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 13:45:20 kjcf05n00 mcfcli[3673891]: %3|1730663120.403|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:45:43 kjcf05n00 mcfcli[3673891]: %3|1730663143.285|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:45:56 kjcf05n00 mcfcli[3673891]: %3|1730663156.763|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:46:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730663161}"] Nov 3 13:46:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663161, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:46:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.049698ms Nov 3 13:46:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.049698ms Nov 3 13:46:01 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:46:01 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:46:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:46:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730663161}"] Nov 3 13:46:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663161, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:46:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.632458ms Nov 3 13:46:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.632458ms Nov 3 13:46:01 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:46:01 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:46:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:46:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730663161}"] Nov 3 13:46:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663161, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:46:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.711174ms Nov 3 13:46:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.711174ms Nov 3 13:46:01 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:46:01 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:46:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:46:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730663161}"] Nov 3 13:46:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663161, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:46:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.678313ms Nov 3 13:46:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.678313ms Nov 3 13:46:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:46:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:46:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:46:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730663161}"] Nov 3 13:46:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663161, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:46:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.785043ms Nov 3 13:46:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.785043ms Nov 3 13:46:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:46:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:46:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:46:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730663161}"] Nov 3 13:46:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663161, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:46:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.798949ms Nov 3 13:46:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.798949ms Nov 3 13:46:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:46:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:46:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:46:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730663161}"] Nov 3 13:46:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663161, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:46:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.923352ms Nov 3 13:46:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.923352ms Nov 3 13:46:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:46:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:46:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:46:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730663161}"] Nov 3 13:46:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663161, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:46:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.611732ms Nov 3 13:46:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.611732ms Nov 3 13:46:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:46:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:46:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:46:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730663161}"] Nov 3 13:46:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663161, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:46:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.291882ms Nov 3 13:46:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.291882ms Nov 3 13:46:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:46:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:46:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:46:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730663161}"] Nov 3 13:46:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663161, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:46:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.876545ms Nov 3 13:46:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.876545ms Nov 3 13:46:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:46:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:46:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:46:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730663161}"] Nov 3 13:46:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663161, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:46:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:46:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:46:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:46:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:46:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:46:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:46:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.090425ms Nov 3 13:46:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:46:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.090425ms Nov 3 13:46:03 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:46:03 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:46:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:46:13 kjcf05n00 mcfcli[3673891]: %3|1730663173.594|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 13:46:36 kjcf05n00 mcfcli[3673891]: %3|1730663196.327|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:46:43 kjcf05n00 mcfcli[3673891]: %3|1730663203.594|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 13:47:13 kjcf05n00 mcfcli[3673891]: %3|1730663233.594|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 13:47:14 kjcf05n00 mcfcli[3673891]: %3|1730663234.278|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:47:43 kjcf05n00 mcfcli[3673891]: %3|1730663263.595|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 13:47:53 kjcf05n00 mcfcli[3673891]: %3|1730663273.824|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:48:13 kjcf05n00 mcfcli[3673891]: %3|1730663293.596|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:48:33 kjcf05n00 mcfcli[3673891]: %3|1730663313.821|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:48:43 kjcf05n00 mcfcli[3673891]: %3|1730663323.596|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:49:12 kjcf05n00 mcfcli[3673891]: %3|1730663352.473|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:49:13 kjcf05n00 mcfcli[3673891]: %3|1730663353.596|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 13:49:30 kjcf05n03 dwd[5164]: nvme10n1 passed periodic SMART status check Nov 3 13:49:31 kjcf05n03 dwd[5164]: nvme12n1 passed periodic SMART status check Nov 3 13:49:31 kjcf05n03 dwd[5164]: nvme11n1 passed periodic SMART status check Nov 3 13:49:31 kjcf05n03 dwd[5164]: nvme15n1 passed periodic SMART status check Nov 3 13:49:31 kjcf05n03 dwd[5164]: nvme20n1 passed periodic SMART status check Nov 3 13:49:31 kjcf05n03 dwd[5164]: nvme21n1 passed periodic SMART status check Nov 3 13:49:32 kjcf05n03 dwd[5164]: nvme22n1 passed periodic SMART status check Nov 3 13:49:32 kjcf05n03 dwd[5164]: nvme6n1 passed periodic SMART status check Nov 3 13:49:32 kjcf05n03 dwd[5164]: nvme7n1 passed periodic SMART status check Nov 3 13:49:32 kjcf05n03 dwd[5164]: nvme16n1 passed periodic SMART status check Nov 3 13:49:32 kjcf05n03 dwd[5164]: nvme5n1 passed periodic SMART status check Nov 3 13:49:43 kjcf05n00 mcfcli[3673891]: %3|1730663383.596|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:49:50 kjcf05n00 mcfcli[3673891]: %3|1730663390.011|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:49:57 kjcf05n00 zabbix-server[1303591]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 13:49:57 kjcf05n00 zabbix-server[1303591]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n03' from event '46275' Nov 3 13:49:57 kjcf05n00 zabbix-server[1303591]: Filesystem 'kjcf05' has been mounted Nov 3 13:49:58 kjcf05n00 zabbix-server[1303591]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 13:49:58 kjcf05n00 zabbix-server[1303591]: Running puppet on 'None' Nov 3 13:50:00 kjcf05n05 puppet-agent[3411377]: Using configured environment 'production' Nov 3 13:50:00 kjcf05n05 puppet-agent[3411377]: Retrieving pluginfacts Nov 3 13:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 13:50:00 kjcf05n05 puppet-agent[3411377]: Retrieving plugin Nov 3 13:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 13:50:00 kjcf05n03 puppet-agent[55591]: Using configured environment 'production' Nov 3 13:50:00 kjcf05n03 puppet-agent[55591]: Retrieving pluginfacts Nov 3 13:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 13:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 13:50:00 kjcf05n03 puppet-agent[55591]: Retrieving plugin Nov 3 13:50:00 kjcf05n02 puppet-agent[115130]: Using configured environment 'production' Nov 3 13:50:00 kjcf05n02 puppet-agent[115130]: Retrieving pluginfacts Nov 3 13:50:00 kjcf05n02 puppet-agent[115130]: Retrieving plugin Nov 3 13:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 13:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 13:50:00 kjcf05n02 puppet-agent[115130]: Loading facts Nov 3 13:50:00 kjcf05n07 puppet-agent[3253970]: Using configured environment 'production' Nov 3 13:50:00 kjcf05n07 puppet-agent[3253970]: Retrieving pluginfacts Nov 3 13:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 13:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 13:50:00 kjcf05n07 puppet-agent[3253970]: Retrieving plugin Nov 3 13:50:00 kjcf05n06 puppet-agent[3257652]: Using configured environment 'production' Nov 3 13:50:00 kjcf05n06 puppet-agent[3257652]: Retrieving pluginfacts Nov 3 13:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 13:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 13:50:00 kjcf05n06 puppet-agent[3257652]: Retrieving plugin Nov 3 13:50:00 kjcf05n06 puppet-agent[3257652]: Loading facts Nov 3 13:50:00 kjcf05n04 puppet-agent[3253196]: Using configured environment 'production' Nov 3 13:50:00 kjcf05n04 puppet-agent[3253196]: Retrieving pluginfacts Nov 3 13:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 13:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 13:50:00 kjcf05n04 puppet-agent[3253196]: Retrieving plugin Nov 3 13:50:00 kjcf05n04 puppet-agent[3253196]: Loading facts Nov 3 13:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 13:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 13:50:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 13:50:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 13:50:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 13:50:00 kjcf05n00 puppet-agent[1303672]: Using configured environment 'production' Nov 3 13:50:00 kjcf05n00 puppet-agent[1303672]: Retrieving pluginfacts Nov 3 13:50:00 kjcf05n05 puppet-agent[3411377]: Loading facts Nov 3 13:50:00 kjcf05n01 puppet-agent[3123175]: Using configured environment 'production' Nov 3 13:50:00 kjcf05n01 puppet-agent[3123175]: Retrieving pluginfacts Nov 3 13:50:00 kjcf05n01 puppet-agent[3123175]: Retrieving plugin Nov 3 13:50:00 kjcf05n03 puppet-agent[55591]: Loading facts Nov 3 13:50:00 kjcf05n07 puppet-agent[3253970]: Loading facts Nov 3 13:50:00 kjcf05n00 puppet-agent[1303672]: Retrieving plugin Nov 3 13:50:01 kjcf05n01 puppet-agent[3123175]: Loading facts Nov 3 13:50:01 kjcf05n00 puppet-agent[1303672]: Loading facts Nov 3 13:50:03 kjcf05n02 puppet-agent[115130]: Caching catalog for kjcf05n02 Nov 3 13:50:03 kjcf05n02 puppet-agent[115130]: Applying configuration version '1730663401' Nov 3 13:50:03 kjcf05n03 puppet-agent[55591]: Caching catalog for kjcf05n03 Nov 3 13:50:03 kjcf05n03 puppet-agent[55591]: Applying configuration version '1730663401' Nov 3 13:50:03 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 13:50:03 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 13:50:03 kjcf05n06 puppet-agent[3257652]: Caching catalog for kjcf05n06 Nov 3 13:50:03 kjcf05n06 puppet-agent[3257652]: Applying configuration version '1730663402' Nov 3 13:50:03 kjcf05n07 puppet-agent[3253970]: Caching catalog for kjcf05n07 Nov 3 13:50:03 kjcf05n07 puppet-agent[3253970]: Applying configuration version '1730663402' Nov 3 13:50:04 kjcf05n01 puppet-agent[3123175]: Caching catalog for kjcf05n01 Nov 3 13:50:04 kjcf05n00 puppet-agent[1303672]: Caching catalog for kjcf05n00 Nov 3 13:50:04 kjcf05n00 puppet-agent[1303672]: Applying configuration version '1730663402' Nov 3 13:50:05 kjcf05n01 puppet-agent[3123175]: Applying configuration version '1730663402' Nov 3 13:50:05 kjcf05n05 puppet-agent[3411377]: Caching catalog for kjcf05n05 Nov 3 13:50:05 kjcf05n05 puppet-agent[3411377]: Applying configuration version '1730663403' Nov 3 13:50:05 kjcf05n04 puppet-agent[3253196]: Caching catalog for kjcf05n04 Nov 3 13:50:05 kjcf05n04 puppet-agent[3253196]: Applying configuration version '1730663403' Nov 3 13:50:05 kjcf05n02 puppet-agent[115130]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 13:50:05 kjcf05n02 puppet-agent[115130]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 13:50:05 kjcf05n02 puppet-agent[115130]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 13:50:05 kjcf05n03 puppet-agent[55591]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 13:50:05 kjcf05n03 puppet-agent[55591]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 13:50:05 kjcf05n03 puppet-agent[55591]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 13:50:05 kjcf05n06 puppet-agent[3257652]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 13:50:05 kjcf05n06 puppet-agent[3257652]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 13:50:05 kjcf05n06 puppet-agent[3257652]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 13:50:06 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 13:50:06 kjcf05n02 zabbix_agent2[57305]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 13:50:06 kjcf05n02 zabbix_agent2[3084]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 13:50:06 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 13:50:06 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 13:50:06 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 13:50:06 kjcf05n02 puppet-agent[115130]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: Press Ctrl+C to exit. Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: Plugin support version 1.0 Nov 3 13:50:06 kjcf05n02 zabbix_agent2[115855]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 13:50:06 kjcf05n07 puppet-agent[3253970]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 13:50:06 kjcf05n07 puppet-agent[3253970]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 13:50:06 kjcf05n07 puppet-agent[3253970]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 13:50:06 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 13:50:06 kjcf05n03 zabbix_agent2[29498]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 13:50:06 kjcf05n03 zabbix_agent2[3072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 13:50:06 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 13:50:06 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 13:50:06 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 13:50:06 kjcf05n03 puppet-agent[55591]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: Press Ctrl+C to exit. Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: Plugin support version 1.0 Nov 3 13:50:06 kjcf05n03 zabbix_agent2[56040]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 13:50:06 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3205380]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 13:50:06 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 13:50:06 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 13:50:06 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 13:50:06 kjcf05n06 puppet-agent[3257652]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: Press Ctrl+C to exit. Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: Plugin support version 1.0 Nov 3 13:50:06 kjcf05n06 zabbix_agent2[3258309]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 13:50:06 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3201493]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 13:50:06 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 13:50:06 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 13:50:06 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 13:50:06 kjcf05n07 puppet-agent[3253970]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: Press Ctrl+C to exit. Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: Plugin support version 1.0 Nov 3 13:50:06 kjcf05n07 zabbix_agent2[3254392]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 13:50:07 kjcf05n04 puppet-agent[3253196]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 13:50:07 kjcf05n04 puppet-agent[3253196]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 13:50:07 kjcf05n04 puppet-agent[3253196]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 13:50:07 kjcf05n05 puppet-agent[3411377]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 13:50:07 kjcf05n05 puppet-agent[3411377]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 13:50:07 kjcf05n05 puppet-agent[3411377]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 13:50:07 kjcf05n00 puppet-agent[1303672]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 13:50:07 kjcf05n01 puppet-agent[3123175]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 13:50:07 kjcf05n01 puppet-agent[3123175]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-13:26:09]/mode) mode changed '0755' to '0750' Nov 3 13:50:07 kjcf05n01 puppet-agent[3123175]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-13:26:09/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 13:50:07 kjcf05n01 puppet-agent[3123175]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-13:26:09/vmcore]/mode) mode changed '0600' to '0640' Nov 3 13:50:07 kjcf05n01 puppet-agent[3123175]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-13:26:09/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 13:50:07 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 13:50:07 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3364554]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 13:50:07 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 13:50:07 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 13:50:07 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 13:50:07 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 13:50:07 kjcf05n05 puppet-agent[3411377]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: Press Ctrl+C to exit. Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: Plugin support version 1.0 Nov 3 13:50:07 kjcf05n05 zabbix_agent2[3411865]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 13:50:08 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3206693]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 13:50:08 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 13:50:08 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 13:50:08 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 13:50:08 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 13:50:08 kjcf05n04 puppet-agent[3253196]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: Press Ctrl+C to exit. Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: Plugin support version 1.0 Nov 3 13:50:08 kjcf05n04 zabbix_agent2[3253662]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 13:50:08 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 13:50:08 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 13:50:08 kjcf05n02 puppet-agent[115130]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 13:50:08 kjcf05n02 puppet-agent[115130]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 13:50:08 kjcf05n02 puppet-agent[115130]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 13:50:08 kjcf05n06 puppet-agent[3257652]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 13:50:08 kjcf05n06 puppet-agent[3257652]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 13:50:08 kjcf05n06 puppet-agent[3257652]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 13:50:08 kjcf05n06 puppet-agent[3257652]: Applied catalog in 4.90 seconds Nov 3 13:50:08 kjcf05n03 puppet-agent[55591]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 13:50:08 kjcf05n03 puppet-agent[55591]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 13:50:08 kjcf05n03 puppet-agent[55591]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 13:50:08 kjcf05n07 puppet-agent[3253970]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 13:50:08 kjcf05n07 puppet-agent[3253970]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 13:50:08 kjcf05n07 puppet-agent[3253970]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 13:50:08 kjcf05n00 puppet-agent[1303672]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 13:50:08 kjcf05n00 puppet-agent[1303672]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 13:50:08 kjcf05n00 puppet-agent[1303672]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 13:50:08 kjcf05n02 puppet-agent[115130]: Applied catalog in 5.18 seconds Nov 3 13:50:08 kjcf05n01 puppet-agent[3123175]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 13:50:08 kjcf05n01 puppet-agent[3123175]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 13:50:08 kjcf05n01 puppet-agent[3123175]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 13:50:08 kjcf05n03 puppet-agent[55591]: Applied catalog in 5.29 seconds Nov 3 13:50:08 kjcf05n07 puppet-agent[3253970]: Applied catalog in 4.99 seconds Nov 3 13:50:09 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3111452]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 13:50:09 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 13:50:09 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 13:50:09 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 13:50:09 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 13:50:09 kjcf05n01 puppet-agent[3123175]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: Press Ctrl+C to exit. Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: Plugin support version 1.0 Nov 3 13:50:09 kjcf05n01 zabbix_agent2[3123621]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 13:50:08 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1285388]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 13:50:09 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 13:50:08 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 13:50:08 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 13:50:08 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 13:50:08 kjcf05n00 puppet-agent[1303672]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: Starting Zabbix Agent 2 (6.2.1) Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: Press Ctrl+C to exit. Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: Plugin support version 1.0 Nov 3 13:50:08 kjcf05n00 zabbix_agent2[1304296]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 13:50:09 kjcf05n00 zabbix-server[1304322]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 13:50:09 kjcf05n05 puppet-agent[3411377]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 13:50:09 kjcf05n05 puppet-agent[3411377]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 13:50:09 kjcf05n05 puppet-agent[3411377]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 13:50:09 kjcf05n05 puppet-agent[3411377]: Applied catalog in 4.70 seconds Nov 3 13:50:09 kjcf05n04 puppet-agent[3253196]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 13:50:09 kjcf05n04 puppet-agent[3253196]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 13:50:09 kjcf05n04 puppet-agent[3253196]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 13:50:09 kjcf05n04 puppet-agent[3253196]: Applied catalog in 4.77 seconds Nov 3 13:50:09 kjcf05n00 zabbix-server[1304323]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 13:50:10 kjcf05n00 zabbix-server[1304331]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 13:50:10 kjcf05n00 zabbix-server[1304338]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 13:50:10 kjcf05n00 puppet-agent[1303672]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 13:50:11 kjcf05n01 puppet-agent[3123175]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_133329.log]/mode) mode changed '0644' to '0640' Nov 3 13:50:11 kjcf05n01 puppet-agent[3123175]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_134512.log]/mode) mode changed '0644' to '0640' Nov 3 13:50:11 kjcf05n00 python3.9[1304204]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 13:50:12 kjcf05n01 puppet-agent[3123175]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_133329.log]/mode) mode changed '0644' to '0640' Nov 3 13:50:12 kjcf05n01 puppet-agent[3123175]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_134512.log]/mode) mode changed '0644' to '0640' Nov 3 13:50:12 kjcf05n01 puppet-agent[3123175]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_134513]/mode) mode changed '0755' to '0750' Nov 3 13:50:12 kjcf05n01 puppet-agent[3123175]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_134513/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 13:50:12 kjcf05n01 puppet-agent[3123175]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 13:50:12 kjcf05n01 puppet-agent[3123175]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 13:50:12 kjcf05n01 puppet-agent[3123175]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 13:50:11 kjcf05n00 puppet-agent[1303672]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 13:50:11 kjcf05n00 puppet-agent[1303672]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 13:50:11 kjcf05n00 puppet-agent[1303672]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 13:50:12 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 13:50:12 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 13:50:12 kjcf05n00 puppet-agent[1303672]: Applied catalog in 8.35 seconds Nov 3 13:50:13 kjcf05n01 puppet-agent[3123175]: Applied catalog in 8.73 seconds Nov 3 13:50:13 kjcf05n00 zabbix-server[1303591]: puppet completed status:(0): '' Nov 3 13:50:13 kjcf05n00 zabbix-server[1303591]: Event '46275' acknowledged Nov 3 13:50:13 kjcf05n00 zabbix-server[1303591]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n03"}' Nov 3 13:50:13 kjcf05n00 mcfcli[3673891]: %3|1730663413.596|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 13:50:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730663424', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 13:50:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730663424'} Nov 3 13:50:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:50:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730663424', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 13:50:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730663424'} Nov 3 13:50:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:50:28 kjcf05n00 mcfcli[3673891]: %3|1730663428.545|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:50:43 kjcf05n00 mcfcli[3673891]: %3|1730663443.597|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 13:51:04 kjcf05n00 mcfcli[3673891]: %3|1730663464.281|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:51:13 kjcf05n00 mcfcli[3673891]: %3|1730663473.598|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 13:51:43 kjcf05n00 mcfcli[3673891]: %3|1730663503.612|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 13:51:44 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 13:51:44 kjcf05n00 mcfcli[3673891]: %3|1730663504.278|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:52:13 kjcf05n00 mcfcli[3673891]: %3|1730663533.612|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:52:22 kjcf05n00 mcfcli[3673891]: %3|1730663542.711|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:52:43 kjcf05n00 mcfcli[3673891]: %3|1730663563.612|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:52:56 kjcf05n01 chronyd[2671]: Selected source 16.110.135.123 Nov 3 13:53:00 kjcf05n00 mcfcli[3673891]: %3|1730663580.844|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:53:13 kjcf05n00 mcfcli[3673891]: %3|1730663593.613|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T19:53:15.867524Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 13:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T19:53:15.867598Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.118ms Nov 3 13:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T13:53:27.254934064-06:00 level=info msg="Completed cleanup jobs" duration=28.116296ms Nov 3 13:53:39 kjcf05n00 mcfcli[3673891]: %3|1730663619.095|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:53:43 kjcf05n00 mcfcli[3673891]: %3|1730663623.613|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 13:54:13 kjcf05n00 mcfcli[3673891]: %3|1730663653.613|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 13:54:16 kjcf05n00 mcfcli[3673891]: %3|1730663656.057|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:54:43 kjcf05n00 mcfcli[3673891]: %3|1730663683.613|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 13:54:54 kjcf05n00 mcfcli[3673891]: %3|1730663694.267|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:55:11 kjcf05n00 python3.9[1307146]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 13:55:13 kjcf05n00 mcfcli[3673891]: %3|1730663713.613|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 13:55:30 kjcf05n00 mcfcli[3673891]: %3|1730663730.045|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:55:43 kjcf05n00 mcfcli[3673891]: %3|1730663743.614|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 13:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 13:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 13:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 13:55:56 kjcf05n03 nslcd[6915]: [3c9869] ldap_result() failed: Can't contact LDAP server Nov 3 13:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 13:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 13:55:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 13:55:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 13:56:01 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 13:56:07 kjcf05n00 mcfcli[3673891]: %3|1730663767.489|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:56:13 kjcf05n00 mcfcli[3673891]: %3|1730663773.614|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:56:18 kjcf05n00 zabbix_server[15727]: Zabbix agent item "dcs.lustre.device.discovery[{$LUSTRE_FS_NAME},mdt]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 3 13:56:18 kjcf05n00 zabbix_server[15779]: Zabbix agent item "system.cpu.util[,steal]" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 3 13:56:25 kjcf05n03 fstonithd.py[15308]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 3 13:56:25 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 13:56:25 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 13:56:25 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 13:56:25 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='13', error='Connection reset by peer (104)' Nov 3 13:56:25 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='13', client='AF_INET(172.16.2.5:44201)', local='AF_INET(0.0.0.0:601)' Nov 3 13:56:27 kjcf05n03 root[66149]: is_enc_ipmi_off starts Nov 3 13:56:27 kjcf05n03 root[66148]: is_viking_off starts Nov 3 13:56:27 kjcf05n03 root[66165]: is_lan_ipmi_off leaves Nov 3 13:56:27 kjcf05n03 root[66167]: is_lan_ipmi_sec_off leaves Nov 3 13:56:27 kjcf05n03 root[66185]: I am not master; I will get master Nov 3 13:56:27 kjcf05n03 root[66187]: I am in slot 1; partner is in slot 0 Nov 3 13:56:32 kjcf05n03 root[66282]: I am now master Nov 3 13:56:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 13:56:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 13:56:33 kjcf05n03 root[66368]: is_viking_off leaves Nov 3 13:56:33 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.mdt.name[MDT0000,mdt_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 13:56:33 kjcf05n00 zabbix_server[15783]: Zabbix agent item "agent.ping" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 13:56:33 kjcf05n03 root[66371]: kjcf05n02 not already off look at kdump Nov 3 13:56:33 kjcf05n03 root[66372]: is_kdump_off starts Nov 3 13:56:33 kjcf05n03 fence_kdump[66373]: waiting for message from '172.16.2.5' Nov 3 13:56:34 kjcf05n03 fence_kdump[66373]: received valid message from '172.16.2.5' Nov 3 13:56:34 kjcf05n03 root[66445]: is_kdump_off detected kdump on kjcf05n02 Nov 3 13:56:34 kjcf05n03 root[66446]: kjcf05n02 is kdumping Nov 3 13:56:35 kjcf05n03 root[66534]: is_enc_ipmi_off starts Nov 3 13:56:35 kjcf05n03 root[66535]: is_viking_off starts Nov 3 13:56:34 kjcf05n00 zabbix_server[15757]: Zabbix agent item "vm.memory.size[buffers]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 13:56:35 kjcf05n03 root[66566]: is_lan_ipmi_off leaves Nov 3 13:56:35 kjcf05n03 root[66568]: is_lan_ipmi_sec_off leaves Nov 3 13:56:35 kjcf05n03 root[66573]: I am in slot 1; partner is in slot 0 Nov 3 13:56:35 kjcf05n03 root[66576]: I am master Nov 3 13:56:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 13:56:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 13:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 13:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 13:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 13:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 13:56:37 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 13:56:37 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 13:56:42 kjcf05n03 root[66904]: is_viking_off leaves Nov 3 13:56:42 kjcf05n03 root[66907]: kjcf05n02 not already off look at kdump Nov 3 13:56:42 kjcf05n03 root[66908]: is_kdump_off starts Nov 3 13:56:42 kjcf05n03 fence_kdump[66909]: waiting for message from '172.16.2.5' Nov 3 13:56:43 kjcf05n03 fence_kdump[66909]: received valid message from '172.16.2.5' Nov 3 13:56:43 kjcf05n03 root[66950]: is_kdump_off detected kdump on kjcf05n02 Nov 3 13:56:43 kjcf05n03 root[66955]: kjcf05n02 is kdumping Nov 3 13:56:43 kjcf05n00 mcfcli[3673891]: %3|1730663803.614|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:56:47 kjcf05n03 systemd-udevd[69314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69315]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69317]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69315]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69317]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69315]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69317]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69315]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69317]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69315]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69317]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69315]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69317]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69341]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69343]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69315]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69345]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69317]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69349]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69341]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69343]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69317]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69345]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69315]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69313]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69314]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69313]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69317]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69313]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69317]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69345]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69343]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69313]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69317]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69314]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69313]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69317]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69313]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69317]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69317]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69317]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69313]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69317]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69313]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69317]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69313]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69317]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69317]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 systemd-udevd[69317]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 13:56:47 kjcf05n03 dwd[5164]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 13:56:47 kjcf05n03 dwd[5164]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 13:56:47 kjcf05n03 dwd[5164]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 13:56:47 kjcf05n03 dwd[5164]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 13:56:47 kjcf05n03 dwd[5164]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 13:56:47 kjcf05n03 dwd[5164]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 13:56:47 kjcf05n03 dwd[5164]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 13:56:47 kjcf05n03 dwd[5164]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 13:56:47 kjcf05n03 dwd[5164]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 13:56:47 kjcf05n03 dwd[5164]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 13:56:47 kjcf05n03 dwd[5164]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 13:56:47 kjcf05n03 dwd[5164]: Starting NVME thread for nvme25n1 Nov 3 13:56:47 kjcf05n03 dwd[5164]: Starting NVME thread for nvme8n1 Nov 3 13:56:47 kjcf05n00 mcfcli[3673891]: %3|1730663807.486|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:56:48 kjcf05n03 dwd[5164]: Starting NVME thread for nvme18n1 Nov 3 13:56:48 kjcf05n03 dwd[5164]: Starting NVME thread for nvme23n1 Nov 3 13:56:48 kjcf05n03 dwd[5164]: Starting NVME thread for nvme9n1 Nov 3 13:56:48 kjcf05n03 dwd[5164]: Starting NVME thread for nvme4n1 Nov 3 13:56:48 kjcf05n03 dwd[5164]: Starting NVME thread for nvme2n1 Nov 3 13:56:48 kjcf05n03 dwd[5164]: Starting NVME thread for nvme3n1 Nov 3 13:56:48 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0001,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 13:56:48 kjcf05n03 dwd[5164]: Starting NVME thread for nvme19n1 Nov 3 13:56:48 kjcf05n03 dwd[5164]: Starting NVME thread for nvme17n1 Nov 3 13:56:48 kjcf05n03 dwd[5164]: Starting NVME thread for nvme24n1 Nov 3 13:56:49 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.cpu.util[,nice]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 13:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 13:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 13:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 13:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 13:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 13:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 13:56:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 13:56:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 13:57:03 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 3 13:57:04 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 3 13:57:06 kjcf05n03 diskmonitor[17700]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 13:57:13 kjcf05n00 mcfcli[3673891]: %3|1730663833.615|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:57:14 kjcf05n03 diskmonitor[17700]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 13:57:14 kjcf05n03 diskmonitor[17700]: Scan for ReadErrorMax change for md65 Nov 3 13:57:14 kjcf05n03 diskmonitor[17700]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 13:57:14 kjcf05n03 diskmonitor[17700]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 13:57:14 kjcf05n03 diskmonitor[17700]: read_saved_file: md65 no saved speed Nov 3 13:57:14 kjcf05n03 diskmonitor[17700]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 13:57:14 kjcf05n03 diskmonitor[17700]: Set sync_speed_min (10000) for md65 Nov 3 13:57:14 kjcf05n03 diskmonitor[17700]: Set sync_speed_max (200000) for md65 Nov 3 13:57:14 kjcf05n03 diskmonitor[17700]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 13:57:26 kjcf05n00 mcfcli[3673891]: %3|1730663846.415|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:57:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 13:57:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 13:57:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 13:57:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 13:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 13:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 13:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 13:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 13:57:43 kjcf05n00 mcfcli[3673891]: %3|1730663863.615|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 13:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 13:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 13:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 13:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 13:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 13:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 13:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 13:58:04 kjcf05n03 nslcd[6915]: (re)loading /etc/nsswitch.conf Nov 3 13:58:06 kjcf05n00 mcfcli[3673891]: %3|1730663886.412|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:58:13 kjcf05n00 mcfcli[3673891]: %3|1730663893.615|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:58:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730663912}"] Nov 3 13:58:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663912, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:58:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.322991ms Nov 3 13:58:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.322991ms Nov 3 13:58:32 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:58:32 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:58:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:58:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730663912}"] Nov 3 13:58:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663912, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:58:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.240857ms Nov 3 13:58:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.240857ms Nov 3 13:58:32 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:58:32 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:58:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:58:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730663912}"] Nov 3 13:58:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663912, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:58:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.562238ms Nov 3 13:58:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.562238ms Nov 3 13:58:32 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:58:32 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:58:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:58:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730663912}"] Nov 3 13:58:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663912, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:58:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.062382ms Nov 3 13:58:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.062382ms Nov 3 13:58:32 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:58:32 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:58:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:58:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730663912}"] Nov 3 13:58:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663912, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:58:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.679057ms Nov 3 13:58:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.679057ms Nov 3 13:58:32 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:58:32 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:58:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:58:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730663912}"] Nov 3 13:58:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663912, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:58:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.234235ms Nov 3 13:58:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.234235ms Nov 3 13:58:32 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:58:32 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:58:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:58:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730663912}"] Nov 3 13:58:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663912, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:58:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:32-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:32 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:32-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:32 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:32-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:32 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.27462ms Nov 3 13:58:32 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:32-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.27462ms Nov 3 13:58:32 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:58:32 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:58:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:58:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730663912}"] Nov 3 13:58:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663912, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:58:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 13:58:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 13:58:33 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:33-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:33 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:33-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:33 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:33-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:33 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:33-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:33 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:33-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:33 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:33-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:33 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:33-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.328621ms Nov 3 13:58:33 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:33-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.328621ms Nov 3 13:58:33 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:58:33 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:58:33 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:58:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730663912}"] Nov 3 13:58:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663912, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:58:33 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:33-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:33 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:33-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:33 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:33-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:33 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:33-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:33 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:33-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:33 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:33-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:33 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:33-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.841989ms Nov 3 13:58:33 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:33-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.841989ms Nov 3 13:58:33 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:58:33 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:58:33 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:58:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730663912}"] Nov 3 13:58:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663912, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:58:33 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:33-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:33 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:33-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:33 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:33-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:33 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:33-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:33 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:33-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:33 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:33-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:33 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:33-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.861115ms Nov 3 13:58:33 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:33-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.861115ms Nov 3 13:58:33 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:58:33 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:58:33 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:58:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730663912}"] Nov 3 13:58:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730663912, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 13:58:33 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:33-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:33 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:33-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 13:58:33 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:33-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:33 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T13:58:33-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:33 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:33-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 13:58:33 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T13:58:33-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 13:58:33 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T13:58:33-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.633312ms Nov 3 13:58:33 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T13:58:33-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.633312ms Nov 3 13:58:33 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:13:58:33 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 13:58:33 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 13:58:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 13:58:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 13:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 13:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 13:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 13:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 13:58:43 kjcf05n00 mcfcli[3673891]: %3|1730663923.616|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:58:43 kjcf05n00 mcfcli[3673891]: %3|1730663923.905|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 13:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 13:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 13:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 13:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 13:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 13:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 13:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 13:59:13 kjcf05n00 mcfcli[3673891]: %3|1730663953.616|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 13:59:21 kjcf05n00 mcfcli[3673891]: %3|1730663961.374|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 13:59:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 13:59:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 13:59:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 13:59:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 13:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 13:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 13:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 13:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 13:59:43 kjcf05n00 mcfcli[3673891]: %3|1730663983.616|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 13:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 13:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 13:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 13:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 13:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 13:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 13:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 13:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 14:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 14:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 13:59:59 kjcf05n00 mcfcli[3673891]: %3|1730663999.956|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 14:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 14:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 14:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 14:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 14:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 14:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 14:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 14:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 14:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 14:00:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 14:00:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:00:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 14:00:12 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 3 14:00:12 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 14:00:12 kjcf05n00 zabbix-server[1310473]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 14:00:12 kjcf05n00 zabbix-server[1310473]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 14:00:12 kjcf05n00 log_interesting_event.py[1310473]: Event '46276' acknowledged Nov 3 14:00:13 kjcf05n00 mcfcli[3673891]: %3|1730664013.617|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:00:16 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 14:00:16 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 3 14:00:16 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 3 14:00:16 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 14:00:16 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 14:00:16 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 3 14:00:16 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 3 14:00:16 kjcf05n00 python3.9[1310427]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 14:00:19 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 3 14:00:21 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 3 14:00:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730664029', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 14:00:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730664029'} Nov 3 14:00:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:00:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730664029', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 14:00:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730664029'} Nov 3 14:00:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:00:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 14:00:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 14:00:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 14:00:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 14:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 14:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 14:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 14:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 14:00:39 kjcf05n00 mcfcli[3673891]: %3|1730664039.954|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:00:43 kjcf05n00 mcfcli[3673891]: %3|1730664043.618|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 14:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 14:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 14:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 14:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 14:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 14:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 14:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 14:01:09 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:33890). Nov 3 14:01:09 kjcf05n01 rsyncd[3127751]: connect from kjcf05n02 (172.16.2.5) Nov 3 14:01:09 kjcf05n01 rsyncd[3127751]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 14:01:09 kjcf05n01 rsyncd[3127751]: building file list Nov 3 14:01:09 kjcf05n01 rsyncd[3127751]: sent 11450 bytes received 136 bytes total size 10905 Nov 3 14:01:09 kjcf05n01 systemd[1]: rsyncd@633-172.16.2.2:873-172.16.2.5:33890.service: Succeeded. Nov 3 14:01:13 kjcf05n00 mcfcli[3673891]: %3|1730664073.618|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 14:01:16 kjcf05n00 mcfcli[3673891]: %3|1730664076.663|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:01:25 kjcf05n03 fstonithd.py[15308]: Listening for kdump packets from partner Nov 3 14:01:27 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 14:01:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 14:01:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 14:01:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 14:01:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 14:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 14:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 14:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 14:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 14:01:43 kjcf05n00 mcfcli[3673891]: %3|1730664103.619|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 14:01:53 kjcf05n00 mcfcli[3673891]: %3|1730664113.208|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 14:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 14:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 14:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 14:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 14:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 14:01:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 14:01:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 14:02:13 kjcf05n03 dwd[5164]: nvme23n1 passed periodic SMART status check Nov 3 14:02:13 kjcf05n03 dwd[5164]: nvme25n1 passed periodic SMART status check Nov 3 14:02:13 kjcf05n03 dwd[5164]: nvme18n1 passed periodic SMART status check Nov 3 14:02:13 kjcf05n03 dwd[5164]: nvme8n1 passed periodic SMART status check Nov 3 14:02:13 kjcf05n00 mcfcli[3673891]: %3|1730664133.619|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 14:02:14 kjcf05n03 dwd[5164]: nvme9n1 passed periodic SMART status check Nov 3 14:02:14 kjcf05n03 dwd[5164]: nvme24n1 passed periodic SMART status check Nov 3 14:02:14 kjcf05n03 dwd[5164]: nvme17n1 passed periodic SMART status check Nov 3 14:02:14 kjcf05n03 dwd[5164]: nvme19n1 passed periodic SMART status check Nov 3 14:02:14 kjcf05n03 dwd[5164]: nvme4n1 passed periodic SMART status check Nov 3 14:02:14 kjcf05n03 dwd[5164]: nvme3n1 passed periodic SMART status check Nov 3 14:02:14 kjcf05n03 dwd[5164]: nvme2n1 passed periodic SMART status check Nov 3 14:02:14 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 14:02:31 kjcf05n00 mcfcli[3673891]: %3|1730664151.160|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:02:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 14:02:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 14:02:35 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='107', client='AF_INET(172.16.2.5:37639)', local='AF_INET(0.0.0.0:601)' Nov 3 14:02:35 kjcf05n02 syslog-ng[3156]: Configuration reload request received, reloading configuration; Nov 3 14:02:35 kjcf05n02 syslog-ng[3156]: Configuration reload finished; Nov 3 14:02:35 kjcf05n02 syslog-ng[3156]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 14:02:35 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 3 14:02:35 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 14:02:35 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 3 14:02:35 kjcf05n02 dracut: Self testing crypto algorithms Nov 3 14:02:35 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 3 14:02:35 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 14:02:35 kjcf05n02 Copying live image to RAM... Nov 3 14:02:35 kjcf05n02 (this may take a minute) Nov 3 14:02:35 kjcf05n02 Done copying live image to RAM. Nov 3 14:02:35 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 14:02:35 kjcf05n02 dracut: Checking integrity of kernel Nov 3 14:02:35 kjcf05n02 dracut: All initrd crypto checks done Nov 3 14:02:35 kjcf05n02 dracut: Switching root Nov 3 14:02:35 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 14:02:35 kjcf05n02 systemd: Detected architecture x86-64. Nov 3 14:02:35 kjcf05n02 systemd: Set hostname to . Nov 3 14:02:35 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 14:02:35 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 14:02:35 kjcf05n02 systemd: Reached target CXI Retry Handlers Started. Nov 3 14:02:35 kjcf05n02 systemd: Reached target Swap. Nov 3 14:02:35 kjcf05n02 systemd: Listening on Journal Socket (/dev/log). Nov 3 14:02:35 kjcf05n02 systemd: Started Dispatch Password Requests to Console Directory Watch. Nov 3 14:02:35 kjcf05n02 systemd: Started Forward Password Requests to Wall Directory Watch. Nov 3 14:02:35 kjcf05n02 systemd-journald[1541]: Journal started Nov 3 14:02:35 kjcf05n02 systemd-journald[1541]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 14:02:35 kjcf05n02 systemd[1]: Mounted /mnt. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Create list of required static device nodes for the current kernel. Nov 3 14:02:35 kjcf05n02 systemd-modules-load[1545]: Inserted module 'fuse' Nov 3 14:02:35 kjcf05n02 systemd[1]: Mounted /data. Nov 3 14:02:35 kjcf05n02 systemd[1]: Mounted /WIBS. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 3 14:02:35 kjcf05n02 systemd[1]: Mounted Huge Pages File System. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Load Kernel Modules. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Remount Root and Kernel File Systems. Nov 3 14:02:35 kjcf05n02 systemd[1]: Mounted POSIX Message Queue File System. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Load/Save Random Seed... Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Rebuild Hardware Database... Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Create System Users... Nov 3 14:02:35 kjcf05n02 systemd[1]: Mounting Kernel Configuration File System... Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Apply Kernel Variables... Nov 3 14:02:35 kjcf05n02 systemd[1]: Mounting FUSE Control File System... Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 14:02:35 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 3 14:02:35 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Create System Users. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 14:02:35 kjcf05n02 systemd-sysctl[1562]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 14:02:35 kjcf05n02 systemd-sysctl[1562]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 3 14:02:35 kjcf05n02 systemd-journald[1541]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 14:02:35 kjcf05n02 systemd-tmpfiles[1568]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 14:02:35 kjcf05n02 systemd-tmpfiles[1568]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 3 14:02:35 kjcf05n02 systemd-udevd[1577]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 3 14:02:35 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 3 14:02:35 kjcf05n02 systemd-udevd[1646]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:02:35 kjcf05n02 systemd-udevd[1635]: Using default interface naming scheme 'rhel-8.0'. Nov 3 14:02:35 kjcf05n02 systemd-udevd[1635]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:02:35 kjcf05n02 systemd-udevd[1638]: Using default interface naming scheme 'rhel-8.0'. Nov 3 14:02:35 kjcf05n02 systemd-udevd[1638]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:02:35 kjcf05n02 systemd-udevd[1617]: Using default interface naming scheme 'rhel-8.0'. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 14:02:35 kjcf05n02 systemd-udevd[1617]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:02:35 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 3 14:02:35 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 14:02:35 kjcf05n02 systemd-tmpfiles[1797]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 14:02:35 kjcf05n02 systemd-tmpfiles[1797]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 14:02:35 kjcf05n02 root[1807]: openibd: running in auto mode Nov 3 14:02:35 kjcf05n02 systemd-tmpfiles[1797]: "/var/tmp" already exists and is not a directory. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started RPC Bind. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 14:02:35 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 14:02:35 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 3 14:02:35 kjcf05n02 systemd-modules-load[1926]: Inserted module 'ib_iser' Nov 3 14:02:35 kjcf05n02 systemd-modules-load[1926]: Inserted module 'ib_isert' Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 14:02:35 kjcf05n02 systemd-modules-load[1926]: Inserted module 'ib_srpt' Nov 3 14:02:35 kjcf05n02 systemd-udevd[1642]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:02:35 kjcf05n02 systemd-udevd[1646]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:02:35 kjcf05n02 systemd-modules-load[1942]: Inserted module 'ib_ipoib' Nov 3 14:02:35 kjcf05n02 systemd-modules-load[1926]: Inserted module 'rdma_ucm' Nov 3 14:02:35 kjcf05n02 systemd-modules-load[1926]: Module 'svcrdma' is blacklisted Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 14:02:35 kjcf05n02 systemd-udevd[1646]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 14:02:35 kjcf05n02 systemd-udevd[1642]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 14:02:35 kjcf05n02 systemd-modules-load[1942]: Inserted module 'ib_umad' Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 14:02:35 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 14:02:35 kjcf05n02 systemd[3156]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:02:35 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 14:02:35 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 3 14:02:35 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 3 14:02:35 kjcf05n02 openibd[1795]: Loading HCA driver and Access Layer:[ OK ] Nov 3 14:02:35 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Update is Completed. Nov 3 14:02:35 kjcf05n02 setup-icl[1775]: Setting LAN IP Address to 203.0.113.3 Nov 3 14:02:35 kjcf05n02 setup-icl[1775]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 14:02:35 kjcf05n02 setup-icl[1775]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 14:02:35 kjcf05n02 setup-icl[1775]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 14:02:35 kjcf05n02 systemd-udevd[1642]: Using default interface naming scheme 'rhel-8.0'. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 14:02:35 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 14:02:35 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 14:02:35 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 3 14:02:35 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 14:02:35 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 14:02:35 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 14:02:35 kjcf05n02 systemd[1]: Reached target Sockets. Nov 3 14:02:35 kjcf05n02 systemd[1]: Reached target Basic System. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 3 14:02:35 kjcf05n02 chronyd[2097]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 14:02:35 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 14:02:35 kjcf05n02 nscd[2100]: 2100 monitoring file `/etc/hosts` (1) Nov 3 14:02:35 kjcf05n02 nscd[2100]: 2100 monitoring directory `/etc` (2) Nov 3 14:02:35 kjcf05n02 nscd[2100]: 2100 monitoring file `/etc/resolv.conf` (3) Nov 3 14:02:35 kjcf05n02 nscd[2100]: 2100 monitoring directory `/etc` (2) Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 0 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 1 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 2 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 3 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 4 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 5 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 6 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 7 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 8 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 9 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 10 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 11 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 12 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 13 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 14 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 15 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 16 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 17 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 18 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 19 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 20 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 21 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 22 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 23 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 24 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 25 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 26 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 27 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 28 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 29 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 30 Nov 3 14:02:35 kjcf05n02 cpupower[2094]: Setting cpu: 31 Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 14:02:35 kjcf05n02 mcelog[2118]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 14:02:35 kjcf05n02 mcelog[2118]: CPU is unsupported Nov 3 14:02:35 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[2119]: Setting up Mellanox network interface: ib0 Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 14:02:35 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[2133]: Setting up Mellanox network interface: ib1 Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 14:02:35 kjcf05n02 chronyd[2097]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 14:02:35 kjcf05n02 chronyd[2097]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 14:02:35 kjcf05n02 network[2190]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 14:02:35 kjcf05n02 network[2217]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 14:02:35 kjcf05n02 network[2190]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[2219]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 14:02:35 kjcf05n02 beSetMlxConfig[2221]: ConnectX-3 multiport not detected Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[2223]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 14:02:35 kjcf05n02 network[2229]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:02:35 kjcf05n02 network[2190]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 14:02:35 kjcf05n02 dwd[2225]: dwd: vMay 29 2024 : 15:38:26 Nov 3 14:02:35 kjcf05n02 dwd[2225]: /usr/sbin/dwd -d --standalone=0 Nov 3 14:02:35 kjcf05n02 dwd[2225]: dwd: option Lethal: 0 Nov 3 14:02:35 kjcf05n02 dwd[2225]: dwd: option Interval: 60 Nov 3 14:02:35 kjcf05n02 dwd[2225]: dwd: option abrtlimit: 10 Nov 3 14:02:35 kjcf05n02 dwd[2225]: dwd: option DZPeriod: 604800 Nov 3 14:02:35 kjcf05n02 dwd[2225]: dwd: option SmartPeriod: 43200 Nov 3 14:02:35 kjcf05n02 dwd[2225]: dwd: option SDDEnabled: 1 Nov 3 14:02:35 kjcf05n02 dwd[2225]: dwd: option SDDAwaitScale: 3 Nov 3 14:02:35 kjcf05n02 dwd[2225]: dwd: option SDDAwaitMin: 100 Nov 3 14:02:35 kjcf05n02 dwd[2225]: dwd: option Verbosity: 1 Nov 3 14:02:35 kjcf05n02 dwd[2225]: dwd: option StandAlone: 0 Nov 3 14:02:35 kjcf05n02 dwd[2225]: option Lethal: 0 Nov 3 14:02:35 kjcf05n02 dwd[2225]: option Interval: 60 Nov 3 14:02:35 kjcf05n02 dwd[2225]: option abrtlimit: 10 Nov 3 14:02:35 kjcf05n02 dwd[2225]: option DZPeriod: 604800 Nov 3 14:02:35 kjcf05n02 dwd[2225]: option SmartPeriod: 43200 Nov 3 14:02:35 kjcf05n02 dwd[2225]: option SDDEnabled: 1 Nov 3 14:02:35 kjcf05n02 dwd[2225]: option SDDAwaitScale: 3 Nov 3 14:02:35 kjcf05n02 dwd[2225]: option SDDAwaitMin: 100 Nov 3 14:02:35 kjcf05n02 dwd[2225]: option Verbosity: 1 Nov 3 14:02:35 kjcf05n02 dwd[2225]: option StandAlone: 0 Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 0 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 1 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 2 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 3 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 4 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 5 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 6 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 7 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 8 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 9 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 10 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 11 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 12 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 13 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 14 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 15 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 16 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 17 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 18 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 19 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 20 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 21 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 22 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 23 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 24 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 25 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 26 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 27 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 28 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 29 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 30 Nov 3 14:02:35 kjcf05n02 cpupower[2258]: Idlestate 2 disabled on CPU 31 Nov 3 14:02:35 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 14:02:35 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[2239]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 14:02:35 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 14:02:35 kjcf05n02 mdraid-phy[2242]: no Cutlass to worry about Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 14:02:35 kjcf05n02 network[2254]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[2256]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 14:02:35 kjcf05n02 dbus-daemon[2230]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 14:02:35 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[2265]: No configuration found for ib1 Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[2272]: No configuration found for ib0 Nov 3 14:02:35 kjcf05n02 beSetMlxConfig[2221]: Starting MST (Mellanox Software Tools) driver set Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[2292]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[2301]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 14:02:35 kjcf05n02 beSetMlxConfig[2221]: Loading MST PCI module - Success Nov 3 14:02:35 kjcf05n02 mlnx_conf_mgr[2327]: INFO: No configurations found for mlx5_1, skipping. Nov 3 14:02:35 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 14:02:35 kjcf05n02 sssd[sssd][2206]: Starting up Nov 3 14:02:35 kjcf05n02 mlnx_conf_mgr[2347]: INFO: No configurations found for mlx5_0, skipping. Nov 3 14:02:35 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 14:02:35 kjcf05n02 beSetMlxConfig[2221]: Loading MST PCI configuration module - Success Nov 3 14:02:35 kjcf05n02 beSetMlxConfig[2221]: Create devices Nov 3 14:02:35 kjcf05n02 sssd[be[implicit_files]][2380]: Starting up Nov 3 14:02:35 kjcf05n02 sssd[nss][2477]: Starting up Nov 3 14:02:35 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 14:02:35 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Login Service... Nov 3 14:02:35 kjcf05n02 systemd-logind[2593]: New seat seat0. Nov 3 14:02:35 kjcf05n02 systemd-logind[2593]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Login Service. Nov 3 14:02:35 kjcf05n02 python3.9[2245]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 14:02:35 kjcf05n02 python3.9[3156]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 14:02:35 kjcf05n02 systemd-sysctl[2756]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 14:02:35 kjcf05n02 systemd-sysctl[2756]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 14:02:35 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 14:02:35 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 14:02:35 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 14:02:35 kjcf05n02 python3.9[2829]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 14:02:35 kjcf05n02 python3.9[3156]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 14:02:35 kjcf05n02 network[2190]: Bringing up loopback interface: [ OK ] Nov 3 14:02:35 kjcf05n02 systemd-sysctl[3093]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 14:02:35 kjcf05n02 systemd-sysctl[3093]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 14:02:35 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 14:02:35 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 14:02:35 kjcf05n02 systemd[1]: Reached target Network. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 14:02:35 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 14:02:35 kjcf05n02 sm-notify[3161]: Version 2.3.3 starting Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 3 14:02:35 kjcf05n02 sshd[3146]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 14:02:35 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 14:02:35 kjcf05n02 python3.9[3128]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 14:02:35 kjcf05n02 python3.9[3156]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 14:02:35 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 3 14:02:35 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 14:02:35 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 3 14:02:35 kjcf05n02 lldpad[3137]: setsockopt nearest_bridge: Invalid argument Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 14:02:35 kjcf05n02 lldpad[3137]: setsockopt nearest_bridge: Invalid argument Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 3 14:02:35 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 14:02:35 kjcf05n02 syslog-ng[3156]: [2024-11-03T20:01:21.796634] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 14:02:35 kjcf05n02 syslog-ng[3156]: [2024-11-03T20:01:21.796935] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 14:02:35 kjcf05n02 syslog-ng[3156]: [2024-11-03T20:01:21.796971] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 14:02:35 kjcf05n02 syslog-ng[3156]: [2024-11-03T20:01:21.797192] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 14:02:35 kjcf05n02 syslog-ng[3156]: [2024-11-03T20:01:21.797362] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 14:02:35 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 14:02:35 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 14:02:35 kjcf05n02 beSetMlxConfig[2221]: Unloading MST PCI module (unused) - Success Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 14:02:35 kjcf05n02 python3.9[3210]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 14:02:35 kjcf05n02 python3.9[3156]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 14:02:35 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 14:02:35 kjcf05n02 python3.9[3419]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 14:02:35 kjcf05n02 python3.9[3156]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 14:02:35 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 14:02:35 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 14:02:35 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 14:02:35 kjcf05n02 chronyd[2097]: System's initial offset : 0.002142 seconds slow of true (slew) Nov 3 14:02:35 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 14:02:35 kjcf05n02 beSetMlxConfig[2221]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 14:02:35 kjcf05n02 beSetMlxConfig[2221]: ib mode Nov 3 14:02:35 kjcf05n02 root[3440]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 3 14:02:35 kjcf05n02 root[3442]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 3 14:02:35 kjcf05n02 beSetMlxConfig[2221]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 14:02:35 kjcf05n02 beSetMlxConfig[2221]: ib mode Nov 3 14:02:35 kjcf05n02 systemd-udevd[1577]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 14:02:35 kjcf05n02 systemd-udevd[3459]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:02:35 kjcf05n02 systemd-udevd[3458]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:02:35 kjcf05n02 systemd-udevd[3462]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:02:35 kjcf05n02 systemd-udevd[3463]: Using default interface naming scheme 'rhel-8.0'. Nov 3 14:02:35 kjcf05n02 systemd-udevd[3463]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:02:35 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 14:02:35 kjcf05n02 systemd[3156]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:02:35 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[3500]: Setting up Mellanox network interface: ib1 Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[3501]: Setting up Mellanox network interface: ib0 Nov 3 14:02:35 kjcf05n02 systemd-udevd[3461]: Using default interface naming scheme 'rhel-8.0'. Nov 3 14:02:35 kjcf05n02 systemd-udevd[3460]: Using default interface naming scheme 'rhel-8.0'. Nov 3 14:02:35 kjcf05n02 systemd-udevd[3461]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:02:35 kjcf05n02 systemd-udevd[3460]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[3550]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[3553]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[3581]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[3582]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[3583]: No configuration found for ib1 Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[3584]: No configuration found for ib0 Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[3591]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[3592]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 14:02:35 kjcf05n02 mlnx_conf_mgr[3631]: INFO: No configurations found for mlx5_1, skipping. Nov 3 14:02:35 kjcf05n02 mlnx_conf_mgr[3632]: INFO: No configurations found for mlx5_0, skipping. Nov 3 14:02:35 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 14:02:35 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 14:02:35 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 3 14:02:35 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 3 14:02:35 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 14:02:35 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 3 14:02:35 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 3 14:02:35 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 14:02:35 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 14:02:35 kjcf05n02 lldpad[3137]: init_ports: Error adding device ib0 Nov 3 14:02:35 kjcf05n02 lldpad[3137]: init_ports: Error adding device ib1 Nov 3 14:02:35 kjcf05n02 lldpad[3137]: Signal 15 received - terminating Nov 3 14:02:35 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 3 14:02:35 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 14:02:35 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 14:02:35 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 3 14:02:35 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 14:02:35 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 3 14:02:35 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 3 14:02:35 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:35 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:02:35 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 1 | Nov-03-2024 | 19:01:53 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 2 | Nov-03-2024 | 19:02:45 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 3 | Nov-03-2024 | 19:02:45 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 4 | Nov-03-2024 | 19:03:50 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 5 | Nov-03-2024 | 19:03:51 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 6 | Nov-03-2024 | 19:58:40 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 7 | Nov-03-2024 | 19:58:40 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 8 | Nov-03-2024 | 19:58:40 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 9 | Nov-03-2024 | 19:58:40 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 10 | Nov-03-2024 | 19:58:40 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 11 | Nov-03-2024 | 19:58:40 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 12 | Nov-03-2024 | 19:58:40 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 13 | Nov-03-2024 | 19:58:40 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 14 | Nov-03-2024 | 19:58:40 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 15 | Nov-03-2024 | 19:58:40 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 16 | Nov-03-2024 | 19:58:40 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 17 | Nov-03-2024 | 19:58:41 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 18 | Nov-03-2024 | 19:59:11 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 19 | Nov-03-2024 | 19:59:11 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 20 | Nov-03-2024 | 19:59:11 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 21 | Nov-03-2024 | 19:59:11 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 22 | Nov-03-2024 | 19:59:11 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 23 | Nov-03-2024 | 19:59:11 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 24 | Nov-03-2024 | 19:59:11 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 25 | Nov-03-2024 | 19:59:11 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 26 | Nov-03-2024 | 19:59:11 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 27 | Nov-03-2024 | 19:59:11 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 28 | Nov-03-2024 | 19:59:11 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 29 | Nov-03-2024 | 19:59:11 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 30 | Nov-03-2024 | 19:59:11 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 31 | Nov-03-2024 | 19:59:11 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 32 | Nov-03-2024 | 19:59:11 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 33 | Nov-03-2024 | 19:59:11 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 34 | Nov-03-2024 | 19:59:11 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 35 | Nov-03-2024 | 19:59:11 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 36 | Nov-03-2024 | 19:59:11 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 37 | Nov-03-2024 | 19:59:11 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 38 | Nov-03-2024 | 19:59:11 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 39 | Nov-03-2024 | 19:59:11 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 40 | Nov-03-2024 | 19:59:12 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 41 | Nov-03-2024 | 19:59:12 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 42 | Nov-03-2024 | 19:59:12 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 43 | Nov-03-2024 | 19:59:12 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 44 | Nov-03-2024 | 19:59:12 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 45 | Nov-03-2024 | 19:59:12 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 46 | Nov-03-2024 | 19:59:12 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 47 | Nov-03-2024 | 19:59:12 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 48 | Nov-03-2024 | 19:59:12 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3974]: 49 | Nov-03-2024 | 19:59:12 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:02:35 kjcf05n02 ipmievd[3979]: Reading sensors... Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 3 14:02:35 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:35 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 14:02:35 kjcf05n02 nscd[2100]: 2100 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 14:02:35 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 14:02:35 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 3 14:02:35 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 14:02:35 kjcf05n02 beSetMlxConfig[4035]: ConnectX-3 multiport not detected Nov 3 14:02:35 kjcf05n02 beSetMlxConfig[4035]: Starting MST (Mellanox Software Tools) driver set Nov 3 14:02:35 kjcf05n02 beSetMlxConfig[4035]: Loading MST PCI module - Success Nov 3 14:02:35 kjcf05n02 systemd-udevd[1577]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 14:02:35 kjcf05n02 beSetMlxConfig[4035]: [warn] mst_pciconf is already loaded, skipping Nov 3 14:02:35 kjcf05n02 beSetMlxConfig[4035]: Create devices Nov 3 14:02:35 kjcf05n02 beSetMlxConfig[4035]: Unloading MST PCI module (unused) - Success Nov 3 14:02:35 kjcf05n02 ipmievd[3979]: Waiting for events... Nov 3 14:02:35 kjcf05n02 beSetMlxConfig[4035]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 14:02:35 kjcf05n02 beSetMlxConfig[4035]: ib mode Nov 3 14:02:35 kjcf05n02 beSetMlxConfig[4035]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 14:02:35 kjcf05n02 beSetMlxConfig[4035]: ib mode Nov 3 14:02:35 kjcf05n02 systemd-udevd[1577]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 14:02:35 kjcf05n02 systemd-udevd[4938]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:02:35 kjcf05n02 systemd-udevd[4937]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:02:35 kjcf05n02 systemd-udevd[4941]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:02:35 kjcf05n02 systemd-udevd[4942]: Using default interface naming scheme 'rhel-8.0'. Nov 3 14:02:35 kjcf05n02 systemd-udevd[4942]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:02:35 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 14:02:35 kjcf05n02 systemd[3156]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:02:35 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[4979]: Setting up Mellanox network interface: ib0 Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[4980]: Setting up Mellanox network interface: ib1 Nov 3 14:02:35 kjcf05n02 systemd-udevd[4940]: Using default interface naming scheme 'rhel-8.0'. Nov 3 14:02:35 kjcf05n02 systemd-udevd[4940]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:02:35 kjcf05n02 systemd-udevd[4939]: Using default interface naming scheme 'rhel-8.0'. Nov 3 14:02:35 kjcf05n02 systemd-udevd[4939]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[5029]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[5030]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[5060]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[5061]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[5062]: No configuration found for ib1 Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[5063]: No configuration found for ib0 Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[5070]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 14:02:35 kjcf05n02 mlnx_interface_mgr[5071]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 14:02:35 kjcf05n02 mlnx_conf_mgr[5110]: INFO: No configurations found for mlx5_0, skipping. Nov 3 14:02:35 kjcf05n02 mlnx_conf_mgr[5111]: INFO: No configurations found for mlx5_1, skipping. Nov 3 14:02:35 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 14:02:35 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}69b003cb040f02274db78e398ecfc101c9739df4a151ed3da079031a1cb1bd64' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}69b003cb040f02274db78e398ecfc101c9739df4a151ed3da079031a1cb1bd64' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}1143ae4257cb2dab7dbbea4c6b01fb358d4a1910f84d0cf19b43e382de58bb92' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}1143ae4257cb2dab7dbbea4c6b01fb358d4a1910f84d0cf19b43e382de58bb92' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}f702c66e506fdf796a7dd807da2e48077874bac3f6ec9958f06f2f7874fc3d7e' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}f702c66e506fdf796a7dd807da2e48077874bac3f6ec9958f06f2f7874fc3d7e' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}0121ad27c0da59fe5f16e1fd5732e22f86bc547a9a495a1ea57d7e035fc13102' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}0121ad27c0da59fe5f16e1fd5732e22f86bc547a9a495a1ea57d7e035fc13102' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 14:02:35 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 3 14:02:35 kjcf05n02 chronyd[2097]: chronyd exiting Nov 3 14:02:35 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 3 14:02:35 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 14:02:35 kjcf05n02 chronyd[5145]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 14:02:35 kjcf05n02 chronyd[5145]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 14:02:35 kjcf05n02 chronyd[5145]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 14:02:35 kjcf05n02 chronyd[5145]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 14:02:35 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 14:02:35 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:35 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 14:02:35 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 3 14:02:35 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 14:02:35 kjcf05n02 dwd[5176]: dwd: vMay 29 2024 : 15:38:26 Nov 3 14:02:35 kjcf05n02 dwd[5176]: /usr/sbin/dwd -i 15 -d Nov 3 14:02:35 kjcf05n02 dwd[5176]: dwd: option Lethal: 0 Nov 3 14:02:35 kjcf05n02 dwd[5176]: dwd: option Interval: 15 Nov 3 14:02:35 kjcf05n02 dwd[5176]: dwd: option abrtlimit: 10 Nov 3 14:02:35 kjcf05n02 dwd[5176]: dwd: option DZPeriod: 604800 Nov 3 14:02:35 kjcf05n02 dwd[5176]: dwd: option SmartPeriod: 43200 Nov 3 14:02:35 kjcf05n02 dwd[5176]: dwd: option SDDEnabled: 1 Nov 3 14:02:35 kjcf05n02 dwd[5176]: dwd: option SDDAwaitScale: 3 Nov 3 14:02:35 kjcf05n02 dwd[5176]: dwd: option SDDAwaitMin: 100 Nov 3 14:02:35 kjcf05n02 dwd[5176]: dwd: option Verbosity: 1 Nov 3 14:02:35 kjcf05n02 dwd[5176]: dwd: option StandAlone: 0 Nov 3 14:02:35 kjcf05n02 dwd[5176]: option Lethal: 0 Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 14:02:35 kjcf05n02 dwd[5176]: option Interval: 15 Nov 3 14:02:35 kjcf05n02 dwd[5176]: option abrtlimit: 10 Nov 3 14:02:35 kjcf05n02 dwd[5176]: option DZPeriod: 604800 Nov 3 14:02:35 kjcf05n02 dwd[5176]: option SmartPeriod: 43200 Nov 3 14:02:35 kjcf05n02 dwd[5176]: option SDDEnabled: 1 Nov 3 14:02:35 kjcf05n02 dwd[5176]: option SDDAwaitScale: 3 Nov 3 14:02:35 kjcf05n02 dwd[5176]: option SDDAwaitMin: 100 Nov 3 14:02:35 kjcf05n02 dwd[5176]: option Verbosity: 1 Nov 3 14:02:35 kjcf05n02 dwd[5176]: option StandAlone: 0 Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 14:02:35 kjcf05n02 dwd[5177]: option Lethal now set to 1 Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 14:02:35 kjcf05n02 dwd[5177]: option abrtlimit now set to 1 Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 14:02:35 kjcf05n02 dwd[5177]: option SmartPeriod now set to 86400 Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 14:02:35 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 14:02:35 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:02:35 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:35 kjcf05n02 python3.9[5208]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 14:02:35 kjcf05n02 python3.9[3156]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 14:02:35 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:02:35 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 14:02:35 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:35 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 3 14:02:35 kjcf05n02 sedcpwrkr[5345]: Using config script: /etc/sedcpwrkr.conf Nov 3 14:02:35 kjcf05n02 sedcpwrkr[5345]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 14:02:35 kjcf05n02 sedcpwrkr[5345]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 14:02:35 kjcf05n02 sedcpwrkr[5345]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 14:02:35 kjcf05n02 sedcpwrkr[5345]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 14:02:35 kjcf05n02 sedcpwrkr[5345]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 14:02:35 kjcf05n02 sedcpwrkr[5345]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 14:02:35 kjcf05n02 sedcpwrkr-server[5376]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 14:02:35 kjcf05n02 sedcpwrkr[5345]: celery multi v5.2.7 (dawn-chorus) Nov 3 14:02:35 kjcf05n02 sedcpwrkr[5345]: > Starting nodes... Nov 3 14:02:35 kjcf05n02 sedcpwrkr[5345]: > sedcpwrkr@kjcf05n02: OK Nov 3 14:02:35 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 14:02:35 kjcf05n02 sedcpwrkr-server[5378]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 14:02:35 kjcf05n02 sedcpwrkr-server[5378]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 14:02:35 kjcf05n02 sedcpwrkr-server[5378]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 14:02:35 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 14:02:35 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 3 14:02:35 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 14:02:35 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 14:02:35 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 14:02:35 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:36 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 14:02:36 kjcf05n02 systemd-udevd[1577]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 14:02:36 kjcf05n02 iptables.init[5445]: iptables: Applying firewall rules: [ OK ] Nov 3 14:02:36 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 3 14:02:36 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:37 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 14:02:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 14:02:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 14:02:37 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 14:02:37 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 14:02:37 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 14:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 14:02:37 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 14:02:37 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5543 which is not our child. We'll most likely not notice when it exits. Nov 3 14:02:37 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 14:02:37 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 14:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 14:02:38 kjcf05n02 openhpid[5543]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 14:02:38 kjcf05n02 openhpid[5543]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 14:02:38 kjcf05n02 openhpid[5543]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 14:02:38 kjcf05n02 openhpid[5543]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 14:02:38 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:38 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:02:38 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:02:38 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 14:02:38 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 14:02:38 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 14:02:38 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 14:02:38 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:38 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 14:02:39 kjcf05n02 dcs-collectord[5634]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 14:02:39 kjcf05n02 hpi.inv.log[5634]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 14:02:39 kjcf05n02 dcs-collectord[5634]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 14:02:39 kjcf05n02 dcs-collectord[5634]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 14:02:39 kjcf05n02 dcs-collector[5625]: Starting dcs-collector:[ OK ] Nov 3 14:02:39 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 14:02:39 kjcf05n02 dcs-collectord[5637]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 14:02:39 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 14:02:39 kjcf05n02 dcs-collectord[5637]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 14:02:39 kjcf05n02 dcs-collectord[5637]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 14:02:39 kjcf05n02 dcs-collectord[5637]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 14:02:39 kjcf05n02 dcs-collectord[5637]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 14:02:39 kjcf05n02 dcs-collectord[5637]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 14:02:39 kjcf05n02 dcs-collectord[5637]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 14:02:39 kjcf05n02 dcs-collectord[5637]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259347996", "units": "kB"}, {"name": "MemAvailable", "value": "258627384", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821016", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1687088", "units": "kB"}, {"name": "Inactive", "value": "960532", "units": "kB"}, {"name": "Active(anon)", "value": "1520636", "units": "kB"}, {"name": "Inactive(anon)", "value": "824780", "units": "kB"}, {"name": "Active(file)", "value": "166452", "units": "kB"}, {"name": "Inactive(file)", "value": "135752", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "752584", "units": "kB"}, {"name": "Mapped", "value": "86052", "units": "kB"}, {"name": "Shmem", "value": "1593264", "units": "kB"}, {"name": "KReclaimable", "value": "108732", "units": "kB"}, {"name": "Slab", "value": "274876", "units": "kB"}, {"name": "SReclaimable", "value": "108732", "units": "kB"}, {"name": "SUnreclaim", "value": "166144", "units": "kB"}, {"name": "KernelStack", "value": "9680", "units": "kB"}, {"name": "PageTables", "value": "18788", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3150248", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11392", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "4096", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "231752", "units": "kB"}, {"name": "DirectMap2M", "value": "24799232", "units": "kB"}, {"name": "DirectMap1G", "value": "243269632", "units": "kB"}]}' Nov 3 14:02:39 kjcf05n02 dcs-collectord[5637]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 14:02:39 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:39 kjcf05n02 dcs-collectord[5637]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 14:02:39 kjcf05n02 dcs-collectord[5637]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730664158.8920681], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730664159.1288366], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730664158.8254147, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 14:02:39 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:39 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 14:02:39 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:02:39 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:02:39 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 14:02:39 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 14:02:39 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 14:02:39 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 14:02:39 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:39 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 14:02:40 kjcf05n02 firmware-update-orc[5743]: Using config script: /etc/firmware_update_orc.conf Nov 3 14:02:40 kjcf05n02 firmware-update-orc[5743]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 14:02:40 kjcf05n02 firmware-update-orc[5743]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 14:02:40 kjcf05n02 firmware-update-orc[5743]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 14:02:40 kjcf05n02 firmware-update-orc[5743]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 14:02:40 kjcf05n02 firmware-update-orc[5743]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 14:02:40 kjcf05n02 firmware-update-orc[5743]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 14:02:40 kjcf05n02 firmware-update-orc-server[5779]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 14:02:40 kjcf05n02 firmware-update-orc[5743]: celery multi v5.2.7 (dawn-chorus) Nov 3 14:02:40 kjcf05n02 firmware-update-orc[5743]: > Starting nodes... Nov 3 14:02:40 kjcf05n02 firmware-update-orc[5743]: > worker1@kjcf05n02: OK Nov 3 14:02:40 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 14:02:40 kjcf05n02 firmware-update-orc-server[5783]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 14:02:40 kjcf05n02 firmware-update-orc-server[5783]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 14:02:40 kjcf05n02 firmware-update-orc-server[5783]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 14:02:40 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 14:02:40 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:41 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:02:41 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:02:41 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:02:41 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 14:02:41 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 14:02:41 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 14:02:41 kjcf05n02 dbus-daemon[2230]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 14:02:41 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 14:02:41 kjcf05n02 dbus-daemon[2230]: [system] Reloaded configuration Nov 3 14:02:41 kjcf05n02 dbus-daemon[2230]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 14:02:41 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 14:02:41 kjcf05n02 dbus-daemon[2230]: [system] Reloaded configuration Nov 3 14:02:41 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 14:02:41 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 14:02:41 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 14:02:41 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 14:02:41 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 14:02:41 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:41 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 3 14:02:41 kjcf05n02 ras-resource-manager-agent[5899]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 14:02:41 kjcf05n02 ras-resource-manager-agent[5885]: Starting ras-resource-manager-agent:[ OK ] Nov 3 14:02:41 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 14:02:41 kjcf05n02 ras-resource-manager-agent[5901]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 14:02:41 kjcf05n02 ras-resource-manager-client[5901]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 14:02:41 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 3 14:02:41 kjcf05n02 ras-resource-manager-client[5901]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 14:02:41 kjcf05n02 ras-resource-manager-client[5911]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 14:02:41 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:42 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:02:42 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:02:42 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:02:42 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 14:02:42 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 14:02:42 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:42 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 14:02:42 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:43 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: Press Ctrl+C to exit. Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: Plugin support version 1.0 Nov 3 14:02:43 kjcf05n02 zabbix_agent2[5985]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 14:02:43 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:02:43 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:02:43 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:43 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 14:02:43 kjcf05n02 dcs-notification-sender[6062]: dcs-notification-senderd is stopped Nov 3 14:02:43 kjcf05n02 zabbix-agent2[6076]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 14:02:43 kjcf05n02 dcs-notification-sender[6062]: Starting notification-sender:[ OK ] Nov 3 14:02:43 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 14:02:43 kjcf05n02 zabbix-agent2[6082]: INFO DCS notification agent started. (agent.py:61) Nov 3 14:02:43 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 14:02:43 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:43 kjcf05n00 mcfcli[3673891]: %3|1730664163.619|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:02:44 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:02:44 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:02:44 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:02:44 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:44 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 14:02:44 kjcf05n02 dcs-collectord[6180]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 14:02:44 kjcf05n02 dcs-collectord[6180]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 14:02:44 kjcf05n02 dcs-bulk-data-sender[6180]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 14:02:44 kjcf05n02 dcs-bulk-data-sender[6171]: Starting bulk-data-sender:[ OK ] Nov 3 14:02:44 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 14:02:44 kjcf05n02 dcs-collectord[6182]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 14:02:44 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 14:02:44 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:45 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:02:45 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:02:45 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:02:45 kjcf05n02 nscd[2100]: 2100 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 14:02:45 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 14:02:45 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 14:02:45 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 14:02:45 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 14:02:45 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 14:02:45 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 14:02:45 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 14:02:45 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 14:02:45 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 14:02:45 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 14:02:45 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 14:02:45 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 14:02:45 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 14:02:45 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 14:02:45 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 14:02:45 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 14:02:45 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 14:02:45 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 14:02:46 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 3 14:02:46 kjcf05n02 sssd[nss][2477]: Shutting down (status = 0) Nov 3 14:02:46 kjcf05n02 sssd[be[implicit_files]][2380]: Shutting down (status = 0) Nov 3 14:02:46 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 3 14:02:46 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 3 14:02:46 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 14:02:46 kjcf05n02 sssd[sssd][6253]: Starting up Nov 3 14:02:46 kjcf05n02 python3.9[5208]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 14:02:46 kjcf05n02 python3.9[3156]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:02:46 kjcf05n02 sssd[be[implicit_files]][6269]: Starting up Nov 3 14:02:46 kjcf05n02 sssd[nss][6270]: Starting up Nov 3 14:02:46 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 14:02:46 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 14:02:46 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 14:02:47 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 14:02:47 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 14:02:47 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 14:02:47 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 14:02:47 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 14:02:47 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 14:02:47 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 14:02:47 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 14:02:47 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 14:02:47 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 14:02:47 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 14:02:47 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 14:02:47 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 14:02:47 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 14:02:47 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:02:47 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:02:47 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:47 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 14:02:48 kjcf05n02 icinga2[6322]: [2024-11-03 14:02:48 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 14:02:48 kjcf05n02 icinga2[6322]: [2024-11-03 14:02:48 -0600] information/cli: Loading configuration file(s). Nov 3 14:02:48 kjcf05n02 icinga2[6322]: [2024-11-03 14:02:48 -0600] information/ConfigItem: Committing config item(s). Nov 3 14:02:48 kjcf05n02 icinga2[6322]: [2024-11-03 14:02:48 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 3 14:02:48 kjcf05n02 icinga2[6322]: [2024-11-03 14:02:48 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 14:02:48 kjcf05n02 icinga2[6322]: [2024-11-03 14:02:48 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 14:02:48 kjcf05n02 icinga2[6322]: [2024-11-03 14:02:48 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 14:02:48 kjcf05n02 icinga2[6322]: [2024-11-03 14:02:48 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 14:02:48 kjcf05n02 icinga2[6322]: [2024-11-03 14:02:48 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 14:02:48 kjcf05n02 icinga2[6322]: [2024-11-03 14:02:48 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 14:02:48 kjcf05n02 icinga2[6322]: [2024-11-03 14:02:48 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 14:02:48 kjcf05n02 icinga2[6322]: [2024-11-03 14:02:48 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 14:02:48 kjcf05n02 icinga2[6322]: [2024-11-03 14:02:48 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 14:02:48 kjcf05n02 icinga2[6322]: [2024-11-03 14:02:48 -0600] information/cli: Closing console log. Nov 3 14:02:48 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 14:02:48 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:48 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:02:48 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:02:48 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:02:49 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 14:02:49 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 14:02:49 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:49 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 3 14:02:49 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:50 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 14:02:50 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:02:50 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:02:50 kjcf05n02 dcs-bulk-data-sender[6182]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 14:02:50 kjcf05n02 dcs-collectord[6182]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 14:02:50 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 14:02:50 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 14:02:50 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 14:02:50 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 14:02:50 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 14:02:50 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 14:02:50 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 14:02:50 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 14:02:50 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 14:02:50 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 14:02:50 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 14:02:50 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 14:02:50 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 14:02:50 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 14:02:50 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:50 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 14:02:50 kjcf05n02 nslcd[6939]: version 0.9.9 starting Nov 3 14:02:50 kjcf05n02 nslcd[6939]: accepting connections Nov 3 14:02:50 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 14:02:50 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:51 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:02:51 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:02:51 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:02:51 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 14:02:51 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 14:02:52 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 14:02:52 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 14:02:52 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 14:02:52 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 14:02:52 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 14:02:52 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 14:02:52 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:52 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 14:02:53 kjcf05n02 dearcpw[7040]: Using config script: /etc/dearcpw.conf Nov 3 14:02:53 kjcf05n02 dearcpw[7040]: - Creating default directory: '/var/log/dearcpw' Nov 3 14:02:53 kjcf05n02 dearcpw[7040]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 14:02:53 kjcf05n02 dearcpw[7040]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 14:02:53 kjcf05n02 dearcpw[7040]: - Creating default directory: '/var/run/dearcpw' Nov 3 14:02:53 kjcf05n02 dearcpw[7040]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 14:02:53 kjcf05n02 dearcpw[7040]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 14:02:53 kjcf05n02 dearcpw-server[7080]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 14:02:53 kjcf05n02 dearcpw[7040]: celery multi v5.2.7 (dawn-chorus) Nov 3 14:02:53 kjcf05n02 dearcpw[7040]: > Starting nodes... Nov 3 14:02:53 kjcf05n02 dearcpw[7040]: > dearcpw@kjcf05n02: OK Nov 3 14:02:53 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 14:02:53 kjcf05n02 dearcpw-server[7096]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 14:02:53 kjcf05n02 dearcpw-server[7096]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 14:02:53 kjcf05n02 dearcpw-server[7096]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 14:02:53 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 3 14:02:53 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:02:53 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:02:53 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 14:02:53 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 14:02:53 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 14:02:53 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 14:02:53 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 14:02:53 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 14:02:53 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 14:02:53 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 14:02:53 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 14:02:53 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 14:02:54 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:33924). Nov 3 14:02:54 kjcf05n01 rsyncd[3128561]: connect from kjcf05n02 (172.16.2.5) Nov 3 14:02:54 kjcf05n01 rsyncd[3128561]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 14:02:54 kjcf05n01 rsyncd[3128561]: receiving file list Nov 3 14:02:54 kjcf05n01 rsyncd[3128561]: sent 29 bytes received 333 bytes total size 10905 Nov 3 14:02:54 kjcf05n01 systemd[1]: rsyncd@634-172.16.2.2:873-172.16.2.5:33924.service: Succeeded. Nov 3 14:02:54 kjcf05n02 puppet[7119]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 3 14:02:54 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 14:02:54 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 14:02:54 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 14:02:54 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 14:02:54 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 14:02:54 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 14:02:54 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 14:02:54 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 14:02:54 kjcf05n02 dcs-collectord[5637]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 14:02:54 kjcf05n02 dcs-collectord[5637]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 14:02:54 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 14:02:54 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 14:02:54 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 14:02:54 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 14:02:54 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 14:02:54 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 14:02:55 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 14:02:55 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 14:02:55 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 14:02:55 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 14:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 14:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 14:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 14:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 14:02:56 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 14:02:56 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 14:02:56 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 14:02:56 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 14:02:57 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 14:02:57 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 14:02:57 kjcf05n02 systemd[1]: Reloading. Nov 3 14:02:57 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 14:02:57 kjcf05n02 diskless-swap[7619]: HA_PS_000: recovering journal Nov 3 14:02:57 kjcf05n02 systemd-udevd[1577]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 14:02:57 kjcf05n02 diskless-swap[7619]: HA_PS_000: clean, 2284/6400 files, 7076/25600 blocks Nov 3 14:02:57 kjcf05n02 ipmievd[3979]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 14:02:57 kjcf05n02 ipmievd[3979]: System Event sensor - Timestamp Clock Sync Nov 3 14:02:57 kjcf05n02 diskless-swap[7619]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 14:02:57 kjcf05n02 diskless-swap[7619]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 14:02:57 kjcf05n02 diskless-swap[7619]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 14:02:57 kjcf05n02 diskless-swap[7619]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 14:02:57 kjcf05n02 ipmievd[3979]: System Event sensor - Timestamp Clock Sync Nov 3 14:02:57 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 14:02:57 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:02:57 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:02:57 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 14:02:57 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 14:02:57 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 14:02:57 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 14:02:57 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 3 14:02:58 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 3 14:02:58 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 3 14:02:58 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 3 14:02:58 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 3 14:02:58 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 14:02:58 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 14:02:58 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 14:02:58 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 14:02:58 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 14:02:58 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 14:02:58 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 14:02:58 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 14:02:58 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 14:02:58 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 14:02:58 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 14:02:59 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 14:02:59 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 14:02:59 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 14:02:59 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 14:02:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 14:02:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 14:03:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 14:03:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 14:03:00 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 14:03:00 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 14:03:00 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 14:03:00 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 14:03:01 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 14:03:01 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 14:03:01 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 14:03:01 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 14:03:01 kjcf05n02 systemd[1]: Reloading. Nov 3 14:03:01 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 3 14:03:01 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:03:01 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:03:01 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 14:03:01 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 14:03:01 kjcf05n02 systemd[1]: Reloading. Nov 3 14:03:01 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 3 14:03:01 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:03:01 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:03:01 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 14:03:01 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 14:03:01 kjcf05n02 systemd[1]: Reloading. Nov 3 14:03:02 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 3 14:03:02 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:03:02 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:03:02 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 14:03:02 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 14:03:02 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 14:03:02 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 14:03:02 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 14:03:02 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 14:03:02 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 14:03:02 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 14:03:02 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 14:03:02 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 14:03:02 kjcf05n02 systemd[1]: Reloading. Nov 3 14:03:02 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 3 14:03:02 kjcf05n02 kdumpctl[7852]: kdump: No kdump initial ramdisk found. Nov 3 14:03:02 kjcf05n02 kdumpctl[7852]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 14:03:02 kjcf05n02 dracut[7964]: dracut-049-135.git20210121.el8 Nov 3 14:03:03 kjcf05n02 dracut[7966]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 14:03:03 kjcf05n02 dracut[7966]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 14:03:03 kjcf05n02 dracut[7966]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 14:03:03 kjcf05n02 dracut[7966]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 14:03:03 kjcf05n02 dracut[7966]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 14:03:03 kjcf05n02 dracut[7966]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 14:03:03 kjcf05n02 dracut[7966]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 14:03:03 kjcf05n02 dracut[7966]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + is_func check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ type -t check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check -h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local dev holder Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + require_binaries mdadm expr Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _module_name=90hperaid Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ mdadm = \-\m ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for cmd in "$@" Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + find_binary mdadm Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for cmd in "$@" Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + find_binary expr Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n -h ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for dev in "${!host_fs_types[@]}" Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ nfs != *_raid_member ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + continue Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _ret=255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + ret=255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ 255 = 0 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ 255 = 255 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ module_depends hperaid Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: +++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: +++ set -x Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ depends Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo rootfs-block Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ return 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ _ret=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ return 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for _moddep in $(module_depends $_mod) Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all == *\ hperaid\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + add_dracutmodules+=' rootfs-block ' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ == *\ hperaid\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check_module rootfs-block Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _mod=rootfs-block Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddep Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ == *\ rootfs-block\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n '' ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all == *\ rootfs-block\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + module_check rootfs-block 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 14:03:03 kjcf05n02 kdumpctl[3156]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _forced=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 2 -eq 2 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _forced=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + is_func check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ type -t check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check -h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _ret=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + ret=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ 0 = 0 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ module_depends rootfs-block Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: +++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 14:03:03 kjcf05n02 kdumpctl[3156]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ depends Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo fs-lib Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ _ret=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ return 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for _moddep in $(module_depends $_mod) Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all == *\ rootfs-block\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + add_dracutmodules+=' fs-lib ' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ == *\ rootfs-block\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check_module fs-lib Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _mod=fs-lib Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddep Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n '' ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + mods_checked_as_dep+=' fs-lib ' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all == *\ fs-lib\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + module_check fs-lib 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _forced=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 2 -eq 2 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _forced=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + is_func check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ type -t check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check -h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _ret=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + ret=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ 0 = 0 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ module_depends fs-lib Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: +++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ depends Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ return 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ _ret=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ return 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + mods_to_load+=' fs-lib ' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + mods_to_load+=' rootfs-block ' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + mods_to_load+=' hperaid ' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _mod=90kernel-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _mod=kernel-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check_module kernel-modules 1 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _mod=kernel-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddep Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all = all ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + module_check kernel-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _forced=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 1 -eq 2 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + is_func check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ type -t check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check -h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + true Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _ret=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + ret=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ 0 != 0 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ module_depends kernel-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: +++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ depends Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ true Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ _ret=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ return 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + mods_to_load+=' kernel-modules ' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _mod=90kernel-modules-extra Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _mod=kernel-modules-extra Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check_module kernel-modules-extra 1 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _mod=kernel-modules-extra Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddep Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all = all ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + module_check kernel-modules-extra Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _forced=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 1 -eq 2 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + is_func check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ type -t check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check -h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + true Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _ret=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + ret=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ 0 != 0 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ module_depends kernel-modules-extra Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: +++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ depends Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ true Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ _ret=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ return 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + mods_to_load+=' kernel-modules-extra ' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _mod=90kernel-network-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _mod=kernel-network-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check_module kernel-network-modules 1 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _mod=kernel-network-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddep Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all = all ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + module_check kernel-network-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _forced=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 1 -eq 2 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + is_func check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ type -t check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check -h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _ret=255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + ret=255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ 255 != 0 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 1 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _mod=90livenet Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _mod=livenet Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check_module livenet 1 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _mod=livenet Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddep Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all = all ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + module_check livenet Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 14:03:03 kjcf05n02 kdumpctl[3156]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _forced=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 1 -eq 2 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + is_func check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ type -t check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check -h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _ret=255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + ret=255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ 255 != 0 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 1 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _mod=90lvm Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _mod=lvm Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check_module lvm 1 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _mod=lvm Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddep Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all = all ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + module_check lvm Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _forced=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 1 -eq 2 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + is_func check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ type -t check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check -h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + require_binaries lvm Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _module_name=90lvm Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ lvm = \-\m ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for cmd in "$@" Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + find_binary lvm Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n -h ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for fs in "${host_fs_types[@]}" Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ nfs = LVM*_member ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _ret=255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + ret=255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ 255 != 0 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 1 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _mod=90mdraid Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _mod=mdraid Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check_module mdraid 1 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _mod=mdraid Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddep Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all = all ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + module_check mdraid Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _forced=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 1 -eq 2 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + is_func check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ type -t check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check -h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _rootdev Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + require_binaries mdadm expr Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _module_name=90mdraid Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ mdadm = \-\m ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for cmd in "$@" Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + find_binary mdadm Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for cmd in "$@" Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + find_binary expr Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n -h ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for dev in "${!host_fs_types[@]}" Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ nfs != *_raid_member ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + continue Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _ret=255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + ret=255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ 255 != 0 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 1 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _mod=90multipath Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _mod=multipath Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check_module multipath 1 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _mod=multipath Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 14:03:03 kjcf05n02 kdumpctl[3156]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddep Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all = all ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + module_check multipath Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _forced=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 1 -eq 2 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + is_func check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ type -t check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check -h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _rootdev Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n -h ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for_each_host_dev_and_slaves is_mpath Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _func=is_mpath Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _dev Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for _dev in "${host_devs[@]}" Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + continue Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 1 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _ret=255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + ret=255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ 255 != 0 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 1 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _mod=90qemu Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _mod=qemu Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check_module qemu 1 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _mod=qemu Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddep Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all = all ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + module_check qemu Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _forced=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 1 -eq 2 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + is_func check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ type -t check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check -h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n -h ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + type -P systemd-detect-virt Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ systemd-detect-virt --vm Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + vm=none Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + (( 1 != 0 )) Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _ret=255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + ret=255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ 255 != 0 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 1 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _mod=90qemu-net Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _mod=qemu-net Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check_module qemu-net 1 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _mod=qemu-net Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddep Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all = all ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + module_check qemu-net Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _forced=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 1 -eq 2 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + is_func check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ type -t check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check -h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n -h ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + type -P systemd-detect-virt Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ systemd-detect-virt --vm Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + vm= Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + (( 1 != 0 )) Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _ret=255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + ret=255 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ 255 != 0 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + return 1 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _mod=90stratis Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + _mod=stratis Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check_module stratis 1 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _mod=stratis Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddep Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -n 1 ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ all = all ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + module_check stratis Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ read a b Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _forced=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _hostonly=-h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 1 -eq 2 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + is_func check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: ++ type -t check Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + '[' 0 -ne 0 ']' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + check -h Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _module_name=90stratis Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + local _ret=0 Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + [[ stratisd-init = \-\m ]] Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + for cmd in "$@" Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + find_binary stratisd-init Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 14:03:03 kjcf05n02 kdumpctl[7852]: + set +x Nov 3 14:03:03 kjcf05n02 dracut[7966]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 14:03:03 kjcf05n02 dracut[7966]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 14:03:03 kjcf05n02 dracut[7966]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 14:03:03 kjcf05n02 dracut[7966]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 14:03:03 kjcf05n02 dracut[7966]: memstrack is available Nov 3 14:03:03 kjcf05n02 dracut[7966]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 14:03:03 kjcf05n02 dracut[7966]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 14:03:03 kjcf05n02 dracut[7966]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 14:03:04 kjcf05n02 dracut[7966]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 14:03:04 kjcf05n02 dracut[7966]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 14:03:04 kjcf05n02 dracut[7966]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 14:03:04 kjcf05n02 dracut[7966]: *** Including module: bash *** Nov 3 14:03:04 kjcf05n02 dracut[7966]: *** Including module: systemd *** Nov 3 14:03:05 kjcf05n02 dracut[7966]: *** Including module: fips *** Nov 3 14:03:05 kjcf05n02 dracut[7966]: *** Including module: systemd-initrd *** Nov 3 14:03:05 kjcf05n02 dracut[7966]: *** Including module: watchdog-modules *** Nov 3 14:03:05 kjcf05n02 dracut[7966]: *** Including module: nss-softokn *** Nov 3 14:03:05 kjcf05n02 dracut[7966]: *** Including module: i18n *** Nov 3 14:03:05 kjcf05n02 dracut[7966]: No KEYMAP configured. Nov 3 14:03:05 kjcf05n02 dracut[7966]: *** Including module: network-legacy *** Nov 3 14:03:05 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 3 14:03:06 kjcf05n02 dracut[7966]: *** Including module: network *** Nov 3 14:03:06 kjcf05n02 dracut[7966]: *** Including module: ib_bonding *** Nov 3 14:03:06 kjcf05n02 dracut[7966]: *** Including module: drm *** Nov 3 14:03:08 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 3 14:03:09 kjcf05n02 dcs-collectord[5637]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 14:03:09 kjcf05n02 dcs-collectord[5637]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 14:03:09 kjcf05n00 mcfcli[3673891]: %3|1730664189.087|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:03:09 kjcf05n02 dracut[7966]: *** Including module: hperaid *** Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + install Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + local rule rule_path Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + inst_multiple cat expr Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.fG3eSo/initramfs -a -f cat expr Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + _ret=0 Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + (( 0 != 0 )) Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + : Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + return 0 Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + inst_multiple -o mdmon Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.fG3eSo/initramfs -a -f -o mdmon Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + _ret=0 Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + (( 0 != 0 )) Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + : Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + return 0 Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: ++ command -v partx Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + inst /usr/sbin/partx /sbin/partx Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + local _hostonly_install Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + [[ -e /tmp/dracut.fG3eSo/initramfs//sbin/partx ]] Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.fG3eSo/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + (( 0 != 0 )) Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + : Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: ++ command -v mdadm Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + local _hostonly_install Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + [[ -e /tmp/dracut.fG3eSo/initramfs//sbin/mdadm ]] Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.fG3eSo/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + (( 0 != 0 )) Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + : Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + [[ yes == \y\e\s ]] Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + local _raidconf Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: ++ cmdline Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: ++ local _activated dev line UUID Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: ++ declare -A _activated Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: ++ for dev in "${!host_fs_types[@]}" Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: ++ [[ nfs != *_raid_member ]] Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: ++ continue Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + _raidconf= Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + [[ -n '' ]] Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + inst_rules 64-md-raid.rules Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + local _target=/etc/udev/rules.d _rule _found Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + inst_dir /usr/lib/udev/rules.d Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + [[ -e /tmp/dracut.fG3eSo/initramfs//usr/lib/udev/rules.d ]] Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + return 0 Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + inst_dir /etc/udev/rules.d Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + [[ -e /tmp/dracut.fG3eSo/initramfs//etc/udev/rules.d ]] Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + return 0 Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + for _rule in "$@" Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + continue Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + continue Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + for r in '' $dracutbasedir/rules.d/ Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + [[ 64-md-raid.rules != /* ]] Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + continue Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + for r in '' $dracutbasedir/rules.d/ Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + continue Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + [[ -n '' ]] Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 14:03:09 kjcf05n02 kdumpctl[7852]: + set +x Nov 3 14:03:09 kjcf05n02 dracut[7966]: Skipping udev rule: 64-md-raid.rules Nov 3 14:03:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730664189', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 331 processes with STATE = RSZDT '}"] Nov 3 14:03:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 331 processes with STATE = RSZDT ', 'message': 'PROCS OK: 331 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730664189'} Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + installkernel Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + instmods =drivers/md Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + local _optional=-o Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + local _silent Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + local _ret Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + [[ '' = yes ]] Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + [[ =drivers/md = \-\c ]] Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + [[ =drivers/md = \-\s ]] Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + (( 1 == 0 )) Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.fG3eSo/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + _ret=0 Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + (( 0 != 0 )) Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + [[ -n '' ]] Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + return 0 Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + _ret=0 Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + unset check depends cmdline install installkernel Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + return 0 Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + modules_loaded+='hperaid ' Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + '[' -n '' ']' Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + _d_mod=90kernel-modules Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + _d_mod=kernel-modules Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + [[ '' = yes ]] Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + dinfo '*** Including module: kernel-modules ***' Nov 3 14:03:10 kjcf05n02 kdumpctl[7852]: + set +x Nov 3 14:03:10 kjcf05n02 dracut[7966]: *** Including module: kernel-modules *** Nov 3 14:03:10 kjcf05n02 dracut[7966]: *** Including module: kernel-modules-extra *** Nov 3 14:03:10 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:03:11 kjcf05n02 dracut[7966]: *** Including module: kernel-network-modules *** Nov 3 14:03:11 kjcf05n02 dracut[7966]: *** Including module: diskless-mod *** Nov 3 14:03:11 kjcf05n02 dracut[7966]: *** Including module: fstab-sys *** Nov 3 14:03:11 kjcf05n02 dracut[7966]: *** Including module: nfs *** Nov 3 14:03:11 kjcf05n02 dracut[7966]: *** Including module: rootfs-block *** Nov 3 14:03:11 kjcf05n02 dracut[7966]: *** Including module: terminfo *** Nov 3 14:03:11 kjcf05n02 dracut[7966]: *** Including module: udev-rules *** Nov 3 14:03:12 kjcf05n02 dracut[7966]: Skipping udev rule: 91-permissions.rules Nov 3 14:03:12 kjcf05n02 dracut[7966]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 14:03:12 kjcf05n02 dracut[7966]: *** Including module: dracut-systemd *** Nov 3 14:03:12 kjcf05n02 dracut[7966]: *** Including module: usrmount *** Nov 3 14:03:12 kjcf05n02 dracut[7966]: *** Including module: base *** Nov 3 14:03:13 kjcf05n02 dracut[7966]: *** Including module: fs-lib *** Nov 3 14:03:13 kjcf05n02 dracut[7966]: *** Including module: kdumpbase *** Nov 3 14:03:12 kjcf05n00 zabbix-server[1312159]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 14:03:12 kjcf05n00 zabbix-server[1312159]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:47\\"}}"' Nov 3 14:03:13 kjcf05n00 log_interesting_event.py[1312159]: Event '46280' acknowledged Nov 3 14:03:13 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31441 deleted. Nov 3 14:03:13 kjcf05n02 dracut[7966]: *** Including module: memstrack *** Nov 3 14:03:13 kjcf05n02 dracut[7966]: *** Including module: shutdown *** Nov 3 14:03:13 kjcf05n02 dracut[7966]: *** Including module: squash *** Nov 3 14:03:13 kjcf05n00 mcfcli[3673891]: %3|1730664193.620|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:03:14 kjcf05n02 dracut[7966]: *** Including modules done *** Nov 3 14:03:14 kjcf05n02 dracut[7966]: *** Installing kernel module dependencies *** Nov 3 14:03:14 kjcf05n02 dracut[7966]: *** Installing kernel module dependencies done *** Nov 3 14:03:14 kjcf05n02 dracut[7966]: *** Resolving executable dependencies *** Nov 3 14:03:15 kjcf05n02 dracut[7966]: *** Resolving executable dependencies done*** Nov 3 14:03:15 kjcf05n02 dracut[7966]: *** Hardlinking files *** Nov 3 14:03:15 kjcf05n02 dracut[7966]: *** Hardlinking files done *** Nov 3 14:03:15 kjcf05n02 dracut[7966]: *** Generating early-microcode cpio image *** Nov 3 14:03:15 kjcf05n02 dracut[7966]: *** Constructing AuthenticAMD.bin **** Nov 3 14:03:15 kjcf05n02 dracut[7966]: *** Store current command line parameters *** Nov 3 14:03:15 kjcf05n02 dracut[7966]: Stored kernel commandline: Nov 3 14:03:15 kjcf05n02 dracut[7966]: rd.driver.pre=sd_mod Nov 3 14:03:15 kjcf05n02 dracut[7966]: rd.driver.pre=nvme Nov 3 14:03:15 kjcf05n02 dracut[7966]: rd.driver.pre=ipmi_si Nov 3 14:03:15 kjcf05n02 dracut[7966]: rd.driver.pre=ipmi_devintf Nov 3 14:03:15 kjcf05n02 dracut[7966]: rd.driver.pre=ipmi_msghandler Nov 3 14:03:15 kjcf05n02 dracut[7966]: nameserver=172.16.2.2 Nov 3 14:03:15 kjcf05n02 dracut[7966]: nameserver=127.0.0.1 Nov 3 14:03:15 kjcf05n02 dracut[7966]: nameserver=172.16.2.2 Nov 3 14:03:15 kjcf05n02 dracut[7966]: nameserver=127.0.0.1 Nov 3 14:03:15 kjcf05n02 dracut[7966]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 3 14:03:15 kjcf05n02 dracut[7966]: rd.neednet Nov 3 14:03:15 kjcf05n02 dracut[7966]: kdumpnic=mgmt0 Nov 3 14:03:15 kjcf05n02 dracut[7966]: bootdev=mgmt0 Nov 3 14:03:15 kjcf05n02 dracut[7966]: *** Install squash loader *** Nov 3 14:03:16 kjcf05n02 dracut[7966]: *** Squashing the files inside the initramfs *** Nov 3 14:03:16 kjcf05n02 dracut[7966]: *** Squashing the files inside the initramfs done *** Nov 3 14:03:16 kjcf05n02 dracut[7966]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 14:03:16 kjcf05n02 dracut[7966]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 14:03:17 kjcf05n02 kdumpctl[7852]: kdump: kexec: loaded kdump kernel Nov 3 14:03:17 kjcf05n02 kdumpctl[7852]: kdump: Starting kdump: [OK] Nov 3 14:03:17 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 3 14:03:17 kjcf05n02 systemd[1]: Reloading. Nov 3 14:03:17 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:03:17 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:03:17 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:03:17 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 14:03:17 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 14:03:17 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 14:03:17 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 14:03:17 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 14:03:17 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 14:03:17 kjcf05n02 ifdown[14560]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 14:03:17 kjcf05n02 ifdown[14561]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:03:17 kjcf05n02 ifdown[14562]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:03:18 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 14:03:18 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 14:03:18 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 14:03:18 kjcf05n02 ifup[14622]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 14:03:18 kjcf05n02 ifup[14623]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:03:18 kjcf05n02 ifup[14638]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730664199', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.4% (3698816 kB) used.'}"] Nov 3 14:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.4% (3698816 kB) used.', 'message': 'OK - 1.4% (3698816 kB) used.', 'value': 'ok', 'timestamp': '1730664199'} Nov 3 14:03:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:03:22 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 14:03:22 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 14:03:22 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 14:03:22 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 14:03:22 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:03:22 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:03:22 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:03:22 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:03:22 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 14:03:22 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 14:03:22 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 14:03:22 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 14:03:22 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:03:22 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:03:22 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:03:22 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:03:22 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 14:03:22 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 14:03:22 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 14:03:22 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 14:03:22 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 14:03:22 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 14:03:22 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 14:03:22 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 14:03:22 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 14:03:22 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 14:03:22 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 14:03:22 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 14:03:22 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 14:03:22 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 14:03:22 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 14:03:22 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 14:03:22 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 14:03:22 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 14:03:22 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 14:03:22 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 14:03:22 kjcf05n02 ifdown[14828]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 14:03:22 kjcf05n02 ifdown[14829]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:03:22 kjcf05n02 ifdown[14830]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:03:23 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 14:03:23 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 14:03:23 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 14:03:23 kjcf05n02 ifup[14890]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 14:03:23 kjcf05n02 ifup[14891]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:03:23 kjcf05n02 ifup[14892]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:03:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730664203', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 14:03:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730664203', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(56.0B/300.0B), ib1=(0.0B/60.0B), icl0=(4.8kB/6.5kB), lo=(500.0B/500.0B), meth0=(1541.0MB/7.7MB), mgmt0=(1477.8MB/7.7MB)'}"] Nov 3 14:03:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730664203'} Nov 3 14:03:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(56.0B/300.0B), ib1=(0.0B/60.0B), icl0=(4.8kB/6.5kB), lo=(500.0B/500.0B), meth0=(1541.0MB/7.7MB), mgmt0=(1477.8MB/7.7MB)', 'message': 'NET OK - (Rx/Tx) ib0=(56.0B/300.0B), ib1=(0.0B/60.0B), icl0=(4.8kB/6.5kB), lo=(500.0B/500.0B), meth0=(1541.0MB/7.7MB), mgmt0=(1477.8MB/7.7MB)', 'value': 'ok', 'timestamp': '1730664203'} Nov 3 14:03:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:03:24 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 14:03:24 kjcf05n02 dcs-collectord[5637]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 14:03:24 kjcf05n02 dcs-collectord[5637]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 14:03:26 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 14:03:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730664205', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 14:03:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730664205'} Nov 3 14:03:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:03:27 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 14:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T14:03:27.253985502-06:00 level=info msg="Completed cleanup jobs" duration=27.340643ms Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 14:03:27 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 14:03:27 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 14:03:27 kjcf05n02 systemd[1]: Reloading. Nov 3 14:03:28 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 3 14:03:28 kjcf05n02 await_ha_peer[15125]: Waiting for HA peer kjcf05n03 Nov 3 14:03:29 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 14:03:29 kjcf05n02 await_ha_peer[15125]: Peer kjcf05n03 has started, starting HA Nov 3 14:03:29 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 3 14:03:29 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 3 14:03:29 kjcf05n02 fstonithd.py[15178]: Listening for kdump packets from partner Nov 3 14:03:29 kjcf05n02 systemd[1]: Reloading. Nov 3 14:03:30 kjcf05n02 systemd[3156]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:03:30 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:03:30 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:03:30 kjcf05n02 systemd[1]: Reloading. Nov 3 14:03:30 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 3 14:03:30 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 14:03:30 kjcf05n02 systemd[1]: Reloading. Nov 3 14:03:30 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 14:03:30 kjcf05n02 puppet-agent[3566]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:03:30 kjcf05n02 puppet[3566]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:03:30 kjcf05n02 puppet-agent[3566]: Applied catalog in 92.73 seconds Nov 3 14:03:30 kjcf05n02 puppet[3566]: Notice: Applied catalog in 92.73 seconds Nov 3 14:03:30 kjcf05n02 systemd[1]: Started Puppet agent. Nov 3 14:03:31 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 14:03:31 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 14:03:31 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 14:03:31 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 14:03:31 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 14:03:31 kjcf05n02 systemd[1]: Reached target Timers. Nov 3 14:03:31 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 14:03:31 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 14:03:31 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 3 14:03:31 kjcf05n02 wce-disable.sh[15326]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 14:03:31 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 14:03:31 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 14:03:31 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 14:03:31 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 14:03:31 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 3 14:03:31 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 3 14:03:31 kjcf05n02 gateway-ec-node.py[15322]: Starting gateway-ec-node service Nov 3 14:03:31 kjcf05n02 python3.9[15323]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 14:03:31 kjcf05n02 python3.9[15323]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 14:03:31 kjcf05n02 RFSF-API[15321]: INFO[2024-11-03T14:03:31-06:00] Datapath API RESTful Service starting Nov 3 14:03:31 kjcf05n02 dp-api-server-node[15321]: INFO[2024-11-03T14:03:31-06:00] Datapath API RESTful Service starting Nov 3 14:03:31 kjcf05n02 RFSF-API[15321]: INFO[2024-11-03T14:03:31-06:00] Running in production mode, starting dbus event listener Nov 3 14:03:31 kjcf05n02 dp-api-server-node[15321]: INFO[2024-11-03T14:03:31-06:00] Running in production mode, starting dbus event listener Nov 3 14:03:31 kjcf05n02 RFSF-API[15321]: INFO[2024-11-03T14:03:31-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 14:03:31 kjcf05n02 dp-api-server-node[15321]: INFO[2024-11-03T14:03:31-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 14:03:31 kjcf05n02 RFSF-API[15321]: INFO[2024-11-03T14:03:31-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 14:03:31 kjcf05n02 dp-api-server-node[15321]: INFO[2024-11-03T14:03:31-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 14:03:31 kjcf05n02 RFSF-API[15321]: INFO[2024-11-03T14:03:31-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 14:03:31 kjcf05n02 dp-api-server-node[15321]: INFO[2024-11-03T14:03:31-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 14:03:31 kjcf05n02 RFSF-API[15321]: INFO[2024-11-03T14:03:31-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 14:03:31 kjcf05n02 dp-api-server-node[15321]: INFO[2024-11-03T14:03:31-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 14:03:31 kjcf05n02 RFSF-API[15321]: INFO[2024-11-03T14:03:31-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 14:03:31 kjcf05n02 dp-api-server-node[15321]: INFO[2024-11-03T14:03:31-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 14:03:31 kjcf05n02 RFSF-API[15321]: INFO[2024-11-03T14:03:31-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 14:03:31 kjcf05n02 dp-api-server-node[15321]: INFO[2024-11-03T14:03:31-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 14:03:31 kjcf05n02 RFSF-API[15321]: INFO[2024-11-03T14:03:31-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 14:03:31 kjcf05n02 dp-api-server-node[15321]: INFO[2024-11-03T14:03:31-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 14:03:31 kjcf05n02 RFSF-API[15321]: INFO[2024-11-03T14:03:31-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 14:03:31 kjcf05n02 dp-api-server-node[15321]: INFO[2024-11-03T14:03:31-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 14:03:31 kjcf05n02 RFSF-API[15321]: INFO[2024-11-03T14:03:31-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 14:03:31 kjcf05n02 dp-api-server-node[15321]: INFO[2024-11-03T14:03:31-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 14:03:31 kjcf05n02 RFSF-API[15321]: INFO[2024-11-03T14:03:31-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 14:03:31 kjcf05n02 dp-api-server-node[15321]: INFO[2024-11-03T14:03:31-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 14:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730664216', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 14:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730664216', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 14:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730664216'} Nov 3 14:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730664216'} Nov 3 14:03:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:03:37 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 14:03:37 kjcf05n02 systemd[1]: Reloading. Nov 3 14:03:37 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 14:03:37 kjcf05n02 systemd[1]: Reloading. Nov 3 14:03:37 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 14:03:37 kjcf05n02 diskmonitor_pre[15710]: Key management is currently disabled.DEAR disabled Nov 3 14:03:37 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 14:03:39 kjcf05n02 dcs-collectord[5637]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 14:03:39 kjcf05n02 dcs-collectord[5637]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 14:03:39 kjcf05n02 dcs-collectord[5637]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 14:03:39 kjcf05n02 sh[15777]: LNET configured: New Created Nov 3 14:03:39 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 14:03:39 kjcf05n02 LCNmon[17869]: Interface ib0 is up Nov 3 14:03:39 kjcf05n02 LCNmon[17869]: Interface ib1 is up Nov 3 14:03:41 kjcf05n00 httpd[902571]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 14:03:42 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: /var/run/diskmonitor does not exist, creating Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: Creating /var/run/diskmonitor/disk Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: Creating /var/run/diskmonitor/encl Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: Creating /var/run/diskmonitor/cli Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: RAS_Interlocks_enabled: 1 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: add handler for sig: 14 sa_flags: 10000004 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: add handler for sig: 1 sa_flags: 10000004 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: add handler for sig: 2 sa_flags: 00000004 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: add handler for sig: 15 sa_flags: 00000004 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: add handler for sig: 6 sa_flags: 00000004 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: add handler for sig: 3 sa_flags: 00000004 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: add handler for sig: 30 sa_flags: 00000004 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: add handler for sig: 20 sa_flags: 00000004 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: add handler for sig: 10 sa_flags: 10000004 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: add handler for sig: 11 sa_flags: 00000004 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: add handler for sig: 7 sa_flags: 00000004 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: add handler for sig: 4 sa_flags: 00000004 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: add handler for sig: 8 sa_flags: 00000004 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: Using HA Baton locks - key: diskmonitor Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: Baton will be held for at most 570 seconds Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: DMMP Enabled: 0 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: random seed: bba575a3 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: NVMe Enclosure: 1 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: ZFS Enclosure: 0 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: Dbus, Initialized Connection Successfully Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: int_catcher_thread: thread start Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: Received dbus message 4 org.freedesktop.DBus -> :1.95 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 14:03:42 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 14:03:43 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18408 (bash) Nov 3 14:03:43 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 14:03:43 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 14:03:43 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 14:03:43 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 14:03:43 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 14:03:43 kjcf05n02 openhpid[5543]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 14:03:43 kjcf05n02 openhpid[5543]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 14:03:43 kjcf05n02 LCNmon[17869]: 10.16.100.57 is unreachable via ib0 Nov 3 14:03:43 kjcf05n00 mcfcli[3673891]: %3|1730664223.620|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:03:44 kjcf05n02 LCNmon[17869]: 10.16.100.61 is unreachable via ib0 Nov 3 14:03:44 kjcf05n02 LCNmon[17869]: Can ping through interface ib0 Nov 3 14:03:44 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 3 14:03:44 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 14:03:44 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 14:03:44 kjcf05n02 LCNmon[17869]: Can ping through interface ib1 Nov 3 14:03:44 kjcf05n02 LCNmon[17869]: NIC ib0, initial state UP Nov 3 14:03:44 kjcf05n02 LCNmon[17869]: NIC ib1, initial state UP Nov 3 14:03:44 kjcf05n02 LCNmon[17869]: LCNstat initial state UP Nov 3 14:03:44 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18500 which is not our child. We'll most likely not notice when it exits. Nov 3 14:03:44 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 14:03:44 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 3 14:03:44 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 3 14:03:44 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 14:03:44 kjcf05n02 dcs-collectord[5637]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 14:03:44 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 14:03:44 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 14:03:44 kjcf05n02 systemd[1]: Startup finished in 50.573s (kernel) + 2min 29.630s (userspace) = 3min 20.203s. Nov 3 14:03:44 kjcf05n02 openhpid[18500]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 14:03:44 kjcf05n02 openhpid[18500]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 14:03:44 kjcf05n02 openhpid[18500]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 14:03:44 kjcf05n02 openhpid[18500]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 14:03:44 kjcf05n02 LCNmon[17869]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 3 14:03:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730664226', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.81, 1.86, 0.86'}"] Nov 3 14:03:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 1.81, 1.86, 0.86', 'message': 'OK - load average: 1.81, 1.86, 0.86', 'value': 'ok', 'timestamp': '1730664226'} Nov 3 14:03:46 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: check_run_sedcmd, No Device name provided Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 14:03:47 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 14:03:49 kjcf05n00 mcfcli[3673891]: %3|1730664229.084|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:03:54 kjcf05n02 dcs-collectord[5637]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 14:03:54 kjcf05n02 dcs-collectord[5637]: WARNING No data collected (hpi_parser.py:353) Nov 3 14:04:07 kjcf05n02 ipmievd[3979]: System Event sensor - Timestamp Clock Sync Nov 3 14:04:09 kjcf05n02 ipmievd[3156]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:04:09 kjcf05n02 dcs-collectord[5637]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 14:04:13 kjcf05n00 mcfcli[3673891]: %3|1730664253.620|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 14:04:20 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 14:04:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730664261', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 14:04:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730664261'} Nov 3 14:04:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:04:24 kjcf05n02 dcs-collectord[5637]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 14:04:24 kjcf05n03 nslcd[6915]: [e8944a] ldap_result() failed: Can't contact LDAP server Nov 3 14:04:27 kjcf05n00 mcfcli[3673891]: %3|1730664267.481|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:04:28 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the dIEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 14:04:28 kjcf05n02 ras-resource-manager-agent[5901]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "d4dd0dd2-9a1e-11ef-92c4-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 14:04:28 kjcf05n02 ras-resource-manager-agent[5901]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'd4dd0dd2-9a1e-11ef-92c4-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 14:04:28 kjcf05n02 ras-resource-manager-agent[5901]: INFO Submitting new device inserted signal, starting to qualify drive: d4dd0dd2-9a1e-11ef-92c4-00093d0695e3 (admin_action.py:110) Nov 3 14:04:28 kjcf05n03 firmware-update-orc-server[5844]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "fa023639-4265-4188-bfc2-1a86ce46f9ed"} (logger.py:65) Nov 3 14:04:28 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 84542 (get_disk_device) Nov 3 14:04:28 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 14:04:28 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 14:04:28 kjcf05n03 ccp-client[84563]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 14:04:28 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'd4dd0dd2-9a1e-11ef-92c4-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 14:04:28 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'd4dd0dd2-9a1e-11ef-92c4-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 14:04:28 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': 'd4dd0dd2-9a1e-11ef-92c4-00093d0695e3', 'response ID': 'd4e7a09e-9a1e-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 14:04:28 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: d4e7a09e-9a1e-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 14:04:29 kjcf05n03 ccp-client[84563]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 14:04:29 kjcf05n03 ccp-client[84572]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 14:04:29 kjcf05n03 ccp-client[84563]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 14:04:29 kjcf05n03 ccp-client[84563]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 14:04:29 kjcf05n03 ccp-client[84572]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 14:04:29 kjcf05n03 ccp-client[84572]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 14:04:29 kjcf05n02 diskmonitor[17454]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 14:04:29 kjcf05n02 ras-resource-manager-agent[5901]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "d5303804-9a1e-11ef-92c4-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 14:04:29 kjcf05n02 ras-resource-manager-agent[5901]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'd5303804-9a1e-11ef-92c4-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 14:04:29 kjcf05n02 ras-resource-manager-agent[5901]: INFO Submitting new device inserted signal, starting to qualify drive: d5303804-9a1e-11ef-92c4-00093d0695e3 (admin_action.py:110) Nov 3 14:04:29 kjcf05n02 firmware-update-orc-server[5857]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "21b89262-56f7-4d25-b801-26d2f6239d7a"} (logger.py:65) Nov 3 14:04:28 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'd5303804-9a1e-11ef-92c4-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 14:04:28 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'd5303804-9a1e-11ef-92c4-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 14:04:28 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': 'd5303804-9a1e-11ef-92c4-00093d0695e3', 'response ID': 'd53774f2-9a1e-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 14:04:28 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: d53774f2-9a1e-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 14:04:32 kjcf05n03 DRVFW[84726]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 14:04:32 kjcf05n03 ccp-client[84727]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 14:04:32 kjcf05n03 ccp-client[84727]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 14:04:32 kjcf05n03 ccp-client[84736]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 14:04:32 kjcf05n03 ccp-client[84727]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 14:04:32 kjcf05n03 ccp-client[84736]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 14:04:32 kjcf05n03 ccp-client[84736]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 14:04:32 kjcf05n03 ccp-client[84727]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 14:04:32 kjcf05n03 firmware-update-orc-server[5844]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 14:04:33 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: d4e7a09e-9a1e-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 14:04:33 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': 'd4dd0dd2-9a1e-11ef-92c4-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': 'd4dd0dd2-9a1e-11ef-92c4-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}}} (logger.py:65) Nov 3 14:04:33 kjcf05n02 ras-resource-manager-agent[5901]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'd4dd0dd2-9a1e-11ef-92c4-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 14:04:33 kjcf05n02 ras-resource-manager-agent[5901]: INFO Drive qualification complete responding: d4dd0dd2-9a1e-11ef-92c4-00093d0695e3 (admin_action.py:205) Nov 3 14:04:33 kjcf05n02 ras-resource-manager-agent[5901]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "d4dd0dd2-9a1e-11ef-92c4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (interesting_event.py:59) Nov 3 14:04:36 kjcf05n02 diskmonitor[17454]: rive: eui.345950304db010060025384500000004 Nov 3 14:04:36 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 14:04:36 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 14:04:36 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 14:04:36 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 14:04:36 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 14:04:36 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 14:04:36 kjcf05n02 diskmonitor[17454]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 14:04:36 kjcf05n02 diskmonitor[17454]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 14:04:36 kjcf05n02 diskmonitor[17454]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 14:04:36 kjcf05n02 diskmonitor[17454]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 14:04:36 kjcf05n02 diskmonitor[17454]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 14:04:36 kjcf05n02 diskmonitor[17454]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "d4dd0dd2-9a1e-11ef-92c4-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 14:04:36 kjcf05n02 diskmonitor[17454]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 14:04:36 kjcf05n02 diskmonitor[17454]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 14:04:36 kjcf05n02 diskmonitor[17454]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "d5303804-9a1e-11ef-92c4-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 14:04:36 kjcf05n02 diskmonitor[17454]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 14:04:36 kjcf05n02 diskmonitor[17454]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 14:04:40 kjcf05n02 chronyd[5145]: Selected source 172.16.2.1 Nov 3 14:04:43 kjcf05n00 mcfcli[3673891]: %3|1730664283.620|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:04:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730664283}"] Nov 3 14:04:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730664283, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:04:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:04:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730664283}"] Nov 3 14:04:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730664283, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:04:44 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 3 14:04:44 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22497 (get_disk_device) Nov 3 14:04:44 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 14:04:44 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 14:04:44 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 14:04:44 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 3 14:04:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:04:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730664283}"] Nov 3 14:04:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730664283, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:04:44 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:04:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730664283}"] Nov 3 14:04:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730664283, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:04:44 kjcf05n02 ccp-client[22530]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 14:04:44 kjcf05n02 ccp-client[22530]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 14:04:44 kjcf05n02 ccp-client[22542]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 14:04:44 kjcf05n02 ccp-client[22530]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 14:04:44 kjcf05n02 ccp-client[22542]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 14:04:44 kjcf05n02 ccp-client[22542]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 14:04:44 kjcf05n02 ccp-client[22530]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 14:04:44 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:04:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730664283}"] Nov 3 14:04:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730664283, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:04:44 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:04:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730664283}"] Nov 3 14:04:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730664283, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:04:44 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:04:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730664283}"] Nov 3 14:04:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730664283, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:04:44 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:04:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730664283}"] Nov 3 14:04:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730664283, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:04:44 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:04:45 kjcf05n02 ras-resource-manager-agent[5901]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "d4dd0dd2-9a1e-11ef-92c4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (service_main_handler.py:66) Nov 3 14:04:45 kjcf05n02 ras-resource-manager-agent[5901]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'd4dd0dd2-9a1e-11ef-92c4-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 14:04:45 kjcf05n02 ras-resource-manager-agent[5901]: INFO Device qualification response has been acknowledged: d4dd0dd2-9a1e-11ef-92c4-00093d0695e3 (admin_action.py:151) Nov 3 14:04:47 kjcf05n02 DRVFW[23033]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 14:04:47 kjcf05n02 python3.9[5208]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 14:04:47 kjcf05n02 python3.9[3156]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:04:47 kjcf05n02 ccp-client[23034]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 14:04:47 kjcf05n02 ccp-client[23034]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 14:04:47 kjcf05n02 ccp-client[23072]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 14:04:47 kjcf05n02 ccp-client[23034]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 14:04:47 kjcf05n02 ccp-client[23034]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 14:04:47 kjcf05n02 ccp-client[23072]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 14:04:47 kjcf05n02 ccp-client[23072]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 14:04:47 kjcf05n02 firmware-update-orc-server[5857]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 14:04:47 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: d53774f2-9a1e-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 14:04:47 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': 'd5303804-9a1e-11ef-92c4-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': 'd5303804-9a1e-11ef-92c4-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}}} (logger.py:65) Nov 3 14:04:48 kjcf05n02 ras-resource-manager-agent[5901]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'd5303804-9a1e-11ef-92c4-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 14:04:48 kjcf05n02 ras-resource-manager-agent[5901]: INFO Drive qualification complete responding: d5303804-9a1e-11ef-92c4-00093d0695e3 (admin_action.py:205) Nov 3 14:04:48 kjcf05n02 ras-resource-manager-agent[5901]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "d5303804-9a1e-11ef-92c4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 3 14:04:49 kjcf05n02 diskmonitor[17454]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 14:04:50 kjcf05n02 diskmonitor[17454]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 14:04:50 kjcf05n02 ras-resource-manager-agent[5901]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "e1bca6a2-9a1e-11ef-92c4-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 14:04:50 kjcf05n02 ras-resource-manager-agent[5901]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'e1bca6a2-9a1e-11ef-92c4-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 14:04:50 kjcf05n02 ras-resource-manager-agent[5901]: INFO Requests ['d5303804-9a1e-11ef-92c4-00093d0695e3', 'e1bca6a2-9a1e-11ef-92c4-00093d0695e3'] already in progress (admin_action.py:99) Nov 3 14:04:50 kjcf05n02 ras-resource-manager-agent[5901]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'e1bca6a2-9a1e-11ef-92c4-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 14:04:50 kjcf05n02 ras-resource-manager-agent[5901]: INFO Drive qualification complete responding: e1bca6a2-9a1e-11ef-92c4-00093d0695e3 (admin_action.py:205) Nov 3 14:04:50 kjcf05n02 ras-resource-manager-agent[5901]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "d5303804-9a1e-11ef-92c4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 3 14:04:50 kjcf05n02 ras-resource-manager-agent[5901]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "e1bca6a2-9a1e-11ef-92c4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "d4dd0dd2-9a1e-11ef-92c4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: Dbus, handle_ingress_ras_signals, uuid: d4dd0dd2-9a1e-11ef-92c4-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "d4dd0dd2-9a1e-11ef-92c4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: main: Pending firmware leveling requests exist, rescanning disks Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "e1bca6a2-9a1e-11ef-92c4-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: leaving test state: 1 next state: 2 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: lock req: no timeout Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: leaving test state: 2 next state: 4 Nov 3 14:04:55 kjcf05n02 diskmonitor[17454]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 14:05:05 kjcf05n00 mcfcli[3673891]: %3|1730664305.210|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:05:13 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31440 deleted. Nov 3 14:05:13 kjcf05n00 mcfcli[3673891]: %3|1730664313.621|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:05:17 kjcf05n00 python3.9[1313435]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 14:05:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730664029', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 14:05:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730664029'} Nov 3 14:05:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:05:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730664029', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 14:05:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730664029'} Nov 3 14:05:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:05:43 kjcf05n00 mcfcli[3673891]: %3|1730664343.622|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 14:05:45 kjcf05n00 mcfcli[3673891]: %3|1730664345.098|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:05:45 kjcf05n00 zabbix-server[1314036]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 14:05:45 kjcf05n00 zabbix-server[1314036]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 119.96\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 96.88\\"}}"' Nov 3 14:05:45 kjcf05n00 log_interesting_event.py[1314036]: Event '46293' acknowledged Nov 3 14:05:49 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 14:05:49 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 14:05:49 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 14:05:54 kjcf05n02 ras-resource-manager-agent[5901]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "d5303804-9a1e-11ef-92c4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 14:05:54 kjcf05n02 ras-resource-manager-agent[5901]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'd5303804-9a1e-11ef-92c4-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 14:05:54 kjcf05n02 ras-resource-manager-agent[5901]: INFO Device qualification response has been acknowledged: d5303804-9a1e-11ef-92c4-00093d0695e3 (admin_action.py:151) Nov 3 14:05:54 kjcf05n02 ras-resource-manager-agent[5901]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "d5303804-9a1e-11ef-92c4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 14:05:54 kjcf05n02 ras-resource-manager-agent[5901]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'd5303804-9a1e-11ef-92c4-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 14:05:54 kjcf05n02 ras-resource-manager-agent[5901]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "e1bca6a2-9a1e-11ef-92c4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 14:05:54 kjcf05n02 ras-resource-manager-agent[5901]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'e1bca6a2-9a1e-11ef-92c4-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 14:05:54 kjcf05n02 ras-resource-manager-agent[5901]: INFO Device qualification response has been acknowledged: e1bca6a2-9a1e-11ef-92c4-00093d0695e3 (admin_action.py:151) Nov 3 14:05:55 kjcf05n02 diskmonitor[17454]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 14:06:04 kjcf05n02 dcs-collectord[5637]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 14:06:04 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 14:06:05 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 14:06:05 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 14:06:12 kjcf05n02 diskmonitor[17454]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "d5303804-9a1e-11ef-92c4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 14:06:12 kjcf05n02 diskmonitor[17454]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 14:06:12 kjcf05n02 diskmonitor[17454]: Dbus, handle_ingress_ras_signals, uuid: d5303804-9a1e-11ef-92c4-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 14:06:12 kjcf05n02 diskmonitor[17454]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 14:06:12 kjcf05n02 diskmonitor[17454]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "d5303804-9a1e-11ef-92c4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 14:06:12 kjcf05n02 diskmonitor[17454]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "d5303804-9a1e-11ef-92c4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 14:06:12 kjcf05n02 diskmonitor[17454]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 14:06:12 kjcf05n02 diskmonitor[17454]: Dbus, handle_ingress_ras_signals, uuid: d5303804-9a1e-11ef-92c4-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 14:06:12 kjcf05n02 diskmonitor[17454]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "d5303804-9a1e-11ef-92c4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 14:06:12 kjcf05n02 diskmonitor[17454]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "e1bca6a2-9a1e-11ef-92c4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 14:06:12 kjcf05n02 diskmonitor[17454]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 14:06:12 kjcf05n02 diskmonitor[17454]: Dbus, handle_ingress_ras_signals, uuid: e1bca6a2-9a1e-11ef-92c4-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 14:06:12 kjcf05n02 diskmonitor[17454]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "e1bca6a2-9a1e-11ef-92c4-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 14:06:12 kjcf05n02 diskmonitor[17454]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 14:06:12 kjcf05n02 diskmonitor[17454]: lock acquired Nov 3 14:06:12 kjcf05n02 diskmonitor[17454]: leaving test state: 4 next state: 8 Nov 3 14:06:12 kjcf05n02 diskmonitor[17454]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 14:06:13 kjcf05n00 mcfcli[3673891]: %3|1730664373.622|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:06:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730664375}"] Nov 3 14:06:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730664375, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:06:15 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:06:15-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:06:15 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:06:15-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:06:15 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:06:15-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:06:15 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:06:15-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:06:15 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:06:15-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:06:15 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:06:15-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:06:15 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:06:15-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.225858ms Nov 3 14:06:15 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:06:15-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.225858ms Nov 3 14:06:15 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:06:15 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:06:15 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:06:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Inactive', 'timestamp': 1730664382}"] Nov 3 14:06:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730664382, 'value': 'Inactive', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:06:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:06:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:06:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:06:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:06:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:06:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:06:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:06:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:06:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:06:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:06:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:06:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:06:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:06:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.348237ms Nov 3 14:06:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:06:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.348237ms Nov 3 14:06:22 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:06:22 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:06:24 kjcf05n00 zabbix-server[1314525]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 14:06:24 kjcf05n00 zabbix-server[1314525]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 81.6\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 55.24\\"}}"' Nov 3 14:06:24 kjcf05n00 log_interesting_event.py[1314525]: Event '46294' acknowledged Nov 3 14:06:25 kjcf05n00 mcfcli[3673891]: %3|1730664385.095|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:06:28 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 14:06:29 kjcf05n02 diskmonitor[17454]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 14:06:29 kjcf05n02 diskmonitor[17454]: leaving test state: 8 next state: 20 Nov 3 14:06:29 kjcf05n02 diskmonitor[17454]: leaving test state: 20 next state: 40 Nov 3 14:06:29 kjcf05n02 diskmonitor[17454]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 268222f8000 Nov 3 14:06:29 kjcf05n02 diskmonitor[17454]: leaving test state: 40 next state: 80 Nov 3 14:06:43 kjcf05n00 mcfcli[3673891]: %3|1730664403.622|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:07:05 kjcf05n00 mcfcli[3673891]: %3|1730664425.092|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:07:13 kjcf05n00 mcfcli[3673891]: %3|1730664433.622|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:07:15 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 14:07:19 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 3 14:07:29 kjcf05n02 diskmonitor[17454]: leaving test state: 80 next state: 100 Nov 3 14:07:29 kjcf05n02 diskmonitor[17454]: lock release: time: Sun Nov 3 14:07:23 2024 Nov 3 14:07:29 kjcf05n02 diskmonitor[17454]: leaving test state: 100 next state: 1 Nov 3 14:07:43 kjcf05n00 mcfcli[3673891]: %3|1730664463.622|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:07:44 kjcf05n00 mcfcli[3673891]: %3|1730664464.730|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:07:47 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 3 14:07:47 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 3 14:08:13 kjcf05n00 mcfcli[3673891]: %3|1730664493.623|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:08:24 kjcf05n00 mcfcli[3673891]: %3|1730664504.727|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:08:43 kjcf05n00 mcfcli[3673891]: %3|1730664523.623|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 14:08:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730664523}"] Nov 3 14:08:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730664523, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:08:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:08:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:08:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:08:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:08:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:08:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:08:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:08:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:08:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:08:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:08:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:08:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:08:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:08:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.18399ms Nov 3 14:08:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:08:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.18399ms Nov 3 14:08:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:08:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:08:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:09:01 kjcf05n00 mcfcli[3673891]: %3|1730664541.831|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:09:13 kjcf05n00 mcfcli[3673891]: %3|1730664553.624|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:09:36 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 3 14:09:36 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 3 14:09:36 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 3 14:09:41 kjcf05n00 mcfcli[3673891]: %3|1730664581.828|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:09:43 kjcf05n00 mcfcli[3673891]: %3|1730664583.624|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:09:57 kjcf05n00 zabbix-server[1316212]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 14:09:57 kjcf05n00 zabbix-server[1316212]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n02' from event '46295' Nov 3 14:09:58 kjcf05n00 zabbix-server[1316212]: Host created 'enclosure_USE26000024VS001' Nov 3 14:09:58 kjcf05n00 zabbix-server[1316212]: Running puppet on 'kjcf05n02' Nov 3 14:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 14:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 14:10:00 kjcf05n02 puppet-agent[35212]: Using configured environment 'production' Nov 3 14:10:00 kjcf05n02 puppet-agent[35212]: Retrieving pluginfacts Nov 3 14:10:00 kjcf05n02 puppet-agent[35212]: Retrieving plugin Nov 3 14:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 14:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 14:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 14:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 14:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 14:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 14:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 14:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 14:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 14:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 14:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 14:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 14:10:00 kjcf05n02 puppet-agent[35212]: Loading facts Nov 3 14:10:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 14:10:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:10:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 14:10:03 kjcf05n02 puppet-agent[35212]: Caching catalog for kjcf05n02 Nov 3 14:10:03 kjcf05n02 puppet-agent[35212]: Applying configuration version '1730664601' Nov 3 14:10:05 kjcf05n02 puppet-agent[35212]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 14:10:05 kjcf05n02 puppet-agent[35212]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 14:10:05 kjcf05n02 puppet-agent[35212]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 14:10:06 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 14:10:06 kjcf05n02 zabbix_agent2[5985]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 14:10:06 kjcf05n02 zabbix_agent2[3156]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:10:06 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 14:10:06 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 14:10:06 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 14:10:06 kjcf05n02 puppet-agent[35212]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: Press Ctrl+C to exit. Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: Plugin support version 1.0 Nov 3 14:10:06 kjcf05n02 zabbix_agent2[35668]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 14:10:08 kjcf05n02 puppet-agent[35212]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 14:10:08 kjcf05n02 puppet-agent[35212]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 14:10:08 kjcf05n02 puppet-agent[35212]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 14:10:08 kjcf05n02 puppet-agent[35212]: Applied catalog in 5.23 seconds Nov 3 14:10:08 kjcf05n00 zabbix-server[1316212]: puppet completed status:(0): '' Nov 3 14:10:08 kjcf05n00 zabbix-server[1316212]: Event '46295' acknowledged Nov 3 14:10:08 kjcf05n00 zabbix-server[1316212]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n02"}' Nov 3 14:10:09 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 14:10:09 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 14:10:09 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 14:10:11 kjcf05n00 python3.9[1316346]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 14:10:13 kjcf05n00 mcfcli[3673891]: %3|1730664613.625|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 14:10:17 kjcf05n00 mcfcli[3673891]: %3|1730664617.093|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:10:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730664029', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 14:10:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730664029'} Nov 3 14:10:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:10:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730664029', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 14:10:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730664029'} Nov 3 14:10:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:10:43 kjcf05n00 mcfcli[3673891]: %3|1730664643.625|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:10:55 kjcf05n00 mcfcli[3673891]: %3|1730664655.098|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:11:13 kjcf05n00 mcfcli[3673891]: %3|1730664673.625|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 14:11:15 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 14:11:15 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 14:11:15 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 14:11:25 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 3 14:11:25 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 3 14:11:25 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 3 14:11:32 kjcf05n00 mcfcli[3673891]: %3|1730664692.582|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:11:43 kjcf05n00 mcfcli[3673891]: %3|1730664703.625|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 14:11:54 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 3 14:12:08 kjcf05n00 mcfcli[3673891]: %3|1730664728.835|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:12:13 kjcf05n00 mcfcli[3673891]: %3|1730664733.625|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:12:21 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 3 14:12:21 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 3 14:12:43 kjcf05n00 mcfcli[3673891]: %3|1730664763.626|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:12:47 kjcf05n00 mcfcli[3673891]: %3|1730664767.056|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:13:13 kjcf05n00 mcfcli[3673891]: %3|1730664793.627|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:13:25 kjcf05n00 mcfcli[3673891]: %3|1730664805.408|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T14:13:27.248094006-06:00 level=info msg="Completed cleanup jobs" duration=21.56154ms Nov 3 14:13:43 kjcf05n00 mcfcli[3673891]: %3|1730664823.627|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 14:14:04 kjcf05n00 mcfcli[3673891]: %3|1730664844.638|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:14:13 kjcf05n00 mcfcli[3673891]: %3|1730664853.627|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:14:18 kjcf05n02 root[42408]: failback_xyraid Nov 3 14:14:19 kjcf05n02 root[42539]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 14:14:20 kjcf05n02 root[42692]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 14:14:23 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 3 14:14:29 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme2n1 Nov 3 14:14:29 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme9n1 Nov 3 14:14:29 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme17n1 Nov 3 14:14:29 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme4n1 Nov 3 14:14:29 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme8n1 Nov 3 14:14:29 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme25n1 Nov 3 14:14:29 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme18n1 Nov 3 14:14:29 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme24n1 Nov 3 14:14:29 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme3n1 Nov 3 14:14:29 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme19n1 Nov 3 14:14:29 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme23n1 Nov 3 14:14:31 kjcf05n02 dwd[5177]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 14:14:31 kjcf05n02 dwd[5177]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 14:14:31 kjcf05n02 dwd[5177]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 14:14:31 kjcf05n02 dwd[5177]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 14:14:31 kjcf05n02 dwd[5177]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 14:14:31 kjcf05n02 dwd[5177]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 14:14:31 kjcf05n02 dwd[5177]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 14:14:31 kjcf05n02 dwd[5177]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 14:14:31 kjcf05n02 dwd[5177]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 14:14:31 kjcf05n02 dwd[5177]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 14:14:31 kjcf05n02 dwd[5177]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 14:14:31 kjcf05n02 dwd[5177]: Starting NVME thread for nvme2n1 Nov 3 14:14:31 kjcf05n02 dwd[5177]: Starting NVME thread for nvme18n1 Nov 3 14:14:32 kjcf05n02 dwd[5177]: Starting NVME thread for nvme19n1 Nov 3 14:14:32 kjcf05n02 dwd[5177]: Starting NVME thread for nvme9n1 Nov 3 14:14:32 kjcf05n02 dwd[5177]: Starting NVME thread for nvme3n1 Nov 3 14:14:32 kjcf05n02 systemd-udevd[45477]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45475]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45476]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45479]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45475]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45476]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45477]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45479]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45475]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45479]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45477]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45476]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45475]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45479]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45476]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45477]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45475]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45479]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45477]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45476]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45475]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45479]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45477]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45502]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45503]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45479]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45505]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45475]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45476]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45477]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45508]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45502]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45479]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45505]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45503]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45476]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45475]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45502]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45477]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45479]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45505]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45476]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45476]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45479]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45505]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45476]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45503]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45502]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45505]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45476]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45479]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45505]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45479]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45505]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45505]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45505]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45479]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45505]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45479]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45505]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45479]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45505]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45479]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:14:32 kjcf05n02 systemd-udevd[45479]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:14:33 kjcf05n02 dwd[5177]: Starting NVME thread for nvme24n1 Nov 3 14:14:33 kjcf05n02 dwd[5177]: Starting NVME thread for nvme4n1 Nov 3 14:14:33 kjcf05n02 dwd[5177]: Starting NVME thread for nvme23n1 Nov 3 14:14:33 kjcf05n02 dwd[5177]: Starting NVME thread for nvme17n1 Nov 3 14:14:33 kjcf05n02 dwd[5177]: Starting NVME thread for nvme25n1 Nov 3 14:14:33 kjcf05n02 dwd[5177]: Starting NVME thread for nvme8n1 Nov 3 14:14:34 kjcf05n02 nslcd[6939]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 14:14:35 kjcf05n02 diskmonitor[17454]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 14:14:35 kjcf05n02 dcs-bulk-data-sender[6182]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 141}' Nov 3 14:14:42 kjcf05n02 diskmonitor[17454]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 14:14:42 kjcf05n02 diskmonitor[17454]: Scan for ReadErrorMax change for md65 Nov 3 14:14:42 kjcf05n02 diskmonitor[17454]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 14:14:42 kjcf05n02 diskmonitor[17454]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 14:14:42 kjcf05n02 diskmonitor[17454]: read_saved_file: md65 no saved speed Nov 3 14:14:42 kjcf05n02 diskmonitor[17454]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 14:14:42 kjcf05n02 diskmonitor[17454]: Set sync_speed_min (10000) for md65 Nov 3 14:14:42 kjcf05n02 diskmonitor[17454]: Set sync_speed_max (200000) for md65 Nov 3 14:14:42 kjcf05n02 diskmonitor[17454]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 14:14:43 kjcf05n00 mcfcli[3673891]: %3|1730664883.628|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:14:43 kjcf05n00 mcfcli[3673891]: %3|1730664883.699|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:14:56 kjcf05n03 diskmonitor[17700]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 14:14:56 kjcf05n03 diskmonitor[17700]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 14:15:13 kjcf05n00 python3.9[1319359]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 14:15:13 kjcf05n00 mcfcli[3673891]: %3|1730664913.628|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 14:15:20 kjcf05n00 mcfcli[3673891]: %3|1730664920.912|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:15:25 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 14:15:25 kjcf05n02 systemd-tmpfiles[48372]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 14:15:25 kjcf05n02 systemd-tmpfiles[48372]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 14:15:25 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 14:15:25 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 14:15:26 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 48587 (bash) Nov 3 14:15:26 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 14:15:26 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 14:15:43 kjcf05n00 mcfcli[3673891]: %3|1730664943.628|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:15:56 kjcf05n00 mcfcli[3673891]: %3|1730664956.238|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:16:07 kjcf05n03 nslcd[6915]: [8e1f29] ldap_result() failed: Can't contact LDAP server Nov 3 14:16:13 kjcf05n00 mcfcli[3673891]: %3|1730664973.630|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:16:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730664974}"] Nov 3 14:16:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730664974, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:16:14 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:14-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:14 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:14-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:14 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:14-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:14 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:14-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:14 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:14-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:14 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:14-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:14 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:14-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.32265ms Nov 3 14:16:14 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:14-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.32265ms Nov 3 14:16:14 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:16:14 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:16:14 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:16:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730664974}"] Nov 3 14:16:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730664974, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:16:14 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:14-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:14 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:14-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:14 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:14-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:14 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:14-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:14 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:14-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:14 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:14-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:14 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:14-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.074796ms Nov 3 14:16:14 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:14-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.074796ms Nov 3 14:16:14 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:16:14 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:16:14 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:16:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730664974}"] Nov 3 14:16:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730664974, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:16:14 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:14-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:14 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:14-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:14 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:14-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:14 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:14-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:14 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:14-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:14 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:14-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:14 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:14-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.989786ms Nov 3 14:16:14 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:14-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.989786ms Nov 3 14:16:14 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:16:14 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:16:14 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:16:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730664974}"] Nov 3 14:16:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730664974, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:16:14 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:14-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:14 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:14-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:14 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:14-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:14 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:14-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:14 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:14-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:14 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:14-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:14 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:14-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.817403ms Nov 3 14:16:14 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:14-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.817403ms Nov 3 14:16:14 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:16:14 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:16:14 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:16:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730664974}"] Nov 3 14:16:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730664974, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:16:14 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:14-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:14 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:14-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:14 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:14-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:14 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:14-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:14 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:14-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:14 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:14-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:14 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:14-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.939712ms Nov 3 14:16:14 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:14-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.939712ms Nov 3 14:16:14 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:16:14 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:16:14 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:16:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730664974}"] Nov 3 14:16:14 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730664974, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:16:14 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:14-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:14 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:14-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:14 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:14-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:14 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:14-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:14 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:14-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:14 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:14-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:14 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:14-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.68213ms Nov 3 14:16:14 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:14-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.68213ms Nov 3 14:16:14 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:16:14 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:16:14 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:16:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730664974}"] Nov 3 14:16:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730664974, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:16:15 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:15-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:15 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:15-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:15 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:15-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:15 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:15-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:15 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:15-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:15 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:15-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:15 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:15-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.056171ms Nov 3 14:16:15 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:15-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.056171ms Nov 3 14:16:15 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:16:15 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:16:15 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:16:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730664974}"] Nov 3 14:16:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730664974, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:16:15 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:15-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:15 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:15-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:15 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:15-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:15 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:15-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:15 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:15-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:15 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:15-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:15 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:15-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.904486ms Nov 3 14:16:15 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:15-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.904486ms Nov 3 14:16:15 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:16:15 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:16:15 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:16:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730664974}"] Nov 3 14:16:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730664974, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:16:15 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:15-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:15 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:15-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:15 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:15-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:15 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:15-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:15 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:15-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:15 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:15-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:15 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:15-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.776397ms Nov 3 14:16:15 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:15-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.776397ms Nov 3 14:16:15 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:16:15 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:16:15 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:16:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730664975}"] Nov 3 14:16:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730664975, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:16:15 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:15-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:15 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:15-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:15 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:15-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:15 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:15-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:15 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:15-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:15 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:15-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:15 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:15-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.954891ms Nov 3 14:16:15 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:15-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.954891ms Nov 3 14:16:15 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:16:15 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:16:15 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:16:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730664975}"] Nov 3 14:16:15 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730664975, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:16:15 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:15-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:15 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:15-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:16:15 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:15-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:15 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:15-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:16:15 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:16:15-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:15 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:16:15-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:16:15 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:16:15-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.949581ms Nov 3 14:16:15 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:16:15-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.949581ms Nov 3 14:16:15 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:16:15 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:16:15 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:16:32 kjcf05n00 mcfcli[3673891]: %3|1730664992.133|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:16:43 kjcf05n00 mcfcli[3673891]: %3|1730665003.630|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:17:12 kjcf05n00 mcfcli[3673891]: %3|1730665032.130|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:17:13 kjcf05n00 mcfcli[3673891]: %3|1730665033.630|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:17:43 kjcf05n00 mcfcli[3673891]: %3|1730665063.631|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 14:17:49 kjcf05n00 mcfcli[3673891]: %3|1730665069.763|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:18:13 kjcf05n00 mcfcli[3673891]: %3|1730665093.631|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 14:18:28 kjcf05n00 mcfcli[3673891]: %3|1730665108.592|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:18:43 kjcf05n00 mcfcli[3673891]: %3|1730665123.631|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:19:07 kjcf05n00 mcfcli[3673891]: %3|1730665147.955|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:19:13 kjcf05n00 mcfcli[3673891]: %3|1730665153.633|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:19:43 kjcf05n00 mcfcli[3673891]: %3|1730665183.633|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:19:46 kjcf05n00 mcfcli[3673891]: %3|1730665186.357|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:19:47 kjcf05n02 dwd[5177]: nvme24n1 passed periodic SMART status check Nov 3 14:19:47 kjcf05n02 dwd[5177]: nvme18n1 passed periodic SMART status check Nov 3 14:19:47 kjcf05n02 dwd[5177]: nvme19n1 passed periodic SMART status check Nov 3 14:19:47 kjcf05n02 dwd[5177]: nvme9n1 passed periodic SMART status check Nov 3 14:19:47 kjcf05n02 dwd[5177]: nvme2n1 passed periodic SMART status check Nov 3 14:19:47 kjcf05n02 dwd[5177]: nvme3n1 passed periodic SMART status check Nov 3 14:19:49 kjcf05n02 dwd[5177]: nvme4n1 passed periodic SMART status check Nov 3 14:19:49 kjcf05n02 dwd[5177]: nvme25n1 passed periodic SMART status check Nov 3 14:19:49 kjcf05n02 dwd[5177]: nvme8n1 passed periodic SMART status check Nov 3 14:19:49 kjcf05n02 dwd[5177]: nvme23n1 passed periodic SMART status check Nov 3 14:19:49 kjcf05n02 dwd[5177]: nvme17n1 passed periodic SMART status check Nov 3 14:19:58 kjcf05n00 zabbix-server[1322183]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 14:19:58 kjcf05n00 zabbix-server[1322183]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46297' Nov 3 14:19:58 kjcf05n00 zabbix-server[1322183]: Filesystem 'kjcf05' has been mounted Nov 3 14:19:58 kjcf05n00 zabbix-server[1322183]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 14:19:58 kjcf05n00 zabbix-server[1322183]: Running puppet on 'None' Nov 3 14:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 14:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 14:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 14:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 14:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 14:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 14:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 14:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 14:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 14:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 14:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 14:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 14:20:00 kjcf05n05 puppet-agent[3470360]: Using configured environment 'production' Nov 3 14:20:00 kjcf05n05 puppet-agent[3470360]: Retrieving pluginfacts Nov 3 14:20:00 kjcf05n05 puppet-agent[3470360]: Retrieving plugin Nov 3 14:20:00 kjcf05n06 puppet-agent[3309912]: Using configured environment 'production' Nov 3 14:20:00 kjcf05n06 puppet-agent[3309912]: Retrieving pluginfacts Nov 3 14:20:00 kjcf05n06 puppet-agent[3309912]: Retrieving plugin Nov 3 14:20:00 kjcf05n04 puppet-agent[3311635]: Using configured environment 'production' Nov 3 14:20:00 kjcf05n04 puppet-agent[3311635]: Retrieving pluginfacts Nov 3 14:20:00 kjcf05n04 puppet-agent[3311635]: Retrieving plugin Nov 3 14:20:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 14:20:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:20:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 14:20:00 kjcf05n03 puppet-agent[111987]: Using configured environment 'production' Nov 3 14:20:00 kjcf05n03 puppet-agent[111987]: Retrieving pluginfacts Nov 3 14:20:00 kjcf05n03 puppet-agent[111987]: Retrieving plugin Nov 3 14:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 14:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 14:20:00 kjcf05n07 puppet-agent[3306579]: Using configured environment 'production' Nov 3 14:20:00 kjcf05n07 puppet-agent[3306579]: Retrieving pluginfacts Nov 3 14:20:00 kjcf05n07 puppet-agent[3306579]: Retrieving plugin Nov 3 14:20:01 kjcf05n02 puppet-agent[56559]: Using configured environment 'production' Nov 3 14:20:01 kjcf05n02 puppet-agent[56559]: Retrieving pluginfacts Nov 3 14:20:01 kjcf05n02 puppet-agent[56559]: Retrieving plugin Nov 3 14:20:01 kjcf05n06 puppet-agent[3309912]: Loading facts Nov 3 14:20:01 kjcf05n04 puppet-agent[3311635]: Loading facts Nov 3 14:20:01 kjcf05n03 puppet-agent[111987]: Loading facts Nov 3 14:20:01 kjcf05n07 puppet-agent[3306579]: Loading facts Nov 3 14:20:01 kjcf05n05 puppet-agent[3470360]: Loading facts Nov 3 14:20:01 kjcf05n01 puppet-agent[3135026]: Using configured environment 'production' Nov 3 14:20:01 kjcf05n01 puppet-agent[3135026]: Retrieving pluginfacts Nov 3 14:20:01 kjcf05n01 puppet-agent[3135026]: Retrieving plugin Nov 3 14:20:01 kjcf05n01 puppet-agent[3135026]: Loading facts Nov 3 14:20:01 kjcf05n02 puppet-agent[56559]: Loading facts Nov 3 14:20:01 kjcf05n00 puppet-agent[1322309]: Using configured environment 'production' Nov 3 14:20:01 kjcf05n00 puppet-agent[1322309]: Retrieving pluginfacts Nov 3 14:20:01 kjcf05n00 puppet-agent[1322309]: Retrieving plugin Nov 3 14:20:01 kjcf05n00 puppet-agent[1322309]: Loading facts Nov 3 14:20:04 kjcf05n03 puppet-agent[111987]: Caching catalog for kjcf05n03 Nov 3 14:20:04 kjcf05n03 puppet-agent[111987]: Applying configuration version '1730665202' Nov 3 14:20:04 kjcf05n06 puppet-agent[3309912]: Caching catalog for kjcf05n06 Nov 3 14:20:04 kjcf05n06 puppet-agent[3309912]: Applying configuration version '1730665202' Nov 3 14:20:04 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 14:20:04 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 14:20:04 kjcf05n02 puppet-agent[56559]: Caching catalog for kjcf05n02 Nov 3 14:20:04 kjcf05n02 puppet-agent[56559]: Applying configuration version '1730665202' Nov 3 14:20:04 kjcf05n07 puppet-agent[3306579]: Caching catalog for kjcf05n07 Nov 3 14:20:04 kjcf05n07 puppet-agent[3306579]: Applying configuration version '1730665202' Nov 3 14:20:05 kjcf05n01 puppet-agent[3135026]: Caching catalog for kjcf05n01 Nov 3 14:20:05 kjcf05n00 puppet-agent[1322309]: Caching catalog for kjcf05n00 Nov 3 14:20:05 kjcf05n00 puppet-agent[1322309]: Applying configuration version '1730665203' Nov 3 14:20:06 kjcf05n06 puppet-agent[3309912]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 14:20:06 kjcf05n06 puppet-agent[3309912]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 14:20:06 kjcf05n06 puppet-agent[3309912]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 14:20:06 kjcf05n01 puppet-agent[3135026]: Applying configuration version '1730665203' Nov 3 14:20:06 kjcf05n03 puppet-agent[111987]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 14:20:06 kjcf05n03 puppet-agent[111987]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 14:20:06 kjcf05n03 puppet-agent[111987]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 14:20:06 kjcf05n07 puppet-agent[3306579]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 14:20:06 kjcf05n07 puppet-agent[3306579]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 14:20:06 kjcf05n07 puppet-agent[3306579]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 14:20:06 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3258309]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 14:20:06 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 14:20:06 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 14:20:06 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 14:20:06 kjcf05n06 puppet-agent[3309912]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: Press Ctrl+C to exit. Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: Plugin support version 1.0 Nov 3 14:20:06 kjcf05n06 zabbix_agent2[3310938]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 14:20:06 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 14:20:06 kjcf05n03 zabbix_agent2[56040]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 14:20:06 kjcf05n03 zabbix_agent2[3072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 14:20:06 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 14:20:06 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 14:20:06 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 14:20:06 kjcf05n03 puppet-agent[111987]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: Press Ctrl+C to exit. Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: Plugin support version 1.0 Nov 3 14:20:06 kjcf05n03 zabbix_agent2[112534]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 14:20:06 kjcf05n02 puppet-agent[56559]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 14:20:06 kjcf05n02 puppet-agent[56559]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 14:20:06 kjcf05n02 puppet-agent[56559]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 14:20:07 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 14:20:07 kjcf05n02 zabbix_agent2[35668]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 14:20:07 kjcf05n02 zabbix_agent2[3156]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:20:07 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 14:20:07 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 14:20:07 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 14:20:07 kjcf05n02 puppet-agent[56559]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: Press Ctrl+C to exit. Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: Plugin support version 1.0 Nov 3 14:20:07 kjcf05n02 zabbix_agent2[57126]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 14:20:07 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3254392]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 14:20:07 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 14:20:07 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 14:20:07 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 14:20:07 kjcf05n07 puppet-agent[3306579]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: Press Ctrl+C to exit. Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: Plugin support version 1.0 Nov 3 14:20:07 kjcf05n07 zabbix_agent2[3307073]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 14:20:08 kjcf05n06 puppet-agent[3309912]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 14:20:08 kjcf05n06 puppet-agent[3309912]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 14:20:08 kjcf05n06 puppet-agent[3309912]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 14:20:08 kjcf05n00 puppet-agent[1322309]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 14:20:08 kjcf05n01 puppet-agent[3135026]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 14:20:08 kjcf05n01 puppet-agent[3135026]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-13:56:23]/mode) mode changed '0755' to '0750' Nov 3 14:20:08 kjcf05n03 puppet-agent[111987]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 14:20:08 kjcf05n03 puppet-agent[111987]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 14:20:08 kjcf05n03 puppet-agent[111987]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 14:20:08 kjcf05n03 puppet-agent[111987]: Applied catalog in 5.17 seconds Nov 3 14:20:08 kjcf05n06 puppet-agent[3309912]: Applied catalog in 4.75 seconds Nov 3 14:20:09 kjcf05n07 puppet-agent[3306579]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 14:20:09 kjcf05n07 puppet-agent[3306579]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 14:20:09 kjcf05n07 puppet-agent[3306579]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 14:20:09 kjcf05n07 puppet-agent[3306579]: Applied catalog in 4.87 seconds Nov 3 14:20:09 kjcf05n01 puppet-agent[3135026]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-13:56:23/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 14:20:09 kjcf05n01 puppet-agent[3135026]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-13:56:23/vmcore]/mode) mode changed '0600' to '0640' Nov 3 14:20:09 kjcf05n01 puppet-agent[3135026]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-13:56:23/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 14:20:09 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 14:20:09 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 14:20:09 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 14:20:09 kjcf05n02 puppet-agent[56559]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 14:20:09 kjcf05n02 puppet-agent[56559]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 14:20:09 kjcf05n02 puppet-agent[56559]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 14:20:09 kjcf05n02 puppet-agent[56559]: Applied catalog in 5.21 seconds Nov 3 14:20:09 kjcf05n00 puppet-agent[1322309]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 14:20:09 kjcf05n00 puppet-agent[1322309]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 14:20:09 kjcf05n00 puppet-agent[1322309]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 14:20:10 kjcf05n01 puppet-agent[3135026]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 14:20:10 kjcf05n01 puppet-agent[3135026]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 14:20:10 kjcf05n01 puppet-agent[3135026]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 14:20:09 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1304296]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 14:20:10 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 14:20:09 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 14:20:09 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 14:20:09 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 14:20:09 kjcf05n00 puppet-agent[1322309]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: Press Ctrl+C to exit. Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: Plugin support version 1.0 Nov 3 14:20:09 kjcf05n00 zabbix_agent2[1322946]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 14:20:10 kjcf05n00 zabbix-server[1322976]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 14:20:10 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3123621]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 14:20:10 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 14:20:10 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 14:20:10 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 14:20:10 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 14:20:10 kjcf05n01 puppet-agent[3135026]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: Press Ctrl+C to exit. Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: Plugin support version 1.0 Nov 3 14:20:10 kjcf05n01 zabbix_agent2[3135632]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 14:20:10 kjcf05n00 zabbix-server[1322977]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 14:20:11 kjcf05n00 zabbix-server[1322983]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 14:20:11 kjcf05n00 zabbix-server[1323000]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 14:20:11 kjcf05n00 puppet-agent[1322309]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 14:20:11 kjcf05n00 python3.9[1322842]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 14:20:12 kjcf05n01 puppet-agent[3135026]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_140343.log]/mode) mode changed '0644' to '0640' Nov 3 14:20:12 kjcf05n01 puppet-agent[3135026]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_141526.log]/mode) mode changed '0644' to '0640' Nov 3 14:20:12 kjcf05n01 puppet-agent[3135026]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_141527]/mode) mode changed '0755' to '0750' Nov 3 14:20:12 kjcf05n01 puppet-agent[3135026]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_141527/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 14:20:12 kjcf05n00 puppet-agent[1322309]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 14:20:12 kjcf05n00 puppet-agent[1322309]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 14:20:12 kjcf05n00 puppet-agent[1322309]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 14:20:13 kjcf05n01 puppet-agent[3135026]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_140343.log]/mode) mode changed '0644' to '0640' Nov 3 14:20:13 kjcf05n01 puppet-agent[3135026]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_141526.log]/mode) mode changed '0644' to '0640' Nov 3 14:20:13 kjcf05n01 puppet-agent[3135026]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 14:20:13 kjcf05n01 puppet-agent[3135026]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 14:20:13 kjcf05n01 puppet-agent[3135026]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 14:20:13 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 14:20:13 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 14:20:13 kjcf05n00 mcfcli[3673891]: %3|1730665213.633|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:20:13 kjcf05n00 puppet-agent[1322309]: Applied catalog in 8.38 seconds Nov 3 14:20:13 kjcf05n05 puppet-agent[3470360]: Caching catalog for kjcf05n05 Nov 3 14:20:13 kjcf05n05 puppet-agent[3470360]: Applying configuration version '1730665212' Nov 3 14:20:14 kjcf05n01 puppet-agent[3135026]: Applied catalog in 8.80 seconds Nov 3 14:20:15 kjcf05n05 puppet-agent[3470360]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 14:20:15 kjcf05n05 puppet-agent[3470360]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 14:20:15 kjcf05n05 puppet-agent[3470360]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 14:20:16 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3411865]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 14:20:16 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 14:20:16 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 14:20:16 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 14:20:16 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 14:20:16 kjcf05n05 puppet-agent[3470360]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: Press Ctrl+C to exit. Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: Plugin support version 1.0 Nov 3 14:20:16 kjcf05n05 zabbix_agent2[3471378]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 14:20:18 kjcf05n05 puppet-agent[3470360]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 14:20:18 kjcf05n05 puppet-agent[3470360]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 14:20:18 kjcf05n05 puppet-agent[3470360]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 14:20:18 kjcf05n05 puppet-agent[3470360]: Applied catalog in 4.80 seconds Nov 3 14:20:25 kjcf05n00 mcfcli[3673891]: %3|1730665225.305|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:20:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730665225', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 14:20:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730665225'} Nov 3 14:20:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:20:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730665225', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 14:20:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730665225'} Nov 3 14:20:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:20:32 kjcf05n04 puppet-agent[3311635]: Caching catalog for kjcf05n04 Nov 3 14:20:32 kjcf05n04 puppet-agent[3311635]: Applying configuration version '1730665230' Nov 3 14:20:34 kjcf05n04 puppet-agent[3311635]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 14:20:34 kjcf05n04 puppet-agent[3311635]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 14:20:34 kjcf05n04 puppet-agent[3311635]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 14:20:35 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3253662]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 14:20:35 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 14:20:35 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 14:20:35 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 14:20:35 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 14:20:35 kjcf05n04 puppet-agent[3311635]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: Press Ctrl+C to exit. Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: Plugin support version 1.0 Nov 3 14:20:35 kjcf05n04 zabbix_agent2[3312918]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 14:20:36 kjcf05n04 puppet-agent[3311635]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 14:20:36 kjcf05n04 puppet-agent[3311635]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 14:20:36 kjcf05n04 puppet-agent[3311635]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 14:20:37 kjcf05n04 puppet-agent[3311635]: Applied catalog in 4.74 seconds Nov 3 14:20:36 kjcf05n00 zabbix-server[1322183]: puppet completed status:(0): '' Nov 3 14:20:36 kjcf05n00 zabbix-server[1322183]: Event '46297' acknowledged Nov 3 14:20:37 kjcf05n00 zabbix-server[1322183]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 3 14:20:43 kjcf05n00 mcfcli[3673891]: %3|1730665243.633|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:21:05 kjcf05n00 mcfcli[3673891]: %3|1730665265.302|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:21:13 kjcf05n00 mcfcli[3673891]: %3|1730665273.634|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:21:42 kjcf05n00 mcfcli[3673891]: %3|1730665302.807|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:21:43 kjcf05n00 mcfcli[3673891]: %3|1730665303.634|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 14:22:13 kjcf05n00 mcfcli[3673891]: %3|1730665333.634|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:22:21 kjcf05n00 mcfcli[3673891]: %3|1730665341.181|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:22:43 kjcf05n00 mcfcli[3673891]: %3|1730665363.635|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 14:22:58 kjcf05n00 mcfcli[3673891]: %3|1730665378.605|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:23:13 kjcf05n00 mcfcli[3673891]: %3|1730665393.636|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 14:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T20:23:15.868301Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 14:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T20:23:15.868368Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.085ms Nov 3 14:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T14:23:27.252558983-06:00 level=info msg="Completed cleanup jobs" duration=26.173126ms Nov 3 14:23:36 kjcf05n00 mcfcli[3673891]: %3|1730665416.459|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:23:43 kjcf05n00 mcfcli[3673891]: %3|1730665423.636|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:24:10 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 3 14:24:10 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 11 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007690 sec, idle for 1 hour(s)] Nov 3 14:24:13 kjcf05n00 mcfcli[3673891]: %3|1730665453.636|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:24:16 kjcf05n00 mcfcli[3673891]: %3|1730665456.456|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:24:25 kjcf05n03 nslcd[6915]: [e87ccd] ldap_result() failed: Can't contact LDAP server Nov 3 14:24:43 kjcf05n00 mcfcli[3673891]: %3|1730665483.637|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:24:54 kjcf05n00 mcfcli[3673891]: %3|1730665494.461|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:25:11 kjcf05n00 python3.9[1325842]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 14:25:13 kjcf05n00 mcfcli[3673891]: %3|1730665513.637|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:25:34 kjcf05n00 mcfcli[3673891]: %3|1730665534.457|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:25:43 kjcf05n00 mcfcli[3673891]: %3|1730665543.637|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:26:13 kjcf05n00 mcfcli[3673891]: %3|1730665573.637|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:26:13 kjcf05n00 mcfcli[3673891]: %3|1730665573.996|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:26:32 kjcf05n00 zabbix_server[15753]: Zabbix agent item "dcs.lustre.device.ost.count[{$LUSTRE_FS_NAME}]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 3 14:26:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 14:26:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 14:26:33 kjcf05n00 zabbix_server[15781]: Zabbix agent item "vm.memory.size[available]" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 3 14:26:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 14:26:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 14:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 14:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 14:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 14:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 14:26:37 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 14:26:37 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 14:26:37 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 14:26:37 kjcf05n03 fstonithd.py[15308]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 3 14:26:39 kjcf05n03 root[123105]: is_enc_ipmi_off starts Nov 3 14:26:39 kjcf05n03 root[123106]: is_viking_off starts Nov 3 14:26:39 kjcf05n03 root[123122]: is_lan_ipmi_off leaves Nov 3 14:26:40 kjcf05n03 root[123124]: is_lan_ipmi_sec_off leaves Nov 3 14:26:40 kjcf05n03 root[123127]: I am in slot 1; partner is in slot 0 Nov 3 14:26:40 kjcf05n03 root[123130]: I am master Nov 3 14:26:43 kjcf05n00 mcfcli[3673891]: %3|1730665603.639|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 14:26:46 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='107', error='Connection reset by peer (104)' Nov 3 14:26:46 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='107', client='AF_INET(172.16.2.5:37639)', local='AF_INET(0.0.0.0:601)' Nov 3 14:26:46 kjcf05n03 root[123227]: is_viking_off leaves Nov 3 14:26:46 kjcf05n03 root[123230]: kjcf05n02 not already off look at kdump Nov 3 14:26:46 kjcf05n03 root[123231]: is_kdump_off starts Nov 3 14:26:46 kjcf05n03 fence_kdump[123232]: waiting for message from '172.16.2.5' Nov 3 14:26:46 kjcf05n03 fence_kdump[123232]: received valid message from '172.16.2.5' Nov 3 14:26:46 kjcf05n03 root[123247]: is_kdump_off detected kdump on kjcf05n02 Nov 3 14:26:46 kjcf05n03 root[123248]: kjcf05n02 is kdumping Nov 3 14:26:46 kjcf05n03 root[123344]: is_enc_ipmi_off starts Nov 3 14:26:46 kjcf05n03 root[123345]: is_viking_off starts Nov 3 14:26:47 kjcf05n03 root[123370]: is_lan_ipmi_off leaves Nov 3 14:26:47 kjcf05n03 root[123372]: is_lan_ipmi_sec_off leaves Nov 3 14:26:47 kjcf05n03 root[123375]: I am master Nov 3 14:26:47 kjcf05n03 root[123378]: I am in slot 1; partner is in slot 0 Nov 3 14:26:47 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.count[{$LUSTRE_FS_NAME}]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 14:26:48 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vfs.fs.inode[/etc/ganesha,pfree]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 14:26:49 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 14:26:49 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 14:26:49 kjcf05n00 mcfcli[3673891]: %3|1730665609.287|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:26:49 kjcf05n00 zabbix_server[15726]: Zabbix agent item "dcs.lustre.device.mdt.name[MDT0000,mdt_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 14:26:53 kjcf05n03 root[123580]: is_viking_off leaves Nov 3 14:26:53 kjcf05n03 root[123583]: kjcf05n02 not already off look at kdump Nov 3 14:26:53 kjcf05n03 root[123584]: is_kdump_off starts Nov 3 14:26:53 kjcf05n03 fence_kdump[123585]: waiting for message from '172.16.2.5' Nov 3 14:26:54 kjcf05n03 fence_kdump[123585]: received valid message from '172.16.2.5' Nov 3 14:26:54 kjcf05n03 root[123597]: is_kdump_off detected kdump on kjcf05n02 Nov 3 14:26:54 kjcf05n03 root[123598]: kjcf05n02 is kdumping Nov 3 14:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 14:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 14:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 14:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 14:26:59 kjcf05n03 systemd-udevd[125828]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125830]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125833]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125835]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125833]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125828]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125830]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125835]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125833]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125828]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125830]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125835]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125828]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125830]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125835]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125833]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125851]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125828]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125835]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125830]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125852]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125854]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125851]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125828]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125833]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125860]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125835]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125830]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125852]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125828]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125854]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125833]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125860]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125830]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125851]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125852]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125828]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125833]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125854]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125851]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125860]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125854]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125828]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125852]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125860]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125852]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125854]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125828]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125851]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125852]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125860]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125854]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125852]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125860]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125852]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125852]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125860]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125852]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125852]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125860]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125852]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125860]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125852]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 systemd-udevd[125852]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:26:59 kjcf05n03 dwd[5164]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 14:26:59 kjcf05n03 dwd[5164]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 14:26:59 kjcf05n03 dwd[5164]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 14:26:59 kjcf05n03 dwd[5164]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 14:26:59 kjcf05n03 dwd[5164]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 14:26:59 kjcf05n03 dwd[5164]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 14:26:59 kjcf05n03 dwd[5164]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 14:26:59 kjcf05n03 dwd[5164]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 14:26:59 kjcf05n03 dwd[5164]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 14:26:59 kjcf05n03 dwd[5164]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 14:26:59 kjcf05n03 dwd[5164]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 14:26:59 kjcf05n03 dwd[5164]: Starting NVME thread for nvme23n1 Nov 3 14:26:59 kjcf05n03 dwd[5164]: Starting NVME thread for nvme18n1 Nov 3 14:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 14:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 14:26:59 kjcf05n03 dwd[5164]: Starting NVME thread for nvme25n1 Nov 3 14:26:59 kjcf05n03 dwd[5164]: Starting NVME thread for nvme17n1 Nov 3 14:26:59 kjcf05n03 dwd[5164]: Starting NVME thread for nvme3n1 Nov 3 14:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 14:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 14:27:00 kjcf05n03 dwd[5164]: Starting NVME thread for nvme9n1 Nov 3 14:27:00 kjcf05n03 dwd[5164]: Starting NVME thread for nvme8n1 Nov 3 14:27:00 kjcf05n03 dwd[5164]: Starting NVME thread for nvme19n1 Nov 3 14:27:00 kjcf05n03 dwd[5164]: Starting NVME thread for nvme24n1 Nov 3 14:27:00 kjcf05n03 dwd[5164]: Starting NVME thread for nvme2n1 Nov 3 14:27:00 kjcf05n03 dwd[5164]: Starting NVME thread for nvme4n1 Nov 3 14:27:03 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vfs.fs.size[/mnt/persistent_ha_data,pused]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 14:27:04 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0000,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 14:27:06 kjcf05n03 diskmonitor[17700]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 14:27:13 kjcf05n00 mcfcli[3673891]: %3|1730665633.639|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:27:15 kjcf05n03 diskmonitor[17700]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 14:27:15 kjcf05n03 diskmonitor[17700]: Scan for ReadErrorMax change for md65 Nov 3 14:27:15 kjcf05n03 diskmonitor[17700]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 14:27:15 kjcf05n03 diskmonitor[17700]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 14:27:15 kjcf05n03 diskmonitor[17700]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.min.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 14:27:15 kjcf05n03 diskmonitor[17700]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.max.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 14:27:15 kjcf05n03 diskmonitor[17700]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 14:27:15 kjcf05n03 diskmonitor[17700]: Set sync_speed_min (10000) for md65 Nov 3 14:27:15 kjcf05n03 diskmonitor[17700]: Set sync_speed_max (200000) for md65 Nov 3 14:27:15 kjcf05n03 diskmonitor[17700]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 14:27:18 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 3 14:27:19 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 3 14:27:29 kjcf05n00 mcfcli[3673891]: %3|1730665649.284|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:27:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 14:27:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 14:27:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 14:27:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 14:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 14:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 14:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 14:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 14:27:43 kjcf05n00 mcfcli[3673891]: %3|1730665663.639|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 14:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 14:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 14:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 14:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 14:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 14:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 14:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 14:28:07 kjcf05n00 mcfcli[3673891]: %3|1730665687.399|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:28:08 kjcf05n03 nslcd[6915]: [7ed7ab] ldap_result() failed: Can't contact LDAP server Nov 3 14:28:13 kjcf05n00 mcfcli[3673891]: %3|1730665693.639|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:28:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 14:28:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 14:28:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 14:28:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 14:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 14:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 14:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 14:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 14:28:43 kjcf05n00 mcfcli[3673891]: %3|1730665723.639|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:28:44 kjcf05n00 mcfcli[3673891]: %3|1730665724.749|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 14:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 14:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 14:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 14:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 14:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 14:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 14:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 14:29:13 kjcf05n00 mcfcli[3673891]: %3|1730665753.640|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 14:29:22 kjcf05n00 mcfcli[3673891]: %3|1730665762.250|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:29:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 14:29:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 14:29:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 14:29:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 14:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 14:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 14:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 14:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 14:29:43 kjcf05n00 mcfcli[3673891]: %3|1730665783.640|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 14:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 14:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 14:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 14:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 14:29:58 kjcf05n00 mcfcli[3673891]: %3|1730665798.930|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 14:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 14:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 14:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 14:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 14:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 14:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 14:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 14:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 14:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 14:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 14:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 14:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 14:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 14:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 14:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 14:30:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 14:30:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:30:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 14:30:13 kjcf05n00 mcfcli[3673891]: %3|1730665813.641|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:30:16 kjcf05n00 python3.9[1328928]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 14:30:25 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 3 14:30:25 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 14:30:29 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 14:30:29 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 3 14:30:29 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 3 14:30:29 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 14:30:29 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 14:30:29 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 3 14:30:29 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 3 14:30:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730665830', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 14:30:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730665830'} Nov 3 14:30:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:30:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730665830', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 14:30:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730665830'} Nov 3 14:30:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:30:32 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 3 14:30:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 14:30:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 14:30:34 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 3 14:30:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 14:30:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 14:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 14:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 14:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 14:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 14:30:37 kjcf05n00 mcfcli[3673891]: %3|1730665837.453|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:30:43 kjcf05n00 mcfcli[3673891]: %3|1730665843.641|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 14:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 14:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 14:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 14:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 14:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 14:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 14:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 14:31:10 kjcf05n00 zabbix-server[1329906]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 14:31:10 kjcf05n00 zabbix-server[1329906]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 14:31:10 kjcf05n00 log_interesting_event.py[1329906]: Event '46300' acknowledged Nov 3 14:31:13 kjcf05n00 mcfcli[3673891]: %3|1730665873.642|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:31:17 kjcf05n00 mcfcli[3673891]: %3|1730665877.423|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:31:21 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:34328). Nov 3 14:31:21 kjcf05n01 rsyncd[3139896]: connect from kjcf05n02 (172.16.2.5) Nov 3 14:31:21 kjcf05n01 rsyncd[3139896]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 14:31:21 kjcf05n01 rsyncd[3139896]: building file list Nov 3 14:31:21 kjcf05n01 rsyncd[3139896]: sent 11450 bytes received 136 bytes total size 10905 Nov 3 14:31:21 kjcf05n01 systemd[1]: rsyncd@635-172.16.2.2:873-172.16.2.5:34328.service: Succeeded. Nov 3 14:31:32 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 14:31:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 14:31:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 14:31:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 14:31:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 14:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 14:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 14:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 14:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 14:31:37 kjcf05n03 fstonithd.py[15308]: Listening for kdump packets from partner Nov 3 14:31:43 kjcf05n00 mcfcli[3673891]: %3|1730665903.642|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 14:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 14:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 14:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 14:31:55 kjcf05n00 mcfcli[3673891]: %3|1730665915.586|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 14:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 14:31:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 14:31:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 14:32:13 kjcf05n00 mcfcli[3673891]: %3|1730665933.642|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:32:14 kjcf05n03 dwd[5164]: nvme25n1 passed periodic SMART status check Nov 3 14:32:14 kjcf05n03 dwd[5164]: nvme3n1 passed periodic SMART status check Nov 3 14:32:14 kjcf05n03 dwd[5164]: nvme23n1 passed periodic SMART status check Nov 3 14:32:14 kjcf05n03 dwd[5164]: nvme18n1 passed periodic SMART status check Nov 3 14:32:14 kjcf05n03 dwd[5164]: nvme17n1 passed periodic SMART status check Nov 3 14:32:15 kjcf05n03 dwd[5164]: nvme19n1 passed periodic SMART status check Nov 3 14:32:15 kjcf05n03 dwd[5164]: nvme2n1 passed periodic SMART status check Nov 3 14:32:15 kjcf05n03 dwd[5164]: nvme9n1 passed periodic SMART status check Nov 3 14:32:15 kjcf05n03 dwd[5164]: nvme24n1 passed periodic SMART status check Nov 3 14:32:15 kjcf05n03 dwd[5164]: nvme8n1 passed periodic SMART status check Nov 3 14:32:15 kjcf05n03 dwd[5164]: nvme4n1 passed periodic SMART status check Nov 3 14:32:20 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 14:32:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 14:32:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 14:32:35 kjcf05n00 mcfcli[3673891]: %3|1730665955.131|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:32:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 14:32:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 14:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 14:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 14:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 14:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 14:32:43 kjcf05n00 mcfcli[3673891]: %3|1730665963.643|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 14:32:46 kjcf05n00 zabbix-server[1330698]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 14:32:46 kjcf05n00 zabbix-server[1330698]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 128.41\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 120.86\\"}}"' Nov 3 14:32:46 kjcf05n00 log_interesting_event.py[1330698]: Event '46301' acknowledged Nov 3 14:32:47 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='39', client='AF_INET(172.16.2.5:46427)', local='AF_INET(0.0.0.0:601)' Nov 3 14:32:47 kjcf05n02 syslog-ng[3230]: Configuration reload request received, reloading configuration; Nov 3 14:32:47 kjcf05n02 syslog-ng[3230]: Configuration reload finished; Nov 3 14:32:47 kjcf05n02 syslog-ng[3230]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 14:32:47 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 3 14:32:47 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 14:32:47 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 3 14:32:47 kjcf05n02 dracut: Self testing crypto algorithms Nov 3 14:32:47 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 3 14:32:47 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 14:32:47 kjcf05n02 Copying live image to RAM... Nov 3 14:32:47 kjcf05n02 (this may take a minute) Nov 3 14:32:47 kjcf05n02 Done copying live image to RAM. Nov 3 14:32:47 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 14:32:47 kjcf05n02 dracut: Checking integrity of kernel Nov 3 14:32:47 kjcf05n02 dracut: All initrd crypto checks done Nov 3 14:32:47 kjcf05n02 dracut: Switching root Nov 3 14:32:47 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 14:32:47 kjcf05n02 systemd: Detected architecture x86-64. Nov 3 14:32:47 kjcf05n02 systemd: Set hostname to . Nov 3 14:32:47 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 14:32:47 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 14:32:47 kjcf05n02 systemd: Reached target rpc_pipefs.target. Nov 3 14:32:47 kjcf05n02 systemd: Created slice system-serial\x2dgetty.slice. Nov 3 14:32:47 kjcf05n02 systemd: Started Dispatch Password Requests to Console Directory Watch. Nov 3 14:32:47 kjcf05n02 systemd: Reached target CXI Retry Handlers Started. Nov 3 14:32:47 kjcf05n02 systemd: Reached target ZFS pool import target. Nov 3 14:32:47 kjcf05n02 systemd-journald[1574]: Journal started Nov 3 14:32:47 kjcf05n02 systemd-journald[1574]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 14:32:47 kjcf05n02 systemd-modules-load[1570]: Inserted module 'fuse' Nov 3 14:32:47 kjcf05n02 systemd[1]: Mounted /WIBS. Nov 3 14:32:47 kjcf05n02 systemd[1]: Mounting Kernel Configuration File System... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Apply Kernel Variables... Nov 3 14:32:47 kjcf05n02 systemd[1]: Mounting FUSE Control File System... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Rebuild Hardware Database... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Create System Users... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Load/Save Random Seed... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 14:32:47 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 3 14:32:47 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 3 14:32:47 kjcf05n02 systemd-sysctl[1602]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 14:32:47 kjcf05n02 systemd-sysctl[1602]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Create System Users. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 14:32:47 kjcf05n02 systemd-journald[1574]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 14:32:47 kjcf05n02 systemd-tmpfiles[1613]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 14:32:47 kjcf05n02 systemd-tmpfiles[1613]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 3 14:32:47 kjcf05n02 systemd-udevd[1620]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 3 14:32:47 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 3 14:32:47 kjcf05n02 systemd-udevd[1630]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:32:47 kjcf05n02 systemd-udevd[1678]: Using default interface naming scheme 'rhel-8.0'. Nov 3 14:32:47 kjcf05n02 systemd-udevd[1678]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:32:47 kjcf05n02 systemd-udevd[1646]: Using default interface naming scheme 'rhel-8.0'. Nov 3 14:32:47 kjcf05n02 systemd-udevd[1646]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:32:47 kjcf05n02 systemd-udevd[1675]: Using default interface naming scheme 'rhel-8.0'. Nov 3 14:32:47 kjcf05n02 systemd-udevd[1675]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 14:32:47 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 3 14:32:47 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 14:32:47 kjcf05n02 root[1861]: openibd: running in auto mode Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 14:32:47 kjcf05n02 systemd-tmpfiles[1860]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 14:32:47 kjcf05n02 systemd-tmpfiles[1860]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 14:32:47 kjcf05n02 systemd-tmpfiles[1860]: "/var/tmp" already exists and is not a directory. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 14:32:47 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 14:32:47 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started RPC Bind. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 14:32:47 kjcf05n02 systemd-modules-load[1918]: Inserted module 'ib_iser' Nov 3 14:32:47 kjcf05n02 systemd-modules-load[1918]: Inserted module 'ib_isert' Nov 3 14:32:47 kjcf05n02 systemd-modules-load[1918]: Inserted module 'ib_srpt' Nov 3 14:32:47 kjcf05n02 systemd-udevd[1628]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:32:47 kjcf05n02 systemd-udevd[1670]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:32:47 kjcf05n02 systemd-modules-load[1919]: Inserted module 'ib_ipoib' Nov 3 14:32:47 kjcf05n02 systemd-modules-load[1918]: Inserted module 'rdma_ucm' Nov 3 14:32:47 kjcf05n02 systemd-modules-load[1918]: Module 'svcrdma' is blacklisted Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 14:32:47 kjcf05n02 systemd-udevd[1628]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 14:32:47 kjcf05n02 systemd-udevd[1670]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 14:32:47 kjcf05n02 systemd-modules-load[1919]: Inserted module 'ib_umad' Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 14:32:47 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 14:32:47 kjcf05n02 systemd[3230]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:32:47 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 14:32:47 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 3 14:32:47 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 3 14:32:47 kjcf05n02 openibd[1843]: Loading HCA driver and Access Layer:[ OK ] Nov 3 14:32:47 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Update is Completed. Nov 3 14:32:47 kjcf05n02 setup-icl[1822]: Setting LAN IP Address to 203.0.113.3 Nov 3 14:32:47 kjcf05n02 setup-icl[1822]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 14:32:47 kjcf05n02 setup-icl[1822]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 14:32:47 kjcf05n02 setup-icl[1822]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 14:32:47 kjcf05n02 systemd-udevd[1628]: Using default interface naming scheme 'rhel-8.0'. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 14:32:47 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 3 14:32:47 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 14:32:47 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 3 14:32:47 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 14:32:47 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 14:32:47 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 14:32:47 kjcf05n02 systemd[1]: Reached target Sockets. Nov 3 14:32:47 kjcf05n02 systemd[1]: Reached target Basic System. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 14:32:47 kjcf05n02 mdraid-phy[2174]: no Cutlass to worry about Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 14:32:47 kjcf05n02 nscd[2189]: 2189 monitoring file `/etc/hosts` (1) Nov 3 14:32:47 kjcf05n02 nscd[2189]: 2189 monitoring directory `/etc` (2) Nov 3 14:32:47 kjcf05n02 nscd[2189]: 2189 monitoring file `/etc/resolv.conf` (3) Nov 3 14:32:47 kjcf05n02 nscd[2189]: 2189 monitoring directory `/etc` (2) Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 14:32:47 kjcf05n02 dbus-daemon[2173]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 0 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 1 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 2 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 3 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 4 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 5 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 6 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 7 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 8 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 9 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 10 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 11 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 12 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 13 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 14 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 15 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 16 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 17 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 18 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 19 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 20 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 21 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 22 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 23 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 24 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 25 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 26 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 27 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 28 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 29 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 30 Nov 3 14:32:47 kjcf05n02 cpupower[2187]: Setting cpu: 31 Nov 3 14:32:47 kjcf05n02 mcelog[2199]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 14:32:47 kjcf05n02 mcelog[2199]: CPU is unsupported Nov 3 14:32:47 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 14:32:47 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[2216]: Setting up Mellanox network interface: ib0 Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 14:32:47 kjcf05n02 network[2231]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[2232]: Setting up Mellanox network interface: ib1 Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 14:32:47 kjcf05n02 beSetMlxConfig[2241]: ConnectX-3 multiport not detected Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 14:32:47 kjcf05n02 chronyd[2296]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 3 14:32:47 kjcf05n02 network[2261]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 14:32:47 kjcf05n02 network[2231]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:32:47 kjcf05n02 dwd[2259]: dwd: vMay 29 2024 : 15:38:26 Nov 3 14:32:47 kjcf05n02 dwd[2259]: /usr/sbin/dwd -d --standalone=0 Nov 3 14:32:47 kjcf05n02 dwd[2259]: dwd: option Lethal: 0 Nov 3 14:32:47 kjcf05n02 dwd[2259]: dwd: option Interval: 60 Nov 3 14:32:47 kjcf05n02 dwd[2259]: dwd: option abrtlimit: 10 Nov 3 14:32:47 kjcf05n02 dwd[2259]: dwd: option DZPeriod: 604800 Nov 3 14:32:47 kjcf05n02 dwd[2259]: dwd: option SmartPeriod: 43200 Nov 3 14:32:47 kjcf05n02 dwd[2259]: dwd: option SDDEnabled: 1 Nov 3 14:32:47 kjcf05n02 dwd[2259]: dwd: option SDDAwaitScale: 3 Nov 3 14:32:47 kjcf05n02 dwd[2259]: dwd: option SDDAwaitMin: 100 Nov 3 14:32:47 kjcf05n02 dwd[2259]: dwd: option Verbosity: 1 Nov 3 14:32:47 kjcf05n02 dwd[2259]: dwd: option StandAlone: 0 Nov 3 14:32:47 kjcf05n02 dwd[2259]: option Lethal: 0 Nov 3 14:32:47 kjcf05n02 dwd[2259]: option Interval: 60 Nov 3 14:32:47 kjcf05n02 dwd[2259]: option abrtlimit: 10 Nov 3 14:32:47 kjcf05n02 dwd[2259]: option DZPeriod: 604800 Nov 3 14:32:47 kjcf05n02 dwd[2259]: option SmartPeriod: 43200 Nov 3 14:32:47 kjcf05n02 dwd[2259]: option SDDEnabled: 1 Nov 3 14:32:47 kjcf05n02 dwd[2259]: option SDDAwaitScale: 3 Nov 3 14:32:47 kjcf05n02 dwd[2259]: option SDDAwaitMin: 100 Nov 3 14:32:47 kjcf05n02 dwd[2259]: option Verbosity: 1 Nov 3 14:32:47 kjcf05n02 dwd[2259]: option StandAlone: 0 Nov 3 14:32:47 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 14:32:47 kjcf05n02 network[2316]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:32:47 kjcf05n02 network[2231]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 3 14:32:47 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 14:32:47 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[2324]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 0 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 1 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 2 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 3 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 4 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 5 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 6 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 7 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 8 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 9 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 10 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 11 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 12 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 13 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 14 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 15 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 16 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 17 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 18 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 19 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 20 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 21 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 22 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 23 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 24 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 25 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 26 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 27 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 28 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 29 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 30 Nov 3 14:32:47 kjcf05n02 cpupower[2341]: Idlestate 2 disabled on CPU 31 Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 3 14:32:47 kjcf05n02 beSetMlxConfig[2241]: Starting MST (Mellanox Software Tools) driver set Nov 3 14:32:47 kjcf05n02 network[2337]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[2338]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 14:32:47 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 14:32:47 kjcf05n02 chronyd[2296]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 14:32:47 kjcf05n02 chronyd[2296]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 14:32:47 kjcf05n02 sssd[sssd][2183]: Starting up Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[2351]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[2369]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 14:32:47 kjcf05n02 beSetMlxConfig[2241]: Loading MST PCI module - Success Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[2377]: No configuration found for ib1 Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[2379]: No configuration found for ib0 Nov 3 14:32:47 kjcf05n02 beSetMlxConfig[2241]: Loading MST PCI configuration module - Success Nov 3 14:32:47 kjcf05n02 beSetMlxConfig[2241]: Create devices Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[2388]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[2392]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 14:32:47 kjcf05n02 mlnx_conf_mgr[2429]: INFO: No configurations found for mlx5_1, skipping. Nov 3 14:32:47 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 14:32:47 kjcf05n02 mlnx_conf_mgr[2449]: INFO: No configurations found for mlx5_0, skipping. Nov 3 14:32:47 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 14:32:47 kjcf05n02 sssd[be[implicit_files]][2378]: Starting up Nov 3 14:32:47 kjcf05n02 sssd[nss][2527]: Starting up Nov 3 14:32:47 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 14:32:47 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Login Service... Nov 3 14:32:47 kjcf05n02 systemd-logind[2626]: New seat seat0. Nov 3 14:32:47 kjcf05n02 systemd-logind[2626]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Login Service. Nov 3 14:32:47 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 14:32:47 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 14:32:47 kjcf05n02 python3.9[2282]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 14:32:47 kjcf05n02 python3.9[3230]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 14:32:47 kjcf05n02 systemd-sysctl[2843]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 14:32:47 kjcf05n02 systemd-sysctl[2843]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 14:32:47 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 14:32:47 kjcf05n02 python3.9[3052]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 14:32:47 kjcf05n02 python3.9[3230]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:32:47 kjcf05n02 network[2231]: Bringing up loopback interface: [ OK ] Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 14:32:47 kjcf05n02 systemd-sysctl[3174]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 14:32:47 kjcf05n02 systemd-sysctl[3174]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 14:32:47 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 3 14:32:47 kjcf05n02 systemd[1]: Reached target Network. Nov 3 14:32:47 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 14:32:47 kjcf05n02 sm-notify[3209]: Version 2.3.3 starting Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 14:32:47 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 14:32:47 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 3 14:32:47 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 14:32:47 kjcf05n02 sshd[3239]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 14:32:47 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 3 14:32:47 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 14:32:47 kjcf05n02 lldpad[3218]: setsockopt nearest_bridge: Invalid argument Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 14:32:47 kjcf05n02 lldpad[3218]: setsockopt nearest_bridge: Invalid argument Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 14:32:47 kjcf05n02 python3.9[3259]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 14:32:47 kjcf05n02 python3.9[3230]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 3 14:32:47 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 14:32:47 kjcf05n02 syslog-ng[3230]: [2024-11-03T20:31:33.635852] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 14:32:47 kjcf05n02 syslog-ng[3230]: [2024-11-03T20:31:33.636137] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 14:32:47 kjcf05n02 syslog-ng[3230]: [2024-11-03T20:31:33.636169] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 14:32:47 kjcf05n02 syslog-ng[3230]: [2024-11-03T20:31:33.636419] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 14:32:47 kjcf05n02 syslog-ng[3230]: [2024-11-03T20:31:33.636765] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 14:32:47 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 3 14:32:47 kjcf05n02 beSetMlxConfig[2241]: Unloading MST PCI module (unused) - Success Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 14:32:47 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 14:32:47 kjcf05n02 python3.9[3494]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 14:32:47 kjcf05n02 python3.9[3230]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 14:32:47 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 14:32:47 kjcf05n02 python3.9[3498]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 14:32:47 kjcf05n02 python3.9[3230]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 14:32:47 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 14:32:47 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 14:32:47 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 14:32:47 kjcf05n02 chronyd[2296]: System's initial offset : 0.000024 seconds slow of true (slew) Nov 3 14:32:47 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 14:32:47 kjcf05n02 beSetMlxConfig[2241]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 14:32:47 kjcf05n02 beSetMlxConfig[2241]: ib mode Nov 3 14:32:47 kjcf05n02 root[3520]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 3 14:32:47 kjcf05n02 root[3522]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 3 14:32:47 kjcf05n02 beSetMlxConfig[2241]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 14:32:47 kjcf05n02 beSetMlxConfig[2241]: ib mode Nov 3 14:32:47 kjcf05n02 systemd-udevd[1620]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 14:32:47 kjcf05n02 systemd-udevd[3537]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:32:47 kjcf05n02 systemd-udevd[3538]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:32:47 kjcf05n02 systemd-udevd[3541]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:32:47 kjcf05n02 systemd-udevd[3542]: Using default interface naming scheme 'rhel-8.0'. Nov 3 14:32:47 kjcf05n02 systemd-udevd[3542]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:32:47 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 14:32:47 kjcf05n02 systemd[3230]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:32:47 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[3580]: Setting up Mellanox network interface: ib0 Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[3579]: Setting up Mellanox network interface: ib1 Nov 3 14:32:47 kjcf05n02 systemd-udevd[3539]: Using default interface naming scheme 'rhel-8.0'. Nov 3 14:32:47 kjcf05n02 systemd-udevd[3540]: Using default interface naming scheme 'rhel-8.0'. Nov 3 14:32:47 kjcf05n02 systemd-udevd[3539]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:32:47 kjcf05n02 systemd-udevd[3540]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[3632]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[3635]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[3659]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[3661]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[3662]: No configuration found for ib0 Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[3663]: No configuration found for ib1 Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[3670]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[3671]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 14:32:47 kjcf05n02 mlnx_conf_mgr[3707]: INFO: No configurations found for mlx5_0, skipping. Nov 3 14:32:47 kjcf05n02 mlnx_conf_mgr[3711]: INFO: No configurations found for mlx5_1, skipping. Nov 3 14:32:47 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 14:32:47 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 14:32:47 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 3 14:32:47 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 3 14:32:47 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 14:32:47 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 3 14:32:47 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 3 14:32:47 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 14:32:47 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 14:32:47 kjcf05n02 lldpad[3218]: init_ports: Error adding device ib0 Nov 3 14:32:47 kjcf05n02 lldpad[3218]: init_ports: Error adding device ib1 Nov 3 14:32:47 kjcf05n02 lldpad[3218]: Signal 15 received - terminating Nov 3 14:32:47 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 3 14:32:47 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 14:32:47 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 14:32:47 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 3 14:32:47 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 14:32:47 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 3 14:32:47 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 3 14:32:47 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:47 kjcf05n02 systemd[3230]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:32:47 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 1 | Nov-03-2024 | 20:02:01 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 2 | Nov-03-2024 | 20:02:52 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 3 | Nov-03-2024 | 20:02:53 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 4 | Nov-03-2024 | 20:03:58 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 5 | Nov-03-2024 | 20:03:59 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 6 | Nov-03-2024 | 20:28:55 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 7 | Nov-03-2024 | 20:28:55 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 8 | Nov-03-2024 | 20:28:55 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 9 | Nov-03-2024 | 20:28:55 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 10 | Nov-03-2024 | 20:28:55 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 11 | Nov-03-2024 | 20:28:55 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 12 | Nov-03-2024 | 20:28:55 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 13 | Nov-03-2024 | 20:28:55 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 14 | Nov-03-2024 | 20:28:55 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 15 | Nov-03-2024 | 20:28:55 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 16 | Nov-03-2024 | 20:28:55 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 17 | Nov-03-2024 | 20:28:55 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 18 | Nov-03-2024 | 20:28:55 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 19 | Nov-03-2024 | 20:28:55 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 20 | Nov-03-2024 | 20:28:55 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 21 | Nov-03-2024 | 20:28:55 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 22 | Nov-03-2024 | 20:28:55 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 23 | Nov-03-2024 | 20:28:55 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 24 | Nov-03-2024 | 20:28:55 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 25 | Nov-03-2024 | 20:28:55 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 26 | Nov-03-2024 | 20:28:55 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 27 | Nov-03-2024 | 20:28:55 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 28 | Nov-03-2024 | 20:28:56 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 29 | Nov-03-2024 | 20:28:56 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 30 | Nov-03-2024 | 20:28:56 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 31 | Nov-03-2024 | 20:28:56 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 32 | Nov-03-2024 | 20:28:56 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 33 | Nov-03-2024 | 20:28:56 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 34 | Nov-03-2024 | 20:28:56 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 35 | Nov-03-2024 | 20:28:56 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 36 | Nov-03-2024 | 20:28:56 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 37 | Nov-03-2024 | 20:28:56 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 38 | Nov-03-2024 | 20:29:25 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 39 | Nov-03-2024 | 20:29:25 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 40 | Nov-03-2024 | 20:29:25 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 41 | Nov-03-2024 | 20:29:25 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 42 | Nov-03-2024 | 20:29:25 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 43 | Nov-03-2024 | 20:29:25 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 44 | Nov-03-2024 | 20:29:25 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 45 | Nov-03-2024 | 20:29:25 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 46 | Nov-03-2024 | 20:29:25 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 47 | Nov-03-2024 | 20:29:25 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 48 | Nov-03-2024 | 20:29:25 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 14:32:47 kjcf05n02 ipmievd[4057]: 49 | Nov-03-2024 | 20:29:25 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 14:32:47 kjcf05n02 ipmievd[4060]: Reading sensors... Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 3 14:32:47 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:47 kjcf05n02 systemd[3230]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 14:32:47 kjcf05n02 nscd[2189]: 2189 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 14:32:47 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 14:32:47 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 3 14:32:47 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 14:32:47 kjcf05n02 beSetMlxConfig[4118]: ConnectX-3 multiport not detected Nov 3 14:32:47 kjcf05n02 beSetMlxConfig[4118]: Starting MST (Mellanox Software Tools) driver set Nov 3 14:32:47 kjcf05n02 beSetMlxConfig[4118]: Loading MST PCI module - Success Nov 3 14:32:47 kjcf05n02 systemd-udevd[1620]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 14:32:47 kjcf05n02 beSetMlxConfig[4118]: [warn] mst_pciconf is already loaded, skipping Nov 3 14:32:47 kjcf05n02 beSetMlxConfig[4118]: Create devices Nov 3 14:32:47 kjcf05n02 beSetMlxConfig[4118]: Unloading MST PCI module (unused) - Success Nov 3 14:32:47 kjcf05n02 ipmievd[4060]: Waiting for events... Nov 3 14:32:47 kjcf05n02 beSetMlxConfig[4118]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 14:32:47 kjcf05n02 beSetMlxConfig[4118]: ib mode Nov 3 14:32:47 kjcf05n02 beSetMlxConfig[4118]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 14:32:47 kjcf05n02 beSetMlxConfig[4118]: ib mode Nov 3 14:32:47 kjcf05n02 systemd-udevd[1620]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 14:32:47 kjcf05n02 systemd-udevd[5020]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:32:47 kjcf05n02 systemd-udevd[5021]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:32:47 kjcf05n02 systemd-udevd[5024]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:32:47 kjcf05n02 systemd-udevd[5026]: Using default interface naming scheme 'rhel-8.0'. Nov 3 14:32:47 kjcf05n02 systemd-udevd[5026]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:32:47 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 14:32:47 kjcf05n02 systemd[3230]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:32:47 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[5063]: Setting up Mellanox network interface: ib0 Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[5062]: Setting up Mellanox network interface: ib1 Nov 3 14:32:47 kjcf05n02 systemd-udevd[5023]: Using default interface naming scheme 'rhel-8.0'. Nov 3 14:32:47 kjcf05n02 systemd-udevd[5022]: Using default interface naming scheme 'rhel-8.0'. Nov 3 14:32:47 kjcf05n02 systemd-udevd[5023]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:32:47 kjcf05n02 systemd-udevd[5022]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[5112]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[5113]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[5143]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[5144]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[5145]: No configuration found for ib1 Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[5146]: No configuration found for ib0 Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[5151]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 14:32:47 kjcf05n02 mlnx_interface_mgr[5154]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 14:32:47 kjcf05n02 mlnx_conf_mgr[5191]: INFO: No configurations found for mlx5_1, skipping. Nov 3 14:32:47 kjcf05n02 mlnx_conf_mgr[5194]: INFO: No configurations found for mlx5_0, skipping. Nov 3 14:32:47 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 14:32:47 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}2fb17b7178a9c3655ab6448eca533690801a82a403535585c7b9f3a21d4c78f7' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}2fb17b7178a9c3655ab6448eca533690801a82a403535585c7b9f3a21d4c78f7' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}dca403eb8f6dbf27b26fd82d85e3e246af7798493ea15e3fef54b62a61c02198' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}dca403eb8f6dbf27b26fd82d85e3e246af7798493ea15e3fef54b62a61c02198' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}e7e1bdd232414a1049b42dcdcd668ee6753b9609db4bb1fea115adfbaedeb76a' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}e7e1bdd232414a1049b42dcdcd668ee6753b9609db4bb1fea115adfbaedeb76a' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}549bf54886398162565ef9747719aa08f8e983f7e4db9b62b91bc7af1e94a130' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}549bf54886398162565ef9747719aa08f8e983f7e4db9b62b91bc7af1e94a130' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 14:32:47 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 3 14:32:47 kjcf05n02 chronyd[2296]: chronyd exiting Nov 3 14:32:47 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 3 14:32:47 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 14:32:47 kjcf05n02 chronyd[5228]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 14:32:47 kjcf05n02 chronyd[5228]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 14:32:47 kjcf05n02 chronyd[5228]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 14:32:47 kjcf05n02 chronyd[5228]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 14:32:47 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 14:32:47 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:47 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 14:32:47 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 3 14:32:47 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 14:32:47 kjcf05n02 dwd[5260]: dwd: vMay 29 2024 : 15:38:26 Nov 3 14:32:47 kjcf05n02 dwd[5260]: /usr/sbin/dwd -i 15 -d Nov 3 14:32:47 kjcf05n02 dwd[5260]: dwd: option Lethal: 0 Nov 3 14:32:47 kjcf05n02 dwd[5260]: dwd: option Interval: 15 Nov 3 14:32:47 kjcf05n02 dwd[5260]: dwd: option abrtlimit: 10 Nov 3 14:32:47 kjcf05n02 dwd[5260]: dwd: option DZPeriod: 604800 Nov 3 14:32:47 kjcf05n02 dwd[5260]: dwd: option SmartPeriod: 43200 Nov 3 14:32:47 kjcf05n02 dwd[5260]: dwd: option SDDEnabled: 1 Nov 3 14:32:47 kjcf05n02 dwd[5260]: dwd: option SDDAwaitScale: 3 Nov 3 14:32:47 kjcf05n02 dwd[5260]: dwd: option SDDAwaitMin: 100 Nov 3 14:32:47 kjcf05n02 dwd[5260]: dwd: option Verbosity: 1 Nov 3 14:32:47 kjcf05n02 dwd[5260]: dwd: option StandAlone: 0 Nov 3 14:32:47 kjcf05n02 dwd[5260]: option Lethal: 0 Nov 3 14:32:47 kjcf05n02 dwd[5260]: option Interval: 15 Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 14:32:47 kjcf05n02 dwd[5260]: option abrtlimit: 10 Nov 3 14:32:47 kjcf05n02 dwd[5260]: option DZPeriod: 604800 Nov 3 14:32:47 kjcf05n02 dwd[5260]: option SmartPeriod: 43200 Nov 3 14:32:47 kjcf05n02 dwd[5260]: option SDDEnabled: 1 Nov 3 14:32:47 kjcf05n02 dwd[5260]: option SDDAwaitScale: 3 Nov 3 14:32:47 kjcf05n02 dwd[5260]: option SDDAwaitMin: 100 Nov 3 14:32:47 kjcf05n02 dwd[5260]: option Verbosity: 1 Nov 3 14:32:47 kjcf05n02 dwd[5260]: option StandAlone: 0 Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 14:32:47 kjcf05n02 dwd[5262]: option Lethal now set to 1 Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 14:32:47 kjcf05n02 dwd[5262]: option abrtlimit now set to 1 Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 14:32:47 kjcf05n02 dwd[5262]: option SmartPeriod now set to 86400 Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 14:32:47 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 14:32:47 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:32:47 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:47 kjcf05n02 python3.9[5291]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 14:32:47 kjcf05n02 python3.9[3230]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 14:32:47 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:32:47 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 14:32:47 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 3 14:32:47 kjcf05n02 sedcpwrkr[5429]: Using config script: /etc/sedcpwrkr.conf Nov 3 14:32:47 kjcf05n02 sedcpwrkr[5429]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 14:32:47 kjcf05n02 sedcpwrkr[5429]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 14:32:47 kjcf05n02 sedcpwrkr[5429]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 14:32:47 kjcf05n02 sedcpwrkr[5429]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 14:32:47 kjcf05n02 sedcpwrkr[5429]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 14:32:47 kjcf05n02 sedcpwrkr[5429]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 14:32:47 kjcf05n02 sedcpwrkr-server[5460]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 14:32:47 kjcf05n02 sedcpwrkr[5429]: celery multi v5.2.7 (dawn-chorus) Nov 3 14:32:47 kjcf05n02 sedcpwrkr[5429]: > Starting nodes... Nov 3 14:32:47 kjcf05n02 sedcpwrkr[5429]: > sedcpwrkr@kjcf05n02: OK Nov 3 14:32:47 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 14:32:47 kjcf05n02 sedcpwrkr-server[5462]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 14:32:47 kjcf05n02 sedcpwrkr-server[5462]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 14:32:47 kjcf05n02 sedcpwrkr-server[5462]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 14:32:47 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 14:32:47 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 3 14:32:47 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 14:32:47 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 14:32:47 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 14:32:47 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:47 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 14:32:47 kjcf05n02 systemd-udevd[1620]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 14:32:47 kjcf05n02 iptables.init[5529]: iptables: Applying firewall rules: [ OK ] Nov 3 14:32:47 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 3 14:32:48 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:48 kjcf05n02 systemd[3230]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:32:48 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:32:48 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:32:48 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 14:32:48 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 14:32:48 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 14:32:48 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 14:32:48 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 14:32:48 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 14:32:48 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 14:32:48 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 14:32:48 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 14:32:48 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 14:32:49 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:49 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 14:32:49 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5627 which is not our child. We'll most likely not notice when it exits. Nov 3 14:32:49 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 14:32:49 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:49 kjcf05n02 openhpid[5627]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 14:32:49 kjcf05n02 openhpid[5627]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 14:32:49 kjcf05n02 openhpid[5627]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 14:32:49 kjcf05n02 openhpid[5627]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 14:32:49 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 14:32:49 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 14:32:49 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 14:32:49 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:50 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 14:32:50 kjcf05n02 dcs-collectord[5718]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 14:32:50 kjcf05n02 hpi.inv.log[5718]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 14:32:50 kjcf05n02 dcs-collectord[5718]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 14:32:50 kjcf05n02 dcs-collectord[5718]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 14:32:50 kjcf05n02 dcs-collector[5709]: Starting dcs-collector:[ OK ] Nov 3 14:32:50 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 14:32:50 kjcf05n02 dcs-collectord[5721]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 14:32:50 kjcf05n02 dcs-collectord[5721]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 14:32:50 kjcf05n02 dcs-collectord[5721]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 14:32:50 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 14:32:50 kjcf05n02 dcs-collectord[5721]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 14:32:50 kjcf05n02 dcs-collectord[5721]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 14:32:50 kjcf05n02 dcs-collectord[5721]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 14:32:50 kjcf05n02 dcs-collectord[5721]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 14:32:50 kjcf05n02 dcs-collectord[5721]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259347740", "units": "kB"}, {"name": "MemAvailable", "value": "258627308", "units": "kB"}, {"name": "Buffers", "value": "84292", "units": "kB"}, {"name": "Cached", "value": "1821404", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686652", "units": "kB"}, {"name": "Inactive", "value": "960292", "units": "kB"}, {"name": "Active(anon)", "value": "1520688", "units": "kB"}, {"name": "Inactive(anon)", "value": "823772", "units": "kB"}, {"name": "Active(file)", "value": "165964", "units": "kB"}, {"name": "Inactive(file)", "value": "136520", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "751132", "units": "kB"}, {"name": "Mapped", "value": "86292", "units": "kB"}, {"name": "Shmem", "value": "1593400", "units": "kB"}, {"name": "KReclaimable", "value": "108804", "units": "kB"}, {"name": "Slab", "value": "274772", "units": "kB"}, {"name": "SReclaimable", "value": "108804", "units": "kB"}, {"name": "SUnreclaim", "value": "165968", "units": "kB"}, {"name": "KernelStack", "value": "9888", "units": "kB"}, {"name": "PageTables", "value": "21200", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3216776", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11264", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "6144", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "297288", "units": "kB"}, {"name": "DirectMap2M", "value": "29976576", "units": "kB"}, {"name": "DirectMap1G", "value": "238026752", "units": "kB"}]}' Nov 3 14:32:50 kjcf05n02 dcs-collectord[5721]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 14:32:50 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:51 kjcf05n02 systemd[3230]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:32:51 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:32:51 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:32:51 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 14:32:51 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 14:32:51 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 14:32:51 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 14:32:51 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:51 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 14:32:51 kjcf05n02 firmware-update-orc[5802]: Using config script: /etc/firmware_update_orc.conf Nov 3 14:32:51 kjcf05n02 firmware-update-orc[5802]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 14:32:51 kjcf05n02 firmware-update-orc[5802]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 14:32:51 kjcf05n02 firmware-update-orc[5802]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 14:32:51 kjcf05n02 firmware-update-orc[5802]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 14:32:51 kjcf05n02 firmware-update-orc[5802]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 14:32:51 kjcf05n02 firmware-update-orc[5802]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 14:32:51 kjcf05n02 dcs-collectord[5721]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 14:32:51 kjcf05n02 dcs-collectord[5721]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730665970.4398], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730665971.6168213], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730665970.3727577, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 14:32:51 kjcf05n02 firmware-update-orc-server[5838]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 14:32:51 kjcf05n02 firmware-update-orc[5802]: celery multi v5.2.7 (dawn-chorus) Nov 3 14:32:51 kjcf05n02 firmware-update-orc[5802]: > Starting nodes... Nov 3 14:32:51 kjcf05n02 firmware-update-orc[5802]: > worker1@kjcf05n02: OK Nov 3 14:32:51 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 14:32:51 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 14:32:51 kjcf05n02 firmware-update-orc-server[5867]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 14:32:52 kjcf05n02 firmware-update-orc-server[5867]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 14:32:52 kjcf05n02 firmware-update-orc-server[5867]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 14:32:52 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 14:32:52 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:52 kjcf05n02 systemd[3230]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:32:52 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:32:52 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:32:52 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 14:32:52 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 14:32:52 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 14:32:52 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 14:32:52 kjcf05n02 dbus-daemon[2173]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 14:32:52 kjcf05n02 dbus-daemon[2173]: [system] Reloaded configuration Nov 3 14:32:52 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 14:32:52 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 14:32:52 kjcf05n02 dbus-daemon[2173]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 14:32:52 kjcf05n02 dbus-daemon[2173]: [system] Reloaded configuration Nov 3 14:32:52 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 14:32:52 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 14:32:52 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 14:32:52 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 14:32:52 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:52 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 3 14:32:53 kjcf05n02 ras-resource-manager-agent[5983]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 14:32:53 kjcf05n02 ras-resource-manager-agent[5969]: Starting ras-resource-manager-agent:[ OK ] Nov 3 14:32:53 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 14:32:53 kjcf05n02 ras-resource-manager-agent[5985]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 14:32:53 kjcf05n02 ras-resource-manager-client[5985]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 14:32:53 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 3 14:32:53 kjcf05n02 ras-resource-manager-client[5985]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 14:32:53 kjcf05n02 ras-resource-manager-client[5995]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 14:32:53 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:53 kjcf05n02 systemd[3230]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:32:53 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:32:53 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:32:53 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 14:32:53 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 14:32:53 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:54 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 14:32:54 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:54 kjcf05n02 systemd[3230]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: Press Ctrl+C to exit. Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: Plugin support version 1.0 Nov 3 14:32:54 kjcf05n02 zabbix_agent2[6069]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 14:32:54 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:32:54 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:32:54 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:54 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 14:32:55 kjcf05n02 dcs-notification-sender[6144]: dcs-notification-senderd is stopped Nov 3 14:32:55 kjcf05n02 zabbix-agent2[6158]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 14:32:55 kjcf05n02 dcs-notification-sender[6144]: Starting notification-sender:[ OK ] Nov 3 14:32:55 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 14:32:55 kjcf05n02 zabbix-agent2[6160]: INFO DCS notification agent started. (agent.py:61) Nov 3 14:32:55 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 14:32:55 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:55 kjcf05n02 systemd[3230]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:32:55 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:32:55 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:32:55 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 14:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 14:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 14:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 14:32:56 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 14:32:56 kjcf05n02 dcs-collectord[6252]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 14:32:56 kjcf05n02 dcs-collectord[6252]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 14:32:56 kjcf05n02 dcs-bulk-data-sender[6252]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 14:32:56 kjcf05n02 dcs-bulk-data-sender[6243]: Starting bulk-data-sender:[ OK ] Nov 3 14:32:56 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 14:32:56 kjcf05n02 dcs-collectord[6270]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 14:32:56 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 14:32:56 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:56 kjcf05n02 systemd[3230]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:32:56 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:32:56 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:32:56 kjcf05n02 nscd[2189]: 2189 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 14:32:56 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 14:32:56 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 14:32:56 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 14:32:56 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 14:32:56 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 14:32:56 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 14:32:56 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 14:32:56 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 14:32:56 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 14:32:56 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 14:32:56 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 14:32:56 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 14:32:56 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 14:32:56 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 14:32:57 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 14:32:57 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 14:32:57 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 14:32:57 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 14:32:57 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 14:32:57 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 14:32:57 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 3 14:32:57 kjcf05n02 sssd[nss][2527]: Shutting down (status = 0) Nov 3 14:32:57 kjcf05n02 sssd[be[implicit_files]][2378]: Shutting down (status = 0) Nov 3 14:32:57 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 3 14:32:57 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 3 14:32:57 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 14:32:57 kjcf05n02 sssd[sssd][6346]: Starting up Nov 3 14:32:57 kjcf05n02 python3.9[5291]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 14:32:57 kjcf05n02 python3.9[3230]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:32:57 kjcf05n02 sssd[be[implicit_files]][6347]: Starting up Nov 3 14:32:58 kjcf05n02 sssd[nss][6348]: Starting up Nov 3 14:32:58 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 14:32:58 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 14:32:58 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 14:32:59 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 14:32:59 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 14:32:59 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 14:32:59 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 14:32:59 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 14:32:59 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 14:32:59 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 14:32:59 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 14:32:59 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 14:32:59 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 14:32:59 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 14:32:59 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 14:32:59 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:59 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 14:32:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 14:32:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 14:32:59 kjcf05n02 icinga2[6408]: [2024-11-03 14:32:59 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 14:32:59 kjcf05n02 icinga2[6408]: [2024-11-03 14:32:59 -0600] information/cli: Loading configuration file(s). Nov 3 14:32:59 kjcf05n02 icinga2[6408]: [2024-11-03 14:32:59 -0600] information/ConfigItem: Committing config item(s). Nov 3 14:32:59 kjcf05n02 icinga2[6408]: [2024-11-03 14:32:59 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 3 14:32:59 kjcf05n02 icinga2[6408]: [2024-11-03 14:32:59 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 14:32:59 kjcf05n02 icinga2[6408]: [2024-11-03 14:32:59 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 14:32:59 kjcf05n02 icinga2[6408]: [2024-11-03 14:32:59 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 14:32:59 kjcf05n02 icinga2[6408]: [2024-11-03 14:32:59 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 14:32:59 kjcf05n02 icinga2[6408]: [2024-11-03 14:32:59 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 14:32:59 kjcf05n02 icinga2[6408]: [2024-11-03 14:32:59 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 14:32:59 kjcf05n02 icinga2[6408]: [2024-11-03 14:32:59 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 14:32:59 kjcf05n02 icinga2[6408]: [2024-11-03 14:32:59 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 14:32:59 kjcf05n02 icinga2[6408]: [2024-11-03 14:32:59 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 14:32:59 kjcf05n02 icinga2[6408]: [2024-11-03 14:32:59 -0600] information/cli: Closing console log. Nov 3 14:32:59 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 14:32:59 kjcf05n02 systemd[1]: Reloading. Nov 3 14:32:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 14:32:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 14:33:00 kjcf05n02 systemd[3230]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:33:00 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:33:00 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:33:00 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 14:33:00 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 14:33:00 kjcf05n02 systemd[1]: Reloading. Nov 3 14:33:01 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 3 14:33:01 kjcf05n02 systemd[1]: Reloading. Nov 3 14:33:01 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 14:33:01 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:33:01 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:33:02 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 14:33:02 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 14:33:02 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 14:33:02 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 14:33:02 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 14:33:02 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 14:33:02 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 14:33:02 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 14:33:02 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 14:33:02 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 14:33:02 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 14:33:02 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 14:33:02 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 14:33:02 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 14:33:02 kjcf05n02 systemd[1]: Reloading. Nov 3 14:33:02 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 14:33:02 kjcf05n02 nslcd[7024]: version 0.9.9 starting Nov 3 14:33:02 kjcf05n02 nslcd[7024]: accepting connections Nov 3 14:33:02 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 14:33:02 kjcf05n02 systemd[1]: Reloading. Nov 3 14:33:03 kjcf05n02 systemd[3230]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:33:03 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:33:03 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:33:03 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 14:33:03 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 14:33:03 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 14:33:03 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 14:33:03 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 14:33:03 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 14:33:04 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 14:33:04 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 14:33:04 kjcf05n02 systemd[1]: Reloading. Nov 3 14:33:04 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 14:33:04 kjcf05n02 dearcpw[7124]: Using config script: /etc/dearcpw.conf Nov 3 14:33:04 kjcf05n02 dearcpw[7124]: - Creating default directory: '/var/log/dearcpw' Nov 3 14:33:04 kjcf05n02 dearcpw[7124]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 14:33:04 kjcf05n02 dearcpw[7124]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 14:33:04 kjcf05n02 dearcpw[7124]: - Creating default directory: '/var/run/dearcpw' Nov 3 14:33:04 kjcf05n02 dearcpw[7124]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 14:33:04 kjcf05n02 dearcpw[7124]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 14:33:04 kjcf05n02 dearcpw-server[7164]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 14:33:04 kjcf05n02 dearcpw[7124]: celery multi v5.2.7 (dawn-chorus) Nov 3 14:33:04 kjcf05n02 dearcpw[7124]: > Starting nodes... Nov 3 14:33:04 kjcf05n02 dearcpw[7124]: > dearcpw@kjcf05n02: OK Nov 3 14:33:04 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 14:33:04 kjcf05n02 dearcpw-server[7304]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 14:33:04 kjcf05n02 dearcpw-server[7304]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 14:33:04 kjcf05n02 dearcpw-server[7304]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 14:33:05 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 3 14:33:05 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:33:05 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:33:05 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 14:33:05 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 14:33:05 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 14:33:05 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 14:33:05 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 14:33:05 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 14:33:05 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 14:33:05 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 14:33:05 kjcf05n02 dcs-bulk-data-sender[6270]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 14:33:05 kjcf05n02 dcs-collectord[6270]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 14:33:05 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:34362). Nov 3 14:33:05 kjcf05n01 rsyncd[3140703]: connect from kjcf05n02 (172.16.2.5) Nov 3 14:33:05 kjcf05n01 rsyncd[3140703]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 14:33:05 kjcf05n01 rsyncd[3140703]: receiving file list Nov 3 14:33:05 kjcf05n01 rsyncd[3140703]: sent 29 bytes received 325 bytes total size 10905 Nov 3 14:33:05 kjcf05n01 systemd[1]: rsyncd@636-172.16.2.2:873-172.16.2.5:34362.service: Succeeded. Nov 3 14:33:05 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 14:33:05 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 14:33:05 kjcf05n02 puppet[7512]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 3 14:33:05 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 14:33:05 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 14:33:05 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 14:33:05 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 14:33:05 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 14:33:05 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 14:33:05 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 14:33:05 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 14:33:05 kjcf05n02 dcs-collectord[5721]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 14:33:05 kjcf05n02 dcs-collectord[5721]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 14:33:05 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 14:33:05 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 14:33:06 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 3 14:33:06 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 14:33:06 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 14:33:06 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 14:33:06 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 14:33:07 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 14:33:07 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 14:33:07 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 14:33:07 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 14:33:06 kjcf05n00 zabbix_server[15687]: item "kjcf05n02:vfs.fs.size[/mnt/persistent_ha_data,pused]" became not supported: no such file or directory Nov 3 14:33:07 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 14:33:07 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 14:33:07 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 14:33:07 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 14:33:07 kjcf05n00 zabbix-server[1330795]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 14:33:07 kjcf05n00 zabbix-server[1330795]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:30\\"}}"' Nov 3 14:33:08 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 3 14:33:08 kjcf05n00 log_interesting_event.py[1330795]: Event '46303' acknowledged Nov 3 14:33:08 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 14:33:08 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 14:33:08 kjcf05n02 systemd[1]: Reloading. Nov 3 14:33:08 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 14:33:08 kjcf05n02 diskless-swap[7708]: HA_PS_000: recovering journal Nov 3 14:33:08 kjcf05n02 systemd-udevd[1620]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 14:33:08 kjcf05n02 diskless-swap[7708]: HA_PS_000: clean, 2284/6400 files, 7076/25600 blocks Nov 3 14:33:08 kjcf05n02 diskless-swap[7708]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 14:33:08 kjcf05n02 diskless-swap[7708]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 14:33:08 kjcf05n02 diskless-swap[7708]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 14:33:08 kjcf05n02 diskless-swap[7708]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 14:33:08 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 14:33:08 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:33:08 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:33:08 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 14:33:08 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 14:33:08 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 14:33:08 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 14:33:08 kjcf05n02 ipmievd[4060]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 14:33:08 kjcf05n02 ipmievd[4060]: System Event sensor - Timestamp Clock Sync Nov 3 14:33:08 kjcf05n02 ipmievd[3230]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:33:08 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 3 14:33:09 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 3 14:33:09 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 3 14:33:09 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 3 14:33:09 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 3 14:33:09 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 14:33:09 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 14:33:09 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 14:33:09 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 14:33:09 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 14:33:09 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 14:33:09 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 14:33:10 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 14:33:10 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 14:33:10 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 14:33:10 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 14:33:10 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 14:33:10 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 14:33:10 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 14:33:10 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 14:33:11 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 14:33:11 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 14:33:11 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 14:33:11 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 14:33:12 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 14:33:12 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 14:33:12 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 14:33:12 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 14:33:12 kjcf05n02 systemd[1]: Reloading. Nov 3 14:33:12 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 3 14:33:12 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:33:12 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:33:12 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 14:33:12 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 14:33:12 kjcf05n02 systemd[1]: Reloading. Nov 3 14:33:13 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 3 14:33:13 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:33:13 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:33:13 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 14:33:13 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 14:33:13 kjcf05n02 systemd[1]: Reloading. Nov 3 14:33:13 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 3 14:33:13 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:33:13 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:33:13 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 14:33:13 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 14:33:13 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 14:33:13 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 14:33:13 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 14:33:13 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 14:33:13 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 14:33:13 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 14:33:13 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 14:33:13 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 14:33:13 kjcf05n02 systemd[1]: Reloading. Nov 3 14:33:13 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 3 14:33:13 kjcf05n02 kdumpctl[7942]: kdump: No kdump initial ramdisk found. Nov 3 14:33:13 kjcf05n02 kdumpctl[7942]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 14:33:13 kjcf05n00 mcfcli[3673891]: %3|1730665993.643|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:33:14 kjcf05n02 dracut[8054]: dracut-049-135.git20210121.el8 Nov 3 14:33:14 kjcf05n02 dracut[8056]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 14:33:14 kjcf05n02 dracut[8056]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 14:33:14 kjcf05n02 dracut[8056]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 14:33:14 kjcf05n02 dracut[8056]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 14:33:14 kjcf05n02 dracut[8056]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 14:33:14 kjcf05n02 dracut[8056]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 14:33:14 kjcf05n02 dracut[8056]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 14:33:14 kjcf05n02 dracut[8056]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + is_func check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ type -t check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 0 -ne 0 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check -h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local dev holder Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + require_binaries mdadm expr Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _module_name=90hperaid Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ mdadm = \-\m ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for cmd in "$@" Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + find_binary mdadm Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for cmd in "$@" Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + find_binary expr Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n -h ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for dev in "${!host_fs_types[@]}" Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ nfs != *_raid_member ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + continue Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _ret=255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + ret=255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ 255 = 0 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ 255 = 255 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ module_depends hperaid Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: +++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: +++ set -x Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ depends Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo rootfs-block Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ return 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ _ret=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ return 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for _moddep in $(module_depends $_mod) Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all == *\ hperaid\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + add_dracutmodules+=' rootfs-block ' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ == *\ hperaid\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check_module rootfs-block Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _mod=rootfs-block Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddep Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ == *\ rootfs-block\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n '' ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all == *\ rootfs-block\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + module_check rootfs-block 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _forced=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 2 -eq 2 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _forced=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + is_func check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ type -t check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 0 -ne 0 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check -h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _ret=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + ret=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ 0 = 0 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ module_depends rootfs-block Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: +++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 14:33:14 kjcf05n02 kdumpctl[3230]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ depends Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo fs-lib Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ _ret=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ return 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for _moddep in $(module_depends $_mod) Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all == *\ rootfs-block\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + add_dracutmodules+=' fs-lib ' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ == *\ rootfs-block\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check_module fs-lib Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _mod=fs-lib Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddep Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n '' ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + mods_checked_as_dep+=' fs-lib ' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all == *\ fs-lib\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + module_check fs-lib 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _forced=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 2 -eq 2 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _forced=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + is_func check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ type -t check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 0 -ne 0 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check -h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _ret=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + ret=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ 0 = 0 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ module_depends fs-lib Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: +++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ depends Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ return 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ _ret=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ return 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + mods_to_load+=' fs-lib ' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + mods_to_load+=' rootfs-block ' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + mods_to_load+=' hperaid ' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _mod=90kernel-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _mod=kernel-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check_module kernel-modules 1 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _mod=kernel-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddep Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n 1 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all = all ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + module_check kernel-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _forced=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 1 -eq 2 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + is_func check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ type -t check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 0 -ne 0 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check -h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + true Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _ret=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + ret=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ 0 != 0 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ module_depends kernel-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: +++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ depends Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ true Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ _ret=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ return 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + mods_to_load+=' kernel-modules ' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _mod=90kernel-modules-extra Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _mod=kernel-modules-extra Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check_module kernel-modules-extra 1 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _mod=kernel-modules-extra Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddep Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n 1 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all = all ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + module_check kernel-modules-extra Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _forced=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 1 -eq 2 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + is_func check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ type -t check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 0 -ne 0 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check -h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + true Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _ret=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + ret=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ 0 != 0 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ module_depends kernel-modules-extra Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: +++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ depends Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ true Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ _ret=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ return 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + mods_to_load+=' kernel-modules-extra ' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _mod=90kernel-network-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _mod=kernel-network-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check_module kernel-network-modules 1 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _mod=kernel-network-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddep Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n 1 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all = all ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + module_check kernel-network-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _forced=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 1 -eq 2 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + is_func check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ type -t check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 0 -ne 0 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check -h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _ret=255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + ret=255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ 255 != 0 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n 1 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 1 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _mod=90livenet Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _mod=livenet Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check_module livenet 1 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _mod=livenet Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddep Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n 1 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all = all ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + module_check livenet Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _forced=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 1 -eq 2 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + is_func check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ type -t check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 0 -ne 0 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check -h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _ret=255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + ret=255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ 255 != 0 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n 1 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 1 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _mod=90lvm Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _mod=lvm Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check_module lvm 1 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _mod=lvm Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddep Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n 1 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all = all ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + module_check lvm Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _forced=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 1 -eq 2 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + is_func check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ type -t check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 0 -ne 0 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check -h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + require_binaries lvm Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _module_name=90lvm Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ lvm = \-\m ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for cmd in "$@" Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + find_binary lvm Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n -h ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for fs in "${host_fs_types[@]}" Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ nfs = LVM*_member ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _ret=255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + ret=255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ 255 != 0 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n 1 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 1 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _mod=90mdraid Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _mod=mdraid Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check_module mdraid 1 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _mod=mdraid Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddep Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n 1 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all = all ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + module_check mdraid Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _forced=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 1 -eq 2 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + is_func check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ type -t check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 0 -ne 0 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check -h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _rootdev Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + require_binaries mdadm expr Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _module_name=90mdraid Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ mdadm = \-\m ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for cmd in "$@" Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + find_binary mdadm Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for cmd in "$@" Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + find_binary expr Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n -h ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for dev in "${!host_fs_types[@]}" Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ nfs != *_raid_member ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + continue Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _ret=255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + ret=255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ 255 != 0 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n 1 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 1 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _mod=90multipath Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _mod=multipath Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check_module multipath 1 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _mod=multipath Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddep Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n 1 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all = all ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + module_check multipath Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _forced=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 1 -eq 2 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + is_func check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ type -t check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 0 -ne 0 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check -h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _rootdev Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n -h ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for_each_host_dev_and_slaves is_mpath Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _func=is_mpath Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _dev Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for _dev in "${host_devs[@]}" Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + continue Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 1 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _ret=255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + ret=255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ 255 != 0 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n 1 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 1 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _mod=90qemu Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _mod=qemu Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check_module qemu 1 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _mod=qemu Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddep Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n 1 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all = all ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + module_check qemu Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _forced=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 1 -eq 2 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + is_func check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ type -t check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 0 -ne 0 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check -h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n -h ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + type -P systemd-detect-virt Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ systemd-detect-virt --vm Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + vm=none Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + (( 1 != 0 )) Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _ret=255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + ret=255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ 255 != 0 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n 1 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 1 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _mod=90qemu-net Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _mod=qemu-net Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check_module qemu-net 1 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _mod=qemu-net Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddep Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n 1 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all = all ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + module_check qemu-net Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _forced=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 1 -eq 2 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + is_func check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ type -t check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 0 -ne 0 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check -h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n -h ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + type -P systemd-detect-virt Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ systemd-detect-virt --vm Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + vm= Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + (( 1 != 0 )) Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _ret=255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + ret=255 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ 255 != 0 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n 1 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + return 1 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _mod=90stratis Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + _mod=stratis Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check_module stratis 1 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _mod=stratis Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddep Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -n 1 ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ all = all ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + module_check stratis Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ read a b Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _forced=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _hostonly=-h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 1 -eq 2 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + is_func check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: ++ type -t check Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + '[' 0 -ne 0 ']' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + check -h Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _module_name=90stratis Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + local _ret=0 Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + [[ stratisd-init = \-\m ]] Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + for cmd in "$@" Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + find_binary stratisd-init Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 14:33:14 kjcf05n02 kdumpctl[7942]: + set +x Nov 3 14:33:14 kjcf05n02 dracut[8056]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 14:33:14 kjcf05n02 dracut[8056]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 14:33:14 kjcf05n02 dracut[8056]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 14:33:14 kjcf05n02 dracut[8056]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 14:33:14 kjcf05n02 dracut[8056]: memstrack is available Nov 3 14:33:14 kjcf05n02 dracut[8056]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 14:33:14 kjcf05n02 dracut[8056]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 14:33:15 kjcf05n02 dracut[8056]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 14:33:15 kjcf05n02 dracut[8056]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 14:33:15 kjcf05n02 dracut[8056]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 14:33:15 kjcf05n02 dracut[8056]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 14:33:15 kjcf05n02 dracut[8056]: *** Including module: bash *** Nov 3 14:33:15 kjcf05n00 mcfcli[3673891]: %3|1730665995.128|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:33:15 kjcf05n02 dracut[8056]: *** Including module: systemd *** Nov 3 14:33:16 kjcf05n02 dracut[8056]: *** Including module: fips *** Nov 3 14:33:16 kjcf05n02 dracut[8056]: *** Including module: systemd-initrd *** Nov 3 14:33:16 kjcf05n02 dracut[8056]: *** Including module: watchdog-modules *** Nov 3 14:33:16 kjcf05n02 dracut[8056]: *** Including module: nss-softokn *** Nov 3 14:33:16 kjcf05n02 dracut[8056]: *** Including module: i18n *** Nov 3 14:33:16 kjcf05n02 dracut[8056]: No KEYMAP configured. Nov 3 14:33:17 kjcf05n02 dracut[8056]: *** Including module: network-legacy *** Nov 3 14:33:17 kjcf05n02 dracut[8056]: *** Including module: network *** Nov 3 14:33:17 kjcf05n02 dracut[8056]: *** Including module: ib_bonding *** Nov 3 14:33:17 kjcf05n02 dracut[8056]: *** Including module: drm *** Nov 3 14:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730665999', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.4% (3689580 kB) used.'}"] Nov 3 14:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.4% (3689580 kB) used.', 'message': 'OK - 1.4% (3689580 kB) used.', 'value': 'ok', 'timestamp': '1730665999'} Nov 3 14:33:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:33:20 kjcf05n02 dcs-collectord[5721]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 14:33:20 kjcf05n02 dcs-collectord[5721]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 14:33:20 kjcf05n02 dracut[8056]: *** Including module: hperaid *** Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + install Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + local rule rule_path Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + inst_multiple cat expr Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.x4jEcI/initramfs -a -f cat expr Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + _ret=0 Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + (( 0 != 0 )) Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + : Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + return 0 Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + inst_multiple -o mdmon Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.x4jEcI/initramfs -a -f -o mdmon Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + _ret=0 Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + (( 0 != 0 )) Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + : Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + return 0 Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: ++ command -v partx Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + inst /usr/sbin/partx /sbin/partx Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + local _hostonly_install Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + [[ -e /tmp/dracut.x4jEcI/initramfs//sbin/partx ]] Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.x4jEcI/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + (( 0 != 0 )) Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + : Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: ++ command -v mdadm Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + local _hostonly_install Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + [[ -e /tmp/dracut.x4jEcI/initramfs//sbin/mdadm ]] Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.x4jEcI/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + (( 0 != 0 )) Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + : Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + [[ yes == \y\e\s ]] Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + local _raidconf Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: ++ cmdline Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: ++ local _activated dev line UUID Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: ++ declare -A _activated Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: ++ for dev in "${!host_fs_types[@]}" Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: ++ [[ nfs != *_raid_member ]] Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: ++ continue Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + _raidconf= Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + [[ -n '' ]] Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + inst_rules 64-md-raid.rules Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + local _target=/etc/udev/rules.d _rule _found Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + inst_dir /usr/lib/udev/rules.d Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + [[ -e /tmp/dracut.x4jEcI/initramfs//usr/lib/udev/rules.d ]] Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + return 0 Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + inst_dir /etc/udev/rules.d Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + [[ -e /tmp/dracut.x4jEcI/initramfs//etc/udev/rules.d ]] Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + return 0 Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + for _rule in "$@" Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + continue Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + continue Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + for r in '' $dracutbasedir/rules.d/ Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + [[ 64-md-raid.rules != /* ]] Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + continue Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + for r in '' $dracutbasedir/rules.d/ Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + continue Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + [[ -n '' ]] Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + set +x Nov 3 14:33:21 kjcf05n02 dracut[8056]: Skipping udev rule: 64-md-raid.rules Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + installkernel Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + instmods =drivers/md Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + local _optional=-o Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + local _silent Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + local _ret Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + [[ '' = yes ]] Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + [[ =drivers/md = \-\c ]] Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + [[ =drivers/md = \-\s ]] Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + (( 1 == 0 )) Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.x4jEcI/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + _ret=0 Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + (( 0 != 0 )) Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + [[ -n '' ]] Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + return 0 Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + _ret=0 Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + unset check depends cmdline install installkernel Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + return 0 Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + modules_loaded+='hperaid ' Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + '[' -n '' ']' Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + _d_mod=90kernel-modules Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + _d_mod=kernel-modules Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + [[ '' = yes ]] Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + dinfo '*** Including module: kernel-modules ***' Nov 3 14:33:21 kjcf05n02 kdumpctl[7942]: + set +x Nov 3 14:33:21 kjcf05n02 dracut[8056]: *** Including module: kernel-modules *** Nov 3 14:33:21 kjcf05n02 dracut[8056]: *** Including module: kernel-modules-extra *** Nov 3 14:33:22 kjcf05n02 dracut[8056]: *** Including module: kernel-network-modules *** Nov 3 14:33:22 kjcf05n02 dracut[8056]: *** Including module: diskless-mod *** Nov 3 14:33:22 kjcf05n02 dracut[8056]: *** Including module: fstab-sys *** Nov 3 14:33:22 kjcf05n02 dracut[8056]: *** Including module: nfs *** Nov 3 14:33:22 kjcf05n00 zabbix-server[1331012]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 14:33:22 kjcf05n00 zabbix-server[1331012]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 85.76\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 110\\"}}"' Nov 3 14:33:22 kjcf05n00 log_interesting_event.py[1331012]: Event '46311' acknowledged Nov 3 14:33:22 kjcf05n02 dracut[8056]: *** Including module: rootfs-block *** Nov 3 14:33:22 kjcf05n02 dracut[8056]: *** Including module: terminfo *** Nov 3 14:33:22 kjcf05n02 dracut[8056]: *** Including module: udev-rules *** Nov 3 14:33:23 kjcf05n02 dracut[8056]: Skipping udev rule: 91-permissions.rules Nov 3 14:33:23 kjcf05n02 dracut[8056]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 14:33:23 kjcf05n02 dracut[8056]: *** Including module: dracut-systemd *** Nov 3 14:33:24 kjcf05n02 dracut[8056]: *** Including module: usrmount *** Nov 3 14:33:24 kjcf05n02 dracut[8056]: *** Including module: base *** Nov 3 14:33:24 kjcf05n02 dracut[8056]: *** Including module: fs-lib *** Nov 3 14:33:24 kjcf05n02 dracut[8056]: *** Including module: kdumpbase *** Nov 3 14:33:24 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 14:33:24 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 3 14:33:24 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 14:33:24 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running Nov 3 14:33:24 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 3 14:33:25 kjcf05n02 dracut[8056]: *** Including module: memstrack *** Nov 3 14:33:25 kjcf05n02 dracut[8056]: *** Including module: shutdown *** Nov 3 14:33:25 kjcf05n02 dracut[8056]: *** Including module: squash *** Nov 3 14:33:25 kjcf05n02 dracut[8056]: *** Including modules done *** Nov 3 14:33:25 kjcf05n02 dracut[8056]: *** Installing kernel module dependencies *** Nov 3 14:33:25 kjcf05n02 dracut[8056]: *** Installing kernel module dependencies done *** Nov 3 14:33:25 kjcf05n02 dracut[8056]: *** Resolving executable dependencies *** Nov 3 14:33:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730666005', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 14:33:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730666005'} Nov 3 14:33:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:33:27 kjcf05n02 dracut[8056]: *** Resolving executable dependencies done*** Nov 3 14:33:27 kjcf05n02 dracut[8056]: *** Hardlinking files *** Nov 3 14:33:27 kjcf05n02 dracut[8056]: *** Hardlinking files done *** Nov 3 14:33:27 kjcf05n02 dracut[8056]: *** Generating early-microcode cpio image *** Nov 3 14:33:27 kjcf05n02 dracut[8056]: *** Constructing AuthenticAMD.bin **** Nov 3 14:33:27 kjcf05n02 dracut[8056]: *** Store current command line parameters *** Nov 3 14:33:27 kjcf05n02 dracut[8056]: Stored kernel commandline: Nov 3 14:33:27 kjcf05n02 dracut[8056]: rd.driver.pre=sd_mod Nov 3 14:33:27 kjcf05n02 dracut[8056]: rd.driver.pre=nvme Nov 3 14:33:27 kjcf05n02 dracut[8056]: rd.driver.pre=ipmi_si Nov 3 14:33:27 kjcf05n02 dracut[8056]: rd.driver.pre=ipmi_devintf Nov 3 14:33:27 kjcf05n02 dracut[8056]: rd.driver.pre=ipmi_msghandler Nov 3 14:33:27 kjcf05n02 dracut[8056]: nameserver=172.16.2.2 Nov 3 14:33:27 kjcf05n02 dracut[8056]: nameserver=127.0.0.1 Nov 3 14:33:27 kjcf05n02 dracut[8056]: nameserver=172.16.2.2 Nov 3 14:33:27 kjcf05n02 dracut[8056]: nameserver=127.0.0.1 Nov 3 14:33:27 kjcf05n02 dracut[8056]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 3 14:33:27 kjcf05n02 dracut[8056]: rd.neednet Nov 3 14:33:27 kjcf05n02 dracut[8056]: kdumpnic=mgmt0 Nov 3 14:33:27 kjcf05n02 dracut[8056]: bootdev=mgmt0 Nov 3 14:33:27 kjcf05n02 dracut[8056]: *** Install squash loader *** Nov 3 14:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T14:33:27.253333791-06:00 level=info msg="Completed cleanup jobs" duration=26.784302ms Nov 3 14:33:27 kjcf05n02 dracut[8056]: *** Squashing the files inside the initramfs *** Nov 3 14:33:27 kjcf05n02 dracut[8056]: *** Squashing the files inside the initramfs done *** Nov 3 14:33:27 kjcf05n02 dracut[8056]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 14:33:28 kjcf05n02 dracut[8056]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 14:33:28 kjcf05n02 kdumpctl[7942]: kdump: kexec: loaded kdump kernel Nov 3 14:33:28 kjcf05n02 kdumpctl[7942]: kdump: Starting kdump: [OK] Nov 3 14:33:28 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 3 14:33:28 kjcf05n02 systemd[1]: Reloading. Nov 3 14:33:28 kjcf05n02 systemd[3230]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:33:28 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:33:28 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:33:28 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 14:33:28 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 14:33:28 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 14:33:28 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 14:33:28 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 14:33:28 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 14:33:28 kjcf05n02 ifdown[14733]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 14:33:28 kjcf05n02 ifdown[14734]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:33:28 kjcf05n02 ifdown[14735]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:33:29 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 14:33:29 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 14:33:29 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 14:33:29 kjcf05n02 ifup[14807]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 14:33:29 kjcf05n02 ifup[14808]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:33:29 kjcf05n02 ifup[14811]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:33:32 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 14:33:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 14:33:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 14:33:33 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 14:33:33 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 3 14:33:33 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 14:33:33 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running Nov 3 14:33:33 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 3 14:33:33 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 14:33:34 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 14:33:34 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:33:34 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 14:33:34 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:33:34 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:33:34 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:33:34 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 14:33:34 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 14:33:34 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 14:33:34 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 14:33:34 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:33:34 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:33:34 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:33:34 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:33:34 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 14:33:34 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 14:33:34 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 14:33:34 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 14:33:34 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 14:33:34 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 14:33:34 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 14:33:34 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 14:33:34 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 14:33:34 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 14:33:34 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 14:33:34 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 14:33:34 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 14:33:34 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 14:33:34 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 14:33:34 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 14:33:34 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 14:33:34 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 14:33:34 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 14:33:34 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 14:33:34 kjcf05n02 ifdown[15066]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 14:33:34 kjcf05n02 ifdown[15068]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:33:34 kjcf05n02 ifdown[15069]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:33:34 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 14:33:34 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 14:33:34 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 14:33:34 kjcf05n02 ifup[15139]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 14:33:34 kjcf05n02 ifup[15140]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:33:34 kjcf05n02 ifup[15141]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:33:35 kjcf05n02 dcs-collectord[5721]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 14:33:35 kjcf05n02 dcs-collectord[5721]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 14:33:36 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 14:33:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730666016', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 14:33:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730666016', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 14:33:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730666016'} Nov 3 14:33:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730666016'} Nov 3 14:33:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:33:37 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 14:33:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 14:33:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 14:33:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 14:33:38 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 14:33:39 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 14:33:39 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 14:33:39 kjcf05n02 systemd[1]: Reloading. Nov 3 14:33:39 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 3 14:33:39 kjcf05n02 await_ha_peer[15357]: Waiting for HA peer kjcf05n03 Nov 3 14:33:40 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 14:33:40 kjcf05n02 await_ha_peer[15357]: Peer kjcf05n03 has started, starting HA Nov 3 14:33:41 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 3 14:33:41 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 3 14:33:41 kjcf05n02 fstonithd.py[15435]: Listening for kdump packets from partner Nov 3 14:33:41 kjcf05n02 systemd[1]: Reloading. Nov 3 14:33:41 kjcf05n02 systemd[3230]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:33:41 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:33:41 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:33:41 kjcf05n02 systemd[1]: Reloading. Nov 3 14:33:41 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 3 14:33:41 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 14:33:41 kjcf05n02 systemd[1]: Reloading. Nov 3 14:33:42 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 14:33:42 kjcf05n02 puppet-agent[3645]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 14:33:42 kjcf05n02 puppet[3645]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 14:33:42 kjcf05n02 puppet-agent[3645]: Applied catalog in 92.39 seconds Nov 3 14:33:42 kjcf05n02 puppet[3645]: Notice: Applied catalog in 92.39 seconds Nov 3 14:33:42 kjcf05n02 systemd[1]: Started Puppet agent. Nov 3 14:33:42 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 14:33:42 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 3 14:33:42 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 14:33:42 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 14:33:42 kjcf05n02 systemd[1]: Reached target Timers. Nov 3 14:33:42 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 14:33:42 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 14:33:42 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 14:33:42 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 14:33:42 kjcf05n02 wce-disable.sh[15647]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 14:33:42 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 14:33:42 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 14:33:42 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 14:33:42 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 14:33:42 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 3 14:33:42 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 3 14:33:42 kjcf05n02 python3.9[15645]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 14:33:42 kjcf05n02 python3.9[15645]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 14:33:42 kjcf05n02 gateway-ec-node.py[15646]: Starting gateway-ec-node service Nov 3 14:33:42 kjcf05n02 RFSF-API[15644]: INFO[2024-11-03T14:33:42-06:00] Datapath API RESTful Service starting Nov 3 14:33:42 kjcf05n02 dp-api-server-node[15644]: INFO[2024-11-03T14:33:42-06:00] Datapath API RESTful Service starting Nov 3 14:33:42 kjcf05n02 RFSF-API[15644]: INFO[2024-11-03T14:33:42-06:00] Running in production mode, starting dbus event listener Nov 3 14:33:42 kjcf05n02 dp-api-server-node[15644]: INFO[2024-11-03T14:33:42-06:00] Running in production mode, starting dbus event listener Nov 3 14:33:42 kjcf05n02 RFSF-API[15644]: INFO[2024-11-03T14:33:42-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 14:33:42 kjcf05n02 dp-api-server-node[15644]: INFO[2024-11-03T14:33:42-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 14:33:42 kjcf05n02 RFSF-API[15644]: INFO[2024-11-03T14:33:42-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 14:33:42 kjcf05n02 dp-api-server-node[15644]: INFO[2024-11-03T14:33:42-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 14:33:42 kjcf05n02 RFSF-API[15644]: INFO[2024-11-03T14:33:42-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 14:33:42 kjcf05n02 dp-api-server-node[15644]: INFO[2024-11-03T14:33:42-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 14:33:42 kjcf05n02 RFSF-API[15644]: INFO[2024-11-03T14:33:42-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 14:33:42 kjcf05n02 dp-api-server-node[15644]: INFO[2024-11-03T14:33:42-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 14:33:42 kjcf05n02 RFSF-API[15644]: INFO[2024-11-03T14:33:42-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 14:33:42 kjcf05n02 dp-api-server-node[15644]: INFO[2024-11-03T14:33:42-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 14:33:42 kjcf05n02 RFSF-API[15644]: INFO[2024-11-03T14:33:42-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 14:33:42 kjcf05n02 dp-api-server-node[15644]: INFO[2024-11-03T14:33:42-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 14:33:42 kjcf05n02 RFSF-API[15644]: INFO[2024-11-03T14:33:42-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 14:33:42 kjcf05n02 dp-api-server-node[15644]: INFO[2024-11-03T14:33:42-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 14:33:42 kjcf05n02 RFSF-API[15644]: INFO[2024-11-03T14:33:42-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 14:33:42 kjcf05n02 dp-api-server-node[15644]: INFO[2024-11-03T14:33:42-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 14:33:42 kjcf05n02 RFSF-API[15644]: INFO[2024-11-03T14:33:42-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 14:33:42 kjcf05n02 dp-api-server-node[15644]: INFO[2024-11-03T14:33:42-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 14:33:42 kjcf05n02 RFSF-API[15644]: INFO[2024-11-03T14:33:42-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 14:33:42 kjcf05n02 dp-api-server-node[15644]: INFO[2024-11-03T14:33:42-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 14:33:43 kjcf05n00 mcfcli[3673891]: %3|1730666023.643|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:33:44 kjcf05n00 zabbix_server[15678]: item "kjcf05n02:vfs.fs.size[/mnt/persistent_ha_data,pused]" became supported Nov 3 14:33:47 kjcf05n02 systemd[1]: Reloading. Nov 3 14:33:47 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 14:33:47 kjcf05n02 systemd[1]: Reloading. Nov 3 14:33:48 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 14:33:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730666028', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(1988.0B/984.0B), ib1=(280.0B/360.0B), icl0=(7.2kB/8.9kB), lo=(600.0B/600.0B), meth0=(1541.5MB/8.1MB), mgmt0=(1478.4MB/8.0MB)'}"] Nov 3 14:33:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(1988.0B/984.0B), ib1=(280.0B/360.0B), icl0=(7.2kB/8.9kB), lo=(600.0B/600.0B), meth0=(1541.5MB/8.1MB), mgmt0=(1478.4MB/8.0MB)', 'message': 'NET OK - (Rx/Tx) ib0=(1988.0B/984.0B), ib1=(280.0B/360.0B), icl0=(7.2kB/8.9kB), lo=(600.0B/600.0B), meth0=(1541.5MB/8.1MB), mgmt0=(1478.4MB/8.0MB)', 'value': 'ok', 'timestamp': '1730666028'} Nov 3 14:33:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:33:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730666028', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 14:33:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730666028'} Nov 3 14:33:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:33:48 kjcf05n02 diskmonitor_pre[16095]: Key management is currently disabled.DEAR disabled Nov 3 14:33:48 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 14:33:50 kjcf05n02 sh[16155]: LNET configured: New Created Nov 3 14:33:50 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 14:33:50 kjcf05n02 LCNmon[18198]: Interface ib0 is up Nov 3 14:33:50 kjcf05n02 LCNmon[18198]: Interface ib1 is up Nov 3 14:33:50 kjcf05n02 dcs-collectord[5721]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 14:33:50 kjcf05n02 dcs-collectord[5721]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 14:33:50 kjcf05n02 dcs-collectord[5721]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: /var/run/diskmonitor does not exist, creating Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: Creating /var/run/diskmonitor/disk Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: Creating /var/run/diskmonitor/encl Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: Creating /var/run/diskmonitor/cli Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: RAS_Interlocks_enabled: 1 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: add handler for sig: 14 sa_flags: 10000004 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: add handler for sig: 1 sa_flags: 10000004 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: add handler for sig: 2 sa_flags: 00000004 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: add handler for sig: 15 sa_flags: 00000004 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: add handler for sig: 6 sa_flags: 00000004 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: add handler for sig: 3 sa_flags: 00000004 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: add handler for sig: 30 sa_flags: 00000004 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: add handler for sig: 20 sa_flags: 00000004 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: add handler for sig: 10 sa_flags: 10000004 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: add handler for sig: 11 sa_flags: 00000004 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: add handler for sig: 7 sa_flags: 00000004 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: add handler for sig: 4 sa_flags: 00000004 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: add handler for sig: 8 sa_flags: 00000004 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: Using HA Baton locks - key: diskmonitor Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: Baton will be held for at most 570 seconds Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: DMMP Enabled: 0 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: random seed: a611c56c Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: NVMe Enclosure: 1 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: ZFS Enclosure: 0 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: Dbus, Initialized Connection Successfully Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: int_catcher_thread: thread start Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: Received dbus message 4 org.freedesktop.DBus -> :1.108 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 14:33:52 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 14:33:53 kjcf05n00 httpd[902567]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 14:33:53 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 14:33:54 kjcf05n02 LCNmon[18198]: 10.16.100.56 is unreachable via ib0 Nov 3 14:33:54 kjcf05n02 LCNmon[18198]: Can ping through interface ib0 Nov 3 14:33:54 kjcf05n02 LCNmon[18198]: Can ping through interface ib1 Nov 3 14:33:54 kjcf05n02 LCNmon[18198]: NIC ib0, initial state UP Nov 3 14:33:54 kjcf05n02 LCNmon[18198]: NIC ib1, initial state UP Nov 3 14:33:54 kjcf05n02 LCNmon[18198]: LCNstat initial state UP Nov 3 14:33:55 kjcf05n02 LCNmon[18198]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 3 14:33:55 kjcf05n02 openhpid[5627]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 14:33:55 kjcf05n02 openhpid[5627]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 14:33:55 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 3 14:33:55 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 14:33:55 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 14:33:55 kjcf05n00 mcfcli[3673891]: %3|1730666035.125|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:33:55 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18763 which is not our child. We'll most likely not notice when it exits. Nov 3 14:33:55 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 14:33:55 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 3 14:33:55 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 3 14:33:55 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 14:33:55 kjcf05n02 dcs-collectord[5721]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 14:33:55 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 14:33:55 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 14:33:55 kjcf05n02 systemd[1]: Startup finished in 49.682s (kernel) + 2min 29.111s (userspace) = 3min 18.793s. Nov 3 14:33:55 kjcf05n02 openhpid[18763]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 14:33:55 kjcf05n02 openhpid[18763]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 14:33:55 kjcf05n02 openhpid[18763]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 14:33:55 kjcf05n02 openhpid[18763]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 14:33:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 14:33:57 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18893 (bash) Nov 3 14:33:57 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 14:33:57 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 14:33:57 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 14:33:57 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 14:33:57 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 14:33:59 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 14:34:05 kjcf05n02 dcs-collectord[5721]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 14:34:05 kjcf05n02 dcs-collectord[5721]: WARNING No data collected (hpi_parser.py:353) Nov 3 14:34:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730666045', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.28, 1.72, 0.82'}"] Nov 3 14:34:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 1.28, 1.72, 0.82', 'message': 'OK - load average: 1.28, 1.72, 0.82', 'value': 'ok', 'timestamp': '1730666045'} Nov 3 14:34:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:34:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730666049', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 359 processes with STATE = RSZDT '}"] Nov 3 14:34:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 359 processes with STATE = RSZDT ', 'message': 'PROCS OK: 359 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730666049'} Nov 3 14:34:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:34:13 kjcf05n00 mcfcli[3673891]: %3|1730666053.644|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:34:19 kjcf05n02 ipmievd[4060]: System Event sensor - Timestamp Clock Sync Nov 3 14:34:20 kjcf05n02 ipmievd[3230]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:34:20 kjcf05n02 dcs-collectord[5721]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 14:34:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730666068', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 14:34:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730666068'} Nov 3 14:34:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 14:34:31 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 14:34:35 kjcf05n00 mcfcli[3673891]: %3|1730666075.093|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:34:35 kjcf05n02 dcs-collectord[5721]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 14:34:37 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31444 deleted. Nov 3 14:34:37 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31445 deleted. Nov 3 14:34:39 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '0c41cd54-9a23-11ef-a046-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 14:34:39 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '0c41cd54-9a23-11ef-a046-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 14:34:39 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '0c41cd54-9a23-11ef-a046-00093d0695e3', 'response ID': '0c4c90c2-9a23-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 14:34:39 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 0c4c90c2-9a23-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 14:34:39 kjcf05n03 firmware-update-orc-server[5844]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "0a1ab01d-9ddf-4edf-ac6d-6645ffa5d97c"} (logger.py:65) Nov 3 14:34:39 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 141202 (get_disk_device) Nov 3 14:34:39 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 14:34:39 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 14:34:39 kjcf05n03 ccp-client[141223]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 14:34:39 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 14:34:39 kjcf05n02 ras-resource-manager-agent[5985]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "0c41cd54-9a23-11ef-a046-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 14:34:39 kjcf05n02 ras-resource-manager-agent[5985]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '0c41cd54-9a23-11ef-a046-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 14:34:39 kjcf05n02 ras-resource-manager-agent[5985]: INFO Submitting new device inserted signal, starting to qualify drive: 0c41cd54-9a23-11ef-a046-00093d0695e3 (admin_action.py:110) Nov 3 14:34:40 kjcf05n03 ccp-client[141223]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 14:34:40 kjcf05n03 ccp-client[141232]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 14:34:40 kjcf05n03 ccp-client[141223]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 14:34:40 kjcf05n03 ccp-client[141223]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 14:34:40 kjcf05n03 ccp-client[141232]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 14:34:40 kjcf05n03 ccp-client[141232]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 14:34:39 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '0c93a138-9a23-11ef-a046-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 14:34:39 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '0c93a138-9a23-11ef-a046-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 14:34:39 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '0c93a138-9a23-11ef-a046-00093d0695e3', 'response ID': '0c9aeb64-9a23-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 14:34:39 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 0c9aeb64-9a23-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 14:34:40 kjcf05n02 diskmonitor[17620]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 14:34:40 kjcf05n02 ras-resource-manager-agent[5985]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "0c93a138-9a23-11ef-a046-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 14:34:40 kjcf05n02 ras-resource-manager-agent[5985]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '0c93a138-9a23-11ef-a046-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 14:34:40 kjcf05n02 ras-resource-manager-agent[5985]: INFO Submitting new device inserted signal, starting to qualify drive: 0c93a138-9a23-11ef-a046-00093d0695e3 (admin_action.py:110) Nov 3 14:34:40 kjcf05n02 firmware-update-orc-server[5941]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "5a853d57-14ed-4aab-9732-13263201d995"} (logger.py:65) Nov 3 14:34:43 kjcf05n03 DRVFW[141342]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 14:34:43 kjcf05n03 ccp-client[141343]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 14:34:43 kjcf05n03 ccp-client[141343]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 14:34:43 kjcf05n03 ccp-client[141372]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 14:34:43 kjcf05n03 ccp-client[141343]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 14:34:43 kjcf05n03 ccp-client[141372]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 14:34:43 kjcf05n03 ccp-client[141343]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 14:34:43 kjcf05n03 ccp-client[141372]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 14:34:43 kjcf05n03 firmware-update-orc-server[5844]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 14:34:43 kjcf05n00 mcfcli[3673891]: %3|1730666083.644|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 14:34:44 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 0c4c90c2-9a23-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 14:34:44 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '0c41cd54-9a23-11ef-a046-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '0c41cd54-9a23-11ef-a046-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}}} (logger.py:65) Nov 3 14:34:44 kjcf05n02 ras-resource-manager-agent[5985]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '0c41cd54-9a23-11ef-a046-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 14:34:44 kjcf05n02 ras-resource-manager-agent[5985]: INFO Drive qualification complete responding: 0c41cd54-9a23-11ef-a046-00093d0695e3 (admin_action.py:205) Nov 3 14:34:44 kjcf05n02 ras-resource-manager-agent[5985]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "0c41cd54-9a23-11ef-a046-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (interesting_event.py:59) Nov 3 14:34:47 kjcf05n02 diskmonitor[17620]: 004 Nov 3 14:34:47 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 14:34:47 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 14:34:47 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 14:34:47 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 14:34:47 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 14:34:47 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 14:34:47 kjcf05n02 diskmonitor[17620]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 14:34:47 kjcf05n02 diskmonitor[17620]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 14:34:47 kjcf05n02 diskmonitor[17620]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 14:34:47 kjcf05n02 diskmonitor[17620]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 14:34:47 kjcf05n02 diskmonitor[17620]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 14:34:47 kjcf05n02 diskmonitor[17620]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "0c41cd54-9a23-11ef-a046-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 14:34:47 kjcf05n02 diskmonitor[17620]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 14:34:47 kjcf05n02 diskmonitor[17620]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 14:34:47 kjcf05n02 diskmonitor[17620]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "0c93a138-9a23-11ef-a046-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 14:34:47 kjcf05n02 diskmonitor[17620]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 14:34:47 kjcf05n02 diskmonitor[17620]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 14:34:52 kjcf05n02 chronyd[5228]: Selected source 16.110.135.123 Nov 3 14:34:55 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22784 (get_disk_device) Nov 3 14:34:55 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 14:34:55 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 14:34:55 kjcf05n02 ccp-client[22807]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 14:34:55 kjcf05n02 ccp-client[22807]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 14:34:55 kjcf05n02 ccp-client[22835]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 14:34:55 kjcf05n02 ccp-client[22807]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 14:34:55 kjcf05n02 ccp-client[22807]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 14:34:55 kjcf05n02 ccp-client[22835]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 14:34:55 kjcf05n02 ccp-client[22835]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 14:34:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730666095}"] Nov 3 14:34:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730666095, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:34:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:34:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730666095}"] Nov 3 14:34:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730666095, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:34:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:34:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730666095}"] Nov 3 14:34:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730666095, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:34:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:34:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730666095}"] Nov 3 14:34:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730666095, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:34:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:34:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730666095}"] Nov 3 14:34:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730666095, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:34:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:34:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730666095}"] Nov 3 14:34:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730666095, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:34:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:34:56 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730666095}"] Nov 3 14:34:56 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730666095, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:34:56 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:34:56 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730666095}"] Nov 3 14:34:56 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730666095, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:34:56 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:34:56 kjcf05n02 ras-resource-manager-agent[5985]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "0c41cd54-9a23-11ef-a046-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (service_main_handler.py:66) Nov 3 14:34:56 kjcf05n02 ras-resource-manager-agent[5985]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '0c41cd54-9a23-11ef-a046-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 14:34:56 kjcf05n02 ras-resource-manager-agent[5985]: INFO Device qualification response has been acknowledged: 0c41cd54-9a23-11ef-a046-00093d0695e3 (admin_action.py:151) Nov 3 14:34:57 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 3 14:34:57 kjcf05n02 diskmonitor[17620]: find: '/sys/devices/virtual/bdi/0:54': No such file or directory Nov 3 14:34:57 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 14:34:57 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 3 14:34:58 kjcf05n02 DRVFW[23302]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 14:34:58 kjcf05n02 ccp-client[23308]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 14:34:58 kjcf05n02 ccp-client[23308]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 14:34:58 kjcf05n02 ccp-client[23308]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 14:34:58 kjcf05n02 ccp-client[23308]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 14:34:58 kjcf05n02 ccp-client[23354]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 14:34:58 kjcf05n02 ccp-client[23354]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 14:34:58 kjcf05n02 ccp-client[23354]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 14:34:58 kjcf05n02 firmware-update-orc-server[5941]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 14:34:58 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 0c9aeb64-9a23-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 14:34:58 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '0c93a138-9a23-11ef-a046-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '0c93a138-9a23-11ef-a046-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}}} (logger.py:65) Nov 3 14:34:59 kjcf05n02 ras-resource-manager-agent[5985]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '0c93a138-9a23-11ef-a046-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 14:34:59 kjcf05n02 ras-resource-manager-agent[5985]: INFO Drive qualification complete responding: 0c93a138-9a23-11ef-a046-00093d0695e3 (admin_action.py:205) Nov 3 14:34:59 kjcf05n02 ras-resource-manager-agent[5985]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "0c93a138-9a23-11ef-a046-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 3 14:34:59 kjcf05n02 python3.9[5291]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 14:35:01 kjcf05n02 python3.9[3230]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:35:01 kjcf05n02 diskmonitor[17620]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 14:35:01 kjcf05n02 diskmonitor[17620]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 14:35:01 kjcf05n02 ras-resource-manager-agent[5985]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "195f8210-9a23-11ef-a046-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 14:35:01 kjcf05n02 ras-resource-manager-agent[5985]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '195f8210-9a23-11ef-a046-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 14:35:01 kjcf05n02 ras-resource-manager-agent[5985]: INFO Requests ['0c93a138-9a23-11ef-a046-00093d0695e3', '195f8210-9a23-11ef-a046-00093d0695e3'] already in progress (admin_action.py:99) Nov 3 14:35:01 kjcf05n02 ras-resource-manager-agent[5985]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '195f8210-9a23-11ef-a046-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 14:35:01 kjcf05n02 ras-resource-manager-agent[5985]: INFO Drive qualification complete responding: 195f8210-9a23-11ef-a046-00093d0695e3 (admin_action.py:205) Nov 3 14:35:01 kjcf05n02 ras-resource-manager-agent[5985]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "0c93a138-9a23-11ef-a046-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 3 14:35:01 kjcf05n02 ras-resource-manager-agent[5985]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "195f8210-9a23-11ef-a046-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "0c41cd54-9a23-11ef-a046-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: Dbus, handle_ingress_ras_signals, uuid: 0c41cd54-9a23-11ef-a046-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "0c41cd54-9a23-11ef-a046-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: main: Pending firmware leveling requests exist, rescanning disks Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "195f8210-9a23-11ef-a046-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: leaving test state: 1 next state: 2 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: lock req: no timeout Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: leaving test state: 2 next state: 4 Nov 3 14:35:09 kjcf05n02 diskmonitor[17620]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 14:35:10 kjcf05n00 mcfcli[3673891]: %3|1730666110.972|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:35:11 kjcf05n00 python3.9[1332368]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 14:35:13 kjcf05n00 mcfcli[3673891]: %3|1730666113.644|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 14:35:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730665830', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 14:35:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730665830'} Nov 3 14:35:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:35:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730665830', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 14:35:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730665830'} Nov 3 14:35:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:35:43 kjcf05n00 mcfcli[3673891]: %3|1730666143.644|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:35:50 kjcf05n00 mcfcli[3673891]: %3|1730666150.969|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:35:56 kjcf05n02 chronyd[5228]: Selected source 172.16.2.1 Nov 3 14:36:00 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 14:36:01 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 14:36:01 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 14:36:01 kjcf05n02 ras-resource-manager-agent[5985]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "0c93a138-9a23-11ef-a046-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 14:36:01 kjcf05n02 ras-resource-manager-agent[5985]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '0c93a138-9a23-11ef-a046-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 14:36:01 kjcf05n02 ras-resource-manager-agent[5985]: INFO Device qualification response has been acknowledged: 0c93a138-9a23-11ef-a046-00093d0695e3 (admin_action.py:151) Nov 3 14:36:01 kjcf05n02 ras-resource-manager-agent[5985]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "0c93a138-9a23-11ef-a046-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 14:36:01 kjcf05n02 ras-resource-manager-agent[5985]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '0c93a138-9a23-11ef-a046-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 14:36:01 kjcf05n02 ras-resource-manager-agent[5985]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "195f8210-9a23-11ef-a046-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 14:36:01 kjcf05n02 ras-resource-manager-agent[5985]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '195f8210-9a23-11ef-a046-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 14:36:01 kjcf05n02 ras-resource-manager-agent[5985]: INFO Device qualification response has been acknowledged: 195f8210-9a23-11ef-a046-00093d0695e3 (admin_action.py:151) Nov 3 14:36:02 kjcf05n02 diskmonitor[17620]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 14:36:11 kjcf05n03 nslcd[6915]: [e2a9e3] ldap_result() failed: Can't contact LDAP server Nov 3 14:36:13 kjcf05n00 mcfcli[3673891]: %3|1730666173.644|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:36:15 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 14:36:15 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 14:36:15 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 14:36:16 kjcf05n02 dcs-collectord[5721]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 14:36:20 kjcf05n02 diskmonitor[17620]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "0c93a138-9a23-11ef-a046-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 14:36:20 kjcf05n02 diskmonitor[17620]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 14:36:20 kjcf05n02 diskmonitor[17620]: Dbus, handle_ingress_ras_signals, uuid: 0c93a138-9a23-11ef-a046-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 14:36:20 kjcf05n02 diskmonitor[17620]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 14:36:20 kjcf05n02 diskmonitor[17620]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "0c93a138-9a23-11ef-a046-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 14:36:20 kjcf05n02 diskmonitor[17620]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "0c93a138-9a23-11ef-a046-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 14:36:20 kjcf05n02 diskmonitor[17620]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 14:36:20 kjcf05n02 diskmonitor[17620]: Dbus, handle_ingress_ras_signals, uuid: 0c93a138-9a23-11ef-a046-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 14:36:20 kjcf05n02 diskmonitor[17620]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "0c93a138-9a23-11ef-a046-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 14:36:20 kjcf05n02 diskmonitor[17620]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "195f8210-9a23-11ef-a046-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 14:36:20 kjcf05n02 diskmonitor[17620]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 14:36:20 kjcf05n02 diskmonitor[17620]: Dbus, handle_ingress_ras_signals, uuid: 195f8210-9a23-11ef-a046-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 14:36:20 kjcf05n02 diskmonitor[17620]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "195f8210-9a23-11ef-a046-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 14:36:20 kjcf05n02 diskmonitor[17620]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 14:36:20 kjcf05n02 diskmonitor[17620]: lock acquired Nov 3 14:36:20 kjcf05n02 diskmonitor[17620]: leaving test state: 4 next state: 8 Nov 3 14:36:20 kjcf05n02 diskmonitor[17620]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 14:36:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730666185}"] Nov 3 14:36:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730666185, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:36:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:36:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:36:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:36:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:36:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:36:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:36:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:36:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:36:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:36:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:36:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:36:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:36:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:36:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.111104ms Nov 3 14:36:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:36:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.111104ms Nov 3 14:36:25 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:36:25 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:36:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:36:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Inactive', 'timestamp': 1730666185}"] Nov 3 14:36:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730666185, 'value': 'Inactive', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:36:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:36:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:36:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:36:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:36:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:36:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:36:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:36:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:36:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:36:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:36:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:36:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:36:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:36:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.22659ms Nov 3 14:36:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:36:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.22659ms Nov 3 14:36:25 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:36:25 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:36:30 kjcf05n00 mcfcli[3673891]: %3|1730666190.966|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:36:33 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 14:36:40 kjcf05n02 diskmonitor[17620]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 14:36:40 kjcf05n02 diskmonitor[17620]: leaving test state: 8 next state: 20 Nov 3 14:36:40 kjcf05n02 diskmonitor[17620]: leaving test state: 20 next state: 40 Nov 3 14:36:40 kjcf05n02 diskmonitor[17620]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 12d3be10000 Nov 3 14:36:40 kjcf05n02 diskmonitor[17620]: leaving test state: 40 next state: 80 Nov 3 14:36:43 kjcf05n00 mcfcli[3673891]: %3|1730666203.644|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:37:08 kjcf05n00 mcfcli[3673891]: %3|1730666228.850|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:37:12 kjcf05n02 diskmonitor[17620]: leaving test state: 80 next state: 100 Nov 3 14:37:12 kjcf05n02 diskmonitor[17620]: lock release: time: Sun Nov 3 14:37:07 2024 Nov 3 14:37:12 kjcf05n02 diskmonitor[17620]: leaving test state: 100 next state: 1 Nov 3 14:37:13 kjcf05n00 mcfcli[3673891]: %3|1730666233.646|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:37:21 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 14:37:43 kjcf05n00 mcfcli[3673891]: %3|1730666263.646|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:37:47 kjcf05n00 mcfcli[3673891]: %3|1730666267.804|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:38:13 kjcf05n00 mcfcli[3673891]: %3|1730666293.646|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:38:27 kjcf05n00 mcfcli[3673891]: %3|1730666307.801|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:38:43 kjcf05n00 mcfcli[3673891]: %3|1730666323.646|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 14:38:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730666335}"] Nov 3 14:38:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730666335, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:38:55 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:38:55-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:38:55 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:38:55-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:38:55 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:38:55-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:38:55 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:38:55-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:38:55 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:38:55-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:38:55 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:38:55-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:38:55 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:38:55-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.239834ms Nov 3 14:38:55 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:38:55-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.239834ms Nov 3 14:38:55 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:38:55 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:38:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:39:04 kjcf05n00 mcfcli[3673891]: %3|1730666344.703|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:39:13 kjcf05n00 mcfcli[3673891]: %3|1730666353.646|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 14:39:43 kjcf05n00 mcfcli[3673891]: %3|1730666383.647|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:39:44 kjcf05n00 mcfcli[3673891]: %3|1730666384.700|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:39:58 kjcf05n00 zabbix-server[1335244]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 14:39:58 kjcf05n00 zabbix-server[1335244]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n02' from event '46324' Nov 3 14:39:58 kjcf05n00 zabbix-server[1335244]: Host created 'enclosure_USE26000024VS001' Nov 3 14:39:58 kjcf05n00 zabbix-server[1335244]: Running puppet on 'kjcf05n02' Nov 3 14:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 14:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 14:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 14:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 14:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 14:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 14:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 14:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 14:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 14:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 14:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 14:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 14:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 14:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 14:40:01 kjcf05n02 puppet-agent[34997]: Using configured environment 'production' Nov 3 14:40:01 kjcf05n02 puppet-agent[34997]: Retrieving pluginfacts Nov 3 14:40:01 kjcf05n02 puppet-agent[34997]: Retrieving plugin Nov 3 14:40:01 kjcf05n02 puppet-agent[34997]: Loading facts Nov 3 14:40:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 14:40:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:40:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 14:40:03 kjcf05n02 puppet-agent[34997]: Caching catalog for kjcf05n02 Nov 3 14:40:03 kjcf05n02 puppet-agent[34997]: Applying configuration version '1730666402' Nov 3 14:40:06 kjcf05n02 puppet-agent[34997]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 14:40:06 kjcf05n02 puppet-agent[34997]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 14:40:06 kjcf05n02 puppet-agent[34997]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 14:40:06 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 14:40:06 kjcf05n02 zabbix_agent2[6069]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 14:40:06 kjcf05n02 zabbix_agent2[3230]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:40:06 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 14:40:06 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 14:40:06 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 14:40:06 kjcf05n02 puppet-agent[34997]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: Press Ctrl+C to exit. Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: Plugin support version 1.0 Nov 3 14:40:06 kjcf05n02 zabbix_agent2[35437]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 14:40:09 kjcf05n02 puppet-agent[34997]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 14:40:09 kjcf05n02 puppet-agent[34997]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 14:40:09 kjcf05n02 puppet-agent[34997]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 14:40:09 kjcf05n02 puppet-agent[34997]: Applied catalog in 5.24 seconds Nov 3 14:40:09 kjcf05n00 zabbix-server[1335244]: puppet completed status:(0): '' Nov 3 14:40:09 kjcf05n00 zabbix-server[1335244]: Event '46324' acknowledged Nov 3 14:40:09 kjcf05n00 zabbix-server[1335244]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n02"}' Nov 3 14:40:12 kjcf05n00 python3.9[1335346]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 14:40:13 kjcf05n00 mcfcli[3673891]: %3|1730666413.648|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:40:23 kjcf05n00 mcfcli[3673891]: %3|1730666423.454|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:40:24 kjcf05n00 zabbix-server[1335718]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 14:40:24 kjcf05n00 zabbix-server[1335718]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 120.92\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 105.8\\"}}"' Nov 3 14:40:24 kjcf05n00 log_interesting_event.py[1335718]: Event '46325' acknowledged Nov 3 14:40:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730665830', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 14:40:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730665830'} Nov 3 14:40:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:40:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730665830', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 14:40:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730665830'} Nov 3 14:40:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:40:43 kjcf05n00 mcfcli[3673891]: %3|1730666443.648|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 14:41:02 kjcf05n00 mcfcli[3673891]: %3|1730666462.214|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:41:13 kjcf05n00 mcfcli[3673891]: %3|1730666473.648|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 14:41:37 kjcf05n00 mcfcli[3673891]: %3|1730666497.985|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:41:43 kjcf05n00 mcfcli[3673891]: %3|1730666503.649|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 14:42:12 kjcf05n00 mcfcli[3673891]: %3|1730666532.454|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:42:13 kjcf05n00 mcfcli[3673891]: %3|1730666533.649|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 14:42:43 kjcf05n00 mcfcli[3673891]: %3|1730666563.649|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:42:49 kjcf05n00 mcfcli[3673891]: %3|1730666569.792|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:43:13 kjcf05n00 mcfcli[3673891]: %3|1730666593.650|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T14:43:27.252550045-06:00 level=info msg="Completed cleanup jobs" duration=26.164601ms Nov 3 14:43:29 kjcf05n00 mcfcli[3673891]: %3|1730666609.789|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:43:43 kjcf05n00 mcfcli[3673891]: %3|1730666623.651|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:44:05 kjcf05n00 mcfcli[3673891]: %3|1730666645.160|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:44:13 kjcf05n00 mcfcli[3673891]: %3|1730666653.651|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:44:26 kjcf05n03 nslcd[6915]: [45e146] ldap_result() failed: Can't contact LDAP server Nov 3 14:44:31 kjcf05n02 root[42613]: failback_xyraid Nov 3 14:44:33 kjcf05n02 root[42730]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 14:44:34 kjcf05n02 root[42881]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 14:44:37 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 3 14:44:41 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme23n1 Nov 3 14:44:41 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme3n1 Nov 3 14:44:41 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme9n1 Nov 3 14:44:41 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme17n1 Nov 3 14:44:41 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme18n1 Nov 3 14:44:41 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme8n1 Nov 3 14:44:41 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme25n1 Nov 3 14:44:41 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme4n1 Nov 3 14:44:41 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme19n1 Nov 3 14:44:41 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme24n1 Nov 3 14:44:41 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme2n1 Nov 3 14:44:43 kjcf05n00 mcfcli[3673891]: %3|1730666683.651|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:44:43 kjcf05n00 mcfcli[3673891]: %3|1730666683.752|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:44:44 kjcf05n02 dwd[5262]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 14:44:44 kjcf05n02 dwd[5262]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 14:44:44 kjcf05n02 dwd[5262]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 14:44:44 kjcf05n02 dwd[5262]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 14:44:44 kjcf05n02 dwd[5262]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 14:44:44 kjcf05n02 dwd[5262]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 14:44:44 kjcf05n02 dwd[5262]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 14:44:44 kjcf05n02 dwd[5262]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 14:44:44 kjcf05n02 dwd[5262]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 14:44:44 kjcf05n02 dwd[5262]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 14:44:44 kjcf05n02 dwd[5262]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 14:44:44 kjcf05n02 dwd[5262]: Starting NVME thread for nvme2n1 Nov 3 14:44:44 kjcf05n02 dwd[5262]: Starting NVME thread for nvme18n1 Nov 3 14:44:44 kjcf05n02 dwd[5262]: Starting NVME thread for nvme19n1 Nov 3 14:44:44 kjcf05n02 dwd[5262]: Starting NVME thread for nvme9n1 Nov 3 14:44:45 kjcf05n02 dwd[5262]: Starting NVME thread for nvme3n1 Nov 3 14:44:45 kjcf05n02 systemd-udevd[45592]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45593]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45596]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45597]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45592]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45593]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45597]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45596]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45592]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45593]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45597]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45596]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45592]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45593]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45597]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45592]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45596]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45593]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45597]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45592]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45596]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45593]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45597]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45620]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45592]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45593]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45596]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45621]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45597]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45626]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45620]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45592]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45628]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45593]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45596]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45597]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45592]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45620]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45621]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45628]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45620]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45621]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45597]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45597]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45592]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45620]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45621]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45597]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45628]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45620]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45597]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45620]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45597]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45620]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45597]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45597]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45620]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45597]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45620]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45597]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45620]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45597]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45597]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 systemd-udevd[45597]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:44:45 kjcf05n02 dwd[5262]: Starting NVME thread for nvme24n1 Nov 3 14:44:45 kjcf05n02 dcs-bulk-data-sender[6270]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 3 14:44:45 kjcf05n02 dwd[5262]: Starting NVME thread for nvme4n1 Nov 3 14:44:45 kjcf05n02 dwd[5262]: Starting NVME thread for nvme23n1 Nov 3 14:44:45 kjcf05n02 dwd[5262]: Starting NVME thread for nvme17n1 Nov 3 14:44:45 kjcf05n02 nslcd[7024]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 14:44:45 kjcf05n02 dwd[5262]: Starting NVME thread for nvme25n1 Nov 3 14:44:46 kjcf05n02 dwd[5262]: Starting NVME thread for nvme8n1 Nov 3 14:44:54 kjcf05n02 diskmonitor[17620]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 14:45:01 kjcf05n02 diskmonitor[17620]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 14:45:01 kjcf05n02 diskmonitor[17620]: Scan for ReadErrorMax change for md65 Nov 3 14:45:01 kjcf05n02 diskmonitor[17620]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 14:45:01 kjcf05n02 diskmonitor[17620]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 14:45:01 kjcf05n02 diskmonitor[17620]: read_saved_file: md65 no saved speed Nov 3 14:45:01 kjcf05n02 diskmonitor[17620]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 14:45:01 kjcf05n02 diskmonitor[17620]: Set sync_speed_min (10000) for md65 Nov 3 14:45:01 kjcf05n02 diskmonitor[17620]: Set sync_speed_max (200000) for md65 Nov 3 14:45:01 kjcf05n02 diskmonitor[17620]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 14:45:01 kjcf05n03 diskmonitor[17700]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 14:45:01 kjcf05n03 diskmonitor[17700]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 14:45:11 kjcf05n00 python3.9[1338321]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 14:45:13 kjcf05n00 mcfcli[3673891]: %3|1730666713.653|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 14:45:23 kjcf05n00 mcfcli[3673891]: %3|1730666723.208|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:45:37 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 14:45:37 kjcf05n02 systemd-tmpfiles[48559]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 14:45:37 kjcf05n02 systemd-tmpfiles[48559]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 14:45:37 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 14:45:37 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 14:45:40 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 48827 (bash) Nov 3 14:45:40 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 14:45:40 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 14:45:43 kjcf05n00 mcfcli[3673891]: %3|1730666743.653|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:46:00 kjcf05n00 mcfcli[3673891]: %3|1730666760.568|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:46:13 kjcf05n00 mcfcli[3673891]: %3|1730666773.653|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:46:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730666785}"] Nov 3 14:46:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730666785, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:46:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.185403ms Nov 3 14:46:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.185403ms Nov 3 14:46:25 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:46:25 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:46:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:46:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730666785}"] Nov 3 14:46:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730666785, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:46:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:25-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:25 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:25-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:25 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:25-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:25 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.267296ms Nov 3 14:46:25 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:25-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.267296ms Nov 3 14:46:25 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:46:25 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:46:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:46:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730666785}"] Nov 3 14:46:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730666785, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:46:26 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:26-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:26 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:26-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:26 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:26-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:26 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:26-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:26 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:26-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:26 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:26-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:26 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:26-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.958347ms Nov 3 14:46:26 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:26-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.958347ms Nov 3 14:46:26 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:46:26 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:46:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:46:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730666785}"] Nov 3 14:46:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730666785, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:46:26 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:26-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:26 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:26-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:26 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:26-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:26 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:26-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:26 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:26-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:26 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:26-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:26 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:26-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.980079ms Nov 3 14:46:26 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:26-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.980079ms Nov 3 14:46:26 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:46:26 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:46:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:46:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730666785}"] Nov 3 14:46:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730666785, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:46:26 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:26-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:26 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:26-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:26 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:26-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:26 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:26-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:26 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:26-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:26 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:26-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:26 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:26-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.222813ms Nov 3 14:46:26 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:26-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.222813ms Nov 3 14:46:26 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:46:26 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:46:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:46:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730666785}"] Nov 3 14:46:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730666785, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:46:26 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:26-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:26 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:26-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:26 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:26-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:26 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:26-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:26 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:26-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:26 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:26-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:26 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:26-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.272806ms Nov 3 14:46:26 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:26-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.272806ms Nov 3 14:46:26 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:46:26 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:46:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:46:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730666785}"] Nov 3 14:46:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730666785, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:46:26 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:26-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:26 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:26-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:26 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:26-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:26 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:26-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:26 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:26-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:26 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:26-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:26 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:26-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.422477ms Nov 3 14:46:26 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:26-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.422477ms Nov 3 14:46:26 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:46:26 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:46:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:46:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730666785}"] Nov 3 14:46:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730666785, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:46:26 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:26-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:26 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:26-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:26 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:26-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:26 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:26-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:26 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:26-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:26 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:26-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:26 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:26-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.083261ms Nov 3 14:46:26 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:26-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.083261ms Nov 3 14:46:26 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:46:26 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:46:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:46:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730666785}"] Nov 3 14:46:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730666785, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:46:26 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:26-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:26 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:26-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:26 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:26-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:26 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:26-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:26 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:26-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:26 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:26-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:26 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:26-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.674666ms Nov 3 14:46:26 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:26-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.674666ms Nov 3 14:46:26 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:46:26 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:46:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:46:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730666785}"] Nov 3 14:46:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730666785, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:46:27 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:27-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:27 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:27-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:27 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:27-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:27 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:27-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:27 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:27-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:27 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:27-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:27 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:27-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.869692ms Nov 3 14:46:27 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:27-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.869692ms Nov 3 14:46:27 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:46:27 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:46:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:46:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730666785}"] Nov 3 14:46:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730666785, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 14:46:27 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:27-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:27 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:27-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 14:46:27 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:27-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:27 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T14:46:27-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:27 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:27-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 14:46:27 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T14:46:27-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 14:46:27 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:46:27-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.787258ms Nov 3 14:46:27 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:46:27-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.787258ms Nov 3 14:46:27 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:14:46:27 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 14:46:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:46:38 kjcf05n00 mcfcli[3673891]: %3|1730666798.601|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:46:43 kjcf05n00 mcfcli[3673891]: %3|1730666803.653|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:47:13 kjcf05n00 mcfcli[3673891]: %3|1730666833.654|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:47:16 kjcf05n00 mcfcli[3673891]: %3|1730666836.503|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:47:43 kjcf05n00 mcfcli[3673891]: %3|1730666863.655|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:47:54 kjcf05n00 mcfcli[3673891]: %3|1730666874.393|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:48:14 kjcf05n00 mcfcli[3673891]: %3|1730666894.154|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 14:48:33 kjcf05n00 mcfcli[3673891]: %3|1730666913.044|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:48:44 kjcf05n00 mcfcli[3673891]: %3|1730666924.155|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:49:10 kjcf05n00 mcfcli[3673891]: %3|1730666950.574|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:49:14 kjcf05n00 mcfcli[3673891]: %3|1730666954.155|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:49:44 kjcf05n00 mcfcli[3673891]: %3|1730666984.155|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:49:50 kjcf05n00 mcfcli[3673891]: %3|1730666990.571|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 14:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 14:50:00 kjcf05n02 dwd[5262]: nvme25n1 passed periodic SMART status check Nov 3 14:50:00 kjcf05n02 dwd[5262]: nvme17n1 passed periodic SMART status check Nov 3 14:50:00 kjcf05n02 dwd[5262]: nvme23n1 passed periodic SMART status check Nov 3 14:50:00 kjcf05n02 dwd[5262]: nvme4n1 passed periodic SMART status check Nov 3 14:50:00 kjcf05n02 dwd[5262]: nvme9n1 passed periodic SMART status check Nov 3 14:50:00 kjcf05n02 dwd[5262]: nvme8n1 passed periodic SMART status check Nov 3 14:50:00 kjcf05n02 dwd[5262]: nvme2n1 passed periodic SMART status check Nov 3 14:50:00 kjcf05n02 dwd[5262]: nvme24n1 passed periodic SMART status check Nov 3 14:50:00 kjcf05n02 dwd[5262]: nvme19n1 passed periodic SMART status check Nov 3 14:50:00 kjcf05n02 dwd[5262]: nvme3n1 passed periodic SMART status check Nov 3 14:50:00 kjcf05n02 dwd[5262]: nvme18n1 passed periodic SMART status check Nov 3 14:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 14:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 14:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 14:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 14:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 14:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 14:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 14:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 14:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 14:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 14:50:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 14:50:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:50:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 14:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 14:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 14:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 14:50:01 kjcf05n00 zabbix-server[1341134]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 14:50:01 kjcf05n00 zabbix-server[1341134]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46329' Nov 3 14:50:01 kjcf05n00 zabbix-server[1341134]: Filesystem 'kjcf05' has been mounted Nov 3 14:50:02 kjcf05n00 zabbix-server[1341134]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 14:50:02 kjcf05n00 zabbix-server[1341134]: Running puppet on 'None' Nov 3 14:50:04 kjcf05n03 puppet-agent[168471]: Using configured environment 'production' Nov 3 14:50:04 kjcf05n03 puppet-agent[168471]: Retrieving pluginfacts Nov 3 14:50:04 kjcf05n03 puppet-agent[168471]: Retrieving plugin Nov 3 14:50:04 kjcf05n02 puppet-agent[56262]: Using configured environment 'production' Nov 3 14:50:04 kjcf05n02 puppet-agent[56262]: Retrieving pluginfacts Nov 3 14:50:04 kjcf05n02 puppet-agent[56262]: Retrieving plugin Nov 3 14:50:04 kjcf05n07 puppet-agent[3359635]: Using configured environment 'production' Nov 3 14:50:04 kjcf05n07 puppet-agent[3359635]: Retrieving pluginfacts Nov 3 14:50:04 kjcf05n07 puppet-agent[3359635]: Retrieving plugin Nov 3 14:50:04 kjcf05n05 puppet-agent[3518408]: Using configured environment 'production' Nov 3 14:50:04 kjcf05n05 puppet-agent[3518408]: Retrieving pluginfacts Nov 3 14:50:04 kjcf05n05 puppet-agent[3518408]: Retrieving plugin Nov 3 14:50:04 kjcf05n05 puppet-agent[3518408]: Loading facts Nov 3 14:50:04 kjcf05n04 puppet-agent[3358897]: Using configured environment 'production' Nov 3 14:50:04 kjcf05n04 puppet-agent[3358897]: Retrieving pluginfacts Nov 3 14:50:04 kjcf05n04 puppet-agent[3358897]: Retrieving plugin Nov 3 14:50:04 kjcf05n04 puppet-agent[3358897]: Loading facts Nov 3 14:50:04 kjcf05n06 puppet-agent[3363312]: Using configured environment 'production' Nov 3 14:50:04 kjcf05n06 puppet-agent[3363312]: Retrieving pluginfacts Nov 3 14:50:04 kjcf05n06 puppet-agent[3363312]: Retrieving plugin Nov 3 14:50:04 kjcf05n06 puppet-agent[3363312]: Loading facts Nov 3 14:50:05 kjcf05n03 puppet-agent[168471]: Loading facts Nov 3 14:50:05 kjcf05n02 puppet-agent[56262]: Loading facts Nov 3 14:50:05 kjcf05n07 puppet-agent[3359635]: Loading facts Nov 3 14:50:05 kjcf05n01 puppet-agent[3147413]: Using configured environment 'production' Nov 3 14:50:05 kjcf05n01 puppet-agent[3147413]: Retrieving pluginfacts Nov 3 14:50:05 kjcf05n01 puppet-agent[3147413]: Retrieving plugin Nov 3 14:50:05 kjcf05n01 puppet-agent[3147413]: Loading facts Nov 3 14:50:05 kjcf05n00 puppet-agent[1341352]: Using configured environment 'production' Nov 3 14:50:05 kjcf05n00 puppet-agent[1341352]: Retrieving pluginfacts Nov 3 14:50:05 kjcf05n00 puppet-agent[1341352]: Retrieving plugin Nov 3 14:50:05 kjcf05n00 puppet-agent[1341352]: Loading facts Nov 3 14:50:07 kjcf05n02 puppet-agent[56262]: Caching catalog for kjcf05n02 Nov 3 14:50:07 kjcf05n02 puppet-agent[56262]: Applying configuration version '1730667006' Nov 3 14:50:07 kjcf05n03 puppet-agent[168471]: Caching catalog for kjcf05n03 Nov 3 14:50:07 kjcf05n03 puppet-agent[168471]: Applying configuration version '1730667006' Nov 3 14:50:07 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 14:50:07 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 14:50:07 kjcf05n06 puppet-agent[3363312]: Caching catalog for kjcf05n06 Nov 3 14:50:07 kjcf05n06 puppet-agent[3363312]: Applying configuration version '1730667006' Nov 3 14:50:08 kjcf05n07 puppet-agent[3359635]: Caching catalog for kjcf05n07 Nov 3 14:50:08 kjcf05n07 puppet-agent[3359635]: Applying configuration version '1730667006' Nov 3 14:50:08 kjcf05n01 puppet-agent[3147413]: Caching catalog for kjcf05n01 Nov 3 14:50:09 kjcf05n01 puppet-agent[3147413]: Applying configuration version '1730667006' Nov 3 14:50:09 kjcf05n00 puppet-agent[1341352]: Caching catalog for kjcf05n00 Nov 3 14:50:09 kjcf05n00 puppet-agent[1341352]: Applying configuration version '1730667007' Nov 3 14:50:09 kjcf05n02 puppet-agent[56262]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 14:50:09 kjcf05n02 puppet-agent[56262]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 14:50:09 kjcf05n02 puppet-agent[56262]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 14:50:09 kjcf05n03 puppet-agent[168471]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 14:50:09 kjcf05n03 puppet-agent[168471]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 14:50:09 kjcf05n03 puppet-agent[168471]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 14:50:09 kjcf05n06 puppet-agent[3363312]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 14:50:09 kjcf05n06 puppet-agent[3363312]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 14:50:09 kjcf05n06 puppet-agent[3363312]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 14:50:10 kjcf05n07 puppet-agent[3359635]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 14:50:10 kjcf05n07 puppet-agent[3359635]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 14:50:10 kjcf05n07 puppet-agent[3359635]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 14:50:10 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 14:50:10 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 14:50:10 kjcf05n02 zabbix_agent2[35437]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 14:50:10 kjcf05n02 zabbix_agent2[3230]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 14:50:10 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 14:50:10 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 14:50:10 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 14:50:10 kjcf05n02 puppet-agent[56262]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: Press Ctrl+C to exit. Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: Plugin support version 1.0 Nov 3 14:50:10 kjcf05n02 zabbix_agent2[56698]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 14:50:10 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 14:50:10 kjcf05n03 zabbix_agent2[112534]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 14:50:10 kjcf05n03 zabbix_agent2[3072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 14:50:10 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 14:50:10 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 14:50:10 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 14:50:10 kjcf05n03 puppet-agent[168471]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: Press Ctrl+C to exit. Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: Plugin support version 1.0 Nov 3 14:50:10 kjcf05n03 zabbix_agent2[168944]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3310938]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 14:50:10 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 14:50:10 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 14:50:10 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 14:50:10 kjcf05n06 puppet-agent[3363312]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: Press Ctrl+C to exit. Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: Plugin support version 1.0 Nov 3 14:50:10 kjcf05n06 zabbix_agent2[3363906]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 14:50:10 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3307073]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 14:50:10 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 14:50:10 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 14:50:10 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 14:50:10 kjcf05n07 puppet-agent[3359635]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: Press Ctrl+C to exit. Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: Plugin support version 1.0 Nov 3 14:50:10 kjcf05n07 zabbix_agent2[3360042]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 14:50:11 kjcf05n01 puppet-agent[3147413]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 14:50:11 kjcf05n01 puppet-agent[3147413]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-14:26:36]/mode) mode changed '0755' to '0750' Nov 3 14:50:12 kjcf05n02 puppet-agent[56262]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 14:50:12 kjcf05n02 puppet-agent[56262]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 14:50:12 kjcf05n02 puppet-agent[56262]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 14:50:12 kjcf05n02 puppet-agent[56262]: Applied catalog in 5.07 seconds Nov 3 14:50:12 kjcf05n01 puppet-agent[3147413]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-14:26:36/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 14:50:12 kjcf05n01 puppet-agent[3147413]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-14:26:36/vmcore]/mode) mode changed '0600' to '0640' Nov 3 14:50:12 kjcf05n01 puppet-agent[3147413]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-14:26:36/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 14:50:12 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 14:50:12 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 14:50:12 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 14:50:11 kjcf05n00 python3.9[1341402]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 14:50:11 kjcf05n00 puppet-agent[1341352]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 14:50:12 kjcf05n06 puppet-agent[3363312]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 14:50:12 kjcf05n06 puppet-agent[3363312]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 14:50:12 kjcf05n06 puppet-agent[3363312]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 14:50:12 kjcf05n06 puppet-agent[3363312]: Applied catalog in 4.83 seconds Nov 3 14:50:12 kjcf05n03 puppet-agent[168471]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 14:50:12 kjcf05n03 puppet-agent[168471]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 14:50:12 kjcf05n03 puppet-agent[168471]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 14:50:12 kjcf05n03 puppet-agent[168471]: Applied catalog in 5.02 seconds Nov 3 14:50:12 kjcf05n07 puppet-agent[3359635]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 14:50:12 kjcf05n07 puppet-agent[3359635]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 14:50:12 kjcf05n07 puppet-agent[3359635]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 14:50:12 kjcf05n07 puppet-agent[3359635]: Applied catalog in 4.88 seconds Nov 3 14:50:13 kjcf05n01 puppet-agent[3147413]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 14:50:13 kjcf05n01 puppet-agent[3147413]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 14:50:13 kjcf05n01 puppet-agent[3147413]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 14:50:13 kjcf05n00 puppet-agent[1341352]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 14:50:13 kjcf05n00 puppet-agent[1341352]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 14:50:13 kjcf05n00 puppet-agent[1341352]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 14:50:13 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3135632]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 14:50:13 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 14:50:13 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 14:50:13 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 14:50:13 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 14:50:13 kjcf05n01 puppet-agent[3147413]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: Press Ctrl+C to exit. Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: Plugin support version 1.0 Nov 3 14:50:13 kjcf05n01 zabbix_agent2[3147826]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 14:50:14 kjcf05n04 puppet-agent[3358897]: Caching catalog for kjcf05n04 Nov 3 14:50:14 kjcf05n04 puppet-agent[3358897]: Applying configuration version '1730667012' Nov 3 14:50:13 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1322946]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 14:50:14 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 14:50:13 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 14:50:13 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 14:50:13 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 14:50:13 kjcf05n00 puppet-agent[1341352]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: Press Ctrl+C to exit. Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: Plugin support version 1.0 Nov 3 14:50:13 kjcf05n00 zabbix_agent2[1342051]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 14:50:14 kjcf05n00 zabbix-server[1342084]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 14:50:14 kjcf05n00 mcfcli[3673891]: %3|1730667014.155|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:50:14 kjcf05n00 zabbix-server[1342127]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 14:50:14 kjcf05n00 zabbix-server[1342154]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 14:50:15 kjcf05n01 puppet-agent[3147413]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_143357.log]/mode) mode changed '0644' to '0640' Nov 3 14:50:15 kjcf05n01 puppet-agent[3147413]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_144540.log]/mode) mode changed '0644' to '0640' Nov 3 14:50:15 kjcf05n01 puppet-agent[3147413]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_144540]/mode) mode changed '0755' to '0750' Nov 3 14:50:15 kjcf05n01 puppet-agent[3147413]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_144540/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 14:50:15 kjcf05n00 zabbix-server[1342172]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 14:50:15 kjcf05n05 puppet-agent[3518408]: Caching catalog for kjcf05n05 Nov 3 14:50:15 kjcf05n05 puppet-agent[3518408]: Applying configuration version '1730667014' Nov 3 14:50:15 kjcf05n00 puppet-agent[1341352]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 14:50:16 kjcf05n04 puppet-agent[3358897]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 14:50:16 kjcf05n04 puppet-agent[3358897]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 14:50:16 kjcf05n04 puppet-agent[3358897]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 14:50:16 kjcf05n01 puppet-agent[3147413]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_143357.log]/mode) mode changed '0644' to '0640' Nov 3 14:50:16 kjcf05n01 puppet-agent[3147413]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_144540.log]/mode) mode changed '0644' to '0640' Nov 3 14:50:16 kjcf05n01 puppet-agent[3147413]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 14:50:16 kjcf05n01 puppet-agent[3147413]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 14:50:16 kjcf05n01 puppet-agent[3147413]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 14:50:16 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3312918]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 14:50:16 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 14:50:16 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 14:50:16 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 14:50:16 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 14:50:16 kjcf05n04 puppet-agent[3358897]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: Press Ctrl+C to exit. Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: Plugin support version 1.0 Nov 3 14:50:16 kjcf05n04 zabbix_agent2[3359800]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 14:50:16 kjcf05n00 puppet-agent[1341352]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 14:50:16 kjcf05n00 puppet-agent[1341352]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 14:50:16 kjcf05n00 puppet-agent[1341352]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 14:50:17 kjcf05n01 puppet-agent[3147413]: Applied catalog in 8.79 seconds Nov 3 14:50:17 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 14:50:17 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 14:50:17 kjcf05n00 puppet-agent[1341352]: Applied catalog in 8.27 seconds Nov 3 14:50:17 kjcf05n05 puppet-agent[3518408]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 14:50:17 kjcf05n05 puppet-agent[3518408]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 14:50:17 kjcf05n05 puppet-agent[3518408]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 14:50:18 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3471378]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 14:50:18 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 14:50:18 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 14:50:18 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 14:50:18 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 14:50:18 kjcf05n05 puppet-agent[3518408]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: Starting Zabbix Agent 2 (6.2.1) Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: Press Ctrl+C to exit. Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: Plugin support version 1.0 Nov 3 14:50:18 kjcf05n05 zabbix_agent2[3519175]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 14:50:18 kjcf05n04 puppet-agent[3358897]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 14:50:18 kjcf05n04 puppet-agent[3358897]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 14:50:18 kjcf05n04 puppet-agent[3358897]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 14:50:18 kjcf05n04 puppet-agent[3358897]: Applied catalog in 4.75 seconds Nov 3 14:50:20 kjcf05n05 puppet-agent[3518408]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 14:50:20 kjcf05n05 puppet-agent[3518408]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 14:50:20 kjcf05n05 puppet-agent[3518408]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 14:50:20 kjcf05n05 puppet-agent[3518408]: Applied catalog in 4.69 seconds Nov 3 14:50:20 kjcf05n00 zabbix-server[1341134]: puppet completed status:(0): '' Nov 3 14:50:20 kjcf05n00 zabbix-server[1341134]: Event '46329' acknowledged Nov 3 14:50:20 kjcf05n00 zabbix-server[1341134]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 3 14:50:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730667025', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 14:50:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730667025'} Nov 3 14:50:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:50:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730667025', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 14:50:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730667025'} Nov 3 14:50:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 14:50:28 kjcf05n00 mcfcli[3673891]: %3|1730667028.074|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:50:44 kjcf05n00 mcfcli[3673891]: %3|1730667044.156|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:51:07 kjcf05n00 mcfcli[3673891]: %3|1730667067.790|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:51:14 kjcf05n00 mcfcli[3673891]: %3|1730667074.156|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:51:44 kjcf05n00 mcfcli[3673891]: %3|1730667104.156|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:51:47 kjcf05n00 mcfcli[3673891]: %3|1730667107.346|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:52:12 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T14:52:12-06:00] Checking for stale sessions... Nov 3 14:52:12 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T14:52:12-06:00] Checking for stale sessions... Nov 3 14:52:14 kjcf05n00 mcfcli[3673891]: %3|1730667134.157|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 14:52:27 kjcf05n00 mcfcli[3673891]: %3|1730667147.047|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:52:44 kjcf05n00 mcfcli[3673891]: %3|1730667164.157|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:53:07 kjcf05n00 mcfcli[3673891]: %3|1730667187.044|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:53:14 kjcf05n00 mcfcli[3673891]: %3|1730667194.157|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T20:53:15.868524Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 14:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T20:53:15.868587Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.081ms Nov 3 14:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T14:53:27.255263804-06:00 level=info msg="Completed cleanup jobs" duration=28.851133ms Nov 3 14:53:44 kjcf05n00 mcfcli[3673891]: %3|1730667224.157|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:53:46 kjcf05n00 mcfcli[3673891]: %3|1730667226.905|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:54:14 kjcf05n00 mcfcli[3673891]: %3|1730667254.158|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:54:24 kjcf05n00 mcfcli[3673891]: %3|1730667264.819|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:54:44 kjcf05n00 mcfcli[3673891]: %3|1730667284.158|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 14:55:03 kjcf05n00 mcfcli[3673891]: %3|1730667303.292|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:55:11 kjcf05n00 python3.9[1344640]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 14:55:14 kjcf05n00 mcfcli[3673891]: %3|1730667314.158|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 14:55:40 kjcf05n00 mcfcli[3673891]: %3|1730667340.231|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:55:44 kjcf05n00 mcfcli[3673891]: %3|1730667344.159|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:56:14 kjcf05n00 mcfcli[3673891]: %3|1730667374.160|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:56:20 kjcf05n00 mcfcli[3673891]: %3|1730667380.228|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:56:24 kjcf05n03 nslcd[6915]: [d062c2] ldap_result() failed: Can't contact LDAP server Nov 3 14:56:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 14:56:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 14:56:33 kjcf05n01 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 14:56:33 kjcf05n01 systemd-tmpfiles[3150144]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 14:56:33 kjcf05n01 systemd-tmpfiles[3150144]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 14:56:33 kjcf05n01 systemd-tmpfiles[3150144]: [/usr/lib/tmpfiles.d/powerman.conf:1] Line references path below legacy directory /var/run/, updating /var/run/powerman → /run/powerman; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 14:56:33 kjcf05n01 systemd-tmpfiles[3150144]: [/usr/lib/tmpfiles.d/puppetserver.conf:1] Line references path below legacy directory /var/run/, updating /var/run/puppetlabs/puppetserver → /run/puppetlabs/puppetserver; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 14:56:33 kjcf05n01 systemd-tmpfiles[3150144]: [/usr/lib/tmpfiles.d/rabbitmq-server.conf:1] Line references path below legacy directory /var/run/, updating /var/run/rabbitmq → /run/rabbitmq; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 14:56:33 kjcf05n01 systemd-tmpfiles[3150144]: [/usr/lib/tmpfiles.d/slapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/openldap → /run/openldap; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 14:56:33 kjcf05n01 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 14:56:33 kjcf05n01 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 14:56:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 14:56:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 14:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 14:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 14:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 14:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 14:56:44 kjcf05n00 mcfcli[3673891]: %3|1730667404.314|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 14:56:45 kjcf05n00 zabbix_server[15719]: Zabbix agent item "dcs.array.discovery" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 3 14:56:47 kjcf05n00 zabbix_server[15718]: Zabbix agent item "dcs.lustre.device.ost.count[{$LUSTRE_FS_NAME}]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 3 14:56:50 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='39', error='Connection reset by peer (104)' Nov 3 14:56:50 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='39', client='AF_INET(172.16.2.5:46427)', local='AF_INET(0.0.0.0:601)' Nov 3 14:56:51 kjcf05n03 fstonithd.py[15308]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 3 14:56:51 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 14:56:51 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 14:56:51 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 14:56:53 kjcf05n03 root[179789]: is_enc_ipmi_off starts Nov 3 14:56:53 kjcf05n03 root[179791]: is_viking_off starts Nov 3 14:56:53 kjcf05n03 root[179807]: is_lan_ipmi_off leaves Nov 3 14:56:53 kjcf05n03 root[179809]: is_lan_ipmi_sec_off leaves Nov 3 14:56:53 kjcf05n03 root[179812]: I am master Nov 3 14:56:53 kjcf05n03 root[179815]: I am in slot 1; partner is in slot 0 Nov 3 14:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 14:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 14:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 14:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 14:56:56 kjcf05n00 mcfcli[3673891]: %3|1730667416.708|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 14:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 14:57:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 14:57:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 14:57:00 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.cpu.util[,iowait]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 14:57:01 kjcf05n03 root[179951]: is_viking_off leaves Nov 3 14:57:01 kjcf05n03 root[179954]: kjcf05n02 not already off look at kdump Nov 3 14:57:01 kjcf05n03 root[179955]: is_kdump_off starts Nov 3 14:57:01 kjcf05n03 fence_kdump[179956]: waiting for message from '172.16.2.5' Nov 3 14:57:01 kjcf05n03 fence_kdump[179956]: received valid message from '172.16.2.5' Nov 3 14:57:01 kjcf05n03 root[179985]: is_kdump_off detected kdump on kjcf05n02 Nov 3 14:57:01 kjcf05n03 root[179986]: kjcf05n02 is kdumping Nov 3 14:57:01 kjcf05n03 root[180107]: is_enc_ipmi_off starts Nov 3 14:57:01 kjcf05n03 root[180108]: is_viking_off starts Nov 3 14:57:01 kjcf05n03 root[180126]: is_lan_ipmi_off leaves Nov 3 14:57:01 kjcf05n03 root[180128]: is_lan_ipmi_sec_off leaves Nov 3 14:57:01 kjcf05n03 root[180132]: I am master Nov 3 14:57:01 kjcf05n03 root[180135]: I am in slot 1; partner is in slot 0 Nov 3 14:57:02 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.count[{$LUSTRE_FS_NAME}]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 14:57:02 kjcf05n00 zabbix_server[15725]: Zabbix agent item "proc.num" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 14:57:03 kjcf05n00 zabbix_server[15759]: Zabbix agent item "proc.num[,,run]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 14:57:11 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 14:57:11 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 14:57:11 kjcf05n03 root[180491]: is_viking_off leaves Nov 3 14:57:11 kjcf05n03 root[180494]: kjcf05n02 not already off look at kdump Nov 3 14:57:11 kjcf05n03 root[180495]: is_kdump_off starts Nov 3 14:57:11 kjcf05n03 fence_kdump[180496]: waiting for message from '172.16.2.5' Nov 3 14:57:12 kjcf05n03 fence_kdump[180496]: received valid message from '172.16.2.5' Nov 3 14:57:12 kjcf05n03 root[180511]: is_kdump_off detected kdump on kjcf05n02 Nov 3 14:57:12 kjcf05n03 root[180512]: kjcf05n02 is kdumping Nov 3 14:57:14 kjcf05n00 mcfcli[3673891]: %3|1730667434.315|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 14:57:16 kjcf05n03 systemd-udevd[182707]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182708]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182709]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182710]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182707]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182709]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182710]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182708]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182707]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182709]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182710]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182708]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182707]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182709]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182710]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182708]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182707]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182710]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182708]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182709]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182707]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182709]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182710]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182732]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182708]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182737]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182709]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182710]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182707]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182739]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182708]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182740]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182709]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182732]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182707]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182708]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182740]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182739]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182709]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182737]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182740]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182708]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182708]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182708]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182707]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182709]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182740]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182708]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182709]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182740]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182708]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182740]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182708]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182740]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182708]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182708]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182740]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182708]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182740]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182740]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182708]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182740]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182740]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:57:16 kjcf05n03 systemd-udevd[182740]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 14:57:17 kjcf05n03 dwd[5164]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 14:57:17 kjcf05n03 dwd[5164]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 14:57:17 kjcf05n03 dwd[5164]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 14:57:17 kjcf05n03 dwd[5164]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 14:57:17 kjcf05n03 dwd[5164]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 14:57:17 kjcf05n03 dwd[5164]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 14:57:17 kjcf05n03 dwd[5164]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 14:57:17 kjcf05n03 dwd[5164]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 14:57:17 kjcf05n03 dwd[5164]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 14:57:17 kjcf05n03 dwd[5164]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 14:57:17 kjcf05n03 dwd[5164]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 14:57:17 kjcf05n03 dwd[5164]: Starting NVME thread for nvme2n1 Nov 3 14:57:17 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0003,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 14:57:17 kjcf05n03 dwd[5164]: Starting NVME thread for nvme8n1 Nov 3 14:57:17 kjcf05n03 dwd[5164]: Starting NVME thread for nvme24n1 Nov 3 14:57:18 kjcf05n03 dwd[5164]: Starting NVME thread for nvme17n1 Nov 3 14:57:18 kjcf05n03 dwd[5164]: Starting NVME thread for nvme3n1 Nov 3 14:57:18 kjcf05n03 dwd[5164]: Starting NVME thread for nvme25n1 Nov 3 14:57:18 kjcf05n03 dwd[5164]: Starting NVME thread for nvme19n1 Nov 3 14:57:18 kjcf05n03 dwd[5164]: Starting NVME thread for nvme4n1 Nov 3 14:57:18 kjcf05n03 dwd[5164]: Starting NVME thread for nvme18n1 Nov 3 14:57:18 kjcf05n03 dwd[5164]: Starting NVME thread for nvme23n1 Nov 3 14:57:18 kjcf05n03 dwd[5164]: Starting NVME thread for nvme9n1 Nov 3 14:57:18 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vfs.fs.size[/var/lib/pacemaker,used]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 14:57:28 kjcf05n03 diskmonitor[17700]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 14:57:32 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 3 14:57:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 14:57:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 14:57:33 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 3 14:57:34 kjcf05n00 mcfcli[3673891]: %3|1730667454.295|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:57:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 14:57:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 14:57:37 kjcf05n03 diskmonitor[17700]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 14:57:37 kjcf05n03 diskmonitor[17700]: Scan for ReadErrorMax change for md65 Nov 3 14:57:37 kjcf05n03 diskmonitor[17700]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 14:57:37 kjcf05n03 diskmonitor[17700]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 14:57:37 kjcf05n03 diskmonitor[17700]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.min.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 14:57:37 kjcf05n03 diskmonitor[17700]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.max.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 14:57:37 kjcf05n03 diskmonitor[17700]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 14:57:37 kjcf05n03 diskmonitor[17700]: Set sync_speed_min (10000) for md65 Nov 3 14:57:37 kjcf05n03 diskmonitor[17700]: Set sync_speed_max (200000) for md65 Nov 3 14:57:37 kjcf05n03 diskmonitor[17700]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 14:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 14:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 14:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 14:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 14:57:44 kjcf05n00 mcfcli[3673891]: %3|1730667464.661|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 14:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 14:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 14:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 14:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 14:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 14:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 14:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 14:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 14:58:12 kjcf05n00 mcfcli[3673891]: %3|1730667492.814|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:58:14 kjcf05n00 mcfcli[3673891]: %3|1730667494.661|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 14:58:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 14:58:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 14:58:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 14:58:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 14:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 14:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 14:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 14:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 14:58:44 kjcf05n00 mcfcli[3673891]: %3|1730667524.661|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:58:51 kjcf05n00 mcfcli[3673891]: %3|1730667531.082|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 14:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 14:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 14:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 14:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 14:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 14:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 14:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 14:59:14 kjcf05n00 mcfcli[3673891]: %3|1730667554.662|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:59:30 kjcf05n00 mcfcli[3673891]: %3|1730667570.040|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 14:59:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 14:59:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 14:59:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 14:59:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 14:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 14:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 14:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 14:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 14:59:44 kjcf05n00 mcfcli[3673891]: %3|1730667584.662|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 14:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 14:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 14:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 14:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 14:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 14:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 14:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 14:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 15:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 15:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 15:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 15:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 15:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 15:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 15:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 15:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 15:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 15:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 15:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 15:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 15:00:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 15:00:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:00:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 15:00:09 kjcf05n00 mcfcli[3673891]: %3|1730667609.853|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:00:10 kjcf05n00 zabbix-server[1347675]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:00:10 kjcf05n00 zabbix-server[1347675]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 15:00:10 kjcf05n00 log_interesting_event.py[1347675]: Event '46330' acknowledged Nov 3 15:00:14 kjcf05n00 mcfcli[3673891]: %3|1730667614.662|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:00:17 kjcf05n00 python3.9[1347672]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 15:00:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730667630', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 15:00:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730667630'} Nov 3 15:00:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:00:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730667630', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 15:00:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730667630'} Nov 3 15:00:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:00:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 15:00:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 15:00:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 15:00:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 15:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 15:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 15:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 15:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 15:00:38 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 3 15:00:38 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 15:00:42 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 15:00:42 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 3 15:00:42 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 3 15:00:42 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 15:00:42 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 15:00:42 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 3 15:00:42 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 3 15:00:44 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 3 15:00:44 kjcf05n00 mcfcli[3673891]: %3|1730667644.662|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:00:47 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 3 15:00:48 kjcf05n00 mcfcli[3673891]: %3|1730667648.813|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:00:54 kjcf05n01 dwd[7573]: nvme0n1 passed periodic SMART status check Nov 3 15:00:54 kjcf05n01 dwd[7573]: nvme1n1 passed periodic SMART status check Nov 3 15:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 15:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 15:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 15:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 15:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 15:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 15:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 15:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 15:01:00 kjcf05n00 dwd[5498]: nvme1n1 passed periodic SMART status check Nov 3 15:01:00 kjcf05n00 dwd[5498]: nvme0n1 passed periodic SMART status check Nov 3 15:01:08 kjcf05n01 dwd[7573]: nvme2n1 passed periodic SMART status check Nov 3 15:01:14 kjcf05n00 mcfcli[3673891]: %3|1730667674.663|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:01:22 kjcf05n01 dwd[7573]: nvme4n1 passed periodic SMART status check Nov 3 15:01:28 kjcf05n00 dwd[5498]: nvme5n1 passed periodic SMART status check Nov 3 15:01:28 kjcf05n00 mcfcli[3673891]: %3|1730667688.073|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:01:29 kjcf05n00 dwd[5498]: nvme6n1 passed periodic SMART status check Nov 3 15:01:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 15:01:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 15:01:34 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:47104). Nov 3 15:01:34 kjcf05n01 rsyncd[3152003]: connect from kjcf05n02 (172.16.2.5) Nov 3 15:01:34 kjcf05n01 rsyncd[3152003]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 15:01:34 kjcf05n01 rsyncd[3152003]: building file list Nov 3 15:01:34 kjcf05n01 rsyncd[3152003]: sent 11450 bytes received 136 bytes total size 10905 Nov 3 15:01:34 kjcf05n01 systemd[1]: rsyncd@637-172.16.2.2:873-172.16.2.5:47104.service: Succeeded. Nov 3 15:01:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 15:01:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 15:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 15:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 15:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 15:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 15:01:37 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 15:01:44 kjcf05n00 mcfcli[3673891]: %3|1730667704.663|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:01:51 kjcf05n03 fstonithd.py[15308]: Listening for kdump packets from partner Nov 3 15:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 15:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 15:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 15:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 15:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 15:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 15:01:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 15:01:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 15:02:07 kjcf05n00 mcfcli[3673891]: %3|1730667727.726|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:02:14 kjcf05n00 mcfcli[3673891]: %3|1730667734.664|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:02:27 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 15:02:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 15:02:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 15:02:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 15:02:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 15:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 15:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 15:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 15:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 15:02:42 kjcf05n03 dwd[5164]: nvme2n1 passed periodic SMART status check Nov 3 15:02:43 kjcf05n03 dwd[5164]: nvme24n1 passed periodic SMART status check Nov 3 15:02:43 kjcf05n03 dwd[5164]: nvme3n1 passed periodic SMART status check Nov 3 15:02:43 kjcf05n03 dwd[5164]: nvme17n1 passed periodic SMART status check Nov 3 15:02:43 kjcf05n03 dwd[5164]: nvme25n1 passed periodic SMART status check Nov 3 15:02:43 kjcf05n03 dwd[5164]: nvme8n1 passed periodic SMART status check Nov 3 15:02:44 kjcf05n03 dwd[5164]: nvme4n1 passed periodic SMART status check Nov 3 15:02:44 kjcf05n03 dwd[5164]: nvme23n1 passed periodic SMART status check Nov 3 15:02:44 kjcf05n03 dwd[5164]: nvme9n1 passed periodic SMART status check Nov 3 15:02:44 kjcf05n03 dwd[5164]: nvme19n1 passed periodic SMART status check Nov 3 15:02:44 kjcf05n00 mcfcli[3673891]: %3|1730667764.664|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:02:45 kjcf05n03 dwd[5164]: nvme18n1 passed periodic SMART status check Nov 3 15:02:46 kjcf05n00 mcfcli[3673891]: %3|1730667766.405|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 15:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 15:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 15:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 15:02:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 15:02:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 15:02:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 15:02:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 15:03:00 kjcf05n00 plex[12314]: IEC: info: 004001002: MRPD package generation started Nov 3 15:03:01 kjcf05n00 zabbix-server[1349580]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:03:01 kjcf05n00 cscli[1349583]: [csinfo_handler.py:82 - csinfo() ] [INFO] CSM:Observers : Executing ['csinfo', '--yaml', '/tmp/tmpqc3owgyy'] command. Nov 3 15:03:01 kjcf05n00 drive_health_mrpd_tool[1349580]: No data found for drive health in enclosure USE26000024VS001 Nov 3 15:03:01 kjcf05n00 drive_health_mrpd_tool[1349580]: No data found for drive health in enclosure USE26000024VS00F Nov 3 15:03:01 kjcf05n00 drive_health_mrpd_tool[1349580]: No data found for drive health in enclosure SGFGD20025060FF Nov 3 15:03:01 kjcf05n00 drive_health_mrpd_tool[1349580]: No data found for drive health in enclosure USE26000024VS00B Nov 3 15:03:01 kjcf05n00 drive_health_mrpd_tool[1349580]: No data found for drive health in enclosure USE26000024VS005 Nov 3 15:03:02 kjcf05n00 csman[1349616]: plex_external pubsub_rpc: INFO Adding channel close callback (pubsub_rpc.py:142) Nov 3 15:03:02 kjcf05n00 csman[1349616]: plex_external pubsub_rpc: INFO Binding plex_pubsub to cli_responses.036caf42-9a27-11ef-9a82-00093d0696a6 with plex.app.dcs.system.cli.show.reply (pubsub_rpc.py:212) Nov 3 15:03:02 kjcf05n00 csman[1349616]: plex_external pubsub_rpc: INFO Publishing message {'id': '036caf42-9a27-11ef-9a82-00093d0696a6', 'body': {}} to topic 'plex.app.dcs.system.cli.show' (pubsub_rpc.py:314) Nov 3 15:03:02 kjcf05n00 csman[1349616]: plex_external pubsub_rpc: INFO Received message: b'{"reply": "ACK", "id": "036caf42-9a27-11ef-9a82-00093d0696a6"}' (pubsub_rpc.py:268) Nov 3 15:03:02 kjcf05n00 csman[1349616]: plex_external pubsub_rpc: INFO Received message: b'{"reply": "System settings: \\n\\tSystem serial number: 10011838\\n\\tSystem identifier name: [not-set]\\n", "id": "036caf42-9a27-11ef-9a82-00093d0696a6", "terminator": true}' (pubsub_rpc.py:268) Nov 3 15:03:04 kjcf05n01 su[3152903]: (to nobody) root on none Nov 3 15:03:04 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='107', client='AF_INET(172.16.2.5:42383)', local='AF_INET(0.0.0.0:601)' Nov 3 15:03:04 kjcf05n02 syslog-ng[3187]: Configuration reload request received, reloading configuration; Nov 3 15:03:04 kjcf05n02 syslog-ng[3187]: Configuration reload finished; Nov 3 15:03:04 kjcf05n02 syslog-ng[3187]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 15:03:04 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 3 15:03:04 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 15:03:04 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 3 15:03:04 kjcf05n02 dracut: Self testing crypto algorithms Nov 3 15:03:04 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 3 15:03:04 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 15:03:04 kjcf05n02 Copying live image to RAM... Nov 3 15:03:04 kjcf05n02 (this may take a minute) Nov 3 15:03:04 kjcf05n02 Done copying live image to RAM. Nov 3 15:03:04 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 15:03:04 kjcf05n02 dracut: Checking integrity of kernel Nov 3 15:03:04 kjcf05n02 dracut: All initrd crypto checks done Nov 3 15:03:04 kjcf05n02 dracut: Switching root Nov 3 15:03:04 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 15:03:04 kjcf05n02 systemd: Detected architecture x86-64. Nov 3 15:03:04 kjcf05n02 systemd: Set hostname to . Nov 3 15:03:04 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 15:03:04 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 15:03:04 kjcf05n02 systemd: Created slice system-serial\x2dgetty.slice. Nov 3 15:03:04 kjcf05n02 systemd: Listening on Journal Socket (/dev/log). Nov 3 15:03:04 kjcf05n02 systemd: Listening on RPCbind Server Activation Socket. Nov 3 15:03:04 kjcf05n02 systemd: Created slice system-sshd\x2dkeygen.slice. Nov 3 15:03:04 kjcf05n02 systemd: Listening on udev Kernel Socket. Nov 3 15:03:04 kjcf05n02 systemd-journald[1534]: Journal started Nov 3 15:03:04 kjcf05n02 systemd-journald[1534]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 15:03:04 kjcf05n02 systemd-modules-load[1516]: Inserted module 'fuse' Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 15:03:04 kjcf05n02 systemd-sysctl[1545]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 15:03:04 kjcf05n02 systemd-sysctl[1545]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Create System Users. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 15:03:04 kjcf05n02 systemd-journald[1534]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 15:03:04 kjcf05n02 systemd-tmpfiles[1554]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:03:04 kjcf05n02 systemd-tmpfiles[1554]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 3 15:03:04 kjcf05n02 systemd-udevd[1563]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 3 15:03:04 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 3 15:03:04 kjcf05n02 systemd-udevd[1569]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:03:04 kjcf05n02 systemd-udevd[1597]: Using default interface naming scheme 'rhel-8.0'. Nov 3 15:03:04 kjcf05n02 systemd-udevd[1597]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:03:04 kjcf05n02 systemd-udevd[1596]: Using default interface naming scheme 'rhel-8.0'. Nov 3 15:03:04 kjcf05n02 systemd-udevd[1596]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:03:04 kjcf05n02 systemd-udevd[1578]: Using default interface naming scheme 'rhel-8.0'. Nov 3 15:03:04 kjcf05n02 systemd-udevd[1578]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 15:03:04 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 3 15:03:04 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 15:03:04 kjcf05n02 root[1784]: openibd: running in auto mode Nov 3 15:03:04 kjcf05n02 systemd-tmpfiles[1778]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:03:04 kjcf05n02 systemd-tmpfiles[1778]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 3 15:03:04 kjcf05n02 systemd-tmpfiles[1778]: "/var/tmp" already exists and is not a directory. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 15:03:04 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 15:03:04 kjcf05n02 systemd[1]: Started RPC Bind. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 15:03:04 kjcf05n02 systemd-modules-load[1843]: Inserted module 'ib_iser' Nov 3 15:03:04 kjcf05n02 systemd-modules-load[1843]: Inserted module 'ib_isert' Nov 3 15:03:04 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 3 15:03:04 kjcf05n02 systemd-modules-load[1843]: Inserted module 'ib_srpt' Nov 3 15:03:04 kjcf05n02 systemd-udevd[1569]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:03:04 kjcf05n02 systemd-udevd[1607]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:03:04 kjcf05n02 systemd-modules-load[1842]: Inserted module 'ib_ipoib' Nov 3 15:03:04 kjcf05n02 systemd-modules-load[1843]: Inserted module 'rdma_ucm' Nov 3 15:03:04 kjcf05n02 systemd-modules-load[1843]: Module 'svcrdma' is blacklisted Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 15:03:04 kjcf05n02 systemd-udevd[1607]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 15:03:04 kjcf05n02 systemd-udevd[1569]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 15:03:04 kjcf05n02 systemd-modules-load[1842]: Inserted module 'ib_umad' Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 15:03:04 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 3 15:03:04 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 3 15:03:04 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 15:03:04 kjcf05n02 systemd[3187]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:04 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 15:03:04 kjcf05n02 openibd[1771]: Loading HCA driver and Access Layer:[ OK ] Nov 3 15:03:04 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Update is Completed. Nov 3 15:03:04 kjcf05n02 setup-icl[1753]: Setting LAN IP Address to 203.0.113.3 Nov 3 15:03:04 kjcf05n02 setup-icl[1753]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 15:03:04 kjcf05n02 setup-icl[1753]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 15:03:04 kjcf05n02 setup-icl[1753]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 15:03:04 kjcf05n02 systemd-udevd[1569]: Using default interface naming scheme 'rhel-8.0'. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 15:03:04 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 3 15:03:04 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 15:03:04 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 3 15:03:04 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 15:03:04 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 15:03:04 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 15:03:04 kjcf05n02 systemd[1]: Reached target Sockets. Nov 3 15:03:04 kjcf05n02 systemd[1]: Reached target Basic System. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 15:03:04 kjcf05n02 mcelog[2109]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 15:03:04 kjcf05n02 mcelog[2109]: CPU is unsupported Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[2122]: Setting up Mellanox network interface: ib0 Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 15:03:04 kjcf05n02 chronyd[2146]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 15:03:04 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 15:03:04 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 3 15:03:04 kjcf05n02 dwd[2138]: dwd: vMay 29 2024 : 15:38:26 Nov 3 15:03:04 kjcf05n02 dwd[2138]: /usr/sbin/dwd -d --standalone=0 Nov 3 15:03:04 kjcf05n02 dwd[2138]: dwd: option Lethal: 0 Nov 3 15:03:04 kjcf05n02 dwd[2138]: dwd: option Interval: 60 Nov 3 15:03:04 kjcf05n02 dwd[2138]: dwd: option abrtlimit: 10 Nov 3 15:03:04 kjcf05n02 dwd[2138]: dwd: option DZPeriod: 604800 Nov 3 15:03:04 kjcf05n02 dwd[2138]: dwd: option SmartPeriod: 43200 Nov 3 15:03:04 kjcf05n02 dwd[2138]: dwd: option SDDEnabled: 1 Nov 3 15:03:04 kjcf05n02 dwd[2138]: dwd: option SDDAwaitScale: 3 Nov 3 15:03:04 kjcf05n02 dwd[2138]: dwd: option SDDAwaitMin: 100 Nov 3 15:03:04 kjcf05n02 dwd[2138]: dwd: option Verbosity: 1 Nov 3 15:03:04 kjcf05n02 dwd[2138]: dwd: option StandAlone: 0 Nov 3 15:03:04 kjcf05n02 dwd[2138]: option Lethal: 0 Nov 3 15:03:04 kjcf05n02 dwd[2138]: option Interval: 60 Nov 3 15:03:04 kjcf05n02 network[2161]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 15:03:04 kjcf05n02 dwd[2138]: option abrtlimit: 10 Nov 3 15:03:04 kjcf05n02 dwd[2138]: option DZPeriod: 604800 Nov 3 15:03:04 kjcf05n02 dwd[2138]: option SmartPeriod: 43200 Nov 3 15:03:04 kjcf05n02 dwd[2138]: option SDDEnabled: 1 Nov 3 15:03:04 kjcf05n02 dwd[2138]: option SDDAwaitScale: 3 Nov 3 15:03:04 kjcf05n02 dwd[2138]: option SDDAwaitMin: 100 Nov 3 15:03:04 kjcf05n02 dwd[2138]: option Verbosity: 1 Nov 3 15:03:04 kjcf05n02 dwd[2138]: option StandAlone: 0 Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[2159]: Setting up Mellanox network interface: ib1 Nov 3 15:03:04 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 15:03:04 kjcf05n02 network[2195]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 15:03:04 kjcf05n02 network[2161]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:03:04 kjcf05n02 nscd[2231]: 2231 monitoring file `/etc/hosts` (1) Nov 3 15:03:04 kjcf05n02 nscd[2231]: 2231 monitoring directory `/etc` (2) Nov 3 15:03:04 kjcf05n02 nscd[2231]: 2231 monitoring file `/etc/resolv.conf` (3) Nov 3 15:03:04 kjcf05n02 nscd[2231]: 2231 monitoring directory `/etc` (2) Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 15:03:04 kjcf05n02 chronyd[2146]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 15:03:04 kjcf05n02 chronyd[2146]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[2211]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 15:03:04 kjcf05n02 network[2230]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:03:04 kjcf05n02 network[2161]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 0 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 1 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 2 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 3 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 4 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 5 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 6 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 7 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 8 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 9 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 10 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 11 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 12 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 13 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 14 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 15 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 16 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 17 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 18 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 19 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 20 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 21 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 22 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 23 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 24 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 25 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 26 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 27 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 28 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 29 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 30 Nov 3 15:03:04 kjcf05n02 cpupower[2258]: Setting cpu: 31 Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 15:03:04 kjcf05n02 beSetMlxConfig[2238]: ConnectX-3 multiport not detected Nov 3 15:03:04 kjcf05n02 dbus-daemon[2203]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[2239]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 15:03:04 kjcf05n02 network[2252]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[2256]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 15:03:04 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 15:03:04 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 15:03:04 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 15:03:04 kjcf05n02 mdraid-phy[2260]: no Cutlass to worry about Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[2274]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[2282]: No configuration found for ib0 Nov 3 15:03:04 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 0 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 1 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 2 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 3 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 4 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 5 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 6 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 7 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 8 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 9 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 10 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 11 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 12 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 13 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 14 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 15 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 16 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 17 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 18 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 19 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 20 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 21 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 22 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 23 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 24 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 25 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 26 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 27 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 28 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 29 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 30 Nov 3 15:03:04 kjcf05n02 cpupower[2306]: Idlestate 2 disabled on CPU 31 Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[2292]: No configuration found for ib1 Nov 3 15:03:04 kjcf05n02 beSetMlxConfig[2238]: Starting MST (Mellanox Software Tools) driver set Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[2302]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[2317]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 15:03:04 kjcf05n02 beSetMlxConfig[2238]: Loading MST PCI module - Success Nov 3 15:03:04 kjcf05n02 mlnx_conf_mgr[2342]: INFO: No configurations found for mlx5_0, skipping. Nov 3 15:03:04 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 15:03:04 kjcf05n02 mlnx_conf_mgr[2364]: INFO: No configurations found for mlx5_1, skipping. Nov 3 15:03:04 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 15:03:04 kjcf05n02 beSetMlxConfig[2238]: Loading MST PCI configuration module - Success Nov 3 15:03:04 kjcf05n02 beSetMlxConfig[2238]: Create devices Nov 3 15:03:04 kjcf05n02 sssd[sssd][2257]: Starting up Nov 3 15:03:04 kjcf05n02 sssd[be[implicit_files]][2433]: Starting up Nov 3 15:03:04 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 15:03:04 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 15:03:04 kjcf05n02 sssd[nss][2531]: Starting up Nov 3 15:03:04 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 15:03:04 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Login Service... Nov 3 15:03:04 kjcf05n02 systemd-logind[2666]: New seat seat0. Nov 3 15:03:04 kjcf05n02 systemd-logind[2666]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Login Service. Nov 3 15:03:04 kjcf05n02 systemd-sysctl[2776]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 15:03:04 kjcf05n02 systemd-sysctl[2776]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 15:03:04 kjcf05n02 python3.9[2266]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 15:03:04 kjcf05n02 python3.9[3187]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 15:03:04 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 15:03:04 kjcf05n02 network[2161]: Bringing up loopback interface: [ OK ] Nov 3 15:03:04 kjcf05n02 systemd-sysctl[3117]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 15:03:04 kjcf05n02 systemd-sysctl[3117]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 15:03:04 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 3 15:03:04 kjcf05n02 systemd[1]: Reached target Network. Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 15:03:04 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 3 15:03:04 kjcf05n02 python3.9[3061]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 15:03:04 kjcf05n02 python3.9[3187]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:04 kjcf05n02 sm-notify[3184]: Version 2.3.3 starting Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 15:03:04 kjcf05n02 sshd[3171]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 15:03:04 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 15:03:04 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 3 15:03:04 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 15:03:04 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 3 15:03:04 kjcf05n02 lldpad[3162]: setsockopt nearest_bridge: Invalid argument Nov 3 15:03:04 kjcf05n02 lldpad[3187]: Last message 'setsockopt nearest_b' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 3 15:03:04 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 15:03:04 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 15:03:04 kjcf05n02 beSetMlxConfig[2238]: Unloading MST PCI module (unused) - Success Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 15:03:04 kjcf05n02 syslog-ng[3187]: [2024-11-03T21:01:46.411886] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 15:03:04 kjcf05n02 syslog-ng[3187]: [2024-11-03T21:01:46.412192] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 15:03:04 kjcf05n02 syslog-ng[3187]: [2024-11-03T21:01:46.412228] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 15:03:04 kjcf05n02 syslog-ng[3187]: [2024-11-03T21:01:46.412772] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 15:03:04 kjcf05n02 syslog-ng[3187]: [2024-11-03T21:01:46.412964] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 15:03:04 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 3 15:03:04 kjcf05n02 python3.9[3219]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 15:03:04 kjcf05n02 python3.9[3187]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 15:03:04 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 15:03:04 kjcf05n02 python3.9[3431]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 15:03:04 kjcf05n02 python3.9[3187]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 15:03:04 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 15:03:04 kjcf05n02 python3.9[3434]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 15:03:04 kjcf05n02 python3.9[3187]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 15:03:04 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 15:03:04 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 15:03:04 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 15:03:04 kjcf05n02 chronyd[2146]: System's initial offset : 0.002155 seconds slow of true (slew) Nov 3 15:03:04 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 15:03:04 kjcf05n02 beSetMlxConfig[2238]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 15:03:04 kjcf05n02 beSetMlxConfig[2238]: ib mode Nov 3 15:03:04 kjcf05n02 beSetMlxConfig[2238]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 15:03:04 kjcf05n02 root[3457]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 3 15:03:04 kjcf05n02 root[3459]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 3 15:03:04 kjcf05n02 beSetMlxConfig[2238]: ib mode Nov 3 15:03:04 kjcf05n02 systemd-udevd[1563]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 15:03:04 kjcf05n02 systemd-udevd[3472]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:03:04 kjcf05n02 systemd-udevd[3473]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:03:04 kjcf05n02 systemd-udevd[3476]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:03:04 kjcf05n02 systemd-udevd[3479]: Using default interface naming scheme 'rhel-8.0'. Nov 3 15:03:04 kjcf05n02 systemd-udevd[3479]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:03:04 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 15:03:04 kjcf05n02 systemd[3187]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:04 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[3514]: Setting up Mellanox network interface: ib1 Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[3515]: Setting up Mellanox network interface: ib0 Nov 3 15:03:04 kjcf05n02 systemd-udevd[3475]: Using default interface naming scheme 'rhel-8.0'. Nov 3 15:03:04 kjcf05n02 systemd-udevd[3474]: Using default interface naming scheme 'rhel-8.0'. Nov 3 15:03:04 kjcf05n02 systemd-udevd[3475]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:03:04 kjcf05n02 systemd-udevd[3474]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[3564]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[3565]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[3595]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[3596]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[3598]: No configuration found for ib1 Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[3597]: No configuration found for ib0 Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[3605]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[3606]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 15:03:04 kjcf05n02 mlnx_conf_mgr[3645]: INFO: No configurations found for mlx5_0, skipping. Nov 3 15:03:04 kjcf05n02 mlnx_conf_mgr[3646]: INFO: No configurations found for mlx5_1, skipping. Nov 3 15:03:04 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 15:03:04 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 15:03:04 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 3 15:03:04 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 3 15:03:04 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 15:03:04 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 3 15:03:04 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 3 15:03:04 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 15:03:04 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 15:03:04 kjcf05n02 lldpad[3162]: init_ports: Error adding device ib0 Nov 3 15:03:04 kjcf05n02 lldpad[3162]: init_ports: Error adding device ib1 Nov 3 15:03:04 kjcf05n02 lldpad[3162]: Signal 15 received - terminating Nov 3 15:03:04 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 3 15:03:04 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 15:03:04 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 15:03:04 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 3 15:03:04 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 15:03:04 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 3 15:03:04 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 3 15:03:04 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:04 kjcf05n02 systemd[3187]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:04 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 1 | Nov-03-2024 | 20:32:13 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 2 | Nov-03-2024 | 20:33:05 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 3 | Nov-03-2024 | 20:33:05 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 4 | Nov-03-2024 | 20:34:10 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 5 | Nov-03-2024 | 20:34:11 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 6 | Nov-03-2024 | 20:59:08 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 7 | Nov-03-2024 | 20:59:08 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 8 | Nov-03-2024 | 20:59:08 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 9 | Nov-03-2024 | 20:59:08 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 10 | Nov-03-2024 | 20:59:08 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 11 | Nov-03-2024 | 20:59:08 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 12 | Nov-03-2024 | 20:59:08 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 13 | Nov-03-2024 | 20:59:08 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 14 | Nov-03-2024 | 20:59:08 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 15 | Nov-03-2024 | 20:59:08 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 16 | Nov-03-2024 | 20:59:08 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 17 | Nov-03-2024 | 20:59:08 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 18 | Nov-03-2024 | 20:59:39 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 19 | Nov-03-2024 | 20:59:39 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 20 | Nov-03-2024 | 20:59:39 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 21 | Nov-03-2024 | 20:59:39 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 22 | Nov-03-2024 | 20:59:39 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 23 | Nov-03-2024 | 20:59:39 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 24 | Nov-03-2024 | 20:59:39 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 25 | Nov-03-2024 | 20:59:39 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 26 | Nov-03-2024 | 20:59:39 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 27 | Nov-03-2024 | 20:59:39 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 28 | Nov-03-2024 | 20:59:39 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 15:03:04 kjcf05n02 ipmievd[3995]: 29 | Nov-03-2024 | 20:59:39 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 15:03:04 kjcf05n02 ipmievd[3998]: Reading sensors... Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 3 15:03:04 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:04 kjcf05n02 systemd[3187]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 15:03:04 kjcf05n02 nscd[2231]: 2231 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 15:03:04 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 15:03:04 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 3 15:03:04 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 15:03:04 kjcf05n02 beSetMlxConfig[4054]: ConnectX-3 multiport not detected Nov 3 15:03:04 kjcf05n02 beSetMlxConfig[4054]: Starting MST (Mellanox Software Tools) driver set Nov 3 15:03:04 kjcf05n02 beSetMlxConfig[4054]: Loading MST PCI module - Success Nov 3 15:03:04 kjcf05n02 systemd-udevd[1563]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 15:03:04 kjcf05n02 beSetMlxConfig[4054]: [warn] mst_pciconf is already loaded, skipping Nov 3 15:03:04 kjcf05n02 beSetMlxConfig[4054]: Create devices Nov 3 15:03:04 kjcf05n02 beSetMlxConfig[4054]: Unloading MST PCI module (unused) - Success Nov 3 15:03:04 kjcf05n02 ipmievd[3998]: Waiting for events... Nov 3 15:03:04 kjcf05n02 beSetMlxConfig[4054]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 15:03:04 kjcf05n02 beSetMlxConfig[4054]: ib mode Nov 3 15:03:04 kjcf05n02 beSetMlxConfig[4054]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 15:03:04 kjcf05n02 beSetMlxConfig[4054]: ib mode Nov 3 15:03:04 kjcf05n02 systemd-udevd[1563]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 15:03:04 kjcf05n02 systemd-udevd[4955]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:03:04 kjcf05n02 systemd-udevd[4956]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:03:04 kjcf05n02 systemd-udevd[4959]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:03:04 kjcf05n02 systemd-udevd[4960]: Using default interface naming scheme 'rhel-8.0'. Nov 3 15:03:04 kjcf05n02 systemd-udevd[4960]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:03:04 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 15:03:04 kjcf05n02 systemd[3187]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:04 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[4997]: Setting up Mellanox network interface: ib1 Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[4998]: Setting up Mellanox network interface: ib0 Nov 3 15:03:04 kjcf05n02 systemd-udevd[4957]: Using default interface naming scheme 'rhel-8.0'. Nov 3 15:03:04 kjcf05n02 systemd-udevd[4958]: Using default interface naming scheme 'rhel-8.0'. Nov 3 15:03:04 kjcf05n02 systemd-udevd[4957]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:03:04 kjcf05n02 systemd-udevd[4958]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[5048]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[5047]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[5078]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[5079]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[5081]: No configuration found for ib0 Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[5082]: No configuration found for ib1 Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[5089]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 15:03:04 kjcf05n02 mlnx_interface_mgr[5090]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 15:03:04 kjcf05n02 mlnx_conf_mgr[5129]: INFO: No configurations found for mlx5_0, skipping. Nov 3 15:03:04 kjcf05n02 mlnx_conf_mgr[5130]: INFO: No configurations found for mlx5_1, skipping. Nov 3 15:03:04 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 15:03:04 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}e462a3f4ae0ae34e161614891fffda5de219a82d6f8b4b1d260a1accee3f76c7' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}e462a3f4ae0ae34e161614891fffda5de219a82d6f8b4b1d260a1accee3f76c7' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}8539f6ec69c0218208a099b06ec48c7f036794ff493e98f1ab7dc4e12a0a7999' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}8539f6ec69c0218208a099b06ec48c7f036794ff493e98f1ab7dc4e12a0a7999' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}9ea1fa9a0fb48829e11fdae57043c6506a359493224cca2ed1d219aba0da7c75' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}9ea1fa9a0fb48829e11fdae57043c6506a359493224cca2ed1d219aba0da7c75' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}63ed7a5be9a0a24b56f6c93b19e33363623a09baf0fa00b2d9c0e1390942b74e' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}63ed7a5be9a0a24b56f6c93b19e33363623a09baf0fa00b2d9c0e1390942b74e' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 15:03:04 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 3 15:03:04 kjcf05n02 chronyd[2146]: chronyd exiting Nov 3 15:03:04 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 3 15:03:04 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 15:03:04 kjcf05n02 chronyd[5168]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 15:03:04 kjcf05n02 chronyd[5168]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 15:03:04 kjcf05n02 chronyd[5168]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 15:03:04 kjcf05n02 chronyd[5168]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 15:03:04 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 15:03:04 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:04 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 15:03:04 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 3 15:03:04 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 15:03:04 kjcf05n02 dwd[5199]: dwd: vMay 29 2024 : 15:38:26 Nov 3 15:03:04 kjcf05n02 dwd[5199]: /usr/sbin/dwd -i 15 -d Nov 3 15:03:04 kjcf05n02 dwd[5199]: dwd: option Lethal: 0 Nov 3 15:03:04 kjcf05n02 dwd[5199]: dwd: option Interval: 15 Nov 3 15:03:04 kjcf05n02 dwd[5199]: dwd: option abrtlimit: 10 Nov 3 15:03:04 kjcf05n02 dwd[5199]: dwd: option DZPeriod: 604800 Nov 3 15:03:04 kjcf05n02 dwd[5199]: dwd: option SmartPeriod: 43200 Nov 3 15:03:04 kjcf05n02 dwd[5199]: dwd: option SDDEnabled: 1 Nov 3 15:03:04 kjcf05n02 dwd[5199]: dwd: option SDDAwaitScale: 3 Nov 3 15:03:04 kjcf05n02 dwd[5199]: dwd: option SDDAwaitMin: 100 Nov 3 15:03:04 kjcf05n02 dwd[5199]: dwd: option Verbosity: 1 Nov 3 15:03:04 kjcf05n02 dwd[5199]: dwd: option StandAlone: 0 Nov 3 15:03:04 kjcf05n02 dwd[5199]: option Lethal: 0 Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 15:03:04 kjcf05n02 dwd[5199]: option Interval: 15 Nov 3 15:03:04 kjcf05n02 dwd[5199]: option abrtlimit: 10 Nov 3 15:03:04 kjcf05n02 dwd[5199]: option DZPeriod: 604800 Nov 3 15:03:04 kjcf05n02 dwd[5199]: option SmartPeriod: 43200 Nov 3 15:03:04 kjcf05n02 dwd[5199]: option SDDEnabled: 1 Nov 3 15:03:04 kjcf05n02 dwd[5199]: option SDDAwaitScale: 3 Nov 3 15:03:04 kjcf05n02 dwd[5199]: option SDDAwaitMin: 100 Nov 3 15:03:04 kjcf05n02 dwd[5199]: option Verbosity: 1 Nov 3 15:03:04 kjcf05n02 dwd[5199]: option StandAlone: 0 Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 15:03:04 kjcf05n02 dwd[5201]: option Lethal now set to 1 Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 15:03:04 kjcf05n02 dwd[5201]: option abrtlimit now set to 1 Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 15:03:04 kjcf05n02 dwd[5201]: option SmartPeriod now set to 86400 Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 15:03:04 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 15:03:04 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:04 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:04 kjcf05n02 python3.9[5230]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 15:03:04 kjcf05n02 python3.9[3187]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 15:03:04 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:04 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 15:03:04 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:04 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 3 15:03:04 kjcf05n02 sedcpwrkr[5367]: Using config script: /etc/sedcpwrkr.conf Nov 3 15:03:04 kjcf05n02 sedcpwrkr[5367]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 15:03:04 kjcf05n02 sedcpwrkr[5367]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 15:03:04 kjcf05n02 sedcpwrkr[5367]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 15:03:04 kjcf05n02 sedcpwrkr[5367]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 15:03:04 kjcf05n02 sedcpwrkr[5367]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 15:03:04 kjcf05n02 sedcpwrkr[5367]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 15:03:04 kjcf05n02 sedcpwrkr-server[5398]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 15:03:04 kjcf05n02 sedcpwrkr[5367]: celery multi v5.2.7 (dawn-chorus) Nov 3 15:03:04 kjcf05n02 sedcpwrkr[5367]: > Starting nodes... Nov 3 15:03:04 kjcf05n02 sedcpwrkr[5367]: > sedcpwrkr@kjcf05n02: OK Nov 3 15:03:04 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 15:03:04 kjcf05n02 sedcpwrkr-server[5400]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 15:03:04 kjcf05n02 sedcpwrkr-server[5400]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 15:03:04 kjcf05n02 sedcpwrkr-server[5400]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 15:03:04 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 15:03:04 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 3 15:03:04 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 15:03:04 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 15:03:04 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 15:03:04 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:04 kjcf05n00 cscli[1349583]: [csinfo_handler.py:90 - csinfo() ] [INFO] CSM:Observers : done! Nov 3 15:03:04 kjcf05n00 plex[12314]: IEC: info: 004001003: MRPD package collection completed: {"total_collectors": 14, "passed": 12, "failed": 2} Nov 3 15:03:04 kjcf05n00 plex[12314]: IEC: info: 004001005: MPRD package generation completed with errors Nov 3 15:03:05 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 15:03:05 kjcf05n02 systemd-udevd[1563]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 15:03:05 kjcf05n02 iptables.init[5467]: iptables: Applying firewall rules: [ OK ] Nov 3 15:03:05 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 3 15:03:05 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:05 kjcf05n02 systemd[3187]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:05 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:05 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:05 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 15:03:05 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 15:03:05 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 15:03:05 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 15:03:05 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 15:03:05 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 15:03:05 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 15:03:05 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 15:03:05 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 15:03:05 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 15:03:06 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:06 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 15:03:06 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5565 which is not our child. We'll most likely not notice when it exits. Nov 3 15:03:06 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 15:03:06 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:06 kjcf05n02 openhpid[5565]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 15:03:06 kjcf05n02 openhpid[5565]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 15:03:06 kjcf05n02 openhpid[5565]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 15:03:06 kjcf05n02 openhpid[5565]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 15:03:06 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 15:03:06 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 15:03:06 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 15:03:06 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:07 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 15:03:07 kjcf05n02 dcs-collectord[5656]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 15:03:07 kjcf05n02 hpi.inv.log[5656]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 15:03:07 kjcf05n02 dcs-collectord[5656]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 15:03:07 kjcf05n02 dcs-collectord[5656]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 15:03:07 kjcf05n02 dcs-collector[5647]: Starting dcs-collector:[ OK ] Nov 3 15:03:07 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 15:03:07 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 15:03:07 kjcf05n02 dcs-collectord[5659]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 15:03:07 kjcf05n02 dcs-collectord[5659]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 15:03:07 kjcf05n02 dcs-collectord[5659]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 15:03:07 kjcf05n02 dcs-collectord[5659]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 15:03:07 kjcf05n02 dcs-collectord[5659]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 15:03:07 kjcf05n02 dcs-collectord[5659]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 15:03:07 kjcf05n02 dcs-collectord[5659]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 15:03:07 kjcf05n02 dcs-collectord[5659]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259346188", "units": "kB"}, {"name": "MemAvailable", "value": "258625436", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1820912", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686704", "units": "kB"}, {"name": "Inactive", "value": "962228", "units": "kB"}, {"name": "Active(anon)", "value": "1520700", "units": "kB"}, {"name": "Inactive(anon)", "value": "826136", "units": "kB"}, {"name": "Active(file)", "value": "166004", "units": "kB"}, {"name": "Inactive(file)", "value": "136092", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "753404", "units": "kB"}, {"name": "Mapped", "value": "86184", "units": "kB"}, {"name": "Shmem", "value": "1593260", "units": "kB"}, {"name": "KReclaimable", "value": "108564", "units": "kB"}, {"name": "Slab", "value": "274296", "units": "kB"}, {"name": "SReclaimable", "value": "108564", "units": "kB"}, {"name": "SUnreclaim", "value": "165732", "units": "kB"}, {"name": "KernelStack", "value": "9712", "units": "kB"}, {"name": "PageTables", "value": "19536", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3357948", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11136", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "2048", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "293192", "units": "kB"}, {"name": "DirectMap2M", "value": "22640640", "units": "kB"}, {"name": "DirectMap1G", "value": "245366784", "units": "kB"}]}' Nov 3 15:03:07 kjcf05n02 dcs-collectord[5659]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 15:03:07 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:08 kjcf05n02 systemd[3187]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:08 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:08 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:08 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 15:03:08 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 15:03:08 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 15:03:08 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 15:03:08 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:08 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 15:03:08 kjcf05n02 firmware-update-orc[5740]: Using config script: /etc/firmware_update_orc.conf Nov 3 15:03:08 kjcf05n02 firmware-update-orc[5740]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 15:03:08 kjcf05n02 firmware-update-orc[5740]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 15:03:08 kjcf05n02 firmware-update-orc[5740]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 15:03:08 kjcf05n02 firmware-update-orc[5740]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 15:03:08 kjcf05n02 firmware-update-orc[5740]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 15:03:08 kjcf05n02 firmware-update-orc[5740]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 15:03:09 kjcf05n02 dcs-collectord[5659]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 15:03:09 kjcf05n02 dcs-collectord[5659]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730667787.635787], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730667788.8044713], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730667787.5668385, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 15:03:09 kjcf05n02 firmware-update-orc-server[5776]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 15:03:09 kjcf05n02 firmware-update-orc[5740]: celery multi v5.2.7 (dawn-chorus) Nov 3 15:03:09 kjcf05n02 firmware-update-orc[5740]: > Starting nodes... Nov 3 15:03:09 kjcf05n02 firmware-update-orc[5740]: > worker1@kjcf05n02: OK Nov 3 15:03:09 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 15:03:09 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 15:03:09 kjcf05n02 firmware-update-orc-server[5805]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 15:03:09 kjcf05n02 firmware-update-orc-server[5805]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 15:03:09 kjcf05n02 firmware-update-orc-server[5805]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 15:03:09 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 15:03:09 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:09 kjcf05n02 systemd[3187]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:09 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:09 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:09 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 15:03:09 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 15:03:09 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 15:03:09 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 15:03:09 kjcf05n02 dbus-daemon[2203]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 15:03:09 kjcf05n02 dbus-daemon[2203]: [system] Reloaded configuration Nov 3 15:03:09 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 15:03:09 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 15:03:09 kjcf05n02 dbus-daemon[2203]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 15:03:09 kjcf05n02 dbus-daemon[2203]: [system] Reloaded configuration Nov 3 15:03:09 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 15:03:09 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 15:03:09 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 15:03:09 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 15:03:09 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:09 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 3 15:03:10 kjcf05n02 ras-resource-manager-agent[5921]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 15:03:10 kjcf05n02 ras-resource-manager-agent[5907]: Starting ras-resource-manager-agent:[ OK ] Nov 3 15:03:10 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 15:03:10 kjcf05n02 ras-resource-manager-agent[5923]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 15:03:10 kjcf05n02 ras-resource-manager-client[5923]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 15:03:10 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 3 15:03:10 kjcf05n02 ras-resource-manager-client[5923]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 15:03:10 kjcf05n02 ras-resource-manager-client[5933]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 15:03:10 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:11 kjcf05n02 systemd[3187]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:11 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:11 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:11 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 15:03:11 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 15:03:11 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:11 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 15:03:11 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:11 kjcf05n02 systemd[3187]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: Press Ctrl+C to exit. Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: Plugin support version 1.0 Nov 3 15:03:11 kjcf05n02 zabbix_agent2[6007]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 15:03:11 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:11 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:11 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:11 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 15:03:12 kjcf05n02 dcs-notification-sender[6084]: dcs-notification-senderd is stopped Nov 3 15:03:12 kjcf05n02 zabbix-agent2[6098]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 15:03:12 kjcf05n02 dcs-notification-sender[6084]: Starting notification-sender:[ OK ] Nov 3 15:03:12 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 15:03:12 kjcf05n02 zabbix-agent2[6100]: INFO DCS notification agent started. (agent.py:61) Nov 3 15:03:12 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 15:03:12 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:12 kjcf05n02 systemd[3187]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:12 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:12 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:13 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:13 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 15:03:13 kjcf05n02 dcs-collectord[6209]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 15:03:13 kjcf05n02 dcs-collectord[6209]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 15:03:13 kjcf05n02 dcs-bulk-data-sender[6209]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 15:03:13 kjcf05n02 dcs-bulk-data-sender[6200]: Starting bulk-data-sender:[ OK ] Nov 3 15:03:13 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 15:03:13 kjcf05n02 dcs-collectord[6211]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 15:03:13 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 15:03:13 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:13 kjcf05n02 systemd[3187]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:13 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:13 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:13 kjcf05n02 nscd[2231]: 2231 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 15:03:13 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 15:03:13 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 15:03:13 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 15:03:13 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 15:03:13 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 15:03:13 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 15:03:13 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 15:03:13 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 15:03:13 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 15:03:13 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 15:03:13 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 15:03:13 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 15:03:13 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 15:03:13 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 15:03:14 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 15:03:14 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 15:03:14 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 15:03:14 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 15:03:14 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 15:03:14 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 15:03:14 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 3 15:03:14 kjcf05n02 sssd[nss][2531]: Shutting down (status = 0) Nov 3 15:03:14 kjcf05n02 sssd[be[implicit_files]][2433]: Shutting down (status = 0) Nov 3 15:03:14 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 3 15:03:14 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 3 15:03:14 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 15:03:14 kjcf05n00 mcfcli[3673891]: %3|1730667794.664|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:03:15 kjcf05n02 sssd[sssd][6275]: Starting up Nov 3 15:03:15 kjcf05n02 python3.9[5230]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 15:03:15 kjcf05n02 python3.9[3187]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:15 kjcf05n02 sssd[be[implicit_files]][6276]: Starting up Nov 3 15:03:15 kjcf05n02 sssd[nss][6277]: Starting up Nov 3 15:03:15 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 15:03:15 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 15:03:15 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 15:03:16 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 15:03:16 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 15:03:16 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 15:03:16 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 15:03:16 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 15:03:16 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 15:03:16 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 15:03:16 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 15:03:16 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 15:03:16 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 15:03:16 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 15:03:16 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 15:03:16 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 15:03:16 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 15:03:16 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:03:16 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:03:16 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:16 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 15:03:17 kjcf05n02 icinga2[6337]: [2024-11-03 15:03:16 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 15:03:17 kjcf05n02 icinga2[6337]: [2024-11-03 15:03:16 -0600] information/cli: Loading configuration file(s). Nov 3 15:03:17 kjcf05n02 icinga2[6337]: [2024-11-03 15:03:16 -0600] information/ConfigItem: Committing config item(s). Nov 3 15:03:17 kjcf05n02 icinga2[6337]: [2024-11-03 15:03:16 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 3 15:03:17 kjcf05n02 icinga2[6337]: [2024-11-03 15:03:16 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 15:03:17 kjcf05n02 icinga2[6337]: [2024-11-03 15:03:16 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 15:03:17 kjcf05n02 icinga2[6337]: [2024-11-03 15:03:16 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 15:03:17 kjcf05n02 icinga2[6337]: [2024-11-03 15:03:16 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 15:03:17 kjcf05n02 icinga2[6337]: [2024-11-03 15:03:16 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 15:03:17 kjcf05n02 icinga2[6337]: [2024-11-03 15:03:16 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 15:03:17 kjcf05n02 icinga2[6337]: [2024-11-03 15:03:16 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 15:03:17 kjcf05n02 icinga2[6337]: [2024-11-03 15:03:16 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 15:03:17 kjcf05n02 icinga2[6337]: [2024-11-03 15:03:16 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 15:03:17 kjcf05n02 icinga2[6337]: [2024-11-03 15:03:16 -0600] information/cli: Closing console log. Nov 3 15:03:17 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 15:03:17 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:17 kjcf05n02 systemd[3187]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:17 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:17 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:18 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 15:03:18 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 15:03:18 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:18 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 3 15:03:18 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:18 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 15:03:18 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:18 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:19 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 15:03:19 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 15:03:19 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 15:03:19 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 15:03:19 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 15:03:19 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 15:03:19 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 15:03:19 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 15:03:19 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 15:03:19 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 15:03:19 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 15:03:19 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 15:03:19 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 15:03:19 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 15:03:19 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:19 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 15:03:19 kjcf05n02 nslcd[6949]: version 0.9.9 starting Nov 3 15:03:19 kjcf05n02 nslcd[6949]: accepting connections Nov 3 15:03:19 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 15:03:19 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:20 kjcf05n02 systemd[3187]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:20 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:20 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:20 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 15:03:20 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 15:03:20 kjcf05n02 dcs-bulk-data-sender[6211]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 15:03:20 kjcf05n02 dcs-collectord[6211]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 15:03:20 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 15:03:20 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 15:03:20 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 15:03:20 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 15:03:21 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 15:03:21 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 15:03:21 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:21 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 15:03:21 kjcf05n02 dearcpw[7056]: Using config script: /etc/dearcpw.conf Nov 3 15:03:21 kjcf05n02 dearcpw[7056]: - Creating default directory: '/var/log/dearcpw' Nov 3 15:03:21 kjcf05n02 dearcpw[7056]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 15:03:21 kjcf05n02 dearcpw[7056]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 15:03:21 kjcf05n02 dearcpw[7056]: - Creating default directory: '/var/run/dearcpw' Nov 3 15:03:21 kjcf05n02 dearcpw[7056]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 15:03:21 kjcf05n02 dearcpw[7056]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 15:03:22 kjcf05n02 dearcpw-server[7096]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 15:03:22 kjcf05n02 dearcpw[7056]: celery multi v5.2.7 (dawn-chorus) Nov 3 15:03:22 kjcf05n02 dearcpw[7056]: > Starting nodes... Nov 3 15:03:22 kjcf05n02 dearcpw[7056]: > dearcpw@kjcf05n02: OK Nov 3 15:03:22 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 15:03:22 kjcf05n02 dearcpw-server[7098]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 15:03:22 kjcf05n02 dearcpw-server[7098]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 15:03:22 kjcf05n02 dearcpw-server[7098]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 15:03:22 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 3 15:03:22 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:22 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:22 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 15:03:22 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 15:03:22 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 15:03:22 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 15:03:22 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 15:03:22 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 15:03:22 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 15:03:22 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 15:03:22 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 15:03:22 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 15:03:22 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:47140). Nov 3 15:03:22 kjcf05n01 rsyncd[3153059]: connect from kjcf05n02 (172.16.2.5) Nov 3 15:03:22 kjcf05n01 rsyncd[3153059]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 15:03:22 kjcf05n01 rsyncd[3153059]: receiving file list Nov 3 15:03:22 kjcf05n01 rsyncd[3153059]: sent 29 bytes received 325 bytes total size 10905 Nov 3 15:03:22 kjcf05n01 systemd[1]: rsyncd@638-172.16.2.2:873-172.16.2.5:47140.service: Succeeded. Nov 3 15:03:22 kjcf05n02 puppet[7142]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 3 15:03:22 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 15:03:22 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 15:03:22 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 15:03:22 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 15:03:22 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 15:03:22 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 15:03:22 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 15:03:22 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 15:03:23 kjcf05n02 dcs-collectord[5659]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 15:03:23 kjcf05n02 dcs-collectord[5659]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 15:03:23 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 15:03:23 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 15:03:23 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 15:03:23 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 15:03:23 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 15:03:23 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 15:03:24 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 15:03:24 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 15:03:24 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 15:03:24 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 15:03:25 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 15:03:25 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 15:03:25 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 15:03:25 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 15:03:25 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 15:03:25 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 15:03:25 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:25 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 15:03:26 kjcf05n02 diskless-swap[7366]: HA_PS_000: recovering journal Nov 3 15:03:26 kjcf05n02 systemd-udevd[1563]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 15:03:26 kjcf05n02 diskless-swap[7366]: HA_PS_000: clean, 2284/6400 files, 7076/25600 blocks Nov 3 15:03:26 kjcf05n02 diskless-swap[7366]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 15:03:26 kjcf05n02 diskless-swap[7366]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 15:03:26 kjcf05n02 diskless-swap[7366]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 15:03:26 kjcf05n02 diskless-swap[7366]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 15:03:26 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 15:03:26 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:26 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:26 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 15:03:26 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 15:03:26 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 15:03:26 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 15:03:26 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 3 15:03:26 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 3 15:03:26 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 3 15:03:26 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 3 15:03:26 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 3 15:03:26 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 15:03:26 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 15:03:26 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 15:03:26 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 15:03:26 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 15:03:26 kjcf05n02 ipmievd[3998]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 15:03:26 kjcf05n02 ipmievd[3998]: System Event sensor - Timestamp Clock Sync Nov 3 15:03:26 kjcf05n00 mcfcli[3673891]: %3|1730667806.402|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:03:26 kjcf05n02 ipmievd[3187]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:26 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 15:03:26 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 15:03:27 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 15:03:27 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 15:03:27 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 15:03:27 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 15:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T15:03:27.253380617-06:00 level=info msg="Completed cleanup jobs" duration=26.232309ms Nov 3 15:03:28 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 15:03:28 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 15:03:28 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 15:03:28 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 15:03:28 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 15:03:28 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 15:03:28 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 15:03:28 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 15:03:29 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 15:03:29 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 15:03:29 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 15:03:29 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 15:03:29 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:29 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 3 15:03:29 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:29 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:29 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 15:03:29 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 15:03:29 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:30 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 3 15:03:30 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:30 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:30 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 15:03:30 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 15:03:30 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:30 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 3 15:03:30 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:30 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:30 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 15:03:30 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 15:03:30 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 15:03:30 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 15:03:30 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 15:03:30 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 15:03:30 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 15:03:30 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 15:03:30 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 15:03:30 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 15:03:30 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:31 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: kdump: No kdump initial ramdisk found. Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 15:03:31 kjcf05n02 dracut[7979]: dracut-049-135.git20210121.el8 Nov 3 15:03:31 kjcf05n02 dracut[7981]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 15:03:31 kjcf05n02 dracut[7981]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 15:03:31 kjcf05n02 dracut[7981]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 15:03:31 kjcf05n02 dracut[7981]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 15:03:31 kjcf05n02 dracut[7981]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 15:03:31 kjcf05n02 dracut[7981]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 15:03:31 kjcf05n02 dracut[7981]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 15:03:31 kjcf05n02 dracut[7981]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + is_func check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ type -t check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 0 -ne 0 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check -h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local dev holder Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + require_binaries mdadm expr Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _module_name=90hperaid Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ mdadm = \-\m ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for cmd in "$@" Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + find_binary mdadm Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for cmd in "$@" Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + find_binary expr Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n -h ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for dev in "${!host_fs_types[@]}" Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ nfs != *_raid_member ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + continue Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _ret=255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + ret=255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ 255 = 0 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ 255 = 255 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ module_depends hperaid Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: +++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: +++ set -x Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ depends Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo rootfs-block Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ return 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ _ret=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ return 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for _moddep in $(module_depends $_mod) Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all == *\ hperaid\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + add_dracutmodules+=' rootfs-block ' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ == *\ hperaid\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check_module rootfs-block Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _mod=rootfs-block Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddep Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ == *\ rootfs-block\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n '' ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all == *\ rootfs-block\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + module_check rootfs-block 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _forced=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 2 -eq 2 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _forced=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + is_func check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ type -t check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 0 -ne 0 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check -h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _ret=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + ret=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ 0 = 0 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ module_depends rootfs-block Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: +++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 15:03:31 kjcf05n02 kdumpctl[3187]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ depends Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo fs-lib Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ _ret=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ return 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for _moddep in $(module_depends $_mod) Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all == *\ rootfs-block\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + add_dracutmodules+=' fs-lib ' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ == *\ rootfs-block\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check_module fs-lib Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _mod=fs-lib Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddep Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n '' ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + mods_checked_as_dep+=' fs-lib ' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all == *\ fs-lib\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + module_check fs-lib 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _forced=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 2 -eq 2 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _forced=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + is_func check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ type -t check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 0 -ne 0 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check -h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _ret=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + ret=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ 0 = 0 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ module_depends fs-lib Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: +++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ depends Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ return 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ _ret=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ return 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + mods_to_load+=' fs-lib ' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + mods_to_load+=' rootfs-block ' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + mods_to_load+=' hperaid ' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _mod=90kernel-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _mod=kernel-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check_module kernel-modules 1 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _mod=kernel-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddep Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n 1 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all = all ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + module_check kernel-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _forced=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 1 -eq 2 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + is_func check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ type -t check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 0 -ne 0 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check -h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + true Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _ret=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + ret=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ 0 != 0 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ module_depends kernel-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: +++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ depends Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ true Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ _ret=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ return 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + mods_to_load+=' kernel-modules ' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _mod=90kernel-modules-extra Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _mod=kernel-modules-extra Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check_module kernel-modules-extra 1 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _mod=kernel-modules-extra Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddep Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n 1 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all = all ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + module_check kernel-modules-extra Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _forced=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 1 -eq 2 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + is_func check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ type -t check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 0 -ne 0 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check -h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + true Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _ret=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + ret=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ 0 != 0 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ module_depends kernel-modules-extra Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: +++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ depends Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ true Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ _ret=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ return 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + mods_to_load+=' kernel-modules-extra ' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _mod=90kernel-network-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _mod=kernel-network-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check_module kernel-network-modules 1 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _mod=kernel-network-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddep Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n 1 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all = all ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + module_check kernel-network-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _forced=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 1 -eq 2 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + is_func check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ type -t check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 0 -ne 0 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check -h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _ret=255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + ret=255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ 255 != 0 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n 1 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 1 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _mod=90livenet Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _mod=livenet Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check_module livenet 1 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _mod=livenet Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddep Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n 1 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all = all ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + module_check livenet Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _forced=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 1 -eq 2 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + is_func check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ type -t check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 0 -ne 0 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check -h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _ret=255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + ret=255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ 255 != 0 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n 1 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 1 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _mod=90lvm Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _mod=lvm Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check_module lvm 1 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _mod=lvm Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddep Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n 1 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all = all ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + module_check lvm Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _forced=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 1 -eq 2 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + is_func check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ type -t check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 0 -ne 0 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check -h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + require_binaries lvm Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _module_name=90lvm Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ lvm = \-\m ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for cmd in "$@" Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + find_binary lvm Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n -h ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for fs in "${host_fs_types[@]}" Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ nfs = LVM*_member ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _ret=255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + ret=255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ 255 != 0 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n 1 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 1 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _mod=90mdraid Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _mod=mdraid Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check_module mdraid 1 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _mod=mdraid Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddep Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n 1 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all = all ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + module_check mdraid Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _forced=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 1 -eq 2 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + is_func check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ type -t check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 0 -ne 0 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check -h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _rootdev Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + require_binaries mdadm expr Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _module_name=90mdraid Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ mdadm = \-\m ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for cmd in "$@" Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + find_binary mdadm Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for cmd in "$@" Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + find_binary expr Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n -h ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for dev in "${!host_fs_types[@]}" Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ nfs != *_raid_member ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + continue Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _ret=255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + ret=255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ 255 != 0 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n 1 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 1 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _mod=90multipath Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _mod=multipath Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check_module multipath 1 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _mod=multipath Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddep Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n 1 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all = all ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + module_check multipath Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _forced=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 1 -eq 2 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + is_func check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ type -t check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 0 -ne 0 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check -h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _rootdev Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n -h ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for_each_host_dev_and_slaves is_mpath Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _func=is_mpath Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _dev Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for _dev in "${host_devs[@]}" Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + continue Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 1 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _ret=255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + ret=255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ 255 != 0 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n 1 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 1 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _mod=90qemu Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _mod=qemu Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check_module qemu 1 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _mod=qemu Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddep Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n 1 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all = all ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + module_check qemu Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _forced=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 1 -eq 2 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + is_func check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ type -t check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 0 -ne 0 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check -h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n -h ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + type -P systemd-detect-virt Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ systemd-detect-virt --vm Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + vm=none Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + (( 1 != 0 )) Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _ret=255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + ret=255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ 255 != 0 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n 1 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 1 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _mod=90qemu-net Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _mod=qemu-net Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check_module qemu-net 1 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _mod=qemu-net Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddep Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n 1 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all = all ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + module_check qemu-net Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _forced=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 1 -eq 2 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + is_func check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ type -t check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 0 -ne 0 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check -h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n -h ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + type -P systemd-detect-virt Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ systemd-detect-virt --vm Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + vm= Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + (( 1 != 0 )) Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _ret=255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + ret=255 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ 255 != 0 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n 1 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + return 1 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _mod=90stratis Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + _mod=stratis Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check_module stratis 1 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _mod=stratis Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddep Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -n 1 ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ all = all ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + module_check stratis Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ read a b Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _forced=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _hostonly=-h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 1 -eq 2 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + is_func check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: ++ type -t check Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + '[' 0 -ne 0 ']' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + check -h Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _module_name=90stratis Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + local _ret=0 Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + [[ stratisd-init = \-\m ]] Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + for cmd in "$@" Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + find_binary stratisd-init Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 15:03:31 kjcf05n02 kdumpctl[7854]: + set +x Nov 3 15:03:31 kjcf05n02 dracut[7981]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 15:03:31 kjcf05n02 dracut[7981]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 15:03:31 kjcf05n02 dracut[7981]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 15:03:31 kjcf05n02 dracut[7981]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 15:03:32 kjcf05n02 dracut[7981]: memstrack is available Nov 3 15:03:32 kjcf05n02 dracut[7981]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 15:03:32 kjcf05n02 dracut[7981]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 15:03:32 kjcf05n02 dracut[7981]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 15:03:32 kjcf05n02 dracut[7981]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 15:03:32 kjcf05n02 dracut[7981]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 15:03:32 kjcf05n02 dracut[7981]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 15:03:32 kjcf05n02 dracut[7981]: *** Including module: bash *** Nov 3 15:03:32 kjcf05n02 dracut[7981]: *** Including module: systemd *** Nov 3 15:03:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 15:03:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 15:03:33 kjcf05n02 dracut[7981]: *** Including module: fips *** Nov 3 15:03:33 kjcf05n02 dracut[7981]: *** Including module: systemd-initrd *** Nov 3 15:03:33 kjcf05n02 dracut[7981]: *** Including module: watchdog-modules *** Nov 3 15:03:33 kjcf05n02 dracut[7981]: *** Including module: nss-softokn *** Nov 3 15:03:33 kjcf05n02 dracut[7981]: *** Including module: i18n *** Nov 3 15:03:33 kjcf05n02 dracut[7981]: No KEYMAP configured. Nov 3 15:03:34 kjcf05n02 dracut[7981]: *** Including module: network-legacy *** Nov 3 15:03:34 kjcf05n02 dracut[7981]: *** Including module: network *** Nov 3 15:03:34 kjcf05n02 dracut[7981]: *** Including module: ib_bonding *** Nov 3 15:03:34 kjcf05n02 dracut[7981]: *** Including module: drm *** Nov 3 15:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730667816', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 15:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730667816'} Nov 3 15:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730667816', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 15:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730667816'} Nov 3 15:03:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:03:37 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 15:03:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 15:03:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 15:03:37 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 3 15:03:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 15:03:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 15:03:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 15:03:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 15:03:37 kjcf05n02 dracut[7981]: *** Including module: hperaid *** Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + install Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + local rule rule_path Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + inst_multiple cat expr Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.741XyL/initramfs -a -f cat expr Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + _ret=0 Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + (( 0 != 0 )) Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + : Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + return 0 Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + inst_multiple -o mdmon Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.741XyL/initramfs -a -f -o mdmon Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + _ret=0 Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + (( 0 != 0 )) Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + : Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + return 0 Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: ++ command -v partx Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + inst /usr/sbin/partx /sbin/partx Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + local _hostonly_install Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + [[ -e /tmp/dracut.741XyL/initramfs//sbin/partx ]] Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.741XyL/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + (( 0 != 0 )) Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + : Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: ++ command -v mdadm Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + local _hostonly_install Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + [[ -e /tmp/dracut.741XyL/initramfs//sbin/mdadm ]] Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.741XyL/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + (( 0 != 0 )) Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + : Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + [[ yes == \y\e\s ]] Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + local _raidconf Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: ++ cmdline Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: ++ local _activated dev line UUID Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: ++ declare -A _activated Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: ++ for dev in "${!host_fs_types[@]}" Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: ++ [[ nfs != *_raid_member ]] Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: ++ continue Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + _raidconf= Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + [[ -n '' ]] Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + inst_rules 64-md-raid.rules Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + local _target=/etc/udev/rules.d _rule _found Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + inst_dir /usr/lib/udev/rules.d Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + [[ -e /tmp/dracut.741XyL/initramfs//usr/lib/udev/rules.d ]] Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + return 0 Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + inst_dir /etc/udev/rules.d Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + [[ -e /tmp/dracut.741XyL/initramfs//etc/udev/rules.d ]] Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + return 0 Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + for _rule in "$@" Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + continue Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + continue Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + for r in '' $dracutbasedir/rules.d/ Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + [[ 64-md-raid.rules != /* ]] Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + continue Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + for r in '' $dracutbasedir/rules.d/ Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + continue Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + [[ -n '' ]] Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 15:03:37 kjcf05n02 kdumpctl[7854]: + set +x Nov 3 15:03:37 kjcf05n02 dracut[7981]: Skipping udev rule: 64-md-raid.rules Nov 3 15:03:37 kjcf05n02 dcs-collectord[5659]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 15:03:37 kjcf05n02 dcs-collectord[5659]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + installkernel Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + instmods =drivers/md Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + local _optional=-o Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + local _silent Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + local _ret Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + [[ '' = yes ]] Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + [[ =drivers/md = \-\c ]] Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + [[ =drivers/md = \-\s ]] Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + (( 1 == 0 )) Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.741XyL/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + _ret=0 Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + (( 0 != 0 )) Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + [[ -n '' ]] Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + return 0 Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + _ret=0 Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + unset check depends cmdline install installkernel Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + return 0 Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + modules_loaded+='hperaid ' Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + '[' -n '' ']' Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + _d_mod=90kernel-modules Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + _d_mod=kernel-modules Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + [[ '' = yes ]] Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + dinfo '*** Including module: kernel-modules ***' Nov 3 15:03:38 kjcf05n02 kdumpctl[7854]: + set +x Nov 3 15:03:38 kjcf05n02 dracut[7981]: *** Including module: kernel-modules *** Nov 3 15:03:38 kjcf05n02 dracut[7981]: *** Including module: kernel-modules-extra *** Nov 3 15:03:39 kjcf05n02 dracut[7981]: *** Including module: kernel-network-modules *** Nov 3 15:03:39 kjcf05n02 dracut[7981]: *** Including module: diskless-mod *** Nov 3 15:03:39 kjcf05n02 dracut[7981]: *** Including module: fstab-sys *** Nov 3 15:03:39 kjcf05n02 dracut[7981]: *** Including module: nfs *** Nov 3 15:03:39 kjcf05n02 dracut[7981]: *** Including module: rootfs-block *** Nov 3 15:03:39 kjcf05n02 dracut[7981]: *** Including module: terminfo *** Nov 3 15:03:39 kjcf05n02 dracut[7981]: *** Including module: udev-rules *** Nov 3 15:03:40 kjcf05n02 dracut[7981]: Skipping udev rule: 91-permissions.rules Nov 3 15:03:40 kjcf05n02 dracut[7981]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 15:03:40 kjcf05n02 dracut[7981]: *** Including module: dracut-systemd *** Nov 3 15:03:40 kjcf05n02 dracut[7981]: *** Including module: usrmount *** Nov 3 15:03:40 kjcf05n02 dracut[7981]: *** Including module: base *** Nov 3 15:03:40 kjcf05n02 dracut[7981]: *** Including module: fs-lib *** Nov 3 15:03:40 kjcf05n02 dracut[7981]: *** Including module: kdumpbase *** Nov 3 15:03:41 kjcf05n02 dracut[7981]: *** Including module: memstrack *** Nov 3 15:03:41 kjcf05n02 dracut[7981]: *** Including module: shutdown *** Nov 3 15:03:41 kjcf05n02 dracut[7981]: *** Including module: squash *** Nov 3 15:03:41 kjcf05n02 dracut[7981]: *** Including modules done *** Nov 3 15:03:41 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 3 15:03:41 kjcf05n02 dracut[7981]: *** Installing kernel module dependencies *** Nov 3 15:03:42 kjcf05n02 dracut[7981]: *** Installing kernel module dependencies done *** Nov 3 15:03:42 kjcf05n02 dracut[7981]: *** Resolving executable dependencies *** Nov 3 15:03:43 kjcf05n02 dracut[7981]: *** Resolving executable dependencies done*** Nov 3 15:03:43 kjcf05n02 dracut[7981]: *** Hardlinking files *** Nov 3 15:03:43 kjcf05n02 dracut[7981]: *** Hardlinking files done *** Nov 3 15:03:43 kjcf05n02 dracut[7981]: *** Generating early-microcode cpio image *** Nov 3 15:03:43 kjcf05n02 dracut[7981]: *** Constructing AuthenticAMD.bin **** Nov 3 15:03:43 kjcf05n02 dracut[7981]: *** Store current command line parameters *** Nov 3 15:03:43 kjcf05n02 dracut[7981]: Stored kernel commandline: Nov 3 15:03:43 kjcf05n02 dracut[7981]: rd.driver.pre=sd_mod Nov 3 15:03:43 kjcf05n02 dracut[7981]: rd.driver.pre=nvme Nov 3 15:03:43 kjcf05n02 dracut[7981]: rd.driver.pre=ipmi_si Nov 3 15:03:43 kjcf05n02 dracut[7981]: rd.driver.pre=ipmi_devintf Nov 3 15:03:43 kjcf05n02 dracut[7981]: rd.driver.pre=ipmi_msghandler Nov 3 15:03:43 kjcf05n02 dracut[7981]: nameserver=172.16.2.2 Nov 3 15:03:43 kjcf05n02 dracut[7981]: nameserver=127.0.0.1 Nov 3 15:03:43 kjcf05n02 dracut[7981]: nameserver=172.16.2.2 Nov 3 15:03:43 kjcf05n02 dracut[7981]: nameserver=127.0.0.1 Nov 3 15:03:43 kjcf05n02 dracut[7981]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 3 15:03:43 kjcf05n02 dracut[7981]: rd.neednet Nov 3 15:03:43 kjcf05n02 dracut[7981]: kdumpnic=mgmt0 Nov 3 15:03:43 kjcf05n02 dracut[7981]: bootdev=mgmt0 Nov 3 15:03:43 kjcf05n02 dracut[7981]: *** Install squash loader *** Nov 3 15:03:43 kjcf05n02 dracut[7981]: *** Squashing the files inside the initramfs *** Nov 3 15:03:44 kjcf05n02 dracut[7981]: *** Squashing the files inside the initramfs done *** Nov 3 15:03:44 kjcf05n02 dracut[7981]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 15:03:44 kjcf05n00 zabbix-server[1350010]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:03:44 kjcf05n00 zabbix-server[1350010]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:50\\"}}"' Nov 3 15:03:44 kjcf05n00 log_interesting_event.py[1350010]: Event '46331' acknowledged Nov 3 15:03:44 kjcf05n02 dracut[7981]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 15:03:44 kjcf05n00 zabbix-server[1350011]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:03:44 kjcf05n00 zabbix-server[1350011]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 3 15:03:44 kjcf05n00 log_interesting_event.py[1350011]: Event '46332' acknowledged Nov 3 15:03:44 kjcf05n00 mcfcli[3673891]: %3|1730667824.664|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:03:45 kjcf05n02 kdumpctl[7854]: kdump: kexec: loaded kdump kernel Nov 3 15:03:45 kjcf05n02 kdumpctl[7854]: kdump: Starting kdump: [OK] Nov 3 15:03:45 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 3 15:03:45 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:45 kjcf05n02 systemd[3187]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:45 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:45 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:45 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 15:03:45 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 15:03:45 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 15:03:45 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 15:03:45 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 15:03:45 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 15:03:45 kjcf05n02 ifdown[14560]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 15:03:45 kjcf05n02 ifdown[14561]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:03:45 kjcf05n02 ifdown[14562]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:03:45 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 15:03:45 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 15:03:45 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 15:03:46 kjcf05n02 ifup[14622]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 15:03:46 kjcf05n02 ifup[14623]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:03:46 kjcf05n02 ifup[14624]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:03:47 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 15:03:50 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 15:03:50 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 15:03:50 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 15:03:50 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:03:50 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:03:50 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:03:50 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:03:50 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 15:03:50 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 15:03:50 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 15:03:50 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 15:03:50 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:03:50 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:03:50 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:03:50 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:03:50 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 15:03:50 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 15:03:50 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 15:03:50 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 15:03:50 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 15:03:50 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 15:03:50 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 15:03:50 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 15:03:50 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 15:03:50 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 15:03:50 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 15:03:50 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 15:03:50 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 15:03:50 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 15:03:50 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 15:03:50 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 15:03:50 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 15:03:50 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 15:03:50 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 15:03:50 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 15:03:50 kjcf05n02 ifdown[14813]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 15:03:50 kjcf05n02 ifdown[14814]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:03:50 kjcf05n02 ifdown[14815]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:03:50 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 15:03:50 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 15:03:50 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 15:03:50 kjcf05n02 ifup[14875]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 15:03:50 kjcf05n02 ifup[14876]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:03:50 kjcf05n02 ifup[14877]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:03:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730667831', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(448.0B/596.0B), ib1=(224.0B/60.0B), icl0=(5.0kB/6.7kB), lo=(500.0B/500.0B), meth0=(1541.0MB/7.6MB), mgmt0=(1477.9MB/7.6MB)'}"] Nov 3 15:03:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(448.0B/596.0B), ib1=(224.0B/60.0B), icl0=(5.0kB/6.7kB), lo=(500.0B/500.0B), meth0=(1541.0MB/7.6MB), mgmt0=(1477.9MB/7.6MB)', 'message': 'NET OK - (Rx/Tx) ib0=(448.0B/596.0B), ib1=(224.0B/60.0B), icl0=(5.0kB/6.7kB), lo=(500.0B/500.0B), meth0=(1541.0MB/7.6MB), mgmt0=(1477.9MB/7.6MB)', 'value': 'ok', 'timestamp': '1730667831'} Nov 3 15:03:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:03:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730667831', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 15:03:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730667831'} Nov 3 15:03:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:03:53 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 15:03:53 kjcf05n02 dcs-collectord[5659]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 15:03:53 kjcf05n02 dcs-collectord[5659]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 15:03:54 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 15:03:55 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 15:03:55 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 15:03:55 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:55 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 3 15:03:55 kjcf05n02 await_ha_peer[15104]: Waiting for HA peer kjcf05n03 Nov 3 15:03:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 15:03:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 15:03:56 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 15:03:56 kjcf05n02 await_ha_peer[15104]: Peer kjcf05n03 has started, starting HA Nov 3 15:03:57 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 3 15:03:57 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 3 15:03:57 kjcf05n02 fstonithd.py[15144]: Listening for kdump packets from partner Nov 3 15:03:57 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:57 kjcf05n02 systemd[3187]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:03:57 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:57 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:57 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:57 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 3 15:03:57 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 15:03:57 kjcf05n02 systemd[1]: Reloading. Nov 3 15:03:58 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 15:03:58 kjcf05n02 puppet-agent[3580]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:03:58 kjcf05n02 puppet[3580]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:03:58 kjcf05n02 puppet-agent[3580]: Applied catalog in 90.62 seconds Nov 3 15:03:58 kjcf05n02 puppet[3580]: Notice: Applied catalog in 90.62 seconds Nov 3 15:03:58 kjcf05n02 systemd[1]: Started Puppet agent. Nov 3 15:03:58 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 15:03:58 kjcf05n02 systemd[1]: Reached target Timers. Nov 3 15:03:58 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 15:03:58 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 15:03:58 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 15:03:58 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 15:03:58 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 15:03:58 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 15:03:58 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 3 15:03:58 kjcf05n02 wce-disable.sh[15302]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 15:03:58 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 15:03:58 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 15:03:58 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 15:03:58 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 15:03:58 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 3 15:03:58 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 3 15:03:59 kjcf05n02 gateway-ec-node.py[15300]: Starting gateway-ec-node service Nov 3 15:03:59 kjcf05n02 python3.9[15299]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 15:03:59 kjcf05n02 python3.9[15299]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 15:03:59 kjcf05n02 RFSF-API[15298]: INFO[2024-11-03T15:03:58-06:00] Datapath API RESTful Service starting Nov 3 15:03:59 kjcf05n02 dp-api-server-node[15298]: INFO[2024-11-03T15:03:58-06:00] Datapath API RESTful Service starting Nov 3 15:03:59 kjcf05n02 RFSF-API[15298]: INFO[2024-11-03T15:03:58-06:00] Running in production mode, starting dbus event listener Nov 3 15:03:59 kjcf05n02 dp-api-server-node[15298]: INFO[2024-11-03T15:03:58-06:00] Running in production mode, starting dbus event listener Nov 3 15:03:59 kjcf05n02 RFSF-API[15298]: INFO[2024-11-03T15:03:58-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 15:03:59 kjcf05n02 dp-api-server-node[15298]: INFO[2024-11-03T15:03:58-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 15:03:59 kjcf05n02 RFSF-API[15298]: INFO[2024-11-03T15:03:58-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 15:03:59 kjcf05n02 dp-api-server-node[15298]: INFO[2024-11-03T15:03:58-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 15:03:59 kjcf05n02 RFSF-API[15298]: INFO[2024-11-03T15:03:58-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 15:03:59 kjcf05n02 dp-api-server-node[15298]: INFO[2024-11-03T15:03:58-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 15:03:59 kjcf05n02 RFSF-API[15298]: INFO[2024-11-03T15:03:58-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 15:03:59 kjcf05n02 dp-api-server-node[15298]: INFO[2024-11-03T15:03:58-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 15:03:59 kjcf05n02 RFSF-API[15298]: INFO[2024-11-03T15:03:58-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 15:03:59 kjcf05n02 dp-api-server-node[15298]: INFO[2024-11-03T15:03:58-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 15:03:59 kjcf05n02 RFSF-API[15298]: INFO[2024-11-03T15:03:58-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 15:03:59 kjcf05n02 dp-api-server-node[15298]: INFO[2024-11-03T15:03:58-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 15:03:59 kjcf05n02 RFSF-API[15298]: INFO[2024-11-03T15:03:58-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 15:03:59 kjcf05n02 dp-api-server-node[15298]: INFO[2024-11-03T15:03:58-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 15:03:59 kjcf05n02 RFSF-API[15298]: INFO[2024-11-03T15:03:58-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 15:03:59 kjcf05n02 dp-api-server-node[15298]: INFO[2024-11-03T15:03:58-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 15:03:59 kjcf05n02 RFSF-API[15298]: INFO[2024-11-03T15:03:58-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 15:03:59 kjcf05n02 dp-api-server-node[15298]: INFO[2024-11-03T15:03:58-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 15:03:59 kjcf05n02 RFSF-API[15298]: INFO[2024-11-03T15:03:58-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 15:03:59 kjcf05n02 dp-api-server-node[15298]: INFO[2024-11-03T15:03:58-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 15:04:03 kjcf05n00 mcfcli[3673891]: %3|1730667843.013|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:04:04 kjcf05n02 systemd[1]: Reloading. Nov 3 15:04:04 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 15:04:04 kjcf05n02 systemd[1]: Reloading. Nov 3 15:04:04 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 15:04:05 kjcf05n02 diskmonitor_pre[15807]: Key management is currently disabled.DEAR disabled Nov 3 15:04:05 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 15:04:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730667845', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 2.34, 2.59, 1.17'}"] Nov 3 15:04:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 2.34, 2.59, 1.17', 'message': 'OK - load average: 2.34, 2.59, 1.17', 'value': 'ok', 'timestamp': '1730667845'} Nov 3 15:04:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:04:06 kjcf05n02 sh[15867]: LNET configured: New Created Nov 3 15:04:06 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 15:04:06 kjcf05n02 LCNmon[17928]: Interface ib0 is up Nov 3 15:04:06 kjcf05n02 LCNmon[17928]: Interface ib1 is up Nov 3 15:04:06 kjcf05n02 LCNmon[17928]: Can ping through interface ib0 Nov 3 15:04:06 kjcf05n02 LCNmon[17928]: Can ping through interface ib1 Nov 3 15:04:06 kjcf05n02 LCNmon[17928]: NIC ib0, initial state UP Nov 3 15:04:06 kjcf05n02 LCNmon[17928]: NIC ib1, initial state UP Nov 3 15:04:06 kjcf05n02 LCNmon[17928]: LCNstat initial state UP Nov 3 15:04:07 kjcf05n02 LCNmon[17928]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 3 15:04:08 kjcf05n02 dcs-collectord[5659]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 15:04:08 kjcf05n02 dcs-collectord[5659]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 15:04:08 kjcf05n02 dcs-collectord[5659]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: /var/run/diskmonitor does not exist, creating Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: Creating /var/run/diskmonitor/disk Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: Creating /var/run/diskmonitor/encl Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: Creating /var/run/diskmonitor/cli Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: RAS_Interlocks_enabled: 1 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: add handler for sig: 14 sa_flags: 10000004 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: add handler for sig: 1 sa_flags: 10000004 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: add handler for sig: 2 sa_flags: 00000004 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: add handler for sig: 15 sa_flags: 00000004 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: add handler for sig: 6 sa_flags: 00000004 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: add handler for sig: 3 sa_flags: 00000004 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: add handler for sig: 30 sa_flags: 00000004 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: add handler for sig: 20 sa_flags: 00000004 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: add handler for sig: 10 sa_flags: 10000004 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: add handler for sig: 11 sa_flags: 00000004 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: add handler for sig: 7 sa_flags: 00000004 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: add handler for sig: 4 sa_flags: 00000004 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: add handler for sig: 8 sa_flags: 00000004 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: Using HA Baton locks - key: diskmonitor Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: Baton will be held for at most 570 seconds Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: DMMP Enabled: 0 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: random seed: 11ec8262 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: NVMe Enclosure: 1 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: ZFS Enclosure: 0 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: Dbus, Initialized Connection Successfully Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: int_catcher_thread: thread start Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: Received dbus message 4 org.freedesktop.DBus -> :1.98 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 15:04:09 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 15:04:08 kjcf05n00 httpd[902566]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 15:04:09 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 15:04:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730667849', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 361 processes with STATE = RSZDT '}"] Nov 3 15:04:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 361 processes with STATE = RSZDT ', 'message': 'PROCS OK: 361 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730667849'} Nov 3 15:04:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:04:11 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18477 (bash) Nov 3 15:04:11 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 15:04:11 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 15:04:11 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 15:04:11 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 15:04:11 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 15:04:12 kjcf05n02 openhpid[5565]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 15:04:12 kjcf05n02 openhpid[5565]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 15:04:12 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 3 15:04:12 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 15:04:12 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 15:04:13 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18582 which is not our child. We'll most likely not notice when it exits. Nov 3 15:04:13 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 15:04:13 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 3 15:04:13 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 3 15:04:13 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 15:04:13 kjcf05n02 dcs-collectord[5659]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 15:04:13 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 15:04:13 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 15:04:13 kjcf05n02 systemd[1]: Startup finished in 47.854s (kernel) + 2min 33.317s (userspace) = 3min 21.171s. Nov 3 15:04:13 kjcf05n02 openhpid[18582]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 15:04:13 kjcf05n02 openhpid[18582]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 15:04:13 kjcf05n02 openhpid[18582]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 15:04:13 kjcf05n02 openhpid[18582]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 15:04:15 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 15:04:14 kjcf05n00 mcfcli[3673891]: %3|1730667854.665|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 15:04:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730667859', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.7% (4392312 kB) used.'}"] Nov 3 15:04:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.7% (4392312 kB) used.', 'message': 'OK - 1.7% (4392312 kB) used.', 'value': 'ok', 'timestamp': '1730667859'} Nov 3 15:04:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:04:20 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31446 deleted. Nov 3 15:04:20 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31447 deleted. Nov 3 15:04:23 kjcf05n02 dcs-collectord[5659]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 15:04:23 kjcf05n02 dcs-collectord[5659]: WARNING No data collected (hpi_parser.py:353) Nov 3 15:04:23 kjcf05n00 zabbix-server[1350351]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:04:23 kjcf05n00 zabbix-server[1350351]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 77.89\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 67.78\\"}}"' Nov 3 15:04:23 kjcf05n00 log_interesting_event.py[1350351]: Event '46334' acknowledged Nov 3 15:04:25 kjcf05n03 nslcd[6915]: [16e9e8] ldap_result() failed: Can't contact LDAP server Nov 3 15:04:25 kjcf05n03 nslcd[6915]: [90cde7] ldap_result() failed: Can't contact LDAP server Nov 3 15:04:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730667875', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 15:04:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730667875'} Nov 3 15:04:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:04:36 kjcf05n02 ipmievd[3998]: System Event sensor - Timestamp Clock Sync Nov 3 15:04:38 kjcf05n02 ipmievd[3187]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:04:38 kjcf05n02 dcs-collectord[5659]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 15:04:40 kjcf05n00 mcfcli[3673891]: %3|1730667880.093|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:04:40 kjcf05n00 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 15:04:40 kjcf05n00 systemd-tmpfiles[1350609]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:04:40 kjcf05n00 systemd-tmpfiles[1350609]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:04:40 kjcf05n00 systemd-tmpfiles[1350609]: [/usr/lib/tmpfiles.d/powerman.conf:1] Line references path below legacy directory /var/run/, updating /var/run/powerman → /run/powerman; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:04:40 kjcf05n00 systemd-tmpfiles[1350609]: [/usr/lib/tmpfiles.d/puppetserver.conf:1] Line references path below legacy directory /var/run/, updating /var/run/puppetlabs/puppetserver → /run/puppetlabs/puppetserver; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:04:40 kjcf05n00 systemd-tmpfiles[1350609]: [/usr/lib/tmpfiles.d/rabbitmq-server.conf:1] Line references path below legacy directory /var/run/, updating /var/run/rabbitmq → /run/rabbitmq; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:04:40 kjcf05n00 systemd-tmpfiles[1350609]: [/usr/lib/tmpfiles.d/slapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/openldap → /run/openldap; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:04:40 kjcf05n00 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 15:04:40 kjcf05n00 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 15:04:44 kjcf05n00 mcfcli[3673891]: %3|1730667884.665|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 15:04:47 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 15:04:53 kjcf05n02 dcs-collectord[5659]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 15:04:55 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 15:04:55 kjcf05n02 ras-resource-manager-agent[5923]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "468c55e8-9a27-11ef-b16b-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 15:04:55 kjcf05n02 ras-resource-manager-agent[5923]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '468c55e8-9a27-11ef-b16b-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 15:04:55 kjcf05n02 ras-resource-manager-agent[5923]: INFO Submitting new device inserted signal, starting to qualify drive: 468c55e8-9a27-11ef-b16b-00093d0695e3 (admin_action.py:110) Nov 3 15:04:55 kjcf05n03 firmware-update-orc-server[5844]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "0e8e583f-ec25-44f3-9ea6-3cb0369a9bcc"} (logger.py:65) Nov 3 15:04:55 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 197705 (get_disk_device) Nov 3 15:04:55 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 15:04:55 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 15:04:55 kjcf05n03 ccp-client[197726]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 15:04:55 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '468c55e8-9a27-11ef-b16b-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 15:04:55 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '468c55e8-9a27-11ef-b16b-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 15:04:55 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '468c55e8-9a27-11ef-b16b-00093d0695e3', 'response ID': '469741f6-9a27-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 15:04:55 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 469741f6-9a27-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 15:04:55 kjcf05n03 ccp-client[197726]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 15:04:55 kjcf05n03 ccp-client[197736]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 15:04:55 kjcf05n03 ccp-client[197726]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 15:04:55 kjcf05n03 ccp-client[197726]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 15:04:55 kjcf05n03 ccp-client[197736]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 15:04:55 kjcf05n03 ccp-client[197736]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 15:04:55 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '46d92d1e-9a27-11ef-b16b-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 15:04:55 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '46d92d1e-9a27-11ef-b16b-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 15:04:55 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '46d92d1e-9a27-11ef-b16b-00093d0695e3', 'response ID': '46e149a4-9a27-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 15:04:55 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 46e149a4-9a27-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 15:04:55 kjcf05n02 diskmonitor[17518]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 15:04:55 kjcf05n02 ras-resource-manager-agent[5923]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "46d92d1e-9a27-11ef-b16b-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 15:04:55 kjcf05n02 ras-resource-manager-agent[5923]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '46d92d1e-9a27-11ef-b16b-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 15:04:55 kjcf05n02 ras-resource-manager-agent[5923]: INFO Submitting new device inserted signal, starting to qualify drive: 46d92d1e-9a27-11ef-b16b-00093d0695e3 (admin_action.py:110) Nov 3 15:04:55 kjcf05n02 firmware-update-orc-server[5879]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "94c664f0-75a9-4d1d-a86d-11fe4b63bfbd"} (logger.py:65) Nov 3 15:04:58 kjcf05n03 DRVFW[197868]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 15:04:58 kjcf05n03 ccp-client[197869]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 15:04:58 kjcf05n03 ccp-client[197869]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 15:04:58 kjcf05n03 ccp-client[197878]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 15:04:58 kjcf05n03 ccp-client[197869]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 15:04:58 kjcf05n03 ccp-client[197869]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 15:04:58 kjcf05n03 ccp-client[197878]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 15:04:58 kjcf05n03 ccp-client[197878]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 15:04:58 kjcf05n03 firmware-update-orc-server[5844]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 15:05:00 kjcf05n02 ras-resource-manager-agent[5923]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '468c55e8-9a27-11ef-b16b-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 15:05:00 kjcf05n02 ras-resource-manager-agent[5923]: INFO Drive qualification complete responding: 468c55e8-9a27-11ef-b16b-00093d0695e3 (admin_action.py:205) Nov 3 15:05:00 kjcf05n02 ras-resource-manager-agent[5923]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "468c55e8-9a27-11ef-b16b-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (interesting_event.py:59) Nov 3 15:05:00 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 469741f6-9a27-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 15:05:00 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '468c55e8-9a27-11ef-b16b-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '468c55e8-9a27-11ef-b16b-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}}} (logger.py:65) Nov 3 15:05:03 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 15:05:03 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 15:05:03 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 15:05:03 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 15:05:03 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 15:05:03 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 15:05:03 kjcf05n02 diskmonitor[17518]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 15:05:03 kjcf05n02 diskmonitor[17518]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 15:05:03 kjcf05n02 diskmonitor[17518]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 15:05:03 kjcf05n02 diskmonitor[17518]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 15:05:03 kjcf05n02 diskmonitor[17518]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 15:05:03 kjcf05n02 diskmonitor[17518]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "468c55e8-9a27-11ef-b16b-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 15:05:03 kjcf05n02 diskmonitor[17518]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 15:05:03 kjcf05n02 diskmonitor[17518]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 15:05:03 kjcf05n02 diskmonitor[17518]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "46d92d1e-9a27-11ef-b16b-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 15:05:03 kjcf05n02 diskmonitor[17518]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 15:05:03 kjcf05n02 diskmonitor[17518]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 15:05:09 kjcf05n02 chronyd[5168]: Selected source 172.16.2.1 Nov 3 15:05:10 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22490 (get_disk_device) Nov 3 15:05:10 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 15:05:10 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 15:05:10 kjcf05n02 ccp-client[22511]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 15:05:11 kjcf05n02 ccp-client[22511]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 15:05:11 kjcf05n02 ccp-client[22520]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 15:05:11 kjcf05n02 ccp-client[22511]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 15:05:11 kjcf05n02 ccp-client[22520]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 15:05:11 kjcf05n02 ccp-client[22520]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 15:05:11 kjcf05n02 ccp-client[22511]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 15:05:11 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 3 15:05:11 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 15:05:11 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 3 15:05:12 kjcf05n00 python3.9[1350774]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 15:05:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730667912}"] Nov 3 15:05:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730667912, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:05:12 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:05:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730667912}"] Nov 3 15:05:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730667912, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:05:12 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:05:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730667912}"] Nov 3 15:05:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730667912, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:05:12 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:05:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730667912}"] Nov 3 15:05:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730667912, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:05:12 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:05:13 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730667912}"] Nov 3 15:05:13 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730667912, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:05:13 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:05:13 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730667912}"] Nov 3 15:05:13 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730667912, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:05:13 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:05:13 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730667912}"] Nov 3 15:05:13 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730667912, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:05:13 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:05:13 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730667912}"] Nov 3 15:05:13 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730667912, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:05:13 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:05:13 kjcf05n00 diskmonitor[2758297]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 15:05:13 kjcf05n02 ras-resource-manager-agent[5923]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "468c55e8-9a27-11ef-b16b-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (service_main_handler.py:66) Nov 3 15:05:13 kjcf05n02 ras-resource-manager-agent[5923]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '468c55e8-9a27-11ef-b16b-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 15:05:13 kjcf05n02 ras-resource-manager-agent[5923]: INFO Device qualification response has been acknowledged: 468c55e8-9a27-11ef-b16b-00093d0695e3 (admin_action.py:151) Nov 3 15:05:14 kjcf05n02 DRVFW[22864]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 15:05:14 kjcf05n02 ccp-client[22866]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 15:05:14 kjcf05n02 ccp-client[22866]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 15:05:14 kjcf05n02 ccp-client[22910]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 15:05:14 kjcf05n02 ccp-client[22866]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 15:05:14 kjcf05n02 ccp-client[22866]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 15:05:14 kjcf05n02 ccp-client[22910]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 15:05:14 kjcf05n02 ccp-client[22910]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 15:05:14 kjcf05n02 firmware-update-orc-server[5879]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 15:05:14 kjcf05n00 mcfcli[3673891]: %3|1730667914.665|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 15:05:15 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 46e149a4-9a27-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 15:05:15 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '46d92d1e-9a27-11ef-b16b-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '46d92d1e-9a27-11ef-b16b-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}}} (logger.py:65) Nov 3 15:05:16 kjcf05n02 ras-resource-manager-agent[5923]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '46d92d1e-9a27-11ef-b16b-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 15:05:16 kjcf05n02 ras-resource-manager-agent[5923]: INFO Drive qualification complete responding: 46d92d1e-9a27-11ef-b16b-00093d0695e3 (admin_action.py:205) Nov 3 15:05:16 kjcf05n02 ras-resource-manager-agent[5923]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "46d92d1e-9a27-11ef-b16b-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 3 15:05:17 kjcf05n02 python3.9[5230]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 15:05:18 kjcf05n02 python3.9[3187]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:05:18 kjcf05n02 diskmonitor[17518]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 15:05:18 kjcf05n02 diskmonitor[17518]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 15:05:18 kjcf05n02 ras-resource-manager-agent[5923]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "547c636e-9a27-11ef-b16b-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 15:05:18 kjcf05n02 ras-resource-manager-agent[5923]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '547c636e-9a27-11ef-b16b-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 15:05:18 kjcf05n02 ras-resource-manager-agent[5923]: INFO Requests ['46d92d1e-9a27-11ef-b16b-00093d0695e3', '547c636e-9a27-11ef-b16b-00093d0695e3'] already in progress (admin_action.py:99) Nov 3 15:05:18 kjcf05n02 ras-resource-manager-agent[5923]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '547c636e-9a27-11ef-b16b-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 15:05:18 kjcf05n02 ras-resource-manager-agent[5923]: INFO Drive qualification complete responding: 547c636e-9a27-11ef-b16b-00093d0695e3 (admin_action.py:205) Nov 3 15:05:18 kjcf05n02 ras-resource-manager-agent[5923]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "46d92d1e-9a27-11ef-b16b-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 3 15:05:18 kjcf05n02 ras-resource-manager-agent[5923]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "547c636e-9a27-11ef-b16b-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 3 15:05:19 kjcf05n00 mcfcli[3673891]: %3|1730667919.245|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "468c55e8-9a27-11ef-b16b-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: Dbus, handle_ingress_ras_signals, uuid: 468c55e8-9a27-11ef-b16b-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "468c55e8-9a27-11ef-b16b-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: main: Pending firmware leveling requests exist, rescanning disks Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "547c636e-9a27-11ef-b16b-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: leaving test state: 1 next state: 2 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: lock req: no timeout Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: leaving test state: 2 next state: 4 Nov 3 15:05:24 kjcf05n02 diskmonitor[17518]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 15:05:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730667630', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 15:05:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730667630'} Nov 3 15:05:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:05:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730667630', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 15:05:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730667630'} Nov 3 15:05:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:05:44 kjcf05n00 mcfcli[3673891]: %3|1730667944.667|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:05:57 kjcf05n00 mcfcli[3673891]: %3|1730667957.054|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:06:14 kjcf05n00 mcfcli[3673891]: %3|1730667974.667|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:06:16 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 15:06:17 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 15:06:17 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 15:06:19 kjcf05n02 ras-resource-manager-agent[5923]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "46d92d1e-9a27-11ef-b16b-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 15:06:19 kjcf05n02 ras-resource-manager-agent[5923]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '46d92d1e-9a27-11ef-b16b-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 15:06:19 kjcf05n02 ras-resource-manager-agent[5923]: INFO Device qualification response has been acknowledged: 46d92d1e-9a27-11ef-b16b-00093d0695e3 (admin_action.py:151) Nov 3 15:06:19 kjcf05n02 ras-resource-manager-agent[5923]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "46d92d1e-9a27-11ef-b16b-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 15:06:19 kjcf05n02 ras-resource-manager-agent[5923]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '46d92d1e-9a27-11ef-b16b-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 15:06:19 kjcf05n02 ras-resource-manager-agent[5923]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "547c636e-9a27-11ef-b16b-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 15:06:19 kjcf05n02 ras-resource-manager-agent[5923]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '547c636e-9a27-11ef-b16b-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 15:06:19 kjcf05n02 ras-resource-manager-agent[5923]: INFO Device qualification response has been acknowledged: 547c636e-9a27-11ef-b16b-00093d0695e3 (admin_action.py:151) Nov 3 15:06:19 kjcf05n02 diskmonitor[17518]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 15:06:32 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 15:06:32 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 15:06:32 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 15:06:33 kjcf05n02 dcs-collectord[5659]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 15:06:35 kjcf05n00 mcfcli[3673891]: %3|1730667995.171|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:06:36 kjcf05n02 diskmonitor[17518]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "46d92d1e-9a27-11ef-b16b-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 15:06:36 kjcf05n02 diskmonitor[17518]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 15:06:36 kjcf05n02 diskmonitor[17518]: Dbus, handle_ingress_ras_signals, uuid: 46d92d1e-9a27-11ef-b16b-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 15:06:36 kjcf05n02 diskmonitor[17518]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 15:06:36 kjcf05n02 diskmonitor[17518]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "46d92d1e-9a27-11ef-b16b-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 15:06:36 kjcf05n02 diskmonitor[17518]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "46d92d1e-9a27-11ef-b16b-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 15:06:36 kjcf05n02 diskmonitor[17518]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 15:06:36 kjcf05n02 diskmonitor[17518]: Dbus, handle_ingress_ras_signals, uuid: 46d92d1e-9a27-11ef-b16b-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 15:06:36 kjcf05n02 diskmonitor[17518]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "46d92d1e-9a27-11ef-b16b-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 15:06:36 kjcf05n02 diskmonitor[17518]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "547c636e-9a27-11ef-b16b-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 15:06:36 kjcf05n02 diskmonitor[17518]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 15:06:36 kjcf05n02 diskmonitor[17518]: Dbus, handle_ingress_ras_signals, uuid: 547c636e-9a27-11ef-b16b-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 15:06:36 kjcf05n02 diskmonitor[17518]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "547c636e-9a27-11ef-b16b-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 15:06:36 kjcf05n02 diskmonitor[17518]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 15:06:36 kjcf05n02 diskmonitor[17518]: lock acquired Nov 3 15:06:36 kjcf05n02 diskmonitor[17518]: leaving test state: 4 next state: 8 Nov 3 15:06:36 kjcf05n02 diskmonitor[17518]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 15:06:38 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 15:06:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730668002}"] Nov 3 15:06:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730668002, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:06:42 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:06:42-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:06:42 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:06:42-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:06:42 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:06:42-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:06:42 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:06:42-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:06:42 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:06:42-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:06:42 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:06:42-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:06:42 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:06:42-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.960532ms Nov 3 15:06:42 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:06:42-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.960532ms Nov 3 15:06:42 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:06:42 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:06:42 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:06:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Inactive', 'timestamp': 1730668002}"] Nov 3 15:06:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730668002, 'value': 'Inactive', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:06:42 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:06:42-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:06:42 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:06:42-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:06:42 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:06:42-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:06:42 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:06:42-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:06:42 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:06:42-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:06:42 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:06:42-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:06:42 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:06:42-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.115181ms Nov 3 15:06:42 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:06:42-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.115181ms Nov 3 15:06:42 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:06:42 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:06:44 kjcf05n00 mcfcli[3673891]: %3|1730668004.667|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 15:06:48 kjcf05n02 diskmonitor[17518]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 15:06:48 kjcf05n02 diskmonitor[17518]: leaving test state: 8 next state: 20 Nov 3 15:06:48 kjcf05n02 diskmonitor[17518]: leaving test state: 20 next state: 40 Nov 3 15:06:48 kjcf05n02 diskmonitor[17518]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 17fc57b0000 Nov 3 15:06:48 kjcf05n02 diskmonitor[17518]: leaving test state: 40 next state: 80 Nov 3 15:06:59 kjcf05n01 diskmonitor[1331407]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 15:07:14 kjcf05n00 mcfcli[3673891]: %3|1730668034.467|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:07:14 kjcf05n00 mcfcli[3673891]: %3|1730668034.667|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:07:28 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 15:07:29 kjcf05n02 diskmonitor[17518]: leaving test state: 80 next state: 100 Nov 3 15:07:29 kjcf05n02 diskmonitor[17518]: lock release: time: Sun Nov 3 15:07:23 2024 Nov 3 15:07:29 kjcf05n02 diskmonitor[17518]: leaving test state: 100 next state: 1 Nov 3 15:07:44 kjcf05n00 mcfcli[3673891]: %3|1730668064.667|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:07:52 kjcf05n00 mcfcli[3673891]: %3|1730668072.564|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:08:06 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 3 15:08:06 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 15:08:06 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 15:08:06 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 15:08:14 kjcf05n00 mcfcli[3673891]: %3|1730668094.668|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:08:31 kjcf05n00 mcfcli[3673891]: %3|1730668111.717|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:08:34 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 3 15:08:34 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 3 15:08:36 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 3 15:08:36 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 3 15:08:36 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 3 15:08:44 kjcf05n00 mcfcli[3673891]: %3|1730668124.668|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 15:08:46 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 15:08:46 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 15:08:46 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 15:09:11 kjcf05n00 mcfcli[3673891]: %3|1730668151.714|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:09:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730668152}"] Nov 3 15:09:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730668152, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:09:12 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:09:12-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:09:12 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:09:12-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:09:12 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:09:12-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:09:12 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:09:12-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:09:12 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:09:12-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:09:12 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:09:12-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:09:12 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:09:12-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.134899ms Nov 3 15:09:12 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:09:12-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.134899ms Nov 3 15:09:12 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:09:12 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:09:12 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:09:14 kjcf05n00 mcfcli[3673891]: %3|1730668154.668|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 15:09:44 kjcf05n00 mcfcli[3673891]: %3|1730668184.669|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 15:09:44 kjcf05n00 zabbix-server[1353669]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:09:44 kjcf05n00 zabbix-server[1353669]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 54.33\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 68.5\\"}}"' Nov 3 15:09:45 kjcf05n00 log_interesting_event.py[1353669]: Event '46346' acknowledged Nov 3 15:09:49 kjcf05n00 mcfcli[3673891]: %3|1730668189.836|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 15:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 15:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 15:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 15:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 15:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 15:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 15:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 15:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 15:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 15:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 15:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 15:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 15:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 15:10:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 15:10:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:10:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 15:10:02 kjcf05n00 zabbix-server[1353925]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:10:02 kjcf05n00 zabbix-server[1353925]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n02' from event '46347' Nov 3 15:10:02 kjcf05n00 zabbix-server[1353925]: Host created 'enclosure_USE26000024VS001' Nov 3 15:10:02 kjcf05n00 zabbix-server[1353925]: Running puppet on 'kjcf05n02' Nov 3 15:10:04 kjcf05n02 puppet-agent[34512]: Using configured environment 'production' Nov 3 15:10:04 kjcf05n02 puppet-agent[34512]: Retrieving pluginfacts Nov 3 15:10:04 kjcf05n02 puppet-agent[34512]: Retrieving plugin Nov 3 15:10:05 kjcf05n02 puppet-agent[34512]: Loading facts Nov 3 15:10:07 kjcf05n02 puppet-agent[34512]: Caching catalog for kjcf05n02 Nov 3 15:10:07 kjcf05n02 puppet-agent[34512]: Applying configuration version '1730668205' Nov 3 15:10:09 kjcf05n02 puppet-agent[34512]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 15:10:09 kjcf05n02 puppet-agent[34512]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 15:10:09 kjcf05n02 puppet-agent[34512]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 15:10:10 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 15:10:10 kjcf05n02 zabbix_agent2[6007]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 15:10:10 kjcf05n02 zabbix_agent2[3187]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:10:10 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 15:10:10 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 15:10:10 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 15:10:10 kjcf05n02 puppet-agent[34512]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: Press Ctrl+C to exit. Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: Plugin support version 1.0 Nov 3 15:10:10 kjcf05n02 zabbix_agent2[34956]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 15:10:12 kjcf05n02 puppet-agent[34512]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 15:10:12 kjcf05n02 puppet-agent[34512]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 15:10:12 kjcf05n02 puppet-agent[34512]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 15:10:12 kjcf05n02 puppet-agent[34512]: Applied catalog in 5.05 seconds Nov 3 15:10:12 kjcf05n00 python3.9[1353992]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 15:10:12 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 3 15:10:12 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 3 15:10:12 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 3 15:10:12 kjcf05n00 zabbix-server[1353925]: puppet completed status:(0): '' Nov 3 15:10:12 kjcf05n00 zabbix-server[1353925]: Event '46347' acknowledged Nov 3 15:10:12 kjcf05n00 zabbix-server[1353925]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n02"}' Nov 3 15:10:14 kjcf05n00 mcfcli[3673891]: %3|1730668214.670|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 15:10:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730667630', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 15:10:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730667630'} Nov 3 15:10:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:10:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730667630', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 15:10:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730667630'} Nov 3 15:10:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:10:28 kjcf05n00 mcfcli[3673891]: %3|1730668228.191|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:10:44 kjcf05n00 mcfcli[3673891]: %3|1730668244.670|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 15:11:03 kjcf05n00 mcfcli[3673891]: %3|1730668263.788|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:11:14 kjcf05n00 mcfcli[3673891]: %3|1730668274.670|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 15:11:42 kjcf05n00 mcfcli[3673891]: %3|1730668302.104|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:11:44 kjcf05n00 mcfcli[3673891]: %3|1730668304.671|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:11:54 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 3 15:12:14 kjcf05n00 mcfcli[3673891]: %3|1730668334.671|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 15:12:18 kjcf05n00 mcfcli[3673891]: %3|1730668338.674|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:12:22 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 3 15:12:22 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 3 15:12:44 kjcf05n00 mcfcli[3673891]: %3|1730668364.673|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 15:12:56 kjcf05n00 mcfcli[3673891]: %3|1730668376.313|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:13:14 kjcf05n00 mcfcli[3673891]: %3|1730668394.673|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 15:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T15:13:27.253366089-06:00 level=info msg="Completed cleanup jobs" duration=26.53157ms Nov 3 15:13:35 kjcf05n00 mcfcli[3673891]: %3|1730668415.230|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:13:44 kjcf05n00 mcfcli[3673891]: %3|1730668424.673|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:14:13 kjcf05n00 mcfcli[3673891]: %3|1730668453.682|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:14:14 kjcf05n00 mcfcli[3673891]: %3|1730668454.674|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 15:14:44 kjcf05n00 mcfcli[3673891]: %3|1730668484.674|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:14:45 kjcf05n02 root[42304]: failback_xyraid Nov 3 15:14:47 kjcf05n02 root[42423]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 15:14:48 kjcf05n02 root[42570]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 15:14:48 kjcf05n00 mcfcli[3673891]: %3|1730668488.626|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:14:50 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 3 15:14:51 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme2n1 Nov 3 15:14:52 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme17n1 Nov 3 15:14:52 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme8n1 Nov 3 15:14:52 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme3n1 Nov 3 15:14:52 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme24n1 Nov 3 15:14:52 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme25n1 Nov 3 15:14:53 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme19n1 Nov 3 15:14:53 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme4n1 Nov 3 15:14:53 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme23n1 Nov 3 15:14:53 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme9n1 Nov 3 15:14:54 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme18n1 Nov 3 15:14:56 kjcf05n02 dwd[5201]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 15:14:56 kjcf05n02 dwd[5201]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 15:14:56 kjcf05n02 dwd[5201]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 15:14:56 kjcf05n02 dwd[5201]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 15:14:56 kjcf05n02 dwd[5201]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 15:14:56 kjcf05n02 dwd[5201]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 15:14:56 kjcf05n02 dwd[5201]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 15:14:56 kjcf05n02 dwd[5201]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 15:14:56 kjcf05n02 dwd[5201]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 15:14:56 kjcf05n02 dwd[5201]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 15:14:56 kjcf05n02 dwd[5201]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 15:14:56 kjcf05n02 dwd[5201]: Starting NVME thread for nvme2n1 Nov 3 15:14:56 kjcf05n02 dwd[5201]: Starting NVME thread for nvme18n1 Nov 3 15:14:56 kjcf05n02 dwd[5201]: Starting NVME thread for nvme19n1 Nov 3 15:14:56 kjcf05n02 dwd[5201]: Starting NVME thread for nvme9n1 Nov 3 15:14:57 kjcf05n02 dwd[5201]: Starting NVME thread for nvme3n1 Nov 3 15:14:57 kjcf05n02 systemd-udevd[45260]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45261]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45263]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45265]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45260]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45261]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45263]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45265]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45260]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45261]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45263]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45265]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45260]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45261]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45263]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45265]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45260]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45261]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45263]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45265]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45260]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45261]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45263]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45265]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45260]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45289]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45263]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45265]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45291]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45293]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45260]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45261]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45294]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45289]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45263]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45265]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45291]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45294]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45289]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45293]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45291]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45294]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45294]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45291]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45294]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45291]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45265]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45263]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45293]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45291]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45265]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45294]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45291]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45294]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45291]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45291]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45294]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45291]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45291]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45294]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45291]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45294]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45291]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 systemd-udevd[45291]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:14:57 kjcf05n02 dwd[5201]: Starting NVME thread for nvme24n1 Nov 3 15:14:57 kjcf05n02 dwd[5201]: Starting NVME thread for nvme4n1 Nov 3 15:14:57 kjcf05n02 dwd[5201]: Starting NVME thread for nvme23n1 Nov 3 15:14:57 kjcf05n02 dwd[5201]: Starting NVME thread for nvme17n1 Nov 3 15:14:58 kjcf05n02 dwd[5201]: Starting NVME thread for nvme25n1 Nov 3 15:14:58 kjcf05n02 dwd[5201]: Starting NVME thread for nvme8n1 Nov 3 15:14:58 kjcf05n02 nslcd[6949]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 15:14:59 kjcf05n03 diskmonitor[17700]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 15:14:59 kjcf05n03 diskmonitor[17700]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 15:15:00 kjcf05n02 dcs-bulk-data-sender[6211]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 3 15:15:03 kjcf05n02 diskmonitor[17518]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 15:15:11 kjcf05n02 diskmonitor[17518]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 15:15:11 kjcf05n02 diskmonitor[17518]: Scan for ReadErrorMax change for md65 Nov 3 15:15:11 kjcf05n02 diskmonitor[17518]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 15:15:11 kjcf05n02 diskmonitor[17518]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 15:15:11 kjcf05n02 diskmonitor[17518]: read_saved_file: md65 no saved speed Nov 3 15:15:11 kjcf05n02 diskmonitor[17518]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 15:15:11 kjcf05n02 diskmonitor[17518]: Set sync_speed_min (10000) for md65 Nov 3 15:15:11 kjcf05n02 diskmonitor[17518]: Set sync_speed_max (200000) for md65 Nov 3 15:15:11 kjcf05n02 diskmonitor[17518]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 15:15:12 kjcf05n00 python3.9[1356931]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 15:15:14 kjcf05n00 mcfcli[3673891]: %3|1730668514.674|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 15:15:27 kjcf05n00 mcfcli[3673891]: %3|1730668527.691|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:15:44 kjcf05n00 mcfcli[3673891]: %3|1730668544.675|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 15:15:51 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 15:15:51 kjcf05n02 systemd-tmpfiles[48269]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:15:51 kjcf05n02 systemd-tmpfiles[48269]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:15:51 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 15:15:51 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 15:15:54 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 48476 (bash) Nov 3 15:15:54 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 15:15:54 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 15:16:06 kjcf05n00 mcfcli[3673891]: %3|1730668566.645|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:16:14 kjcf05n00 mcfcli[3673891]: %3|1730668574.675|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 15:16:42 kjcf05n00 mcfcli[3673891]: %3|1730668602.212|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:16:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730668602}"] Nov 3 15:16:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730668602, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:16:42 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:42-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:42 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:42-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:42 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:42-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:42 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:42-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:42 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:42-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:42 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:42-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:42 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:42-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.054557ms Nov 3 15:16:42 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:42-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.054557ms Nov 3 15:16:42 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:16:42 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:16:42 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:16:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730668602}"] Nov 3 15:16:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730668602, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:16:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.916379ms Nov 3 15:16:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.916379ms Nov 3 15:16:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:16:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:16:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:16:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730668602}"] Nov 3 15:16:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730668602, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:16:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.234414ms Nov 3 15:16:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.234414ms Nov 3 15:16:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:16:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:16:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:16:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730668602}"] Nov 3 15:16:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730668602, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:16:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.794391ms Nov 3 15:16:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.794391ms Nov 3 15:16:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:16:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:16:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:16:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730668602}"] Nov 3 15:16:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730668602, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:16:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.018751ms Nov 3 15:16:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.018751ms Nov 3 15:16:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:16:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:16:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:16:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730668602}"] Nov 3 15:16:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730668602, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:16:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.294036ms Nov 3 15:16:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.294036ms Nov 3 15:16:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:16:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:16:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:16:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730668602}"] Nov 3 15:16:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730668602, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:16:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.48774ms Nov 3 15:16:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.48774ms Nov 3 15:16:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:16:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:16:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:16:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730668602}"] Nov 3 15:16:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730668602, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:16:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.029661ms Nov 3 15:16:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.029661ms Nov 3 15:16:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:16:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:16:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:16:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730668602}"] Nov 3 15:16:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730668602, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:16:44 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:44-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:44 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:44-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:44 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:44-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:44 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:44-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:44 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:44-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:44 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:44-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:44 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:44-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.263399ms Nov 3 15:16:44 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:44-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.263399ms Nov 3 15:16:44 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:16:44 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:16:44 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:16:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730668602}"] Nov 3 15:16:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730668602, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:16:44 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:44-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:44 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:44-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:44 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:44-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:44 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:44-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:44 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:44-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:44 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:44-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:44 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:44-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.00776ms Nov 3 15:16:44 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:44-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.00776ms Nov 3 15:16:44 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:16:44 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:16:44 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:16:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730668602}"] Nov 3 15:16:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730668602, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:16:44 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:44-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:44 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:44-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:16:44 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:44-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:44 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:16:44-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:44 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:44-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:16:44 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:16:44-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:16:44 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:16:44-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.313904ms Nov 3 15:16:44 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:16:44-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.313904ms Nov 3 15:16:44 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:16:44 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:16:44 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:16:44 kjcf05n00 mcfcli[3673891]: %3|1730668604.676|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 15:17:14 kjcf05n00 mcfcli[3673891]: %3|1730668634.676|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 15:17:22 kjcf05n00 mcfcli[3673891]: %3|1730668642.209|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:17:30 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 15:17:44 kjcf05n00 mcfcli[3673891]: %3|1730668664.676|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 15:18:01 kjcf05n00 mcfcli[3673891]: %3|1730668681.531|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:18:14 kjcf05n00 mcfcli[3673891]: %3|1730668694.676|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:18:41 kjcf05n00 mcfcli[3673891]: %3|1730668721.265|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:18:44 kjcf05n00 mcfcli[3673891]: %3|1730668724.677|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:19:14 kjcf05n00 mcfcli[3673891]: %3|1730668754.677|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:19:19 kjcf05n00 mcfcli[3673891]: %3|1730668759.928|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:19:44 kjcf05n00 mcfcli[3673891]: %3|1730668784.677|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 15:19:57 kjcf05n00 mcfcli[3673891]: %3|1730668797.482|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 15:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 15:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 15:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 15:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 15:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 15:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 15:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 15:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 15:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 15:20:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 15:20:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:20:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 15:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 15:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 15:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 15:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 15:20:03 kjcf05n00 zabbix-server[1359809]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:20:03 kjcf05n00 zabbix-server[1359809]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46349' Nov 3 15:20:04 kjcf05n00 zabbix-server[1359809]: Filesystem 'kjcf05' has been mounted Nov 3 15:20:04 kjcf05n00 zabbix-server[1359809]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 15:20:04 kjcf05n00 zabbix-server[1359809]: Running puppet on 'None' Nov 3 15:20:06 kjcf05n05 puppet-agent[3578074]: Using configured environment 'production' Nov 3 15:20:06 kjcf05n05 puppet-agent[3578074]: Retrieving pluginfacts Nov 3 15:20:06 kjcf05n05 puppet-agent[3578074]: Retrieving plugin Nov 3 15:20:06 kjcf05n04 puppet-agent[3417520]: Using configured environment 'production' Nov 3 15:20:06 kjcf05n04 puppet-agent[3417520]: Retrieving pluginfacts Nov 3 15:20:06 kjcf05n04 puppet-agent[3417520]: Retrieving plugin Nov 3 15:20:06 kjcf05n03 puppet-agent[224352]: Using configured environment 'production' Nov 3 15:20:06 kjcf05n03 puppet-agent[224352]: Retrieving pluginfacts Nov 3 15:20:06 kjcf05n03 puppet-agent[224352]: Retrieving plugin Nov 3 15:20:06 kjcf05n02 puppet-agent[56320]: Using configured environment 'production' Nov 3 15:20:06 kjcf05n02 puppet-agent[56320]: Retrieving pluginfacts Nov 3 15:20:06 kjcf05n02 puppet-agent[56320]: Retrieving plugin Nov 3 15:20:06 kjcf05n07 puppet-agent[3412189]: Using configured environment 'production' Nov 3 15:20:06 kjcf05n07 puppet-agent[3412189]: Retrieving pluginfacts Nov 3 15:20:06 kjcf05n07 puppet-agent[3412189]: Retrieving plugin Nov 3 15:20:06 kjcf05n07 puppet-agent[3412189]: Loading facts Nov 3 15:20:06 kjcf05n06 puppet-agent[3415948]: Using configured environment 'production' Nov 3 15:20:06 kjcf05n06 puppet-agent[3415948]: Retrieving pluginfacts Nov 3 15:20:06 kjcf05n06 puppet-agent[3415948]: Retrieving plugin Nov 3 15:20:06 kjcf05n06 puppet-agent[3415948]: Loading facts Nov 3 15:20:07 kjcf05n05 puppet-agent[3578074]: Loading facts Nov 3 15:20:07 kjcf05n04 puppet-agent[3417520]: Loading facts Nov 3 15:20:07 kjcf05n01 puppet-agent[3159488]: Using configured environment 'production' Nov 3 15:20:07 kjcf05n01 puppet-agent[3159488]: Retrieving pluginfacts Nov 3 15:20:07 kjcf05n01 puppet-agent[3159488]: Retrieving plugin Nov 3 15:20:07 kjcf05n01 puppet-agent[3159488]: Loading facts Nov 3 15:20:07 kjcf05n03 puppet-agent[224352]: Loading facts Nov 3 15:20:07 kjcf05n02 puppet-agent[56320]: Loading facts Nov 3 15:20:07 kjcf05n00 puppet-agent[1359910]: Using configured environment 'production' Nov 3 15:20:07 kjcf05n00 puppet-agent[1359910]: Retrieving pluginfacts Nov 3 15:20:07 kjcf05n00 puppet-agent[1359910]: Retrieving plugin Nov 3 15:20:07 kjcf05n00 puppet-agent[1359910]: Loading facts Nov 3 15:20:09 kjcf05n03 puppet-agent[224352]: Caching catalog for kjcf05n03 Nov 3 15:20:09 kjcf05n03 puppet-agent[224352]: Applying configuration version '1730668808' Nov 3 15:20:09 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 15:20:09 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 15:20:10 kjcf05n02 puppet-agent[56320]: Caching catalog for kjcf05n02 Nov 3 15:20:10 kjcf05n02 puppet-agent[56320]: Applying configuration version '1730668808' Nov 3 15:20:10 kjcf05n06 puppet-agent[3415948]: Caching catalog for kjcf05n06 Nov 3 15:20:10 kjcf05n06 puppet-agent[3415948]: Applying configuration version '1730668808' Nov 3 15:20:10 kjcf05n07 puppet-agent[3412189]: Caching catalog for kjcf05n07 Nov 3 15:20:10 kjcf05n07 puppet-agent[3412189]: Applying configuration version '1730668808' Nov 3 15:20:11 kjcf05n01 puppet-agent[3159488]: Caching catalog for kjcf05n01 Nov 3 15:20:11 kjcf05n02 dwd[5201]: nvme9n1 passed periodic SMART status check Nov 3 15:20:11 kjcf05n02 dwd[5201]: nvme2n1 passed periodic SMART status check Nov 3 15:20:11 kjcf05n02 dwd[5201]: nvme18n1 passed periodic SMART status check Nov 3 15:20:11 kjcf05n02 dwd[5201]: nvme19n1 passed periodic SMART status check Nov 3 15:20:11 kjcf05n02 dwd[5201]: nvme3n1 passed periodic SMART status check Nov 3 15:20:11 kjcf05n01 puppet-agent[3159488]: Applying configuration version '1730668808' Nov 3 15:20:11 kjcf05n00 puppet-agent[1359910]: Caching catalog for kjcf05n00 Nov 3 15:20:11 kjcf05n00 puppet-agent[1359910]: Applying configuration version '1730668809' Nov 3 15:20:11 kjcf05n03 puppet-agent[224352]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 15:20:11 kjcf05n03 puppet-agent[224352]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 15:20:11 kjcf05n03 puppet-agent[224352]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 15:20:12 kjcf05n02 puppet-agent[56320]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 15:20:12 kjcf05n02 puppet-agent[56320]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 15:20:12 kjcf05n02 puppet-agent[56320]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 15:20:12 kjcf05n06 puppet-agent[3415948]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 15:20:12 kjcf05n06 puppet-agent[3415948]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 15:20:12 kjcf05n06 puppet-agent[3415948]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 15:20:12 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 15:20:12 kjcf05n03 zabbix_agent2[168944]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 15:20:12 kjcf05n03 zabbix_agent2[3072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 15:20:12 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 15:20:12 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 15:20:12 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 15:20:12 kjcf05n03 puppet-agent[224352]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: Press Ctrl+C to exit. Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: Plugin support version 1.0 Nov 3 15:20:12 kjcf05n03 zabbix_agent2[224715]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 15:20:12 kjcf05n02 dwd[5201]: nvme17n1 passed periodic SMART status check Nov 3 15:20:12 kjcf05n02 dwd[5201]: nvme8n1 passed periodic SMART status check Nov 3 15:20:12 kjcf05n02 dwd[5201]: nvme4n1 passed periodic SMART status check Nov 3 15:20:12 kjcf05n02 dwd[5201]: nvme24n1 passed periodic SMART status check Nov 3 15:20:12 kjcf05n02 dwd[5201]: nvme25n1 passed periodic SMART status check Nov 3 15:20:12 kjcf05n02 dwd[5201]: nvme23n1 passed periodic SMART status check Nov 3 15:20:12 kjcf05n07 puppet-agent[3412189]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 15:20:12 kjcf05n07 puppet-agent[3412189]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 15:20:12 kjcf05n07 puppet-agent[3412189]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 15:20:12 kjcf05n00 python3.9[1359904]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 15:20:12 kjcf05n00 zabbix_server[15727]: Zabbix agent item "system.cpu.util[,interrupt]" on host "kjcf05n06" failed: first network error, wait for 15 seconds Nov 3 15:20:12 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 15:20:12 kjcf05n02 zabbix_agent2[34956]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 15:20:12 kjcf05n02 zabbix_agent2[3187]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:20:12 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 15:20:12 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 15:20:12 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 15:20:12 kjcf05n02 puppet-agent[56320]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: Press Ctrl+C to exit. Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: Plugin support version 1.0 Nov 3 15:20:12 kjcf05n02 zabbix_agent2[56762]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 15:20:12 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3363906]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 15:20:12 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 15:20:12 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 15:20:12 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 15:20:12 kjcf05n06 puppet-agent[3415948]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: Press Ctrl+C to exit. Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: Plugin support version 1.0 Nov 3 15:20:12 kjcf05n06 zabbix_agent2[3416428]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 15:20:13 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3360042]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 15:20:13 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 15:20:13 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 15:20:13 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 15:20:13 kjcf05n07 puppet-agent[3412189]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: Press Ctrl+C to exit. Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: Plugin support version 1.0 Nov 3 15:20:13 kjcf05n07 zabbix_agent2[3412588]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 15:20:14 kjcf05n01 puppet-agent[3159488]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 15:20:14 kjcf05n01 puppet-agent[3159488]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-14:56:50]/mode) mode changed '0755' to '0750' Nov 3 15:20:13 kjcf05n00 puppet-agent[1359910]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 15:20:14 kjcf05n03 puppet-agent[224352]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 15:20:14 kjcf05n03 puppet-agent[224352]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 15:20:14 kjcf05n03 puppet-agent[224352]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 15:20:14 kjcf05n03 puppet-agent[224352]: Applied catalog in 5.14 seconds Nov 3 15:20:14 kjcf05n01 puppet-agent[3159488]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-14:56:50/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 15:20:14 kjcf05n01 puppet-agent[3159488]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-14:56:50/vmcore]/mode) mode changed '0600' to '0640' Nov 3 15:20:14 kjcf05n01 puppet-agent[3159488]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-14:56:50/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 15:20:14 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 15:20:14 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 15:20:14 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 15:20:14 kjcf05n06 puppet-agent[3415948]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 15:20:14 kjcf05n06 puppet-agent[3415948]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 15:20:14 kjcf05n06 puppet-agent[3415948]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 15:20:14 kjcf05n06 puppet-agent[3415948]: Applied catalog in 4.76 seconds Nov 3 15:20:14 kjcf05n02 puppet-agent[56320]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 15:20:14 kjcf05n02 puppet-agent[56320]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 15:20:14 kjcf05n02 puppet-agent[56320]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 15:20:14 kjcf05n02 puppet-agent[56320]: Applied catalog in 5.00 seconds Nov 3 15:20:14 kjcf05n07 puppet-agent[3412189]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 15:20:14 kjcf05n07 puppet-agent[3412189]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 15:20:14 kjcf05n07 puppet-agent[3412189]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 15:20:14 kjcf05n00 mcfcli[3673891]: %3|1730668814.678|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:20:15 kjcf05n01 puppet-agent[3159488]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 15:20:15 kjcf05n01 puppet-agent[3159488]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 15:20:15 kjcf05n01 puppet-agent[3159488]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 15:20:14 kjcf05n00 puppet-agent[1359910]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 15:20:14 kjcf05n00 puppet-agent[1359910]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 15:20:14 kjcf05n00 puppet-agent[1359910]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 15:20:15 kjcf05n07 puppet-agent[3412189]: Applied catalog in 4.86 seconds Nov 3 15:20:15 kjcf05n05 puppet-agent[3578074]: Caching catalog for kjcf05n05 Nov 3 15:20:15 kjcf05n05 puppet-agent[3578074]: Applying configuration version '1730668813' Nov 3 15:20:15 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3147826]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 15:20:15 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 15:20:15 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 15:20:15 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 15:20:15 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 15:20:15 kjcf05n01 puppet-agent[3159488]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: Press Ctrl+C to exit. Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: Plugin support version 1.0 Nov 3 15:20:15 kjcf05n01 zabbix_agent2[3159843]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 15:20:15 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1342051]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 15:20:16 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 15:20:15 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 15:20:15 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 15:20:15 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 15:20:15 kjcf05n00 puppet-agent[1359910]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: Press Ctrl+C to exit. Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: Plugin support version 1.0 Nov 3 15:20:15 kjcf05n00 zabbix_agent2[1360644]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 15:20:16 kjcf05n00 zabbix-server[1360674]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:20:16 kjcf05n00 zabbix-server[1360675]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:20:16 kjcf05n00 zabbix-server[1360684]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:20:17 kjcf05n00 zabbix-server[1360689]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:20:17 kjcf05n05 puppet-agent[3578074]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 15:20:17 kjcf05n05 puppet-agent[3578074]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 15:20:17 kjcf05n05 puppet-agent[3578074]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 15:20:17 kjcf05n01 puppet-agent[3159488]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_150410.log]/mode) mode changed '0644' to '0640' Nov 3 15:20:17 kjcf05n01 puppet-agent[3159488]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_151554.log]/mode) mode changed '0644' to '0640' Nov 3 15:20:17 kjcf05n01 puppet-agent[3159488]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_151554]/mode) mode changed '0755' to '0750' Nov 3 15:20:17 kjcf05n01 puppet-agent[3159488]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_151554/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 15:20:17 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3519175]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 15:20:17 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 15:20:17 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 15:20:17 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 15:20:17 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 15:20:17 kjcf05n05 puppet-agent[3578074]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: Press Ctrl+C to exit. Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: Plugin support version 1.0 Nov 3 15:20:17 kjcf05n05 zabbix_agent2[3578855]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 15:20:17 kjcf05n00 puppet-agent[1359910]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 15:20:18 kjcf05n01 puppet-agent[3159488]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_150410.log]/mode) mode changed '0644' to '0640' Nov 3 15:20:18 kjcf05n01 puppet-agent[3159488]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_151554.log]/mode) mode changed '0644' to '0640' Nov 3 15:20:18 kjcf05n01 puppet-agent[3159488]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 15:20:18 kjcf05n01 puppet-agent[3159488]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 15:20:18 kjcf05n01 puppet-agent[3159488]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 15:20:18 kjcf05n00 puppet-agent[1359910]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 15:20:18 kjcf05n00 puppet-agent[1359910]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 15:20:18 kjcf05n00 puppet-agent[1359910]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 15:20:19 kjcf05n05 puppet-agent[3578074]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 15:20:19 kjcf05n05 puppet-agent[3578074]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 15:20:19 kjcf05n05 puppet-agent[3578074]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 15:20:19 kjcf05n01 puppet-agent[3159488]: Applied catalog in 8.91 seconds Nov 3 15:20:19 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 15:20:19 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 15:20:19 kjcf05n00 puppet-agent[1359910]: Applied catalog in 8.40 seconds Nov 3 15:20:20 kjcf05n05 puppet-agent[3578074]: Applied catalog in 4.80 seconds Nov 3 15:20:22 kjcf05n04 puppet-agent[3417520]: Caching catalog for kjcf05n04 Nov 3 15:20:22 kjcf05n04 puppet-agent[3417520]: Applying configuration version '1730668819' Nov 3 15:20:23 kjcf05n04 puppet-agent[3417520]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 15:20:23 kjcf05n04 puppet-agent[3417520]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 15:20:23 kjcf05n04 puppet-agent[3417520]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 15:20:24 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3359800]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 15:20:24 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 15:20:24 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 15:20:24 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 15:20:24 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 15:20:24 kjcf05n04 puppet-agent[3417520]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: Press Ctrl+C to exit. Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: Plugin support version 1.0 Nov 3 15:20:24 kjcf05n04 zabbix_agent2[3418367]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 15:20:26 kjcf05n04 puppet-agent[3417520]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 15:20:26 kjcf05n04 puppet-agent[3417520]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 15:20:26 kjcf05n04 puppet-agent[3417520]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 15:20:26 kjcf05n00 zabbix-server[1359809]: puppet completed status:(0): '' Nov 3 15:20:26 kjcf05n00 zabbix-server[1359809]: Event '46349' acknowledged Nov 3 15:20:26 kjcf05n00 zabbix-server[1359809]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 3 15:20:26 kjcf05n04 puppet-agent[3417520]: Applied catalog in 4.74 seconds Nov 3 15:20:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730668826', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 15:20:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730668826'} Nov 3 15:20:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:20:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730668826', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 15:20:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730668826'} Nov 3 15:20:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:20:29 kjcf05n00 zabbix_server[15783]: resuming Zabbix agent checks on host "kjcf05n06": connection restored Nov 3 15:20:34 kjcf05n00 mcfcli[3673891]: %3|1730668834.769|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:20:44 kjcf05n00 mcfcli[3673891]: %3|1730668844.679|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 15:21:14 kjcf05n00 mcfcli[3673891]: %3|1730668874.511|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:21:14 kjcf05n00 mcfcli[3673891]: %3|1730668874.679|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 15:21:44 kjcf05n00 mcfcli[3673891]: %3|1730668904.680|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:21:54 kjcf05n00 mcfcli[3673891]: %3|1730668914.508|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:22:15 kjcf05n00 mcfcli[3673891]: %3|1730668935.179|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 15:22:31 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 15:22:34 kjcf05n00 mcfcli[3673891]: %3|1730668954.505|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:22:45 kjcf05n00 mcfcli[3673891]: %3|1730668965.179|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:23:10 kjcf05n00 mcfcli[3673891]: %3|1730668990.644|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:23:15 kjcf05n00 mcfcli[3673891]: %3|1730668995.179|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 15:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T21:23:15.868419Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 15:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T21:23:15.868478Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.081ms Nov 3 15:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T15:23:27.25316976-06:00 level=info msg="Completed cleanup jobs" duration=26.705535ms Nov 3 15:23:45 kjcf05n00 mcfcli[3673891]: %3|1730669025.179|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 15:23:49 kjcf05n00 mcfcli[3673891]: %3|1730669029.854|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:24:10 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 3 15:24:10 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 10 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007760 sec, idle for 1 hour(s)] Nov 3 15:24:15 kjcf05n00 mcfcli[3673891]: %3|1730669055.180|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:24:25 kjcf05n03 nslcd[6915]: [0e0f76] ldap_result() failed: Can't contact LDAP server Nov 3 15:24:25 kjcf05n03 nslcd[6915]: [52255a] ldap_result() failed: Can't contact LDAP server Nov 3 15:24:28 kjcf05n00 mcfcli[3673891]: %3|1730669068.153|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:24:45 kjcf05n00 mcfcli[3673891]: %3|1730669085.180|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 15:25:08 kjcf05n00 mcfcli[3673891]: %3|1730669108.150|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:25:12 kjcf05n00 python3.9[1363360]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 15:25:15 kjcf05n00 mcfcli[3673891]: %3|1730669115.180|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 15:25:45 kjcf05n00 mcfcli[3673891]: %3|1730669145.181|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:25:46 kjcf05n00 mcfcli[3673891]: %3|1730669146.315|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:26:15 kjcf05n00 mcfcli[3673891]: %3|1730669175.183|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:26:24 kjcf05n00 mcfcli[3673891]: %3|1730669184.506|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 15:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 15:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 15:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 15:26:45 kjcf05n00 mcfcli[3673891]: %3|1730669205.184|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 15:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 15:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 15:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 15:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 15:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 15:26:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 15:26:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 15:27:00 kjcf05n00 zabbix_server[15753]: Zabbix agent item "system.uptime" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 3 15:27:02 kjcf05n00 mcfcli[3673891]: %3|1730669222.392|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:27:02 kjcf05n00 zabbix_server[15782]: Zabbix agent item "dcs.lustre.device.ost.count[{$LUSTRE_FS_NAME}]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 3 15:27:05 kjcf05n03 fstonithd.py[15308]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 3 15:27:05 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 15:27:05 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 15:27:05 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 15:27:07 kjcf05n03 root[235830]: is_viking_off starts Nov 3 15:27:07 kjcf05n03 root[235829]: is_enc_ipmi_off starts Nov 3 15:27:07 kjcf05n03 root[235850]: is_lan_ipmi_off leaves Nov 3 15:27:07 kjcf05n03 root[235852]: is_lan_ipmi_sec_off leaves Nov 3 15:27:07 kjcf05n03 root[235857]: I am in slot 1; partner is in slot 0 Nov 3 15:27:07 kjcf05n03 root[235858]: I am master Nov 3 15:27:11 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='107', error='Connection reset by peer (104)' Nov 3 15:27:11 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='107', client='AF_INET(172.16.2.5:42383)', local='AF_INET(0.0.0.0:601)' Nov 3 15:27:14 kjcf05n03 root[236117]: is_viking_off leaves Nov 3 15:27:14 kjcf05n03 root[236120]: kjcf05n02 not already off look at kdump Nov 3 15:27:14 kjcf05n03 root[236121]: is_kdump_off starts Nov 3 15:27:14 kjcf05n03 fence_kdump[236122]: waiting for message from '172.16.2.5' Nov 3 15:27:15 kjcf05n03 fence_kdump[236122]: received valid message from '172.16.2.5' Nov 3 15:27:15 kjcf05n03 root[236137]: is_kdump_off detected kdump on kjcf05n02 Nov 3 15:27:15 kjcf05n03 root[236138]: kjcf05n02 is kdumping Nov 3 15:27:15 kjcf05n03 root[236273]: is_viking_off starts Nov 3 15:27:15 kjcf05n03 root[236274]: is_enc_ipmi_off starts Nov 3 15:27:15 kjcf05n03 root[236292]: is_lan_ipmi_sec_off leaves Nov 3 15:27:15 kjcf05n03 root[236294]: is_lan_ipmi_off leaves Nov 3 15:27:15 kjcf05n03 root[236297]: I am in slot 1; partner is in slot 0 Nov 3 15:27:15 kjcf05n03 root[236300]: I am master Nov 3 15:27:15 kjcf05n00 mcfcli[3673891]: %3|1730669235.328|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 15:27:15 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.users.num" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 15:27:16 kjcf05n00 zabbix_server[15750]: Zabbix agent item "vfs.file.contents["/sys/class/net/ib0/operstate"]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 15:27:17 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.discovery[{$LUSTRE_FS_NAME},mdt]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 15:27:17 kjcf05n00 zabbix_server[15774]: Zabbix agent item "vfs.fs.size[/var/lib/reboot_cnt,pused]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 15:27:21 kjcf05n03 root[236435]: is_viking_off leaves Nov 3 15:27:21 kjcf05n03 root[236438]: kjcf05n02 not already off look at kdump Nov 3 15:27:21 kjcf05n03 root[236439]: is_kdump_off starts Nov 3 15:27:21 kjcf05n03 fence_kdump[236440]: waiting for message from '172.16.2.5' Nov 3 15:27:21 kjcf05n03 fence_kdump[236440]: received valid message from '172.16.2.5' Nov 3 15:27:22 kjcf05n03 root[236441]: is_kdump_off detected kdump on kjcf05n02 Nov 3 15:27:22 kjcf05n03 root[236442]: kjcf05n02 is kdumping Nov 3 15:27:23 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 15:27:23 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 15:27:26 kjcf05n03 dwd[5164]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 15:27:26 kjcf05n03 dwd[5164]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 15:27:26 kjcf05n03 dwd[5164]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 15:27:26 kjcf05n03 dwd[5164]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 15:27:26 kjcf05n03 dwd[5164]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 15:27:26 kjcf05n03 dwd[5164]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 15:27:26 kjcf05n03 dwd[5164]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 15:27:26 kjcf05n03 dwd[5164]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 15:27:26 kjcf05n03 dwd[5164]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 15:27:26 kjcf05n03 dwd[5164]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 15:27:26 kjcf05n03 dwd[5164]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 15:27:26 kjcf05n03 dwd[5164]: Starting NVME thread for nvme4n1 Nov 3 15:27:27 kjcf05n03 dwd[5164]: Starting NVME thread for nvme18n1 Nov 3 15:27:27 kjcf05n03 dwd[5164]: Starting NVME thread for nvme23n1 Nov 3 15:27:27 kjcf05n03 dwd[5164]: Starting NVME thread for nvme2n1 Nov 3 15:27:27 kjcf05n03 dwd[5164]: Starting NVME thread for nvme19n1 Nov 3 15:27:27 kjcf05n03 dwd[5164]: Starting NVME thread for nvme25n1 Nov 3 15:27:27 kjcf05n03 dwd[5164]: Starting NVME thread for nvme3n1 Nov 3 15:27:28 kjcf05n03 dwd[5164]: Starting NVME thread for nvme8n1 Nov 3 15:27:28 kjcf05n03 dwd[5164]: Starting NVME thread for nvme9n1 Nov 3 15:27:28 kjcf05n03 dwd[5164]: Starting NVME thread for nvme24n1 Nov 3 15:27:28 kjcf05n03 dwd[5164]: Starting NVME thread for nvme17n1 Nov 3 15:27:28 kjcf05n03 systemd-udevd[238825]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238829]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238826]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238830]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238826]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238830]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238829]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238825]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238826]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238830]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238829]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238825]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238826]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238830]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238825]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238829]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238846]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238847]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238826]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238829]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238851]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238849]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238846]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238830]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238825]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238826]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238829]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238830]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238851]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238847]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238846]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238849]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238826]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238830]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238829]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238851]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238847]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238849]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238826]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238829]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238830]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238847]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238849]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238830]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:27:28 kjcf05n03 systemd-udevd[238829]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:27:29 kjcf05n03 systemd-udevd[238830]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:27:29 kjcf05n03 systemd-udevd[238851]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 15:27:29 kjcf05n03 systemd-udevd[238847]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:27:29 kjcf05n03 systemd-udevd[238829]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:27:29 kjcf05n03 systemd-udevd[238830]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:27:29 kjcf05n03 systemd-udevd[238851]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:27:29 kjcf05n03 systemd-udevd[238829]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 15:27:29 kjcf05n03 systemd-udevd[238826]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 15:27:29 kjcf05n03 systemd-udevd[238830]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 15:27:29 kjcf05n03 systemd-udevd[238826]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 15:27:29 kjcf05n03 systemd-udevd[238826]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 15:27:29 kjcf05n03 systemd-udevd[238830]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:27:29 kjcf05n03 systemd-udevd[238826]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 15:27:29 kjcf05n03 systemd-udevd[238830]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 15:27:29 kjcf05n03 systemd-udevd[238826]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:27:29 kjcf05n03 systemd-udevd[238830]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 15:27:29 kjcf05n03 systemd-udevd[238826]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:27:29 kjcf05n03 systemd-udevd[238826]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:27:29 kjcf05n03 systemd-udevd[238826]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:27:32 kjcf05n03 diskmonitor[17700]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 15:27:32 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vm.memory.size[total]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 15:27:32 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.mdt.name[MDT0000,mdt_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 15:27:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 15:27:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 15:27:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 15:27:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 15:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 15:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 15:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 15:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 15:27:39 kjcf05n00 mcfcli[3673891]: %3|1730669259.032|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:27:39 kjcf05n03 diskmonitor[17700]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 15:27:39 kjcf05n03 diskmonitor[17700]: Scan for ReadErrorMax change for md65 Nov 3 15:27:39 kjcf05n03 diskmonitor[17700]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 15:27:39 kjcf05n03 diskmonitor[17700]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 15:27:39 kjcf05n03 diskmonitor[17700]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.min.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 15:27:39 kjcf05n03 diskmonitor[17700]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.max.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 15:27:39 kjcf05n03 diskmonitor[17700]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 15:27:39 kjcf05n03 diskmonitor[17700]: Set sync_speed_min (10000) for md65 Nov 3 15:27:39 kjcf05n03 diskmonitor[17700]: Set sync_speed_max (200000) for md65 Nov 3 15:27:39 kjcf05n03 diskmonitor[17700]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 15:27:45 kjcf05n00 mcfcli[3673891]: %3|1730669265.328|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 15:27:47 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 3 15:27:47 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 3 15:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 15:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 15:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 15:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 15:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 15:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 15:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 15:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 15:28:15 kjcf05n00 mcfcli[3673891]: %3|1730669295.685|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 15:28:19 kjcf05n00 mcfcli[3673891]: %3|1730669299.029|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:28:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 15:28:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 15:28:36 kjcf05n03 nslcd[6915]: [9cf92e] ldap_result() failed: Can't contact LDAP server Nov 3 15:28:36 kjcf05n03 nslcd[6915]: [ed7263] ldap_result() failed: Can't contact LDAP server Nov 3 15:28:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 15:28:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 15:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 15:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 15:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 15:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 15:28:38 kjcf05n03 nslcd[6915]: [dcc233] ldap_result() failed: Can't contact LDAP server Nov 3 15:28:45 kjcf05n00 mcfcli[3673891]: %3|1730669325.685|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 15:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 15:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 15:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 15:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 15:28:56 kjcf05n00 mcfcli[3673891]: %3|1730669336.712|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 15:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 15:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 15:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 15:29:15 kjcf05n00 mcfcli[3673891]: %3|1730669355.685|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 15:29:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 15:29:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 15:29:36 kjcf05n00 mcfcli[3673891]: %3|1730669376.709|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:29:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 15:29:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 15:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 15:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 15:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 15:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 15:29:45 kjcf05n00 mcfcli[3673891]: %3|1730669385.686|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 15:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 15:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 15:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 15:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 15:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 15:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 15:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 15:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 15:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 15:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 15:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 15:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 15:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 15:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 15:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 15:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 15:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 15:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 15:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 15:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 15:30:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 15:30:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:30:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 15:30:10 kjcf05n00 zabbix-server[1366364]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:30:10 kjcf05n00 zabbix-server[1366364]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 15:30:10 kjcf05n00 log_interesting_event.py[1366364]: Event '46352' acknowledged Nov 3 15:30:13 kjcf05n00 mcfcli[3673891]: %3|1730669413.048|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:30:15 kjcf05n00 mcfcli[3673891]: %3|1730669415.686|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 15:30:17 kjcf05n00 python3.9[1366365]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 15:30:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730669430', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 15:30:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730669430'} Nov 3 15:30:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:30:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730669430', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 15:30:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730669430'} Nov 3 15:30:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:30:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 15:30:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 15:30:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 15:30:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 15:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 15:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 15:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 15:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 15:30:45 kjcf05n00 mcfcli[3673891]: %3|1730669445.686|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 15:30:52 kjcf05n00 mcfcli[3673891]: %3|1730669452.124|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:30:54 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 3 15:30:54 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 15:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 15:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 15:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 15:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 15:30:58 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 15:30:58 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 3 15:30:58 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 3 15:30:58 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 15:30:58 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 15:30:58 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 3 15:30:58 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 3 15:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 15:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 15:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 15:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 15:31:02 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 3 15:31:05 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 3 15:31:15 kjcf05n00 mcfcli[3673891]: %3|1730669475.686|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:31:25 kjcf05n00 mcfcli[3673891]: %3|1730669485.866|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:31:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 15:31:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 15:31:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 15:31:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 15:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 15:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 15:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 15:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 15:31:42 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 15:31:45 kjcf05n00 mcfcli[3673891]: %3|1730669505.687|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 15:31:52 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:58084). Nov 3 15:31:52 kjcf05n01 rsyncd[3164243]: connect from kjcf05n02 (172.16.2.5) Nov 3 15:31:52 kjcf05n01 rsyncd[3164243]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 15:31:52 kjcf05n01 rsyncd[3164243]: building file list Nov 3 15:31:52 kjcf05n01 rsyncd[3164243]: sent 11450 bytes received 136 bytes total size 10905 Nov 3 15:31:52 kjcf05n01 systemd[1]: rsyncd@639-172.16.2.2:873-172.16.2.5:58084.service: Succeeded. Nov 3 15:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 15:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 15:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 15:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 15:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 15:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 15:31:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 15:31:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 15:32:02 kjcf05n00 mcfcli[3673891]: %3|1730669522.257|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:32:05 kjcf05n03 fstonithd.py[15308]: Listening for kdump packets from partner Nov 3 15:32:15 kjcf05n00 mcfcli[3673891]: %3|1730669535.687|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:32:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 15:32:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 15:32:33 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 15:32:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 15:32:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 15:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 15:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 15:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 15:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 15:32:38 kjcf05n00 mcfcli[3673891]: %3|1730669558.466|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:32:41 kjcf05n03 dwd[5164]: nvme4n1 passed periodic SMART status check Nov 3 15:32:42 kjcf05n03 dwd[5164]: nvme3n1 passed periodic SMART status check Nov 3 15:32:42 kjcf05n03 dwd[5164]: nvme25n1 passed periodic SMART status check Nov 3 15:32:42 kjcf05n03 dwd[5164]: nvme23n1 passed periodic SMART status check Nov 3 15:32:42 kjcf05n03 dwd[5164]: nvme2n1 passed periodic SMART status check Nov 3 15:32:42 kjcf05n03 dwd[5164]: nvme18n1 passed periodic SMART status check Nov 3 15:32:42 kjcf05n03 dwd[5164]: nvme19n1 passed periodic SMART status check Nov 3 15:32:43 kjcf05n03 dwd[5164]: nvme8n1 passed periodic SMART status check Nov 3 15:32:43 kjcf05n03 dwd[5164]: nvme9n1 passed periodic SMART status check Nov 3 15:32:43 kjcf05n03 dwd[5164]: nvme24n1 passed periodic SMART status check Nov 3 15:32:43 kjcf05n03 dwd[5164]: nvme17n1 passed periodic SMART status check Nov 3 15:32:45 kjcf05n00 mcfcli[3673891]: %3|1730669565.687|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:32:46 kjcf05n00 zabbix-server[1367991]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:32:46 kjcf05n00 zabbix-server[1367991]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 169.38\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 119.41\\"}}"' Nov 3 15:32:46 kjcf05n00 log_interesting_event.py[1367991]: Event '46353' acknowledged Nov 3 15:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 15:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 15:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 15:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 15:32:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 15:32:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 15:32:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 15:32:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 15:33:15 kjcf05n00 mcfcli[3673891]: %3|1730669595.687|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:33:18 kjcf05n00 mcfcli[3673891]: %3|1730669598.463|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:33:20 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='30', client='AF_INET(172.16.2.5:39945)', local='AF_INET(0.0.0.0:601)' Nov 3 15:33:20 kjcf05n02 syslog-ng[3182]: Configuration reload request received, reloading configuration; Nov 3 15:33:20 kjcf05n02 syslog-ng[3182]: Configuration reload finished; Nov 3 15:33:20 kjcf05n02 syslog-ng[3182]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 15:33:20 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 3 15:33:20 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 15:33:20 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 3 15:33:20 kjcf05n02 dracut: Self testing crypto algorithms Nov 3 15:33:20 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 3 15:33:20 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 15:33:20 kjcf05n02 Copying live image to RAM... Nov 3 15:33:20 kjcf05n02 (this may take a minute) Nov 3 15:33:20 kjcf05n02 Done copying live image to RAM. Nov 3 15:33:20 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 15:33:20 kjcf05n02 dracut: Checking integrity of kernel Nov 3 15:33:20 kjcf05n02 dracut: All initrd crypto checks done Nov 3 15:33:20 kjcf05n02 dracut: Switching root Nov 3 15:33:20 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 15:33:20 kjcf05n02 systemd: Detected architecture x86-64. Nov 3 15:33:20 kjcf05n02 systemd: Set hostname to . Nov 3 15:33:20 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 15:33:20 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 15:33:20 kjcf05n02 systemd: Reached target Swap. Nov 3 15:33:20 kjcf05n02 systemd: Started Dispatch Password Requests to Console Directory Watch. Nov 3 15:33:20 kjcf05n02 systemd: Created slice system-serial\x2dgetty.slice. Nov 3 15:33:20 kjcf05n02 systemd: Reached target ZFS pool import target. Nov 3 15:33:20 kjcf05n02 systemd: Set up automount Arbitrary Executable File Formats File System Automount Point. Nov 3 15:33:20 kjcf05n02 systemd-journald[1526]: Journal started Nov 3 15:33:20 kjcf05n02 systemd-journald[1526]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 15:33:20 kjcf05n02 systemd-modules-load[1523]: Inserted module 'fuse' Nov 3 15:33:20 kjcf05n02 systemd[1]: Mounted /WIBS. Nov 3 15:33:20 kjcf05n02 systemd[1]: Mounted Kernel Debug File System. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Load Kernel Modules. Nov 3 15:33:20 kjcf05n02 systemd[1]: Mounted /mnt. Nov 3 15:33:20 kjcf05n02 systemd[1]: Mounted /data. Nov 3 15:33:20 kjcf05n02 systemd[1]: Mounted POSIX Message Queue File System. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Create list of required static device nodes for the current kernel. Nov 3 15:33:20 kjcf05n02 systemd[1]: Mounted Temporary Directory (/tmp). Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Apply Kernel Variables... Nov 3 15:33:20 kjcf05n02 systemd[1]: Mounting FUSE Control File System... Nov 3 15:33:20 kjcf05n02 systemd[1]: Mounting Kernel Configuration File System... Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Rebuild Hardware Database... Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Create System Users... Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Load/Save Random Seed... Nov 3 15:33:20 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 3 15:33:20 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 3 15:33:20 kjcf05n02 systemd-sysctl[1542]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 15:33:20 kjcf05n02 systemd-sysctl[1542]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 3 15:33:20 kjcf05n02 systemd-journald[1526]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Create System Users. Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 15:33:20 kjcf05n02 systemd-tmpfiles[1556]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:33:20 kjcf05n02 systemd-tmpfiles[1556]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 3 15:33:20 kjcf05n02 systemd-udevd[1562]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 3 15:33:20 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 3 15:33:20 kjcf05n02 systemd-udevd[1566]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:33:20 kjcf05n02 systemd-udevd[1591]: Using default interface naming scheme 'rhel-8.0'. Nov 3 15:33:20 kjcf05n02 systemd-udevd[1591]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:33:20 kjcf05n02 systemd-udevd[1618]: Using default interface naming scheme 'rhel-8.0'. Nov 3 15:33:20 kjcf05n02 systemd-udevd[1618]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:33:20 kjcf05n02 systemd-udevd[1573]: Using default interface naming scheme 'rhel-8.0'. Nov 3 15:33:20 kjcf05n02 systemd-udevd[1573]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 15:33:20 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 3 15:33:20 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 3 15:33:20 kjcf05n02 root[1812]: openibd: running in auto mode Nov 3 15:33:20 kjcf05n02 systemd-tmpfiles[1802]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:33:20 kjcf05n02 systemd-tmpfiles[1802]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 15:33:20 kjcf05n02 systemd-tmpfiles[1802]: "/var/tmp" already exists and is not a directory. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 15:33:20 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 3 15:33:20 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 15:33:20 kjcf05n02 systemd-modules-load[1854]: Inserted module 'ib_iser' Nov 3 15:33:20 kjcf05n02 systemd-modules-load[1854]: Inserted module 'ib_isert' Nov 3 15:33:20 kjcf05n02 systemd-modules-load[1854]: Inserted module 'ib_srpt' Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 15:33:20 kjcf05n02 systemd-udevd[1615]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:33:20 kjcf05n02 systemd-modules-load[1861]: Inserted module 'ib_ipoib' Nov 3 15:33:20 kjcf05n02 systemd-udevd[1607]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started RPC Bind. Nov 3 15:33:20 kjcf05n02 systemd-modules-load[1854]: Inserted module 'rdma_ucm' Nov 3 15:33:20 kjcf05n02 systemd-modules-load[1854]: Module 'svcrdma' is blacklisted Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 15:33:20 kjcf05n02 systemd-udevd[1615]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 15:33:20 kjcf05n02 systemd-udevd[1607]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 15:33:20 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 15:33:20 kjcf05n02 systemd-modules-load[1861]: Inserted module 'ib_umad' Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 15:33:20 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 15:33:20 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 3 15:33:20 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 3 15:33:20 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 15:33:20 kjcf05n02 openibd[1793]: Loading HCA driver and Access Layer:[ OK ] Nov 3 15:33:20 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Update is Completed. Nov 3 15:33:20 kjcf05n02 setup-icl[1768]: Setting LAN IP Address to 203.0.113.3 Nov 3 15:33:20 kjcf05n02 setup-icl[1768]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 15:33:20 kjcf05n02 setup-icl[1768]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 15:33:20 kjcf05n02 setup-icl[1768]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 15:33:20 kjcf05n02 systemd-udevd[1615]: Using default interface naming scheme 'rhel-8.0'. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 15:33:20 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 15:33:20 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 3 15:33:20 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 15:33:20 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 15:33:20 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 15:33:20 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 15:33:20 kjcf05n02 systemd[1]: Reached target Sockets. Nov 3 15:33:20 kjcf05n02 systemd[1]: Reached target Basic System. Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 3 15:33:20 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 3 15:33:20 kjcf05n02 nscd[2125]: 2125 monitoring file `/etc/hosts` (1) Nov 3 15:33:20 kjcf05n02 nscd[2125]: 2125 monitoring directory `/etc` (2) Nov 3 15:33:20 kjcf05n02 nscd[2125]: 2125 monitoring file `/etc/resolv.conf` (3) Nov 3 15:33:20 kjcf05n02 nscd[2125]: 2125 monitoring directory `/etc` (2) Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 15:33:20 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 3 15:33:20 kjcf05n02 chronyd[2147]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 15:33:20 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 15:33:20 kjcf05n02 network[2135]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 15:33:20 kjcf05n02 dbus-daemon[2124]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 0 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 1 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 2 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 3 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 4 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 5 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 6 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 7 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 8 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 9 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 10 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 11 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 12 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 13 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 14 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 15 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 16 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 17 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 18 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 19 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 20 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 21 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 22 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 23 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 24 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 25 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 26 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 27 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 28 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 29 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 30 Nov 3 15:33:20 kjcf05n02 cpupower[2179]: Setting cpu: 31 Nov 3 15:33:20 kjcf05n02 network[2165]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 15:33:20 kjcf05n02 network[2135]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:33:20 kjcf05n02 beSetMlxConfig[2170]: ConnectX-3 multiport not detected Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[2173]: Setting up Mellanox network interface: ib0 Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 15:33:20 kjcf05n02 mcelog[2191]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 15:33:20 kjcf05n02 mcelog[2191]: CPU is unsupported Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 15:33:20 kjcf05n02 dwd[2180]: dwd: vMay 29 2024 : 15:38:26 Nov 3 15:33:20 kjcf05n02 dwd[2180]: /usr/sbin/dwd -d --standalone=0 Nov 3 15:33:20 kjcf05n02 dwd[2180]: dwd: option Lethal: 0 Nov 3 15:33:20 kjcf05n02 dwd[2180]: dwd: option Interval: 60 Nov 3 15:33:20 kjcf05n02 dwd[2180]: dwd: option abrtlimit: 10 Nov 3 15:33:20 kjcf05n02 dwd[2180]: dwd: option DZPeriod: 604800 Nov 3 15:33:20 kjcf05n02 dwd[2180]: dwd: option SmartPeriod: 43200 Nov 3 15:33:20 kjcf05n02 dwd[2180]: dwd: option SDDEnabled: 1 Nov 3 15:33:20 kjcf05n02 dwd[2180]: dwd: option SDDAwaitScale: 3 Nov 3 15:33:20 kjcf05n02 dwd[2180]: dwd: option SDDAwaitMin: 100 Nov 3 15:33:20 kjcf05n02 dwd[2180]: dwd: option Verbosity: 1 Nov 3 15:33:20 kjcf05n02 dwd[2180]: dwd: option StandAlone: 0 Nov 3 15:33:20 kjcf05n02 dwd[2180]: option Lethal: 0 Nov 3 15:33:20 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 15:33:20 kjcf05n02 dwd[2180]: option Interval: 60 Nov 3 15:33:20 kjcf05n02 dwd[2180]: option abrtlimit: 10 Nov 3 15:33:20 kjcf05n02 dwd[2180]: option DZPeriod: 604800 Nov 3 15:33:20 kjcf05n02 dwd[2180]: option SmartPeriod: 43200 Nov 3 15:33:20 kjcf05n02 dwd[2180]: option SDDEnabled: 1 Nov 3 15:33:20 kjcf05n02 dwd[2180]: option SDDAwaitScale: 3 Nov 3 15:33:20 kjcf05n02 dwd[2180]: option SDDAwaitMin: 100 Nov 3 15:33:20 kjcf05n02 dwd[2180]: option Verbosity: 1 Nov 3 15:33:20 kjcf05n02 dwd[2180]: option StandAlone: 0 Nov 3 15:33:20 kjcf05n02 network[2183]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:33:20 kjcf05n02 network[2135]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 15:33:20 kjcf05n02 chronyd[2147]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 15:33:20 kjcf05n02 chronyd[2147]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[2215]: Setting up Mellanox network interface: ib1 Nov 3 15:33:20 kjcf05n02 network[2224]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 15:33:20 kjcf05n02 beSetMlxConfig[2170]: Starting MST (Mellanox Software Tools) driver set Nov 3 15:33:20 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[2264]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 3 15:33:20 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 15:33:20 kjcf05n02 mdraid-phy[2280]: no Cutlass to worry about Nov 3 15:33:20 kjcf05n02 sssd[sssd][2119]: Starting up Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[2300]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 15:33:20 kjcf05n02 beSetMlxConfig[2170]: Loading MST PCI module - Success Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 0 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 1 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 2 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 3 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 4 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 5 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 6 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 7 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 8 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 9 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 10 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 11 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 12 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 13 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 14 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 15 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 16 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 17 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 18 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 19 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 20 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 21 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 22 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 23 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 24 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 25 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 26 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 27 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 28 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 29 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 30 Nov 3 15:33:20 kjcf05n02 cpupower[2319]: Idlestate 2 disabled on CPU 31 Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[2310]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 15:33:20 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 15:33:20 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[2327]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 15:33:20 kjcf05n02 beSetMlxConfig[2170]: Loading MST PCI configuration module - Success Nov 3 15:33:20 kjcf05n02 beSetMlxConfig[2170]: Create devices Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[2328]: No configuration found for ib0 Nov 3 15:33:20 kjcf05n02 dbus-daemon[2124]: [system] Successfully activated service 'org.freedesktop.systemd1' Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[2332]: No configuration found for ib1 Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[2338]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[2364]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 15:33:20 kjcf05n02 mlnx_conf_mgr[2392]: INFO: No configurations found for mlx5_0, skipping. Nov 3 15:33:20 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 15:33:20 kjcf05n02 mlnx_conf_mgr[2419]: INFO: No configurations found for mlx5_1, skipping. Nov 3 15:33:20 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 15:33:20 kjcf05n02 sssd[be[implicit_files]][2339]: Starting up Nov 3 15:33:20 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 15:33:20 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 15:33:20 kjcf05n02 sssd[nss][2506]: Starting up Nov 3 15:33:20 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 15:33:20 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Login Service... Nov 3 15:33:20 kjcf05n02 systemd-logind[2611]: New seat seat0. Nov 3 15:33:20 kjcf05n02 systemd-logind[2611]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Login Service. Nov 3 15:33:20 kjcf05n02 python3.9[2246]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 15:33:20 kjcf05n02 python3.9[3182]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 15:33:20 kjcf05n02 systemd-sysctl[2789]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 15:33:20 kjcf05n02 systemd-sysctl[2789]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 15:33:20 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 15:33:20 kjcf05n02 network[2135]: Bringing up loopback interface: [ OK ] Nov 3 15:33:20 kjcf05n02 systemd-sysctl[3121]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 15:33:20 kjcf05n02 systemd-sysctl[3121]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 15:33:20 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 3 15:33:20 kjcf05n02 systemd[1]: Reached target Network. Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 15:33:20 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 3 15:33:20 kjcf05n02 python3.9[3026]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 15:33:20 kjcf05n02 python3.9[3182]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 15:33:20 kjcf05n02 sm-notify[3166]: Version 2.3.3 starting Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 15:33:20 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 3 15:33:20 kjcf05n02 sshd[3175]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 15:33:20 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 15:33:20 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 3 15:33:20 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 15:33:20 kjcf05n02 lldpad[3192]: setsockopt nearest_bridge: Invalid argument Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 15:33:20 kjcf05n02 lldpad[3192]: setsockopt nearest_bridge: Invalid argument Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 3 15:33:20 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 3 15:33:20 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 15:33:20 kjcf05n02 syslog-ng[3182]: [2024-11-03T21:32:06.243065] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 15:33:20 kjcf05n02 syslog-ng[3182]: [2024-11-03T21:32:06.243400] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 15:33:20 kjcf05n02 syslog-ng[3182]: [2024-11-03T21:32:06.243438] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 15:33:20 kjcf05n02 syslog-ng[3182]: [2024-11-03T21:32:06.243986] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 15:33:20 kjcf05n02 syslog-ng[3182]: [2024-11-03T21:32:06.244209] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 15:33:20 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 3 15:33:20 kjcf05n02 beSetMlxConfig[2170]: Unloading MST PCI module (unused) - Success Nov 3 15:33:20 kjcf05n02 python3.9[3218]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 15:33:20 kjcf05n02 python3.9[3182]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 15:33:20 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 15:33:20 kjcf05n02 python3.9[3444]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 15:33:20 kjcf05n02 python3.9[3182]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 15:33:20 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 15:33:20 kjcf05n02 python3.9[3447]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 15:33:20 kjcf05n02 python3.9[3182]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 15:33:20 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 15:33:20 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 15:33:20 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 15:33:20 kjcf05n02 chronyd[2147]: System's initial offset : 0.008184 seconds slow of true (slew) Nov 3 15:33:20 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 15:33:20 kjcf05n02 beSetMlxConfig[2170]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 15:33:20 kjcf05n02 beSetMlxConfig[2170]: ib mode Nov 3 15:33:20 kjcf05n02 root[3467]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 3 15:33:20 kjcf05n02 root[3469]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 3 15:33:20 kjcf05n02 beSetMlxConfig[2170]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 15:33:20 kjcf05n02 beSetMlxConfig[2170]: ib mode Nov 3 15:33:20 kjcf05n02 systemd-udevd[1562]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 15:33:20 kjcf05n02 systemd-udevd[3483]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:33:20 kjcf05n02 systemd-udevd[3484]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:33:20 kjcf05n02 systemd-udevd[3487]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:33:20 kjcf05n02 systemd-udevd[3490]: Using default interface naming scheme 'rhel-8.0'. Nov 3 15:33:20 kjcf05n02 systemd-udevd[3490]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:33:20 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 15:33:20 kjcf05n02 systemd[3182]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:20 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[3526]: Setting up Mellanox network interface: ib0 Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[3525]: Setting up Mellanox network interface: ib1 Nov 3 15:33:20 kjcf05n02 systemd-udevd[3486]: Using default interface naming scheme 'rhel-8.0'. Nov 3 15:33:20 kjcf05n02 systemd-udevd[3485]: Using default interface naming scheme 'rhel-8.0'. Nov 3 15:33:20 kjcf05n02 systemd-udevd[3486]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:33:20 kjcf05n02 systemd-udevd[3485]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[3580]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[3581]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[3605]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[3607]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[3608]: No configuration found for ib0 Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[3609]: No configuration found for ib1 Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[3616]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[3617]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 15:33:20 kjcf05n02 mlnx_conf_mgr[3655]: INFO: No configurations found for mlx5_0, skipping. Nov 3 15:33:20 kjcf05n02 mlnx_conf_mgr[3657]: INFO: No configurations found for mlx5_1, skipping. Nov 3 15:33:20 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 15:33:20 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 15:33:20 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 3 15:33:20 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 3 15:33:20 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 15:33:20 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 3 15:33:20 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 3 15:33:20 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 15:33:20 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 15:33:20 kjcf05n02 lldpad[3192]: init_ports: Error adding device ib0 Nov 3 15:33:20 kjcf05n02 lldpad[3192]: init_ports: Error adding device ib1 Nov 3 15:33:20 kjcf05n02 lldpad[3192]: Signal 15 received - terminating Nov 3 15:33:20 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 3 15:33:20 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 15:33:20 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 15:33:20 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 3 15:33:20 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 15:33:20 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 3 15:33:20 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 3 15:33:20 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:20 kjcf05n02 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:20 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 1 | Nov-03-2024 | 21:02:30 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 2 | Nov-03-2024 | 21:03:21 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 3 | Nov-03-2024 | 21:03:21 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 4 | Nov-03-2024 | 21:04:26 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 5 | Nov-03-2024 | 21:04:27 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 6 | Nov-03-2024 | 21:29:21 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 7 | Nov-03-2024 | 21:29:21 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 8 | Nov-03-2024 | 21:29:21 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 9 | Nov-03-2024 | 21:29:21 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 10 | Nov-03-2024 | 21:29:21 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 11 | Nov-03-2024 | 21:29:21 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 12 | Nov-03-2024 | 21:29:21 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 13 | Nov-03-2024 | 21:29:21 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 14 | Nov-03-2024 | 21:29:21 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 15 | Nov-03-2024 | 21:29:21 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 16 | Nov-03-2024 | 21:29:21 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 17 | Nov-03-2024 | 21:29:21 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 18 | Nov-03-2024 | 21:29:21 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 19 | Nov-03-2024 | 21:29:22 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 20 | Nov-03-2024 | 21:29:22 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 21 | Nov-03-2024 | 21:29:22 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 22 | Nov-03-2024 | 21:29:22 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 23 | Nov-03-2024 | 21:29:22 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 24 | Nov-03-2024 | 21:29:22 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 25 | Nov-03-2024 | 21:29:22 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 26 | Nov-03-2024 | 21:29:22 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 27 | Nov-03-2024 | 21:29:22 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 28 | Nov-03-2024 | 21:29:22 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 29 | Nov-03-2024 | 21:29:22 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 30 | Nov-03-2024 | 21:29:22 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 31 | Nov-03-2024 | 21:29:22 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 32 | Nov-03-2024 | 21:29:22 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 33 | Nov-03-2024 | 21:29:22 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 34 | Nov-03-2024 | 21:29:22 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 35 | Nov-03-2024 | 21:29:22 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 36 | Nov-03-2024 | 21:29:22 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 37 | Nov-03-2024 | 21:29:22 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 38 | Nov-03-2024 | 21:29:52 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 39 | Nov-03-2024 | 21:29:52 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 40 | Nov-03-2024 | 21:29:52 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 41 | Nov-03-2024 | 21:29:52 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 42 | Nov-03-2024 | 21:29:52 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 43 | Nov-03-2024 | 21:29:52 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 44 | Nov-03-2024 | 21:29:52 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 45 | Nov-03-2024 | 21:29:52 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 46 | Nov-03-2024 | 21:29:52 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 47 | Nov-03-2024 | 21:29:52 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 48 | Nov-03-2024 | 21:29:52 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 49 | Nov-03-2024 | 21:29:53 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 50 | Nov-03-2024 | 21:29:53 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 51 | Nov-03-2024 | 21:29:53 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 52 | Nov-03-2024 | 21:29:53 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 53 | Nov-03-2024 | 21:29:53 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 54 | Nov-03-2024 | 21:29:53 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 55 | Nov-03-2024 | 21:29:53 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 56 | Nov-03-2024 | 21:29:53 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 57 | Nov-03-2024 | 21:29:53 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 58 | Nov-03-2024 | 21:29:53 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 59 | Nov-03-2024 | 21:29:53 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 60 | Nov-03-2024 | 21:29:54 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 61 | Nov-03-2024 | 21:29:54 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 62 | Nov-03-2024 | 21:29:54 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 63 | Nov-03-2024 | 21:29:54 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 64 | Nov-03-2024 | 21:29:54 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 65 | Nov-03-2024 | 21:29:54 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 66 | Nov-03-2024 | 21:29:54 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 67 | Nov-03-2024 | 21:29:54 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 68 | Nov-03-2024 | 21:29:54 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4002]: 69 | Nov-03-2024 | 21:29:54 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 15:33:20 kjcf05n02 ipmievd[4007]: Reading sensors... Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 3 15:33:20 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:20 kjcf05n02 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 15:33:20 kjcf05n02 nscd[2125]: 2125 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 15:33:20 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 15:33:20 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 3 15:33:20 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 15:33:20 kjcf05n02 beSetMlxConfig[4063]: ConnectX-3 multiport not detected Nov 3 15:33:20 kjcf05n02 beSetMlxConfig[4063]: Starting MST (Mellanox Software Tools) driver set Nov 3 15:33:20 kjcf05n02 beSetMlxConfig[4063]: Loading MST PCI module - Success Nov 3 15:33:20 kjcf05n02 systemd-udevd[1562]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 15:33:20 kjcf05n02 beSetMlxConfig[4063]: [warn] mst_pciconf is already loaded, skipping Nov 3 15:33:20 kjcf05n02 beSetMlxConfig[4063]: Create devices Nov 3 15:33:20 kjcf05n02 beSetMlxConfig[4063]: Unloading MST PCI module (unused) - Success Nov 3 15:33:20 kjcf05n02 ipmievd[4007]: Waiting for events... Nov 3 15:33:20 kjcf05n02 beSetMlxConfig[4063]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 15:33:20 kjcf05n02 beSetMlxConfig[4063]: ib mode Nov 3 15:33:20 kjcf05n02 beSetMlxConfig[4063]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 15:33:20 kjcf05n02 beSetMlxConfig[4063]: ib mode Nov 3 15:33:20 kjcf05n02 systemd-udevd[1562]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 15:33:20 kjcf05n02 systemd-udevd[4964]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:33:20 kjcf05n02 systemd-udevd[4965]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:33:20 kjcf05n02 systemd-udevd[4968]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:33:20 kjcf05n02 systemd-udevd[4971]: Using default interface naming scheme 'rhel-8.0'. Nov 3 15:33:20 kjcf05n02 systemd-udevd[4971]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:33:20 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 15:33:20 kjcf05n02 systemd[3182]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:20 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[5006]: Setting up Mellanox network interface: ib1 Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[5007]: Setting up Mellanox network interface: ib0 Nov 3 15:33:20 kjcf05n02 systemd-udevd[4967]: Using default interface naming scheme 'rhel-8.0'. Nov 3 15:33:20 kjcf05n02 systemd-udevd[4966]: Using default interface naming scheme 'rhel-8.0'. Nov 3 15:33:20 kjcf05n02 systemd-udevd[4967]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:33:20 kjcf05n02 systemd-udevd[4966]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[5056]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[5060]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[5086]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[5088]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[5089]: No configuration found for ib0 Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[5090]: No configuration found for ib1 Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[5094]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 15:33:20 kjcf05n02 mlnx_interface_mgr[5098]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 15:33:20 kjcf05n02 mlnx_conf_mgr[5138]: INFO: No configurations found for mlx5_1, skipping. Nov 3 15:33:20 kjcf05n02 mlnx_conf_mgr[5137]: INFO: No configurations found for mlx5_0, skipping. Nov 3 15:33:20 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 15:33:20 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}074558faa5629c6b14d6b614881aa08a3d4b22f2b257ac77f9365075c59a53fa' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}074558faa5629c6b14d6b614881aa08a3d4b22f2b257ac77f9365075c59a53fa' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}d2ac2edd2b0320b1aa9a3e47b8678ab3d9672983ea87ad1ab763a015ee603c6c' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}d2ac2edd2b0320b1aa9a3e47b8678ab3d9672983ea87ad1ab763a015ee603c6c' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}8bac22cea8466e73605e504137f88353cd94863bc6ab9b0f53b38322ff3a405d' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}8bac22cea8466e73605e504137f88353cd94863bc6ab9b0f53b38322ff3a405d' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}ff2bae6a617662df75d77a2998cf8399e5c84e09664f9cb2cfb81fc4456f3752' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}ff2bae6a617662df75d77a2998cf8399e5c84e09664f9cb2cfb81fc4456f3752' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 15:33:20 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 3 15:33:20 kjcf05n02 chronyd[2147]: chronyd exiting Nov 3 15:33:20 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 3 15:33:20 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 15:33:20 kjcf05n02 chronyd[5172]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 15:33:20 kjcf05n02 chronyd[5172]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 15:33:20 kjcf05n02 chronyd[5172]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 15:33:20 kjcf05n02 chronyd[5172]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 15:33:20 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 15:33:20 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:20 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 15:33:20 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 3 15:33:20 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 15:33:20 kjcf05n02 dwd[5203]: dwd: vMay 29 2024 : 15:38:26 Nov 3 15:33:20 kjcf05n02 dwd[5203]: /usr/sbin/dwd -i 15 -d Nov 3 15:33:20 kjcf05n02 dwd[5203]: dwd: option Lethal: 0 Nov 3 15:33:20 kjcf05n02 dwd[5203]: dwd: option Interval: 15 Nov 3 15:33:20 kjcf05n02 dwd[5203]: dwd: option abrtlimit: 10 Nov 3 15:33:20 kjcf05n02 dwd[5203]: dwd: option DZPeriod: 604800 Nov 3 15:33:20 kjcf05n02 dwd[5203]: dwd: option SmartPeriod: 43200 Nov 3 15:33:20 kjcf05n02 dwd[5203]: dwd: option SDDEnabled: 1 Nov 3 15:33:20 kjcf05n02 dwd[5203]: dwd: option SDDAwaitScale: 3 Nov 3 15:33:20 kjcf05n02 dwd[5203]: dwd: option SDDAwaitMin: 100 Nov 3 15:33:20 kjcf05n02 dwd[5203]: dwd: option Verbosity: 1 Nov 3 15:33:20 kjcf05n02 dwd[5203]: dwd: option StandAlone: 0 Nov 3 15:33:20 kjcf05n02 dwd[5203]: option Lethal: 0 Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 15:33:20 kjcf05n02 dwd[5203]: option Interval: 15 Nov 3 15:33:20 kjcf05n02 dwd[5203]: option abrtlimit: 10 Nov 3 15:33:20 kjcf05n02 dwd[5203]: option DZPeriod: 604800 Nov 3 15:33:20 kjcf05n02 dwd[5203]: option SmartPeriod: 43200 Nov 3 15:33:20 kjcf05n02 dwd[5203]: option SDDEnabled: 1 Nov 3 15:33:20 kjcf05n02 dwd[5203]: option SDDAwaitScale: 3 Nov 3 15:33:20 kjcf05n02 dwd[5203]: option SDDAwaitMin: 100 Nov 3 15:33:20 kjcf05n02 dwd[5203]: option Verbosity: 1 Nov 3 15:33:20 kjcf05n02 dwd[5203]: option StandAlone: 0 Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 15:33:20 kjcf05n02 dwd[5204]: option Lethal now set to 1 Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 15:33:20 kjcf05n02 dwd[5204]: option abrtlimit now set to 1 Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 15:33:20 kjcf05n02 dwd[5204]: option SmartPeriod now set to 86400 Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 15:33:20 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 15:33:20 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:20 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:20 kjcf05n02 python3.9[5235]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 15:33:20 kjcf05n02 python3.9[3182]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 15:33:20 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:20 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 15:33:20 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 3 15:33:20 kjcf05n02 sedcpwrkr[5372]: Using config script: /etc/sedcpwrkr.conf Nov 3 15:33:20 kjcf05n02 sedcpwrkr[5372]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 15:33:20 kjcf05n02 sedcpwrkr[5372]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 15:33:20 kjcf05n02 sedcpwrkr[5372]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 15:33:20 kjcf05n02 sedcpwrkr[5372]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 15:33:20 kjcf05n02 sedcpwrkr[5372]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 15:33:20 kjcf05n02 sedcpwrkr[5372]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 15:33:20 kjcf05n02 sedcpwrkr-server[5403]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 15:33:20 kjcf05n02 sedcpwrkr[5372]: celery multi v5.2.7 (dawn-chorus) Nov 3 15:33:20 kjcf05n02 sedcpwrkr[5372]: > Starting nodes... Nov 3 15:33:20 kjcf05n02 sedcpwrkr[5372]: > sedcpwrkr@kjcf05n02: OK Nov 3 15:33:20 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 15:33:20 kjcf05n02 sedcpwrkr-server[5405]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 15:33:20 kjcf05n02 sedcpwrkr-server[5405]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 15:33:20 kjcf05n02 sedcpwrkr-server[5405]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 15:33:20 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 15:33:20 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 3 15:33:20 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 15:33:20 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 15:33:20 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 15:33:20 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:20 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 15:33:20 kjcf05n02 systemd-udevd[1562]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 15:33:20 kjcf05n02 iptables.init[5472]: iptables: Applying firewall rules: [ OK ] Nov 3 15:33:20 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 3 15:33:20 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:21 kjcf05n02 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:21 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:21 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:21 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 15:33:21 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 15:33:21 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 15:33:21 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 15:33:21 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 15:33:21 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 15:33:21 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 15:33:21 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 15:33:21 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 15:33:21 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 15:33:22 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:22 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 15:33:22 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5571 which is not our child. We'll most likely not notice when it exits. Nov 3 15:33:22 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 15:33:22 kjcf05n02 openhpid[5571]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 15:33:22 kjcf05n02 openhpid[5571]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 15:33:22 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:22 kjcf05n02 openhpid[5571]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 15:33:22 kjcf05n02 openhpid[5571]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 15:33:22 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 15:33:22 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 15:33:22 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 15:33:22 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:23 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 15:33:23 kjcf05n02 dcs-collectord[5662]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 15:33:23 kjcf05n02 hpi.inv.log[5662]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 15:33:23 kjcf05n02 dcs-collectord[5662]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 15:33:23 kjcf05n02 dcs-collectord[5662]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 15:33:23 kjcf05n02 dcs-collector[5653]: Starting dcs-collector:[ OK ] Nov 3 15:33:23 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 15:33:23 kjcf05n02 dcs-collectord[5665]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 15:33:23 kjcf05n02 dcs-collectord[5665]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 15:33:23 kjcf05n02 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 15:33:23 kjcf05n02 dcs-collectord[5665]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 15:33:23 kjcf05n02 dcs-collectord[5665]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 15:33:23 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 15:33:23 kjcf05n02 dcs-collectord[5665]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 15:33:23 kjcf05n02 dcs-collectord[5665]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 15:33:23 kjcf05n02 dcs-collectord[5665]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259348076", "units": "kB"}, {"name": "MemAvailable", "value": "258627596", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1820848", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1687368", "units": "kB"}, {"name": "Inactive", "value": "960852", "units": "kB"}, {"name": "Active(anon)", "value": "1520976", "units": "kB"}, {"name": "Inactive(anon)", "value": "825220", "units": "kB"}, {"name": "Active(file)", "value": "166392", "units": "kB"}, {"name": "Inactive(file)", "value": "135632", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "752988", "units": "kB"}, {"name": "Mapped", "value": "87248", "units": "kB"}, {"name": "Shmem", "value": "1593276", "units": "kB"}, {"name": "KReclaimable", "value": "109172", "units": "kB"}, {"name": "Slab", "value": "274476", "units": "kB"}, {"name": "SReclaimable", "value": "109172", "units": "kB"}, {"name": "SUnreclaim", "value": "165304", "units": "kB"}, {"name": "KernelStack", "value": "9600", "units": "kB"}, {"name": "PageTables", "value": "20176", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3083488", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11136", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "2048", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "285000", "units": "kB"}, {"name": "DirectMap2M", "value": "26843136", "units": "kB"}, {"name": "DirectMap1G", "value": "241172480", "units": "kB"}]}' Nov 3 15:33:23 kjcf05n02 dcs-collectord[5665]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 15:33:23 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:24 kjcf05n02 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:24 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:24 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:24 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 15:33:24 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 15:33:24 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 15:33:24 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 15:33:24 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:24 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 15:33:24 kjcf05n02 firmware-update-orc[5746]: Using config script: /etc/firmware_update_orc.conf Nov 3 15:33:24 kjcf05n02 firmware-update-orc[5746]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 15:33:24 kjcf05n02 firmware-update-orc[5746]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 15:33:24 kjcf05n02 firmware-update-orc[5746]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 15:33:24 kjcf05n02 firmware-update-orc[5746]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 15:33:24 kjcf05n02 firmware-update-orc[5746]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 15:33:24 kjcf05n02 firmware-update-orc[5746]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 15:33:25 kjcf05n02 dcs-collectord[5665]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 15:33:25 kjcf05n02 dcs-collectord[5665]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730669603.621009], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730669604.7981255], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730669603.5496204, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 15:33:25 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 15:33:25 kjcf05n02 firmware-update-orc-server[5794]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 15:33:25 kjcf05n02 firmware-update-orc[5746]: celery multi v5.2.7 (dawn-chorus) Nov 3 15:33:25 kjcf05n02 firmware-update-orc[5746]: > Starting nodes... Nov 3 15:33:25 kjcf05n02 firmware-update-orc[5746]: > worker1@kjcf05n02: OK Nov 3 15:33:25 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 15:33:25 kjcf05n02 firmware-update-orc-server[5811]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 15:33:25 kjcf05n02 firmware-update-orc-server[5811]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 15:33:25 kjcf05n02 firmware-update-orc-server[5811]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 15:33:25 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 15:33:25 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:25 kjcf05n02 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:25 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:25 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:25 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 15:33:25 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 15:33:25 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 15:33:25 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 15:33:25 kjcf05n02 dbus-daemon[2124]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 15:33:25 kjcf05n02 dbus-daemon[2124]: [system] Reloaded configuration Nov 3 15:33:25 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 15:33:25 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 15:33:25 kjcf05n02 dbus-daemon[2124]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 15:33:25 kjcf05n02 dbus-daemon[2124]: [system] Reloaded configuration Nov 3 15:33:25 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 15:33:25 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 15:33:25 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 15:33:25 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 15:33:25 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:26 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 3 15:33:26 kjcf05n02 ras-resource-manager-agent[5927]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 15:33:26 kjcf05n02 ras-resource-manager-agent[5913]: Starting ras-resource-manager-agent:[ OK ] Nov 3 15:33:26 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 15:33:26 kjcf05n02 ras-resource-manager-agent[5929]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 15:33:26 kjcf05n02 ras-resource-manager-client[5929]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 15:33:26 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 3 15:33:26 kjcf05n02 ras-resource-manager-client[5929]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 15:33:26 kjcf05n02 ras-resource-manager-client[5939]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 15:33:26 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:27 kjcf05n02 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:27 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:27 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:27 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 15:33:27 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 15:33:27 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:27 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 15:33:27 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T15:33:27.252737333-06:00 level=info msg="Completed cleanup jobs" duration=26.18504ms Nov 3 15:33:27 kjcf05n02 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: Press Ctrl+C to exit. Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: Plugin support version 1.0 Nov 3 15:33:27 kjcf05n02 zabbix_agent2[6013]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 15:33:27 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:27 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:27 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:28 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 15:33:28 kjcf05n02 dcs-notification-sender[6093]: dcs-notification-senderd is stopped Nov 3 15:33:28 kjcf05n02 zabbix-agent2[6107]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 15:33:28 kjcf05n02 dcs-notification-sender[6093]: Starting notification-sender:[ OK ] Nov 3 15:33:28 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 15:33:28 kjcf05n02 zabbix-agent2[6109]: INFO DCS notification agent started. (agent.py:61) Nov 3 15:33:28 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 15:33:28 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:29 kjcf05n02 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:29 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:29 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:29 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:29 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 15:33:29 kjcf05n02 dcs-collectord[6220]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 15:33:29 kjcf05n02 dcs-collectord[6220]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 15:33:29 kjcf05n02 dcs-bulk-data-sender[6220]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 15:33:29 kjcf05n02 dcs-bulk-data-sender[6211]: Starting bulk-data-sender:[ OK ] Nov 3 15:33:29 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 15:33:29 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 15:33:29 kjcf05n02 dcs-collectord[6222]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 15:33:29 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:30 kjcf05n02 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:30 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:30 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:30 kjcf05n02 nscd[2125]: 2125 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 15:33:30 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 15:33:30 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 15:33:30 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 15:33:30 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 15:33:30 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 15:33:30 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 15:33:30 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 15:33:30 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 15:33:30 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 15:33:30 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 15:33:30 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 15:33:30 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 15:33:30 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 15:33:30 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 15:33:30 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 15:33:30 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 15:33:30 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 15:33:31 kjcf05n02 python3.9[5235]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 15:33:31 kjcf05n02 python3.9[3182]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:31 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 3 15:33:31 kjcf05n02 sssd[nss][2506]: Shutting down (status = 0) Nov 3 15:33:31 kjcf05n02 sssd[be[implicit_files]][2339]: Shutting down (status = 0) Nov 3 15:33:31 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 3 15:33:31 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 3 15:33:31 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 15:33:31 kjcf05n02 sssd[sssd][6288]: Starting up Nov 3 15:33:31 kjcf05n02 sssd[be[implicit_files]][6302]: Starting up Nov 3 15:33:31 kjcf05n02 sssd[nss][6303]: Starting up Nov 3 15:33:31 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 15:33:31 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 15:33:31 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 15:33:32 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 15:33:32 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 15:33:32 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 15:33:32 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 15:33:32 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 15:33:32 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 15:33:32 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 15:33:32 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 15:33:32 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 15:33:32 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 15:33:32 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 15:33:32 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 15:33:32 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 15:33:32 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 15:33:32 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 15:33:32 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 15:33:32 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:32 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 15:33:33 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib0 Nov 3 15:33:33 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib0 Nov 3 15:33:33 kjcf05n02 icinga2[6352]: [2024-11-03 15:33:33 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 15:33:33 kjcf05n02 icinga2[6352]: [2024-11-03 15:33:33 -0600] information/cli: Loading configuration file(s). Nov 3 15:33:33 kjcf05n02 icinga2[6352]: [2024-11-03 15:33:33 -0600] information/ConfigItem: Committing config item(s). Nov 3 15:33:33 kjcf05n02 icinga2[6352]: [2024-11-03 15:33:33 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 3 15:33:33 kjcf05n02 icinga2[6352]: [2024-11-03 15:33:33 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 15:33:33 kjcf05n02 icinga2[6352]: [2024-11-03 15:33:33 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 15:33:33 kjcf05n02 icinga2[6352]: [2024-11-03 15:33:33 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 15:33:33 kjcf05n02 icinga2[6352]: [2024-11-03 15:33:33 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 15:33:33 kjcf05n02 icinga2[6352]: [2024-11-03 15:33:33 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 15:33:33 kjcf05n02 icinga2[6352]: [2024-11-03 15:33:33 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 15:33:33 kjcf05n02 icinga2[6352]: [2024-11-03 15:33:33 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 15:33:33 kjcf05n02 icinga2[6352]: [2024-11-03 15:33:33 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 15:33:33 kjcf05n02 icinga2[6352]: [2024-11-03 15:33:33 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 15:33:33 kjcf05n02 icinga2[6352]: [2024-11-03 15:33:33 -0600] information/cli: Closing console log. Nov 3 15:33:33 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 15:33:33 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:33 kjcf05n02 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:33 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:33 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:34 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 15:33:34 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 15:33:34 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:34 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 3 15:33:34 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:35 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 15:33:35 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:35 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:35 kjcf05n02 dcs-bulk-data-sender[6222]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 15:33:35 kjcf05n02 dcs-collectord[6222]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 15:33:35 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 15:33:35 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 15:33:35 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 15:33:35 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 15:33:35 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 15:33:35 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 15:33:35 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 15:33:35 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 15:33:35 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 15:33:35 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 15:33:35 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 15:33:35 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 15:33:35 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 15:33:35 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 15:33:36 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:36 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 15:33:36 kjcf05n02 nslcd[7269]: version 0.9.9 starting Nov 3 15:33:36 kjcf05n02 nslcd[7269]: accepting connections Nov 3 15:33:36 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 15:33:36 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:36 kjcf05n02 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:36 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:36 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:36 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 15:33:36 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 15:33:37 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 15:33:37 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 15:33:37 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 15:33:37 kjcf05n03 LCNmon[18111]: 10.16.100.52 is unreachable via ib1 Nov 3 15:33:37 kjcf05n03 LCNmon[18111]: 10.16.100.58 is unreachable via ib1 Nov 3 15:33:37 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 15:33:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 15:33:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 15:33:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 15:33:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 15:33:37 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 15:33:37 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 15:33:37 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:38 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 15:33:38 kjcf05n02 dearcpw[7465]: Using config script: /etc/dearcpw.conf Nov 3 15:33:38 kjcf05n02 dearcpw[7465]: - Creating default directory: '/var/log/dearcpw' Nov 3 15:33:38 kjcf05n02 dearcpw[7465]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 15:33:38 kjcf05n02 dearcpw[7465]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 15:33:38 kjcf05n02 dearcpw[7465]: - Creating default directory: '/var/run/dearcpw' Nov 3 15:33:38 kjcf05n02 dearcpw[7465]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 15:33:38 kjcf05n02 dearcpw[7465]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 15:33:38 kjcf05n02 dearcpw-server[7518]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 15:33:38 kjcf05n02 dearcpw[7465]: celery multi v5.2.7 (dawn-chorus) Nov 3 15:33:38 kjcf05n02 dearcpw[7465]: > Starting nodes... Nov 3 15:33:38 kjcf05n02 dearcpw[7465]: > dearcpw@kjcf05n02: OK Nov 3 15:33:38 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 15:33:38 kjcf05n02 dearcpw-server[7520]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 15:33:38 kjcf05n02 dearcpw-server[7520]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 15:33:38 kjcf05n02 dearcpw-server[7520]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 15:33:38 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 3 15:33:38 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:38 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:38 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 15:33:38 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 15:33:38 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 15:33:38 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 15:33:38 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 15:33:38 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 15:33:38 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 15:33:38 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 15:33:38 kjcf05n02 dcs-collectord[5665]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 15:33:38 kjcf05n02 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 15:33:39 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:58120). Nov 3 15:33:39 kjcf05n01 rsyncd[3165080]: connect from kjcf05n02 (172.16.2.5) Nov 3 15:33:39 kjcf05n01 rsyncd[3165080]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 15:33:39 kjcf05n01 rsyncd[3165080]: receiving file list Nov 3 15:33:39 kjcf05n01 rsyncd[3165080]: sent 29 bytes received 325 bytes total size 10905 Nov 3 15:33:39 kjcf05n01 systemd[1]: rsyncd@640-172.16.2.2:873-172.16.2.5:58120.service: Succeeded. Nov 3 15:33:39 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 15:33:39 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 15:33:39 kjcf05n02 puppet[7551]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 3 15:33:39 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 15:33:39 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 15:33:39 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 15:33:39 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 15:33:39 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 15:33:39 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 15:33:39 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 15:33:39 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 15:33:39 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 15:33:39 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 15:33:40 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 15:33:40 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 15:33:40 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 15:33:40 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 15:33:40 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 15:33:40 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 15:33:40 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 15:33:40 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 15:33:41 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 15:33:41 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 15:33:41 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 15:33:41 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 15:33:41 kjcf05n02 ipmievd[4007]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 15:33:41 kjcf05n02 ipmievd[4007]: System Event sensor - Timestamp Clock Sync Nov 3 15:33:41 kjcf05n02 ipmievd[3182]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:41 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 15:33:41 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 15:33:42 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:42 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 15:33:42 kjcf05n02 diskless-swap[7643]: HA_PS_000: recovering journal Nov 3 15:33:42 kjcf05n02 systemd-udevd[1562]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 15:33:42 kjcf05n02 diskless-swap[7643]: HA_PS_000: clean, 2284/6400 files, 7076/25600 blocks Nov 3 15:33:42 kjcf05n02 diskless-swap[7643]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 15:33:42 kjcf05n02 diskless-swap[7643]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 15:33:42 kjcf05n02 diskless-swap[7643]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 15:33:42 kjcf05n02 diskless-swap[7643]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 15:33:42 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 15:33:42 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:42 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:42 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 15:33:42 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 15:33:42 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 15:33:42 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 15:33:43 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 3 15:33:43 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 3 15:33:43 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 3 15:33:43 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 3 15:33:43 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 3 15:33:43 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 15:33:43 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 15:33:43 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 15:33:43 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 15:33:43 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 15:33:43 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 15:33:43 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 15:33:43 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 15:33:43 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 15:33:43 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 15:33:43 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 15:33:44 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 15:33:44 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 15:33:44 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 15:33:44 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 15:33:45 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 15:33:45 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 15:33:45 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 15:33:45 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 15:33:45 kjcf05n00 mcfcli[3673891]: %3|1730669625.687|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:33:46 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 15:33:46 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 15:33:46 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 15:33:46 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 15:33:46 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:46 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 3 15:33:46 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:46 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:46 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 15:33:46 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 15:33:46 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:46 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 3 15:33:46 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:46 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:46 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 15:33:46 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 15:33:46 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:47 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 3 15:33:47 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:33:47 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:33:47 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 15:33:47 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 15:33:47 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 15:33:47 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 15:33:47 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 15:33:47 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 15:33:47 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 15:33:47 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 15:33:47 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 15:33:47 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 15:33:47 kjcf05n02 systemd[1]: Reloading. Nov 3 15:33:47 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 3 15:33:47 kjcf05n02 kdumpctl[7875]: kdump: No kdump initial ramdisk found. Nov 3 15:33:47 kjcf05n02 kdumpctl[7875]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 15:33:47 kjcf05n02 dracut[7987]: dracut-049-135.git20210121.el8 Nov 3 15:33:48 kjcf05n02 dracut[7989]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 15:33:48 kjcf05n02 dracut[7989]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 15:33:48 kjcf05n02 dracut[7989]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 15:33:48 kjcf05n02 dracut[7989]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 15:33:48 kjcf05n02 dracut[7989]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 15:33:48 kjcf05n02 dracut[7989]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 15:33:48 kjcf05n02 dracut[7989]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 15:33:48 kjcf05n02 dracut[7989]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + is_func check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ type -t check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 0 -ne 0 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check -h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local dev holder Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + require_binaries mdadm expr Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _module_name=90hperaid Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ mdadm = \-\m ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for cmd in "$@" Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + find_binary mdadm Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for cmd in "$@" Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + find_binary expr Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n -h ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for dev in "${!host_fs_types[@]}" Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ nfs != *_raid_member ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + continue Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _ret=255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + ret=255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ 255 = 0 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ 255 = 255 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ module_depends hperaid Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: +++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: +++ set -x Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ depends Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo rootfs-block Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ return 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ _ret=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ return 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for _moddep in $(module_depends $_mod) Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all == *\ hperaid\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + add_dracutmodules+=' rootfs-block ' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ == *\ hperaid\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check_module rootfs-block Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _mod=rootfs-block Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddep Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ == *\ rootfs-block\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n '' ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all == *\ rootfs-block\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + module_check rootfs-block 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _forced=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 2 -eq 2 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _forced=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + is_func check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ type -t check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 0 -ne 0 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check -h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _ret=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + ret=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ 0 = 0 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ module_depends rootfs-block Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: +++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 15:33:48 kjcf05n02 kdumpctl[3182]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ depends Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo fs-lib Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ _ret=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ return 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for _moddep in $(module_depends $_mod) Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all == *\ rootfs-block\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + add_dracutmodules+=' fs-lib ' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ == *\ rootfs-block\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check_module fs-lib Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _mod=fs-lib Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddep Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n '' ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + mods_checked_as_dep+=' fs-lib ' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all == *\ fs-lib\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + module_check fs-lib 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 15:33:48 kjcf05n02 kdumpctl[3182]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _forced=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 2 -eq 2 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _forced=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + is_func check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ type -t check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 0 -ne 0 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check -h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _ret=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + ret=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ 0 = 0 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ module_depends fs-lib Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: +++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ depends Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ return 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ _ret=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ return 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + mods_to_load+=' fs-lib ' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + mods_to_load+=' rootfs-block ' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + mods_to_load+=' hperaid ' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _mod=90kernel-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _mod=kernel-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check_module kernel-modules 1 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _mod=kernel-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddep Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n 1 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all = all ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + module_check kernel-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _forced=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 1 -eq 2 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + is_func check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ type -t check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 0 -ne 0 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check -h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + true Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _ret=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + ret=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ 0 != 0 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ module_depends kernel-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: +++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ depends Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ true Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ _ret=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ return 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + mods_to_load+=' kernel-modules ' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _mod=90kernel-modules-extra Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _mod=kernel-modules-extra Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check_module kernel-modules-extra 1 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _mod=kernel-modules-extra Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddep Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n 1 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all = all ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + module_check kernel-modules-extra Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _forced=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 1 -eq 2 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + is_func check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ type -t check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 0 -ne 0 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check -h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + true Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _ret=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + ret=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ 0 != 0 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ module_depends kernel-modules-extra Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: +++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ depends Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ true Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ _ret=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ return 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + mods_to_load+=' kernel-modules-extra ' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _mod=90kernel-network-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _mod=kernel-network-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check_module kernel-network-modules 1 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _mod=kernel-network-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddep Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n 1 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all = all ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + module_check kernel-network-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _forced=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 1 -eq 2 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + is_func check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ type -t check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 0 -ne 0 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check -h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _ret=255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + ret=255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ 255 != 0 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n 1 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 1 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _mod=90livenet Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _mod=livenet Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check_module livenet 1 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _mod=livenet Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddep Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n 1 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all = all ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + module_check livenet Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 15:33:48 kjcf05n02 kdumpctl[3182]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _forced=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 1 -eq 2 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + is_func check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ type -t check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 0 -ne 0 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check -h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _ret=255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + ret=255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ 255 != 0 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n 1 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 1 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _mod=90lvm Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _mod=lvm Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check_module lvm 1 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _mod=lvm Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddep Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n 1 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all = all ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + module_check lvm Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 15:33:48 kjcf05n02 kdumpctl[3182]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _forced=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 1 -eq 2 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + is_func check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ type -t check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 0 -ne 0 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check -h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + require_binaries lvm Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _module_name=90lvm Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ lvm = \-\m ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for cmd in "$@" Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + find_binary lvm Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n -h ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for fs in "${host_fs_types[@]}" Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ nfs = LVM*_member ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _ret=255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + ret=255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ 255 != 0 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n 1 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 1 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _mod=90mdraid Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _mod=mdraid Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check_module mdraid 1 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _mod=mdraid Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 15:33:48 kjcf05n02 kdumpctl[3182]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddep Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n 1 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all = all ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + module_check mdraid Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _forced=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 1 -eq 2 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + is_func check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ type -t check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 0 -ne 0 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check -h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _rootdev Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + require_binaries mdadm expr Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _module_name=90mdraid Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ mdadm = \-\m ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for cmd in "$@" Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + find_binary mdadm Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for cmd in "$@" Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + find_binary expr Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n -h ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for dev in "${!host_fs_types[@]}" Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ nfs != *_raid_member ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + continue Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _ret=255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + ret=255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ 255 != 0 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n 1 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 1 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _mod=90multipath Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _mod=multipath Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check_module multipath 1 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _mod=multipath Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 15:33:48 kjcf05n02 kdumpctl[3182]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddep Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n 1 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all = all ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + module_check multipath Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _forced=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 1 -eq 2 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + is_func check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ type -t check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 0 -ne 0 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check -h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _rootdev Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n -h ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for_each_host_dev_and_slaves is_mpath Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _func=is_mpath Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _dev Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for _dev in "${host_devs[@]}" Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + continue Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 1 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _ret=255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + ret=255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ 255 != 0 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n 1 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 1 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _mod=90qemu Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _mod=qemu Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check_module qemu 1 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _mod=qemu Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddep Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n 1 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all = all ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + module_check qemu Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _forced=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 1 -eq 2 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + is_func check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ type -t check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 0 -ne 0 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check -h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n -h ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + type -P systemd-detect-virt Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ systemd-detect-virt --vm Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + vm=none Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + (( 1 != 0 )) Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _ret=255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + ret=255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ 255 != 0 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n 1 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 1 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _mod=90qemu-net Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _mod=qemu-net Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check_module qemu-net 1 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _mod=qemu-net Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddep Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n 1 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all = all ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + module_check qemu-net Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _forced=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 1 -eq 2 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + is_func check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ type -t check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 0 -ne 0 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check -h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n -h ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + type -P systemd-detect-virt Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ systemd-detect-virt --vm Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + vm= Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + (( 1 != 0 )) Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _ret=255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + ret=255 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ 255 != 0 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n 1 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + return 1 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _mod=90stratis Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + _mod=stratis Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check_module stratis 1 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _mod=stratis Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddep Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -n 1 ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ all = all ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + module_check stratis Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ read a b Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _forced=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _hostonly=-h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 1 -eq 2 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + is_func check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: ++ type -t check Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + '[' 0 -ne 0 ']' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + check -h Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _module_name=90stratis Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + local _ret=0 Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + [[ stratisd-init = \-\m ]] Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + for cmd in "$@" Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + find_binary stratisd-init Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 15:33:48 kjcf05n02 kdumpctl[7875]: + set +x Nov 3 15:33:48 kjcf05n02 dracut[7989]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 15:33:48 kjcf05n02 dracut[7989]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 15:33:48 kjcf05n02 dracut[7989]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 15:33:48 kjcf05n02 dracut[7989]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 15:33:48 kjcf05n02 dracut[7989]: memstrack is available Nov 3 15:33:48 kjcf05n02 dracut[7989]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 15:33:48 kjcf05n02 dracut[7989]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 15:33:48 kjcf05n02 dracut[7989]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 15:33:49 kjcf05n02 dracut[7989]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 15:33:49 kjcf05n02 dracut[7989]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 15:33:49 kjcf05n02 dracut[7989]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 15:33:49 kjcf05n02 dracut[7989]: *** Including module: bash *** Nov 3 15:33:49 kjcf05n02 dracut[7989]: *** Including module: systemd *** Nov 3 15:33:50 kjcf05n02 dracut[7989]: *** Including module: fips *** Nov 3 15:33:50 kjcf05n02 dracut[7989]: *** Including module: systemd-initrd *** Nov 3 15:33:50 kjcf05n02 dracut[7989]: *** Including module: watchdog-modules *** Nov 3 15:33:50 kjcf05n02 dracut[7989]: *** Including module: nss-softokn *** Nov 3 15:33:50 kjcf05n02 dracut[7989]: *** Including module: i18n *** Nov 3 15:33:50 kjcf05n02 dracut[7989]: No KEYMAP configured. Nov 3 15:33:50 kjcf05n02 dracut[7989]: *** Including module: network-legacy *** Nov 3 15:33:50 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 3 15:33:51 kjcf05n02 dracut[7989]: *** Including module: network *** Nov 3 15:33:51 kjcf05n02 dracut[7989]: *** Including module: ib_bonding *** Nov 3 15:33:51 kjcf05n02 dracut[7989]: *** Including module: drm *** Nov 3 15:33:52 kjcf05n00 mcfcli[3673891]: %3|1730669632.464|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:33:53 kjcf05n02 dcs-collectord[5665]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 15:33:53 kjcf05n02 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 15:33:54 kjcf05n02 dracut[7989]: *** Including module: hperaid *** Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + install Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + local rule rule_path Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + inst_multiple cat expr Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.wH1KLV/initramfs -a -f cat expr Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + _ret=0 Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + (( 0 != 0 )) Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + : Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + return 0 Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + inst_multiple -o mdmon Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.wH1KLV/initramfs -a -f -o mdmon Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + _ret=0 Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + (( 0 != 0 )) Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + : Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + return 0 Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: ++ command -v partx Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + inst /usr/sbin/partx /sbin/partx Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + local _hostonly_install Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + [[ -e /tmp/dracut.wH1KLV/initramfs//sbin/partx ]] Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.wH1KLV/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + (( 0 != 0 )) Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + : Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: ++ command -v mdadm Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + local _hostonly_install Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + [[ -e /tmp/dracut.wH1KLV/initramfs//sbin/mdadm ]] Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.wH1KLV/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + (( 0 != 0 )) Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + : Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + [[ yes == \y\e\s ]] Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + local _raidconf Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: ++ cmdline Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: ++ local _activated dev line UUID Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: ++ declare -A _activated Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: ++ for dev in "${!host_fs_types[@]}" Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: ++ [[ nfs != *_raid_member ]] Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: ++ continue Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + _raidconf= Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + [[ -n '' ]] Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + inst_rules 64-md-raid.rules Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + local _target=/etc/udev/rules.d _rule _found Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + inst_dir /usr/lib/udev/rules.d Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + [[ -e /tmp/dracut.wH1KLV/initramfs//usr/lib/udev/rules.d ]] Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + return 0 Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + inst_dir /etc/udev/rules.d Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + [[ -e /tmp/dracut.wH1KLV/initramfs//etc/udev/rules.d ]] Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + return 0 Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + for _rule in "$@" Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + continue Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + continue Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + for r in '' $dracutbasedir/rules.d/ Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + [[ 64-md-raid.rules != /* ]] Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + continue Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + for r in '' $dracutbasedir/rules.d/ Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + continue Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + [[ -n '' ]] Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 15:33:54 kjcf05n02 kdumpctl[7875]: + set +x Nov 3 15:33:54 kjcf05n02 dracut[7989]: Skipping udev rule: 64-md-raid.rules Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + installkernel Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + instmods =drivers/md Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + local _optional=-o Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + local _silent Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + local _ret Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + [[ '' = yes ]] Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + [[ =drivers/md = \-\c ]] Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + [[ =drivers/md = \-\s ]] Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + (( 1 == 0 )) Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.wH1KLV/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + _ret=0 Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + (( 0 != 0 )) Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + [[ -n '' ]] Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + return 0 Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + _ret=0 Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + unset check depends cmdline install installkernel Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + return 0 Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + modules_loaded+='hperaid ' Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + '[' -n '' ']' Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + _d_mod=90kernel-modules Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + _d_mod=kernel-modules Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + [[ '' = yes ]] Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + dinfo '*** Including module: kernel-modules ***' Nov 3 15:33:55 kjcf05n02 kdumpctl[7875]: + set +x Nov 3 15:33:55 kjcf05n02 dracut[7989]: *** Including module: kernel-modules *** Nov 3 15:33:55 kjcf05n02 dracut[7989]: *** Including module: kernel-modules-extra *** Nov 3 15:33:55 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 3 15:33:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730669635', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(0.0B/0.0B), ib1=(0.0B/0.0B), icl0=(4.3kB/5.8kB), lo=(500.0B/500.0B), meth0=(1540.9MB/7.8MB), mgmt0=(1477.6MB/7.8MB)'}"] Nov 3 15:33:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(0.0B/0.0B), ib1=(0.0B/0.0B), icl0=(4.3kB/5.8kB), lo=(500.0B/500.0B), meth0=(1540.9MB/7.8MB), mgmt0=(1477.6MB/7.8MB)', 'message': 'NET OK - (Rx/Tx) ib0=(0.0B/0.0B), ib1=(0.0B/0.0B), icl0=(4.3kB/5.8kB), lo=(500.0B/500.0B), meth0=(1540.9MB/7.8MB), mgmt0=(1477.6MB/7.8MB)', 'value': 'ok', 'timestamp': '1730669635'} Nov 3 15:33:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:33:55 kjcf05n00 zabbix-server[1368485]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:33:55 kjcf05n00 zabbix-server[1368485]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:45\\"}}"' Nov 3 15:33:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730669635', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128622 MiB (99.98% inode=100%);'}"] Nov 3 15:33:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128622 MiB (99.98% inode=100%);', 'message': 'DISK OK - free space: /tmp 128622 MiB (99.98% inode=100%);', 'value': 'ok', 'timestamp': '1730669635'} Nov 3 15:33:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:33:55 kjcf05n00 log_interesting_event.py[1368485]: Event '46355' acknowledged Nov 3 15:33:55 kjcf05n00 zabbix-server[1368492]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:33:55 kjcf05n00 zabbix-server[1368492]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 3 15:33:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 15:33:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 15:33:55 kjcf05n00 log_interesting_event.py[1368492]: Event '46356' acknowledged Nov 3 15:33:55 kjcf05n00 zabbix-server[1368495]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:33:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 15:33:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 15:33:56 kjcf05n02 dracut[7989]: *** Including module: kernel-network-modules *** Nov 3 15:33:56 kjcf05n02 dracut[7989]: *** Including module: diskless-mod *** Nov 3 15:33:56 kjcf05n02 dracut[7989]: *** Including module: fstab-sys *** Nov 3 15:33:56 kjcf05n02 dracut[7989]: *** Including module: nfs *** Nov 3 15:33:55 kjcf05n00 zabbix-server[1368495]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 3 15:33:56 kjcf05n00 log_interesting_event.py[1368495]: Event '46357' acknowledged Nov 3 15:33:56 kjcf05n02 dracut[7989]: *** Including module: rootfs-block *** Nov 3 15:33:56 kjcf05n02 dracut[7989]: *** Including module: terminfo *** Nov 3 15:33:56 kjcf05n02 dracut[7989]: *** Including module: udev-rules *** Nov 3 15:33:57 kjcf05n02 dracut[7989]: Skipping udev rule: 91-permissions.rules Nov 3 15:33:57 kjcf05n02 dracut[7989]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 15:33:57 kjcf05n02 dracut[7989]: *** Including module: dracut-systemd *** Nov 3 15:33:57 kjcf05n02 dracut[7989]: *** Including module: usrmount *** Nov 3 15:33:57 kjcf05n02 dracut[7989]: *** Including module: base *** Nov 3 15:33:58 kjcf05n02 dracut[7989]: *** Including module: fs-lib *** Nov 3 15:33:58 kjcf05n02 dracut[7989]: *** Including module: kdumpbase *** Nov 3 15:33:59 kjcf05n02 dracut[7989]: *** Including module: memstrack *** Nov 3 15:33:59 kjcf05n02 dracut[7989]: *** Including module: shutdown *** Nov 3 15:33:59 kjcf05n02 dracut[7989]: *** Including module: squash *** Nov 3 15:33:59 kjcf05n02 dracut[7989]: *** Including modules done *** Nov 3 15:33:59 kjcf05n02 dracut[7989]: *** Installing kernel module dependencies *** Nov 3 15:33:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 15:33:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 15:33:59 kjcf05n02 dracut[7989]: *** Installing kernel module dependencies done *** Nov 3 15:33:59 kjcf05n02 dracut[7989]: *** Resolving executable dependencies *** Nov 3 15:33:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 15:33:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 15:34:00 kjcf05n02 dracut[7989]: *** Resolving executable dependencies done*** Nov 3 15:34:00 kjcf05n02 dracut[7989]: *** Hardlinking files *** Nov 3 15:34:00 kjcf05n02 dracut[7989]: *** Hardlinking files done *** Nov 3 15:34:00 kjcf05n02 dracut[7989]: *** Generating early-microcode cpio image *** Nov 3 15:34:00 kjcf05n02 dracut[7989]: *** Constructing AuthenticAMD.bin **** Nov 3 15:34:00 kjcf05n02 dracut[7989]: *** Store current command line parameters *** Nov 3 15:34:00 kjcf05n02 dracut[7989]: Stored kernel commandline: Nov 3 15:34:00 kjcf05n02 dracut[7989]: rd.driver.pre=sd_mod Nov 3 15:34:00 kjcf05n02 dracut[7989]: rd.driver.pre=nvme Nov 3 15:34:00 kjcf05n02 dracut[7989]: rd.driver.pre=ipmi_si Nov 3 15:34:00 kjcf05n02 dracut[7989]: rd.driver.pre=ipmi_devintf Nov 3 15:34:00 kjcf05n02 dracut[7989]: rd.driver.pre=ipmi_msghandler Nov 3 15:34:00 kjcf05n02 dracut[7989]: nameserver=172.16.2.2 Nov 3 15:34:00 kjcf05n02 dracut[7989]: nameserver=127.0.0.1 Nov 3 15:34:00 kjcf05n02 dracut[7989]: nameserver=172.16.2.2 Nov 3 15:34:00 kjcf05n02 dracut[7989]: nameserver=127.0.0.1 Nov 3 15:34:00 kjcf05n02 dracut[7989]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 3 15:34:00 kjcf05n02 dracut[7989]: rd.neednet Nov 3 15:34:00 kjcf05n02 dracut[7989]: kdumpnic=mgmt0 Nov 3 15:34:00 kjcf05n02 dracut[7989]: bootdev=mgmt0 Nov 3 15:34:00 kjcf05n02 dracut[7989]: *** Install squash loader *** Nov 3 15:34:01 kjcf05n02 dracut[7989]: *** Squashing the files inside the initramfs *** Nov 3 15:34:01 kjcf05n02 dracut[7989]: *** Squashing the files inside the initramfs done *** Nov 3 15:34:01 kjcf05n02 dracut[7989]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 15:34:01 kjcf05n02 dracut[7989]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 15:34:02 kjcf05n02 kdumpctl[7875]: kdump: kexec: loaded kdump kernel Nov 3 15:34:02 kjcf05n02 kdumpctl[7875]: kdump: Starting kdump: [OK] Nov 3 15:34:02 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 3 15:34:02 kjcf05n02 systemd[1]: Reloading. Nov 3 15:34:03 kjcf05n02 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:34:03 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:34:03 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:34:03 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 15:34:03 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 15:34:03 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 15:34:03 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 15:34:03 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 15:34:03 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 15:34:03 kjcf05n02 ifdown[14610]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 15:34:03 kjcf05n02 ifdown[14611]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:34:03 kjcf05n02 ifdown[14612]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:34:03 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 15:34:03 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 15:34:03 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 15:34:03 kjcf05n02 ifup[14674]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 15:34:03 kjcf05n02 ifup[14675]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:34:03 kjcf05n02 ifup[14676]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:34:05 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 15:34:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730669645', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 2.39, 2.09, 0.91'}"] Nov 3 15:34:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 2.39, 2.09, 0.91', 'message': 'OK - load average: 2.39, 2.09, 0.91', 'value': 'ok', 'timestamp': '1730669645'} Nov 3 15:34:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:34:07 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 15:34:08 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 15:34:08 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:34:08 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 15:34:08 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:34:08 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:34:08 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:34:08 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 15:34:08 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 15:34:08 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 15:34:08 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 15:34:08 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:34:08 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:34:08 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:34:08 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:34:08 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 15:34:08 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 15:34:08 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 15:34:08 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 15:34:08 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 15:34:08 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 15:34:08 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 15:34:08 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 15:34:08 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 15:34:08 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 15:34:08 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 15:34:08 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 15:34:08 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 15:34:08 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 15:34:08 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 15:34:08 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 15:34:08 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 15:34:08 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 15:34:08 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 15:34:08 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 15:34:08 kjcf05n02 ifdown[14854]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 15:34:08 kjcf05n02 ifdown[14855]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:34:08 kjcf05n02 ifdown[14871]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:34:08 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 15:34:08 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 15:34:08 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 15:34:08 kjcf05n02 ifup[14931]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 15:34:08 kjcf05n02 ifup[14932]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:34:08 kjcf05n02 ifup[14933]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:34:09 kjcf05n02 dcs-collectord[5665]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 15:34:09 kjcf05n02 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 15:34:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730669649', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 327 processes with STATE = RSZDT '}"] Nov 3 15:34:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 327 processes with STATE = RSZDT ', 'message': 'PROCS OK: 327 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730669649'} Nov 3 15:34:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:34:10 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 15:34:12 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 15:34:13 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 15:34:13 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 15:34:13 kjcf05n02 systemd[1]: Reloading. Nov 3 15:34:13 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 3 15:34:13 kjcf05n02 await_ha_peer[15147]: Waiting for HA peer kjcf05n03 Nov 3 15:34:14 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 15:34:14 kjcf05n02 await_ha_peer[15147]: Peer kjcf05n03 has started, starting HA Nov 3 15:34:15 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 3 15:34:15 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 3 15:34:15 kjcf05n02 fstonithd.py[15185]: Listening for kdump packets from partner Nov 3 15:34:15 kjcf05n02 systemd[1]: Reloading. Nov 3 15:34:15 kjcf05n02 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:34:15 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:34:15 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:34:15 kjcf05n02 systemd[1]: Reloading. Nov 3 15:34:15 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 3 15:34:15 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 15:34:15 kjcf05n02 systemd[1]: Reloading. Nov 3 15:34:15 kjcf05n00 mcfcli[3673891]: %3|1730669655.688|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 15:34:16 kjcf05n02 systemd[1]: Reloading. Nov 3 15:34:16 kjcf05n02 puppet-agent[3591]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 15:34:16 kjcf05n02 puppet[3591]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 15:34:16 kjcf05n02 puppet-agent[3591]: Applied catalog in 93.98 seconds Nov 3 15:34:16 kjcf05n02 puppet[3591]: Notice: Applied catalog in 93.98 seconds Nov 3 15:34:16 kjcf05n02 systemd[1]: Started Puppet agent. Nov 3 15:34:16 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 15:34:16 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 15:34:16 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 15:34:16 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 15:34:16 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 15:34:16 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 3 15:34:16 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 15:34:16 kjcf05n02 systemd[1]: Reached target Timers. Nov 3 15:34:16 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 15:34:16 kjcf05n02 wce-disable.sh[15341]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 15:34:16 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 15:34:16 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 15:34:16 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 15:34:16 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 15:34:16 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 3 15:34:16 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 3 15:34:17 kjcf05n02 python3.9[15343]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 15:34:17 kjcf05n02 python3.9[15343]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 15:34:17 kjcf05n02 gateway-ec-node.py[15344]: Starting gateway-ec-node service Nov 3 15:34:17 kjcf05n02 RFSF-API[15342]: INFO[2024-11-03T15:34:16-06:00] Datapath API RESTful Service starting Nov 3 15:34:17 kjcf05n02 dp-api-server-node[15342]: INFO[2024-11-03T15:34:16-06:00] Datapath API RESTful Service starting Nov 3 15:34:17 kjcf05n02 RFSF-API[15342]: INFO[2024-11-03T15:34:16-06:00] Running in production mode, starting dbus event listener Nov 3 15:34:17 kjcf05n02 dp-api-server-node[15342]: INFO[2024-11-03T15:34:16-06:00] Running in production mode, starting dbus event listener Nov 3 15:34:17 kjcf05n02 RFSF-API[15342]: INFO[2024-11-03T15:34:16-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 15:34:17 kjcf05n02 dp-api-server-node[15342]: INFO[2024-11-03T15:34:16-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 15:34:17 kjcf05n02 RFSF-API[15342]: INFO[2024-11-03T15:34:16-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 15:34:17 kjcf05n02 dp-api-server-node[15342]: INFO[2024-11-03T15:34:16-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 15:34:17 kjcf05n02 RFSF-API[15342]: INFO[2024-11-03T15:34:16-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 15:34:17 kjcf05n02 dp-api-server-node[15342]: INFO[2024-11-03T15:34:16-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 15:34:17 kjcf05n02 RFSF-API[15342]: INFO[2024-11-03T15:34:16-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 15:34:17 kjcf05n02 dp-api-server-node[15342]: INFO[2024-11-03T15:34:16-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 15:34:17 kjcf05n02 RFSF-API[15342]: INFO[2024-11-03T15:34:16-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 15:34:17 kjcf05n02 dp-api-server-node[15342]: INFO[2024-11-03T15:34:16-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 15:34:17 kjcf05n02 RFSF-API[15342]: INFO[2024-11-03T15:34:16-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 15:34:17 kjcf05n02 dp-api-server-node[15342]: INFO[2024-11-03T15:34:16-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 15:34:17 kjcf05n02 RFSF-API[15342]: INFO[2024-11-03T15:34:16-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 15:34:17 kjcf05n02 dp-api-server-node[15342]: INFO[2024-11-03T15:34:16-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 15:34:17 kjcf05n02 RFSF-API[15342]: INFO[2024-11-03T15:34:16-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 15:34:17 kjcf05n02 dp-api-server-node[15342]: INFO[2024-11-03T15:34:16-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 15:34:17 kjcf05n02 RFSF-API[15342]: INFO[2024-11-03T15:34:16-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 15:34:17 kjcf05n02 dp-api-server-node[15342]: INFO[2024-11-03T15:34:16-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 15:34:17 kjcf05n02 dp-api-server-node[15342]: INFO[2024-11-03T15:34:16-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 15:34:17 kjcf05n02 RFSF-API[15342]: INFO[2024-11-03T15:34:16-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 15:34:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730669659', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.5% (3891916 kB) used.'}"] Nov 3 15:34:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.5% (3891916 kB) used.', 'message': 'OK - 1.5% (3891916 kB) used.', 'value': 'ok', 'timestamp': '1730669659'} Nov 3 15:34:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:34:22 kjcf05n00 zabbix-server[1368709]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:34:22 kjcf05n00 zabbix-server[1368709]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 173.06\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 99.58\\"}}"' Nov 3 15:34:22 kjcf05n00 log_interesting_event.py[1368709]: Event '46363' acknowledged Nov 3 15:34:23 kjcf05n02 systemd[1]: Reloading. Nov 3 15:34:23 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 15:34:23 kjcf05n02 systemd[1]: Reloading. Nov 3 15:34:23 kjcf05n02 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 15:34:24 kjcf05n02 dcs-collectord[5665]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 15:34:24 kjcf05n02 dcs-collectord[5665]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 15:34:24 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 15:34:24 kjcf05n02 diskmonitor_pre[15825]: Key management is currently disabled.DEAR disabled Nov 3 15:34:24 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 15:34:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730669665', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 15:34:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730669665'} Nov 3 15:34:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:34:25 kjcf05n00 httpd[902568]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 15:34:26 kjcf05n02 sh[15887]: LNET configured: New Created Nov 3 15:34:26 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 15:34:26 kjcf05n02 LCNmon[17954]: Interface ib0 is up Nov 3 15:34:26 kjcf05n02 LCNmon[17954]: Interface ib1 is up Nov 3 15:34:26 kjcf05n02 LCNmon[17954]: Can ping through interface ib0 Nov 3 15:34:26 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18026 (bash) Nov 3 15:34:26 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 15:34:26 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 15:34:26 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 15:34:26 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 15:34:26 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 15:34:26 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 15:34:26 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31448 deleted. Nov 3 15:34:27 kjcf05n02 LCNmon[17954]: Can ping through interface ib1 Nov 3 15:34:27 kjcf05n02 LCNmon[17954]: NIC ib0, initial state UP Nov 3 15:34:27 kjcf05n02 LCNmon[17954]: NIC ib1, initial state UP Nov 3 15:34:27 kjcf05n02 LCNmon[17954]: LCNstat initial state UP Nov 3 15:34:27 kjcf05n02 LCNmon[17954]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 3 15:34:28 kjcf05n02 openhpid[5571]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 15:34:28 kjcf05n02 openhpid[5571]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: /var/run/diskmonitor does not exist, creating Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: Creating /var/run/diskmonitor/disk Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: Creating /var/run/diskmonitor/encl Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: Creating /var/run/diskmonitor/cli Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: RAS_Interlocks_enabled: 1 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: add handler for sig: 14 sa_flags: 10000004 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: add handler for sig: 1 sa_flags: 10000004 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: add handler for sig: 2 sa_flags: 00000004 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: add handler for sig: 15 sa_flags: 00000004 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: add handler for sig: 6 sa_flags: 00000004 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: add handler for sig: 3 sa_flags: 00000004 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: add handler for sig: 30 sa_flags: 00000004 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: add handler for sig: 20 sa_flags: 00000004 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: add handler for sig: 10 sa_flags: 10000004 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: add handler for sig: 11 sa_flags: 00000004 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: add handler for sig: 7 sa_flags: 00000004 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: add handler for sig: 4 sa_flags: 00000004 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: add handler for sig: 8 sa_flags: 00000004 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: Using HA Baton locks - key: diskmonitor Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: Baton will be held for at most 570 seconds Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: DMMP Enabled: 0 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: random seed: ce77f65a Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: NVMe Enclosure: 1 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: ZFS Enclosure: 0 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: Dbus, Initialized Connection Successfully Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: int_catcher_thread: thread start Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: Received dbus message 4 org.freedesktop.DBus -> :1.99 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 15:34:28 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 15:34:28 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 3 15:34:28 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 15:34:28 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 15:34:28 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18307 which is not our child. We'll most likely not notice when it exits. Nov 3 15:34:28 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 15:34:28 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 3 15:34:28 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 3 15:34:28 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 15:34:28 kjcf05n02 dcs-collectord[5665]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 15:34:28 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 15:34:28 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 15:34:28 kjcf05n02 systemd[1]: Startup finished in 50.233s (kernel) + 2min 31.227s (userspace) = 3min 21.461s. Nov 3 15:34:28 kjcf05n02 openhpid[18307]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 15:34:28 kjcf05n02 openhpid[18307]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 15:34:28 kjcf05n02 openhpid[18307]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 15:34:28 kjcf05n02 openhpid[18307]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 15:34:29 kjcf05n00 mcfcli[3673891]: %3|1730669669.713|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: check_run_sedcmd, No Device name provided Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: check_run_sedcmd, No Device name provided Nov 3 15:34:33 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 15:34:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730669676', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 15:34:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730669676', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 15:34:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730669676'} Nov 3 15:34:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:34:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730669676'} Nov 3 15:34:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:34:39 kjcf05n02 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 15:34:39 kjcf05n02 dcs-collectord[5665]: WARNING No data collected (hpi_parser.py:353) Nov 3 15:34:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730669682', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 15:34:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730669682'} Nov 3 15:34:42 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:34:45 kjcf05n00 mcfcli[3673891]: %3|1730669685.688|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 15:34:52 kjcf05n02 ipmievd[4007]: System Event sensor - Timestamp Clock Sync Nov 3 15:34:54 kjcf05n02 ipmievd[3182]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:34:54 kjcf05n02 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 15:35:07 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 15:35:07 kjcf05n00 mcfcli[3673891]: %3|1730669707.672|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:35:09 kjcf05n02 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 15:35:12 kjcf05n00 python3.9[1369252]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 15:35:15 kjcf05n03 firmware-update-orc-server[5844]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "44a6cf33-6e7e-4cb1-875e-048318aaa79e"} (logger.py:65) Nov 3 15:35:15 kjcf05n02 diskmonitor[17553]: unlock_IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 15:35:15 kjcf05n02 ras-resource-manager-agent[5929]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "83896180-9a2b-11ef-abf8-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 15:35:15 kjcf05n02 ras-resource-manager-agent[5929]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '83896180-9a2b-11ef-abf8-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 15:35:15 kjcf05n02 ras-resource-manager-agent[5929]: INFO Submitting new device inserted signal, starting to qualify drive: 83896180-9a2b-11ef-abf8-00093d0695e3 (admin_action.py:110) Nov 3 15:35:15 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 254135 (get_disk_device) Nov 3 15:35:15 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 15:35:15 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 15:35:15 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '83896180-9a2b-11ef-abf8-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 15:35:15 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '83896180-9a2b-11ef-abf8-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 15:35:15 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '83896180-9a2b-11ef-abf8-00093d0695e3', 'response ID': '8393a5d2-9a2b-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 15:35:15 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 8393a5d2-9a2b-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 15:35:16 kjcf05n03 ccp-client[254158]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 15:35:16 kjcf05n03 ccp-client[254158]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 15:35:16 kjcf05n03 ccp-client[254167]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 15:35:16 kjcf05n03 ccp-client[254158]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 15:35:16 kjcf05n03 ccp-client[254167]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 15:35:16 kjcf05n03 ccp-client[254167]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 15:35:16 kjcf05n03 ccp-client[254158]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 15:35:15 kjcf05n00 mcfcli[3673891]: %3|1730669715.688|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 15:35:15 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '83db996e-9a2b-11ef-abf8-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 15:35:15 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '83db996e-9a2b-11ef-abf8-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 15:35:15 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '83db996e-9a2b-11ef-abf8-00093d0695e3', 'response ID': '83e25b64-9a2b-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 15:35:15 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 83e25b64-9a2b-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 15:35:16 kjcf05n02 diskmonitor[17553]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 15:35:16 kjcf05n02 ras-resource-manager-agent[5929]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "83db996e-9a2b-11ef-abf8-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 15:35:16 kjcf05n02 ras-resource-manager-agent[5929]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '83db996e-9a2b-11ef-abf8-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 15:35:16 kjcf05n02 ras-resource-manager-agent[5929]: INFO Submitting new device inserted signal, starting to qualify drive: 83db996e-9a2b-11ef-abf8-00093d0695e3 (admin_action.py:110) Nov 3 15:35:16 kjcf05n02 firmware-update-orc-server[5885]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "52efee10-e9fb-4053-b93e-63635a4cc506"} (logger.py:65) Nov 3 15:35:19 kjcf05n03 DRVFW[254280]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 15:35:19 kjcf05n03 ccp-client[254281]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 15:35:19 kjcf05n03 ccp-client[254281]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 15:35:19 kjcf05n03 ccp-client[254290]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 15:35:19 kjcf05n03 ccp-client[254281]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 15:35:19 kjcf05n03 ccp-client[254281]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 15:35:19 kjcf05n03 ccp-client[254290]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 15:35:19 kjcf05n03 ccp-client[254290]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 15:35:19 kjcf05n03 firmware-update-orc-server[5844]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 15:35:19 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 8393a5d2-9a2b-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 15:35:19 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '83896180-9a2b-11ef-abf8-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '83896180-9a2b-11ef-abf8-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}}} (logger.py:65) Nov 3 15:35:19 kjcf05n02 ras-resource-manager-agent[5929]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '83896180-9a2b-11ef-abf8-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 15:35:19 kjcf05n02 ras-resource-manager-agent[5929]: INFO Drive qualification complete responding: 83896180-9a2b-11ef-abf8-00093d0695e3 (admin_action.py:205) Nov 3 15:35:19 kjcf05n02 ras-resource-manager-agent[5929]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "83896180-9a2b-11ef-abf8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (interesting_event.py:59) Nov 3 15:35:22 kjcf05n02 diskmonitor[17553]: drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 15:35:22 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 15:35:22 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 15:35:22 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 15:35:22 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 15:35:22 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 15:35:22 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 15:35:22 kjcf05n02 diskmonitor[17553]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 15:35:22 kjcf05n02 diskmonitor[17553]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 15:35:22 kjcf05n02 diskmonitor[17553]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 15:35:22 kjcf05n02 diskmonitor[17553]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 15:35:22 kjcf05n02 diskmonitor[17553]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 15:35:22 kjcf05n02 diskmonitor[17553]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "83896180-9a2b-11ef-abf8-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 15:35:22 kjcf05n02 diskmonitor[17553]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 15:35:22 kjcf05n02 diskmonitor[17553]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 15:35:22 kjcf05n02 diskmonitor[17553]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "83db996e-9a2b-11ef-abf8-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 15:35:22 kjcf05n02 diskmonitor[17553]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 15:35:22 kjcf05n02 diskmonitor[17553]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 15:35:25 kjcf05n02 chronyd[5172]: Selected source 172.16.2.1 Nov 3 15:35:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730669430', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 15:35:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730669430'} Nov 3 15:35:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:35:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730669430', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 15:35:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730669430'} Nov 3 15:35:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:35:26 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22490 (get_disk_device) Nov 3 15:35:26 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 15:35:26 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 15:35:26 kjcf05n02 ccp-client[22526]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 15:35:26 kjcf05n02 ccp-client[22526]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 15:35:26 kjcf05n02 ccp-client[22540]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 15:35:26 kjcf05n02 ccp-client[22526]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 15:35:26 kjcf05n02 ccp-client[22526]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 15:35:26 kjcf05n02 ccp-client[22540]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 15:35:26 kjcf05n02 ccp-client[22540]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 15:35:26 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 3 15:35:27 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 15:35:27 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 3 15:35:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730669728}"] Nov 3 15:35:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730669728, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:35:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:35:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730669728}"] Nov 3 15:35:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730669728, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:35:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:35:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730669728}"] Nov 3 15:35:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730669728, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:35:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:35:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730669728}"] Nov 3 15:35:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730669728, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:35:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:35:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730669728}"] Nov 3 15:35:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730669728, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:35:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:35:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730669728}"] Nov 3 15:35:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730669728, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:35:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:35:29 kjcf05n02 DRVFW[22855]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 15:35:29 kjcf05n02 ccp-client[22856]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 15:35:29 kjcf05n02 ccp-client[22856]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 15:35:29 kjcf05n02 ccp-client[22865]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 15:35:29 kjcf05n02 ccp-client[22856]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 15:35:29 kjcf05n02 ccp-client[22856]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 15:35:29 kjcf05n02 ccp-client[22865]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 15:35:29 kjcf05n02 ccp-client[22865]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 15:35:29 kjcf05n02 firmware-update-orc-server[5885]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 15:35:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730669728}"] Nov 3 15:35:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730669728, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:35:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:35:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730669729}"] Nov 3 15:35:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730669729, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:35:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:35:30 kjcf05n02 ras-resource-manager-agent[5929]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "83896180-9a2b-11ef-abf8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (service_main_handler.py:66) Nov 3 15:35:30 kjcf05n02 ras-resource-manager-agent[5929]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '83896180-9a2b-11ef-abf8-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 15:35:30 kjcf05n02 ras-resource-manager-agent[5929]: INFO Device qualification response has been acknowledged: 83896180-9a2b-11ef-abf8-00093d0695e3 (admin_action.py:151) Nov 3 15:35:30 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 83e25b64-9a2b-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 15:35:30 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '83db996e-9a2b-11ef-abf8-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '83db996e-9a2b-11ef-abf8-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}}} (logger.py:65) Nov 3 15:35:31 kjcf05n02 ras-resource-manager-agent[5929]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '83db996e-9a2b-11ef-abf8-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}} (resource_admin.py:98) Nov 3 15:35:31 kjcf05n02 ras-resource-manager-agent[5929]: INFO Drive qualification complete responding: 83db996e-9a2b-11ef-abf8-00093d0695e3 (admin_action.py:205) Nov 3 15:35:31 kjcf05n02 ras-resource-manager-agent[5929]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "83db996e-9a2b-11ef-abf8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (interesting_event.py:59) Nov 3 15:35:34 kjcf05n02 diskmonitor[17553]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 15:35:35 kjcf05n02 diskmonitor[17553]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 15:35:35 kjcf05n02 ras-resource-manager-agent[5929]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "8f3e03fa-9a2b-11ef-abf8-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 15:35:35 kjcf05n02 ras-resource-manager-agent[5929]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '8f3e03fa-9a2b-11ef-abf8-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 15:35:35 kjcf05n02 ras-resource-manager-agent[5929]: INFO Requests ['83db996e-9a2b-11ef-abf8-00093d0695e3', '8f3e03fa-9a2b-11ef-abf8-00093d0695e3'] already in progress (admin_action.py:99) Nov 3 15:35:35 kjcf05n02 ras-resource-manager-agent[5929]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '8f3e03fa-9a2b-11ef-abf8-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}} (resource_admin.py:98) Nov 3 15:35:35 kjcf05n02 ras-resource-manager-agent[5929]: INFO Drive qualification complete responding: 8f3e03fa-9a2b-11ef-abf8-00093d0695e3 (admin_action.py:205) Nov 3 15:35:35 kjcf05n02 ras-resource-manager-agent[5929]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "83db996e-9a2b-11ef-abf8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (interesting_event.py:59) Nov 3 15:35:35 kjcf05n02 ras-resource-manager-agent[5929]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "8f3e03fa-9a2b-11ef-abf8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (interesting_event.py:59) Nov 3 15:35:37 kjcf05n02 python3.9[5235]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 15:35:40 kjcf05n02 python3.9[3182]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "83896180-9a2b-11ef-abf8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: Dbus, handle_ingress_ras_signals, uuid: 83896180-9a2b-11ef-abf8-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "83896180-9a2b-11ef-abf8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: main: Pending firmware leveling requests exist, rescanning disks Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "8f3e03fa-9a2b-11ef-abf8-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: leaving test state: 1 next state: 2 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: lock req: no timeout Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: leaving test state: 2 next state: 4 Nov 3 15:35:40 kjcf05n02 diskmonitor[17553]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 15:35:44 kjcf05n00 mcfcli[3673891]: %3|1730669744.366|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:35:45 kjcf05n00 mcfcli[3673891]: %3|1730669745.690|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 15:36:15 kjcf05n00 mcfcli[3673891]: %3|1730669775.690|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 15:36:23 kjcf05n00 mcfcli[3673891]: %3|1730669783.227|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:36:25 kjcf05n03 nslcd[6915]: [efd79f] ldap_result() failed: Can't contact LDAP server Nov 3 15:36:32 kjcf05n02 ras-resource-manager-agent[5929]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "83db996e-9a2b-11ef-abf8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (service_main_handler.py:66) Nov 3 15:36:32 kjcf05n02 ras-resource-manager-agent[5929]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '83db996e-9a2b-11ef-abf8-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}} (resource_admin.py:98) Nov 3 15:36:32 kjcf05n02 ras-resource-manager-agent[5929]: INFO Device qualification response has been acknowledged: 83db996e-9a2b-11ef-abf8-00093d0695e3 (admin_action.py:151) Nov 3 15:36:32 kjcf05n02 ras-resource-manager-agent[5929]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "83db996e-9a2b-11ef-abf8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (service_main_handler.py:66) Nov 3 15:36:32 kjcf05n02 ras-resource-manager-agent[5929]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '83db996e-9a2b-11ef-abf8-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}} (resource_admin.py:98) Nov 3 15:36:32 kjcf05n02 ras-resource-manager-agent[5929]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "8f3e03fa-9a2b-11ef-abf8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (service_main_handler.py:66) Nov 3 15:36:32 kjcf05n02 ras-resource-manager-agent[5929]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '8f3e03fa-9a2b-11ef-abf8-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}} (resource_admin.py:98) Nov 3 15:36:32 kjcf05n02 ras-resource-manager-agent[5929]: INFO Device qualification response has been acknowledged: 8f3e03fa-9a2b-11ef-abf8-00093d0695e3 (admin_action.py:151) Nov 3 15:36:33 kjcf05n02 diskmonitor[17553]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 15:36:36 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 15:36:36 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 15:36:36 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 15:36:43 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 15:36:45 kjcf05n00 mcfcli[3673891]: %3|1730669805.690|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 15:36:47 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 15:36:47 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 15:36:47 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 15:36:49 kjcf05n02 dcs-collectord[5665]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 15:36:49 kjcf05n02 diskmonitor[17553]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "83db996e-9a2b-11ef-abf8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 3 15:36:49 kjcf05n02 diskmonitor[17553]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 15:36:49 kjcf05n02 diskmonitor[17553]: Dbus, handle_ingress_ras_signals, uuid: 83db996e-9a2b-11ef-abf8-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 15:36:49 kjcf05n02 diskmonitor[17553]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 15:36:49 kjcf05n02 diskmonitor[17553]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "83db996e-9a2b-11ef-abf8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 3 15:36:49 kjcf05n02 diskmonitor[17553]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "83db996e-9a2b-11ef-abf8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 3 15:36:49 kjcf05n02 diskmonitor[17553]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 15:36:49 kjcf05n02 diskmonitor[17553]: Dbus, handle_ingress_ras_signals, uuid: 83db996e-9a2b-11ef-abf8-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 15:36:49 kjcf05n02 diskmonitor[17553]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "83db996e-9a2b-11ef-abf8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 3 15:36:49 kjcf05n02 diskmonitor[17553]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "8f3e03fa-9a2b-11ef-abf8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 3 15:36:49 kjcf05n02 diskmonitor[17553]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 15:36:49 kjcf05n02 diskmonitor[17553]: Dbus, handle_ingress_ras_signals, uuid: 8f3e03fa-9a2b-11ef-abf8-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 15:36:49 kjcf05n02 diskmonitor[17553]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "8f3e03fa-9a2b-11ef-abf8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 3 15:36:49 kjcf05n02 diskmonitor[17553]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 15:36:49 kjcf05n02 diskmonitor[17553]: lock acquired Nov 3 15:36:49 kjcf05n02 diskmonitor[17553]: leaving test state: 4 next state: 8 Nov 3 15:36:49 kjcf05n02 diskmonitor[17553]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 15:36:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730669818}"] Nov 3 15:36:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730669818, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:36:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:36:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:36:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:36:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:36:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:36:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:36:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:36:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:36:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:36:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:36:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:36:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:36:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:36:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.286653ms Nov 3 15:36:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:36:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.286653ms Nov 3 15:36:58 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:36:58 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:36:58 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:36:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Inactive', 'timestamp': 1730669818}"] Nov 3 15:36:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730669818, 'value': 'Inactive', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:36:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:36:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:36:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:36:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:36:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:36:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:36:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:36:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:36:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:36:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:36:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:36:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:36:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:36:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.178319ms Nov 3 15:36:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:36:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.178319ms Nov 3 15:36:59 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:36:59 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:37:01 kjcf05n00 mcfcli[3673891]: %3|1730669821.788|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:37:10 kjcf05n02 diskmonitor[17553]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 15:37:10 kjcf05n02 diskmonitor[17553]: leaving test state: 8 next state: 20 Nov 3 15:37:10 kjcf05n02 diskmonitor[17553]: leaving test state: 20 next state: 40 Nov 3 15:37:10 kjcf05n02 diskmonitor[17553]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset d655b88000 Nov 3 15:37:10 kjcf05n02 diskmonitor[17553]: leaving test state: 40 next state: 80 Nov 3 15:37:15 kjcf05n00 mcfcli[3673891]: %3|1730669835.690|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 15:37:32 kjcf05n02 diskmonitor[17553]: leaving test state: 80 next state: 100 Nov 3 15:37:32 kjcf05n02 diskmonitor[17553]: lock release: time: Sun Nov 3 15:37:25 2024 Nov 3 15:37:32 kjcf05n02 diskmonitor[17553]: leaving test state: 100 next state: 1 Nov 3 15:37:34 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 15:37:39 kjcf05n00 mcfcli[3673891]: %3|1730669859.604|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:37:45 kjcf05n00 mcfcli[3673891]: %3|1730669865.691|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:38:15 kjcf05n00 mcfcli[3673891]: %3|1730669895.692|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 15:38:15 kjcf05n00 mcfcli[3673891]: %3|1730669895.771|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:38:45 kjcf05n00 mcfcli[3673891]: %3|1730669925.692|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:38:55 kjcf05n00 mcfcli[3673891]: %3|1730669935.768|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:39:15 kjcf05n00 mcfcli[3673891]: %3|1730669955.692|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 15:39:26 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31449 deleted. Nov 3 15:39:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730669968}"] Nov 3 15:39:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730669968, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:39:28 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:39:28-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:39:28 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:39:28-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:39:28 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:39:28-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:39:28 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:39:28-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:39:28 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:39:28-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:39:28 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:39:28-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:39:28 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:39:28-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.198387ms Nov 3 15:39:28 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:39:28-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.198387ms Nov 3 15:39:28 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:39:28 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:39:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:39:32 kjcf05n00 mcfcli[3673891]: %3|1730669972.643|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:39:45 kjcf05n00 mcfcli[3673891]: %3|1730669985.693|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 15:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 15:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 15:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 15:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 15:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 15:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 15:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 15:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 15:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 15:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 15:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 15:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 15:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 15:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 15:40:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 15:40:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:40:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 15:40:04 kjcf05n00 zabbix-server[1372265]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:40:04 kjcf05n00 zabbix-server[1372265]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n02' from event '46376' Nov 3 15:40:04 kjcf05n00 zabbix-server[1372265]: Host created 'enclosure_USE26000024VS001' Nov 3 15:40:04 kjcf05n00 zabbix-server[1372265]: Running puppet on 'kjcf05n02' Nov 3 15:40:07 kjcf05n02 puppet-agent[34230]: Using configured environment 'production' Nov 3 15:40:07 kjcf05n02 puppet-agent[34230]: Retrieving pluginfacts Nov 3 15:40:07 kjcf05n02 puppet-agent[34230]: Retrieving plugin Nov 3 15:40:07 kjcf05n02 puppet-agent[34230]: Loading facts Nov 3 15:40:10 kjcf05n02 puppet-agent[34230]: Caching catalog for kjcf05n02 Nov 3 15:40:10 kjcf05n02 puppet-agent[34230]: Applying configuration version '1730670008' Nov 3 15:40:10 kjcf05n00 mcfcli[3673891]: %3|1730670010.083|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:40:12 kjcf05n02 puppet-agent[34230]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 15:40:12 kjcf05n02 puppet-agent[34230]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 15:40:12 kjcf05n02 puppet-agent[34230]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 15:40:13 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 15:40:13 kjcf05n02 zabbix_agent2[6013]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 15:40:13 kjcf05n02 zabbix_agent2[3182]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:40:13 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 15:40:13 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 15:40:13 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 15:40:13 kjcf05n02 puppet-agent[34230]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: Press Ctrl+C to exit. Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: Plugin support version 1.0 Nov 3 15:40:13 kjcf05n02 zabbix_agent2[34585]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 15:40:12 kjcf05n00 python3.9[1372294]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 15:40:15 kjcf05n02 puppet-agent[34230]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 15:40:15 kjcf05n02 puppet-agent[34230]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 15:40:15 kjcf05n02 puppet-agent[34230]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 15:40:15 kjcf05n02 puppet-agent[34230]: Applied catalog in 5.18 seconds Nov 3 15:40:15 kjcf05n00 zabbix-server[1372265]: puppet completed status:(0): '' Nov 3 15:40:15 kjcf05n00 zabbix-server[1372265]: Event '46376' acknowledged Nov 3 15:40:15 kjcf05n00 zabbix-server[1372265]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n02"}' Nov 3 15:40:15 kjcf05n00 mcfcli[3673891]: %3|1730670015.693|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:40:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730669430', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 15:40:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730669430'} Nov 3 15:40:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:40:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730669430', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 15:40:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730669430'} Nov 3 15:40:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:40:45 kjcf05n00 mcfcli[3673891]: %3|1730670045.693|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 15:40:48 kjcf05n00 mcfcli[3673891]: %3|1730670048.446|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:41:15 kjcf05n00 mcfcli[3673891]: %3|1730670075.694|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:41:25 kjcf05n00 mcfcli[3673891]: %3|1730670085.099|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:41:45 kjcf05n00 mcfcli[3673891]: %3|1730670105.694|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 15:41:46 kjcf05n00 zabbix-server[1373626]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:41:46 kjcf05n00 zabbix-server[1373626]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 264.83\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 135.62\\"}}"' Nov 3 15:41:46 kjcf05n00 log_interesting_event.py[1373626]: Event '46378' acknowledged Nov 3 15:42:02 kjcf05n00 mcfcli[3673891]: %3|1730670122.090|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:42:15 kjcf05n00 mcfcli[3673891]: %3|1730670135.694|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:42:37 kjcf05n00 mcfcli[3673891]: %3|1730670157.888|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:42:45 kjcf05n00 mcfcli[3673891]: %3|1730670165.694|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:43:14 kjcf05n00 mcfcli[3673891]: %3|1730670194.065|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:43:15 kjcf05n00 mcfcli[3673891]: %3|1730670195.695|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 15:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T15:43:27.252948829-06:00 level=info msg="Completed cleanup jobs" duration=26.267874ms Nov 3 15:43:45 kjcf05n00 mcfcli[3673891]: %3|1730670225.695|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:43:51 kjcf05n00 mcfcli[3673891]: %3|1730670231.080|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:44:10 kjcf05n05 dwd[10696]: md1 read await report (#disks=53, min #ops=4.8e6): mean=28.1, sd=1.2, min=23.4, q1=27.9, q2=28.3, q3=28.6, max=30.1 (dm-56/0x5000c500ae885aaf) Nov 3 15:44:10 kjcf05n05 dwd[10696]: md1 write await report (#disks=53, min #ops=3.9e6): mean=29.0, sd=0.8, min=26.7, q1=28.5, q2=28.8, q3=29.3, max=31.1 (dm-102/0x5000c500c9ad8c63) Nov 3 15:44:15 kjcf05n00 mcfcli[3673891]: %3|1730670255.696|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:44:26 kjcf05n03 nslcd[6915]: [a7c4c9] ldap_result() failed: Can't contact LDAP server Nov 3 15:44:26 kjcf05n03 nslcd[6915]: [68079a] ldap_result() failed: Can't contact LDAP server Nov 3 15:44:31 kjcf05n00 mcfcli[3673891]: %3|1730670271.077|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:44:45 kjcf05n00 mcfcli[3673891]: %3|1730670285.697|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:45:01 kjcf05n02 root[42268]: failback_xyraid Nov 3 15:45:02 kjcf05n02 root[42422]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 15:45:03 kjcf05n02 root[42566]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 15:45:04 kjcf05n04 dwd[10437]: md0 read await report (#disks=53, min #ops=4.6e6): mean=26.6, sd=0.9, min=23.3, q1=26.2, q2=26.6, q3=27.1, max=29.3 (dm-83/0x5000c500c9adb153) Nov 3 15:45:04 kjcf05n04 dwd[10437]: md0 write await report (#disks=53, min #ops=3.7e6): mean=28.2, sd=0.9, min=26.8, q1=27.5, q2=28.0, q3=28.7, max=31.5 (dm-95/0x5000c500c9adb323) Nov 3 15:45:06 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 3 15:45:09 kjcf05n00 mcfcli[3673891]: %3|1730670309.014|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:45:10 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme24n1 Nov 3 15:45:10 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme19n1 Nov 3 15:45:10 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme18n1 Nov 3 15:45:10 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme8n1 Nov 3 15:45:10 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme25n1 Nov 3 15:45:10 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme2n1 Nov 3 15:45:10 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme3n1 Nov 3 15:45:10 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme23n1 Nov 3 15:45:10 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme17n1 Nov 3 15:45:10 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme4n1 Nov 3 15:45:10 kjcf05n03 dwd[5164]: Drive path is missing, purging: nvme9n1 Nov 3 15:45:12 kjcf05n02 dwd[5204]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 15:45:12 kjcf05n02 dwd[5204]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 15:45:12 kjcf05n02 dwd[5204]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 15:45:12 kjcf05n02 dwd[5204]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 15:45:12 kjcf05n02 dwd[5204]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 15:45:12 kjcf05n02 dwd[5204]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 15:45:12 kjcf05n02 dwd[5204]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 15:45:12 kjcf05n02 dwd[5204]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 15:45:12 kjcf05n02 dwd[5204]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 15:45:12 kjcf05n02 dwd[5204]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 15:45:12 kjcf05n02 dwd[5204]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 15:45:12 kjcf05n02 dwd[5204]: Starting NVME thread for nvme2n1 Nov 3 15:45:12 kjcf05n02 dwd[5204]: Starting NVME thread for nvme18n1 Nov 3 15:45:12 kjcf05n02 dwd[5204]: Starting NVME thread for nvme19n1 Nov 3 15:45:12 kjcf05n02 dwd[5204]: Starting NVME thread for nvme9n1 Nov 3 15:45:12 kjcf05n00 python3.9[1375433]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 15:45:13 kjcf05n02 dwd[5204]: Starting NVME thread for nvme3n1 Nov 3 15:45:13 kjcf05n02 dwd[5204]: Starting NVME thread for nvme24n1 Nov 3 15:45:13 kjcf05n02 dwd[5204]: Starting NVME thread for nvme4n1 Nov 3 15:45:13 kjcf05n02 dwd[5204]: Starting NVME thread for nvme23n1 Nov 3 15:45:13 kjcf05n02 systemd-udevd[45358]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45359]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45361]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45362]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45358]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45359]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45362]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45361]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45359]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45358]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45361]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45362]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45358]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45359]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45362]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45361]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45358]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45359]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45381]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45362]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45361]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45382]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45358]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45384]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45359]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45389]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45381]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45362]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45361]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45382]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45384]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45359]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45381]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45389]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45362]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45361]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45384]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45382]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45389]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45359]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45381]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45362]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45389]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 dwd[5204]: Starting NVME thread for nvme17n1 Nov 3 15:45:13 kjcf05n02 systemd-udevd[45359]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45389]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45362]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45359]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45361]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45381]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45362]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45359]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45389]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45362]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45362]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45389]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45362]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45362]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45389]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45362]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45389]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 dwd[5204]: Starting NVME thread for nvme25n1 Nov 3 15:45:13 kjcf05n02 systemd-udevd[45362]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45389]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45362]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 systemd-udevd[45362]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:45:13 kjcf05n02 dwd[5204]: Starting NVME thread for nvme8n1 Nov 3 15:45:14 kjcf05n02 nslcd[7269]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 15:45:15 kjcf05n02 dcs-bulk-data-sender[6222]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 3 15:45:15 kjcf05n02 diskmonitor[17553]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 15:45:15 kjcf05n00 mcfcli[3673891]: %3|1730670315.697|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:45:20 kjcf05n06 dwd[5504]: md128 write await report (#disks=12, min #ops=1.6e5): mean=0.0, sd=0.0, min=0.0, q1=0.0, q2=0.0, q3=0.0, max=0.0 (nvme17n1p1/eui.345950304e3006070025384500000003) Nov 3 15:45:20 kjcf05n06 dwd[5504]: md0 read await report (#disks=12, min #ops=2.9e7): mean=0.3, sd=0.0, min=0.3, q1=0.3, q2=0.3, q3=0.3, max=0.3 (nvme4n1p3/eui.345950304e3006210025384500000003) Nov 3 15:45:20 kjcf05n06 dwd[5504]: md0 write await report (#disks=12, min #ops=4.0e7): mean=0.4, sd=0.0, min=0.4, q1=0.4, q2=0.4, q3=0.4, max=0.4 (nvme4n1p3/eui.345950304e3006210025384500000003) Nov 3 15:45:20 kjcf05n06 dwd[5504]: md129 write await report (#disks=12, min #ops=2.1e5): mean=0.1, sd=0.0, min=0.1, q1=0.1, q2=0.1, q3=0.1, max=0.1 (nvme8n1p2/eui.345950304e3005800025384500000003) Nov 3 15:45:22 kjcf05n02 diskmonitor[17553]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 15:45:22 kjcf05n02 diskmonitor[17553]: Scan for ReadErrorMax change for md65 Nov 3 15:45:22 kjcf05n02 diskmonitor[17553]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 15:45:22 kjcf05n02 diskmonitor[17553]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 15:45:22 kjcf05n02 diskmonitor[17553]: read_saved_file: md65 no saved speed Nov 3 15:45:22 kjcf05n02 diskmonitor[17553]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 15:45:22 kjcf05n02 diskmonitor[17553]: Set sync_speed_min (10000) for md65 Nov 3 15:45:22 kjcf05n02 diskmonitor[17553]: Set sync_speed_max (200000) for md65 Nov 3 15:45:22 kjcf05n02 diskmonitor[17553]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 15:45:45 kjcf05n00 mcfcli[3673891]: %3|1730670345.622|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:45:45 kjcf05n00 mcfcli[3673891]: %3|1730670345.697|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 15:45:52 kjcf05n07 dwd[5489]: md130 write await report (#disks=12, min #ops=1.7e5): mean=0.0, sd=0.0, min=0.0, q1=0.0, q2=0.0, q3=0.0, max=0.0 (nvme13n1p1/eui.345950304e3006020025384500000003) Nov 3 15:45:52 kjcf05n07 dwd[5489]: md1 read await report (#disks=12, min #ops=2.9e7): mean=0.3, sd=0.0, min=0.3, q1=0.3, q2=0.3, q3=0.3, max=0.3 (nvme7n1p3/eui.345950304e3006150025384500000003) Nov 3 15:45:52 kjcf05n07 dwd[5489]: md1 write await report (#disks=12, min #ops=3.9e7): mean=0.4, sd=0.0, min=0.3, q1=0.3, q2=0.4, q3=0.4, max=0.4 (nvme7n1p3/eui.345950304e3006150025384500000003) Nov 3 15:45:52 kjcf05n07 dwd[5489]: md131 write await report (#disks=12, min #ops=2.1e5): mean=0.1, sd=0.0, min=0.1, q1=0.1, q2=0.1, q3=0.1, max=0.1 (nvme11n1p2/eui.345950304e3006080025384500000003) Nov 3 15:46:07 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 15:46:07 kjcf05n02 systemd-tmpfiles[48244]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:46:07 kjcf05n02 systemd-tmpfiles[48244]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:46:07 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 15:46:07 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 15:46:10 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 48406 (bash) Nov 3 15:46:10 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 15:46:10 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 15:46:12 kjcf05n03 diskmonitor[17700]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 15:46:12 kjcf05n03 diskmonitor[17700]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 15:46:15 kjcf05n00 mcfcli[3673891]: %3|1730670375.698|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:46:25 kjcf05n00 mcfcli[3673891]: %3|1730670385.279|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:46:45 kjcf05n00 mcfcli[3673891]: %3|1730670405.698|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:46:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730670419}"] Nov 3 15:46:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730670419, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:46:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:46:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:46:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:46:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:46:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:46:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:46:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:46:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:46:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:46:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:46:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:46:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:46:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:46:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.223013ms Nov 3 15:46:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:46:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.223013ms Nov 3 15:46:59 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:46:59 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:46:59 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:46:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730670419}"] Nov 3 15:46:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730670419, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:46:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:46:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:46:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:46:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:46:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:46:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:46:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:46:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:46:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:46:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:46:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:46:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:46:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:46:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.875423ms Nov 3 15:46:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:46:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.875423ms Nov 3 15:46:59 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:46:59 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:46:59 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:46:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730670419}"] Nov 3 15:46:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730670419, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:46:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:46:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:46:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:46:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:46:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:46:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:46:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:46:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:46:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:46:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:46:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:46:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:46:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:46:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.607911ms Nov 3 15:46:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:46:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.607911ms Nov 3 15:46:59 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:46:59 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:46:59 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:46:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730670419}"] Nov 3 15:46:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730670419, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:46:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:46:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:46:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:46:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:46:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:46:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:46:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:46:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:46:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:46:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:46:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:46:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:46:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:46:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.93294ms Nov 3 15:46:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:46:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.93294ms Nov 3 15:46:59 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:46:59 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:46:59 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:46:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730670419}"] Nov 3 15:46:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730670419, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:46:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:46:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:46:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:46:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:46:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:46:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:46:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:46:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:46:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:46:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:46:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:46:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:46:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:46:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.074425ms Nov 3 15:46:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:46:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.074425ms Nov 3 15:46:59 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:46:59 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:46:59 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:46:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730670419}"] Nov 3 15:46:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730670419, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:46:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:46:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:46:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:46:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:46:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:46:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:46:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:46:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:46:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:46:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:46:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:46:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:46:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:46:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.905088ms Nov 3 15:46:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:46:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.905088ms Nov 3 15:46:59 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:46:59 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:46:59 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:47:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730670419}"] Nov 3 15:47:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730670419, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:47:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:47:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:47:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:47:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:47:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:47:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:47:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:47:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:47:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:47:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:47:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:47:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:47:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:47:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.23187ms Nov 3 15:47:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:47:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.23187ms Nov 3 15:47:00 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:47:00 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:47:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:47:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730670419}"] Nov 3 15:47:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730670419, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:47:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:47:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:47:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:47:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:47:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:47:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:47:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:47:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:47:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:47:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:47:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:47:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:47:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:47:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.66043ms Nov 3 15:47:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:47:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.66043ms Nov 3 15:47:00 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:47:00 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:47:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:47:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730670419}"] Nov 3 15:47:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730670419, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:47:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:47:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:47:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:47:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:47:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:47:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:47:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:47:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:47:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:47:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:47:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:47:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:47:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:47:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.759034ms Nov 3 15:47:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:47:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.759034ms Nov 3 15:47:00 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:47:00 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:47:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:47:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730670419}"] Nov 3 15:47:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730670419, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:47:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:47:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:47:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:47:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:47:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:47:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:47:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:47:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:47:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:47:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:47:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:47:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:47:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:47:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.907563ms Nov 3 15:47:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:47:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.907563ms Nov 3 15:47:00 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:47:00 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:47:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:47:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730670419}"] Nov 3 15:47:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730670419, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:47:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:47:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:47:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:47:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:47:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:47:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:47:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:47:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:47:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:47:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:47:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:47:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:47:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:47:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.056321ms Nov 3 15:47:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:47:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.056321ms Nov 3 15:47:00 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:47:00 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:47:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:47:05 kjcf05n00 mcfcli[3673891]: %3|1730670425.276|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:47:15 kjcf05n00 mcfcli[3673891]: %3|1730670435.698|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:47:40 kjcf05n04 diskmonitor[39342]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 15:47:45 kjcf05n00 mcfcli[3673891]: %3|1730670465.273|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:47:45 kjcf05n00 mcfcli[3673891]: %3|1730670465.698|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:48:15 kjcf05n06 diskmonitor[19372]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 15:48:15 kjcf05n00 mcfcli[3673891]: %3|1730670495.699|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:48:23 kjcf05n00 mcfcli[3673891]: %3|1730670503.075|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:48:45 kjcf05n00 mcfcli[3673891]: %3|1730670525.699|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:49:01 kjcf05n00 mcfcli[3673891]: %3|1730670541.133|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:49:08 kjcf05n07 diskmonitor[19063]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 15:49:15 kjcf05n00 mcfcli[3673891]: %3|1730670555.700|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:49:21 kjcf05n00 zabbix-server[1377889]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:49:21 kjcf05n00 zabbix-server[1377889]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 130.84\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 76.77\\"}}"' Nov 3 15:49:22 kjcf05n00 log_interesting_event.py[1377889]: Event '46381' acknowledged Nov 3 15:49:39 kjcf05n05 diskmonitor[40540]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 15:49:40 kjcf05n00 mcfcli[3673891]: %3|1730670580.400|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:49:45 kjcf05n00 mcfcli[3673891]: %3|1730670585.700|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 15:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 15:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 15:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 15:50:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 15:50:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:50:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 15:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 15:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 15:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 15:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 15:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 15:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 15:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 15:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 15:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 15:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 15:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 15:50:04 kjcf05n00 zabbix-server[1378282]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:50:04 kjcf05n00 zabbix-server[1378282]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46382' Nov 3 15:50:04 kjcf05n00 zabbix-server[1378282]: Filesystem 'kjcf05' has been mounted Nov 3 15:50:05 kjcf05n00 zabbix-server[1378282]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 15:50:05 kjcf05n00 zabbix-server[1378282]: Running puppet on 'None' Nov 3 15:50:06 kjcf05n06 puppet-agent[3468718]: Using configured environment 'production' Nov 3 15:50:06 kjcf05n06 puppet-agent[3468718]: Retrieving pluginfacts Nov 3 15:50:06 kjcf05n06 puppet-agent[3468718]: Retrieving plugin Nov 3 15:50:07 kjcf05n03 puppet-agent[280350]: Using configured environment 'production' Nov 3 15:50:07 kjcf05n03 puppet-agent[280350]: Retrieving pluginfacts Nov 3 15:50:07 kjcf05n03 puppet-agent[280350]: Retrieving plugin Nov 3 15:50:07 kjcf05n05 puppet-agent[3626113]: Using configured environment 'production' Nov 3 15:50:07 kjcf05n05 puppet-agent[3626113]: Retrieving pluginfacts Nov 3 15:50:07 kjcf05n05 puppet-agent[3626113]: Retrieving plugin Nov 3 15:50:07 kjcf05n05 puppet-agent[3626113]: Loading facts Nov 3 15:50:07 kjcf05n07 puppet-agent[3464979]: Using configured environment 'production' Nov 3 15:50:07 kjcf05n07 puppet-agent[3464979]: Retrieving pluginfacts Nov 3 15:50:07 kjcf05n07 puppet-agent[3464979]: Retrieving plugin Nov 3 15:50:07 kjcf05n04 puppet-agent[3464263]: Using configured environment 'production' Nov 3 15:50:07 kjcf05n04 puppet-agent[3464263]: Retrieving pluginfacts Nov 3 15:50:07 kjcf05n04 puppet-agent[3464263]: Retrieving plugin Nov 3 15:50:07 kjcf05n04 puppet-agent[3464263]: Loading facts Nov 3 15:50:07 kjcf05n02 puppet-agent[55758]: Using configured environment 'production' Nov 3 15:50:07 kjcf05n02 puppet-agent[55758]: Retrieving pluginfacts Nov 3 15:50:07 kjcf05n02 puppet-agent[55758]: Retrieving plugin Nov 3 15:50:07 kjcf05n02 puppet-agent[55758]: Loading facts Nov 3 15:50:07 kjcf05n06 puppet-agent[3468718]: Loading facts Nov 3 15:50:07 kjcf05n01 puppet-agent[3171473]: Using configured environment 'production' Nov 3 15:50:07 kjcf05n01 puppet-agent[3171473]: Retrieving pluginfacts Nov 3 15:50:07 kjcf05n01 puppet-agent[3171473]: Retrieving plugin Nov 3 15:50:07 kjcf05n03 puppet-agent[280350]: Loading facts Nov 3 15:50:07 kjcf05n07 puppet-agent[3464979]: Loading facts Nov 3 15:50:07 kjcf05n00 puppet-agent[1378386]: Using configured environment 'production' Nov 3 15:50:07 kjcf05n00 puppet-agent[1378386]: Retrieving pluginfacts Nov 3 15:50:07 kjcf05n00 puppet-agent[1378386]: Retrieving plugin Nov 3 15:50:08 kjcf05n01 puppet-agent[3171473]: Loading facts Nov 3 15:50:07 kjcf05n00 puppet-agent[1378386]: Loading facts Nov 3 15:50:10 kjcf05n06 puppet-agent[3468718]: Caching catalog for kjcf05n06 Nov 3 15:50:10 kjcf05n06 puppet-agent[3468718]: Applying configuration version '1730670608' Nov 3 15:50:10 kjcf05n03 puppet-agent[280350]: Caching catalog for kjcf05n03 Nov 3 15:50:10 kjcf05n03 puppet-agent[280350]: Applying configuration version '1730670608' Nov 3 15:50:10 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 15:50:10 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 15:50:10 kjcf05n02 puppet-agent[55758]: Caching catalog for kjcf05n02 Nov 3 15:50:10 kjcf05n02 puppet-agent[55758]: Applying configuration version '1730670608' Nov 3 15:50:10 kjcf05n07 puppet-agent[3464979]: Caching catalog for kjcf05n07 Nov 3 15:50:10 kjcf05n07 puppet-agent[3464979]: Applying configuration version '1730670608' Nov 3 15:50:11 kjcf05n01 puppet-agent[3171473]: Caching catalog for kjcf05n01 Nov 3 15:50:11 kjcf05n00 puppet-agent[1378386]: Caching catalog for kjcf05n00 Nov 3 15:50:11 kjcf05n00 puppet-agent[1378386]: Applying configuration version '1730670609' Nov 3 15:50:12 kjcf05n01 puppet-agent[3171473]: Applying configuration version '1730670609' Nov 3 15:50:12 kjcf05n06 puppet-agent[3468718]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 15:50:12 kjcf05n06 puppet-agent[3468718]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 15:50:12 kjcf05n06 puppet-agent[3468718]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 15:50:12 kjcf05n03 puppet-agent[280350]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 15:50:12 kjcf05n03 puppet-agent[280350]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 15:50:12 kjcf05n03 puppet-agent[280350]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 15:50:12 kjcf05n02 puppet-agent[55758]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 15:50:12 kjcf05n02 puppet-agent[55758]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 15:50:12 kjcf05n02 puppet-agent[55758]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 15:50:12 kjcf05n07 puppet-agent[3464979]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 15:50:12 kjcf05n07 puppet-agent[3464979]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 15:50:12 kjcf05n07 puppet-agent[3464979]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 15:50:12 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3416428]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 15:50:12 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 15:50:12 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 15:50:12 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 15:50:12 kjcf05n06 puppet-agent[3468718]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: Press Ctrl+C to exit. Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: Plugin support version 1.0 Nov 3 15:50:12 kjcf05n06 zabbix_agent2[3469196]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 15:50:12 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 15:50:12 kjcf05n03 zabbix_agent2[224715]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 15:50:12 kjcf05n03 zabbix_agent2[3072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 15:50:12 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 15:50:12 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 15:50:12 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 15:50:12 kjcf05n03 puppet-agent[280350]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: Press Ctrl+C to exit. Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: Plugin support version 1.0 Nov 3 15:50:12 kjcf05n03 zabbix_agent2[280743]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 15:50:12 kjcf05n00 zabbix_server[15723]: Zabbix agent item "system.cpu.util[,interrupt]" on host "kjcf05n06" failed: first network error, wait for 15 seconds Nov 3 15:50:13 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 15:50:13 kjcf05n02 zabbix_agent2[34585]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 15:50:13 kjcf05n02 zabbix_agent2[3182]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 15:50:13 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 15:50:13 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 15:50:13 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 15:50:13 kjcf05n02 puppet-agent[55758]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: Press Ctrl+C to exit. Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: Plugin support version 1.0 Nov 3 15:50:13 kjcf05n02 zabbix_agent2[56114]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 15:50:13 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3412588]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 15:50:13 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 15:50:13 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 15:50:13 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 15:50:13 kjcf05n07 puppet-agent[3464979]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: Press Ctrl+C to exit. Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: Plugin support version 1.0 Nov 3 15:50:13 kjcf05n07 zabbix_agent2[3465838]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 15:50:12 kjcf05n00 python3.9[1378376]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 15:50:14 kjcf05n00 puppet-agent[1378386]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 15:50:14 kjcf05n01 puppet-agent[3171473]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 15:50:14 kjcf05n01 puppet-agent[3171473]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-15:27:04]/mode) mode changed '0755' to '0750' Nov 3 15:50:14 kjcf05n06 puppet-agent[3468718]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 15:50:14 kjcf05n06 puppet-agent[3468718]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 15:50:14 kjcf05n06 puppet-agent[3468718]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 15:50:14 kjcf05n06 puppet-agent[3468718]: Applied catalog in 4.84 seconds Nov 3 15:50:14 kjcf05n03 puppet-agent[280350]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 15:50:14 kjcf05n03 puppet-agent[280350]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 15:50:14 kjcf05n03 puppet-agent[280350]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 15:50:14 kjcf05n03 puppet-agent[280350]: Applied catalog in 5.11 seconds Nov 3 15:50:15 kjcf05n01 puppet-agent[3171473]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-15:27:04/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 15:50:15 kjcf05n01 puppet-agent[3171473]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-15:27:04/vmcore]/mode) mode changed '0600' to '0640' Nov 3 15:50:15 kjcf05n01 puppet-agent[3171473]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-15:27:04/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 15:50:15 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 15:50:15 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 15:50:15 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 15:50:15 kjcf05n07 puppet-agent[3464979]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 15:50:15 kjcf05n07 puppet-agent[3464979]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 15:50:15 kjcf05n07 puppet-agent[3464979]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 15:50:15 kjcf05n02 puppet-agent[55758]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 15:50:15 kjcf05n02 puppet-agent[55758]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 15:50:15 kjcf05n02 puppet-agent[55758]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 15:50:15 kjcf05n02 puppet-agent[55758]: Applied catalog in 5.25 seconds Nov 3 15:50:15 kjcf05n04 puppet-agent[3464263]: Caching catalog for kjcf05n04 Nov 3 15:50:15 kjcf05n04 puppet-agent[3464263]: Applying configuration version '1730670613' Nov 3 15:50:15 kjcf05n07 puppet-agent[3464979]: Applied catalog in 4.96 seconds Nov 3 15:50:15 kjcf05n00 puppet-agent[1378386]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 15:50:15 kjcf05n00 puppet-agent[1378386]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 15:50:15 kjcf05n00 puppet-agent[1378386]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 15:50:15 kjcf05n01 puppet-agent[3171473]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 15:50:15 kjcf05n01 puppet-agent[3171473]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 15:50:15 kjcf05n01 puppet-agent[3171473]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 15:50:15 kjcf05n00 mcfcli[3673891]: %3|1730670615.700|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:50:15 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1360644]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 15:50:15 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 15:50:15 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 15:50:16 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3159843]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 15:50:16 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 15:50:16 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 15:50:16 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 15:50:16 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 15:50:16 kjcf05n01 puppet-agent[3171473]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: Press Ctrl+C to exit. Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: Plugin support version 1.0 Nov 3 15:50:16 kjcf05n01 zabbix_agent2[3171828]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 15:50:15 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 15:50:15 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 15:50:15 kjcf05n00 puppet-agent[1378386]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: Press Ctrl+C to exit. Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: Plugin support version 1.0 Nov 3 15:50:15 kjcf05n00 zabbix_agent2[1379115]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 15:50:16 kjcf05n00 zabbix-server[1379149]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:50:16 kjcf05n00 zabbix-server[1379150]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:50:17 kjcf05n04 puppet-agent[3464263]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 15:50:17 kjcf05n04 puppet-agent[3464263]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 15:50:17 kjcf05n04 puppet-agent[3464263]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 15:50:17 kjcf05n00 mcfcli[3673891]: %3|1730670617.054|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:50:17 kjcf05n00 zabbix-server[1379160]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:50:17 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3418367]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 15:50:17 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 15:50:17 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 15:50:17 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 15:50:17 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 15:50:17 kjcf05n04 puppet-agent[3464263]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: Press Ctrl+C to exit. Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: Plugin support version 1.0 Nov 3 15:50:17 kjcf05n04 zabbix_agent2[3465107]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 15:50:17 kjcf05n00 zabbix-server[1379165]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:50:17 kjcf05n00 puppet-agent[1378386]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 15:50:18 kjcf05n01 puppet-agent[3171473]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_153426.log]/mode) mode changed '0644' to '0640' Nov 3 15:50:18 kjcf05n01 puppet-agent[3171473]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_154609.log]/mode) mode changed '0644' to '0640' Nov 3 15:50:18 kjcf05n01 puppet-agent[3171473]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_154610]/mode) mode changed '0755' to '0750' Nov 3 15:50:18 kjcf05n01 puppet-agent[3171473]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_154610/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 15:50:19 kjcf05n01 puppet-agent[3171473]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_153424.log]/mode) mode changed '0644' to '0640' Nov 3 15:50:19 kjcf05n01 puppet-agent[3171473]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_154609.log]/mode) mode changed '0644' to '0640' Nov 3 15:50:19 kjcf05n01 puppet-agent[3171473]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 15:50:19 kjcf05n01 puppet-agent[3171473]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 15:50:19 kjcf05n01 puppet-agent[3171473]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 15:50:18 kjcf05n00 puppet-agent[1378386]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 15:50:18 kjcf05n00 puppet-agent[1378386]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 15:50:18 kjcf05n00 puppet-agent[1378386]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 15:50:19 kjcf05n04 puppet-agent[3464263]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 15:50:19 kjcf05n04 puppet-agent[3464263]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 15:50:19 kjcf05n04 puppet-agent[3464263]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 15:50:20 kjcf05n04 puppet-agent[3464263]: Applied catalog in 4.79 seconds Nov 3 15:50:19 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 15:50:20 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 15:50:19 kjcf05n00 puppet-agent[1378386]: Applied catalog in 8.50 seconds Nov 3 15:50:20 kjcf05n01 puppet-agent[3171473]: Applied catalog in 8.93 seconds Nov 3 15:50:24 kjcf05n05 puppet-agent[3626113]: Caching catalog for kjcf05n05 Nov 3 15:50:24 kjcf05n05 puppet-agent[3626113]: Applying configuration version '1730670622' Nov 3 15:50:26 kjcf05n05 puppet-agent[3626113]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 15:50:26 kjcf05n05 puppet-agent[3626113]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 15:50:26 kjcf05n05 puppet-agent[3626113]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 15:50:27 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3578855]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 15:50:27 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 15:50:27 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 15:50:27 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 15:50:27 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 15:50:27 kjcf05n05 puppet-agent[3626113]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: Starting Zabbix Agent 2 (6.2.1) Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: Press Ctrl+C to exit. Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: Plugin support version 1.0 Nov 3 15:50:27 kjcf05n05 zabbix_agent2[3626880]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 15:50:27 kjcf05n02 dwd[5204]: nvme19n1 passed periodic SMART status check Nov 3 15:50:27 kjcf05n02 dwd[5204]: nvme2n1 passed periodic SMART status check Nov 3 15:50:27 kjcf05n02 dwd[5204]: nvme3n1 passed periodic SMART status check Nov 3 15:50:27 kjcf05n02 dwd[5204]: nvme9n1 passed periodic SMART status check Nov 3 15:50:27 kjcf05n02 dwd[5204]: nvme18n1 passed periodic SMART status check Nov 3 15:50:28 kjcf05n02 dwd[5204]: nvme17n1 passed periodic SMART status check Nov 3 15:50:28 kjcf05n02 dwd[5204]: nvme8n1 passed periodic SMART status check Nov 3 15:50:28 kjcf05n02 dwd[5204]: nvme24n1 passed periodic SMART status check Nov 3 15:50:28 kjcf05n02 dwd[5204]: nvme25n1 passed periodic SMART status check Nov 3 15:50:28 kjcf05n02 dwd[5204]: nvme23n1 passed periodic SMART status check Nov 3 15:50:28 kjcf05n02 dwd[5204]: nvme4n1 passed periodic SMART status check Nov 3 15:50:28 kjcf05n05 puppet-agent[3626113]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 15:50:28 kjcf05n05 puppet-agent[3626113]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 15:50:28 kjcf05n05 puppet-agent[3626113]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 15:50:29 kjcf05n00 zabbix_server[15783]: resuming Zabbix agent checks on host "kjcf05n06": connection restored Nov 3 15:50:29 kjcf05n00 zabbix-server[1378282]: puppet completed status:(0): '' Nov 3 15:50:29 kjcf05n00 zabbix-server[1378282]: Event '46382' acknowledged Nov 3 15:50:29 kjcf05n00 zabbix-server[1378282]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 3 15:50:29 kjcf05n05 puppet-agent[3626113]: Applied catalog in 4.78 seconds Nov 3 15:50:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730670633', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 15:50:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730670633'} Nov 3 15:50:33 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:50:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730670633', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 15:50:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730670633'} Nov 3 15:50:33 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:50:45 kjcf05n00 mcfcli[3673891]: %3|1730670645.700|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 15:50:46 kjcf05n00 zabbix-server[1379558]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 15:50:46 kjcf05n00 zabbix-server[1379558]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 112.54\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 123.57\\"}}"' Nov 3 15:50:46 kjcf05n00 log_interesting_event.py[1379558]: Event '46383' acknowledged Nov 3 15:50:55 kjcf05n00 mcfcli[3673891]: %3|1730670655.276|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:51:15 kjcf05n00 mcfcli[3673891]: %3|1730670675.700|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:51:33 kjcf05n00 mcfcli[3673891]: %3|1730670693.760|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:51:45 kjcf05n00 mcfcli[3673891]: %3|1730670705.701|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 15:52:09 kjcf05n00 mcfcli[3673891]: %3|1730670729.238|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:52:15 kjcf05n00 mcfcli[3673891]: %3|1730670735.702|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 15:52:43 kjcf05n06 tune_prealloc_table[3472937]: Starting parse of /proc/fs/ldiskfs/md0/mb_groups Nov 3 15:52:44 kjcf05n06 tune_prealloc_table[3472940]: Tuning md0 prealloc_table with 1 2 4 8 16 32 64 128 256 512 1024 2048 4096 8192 Nov 3 15:52:45 kjcf05n00 mcfcli[3673891]: %3|1730670765.702|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 15:52:49 kjcf05n00 mcfcli[3673891]: %3|1730670769.235|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:52:51 kjcf05n04 tune_prealloc_table[3469406]: Starting parse of /proc/fs/ldiskfs/md0/mb_groups Nov 3 15:52:56 kjcf05n04 tune_prealloc_table[3469484]: Tuning md0 prealloc_table with 1 2 4 8 16 32 64 128 256 512 1024 2048 4096 8192 Nov 3 15:52:58 kjcf05n07 tune_prealloc_table[3469923]: Starting parse of /proc/fs/ldiskfs/md1/mb_groups Nov 3 15:52:58 kjcf05n07 tune_prealloc_table[3469940]: Tuning md1 prealloc_table with 1 2 4 8 16 32 64 128 256 512 1024 2048 4096 8192 Nov 3 15:53:10 kjcf05n05 tune_prealloc_table[3630784]: Starting parse of /proc/fs/ldiskfs/md1/mb_groups Nov 3 15:53:15 kjcf05n05 tune_prealloc_table[3630857]: Tuning md1 prealloc_table with 1 2 4 8 16 32 64 128 256 512 1024 2048 4096 8192 Nov 3 15:53:15 kjcf05n00 mcfcli[3673891]: %3|1730670795.702|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 15:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T21:53:15.867493Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 15:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T21:53:15.867564Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.091ms Nov 3 15:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T15:53:27.254709064-06:00 level=info msg="Completed cleanup jobs" duration=28.31044ms Nov 3 15:53:27 kjcf05n00 mcfcli[3673891]: %3|1730670807.679|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:53:45 kjcf05n00 mcfcli[3673891]: %3|1730670825.702|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 15:54:04 kjcf05n00 mcfcli[3673891]: %3|1730670844.125|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:54:04 kjcf05n06 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 15:54:04 kjcf05n06 systemd-tmpfiles[3475011]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:54:04 kjcf05n06 systemd-tmpfiles[3475011]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:54:04 kjcf05n06 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 15:54:04 kjcf05n06 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 15:54:05 kjcf05n07 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 15:54:05 kjcf05n07 systemd-tmpfiles[3472208]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:54:05 kjcf05n07 systemd-tmpfiles[3472208]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:54:05 kjcf05n07 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 15:54:05 kjcf05n07 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 15:54:05 kjcf05n04 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 15:54:05 kjcf05n04 systemd-tmpfiles[3471087]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:54:05 kjcf05n04 systemd-tmpfiles[3471087]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:54:05 kjcf05n04 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 15:54:05 kjcf05n04 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 15:54:05 kjcf05n05 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 15:54:05 kjcf05n05 systemd-tmpfiles[3632116]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:54:05 kjcf05n05 systemd-tmpfiles[3632116]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 15:54:05 kjcf05n05 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 15:54:05 kjcf05n05 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 15:54:15 kjcf05n00 mcfcli[3673891]: %3|1730670855.703|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 15:54:39 kjcf05n00 mcfcli[3673891]: %3|1730670879.123|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:54:45 kjcf05n00 mcfcli[3673891]: %3|1730670885.703|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:55:13 kjcf05n00 python3.9[1381739]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 15:55:15 kjcf05n00 mcfcli[3673891]: %3|1730670915.704|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:55:18 kjcf05n00 mcfcli[3673891]: %3|1730670918.535|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:55:45 kjcf05n00 mcfcli[3673891]: %3|1730670945.704|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 15:55:58 kjcf05n00 mcfcli[3673891]: %3|1730670958.532|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:56:15 kjcf05n00 mcfcli[3673891]: %3|1730670975.704|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 15:56:27 kjcf05n03 nslcd[6915]: [6afb66] ldap_result() failed: Can't contact LDAP server Nov 3 15:56:34 kjcf05n00 mcfcli[3673891]: %3|1730670994.401|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:56:45 kjcf05n00 mcfcli[3673891]: %3|1730671005.704|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 15:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 15:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 15:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 15:57:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 15:57:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 15:57:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 15:57:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 15:57:14 kjcf05n00 mcfcli[3673891]: %3|1730671034.398|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:57:14 kjcf05n00 zabbix_server[15777]: Zabbix agent item "vfs.fs.size[/mnt/persistent_ha_data,pused]" on host "kjcf05n03" failed: first network error, wait for 15 seconds Nov 3 15:57:15 kjcf05n00 mcfcli[3673891]: %3|1730671035.704|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:57:21 kjcf05n02 fstonithd.py[15185]: My partner 172.16.2.6 is kdumping. Forcing HA into GATHER state. Nov 3 15:57:21 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 15:57:21 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 15:57:21 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 15:57:22 kjcf05n02 root[68128]: is_viking_off starts Nov 3 15:57:22 kjcf05n02 root[68126]: is_enc_ipmi_off starts Nov 3 15:57:22 kjcf05n02 root[68144]: is_lan_ipmi_off leaves Nov 3 15:57:22 kjcf05n02 root[68146]: is_lan_ipmi_sec_off leaves Nov 3 15:57:22 kjcf05n02 root[68151]: I am not master; I will get master Nov 3 15:57:22 kjcf05n02 root[68154]: I am in slot 0; partner is in slot 1 Nov 3 15:57:27 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='15', error='Connection reset by peer (104)' Nov 3 15:57:27 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='15', client='AF_INET(172.16.2.6:39827)', local='AF_INET(0.0.0.0:601)' Nov 3 15:57:27 kjcf05n02 root[68517]: I am now master Nov 3 15:57:29 kjcf05n00 zabbix_server[15783]: Zabbix agent item "net.if.out["icl0",dropped]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 15:57:30 kjcf05n00 zabbix_server[15753]: Zabbix agent item "net.if.in["mgmt0",dropped]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 15:57:31 kjcf05n02 LCNmon[17954]: 10.16.100.53 is unreachable via ib0 Nov 3 15:57:31 kjcf05n02 LCNmon[17954]: 10.16.100.59 is unreachable via ib0 Nov 3 15:57:31 kjcf05n00 zabbix_server[15778]: Zabbix agent item "system.cpu.num" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 15:57:32 kjcf05n00 zabbix_server[15739]: Zabbix agent item "net.if.in["meth0",dropped]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 15:57:33 kjcf05n00 zabbix_server[15780]: Zabbix agent item "system.cpu.util[,guest]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 15:57:35 kjcf05n02 LCNmon[17954]: 10.16.100.53 is unreachable via ib1 Nov 3 15:57:35 kjcf05n02 LCNmon[17954]: 10.16.100.59 is unreachable via ib1 Nov 3 15:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 15:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 15:57:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 15:57:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 15:57:38 kjcf05n02 diskmonitor[17553]: run_on_master: ntry=1/10, neither node is master, retrying Nov 3 15:57:41 kjcf05n02 root[69215]: is_viking_off leaves Nov 3 15:57:41 kjcf05n02 root[69222]: kjcf05n03 not already off look at kdump Nov 3 15:57:41 kjcf05n02 root[69223]: is_kdump_off starts Nov 3 15:57:41 kjcf05n02 fence_kdump[69224]: waiting for message from '172.16.2.6' Nov 3 15:57:41 kjcf05n02 fence_kdump[69224]: received valid message from '172.16.2.6' Nov 3 15:57:41 kjcf05n02 root[69244]: is_kdump_off detected kdump on kjcf05n03 Nov 3 15:57:41 kjcf05n02 root[69245]: kjcf05n03 is kdumping Nov 3 15:57:41 kjcf05n02 root[69338]: is_enc_ipmi_off starts Nov 3 15:57:41 kjcf05n02 root[69340]: is_viking_off starts Nov 3 15:57:41 kjcf05n02 root[69359]: is_lan_ipmi_off leaves Nov 3 15:57:41 kjcf05n02 root[69361]: is_lan_ipmi_sec_off leaves Nov 3 15:57:41 kjcf05n02 root[69386]: I am in slot 0; partner is in slot 1 Nov 3 15:57:42 kjcf05n02 root[69389]: I am master Nov 3 15:57:44 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 15:57:44 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 15:57:45 kjcf05n00 mcfcli[3673891]: %3|1730671065.705|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:57:48 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vfs.file.contents["/sys/class/net/ib1/operstate"]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 15:57:51 kjcf05n00 mcfcli[3673891]: %3|1730671071.154|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:57:54 kjcf05n02 root[69988]: is_viking_off leaves Nov 3 15:57:54 kjcf05n02 root[69991]: kjcf05n03 not already off look at kdump Nov 3 15:57:54 kjcf05n02 root[69992]: is_kdump_off starts Nov 3 15:57:54 kjcf05n02 fence_kdump[69993]: waiting for message from '172.16.2.6' Nov 3 15:57:55 kjcf05n02 fence_kdump[69993]: received valid message from '172.16.2.6' Nov 3 15:57:55 kjcf05n02 root[70013]: is_kdump_off detected kdump on kjcf05n03 Nov 3 15:57:55 kjcf05n02 root[70017]: kjcf05n03 is kdumping Nov 3 15:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 15:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 15:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 15:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 15:57:59 kjcf05n02 dwd[5204]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 15:57:59 kjcf05n02 dwd[5204]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 15:57:59 kjcf05n02 dwd[5204]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 15:57:59 kjcf05n02 dwd[5204]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 15:57:59 kjcf05n02 dwd[5204]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 15:57:59 kjcf05n02 dwd[5204]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 15:57:59 kjcf05n02 dwd[5204]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 15:57:59 kjcf05n02 dwd[5204]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 15:57:59 kjcf05n02 dwd[5204]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 15:57:59 kjcf05n02 dwd[5204]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 15:57:59 kjcf05n02 dwd[5204]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 15:57:59 kjcf05n02 dwd[5204]: Starting NVME thread for nvme16n1 Nov 3 15:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 15:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 15:58:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 15:58:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 15:58:00 kjcf05n02 dwd[5204]: Starting NVME thread for nvme22n1 Nov 3 15:58:00 kjcf05n02 dwd[5204]: Starting NVME thread for nvme15n1 Nov 3 15:58:00 kjcf05n02 dwd[5204]: Starting NVME thread for nvme6n1 Nov 3 15:58:00 kjcf05n02 dwd[5204]: Starting NVME thread for nvme11n1 Nov 3 15:58:01 kjcf05n02 dwd[5204]: Starting NVME thread for nvme7n1 Nov 3 15:58:01 kjcf05n02 dwd[5204]: Starting NVME thread for nvme10n1 Nov 3 15:58:01 kjcf05n02 dwd[5204]: Starting NVME thread for nvme20n1 Nov 3 15:58:01 kjcf05n02 systemd-udevd[72337]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72336]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72338]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72342]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72336]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72337]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72338]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72342]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72336]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72337]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72338]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72342]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72337]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72342]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72338]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72336]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72337]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72338]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72336]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72342]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72337]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72336]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72338]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72342]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72337]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72338]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72336]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72342]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72337]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72342]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72338]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72336]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72374]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72376]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72378]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72379]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72376]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72374]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72378]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72379]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72373]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72378]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72374]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72373]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72378]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72373]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 dwd[5204]: Starting NVME thread for nvme21n1 Nov 3 15:58:01 kjcf05n02 systemd-udevd[72374]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72373]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72374]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72373]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72374]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72373]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72374]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72373]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72373]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72373]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72374]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72373]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72374]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72373]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72374]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72373]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72373]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 systemd-udevd[72373]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 15:58:01 kjcf05n02 dwd[5204]: Starting NVME thread for nvme5n1 Nov 3 15:58:01 kjcf05n02 dwd[5204]: Starting NVME thread for nvme12n1 Nov 3 15:58:03 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n03": interface unavailable Nov 3 15:58:04 kjcf05n02 diskmonitor[17553]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 15:58:14 kjcf05n02 diskmonitor[17553]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 15:58:14 kjcf05n02 diskmonitor[17553]: Scan for ReadErrorMax change for md66 Nov 3 15:58:14 kjcf05n02 diskmonitor[17553]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 15:58:14 kjcf05n02 diskmonitor[17553]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 15:58:14 kjcf05n02 diskmonitor[17553]: read_saved_file: md66 no saved speed Nov 3 15:58:14 kjcf05n02 diskmonitor[17553]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 15:58:14 kjcf05n02 diskmonitor[17553]: Set sync_speed_min (10000) for md66 Nov 3 15:58:14 kjcf05n02 diskmonitor[17553]: Set sync_speed_max (200000) for md66 Nov 3 15:58:14 kjcf05n02 diskmonitor[17553]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 15:58:15 kjcf05n00 mcfcli[3673891]: %3|1730671095.706|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 15:58:27 kjcf05n00 mcfcli[3673891]: %3|1730671107.656|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:58:31 kjcf05n02 LCNmon[17954]: 10.16.100.53 is unreachable via ib0 Nov 3 15:58:31 kjcf05n02 LCNmon[17954]: 10.16.100.59 is unreachable via ib0 Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-36 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-61 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-17 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-85 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-0 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-10 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-49 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-65 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-4 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-98 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-52 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-46 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-11 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-24 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-25 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-60 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-97 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-41 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-53 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-13 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-82 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-5 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-22 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-12 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-42 passed periodic SMART status check Nov 3 15:58:33 kjcf05n04 dwd[10437]: dm-73 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-28 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-58 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-72 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-18 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-1 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-23 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-95 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-47 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-29 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-35 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-84 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-70 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-96 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-48 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-77 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-76 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-99 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-37 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-71 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-83 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-100 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-94 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-66 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-89 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-90 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-34 passed periodic SMART status check Nov 3 15:58:34 kjcf05n04 dwd[10437]: dm-59 passed periodic SMART status check Nov 3 15:58:35 kjcf05n02 LCNmon[17954]: 10.16.100.53 is unreachable via ib1 Nov 3 15:58:35 kjcf05n02 LCNmon[17954]: 10.16.100.59 is unreachable via ib1 Nov 3 15:58:36 kjcf05n05 dwd[10696]: dm-26 passed periodic SMART status check Nov 3 15:58:36 kjcf05n05 dwd[10696]: dm-51 passed periodic SMART status check Nov 3 15:58:36 kjcf05n05 dwd[10696]: dm-88 passed periodic SMART status check Nov 3 15:58:36 kjcf05n05 dwd[10696]: dm-104 passed periodic SMART status check Nov 3 15:58:36 kjcf05n05 dwd[10696]: dm-27 passed periodic SMART status check Nov 3 15:58:36 kjcf05n05 dwd[10696]: dm-62 passed periodic SMART status check Nov 3 15:58:36 kjcf05n05 dwd[10696]: dm-14 passed periodic SMART status check Nov 3 15:58:36 kjcf05n05 dwd[10696]: dm-6 passed periodic SMART status check Nov 3 15:58:36 kjcf05n05 dwd[10696]: dm-50 passed periodic SMART status check Nov 3 15:58:36 kjcf05n05 dwd[10696]: dm-75 passed periodic SMART status check Nov 3 15:58:36 kjcf05n05 dwd[10696]: dm-44 passed periodic SMART status check Nov 3 15:58:36 kjcf05n05 dwd[10696]: dm-55 passed periodic SMART status check Nov 3 15:58:36 kjcf05n05 dwd[10696]: dm-67 passed periodic SMART status check Nov 3 15:58:36 kjcf05n05 dwd[10696]: dm-2 passed periodic SMART status check Nov 3 15:58:36 kjcf05n05 dwd[10696]: dm-30 passed periodic SMART status check Nov 3 15:58:36 kjcf05n05 dwd[10696]: dm-68 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-80 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-32 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-105 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-63 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-33 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-69 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-15 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-3 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-8 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-91 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-79 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-20 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-19 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-101 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-31 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-64 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-93 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-21 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-45 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-39 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-86 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-74 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-54 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-103 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-43 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-7 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-16 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-102 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-57 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-56 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-78 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-9 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-38 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-40 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 dwd[10696]: dm-87 passed periodic SMART status check Nov 3 15:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 15:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 15:58:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 15:58:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 15:58:45 kjcf05n00 mcfcli[3673891]: %3|1730671125.706|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 15:58:51 kjcf05n02 nslcd[7269]: ldap_result() failed: Can't contact LDAP server Nov 3 15:58:51 kjcf05n02 nslcd[7269]: (re)loading /etc/nsswitch.conf Nov 3 15:58:51 kjcf05n02 nslcd[7269]: [b0dc51] ldap_result() failed: Can't contact LDAP server Nov 3 15:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 15:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 15:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 15:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 15:59:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 15:59:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 15:59:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 15:59:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 15:59:06 kjcf05n00 mcfcli[3673891]: %3|1730671146.286|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:59:15 kjcf05n00 mcfcli[3673891]: %3|1730671155.706|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:59:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730671169}"] Nov 3 15:59:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730671169, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:59:29 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:29-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:29 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:29-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:29 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:29-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:29 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:29-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:29 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:29-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:29 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:29-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:29 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:29-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.158182ms Nov 3 15:59:29 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:29-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.158182ms Nov 3 15:59:29 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:59:29 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:59:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:59:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730671169}"] Nov 3 15:59:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730671169, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:59:29 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:29-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:29 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:29-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:29 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:29-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:29 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:29-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:29 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:29-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:29 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:29-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:29 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:29-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.827583ms Nov 3 15:59:29 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:29-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.827583ms Nov 3 15:59:29 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:59:29 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:59:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:59:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730671169}"] Nov 3 15:59:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730671169, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:59:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.789621ms Nov 3 15:59:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.789621ms Nov 3 15:59:30 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:59:30 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:59:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:59:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730671169}"] Nov 3 15:59:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730671169, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:59:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.957947ms Nov 3 15:59:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.957947ms Nov 3 15:59:30 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:59:30 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:59:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:59:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730671169}"] Nov 3 15:59:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730671169, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:59:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.172469ms Nov 3 15:59:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.172469ms Nov 3 15:59:30 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:59:30 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:59:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:59:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730671169}"] Nov 3 15:59:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730671169, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:59:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.108408ms Nov 3 15:59:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.108408ms Nov 3 15:59:30 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:59:30 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:59:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:59:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730671169}"] Nov 3 15:59:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730671169, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:59:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.304766ms Nov 3 15:59:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.304766ms Nov 3 15:59:30 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:59:30 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:59:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:59:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730671169}"] Nov 3 15:59:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730671169, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:59:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.936707ms Nov 3 15:59:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.936707ms Nov 3 15:59:30 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:59:30 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:59:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:59:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730671169}"] Nov 3 15:59:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730671169, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:59:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.979818ms Nov 3 15:59:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.979818ms Nov 3 15:59:30 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:59:30 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:59:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:59:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730671169}"] Nov 3 15:59:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730671169, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:59:31 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:31-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:31 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:31-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:31 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:31-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:31 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:31-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:31 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:31-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:31 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:31-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:31 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:31-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.971913ms Nov 3 15:59:31 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:31-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.971913ms Nov 3 15:59:31 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:59:31 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:59:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:59:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730671169}"] Nov 3 15:59:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730671169, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 15:59:31 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:31-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:31 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:31-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 15:59:31 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:31-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:31 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T15:59:31-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:31 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:31-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 15:59:31 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T15:59:31-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 15:59:31 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T15:59:31-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.492789ms Nov 3 15:59:31 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T15:59:31-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.492789ms Nov 3 15:59:31 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:15:59:31 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 15:59:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 15:59:31 kjcf05n02 LCNmon[17954]: 10.16.100.53 is unreachable via ib0 Nov 3 15:59:31 kjcf05n02 LCNmon[17954]: 10.16.100.59 is unreachable via ib0 Nov 3 15:59:35 kjcf05n02 LCNmon[17954]: 10.16.100.53 is unreachable via ib1 Nov 3 15:59:35 kjcf05n02 LCNmon[17954]: 10.16.100.59 is unreachable via ib1 Nov 3 15:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 15:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 15:59:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 15:59:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 15:59:44 kjcf05n00 mcfcli[3673891]: %3|1730671184.234|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 15:59:45 kjcf05n00 mcfcli[3673891]: %3|1730671185.706|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 15:59:49 kjcf05n05 dwd[10696]: nvme2n1 passed periodic SMART status check Nov 3 15:59:53 kjcf05n04 dwd[10437]: nvme2n1 passed periodic SMART status check Nov 3 15:59:53 kjcf05n04 dwd[10437]: nvme3n1 passed periodic SMART status check Nov 3 15:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 15:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 15:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 15:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 16:00:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 16:00:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 16:00:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 16:00:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 16:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 16:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 16:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 16:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 16:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 16:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 16:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 16:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 16:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 16:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 16:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 16:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 16:00:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 16:00:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:00:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 16:00:02 kjcf05n07 dwd[5489]: nvme16n1 passed periodic SMART status check Nov 3 16:00:02 kjcf05n07 dwd[5489]: nvme5n1 passed periodic SMART status check Nov 3 16:00:02 kjcf05n07 dwd[5489]: nvme22n1 passed periodic SMART status check Nov 3 16:00:02 kjcf05n07 dwd[5489]: nvme12n1 passed periodic SMART status check Nov 3 16:00:02 kjcf05n07 dwd[5489]: nvme11n1 passed periodic SMART status check Nov 3 16:00:02 kjcf05n07 dwd[5489]: nvme13n1 passed periodic SMART status check Nov 3 16:00:03 kjcf05n07 dwd[5489]: nvme6n1 passed periodic SMART status check Nov 3 16:00:03 kjcf05n07 dwd[5489]: nvme15n1 passed periodic SMART status check Nov 3 16:00:05 kjcf05n07 dwd[5489]: nvme7n1 passed periodic SMART status check Nov 3 16:00:10 kjcf05n07 dwd[5489]: nvme14n1 passed periodic SMART status check Nov 3 16:00:15 kjcf05n00 mcfcli[3673891]: %3|1730671215.707|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 16:00:16 kjcf05n07 dwd[5489]: nvme20n1 passed periodic SMART status check Nov 3 16:00:16 kjcf05n07 dwd[5489]: nvme21n1 passed periodic SMART status check Nov 3 16:00:17 kjcf05n06 dwd[5504]: nvme24n1 passed periodic SMART status check Nov 3 16:00:17 kjcf05n06 dwd[5504]: nvme19n1 passed periodic SMART status check Nov 3 16:00:17 kjcf05n06 dwd[5504]: nvme2n1 passed periodic SMART status check Nov 3 16:00:17 kjcf05n06 dwd[5504]: nvme18n1 passed periodic SMART status check Nov 3 16:00:18 kjcf05n06 dwd[5504]: nvme8n1 passed periodic SMART status check Nov 3 16:00:21 kjcf05n00 mcfcli[3673891]: %3|1730671221.985|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:00:24 kjcf05n00 python3.9[1385009]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 16:00:25 kjcf05n06 dwd[5504]: nvme9n1 passed periodic SMART status check Nov 3 16:00:25 kjcf05n06 dwd[5504]: nvme25n1 passed periodic SMART status check Nov 3 16:00:25 kjcf05n06 dwd[5504]: nvme10n1 passed periodic SMART status check Nov 3 16:00:25 kjcf05n06 dwd[5504]: nvme17n1 passed periodic SMART status check Nov 3 16:00:25 kjcf05n06 dwd[5504]: nvme23n1 passed periodic SMART status check Nov 3 16:00:25 kjcf05n06 dwd[5504]: nvme4n1 passed periodic SMART status check Nov 3 16:00:31 kjcf05n06 dwd[5504]: nvme3n1 passed periodic SMART status check Nov 3 16:00:31 kjcf05n02 LCNmon[17954]: 10.16.100.53 is unreachable via ib0 Nov 3 16:00:31 kjcf05n02 LCNmon[17954]: 10.16.100.59 is unreachable via ib0 Nov 3 16:00:32 kjcf05n00 zabbix-server[1385445]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:00:32 kjcf05n00 zabbix-server[1385445]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n03:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 16:00:32 kjcf05n00 log_interesting_event.py[1385445]: Event '46386' acknowledged Nov 3 16:00:33 kjcf05n05 dwd[10696]: nvme3n1 passed periodic SMART status check Nov 3 16:00:35 kjcf05n02 LCNmon[17954]: 10.16.100.53 is unreachable via ib1 Nov 3 16:00:35 kjcf05n02 LCNmon[17954]: 10.16.100.59 is unreachable via ib1 Nov 3 16:00:37 kjcf05n05 dwd[10696]: dm-92 passed periodic SMART status check Nov 3 16:00:37 kjcf05n05 dwd[10696]: dm-81 passed periodic SMART status check Nov 3 16:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 16:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 16:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 16:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 16:00:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730671237', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 16:00:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730671237'} Nov 3 16:00:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:00:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730671237', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 16:00:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730671237'} Nov 3 16:00:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:00:45 kjcf05n00 mcfcli[3673891]: %3|1730671245.707|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 16:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 16:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 16:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 16:00:58 kjcf05n00 mcfcli[3673891]: %3|1730671258.435|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 16:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 16:01:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 16:01:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 16:01:10 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:9a:1a Nov 3 16:01:10 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 16:01:14 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 16:01:14 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a kjcf05n03 Nov 3 16:01:14 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.6 Nov 3 16:01:14 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 16:01:14 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 16:01:14 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.6 Nov 3 16:01:14 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/pxelinux.cfg to 172.16.2.6 Nov 3 16:01:16 kjcf05n00 mcfcli[3673891]: %3|1730671276.207|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 16:01:16 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/vmlinuz_diskless to 172.16.2.6 Nov 3 16:01:25 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/initramfs-diskless.img to 172.16.2.6 Nov 3 16:01:31 kjcf05n02 LCNmon[17954]: 10.16.100.53 is unreachable via ib0 Nov 3 16:01:31 kjcf05n02 LCNmon[17954]: 10.16.100.59 is unreachable via ib0 Nov 3 16:01:34 kjcf05n00 mcfcli[3673891]: %3|1730671294.437|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:01:35 kjcf05n02 LCNmon[17954]: 10.16.100.53 is unreachable via ib1 Nov 3 16:01:35 kjcf05n02 LCNmon[17954]: 10.16.100.59 is unreachable via ib1 Nov 3 16:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 16:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 16:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 16:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 16:01:46 kjcf05n00 mcfcli[3673891]: %3|1730671306.207|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 16:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 16:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 16:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 16:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 16:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 16:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 16:02:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 16:02:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 16:02:11 kjcf05n00 mcfcli[3673891]: %3|1730671331.701|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:02:12 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:49744). Nov 3 16:02:12 kjcf05n01 rsyncd[3176782]: connect from kjcf05n03 (172.16.2.6) Nov 3 16:02:12 kjcf05n01 rsyncd[3176782]: rsync on puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 16:02:12 kjcf05n01 rsyncd[3176782]: building file list Nov 3 16:02:12 kjcf05n01 rsyncd[3176782]: sent 11446 bytes received 136 bytes total size 10901 Nov 3 16:02:12 kjcf05n01 systemd[1]: rsyncd@641-172.16.2.2:873-172.16.2.6:49744.service: Succeeded. Nov 3 16:02:16 kjcf05n00 mcfcli[3673891]: %3|1730671336.208|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 16:02:21 kjcf05n02 fstonithd.py[15185]: Listening for kdump packets from partner Nov 3 16:02:31 kjcf05n02 LCNmon[17954]: 10.16.100.53 is unreachable via ib0 Nov 3 16:02:31 kjcf05n02 LCNmon[17954]: 10.16.100.59 is unreachable via ib0 Nov 3 16:02:35 kjcf05n02 LCNmon[17954]: 10.16.100.53 is unreachable via ib1 Nov 3 16:02:35 kjcf05n02 LCNmon[17954]: 10.16.100.59 is unreachable via ib1 Nov 3 16:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 16:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 16:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 16:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 16:02:40 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 16:02:46 kjcf05n00 mcfcli[3673891]: %3|1730671366.208|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 16:02:51 kjcf05n00 mcfcli[3673891]: %3|1730671371.698|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 16:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 16:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 16:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 16:03:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 16:03:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 16:03:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 16:03:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 16:03:14 kjcf05n02 dwd[5204]: nvme16n1 passed periodic SMART status check Nov 3 16:03:15 kjcf05n02 dwd[5204]: nvme10n1 passed periodic SMART status check Nov 3 16:03:15 kjcf05n02 dwd[5204]: nvme22n1 passed periodic SMART status check Nov 3 16:03:15 kjcf05n02 dwd[5204]: nvme11n1 passed periodic SMART status check Nov 3 16:03:15 kjcf05n02 dwd[5204]: nvme7n1 passed periodic SMART status check Nov 3 16:03:15 kjcf05n02 dwd[5204]: nvme6n1 passed periodic SMART status check Nov 3 16:03:15 kjcf05n02 dwd[5204]: nvme15n1 passed periodic SMART status check Nov 3 16:03:16 kjcf05n02 dwd[5204]: nvme5n1 passed periodic SMART status check Nov 3 16:03:16 kjcf05n02 dwd[5204]: nvme20n1 passed periodic SMART status check Nov 3 16:03:16 kjcf05n02 dwd[5204]: nvme12n1 passed periodic SMART status check Nov 3 16:03:16 kjcf05n02 dwd[5204]: nvme21n1 passed periodic SMART status check Nov 3 16:03:16 kjcf05n00 mcfcli[3673891]: %3|1730671396.209|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 16:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T16:03:27.26865936-06:00 level=info msg="Completed cleanup jobs" duration=41.520611ms Nov 3 16:03:29 kjcf05n00 mcfcli[3673891]: %3|1730671409.362|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:03:31 kjcf05n02 LCNmon[17954]: 10.16.100.53 is unreachable via ib0 Nov 3 16:03:31 kjcf05n02 LCNmon[17954]: 10.16.100.59 is unreachable via ib0 Nov 3 16:03:35 kjcf05n02 LCNmon[17954]: 10.16.100.53 is unreachable via ib1 Nov 3 16:03:35 kjcf05n02 LCNmon[17954]: 10.16.100.59 is unreachable via ib1 Nov 3 16:03:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 16:03:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 16:03:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 16:03:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 16:03:37 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='15', client='AF_INET(172.16.2.6:44009)', local='AF_INET(0.0.0.0:601)' Nov 3 16:03:37 kjcf05n03 syslog-ng[3145]: Configuration reload request received, reloading configuration; Nov 3 16:03:37 kjcf05n03 syslog-ng[3145]: Configuration reload finished; Nov 3 16:03:37 kjcf05n03 syslog-ng[3145]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 16:03:37 kjcf05n03 dracut: dracut-049-135.git20210121.el8 Nov 3 16:03:37 kjcf05n03 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 16:03:37 kjcf05n03 dracut: Loading and integrity checking all crypto modules Nov 3 16:03:37 kjcf05n03 dracut: Self testing crypto algorithms Nov 3 16:03:37 kjcf05n03 dracut: rd.md=0: removing MD RAID activation Nov 3 16:03:37 kjcf05n03 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 16:03:37 kjcf05n03 Copying live image to RAM... Nov 3 16:03:37 kjcf05n03 (this may take a minute) Nov 3 16:03:37 kjcf05n03 Done copying live image to RAM. Nov 3 16:03:37 kjcf05n03 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 16:03:37 kjcf05n03 dracut: Checking integrity of kernel Nov 3 16:03:37 kjcf05n03 dracut: All initrd crypto checks done Nov 3 16:03:37 kjcf05n03 dracut: Switching root Nov 3 16:03:37 kjcf05n03 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 16:03:37 kjcf05n03 systemd: Detected architecture x86-64. Nov 3 16:03:37 kjcf05n03 systemd: Set hostname to . Nov 3 16:03:37 kjcf05n03 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 16:03:37 kjcf05n03 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 16:03:37 kjcf05n03 systemd: Created slice system-sshd\x2dkeygen.slice. Nov 3 16:03:37 kjcf05n03 systemd: Reached target ZFS pool import target. Nov 3 16:03:37 kjcf05n03 systemd: Listening on Journal Socket (/dev/log). Nov 3 16:03:37 kjcf05n03 systemd: Listening on initctl Compatibility Named Pipe. Nov 3 16:03:37 kjcf05n03 systemd: Created slice system-serial\x2dgetty.slice. Nov 3 16:03:37 kjcf05n03 systemd-journald[1511]: Journal started Nov 3 16:03:37 kjcf05n03 systemd-journald[1511]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 16:03:37 kjcf05n03 systemd-modules-load[1508]: Inserted module 'fuse' Nov 3 16:03:37 kjcf05n03 systemd[1]: Mounted Kernel Debug File System. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 3 16:03:37 kjcf05n03 systemd[1]: Mounted /data. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Create list of required static device nodes for the current kernel. Nov 3 16:03:37 kjcf05n03 systemd[1]: Mounted /mnt. Nov 3 16:03:37 kjcf05n03 systemd[1]: Mounted POSIX Message Queue File System. Nov 3 16:03:37 kjcf05n03 systemd[1]: Mounting Kernel Configuration File System... Nov 3 16:03:37 kjcf05n03 systemd[1]: Mounting FUSE Control File System... Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Apply Kernel Variables... Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Rebuild Hardware Database... Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Create System Users... Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Load/Save Random Seed... Nov 3 16:03:37 kjcf05n03 systemd[1]: Mounted Kernel Configuration File System. Nov 3 16:03:37 kjcf05n03 systemd[1]: Mounted FUSE Control File System. Nov 3 16:03:37 kjcf05n03 systemd-sysctl[1539]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 16:03:37 kjcf05n03 systemd-sysctl[1539]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Apply Kernel Variables. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Create System Users. Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Load/Save Random Seed. Nov 3 16:03:37 kjcf05n03 systemd-journald[1511]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started udev Coldplug all Devices. Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 16:03:37 kjcf05n03 systemd-tmpfiles[1546]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 16:03:37 kjcf05n03 systemd-tmpfiles[1546]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Rebuild Hardware Database. Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting udev Kernel Device Manager... Nov 3 16:03:37 kjcf05n03 systemd-udevd[1555]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started udev Kernel Device Manager. Nov 3 16:03:37 kjcf05n03 systemd[1]: Found device /dev/ttyS0. Nov 3 16:03:37 kjcf05n03 systemd-udevd[1597]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:03:37 kjcf05n03 systemd-udevd[1579]: Using default interface naming scheme 'rhel-8.0'. Nov 3 16:03:37 kjcf05n03 systemd-udevd[1579]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:03:37 kjcf05n03 systemd-udevd[1614]: Using default interface naming scheme 'rhel-8.0'. Nov 3 16:03:37 kjcf05n03 systemd-udevd[1614]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:03:37 kjcf05n03 systemd-udevd[1612]: Using default interface naming scheme 'rhel-8.0'. Nov 3 16:03:37 kjcf05n03 systemd-udevd[1612]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 16:03:37 kjcf05n03 systemd[1]: Reached target Local File Systems (Pre). Nov 3 16:03:37 kjcf05n03 systemd[1]: Reached target Local File Systems. Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Rebuild Journal Catalog. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 16:03:37 kjcf05n03 root[1786]: openibd: running in auto mode Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 16:03:37 kjcf05n03 systemd-tmpfiles[1783]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 16:03:37 kjcf05n03 systemd-tmpfiles[1783]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 16:03:37 kjcf05n03 systemd-tmpfiles[1783]: "/var/tmp" already exists and is not a directory. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Create Volatile Files and Directories. Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting RPC Bind... Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started RPC Bind. Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 16:03:37 kjcf05n03 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 16:03:37 kjcf05n03 systemd[1]: Started RDMA Node Description Daemon. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 16:03:37 kjcf05n03 systemd-modules-load[1885]: Inserted module 'ib_iser' Nov 3 16:03:37 kjcf05n03 systemd-modules-load[1885]: Inserted module 'ib_isert' Nov 3 16:03:37 kjcf05n03 systemd-modules-load[1885]: Inserted module 'ib_srpt' Nov 3 16:03:37 kjcf05n03 systemd-udevd[1586]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:03:37 kjcf05n03 systemd-udevd[1599]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:03:37 kjcf05n03 systemd-modules-load[1876]: Inserted module 'ib_ipoib' Nov 3 16:03:37 kjcf05n03 systemd-modules-load[1885]: Inserted module 'rdma_ucm' Nov 3 16:03:37 kjcf05n03 systemd-modules-load[1885]: Module 'svcrdma' is blacklisted Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 16:03:37 kjcf05n03 systemd-udevd[1586]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 16:03:37 kjcf05n03 systemd-udevd[1599]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 16:03:37 kjcf05n03 systemd-modules-load[1876]: Inserted module 'ib_umad' Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 16:03:37 kjcf05n03 systemd[1]: Reached target Network (Pre). Nov 3 16:03:37 kjcf05n03 systemd[1]: Reached target RDMA Hardware. Nov 3 16:03:37 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 16:03:37 kjcf05n03 systemd[3145]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:37 kjcf05n03 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 16:03:37 kjcf05n03 openibd[1771]: Loading HCA driver and Access Layer:[ OK ] Nov 3 16:03:37 kjcf05n03 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Update is Completed... Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Update is Completed. Nov 3 16:03:37 kjcf05n03 setup-icl[1760]: Setting LAN IP Address to 203.0.113.4 Nov 3 16:03:37 kjcf05n03 setup-icl[1760]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 16:03:37 kjcf05n03 setup-icl[1760]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 16:03:37 kjcf05n03 setup-icl[1760]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 16:03:37 kjcf05n03 systemd-udevd[1586]: Using default interface naming scheme 'rhel-8.0'. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 16:03:37 kjcf05n03 systemd[1]: Reached target System Initialization. Nov 3 16:03:37 kjcf05n03 systemd[1]: Listening on lldpad.socket. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 16:03:37 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 16:03:37 kjcf05n03 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 16:03:37 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 16:03:37 kjcf05n03 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 16:03:37 kjcf05n03 systemd[1]: Reached target Sockets. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 16:03:37 kjcf05n03 systemd[1]: Reached target Basic System. Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Name Service Cache Daemon... Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Resets System Activity Logs... Nov 3 16:03:37 kjcf05n03 nscd[2076]: 2076 monitoring file `/etc/hosts` (1) Nov 3 16:03:37 kjcf05n03 nscd[2076]: 2076 monitoring directory `/etc` (2) Nov 3 16:03:37 kjcf05n03 nscd[2076]: 2076 monitoring file `/etc/resolv.conf` (3) Nov 3 16:03:37 kjcf05n03 nscd[2076]: 2076 monitoring directory `/etc` (2) Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 16:03:37 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started irqbalance daemon. Nov 3 16:03:37 kjcf05n03 dwd[2073]: dwd: vMay 29 2024 : 15:38:26 Nov 3 16:03:37 kjcf05n03 dwd[2073]: /usr/sbin/dwd -d --standalone=0 Nov 3 16:03:37 kjcf05n03 dwd[2073]: dwd: option Lethal: 0 Nov 3 16:03:37 kjcf05n03 dwd[2073]: dwd: option Interval: 60 Nov 3 16:03:37 kjcf05n03 dwd[2073]: dwd: option abrtlimit: 10 Nov 3 16:03:37 kjcf05n03 dwd[2073]: dwd: option DZPeriod: 604800 Nov 3 16:03:37 kjcf05n03 dwd[2073]: dwd: option SmartPeriod: 43200 Nov 3 16:03:37 kjcf05n03 dwd[2073]: dwd: option SDDEnabled: 1 Nov 3 16:03:37 kjcf05n03 dwd[2073]: dwd: option SDDAwaitScale: 3 Nov 3 16:03:37 kjcf05n03 dwd[2073]: dwd: option SDDAwaitMin: 100 Nov 3 16:03:37 kjcf05n03 dwd[2073]: dwd: option Verbosity: 1 Nov 3 16:03:37 kjcf05n03 dwd[2073]: dwd: option StandAlone: 0 Nov 3 16:03:37 kjcf05n03 dwd[2073]: option Lethal: 0 Nov 3 16:03:37 kjcf05n03 dwd[2073]: option Interval: 60 Nov 3 16:03:37 kjcf05n03 dwd[2073]: option abrtlimit: 10 Nov 3 16:03:37 kjcf05n03 dwd[2073]: option DZPeriod: 604800 Nov 3 16:03:37 kjcf05n03 dwd[2073]: option SmartPeriod: 43200 Nov 3 16:03:37 kjcf05n03 dwd[2073]: option SDDEnabled: 1 Nov 3 16:03:37 kjcf05n03 dwd[2073]: option SDDAwaitScale: 3 Nov 3 16:03:37 kjcf05n03 dwd[2073]: option SDDAwaitMin: 100 Nov 3 16:03:37 kjcf05n03 dwd[2073]: option Verbosity: 1 Nov 3 16:03:37 kjcf05n03 dwd[2073]: option StandAlone: 0 Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 16:03:37 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 0 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 1 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 2 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 3 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 4 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 5 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 6 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 7 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 8 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 9 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 10 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 11 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 12 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 13 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 14 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 15 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 16 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 17 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 18 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 19 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 20 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 21 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 22 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 23 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 24 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 25 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 26 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 27 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 28 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 29 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 30 Nov 3 16:03:37 kjcf05n03 cpupower[2100]: Setting cpu: 31 Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[2097]: Setting up Mellanox network interface: ib0 Nov 3 16:03:37 kjcf05n03 systemd[1]: Started D-Bus System Message Bus. Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[2113]: Setting up Mellanox network interface: ib1 Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 16:03:37 kjcf05n03 dbus-daemon[2122]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 16:03:37 kjcf05n03 mcelog[2192]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 16:03:37 kjcf05n03 mcelog[2192]: CPU is unsupported Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[2194]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 16:03:37 kjcf05n03 beSetMlxConfig[2181]: ConnectX-3 multiport not detected Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 16:03:37 kjcf05n03 chronyd[2223]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[2197]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 16:03:37 kjcf05n03 network[2202]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Name Service Cache Daemon. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Resets System Activity Logs. Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[2227]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 16:03:37 kjcf05n03 mdraid-phy[2228]: no Cutlass to worry about Nov 3 16:03:37 kjcf05n03 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 0 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 1 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 2 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 3 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 4 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 5 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 6 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 7 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 8 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 9 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 10 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 11 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 12 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 13 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 14 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 15 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 16 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 17 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 18 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 19 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 20 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 21 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 22 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 23 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 24 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 25 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 26 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 27 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 28 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 29 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 30 Nov 3 16:03:37 kjcf05n03 cpupower[2252]: Idlestate 2 disabled on CPU 31 Nov 3 16:03:37 kjcf05n03 network[2237]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 16:03:37 kjcf05n03 network[2202]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[2239]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 16:03:37 kjcf05n03 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[2247]: No configuration found for ib0 Nov 3 16:03:37 kjcf05n03 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 16:03:37 kjcf05n03 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Manage Cutlass PHYs. Nov 3 16:03:37 kjcf05n03 sssd[sssd][2083]: Starting up Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 16:03:37 kjcf05n03 beSetMlxConfig[2181]: Starting MST (Mellanox Software Tools) driver set Nov 3 16:03:37 kjcf05n03 network[2260]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:03:37 kjcf05n03 network[2202]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[2261]: No configuration found for ib1 Nov 3 16:03:37 kjcf05n03 dbus-daemon[2122]: [system] Successfully activated service 'org.freedesktop.systemd1' Nov 3 16:03:37 kjcf05n03 chronyd[2223]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 16:03:37 kjcf05n03 chronyd[2223]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[2267]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 16:03:37 kjcf05n03 network[2272]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[2278]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 16:03:37 kjcf05n03 beSetMlxConfig[2181]: Loading MST PCI module - Success Nov 3 16:03:37 kjcf05n03 mlnx_conf_mgr[2304]: INFO: No configurations found for mlx5_0, skipping. Nov 3 16:03:37 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 16:03:37 kjcf05n03 mlnx_conf_mgr[2333]: INFO: No configurations found for mlx5_1, skipping. Nov 3 16:03:37 kjcf05n03 beSetMlxConfig[2181]: Loading MST PCI configuration module - Success Nov 3 16:03:37 kjcf05n03 beSetMlxConfig[2181]: Create devices Nov 3 16:03:37 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 16:03:37 kjcf05n03 sssd[be[implicit_files]][2279]: Starting up Nov 3 16:03:37 kjcf05n03 sssd[nss][2415]: Starting up Nov 3 16:03:37 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 16:03:37 kjcf05n03 systemd[1]: Reached target User and Group Name Lookups. Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Login Service... Nov 3 16:03:37 kjcf05n03 systemd-logind[2514]: New seat seat0. Nov 3 16:03:37 kjcf05n03 systemd-logind[2514]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Login Service. Nov 3 16:03:37 kjcf05n03 python3.9[2215]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 16:03:37 kjcf05n03 python3.9[3145]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 16:03:37 kjcf05n03 systemd-sysctl[2770]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 16:03:37 kjcf05n03 systemd-sysctl[2770]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 16:03:37 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 16:03:37 kjcf05n03 python3.9[2949]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 16:03:37 kjcf05n03 python3.9[3145]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 16:03:37 kjcf05n03 network[2202]: Bringing up loopback interface: [ OK ] Nov 3 16:03:37 kjcf05n03 systemd-sysctl[3113]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 16:03:37 kjcf05n03 systemd-sysctl[3113]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 16:03:37 kjcf05n03 systemd[1]: Started LSB: Bring up/down networking. Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 16:03:37 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 16:03:37 kjcf05n03 systemd[1]: Reached target Network. Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 16:03:37 kjcf05n03 systemd[1]: Reached target Network is Online. Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting System Logger Daemon... Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 16:03:37 kjcf05n03 sm-notify[3147]: Version 2.3.3 starting Nov 3 16:03:37 kjcf05n03 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Notify NFS peers of a restart. Nov 3 16:03:37 kjcf05n03 python3.9[3138]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 16:03:37 kjcf05n03 python3.9[3145]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:37 kjcf05n03 systemd[1]: Reached target NFS client services. Nov 3 16:03:37 kjcf05n03 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 16:03:37 kjcf05n03 systemd[1]: Reached target Remote File Systems. Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Permit User Sessions... Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 16:03:37 kjcf05n03 lldpad[3141]: setsockopt nearest_bridge: Invalid argument Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Permit User Sessions. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Getty on tty1. Nov 3 16:03:37 kjcf05n03 beSetMlxConfig[2181]: Unloading MST PCI module (unused) - Success Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Serial Getty on ttyS0. Nov 3 16:03:37 kjcf05n03 systemd[1]: Reached target Login Prompts. Nov 3 16:03:37 kjcf05n03 lldpad[3141]: setsockopt nearest_bridge: Invalid argument Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 16:03:37 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 16:03:37 kjcf05n03 syslog-ng[3145]: [2024-11-03T22:02:24.483934] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 16:03:37 kjcf05n03 syslog-ng[3145]: [2024-11-03T22:02:24.484213] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 16:03:37 kjcf05n03 syslog-ng[3145]: [2024-11-03T22:02:24.484244] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 16:03:37 kjcf05n03 syslog-ng[3145]: [2024-11-03T22:02:24.484447] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 16:03:37 kjcf05n03 syslog-ng[3145]: [2024-11-03T22:02:24.484628] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 16:03:37 kjcf05n03 systemd[1]: Started System Logger Daemon. Nov 3 16:03:37 kjcf05n03 python3.9[3265]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 16:03:37 kjcf05n03 python3.9[3145]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 16:03:37 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 16:03:37 kjcf05n03 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 16:03:37 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 16:03:37 kjcf05n03 python3.9[3397]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 16:03:37 kjcf05n03 python3.9[3145]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 16:03:37 kjcf05n03 sshd[3404]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 16:03:37 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 16:03:37 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 16:03:37 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 16:03:37 kjcf05n03 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 16:03:37 kjcf05n03 chronyd[2223]: System's initial offset : 0.001131 seconds slow of true (slew) Nov 3 16:03:37 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 16:03:37 kjcf05n03 beSetMlxConfig[2181]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 16:03:37 kjcf05n03 beSetMlxConfig[2181]: ib mode Nov 3 16:03:37 kjcf05n03 beSetMlxConfig[2181]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 16:03:37 kjcf05n03 root[3427]: openibd: Set node_desc for mlx5_0: kjcf05n03 HCA-1 Nov 3 16:03:37 kjcf05n03 root[3429]: openibd: Set node_desc for mlx5_1: kjcf05n03 HCA-2 Nov 3 16:03:37 kjcf05n03 beSetMlxConfig[2181]: ib mode Nov 3 16:03:37 kjcf05n03 systemd-udevd[1555]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 16:03:37 kjcf05n03 systemd-udevd[3442]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:03:37 kjcf05n03 systemd-udevd[3443]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:03:37 kjcf05n03 systemd-udevd[3446]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:03:37 kjcf05n03 systemd-udevd[3450]: Using default interface naming scheme 'rhel-8.0'. Nov 3 16:03:37 kjcf05n03 systemd-udevd[3450]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:03:37 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 16:03:37 kjcf05n03 systemd[3145]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:37 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[3484]: Setting up Mellanox network interface: ib0 Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[3485]: Setting up Mellanox network interface: ib1 Nov 3 16:03:37 kjcf05n03 systemd-udevd[3445]: Using default interface naming scheme 'rhel-8.0'. Nov 3 16:03:37 kjcf05n03 systemd-udevd[3445]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[3534]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[3535]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[3550]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[3551]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[3552]: No configuration found for ib0 Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[3553]: No configuration found for ib1 Nov 3 16:03:37 kjcf05n03 systemd-udevd[3444]: Using default interface naming scheme 'rhel-8.0'. Nov 3 16:03:37 kjcf05n03 systemd-udevd[3444]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Puppet agent... Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[3560]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[3561]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 16:03:37 kjcf05n03 mlnx_conf_mgr[3615]: INFO: No configurations found for mlx5_1, skipping. Nov 3 16:03:37 kjcf05n03 mlnx_conf_mgr[3616]: INFO: No configurations found for mlx5_0, skipping. Nov 3 16:03:37 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 16:03:37 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 16:03:37 kjcf05n03 systemd[1]: Stopping Command Scheduler... Nov 3 16:03:37 kjcf05n03 systemd[1]: crond.service: Succeeded. Nov 3 16:03:37 kjcf05n03 systemd[1]: Stopped Command Scheduler. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 16:03:37 kjcf05n03 systemd[1]: Stopping Job spooling tools... Nov 3 16:03:37 kjcf05n03 systemd[1]: atd.service: Succeeded. Nov 3 16:03:37 kjcf05n03 systemd[1]: Stopped Job spooling tools. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 16:03:37 kjcf05n03 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 16:03:37 kjcf05n03 lldpad[3141]: init_ports: Error adding device ib0 Nov 3 16:03:37 kjcf05n03 lldpad[3141]: init_ports: Error adding device ib1 Nov 3 16:03:37 kjcf05n03 lldpad[3141]: Signal 15 received - terminating Nov 3 16:03:37 kjcf05n03 systemd[1]: lldpad.service: Succeeded. Nov 3 16:03:37 kjcf05n03 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 16:03:37 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 16:03:37 kjcf05n03 systemd[1]: lldpad.socket: Succeeded. Nov 3 16:03:37 kjcf05n03 systemd[1]: Closed lldpad.socket. Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 16:03:37 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting IPMI Driver... Nov 3 16:03:37 kjcf05n03 systemd[1]: Started IPMI Driver. Nov 3 16:03:37 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:37 kjcf05n03 systemd[3145]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:03:37 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Ipmievd Daemon... Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 1 | Nov-03-2024 | 19:31:48 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 2 | Nov-03-2024 | 19:32:39 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 3 | Nov-03-2024 | 19:32:40 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 4 | Nov-03-2024 | 19:33:45 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 5 | Nov-03-2024 | 19:33:46 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 6 | Nov-03-2024 | 21:59:30 | Sensor #12 (Generator ID 20h) | Voltage | Assertion Event | Lower Non-critical - going low ; Sensor Reading = 18h ; Threshold = A0h Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 7 | Nov-03-2024 | 21:59:30 | Sensor #12 (Generator ID 20h) | Voltage | Assertion Event | Lower Critical - going low ; Sensor Reading = 18h ; Threshold = 96h Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 8 | Nov-03-2024 | 21:59:30 | Sensor #12 (Generator ID 20h) | Voltage | Assertion Event | Lower Non-recoverable - going low ; Sensor Reading = 18h ; Threshold = 8Ch Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 9 | Nov-03-2024 | 21:59:38 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 10 | Nov-03-2024 | 21:59:38 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 11 | Nov-03-2024 | 21:59:38 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 12 | Nov-03-2024 | 21:59:38 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 13 | Nov-03-2024 | 21:59:38 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 14 | Nov-03-2024 | 21:59:38 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 15 | Nov-03-2024 | 21:59:38 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 16 | Nov-03-2024 | 21:59:38 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 17 | Nov-03-2024 | 21:59:38 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 18 | Nov-03-2024 | 21:59:38 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 19 | Nov-03-2024 | 21:59:38 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 20 | Nov-03-2024 | 21:59:38 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 21 | Nov-03-2024 | 22:00:08 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 22 | Nov-03-2024 | 22:00:08 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 23 | Nov-03-2024 | 22:00:08 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 24 | Nov-03-2024 | 22:00:08 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 25 | Nov-03-2024 | 22:00:08 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 26 | Nov-03-2024 | 22:00:08 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 27 | Nov-03-2024 | 22:00:08 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 28 | Nov-03-2024 | 22:00:08 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 29 | Nov-03-2024 | 22:00:08 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 30 | Nov-03-2024 | 22:00:08 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 31 | Nov-03-2024 | 22:00:08 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 32 | Nov-03-2024 | 22:00:08 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 33 | Nov-03-2024 | 22:00:08 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 34 | Nov-03-2024 | 22:00:08 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 35 | Nov-03-2024 | 22:00:08 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 36 | Nov-03-2024 | 22:00:08 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 37 | Nov-03-2024 | 22:00:08 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 38 | Nov-03-2024 | 22:00:08 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 39 | Nov-03-2024 | 22:00:08 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 40 | Nov-03-2024 | 22:00:08 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 41 | Nov-03-2024 | 22:00:08 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 42 | Nov-03-2024 | 22:00:08 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 43 | Nov-03-2024 | 22:00:10 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 44 | Nov-03-2024 | 22:00:10 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 45 | Nov-03-2024 | 22:00:10 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 46 | Nov-03-2024 | 22:00:10 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 47 | Nov-03-2024 | 22:00:10 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 48 | Nov-03-2024 | 22:00:10 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 49 | Nov-03-2024 | 22:00:10 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 50 | Nov-03-2024 | 22:00:10 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 51 | Nov-03-2024 | 22:00:10 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3960]: 52 | Nov-03-2024 | 22:00:10 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:03:37 kjcf05n03 ipmievd[3963]: Reading sensors... Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Ipmievd Daemon. Nov 3 16:03:37 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:37 kjcf05n03 systemd[3145]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 16:03:37 kjcf05n03 nscd[2076]: 2076 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 16:03:37 kjcf05n03 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 16:03:37 kjcf05n03 systemd[1]: Stopped Set Mellanox configuration. Nov 3 16:03:37 kjcf05n03 systemd[1]: Stopping Set Mellanox configuration... Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 16:03:37 kjcf05n03 beSetMlxConfig[4020]: ConnectX-3 multiport not detected Nov 3 16:03:37 kjcf05n03 beSetMlxConfig[4020]: Starting MST (Mellanox Software Tools) driver set Nov 3 16:03:37 kjcf05n03 beSetMlxConfig[4020]: Loading MST PCI module - Success Nov 3 16:03:37 kjcf05n03 systemd-udevd[1555]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 16:03:37 kjcf05n03 beSetMlxConfig[4020]: [warn] mst_pciconf is already loaded, skipping Nov 3 16:03:37 kjcf05n03 beSetMlxConfig[4020]: Create devices Nov 3 16:03:37 kjcf05n03 beSetMlxConfig[4020]: Unloading MST PCI module (unused) - Success Nov 3 16:03:37 kjcf05n03 ipmievd[3963]: Waiting for events... Nov 3 16:03:37 kjcf05n03 beSetMlxConfig[4020]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 16:03:37 kjcf05n03 beSetMlxConfig[4020]: ib mode Nov 3 16:03:37 kjcf05n03 beSetMlxConfig[4020]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 16:03:37 kjcf05n03 beSetMlxConfig[4020]: ib mode Nov 3 16:03:37 kjcf05n03 systemd-udevd[1555]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 16:03:37 kjcf05n03 systemd-udevd[4921]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:03:37 kjcf05n03 systemd-udevd[4922]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:03:37 kjcf05n03 systemd-udevd[4926]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:03:37 kjcf05n03 systemd-udevd[4928]: Using default interface naming scheme 'rhel-8.0'. Nov 3 16:03:37 kjcf05n03 systemd-udevd[4928]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:03:37 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 16:03:37 kjcf05n03 systemd[3145]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:37 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[4963]: Setting up Mellanox network interface: ib1 Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[4964]: Setting up Mellanox network interface: ib0 Nov 3 16:03:37 kjcf05n03 systemd-udevd[4923]: Using default interface naming scheme 'rhel-8.0'. Nov 3 16:03:37 kjcf05n03 systemd-udevd[4924]: Using default interface naming scheme 'rhel-8.0'. Nov 3 16:03:37 kjcf05n03 systemd-udevd[4923]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:03:37 kjcf05n03 systemd-udevd[4924]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[5012]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[5014]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[5043]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[5045]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[5046]: No configuration found for ib1 Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[5047]: No configuration found for ib0 Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[5051]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 16:03:37 kjcf05n03 mlnx_interface_mgr[5055]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 16:03:37 kjcf05n03 mlnx_conf_mgr[5089]: INFO: No configurations found for mlx5_1, skipping. Nov 3 16:03:37 kjcf05n03 mlnx_conf_mgr[5095]: INFO: No configurations found for mlx5_0, skipping. Nov 3 16:03:37 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 16:03:37 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}e2c0cb32defa67518ac50546615c5ec96372cfc18f10562e905ae6d6198b0cdc' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}e2c0cb32defa67518ac50546615c5ec96372cfc18f10562e905ae6d6198b0cdc' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}02a2a22ad77a55b74515a4218e33a00955c202b3f9003b2d237997d031b759ed' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}02a2a22ad77a55b74515a4218e33a00955c202b3f9003b2d237997d031b759ed' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}9b3b24dd257a4384f5dc4cfd3e910655cd46b786d667aabfe73a4789bc2e03dd' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}9b3b24dd257a4384f5dc4cfd3e910655cd46b786d667aabfe73a4789bc2e03dd' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}6b247dd3695fcd8554b37250373724e6a469940ae836ab56a7ebc122d0564643' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}6b247dd3695fcd8554b37250373724e6a469940ae836ab56a7ebc122d0564643' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 16:03:37 kjcf05n03 systemd[1]: Stopping NTP client/server... Nov 3 16:03:37 kjcf05n03 chronyd[2223]: chronyd exiting Nov 3 16:03:37 kjcf05n03 systemd[1]: chronyd.service: Succeeded. Nov 3 16:03:37 kjcf05n03 systemd[1]: Stopped NTP client/server. Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 16:03:37 kjcf05n03 chronyd[5130]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 16:03:37 kjcf05n03 chronyd[5130]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 16:03:37 kjcf05n03 chronyd[5130]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 16:03:37 kjcf05n03 chronyd[5130]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 16:03:37 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 16:03:37 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:37 kjcf05n03 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 16:03:37 kjcf05n03 systemd[1]: dwd.service: Succeeded. Nov 3 16:03:37 kjcf05n03 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 16:03:37 kjcf05n03 dwd[5161]: dwd: vMay 29 2024 : 15:38:26 Nov 3 16:03:37 kjcf05n03 dwd[5161]: /usr/sbin/dwd -i 15 -d Nov 3 16:03:37 kjcf05n03 dwd[5161]: dwd: option Lethal: 0 Nov 3 16:03:37 kjcf05n03 dwd[5161]: dwd: option Interval: 15 Nov 3 16:03:37 kjcf05n03 dwd[5161]: dwd: option abrtlimit: 10 Nov 3 16:03:37 kjcf05n03 dwd[5161]: dwd: option DZPeriod: 604800 Nov 3 16:03:37 kjcf05n03 dwd[5161]: dwd: option SmartPeriod: 43200 Nov 3 16:03:37 kjcf05n03 dwd[5161]: dwd: option SDDEnabled: 1 Nov 3 16:03:37 kjcf05n03 dwd[5161]: dwd: option SDDAwaitScale: 3 Nov 3 16:03:37 kjcf05n03 dwd[5161]: dwd: option SDDAwaitMin: 100 Nov 3 16:03:37 kjcf05n03 dwd[5161]: dwd: option Verbosity: 1 Nov 3 16:03:37 kjcf05n03 dwd[5161]: dwd: option StandAlone: 0 Nov 3 16:03:37 kjcf05n03 dwd[5161]: option Lethal: 0 Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 16:03:37 kjcf05n03 dwd[5161]: option Interval: 15 Nov 3 16:03:37 kjcf05n03 dwd[5161]: option abrtlimit: 10 Nov 3 16:03:37 kjcf05n03 dwd[5161]: option DZPeriod: 604800 Nov 3 16:03:37 kjcf05n03 dwd[5161]: option SmartPeriod: 43200 Nov 3 16:03:37 kjcf05n03 dwd[5161]: option SDDEnabled: 1 Nov 3 16:03:37 kjcf05n03 dwd[5161]: option SDDAwaitScale: 3 Nov 3 16:03:37 kjcf05n03 dwd[5161]: option SDDAwaitMin: 100 Nov 3 16:03:37 kjcf05n03 dwd[5161]: option Verbosity: 1 Nov 3 16:03:37 kjcf05n03 dwd[5161]: option StandAlone: 0 Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 16:03:37 kjcf05n03 dwd[5162]: option Lethal now set to 1 Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 16:03:37 kjcf05n03 dwd[5162]: option abrtlimit now set to 1 Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 16:03:37 kjcf05n03 dwd[5162]: option SmartPeriod now set to 86400 Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 16:03:37 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 16:03:37 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Discard unused blocks. Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:03:37 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:37 kjcf05n03 python3.9[5191]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 16:03:37 kjcf05n03 python3.9[3145]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 16:03:37 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Periodic ZFS scrub. Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:03:37 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 16:03:37 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:37 kjcf05n03 systemd[1]: Starting Sed Control Plane worker process... Nov 3 16:03:37 kjcf05n03 sedcpwrkr[5330]: Using config script: /etc/sedcpwrkr.conf Nov 3 16:03:37 kjcf05n03 sedcpwrkr[5330]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 16:03:37 kjcf05n03 sedcpwrkr[5330]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 16:03:37 kjcf05n03 sedcpwrkr[5330]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 16:03:37 kjcf05n03 sedcpwrkr[5330]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 16:03:37 kjcf05n03 sedcpwrkr[5330]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 16:03:37 kjcf05n03 sedcpwrkr[5330]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 16:03:37 kjcf05n03 sedcpwrkr-server[5361]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 16:03:37 kjcf05n03 sedcpwrkr[5330]: celery multi v5.2.7 (dawn-chorus) Nov 3 16:03:37 kjcf05n03 sedcpwrkr[5330]: > Starting nodes... Nov 3 16:03:37 kjcf05n03 sedcpwrkr[5330]: > sedcpwrkr@kjcf05n03: OK Nov 3 16:03:37 kjcf05n03 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 16:03:37 kjcf05n03 sedcpwrkr-server[5363]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 16:03:37 kjcf05n03 sedcpwrkr-server[5363]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 16:03:37 kjcf05n03 sedcpwrkr-server[5363]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 16:03:37 kjcf05n03 systemd[1]: Started Sed Control Plane worker process. Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 16:03:37 kjcf05n03 systemd[1]: Reloading System Logger Daemon. Nov 3 16:03:37 kjcf05n03 systemd[1]: Reloaded System Logger Daemon. Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 16:03:37 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 16:03:37 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 16:03:38 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:38 kjcf05n03 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 16:03:38 kjcf05n03 systemd-udevd[1555]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 16:03:38 kjcf05n03 iptables.init[5430]: iptables: Applying firewall rules: [ OK ] Nov 3 16:03:38 kjcf05n03 systemd[1]: Started IPv4 firewall with iptables. Nov 3 16:03:38 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:39 kjcf05n03 systemd[3145]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 16:03:39 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 16:03:39 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 16:03:39 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:40 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 16:03:40 kjcf05n03 systemd[1]: openhpid.service: Supervising process 5528 which is not our child. We'll most likely not notice when it exits. Nov 3 16:03:40 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 16:03:40 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:40 kjcf05n03 openhpid[5528]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 16:03:40 kjcf05n03 openhpid[5528]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 16:03:40 kjcf05n03 openhpid[5528]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 16:03:40 kjcf05n03 openhpid[5528]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 16:03:40 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:40 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:03:40 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:03:40 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 16:03:40 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 16:03:40 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 16:03:40 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 16:03:40 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:41 kjcf05n03 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 16:03:41 kjcf05n03 dcs-collectord[5619]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 16:03:41 kjcf05n03 hpi.inv.log[5619]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 16:03:41 kjcf05n03 dcs-collectord[5619]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 16:03:41 kjcf05n03 dcs-collectord[5619]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 16:03:41 kjcf05n03 dcs-collector[5610]: Starting dcs-collector:[ OK ] Nov 3 16:03:41 kjcf05n03 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 16:03:41 kjcf05n03 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 16:03:41 kjcf05n03 dcs-collectord[5622]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 16:03:41 kjcf05n03 dcs-collectord[5622]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 16:03:41 kjcf05n03 dcs-collectord[5622]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 16:03:41 kjcf05n03 dcs-collectord[5622]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 16:03:41 kjcf05n03 dcs-collectord[5622]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 16:03:41 kjcf05n03 dcs-collectord[5622]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 16:03:41 kjcf05n03 dcs-collectord[5622]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 16:03:41 kjcf05n03 dcs-collectord[5622]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259344600", "units": "kB"}, {"name": "MemAvailable", "value": "258624232", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821156", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686776", "units": "kB"}, {"name": "Inactive", "value": "963328", "units": "kB"}, {"name": "Active(anon)", "value": "1520612", "units": "kB"}, {"name": "Inactive(anon)", "value": "827168", "units": "kB"}, {"name": "Active(file)", "value": "166164", "units": "kB"}, {"name": "Inactive(file)", "value": "136160", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "754696", "units": "kB"}, {"name": "Mapped", "value": "86048", "units": "kB"}, {"name": "Shmem", "value": "1593276", "units": "kB"}, {"name": "KReclaimable", "value": "109092", "units": "kB"}, {"name": "Slab", "value": "276008", "units": "kB"}, {"name": "SReclaimable", "value": "109092", "units": "kB"}, {"name": "SUnreclaim", "value": "166916", "units": "kB"}, {"name": "KernelStack", "value": "9744", "units": "kB"}, {"name": "PageTables", "value": "20424", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3294508", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11264", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "4096", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "285000", "units": "kB"}, {"name": "DirectMap2M", "value": "21600256", "units": "kB"}, {"name": "DirectMap1G", "value": "246415360", "units": "kB"}]}' Nov 3 16:03:41 kjcf05n03 dcs-collectord[5622]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 16:03:41 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:41 kjcf05n03 systemd[3145]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:41 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:03:41 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:03:41 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 16:03:41 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 16:03:41 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 16:03:41 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 16:03:41 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:42 kjcf05n03 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 16:03:42 kjcf05n03 firmware-update-orc[5703]: Using config script: /etc/firmware_update_orc.conf Nov 3 16:03:42 kjcf05n03 firmware-update-orc[5703]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 16:03:42 kjcf05n03 firmware-update-orc[5703]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 16:03:42 kjcf05n03 firmware-update-orc[5703]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 16:03:42 kjcf05n03 firmware-update-orc[5703]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 16:03:42 kjcf05n03 firmware-update-orc[5703]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 16:03:42 kjcf05n03 firmware-update-orc[5703]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 16:03:42 kjcf05n03 dcs-collectord[5622]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 16:03:42 kjcf05n03 dcs-collectord[5622]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730671421.212241], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730671422.387844], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730671421.1405017, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 16:03:42 kjcf05n03 firmware-update-orc-server[5745]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 16:03:42 kjcf05n03 firmware-update-orc[5703]: celery multi v5.2.7 (dawn-chorus) Nov 3 16:03:42 kjcf05n03 firmware-update-orc[5703]: > Starting nodes... Nov 3 16:03:42 kjcf05n03 firmware-update-orc[5703]: > worker1@kjcf05n03: OK Nov 3 16:03:42 kjcf05n03 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 16:03:42 kjcf05n03 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 16:03:42 kjcf05n03 firmware-update-orc-server[5768]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 16:03:42 kjcf05n03 firmware-update-orc-server[5768]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 16:03:42 kjcf05n03 firmware-update-orc-server[5768]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 16:03:42 kjcf05n03 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 16:03:42 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:43 kjcf05n03 systemd[3145]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:43 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:03:43 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:03:43 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 16:03:43 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 16:03:43 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 16:03:43 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 16:03:43 kjcf05n03 dbus-daemon[2122]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 16:03:43 kjcf05n03 dbus-daemon[2122]: [system] Reloaded configuration Nov 3 16:03:43 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 16:03:43 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 16:03:43 kjcf05n03 dbus-daemon[2122]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 16:03:43 kjcf05n03 dbus-daemon[2122]: [system] Reloaded configuration Nov 3 16:03:43 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 16:03:43 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 16:03:43 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 16:03:43 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 16:03:43 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:43 kjcf05n03 systemd[1]: Starting Manages hardware resources... Nov 3 16:03:44 kjcf05n03 ras-resource-manager-agent[5884]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 16:03:44 kjcf05n03 ras-resource-manager-agent[5870]: Starting ras-resource-manager-agent:[ OK ] Nov 3 16:03:44 kjcf05n03 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 16:03:44 kjcf05n03 ras-resource-manager-agent[5886]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 16:03:44 kjcf05n03 ras-resource-manager-client[5886]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 16:03:44 kjcf05n03 systemd[1]: Started Manages hardware resources. Nov 3 16:03:44 kjcf05n03 ras-resource-manager-client[5886]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 16:03:44 kjcf05n03 ras-resource-manager-client[5896]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 16:03:44 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:44 kjcf05n03 systemd[3145]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:44 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:03:44 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:03:44 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 16:03:44 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 16:03:44 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:44 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 16:03:45 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:45 kjcf05n03 systemd[3145]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: Press Ctrl+C to exit. Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: Plugin support version 1.0 Nov 3 16:03:45 kjcf05n03 zabbix_agent2[5970]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 16:03:45 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:03:45 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:03:45 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:45 kjcf05n03 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 16:03:45 kjcf05n03 dcs-notification-sender[6047]: dcs-notification-senderd is stopped Nov 3 16:03:45 kjcf05n03 zabbix-agent2[6061]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 16:03:45 kjcf05n03 dcs-notification-sender[6047]: Starting notification-sender:[ OK ] Nov 3 16:03:45 kjcf05n03 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 16:03:46 kjcf05n03 zabbix-agent2[6067]: INFO DCS notification agent started. (agent.py:61) Nov 3 16:03:46 kjcf05n03 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 16:03:46 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:46 kjcf05n00 mcfcli[3673891]: %3|1730671426.210|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 16:03:46 kjcf05n03 systemd[3145]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:46 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:03:46 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:03:46 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:46 kjcf05n03 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 16:03:46 kjcf05n03 dcs-collectord[6154]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 16:03:47 kjcf05n03 dcs-collectord[6154]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 16:03:47 kjcf05n03 dcs-bulk-data-sender[6154]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 16:03:47 kjcf05n03 dcs-bulk-data-sender[6145]: Starting bulk-data-sender:[ OK ] Nov 3 16:03:47 kjcf05n03 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 16:03:47 kjcf05n03 dcs-collectord[6156]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 16:03:47 kjcf05n03 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 16:03:47 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:47 kjcf05n03 systemd[3145]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:47 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:03:47 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:03:47 kjcf05n03 nscd[2076]: 2076 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 16:03:47 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 16:03:47 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 16:03:47 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 16:03:47 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 16:03:47 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 16:03:47 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 16:03:47 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 16:03:47 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 16:03:47 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 16:03:47 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 16:03:47 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 16:03:47 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 16:03:47 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 16:03:47 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 16:03:48 kjcf05n03 systemd[1]: Stopping System Security Services Daemon... Nov 3 16:03:48 kjcf05n03 sssd[nss][2415]: Shutting down (status = 0) Nov 3 16:03:48 kjcf05n03 sssd[be[implicit_files]][2279]: Shutting down (status = 0) Nov 3 16:03:48 kjcf05n03 systemd[1]: sssd.service: Succeeded. Nov 3 16:03:48 kjcf05n03 systemd[1]: Stopped System Security Services Daemon. Nov 3 16:03:48 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 16:03:48 kjcf05n03 python3.9[5191]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 16:03:48 kjcf05n03 python3.9[3145]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:48 kjcf05n03 sssd[sssd][6245]: Starting up Nov 3 16:03:48 kjcf05n03 sssd[be[implicit_files]][6246]: Starting up Nov 3 16:03:48 kjcf05n03 sssd[nss][6247]: Starting up Nov 3 16:03:48 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:48 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:48 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 16:03:49 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 16:03:49 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 16:03:50 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 16:03:50 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 16:03:50 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure) defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 16:03:50 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure: defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 16:03:50 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure) defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 16:03:50 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure: defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 16:03:50 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 16:03:50 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 16:03:50 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 16:03:50 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 16:03:50 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:03:50 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:03:50 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:50 kjcf05n03 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 16:03:50 kjcf05n03 icinga2[6304]: [2024-11-03 16:03:50 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 16:03:50 kjcf05n03 icinga2[6304]: [2024-11-03 16:03:50 -0600] information/cli: Loading configuration file(s). Nov 3 16:03:50 kjcf05n03 icinga2[6304]: [2024-11-03 16:03:50 -0600] information/ConfigItem: Committing config item(s). Nov 3 16:03:50 kjcf05n03 icinga2[6304]: [2024-11-03 16:03:50 -0600] information/ApiListener: My API identity: kjcf05n03 Nov 3 16:03:50 kjcf05n03 icinga2[6304]: [2024-11-03 16:03:50 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 16:03:50 kjcf05n03 icinga2[6304]: [2024-11-03 16:03:50 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 16:03:50 kjcf05n03 icinga2[6304]: [2024-11-03 16:03:50 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 16:03:50 kjcf05n03 icinga2[6304]: [2024-11-03 16:03:50 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 16:03:50 kjcf05n03 icinga2[6304]: [2024-11-03 16:03:50 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 16:03:50 kjcf05n03 icinga2[6304]: [2024-11-03 16:03:50 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 16:03:50 kjcf05n03 icinga2[6304]: [2024-11-03 16:03:50 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 16:03:50 kjcf05n03 icinga2[6304]: [2024-11-03 16:03:50 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 16:03:50 kjcf05n03 icinga2[6304]: [2024-11-03 16:03:50 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 16:03:50 kjcf05n03 icinga2[6304]: [2024-11-03 16:03:50 -0600] information/cli: Closing console log. Nov 3 16:03:50 kjcf05n03 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 16:03:50 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:51 kjcf05n03 systemd[3145]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:51 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:03:51 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:03:51 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 16:03:51 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 16:03:51 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:51 kjcf05n03 systemd[1]: Started Icinga2 network monitor. Nov 3 16:03:51 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:52 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 16:03:52 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:03:52 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:03:52 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 16:03:52 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 16:03:52 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 16:03:52 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 16:03:52 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 16:03:52 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 16:03:52 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 16:03:52 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 16:03:52 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 16:03:52 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 16:03:52 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 16:03:52 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 16:03:52 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 16:03:52 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 16:03:53 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:53 kjcf05n03 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 16:03:53 kjcf05n03 nslcd[6919]: version 0.9.9 starting Nov 3 16:03:53 kjcf05n03 nslcd[6919]: accepting connections Nov 3 16:03:53 kjcf05n03 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 16:03:53 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:54 kjcf05n03 systemd[3145]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:54 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:03:54 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:03:54 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 16:03:54 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 16:03:54 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 16:03:54 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 16:03:54 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 16:03:54 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 16:03:55 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 16:03:55 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 16:03:55 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:55 kjcf05n03 dcs-bulk-data-sender[6156]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 16:03:55 kjcf05n03 dcs-collectord[6156]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 16:03:55 kjcf05n03 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 16:03:55 kjcf05n03 dearcpw[7160]: Using config script: /etc/dearcpw.conf Nov 3 16:03:55 kjcf05n03 dearcpw[7160]: - Creating default directory: '/var/log/dearcpw' Nov 3 16:03:55 kjcf05n03 dearcpw[7160]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 16:03:55 kjcf05n03 dearcpw[7160]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 16:03:55 kjcf05n03 dearcpw[7160]: - Creating default directory: '/var/run/dearcpw' Nov 3 16:03:55 kjcf05n03 dearcpw[7160]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 16:03:55 kjcf05n03 dearcpw[7160]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 16:03:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 16:03:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 16:03:55 kjcf05n03 dearcpw-server[7200]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 16:03:55 kjcf05n03 dearcpw[7160]: celery multi v5.2.7 (dawn-chorus) Nov 3 16:03:55 kjcf05n03 dearcpw[7160]: > Starting nodes... Nov 3 16:03:55 kjcf05n03 dearcpw[7160]: > dearcpw@kjcf05n03: OK Nov 3 16:03:55 kjcf05n03 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 16:03:55 kjcf05n03 dearcpw-server[7202]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 16:03:55 kjcf05n03 dearcpw-server[7202]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 16:03:55 kjcf05n03 dearcpw-server[7202]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 16:03:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 16:03:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 16:03:56 kjcf05n03 systemd[1]: Started DEAR Control Plane worker process. Nov 3 16:03:56 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:03:56 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:03:56 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 16:03:56 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 16:03:56 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 16:03:56 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 16:03:56 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 16:03:56 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 16:03:56 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 16:03:56 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 16:03:56 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 16:03:56 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 16:03:56 kjcf05n03 puppet[7433]: IEC: 017000000: Node is up and running: { "node": "kjcf05n03" } Nov 3 16:03:56 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 16:03:56 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 16:03:56 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 16:03:56 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 16:03:56 kjcf05n03 dcs-collectord[5622]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 16:03:56 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 16:03:56 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 16:03:56 kjcf05n03 dcs-collectord[5622]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 16:03:56 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 16:03:56 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 16:03:56 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:49778). Nov 3 16:03:56 kjcf05n01 rsyncd[3177208]: connect from kjcf05n03 (172.16.2.6) Nov 3 16:03:56 kjcf05n01 rsyncd[3177208]: rsync to puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 16:03:56 kjcf05n01 rsyncd[3177208]: receiving file list Nov 3 16:03:56 kjcf05n01 rsyncd[3177208]: sent 29 bytes received 325 bytes total size 10901 Nov 3 16:03:56 kjcf05n01 systemd[1]: rsyncd@642-172.16.2.2:873-172.16.2.6:49778.service: Succeeded. Nov 3 16:03:56 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 16:03:56 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 16:03:57 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 16:03:57 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 16:03:57 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 16:03:57 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 16:03:58 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 16:03:58 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 16:03:58 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 16:03:58 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 16:03:58 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 16:03:58 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 16:03:58 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 16:03:58 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 16:03:59 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 16:03:59 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 16:03:59 kjcf05n03 systemd[1]: Reloading. Nov 3 16:03:59 kjcf05n03 ipmievd[3963]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 16:03:59 kjcf05n03 ipmievd[3963]: System Event sensor - Timestamp Clock Sync Nov 3 16:03:59 kjcf05n03 ipmievd[3145]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:03:59 kjcf05n03 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 16:03:59 kjcf05n03 diskless-swap[7587]: HA_PS_000: recovering journal Nov 3 16:03:59 kjcf05n03 systemd-udevd[1555]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 16:03:59 kjcf05n03 diskless-swap[7587]: HA_PS_000: clean, 2281/6400 files, 7047/25600 blocks Nov 3 16:04:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 16:04:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 16:04:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 16:04:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 16:04:00 kjcf05n03 diskless-swap[7587]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 16:04:00 kjcf05n03 diskless-swap[7587]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 16:04:00 kjcf05n03 diskless-swap[7587]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 16:04:00 kjcf05n03 diskless-swap[7587]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 16:04:00 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 16:04:00 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:04:00 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:04:00 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 16:04:00 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 16:04:00 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 16:04:00 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 16:04:00 kjcf05n03 systemd[1]: Stopping OpenSSH server daemon... Nov 3 16:04:00 kjcf05n03 systemd[1]: sshd.service: Succeeded. Nov 3 16:04:00 kjcf05n03 systemd[1]: Stopped OpenSSH server daemon. Nov 3 16:04:00 kjcf05n03 systemd[1]: Stopped target sshd-keygen.target. Nov 3 16:04:00 kjcf05n03 systemd[1]: Stopping sshd-keygen.target. Nov 3 16:04:00 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 16:04:00 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 16:04:00 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 16:04:00 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 16:04:00 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 16:04:00 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 16:04:00 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 16:04:01 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 16:04:01 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 16:04:01 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 16:04:01 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 16:04:01 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 16:04:01 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 16:04:01 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 16:04:01 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 16:04:02 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 16:04:02 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 16:04:02 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 16:04:02 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 16:04:03 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 16:04:03 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 16:04:03 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 16:04:03 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 16:04:03 kjcf05n03 systemd[1]: Reloading. Nov 3 16:04:03 kjcf05n03 systemd[1]: Set up automount opt-firmware.automount. Nov 3 16:04:03 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:04:03 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:04:03 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 16:04:03 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 16:04:03 kjcf05n03 systemd[1]: Reloading. Nov 3 16:04:04 kjcf05n03 systemd[1]: Set up automount mnt-llog.automount. Nov 3 16:04:04 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:04:04 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:04:04 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 16:04:04 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 16:04:04 kjcf05n03 systemd[1]: Reloading. Nov 3 16:04:04 kjcf05n03 systemd[1]: Set up automount usr-share-man.automount. Nov 3 16:04:04 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:04:04 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:04:04 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 16:04:04 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 16:04:04 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 16:04:04 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 16:04:04 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 16:04:04 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 16:04:04 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 16:04:04 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 16:04:04 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 16:04:04 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 16:04:05 kjcf05n03 systemd[1]: Reloading. Nov 3 16:04:05 kjcf05n03 systemd[1]: Starting Crash recovery kernel arming... Nov 3 16:04:05 kjcf05n03 kdumpctl[7822]: kdump: No kdump initial ramdisk found. Nov 3 16:04:05 kjcf05n03 kdumpctl[7822]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 16:04:05 kjcf05n03 dracut[7949]: dracut-049-135.git20210121.el8 Nov 3 16:04:05 kjcf05n03 dracut[7951]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 16:04:05 kjcf05n03 dracut[7951]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 16:04:05 kjcf05n03 dracut[7951]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 16:04:05 kjcf05n03 dracut[7951]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 16:04:05 kjcf05n03 dracut[7951]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 16:04:05 kjcf05n03 dracut[7951]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 16:04:05 kjcf05n03 dracut[7951]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 16:04:05 kjcf05n03 dracut[7951]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + is_func check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ type -t check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 0 -ne 0 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check -h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local dev holder Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + require_binaries mdadm expr Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _module_name=90hperaid Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ mdadm = \-\m ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for cmd in "$@" Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + find_binary mdadm Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for cmd in "$@" Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + find_binary expr Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n -h ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for dev in "${!host_fs_types[@]}" Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ nfs != *_raid_member ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + continue Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _ret=255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + ret=255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ 255 = 0 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ 255 = 255 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ module_depends hperaid Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: +++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 16:04:06 kjcf05n03 kdumpctl[3145]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: +++ set -x Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ depends Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo rootfs-block Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ return 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ _ret=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ return 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for _moddep in $(module_depends $_mod) Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all == *\ hperaid\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + add_dracutmodules+=' rootfs-block ' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ == *\ hperaid\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check_module rootfs-block Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _mod=rootfs-block Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddep Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ == *\ rootfs-block\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n '' ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all == *\ rootfs-block\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + module_check rootfs-block 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _forced=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 2 -eq 2 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _forced=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + is_func check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ type -t check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 0 -ne 0 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check -h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _ret=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + ret=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ 0 = 0 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ module_depends rootfs-block Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: +++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ depends Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo fs-lib Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ _ret=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ return 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for _moddep in $(module_depends $_mod) Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all == *\ rootfs-block\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + add_dracutmodules+=' fs-lib ' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ == *\ rootfs-block\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check_module fs-lib Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _mod=fs-lib Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddep Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n '' ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + mods_checked_as_dep+=' fs-lib ' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all == *\ fs-lib\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + module_check fs-lib 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _forced=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 2 -eq 2 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _forced=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + is_func check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ type -t check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 0 -ne 0 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check -h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _ret=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + ret=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ 0 = 0 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ module_depends fs-lib Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: +++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ depends Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ return 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ _ret=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ return 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + mods_to_load+=' fs-lib ' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + mods_to_load+=' rootfs-block ' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + mods_to_load+=' hperaid ' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _mod=90kernel-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _mod=kernel-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check_module kernel-modules 1 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _mod=kernel-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddep Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n 1 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all = all ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + module_check kernel-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _forced=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 1 -eq 2 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + is_func check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ type -t check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 0 -ne 0 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check -h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + true Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _ret=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + ret=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ 0 != 0 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ module_depends kernel-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: +++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[3145]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ depends Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ true Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ _ret=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ return 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + mods_to_load+=' kernel-modules ' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _mod=90kernel-modules-extra Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _mod=kernel-modules-extra Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check_module kernel-modules-extra 1 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _mod=kernel-modules-extra Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddep Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n 1 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all = all ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + module_check kernel-modules-extra Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _forced=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 1 -eq 2 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + is_func check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ type -t check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 0 -ne 0 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check -h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + true Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _ret=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + ret=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ 0 != 0 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ module_depends kernel-modules-extra Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: +++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 16:04:06 kjcf05n03 kdumpctl[3145]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ depends Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ true Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ _ret=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ return 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + mods_to_load+=' kernel-modules-extra ' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _mod=90kernel-network-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _mod=kernel-network-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check_module kernel-network-modules 1 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _mod=kernel-network-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddep Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n 1 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all = all ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + module_check kernel-network-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _forced=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 1 -eq 2 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + is_func check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ type -t check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 0 -ne 0 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check -h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _ret=255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + ret=255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ 255 != 0 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n 1 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 1 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _mod=90livenet Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _mod=livenet Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check_module livenet 1 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _mod=livenet Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddep Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n 1 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all = all ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + module_check livenet Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _forced=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 1 -eq 2 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + is_func check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ type -t check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 0 -ne 0 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check -h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _ret=255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + ret=255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ 255 != 0 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n 1 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 1 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _mod=90lvm Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _mod=lvm Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check_module lvm 1 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _mod=lvm Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddep Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n 1 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all = all ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + module_check lvm Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _forced=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 1 -eq 2 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + is_func check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ type -t check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 0 -ne 0 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check -h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + require_binaries lvm Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _module_name=90lvm Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ lvm = \-\m ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for cmd in "$@" Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + find_binary lvm Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n -h ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for fs in "${host_fs_types[@]}" Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ nfs = LVM*_member ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _ret=255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + ret=255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ 255 != 0 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n 1 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 1 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _mod=90mdraid Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _mod=mdraid Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check_module mdraid 1 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _mod=mdraid Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddep Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n 1 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all = all ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + module_check mdraid Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _forced=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 1 -eq 2 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + is_func check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ type -t check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 0 -ne 0 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check -h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _rootdev Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + require_binaries mdadm expr Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _module_name=90mdraid Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ mdadm = \-\m ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for cmd in "$@" Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + find_binary mdadm Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for cmd in "$@" Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + find_binary expr Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n -h ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for dev in "${!host_fs_types[@]}" Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ nfs != *_raid_member ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + continue Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _ret=255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + ret=255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ 255 != 0 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n 1 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 1 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _mod=90multipath Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _mod=multipath Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check_module multipath 1 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _mod=multipath Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddep Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n 1 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all = all ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + module_check multipath Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _forced=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 1 -eq 2 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + is_func check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ type -t check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 0 -ne 0 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check -h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _rootdev Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n -h ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for_each_host_dev_and_slaves is_mpath Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _func=is_mpath Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _dev Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for _dev in "${host_devs[@]}" Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + continue Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 1 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _ret=255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + ret=255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ 255 != 0 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n 1 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 1 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _mod=90qemu Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _mod=qemu Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check_module qemu 1 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _mod=qemu Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddep Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n 1 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all = all ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + module_check qemu Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _forced=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 1 -eq 2 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + is_func check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ type -t check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 0 -ne 0 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check -h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n -h ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + type -P systemd-detect-virt Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ systemd-detect-virt --vm Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + vm=none Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + (( 1 != 0 )) Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _ret=255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + ret=255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ 255 != 0 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n 1 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 1 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _mod=90qemu-net Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _mod=qemu-net Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check_module qemu-net 1 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _mod=qemu-net Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddep Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n 1 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all = all ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + module_check qemu-net Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _forced=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 1 -eq 2 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + is_func check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ type -t check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 0 -ne 0 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check -h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n -h ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + type -P systemd-detect-virt Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ systemd-detect-virt --vm Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + vm= Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + (( 1 != 0 )) Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _ret=255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + ret=255 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ 255 != 0 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n 1 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + return 1 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _mod=90stratis Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + _mod=stratis Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check_module stratis 1 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _mod=stratis Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddep Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -n 1 ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ all = all ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + module_check stratis Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ read a b Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _forced=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _hostonly=-h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 1 -eq 2 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + is_func check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: ++ type -t check Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + '[' 0 -ne 0 ']' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + check -h Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _module_name=90stratis Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + local _ret=0 Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + [[ stratisd-init = \-\m ]] Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + for cmd in "$@" Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + find_binary stratisd-init Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 16:04:06 kjcf05n03 kdumpctl[7822]: + set +x Nov 3 16:04:06 kjcf05n03 dracut[7951]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 16:04:06 kjcf05n03 dracut[7951]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 16:04:06 kjcf05n03 dracut[7951]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 16:04:06 kjcf05n03 dracut[7951]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 16:04:06 kjcf05n03 dracut[7951]: memstrack is available Nov 3 16:04:06 kjcf05n03 dracut[7951]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 16:04:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730671445', 'host':'kjcf05n03', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 16:04:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730671445', 'host':'kjcf05n03', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 16:04:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730671445'} Nov 3 16:04:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730671445'} Nov 3 16:04:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:04:06 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 16:04:06 kjcf05n03 dracut[7951]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 16:04:06 kjcf05n03 dracut[7951]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 16:04:06 kjcf05n03 dracut[7951]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 16:04:06 kjcf05n03 dracut[7951]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 16:04:06 kjcf05n03 dracut[7951]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 16:04:06 kjcf05n03 dracut[7951]: *** Including module: bash *** Nov 3 16:04:06 kjcf05n03 dracut[7951]: *** Including module: systemd *** Nov 3 16:04:06 kjcf05n00 mcfcli[3673891]: %3|1730671446.630|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:04:07 kjcf05n03 dracut[7951]: *** Including module: fips *** Nov 3 16:04:08 kjcf05n03 dracut[7951]: *** Including module: systemd-initrd *** Nov 3 16:04:08 kjcf05n03 dracut[7951]: *** Including module: watchdog-modules *** Nov 3 16:04:08 kjcf05n03 dracut[7951]: *** Including module: nss-softokn *** Nov 3 16:04:08 kjcf05n03 dracut[7951]: *** Including module: i18n *** Nov 3 16:04:08 kjcf05n03 dracut[7951]: No KEYMAP configured. Nov 3 16:04:08 kjcf05n03 dracut[7951]: *** Including module: network-legacy *** Nov 3 16:04:08 kjcf05n03 dracut[7951]: *** Including module: network *** Nov 3 16:04:08 kjcf05n03 dracut[7951]: *** Including module: ib_bonding *** Nov 3 16:04:08 kjcf05n03 dracut[7951]: *** Including module: drm *** Nov 3 16:04:10 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 16:04:10 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 16:04:10 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 16:04:10 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running Nov 3 16:04:10 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 16:04:11 kjcf05n03 dcs-collectord[5622]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 16:04:11 kjcf05n03 dcs-collectord[5622]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 16:04:12 kjcf05n03 dracut[7951]: *** Including module: hperaid *** Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + install Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + local rule rule_path Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + inst_multiple cat expr Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.BdGrIB/initramfs -a -f cat expr Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + _ret=0 Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + (( 0 != 0 )) Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + : Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + return 0 Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + inst_multiple -o mdmon Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.BdGrIB/initramfs -a -f -o mdmon Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + _ret=0 Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + (( 0 != 0 )) Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + : Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + return 0 Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: ++ command -v partx Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + inst /usr/sbin/partx /sbin/partx Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + local _hostonly_install Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + [[ -e /tmp/dracut.BdGrIB/initramfs//sbin/partx ]] Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.BdGrIB/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + (( 0 != 0 )) Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + : Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: ++ command -v mdadm Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + local _hostonly_install Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + [[ -e /tmp/dracut.BdGrIB/initramfs//sbin/mdadm ]] Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.BdGrIB/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + (( 0 != 0 )) Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + : Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + [[ yes == \y\e\s ]] Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + local _raidconf Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: ++ cmdline Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: ++ local _activated dev line UUID Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: ++ declare -A _activated Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: ++ for dev in "${!host_fs_types[@]}" Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: ++ [[ nfs != *_raid_member ]] Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: ++ continue Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + _raidconf= Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + [[ -n '' ]] Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + inst_rules 64-md-raid.rules Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + local _target=/etc/udev/rules.d _rule _found Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + inst_dir /usr/lib/udev/rules.d Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + [[ -e /tmp/dracut.BdGrIB/initramfs//usr/lib/udev/rules.d ]] Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + return 0 Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + inst_dir /etc/udev/rules.d Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + [[ -e /tmp/dracut.BdGrIB/initramfs//etc/udev/rules.d ]] Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + return 0 Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + for _rule in "$@" Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + continue Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + continue Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + for r in '' $dracutbasedir/rules.d/ Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + [[ 64-md-raid.rules != /* ]] Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + continue Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + for r in '' $dracutbasedir/rules.d/ Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + continue Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + [[ -n '' ]] Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 16:04:12 kjcf05n03 kdumpctl[7822]: + set +x Nov 3 16:04:12 kjcf05n03 dracut[7951]: Skipping udev rule: 64-md-raid.rules Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + installkernel Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + instmods =drivers/md Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + local _optional=-o Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + local _silent Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + local _ret Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + [[ '' = yes ]] Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + [[ =drivers/md = \-\c ]] Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + [[ =drivers/md = \-\s ]] Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + (( 1 == 0 )) Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.BdGrIB/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + _ret=0 Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + (( 0 != 0 )) Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + [[ -n '' ]] Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + return 0 Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + _ret=0 Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + unset check depends cmdline install installkernel Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + return 0 Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + modules_loaded+='hperaid ' Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + '[' -n '' ']' Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + _d_mod=90kernel-modules Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + _d_mod=kernel-modules Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + [[ '' = yes ]] Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + dinfo '*** Including module: kernel-modules ***' Nov 3 16:04:13 kjcf05n03 kdumpctl[7822]: + set +x Nov 3 16:04:13 kjcf05n03 dracut[7951]: *** Including module: kernel-modules *** Nov 3 16:04:13 kjcf05n03 dracut[7951]: *** Including module: kernel-modules-extra *** Nov 3 16:04:13 kjcf05n03 dracut[7951]: *** Including module: kernel-network-modules *** Nov 3 16:04:13 kjcf05n03 dracut[7951]: *** Including module: diskless-mod *** Nov 3 16:04:13 kjcf05n03 dracut[7951]: *** Including module: fstab-sys *** Nov 3 16:04:13 kjcf05n03 dracut[7951]: *** Including module: nfs *** Nov 3 16:04:14 kjcf05n03 dracut[7951]: *** Including module: rootfs-block *** Nov 3 16:04:14 kjcf05n03 dracut[7951]: *** Including module: terminfo *** Nov 3 16:04:14 kjcf05n03 dracut[7951]: *** Including module: udev-rules *** Nov 3 16:04:14 kjcf05n03 dracut[7951]: Skipping udev rule: 91-permissions.rules Nov 3 16:04:14 kjcf05n03 dracut[7951]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 16:04:14 kjcf05n03 dracut[7951]: *** Including module: dracut-systemd *** Nov 3 16:04:15 kjcf05n03 dracut[7951]: *** Including module: usrmount *** Nov 3 16:04:15 kjcf05n03 dracut[7951]: *** Including module: base *** Nov 3 16:04:15 kjcf05n03 dracut[7951]: *** Including module: fs-lib *** Nov 3 16:04:15 kjcf05n03 dracut[7951]: *** Including module: kdumpbase *** Nov 3 16:04:16 kjcf05n03 dracut[7951]: *** Including module: memstrack *** Nov 3 16:04:16 kjcf05n03 dracut[7951]: *** Including module: shutdown *** Nov 3 16:04:16 kjcf05n03 dracut[7951]: *** Including module: squash *** Nov 3 16:04:16 kjcf05n00 mcfcli[3673891]: %3|1730671456.343|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 16:04:16 kjcf05n03 dracut[7951]: *** Including modules done *** Nov 3 16:04:16 kjcf05n03 dracut[7951]: *** Installing kernel module dependencies *** Nov 3 16:04:16 kjcf05n03 dracut[7951]: *** Installing kernel module dependencies done *** Nov 3 16:04:17 kjcf05n03 dracut[7951]: *** Resolving executable dependencies *** Nov 3 16:04:18 kjcf05n03 dracut[7951]: *** Resolving executable dependencies done*** Nov 3 16:04:18 kjcf05n03 dracut[7951]: *** Hardlinking files *** Nov 3 16:04:18 kjcf05n03 dracut[7951]: *** Hardlinking files done *** Nov 3 16:04:18 kjcf05n03 dracut[7951]: *** Generating early-microcode cpio image *** Nov 3 16:04:18 kjcf05n03 dracut[7951]: *** Constructing AuthenticAMD.bin **** Nov 3 16:04:18 kjcf05n03 dracut[7951]: *** Store current command line parameters *** Nov 3 16:04:18 kjcf05n03 dracut[7951]: Stored kernel commandline: Nov 3 16:04:18 kjcf05n03 dracut[7951]: rd.driver.pre=sd_mod Nov 3 16:04:18 kjcf05n03 dracut[7951]: rd.driver.pre=nvme Nov 3 16:04:18 kjcf05n03 dracut[7951]: rd.driver.pre=ipmi_si Nov 3 16:04:18 kjcf05n03 dracut[7951]: rd.driver.pre=ipmi_devintf Nov 3 16:04:18 kjcf05n03 dracut[7951]: rd.driver.pre=ipmi_msghandler Nov 3 16:04:18 kjcf05n03 dracut[7951]: nameserver=172.16.2.2 Nov 3 16:04:18 kjcf05n03 dracut[7951]: nameserver=127.0.0.1 Nov 3 16:04:18 kjcf05n03 dracut[7951]: nameserver=172.16.2.2 Nov 3 16:04:18 kjcf05n03 dracut[7951]: nameserver=127.0.0.1 Nov 3 16:04:18 kjcf05n03 dracut[7951]: ifname=kdump-meth0:00:09:3d:06:9a:1a team=mgmt0:kdump-meth0 Nov 3 16:04:18 kjcf05n03 dracut[7951]: rd.neednet Nov 3 16:04:18 kjcf05n03 dracut[7951]: kdumpnic=mgmt0 Nov 3 16:04:18 kjcf05n03 dracut[7951]: bootdev=mgmt0 Nov 3 16:04:18 kjcf05n03 dracut[7951]: *** Install squash loader *** Nov 3 16:04:18 kjcf05n03 dracut[7951]: *** Squashing the files inside the initramfs *** Nov 3 16:04:18 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 16:04:18 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 16:04:18 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 16:04:18 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running Nov 3 16:04:18 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 16:04:19 kjcf05n03 dracut[7951]: *** Squashing the files inside the initramfs done *** Nov 3 16:04:19 kjcf05n03 dracut[7951]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 16:04:19 kjcf05n03 dracut[7951]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 16:04:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730671459', 'host':'kjcf05n03', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 16:04:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730671459'} Nov 3 16:04:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:04:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730671459', 'host':'kjcf05n03', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 2.43, 2.11, 0.92'}"] Nov 3 16:04:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Load', 'description': 'OK - load average: 2.43, 2.11, 0.92', 'message': 'OK - load average: 2.43, 2.11, 0.92', 'value': 'ok', 'timestamp': '1730671459'} Nov 3 16:04:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:04:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730671459', 'host':'kjcf05n03', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 330 processes with STATE = RSZDT '}"] Nov 3 16:04:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Total Processes', 'description': 'PROCS OK: 330 processes with STATE = RSZDT ', 'message': 'PROCS OK: 330 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730671459'} Nov 3 16:04:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:04:20 kjcf05n03 kdumpctl[7822]: kdump: kexec: loaded kdump kernel Nov 3 16:04:20 kjcf05n03 kdumpctl[7822]: kdump: Starting kdump: [OK] Nov 3 16:04:20 kjcf05n03 systemd[1]: Started Crash recovery kernel arming. Nov 3 16:04:20 kjcf05n03 systemd[1]: Reloading. Nov 3 16:04:20 kjcf05n03 systemd[3145]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:04:20 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:04:20 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:04:20 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 16:04:20 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 16:04:20 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 16:04:20 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 16:04:20 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 16:04:20 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 16:04:20 kjcf05n03 ifdown[14721]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 16:04:20 kjcf05n03 ifdown[14722]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:04:20 kjcf05n03 ifdown[14723]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:04:21 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 16:04:21 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 16:04:21 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 16:04:21 kjcf05n03 ifup[14783]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 16:04:21 kjcf05n03 ifup[14784]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:04:21 kjcf05n03 ifup[14785]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:04:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730671462', 'host':'kjcf05n03', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 16:04:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730671462'} Nov 3 16:04:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:04:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730671462', 'host':'kjcf05n03', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(0.0B/120.0B), ib1=(0.0B/0.0B), icl0=(4.8kB/6.4kB), lo=(500.0B/500.0B), meth0=(1541.0MB/7.7MB), mgmt0=(1477.8MB/7.7MB)'}"] Nov 3 16:04:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(0.0B/120.0B), ib1=(0.0B/0.0B), icl0=(4.8kB/6.4kB), lo=(500.0B/500.0B), meth0=(1541.0MB/7.7MB), mgmt0=(1477.8MB/7.7MB)', 'message': 'NET OK - (Rx/Tx) ib0=(0.0B/120.0B), ib1=(0.0B/0.0B), icl0=(4.8kB/6.4kB), lo=(500.0B/500.0B), meth0=(1541.0MB/7.7MB), mgmt0=(1477.8MB/7.7MB)', 'value': 'ok', 'timestamp': '1730671462'} Nov 3 16:04:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:04:23 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 16:04:23 kjcf05n00 zabbix-server[1387674]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:04:23 kjcf05n00 zabbix-server[1387674]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 142.03\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 94.23\\"}}"' Nov 3 16:04:23 kjcf05n00 log_interesting_event.py[1387674]: Event '46387' acknowledged Nov 3 16:04:25 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 16:04:25 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 16:04:25 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 16:04:25 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:04:25 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:04:25 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:04:25 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:04:25 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 16:04:25 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 16:04:25 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 16:04:25 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 16:04:25 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:04:25 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:04:25 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:04:25 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:04:25 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 16:04:25 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 16:04:25 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 16:04:25 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 16:04:25 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 16:04:25 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 16:04:25 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 16:04:25 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 16:04:25 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 16:04:25 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 16:04:25 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 16:04:25 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 16:04:25 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 16:04:25 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 16:04:25 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 16:04:25 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 16:04:25 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 16:04:25 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 16:04:25 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 16:04:25 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 16:04:25 kjcf05n03 ifdown[14980]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 16:04:25 kjcf05n03 ifdown[14981]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:04:25 kjcf05n03 ifdown[14982]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:04:25 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 16:04:25 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 16:04:25 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 16:04:26 kjcf05n03 ifup[15044]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 16:04:26 kjcf05n03 ifup[15045]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:04:26 kjcf05n03 ifup[15046]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:04:26 kjcf05n03 dcs-collectord[5622]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 16:04:26 kjcf05n03 dcs-collectord[5622]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 16:04:28 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 16:04:29 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 16:04:29 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 16:04:29 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 16:04:29 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running Nov 3 16:04:29 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 16:04:30 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 16:04:30 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 16:04:30 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 16:04:30 kjcf05n03 systemd[1]: Reloading. Nov 3 16:04:30 kjcf05n03 systemd[1]: Starting Corosync Cluster Engine... Nov 3 16:04:30 kjcf05n03 await_ha_peer[15322]: Waiting for HA peer kjcf05n02 Nov 3 16:04:31 kjcf05n02 LCNmon[17954]: 10.16.100.59 is unreachable via ib0 Nov 3 16:04:32 kjcf05n03 await_ha_peer[15322]: Peer kjcf05n02 has started, starting HA Nov 3 16:04:32 kjcf05n03 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 16:04:32 kjcf05n03 systemd[1]: Started Corosync Cluster Engine. Nov 3 16:04:32 kjcf05n03 systemd[1]: Started Fast STONITH daemon. Nov 3 16:04:32 kjcf05n03 fstonithd.py[15375]: Listening for kdump packets from partner Nov 3 16:04:32 kjcf05n03 systemd[1]: Reloading. Nov 3 16:04:32 kjcf05n03 systemd[3145]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:04:32 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:04:32 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:04:33 kjcf05n03 systemd[1]: Reloading. Nov 3 16:04:33 kjcf05n03 systemd[1]: Reached target resource-agents dependencies. Nov 3 16:04:33 kjcf05n03 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 16:04:33 kjcf05n03 systemd[1]: Reloading. Nov 3 16:04:33 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 16:04:33 kjcf05n03 puppet-agent[3576]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:04:33 kjcf05n03 puppet[3576]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:04:33 kjcf05n03 puppet-agent[3576]: Applied catalog in 93.44 seconds Nov 3 16:04:33 kjcf05n03 puppet[3576]: Notice: Applied catalog in 93.44 seconds Nov 3 16:04:33 kjcf05n03 systemd[1]: Started Puppet agent. Nov 3 16:04:33 kjcf05n03 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 16:04:33 kjcf05n03 systemd[1]: Starting Set absolute GEM time... Nov 3 16:04:33 kjcf05n03 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 16:04:33 kjcf05n03 check_diskmonit[15517]: DISKMONITOR CHECK: ERROR: Failed to run dm_report. Exit code: 1. Error output: b'Error: diskmonitor not running\n' Nov 3 16:04:33 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 16:04:33 kjcf05n03 systemd[1]: Reached target Timers. Nov 3 16:04:33 kjcf05n03 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 16:04:33 kjcf05n03 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 16:04:33 kjcf05n03 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 16:04:33 kjcf05n03 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 16:04:33 kjcf05n03 wce-disable.sh[15522]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 16:04:33 kjcf05n03 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 16:04:33 kjcf05n03 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 16:04:33 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 16:04:33 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 16:04:33 kjcf05n03 systemd[1]: set_gem_time.service: Succeeded. Nov 3 16:04:33 kjcf05n03 systemd[1]: Started Set absolute GEM time. Nov 3 16:04:34 kjcf05n03 gateway-ec-node.py[15529]: Starting gateway-ec-node service Nov 3 16:04:34 kjcf05n03 python3.9[15526]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 16:04:34 kjcf05n03 python3.9[15526]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 16:04:34 kjcf05n03 RFSF-API[15525]: INFO[2024-11-03T16:04:34-06:00] Datapath API RESTful Service starting Nov 3 16:04:34 kjcf05n03 dp-api-server-node[15525]: INFO[2024-11-03T16:04:34-06:00] Datapath API RESTful Service starting Nov 3 16:04:34 kjcf05n03 RFSF-API[15525]: INFO[2024-11-03T16:04:34-06:00] Running in production mode, starting dbus event listener Nov 3 16:04:34 kjcf05n03 dp-api-server-node[15525]: INFO[2024-11-03T16:04:34-06:00] Running in production mode, starting dbus event listener Nov 3 16:04:34 kjcf05n03 RFSF-API[15525]: INFO[2024-11-03T16:04:34-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 16:04:34 kjcf05n03 dp-api-server-node[15525]: INFO[2024-11-03T16:04:34-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 16:04:34 kjcf05n03 RFSF-API[15525]: INFO[2024-11-03T16:04:34-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 16:04:34 kjcf05n03 dp-api-server-node[15525]: INFO[2024-11-03T16:04:34-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 16:04:34 kjcf05n03 RFSF-API[15525]: INFO[2024-11-03T16:04:34-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 16:04:34 kjcf05n03 dp-api-server-node[15525]: INFO[2024-11-03T16:04:34-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 16:04:34 kjcf05n03 RFSF-API[15525]: INFO[2024-11-03T16:04:34-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 16:04:34 kjcf05n03 dp-api-server-node[15525]: INFO[2024-11-03T16:04:34-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 16:04:34 kjcf05n03 RFSF-API[15525]: INFO[2024-11-03T16:04:34-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 16:04:34 kjcf05n03 dp-api-server-node[15525]: INFO[2024-11-03T16:04:34-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 16:04:34 kjcf05n03 RFSF-API[15525]: INFO[2024-11-03T16:04:34-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 16:04:34 kjcf05n03 dp-api-server-node[15525]: INFO[2024-11-03T16:04:34-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 16:04:34 kjcf05n03 RFSF-API[15525]: INFO[2024-11-03T16:04:34-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 16:04:34 kjcf05n03 RFSF-API[15525]: INFO[2024-11-03T16:04:34-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 16:04:34 kjcf05n03 dp-api-server-node[15525]: INFO[2024-11-03T16:04:34-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 16:04:34 kjcf05n03 dp-api-server-node[15525]: INFO[2024-11-03T16:04:34-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 16:04:34 kjcf05n03 dp-api-server-node[15525]: INFO[2024-11-03T16:04:34-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 16:04:34 kjcf05n03 dp-api-server-node[15525]: INFO[2024-11-03T16:04:34-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 16:04:34 kjcf05n03 RFSF-API[15525]: INFO[2024-11-03T16:04:34-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 16:04:34 kjcf05n03 RFSF-API[15525]: INFO[2024-11-03T16:04:34-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 16:04:40 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 15851 (bash) Nov 3 16:04:40 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 16:04:40 kjcf05n03 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 16:04:40 kjcf05n03 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 16:04:40 kjcf05n03 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 16:04:40 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 16:04:40 kjcf05n03 systemd[1]: Reloading. Nov 3 16:04:40 kjcf05n03 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 16:04:40 kjcf05n03 systemd[1]: Reloading. Nov 3 16:04:41 kjcf05n03 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 16:04:41 kjcf05n03 dcs-collectord[5622]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 16:04:41 kjcf05n03 dcs-collectord[5622]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 16:04:41 kjcf05n03 dcs-collectord[5622]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 16:04:41 kjcf05n03 diskmonitor_pre[16055]: Key management is currently disabled.DEAR disabled Nov 3 16:04:41 kjcf05n03 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 16:04:43 kjcf05n03 sh[16134]: LNET configured: New Created Nov 3 16:04:43 kjcf05n03 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 16:04:43 kjcf05n03 LCNmon[18219]: Interface ib0 is up Nov 3 16:04:43 kjcf05n03 LCNmon[18219]: Interface ib1 is up Nov 3 16:04:43 kjcf05n03 LCNmon[18219]: Can ping through interface ib0 Nov 3 16:04:43 kjcf05n03 LCNmon[18219]: Can ping through interface ib1 Nov 3 16:04:43 kjcf05n03 LCNmon[18219]: NIC ib0, initial state UP Nov 3 16:04:43 kjcf05n03 LCNmon[18219]: NIC ib1, initial state UP Nov 3 16:04:43 kjcf05n03 LCNmon[18219]: LCNstat initial state UP Nov 3 16:04:43 kjcf05n03 LCNmon[18219]: LCNmon monitoring hosts kjcf05n03 and kjcf05n02 Nov 3 16:04:43 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n03": interface became available Nov 3 16:04:44 kjcf05n00 zabbix-server[1388230]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:04:44 kjcf05n00 zabbix-server[1388230]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 115.97\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 99.78\\"}}"' Nov 3 16:04:44 kjcf05n00 log_interesting_event.py[1388230]: Event '46388' acknowledged Nov 3 16:04:45 kjcf05n00 mcfcli[3673891]: %3|1730671485.427|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: /var/run/diskmonitor does not exist, creating Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: Creating /var/run/diskmonitor/disk Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: Creating /var/run/diskmonitor/encl Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: Creating /var/run/diskmonitor/cli Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: RAS_Interlocks_enabled: 1 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: add handler for sig: 14 sa_flags: 10000004 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: add handler for sig: 1 sa_flags: 10000004 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: add handler for sig: 2 sa_flags: 00000004 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: add handler for sig: 15 sa_flags: 00000004 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: add handler for sig: 6 sa_flags: 00000004 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: add handler for sig: 3 sa_flags: 00000004 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: add handler for sig: 30 sa_flags: 00000004 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: add handler for sig: 20 sa_flags: 00000004 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: add handler for sig: 10 sa_flags: 10000004 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: add handler for sig: 11 sa_flags: 00000004 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: add handler for sig: 7 sa_flags: 00000004 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: add handler for sig: 4 sa_flags: 00000004 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: add handler for sig: 8 sa_flags: 00000004 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: Using HA Baton locks - key: diskmonitor Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: Baton will be held for at most 570 seconds Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: DMMP Enabled: 0 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: random seed: 97d4598f Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: NVMe Enclosure: 1 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: ZFS Enclosure: 0 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: Dbus, Initialized Connection Successfully Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: int_catcher_thread: thread start Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: Received dbus message 4 org.freedesktop.DBus -> :1.120 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b07bec_S4EUNF0MA05386M encl_slot: 0 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b07bed_S4EUNF0MA05387D encl_slot: 0 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 16:04:45 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 16:04:45 kjcf05n03 openhpid[5528]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 16:04:45 kjcf05n03 openhpid[5528]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 16:04:46 kjcf05n03 systemd[1]: openhpid.service: Succeeded. Nov 3 16:04:46 kjcf05n03 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 16:04:46 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 16:04:46 kjcf05n03 systemd[1]: openhpid.service: Supervising process 18540 which is not our child. We'll most likely not notice when it exits. Nov 3 16:04:46 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 16:04:46 kjcf05n03 systemd[1]: Reached target Multi-User System. Nov 3 16:04:46 kjcf05n03 systemd[1]: Reached target Graphical Interface. Nov 3 16:04:46 kjcf05n03 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 16:04:46 kjcf05n03 dcs-collectord[5622]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 16:04:46 kjcf05n03 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 16:04:46 kjcf05n03 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 16:04:46 kjcf05n03 systemd[1]: Startup finished in 50.168s (kernel) + 2min 28.977s (userspace) = 3min 19.146s. Nov 3 16:04:46 kjcf05n03 openhpid[18540]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 16:04:46 kjcf05n03 openhpid[18540]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 16:04:46 kjcf05n03 openhpid[18540]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 16:04:46 kjcf05n03 openhpid[18540]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 16:04:46 kjcf05n00 mcfcli[3673891]: %3|1730671486.343|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 16:04:47 kjcf05n00 zabbix-server[1388239]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:04:47 kjcf05n00 zabbix-server[1388239]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n03 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n03:system.uptime): 00:03:18\\"}}"' Nov 3 16:04:47 kjcf05n00 log_interesting_event.py[1388239]: Event '46389' acknowledged Nov 3 16:04:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730671488', 'host':'kjcf05n03', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.7% (4414816 kB) used.'}"] Nov 3 16:04:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'RAM usage', 'description': 'OK - 1.7% (4414816 kB) used.', 'message': 'OK - 1.7% (4414816 kB) used.', 'value': 'ok', 'timestamp': '1730671488'} Nov 3 16:04:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 16:04:51 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 16:04:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730671493', 'host':'kjcf05n03', 'service_name':'Arrays and Disk Status', 'value':'UNKNOWN', 'message':'Diskmonitor not running'}"] Nov 3 16:04:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Arrays and Disk Status', 'description': 'Diskmonitor not running', 'message': 'Diskmonitor not running', 'value': 'unknown', 'timestamp': '1730671493'} Nov 3 16:04:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:04:56 kjcf05n03 dcs-collectord[5622]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 16:04:56 kjcf05n03 dcs-collectord[5622]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 16:04:59 kjcf05n00 httpd[902571]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-B): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n03', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 16:05:00 kjcf05n03 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 16:05:11 kjcf05n03 dcs-collectord[5622]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 16:05:11 kjcf05n03 dcs-collectord[5622]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 16:05:13 kjcf05n00 python3.9[1388327]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 16:05:14 kjcf05n02 nslcd[7269]: [e8944a] ldap_result() failed: Can't contact LDAP server Nov 3 16:05:16 kjcf05n00 mcfcli[3673891]: %3|1730671516.343|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:05:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730671516', 'host':'kjcf05n03', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 16:05:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730671516'} Nov 3 16:05:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:05:22 kjcf05n00 mcfcli[3673891]: %3|1730671522.133|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b07bed_S4EUNF0MA05387D encl_sn: USE26000024VS001, slot: 2 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b07bec_S4EUNF0MA05386M encl_sn: USE26000024VS001, slot: 1 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 16:05:24 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 16:05:26 kjcf05n03 dcs-collectord[5622]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 16:05:26 kjcf05n03 dcs-collectord[5622]: WARNING No data collected (hpi_parser.py:353) Nov 3 16:05:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730671237', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 16:05:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730671237'} Nov 3 16:05:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:05:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730671237', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 16:05:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730671237'} Nov 3 16:05:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:05:29 kjcf05n03 ipmievd[3963]: System Event sensor - Timestamp Clock Sync Nov 3 16:05:32 kjcf05n02 firmware-update-orc-server[5885]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "08a00e65-5753-4f8b-a416-b782430702c7"} (logger.py:65) Nov 3 16:05:32 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 87662 (get_disk_device) Nov 3 16:05:32 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 16:05:32 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 16:05:32 kjcf05n03 ipmievd[3145]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:05:32 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db0102400253845000000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 16:05:32 kjcf05n03 ras-resource-manager-agent[5886]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "be6d9d4e-9a2f-11ef-96f1-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 16:05:32 kjcf05n03 ras-resource-manager-agent[5886]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'be6d9d4e-9a2f-11ef-96f1-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 16:05:32 kjcf05n03 ras-resource-manager-agent[5886]: INFO Submitting new device inserted signal, starting to qualify drive: be6d9d4e-9a2f-11ef-96f1-00093d069a1b (admin_action.py:110) Nov 3 16:05:32 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'be6d9d4e-9a2f-11ef-96f1-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 16:05:32 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'be6d9d4e-9a2f-11ef-96f1-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 16:05:32 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': 'be6d9d4e-9a2f-11ef-96f1-00093d069a1b', 'response ID': 'be78a644-9a2f-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 16:05:32 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: be78a644-9a2f-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 16:05:32 kjcf05n02 ccp-client[87683]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 16:05:32 kjcf05n02 ccp-client[87683]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 16:05:32 kjcf05n02 ccp-client[87692]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 16:05:32 kjcf05n02 ccp-client[87683]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 16:05:32 kjcf05n02 ccp-client[87683]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 16:05:32 kjcf05n02 ccp-client[87692]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 16:05:32 kjcf05n02 ccp-client[87692]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 16:05:32 kjcf05n03 diskmonitor[17811]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 16:05:32 kjcf05n03 ras-resource-manager-agent[5886]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "bebf7d80-9a2f-11ef-96f1-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 16:05:32 kjcf05n03 ras-resource-manager-agent[5886]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'bebf7d80-9a2f-11ef-96f1-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 16:05:32 kjcf05n03 ras-resource-manager-agent[5886]: INFO Submitting new device inserted signal, starting to qualify drive: bebf7d80-9a2f-11ef-96f1-00093d069a1b (admin_action.py:110) Nov 3 16:05:32 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'bebf7d80-9a2f-11ef-96f1-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 16:05:32 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'bebf7d80-9a2f-11ef-96f1-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 16:05:32 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': 'bebf7d80-9a2f-11ef-96f1-00093d069a1b', 'response ID': 'bec7253a-9a2f-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 16:05:32 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: bec7253a-9a2f-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 16:05:33 kjcf05n03 firmware-update-orc-server[5845]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "29790a20-d17b-44f5-bed5-b85647ad2267"} (logger.py:65) Nov 3 16:05:36 kjcf05n02 DRVFW[87804]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 16:05:36 kjcf05n02 ccp-client[87805]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 16:05:36 kjcf05n02 ccp-client[87805]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 16:05:36 kjcf05n02 ccp-client[87814]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 16:05:36 kjcf05n02 ccp-client[87805]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 16:05:36 kjcf05n02 ccp-client[87805]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 16:05:36 kjcf05n02 ccp-client[87814]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 16:05:36 kjcf05n02 ccp-client[87814]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 16:05:36 kjcf05n02 firmware-update-orc-server[5885]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 16:05:37 kjcf05n03 ras-resource-manager-agent[5886]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'be6d9d4e-9a2f-11ef-96f1-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 16:05:37 kjcf05n03 ras-resource-manager-agent[5886]: INFO Drive qualification complete responding: be6d9d4e-9a2f-11ef-96f1-00093d069a1b (admin_action.py:205) Nov 3 16:05:37 kjcf05n03 ras-resource-manager-agent[5886]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "be6d9d4e-9a2f-11ef-96f1-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} (interesting_event.py:59) Nov 3 16:05:37 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: be78a644-9a2f-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 16:05:37 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': 'be6d9d4e-9a2f-11ef-96f1-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'be6d9d4e-9a2f-11ef-96f1-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}}} (logger.py:65) Nov 3 16:05:38 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31442 deleted. Nov 3 16:05:39 kjcf05n03 diskmonitor[17811]: 04 Nov 3 16:05:39 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 16:05:39 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 16:05:39 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 16:05:39 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 16:05:39 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 16:05:39 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 16:05:39 kjcf05n03 diskmonitor[17811]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 16:05:39 kjcf05n03 diskmonitor[17811]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 16:05:39 kjcf05n03 diskmonitor[17811]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 16:05:39 kjcf05n03 diskmonitor[17811]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 16:05:39 kjcf05n03 diskmonitor[17811]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 16:05:39 kjcf05n03 diskmonitor[17811]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "be6d9d4e-9a2f-11ef-96f1-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 16:05:39 kjcf05n03 diskmonitor[17811]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 16:05:39 kjcf05n03 diskmonitor[17811]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 16:05:39 kjcf05n03 diskmonitor[17811]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "bebf7d80-9a2f-11ef-96f1-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 16:05:39 kjcf05n03 diskmonitor[17811]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 16:05:39 kjcf05n03 diskmonitor[17811]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 16:05:41 kjcf05n03 dcs-collectord[5622]: INFO Successfully collected data dmreport after 8 failures (dm_report_collection_process.py:204) Nov 3 16:05:42 kjcf05n03 systemd[1]: Unmounting /mnt/llog... Nov 3 16:05:42 kjcf05n03 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 16:05:42 kjcf05n03 systemd[1]: Unmounted /mnt/llog. Nov 3 16:05:42 kjcf05n03 chronyd[5130]: Selected source 172.16.2.1 Nov 3 16:05:44 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22566 (get_disk_device) Nov 3 16:05:44 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 16:05:44 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 16:05:44 kjcf05n03 ccp-client[22588]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 16:05:44 kjcf05n03 ccp-client[22588]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 16:05:44 kjcf05n03 ccp-client[22607]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 16:05:44 kjcf05n03 ccp-client[22588]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 16:05:44 kjcf05n03 ccp-client[22588]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 16:05:44 kjcf05n03 ccp-client[22607]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 16:05:44 kjcf05n03 ccp-client[22607]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 16:05:46 kjcf05n00 mcfcli[3673891]: %3|1730671546.344|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 16:05:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Inactive', 'timestamp': 1730671546}"] Nov 3 16:05:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730671546, 'value': 'Inactive', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:05:47 kjcf05n03 DRVFW[22833]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 16:05:47 kjcf05n03 ccp-client[22855]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 16:05:47 kjcf05n03 ccp-client[22855]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 16:05:47 kjcf05n03 ccp-client[22924]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 16:05:47 kjcf05n03 ccp-client[22855]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 16:05:47 kjcf05n03 ccp-client[22855]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 16:05:47 kjcf05n03 ccp-client[22924]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 16:05:47 kjcf05n03 ccp-client[22924]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 16:05:47 kjcf05n03 firmware-update-orc-server[5845]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 16:05:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:05:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:05:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:05:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:05:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:05:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:05:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:05:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:05:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:05:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:05:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:05:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:05:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:05:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.359158ms Nov 3 16:05:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:05:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.359158ms Nov 3 16:05:47 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:05:47 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:05:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Inactive', 'timestamp': 1730671547}"] Nov 3 16:05:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730671547, 'value': 'Inactive', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:05:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:05:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:05:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:05:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:05:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:05:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:05:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:05:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:05:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:05:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:05:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:05:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:05:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:05:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.164043ms Nov 3 16:05:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:05:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.164043ms Nov 3 16:05:47 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:05:47 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:05:48 kjcf05n03 ras-resource-manager-agent[5886]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'bebf7d80-9a2f-11ef-96f1-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 3 16:05:48 kjcf05n03 ras-resource-manager-agent[5886]: INFO Drive qualification complete responding: bebf7d80-9a2f-11ef-96f1-00093d069a1b (admin_action.py:205) Nov 3 16:05:48 kjcf05n03 ras-resource-manager-agent[5886]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "bebf7d80-9a2f-11ef-96f1-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (interesting_event.py:59) Nov 3 16:05:48 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: bec7253a-9a2f-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 16:05:48 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': 'bebf7d80-9a2f-11ef-96f1-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'bebf7d80-9a2f-11ef-96f1-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}}} (logger.py:65) Nov 3 16:05:49 kjcf05n03 python3.9[5191]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 16:05:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730671550}"] Nov 3 16:05:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730671550, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:05:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:05:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730671550}"] Nov 3 16:05:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730671550, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:05:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:05:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730671551}"] Nov 3 16:05:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730671551, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:05:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:05:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730671551}"] Nov 3 16:05:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730671551, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:05:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:05:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730671551}"] Nov 3 16:05:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730671551, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:05:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:05:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730671551}"] Nov 3 16:05:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730671551, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:05:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730671551}"] Nov 3 16:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730671551, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:05:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730671551}"] Nov 3 16:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730671551, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:05:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:05:52 kjcf05n03 python3.9[3145]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:05:52 kjcf05n03 ras-resource-manager-agent[5886]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "be6d9d4e-9a2f-11ef-96f1-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} (service_main_handler.py:66) Nov 3 16:05:52 kjcf05n03 ras-resource-manager-agent[5886]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'be6d9d4e-9a2f-11ef-96f1-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 16:05:52 kjcf05n03 ras-resource-manager-agent[5886]: INFO Device qualification response has been acknowledged: be6d9d4e-9a2f-11ef-96f1-00093d069a1b (admin_action.py:151) Nov 3 16:05:52 kjcf05n03 ras-resource-manager-agent[5886]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "bebf7d80-9a2f-11ef-96f1-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (service_main_handler.py:66) Nov 3 16:05:52 kjcf05n03 ras-resource-manager-agent[5886]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'bebf7d80-9a2f-11ef-96f1-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 3 16:05:52 kjcf05n03 ras-resource-manager-agent[5886]: INFO Device qualification response has been acknowledged: bebf7d80-9a2f-11ef-96f1-00093d069a1b (admin_action.py:151) Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "be6d9d4e-9a2f-11ef-96f1-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: Dbus, handle_ingress_ras_signals, uuid: be6d9d4e-9a2f-11ef-96f1-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "be6d9d4e-9a2f-11ef-96f1-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "bebf7d80-9a2f-11ef-96f1-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: Dbus, handle_ingress_ras_signals, uuid: bebf7d80-9a2f-11ef-96f1-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "bebf7d80-9a2f-11ef-96f1-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 16:05:54 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 16:05:56 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 16:05:57 kjcf05n03 diskmonitor[17811]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 16:06:01 kjcf05n03 diskmonitor[17811]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 16:06:01 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 16:06:01 kjcf05n03 diskmonitor[17811]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 16:06:01 kjcf05n03 diskmonitor[17811]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 16:06:01 kjcf05n03 diskmonitor[17811]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 16:06:01 kjcf05n03 diskmonitor[17811]: leaving test state: 1 next state: 2 Nov 3 16:06:01 kjcf05n03 diskmonitor[17811]: lock req: no timeout Nov 3 16:06:01 kjcf05n03 diskmonitor[17811]: leaving test state: 2 next state: 4 Nov 3 16:06:01 kjcf05n03 diskmonitor[17811]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 16:06:01 kjcf05n00 mcfcli[3673891]: %3|1730671561.426|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:06:16 kjcf05n00 mcfcli[3673891]: %3|1730671576.344|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:06:41 kjcf05n00 mcfcli[3673891]: %3|1730671601.423|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:06:46 kjcf05n00 mcfcli[3673891]: %3|1730671606.344|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:06:53 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 16:06:54 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 16:06:54 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 16:07:04 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 16:07:04 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 16:07:04 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 16:07:13 kjcf05n03 diskmonitor[17811]: lock acquired Nov 3 16:07:13 kjcf05n03 diskmonitor[17811]: leaving test state: 4 next state: 8 Nov 3 16:07:16 kjcf05n00 mcfcli[3673891]: %3|1730671636.344|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:07:20 kjcf05n00 mcfcli[3673891]: %3|1730671640.418|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:07:29 kjcf05n03 diskmonitor[17811]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 16:07:29 kjcf05n03 diskmonitor[17811]: leaving test state: 8 next state: 20 Nov 3 16:07:29 kjcf05n03 diskmonitor[17811]: leaving test state: 20 next state: 40 Nov 3 16:07:29 kjcf05n03 diskmonitor[17811]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 70eb370000 Nov 3 16:07:29 kjcf05n03 diskmonitor[17811]: leaving test state: 40 next state: 80 Nov 3 16:07:41 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 16:07:46 kjcf05n00 mcfcli[3673891]: %3|1730671666.345|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:07:55 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 3 16:07:55 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 3 16:07:55 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 3 16:07:58 kjcf05n00 mcfcli[3673891]: %3|1730671678.638|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:08:10 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 3 16:08:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730671696}"] Nov 3 16:08:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730671696, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:08:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:08:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:08:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:08:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:08:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:08:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:08:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:08:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:08:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:08:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:08:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:08:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:08:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:08:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.37624ms Nov 3 16:08:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:08:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.37624ms Nov 3 16:08:16 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:08:16 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:08:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:08:16 kjcf05n00 mcfcli[3673891]: %3|1730671696.345|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 16:08:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730671696}"] Nov 3 16:08:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730671696, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:08:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:08:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:08:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:08:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:08:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:08:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:08:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:08:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:08:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:08:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:08:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:08:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:08:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:08:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.763683ms Nov 3 16:08:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:08:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.763683ms Nov 3 16:08:16 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:08:16 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:08:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:08:28 kjcf05n03 diskmonitor[17811]: leaving test state: 80 next state: 100 Nov 3 16:08:28 kjcf05n03 diskmonitor[17811]: lock release: time: Sun Nov 3 16:08:22 2024 Nov 3 16:08:28 kjcf05n03 diskmonitor[17811]: leaving test state: 100 next state: 1 Nov 3 16:08:37 kjcf05n00 mcfcli[3673891]: %3|1730671717.246|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:08:38 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 3 16:08:38 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 3 16:08:46 kjcf05n00 mcfcli[3673891]: %3|1730671726.712|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 16:08:53 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 3 16:09:15 kjcf05n00 mcfcli[3673891]: %3|1730671755.524|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:09:16 kjcf05n00 mcfcli[3673891]: %3|1730671756.713|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:09:20 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 3 16:09:20 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 3 16:09:38 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31443 deleted. Nov 3 16:09:46 kjcf05n00 mcfcli[3673891]: %3|1730671786.713|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:09:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730671790', 'host':'kjcf05n03', 'service_name':'Arrays and Disk Status', 'value':'OK', 'message':'No arrays found, T10PI: Not relevant on this system\\nTotal number of disk slots available: 24\\nTotal number of disks found: 24\\n\\nslot: 1, wwn: eui.345950304db010370025384500000004, cap: 3840755982336, dev: nvme14n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\nslot: 13, wwn: eui.345950304db010210025384500000004, cap: 3840755982336, dev: nvme13n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\n\\nMD RAID to Lustre mapping\\n\\n\\n\\n\\nDegraded Array information:\\n\\nAll arrays are in clean state on node kjcf05n03'}"] Nov 3 16:09:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Arrays and Disk Status', 'description': 'No arrays found, T10PI: Not relevant on this system\\nTotal number of disk slots available: 24\\nTotal number of disks found: 24\\n\\nslot: 1, wwn: eui.345950304db010370025384500000004, cap: 3840755982336, dev: nvme14n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\nslot: 13, wwn: eui.345950304db010210025384500000004, cap: 3840755982336, dev: nvme13n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\n\\nMD RAID to Lustre mapping\\n\\n\\n\\n\\nDegraded Array information:\\n\\nAll arrays are in clean state on node kjcf05n03', 'message': 'No arrays found, T10PI: Not relevant on this system\\nTotal number of disk slots available: 24\\nTotal number of disks found: 24\\n\\nslot: 1, wwn: eui.345950304db010370025384500000004, cap: 3840755982336, dev: nvme14n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\nslot: 13, wwn: eui.345950304db010210025384500000004, cap: 3840755982336, dev: nvme13n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\n\\nMD RAID to Lustre mapping\\n\\n\\n\\n\\nDegraded Array information:\\n\\nAll arrays are in clean state on node kjcf05n03', 'value': 'ok', 'timestamp': '1730671790'} Nov 3 16:09:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:09:53 kjcf05n00 mcfcli[3673891]: %3|1730671793.802|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 16:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 16:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 16:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 16:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 16:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 16:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 16:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 16:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 16:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 16:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 16:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 16:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 16:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 16:10:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 16:10:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:10:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 16:10:03 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 16:10:03 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 16:10:03 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 16:10:15 kjcf05n00 python3.9[1391485]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 16:10:16 kjcf05n00 mcfcli[3673891]: %3|1730671816.713|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:10:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730671237', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 16:10:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730671237'} Nov 3 16:10:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:10:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730671237', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 16:10:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730671237'} Nov 3 16:10:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:10:31 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 16:10:31 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 16:10:31 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 16:10:32 kjcf05n00 mcfcli[3673891]: %3|1730671832.957|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:10:46 kjcf05n00 mcfcli[3673891]: %3|1730671846.713|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:11:05 kjcf05n00 zabbix-server[1392261]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:11:05 kjcf05n00 zabbix-server[1392261]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n03' from event '46401' Nov 3 16:11:05 kjcf05n00 zabbix-server[1392261]: Host created 'enclosure_USE26000024VS001' Nov 3 16:11:05 kjcf05n00 zabbix-server[1392261]: Running puppet on 'kjcf05n03' Nov 3 16:11:07 kjcf05n03 puppet-agent[34968]: Using configured environment 'production' Nov 3 16:11:07 kjcf05n03 puppet-agent[34968]: Retrieving pluginfacts Nov 3 16:11:07 kjcf05n03 puppet-agent[34968]: Retrieving plugin Nov 3 16:11:07 kjcf05n03 puppet-agent[34968]: Loading facts Nov 3 16:11:10 kjcf05n03 puppet-agent[34968]: Caching catalog for kjcf05n03 Nov 3 16:11:10 kjcf05n03 puppet-agent[34968]: Applying configuration version '1730671868' Nov 3 16:11:11 kjcf05n00 mcfcli[3673891]: %3|1730671871.933|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:11:12 kjcf05n03 puppet-agent[34968]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 16:11:12 kjcf05n03 puppet-agent[34968]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 16:11:12 kjcf05n03 puppet-agent[34968]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 16:11:13 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 16:11:13 kjcf05n03 zabbix_agent2[5970]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 16:11:13 kjcf05n03 zabbix_agent2[3145]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:11:13 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 16:11:13 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 16:11:13 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 16:11:13 kjcf05n03 puppet-agent[34968]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: Press Ctrl+C to exit. Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: Plugin support version 1.0 Nov 3 16:11:13 kjcf05n03 zabbix_agent2[35321]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 16:11:15 kjcf05n03 puppet-agent[34968]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 16:11:15 kjcf05n03 puppet-agent[34968]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 16:11:15 kjcf05n03 puppet-agent[34968]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 16:11:15 kjcf05n03 puppet-agent[34968]: Applied catalog in 5.16 seconds Nov 3 16:11:15 kjcf05n00 zabbix-server[1392261]: puppet completed status:(0): '' Nov 3 16:11:15 kjcf05n00 zabbix-server[1392261]: Event '46401' acknowledged Nov 3 16:11:15 kjcf05n00 zabbix-server[1392261]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n03"}' Nov 3 16:11:16 kjcf05n00 mcfcli[3673891]: %3|1730671876.714|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 16:11:23 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 3 16:11:23 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 3 16:11:23 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 3 16:11:46 kjcf05n00 mcfcli[3673891]: %3|1730671906.714|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:11:51 kjcf05n00 mcfcli[3673891]: %3|1730671911.930|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:12:16 kjcf05n00 mcfcli[3673891]: %3|1730671936.715|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:12:31 kjcf05n00 mcfcli[3673891]: %3|1730671951.134|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:12:46 kjcf05n00 mcfcli[3673891]: %3|1730671966.715|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:13:10 kjcf05n00 mcfcli[3673891]: %3|1730671990.407|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:13:16 kjcf05n00 mcfcli[3673891]: %3|1730671996.715|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T16:13:27.253041574-06:00 level=info msg="Completed cleanup jobs" duration=26.432242ms Nov 3 16:13:46 kjcf05n00 mcfcli[3673891]: %3|1730672026.716|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 16:13:48 kjcf05n00 mcfcli[3673891]: %3|1730672028.383|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:14:16 kjcf05n00 mcfcli[3673891]: %3|1730672056.717|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 16:14:27 kjcf05n00 mcfcli[3673891]: %3|1730672067.264|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:14:46 kjcf05n00 mcfcli[3673891]: %3|1730672086.717|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 16:15:05 kjcf05n00 mcfcli[3673891]: %3|1730672105.400|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:15:13 kjcf05n00 python3.9[1394500]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 16:15:14 kjcf05n03 root[41605]: failback_xyraid Nov 3 16:15:16 kjcf05n03 root[41730]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 16:15:16 kjcf05n00 mcfcli[3673891]: %3|1730672116.717|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 16:15:17 kjcf05n03 root[41807]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 16:15:21 kjcf05n02 systemd[1]: data-kjcf05n03:md66.mount: Succeeded. Nov 3 16:15:23 kjcf05n02 dwd[5204]: Drive path is missing, purging: nvme16n1 Nov 3 16:15:24 kjcf05n02 dwd[5204]: Drive path is missing, purging: nvme15n1 Nov 3 16:15:24 kjcf05n02 dwd[5204]: Drive path is missing, purging: nvme6n1 Nov 3 16:15:24 kjcf05n02 dwd[5204]: Drive path is missing, purging: nvme10n1 Nov 3 16:15:24 kjcf05n02 dwd[5204]: Drive path is missing, purging: nvme11n1 Nov 3 16:15:24 kjcf05n02 dwd[5204]: Drive path is missing, purging: nvme7n1 Nov 3 16:15:24 kjcf05n02 dwd[5204]: Drive path is missing, purging: nvme22n1 Nov 3 16:15:24 kjcf05n02 dwd[5204]: Drive path is missing, purging: nvme12n1 Nov 3 16:15:24 kjcf05n02 dwd[5204]: Drive path is missing, purging: nvme5n1 Nov 3 16:15:24 kjcf05n02 dwd[5204]: Drive path is missing, purging: nvme21n1 Nov 3 16:15:24 kjcf05n02 dwd[5204]: Drive path is missing, purging: nvme20n1 Nov 3 16:15:26 kjcf05n03 dwd[5162]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 16:15:26 kjcf05n03 dwd[5162]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 16:15:26 kjcf05n03 dwd[5162]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 16:15:26 kjcf05n03 dwd[5162]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 16:15:26 kjcf05n03 dwd[5162]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 16:15:26 kjcf05n03 dwd[5162]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 16:15:26 kjcf05n03 dwd[5162]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 16:15:26 kjcf05n03 dwd[5162]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 16:15:26 kjcf05n03 dwd[5162]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 16:15:26 kjcf05n03 dwd[5162]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 16:15:26 kjcf05n03 dwd[5162]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 16:15:26 kjcf05n03 dwd[5162]: Starting NVME thread for nvme10n1 Nov 3 16:15:26 kjcf05n03 dwd[5162]: Starting NVME thread for nvme15n1 Nov 3 16:15:26 kjcf05n03 dwd[5162]: Starting NVME thread for nvme21n1 Nov 3 16:15:27 kjcf05n03 dwd[5162]: Starting NVME thread for nvme11n1 Nov 3 16:15:27 kjcf05n03 dwd[5162]: Starting NVME thread for nvme20n1 Nov 3 16:15:27 kjcf05n03 dwd[5162]: Starting NVME thread for nvme12n1 Nov 3 16:15:27 kjcf05n03 systemd-udevd[44563]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44564]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44566]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44568]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44563]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44564]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44566]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44568]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44563]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44564]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44566]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44568]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44563]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44564]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44566]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44568]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44563]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44564]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44566]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44568]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44563]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44564]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44566]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44568]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44564]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44563]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44566]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44568]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44564]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44563]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44566]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44568]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44604]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44605]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44607]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44604]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44605]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44607]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44605]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44607]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44607]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44605]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44605]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44605]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44605]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44605]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44605]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44605]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:15:27 kjcf05n03 systemd-udevd[44601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:15:28 kjcf05n03 dwd[5162]: Starting NVME thread for nvme7n1 Nov 3 16:15:28 kjcf05n03 nslcd[6919]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 16:15:28 kjcf05n03 dwd[5162]: Starting NVME thread for nvme6n1 Nov 3 16:15:28 kjcf05n03 dwd[5162]: Starting NVME thread for nvme5n1 Nov 3 16:15:28 kjcf05n03 dwd[5162]: Starting NVME thread for nvme16n1 Nov 3 16:15:28 kjcf05n03 dwd[5162]: Starting NVME thread for nvme22n1 Nov 3 16:15:30 kjcf05n03 dcs-bulk-data-sender[6156]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 139}' Nov 3 16:15:36 kjcf05n03 diskmonitor[17811]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 16:15:42 kjcf05n03 diskmonitor[17811]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 16:15:42 kjcf05n03 diskmonitor[17811]: Scan for ReadErrorMax change for md66 Nov 3 16:15:42 kjcf05n03 diskmonitor[17811]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 16:15:42 kjcf05n03 diskmonitor[17811]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 16:15:42 kjcf05n03 diskmonitor[17811]: read_saved_file: md66 no saved speed Nov 3 16:15:42 kjcf05n03 diskmonitor[17811]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 16:15:42 kjcf05n03 diskmonitor[17811]: Set sync_speed_min (10000) for md66 Nov 3 16:15:42 kjcf05n03 diskmonitor[17811]: Set sync_speed_max (200000) for md66 Nov 3 16:15:42 kjcf05n03 diskmonitor[17811]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 16:15:45 kjcf05n00 mcfcli[3673891]: %3|1730672145.397|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:15:46 kjcf05n00 mcfcli[3673891]: %3|1730672146.718|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 16:16:07 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 46908 (bash) Nov 3 16:16:07 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 16:16:07 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 16:16:10 kjcf05n02 diskmonitor[17553]: Removed MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 16:16:10 kjcf05n02 diskmonitor[17553]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 16:16:16 kjcf05n00 mcfcli[3673891]: %3|1730672176.718|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 16:16:23 kjcf05n00 mcfcli[3673891]: %3|1730672183.674|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:16:27 kjcf05n03 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 16:16:27 kjcf05n03 systemd-tmpfiles[47676]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 16:16:27 kjcf05n03 systemd-tmpfiles[47676]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 16:16:27 kjcf05n03 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 16:16:27 kjcf05n03 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 16:16:46 kjcf05n00 mcfcli[3673891]: %3|1730672206.718|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 16:17:02 kjcf05n00 mcfcli[3673891]: %3|1730672222.822|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:17:16 kjcf05n00 mcfcli[3673891]: %3|1730672236.718|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:17:41 kjcf05n00 mcfcli[3673891]: %3|1730672261.583|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:17:46 kjcf05n00 mcfcli[3673891]: %3|1730672266.719|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:18:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730672296}"] Nov 3 16:18:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672296, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:18:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.47748ms Nov 3 16:18:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.47748ms Nov 3 16:18:16 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:18:16 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:18:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:18:16 kjcf05n00 mcfcli[3673891]: %3|1730672296.719|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:18:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730672296}"] Nov 3 16:18:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672296, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:18:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.31202ms Nov 3 16:18:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.31202ms Nov 3 16:18:16 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:18:16 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:18:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:18:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730672296}"] Nov 3 16:18:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672296, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:18:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.145107ms Nov 3 16:18:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.145107ms Nov 3 16:18:16 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:18:16 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:18:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:18:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730672296}"] Nov 3 16:18:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672296, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:18:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.227391ms Nov 3 16:18:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.227391ms Nov 3 16:18:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:18:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:18:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:18:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730672296}"] Nov 3 16:18:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672296, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:18:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.834195ms Nov 3 16:18:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.834195ms Nov 3 16:18:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:18:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:18:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:18:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730672297}"] Nov 3 16:18:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672297, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:18:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.631916ms Nov 3 16:18:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.631916ms Nov 3 16:18:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:18:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:18:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:18:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730672297}"] Nov 3 16:18:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672297, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:18:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.540277ms Nov 3 16:18:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.540277ms Nov 3 16:18:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:18:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:18:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:18:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730672297}"] Nov 3 16:18:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672297, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:18:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.028529ms Nov 3 16:18:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.028529ms Nov 3 16:18:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:18:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:18:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:18:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730672297}"] Nov 3 16:18:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672297, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:18:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.852089ms Nov 3 16:18:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.852089ms Nov 3 16:18:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:18:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:18:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:18:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730672297}"] Nov 3 16:18:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672297, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:18:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.730451ms Nov 3 16:18:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.730451ms Nov 3 16:18:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:18:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:18:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:18:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730672297}"] Nov 3 16:18:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672297, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:18:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:18:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:18:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:18:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:18:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:18:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:18:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.673644ms Nov 3 16:18:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:18:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.673644ms Nov 3 16:18:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:18:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:18:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:18:21 kjcf05n00 mcfcli[3673891]: %3|1730672301.580|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:18:46 kjcf05n00 mcfcli[3673891]: %3|1730672326.719|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:18:59 kjcf05n00 mcfcli[3673891]: %3|1730672339.432|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:19:16 kjcf05n00 mcfcli[3673891]: %3|1730672356.720|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:19:39 kjcf05n00 mcfcli[3673891]: %3|1730672379.429|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:19:46 kjcf05n00 mcfcli[3673891]: %3|1730672386.720|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 16:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 16:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 16:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 16:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 16:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 16:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 16:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 16:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 16:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 16:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 16:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 16:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 16:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 16:20:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 16:20:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:20:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 16:20:05 kjcf05n00 zabbix-server[1397556]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:20:05 kjcf05n00 zabbix-server[1397556]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n03' from event '46403' Nov 3 16:20:06 kjcf05n00 zabbix-server[1397556]: Filesystem 'kjcf05' has been mounted Nov 3 16:20:06 kjcf05n00 zabbix-server[1397556]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 16:20:06 kjcf05n00 zabbix-server[1397556]: Running puppet on 'None' Nov 3 16:20:08 kjcf05n05 puppet-agent[3686327]: Using configured environment 'production' Nov 3 16:20:08 kjcf05n05 puppet-agent[3686327]: Retrieving pluginfacts Nov 3 16:20:08 kjcf05n05 puppet-agent[3686327]: Retrieving plugin Nov 3 16:20:08 kjcf05n03 puppet-agent[53858]: Using configured environment 'production' Nov 3 16:20:08 kjcf05n03 puppet-agent[53858]: Retrieving pluginfacts Nov 3 16:20:08 kjcf05n03 puppet-agent[53858]: Retrieving plugin Nov 3 16:20:08 kjcf05n06 puppet-agent[3521695]: Using configured environment 'production' Nov 3 16:20:08 kjcf05n06 puppet-agent[3521695]: Retrieving pluginfacts Nov 3 16:20:08 kjcf05n06 puppet-agent[3521695]: Retrieving plugin Nov 3 16:20:08 kjcf05n04 puppet-agent[3523045]: Using configured environment 'production' Nov 3 16:20:08 kjcf05n04 puppet-agent[3523045]: Retrieving pluginfacts Nov 3 16:20:08 kjcf05n04 puppet-agent[3523045]: Retrieving plugin Nov 3 16:20:08 kjcf05n02 puppet-agent[114923]: Using configured environment 'production' Nov 3 16:20:08 kjcf05n02 puppet-agent[114923]: Retrieving pluginfacts Nov 3 16:20:08 kjcf05n02 puppet-agent[114923]: Retrieving plugin Nov 3 16:20:08 kjcf05n07 puppet-agent[3518006]: Using configured environment 'production' Nov 3 16:20:08 kjcf05n07 puppet-agent[3518006]: Retrieving pluginfacts Nov 3 16:20:08 kjcf05n07 puppet-agent[3518006]: Retrieving plugin Nov 3 16:20:09 kjcf05n06 puppet-agent[3521695]: Loading facts Nov 3 16:20:09 kjcf05n05 puppet-agent[3686327]: Loading facts Nov 3 16:20:09 kjcf05n03 puppet-agent[53858]: Loading facts Nov 3 16:20:09 kjcf05n04 puppet-agent[3523045]: Loading facts Nov 3 16:20:09 kjcf05n01 puppet-agent[3183853]: Using configured environment 'production' Nov 3 16:20:09 kjcf05n01 puppet-agent[3183853]: Retrieving pluginfacts Nov 3 16:20:09 kjcf05n01 puppet-agent[3183853]: Retrieving plugin Nov 3 16:20:09 kjcf05n02 puppet-agent[114923]: Loading facts Nov 3 16:20:09 kjcf05n07 puppet-agent[3518006]: Loading facts Nov 3 16:20:09 kjcf05n00 puppet-agent[1397632]: Using configured environment 'production' Nov 3 16:20:09 kjcf05n00 puppet-agent[1397632]: Retrieving pluginfacts Nov 3 16:20:09 kjcf05n00 puppet-agent[1397632]: Retrieving plugin Nov 3 16:20:09 kjcf05n00 puppet-agent[1397632]: Loading facts Nov 3 16:20:09 kjcf05n01 puppet-agent[3183853]: Loading facts Nov 3 16:20:11 kjcf05n02 puppet-agent[114923]: Caching catalog for kjcf05n02 Nov 3 16:20:11 kjcf05n02 puppet-agent[114923]: Applying configuration version '1730672410' Nov 3 16:20:11 kjcf05n07 puppet-agent[3518006]: Caching catalog for kjcf05n07 Nov 3 16:20:11 kjcf05n07 puppet-agent[3518006]: Applying configuration version '1730672410' Nov 3 16:20:11 kjcf05n03 puppet-agent[53858]: Caching catalog for kjcf05n03 Nov 3 16:20:11 kjcf05n03 puppet-agent[53858]: Applying configuration version '1730672410' Nov 3 16:20:11 kjcf05n06 puppet-agent[3521695]: Caching catalog for kjcf05n06 Nov 3 16:20:11 kjcf05n06 puppet-agent[3521695]: Applying configuration version '1730672410' Nov 3 16:20:11 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 16:20:11 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 16:20:13 kjcf05n01 puppet-agent[3183853]: Caching catalog for kjcf05n01 Nov 3 16:20:13 kjcf05n01 puppet-agent[3183853]: Applying configuration version '1730672411' Nov 3 16:20:13 kjcf05n00 puppet-agent[1397632]: Caching catalog for kjcf05n00 Nov 3 16:20:13 kjcf05n00 python3.9[1397561]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 16:20:13 kjcf05n00 puppet-agent[1397632]: Applying configuration version '1730672411' Nov 3 16:20:13 kjcf05n02 puppet-agent[114923]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 16:20:13 kjcf05n02 puppet-agent[114923]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 16:20:13 kjcf05n02 puppet-agent[114923]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 16:20:13 kjcf05n03 puppet-agent[53858]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 16:20:13 kjcf05n03 puppet-agent[53858]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 16:20:13 kjcf05n03 puppet-agent[53858]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 16:20:13 kjcf05n07 puppet-agent[3518006]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 16:20:13 kjcf05n07 puppet-agent[3518006]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 16:20:13 kjcf05n07 puppet-agent[3518006]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 16:20:14 kjcf05n06 puppet-agent[3521695]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 16:20:14 kjcf05n06 puppet-agent[3521695]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 16:20:14 kjcf05n06 puppet-agent[3521695]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 16:20:14 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 16:20:14 kjcf05n02 zabbix_agent2[56114]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 16:20:14 kjcf05n02 zabbix_agent2[3182]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:20:14 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 16:20:14 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 16:20:14 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 16:20:14 kjcf05n02 puppet-agent[114923]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: Press Ctrl+C to exit. Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: Plugin support version 1.0 Nov 3 16:20:14 kjcf05n02 zabbix_agent2[115276]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 16:20:14 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 16:20:14 kjcf05n03 zabbix_agent2[35321]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 16:20:14 kjcf05n03 zabbix_agent2[3145]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:20:14 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 16:20:14 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 16:20:14 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 16:20:14 kjcf05n03 puppet-agent[53858]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: Press Ctrl+C to exit. Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: Plugin support version 1.0 Nov 3 16:20:14 kjcf05n03 zabbix_agent2[54207]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 16:20:14 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3469196]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 16:20:14 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 16:20:14 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 16:20:14 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 16:20:14 kjcf05n06 puppet-agent[3521695]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: Press Ctrl+C to exit. Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: Plugin support version 1.0 Nov 3 16:20:14 kjcf05n06 zabbix_agent2[3522163]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 16:20:14 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3465838]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 16:20:14 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 16:20:14 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 16:20:14 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 16:20:14 kjcf05n07 puppet-agent[3518006]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: Press Ctrl+C to exit. Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: Plugin support version 1.0 Nov 3 16:20:14 kjcf05n07 zabbix_agent2[3518902]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 16:20:16 kjcf05n01 puppet-agent[3183853]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 16:20:16 kjcf05n06 puppet-agent[3521695]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 16:20:16 kjcf05n06 puppet-agent[3521695]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 16:20:16 kjcf05n06 puppet-agent[3521695]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 16:20:16 kjcf05n00 puppet-agent[1397632]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 16:20:16 kjcf05n02 puppet-agent[114923]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 16:20:16 kjcf05n02 puppet-agent[114923]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 16:20:16 kjcf05n02 puppet-agent[114923]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 16:20:16 kjcf05n07 puppet-agent[3518006]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 16:20:16 kjcf05n07 puppet-agent[3518006]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 16:20:16 kjcf05n07 puppet-agent[3518006]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 16:20:16 kjcf05n03 puppet-agent[53858]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 16:20:16 kjcf05n03 puppet-agent[53858]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 16:20:16 kjcf05n03 puppet-agent[53858]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 16:20:16 kjcf05n03 puppet-agent[53858]: Applied catalog in 5.08 seconds Nov 3 16:20:16 kjcf05n01 puppet-agent[3183853]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-15:57:20]/mode) mode changed '0755' to '0750' Nov 3 16:20:16 kjcf05n01 puppet-agent[3183853]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-15:57:20/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 16:20:16 kjcf05n01 puppet-agent[3183853]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-15:57:20/vmcore]/mode) mode changed '0600' to '0640' Nov 3 16:20:16 kjcf05n01 puppet-agent[3183853]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-15:57:20/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 16:20:16 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 16:20:16 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 16:20:16 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 16:20:16 kjcf05n05 puppet-agent[3686327]: Caching catalog for kjcf05n05 Nov 3 16:20:16 kjcf05n05 puppet-agent[3686327]: Applying configuration version '1730672415' Nov 3 16:20:16 kjcf05n06 puppet-agent[3521695]: Applied catalog in 4.76 seconds Nov 3 16:20:16 kjcf05n00 mcfcli[3673891]: %3|1730672416.720|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:20:17 kjcf05n02 puppet-agent[114923]: Applied catalog in 5.14 seconds Nov 3 16:20:17 kjcf05n07 puppet-agent[3518006]: Applied catalog in 4.89 seconds Nov 3 16:20:17 kjcf05n01 puppet-agent[3183853]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 16:20:17 kjcf05n01 puppet-agent[3183853]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 16:20:17 kjcf05n01 puppet-agent[3183853]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 16:20:17 kjcf05n00 puppet-agent[1397632]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 16:20:17 kjcf05n00 puppet-agent[1397632]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 16:20:17 kjcf05n00 puppet-agent[1397632]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 16:20:18 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3171828]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 16:20:18 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 16:20:18 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 16:20:18 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 16:20:18 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 16:20:18 kjcf05n01 puppet-agent[3183853]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: Press Ctrl+C to exit. Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: Plugin support version 1.0 Nov 3 16:20:18 kjcf05n01 zabbix_agent2[3184199]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 16:20:17 kjcf05n00 mcfcli[3673891]: %3|1730672417.854|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:20:17 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1379115]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 16:20:18 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 16:20:17 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 16:20:17 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 16:20:17 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 16:20:17 kjcf05n00 puppet-agent[1397632]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: Press Ctrl+C to exit. Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: Plugin support version 1.0 Nov 3 16:20:17 kjcf05n00 zabbix_agent2[1398391]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 16:20:18 kjcf05n00 zabbix-server[1398413]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:20:18 kjcf05n05 puppet-agent[3686327]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 16:20:18 kjcf05n05 puppet-agent[3686327]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 16:20:18 kjcf05n05 puppet-agent[3686327]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 16:20:18 kjcf05n00 zabbix-server[1398414]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:20:19 kjcf05n00 zabbix-server[1398423]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:20:19 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3626880]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 16:20:19 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 16:20:19 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 16:20:19 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 16:20:19 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 16:20:19 kjcf05n05 puppet-agent[3686327]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: Press Ctrl+C to exit. Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: Plugin support version 1.0 Nov 3 16:20:19 kjcf05n05 zabbix_agent2[3687161]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 16:20:19 kjcf05n00 zabbix-server[1398434]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:20:20 kjcf05n01 puppet-agent[3183853]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_160440.log]/mode) mode changed '0644' to '0640' Nov 3 16:20:20 kjcf05n01 puppet-agent[3183853]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_161607.log]/mode) mode changed '0644' to '0640' Nov 3 16:20:19 kjcf05n00 puppet-agent[1397632]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 16:20:20 kjcf05n01 puppet-agent[3183853]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_160440.log]/mode) mode changed '0644' to '0640' Nov 3 16:20:20 kjcf05n01 puppet-agent[3183853]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_161607.log]/mode) mode changed '0644' to '0640' Nov 3 16:20:20 kjcf05n01 puppet-agent[3183853]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_161608]/mode) mode changed '0755' to '0750' Nov 3 16:20:20 kjcf05n01 puppet-agent[3183853]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_161608/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 16:20:20 kjcf05n01 puppet-agent[3183853]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 16:20:20 kjcf05n01 puppet-agent[3183853]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 16:20:20 kjcf05n01 puppet-agent[3183853]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 16:20:20 kjcf05n00 puppet-agent[1397632]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 16:20:20 kjcf05n00 puppet-agent[1397632]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 16:20:20 kjcf05n00 puppet-agent[1397632]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 16:20:21 kjcf05n05 puppet-agent[3686327]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 16:20:21 kjcf05n05 puppet-agent[3686327]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 16:20:21 kjcf05n05 puppet-agent[3686327]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 16:20:21 kjcf05n05 puppet-agent[3686327]: Applied catalog in 4.81 seconds Nov 3 16:20:22 kjcf05n01 puppet-agent[3183853]: Applied catalog in 8.90 seconds Nov 3 16:20:21 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 16:20:22 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 16:20:21 kjcf05n00 puppet-agent[1397632]: Applied catalog in 8.27 seconds Nov 3 16:20:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730672426', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 16:20:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730672426'} Nov 3 16:20:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:20:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730672426', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 16:20:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730672426'} Nov 3 16:20:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:20:38 kjcf05n04 puppet-agent[3523045]: Caching catalog for kjcf05n04 Nov 3 16:20:38 kjcf05n04 puppet-agent[3523045]: Applying configuration version '1730672436' Nov 3 16:20:40 kjcf05n04 puppet-agent[3523045]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 16:20:40 kjcf05n04 puppet-agent[3523045]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 16:20:40 kjcf05n04 puppet-agent[3523045]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 16:20:41 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3465107]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 16:20:41 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 16:20:41 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 16:20:41 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 16:20:41 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 16:20:41 kjcf05n04 puppet-agent[3523045]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: Press Ctrl+C to exit. Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: Plugin support version 1.0 Nov 3 16:20:41 kjcf05n04 zabbix_agent2[3524343]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 16:20:41 kjcf05n03 dwd[5162]: nvme15n1 passed periodic SMART status check Nov 3 16:20:41 kjcf05n03 dwd[5162]: nvme10n1 passed periodic SMART status check Nov 3 16:20:42 kjcf05n03 dwd[5162]: nvme21n1 passed periodic SMART status check Nov 3 16:20:42 kjcf05n03 dwd[5162]: nvme12n1 passed periodic SMART status check Nov 3 16:20:42 kjcf05n03 dwd[5162]: nvme11n1 passed periodic SMART status check Nov 3 16:20:42 kjcf05n03 dwd[5162]: nvme20n1 passed periodic SMART status check Nov 3 16:20:42 kjcf05n04 puppet-agent[3523045]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 16:20:42 kjcf05n04 puppet-agent[3523045]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 16:20:42 kjcf05n04 puppet-agent[3523045]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 16:20:43 kjcf05n04 puppet-agent[3523045]: Applied catalog in 4.79 seconds Nov 3 16:20:42 kjcf05n00 zabbix-server[1397556]: puppet completed status:(0): '' Nov 3 16:20:43 kjcf05n00 zabbix-server[1397556]: Event '46403' acknowledged Nov 3 16:20:43 kjcf05n00 zabbix-server[1397556]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n03"}' Nov 3 16:20:43 kjcf05n03 dwd[5162]: nvme16n1 passed periodic SMART status check Nov 3 16:20:43 kjcf05n03 dwd[5162]: nvme7n1 passed periodic SMART status check Nov 3 16:20:43 kjcf05n03 dwd[5162]: nvme22n1 passed periodic SMART status check Nov 3 16:20:43 kjcf05n03 dwd[5162]: nvme5n1 passed periodic SMART status check Nov 3 16:20:43 kjcf05n03 dwd[5162]: nvme6n1 passed periodic SMART status check Nov 3 16:20:46 kjcf05n00 mcfcli[3673891]: %3|1730672446.720|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 16:20:55 kjcf05n00 mcfcli[3673891]: %3|1730672455.429|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:21:16 kjcf05n00 mcfcli[3673891]: %3|1730672476.721|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 16:21:30 kjcf05n00 mcfcli[3673891]: %3|1730672490.394|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:21:46 kjcf05n00 mcfcli[3673891]: %3|1730672506.721|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 16:22:10 kjcf05n00 mcfcli[3673891]: %3|1730672530.391|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:22:16 kjcf05n00 mcfcli[3673891]: %3|1730672536.721|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 16:22:46 kjcf05n00 mcfcli[3673891]: %3|1730672566.722|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 16:22:50 kjcf05n00 mcfcli[3673891]: %3|1730672570.388|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T22:23:15.868183Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 16:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T22:23:15.868243Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.083ms Nov 3 16:23:16 kjcf05n00 mcfcli[3673891]: %3|1730672596.722|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 16:23:26 kjcf05n00 mcfcli[3673891]: %3|1730672606.724|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T16:23:27.253158309-06:00 level=info msg="Completed cleanup jobs" duration=26.096824ms Nov 3 16:23:46 kjcf05n00 mcfcli[3673891]: %3|1730672626.723|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 16:24:04 kjcf05n00 mcfcli[3673891]: %3|1730672644.503|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:24:10 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 3 16:24:10 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 9 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.008139 sec, idle for 1 hour(s)] Nov 3 16:24:16 kjcf05n00 mcfcli[3673891]: %3|1730672656.723|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:24:44 kjcf05n00 mcfcli[3673891]: %3|1730672684.500|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:24:46 kjcf05n00 mcfcli[3673891]: %3|1730672686.724|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:25:13 kjcf05n00 python3.9[1400931]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 16:25:15 kjcf05n02 nslcd[7269]: [e87ccd] ldap_result() failed: Can't contact LDAP server Nov 3 16:25:16 kjcf05n00 mcfcli[3673891]: %3|1730672716.724|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:25:20 kjcf05n00 mcfcli[3673891]: %3|1730672720.133|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:25:46 kjcf05n00 mcfcli[3673891]: %3|1730672746.724|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:25:58 kjcf05n00 mcfcli[3673891]: %3|1730672758.313|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:26:16 kjcf05n00 mcfcli[3673891]: %3|1730672776.725|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 16:26:19 kjcf05n02 nslcd[7269]: [7ed7ab] ldap_result() failed: Can't contact LDAP server Nov 3 16:26:36 kjcf05n00 mcfcli[3673891]: %3|1730672796.672|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:26:47 kjcf05n00 mcfcli[3673891]: %3|1730672807.225|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 16:26:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 16:26:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 16:26:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 16:26:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 16:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 16:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 16:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 16:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 16:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 16:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 16:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 16:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 16:27:13 kjcf05n00 zabbix_server[15718]: Zabbix agent item "dcs.lustre.device.discovery[{$LUSTRE_FS_NAME},mdt]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 3 16:27:13 kjcf05n00 zabbix_server[15742]: Zabbix agent item "vfs.fs.inode[/etc/ganesha,pfree]" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 3 16:27:16 kjcf05n00 mcfcli[3673891]: %3|1730672836.350|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:27:17 kjcf05n00 mcfcli[3673891]: %3|1730672837.225|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 16:27:18 kjcf05n03 fstonithd.py[15375]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 3 16:27:19 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 16:27:19 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 16:27:19 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 16:27:19 kjcf05n03 root[65844]: is_enc_ipmi_off starts Nov 3 16:27:19 kjcf05n03 root[65845]: is_viking_off starts Nov 3 16:27:19 kjcf05n03 root[65863]: I am not master; I will get master Nov 3 16:27:20 kjcf05n03 root[65866]: I am in slot 1; partner is in slot 0 Nov 3 16:27:20 kjcf05n03 root[65887]: is_lan_ipmi_off leaves Nov 3 16:27:20 kjcf05n03 root[65889]: is_lan_ipmi_sec_off leaves Nov 3 16:27:21 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='30', error='Connection reset by peer (104)' Nov 3 16:27:21 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='30', client='AF_INET(172.16.2.5:39945)', local='AF_INET(0.0.0.0:601)' Nov 3 16:27:25 kjcf05n03 root[65991]: I am now master Nov 3 16:27:27 kjcf05n03 root[66010]: is_viking_off leaves Nov 3 16:27:27 kjcf05n03 root[66013]: kjcf05n02 not already off look at kdump Nov 3 16:27:27 kjcf05n03 root[66027]: is_kdump_off starts Nov 3 16:27:27 kjcf05n03 fence_kdump[66028]: waiting for message from '172.16.2.5' Nov 3 16:27:27 kjcf05n03 fence_kdump[66028]: received valid message from '172.16.2.5' Nov 3 16:27:27 kjcf05n03 root[66033]: is_kdump_off detected kdump on kjcf05n02 Nov 3 16:27:27 kjcf05n03 root[66034]: kjcf05n02 is kdumping Nov 3 16:27:27 kjcf05n03 root[66123]: is_viking_off starts Nov 3 16:27:27 kjcf05n03 root[66122]: is_enc_ipmi_off starts Nov 3 16:27:28 kjcf05n03 root[66152]: is_lan_ipmi_off leaves Nov 3 16:27:28 kjcf05n03 root[66154]: is_lan_ipmi_sec_off leaves Nov 3 16:27:28 kjcf05n00 zabbix_server[15783]: Zabbix agent item "net.if.in["icl0",dropped]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 16:27:28 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.mdt.name[MDT0001,mdt_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 16:27:28 kjcf05n03 root[66171]: I am master Nov 3 16:27:28 kjcf05n03 root[66174]: I am in slot 1; partner is in slot 0 Nov 3 16:27:30 kjcf05n00 zabbix_server[15728]: Zabbix agent item "system.uptime" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 16:27:31 kjcf05n00 zabbix_server[15779]: Zabbix agent item "xrtx.enclosure.serial_number[USE26000024VS001]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 16:27:36 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 16:27:36 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 16:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 16:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 16:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 16:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 16:27:40 kjcf05n03 root[66587]: is_viking_off leaves Nov 3 16:27:40 kjcf05n03 root[66592]: kjcf05n02 not already off look at kdump Nov 3 16:27:40 kjcf05n03 root[66593]: is_kdump_off starts Nov 3 16:27:40 kjcf05n03 fence_kdump[66598]: waiting for message from '172.16.2.5' Nov 3 16:27:40 kjcf05n03 fence_kdump[66598]: received valid message from '172.16.2.5' Nov 3 16:27:40 kjcf05n03 root[66615]: is_kdump_off detected kdump on kjcf05n02 Nov 3 16:27:40 kjcf05n03 root[66616]: kjcf05n02 is kdumping Nov 3 16:27:43 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0003,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 16:27:45 kjcf05n03 dwd[5162]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 16:27:45 kjcf05n03 dwd[5162]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 16:27:45 kjcf05n03 dwd[5162]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 16:27:45 kjcf05n03 dwd[5162]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 16:27:45 kjcf05n03 dwd[5162]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 16:27:45 kjcf05n03 dwd[5162]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 16:27:45 kjcf05n03 dwd[5162]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 16:27:45 kjcf05n03 dwd[5162]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 16:27:45 kjcf05n03 dwd[5162]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 16:27:45 kjcf05n03 dwd[5162]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 16:27:45 kjcf05n03 dwd[5162]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 16:27:45 kjcf05n03 dwd[5162]: Starting NVME thread for nvme25n1 Nov 3 16:27:45 kjcf05n03 dwd[5162]: Starting NVME thread for nvme8n1 Nov 3 16:27:45 kjcf05n03 dwd[5162]: Starting NVME thread for nvme18n1 Nov 3 16:27:45 kjcf05n03 dwd[5162]: Starting NVME thread for nvme23n1 Nov 3 16:27:46 kjcf05n03 systemd-udevd[69040]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69041]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69043]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69045]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69040]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69043]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69041]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69045]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69043]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69040]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69041]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69045]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69043]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69040]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69041]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69045]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69043]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69040]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69041]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69045]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69040]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69043]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69065]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69066]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69067]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69041]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69072]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69045]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69043]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69040]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69065]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69066]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69041]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69067]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69072]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69045]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69043]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69065]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69041]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69066]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69067]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69043]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69043]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69041]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69043]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69067]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69072]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69041]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69043]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69067]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69041]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69043]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69041]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69043]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69043]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69041]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69043]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69041]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69043]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69041]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69043]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69043]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69043]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 systemd-udevd[69043]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:27:46 kjcf05n03 dwd[5162]: Starting NVME thread for nvme9n1 Nov 3 16:27:46 kjcf05n03 dwd[5162]: Starting NVME thread for nvme4n1 Nov 3 16:27:46 kjcf05n03 dwd[5162]: Starting NVME thread for nvme2n1 Nov 3 16:27:46 kjcf05n03 dwd[5162]: Starting NVME thread for nvme3n1 Nov 3 16:27:46 kjcf05n03 dwd[5162]: Starting NVME thread for nvme19n1 Nov 3 16:27:46 kjcf05n00 zabbix_server[15783]: Zabbix agent item "net.if.out["ib0",dropped]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 16:27:47 kjcf05n03 dwd[5162]: Starting NVME thread for nvme17n1 Nov 3 16:27:47 kjcf05n03 dwd[5162]: Starting NVME thread for nvme24n1 Nov 3 16:27:47 kjcf05n00 mcfcli[3673891]: %3|1730672867.225|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:27:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 16:27:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 16:27:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 16:27:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 16:27:54 kjcf05n00 mcfcli[3673891]: %3|1730672874.016|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 16:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 16:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 16:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 16:27:58 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 3 16:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 16:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 16:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 16:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 16:28:00 kjcf05n03 diskmonitor[17811]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 16:28:01 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 3 16:28:12 kjcf05n03 diskmonitor[17811]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 16:28:12 kjcf05n03 diskmonitor[17811]: Scan for ReadErrorMax change for md65 Nov 3 16:28:12 kjcf05n03 diskmonitor[17811]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 16:28:12 kjcf05n03 diskmonitor[17811]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 16:28:12 kjcf05n03 diskmonitor[17811]: read_saved_file: md65 no saved speed Nov 3 16:28:12 kjcf05n03 diskmonitor[17811]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 16:28:12 kjcf05n03 diskmonitor[17811]: Set sync_speed_min (10000) for md65 Nov 3 16:28:12 kjcf05n03 diskmonitor[17811]: Set sync_speed_max (200000) for md65 Nov 3 16:28:12 kjcf05n03 diskmonitor[17811]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 16:28:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730672896}"] Nov 3 16:28:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672896, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:28:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.200632ms Nov 3 16:28:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.200632ms Nov 3 16:28:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:28:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:28:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:28:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730672896}"] Nov 3 16:28:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672896, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:28:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.851097ms Nov 3 16:28:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.851097ms Nov 3 16:28:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:28:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:28:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:28:17 kjcf05n00 mcfcli[3673891]: %3|1730672897.226|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:28:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730672896}"] Nov 3 16:28:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672896, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:28:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.243222ms Nov 3 16:28:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.243222ms Nov 3 16:28:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:28:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:28:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:28:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730672896}"] Nov 3 16:28:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672896, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:28:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.228484ms Nov 3 16:28:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.228484ms Nov 3 16:28:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:28:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:28:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:28:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730672896}"] Nov 3 16:28:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672896, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:28:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.705935ms Nov 3 16:28:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.705935ms Nov 3 16:28:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:28:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:28:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:28:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730672896}"] Nov 3 16:28:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672896, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:28:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.590091ms Nov 3 16:28:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.590091ms Nov 3 16:28:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:28:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:28:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:28:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730672896}"] Nov 3 16:28:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672896, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:28:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.663646ms Nov 3 16:28:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.663646ms Nov 3 16:28:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:28:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:28:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:28:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730672896}"] Nov 3 16:28:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672896, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:28:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.734228ms Nov 3 16:28:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.734228ms Nov 3 16:28:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:28:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:28:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:28:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730672896}"] Nov 3 16:28:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672896, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:28:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.89041ms Nov 3 16:28:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.89041ms Nov 3 16:28:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:28:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:28:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:28:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730672896}"] Nov 3 16:28:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672896, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:28:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.143454ms Nov 3 16:28:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.143454ms Nov 3 16:28:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:28:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:28:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:28:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730672896}"] Nov 3 16:28:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730672896, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:28:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:28:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:28:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:28:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:28:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:28:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:28:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.860053ms Nov 3 16:28:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:28:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.860053ms Nov 3 16:28:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:28:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:28:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:28:29 kjcf05n00 mcfcli[3673891]: %3|1730672909.589|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 16:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 16:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 16:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 16:28:47 kjcf05n00 mcfcli[3673891]: %3|1730672927.226|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:28:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 16:28:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 16:28:52 kjcf05n03 nslcd[6919]: ldap_result() failed: Can't contact LDAP server Nov 3 16:28:52 kjcf05n03 nslcd[6919]: (re)loading /etc/nsswitch.conf Nov 3 16:28:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 16:28:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 16:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 16:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 16:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 16:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 16:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 16:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 16:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 16:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 16:29:08 kjcf05n00 mcfcli[3673891]: %3|1730672948.698|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:29:17 kjcf05n00 mcfcli[3673891]: %3|1730672957.227|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 16:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 16:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 16:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 16:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 16:29:46 kjcf05n00 mcfcli[3673891]: %3|1730672986.289|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:29:47 kjcf05n00 mcfcli[3673891]: %3|1730672987.227|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 16:29:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 16:29:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 16:29:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 16:29:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 16:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 16:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 16:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 16:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 16:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 16:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 16:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 16:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 16:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 16:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 16:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 16:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 16:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 16:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 16:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 16:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 16:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 16:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 16:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 16:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 16:30:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 16:30:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:30:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 16:30:17 kjcf05n00 mcfcli[3673891]: %3|1730673017.228|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:30:18 kjcf05n00 python3.9[1404095]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 16:30:25 kjcf05n00 mcfcli[3673891]: %3|1730673025.001|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:30:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730673031', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 16:30:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730673031'} Nov 3 16:30:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:30:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730673031', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 16:30:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730673031'} Nov 3 16:30:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 16:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 16:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 16:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 16:30:47 kjcf05n00 mcfcli[3673891]: %3|1730673047.353|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 16:30:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 16:30:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 16:30:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 16:30:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 16:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 16:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 16:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 16:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 16:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 16:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 16:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 16:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 16:31:01 kjcf05n00 mcfcli[3673891]: %3|1730673061.179|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:31:06 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 3 16:31:06 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 16:31:10 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 16:31:10 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 3 16:31:10 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 3 16:31:10 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 16:31:10 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 16:31:10 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 3 16:31:10 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 3 16:31:10 kjcf05n00 zabbix-server[1404894]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:31:10 kjcf05n00 zabbix-server[1404894]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 16:31:10 kjcf05n00 log_interesting_event.py[1404894]: Event '46406' acknowledged Nov 3 16:31:14 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 3 16:31:16 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 3 16:31:17 kjcf05n00 mcfcli[3673891]: %3|1730673077.353|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 16:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 16:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 16:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 16:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 16:31:41 kjcf05n00 mcfcli[3673891]: %3|1730673101.176|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:31:47 kjcf05n00 mcfcli[3673891]: %3|1730673107.354|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:31:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 16:31:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 16:31:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 16:31:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 16:31:53 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 16:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 16:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 16:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 16:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 16:31:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 16:31:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 16:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 16:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 16:32:04 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:39536). Nov 3 16:32:04 kjcf05n01 rsyncd[3189027]: connect from kjcf05n02 (172.16.2.5) Nov 3 16:32:04 kjcf05n01 rsyncd[3189027]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 16:32:04 kjcf05n01 rsyncd[3189027]: building file list Nov 3 16:32:04 kjcf05n01 rsyncd[3189027]: sent 11450 bytes received 136 bytes total size 10905 Nov 3 16:32:04 kjcf05n01 systemd[1]: rsyncd@643-172.16.2.2:873-172.16.2.5:39536.service: Succeeded. Nov 3 16:32:17 kjcf05n00 mcfcli[3673891]: %3|1730673137.729|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 16:32:18 kjcf05n03 fstonithd.py[15375]: Listening for kdump packets from partner Nov 3 16:32:19 kjcf05n00 mcfcli[3673891]: %3|1730673139.748|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 16:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 16:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 16:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 16:32:46 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 16:32:47 kjcf05n00 mcfcli[3673891]: %3|1730673167.730|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 16:32:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 16:32:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 16:32:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 16:32:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 16:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 16:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 16:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 16:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 16:32:56 kjcf05n00 mcfcli[3673891]: %3|1730673176.729|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:32:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 16:32:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 16:32:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 16:32:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 16:33:00 kjcf05n03 dwd[5162]: nvme18n1 passed periodic SMART status check Nov 3 16:33:00 kjcf05n03 dwd[5162]: nvme23n1 passed periodic SMART status check Nov 3 16:33:00 kjcf05n03 dwd[5162]: nvme25n1 passed periodic SMART status check Nov 3 16:33:00 kjcf05n03 dwd[5162]: nvme8n1 passed periodic SMART status check Nov 3 16:33:01 kjcf05n03 dwd[5162]: nvme4n1 passed periodic SMART status check Nov 3 16:33:01 kjcf05n03 dwd[5162]: nvme17n1 passed periodic SMART status check Nov 3 16:33:01 kjcf05n03 dwd[5162]: nvme24n1 passed periodic SMART status check Nov 3 16:33:01 kjcf05n03 dwd[5162]: nvme9n1 passed periodic SMART status check Nov 3 16:33:01 kjcf05n03 dwd[5162]: nvme19n1 passed periodic SMART status check Nov 3 16:33:01 kjcf05n03 dwd[5162]: nvme3n1 passed periodic SMART status check Nov 3 16:33:01 kjcf05n03 dwd[5162]: nvme2n1 passed periodic SMART status check Nov 3 16:33:17 kjcf05n00 mcfcli[3673891]: %3|1730673197.730|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 16:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T16:33:27.268366618-06:00 level=info msg="Completed cleanup jobs" duration=41.224716ms Nov 3 16:33:29 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='75', client='AF_INET(172.16.2.5:33995)', local='AF_INET(0.0.0.0:601)' Nov 3 16:33:29 kjcf05n02 syslog-ng[3209]: Configuration reload request received, reloading configuration; Nov 3 16:33:29 kjcf05n02 syslog-ng[3209]: Configuration reload finished; Nov 3 16:33:29 kjcf05n02 syslog-ng[3209]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 16:33:29 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 3 16:33:29 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 16:33:29 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 3 16:33:29 kjcf05n02 dracut: Self testing crypto algorithms Nov 3 16:33:29 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 3 16:33:29 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 16:33:29 kjcf05n02 Copying live image to RAM... Nov 3 16:33:29 kjcf05n02 (this may take a minute) Nov 3 16:33:29 kjcf05n02 Done copying live image to RAM. Nov 3 16:33:29 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 16:33:29 kjcf05n02 dracut: Checking integrity of kernel Nov 3 16:33:29 kjcf05n02 dracut: All initrd crypto checks done Nov 3 16:33:29 kjcf05n02 dracut: Switching root Nov 3 16:33:29 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 16:33:29 kjcf05n02 systemd: Detected architecture x86-64. Nov 3 16:33:29 kjcf05n02 systemd: Set hostname to . Nov 3 16:33:29 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 16:33:29 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 16:33:29 kjcf05n02 systemd: Listening on LVM2 poll daemon socket. Nov 3 16:33:29 kjcf05n02 systemd: Created slice system-sshd\x2dkeygen.slice. Nov 3 16:33:29 kjcf05n02 systemd: Created slice User and Session Slice. Nov 3 16:33:29 kjcf05n02 systemd: Listening on Process Core Dump Socket. Nov 3 16:33:29 kjcf05n02 systemd: Started Forward Password Requests to Wall Directory Watch. Nov 3 16:33:29 kjcf05n02 systemd-journald[1520]: Journal started Nov 3 16:33:29 kjcf05n02 systemd-journald[1520]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 16:33:29 kjcf05n02 systemd-modules-load[1529]: Inserted module 'fuse' Nov 3 16:33:29 kjcf05n02 systemd[1]: Mounted /WIBS. Nov 3 16:33:29 kjcf05n02 systemd[1]: Mounted Kernel Debug File System. Nov 3 16:33:29 kjcf05n02 systemd[1]: Mounted /mnt. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Remount Root and Kernel File Systems. Nov 3 16:33:29 kjcf05n02 systemd[1]: Mounted /data. Nov 3 16:33:29 kjcf05n02 systemd[1]: Mounted POSIX Message Queue File System. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 3 16:33:29 kjcf05n02 systemd[1]: Mounted Huge Pages File System. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Load Kernel Modules. Nov 3 16:33:29 kjcf05n02 systemd[1]: Mounted Temporary Directory (/tmp). Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Create list of required static device nodes for the current kernel. Nov 3 16:33:29 kjcf05n02 systemd[1]: Mounting Kernel Configuration File System... Nov 3 16:33:29 kjcf05n02 systemd[1]: Mounting FUSE Control File System... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Apply Kernel Variables... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Create System Users... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Rebuild Hardware Database... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Load/Save Random Seed... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 16:33:29 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 3 16:33:29 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 3 16:33:29 kjcf05n02 systemd-sysctl[1543]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 16:33:29 kjcf05n02 systemd-sysctl[1543]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Create System Users. Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 3 16:33:29 kjcf05n02 systemd-journald[1520]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 16:33:29 kjcf05n02 systemd-tmpfiles[1552]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 16:33:29 kjcf05n02 systemd-tmpfiles[1552]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 3 16:33:29 kjcf05n02 systemd-udevd[1559]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 3 16:33:29 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 3 16:33:29 kjcf05n02 systemd-udevd[1583]: Using default interface naming scheme 'rhel-8.0'. Nov 3 16:33:29 kjcf05n02 systemd-udevd[1583]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:33:29 kjcf05n02 systemd-udevd[1564]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:33:29 kjcf05n02 systemd-udevd[1608]: Using default interface naming scheme 'rhel-8.0'. Nov 3 16:33:29 kjcf05n02 systemd-udevd[1608]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 16:33:29 kjcf05n02 systemd-udevd[1581]: Using default interface naming scheme 'rhel-8.0'. Nov 3 16:33:29 kjcf05n02 systemd-udevd[1581]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:33:29 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 3 16:33:29 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 16:33:29 kjcf05n02 root[1802]: openibd: running in auto mode Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 16:33:29 kjcf05n02 systemd-tmpfiles[1801]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 16:33:29 kjcf05n02 systemd-tmpfiles[1801]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 16:33:29 kjcf05n02 systemd-tmpfiles[1801]: "/var/tmp" already exists and is not a directory. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 16:33:29 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 16:33:29 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started RPC Bind. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 16:33:29 kjcf05n02 systemd-modules-load[1863]: Inserted module 'ib_iser' Nov 3 16:33:29 kjcf05n02 systemd-modules-load[1863]: Inserted module 'ib_isert' Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 16:33:29 kjcf05n02 systemd-modules-load[1863]: Inserted module 'ib_srpt' Nov 3 16:33:29 kjcf05n02 systemd-udevd[1574]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:33:29 kjcf05n02 systemd-modules-load[1856]: Inserted module 'ib_ipoib' Nov 3 16:33:29 kjcf05n02 systemd-udevd[1625]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:33:29 kjcf05n02 systemd-modules-load[1863]: Inserted module 'rdma_ucm' Nov 3 16:33:29 kjcf05n02 systemd-modules-load[1863]: Module 'svcrdma' is blacklisted Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 16:33:29 kjcf05n02 systemd-udevd[1574]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 16:33:29 kjcf05n02 systemd-udevd[1625]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 16:33:29 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 16:33:29 kjcf05n02 systemd[3209]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:29 kjcf05n02 systemd-modules-load[1856]: Inserted module 'ib_umad' Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 16:33:29 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 3 16:33:29 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 3 16:33:29 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 16:33:29 kjcf05n02 openibd[1778]: Loading HCA driver and Access Layer:[ OK ] Nov 3 16:33:29 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Update is Completed. Nov 3 16:33:29 kjcf05n02 setup-icl[1767]: Setting LAN IP Address to 203.0.113.3 Nov 3 16:33:29 kjcf05n02 setup-icl[1767]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 16:33:29 kjcf05n02 setup-icl[1767]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 16:33:29 kjcf05n02 setup-icl[1767]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 16:33:29 kjcf05n02 systemd-udevd[1574]: Using default interface naming scheme 'rhel-8.0'. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 16:33:29 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 3 16:33:29 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 3 16:33:29 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 16:33:29 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 16:33:29 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 16:33:29 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 16:33:29 kjcf05n02 systemd[1]: Reached target Sockets. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 16:33:29 kjcf05n02 systemd[1]: Reached target Basic System. Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 3 16:33:29 kjcf05n02 chronyd[2127]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 16:33:29 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 3 16:33:29 kjcf05n02 mdraid-phy[2131]: no Cutlass to worry about Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 16:33:29 kjcf05n02 nscd[2159]: 2159 monitoring file `/etc/hosts` (1) Nov 3 16:33:29 kjcf05n02 nscd[2159]: 2159 monitoring directory `/etc` (2) Nov 3 16:33:29 kjcf05n02 nscd[2159]: 2159 monitoring file `/etc/resolv.conf` (3) Nov 3 16:33:29 kjcf05n02 nscd[2159]: 2159 monitoring directory `/etc` (2) Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[2148]: Setting up Mellanox network interface: ib1 Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 16:33:29 kjcf05n02 chronyd[2127]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 16:33:29 kjcf05n02 chronyd[2127]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 16:33:29 kjcf05n02 mcelog[2176]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 16:33:29 kjcf05n02 mcelog[2176]: CPU is unsupported Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 0 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 1 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 2 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 3 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 4 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 5 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 6 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 7 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 8 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 9 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 10 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 11 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 12 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 13 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 14 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 15 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 16 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 17 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 18 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 19 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 20 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 21 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 22 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 23 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 24 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 25 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 26 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 27 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 28 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 29 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 30 Nov 3 16:33:29 kjcf05n02 cpupower[2195]: Setting cpu: 31 Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 16:33:29 kjcf05n02 dbus-daemon[2153]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 16:33:29 kjcf05n02 beSetMlxConfig[2186]: ConnectX-3 multiport not detected Nov 3 16:33:29 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 16:33:29 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[2212]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 16:33:29 kjcf05n02 network[2226]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[2225]: Setting up Mellanox network interface: ib0 Nov 3 16:33:29 kjcf05n02 dwd[2218]: dwd: vMay 29 2024 : 15:38:26 Nov 3 16:33:29 kjcf05n02 dwd[2218]: /usr/sbin/dwd -d --standalone=0 Nov 3 16:33:29 kjcf05n02 dwd[2218]: dwd: option Lethal: 0 Nov 3 16:33:29 kjcf05n02 dwd[2218]: dwd: option Interval: 60 Nov 3 16:33:29 kjcf05n02 dwd[2218]: dwd: option abrtlimit: 10 Nov 3 16:33:29 kjcf05n02 dwd[2218]: dwd: option DZPeriod: 604800 Nov 3 16:33:29 kjcf05n02 dwd[2218]: dwd: option SmartPeriod: 43200 Nov 3 16:33:29 kjcf05n02 dwd[2218]: dwd: option SDDEnabled: 1 Nov 3 16:33:29 kjcf05n02 dwd[2218]: dwd: option SDDAwaitScale: 3 Nov 3 16:33:29 kjcf05n02 dwd[2218]: dwd: option SDDAwaitMin: 100 Nov 3 16:33:29 kjcf05n02 dwd[2218]: dwd: option Verbosity: 1 Nov 3 16:33:29 kjcf05n02 dwd[2218]: dwd: option StandAlone: 0 Nov 3 16:33:29 kjcf05n02 dwd[2218]: option Lethal: 0 Nov 3 16:33:29 kjcf05n02 dwd[2218]: option Interval: 60 Nov 3 16:33:29 kjcf05n02 dwd[2218]: option abrtlimit: 10 Nov 3 16:33:29 kjcf05n02 dwd[2218]: option DZPeriod: 604800 Nov 3 16:33:29 kjcf05n02 dwd[2218]: option SmartPeriod: 43200 Nov 3 16:33:29 kjcf05n02 dwd[2218]: option SDDEnabled: 1 Nov 3 16:33:29 kjcf05n02 dwd[2218]: option SDDAwaitScale: 3 Nov 3 16:33:29 kjcf05n02 dwd[2218]: option SDDAwaitMin: 100 Nov 3 16:33:29 kjcf05n02 dwd[2218]: option Verbosity: 1 Nov 3 16:33:29 kjcf05n02 dwd[2218]: option StandAlone: 0 Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 3 16:33:29 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 16:33:29 kjcf05n02 network[2254]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 16:33:29 kjcf05n02 network[2226]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[2259]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 16:33:29 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 16:33:29 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 0 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 1 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 2 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 3 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 4 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 5 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 6 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 7 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 8 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 9 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 10 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 11 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 12 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 13 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 14 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 15 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 16 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 17 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 18 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 19 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 20 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 21 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 22 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 23 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 24 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 25 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 26 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 27 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 28 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 29 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 30 Nov 3 16:33:29 kjcf05n02 cpupower[2299]: Idlestate 2 disabled on CPU 31 Nov 3 16:33:29 kjcf05n02 beSetMlxConfig[2186]: Starting MST (Mellanox Software Tools) driver set Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[2295]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 16:33:29 kjcf05n02 network[2296]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:33:29 kjcf05n02 network[2226]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[2297]: No configuration found for ib1 Nov 3 16:33:29 kjcf05n02 sssd[sssd][2129]: Starting up Nov 3 16:33:29 kjcf05n02 beSetMlxConfig[2186]: Loading MST PCI module - Success Nov 3 16:33:29 kjcf05n02 network[2313]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[2315]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[2319]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 16:33:29 kjcf05n02 beSetMlxConfig[2186]: Loading MST PCI configuration module - Success Nov 3 16:33:29 kjcf05n02 beSetMlxConfig[2186]: Create devices Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[2329]: No configuration found for ib0 Nov 3 16:33:29 kjcf05n02 mlnx_conf_mgr[2355]: INFO: No configurations found for mlx5_1, skipping. Nov 3 16:33:29 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[2362]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 16:33:29 kjcf05n02 mlnx_conf_mgr[2415]: INFO: No configurations found for mlx5_0, skipping. Nov 3 16:33:29 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 16:33:29 kjcf05n02 sssd[be[implicit_files]][2323]: Starting up Nov 3 16:33:29 kjcf05n02 sssd[nss][2480]: Starting up Nov 3 16:33:29 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 16:33:29 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Login Service... Nov 3 16:33:29 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 16:33:29 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 16:33:29 kjcf05n02 systemd-logind[2579]: New seat seat0. Nov 3 16:33:29 kjcf05n02 systemd-logind[2579]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Login Service. Nov 3 16:33:29 kjcf05n02 python3.9[2128]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 16:33:29 kjcf05n02 python3.9[3209]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 16:33:29 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 16:33:29 kjcf05n02 python3.9[2775]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 16:33:29 kjcf05n02 python3.9[3209]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:29 kjcf05n02 systemd-sysctl[2828]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 16:33:29 kjcf05n02 systemd-sysctl[2828]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 16:33:29 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 16:33:29 kjcf05n02 network[2226]: Bringing up loopback interface: [ OK ] Nov 3 16:33:29 kjcf05n02 systemd-sysctl[3172]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 16:33:29 kjcf05n02 systemd-sysctl[3172]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 16:33:29 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 3 16:33:29 kjcf05n02 systemd[1]: Reached target Network. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 16:33:29 kjcf05n02 python3.9[3134]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 16:33:29 kjcf05n02 python3.9[3209]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 16:33:29 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 16:33:29 kjcf05n02 sm-notify[3211]: Version 2.3.3 starting Nov 3 16:33:29 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 3 16:33:29 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 3 16:33:29 kjcf05n02 sshd[3196]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 16:33:29 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 16:33:29 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 3 16:33:29 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 16:33:29 kjcf05n02 lldpad[3189]: setsockopt nearest_bridge: Invalid argument Nov 3 16:33:29 kjcf05n02 lldpad[3209]: Last message 'setsockopt nearest_b' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:29 kjcf05n02 beSetMlxConfig[2186]: Unloading MST PCI module (unused) - Success Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 3 16:33:29 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 16:33:29 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 16:33:29 kjcf05n02 syslog-ng[3209]: [2024-11-03T22:32:16.673084] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 16:33:29 kjcf05n02 syslog-ng[3209]: [2024-11-03T22:32:16.673483] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 16:33:29 kjcf05n02 syslog-ng[3209]: [2024-11-03T22:32:16.673551] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 16:33:29 kjcf05n02 syslog-ng[3209]: [2024-11-03T22:32:16.674224] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 16:33:29 kjcf05n02 syslog-ng[3209]: [2024-11-03T22:32:16.674578] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 16:33:29 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 3 16:33:29 kjcf05n02 python3.9[3328]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 16:33:29 kjcf05n02 python3.9[3209]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 16:33:29 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 16:33:29 kjcf05n02 python3.9[3451]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 16:33:29 kjcf05n02 python3.9[3209]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 16:33:29 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 16:33:29 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 16:33:29 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 16:33:29 kjcf05n02 chronyd[2127]: System's initial offset : 0.002184 seconds slow of true (slew) Nov 3 16:33:29 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 16:33:29 kjcf05n02 beSetMlxConfig[2186]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 16:33:29 kjcf05n02 beSetMlxConfig[2186]: ib mode Nov 3 16:33:29 kjcf05n02 root[3471]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 3 16:33:29 kjcf05n02 beSetMlxConfig[2186]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 16:33:29 kjcf05n02 root[3473]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 3 16:33:29 kjcf05n02 beSetMlxConfig[2186]: ib mode Nov 3 16:33:29 kjcf05n02 systemd-udevd[1559]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 16:33:29 kjcf05n02 systemd-udevd[3488]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:33:29 kjcf05n02 systemd-udevd[3489]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:33:29 kjcf05n02 systemd-udevd[3492]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:33:29 kjcf05n02 systemd-udevd[3495]: Using default interface naming scheme 'rhel-8.0'. Nov 3 16:33:29 kjcf05n02 systemd-udevd[3495]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:33:29 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 16:33:29 kjcf05n02 systemd[3209]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:29 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[3530]: Setting up Mellanox network interface: ib1 Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[3531]: Setting up Mellanox network interface: ib0 Nov 3 16:33:29 kjcf05n02 systemd-udevd[3490]: Using default interface naming scheme 'rhel-8.0'. Nov 3 16:33:29 kjcf05n02 systemd-udevd[3491]: Using default interface naming scheme 'rhel-8.0'. Nov 3 16:33:29 kjcf05n02 systemd-udevd[3490]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:33:29 kjcf05n02 systemd-udevd[3491]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[3580]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[3581]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[3611]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[3612]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[3613]: No configuration found for ib0 Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[3614]: No configuration found for ib1 Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[3621]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[3622]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 16:33:29 kjcf05n02 mlnx_conf_mgr[3661]: INFO: No configurations found for mlx5_0, skipping. Nov 3 16:33:29 kjcf05n02 mlnx_conf_mgr[3662]: INFO: No configurations found for mlx5_1, skipping. Nov 3 16:33:29 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 16:33:29 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 16:33:29 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 3 16:33:29 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 3 16:33:29 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 16:33:29 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 3 16:33:29 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 3 16:33:29 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 16:33:29 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 16:33:29 kjcf05n02 lldpad[3189]: init_ports: Error adding device ib0 Nov 3 16:33:29 kjcf05n02 lldpad[3189]: init_ports: Error adding device ib1 Nov 3 16:33:29 kjcf05n02 lldpad[3189]: Signal 15 received - terminating Nov 3 16:33:29 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 3 16:33:29 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 16:33:29 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 16:33:29 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 3 16:33:29 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 16:33:29 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 3 16:33:29 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 3 16:33:29 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:29 kjcf05n02 systemd[3209]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:29 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 1 | Nov-03-2024 | 21:32:45 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 2 | Nov-03-2024 | 21:33:37 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 3 | Nov-03-2024 | 21:33:37 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 4 | Nov-03-2024 | 21:34:42 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 5 | Nov-03-2024 | 21:34:43 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 6 | Nov-03-2024 | 22:29:35 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 7 | Nov-03-2024 | 22:29:35 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 8 | Nov-03-2024 | 22:29:35 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 9 | Nov-03-2024 | 22:29:35 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 10 | Nov-03-2024 | 22:29:35 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 11 | Nov-03-2024 | 22:29:35 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 12 | Nov-03-2024 | 22:29:35 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 13 | Nov-03-2024 | 22:29:35 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 14 | Nov-03-2024 | 22:29:35 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 15 | Nov-03-2024 | 22:29:35 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 16 | Nov-03-2024 | 22:29:35 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 17 | Nov-03-2024 | 22:29:35 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 18 | Nov-03-2024 | 22:30:06 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 19 | Nov-03-2024 | 22:30:06 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 20 | Nov-03-2024 | 22:30:06 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 21 | Nov-03-2024 | 22:30:06 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 22 | Nov-03-2024 | 22:30:06 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 23 | Nov-03-2024 | 22:30:06 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 24 | Nov-03-2024 | 22:30:06 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 25 | Nov-03-2024 | 22:30:06 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 26 | Nov-03-2024 | 22:30:06 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 27 | Nov-03-2024 | 22:30:06 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 28 | Nov-03-2024 | 22:30:06 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 16:33:29 kjcf05n02 ipmievd[4004]: 29 | Nov-03-2024 | 22:30:06 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 16:33:29 kjcf05n02 ipmievd[4007]: Reading sensors... Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 3 16:33:29 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:29 kjcf05n02 systemd[3209]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 16:33:29 kjcf05n02 nscd[2159]: 2159 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 16:33:29 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 16:33:29 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 3 16:33:29 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 16:33:29 kjcf05n02 beSetMlxConfig[4065]: ConnectX-3 multiport not detected Nov 3 16:33:29 kjcf05n02 beSetMlxConfig[4065]: Starting MST (Mellanox Software Tools) driver set Nov 3 16:33:29 kjcf05n02 beSetMlxConfig[4065]: Loading MST PCI module - Success Nov 3 16:33:29 kjcf05n02 systemd-udevd[1559]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 16:33:29 kjcf05n02 beSetMlxConfig[4065]: [warn] mst_pciconf is already loaded, skipping Nov 3 16:33:29 kjcf05n02 beSetMlxConfig[4065]: Create devices Nov 3 16:33:29 kjcf05n02 beSetMlxConfig[4065]: Unloading MST PCI module (unused) - Success Nov 3 16:33:29 kjcf05n02 ipmievd[4007]: Waiting for events... Nov 3 16:33:29 kjcf05n02 beSetMlxConfig[4065]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 16:33:29 kjcf05n02 beSetMlxConfig[4065]: ib mode Nov 3 16:33:29 kjcf05n02 beSetMlxConfig[4065]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 16:33:29 kjcf05n02 beSetMlxConfig[4065]: ib mode Nov 3 16:33:29 kjcf05n02 systemd-udevd[1559]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 16:33:29 kjcf05n02 systemd-udevd[4964]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:33:29 kjcf05n02 systemd-udevd[4965]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:33:29 kjcf05n02 systemd-udevd[4969]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:33:29 kjcf05n02 systemd-udevd[4971]: Using default interface naming scheme 'rhel-8.0'. Nov 3 16:33:29 kjcf05n02 systemd-udevd[4971]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:33:29 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 16:33:29 kjcf05n02 systemd[3209]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:29 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[5006]: Setting up Mellanox network interface: ib0 Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[5007]: Setting up Mellanox network interface: ib1 Nov 3 16:33:29 kjcf05n02 systemd-udevd[4966]: Using default interface naming scheme 'rhel-8.0'. Nov 3 16:33:29 kjcf05n02 systemd-udevd[4967]: Using default interface naming scheme 'rhel-8.0'. Nov 3 16:33:29 kjcf05n02 systemd-udevd[4966]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:33:29 kjcf05n02 systemd-udevd[4967]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[5057]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[5056]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[5087]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[5088]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[5089]: No configuration found for ib1 Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[5090]: No configuration found for ib0 Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[5094]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 16:33:29 kjcf05n02 mlnx_interface_mgr[5098]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 16:33:29 kjcf05n02 mlnx_conf_mgr[5134]: INFO: No configurations found for mlx5_1, skipping. Nov 3 16:33:29 kjcf05n02 mlnx_conf_mgr[5138]: INFO: No configurations found for mlx5_0, skipping. Nov 3 16:33:29 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 16:33:29 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}7c1a1833ce2d5c9cec3a770a7a87ad57e4775008132da68becab185022e9381c' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}7c1a1833ce2d5c9cec3a770a7a87ad57e4775008132da68becab185022e9381c' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}11359ccd2974b732fc80f9023370b11ce71b936d0e43e8b9db0827ea954a0f25' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}11359ccd2974b732fc80f9023370b11ce71b936d0e43e8b9db0827ea954a0f25' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}2251740a788f48d9d91ad22e58820ff666d0969d496667a290cbb9ecaa23ad76' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}2251740a788f48d9d91ad22e58820ff666d0969d496667a290cbb9ecaa23ad76' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}4caaa7a4fc7f5fcc49461c05b5cf8fa533f36c4aaa56cac3a4dc26a78c5a3f7b' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}4caaa7a4fc7f5fcc49461c05b5cf8fa533f36c4aaa56cac3a4dc26a78c5a3f7b' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 16:33:29 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 3 16:33:29 kjcf05n02 chronyd[2127]: chronyd exiting Nov 3 16:33:29 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 3 16:33:29 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 16:33:29 kjcf05n02 chronyd[5172]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 16:33:29 kjcf05n02 chronyd[5172]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 16:33:29 kjcf05n02 chronyd[5172]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 16:33:29 kjcf05n02 chronyd[5172]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 16:33:29 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 16:33:29 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:29 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 16:33:29 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 3 16:33:29 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 16:33:29 kjcf05n02 dwd[5204]: dwd: vMay 29 2024 : 15:38:26 Nov 3 16:33:29 kjcf05n02 dwd[5204]: /usr/sbin/dwd -i 15 -d Nov 3 16:33:29 kjcf05n02 dwd[5204]: dwd: option Lethal: 0 Nov 3 16:33:29 kjcf05n02 dwd[5204]: dwd: option Interval: 15 Nov 3 16:33:29 kjcf05n02 dwd[5204]: dwd: option abrtlimit: 10 Nov 3 16:33:29 kjcf05n02 dwd[5204]: dwd: option DZPeriod: 604800 Nov 3 16:33:29 kjcf05n02 dwd[5204]: dwd: option SmartPeriod: 43200 Nov 3 16:33:29 kjcf05n02 dwd[5204]: dwd: option SDDEnabled: 1 Nov 3 16:33:29 kjcf05n02 dwd[5204]: dwd: option SDDAwaitScale: 3 Nov 3 16:33:29 kjcf05n02 dwd[5204]: dwd: option SDDAwaitMin: 100 Nov 3 16:33:29 kjcf05n02 dwd[5204]: dwd: option Verbosity: 1 Nov 3 16:33:29 kjcf05n02 dwd[5204]: dwd: option StandAlone: 0 Nov 3 16:33:29 kjcf05n02 dwd[5204]: option Lethal: 0 Nov 3 16:33:29 kjcf05n02 dwd[5204]: option Interval: 15 Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 16:33:29 kjcf05n02 dwd[5204]: option abrtlimit: 10 Nov 3 16:33:29 kjcf05n02 dwd[5204]: option DZPeriod: 604800 Nov 3 16:33:29 kjcf05n02 dwd[5204]: option SmartPeriod: 43200 Nov 3 16:33:29 kjcf05n02 dwd[5204]: option SDDEnabled: 1 Nov 3 16:33:29 kjcf05n02 dwd[5204]: option SDDAwaitScale: 3 Nov 3 16:33:29 kjcf05n02 dwd[5204]: option SDDAwaitMin: 100 Nov 3 16:33:29 kjcf05n02 dwd[5204]: option Verbosity: 1 Nov 3 16:33:29 kjcf05n02 dwd[5204]: option StandAlone: 0 Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 16:33:29 kjcf05n02 dwd[5205]: option Lethal now set to 1 Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 16:33:29 kjcf05n02 dwd[5205]: option abrtlimit now set to 1 Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 16:33:29 kjcf05n02 dwd[5205]: option SmartPeriod now set to 86400 Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 16:33:29 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 16:33:29 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:29 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:29 kjcf05n02 python3.9[5234]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 16:33:29 kjcf05n02 python3.9[3209]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 16:33:29 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:29 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 16:33:29 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:29 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 3 16:33:29 kjcf05n02 sedcpwrkr[5373]: Using config script: /etc/sedcpwrkr.conf Nov 3 16:33:29 kjcf05n02 sedcpwrkr[5373]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 16:33:29 kjcf05n02 sedcpwrkr[5373]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 16:33:29 kjcf05n02 sedcpwrkr[5373]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 16:33:29 kjcf05n02 sedcpwrkr[5373]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 16:33:29 kjcf05n02 sedcpwrkr[5373]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 16:33:29 kjcf05n02 sedcpwrkr[5373]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 16:33:29 kjcf05n02 sedcpwrkr-server[5404]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 16:33:29 kjcf05n02 sedcpwrkr[5373]: celery multi v5.2.7 (dawn-chorus) Nov 3 16:33:29 kjcf05n02 sedcpwrkr[5373]: > Starting nodes... Nov 3 16:33:29 kjcf05n02 sedcpwrkr[5373]: > sedcpwrkr@kjcf05n02: OK Nov 3 16:33:29 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 16:33:29 kjcf05n02 sedcpwrkr-server[5406]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 16:33:29 kjcf05n02 sedcpwrkr-server[5406]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 16:33:29 kjcf05n02 sedcpwrkr-server[5406]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 16:33:29 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 16:33:29 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 3 16:33:29 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 16:33:29 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 16:33:29 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 16:33:30 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:30 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 16:33:30 kjcf05n02 systemd-udevd[1559]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 16:33:30 kjcf05n02 iptables.init[5473]: iptables: Applying firewall rules: [ OK ] Nov 3 16:33:30 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 3 16:33:30 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:31 kjcf05n02 systemd[3209]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 16:33:31 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 16:33:31 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 16:33:31 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:31 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 16:33:31 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5571 which is not our child. We'll most likely not notice when it exits. Nov 3 16:33:31 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 16:33:31 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:32 kjcf05n02 openhpid[5571]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 16:33:32 kjcf05n02 openhpid[5571]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 16:33:32 kjcf05n02 openhpid[5571]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 16:33:32 kjcf05n02 openhpid[5571]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 16:33:32 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:32 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:32 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:32 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 16:33:32 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 16:33:32 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 16:33:32 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 16:33:32 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:33 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 16:33:33 kjcf05n02 dcs-collectord[5662]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 16:33:33 kjcf05n02 hpi.inv.log[5662]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 16:33:33 kjcf05n02 dcs-collectord[5662]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 16:33:33 kjcf05n02 dcs-collectord[5662]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 16:33:33 kjcf05n02 dcs-collector[5653]: Starting dcs-collector:[ OK ] Nov 3 16:33:33 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 16:33:33 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 16:33:33 kjcf05n02 dcs-collectord[5665]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 16:33:33 kjcf05n02 dcs-collectord[5665]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 16:33:33 kjcf05n02 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 16:33:33 kjcf05n02 dcs-collectord[5665]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 16:33:33 kjcf05n02 dcs-collectord[5665]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 16:33:33 kjcf05n02 dcs-collectord[5665]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 16:33:33 kjcf05n02 dcs-collectord[5665]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 16:33:33 kjcf05n02 dcs-collectord[5665]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259345140", "units": "kB"}, {"name": "MemAvailable", "value": "258625012", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821276", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686872", "units": "kB"}, {"name": "Inactive", "value": "964328", "units": "kB"}, {"name": "Active(anon)", "value": "1520640", "units": "kB"}, {"name": "Inactive(anon)", "value": "828232", "units": "kB"}, {"name": "Active(file)", "value": "166232", "units": "kB"}, {"name": "Inactive(file)", "value": "136096", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "753772", "units": "kB"}, {"name": "Mapped", "value": "86156", "units": "kB"}, {"name": "Shmem", "value": "1593400", "units": "kB"}, {"name": "KReclaimable", "value": "109580", "units": "kB"}, {"name": "Slab", "value": "275588", "units": "kB"}, {"name": "SReclaimable", "value": "109580", "units": "kB"}, {"name": "SUnreclaim", "value": "166008", "units": "kB"}, {"name": "KernelStack", "value": "9808", "units": "kB"}, {"name": "PageTables", "value": "20012", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3232940", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11136", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "6144", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "270664", "units": "kB"}, {"name": "DirectMap2M", "value": "23711744", "units": "kB"}, {"name": "DirectMap1G", "value": "244318208", "units": "kB"}]}' Nov 3 16:33:33 kjcf05n02 dcs-collectord[5665]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 16:33:33 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:33 kjcf05n02 dcs-collectord[5665]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 16:33:33 kjcf05n02 dcs-collectord[5665]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730673213.084378], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730673213.328024], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730673213.0176144, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 16:33:33 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:33 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 16:33:33 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:33 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:33 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 16:33:33 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 16:33:33 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 16:33:33 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 16:33:33 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:33 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 16:33:33 kjcf05n02 firmware-update-orc[5771]: Using config script: /etc/firmware_update_orc.conf Nov 3 16:33:34 kjcf05n02 firmware-update-orc[5771]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 16:33:34 kjcf05n02 firmware-update-orc[5771]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 16:33:34 kjcf05n02 firmware-update-orc[5771]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 16:33:34 kjcf05n02 firmware-update-orc[5771]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 16:33:34 kjcf05n02 firmware-update-orc[5771]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 16:33:34 kjcf05n02 firmware-update-orc[5771]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 16:33:34 kjcf05n02 firmware-update-orc-server[5808]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 16:33:34 kjcf05n02 firmware-update-orc[5771]: celery multi v5.2.7 (dawn-chorus) Nov 3 16:33:34 kjcf05n02 firmware-update-orc[5771]: > Starting nodes... Nov 3 16:33:34 kjcf05n02 firmware-update-orc[5771]: > worker1@kjcf05n02: OK Nov 3 16:33:34 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 16:33:34 kjcf05n02 firmware-update-orc-server[5811]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 16:33:34 kjcf05n02 firmware-update-orc-server[5811]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 16:33:34 kjcf05n02 firmware-update-orc-server[5811]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 16:33:34 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 16:33:34 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:35 kjcf05n02 systemd[3209]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:35 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:35 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:35 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 16:33:35 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 16:33:35 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 16:33:35 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 16:33:35 kjcf05n02 dbus-daemon[2153]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 16:33:35 kjcf05n02 dbus-daemon[2153]: [system] Reloaded configuration Nov 3 16:33:35 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 16:33:35 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 16:33:35 kjcf05n02 dbus-daemon[2153]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 16:33:35 kjcf05n02 dbus-daemon[2153]: [system] Reloaded configuration Nov 3 16:33:35 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 16:33:35 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 16:33:35 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 16:33:35 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 16:33:35 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:35 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 3 16:33:36 kjcf05n02 ras-resource-manager-agent[5927]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 16:33:36 kjcf05n02 ras-resource-manager-agent[5913]: Starting ras-resource-manager-agent:[ OK ] Nov 3 16:33:36 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 16:33:36 kjcf05n02 ras-resource-manager-agent[5929]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 16:33:36 kjcf05n02 ras-resource-manager-client[5929]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 16:33:36 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 3 16:33:36 kjcf05n02 ras-resource-manager-client[5929]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 16:33:36 kjcf05n02 ras-resource-manager-client[5939]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 16:33:36 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:36 kjcf05n02 systemd[3209]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:36 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:36 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:36 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 16:33:36 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 16:33:36 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:36 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 16:33:36 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:36 kjcf05n00 mcfcli[3673891]: %3|1730673216.726|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:33:37 kjcf05n02 systemd[3209]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: Press Ctrl+C to exit. Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: Plugin support version 1.0 Nov 3 16:33:37 kjcf05n02 zabbix_agent2[6013]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 16:33:37 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:37 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:37 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:37 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 16:33:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 16:33:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 16:33:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 16:33:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 16:33:37 kjcf05n02 dcs-notification-sender[6090]: dcs-notification-senderd is stopped Nov 3 16:33:37 kjcf05n02 zabbix-agent2[6104]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 16:33:37 kjcf05n02 dcs-notification-sender[6090]: Starting notification-sender:[ OK ] Nov 3 16:33:37 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 16:33:38 kjcf05n02 zabbix-agent2[6110]: INFO DCS notification agent started. (agent.py:61) Nov 3 16:33:38 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 16:33:38 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:38 kjcf05n02 systemd[3209]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:38 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:38 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:38 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:38 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 16:33:39 kjcf05n02 dcs-collectord[6190]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 16:33:39 kjcf05n02 dcs-collectord[6190]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 16:33:39 kjcf05n02 dcs-bulk-data-sender[6190]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 16:33:39 kjcf05n02 dcs-bulk-data-sender[6181]: Starting bulk-data-sender:[ OK ] Nov 3 16:33:39 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 16:33:39 kjcf05n02 dcs-collectord[6192]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 16:33:39 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 16:33:39 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:39 kjcf05n02 systemd[3209]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:39 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:39 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:39 kjcf05n02 nscd[2159]: 2159 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 16:33:39 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 16:33:39 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 16:33:39 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 16:33:39 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 16:33:39 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 16:33:39 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 16:33:39 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 16:33:39 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 16:33:39 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 16:33:39 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 16:33:39 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 16:33:39 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 16:33:39 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 16:33:39 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 16:33:40 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 16:33:40 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 16:33:40 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 16:33:40 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 16:33:40 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 16:33:40 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 16:33:40 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 3 16:33:40 kjcf05n02 sssd[nss][2480]: Shutting down (status = 0) Nov 3 16:33:40 kjcf05n02 sssd[be[implicit_files]][2323]: Shutting down (status = 0) Nov 3 16:33:40 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 3 16:33:40 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 3 16:33:40 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 16:33:40 kjcf05n02 python3.9[5234]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 16:33:40 kjcf05n02 python3.9[3209]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:40 kjcf05n02 sssd[sssd][6278]: Starting up Nov 3 16:33:40 kjcf05n02 sssd[be[implicit_files]][6279]: Starting up Nov 3 16:33:41 kjcf05n02 sssd[nss][6280]: Starting up Nov 3 16:33:41 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 16:33:41 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 16:33:41 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 16:33:42 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 16:33:42 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 16:33:42 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 16:33:42 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 16:33:42 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 16:33:42 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 16:33:42 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 16:33:42 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 16:33:42 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 16:33:42 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 16:33:42 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 16:33:42 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 16:33:42 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:42 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 16:33:42 kjcf05n02 icinga2[6344]: [2024-11-03 16:33:42 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 16:33:42 kjcf05n02 icinga2[6344]: [2024-11-03 16:33:42 -0600] information/cli: Loading configuration file(s). Nov 3 16:33:42 kjcf05n02 icinga2[6344]: [2024-11-03 16:33:42 -0600] information/ConfigItem: Committing config item(s). Nov 3 16:33:42 kjcf05n02 icinga2[6344]: [2024-11-03 16:33:42 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 3 16:33:42 kjcf05n02 icinga2[6344]: [2024-11-03 16:33:42 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 16:33:42 kjcf05n02 icinga2[6344]: [2024-11-03 16:33:42 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 16:33:42 kjcf05n02 icinga2[6344]: [2024-11-03 16:33:42 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 16:33:42 kjcf05n02 icinga2[6344]: [2024-11-03 16:33:42 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 16:33:42 kjcf05n02 icinga2[6344]: [2024-11-03 16:33:42 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 16:33:42 kjcf05n02 icinga2[6344]: [2024-11-03 16:33:42 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 16:33:42 kjcf05n02 icinga2[6344]: [2024-11-03 16:33:42 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 16:33:42 kjcf05n02 icinga2[6344]: [2024-11-03 16:33:42 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 16:33:42 kjcf05n02 icinga2[6344]: [2024-11-03 16:33:42 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 16:33:42 kjcf05n02 icinga2[6344]: [2024-11-03 16:33:42 -0600] information/cli: Closing console log. Nov 3 16:33:42 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 16:33:42 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:43 kjcf05n02 systemd[3209]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:43 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:43 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:43 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 16:33:43 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 16:33:43 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:43 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 3 16:33:43 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:44 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 16:33:44 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:44 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:44 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 16:33:44 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 16:33:44 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 16:33:44 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 16:33:44 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 16:33:44 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 16:33:44 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 16:33:44 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 16:33:44 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 16:33:44 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 16:33:44 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 16:33:44 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 16:33:44 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 16:33:44 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 16:33:45 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:45 kjcf05n02 dcs-bulk-data-sender[6192]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 16:33:45 kjcf05n02 dcs-collectord[6192]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 16:33:45 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 16:33:45 kjcf05n02 nslcd[7263]: version 0.9.9 starting Nov 3 16:33:45 kjcf05n02 nslcd[7263]: accepting connections Nov 3 16:33:45 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 16:33:45 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:45 kjcf05n02 systemd[3209]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:45 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:45 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:45 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 16:33:45 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 16:33:45 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 16:33:45 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 16:33:46 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 16:33:46 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 16:33:46 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 16:33:46 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 16:33:46 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:46 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 16:33:47 kjcf05n02 dearcpw[7448]: Using config script: /etc/dearcpw.conf Nov 3 16:33:47 kjcf05n02 dearcpw[7448]: - Creating default directory: '/var/log/dearcpw' Nov 3 16:33:47 kjcf05n02 dearcpw[7448]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 16:33:47 kjcf05n02 dearcpw[7448]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 16:33:47 kjcf05n02 dearcpw[7448]: - Creating default directory: '/var/run/dearcpw' Nov 3 16:33:47 kjcf05n02 dearcpw[7448]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 16:33:47 kjcf05n02 dearcpw[7448]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 16:33:47 kjcf05n02 dearcpw-server[7502]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 16:33:47 kjcf05n02 dearcpw[7448]: celery multi v5.2.7 (dawn-chorus) Nov 3 16:33:47 kjcf05n02 dearcpw[7448]: > Starting nodes... Nov 3 16:33:47 kjcf05n02 dearcpw[7448]: > dearcpw@kjcf05n02: OK Nov 3 16:33:47 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 16:33:47 kjcf05n02 dearcpw-server[7504]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 16:33:47 kjcf05n02 dearcpw-server[7504]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 16:33:47 kjcf05n02 dearcpw-server[7504]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 16:33:48 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 3 16:33:48 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:48 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:48 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 16:33:48 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 16:33:48 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 16:33:48 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 16:33:48 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 16:33:48 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 16:33:48 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 16:33:48 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 16:33:48 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 16:33:48 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 16:33:47 kjcf05n00 mcfcli[3673891]: %3|1730673227.730|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 16:33:48 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:39570). Nov 3 16:33:48 kjcf05n01 rsyncd[3189468]: connect from kjcf05n02 (172.16.2.5) Nov 3 16:33:48 kjcf05n01 rsyncd[3189468]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 16:33:48 kjcf05n01 rsyncd[3189468]: receiving file list Nov 3 16:33:48 kjcf05n01 rsyncd[3189468]: sent 29 bytes received 325 bytes total size 10905 Nov 3 16:33:48 kjcf05n01 systemd[1]: rsyncd@644-172.16.2.2:873-172.16.2.5:39570.service: Succeeded. Nov 3 16:33:48 kjcf05n02 puppet[7541]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 3 16:33:48 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 16:33:48 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 16:33:48 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 16:33:48 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 16:33:48 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 16:33:48 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 16:33:48 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 16:33:48 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 16:33:48 kjcf05n02 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 16:33:48 kjcf05n02 dcs-collectord[5665]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 16:33:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 16:33:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 16:33:48 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 16:33:48 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 16:33:49 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 16:33:49 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 16:33:49 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 16:33:49 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 16:33:49 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 16:33:49 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 16:33:50 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 16:33:50 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 16:33:50 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 16:33:50 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 16:33:50 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 16:33:50 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 16:33:51 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 16:33:51 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 16:33:51 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:51 kjcf05n02 ipmievd[4007]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 16:33:51 kjcf05n02 ipmievd[4007]: System Event sensor - Timestamp Clock Sync Nov 3 16:33:51 kjcf05n02 ipmievd[3209]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:51 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 16:33:51 kjcf05n02 diskless-swap[7629]: HA_PS_000: recovering journal Nov 3 16:33:51 kjcf05n02 systemd-udevd[1559]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 16:33:51 kjcf05n02 diskless-swap[7629]: HA_PS_000: clean, 2285/6400 files, 7077/25600 blocks Nov 3 16:33:51 kjcf05n02 diskless-swap[7629]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 16:33:51 kjcf05n02 diskless-swap[7629]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 16:33:51 kjcf05n02 diskless-swap[7629]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 16:33:51 kjcf05n02 diskless-swap[7629]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 16:33:51 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 16:33:51 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:51 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:51 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 16:33:51 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 16:33:51 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 16:33:51 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 16:33:51 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 3 16:33:52 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 3 16:33:52 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 3 16:33:52 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 3 16:33:52 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 3 16:33:52 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 16:33:52 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 16:33:52 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 16:33:52 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 16:33:52 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 16:33:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 16:33:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 16:33:52 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 16:33:52 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 16:33:53 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 16:33:53 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 16:33:53 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 16:33:53 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 16:33:53 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 16:33:53 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 16:33:53 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 16:33:53 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 16:33:54 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 16:33:54 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 16:33:54 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 16:33:54 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 16:33:55 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 16:33:55 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 16:33:55 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 16:33:55 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 16:33:55 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:55 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 3 16:33:55 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:55 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:55 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 16:33:55 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 16:33:55 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:55 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 3 16:33:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 16:33:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 16:33:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 16:33:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 16:33:56 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:56 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:56 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 16:33:56 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 16:33:56 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:56 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 3 16:33:56 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:33:56 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:33:56 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 16:33:56 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 16:33:56 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 16:33:56 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 16:33:56 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 16:33:56 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 16:33:56 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 16:33:56 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 16:33:56 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 16:33:56 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 16:33:56 kjcf05n02 systemd[1]: Reloading. Nov 3 16:33:56 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: kdump: No kdump initial ramdisk found. Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 16:33:57 kjcf05n02 dracut[7971]: dracut-049-135.git20210121.el8 Nov 3 16:33:57 kjcf05n02 dracut[7973]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 16:33:57 kjcf05n02 dracut[7973]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 16:33:57 kjcf05n02 dracut[7973]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 16:33:57 kjcf05n02 dracut[7973]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 16:33:57 kjcf05n02 dracut[7973]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 16:33:57 kjcf05n02 dracut[7973]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 16:33:57 kjcf05n02 dracut[7973]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 16:33:57 kjcf05n02 dracut[7973]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + is_func check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check -h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local dev holder Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + require_binaries mdadm expr Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _module_name=90hperaid Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ mdadm = \-\m ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for cmd in "$@" Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + find_binary mdadm Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for cmd in "$@" Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + find_binary expr Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n -h ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for dev in "${!host_fs_types[@]}" Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ nfs != *_raid_member ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + continue Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _ret=255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + ret=255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ 255 = 0 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ 255 = 255 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ module_depends hperaid Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: +++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: +++ set -x Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ depends Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo rootfs-block Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ return 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ _ret=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ return 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for _moddep in $(module_depends $_mod) Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all == *\ hperaid\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + add_dracutmodules+=' rootfs-block ' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ == *\ hperaid\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check_module rootfs-block Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _mod=rootfs-block Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ == *\ rootfs-block\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n '' ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all == *\ rootfs-block\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + module_check rootfs-block 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 2 -eq 2 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _forced=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + is_func check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check -h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _ret=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + ret=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ 0 = 0 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ module_depends rootfs-block Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: +++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 16:33:57 kjcf05n02 kdumpctl[3209]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ depends Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo fs-lib Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ _ret=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ return 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for _moddep in $(module_depends $_mod) Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all == *\ rootfs-block\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + add_dracutmodules+=' fs-lib ' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ == *\ rootfs-block\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check_module fs-lib Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _mod=fs-lib Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n '' ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + mods_checked_as_dep+=' fs-lib ' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all == *\ fs-lib\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + module_check fs-lib 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 2 -eq 2 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _forced=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + is_func check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check -h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _ret=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + ret=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ 0 = 0 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ module_depends fs-lib Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: +++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ depends Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ return 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ _ret=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ return 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + mods_to_load+=' fs-lib ' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + mods_to_load+=' rootfs-block ' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + mods_to_load+=' hperaid ' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _mod=90kernel-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _mod=kernel-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check_module kernel-modules 1 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _mod=kernel-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all = all ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + module_check kernel-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 1 -eq 2 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + is_func check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check -h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + true Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _ret=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + ret=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ 0 != 0 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ module_depends kernel-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: +++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ depends Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ true Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ _ret=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ return 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + mods_to_load+=' kernel-modules ' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _mod=90kernel-modules-extra Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _mod=kernel-modules-extra Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check_module kernel-modules-extra 1 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _mod=kernel-modules-extra Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all = all ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + module_check kernel-modules-extra Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 1 -eq 2 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + is_func check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check -h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + true Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _ret=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + ret=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ 0 != 0 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ module_depends kernel-modules-extra Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: +++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ depends Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ true Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ _ret=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ return 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + mods_to_load+=' kernel-modules-extra ' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _mod=90kernel-network-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _mod=kernel-network-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check_module kernel-network-modules 1 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _mod=kernel-network-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all = all ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + module_check kernel-network-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 1 -eq 2 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + is_func check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check -h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _ret=255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + ret=255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ 255 != 0 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 1 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _mod=90livenet Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _mod=livenet Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check_module livenet 1 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _mod=livenet Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all = all ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + module_check livenet Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 1 -eq 2 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + is_func check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check -h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _ret=255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + ret=255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ 255 != 0 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 1 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _mod=90lvm Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _mod=lvm Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check_module lvm 1 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _mod=lvm Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all = all ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + module_check lvm Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 16:33:57 kjcf05n02 kdumpctl[3209]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 1 -eq 2 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + is_func check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check -h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + require_binaries lvm Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _module_name=90lvm Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ lvm = \-\m ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for cmd in "$@" Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + find_binary lvm Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n -h ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for fs in "${host_fs_types[@]}" Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ nfs = LVM*_member ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _ret=255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + ret=255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ 255 != 0 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 1 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _mod=90mdraid Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _mod=mdraid Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check_module mdraid 1 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _mod=mdraid Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all = all ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + module_check mdraid Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 1 -eq 2 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + is_func check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check -h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _rootdev Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + require_binaries mdadm expr Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _module_name=90mdraid Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ mdadm = \-\m ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for cmd in "$@" Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + find_binary mdadm Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for cmd in "$@" Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + find_binary expr Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n -h ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for dev in "${!host_fs_types[@]}" Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ nfs != *_raid_member ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + continue Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _ret=255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + ret=255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ 255 != 0 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 1 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _mod=90multipath Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _mod=multipath Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check_module multipath 1 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _mod=multipath Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all = all ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + module_check multipath Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 1 -eq 2 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + is_func check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check -h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _rootdev Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n -h ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for_each_host_dev_and_slaves is_mpath Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _func=is_mpath Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _dev Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for _dev in "${host_devs[@]}" Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + continue Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 1 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _ret=255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + ret=255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ 255 != 0 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 1 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _mod=90qemu Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _mod=qemu Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check_module qemu 1 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _mod=qemu Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all = all ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + module_check qemu Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 1 -eq 2 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + is_func check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check -h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n -h ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + type -P systemd-detect-virt Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ systemd-detect-virt --vm Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + vm=none Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + (( 1 != 0 )) Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _ret=255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + ret=255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ 255 != 0 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 1 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _mod=90qemu-net Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _mod=qemu-net Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check_module qemu-net 1 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _mod=qemu-net Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all = all ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + module_check qemu-net Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 1 -eq 2 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + is_func check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check -h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n -h ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + type -P systemd-detect-virt Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ systemd-detect-virt --vm Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + vm= Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + (( 1 != 0 )) Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _ret=255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + ret=255 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ 255 != 0 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + return 1 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _mod=90stratis Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + _mod=stratis Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check_module stratis 1 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _mod=stratis Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ all = all ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + module_check stratis Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 1 -eq 2 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + is_func check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + check -h Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _module_name=90stratis Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + local _ret=0 Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + [[ stratisd-init = \-\m ]] Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + for cmd in "$@" Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + find_binary stratisd-init Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 16:33:57 kjcf05n02 kdumpctl[7859]: + set +x Nov 3 16:33:57 kjcf05n02 dracut[7973]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 16:33:57 kjcf05n02 dracut[7973]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 16:33:57 kjcf05n02 dracut[7973]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 16:33:58 kjcf05n02 dracut[7973]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 16:33:58 kjcf05n02 dracut[7973]: memstrack is available Nov 3 16:33:58 kjcf05n02 dracut[7973]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 16:33:58 kjcf05n02 dracut[7973]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 16:33:58 kjcf05n02 dracut[7973]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 16:33:58 kjcf05n02 dracut[7973]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 16:33:58 kjcf05n02 dracut[7973]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 16:33:58 kjcf05n02 dracut[7973]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 16:33:58 kjcf05n02 dracut[7973]: *** Including module: bash *** Nov 3 16:33:58 kjcf05n02 dracut[7973]: *** Including module: systemd *** Nov 3 16:33:59 kjcf05n02 dracut[7973]: *** Including module: fips *** Nov 3 16:33:59 kjcf05n02 dracut[7973]: *** Including module: systemd-initrd *** Nov 3 16:33:59 kjcf05n02 dracut[7973]: *** Including module: watchdog-modules *** Nov 3 16:33:59 kjcf05n02 dracut[7973]: *** Including module: nss-softokn *** Nov 3 16:33:59 kjcf05n02 dracut[7973]: *** Including module: i18n *** Nov 3 16:33:59 kjcf05n02 dracut[7973]: No KEYMAP configured. Nov 3 16:33:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 16:33:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 16:33:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 16:33:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 16:34:00 kjcf05n02 dracut[7973]: *** Including module: network-legacy *** Nov 3 16:34:00 kjcf05n02 dracut[7973]: *** Including module: network *** Nov 3 16:34:00 kjcf05n02 dracut[7973]: *** Including module: ib_bonding *** Nov 3 16:34:00 kjcf05n02 dracut[7973]: *** Including module: drm *** Nov 3 16:34:03 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 3 16:34:03 kjcf05n02 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 16:34:03 kjcf05n02 dcs-collectord[5665]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 16:34:04 kjcf05n02 dracut[7973]: *** Including module: hperaid *** Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + install Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + local rule rule_path Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + inst_multiple cat expr Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.v8ucQ8/initramfs -a -f cat expr Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + _ret=0 Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + (( 0 != 0 )) Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + : Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + return 0 Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + inst_multiple -o mdmon Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.v8ucQ8/initramfs -a -f -o mdmon Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + _ret=0 Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + (( 0 != 0 )) Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + : Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + return 0 Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: ++ command -v partx Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + inst /usr/sbin/partx /sbin/partx Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + local _hostonly_install Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + [[ -e /tmp/dracut.v8ucQ8/initramfs//sbin/partx ]] Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.v8ucQ8/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + (( 0 != 0 )) Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + : Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: ++ command -v mdadm Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + local _hostonly_install Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + [[ -e /tmp/dracut.v8ucQ8/initramfs//sbin/mdadm ]] Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.v8ucQ8/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + (( 0 != 0 )) Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + : Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + [[ yes == \y\e\s ]] Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + local _raidconf Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: ++ cmdline Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: ++ local _activated dev line UUID Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: ++ declare -A _activated Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: ++ for dev in "${!host_fs_types[@]}" Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: ++ [[ nfs != *_raid_member ]] Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: ++ continue Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + _raidconf= Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + [[ -n '' ]] Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + inst_rules 64-md-raid.rules Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + local _target=/etc/udev/rules.d _rule _found Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + inst_dir /usr/lib/udev/rules.d Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + [[ -e /tmp/dracut.v8ucQ8/initramfs//usr/lib/udev/rules.d ]] Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + return 0 Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + inst_dir /etc/udev/rules.d Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + [[ -e /tmp/dracut.v8ucQ8/initramfs//etc/udev/rules.d ]] Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + return 0 Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + for _rule in "$@" Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + continue Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + continue Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + for r in '' $dracutbasedir/rules.d/ Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + [[ 64-md-raid.rules != /* ]] Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + continue Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + for r in '' $dracutbasedir/rules.d/ Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + continue Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + [[ -n '' ]] Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + set +x Nov 3 16:34:04 kjcf05n02 dracut[7973]: Skipping udev rule: 64-md-raid.rules Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + installkernel Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + instmods =drivers/md Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + local _optional=-o Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + local _silent Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + local _ret Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + [[ '' = yes ]] Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + [[ =drivers/md = \-\c ]] Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + [[ =drivers/md = \-\s ]] Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + (( 1 == 0 )) Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.v8ucQ8/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + _ret=0 Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + (( 0 != 0 )) Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + [[ -n '' ]] Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + return 0 Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + _ret=0 Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + return 0 Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + modules_loaded+='hperaid ' Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + '[' -n '' ']' Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + _d_mod=90kernel-modules Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + _d_mod=kernel-modules Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + [[ '' = yes ]] Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + dinfo '*** Including module: kernel-modules ***' Nov 3 16:34:04 kjcf05n02 kdumpctl[7859]: + set +x Nov 3 16:34:04 kjcf05n02 dracut[7973]: *** Including module: kernel-modules *** Nov 3 16:34:04 kjcf05n02 dracut[7973]: *** Including module: kernel-modules-extra *** Nov 3 16:34:04 kjcf05n02 dracut[7973]: *** Including module: kernel-network-modules *** Nov 3 16:34:05 kjcf05n02 dracut[7973]: *** Including module: diskless-mod *** Nov 3 16:34:05 kjcf05n02 dracut[7973]: *** Including module: fstab-sys *** Nov 3 16:34:05 kjcf05n02 dracut[7973]: *** Including module: nfs *** Nov 3 16:34:05 kjcf05n02 dracut[7973]: *** Including module: rootfs-block *** Nov 3 16:34:05 kjcf05n02 dracut[7973]: *** Including module: terminfo *** Nov 3 16:34:05 kjcf05n02 dracut[7973]: *** Including module: udev-rules *** Nov 3 16:34:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730673245', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 2.55, 2.05, 0.89'}"] Nov 3 16:34:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 2.55, 2.05, 0.89', 'message': 'OK - load average: 2.55, 2.05, 0.89', 'value': 'ok', 'timestamp': '1730673245'} Nov 3 16:34:06 kjcf05n02 dracut[7973]: Skipping udev rule: 91-permissions.rules Nov 3 16:34:06 kjcf05n02 dracut[7973]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 16:34:06 kjcf05n02 dracut[7973]: *** Including module: dracut-systemd *** Nov 3 16:34:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:34:07 kjcf05n02 dracut[7973]: *** Including module: usrmount *** Nov 3 16:34:07 kjcf05n02 dracut[7973]: *** Including module: base *** Nov 3 16:34:07 kjcf05n02 dracut[7973]: *** Including module: fs-lib *** Nov 3 16:34:07 kjcf05n02 dracut[7973]: *** Including module: kdumpbase *** Nov 3 16:34:07 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 3 16:34:07 kjcf05n02 dracut[7973]: *** Including module: memstrack *** Nov 3 16:34:08 kjcf05n02 dracut[7973]: *** Including module: shutdown *** Nov 3 16:34:08 kjcf05n02 dracut[7973]: *** Including module: squash *** Nov 3 16:34:08 kjcf05n02 dracut[7973]: *** Including modules done *** Nov 3 16:34:08 kjcf05n02 dracut[7973]: *** Installing kernel module dependencies *** Nov 3 16:34:08 kjcf05n02 dracut[7973]: *** Installing kernel module dependencies done *** Nov 3 16:34:08 kjcf05n02 dracut[7973]: *** Resolving executable dependencies *** Nov 3 16:34:09 kjcf05n02 dracut[7973]: *** Resolving executable dependencies done*** Nov 3 16:34:09 kjcf05n02 dracut[7973]: *** Hardlinking files *** Nov 3 16:34:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730673249', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 340 processes with STATE = RSZDT '}"] Nov 3 16:34:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 340 processes with STATE = RSZDT ', 'message': 'PROCS OK: 340 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730673249'} Nov 3 16:34:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:34:10 kjcf05n02 dracut[7973]: *** Hardlinking files done *** Nov 3 16:34:10 kjcf05n02 dracut[7973]: *** Generating early-microcode cpio image *** Nov 3 16:34:10 kjcf05n02 dracut[7973]: *** Constructing AuthenticAMD.bin **** Nov 3 16:34:10 kjcf05n02 dracut[7973]: *** Store current command line parameters *** Nov 3 16:34:10 kjcf05n02 dracut[7973]: Stored kernel commandline: Nov 3 16:34:10 kjcf05n02 dracut[7973]: rd.driver.pre=sd_mod Nov 3 16:34:10 kjcf05n02 dracut[7973]: rd.driver.pre=nvme Nov 3 16:34:10 kjcf05n02 dracut[7973]: rd.driver.pre=ipmi_si Nov 3 16:34:10 kjcf05n02 dracut[7973]: rd.driver.pre=ipmi_devintf Nov 3 16:34:10 kjcf05n02 dracut[7973]: rd.driver.pre=ipmi_msghandler Nov 3 16:34:10 kjcf05n02 dracut[7973]: nameserver=172.16.2.2 Nov 3 16:34:10 kjcf05n02 dracut[7973]: nameserver=127.0.0.1 Nov 3 16:34:10 kjcf05n02 dracut[7973]: nameserver=172.16.2.2 Nov 3 16:34:10 kjcf05n02 dracut[7973]: nameserver=127.0.0.1 Nov 3 16:34:10 kjcf05n02 dracut[7973]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 3 16:34:10 kjcf05n02 dracut[7973]: rd.neednet Nov 3 16:34:10 kjcf05n02 dracut[7973]: kdumpnic=mgmt0 Nov 3 16:34:10 kjcf05n02 dracut[7973]: bootdev=mgmt0 Nov 3 16:34:10 kjcf05n02 dracut[7973]: *** Install squash loader *** Nov 3 16:34:10 kjcf05n02 dracut[7973]: *** Squashing the files inside the initramfs *** Nov 3 16:34:10 kjcf05n00 zabbix-server[1406565]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:34:10 kjcf05n00 zabbix-server[1406565]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:51\\"}}"' Nov 3 16:34:10 kjcf05n00 log_interesting_event.py[1406565]: Event '46410' acknowledged Nov 3 16:34:11 kjcf05n02 dracut[7973]: *** Squashing the files inside the initramfs done *** Nov 3 16:34:11 kjcf05n02 dracut[7973]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 16:34:11 kjcf05n02 dracut[7973]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 16:34:10 kjcf05n00 zabbix-server[1406578]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:34:10 kjcf05n00 zabbix-server[1406578]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 3 16:34:11 kjcf05n00 log_interesting_event.py[1406578]: Event '46413' acknowledged Nov 3 16:34:11 kjcf05n00 zabbix-server[1406585]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:34:11 kjcf05n00 zabbix-server[1406585]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 3 16:34:11 kjcf05n00 log_interesting_event.py[1406585]: Event '46414' acknowledged Nov 3 16:34:11 kjcf05n00 mcfcli[3673891]: %3|1730673251.409|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:34:11 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 16:34:11 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 3 16:34:11 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 16:34:11 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running Nov 3 16:34:11 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 3 16:34:11 kjcf05n02 kdumpctl[7859]: kdump: kexec: loaded kdump kernel Nov 3 16:34:11 kjcf05n02 kdumpctl[7859]: kdump: Starting kdump: [OK] Nov 3 16:34:11 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 3 16:34:11 kjcf05n02 systemd[1]: Reloading. Nov 3 16:34:12 kjcf05n02 systemd[3209]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:34:12 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:34:12 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:34:12 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 16:34:12 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 16:34:12 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 16:34:12 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 16:34:12 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 16:34:12 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 16:34:12 kjcf05n02 ifdown[14667]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 16:34:12 kjcf05n02 ifdown[14668]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:34:12 kjcf05n02 ifdown[14669]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:34:12 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 16:34:12 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 16:34:12 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 16:34:12 kjcf05n02 ifup[14731]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 16:34:12 kjcf05n02 ifup[14732]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:34:12 kjcf05n02 ifup[14733]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:34:15 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 16:34:16 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 16:34:17 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 16:34:17 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 16:34:17 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:34:17 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:34:17 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:34:17 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:34:17 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 16:34:17 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 16:34:17 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 16:34:17 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 16:34:17 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:34:17 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:34:17 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:34:17 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:34:17 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 16:34:17 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 16:34:17 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 16:34:17 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 16:34:17 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 16:34:17 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 16:34:17 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 16:34:17 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 16:34:17 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 16:34:17 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 16:34:17 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 16:34:17 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 16:34:17 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 16:34:17 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 16:34:17 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 16:34:17 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 16:34:17 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 16:34:17 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 16:34:17 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 16:34:17 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 16:34:17 kjcf05n02 ifdown[14907]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 16:34:17 kjcf05n02 ifdown[14908]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:34:17 kjcf05n02 ifdown[14923]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:34:17 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 16:34:17 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 16:34:17 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 16:34:17 kjcf05n02 ifup[14985]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 16:34:17 kjcf05n02 ifup[14988]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:34:17 kjcf05n02 ifup[14990]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:34:17 kjcf05n00 mcfcli[3673891]: %3|1730673257.730|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:34:18 kjcf05n02 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 16:34:18 kjcf05n02 dcs-collectord[5665]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 16:34:19 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 16:34:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730673259', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.4% (3710132 kB) used.'}"] Nov 3 16:34:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.4% (3710132 kB) used.', 'message': 'OK - 1.4% (3710132 kB) used.', 'value': 'ok', 'timestamp': '1730673259'} Nov 3 16:34:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:34:20 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 16:34:20 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 3 16:34:20 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 16:34:20 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running Nov 3 16:34:20 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 3 16:34:21 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 16:34:22 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 16:34:22 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 16:34:22 kjcf05n02 systemd[1]: Reloading. Nov 3 16:34:22 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 3 16:34:22 kjcf05n02 await_ha_peer[15283]: Waiting for HA peer kjcf05n03 Nov 3 16:34:23 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 16:34:23 kjcf05n02 await_ha_peer[15283]: Peer kjcf05n03 has started, starting HA Nov 3 16:34:24 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 3 16:34:24 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 3 16:34:24 kjcf05n02 fstonithd.py[15325]: Listening for kdump packets from partner Nov 3 16:34:24 kjcf05n02 systemd[1]: Reloading. Nov 3 16:34:24 kjcf05n02 systemd[3209]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:34:24 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:34:24 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:34:24 kjcf05n02 systemd[1]: Reloading. Nov 3 16:34:24 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 3 16:34:24 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 16:34:24 kjcf05n02 systemd[1]: Reloading. Nov 3 16:34:25 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 16:34:25 kjcf05n02 puppet-agent[3596]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 16:34:25 kjcf05n02 puppet[3596]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 16:34:25 kjcf05n02 puppet-agent[3596]: Applied catalog in 92.60 seconds Nov 3 16:34:25 kjcf05n02 puppet[3596]: Notice: Applied catalog in 92.60 seconds Nov 3 16:34:25 kjcf05n02 systemd[1]: Started Puppet agent. Nov 3 16:34:25 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 16:34:25 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 16:34:25 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 16:34:25 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 3 16:34:25 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 16:34:25 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 16:34:25 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 16:34:25 kjcf05n02 systemd[1]: Reached target Timers. Nov 3 16:34:25 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 16:34:25 kjcf05n02 wce-disable.sh[15482]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 16:34:25 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 16:34:25 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 16:34:25 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 16:34:25 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 16:34:25 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 3 16:34:25 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 3 16:34:25 kjcf05n02 python3.9[15480]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 16:34:25 kjcf05n02 python3.9[15480]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 16:34:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730673265', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 16:34:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730673265'} Nov 3 16:34:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:34:26 kjcf05n02 gateway-ec-node.py[15479]: Starting gateway-ec-node service Nov 3 16:34:26 kjcf05n02 RFSF-API[15478]: INFO[2024-11-03T16:34:25-06:00] Datapath API RESTful Service starting Nov 3 16:34:26 kjcf05n02 dp-api-server-node[15478]: INFO[2024-11-03T16:34:25-06:00] Datapath API RESTful Service starting Nov 3 16:34:26 kjcf05n02 RFSF-API[15478]: INFO[2024-11-03T16:34:25-06:00] Running in production mode, starting dbus event listener Nov 3 16:34:26 kjcf05n02 dp-api-server-node[15478]: INFO[2024-11-03T16:34:25-06:00] Running in production mode, starting dbus event listener Nov 3 16:34:26 kjcf05n02 RFSF-API[15478]: INFO[2024-11-03T16:34:25-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 16:34:26 kjcf05n02 dp-api-server-node[15478]: INFO[2024-11-03T16:34:25-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 16:34:26 kjcf05n02 RFSF-API[15478]: INFO[2024-11-03T16:34:25-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 16:34:26 kjcf05n02 dp-api-server-node[15478]: INFO[2024-11-03T16:34:25-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 16:34:26 kjcf05n02 RFSF-API[15478]: INFO[2024-11-03T16:34:25-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 16:34:26 kjcf05n02 dp-api-server-node[15478]: INFO[2024-11-03T16:34:25-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 16:34:26 kjcf05n02 RFSF-API[15478]: INFO[2024-11-03T16:34:25-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 16:34:26 kjcf05n02 dp-api-server-node[15478]: INFO[2024-11-03T16:34:25-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 16:34:26 kjcf05n02 RFSF-API[15478]: INFO[2024-11-03T16:34:25-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 16:34:26 kjcf05n02 dp-api-server-node[15478]: INFO[2024-11-03T16:34:25-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 16:34:26 kjcf05n02 RFSF-API[15478]: INFO[2024-11-03T16:34:25-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 16:34:26 kjcf05n02 dp-api-server-node[15478]: INFO[2024-11-03T16:34:25-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 16:34:26 kjcf05n02 RFSF-API[15478]: INFO[2024-11-03T16:34:25-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 16:34:26 kjcf05n02 dp-api-server-node[15478]: INFO[2024-11-03T16:34:25-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 16:34:26 kjcf05n02 RFSF-API[15478]: INFO[2024-11-03T16:34:25-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 16:34:26 kjcf05n02 dp-api-server-node[15478]: INFO[2024-11-03T16:34:25-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 16:34:26 kjcf05n02 RFSF-API[15478]: INFO[2024-11-03T16:34:25-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 16:34:26 kjcf05n02 dp-api-server-node[15478]: INFO[2024-11-03T16:34:25-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 16:34:26 kjcf05n02 RFSF-API[15478]: INFO[2024-11-03T16:34:25-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 16:34:26 kjcf05n02 dp-api-server-node[15478]: INFO[2024-11-03T16:34:25-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 16:34:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730673266', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 16:34:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730673266'} Nov 3 16:34:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:34:29 kjcf05n02 systemd[1]: Reloading. Nov 3 16:34:29 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 16:34:29 kjcf05n02 systemd[1]: Reloading. Nov 3 16:34:29 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 16:34:30 kjcf05n02 diskmonitor_pre[15921]: Key management is currently disabled.DEAR disabled Nov 3 16:34:30 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 16:34:32 kjcf05n02 sh[15988]: LNET configured: New Created Nov 3 16:34:32 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 16:34:32 kjcf05n02 LCNmon[18082]: Interface ib0 is up Nov 3 16:34:32 kjcf05n02 LCNmon[18082]: Interface ib1 is up Nov 3 16:34:33 kjcf05n02 dcs-collectord[5665]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 16:34:33 kjcf05n02 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 16:34:33 kjcf05n02 dcs-collectord[5665]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: /var/run/diskmonitor does not exist, creating Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: Creating /var/run/diskmonitor/disk Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: Creating /var/run/diskmonitor/encl Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: Creating /var/run/diskmonitor/cli Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: RAS_Interlocks_enabled: 1 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: add handler for sig: 14 sa_flags: 10000004 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: add handler for sig: 1 sa_flags: 10000004 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: add handler for sig: 2 sa_flags: 00000004 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: add handler for sig: 15 sa_flags: 00000004 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: add handler for sig: 6 sa_flags: 00000004 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: add handler for sig: 3 sa_flags: 00000004 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: add handler for sig: 30 sa_flags: 00000004 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: add handler for sig: 20 sa_flags: 00000004 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: add handler for sig: 10 sa_flags: 10000004 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: add handler for sig: 11 sa_flags: 00000004 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: add handler for sig: 7 sa_flags: 00000004 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: add handler for sig: 4 sa_flags: 00000004 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: add handler for sig: 8 sa_flags: 00000004 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: Using HA Baton locks - key: diskmonitor Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: Baton will be held for at most 570 seconds Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: DMMP Enabled: 0 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: random seed: 7a23e594 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: NVMe Enclosure: 1 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: ZFS Enclosure: 0 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: Dbus, Initialized Connection Successfully Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: int_catcher_thread: thread start Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: Received dbus message 4 org.freedesktop.DBus -> :1.110 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 16:34:34 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 16:34:35 kjcf05n00 httpd[902563]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 16:34:36 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 16:34:36 kjcf05n02 LCNmon[18082]: 10.16.100.54 is unreachable via ib0 Nov 3 16:34:36 kjcf05n02 LCNmon[18082]: Can ping through interface ib0 Nov 3 16:34:36 kjcf05n02 LCNmon[18082]: Can ping through interface ib1 Nov 3 16:34:36 kjcf05n02 LCNmon[18082]: NIC ib0, initial state UP Nov 3 16:34:36 kjcf05n02 LCNmon[18082]: NIC ib1, initial state UP Nov 3 16:34:36 kjcf05n02 LCNmon[18082]: LCNstat initial state UP Nov 3 16:34:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730673276', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 16:34:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730673276', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 16:34:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730673276'} Nov 3 16:34:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:34:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730673276'} Nov 3 16:34:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:34:36 kjcf05n02 LCNmon[18082]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 3 16:34:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 16:34:38 kjcf05n02 openhpid[5571]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 16:34:38 kjcf05n02 openhpid[5571]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 16:34:38 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 3 16:34:38 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 16:34:38 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 16:34:38 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18710 which is not our child. We'll most likely not notice when it exits. Nov 3 16:34:38 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 16:34:38 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 3 16:34:38 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 3 16:34:38 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 16:34:38 kjcf05n02 dcs-collectord[5665]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 16:34:38 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 16:34:38 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 16:34:38 kjcf05n02 systemd[1]: Startup finished in 50.416s (kernel) + 2min 28.863s (userspace) = 3min 19.279s. Nov 3 16:34:38 kjcf05n02 openhpid[18710]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 16:34:38 kjcf05n02 openhpid[18710]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 16:34:38 kjcf05n02 openhpid[18710]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 16:34:38 kjcf05n02 openhpid[18710]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 16:34:38 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18750 (bash) Nov 3 16:34:38 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 16:34:38 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 16:34:38 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 16:34:38 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 16:34:38 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 3 16:34:41 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 16:34:43 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31450 deleted. Nov 3 16:34:43 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31451 deleted. Nov 3 16:34:47 kjcf05n00 mcfcli[3673891]: %3|1730673287.730|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 16:34:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730673288', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(3108.0B/2640.0B), ib1=(2828.0B/2736.0B), icl0=(8.2kB/9.9kB), lo=(1080.0B/1080.0B), meth0=(1541.7MB/8.4MB), mgmt0=(1478.4MB/8.3MB)'}"] Nov 3 16:34:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(3108.0B/2640.0B), ib1=(2828.0B/2736.0B), icl0=(8.2kB/9.9kB), lo=(1080.0B/1080.0B), meth0=(1541.7MB/8.4MB), mgmt0=(1478.4MB/8.3MB)', 'message': 'NET OK - (Rx/Tx) ib0=(3108.0B/2640.0B), ib1=(2828.0B/2736.0B), icl0=(8.2kB/9.9kB), lo=(1080.0B/1080.0B), meth0=(1541.7MB/8.4MB), mgmt0=(1478.4MB/8.3MB)', 'value': 'ok', 'timestamp': '1730673288'} Nov 3 16:34:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:34:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730673288', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 16:34:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730673288'} Nov 3 16:34:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:34:48 kjcf05n02 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 16:34:48 kjcf05n02 dcs-collectord[5665]: WARNING No data collected (hpi_parser.py:353) Nov 3 16:34:49 kjcf05n00 mcfcli[3673891]: %3|1730673289.259|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:35:01 kjcf05n02 ipmievd[4007]: System Event sensor - Timestamp Clock Sync Nov 3 16:35:03 kjcf05n02 ipmievd[3209]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:35:03 kjcf05n02 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 16:35:13 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 16:35:17 kjcf05n00 mcfcli[3673891]: %3|1730673317.730|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 16:35:18 kjcf05n02 dcs-collectord[5665]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 16:35:18 kjcf05n00 python3.9[1407384]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 16:35:21 kjcf05n03 firmware-update-orc-server[5845]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "751430e8-e2a4-4d00-99e9-d3ba23a35397"} (logger.py:65) Nov 3 16:35:21 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 84228 (get_disk_device) Nov 3 16:35:21 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 16:35:21 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 16:35:21 kjcf05n03 ccp-client[84252]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 16:35:21 kjcf05n03 ccp-client[84252]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 16:35:21 kjcf05n03 ccp-client[84263]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 16:35:21 kjcf05n03 ccp-client[84252]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 16:35:21 kjcf05n03 ccp-client[84252]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 16:35:21 kjcf05n03 ccp-client[84263]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 16:35:21 kjcf05n03 ccp-client[84263]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 16:35:21 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'e8bd0cca-9a33-11ef-9bc6-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 16:35:21 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'e8bd0cca-9a33-11ef-9bc6-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 16:35:21 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': 'e8bd0cca-9a33-11ef-9bc6-00093d0695e3', 'response ID': 'e8c7612a-9a33-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 16:35:21 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: e8c7612a-9a33-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 16:35:21 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 16:35:21 kjcf05n02 ras-resource-manager-agent[5929]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "e8bd0cca-9a33-11ef-9bc6-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 16:35:21 kjcf05n02 ras-resource-manager-agent[5929]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'e8bd0cca-9a33-11ef-9bc6-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 16:35:21 kjcf05n02 ras-resource-manager-agent[5929]: INFO Submitting new device inserted signal, starting to qualify drive: e8bd0cca-9a33-11ef-9bc6-00093d0695e3 (admin_action.py:110) Nov 3 16:35:21 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'e90f7b72-9a33-11ef-9bc6-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 16:35:21 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'e90f7b72-9a33-11ef-9bc6-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 16:35:21 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': 'e90f7b72-9a33-11ef-9bc6-00093d0695e3', 'response ID': 'e917570c-9a33-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 16:35:21 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: e917570c-9a33-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 16:35:22 kjcf05n02 diskmonitor[17677]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 16:35:22 kjcf05n02 ras-resource-manager-agent[5929]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "e90f7b72-9a33-11ef-9bc6-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 16:35:22 kjcf05n02 ras-resource-manager-agent[5929]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'e90f7b72-9a33-11ef-9bc6-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 16:35:22 kjcf05n02 ras-resource-manager-agent[5929]: INFO Submitting new device inserted signal, starting to qualify drive: e90f7b72-9a33-11ef-9bc6-00093d0695e3 (admin_action.py:110) Nov 3 16:35:22 kjcf05n02 firmware-update-orc-server[5885]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "0ae9ff63-3748-4c6b-b4f1-aa79f5b8812b"} (logger.py:65) Nov 3 16:35:24 kjcf05n03 DRVFW[84475]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 16:35:24 kjcf05n03 ccp-client[84476]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 16:35:24 kjcf05n03 ccp-client[84476]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 16:35:24 kjcf05n03 ccp-client[84485]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 16:35:24 kjcf05n03 ccp-client[84476]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 16:35:24 kjcf05n03 ccp-client[84476]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 16:35:24 kjcf05n03 ccp-client[84485]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 16:35:24 kjcf05n03 ccp-client[84485]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 16:35:24 kjcf05n03 firmware-update-orc-server[5845]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 16:35:25 kjcf05n02 ras-resource-manager-agent[5929]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'e8bd0cca-9a33-11ef-9bc6-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 16:35:25 kjcf05n02 ras-resource-manager-agent[5929]: INFO Drive qualification complete responding: e8bd0cca-9a33-11ef-9bc6-00093d0695e3 (admin_action.py:205) Nov 3 16:35:25 kjcf05n02 ras-resource-manager-agent[5929]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "e8bd0cca-9a33-11ef-9bc6-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (interesting_event.py:59) Nov 3 16:35:25 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: e8c7612a-9a33-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 16:35:25 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': 'e8bd0cca-9a33-11ef-9bc6-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': 'e8bd0cca-9a33-11ef-9bc6-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}}} (logger.py:65) Nov 3 16:35:28 kjcf05n00 mcfcli[3673891]: %3|1730673328.458|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:35:29 kjcf05n02 diskmonitor[17677]: 004 Nov 3 16:35:29 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 16:35:29 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 16:35:29 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 16:35:29 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 16:35:29 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 16:35:29 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 16:35:29 kjcf05n02 diskmonitor[17677]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 16:35:29 kjcf05n02 diskmonitor[17677]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 16:35:29 kjcf05n02 diskmonitor[17677]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 16:35:29 kjcf05n02 diskmonitor[17677]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 16:35:29 kjcf05n02 diskmonitor[17677]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 16:35:29 kjcf05n02 diskmonitor[17677]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "e8bd0cca-9a33-11ef-9bc6-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 16:35:29 kjcf05n02 diskmonitor[17677]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 16:35:29 kjcf05n02 diskmonitor[17677]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 16:35:29 kjcf05n02 diskmonitor[17677]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "e90f7b72-9a33-11ef-9bc6-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 16:35:29 kjcf05n02 diskmonitor[17677]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 16:35:29 kjcf05n02 diskmonitor[17677]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 16:35:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730673031', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 16:35:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730673031'} Nov 3 16:35:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:35:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730673031', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 16:35:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730673031'} Nov 3 16:35:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:35:34 kjcf05n02 chronyd[5172]: Selected source 172.16.2.1 Nov 3 16:35:36 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22634 (get_disk_device) Nov 3 16:35:36 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 16:35:36 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 16:35:36 kjcf05n02 ccp-client[22655]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 16:35:37 kjcf05n02 ccp-client[22655]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 16:35:37 kjcf05n02 ccp-client[22676]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 16:35:37 kjcf05n02 ccp-client[22655]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 16:35:37 kjcf05n02 ccp-client[22655]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 16:35:37 kjcf05n02 ccp-client[22676]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 16:35:37 kjcf05n02 ccp-client[22676]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 16:35:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730673337}"] Nov 3 16:35:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730673337, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:35:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:35:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730673337}"] Nov 3 16:35:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730673337, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:35:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:35:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730673337}"] Nov 3 16:35:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730673337, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:35:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:35:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730673337}"] Nov 3 16:35:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730673337, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:35:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:35:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730673337}"] Nov 3 16:35:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730673337, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:35:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:35:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730673337}"] Nov 3 16:35:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730673337, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:35:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:35:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730673338}"] Nov 3 16:35:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730673338, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:35:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:35:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730673338}"] Nov 3 16:35:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730673338, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:35:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:35:39 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 3 16:35:39 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 16:35:39 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 3 16:35:40 kjcf05n02 DRVFW[23017]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 16:35:40 kjcf05n02 ccp-client[23022]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 16:35:40 kjcf05n02 ccp-client[23022]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 16:35:40 kjcf05n02 ccp-client[23036]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 16:35:40 kjcf05n02 ccp-client[23022]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 16:35:40 kjcf05n02 ccp-client[23022]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 16:35:40 kjcf05n02 ccp-client[23036]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 16:35:40 kjcf05n02 ccp-client[23036]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 16:35:40 kjcf05n02 firmware-update-orc-server[5885]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 16:35:41 kjcf05n02 python3.9[5234]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 16:35:41 kjcf05n02 python3.9[3209]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:35:41 kjcf05n02 ras-resource-manager-agent[5929]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'e90f7b72-9a33-11ef-9bc6-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 16:35:41 kjcf05n02 ras-resource-manager-agent[5929]: INFO Drive qualification complete responding: e90f7b72-9a33-11ef-9bc6-00093d0695e3 (admin_action.py:205) Nov 3 16:35:41 kjcf05n02 ras-resource-manager-agent[5929]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "e90f7b72-9a33-11ef-9bc6-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 3 16:35:41 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: e917570c-9a33-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 16:35:41 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': 'e90f7b72-9a33-11ef-9bc6-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': 'e90f7b72-9a33-11ef-9bc6-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}}} (logger.py:65) Nov 3 16:35:45 kjcf05n02 ras-resource-manager-agent[5929]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "e8bd0cca-9a33-11ef-9bc6-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (service_main_handler.py:66) Nov 3 16:35:45 kjcf05n02 ras-resource-manager-agent[5929]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'e8bd0cca-9a33-11ef-9bc6-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 16:35:45 kjcf05n02 ras-resource-manager-agent[5929]: INFO Device qualification response has been acknowledged: e8bd0cca-9a33-11ef-9bc6-00093d0695e3 (admin_action.py:151) Nov 3 16:35:45 kjcf05n02 ras-resource-manager-agent[5929]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "e90f7b72-9a33-11ef-9bc6-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 3 16:35:45 kjcf05n02 ras-resource-manager-agent[5929]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'e90f7b72-9a33-11ef-9bc6-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 3 16:35:45 kjcf05n02 ras-resource-manager-agent[5929]: INFO Device qualification response has been acknowledged: e90f7b72-9a33-11ef-9bc6-00093d0695e3 (admin_action.py:151) Nov 3 16:35:47 kjcf05n00 mcfcli[3673891]: %3|1730673347.730|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "e8bd0cca-9a33-11ef-9bc6-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: Dbus, handle_ingress_ras_signals, uuid: e8bd0cca-9a33-11ef-9bc6-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "e8bd0cca-9a33-11ef-9bc6-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "e90f7b72-9a33-11ef-9bc6-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: Dbus, handle_ingress_ras_signals, uuid: e90f7b72-9a33-11ef-9bc6-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "e90f7b72-9a33-11ef-9bc6-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 16:35:48 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 16:35:49 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 16:35:50 kjcf05n02 diskmonitor[17677]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 16:35:55 kjcf05n02 diskmonitor[17677]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 16:35:55 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 16:35:55 kjcf05n02 diskmonitor[17677]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 16:35:55 kjcf05n02 diskmonitor[17677]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 16:35:55 kjcf05n02 diskmonitor[17677]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 16:35:55 kjcf05n02 diskmonitor[17677]: leaving test state: 1 next state: 2 Nov 3 16:35:55 kjcf05n02 diskmonitor[17677]: lock req: no timeout Nov 3 16:35:55 kjcf05n02 diskmonitor[17677]: leaving test state: 2 next state: 4 Nov 3 16:35:55 kjcf05n02 diskmonitor[17677]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 16:36:07 kjcf05n00 mcfcli[3673891]: %3|1730673367.184|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:36:17 kjcf05n00 mcfcli[3673891]: %3|1730673377.731|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 16:36:42 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 16:36:42 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 16:36:42 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 16:36:46 kjcf05n00 zabbix-server[1408539]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:36:46 kjcf05n00 zabbix-server[1408539]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 92.77\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 91.19\\"}}"' Nov 3 16:36:46 kjcf05n00 log_interesting_event.py[1408539]: Event '46427' acknowledged Nov 3 16:36:47 kjcf05n00 mcfcli[3673891]: %3|1730673407.182|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:36:47 kjcf05n00 mcfcli[3673891]: %3|1730673407.731|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 16:36:54 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 16:36:57 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 16:36:57 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 16:36:57 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 16:36:59 kjcf05n02 dcs-collectord[5665]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 16:37:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730673427}"] Nov 3 16:37:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730673427, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:37:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:37:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:37:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:37:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:37:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:37:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:37:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:37:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:37:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:37:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:37:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:37:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:37:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:37:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.366562ms Nov 3 16:37:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:37:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.366562ms Nov 3 16:37:08 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:37:08 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:37:08 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:37:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730673428}"] Nov 3 16:37:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730673428, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:37:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:37:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:37:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:37:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:37:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:37:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:37:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:37:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:37:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:37:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:37:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:37:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:37:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:37:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.879891ms Nov 3 16:37:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:37:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.879891ms Nov 3 16:37:08 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:37:08 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:37:08 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:37:10 kjcf05n02 diskmonitor[17677]: lock acquired Nov 3 16:37:10 kjcf05n02 diskmonitor[17677]: leaving test state: 4 next state: 8 Nov 3 16:37:17 kjcf05n00 mcfcli[3673891]: %3|1730673437.731|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:37:25 kjcf05n00 mcfcli[3673891]: %3|1730673445.656|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:37:31 kjcf05n02 diskmonitor[17677]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 16:37:31 kjcf05n02 diskmonitor[17677]: leaving test state: 8 next state: 20 Nov 3 16:37:31 kjcf05n02 diskmonitor[17677]: leaving test state: 20 next state: 40 Nov 3 16:37:31 kjcf05n02 diskmonitor[17677]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 2ca06870000 Nov 3 16:37:31 kjcf05n02 diskmonitor[17677]: leaving test state: 40 next state: 80 Nov 3 16:37:47 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 16:37:47 kjcf05n00 mcfcli[3673891]: %3|1730673467.732|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 16:37:59 kjcf05n02 diskmonitor[17677]: leaving test state: 80 next state: 100 Nov 3 16:37:59 kjcf05n02 diskmonitor[17677]: lock release: time: Sun Nov 3 16:37:52 2024 Nov 3 16:37:59 kjcf05n02 diskmonitor[17677]: leaving test state: 100 next state: 1 Nov 3 16:38:00 kjcf05n00 mcfcli[3673891]: %3|1730673480.875|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:38:17 kjcf05n00 mcfcli[3673891]: %3|1730673497.732|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:38:40 kjcf05n00 mcfcli[3673891]: %3|1730673520.519|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:38:47 kjcf05n00 mcfcli[3673891]: %3|1730673527.732|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:39:17 kjcf05n00 mcfcli[3673891]: %3|1730673557.732|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:39:19 kjcf05n00 mcfcli[3673891]: %3|1730673559.856|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:39:22 kjcf05n00 zabbix-server[1410133]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:39:22 kjcf05n00 zabbix-server[1410133]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 185.09\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 118.37\\"}}"' Nov 3 16:39:22 kjcf05n00 log_interesting_event.py[1410133]: Event '46428' acknowledged Nov 3 16:39:47 kjcf05n00 mcfcli[3673891]: %3|1730673587.733|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 16:39:56 kjcf05n00 mcfcli[3673891]: %3|1730673596.468|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 16:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 16:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 16:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 16:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 16:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 16:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 16:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 16:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 16:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 16:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 16:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 16:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 16:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 16:40:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 16:40:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:40:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 16:40:07 kjcf05n00 zabbix-server[1410365]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:40:07 kjcf05n00 zabbix-server[1410365]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n02' from event '46429' Nov 3 16:40:07 kjcf05n00 zabbix-server[1410365]: Host created 'enclosure_USE26000024VS001' Nov 3 16:40:07 kjcf05n00 zabbix-server[1410365]: Running puppet on 'kjcf05n02' Nov 3 16:40:09 kjcf05n02 puppet-agent[34151]: Using configured environment 'production' Nov 3 16:40:09 kjcf05n02 puppet-agent[34151]: Retrieving pluginfacts Nov 3 16:40:09 kjcf05n02 puppet-agent[34151]: Retrieving plugin Nov 3 16:40:09 kjcf05n02 puppet-agent[34151]: Loading facts Nov 3 16:40:12 kjcf05n02 puppet-agent[34151]: Caching catalog for kjcf05n02 Nov 3 16:40:12 kjcf05n02 puppet-agent[34151]: Applying configuration version '1730673610' Nov 3 16:40:13 kjcf05n00 python3.9[1410361]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 16:40:14 kjcf05n02 puppet-agent[34151]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 16:40:14 kjcf05n02 puppet-agent[34151]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 16:40:14 kjcf05n02 puppet-agent[34151]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 16:40:15 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 16:40:15 kjcf05n02 zabbix_agent2[6013]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 16:40:15 kjcf05n02 zabbix_agent2[3209]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:40:15 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 16:40:15 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 16:40:15 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 16:40:15 kjcf05n02 puppet-agent[34151]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: Press Ctrl+C to exit. Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: Plugin support version 1.0 Nov 3 16:40:15 kjcf05n02 zabbix_agent2[34506]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 16:40:17 kjcf05n02 puppet-agent[34151]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 16:40:17 kjcf05n02 puppet-agent[34151]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 16:40:17 kjcf05n02 puppet-agent[34151]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 16:40:17 kjcf05n02 puppet-agent[34151]: Applied catalog in 5.12 seconds Nov 3 16:40:17 kjcf05n00 zabbix-server[1410365]: puppet completed status:(0): '' Nov 3 16:40:17 kjcf05n00 zabbix-server[1410365]: Event '46429' acknowledged Nov 3 16:40:17 kjcf05n00 zabbix-server[1410365]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n02"}' Nov 3 16:40:17 kjcf05n00 mcfcli[3673891]: %3|1730673617.733|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:40:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730673031', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 16:40:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730673031'} Nov 3 16:40:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:40:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730673031', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 16:40:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730673031'} Nov 3 16:40:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:40:36 kjcf05n00 mcfcli[3673891]: %3|1730673636.465|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:40:47 kjcf05n00 mcfcli[3673891]: %3|1730673647.733|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 16:41:14 kjcf05n00 mcfcli[3673891]: %3|1730673674.778|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:41:17 kjcf05n00 mcfcli[3673891]: %3|1730673677.733|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 16:41:47 kjcf05n00 mcfcli[3673891]: %3|1730673707.733|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 16:41:51 kjcf05n01 diskmonitor[1331407]: leaving test state: 1 next state: 2 Nov 3 16:41:51 kjcf05n01 diskmonitor[1331407]: lock req: no timeout Nov 3 16:41:51 kjcf05n01 diskmonitor[1331407]: leaving test state: 2 next state: 4 Nov 3 16:41:52 kjcf05n00 mcfcli[3673891]: %3|1730673712.947|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:42:12 kjcf05n01 diskmonitor[1331407]: lock acquired Nov 3 16:42:12 kjcf05n01 diskmonitor[1331407]: leaving test state: 4 next state: 8 Nov 3 16:42:15 kjcf05n01 diskmonitor[1331407]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 3 16:42:15 kjcf05n01 diskmonitor[1331407]: leaving test state: 8 next state: 20 Nov 3 16:42:15 kjcf05n01 diskmonitor[1331407]: leaving test state: 20 next state: 40 Nov 3 16:42:15 kjcf05n01 diskmonitor[1331407]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset 8d08628000 Nov 3 16:42:15 kjcf05n01 diskmonitor[1331407]: leaving test state: 40 next state: 80 Nov 3 16:42:17 kjcf05n00 mcfcli[3673891]: %3|1730673737.733|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:42:32 kjcf05n00 mcfcli[3673891]: %3|1730673752.528|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:42:47 kjcf05n00 mcfcli[3673891]: %3|1730673767.735|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:43:09 kjcf05n01 diskmonitor[1331407]: leaving test state: 80 next state: 100 Nov 3 16:43:09 kjcf05n01 diskmonitor[1331407]: lock release: time: Sun Nov 3 16:43:07 2024 Nov 3 16:43:09 kjcf05n01 diskmonitor[1331407]: leaving test state: 100 next state: 1 Nov 3 16:43:09 kjcf05n00 mcfcli[3673891]: %3|1730673789.965|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:43:17 kjcf05n00 mcfcli[3673891]: %3|1730673797.735|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 16:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T16:43:27.268372106-06:00 level=info msg="Completed cleanup jobs" duration=41.293184ms Nov 3 16:43:47 kjcf05n00 mcfcli[3673891]: %3|1730673827.737|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:43:49 kjcf05n00 mcfcli[3673891]: %3|1730673829.303|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:44:17 kjcf05n00 mcfcli[3673891]: %3|1730673857.737|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:44:28 kjcf05n00 mcfcli[3673891]: %3|1730673868.500|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:44:47 kjcf05n00 mcfcli[3673891]: %3|1730673887.737|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:45:07 kjcf05n00 mcfcli[3673891]: %3|1730673907.136|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:45:13 kjcf05n02 root[42454]: failback_xyraid Nov 3 16:45:13 kjcf05n00 python3.9[1413524]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 16:45:14 kjcf05n02 root[42581]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 16:45:15 kjcf05n02 root[42729]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 16:45:17 kjcf05n00 mcfcli[3673891]: %3|1730673917.737|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 16:45:18 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 3 16:45:22 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme9n1 Nov 3 16:45:22 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme18n1 Nov 3 16:45:22 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme25n1 Nov 3 16:45:22 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme19n1 Nov 3 16:45:22 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme4n1 Nov 3 16:45:22 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme23n1 Nov 3 16:45:22 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme17n1 Nov 3 16:45:22 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme2n1 Nov 3 16:45:22 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme24n1 Nov 3 16:45:22 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme3n1 Nov 3 16:45:22 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme8n1 Nov 3 16:45:24 kjcf05n02 dwd[5205]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 16:45:24 kjcf05n02 dwd[5205]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 16:45:24 kjcf05n02 dwd[5205]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 16:45:24 kjcf05n02 dwd[5205]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 16:45:24 kjcf05n02 dwd[5205]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 16:45:24 kjcf05n02 dwd[5205]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 16:45:24 kjcf05n02 dwd[5205]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 16:45:24 kjcf05n02 dwd[5205]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 16:45:24 kjcf05n02 dwd[5205]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 16:45:24 kjcf05n02 dwd[5205]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 16:45:24 kjcf05n02 dwd[5205]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 16:45:24 kjcf05n02 dwd[5205]: Starting NVME thread for nvme2n1 Nov 3 16:45:24 kjcf05n02 dwd[5205]: Starting NVME thread for nvme18n1 Nov 3 16:45:24 kjcf05n02 dwd[5205]: Starting NVME thread for nvme19n1 Nov 3 16:45:24 kjcf05n02 dwd[5205]: Starting NVME thread for nvme9n1 Nov 3 16:45:25 kjcf05n02 dcs-bulk-data-sender[6192]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 3 16:45:25 kjcf05n02 dwd[5205]: Starting NVME thread for nvme3n1 Nov 3 16:45:25 kjcf05n02 systemd-udevd[45447]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45448]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45449]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45447]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45448]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45449]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45447]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45448]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45449]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45447]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45448]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45449]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45447]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45448]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45449]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45447]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45447]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45449]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45448]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45473]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45478]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45480]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45447]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45448]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45449]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45482]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45473]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45478]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45448]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45449]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45482]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45447]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45478]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45482]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45482]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45448]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45482]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45449]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45448]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45482]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45448]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45482]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45448]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45482]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45482]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45482]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45448]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45482]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45448]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45482]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45448]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45482]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45482]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 systemd-udevd[45482]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:45:25 kjcf05n02 dwd[5205]: Starting NVME thread for nvme24n1 Nov 3 16:45:25 kjcf05n02 nslcd[7263]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 16:45:26 kjcf05n02 dwd[5205]: Starting NVME thread for nvme4n1 Nov 3 16:45:26 kjcf05n02 dwd[5205]: Starting NVME thread for nvme23n1 Nov 3 16:45:26 kjcf05n02 dwd[5205]: Starting NVME thread for nvme17n1 Nov 3 16:45:26 kjcf05n02 dwd[5205]: Starting NVME thread for nvme25n1 Nov 3 16:45:26 kjcf05n02 dwd[5205]: Starting NVME thread for nvme8n1 Nov 3 16:45:32 kjcf05n02 diskmonitor[17677]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 16:45:40 kjcf05n02 diskmonitor[17677]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 16:45:40 kjcf05n02 diskmonitor[17677]: Scan for ReadErrorMax change for md65 Nov 3 16:45:40 kjcf05n02 diskmonitor[17677]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 16:45:40 kjcf05n02 diskmonitor[17677]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 16:45:40 kjcf05n02 diskmonitor[17677]: read_saved_file: md65 no saved speed Nov 3 16:45:40 kjcf05n02 diskmonitor[17677]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 16:45:40 kjcf05n02 diskmonitor[17677]: Set sync_speed_min (10000) for md65 Nov 3 16:45:40 kjcf05n02 diskmonitor[17677]: Set sync_speed_max (200000) for md65 Nov 3 16:45:40 kjcf05n02 diskmonitor[17677]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 16:45:45 kjcf05n00 mcfcli[3673891]: %3|1730673945.130|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:45:46 kjcf05n00 zabbix-server[1414037]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:45:46 kjcf05n00 zabbix-server[1414037]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 67.88\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 83.68\\"}}"' Nov 3 16:45:46 kjcf05n00 log_interesting_event.py[1414037]: Event '46432' acknowledged Nov 3 16:45:47 kjcf05n00 mcfcli[3673891]: %3|1730673947.737|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 16:45:54 kjcf05n03 diskmonitor[17811]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 16:45:54 kjcf05n03 diskmonitor[17811]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 16:46:17 kjcf05n00 mcfcli[3673891]: %3|1730673977.737|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:46:19 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 16:46:19 kjcf05n02 systemd-tmpfiles[48325]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 16:46:19 kjcf05n02 systemd-tmpfiles[48325]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 16:46:19 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 16:46:19 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 16:46:21 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 48561 (bash) Nov 3 16:46:21 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 16:46:21 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 16:46:25 kjcf05n00 mcfcli[3673891]: %3|1730673985.126|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:46:47 kjcf05n00 mcfcli[3673891]: %3|1730674007.738|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:47:04 kjcf05n00 mcfcli[3673891]: %3|1730674024.894|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:47:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730674028}"] Nov 3 16:47:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730674028, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:47:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.356773ms Nov 3 16:47:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.356773ms Nov 3 16:47:08 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:47:08 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:47:08 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:47:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730674028}"] Nov 3 16:47:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730674028, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:47:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.739087ms Nov 3 16:47:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.739087ms Nov 3 16:47:08 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:47:08 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:47:08 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:47:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730674028}"] Nov 3 16:47:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730674028, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:47:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.883748ms Nov 3 16:47:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.883748ms Nov 3 16:47:08 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:47:08 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:47:08 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:47:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730674028}"] Nov 3 16:47:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730674028, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:47:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:08-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:08 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:08-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:08 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:08-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:08 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.160396ms Nov 3 16:47:08 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:08-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.160396ms Nov 3 16:47:08 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:47:08 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:47:08 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:47:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730674028}"] Nov 3 16:47:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730674028, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:47:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.812654ms Nov 3 16:47:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.812654ms Nov 3 16:47:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:47:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:47:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:47:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730674028}"] Nov 3 16:47:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730674028, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:47:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.40797ms Nov 3 16:47:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.40797ms Nov 3 16:47:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:47:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:47:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:47:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730674028}"] Nov 3 16:47:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730674028, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:47:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.079604ms Nov 3 16:47:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.079604ms Nov 3 16:47:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:47:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:47:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:47:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730674028}"] Nov 3 16:47:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730674028, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:47:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.691438ms Nov 3 16:47:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.691438ms Nov 3 16:47:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:47:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:47:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:47:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730674028}"] Nov 3 16:47:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730674028, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:47:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.064316ms Nov 3 16:47:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.064316ms Nov 3 16:47:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:47:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:47:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:47:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730674028}"] Nov 3 16:47:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730674028, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:47:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.988614ms Nov 3 16:47:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.988614ms Nov 3 16:47:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:47:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:47:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:47:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730674028}"] Nov 3 16:47:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730674028, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 16:47:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:09-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 16:47:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:09 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T16:47:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:09-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 16:47:09 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T16:47:09-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 16:47:09 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T16:47:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.967956ms Nov 3 16:47:09 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T16:47:09-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.967956ms Nov 3 16:47:09 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:16:47:09 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 16:47:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:47:17 kjcf05n00 mcfcli[3673891]: %3|1730674037.738|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 16:47:42 kjcf05n00 mcfcli[3673891]: %3|1730674062.939|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:47:47 kjcf05n00 mcfcli[3673891]: %3|1730674067.739|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 16:48:17 kjcf05n00 mcfcli[3673891]: %3|1730674097.739|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 16:48:19 kjcf05n00 mcfcli[3673891]: %3|1730674099.410|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:48:47 kjcf05n00 mcfcli[3673891]: %3|1730674127.740|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 16:48:59 kjcf05n00 mcfcli[3673891]: %3|1730674139.407|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:49:08 kjcf05n00 zabbix-server[1415882]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:49:08 kjcf05n00 zabbix-server[1415882]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46433' Nov 3 16:49:08 kjcf05n00 zabbix-server[1415882]: Filesystem 'kjcf05' has been mounted Nov 3 16:49:08 kjcf05n00 zabbix-server[1415882]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 16:49:08 kjcf05n00 zabbix-server[1415882]: Running puppet on 'None' Nov 3 16:49:10 kjcf05n02 puppet-agent[53773]: Using configured environment 'production' Nov 3 16:49:10 kjcf05n02 puppet-agent[53773]: Retrieving pluginfacts Nov 3 16:49:10 kjcf05n02 puppet-agent[53773]: Retrieving plugin Nov 3 16:49:10 kjcf05n05 puppet-agent[3731954]: Using configured environment 'production' Nov 3 16:49:10 kjcf05n05 puppet-agent[3731954]: Retrieving pluginfacts Nov 3 16:49:10 kjcf05n05 puppet-agent[3731954]: Retrieving plugin Nov 3 16:49:10 kjcf05n06 puppet-agent[3571752]: Using configured environment 'production' Nov 3 16:49:10 kjcf05n06 puppet-agent[3571752]: Retrieving pluginfacts Nov 3 16:49:10 kjcf05n06 puppet-agent[3571752]: Retrieving plugin Nov 3 16:49:11 kjcf05n04 puppet-agent[3568403]: Using configured environment 'production' Nov 3 16:49:11 kjcf05n04 puppet-agent[3568403]: Retrieving pluginfacts Nov 3 16:49:11 kjcf05n04 puppet-agent[3568403]: Retrieving plugin Nov 3 16:49:11 kjcf05n07 puppet-agent[3569275]: Using configured environment 'production' Nov 3 16:49:11 kjcf05n07 puppet-agent[3569275]: Retrieving pluginfacts Nov 3 16:49:11 kjcf05n07 puppet-agent[3569275]: Retrieving plugin Nov 3 16:49:11 kjcf05n03 puppet-agent[108552]: Using configured environment 'production' Nov 3 16:49:11 kjcf05n03 puppet-agent[108552]: Retrieving pluginfacts Nov 3 16:49:11 kjcf05n03 puppet-agent[108552]: Retrieving plugin Nov 3 16:49:11 kjcf05n03 puppet-agent[108552]: Loading facts Nov 3 16:49:11 kjcf05n02 puppet-agent[53773]: Loading facts Nov 3 16:49:11 kjcf05n05 puppet-agent[3731954]: Loading facts Nov 3 16:49:11 kjcf05n06 puppet-agent[3571752]: Loading facts Nov 3 16:49:11 kjcf05n01 puppet-agent[3196462]: Using configured environment 'production' Nov 3 16:49:11 kjcf05n01 puppet-agent[3196462]: Retrieving pluginfacts Nov 3 16:49:11 kjcf05n01 puppet-agent[3196462]: Retrieving plugin Nov 3 16:49:11 kjcf05n01 puppet-agent[3196462]: Loading facts Nov 3 16:49:11 kjcf05n04 puppet-agent[3568403]: Loading facts Nov 3 16:49:11 kjcf05n07 puppet-agent[3569275]: Loading facts Nov 3 16:49:11 kjcf05n00 puppet-agent[1415947]: Using configured environment 'production' Nov 3 16:49:11 kjcf05n00 puppet-agent[1415947]: Retrieving pluginfacts Nov 3 16:49:11 kjcf05n00 puppet-agent[1415947]: Retrieving plugin Nov 3 16:49:11 kjcf05n00 puppet-agent[1415947]: Loading facts Nov 3 16:49:14 kjcf05n03 puppet-agent[108552]: Caching catalog for kjcf05n03 Nov 3 16:49:14 kjcf05n03 puppet-agent[108552]: Applying configuration version '1730674152' Nov 3 16:49:13 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 16:49:13 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 16:49:14 kjcf05n02 puppet-agent[53773]: Caching catalog for kjcf05n02 Nov 3 16:49:14 kjcf05n02 puppet-agent[53773]: Applying configuration version '1730674152' Nov 3 16:49:14 kjcf05n06 puppet-agent[3571752]: Caching catalog for kjcf05n06 Nov 3 16:49:14 kjcf05n06 puppet-agent[3571752]: Applying configuration version '1730674152' Nov 3 16:49:14 kjcf05n07 puppet-agent[3569275]: Caching catalog for kjcf05n07 Nov 3 16:49:14 kjcf05n07 puppet-agent[3569275]: Applying configuration version '1730674152' Nov 3 16:49:15 kjcf05n01 puppet-agent[3196462]: Caching catalog for kjcf05n01 Nov 3 16:49:15 kjcf05n00 puppet-agent[1415947]: Caching catalog for kjcf05n00 Nov 3 16:49:15 kjcf05n00 puppet-agent[1415947]: Applying configuration version '1730674153' Nov 3 16:49:16 kjcf05n01 puppet-agent[3196462]: Applying configuration version '1730674153' Nov 3 16:49:16 kjcf05n03 puppet-agent[108552]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 16:49:16 kjcf05n03 puppet-agent[108552]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 16:49:16 kjcf05n03 puppet-agent[108552]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 16:49:16 kjcf05n02 puppet-agent[53773]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 16:49:16 kjcf05n02 puppet-agent[53773]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 16:49:16 kjcf05n02 puppet-agent[53773]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 16:49:16 kjcf05n06 puppet-agent[3571752]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 16:49:16 kjcf05n06 puppet-agent[3571752]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 16:49:16 kjcf05n06 puppet-agent[3571752]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 16:49:16 kjcf05n07 puppet-agent[3569275]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 16:49:16 kjcf05n07 puppet-agent[3569275]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 16:49:16 kjcf05n07 puppet-agent[3569275]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 16:49:16 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 16:49:16 kjcf05n03 zabbix_agent2[54207]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 16:49:16 kjcf05n03 zabbix_agent2[3145]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 16:49:16 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 16:49:16 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 16:49:16 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 16:49:16 kjcf05n03 puppet-agent[108552]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: Press Ctrl+C to exit. Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: Plugin support version 1.0 Nov 3 16:49:16 kjcf05n03 zabbix_agent2[108898]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 16:49:16 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3522163]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 16:49:16 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 16:49:16 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 16:49:16 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 16:49:16 kjcf05n06 puppet-agent[3571752]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: Press Ctrl+C to exit. Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: Plugin support version 1.0 Nov 3 16:49:16 kjcf05n06 zabbix_agent2[3572686]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 16:49:17 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 16:49:17 kjcf05n02 zabbix_agent2[34506]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 16:49:17 kjcf05n02 zabbix_agent2[3209]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 16:49:17 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 16:49:17 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 16:49:17 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 16:49:17 kjcf05n02 puppet-agent[53773]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: Press Ctrl+C to exit. Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: Plugin support version 1.0 Nov 3 16:49:17 kjcf05n02 zabbix_agent2[54243]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 16:49:17 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3518902]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 16:49:17 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 16:49:17 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 16:49:17 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 16:49:17 kjcf05n07 puppet-agent[3569275]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: Press Ctrl+C to exit. Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: Plugin support version 1.0 Nov 3 16:49:17 kjcf05n07 zabbix_agent2[3570175]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 16:49:17 kjcf05n00 mcfcli[3673891]: %3|1730674157.740|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 16:49:18 kjcf05n01 puppet-agent[3196462]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 16:49:18 kjcf05n01 puppet-agent[3196462]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-16:27:18]/mode) mode changed '0755' to '0750' Nov 3 16:49:18 kjcf05n00 puppet-agent[1415947]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 16:49:18 kjcf05n06 puppet-agent[3571752]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 16:49:18 kjcf05n06 puppet-agent[3571752]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 16:49:18 kjcf05n06 puppet-agent[3571752]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 16:49:18 kjcf05n01 puppet-agent[3196462]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-16:27:18/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 16:49:18 kjcf05n01 puppet-agent[3196462]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-16:27:18/vmcore]/mode) mode changed '0600' to '0640' Nov 3 16:49:18 kjcf05n01 puppet-agent[3196462]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-16:27:18/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 16:49:18 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 16:49:18 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 16:49:18 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 16:49:18 kjcf05n03 puppet-agent[108552]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 16:49:18 kjcf05n03 puppet-agent[108552]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 16:49:18 kjcf05n03 puppet-agent[108552]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 16:49:19 kjcf05n02 puppet-agent[53773]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 16:49:19 kjcf05n02 puppet-agent[53773]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 16:49:19 kjcf05n02 puppet-agent[53773]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 16:49:19 kjcf05n02 puppet-agent[53773]: Applied catalog in 5.09 seconds Nov 3 16:49:19 kjcf05n07 puppet-agent[3569275]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 16:49:19 kjcf05n07 puppet-agent[3569275]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 16:49:19 kjcf05n07 puppet-agent[3569275]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 16:49:19 kjcf05n06 puppet-agent[3571752]: Applied catalog in 4.71 seconds Nov 3 16:49:19 kjcf05n03 puppet-agent[108552]: Applied catalog in 5.15 seconds Nov 3 16:49:19 kjcf05n01 puppet-agent[3196462]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 16:49:19 kjcf05n01 puppet-agent[3196462]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 16:49:19 kjcf05n01 puppet-agent[3196462]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 16:49:19 kjcf05n00 puppet-agent[1415947]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 16:49:19 kjcf05n00 puppet-agent[1415947]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 16:49:19 kjcf05n00 puppet-agent[1415947]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 16:49:19 kjcf05n07 puppet-agent[3569275]: Applied catalog in 4.88 seconds Nov 3 16:49:20 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3184199]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 16:49:20 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 16:49:20 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 16:49:20 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 16:49:20 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 16:49:20 kjcf05n01 puppet-agent[3196462]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: Press Ctrl+C to exit. Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: Plugin support version 1.0 Nov 3 16:49:20 kjcf05n01 zabbix_agent2[3196810]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 16:49:19 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1398391]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 16:49:20 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 16:49:19 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 16:49:19 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 16:49:19 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 16:49:19 kjcf05n00 puppet-agent[1415947]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: Press Ctrl+C to exit. Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: Plugin support version 1.0 Nov 3 16:49:19 kjcf05n00 zabbix_agent2[1416469]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 16:49:20 kjcf05n00 zabbix-server[1416492]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:49:20 kjcf05n00 zabbix-server[1416493]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:49:21 kjcf05n00 zabbix-server[1416500]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:49:21 kjcf05n00 zabbix-server[1416502]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 16:49:21 kjcf05n00 puppet-agent[1415947]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 16:49:22 kjcf05n01 puppet-agent[3196462]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_163438.log]/mode) mode changed '0644' to '0640' Nov 3 16:49:22 kjcf05n01 puppet-agent[3196462]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_164621.log]/mode) mode changed '0644' to '0640' Nov 3 16:49:22 kjcf05n01 puppet-agent[3196462]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_164622]/mode) mode changed '0755' to '0750' Nov 3 16:49:22 kjcf05n01 puppet-agent[3196462]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_164622/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 16:49:23 kjcf05n01 puppet-agent[3196462]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_163438.log]/mode) mode changed '0644' to '0640' Nov 3 16:49:23 kjcf05n01 puppet-agent[3196462]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_164621.log]/mode) mode changed '0644' to '0640' Nov 3 16:49:23 kjcf05n01 puppet-agent[3196462]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 16:49:23 kjcf05n01 puppet-agent[3196462]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 16:49:23 kjcf05n01 puppet-agent[3196462]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 16:49:22 kjcf05n00 puppet-agent[1415947]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 16:49:22 kjcf05n00 puppet-agent[1415947]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 16:49:22 kjcf05n00 puppet-agent[1415947]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 16:49:23 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 16:49:24 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 16:49:23 kjcf05n00 puppet-agent[1415947]: Applied catalog in 8.36 seconds Nov 3 16:49:24 kjcf05n01 puppet-agent[3196462]: Applied catalog in 8.80 seconds Nov 3 16:49:35 kjcf05n05 puppet-agent[3731954]: Caching catalog for kjcf05n05 Nov 3 16:49:35 kjcf05n05 puppet-agent[3731954]: Applying configuration version '1730674173' Nov 3 16:49:37 kjcf05n05 puppet-agent[3731954]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 16:49:37 kjcf05n05 puppet-agent[3731954]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 16:49:37 kjcf05n05 puppet-agent[3731954]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 16:49:37 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3687161]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 16:49:37 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 16:49:37 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 16:49:37 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 16:49:37 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 16:49:37 kjcf05n05 puppet-agent[3731954]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: Press Ctrl+C to exit. Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: Plugin support version 1.0 Nov 3 16:49:37 kjcf05n05 zabbix_agent2[3733375]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 16:49:39 kjcf05n05 puppet-agent[3731954]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 16:49:39 kjcf05n05 puppet-agent[3731954]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 16:49:39 kjcf05n05 puppet-agent[3731954]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 16:49:39 kjcf05n00 mcfcli[3673891]: %3|1730674179.404|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:49:40 kjcf05n05 puppet-agent[3731954]: Applied catalog in 4.76 seconds Nov 3 16:49:45 kjcf05n04 puppet-agent[3568403]: Caching catalog for kjcf05n04 Nov 3 16:49:45 kjcf05n04 puppet-agent[3568403]: Applying configuration version '1730674184' Nov 3 16:49:47 kjcf05n04 puppet-agent[3568403]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 16:49:47 kjcf05n04 puppet-agent[3568403]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 16:49:47 kjcf05n04 puppet-agent[3568403]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 16:49:48 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3524343]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 16:49:48 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 16:49:48 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 16:49:48 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 16:49:48 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 16:49:48 kjcf05n04 puppet-agent[3568403]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: Starting Zabbix Agent 2 (6.2.1) Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: Press Ctrl+C to exit. Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: Plugin support version 1.0 Nov 3 16:49:48 kjcf05n04 zabbix_agent2[3570053]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 16:49:48 kjcf05n00 mcfcli[3673891]: %3|1730674188.239|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 16:49:50 kjcf05n04 puppet-agent[3568403]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 16:49:50 kjcf05n04 puppet-agent[3568403]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 16:49:50 kjcf05n04 puppet-agent[3568403]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 16:49:50 kjcf05n04 puppet-agent[3568403]: Applied catalog in 4.73 seconds Nov 3 16:49:50 kjcf05n00 zabbix-server[1415882]: puppet completed status:(0): '' Nov 3 16:49:50 kjcf05n00 zabbix-server[1415882]: Event '46433' acknowledged Nov 3 16:49:50 kjcf05n00 zabbix-server[1415882]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 3 16:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 16:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 16:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 16:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 16:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 16:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 16:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 16:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 16:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 16:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 16:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 16:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 16:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 16:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 16:50:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 16:50:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 16:50:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 16:50:13 kjcf05n00 python3.9[1417007]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 16:50:16 kjcf05n00 mcfcli[3673891]: %3|1730674216.929|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:50:18 kjcf05n00 mcfcli[3673891]: %3|1730674218.240|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 16:50:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730674226', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 16:50:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730674226'} Nov 3 16:50:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:50:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730674226', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 16:50:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730674226'} Nov 3 16:50:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 16:50:39 kjcf05n02 dwd[5205]: nvme9n1 passed periodic SMART status check Nov 3 16:50:39 kjcf05n02 dwd[5205]: nvme19n1 passed periodic SMART status check Nov 3 16:50:39 kjcf05n02 dwd[5205]: nvme18n1 passed periodic SMART status check Nov 3 16:50:39 kjcf05n02 dwd[5205]: nvme2n1 passed periodic SMART status check Nov 3 16:50:40 kjcf05n02 dwd[5205]: nvme4n1 passed periodic SMART status check Nov 3 16:50:40 kjcf05n02 dwd[5205]: nvme24n1 passed periodic SMART status check Nov 3 16:50:40 kjcf05n02 dwd[5205]: nvme23n1 passed periodic SMART status check Nov 3 16:50:40 kjcf05n02 dwd[5205]: nvme3n1 passed periodic SMART status check Nov 3 16:50:41 kjcf05n02 dwd[5205]: nvme17n1 passed periodic SMART status check Nov 3 16:50:41 kjcf05n02 dwd[5205]: nvme8n1 passed periodic SMART status check Nov 3 16:50:41 kjcf05n02 dwd[5205]: nvme25n1 passed periodic SMART status check Nov 3 16:50:48 kjcf05n00 mcfcli[3673891]: %3|1730674248.240|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 16:50:54 kjcf05n00 mcfcli[3673891]: %3|1730674254.484|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:51:18 kjcf05n00 mcfcli[3673891]: %3|1730674278.240|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:51:33 kjcf05n00 mcfcli[3673891]: %3|1730674293.711|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:51:48 kjcf05n00 mcfcli[3673891]: %3|1730674308.240|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 16:52:13 kjcf05n00 mcfcli[3673891]: %3|1730674333.459|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:52:18 kjcf05n00 mcfcli[3673891]: %3|1730674338.241|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:52:48 kjcf05n00 mcfcli[3673891]: %3|1730674368.241|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 16:52:49 kjcf05n00 mcfcli[3673891]: %3|1730674369.403|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T22:53:15.868452Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 16:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T22:53:15.868512Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.078ms Nov 3 16:53:18 kjcf05n00 mcfcli[3673891]: %3|1730674398.242|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 16:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T16:53:27.255304507-06:00 level=info msg="Completed cleanup jobs" duration=28.717652ms Nov 3 16:53:27 kjcf05n00 mcfcli[3673891]: %3|1730674407.968|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:53:48 kjcf05n00 mcfcli[3673891]: %3|1730674428.242|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:54:07 kjcf05n00 mcfcli[3673891]: %3|1730674447.018|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:54:18 kjcf05n00 mcfcli[3673891]: %3|1730674458.362|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:54:43 kjcf05n00 mcfcli[3673891]: %3|1730674483.950|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:54:48 kjcf05n00 mcfcli[3673891]: %3|1730674488.363|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 16:55:13 kjcf05n00 python3.9[1419833]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 16:55:18 kjcf05n00 mcfcli[3673891]: %3|1730674518.744|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 16:55:21 kjcf05n00 mcfcli[3673891]: %3|1730674521.874|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:55:27 kjcf05n03 nslcd[6919]: [e87ccd] ldap_result() failed: Can't contact LDAP server Nov 3 16:55:48 kjcf05n00 mcfcli[3673891]: %3|1730674548.744|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 16:55:59 kjcf05n00 mcfcli[3673891]: %3|1730674559.599|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:56:18 kjcf05n00 mcfcli[3673891]: %3|1730674578.744|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 16:56:36 kjcf05n03 nslcd[6919]: [7ed7ab] ldap_result() failed: Can't contact LDAP server Nov 3 16:56:37 kjcf05n00 mcfcli[3673891]: %3|1730674597.068|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:56:48 kjcf05n00 mcfcli[3673891]: %3|1730674608.746|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:57:06 kjcf05n00 diskmonitor[2758297]: leaving test state: 1 next state: 2 Nov 3 16:57:06 kjcf05n00 diskmonitor[2758297]: lock req: no timeout Nov 3 16:57:06 kjcf05n00 diskmonitor[2758297]: leaving test state: 2 next state: 4 Nov 3 16:57:17 kjcf05n00 mcfcli[3673891]: %3|1730674637.065|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:57:18 kjcf05n00 mcfcli[3673891]: %3|1730674638.746|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:57:27 kjcf05n00 zabbix_server[15752]: Zabbix agent item "system.swap.size[,pfree]" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 3 16:57:27 kjcf05n00 zabbix_server[15720]: Zabbix agent item "dcs.lustre.device.ost.count[{$LUSTRE_FS_NAME}]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 3 16:57:32 kjcf05n03 fstonithd.py[15375]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 3 16:57:32 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 16:57:32 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 16:57:32 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 16:57:33 kjcf05n03 root[122554]: is_enc_ipmi_off starts Nov 3 16:57:33 kjcf05n03 root[122556]: is_viking_off starts Nov 3 16:57:33 kjcf05n03 root[122573]: I am master Nov 3 16:57:33 kjcf05n03 root[122577]: is_lan_ipmi_off leaves Nov 3 16:57:33 kjcf05n03 root[122578]: I am in slot 1; partner is in slot 0 Nov 3 16:57:33 kjcf05n03 root[122580]: is_lan_ipmi_sec_off leaves Nov 3 16:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 16:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 16:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 16:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 16:57:38 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='75', error='Connection reset by peer (104)' Nov 3 16:57:38 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='75', client='AF_INET(172.16.2.5:33995)', local='AF_INET(0.0.0.0:601)' Nov 3 16:57:41 kjcf05n03 root[122699]: is_viking_off leaves Nov 3 16:57:41 kjcf05n03 root[122702]: kjcf05n02 not already off look at kdump Nov 3 16:57:41 kjcf05n03 root[122703]: is_kdump_off starts Nov 3 16:57:41 kjcf05n03 fence_kdump[122704]: waiting for message from '172.16.2.5' Nov 3 16:57:41 kjcf05n03 fence_kdump[122704]: received valid message from '172.16.2.5' Nov 3 16:57:41 kjcf05n03 root[122705]: is_kdump_off detected kdump on kjcf05n02 Nov 3 16:57:41 kjcf05n03 root[122706]: kjcf05n02 is kdumping Nov 3 16:57:41 kjcf05n03 root[122802]: is_enc_ipmi_off starts Nov 3 16:57:41 kjcf05n03 root[122803]: is_viking_off starts Nov 3 16:57:41 kjcf05n03 root[122821]: is_lan_ipmi_off leaves Nov 3 16:57:41 kjcf05n03 root[122823]: is_lan_ipmi_sec_off leaves Nov 3 16:57:41 kjcf05n03 root[122826]: I am master Nov 3 16:57:41 kjcf05n03 root[122829]: I am in slot 1; partner is in slot 0 Nov 3 16:57:42 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0002,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 16:57:42 kjcf05n00 zabbix_server[15783]: Zabbix agent item "net.if.out["meth0"]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 16:57:43 kjcf05n00 zabbix_server[15731]: Zabbix agent item "net.if.in["ib1",dropped]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 16:57:44 kjcf05n00 zabbix_server[15754]: Zabbix agent item "net.if.in["icl0",dropped]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 16:57:45 kjcf05n00 zabbix_server[15765]: Zabbix agent item "dcs.array.discovery" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 16:57:48 kjcf05n03 root[123051]: is_viking_off leaves Nov 3 16:57:48 kjcf05n03 root[123054]: kjcf05n02 not already off look at kdump Nov 3 16:57:48 kjcf05n03 root[123055]: is_kdump_off starts Nov 3 16:57:48 kjcf05n03 fence_kdump[123056]: waiting for message from '172.16.2.5' Nov 3 16:57:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 16:57:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 16:57:48 kjcf05n03 fence_kdump[123056]: received valid message from '172.16.2.5' Nov 3 16:57:48 kjcf05n03 root[123171]: is_kdump_off detected kdump on kjcf05n02 Nov 3 16:57:48 kjcf05n03 root[123172]: kjcf05n02 is kdumping Nov 3 16:57:48 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 16:57:48 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 16:57:48 kjcf05n00 mcfcli[3673891]: %3|1730674668.746|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 16:57:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 16:57:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 16:57:52 kjcf05n03 systemd-udevd[125598]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125599]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125600]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125602]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125598]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125600]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125599]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125602]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125600]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125598]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125599]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125602]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125600]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125598]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125602]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125599]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125600]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125602]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125598]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125599]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125600]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125602]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125623]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125598]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125625]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125599]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125627]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125631]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125600]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125602]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125598]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125623]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125599]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125627]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125600]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125631]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125602]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125623]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125625]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125599]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125627]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 16:57:52 kjcf05n03 systemd-udevd[125631]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125631]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125599]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125631]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125623]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125600]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125599]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125631]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125602]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125599]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125631]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125599]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125631]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125631]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125599]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125631]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125599]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125631]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125599]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125631]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125599]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125599]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 systemd-udevd[125599]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 16:57:53 kjcf05n03 dwd[5162]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 16:57:53 kjcf05n03 dwd[5162]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 16:57:53 kjcf05n03 dwd[5162]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 16:57:53 kjcf05n03 dwd[5162]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 16:57:53 kjcf05n03 dwd[5162]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 16:57:53 kjcf05n03 dwd[5162]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 16:57:53 kjcf05n03 dwd[5162]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 16:57:53 kjcf05n03 dwd[5162]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 16:57:53 kjcf05n03 dwd[5162]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 16:57:53 kjcf05n03 dwd[5162]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 16:57:53 kjcf05n03 dwd[5162]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 16:57:53 kjcf05n03 dwd[5162]: Starting NVME thread for nvme23n1 Nov 3 16:57:53 kjcf05n03 dwd[5162]: Starting NVME thread for nvme18n1 Nov 3 16:57:53 kjcf05n03 dwd[5162]: Starting NVME thread for nvme25n1 Nov 3 16:57:53 kjcf05n03 dwd[5162]: Starting NVME thread for nvme17n1 Nov 3 16:57:53 kjcf05n03 dwd[5162]: Starting NVME thread for nvme3n1 Nov 3 16:57:54 kjcf05n03 dwd[5162]: Starting NVME thread for nvme9n1 Nov 3 16:57:54 kjcf05n03 dwd[5162]: Starting NVME thread for nvme8n1 Nov 3 16:57:54 kjcf05n03 dwd[5162]: Starting NVME thread for nvme19n1 Nov 3 16:57:54 kjcf05n03 dwd[5162]: Starting NVME thread for nvme24n1 Nov 3 16:57:54 kjcf05n03 dwd[5162]: Starting NVME thread for nvme2n1 Nov 3 16:57:54 kjcf05n03 dwd[5162]: Starting NVME thread for nvme4n1 Nov 3 16:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 16:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 16:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 16:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 16:57:56 kjcf05n00 mcfcli[3673891]: %3|1730674676.282|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:57:57 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0003,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 16:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 16:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 16:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 16:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 16:58:00 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vfs.fs.size[/var/lib/pacemaker,pused]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 16:58:12 kjcf05n03 diskmonitor[17811]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 16:58:12 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 3 16:58:15 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 3 16:58:17 kjcf05n00 diskmonitor[2758297]: lock acquired Nov 3 16:58:17 kjcf05n00 diskmonitor[2758297]: leaving test state: 4 next state: 8 Nov 3 16:58:18 kjcf05n00 mcfcli[3673891]: %3|1730674698.746|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 16:58:19 kjcf05n03 diskmonitor[17811]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 16:58:19 kjcf05n03 diskmonitor[17811]: Scan for ReadErrorMax change for md65 Nov 3 16:58:19 kjcf05n03 diskmonitor[17811]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 16:58:19 kjcf05n03 diskmonitor[17811]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 16:58:19 kjcf05n03 diskmonitor[17811]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.min.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 16:58:19 kjcf05n03 diskmonitor[17811]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.max.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 16:58:19 kjcf05n03 diskmonitor[17811]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 16:58:19 kjcf05n03 diskmonitor[17811]: Set sync_speed_min (10000) for md65 Nov 3 16:58:19 kjcf05n03 diskmonitor[17811]: Set sync_speed_max (200000) for md65 Nov 3 16:58:19 kjcf05n03 diskmonitor[17811]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 16:58:32 kjcf05n00 diskmonitor[2758297]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 3 16:58:32 kjcf05n00 diskmonitor[2758297]: leaving test state: 8 next state: 20 Nov 3 16:58:32 kjcf05n00 diskmonitor[2758297]: leaving test state: 20 next state: 40 Nov 3 16:58:32 kjcf05n00 diskmonitor[2758297]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset 10b164e0000 Nov 3 16:58:32 kjcf05n00 diskmonitor[2758297]: leaving test state: 40 next state: 80 Nov 3 16:58:34 kjcf05n00 mcfcli[3673891]: %3|1730674714.386|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 16:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 16:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 16:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 16:58:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 16:58:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 16:58:48 kjcf05n00 mcfcli[3673891]: %3|1730674728.746|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 16:58:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 16:58:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 16:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 16:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 16:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 16:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 16:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 16:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 16:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 16:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 16:59:03 kjcf05n03 nslcd[6919]: [b141f2] ldap_result() failed: Can't contact LDAP server Nov 3 16:59:03 kjcf05n03 nslcd[6919]: [b71efb] ldap_result() failed: Can't contact LDAP server Nov 3 16:59:11 kjcf05n00 mcfcli[3673891]: %3|1730674751.917|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:59:18 kjcf05n00 mcfcli[3673891]: %3|1730674758.747|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:59:20 kjcf05n03 nslcd[6919]: [e2a9e3] ldap_result() failed: Can't contact LDAP server Nov 3 16:59:23 kjcf05n00 diskmonitor[2758297]: leaving test state: 80 next state: 100 Nov 3 16:59:23 kjcf05n00 diskmonitor[2758297]: lock release: time: Sun Nov 3 16:59:22 2024 Nov 3 16:59:23 kjcf05n00 diskmonitor[2758297]: leaving test state: 100 next state: 1 Nov 3 16:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 16:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 16:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 16:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 16:59:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 16:59:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 16:59:48 kjcf05n00 mcfcli[3673891]: %3|1730674788.748|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 16:59:51 kjcf05n00 mcfcli[3673891]: %3|1730674791.914|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 16:59:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 16:59:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 16:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 16:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 16:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 16:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 16:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 16:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 16:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 16:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 17:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 17:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 17:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 17:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 17:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 17:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 17:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 17:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 17:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 17:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 17:00:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 17:00:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:00:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 17:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 17:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 17:00:18 kjcf05n00 python3.9[1423735]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 17:00:18 kjcf05n00 mcfcli[3673891]: %3|1730674818.748|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 17:00:25 kjcf05n00 mcfcli[3673891]: %3|1730674825.908|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:00:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730674831', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 17:00:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730674831'} Nov 3 17:00:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:00:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730674831', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 17:00:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730674831'} Nov 3 17:00:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 17:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 17:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 17:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 17:00:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 17:00:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 17:00:48 kjcf05n00 mcfcli[3673891]: %3|1730674848.748|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 17:00:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 17:00:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 17:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 17:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 17:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 17:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 17:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 17:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 17:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 17:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 17:01:03 kjcf05n00 mcfcli[3673891]: %3|1730674863.698|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:01:11 kjcf05n00 zabbix-server[1424405]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 17:01:11 kjcf05n00 zabbix-server[1424405]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 17:01:11 kjcf05n00 log_interesting_event.py[1424405]: Event '46434' acknowledged Nov 3 17:01:18 kjcf05n00 mcfcli[3673891]: %3|1730674878.748|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 17:01:20 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 3 17:01:20 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 17:01:24 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 17:01:24 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 3 17:01:24 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 3 17:01:24 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 17:01:24 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 17:01:24 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 3 17:01:24 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 3 17:01:27 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 3 17:01:29 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 3 17:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 17:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 17:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 17:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 17:01:41 kjcf05n00 mcfcli[3673891]: %3|1730674901.263|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:01:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 17:01:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 17:01:48 kjcf05n00 mcfcli[3673891]: %3|1730674908.748|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 17:01:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 17:01:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 17:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 17:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 17:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 17:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 17:01:58 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 17:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 17:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 17:01:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 17:01:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 17:02:17 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:53608). Nov 3 17:02:17 kjcf05n01 rsyncd[3201969]: connect from kjcf05n02 (172.16.2.5) Nov 3 17:02:17 kjcf05n01 rsyncd[3201969]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 17:02:17 kjcf05n01 rsyncd[3201969]: building file list Nov 3 17:02:17 kjcf05n01 rsyncd[3201969]: sent 11450 bytes received 136 bytes total size 10905 Nov 3 17:02:17 kjcf05n01 systemd[1]: rsyncd@645-172.16.2.2:873-172.16.2.5:53608.service: Succeeded. Nov 3 17:02:17 kjcf05n00 mcfcli[3673891]: %3|1730674937.931|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:02:18 kjcf05n00 mcfcli[3673891]: %3|1730674938.748|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:02:32 kjcf05n03 fstonithd.py[15375]: Listening for kdump packets from partner Nov 3 17:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 17:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 17:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 17:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 17:02:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 17:02:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 17:02:48 kjcf05n00 mcfcli[3673891]: %3|1730674968.749|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:02:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 17:02:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 17:02:52 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 17:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 17:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 17:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 17:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 17:02:57 kjcf05n00 mcfcli[3673891]: %3|1730674977.928|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:02:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 17:02:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 17:02:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 17:02:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 17:03:18 kjcf05n00 mcfcli[3673891]: %3|1730674998.749|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:03:19 kjcf05n03 dwd[5162]: nvme23n1 passed periodic SMART status check Nov 3 17:03:19 kjcf05n03 dwd[5162]: nvme3n1 passed periodic SMART status check Nov 3 17:03:19 kjcf05n03 dwd[5162]: nvme18n1 passed periodic SMART status check Nov 3 17:03:19 kjcf05n03 dwd[5162]: nvme25n1 passed periodic SMART status check Nov 3 17:03:19 kjcf05n03 dwd[5162]: nvme17n1 passed periodic SMART status check Nov 3 17:03:20 kjcf05n03 dwd[5162]: nvme2n1 passed periodic SMART status check Nov 3 17:03:20 kjcf05n03 dwd[5162]: nvme19n1 passed periodic SMART status check Nov 3 17:03:20 kjcf05n03 dwd[5162]: nvme8n1 passed periodic SMART status check Nov 3 17:03:20 kjcf05n03 dwd[5162]: nvme9n1 passed periodic SMART status check Nov 3 17:03:20 kjcf05n03 dwd[5162]: nvme4n1 passed periodic SMART status check Nov 3 17:03:20 kjcf05n03 dwd[5162]: nvme24n1 passed periodic SMART status check Nov 3 17:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T17:03:27.252949934-06:00 level=info msg="Completed cleanup jobs" duration=26.095442ms Nov 3 17:03:34 kjcf05n00 mcfcli[3673891]: %3|1730675014.974|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:03:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 17:03:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 17:03:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 17:03:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 17:03:43 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='39', client='AF_INET(172.16.2.5:35209)', local='AF_INET(0.0.0.0:601)' Nov 3 17:03:43 kjcf05n02 syslog-ng[3147]: Configuration reload request received, reloading configuration; Nov 3 17:03:43 kjcf05n02 syslog-ng[3147]: Configuration reload finished; Nov 3 17:03:43 kjcf05n02 syslog-ng[3147]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 17:03:43 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 3 17:03:43 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 17:03:43 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 3 17:03:43 kjcf05n02 dracut: Self testing crypto algorithms Nov 3 17:03:43 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 3 17:03:43 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 17:03:43 kjcf05n02 Copying live image to RAM... Nov 3 17:03:43 kjcf05n02 (this may take a minute) Nov 3 17:03:43 kjcf05n02 Done copying live image to RAM. Nov 3 17:03:43 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 17:03:43 kjcf05n02 dracut: Checking integrity of kernel Nov 3 17:03:43 kjcf05n02 dracut: All initrd crypto checks done Nov 3 17:03:43 kjcf05n02 dracut: Switching root Nov 3 17:03:43 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 17:03:43 kjcf05n02 systemd: Detected architecture x86-64. Nov 3 17:03:43 kjcf05n02 systemd: Set hostname to . Nov 3 17:03:43 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 17:03:43 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 17:03:43 kjcf05n02 systemd: Listening on udev Kernel Socket. Nov 3 17:03:43 kjcf05n02 systemd: Created slice system-getty.slice. Nov 3 17:03:43 kjcf05n02 systemd: Listening on LVM2 poll daemon socket. Nov 3 17:03:43 kjcf05n02 systemd: Reached target ZFS pool import target. Nov 3 17:03:43 kjcf05n02 systemd: Reached target CXI Retry Handlers Started. Nov 3 17:03:43 kjcf05n02 systemd-journald[1521]: Journal started Nov 3 17:03:43 kjcf05n02 systemd-journald[1521]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 17:03:43 kjcf05n02 systemd-modules-load[1508]: Inserted module 'fuse' Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 3 17:03:43 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Create System Users. Nov 3 17:03:43 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 17:03:43 kjcf05n02 systemd-sysctl[1540]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 17:03:43 kjcf05n02 systemd-sysctl[1540]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 3 17:03:43 kjcf05n02 systemd-tmpfiles[1543]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 17:03:43 kjcf05n02 systemd-tmpfiles[1543]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 17:03:43 kjcf05n02 systemd-journald[1521]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 3 17:03:43 kjcf05n02 systemd-udevd[1555]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 3 17:03:43 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 3 17:03:43 kjcf05n02 systemd-udevd[1612]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:03:43 kjcf05n02 systemd-udevd[1606]: Using default interface naming scheme 'rhel-8.0'. Nov 3 17:03:43 kjcf05n02 systemd-udevd[1606]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:03:43 kjcf05n02 systemd-udevd[1593]: Using default interface naming scheme 'rhel-8.0'. Nov 3 17:03:43 kjcf05n02 systemd-udevd[1593]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:03:43 kjcf05n02 systemd-udevd[1601]: Using default interface naming scheme 'rhel-8.0'. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 17:03:43 kjcf05n02 systemd-udevd[1601]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:03:43 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 3 17:03:43 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 17:03:43 kjcf05n02 systemd-tmpfiles[1769]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 17:03:43 kjcf05n02 systemd-tmpfiles[1769]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 17:03:43 kjcf05n02 systemd-tmpfiles[1769]: "/var/tmp" already exists and is not a directory. Nov 3 17:03:43 kjcf05n02 root[1782]: openibd: running in auto mode Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started RPC Bind. Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 17:03:43 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 17:03:43 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 17:03:43 kjcf05n02 systemd-modules-load[1897]: Inserted module 'ib_iser' Nov 3 17:03:43 kjcf05n02 systemd-modules-load[1897]: Inserted module 'ib_isert' Nov 3 17:03:43 kjcf05n02 systemd-modules-load[1897]: Inserted module 'ib_srpt' Nov 3 17:03:43 kjcf05n02 systemd-udevd[1607]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:03:43 kjcf05n02 systemd-modules-load[1904]: Inserted module 'ib_ipoib' Nov 3 17:03:43 kjcf05n02 systemd-udevd[1619]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:03:43 kjcf05n02 systemd-modules-load[1897]: Inserted module 'rdma_ucm' Nov 3 17:03:43 kjcf05n02 systemd-modules-load[1897]: Module 'svcrdma' is blacklisted Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 17:03:43 kjcf05n02 systemd-udevd[1619]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 17:03:43 kjcf05n02 systemd-udevd[1607]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 17:03:43 kjcf05n02 systemd-modules-load[1904]: Inserted module 'ib_umad' Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 17:03:43 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 3 17:03:43 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 3 17:03:43 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 17:03:43 kjcf05n02 systemd[3147]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:03:43 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 17:03:43 kjcf05n02 openibd[1768]: Loading HCA driver and Access Layer:[ OK ] Nov 3 17:03:43 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Update is Completed. Nov 3 17:03:43 kjcf05n02 setup-icl[1759]: Setting LAN IP Address to 203.0.113.3 Nov 3 17:03:43 kjcf05n02 setup-icl[1759]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 17:03:43 kjcf05n02 setup-icl[1759]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 17:03:43 kjcf05n02 setup-icl[1759]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 17:03:43 kjcf05n02 systemd-udevd[1607]: Using default interface naming scheme 'rhel-8.0'. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 17:03:43 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 17:03:43 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 17:03:43 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 3 17:03:43 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 17:03:43 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 17:03:43 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 17:03:43 kjcf05n02 systemd[1]: Reached target Sockets. Nov 3 17:03:43 kjcf05n02 systemd[1]: Reached target Basic System. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 17:03:43 kjcf05n02 mcelog[2077]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 17:03:43 kjcf05n02 mcelog[2077]: CPU is unsupported Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 0 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 1 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 2 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 3 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 4 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 5 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 6 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 7 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 8 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 9 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 10 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 11 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 12 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 13 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 14 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 15 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 16 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 17 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 18 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 19 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 20 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 21 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 22 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 23 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 24 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 25 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 26 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 27 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 28 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 29 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 30 Nov 3 17:03:43 kjcf05n02 cpupower[2086]: Setting cpu: 31 Nov 3 17:03:43 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[2082]: Setting up Mellanox network interface: ib0 Nov 3 17:03:43 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[2105]: Setting up Mellanox network interface: ib1 Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 3 17:03:43 kjcf05n02 nscd[2172]: 2172 monitoring file `/etc/hosts` (1) Nov 3 17:03:43 kjcf05n02 nscd[2172]: 2172 monitoring directory `/etc` (2) Nov 3 17:03:43 kjcf05n02 nscd[2172]: 2172 monitoring file `/etc/resolv.conf` (3) Nov 3 17:03:43 kjcf05n02 nscd[2172]: 2172 monitoring directory `/etc` (2) Nov 3 17:03:43 kjcf05n02 beSetMlxConfig[2133]: ConnectX-3 multiport not detected Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 17:03:43 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[2171]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 17:03:43 kjcf05n02 network[2182]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[2181]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 17:03:43 kjcf05n02 chronyd[2229]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[2208]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 17:03:43 kjcf05n02 network[2211]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 17:03:43 kjcf05n02 network[2182]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:03:43 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 17:03:43 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[2222]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 0 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 1 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 2 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 3 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 4 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 5 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 6 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 7 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 8 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 9 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 10 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 11 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 12 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 13 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 14 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 15 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 16 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 17 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 18 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 19 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 20 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 21 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 22 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 23 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 24 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 25 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 26 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 27 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 28 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 29 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 30 Nov 3 17:03:43 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 31 Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 17:03:43 kjcf05n02 beSetMlxConfig[2133]: Starting MST (Mellanox Software Tools) driver set Nov 3 17:03:43 kjcf05n02 mdraid-phy[2239]: no Cutlass to worry about Nov 3 17:03:43 kjcf05n02 dwd[2233]: dwd: vMay 29 2024 : 15:38:26 Nov 3 17:03:43 kjcf05n02 dwd[2233]: /usr/sbin/dwd -d --standalone=0 Nov 3 17:03:43 kjcf05n02 dwd[2233]: dwd: option Lethal: 0 Nov 3 17:03:43 kjcf05n02 dwd[2233]: dwd: option Interval: 60 Nov 3 17:03:43 kjcf05n02 dwd[2233]: dwd: option abrtlimit: 10 Nov 3 17:03:43 kjcf05n02 dwd[2233]: dwd: option DZPeriod: 604800 Nov 3 17:03:43 kjcf05n02 dwd[2233]: dwd: option SmartPeriod: 43200 Nov 3 17:03:43 kjcf05n02 dwd[2233]: dwd: option SDDEnabled: 1 Nov 3 17:03:43 kjcf05n02 dwd[2233]: dwd: option SDDAwaitScale: 3 Nov 3 17:03:43 kjcf05n02 dwd[2233]: dwd: option SDDAwaitMin: 100 Nov 3 17:03:43 kjcf05n02 dwd[2233]: dwd: option Verbosity: 1 Nov 3 17:03:43 kjcf05n02 dwd[2233]: dwd: option StandAlone: 0 Nov 3 17:03:43 kjcf05n02 dwd[2233]: option Lethal: 0 Nov 3 17:03:43 kjcf05n02 dwd[2233]: option Interval: 60 Nov 3 17:03:43 kjcf05n02 dwd[2233]: option abrtlimit: 10 Nov 3 17:03:43 kjcf05n02 dwd[2233]: option DZPeriod: 604800 Nov 3 17:03:43 kjcf05n02 dwd[2233]: option SmartPeriod: 43200 Nov 3 17:03:43 kjcf05n02 dwd[2233]: option SDDEnabled: 1 Nov 3 17:03:43 kjcf05n02 dwd[2233]: option SDDAwaitScale: 3 Nov 3 17:03:43 kjcf05n02 dwd[2233]: option SDDAwaitMin: 100 Nov 3 17:03:43 kjcf05n02 dwd[2233]: option Verbosity: 1 Nov 3 17:03:43 kjcf05n02 dwd[2233]: option StandAlone: 0 Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 3 17:03:43 kjcf05n02 dbus-daemon[2187]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[2242]: No configuration found for ib0 Nov 3 17:03:43 kjcf05n02 network[2247]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:03:43 kjcf05n02 network[2182]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 17:03:43 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[2252]: No configuration found for ib1 Nov 3 17:03:43 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 17:03:43 kjcf05n02 beSetMlxConfig[2133]: Loading MST PCI module - Success Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[2265]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 3 17:03:43 kjcf05n02 network[2267]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 17:03:43 kjcf05n02 chronyd[2229]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 17:03:43 kjcf05n02 chronyd[2229]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[2273]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 17:03:43 kjcf05n02 mlnx_conf_mgr[2310]: INFO: No configurations found for mlx5_0, skipping. Nov 3 17:03:43 kjcf05n02 beSetMlxConfig[2133]: Loading MST PCI configuration module - Success Nov 3 17:03:43 kjcf05n02 beSetMlxConfig[2133]: Create devices Nov 3 17:03:43 kjcf05n02 sssd[sssd][2164]: Starting up Nov 3 17:03:43 kjcf05n02 mlnx_conf_mgr[2328]: INFO: No configurations found for mlx5_1, skipping. Nov 3 17:03:43 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 17:03:43 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 17:03:43 kjcf05n02 sssd[be[implicit_files]][2370]: Starting up Nov 3 17:03:43 kjcf05n02 sssd[nss][2461]: Starting up Nov 3 17:03:43 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 17:03:43 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Login Service... Nov 3 17:03:43 kjcf05n02 systemd-logind[2572]: New seat seat0. Nov 3 17:03:43 kjcf05n02 systemd-logind[2572]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Login Service. Nov 3 17:03:43 kjcf05n02 python3.9[2246]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 17:03:43 kjcf05n02 python3.9[3147]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 17:03:43 kjcf05n02 systemd-sysctl[2763]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 17:03:43 kjcf05n02 systemd-sysctl[2763]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 17:03:43 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 17:03:43 kjcf05n02 python3.9[2827]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 17:03:43 kjcf05n02 python3.9[3147]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 17:03:43 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 17:03:43 kjcf05n02 network[2182]: Bringing up loopback interface: [ OK ] Nov 3 17:03:43 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 17:03:43 kjcf05n02 python3.9[3022]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 17:03:43 kjcf05n02 python3.9[3147]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:03:43 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 17:03:43 kjcf05n02 systemd-sysctl[3099]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 17:03:43 kjcf05n02 systemd-sysctl[3099]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 17:03:43 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 17:03:43 kjcf05n02 systemd[1]: Reached target Network. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 17:03:43 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 3 17:03:43 kjcf05n02 sm-notify[3142]: Version 2.3.3 starting Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 17:03:43 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 17:03:43 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 3 17:03:43 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 17:03:43 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 3 17:03:43 kjcf05n02 sshd[3157]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 3 17:03:43 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 17:03:43 kjcf05n02 lldpad[3139]: setsockopt nearest_bridge: Invalid argument Nov 3 17:03:43 kjcf05n02 lldpad[3147]: Last message 'setsockopt nearest_b' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 3 17:03:43 kjcf05n02 beSetMlxConfig[2133]: Unloading MST PCI module (unused) - Success Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 3 17:03:43 kjcf05n02 python3.9[3164]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 17:03:43 kjcf05n02 python3.9[3147]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:03:43 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 17:03:43 kjcf05n02 syslog-ng[3147]: [2024-11-03T23:02:30.811570] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 17:03:43 kjcf05n02 syslog-ng[3147]: [2024-11-03T23:02:30.811858] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 17:03:43 kjcf05n02 syslog-ng[3147]: [2024-11-03T23:02:30.811894] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 17:03:43 kjcf05n02 syslog-ng[3147]: [2024-11-03T23:02:30.812473] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 17:03:43 kjcf05n02 syslog-ng[3147]: [2024-11-03T23:02:30.812765] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 17:03:43 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 17:03:43 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 17:03:43 kjcf05n02 python3.9[3400]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 17:03:43 kjcf05n02 python3.9[3147]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 17:03:43 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 17:03:43 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 17:03:43 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 17:03:43 kjcf05n02 chronyd[2229]: System's initial offset : 0.000913 seconds slow of true (slew) Nov 3 17:03:43 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 17:03:43 kjcf05n02 beSetMlxConfig[2133]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 17:03:43 kjcf05n02 beSetMlxConfig[2133]: ib mode Nov 3 17:03:43 kjcf05n02 root[3420]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 3 17:03:43 kjcf05n02 root[3422]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 3 17:03:43 kjcf05n02 beSetMlxConfig[2133]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 17:03:43 kjcf05n02 beSetMlxConfig[2133]: ib mode Nov 3 17:03:43 kjcf05n02 systemd-udevd[1555]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 17:03:43 kjcf05n02 systemd-udevd[3438]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:03:43 kjcf05n02 systemd-udevd[3439]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:03:43 kjcf05n02 systemd-udevd[3442]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:03:43 kjcf05n02 systemd-udevd[3446]: Using default interface naming scheme 'rhel-8.0'. Nov 3 17:03:43 kjcf05n02 systemd-udevd[3446]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:03:43 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 17:03:43 kjcf05n02 systemd[3147]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:03:43 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[3480]: Setting up Mellanox network interface: ib0 Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[3481]: Setting up Mellanox network interface: ib1 Nov 3 17:03:43 kjcf05n02 systemd-udevd[3440]: Using default interface naming scheme 'rhel-8.0'. Nov 3 17:03:43 kjcf05n02 systemd-udevd[3440]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:03:43 kjcf05n02 systemd-udevd[3441]: Using default interface naming scheme 'rhel-8.0'. Nov 3 17:03:43 kjcf05n02 systemd-udevd[3441]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[3530]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[3531]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[3561]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[3562]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[3563]: No configuration found for ib0 Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[3564]: No configuration found for ib1 Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[3571]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[3572]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 17:03:43 kjcf05n02 mlnx_conf_mgr[3609]: INFO: No configurations found for mlx5_0, skipping. Nov 3 17:03:43 kjcf05n02 mlnx_conf_mgr[3612]: INFO: No configurations found for mlx5_1, skipping. Nov 3 17:03:43 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 17:03:43 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 17:03:43 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 3 17:03:43 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 3 17:03:43 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 17:03:43 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 3 17:03:43 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 3 17:03:43 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 17:03:43 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 17:03:43 kjcf05n02 lldpad[3139]: init_ports: Error adding device ib0 Nov 3 17:03:43 kjcf05n02 lldpad[3139]: init_ports: Error adding device ib1 Nov 3 17:03:43 kjcf05n02 lldpad[3139]: Signal 15 received - terminating Nov 3 17:03:43 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 3 17:03:43 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 17:03:43 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 17:03:43 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 3 17:03:43 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 17:03:43 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 3 17:03:43 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 3 17:03:43 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:43 kjcf05n02 systemd[3147]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:03:43 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 1 | Nov-03-2024 | 22:32:55 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 2 | Nov-03-2024 | 22:33:46 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 3 | Nov-03-2024 | 22:33:47 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 4 | Nov-03-2024 | 22:34:53 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 5 | Nov-03-2024 | 22:34:53 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 6 | Nov-03-2024 | 22:59:49 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 7 | Nov-03-2024 | 22:59:49 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 8 | Nov-03-2024 | 22:59:49 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 9 | Nov-03-2024 | 22:59:49 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 10 | Nov-03-2024 | 22:59:49 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 11 | Nov-03-2024 | 22:59:49 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 12 | Nov-03-2024 | 22:59:49 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 13 | Nov-03-2024 | 22:59:49 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 14 | Nov-03-2024 | 22:59:49 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 15 | Nov-03-2024 | 22:59:49 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 16 | Nov-03-2024 | 22:59:49 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 17 | Nov-03-2024 | 22:59:49 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 18 | Nov-03-2024 | 22:59:49 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 19 | Nov-03-2024 | 22:59:49 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 20 | Nov-03-2024 | 22:59:49 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 21 | Nov-03-2024 | 22:59:49 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 22 | Nov-03-2024 | 22:59:49 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 23 | Nov-03-2024 | 22:59:49 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 24 | Nov-03-2024 | 22:59:49 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 25 | Nov-03-2024 | 22:59:49 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 26 | Nov-03-2024 | 22:59:49 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 27 | Nov-03-2024 | 22:59:49 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 28 | Nov-03-2024 | 22:59:50 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 29 | Nov-03-2024 | 22:59:50 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 30 | Nov-03-2024 | 22:59:50 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 31 | Nov-03-2024 | 22:59:50 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 32 | Nov-03-2024 | 22:59:50 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 33 | Nov-03-2024 | 22:59:50 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 34 | Nov-03-2024 | 22:59:50 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 35 | Nov-03-2024 | 22:59:50 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 36 | Nov-03-2024 | 22:59:50 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 37 | Nov-03-2024 | 22:59:50 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 38 | Nov-03-2024 | 23:00:20 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 39 | Nov-03-2024 | 23:00:20 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 40 | Nov-03-2024 | 23:00:20 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 41 | Nov-03-2024 | 23:00:20 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 42 | Nov-03-2024 | 23:00:20 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 43 | Nov-03-2024 | 23:00:20 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 44 | Nov-03-2024 | 23:00:20 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 45 | Nov-03-2024 | 23:00:20 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 46 | Nov-03-2024 | 23:00:20 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 47 | Nov-03-2024 | 23:00:20 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 48 | Nov-03-2024 | 23:00:20 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 49 | Nov-03-2024 | 23:00:20 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 50 | Nov-03-2024 | 23:00:20 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 51 | Nov-03-2024 | 23:00:20 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 52 | Nov-03-2024 | 23:00:20 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 53 | Nov-03-2024 | 23:00:20 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 54 | Nov-03-2024 | 23:00:20 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 55 | Nov-03-2024 | 23:00:20 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 56 | Nov-03-2024 | 23:00:20 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 57 | Nov-03-2024 | 23:00:20 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 58 | Nov-03-2024 | 23:00:20 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 59 | Nov-03-2024 | 23:00:20 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 60 | Nov-03-2024 | 23:00:22 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 61 | Nov-03-2024 | 23:00:22 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 62 | Nov-03-2024 | 23:00:22 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 63 | Nov-03-2024 | 23:00:22 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 64 | Nov-03-2024 | 23:00:22 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 65 | Nov-03-2024 | 23:00:22 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 66 | Nov-03-2024 | 23:00:22 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 67 | Nov-03-2024 | 23:00:22 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 68 | Nov-03-2024 | 23:00:22 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3956]: 69 | Nov-03-2024 | 23:00:22 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:03:43 kjcf05n02 ipmievd[3959]: Reading sensors... Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 3 17:03:43 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:43 kjcf05n02 systemd[3147]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 17:03:43 kjcf05n02 nscd[2172]: 2172 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 17:03:43 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 17:03:43 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 3 17:03:43 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 17:03:43 kjcf05n02 beSetMlxConfig[4016]: ConnectX-3 multiport not detected Nov 3 17:03:43 kjcf05n02 beSetMlxConfig[4016]: Starting MST (Mellanox Software Tools) driver set Nov 3 17:03:43 kjcf05n02 beSetMlxConfig[4016]: Loading MST PCI module - Success Nov 3 17:03:43 kjcf05n02 systemd-udevd[1555]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 17:03:43 kjcf05n02 beSetMlxConfig[4016]: [warn] mst_pciconf is already loaded, skipping Nov 3 17:03:43 kjcf05n02 beSetMlxConfig[4016]: Create devices Nov 3 17:03:43 kjcf05n02 beSetMlxConfig[4016]: Unloading MST PCI module (unused) - Success Nov 3 17:03:43 kjcf05n02 ipmievd[3959]: Waiting for events... Nov 3 17:03:43 kjcf05n02 beSetMlxConfig[4016]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 17:03:43 kjcf05n02 beSetMlxConfig[4016]: ib mode Nov 3 17:03:43 kjcf05n02 beSetMlxConfig[4016]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 17:03:43 kjcf05n02 beSetMlxConfig[4016]: ib mode Nov 3 17:03:43 kjcf05n02 systemd-udevd[1555]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 17:03:43 kjcf05n02 systemd-udevd[4917]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:03:43 kjcf05n02 systemd-udevd[4918]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:03:43 kjcf05n02 systemd-udevd[4921]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:03:43 kjcf05n02 systemd-udevd[4924]: Using default interface naming scheme 'rhel-8.0'. Nov 3 17:03:43 kjcf05n02 systemd-udevd[4924]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:03:43 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 17:03:43 kjcf05n02 systemd[3147]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:03:43 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[4959]: Setting up Mellanox network interface: ib1 Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[4960]: Setting up Mellanox network interface: ib0 Nov 3 17:03:43 kjcf05n02 systemd-udevd[4920]: Using default interface naming scheme 'rhel-8.0'. Nov 3 17:03:43 kjcf05n02 systemd-udevd[4920]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:03:43 kjcf05n02 systemd-udevd[4919]: Using default interface naming scheme 'rhel-8.0'. Nov 3 17:03:43 kjcf05n02 systemd-udevd[4919]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[5009]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[5010]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[5040]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[5041]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[5042]: No configuration found for ib0 Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[5043]: No configuration found for ib1 Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[5050]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 17:03:43 kjcf05n02 mlnx_interface_mgr[5051]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 17:03:43 kjcf05n02 mlnx_conf_mgr[5091]: INFO: No configurations found for mlx5_0, skipping. Nov 3 17:03:43 kjcf05n02 mlnx_conf_mgr[5090]: INFO: No configurations found for mlx5_1, skipping. Nov 3 17:03:43 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 17:03:43 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}33554b0294976b1f58faf608e8dbf01da7180a6730278c30d2d77d40aeb11855' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}33554b0294976b1f58faf608e8dbf01da7180a6730278c30d2d77d40aeb11855' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}dbd10fc54d0403242ccdb2d9e38d742f5735ec94aa21c3e69d2a2b4a0520ca78' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}dbd10fc54d0403242ccdb2d9e38d742f5735ec94aa21c3e69d2a2b4a0520ca78' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}9694adb1cad1fe334906f635da057945b0314f66377bd6146592d6dd4fb65616' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}9694adb1cad1fe334906f635da057945b0314f66377bd6146592d6dd4fb65616' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}45a654e102c9e4e609aa92b90b85c08c5a89845f9054cd086ef395410e47dcf8' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}45a654e102c9e4e609aa92b90b85c08c5a89845f9054cd086ef395410e47dcf8' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 17:03:43 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 3 17:03:43 kjcf05n02 chronyd[2229]: chronyd exiting Nov 3 17:03:43 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 3 17:03:43 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 17:03:43 kjcf05n02 chronyd[5126]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 17:03:43 kjcf05n02 chronyd[5126]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 17:03:43 kjcf05n02 chronyd[5126]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 17:03:43 kjcf05n02 chronyd[5126]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 17:03:43 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 17:03:43 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:43 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 17:03:43 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 3 17:03:43 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 17:03:43 kjcf05n02 dwd[5159]: dwd: vMay 29 2024 : 15:38:26 Nov 3 17:03:43 kjcf05n02 dwd[5159]: /usr/sbin/dwd -i 15 -d Nov 3 17:03:43 kjcf05n02 dwd[5159]: dwd: option Lethal: 0 Nov 3 17:03:43 kjcf05n02 dwd[5159]: dwd: option Interval: 15 Nov 3 17:03:43 kjcf05n02 dwd[5159]: dwd: option abrtlimit: 10 Nov 3 17:03:43 kjcf05n02 dwd[5159]: dwd: option DZPeriod: 604800 Nov 3 17:03:43 kjcf05n02 dwd[5159]: dwd: option SmartPeriod: 43200 Nov 3 17:03:43 kjcf05n02 dwd[5159]: dwd: option SDDEnabled: 1 Nov 3 17:03:43 kjcf05n02 dwd[5159]: dwd: option SDDAwaitScale: 3 Nov 3 17:03:43 kjcf05n02 dwd[5159]: dwd: option SDDAwaitMin: 100 Nov 3 17:03:43 kjcf05n02 dwd[5159]: dwd: option Verbosity: 1 Nov 3 17:03:43 kjcf05n02 dwd[5159]: dwd: option StandAlone: 0 Nov 3 17:03:43 kjcf05n02 dwd[5159]: option Lethal: 0 Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 17:03:43 kjcf05n02 dwd[5159]: option Interval: 15 Nov 3 17:03:43 kjcf05n02 dwd[5159]: option abrtlimit: 10 Nov 3 17:03:43 kjcf05n02 dwd[5159]: option DZPeriod: 604800 Nov 3 17:03:43 kjcf05n02 dwd[5159]: option SmartPeriod: 43200 Nov 3 17:03:43 kjcf05n02 dwd[5159]: option SDDEnabled: 1 Nov 3 17:03:43 kjcf05n02 dwd[5159]: option SDDAwaitScale: 3 Nov 3 17:03:43 kjcf05n02 dwd[5159]: option SDDAwaitMin: 100 Nov 3 17:03:43 kjcf05n02 dwd[5159]: option Verbosity: 1 Nov 3 17:03:43 kjcf05n02 dwd[5159]: option StandAlone: 0 Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 17:03:43 kjcf05n02 dwd[5160]: option Lethal now set to 1 Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 17:03:43 kjcf05n02 dwd[5160]: option abrtlimit now set to 1 Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 17:03:43 kjcf05n02 dwd[5160]: option SmartPeriod now set to 86400 Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 17:03:43 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 17:03:43 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:03:43 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:43 kjcf05n02 python3.9[5189]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 17:03:43 kjcf05n02 python3.9[3147]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 17:03:43 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:03:43 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 17:03:43 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:43 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 3 17:03:43 kjcf05n02 sedcpwrkr[5327]: Using config script: /etc/sedcpwrkr.conf Nov 3 17:03:43 kjcf05n02 sedcpwrkr[5327]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 17:03:43 kjcf05n02 sedcpwrkr[5327]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 17:03:43 kjcf05n02 sedcpwrkr[5327]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 17:03:43 kjcf05n02 sedcpwrkr[5327]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 17:03:43 kjcf05n02 sedcpwrkr[5327]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 17:03:43 kjcf05n02 sedcpwrkr[5327]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 17:03:43 kjcf05n02 sedcpwrkr-server[5358]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 17:03:43 kjcf05n02 sedcpwrkr[5327]: celery multi v5.2.7 (dawn-chorus) Nov 3 17:03:43 kjcf05n02 sedcpwrkr[5327]: > Starting nodes... Nov 3 17:03:43 kjcf05n02 sedcpwrkr[5327]: > sedcpwrkr@kjcf05n02: OK Nov 3 17:03:43 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 17:03:43 kjcf05n02 sedcpwrkr-server[5360]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 17:03:43 kjcf05n02 sedcpwrkr-server[5360]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 17:03:43 kjcf05n02 sedcpwrkr-server[5360]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 17:03:43 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 17:03:43 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 3 17:03:43 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 17:03:43 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 17:03:43 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 17:03:44 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:44 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 17:03:44 kjcf05n02 systemd-udevd[1555]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 17:03:44 kjcf05n02 iptables.init[5427]: iptables: Applying firewall rules: [ OK ] Nov 3 17:03:44 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 3 17:03:44 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:45 kjcf05n02 systemd[3147]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 17:03:45 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 17:03:45 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 17:03:45 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:46 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 17:03:46 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5524 which is not our child. We'll most likely not notice when it exits. Nov 3 17:03:46 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 17:03:46 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:46 kjcf05n02 openhpid[5524]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 17:03:46 kjcf05n02 openhpid[5524]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 17:03:46 kjcf05n02 openhpid[5524]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 17:03:46 kjcf05n02 openhpid[5524]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 17:03:46 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:46 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:03:46 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:03:46 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 17:03:46 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 17:03:46 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 17:03:46 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 17:03:46 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:46 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 17:03:47 kjcf05n02 dcs-collectord[5615]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 17:03:47 kjcf05n02 hpi.inv.log[5615]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 17:03:47 kjcf05n02 dcs-collectord[5615]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 17:03:47 kjcf05n02 dcs-collectord[5615]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 17:03:47 kjcf05n02 dcs-collector[5606]: Starting dcs-collector:[ OK ] Nov 3 17:03:47 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 17:03:47 kjcf05n02 dcs-collectord[5618]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 17:03:47 kjcf05n02 dcs-collectord[5618]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 17:03:47 kjcf05n02 dcs-collectord[5618]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 17:03:47 kjcf05n02 dcs-collectord[5618]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 17:03:47 kjcf05n02 dcs-collectord[5618]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 17:03:47 kjcf05n02 dcs-collectord[5618]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 17:03:47 kjcf05n02 dcs-collectord[5618]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 17:03:47 kjcf05n02 dcs-collectord[5618]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259341688", "units": "kB"}, {"name": "MemAvailable", "value": "258621912", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821276", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686908", "units": "kB"}, {"name": "Inactive", "value": "964848", "units": "kB"}, {"name": "Active(anon)", "value": "1520648", "units": "kB"}, {"name": "Inactive(anon)", "value": "828780", "units": "kB"}, {"name": "Active(file)", "value": "166260", "units": "kB"}, {"name": "Inactive(file)", "value": "136068", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "756108", "units": "kB"}, {"name": "Mapped", "value": "86172", "units": "kB"}, {"name": "Shmem", "value": "1593400", "units": "kB"}, {"name": "KReclaimable", "value": "109940", "units": "kB"}, {"name": "Slab", "value": "275736", "units": "kB"}, {"name": "SReclaimable", "value": "109940", "units": "kB"}, {"name": "SUnreclaim", "value": "165796", "units": "kB"}, {"name": "KernelStack", "value": "9664", "units": "kB"}, {"name": "PageTables", "value": "20444", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3174132", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11392", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "4096", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "272712", "units": "kB"}, {"name": "DirectMap2M", "value": "20563968", "units": "kB"}, {"name": "DirectMap1G", "value": "247463936", "units": "kB"}]}' Nov 3 17:03:47 kjcf05n02 dcs-collectord[5618]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 17:03:47 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 17:03:47 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:47 kjcf05n02 dcs-collectord[5618]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 17:03:47 kjcf05n02 dcs-collectord[5618]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730675027.1198807], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730675027.3627071], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730675027.0539298, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 17:03:47 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:47 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 17:03:47 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:03:47 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:03:47 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 17:03:47 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 17:03:47 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 17:03:47 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 17:03:48 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:48 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 17:03:48 kjcf05n02 firmware-update-orc[5724]: Using config script: /etc/firmware_update_orc.conf Nov 3 17:03:48 kjcf05n02 firmware-update-orc[5724]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 17:03:48 kjcf05n02 firmware-update-orc[5724]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 17:03:48 kjcf05n02 firmware-update-orc[5724]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 17:03:48 kjcf05n02 firmware-update-orc[5724]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 17:03:48 kjcf05n02 firmware-update-orc[5724]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 17:03:48 kjcf05n02 firmware-update-orc[5724]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 17:03:48 kjcf05n02 firmware-update-orc-server[5760]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 17:03:48 kjcf05n02 firmware-update-orc[5724]: celery multi v5.2.7 (dawn-chorus) Nov 3 17:03:48 kjcf05n02 firmware-update-orc[5724]: > Starting nodes... Nov 3 17:03:48 kjcf05n02 firmware-update-orc[5724]: > worker1@kjcf05n02: OK Nov 3 17:03:48 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 17:03:48 kjcf05n02 firmware-update-orc-server[5764]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 17:03:48 kjcf05n02 firmware-update-orc-server[5764]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 17:03:48 kjcf05n02 firmware-update-orc-server[5764]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 17:03:48 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 17:03:48 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 17:03:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 17:03:48 kjcf05n00 mcfcli[3673891]: %3|1730675028.750|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 17:03:49 kjcf05n02 systemd[3147]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:03:49 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:03:49 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:03:49 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 17:03:49 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 17:03:49 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 17:03:49 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 17:03:49 kjcf05n02 dbus-daemon[2187]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 17:03:49 kjcf05n02 dbus-daemon[2187]: [system] Reloaded configuration Nov 3 17:03:49 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 17:03:49 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 17:03:49 kjcf05n02 dbus-daemon[2187]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 17:03:49 kjcf05n02 dbus-daemon[2187]: [system] Reloaded configuration Nov 3 17:03:49 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 17:03:49 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 17:03:49 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 17:03:49 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 17:03:49 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:49 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 3 17:03:50 kjcf05n02 ras-resource-manager-agent[5880]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 17:03:50 kjcf05n02 ras-resource-manager-agent[5866]: Starting ras-resource-manager-agent:[ OK ] Nov 3 17:03:50 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 17:03:50 kjcf05n02 ras-resource-manager-agent[5882]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 17:03:50 kjcf05n02 ras-resource-manager-client[5882]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 17:03:50 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 3 17:03:50 kjcf05n02 ras-resource-manager-client[5882]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 17:03:50 kjcf05n02 ras-resource-manager-client[5892]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 17:03:50 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:50 kjcf05n02 systemd[3147]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:03:50 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:03:50 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:03:50 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 17:03:50 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 17:03:50 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:50 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 17:03:50 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:51 kjcf05n02 systemd[3147]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: Press Ctrl+C to exit. Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: Plugin support version 1.0 Nov 3 17:03:51 kjcf05n02 zabbix_agent2[5966]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 17:03:51 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:03:51 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:03:51 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:51 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 17:03:51 kjcf05n02 dcs-notification-sender[6043]: dcs-notification-senderd is stopped Nov 3 17:03:51 kjcf05n02 zabbix-agent2[6057]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 17:03:51 kjcf05n02 dcs-notification-sender[6043]: Starting notification-sender:[ OK ] Nov 3 17:03:51 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 17:03:52 kjcf05n02 zabbix-agent2[6059]: INFO DCS notification agent started. (agent.py:61) Nov 3 17:03:52 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 17:03:52 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:52 kjcf05n02 systemd[3147]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:03:52 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:03:52 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:03:52 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:52 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 17:03:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 17:03:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 17:03:52 kjcf05n02 dcs-collectord[6147]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 17:03:52 kjcf05n02 dcs-collectord[6147]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 17:03:52 kjcf05n02 dcs-bulk-data-sender[6147]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 17:03:52 kjcf05n02 dcs-bulk-data-sender[6138]: Starting bulk-data-sender:[ OK ] Nov 3 17:03:52 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 17:03:52 kjcf05n02 dcs-collectord[6149]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 17:03:52 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 17:03:52 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:53 kjcf05n02 systemd[3147]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:03:53 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:03:53 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:03:53 kjcf05n02 nscd[2172]: 2172 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 17:03:53 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 17:03:53 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 17:03:53 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 17:03:53 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 17:03:53 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 17:03:53 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 17:03:53 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 17:03:53 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 17:03:53 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 17:03:53 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 17:03:53 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 17:03:53 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 17:03:53 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 17:03:53 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 17:03:53 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 17:03:53 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 17:03:53 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 17:03:54 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 3 17:03:54 kjcf05n02 sssd[nss][2461]: Shutting down (status = 0) Nov 3 17:03:54 kjcf05n02 sssd[be[implicit_files]][2370]: Shutting down (status = 0) Nov 3 17:03:54 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 3 17:03:54 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 3 17:03:54 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 17:03:54 kjcf05n02 sssd[sssd][6236]: Starting up Nov 3 17:03:54 kjcf05n02 sssd[be[implicit_files]][6238]: Starting up Nov 3 17:03:54 kjcf05n02 python3.9[5189]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 17:03:54 kjcf05n02 python3.9[3147]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:03:54 kjcf05n02 sssd[nss][6239]: Starting up Nov 3 17:03:54 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 17:03:54 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 17:03:54 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 17:03:55 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 17:03:55 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 17:03:55 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 17:03:55 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 17:03:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 17:03:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 17:03:55 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 17:03:55 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 17:03:55 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 17:03:55 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 17:03:55 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 17:03:55 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 17:03:55 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 17:03:55 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 17:03:55 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 17:03:55 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 17:03:55 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:03:55 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:03:55 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:55 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 17:03:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 17:03:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 17:03:56 kjcf05n02 icinga2[6286]: [2024-11-03 17:03:56 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 17:03:56 kjcf05n02 icinga2[6286]: [2024-11-03 17:03:56 -0600] information/cli: Loading configuration file(s). Nov 3 17:03:56 kjcf05n02 icinga2[6286]: [2024-11-03 17:03:56 -0600] information/ConfigItem: Committing config item(s). Nov 3 17:03:56 kjcf05n02 icinga2[6286]: [2024-11-03 17:03:56 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 3 17:03:56 kjcf05n02 icinga2[6286]: [2024-11-03 17:03:56 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 17:03:56 kjcf05n02 icinga2[6286]: [2024-11-03 17:03:56 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 17:03:56 kjcf05n02 icinga2[6286]: [2024-11-03 17:03:56 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 17:03:56 kjcf05n02 icinga2[6286]: [2024-11-03 17:03:56 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 17:03:56 kjcf05n02 icinga2[6286]: [2024-11-03 17:03:56 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 17:03:56 kjcf05n02 icinga2[6286]: [2024-11-03 17:03:56 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 17:03:56 kjcf05n02 icinga2[6286]: [2024-11-03 17:03:56 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 17:03:56 kjcf05n02 icinga2[6286]: [2024-11-03 17:03:56 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 17:03:56 kjcf05n02 icinga2[6286]: [2024-11-03 17:03:56 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 17:03:56 kjcf05n02 icinga2[6286]: [2024-11-03 17:03:56 -0600] information/cli: Closing console log. Nov 3 17:03:56 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 17:03:56 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:56 kjcf05n02 systemd[3147]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:03:56 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:03:56 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:03:57 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 17:03:57 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 17:03:57 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:57 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 3 17:03:57 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:58 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 17:03:58 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:03:58 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:03:58 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 17:03:58 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 17:03:58 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 17:03:58 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 17:03:58 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 17:03:58 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 17:03:58 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 17:03:58 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 17:03:58 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 17:03:58 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 17:03:58 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 17:03:58 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 17:03:58 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 17:03:58 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 17:03:58 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:58 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 17:03:58 kjcf05n02 nslcd[6901]: version 0.9.9 starting Nov 3 17:03:58 kjcf05n02 nslcd[6901]: accepting connections Nov 3 17:03:58 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 17:03:59 kjcf05n02 systemd[1]: Reloading. Nov 3 17:03:59 kjcf05n02 systemd[3147]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:03:59 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:03:59 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:03:59 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 17:03:59 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 17:03:59 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 17:03:59 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 17:03:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 17:03:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 17:03:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 17:03:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 17:04:00 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 17:04:00 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 17:04:00 kjcf05n02 dcs-bulk-data-sender[6149]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 17:04:00 kjcf05n02 dcs-collectord[6149]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 17:04:00 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 17:04:00 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 17:04:00 kjcf05n02 systemd[1]: Reloading. Nov 3 17:04:01 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 17:04:01 kjcf05n02 dearcpw[7008]: Using config script: /etc/dearcpw.conf Nov 3 17:04:01 kjcf05n02 dearcpw[7008]: - Creating default directory: '/var/log/dearcpw' Nov 3 17:04:01 kjcf05n02 dearcpw[7008]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 17:04:01 kjcf05n02 dearcpw[7008]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 17:04:01 kjcf05n02 dearcpw[7008]: - Creating default directory: '/var/run/dearcpw' Nov 3 17:04:01 kjcf05n02 dearcpw[7008]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 17:04:01 kjcf05n02 dearcpw[7008]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 17:04:01 kjcf05n02 dearcpw-server[7048]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 17:04:01 kjcf05n02 dearcpw[7008]: celery multi v5.2.7 (dawn-chorus) Nov 3 17:04:01 kjcf05n02 dearcpw[7008]: > Starting nodes... Nov 3 17:04:01 kjcf05n02 dearcpw[7008]: > dearcpw@kjcf05n02: OK Nov 3 17:04:01 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 17:04:01 kjcf05n02 dearcpw-server[7064]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 17:04:01 kjcf05n02 dearcpw-server[7064]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 17:04:01 kjcf05n02 dearcpw-server[7064]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 17:04:01 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 3 17:04:01 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:04:01 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:04:01 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 17:04:01 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 17:04:01 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 17:04:01 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 17:04:01 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 17:04:01 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 17:04:01 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 17:04:01 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 17:04:01 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 17:04:01 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 17:04:01 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:53642). Nov 3 17:04:01 kjcf05n01 rsyncd[3202572]: connect from kjcf05n02 (172.16.2.5) Nov 3 17:04:01 kjcf05n01 rsyncd[3202572]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 17:04:01 kjcf05n01 rsyncd[3202572]: receiving file list Nov 3 17:04:01 kjcf05n01 rsyncd[3202572]: sent 29 bytes received 325 bytes total size 10905 Nov 3 17:04:01 kjcf05n01 systemd[1]: rsyncd@646-172.16.2.2:873-172.16.2.5:53642.service: Succeeded. Nov 3 17:04:01 kjcf05n02 puppet[7091]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 3 17:04:01 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 17:04:01 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 17:04:01 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 17:04:01 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 17:04:01 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 17:04:01 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 17:04:01 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 17:04:01 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 17:04:02 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 17:04:02 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 17:04:02 kjcf05n02 dcs-collectord[5618]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 17:04:02 kjcf05n02 dcs-collectord[5618]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 17:04:02 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 17:04:02 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 17:04:02 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 17:04:02 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 17:04:03 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 17:04:03 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 17:04:03 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 17:04:03 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 17:04:04 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 17:04:04 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 17:04:04 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 17:04:04 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 17:04:04 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 17:04:04 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 17:04:04 kjcf05n02 systemd[1]: Reloading. Nov 3 17:04:05 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 17:04:05 kjcf05n02 diskless-swap[7315]: HA_PS_000: recovering journal Nov 3 17:04:05 kjcf05n02 systemd-udevd[1555]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 17:04:05 kjcf05n02 diskless-swap[7315]: HA_PS_000: clean, 2285/6400 files, 7077/25600 blocks Nov 3 17:04:05 kjcf05n02 diskless-swap[7315]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 17:04:05 kjcf05n02 diskless-swap[7315]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 17:04:05 kjcf05n02 diskless-swap[7315]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 17:04:05 kjcf05n02 diskless-swap[7315]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 17:04:05 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 17:04:05 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:04:05 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:04:05 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 17:04:05 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 17:04:05 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 17:04:05 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 17:04:05 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 3 17:04:05 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 3 17:04:05 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 3 17:04:05 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 3 17:04:05 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 3 17:04:05 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 17:04:05 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 17:04:05 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 17:04:05 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 17:04:05 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 17:04:06 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 17:04:06 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 17:04:06 kjcf05n02 ipmievd[3959]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 17:04:06 kjcf05n02 ipmievd[3959]: System Event sensor - Timestamp Clock Sync Nov 3 17:04:06 kjcf05n02 ipmievd[3147]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:04:06 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 17:04:06 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 17:04:06 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 17:04:06 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 17:04:07 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 17:04:07 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 17:04:07 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 17:04:07 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 17:04:08 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 17:04:08 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 17:04:08 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 17:04:08 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 17:04:08 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 17:04:08 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 17:04:08 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 17:04:08 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 17:04:09 kjcf05n02 systemd[1]: Reloading. Nov 3 17:04:09 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 3 17:04:09 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:04:09 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:04:09 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 17:04:09 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 17:04:09 kjcf05n02 systemd[1]: Reloading. Nov 3 17:04:09 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 3 17:04:09 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:04:09 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:04:09 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 17:04:09 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 17:04:09 kjcf05n02 systemd[1]: Reloading. Nov 3 17:04:09 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 3 17:04:09 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:04:09 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:04:09 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 17:04:09 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 17:04:10 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 17:04:10 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 17:04:10 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 17:04:10 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 17:04:10 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 17:04:10 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 17:04:10 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 17:04:10 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 17:04:10 kjcf05n02 systemd[1]: Reloading. Nov 3 17:04:10 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 3 17:04:10 kjcf05n02 kdumpctl[7816]: kdump: No kdump initial ramdisk found. Nov 3 17:04:10 kjcf05n02 kdumpctl[7816]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 17:04:10 kjcf05n02 dracut[7928]: dracut-049-135.git20210121.el8 Nov 3 17:04:11 kjcf05n02 dracut[7930]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 17:04:11 kjcf05n02 dracut[7930]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 17:04:11 kjcf05n02 dracut[7930]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 17:04:11 kjcf05n02 dracut[7930]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 17:04:11 kjcf05n02 dracut[7930]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 17:04:11 kjcf05n02 dracut[7930]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 17:04:11 kjcf05n02 dracut[7930]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 17:04:11 kjcf05n02 dracut[7930]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + is_func check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ type -t check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 0 -ne 0 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check -h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local dev holder Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + require_binaries mdadm expr Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _module_name=90hperaid Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ mdadm = \-\m ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for cmd in "$@" Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + find_binary mdadm Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for cmd in "$@" Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + find_binary expr Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n -h ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for dev in "${!host_fs_types[@]}" Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ nfs != *_raid_member ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + continue Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _ret=255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + ret=255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ 255 = 0 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ 255 = 255 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ module_depends hperaid Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: +++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: +++ set -x Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ depends Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo rootfs-block Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ return 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ _ret=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ return 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for _moddep in $(module_depends $_mod) Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all == *\ hperaid\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + add_dracutmodules+=' rootfs-block ' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ == *\ hperaid\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check_module rootfs-block Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _mod=rootfs-block Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddep Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ == *\ rootfs-block\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n '' ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all == *\ rootfs-block\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + module_check rootfs-block 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 17:04:11 kjcf05n02 kdumpctl[3147]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _forced=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 2 -eq 2 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _forced=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + is_func check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ type -t check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 0 -ne 0 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check -h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _ret=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + ret=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ 0 = 0 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ module_depends rootfs-block Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: +++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 17:04:11 kjcf05n02 kdumpctl[3147]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ depends Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo fs-lib Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ _ret=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ return 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for _moddep in $(module_depends $_mod) Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all == *\ rootfs-block\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + add_dracutmodules+=' fs-lib ' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ == *\ rootfs-block\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check_module fs-lib Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _mod=fs-lib Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddep Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n '' ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + mods_checked_as_dep+=' fs-lib ' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all == *\ fs-lib\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + module_check fs-lib 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _forced=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 2 -eq 2 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _forced=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + is_func check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ type -t check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 0 -ne 0 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check -h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _ret=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + ret=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ 0 = 0 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ module_depends fs-lib Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: +++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ depends Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ return 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ _ret=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ return 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + mods_to_load+=' fs-lib ' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + mods_to_load+=' rootfs-block ' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + mods_to_load+=' hperaid ' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _mod=90kernel-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _mod=kernel-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check_module kernel-modules 1 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _mod=kernel-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddep Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n 1 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all = all ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + module_check kernel-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _forced=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 1 -eq 2 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + is_func check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ type -t check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 0 -ne 0 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check -h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + true Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _ret=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + ret=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ 0 != 0 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ module_depends kernel-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: +++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ depends Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ true Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ _ret=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ return 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + mods_to_load+=' kernel-modules ' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _mod=90kernel-modules-extra Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _mod=kernel-modules-extra Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check_module kernel-modules-extra 1 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _mod=kernel-modules-extra Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddep Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n 1 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all = all ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + module_check kernel-modules-extra Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _forced=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 1 -eq 2 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + is_func check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ type -t check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 0 -ne 0 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check -h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + true Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _ret=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + ret=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ 0 != 0 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ module_depends kernel-modules-extra Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: +++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ depends Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ true Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ _ret=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ return 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + mods_to_load+=' kernel-modules-extra ' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _mod=90kernel-network-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _mod=kernel-network-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check_module kernel-network-modules 1 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _mod=kernel-network-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddep Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n 1 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all = all ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + module_check kernel-network-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _forced=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 1 -eq 2 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + is_func check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ type -t check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 0 -ne 0 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check -h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _ret=255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + ret=255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ 255 != 0 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n 1 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 1 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _mod=90livenet Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _mod=livenet Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check_module livenet 1 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _mod=livenet Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddep Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n 1 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all = all ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + module_check livenet Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _forced=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 1 -eq 2 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + is_func check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ type -t check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 0 -ne 0 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check -h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _ret=255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + ret=255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ 255 != 0 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n 1 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 1 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _mod=90lvm Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _mod=lvm Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check_module lvm 1 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _mod=lvm Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddep Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n 1 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all = all ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + module_check lvm Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 17:04:11 kjcf05n02 kdumpctl[3147]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _forced=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 1 -eq 2 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + is_func check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ type -t check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 0 -ne 0 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check -h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + require_binaries lvm Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _module_name=90lvm Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ lvm = \-\m ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for cmd in "$@" Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + find_binary lvm Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n -h ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for fs in "${host_fs_types[@]}" Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ nfs = LVM*_member ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _ret=255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + ret=255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ 255 != 0 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n 1 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 1 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _mod=90mdraid Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _mod=mdraid Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check_module mdraid 1 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _mod=mdraid Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddep Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n 1 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all = all ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + module_check mdraid Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _forced=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 1 -eq 2 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + is_func check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ type -t check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 0 -ne 0 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check -h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _rootdev Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + require_binaries mdadm expr Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _module_name=90mdraid Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ mdadm = \-\m ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for cmd in "$@" Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + find_binary mdadm Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for cmd in "$@" Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + find_binary expr Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n -h ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for dev in "${!host_fs_types[@]}" Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ nfs != *_raid_member ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + continue Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _ret=255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + ret=255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ 255 != 0 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n 1 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 1 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _mod=90multipath Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _mod=multipath Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check_module multipath 1 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _mod=multipath Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddep Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n 1 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all = all ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + module_check multipath Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _forced=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 1 -eq 2 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + is_func check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ type -t check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 0 -ne 0 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check -h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _rootdev Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n -h ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for_each_host_dev_and_slaves is_mpath Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _func=is_mpath Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _dev Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for _dev in "${host_devs[@]}" Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + continue Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 1 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _ret=255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + ret=255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ 255 != 0 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n 1 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 1 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _mod=90qemu Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _mod=qemu Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check_module qemu 1 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _mod=qemu Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddep Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n 1 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all = all ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + module_check qemu Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _forced=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 1 -eq 2 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + is_func check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ type -t check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 0 -ne 0 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check -h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n -h ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + type -P systemd-detect-virt Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ systemd-detect-virt --vm Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + vm=none Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + (( 1 != 0 )) Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _ret=255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + ret=255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ 255 != 0 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n 1 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 1 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _mod=90qemu-net Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _mod=qemu-net Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check_module qemu-net 1 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _mod=qemu-net Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddep Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n 1 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all = all ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + module_check qemu-net Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _forced=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 1 -eq 2 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + is_func check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ type -t check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 0 -ne 0 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check -h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n -h ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + type -P systemd-detect-virt Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ systemd-detect-virt --vm Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + vm= Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + (( 1 != 0 )) Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _ret=255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + ret=255 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ 255 != 0 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n 1 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + return 1 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _mod=90stratis Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + _mod=stratis Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check_module stratis 1 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _mod=stratis Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddep Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -n 1 ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ all = all ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + module_check stratis Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ read a b Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _forced=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _hostonly=-h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 1 -eq 2 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + is_func check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: ++ type -t check Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + '[' 0 -ne 0 ']' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + check -h Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _module_name=90stratis Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + local _ret=0 Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + [[ stratisd-init = \-\m ]] Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + for cmd in "$@" Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + find_binary stratisd-init Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 17:04:11 kjcf05n02 kdumpctl[7816]: + set +x Nov 3 17:04:11 kjcf05n02 dracut[7930]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 17:04:11 kjcf05n02 dracut[7930]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 17:04:11 kjcf05n02 dracut[7930]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 17:04:11 kjcf05n02 dracut[7930]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 17:04:11 kjcf05n02 dracut[7930]: memstrack is available Nov 3 17:04:11 kjcf05n02 dracut[7930]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 17:04:11 kjcf05n02 dracut[7930]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 17:04:11 kjcf05n02 dracut[7930]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 17:04:11 kjcf05n02 dracut[7930]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 17:04:11 kjcf05n02 dracut[7930]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 17:04:11 kjcf05n02 dracut[7930]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 17:04:12 kjcf05n02 dracut[7930]: *** Including module: bash *** Nov 3 17:04:12 kjcf05n02 dracut[7930]: *** Including module: systemd *** Nov 3 17:04:12 kjcf05n02 dracut[7930]: *** Including module: fips *** Nov 3 17:04:13 kjcf05n02 dracut[7930]: *** Including module: systemd-initrd *** Nov 3 17:04:13 kjcf05n02 dracut[7930]: *** Including module: watchdog-modules *** Nov 3 17:04:13 kjcf05n02 dracut[7930]: *** Including module: nss-softokn *** Nov 3 17:04:13 kjcf05n02 dracut[7930]: *** Including module: i18n *** Nov 3 17:04:13 kjcf05n02 dracut[7930]: No KEYMAP configured. Nov 3 17:04:13 kjcf05n00 mcfcli[3673891]: %3|1730675053.280|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:04:13 kjcf05n02 dracut[7930]: *** Including module: network-legacy *** Nov 3 17:04:13 kjcf05n02 dracut[7930]: *** Including module: network *** Nov 3 17:04:13 kjcf05n02 dracut[7930]: *** Including module: ib_bonding *** Nov 3 17:04:13 kjcf05n02 dracut[7930]: *** Including module: drm *** Nov 3 17:04:16 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 3 17:04:17 kjcf05n02 dcs-collectord[5618]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 17:04:17 kjcf05n02 dcs-collectord[5618]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 17:04:17 kjcf05n02 dracut[7930]: *** Including module: hperaid *** Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + install Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + local rule rule_path Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + inst_multiple cat expr Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.EcgiRn/initramfs -a -f cat expr Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + _ret=0 Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + (( 0 != 0 )) Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + : Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + return 0 Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + inst_multiple -o mdmon Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.EcgiRn/initramfs -a -f -o mdmon Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + _ret=0 Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + (( 0 != 0 )) Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + : Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + return 0 Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: ++ command -v partx Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + inst /usr/sbin/partx /sbin/partx Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + local _hostonly_install Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + [[ -e /tmp/dracut.EcgiRn/initramfs//sbin/partx ]] Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.EcgiRn/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + (( 0 != 0 )) Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + : Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: ++ command -v mdadm Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + local _hostonly_install Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + [[ -e /tmp/dracut.EcgiRn/initramfs//sbin/mdadm ]] Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.EcgiRn/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + (( 0 != 0 )) Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + : Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + [[ yes == \y\e\s ]] Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + local _raidconf Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: ++ cmdline Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: ++ local _activated dev line UUID Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: ++ declare -A _activated Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: ++ for dev in "${!host_fs_types[@]}" Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: ++ [[ nfs != *_raid_member ]] Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: ++ continue Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + _raidconf= Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + [[ -n '' ]] Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + inst_rules 64-md-raid.rules Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + local _target=/etc/udev/rules.d _rule _found Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + inst_dir /usr/lib/udev/rules.d Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + [[ -e /tmp/dracut.EcgiRn/initramfs//usr/lib/udev/rules.d ]] Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + return 0 Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + inst_dir /etc/udev/rules.d Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + [[ -e /tmp/dracut.EcgiRn/initramfs//etc/udev/rules.d ]] Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + return 0 Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + for _rule in "$@" Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + continue Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + continue Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + for r in '' $dracutbasedir/rules.d/ Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + [[ 64-md-raid.rules != /* ]] Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + continue Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + for r in '' $dracutbasedir/rules.d/ Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + continue Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + [[ -n '' ]] Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 17:04:17 kjcf05n02 kdumpctl[7816]: + set +x Nov 3 17:04:17 kjcf05n02 dracut[7930]: Skipping udev rule: 64-md-raid.rules Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + installkernel Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + instmods =drivers/md Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + local _optional=-o Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + local _silent Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + local _ret Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + [[ '' = yes ]] Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + [[ =drivers/md = \-\c ]] Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + [[ =drivers/md = \-\s ]] Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + (( 1 == 0 )) Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.EcgiRn/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + _ret=0 Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + (( 0 != 0 )) Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + [[ -n '' ]] Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + return 0 Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + _ret=0 Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + unset check depends cmdline install installkernel Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + return 0 Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + modules_loaded+='hperaid ' Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + '[' -n '' ']' Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + _d_mod=90kernel-modules Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + _d_mod=kernel-modules Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + [[ '' = yes ]] Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + dinfo '*** Including module: kernel-modules ***' Nov 3 17:04:18 kjcf05n02 kdumpctl[7816]: + set +x Nov 3 17:04:18 kjcf05n02 dracut[7930]: *** Including module: kernel-modules *** Nov 3 17:04:18 kjcf05n02 dracut[7930]: *** Including module: kernel-modules-extra *** Nov 3 17:04:18 kjcf05n02 dracut[7930]: *** Including module: kernel-network-modules *** Nov 3 17:04:18 kjcf05n02 dracut[7930]: *** Including module: diskless-mod *** Nov 3 17:04:18 kjcf05n02 dracut[7930]: *** Including module: fstab-sys *** Nov 3 17:04:18 kjcf05n02 dracut[7930]: *** Including module: nfs *** Nov 3 17:04:18 kjcf05n00 mcfcli[3673891]: %3|1730675058.750|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:04:19 kjcf05n02 dracut[7930]: *** Including module: rootfs-block *** Nov 3 17:04:19 kjcf05n02 dracut[7930]: *** Including module: terminfo *** Nov 3 17:04:19 kjcf05n02 dracut[7930]: *** Including module: udev-rules *** Nov 3 17:04:19 kjcf05n02 dracut[7930]: Skipping udev rule: 91-permissions.rules Nov 3 17:04:19 kjcf05n02 dracut[7930]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 17:04:19 kjcf05n02 dracut[7930]: *** Including module: dracut-systemd *** Nov 3 17:04:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730675059', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.4% (3684948 kB) used.'}"] Nov 3 17:04:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.4% (3684948 kB) used.', 'message': 'OK - 1.4% (3684948 kB) used.', 'value': 'ok', 'timestamp': '1730675059'} Nov 3 17:04:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:04:20 kjcf05n02 dracut[7930]: *** Including module: usrmount *** Nov 3 17:04:20 kjcf05n02 dracut[7930]: *** Including module: base *** Nov 3 17:04:20 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 3 17:04:20 kjcf05n02 dracut[7930]: *** Including module: fs-lib *** Nov 3 17:04:20 kjcf05n02 dracut[7930]: *** Including module: kdumpbase *** Nov 3 17:04:21 kjcf05n02 dracut[7930]: *** Including module: memstrack *** Nov 3 17:04:21 kjcf05n02 dracut[7930]: *** Including module: shutdown *** Nov 3 17:04:21 kjcf05n02 dracut[7930]: *** Including module: squash *** Nov 3 17:04:21 kjcf05n02 dracut[7930]: *** Including modules done *** Nov 3 17:04:21 kjcf05n02 dracut[7930]: *** Installing kernel module dependencies *** Nov 3 17:04:22 kjcf05n02 dracut[7930]: *** Installing kernel module dependencies done *** Nov 3 17:04:22 kjcf05n02 dracut[7930]: *** Resolving executable dependencies *** Nov 3 17:04:23 kjcf05n02 dracut[7930]: *** Resolving executable dependencies done*** Nov 3 17:04:23 kjcf05n02 dracut[7930]: *** Hardlinking files *** Nov 3 17:04:23 kjcf05n02 dracut[7930]: *** Hardlinking files done *** Nov 3 17:04:23 kjcf05n02 dracut[7930]: *** Generating early-microcode cpio image *** Nov 3 17:04:23 kjcf05n02 dracut[7930]: *** Constructing AuthenticAMD.bin **** Nov 3 17:04:23 kjcf05n02 dracut[7930]: *** Store current command line parameters *** Nov 3 17:04:23 kjcf05n02 dracut[7930]: Stored kernel commandline: Nov 3 17:04:23 kjcf05n02 dracut[7930]: rd.driver.pre=sd_mod Nov 3 17:04:23 kjcf05n02 dracut[7930]: rd.driver.pre=nvme Nov 3 17:04:23 kjcf05n02 dracut[7930]: rd.driver.pre=ipmi_si Nov 3 17:04:23 kjcf05n02 dracut[7930]: rd.driver.pre=ipmi_devintf Nov 3 17:04:23 kjcf05n02 dracut[7930]: rd.driver.pre=ipmi_msghandler Nov 3 17:04:23 kjcf05n02 dracut[7930]: nameserver=172.16.2.2 Nov 3 17:04:23 kjcf05n02 dracut[7930]: nameserver=127.0.0.1 Nov 3 17:04:23 kjcf05n02 dracut[7930]: nameserver=172.16.2.2 Nov 3 17:04:23 kjcf05n02 dracut[7930]: nameserver=127.0.0.1 Nov 3 17:04:23 kjcf05n02 dracut[7930]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 3 17:04:23 kjcf05n02 dracut[7930]: rd.neednet Nov 3 17:04:23 kjcf05n02 dracut[7930]: kdumpnic=mgmt0 Nov 3 17:04:23 kjcf05n02 dracut[7930]: bootdev=mgmt0 Nov 3 17:04:23 kjcf05n02 dracut[7930]: *** Install squash loader *** Nov 3 17:04:23 kjcf05n00 zabbix-server[1426169]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 17:04:23 kjcf05n00 zabbix-server[1426169]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:50\\"}}"' Nov 3 17:04:23 kjcf05n00 log_interesting_event.py[1426169]: Event '46436' acknowledged Nov 3 17:04:23 kjcf05n02 dracut[7930]: *** Squashing the files inside the initramfs *** Nov 3 17:04:24 kjcf05n02 dracut[7930]: *** Squashing the files inside the initramfs done *** Nov 3 17:04:24 kjcf05n02 dracut[7930]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 17:04:24 kjcf05n02 dracut[7930]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 17:04:25 kjcf05n02 kdumpctl[7816]: kdump: kexec: loaded kdump kernel Nov 3 17:04:25 kjcf05n02 kdumpctl[7816]: kdump: Starting kdump: [OK] Nov 3 17:04:25 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 3 17:04:25 kjcf05n02 systemd[1]: Reloading. Nov 3 17:04:25 kjcf05n02 systemd[3147]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:04:25 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:04:25 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:04:25 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 17:04:25 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 17:04:25 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 17:04:25 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 17:04:25 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 17:04:25 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 17:04:25 kjcf05n02 ifdown[14525]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 17:04:25 kjcf05n02 ifdown[14526]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:04:25 kjcf05n02 ifdown[14527]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:04:25 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 17:04:25 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 17:04:25 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 17:04:25 kjcf05n02 ifup[14588]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 17:04:25 kjcf05n02 ifup[14589]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:04:25 kjcf05n02 ifup[14590]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:04:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730675065', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 17:04:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730675065'} Nov 3 17:04:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:04:27 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 17:04:30 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 17:04:30 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 17:04:30 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 17:04:30 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:04:30 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:04:30 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:04:30 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:04:30 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 17:04:30 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 17:04:30 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 17:04:30 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 17:04:30 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:04:30 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:04:30 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:04:30 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:04:30 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 17:04:30 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 17:04:30 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 17:04:30 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 17:04:30 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 17:04:30 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 17:04:30 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 17:04:30 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 17:04:30 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 17:04:30 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 17:04:30 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 17:04:30 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 17:04:30 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 17:04:30 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 17:04:30 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 17:04:30 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 17:04:30 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 17:04:30 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 17:04:30 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 17:04:30 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 17:04:30 kjcf05n02 ifdown[14784]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 17:04:30 kjcf05n02 ifdown[14785]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:04:30 kjcf05n02 ifdown[14786]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:04:30 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 17:04:30 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 17:04:30 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 17:04:30 kjcf05n02 ifup[14846]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 17:04:30 kjcf05n02 ifup[14848]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:04:30 kjcf05n02 ifup[14849]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:04:32 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 17:04:32 kjcf05n02 dcs-collectord[5618]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 17:04:32 kjcf05n02 dcs-collectord[5618]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 17:04:35 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 17:04:35 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 17:04:35 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 17:04:35 kjcf05n02 systemd[1]: Reloading. Nov 3 17:04:35 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 3 17:04:35 kjcf05n02 await_ha_peer[15057]: Waiting for HA peer kjcf05n03 Nov 3 17:04:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730675076', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 17:04:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730675076'} Nov 3 17:04:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:04:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730675076', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 17:04:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730675076'} Nov 3 17:04:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:04:36 kjcf05n02 await_ha_peer[15057]: Peer kjcf05n03 has started, starting HA Nov 3 17:04:37 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 17:04:37 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 3 17:04:37 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 3 17:04:37 kjcf05n02 fstonithd.py[15123]: Listening for kdump packets from partner Nov 3 17:04:37 kjcf05n02 systemd[1]: Reloading. Nov 3 17:04:37 kjcf05n02 systemd[3147]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:04:37 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:04:37 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:04:37 kjcf05n02 systemd[1]: Reloading. Nov 3 17:04:37 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 3 17:04:37 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 17:04:38 kjcf05n02 systemd[1]: Reloading. Nov 3 17:04:38 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 17:04:38 kjcf05n02 puppet-agent[3546]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:04:38 kjcf05n02 puppet[3546]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:04:38 kjcf05n02 puppet-agent[3546]: Applied catalog in 91.98 seconds Nov 3 17:04:38 kjcf05n02 puppet[3546]: Notice: Applied catalog in 91.98 seconds Nov 3 17:04:38 kjcf05n02 systemd[1]: Started Puppet agent. Nov 3 17:04:38 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 17:04:38 kjcf05n02 systemd[1]: Reached target Timers. Nov 3 17:04:38 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 17:04:38 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 17:04:38 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 17:04:38 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 17:04:38 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 17:04:38 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 17:04:38 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 3 17:04:38 kjcf05n02 wce-disable.sh[15264]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 17:04:38 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 17:04:38 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 17:04:38 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 17:04:38 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 17:04:38 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 3 17:04:38 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 3 17:04:38 kjcf05n02 python3.9[15262]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 17:04:38 kjcf05n02 python3.9[15262]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 17:04:38 kjcf05n02 gateway-ec-node.py[15263]: Starting gateway-ec-node service Nov 3 17:04:39 kjcf05n02 RFSF-API[15261]: INFO[2024-11-03T17:04:38-06:00] Datapath API RESTful Service starting Nov 3 17:04:39 kjcf05n02 dp-api-server-node[15261]: INFO[2024-11-03T17:04:38-06:00] Datapath API RESTful Service starting Nov 3 17:04:39 kjcf05n02 RFSF-API[15261]: INFO[2024-11-03T17:04:38-06:00] Running in production mode, starting dbus event listener Nov 3 17:04:39 kjcf05n02 dp-api-server-node[15261]: INFO[2024-11-03T17:04:38-06:00] Running in production mode, starting dbus event listener Nov 3 17:04:39 kjcf05n02 RFSF-API[15261]: INFO[2024-11-03T17:04:38-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 17:04:39 kjcf05n02 dp-api-server-node[15261]: INFO[2024-11-03T17:04:38-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 17:04:39 kjcf05n02 RFSF-API[15261]: INFO[2024-11-03T17:04:38-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 17:04:39 kjcf05n02 dp-api-server-node[15261]: INFO[2024-11-03T17:04:38-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 17:04:39 kjcf05n02 RFSF-API[15261]: INFO[2024-11-03T17:04:38-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 17:04:39 kjcf05n02 dp-api-server-node[15261]: INFO[2024-11-03T17:04:38-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 17:04:39 kjcf05n02 RFSF-API[15261]: INFO[2024-11-03T17:04:38-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 17:04:39 kjcf05n02 dp-api-server-node[15261]: INFO[2024-11-03T17:04:38-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 17:04:39 kjcf05n02 RFSF-API[15261]: INFO[2024-11-03T17:04:38-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 17:04:39 kjcf05n02 dp-api-server-node[15261]: INFO[2024-11-03T17:04:38-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 17:04:39 kjcf05n02 RFSF-API[15261]: INFO[2024-11-03T17:04:38-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 17:04:39 kjcf05n02 dp-api-server-node[15261]: INFO[2024-11-03T17:04:38-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 17:04:39 kjcf05n02 RFSF-API[15261]: INFO[2024-11-03T17:04:38-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 17:04:39 kjcf05n02 dp-api-server-node[15261]: INFO[2024-11-03T17:04:38-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 17:04:39 kjcf05n02 RFSF-API[15261]: INFO[2024-11-03T17:04:38-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 17:04:39 kjcf05n02 dp-api-server-node[15261]: INFO[2024-11-03T17:04:38-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 17:04:39 kjcf05n02 RFSF-API[15261]: INFO[2024-11-03T17:04:38-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 17:04:39 kjcf05n02 dp-api-server-node[15261]: INFO[2024-11-03T17:04:38-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 17:04:39 kjcf05n02 RFSF-API[15261]: INFO[2024-11-03T17:04:38-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 17:04:39 kjcf05n02 dp-api-server-node[15261]: INFO[2024-11-03T17:04:38-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 17:04:45 kjcf05n02 systemd[1]: Reloading. Nov 3 17:04:46 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 17:04:46 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 17:04:46 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 17:04:46 kjcf05n02 diskmonitor_pre[15792]: Key management is currently disabled.DEAR disabled Nov 3 17:04:46 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 17:04:47 kjcf05n02 dcs-collectord[5618]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 17:04:47 kjcf05n02 dcs-collectord[5618]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 17:04:47 kjcf05n02 dcs-collectord[5618]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 17:04:48 kjcf05n02 sh[15788]: LNET configured: New Created Nov 3 17:04:48 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 17:04:48 kjcf05n02 LCNmon[17817]: Interface ib0 is up Nov 3 17:04:48 kjcf05n02 LCNmon[17817]: Interface ib1 is up Nov 3 17:04:48 kjcf05n02 LCNmon[17817]: Can ping through interface ib0 Nov 3 17:04:48 kjcf05n00 httpd[902567]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 17:04:48 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 17:04:48 kjcf05n00 mcfcli[3673891]: %3|1730675088.751|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: /var/run/diskmonitor does not exist, creating Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: Creating /var/run/diskmonitor/disk Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: Creating /var/run/diskmonitor/encl Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: Creating /var/run/diskmonitor/cli Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: RAS_Interlocks_enabled: 1 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: add handler for sig: 14 sa_flags: 10000004 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: add handler for sig: 1 sa_flags: 10000004 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: add handler for sig: 2 sa_flags: 00000004 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: add handler for sig: 15 sa_flags: 00000004 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: add handler for sig: 6 sa_flags: 00000004 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: add handler for sig: 3 sa_flags: 00000004 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: add handler for sig: 30 sa_flags: 00000004 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: add handler for sig: 20 sa_flags: 00000004 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: add handler for sig: 10 sa_flags: 10000004 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: add handler for sig: 11 sa_flags: 00000004 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: add handler for sig: 7 sa_flags: 00000004 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: add handler for sig: 4 sa_flags: 00000004 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: add handler for sig: 8 sa_flags: 00000004 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: Using HA Baton locks - key: diskmonitor Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: Baton will be held for at most 570 seconds Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: DMMP Enabled: 0 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: random seed: 1235b80e Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: NVMe Enclosure: 1 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: ZFS Enclosure: 0 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: Dbus, Initialized Connection Successfully Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: int_catcher_thread: thread start Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: Received dbus message 4 org.freedesktop.DBus -> :1.92 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 17:04:50 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 17:04:50 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31455 deleted. Nov 3 17:04:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730675091', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(3192.0B/2312.0B), ib1=(3248.0B/3200.0B), icl0=(7.6kB/9.3kB), lo=(800.0B/800.0B), meth0=(1541.7MB/8.1MB), mgmt0=(1478.3MB/8.1MB)'}"] Nov 3 17:04:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(3192.0B/2312.0B), ib1=(3248.0B/3200.0B), icl0=(7.6kB/9.3kB), lo=(800.0B/800.0B), meth0=(1541.7MB/8.1MB), mgmt0=(1478.3MB/8.1MB)', 'message': 'NET OK - (Rx/Tx) ib0=(3192.0B/2312.0B), ib1=(3248.0B/3200.0B), icl0=(7.6kB/9.3kB), lo=(800.0B/800.0B), meth0=(1541.7MB/8.1MB), mgmt0=(1478.3MB/8.1MB)', 'value': 'ok', 'timestamp': '1730675091'} Nov 3 17:04:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:04:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730675091', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 17:04:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730675091'} Nov 3 17:04:52 kjcf05n02 openhpid[5524]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 17:04:52 kjcf05n02 openhpid[5524]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 17:04:52 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 3 17:04:52 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 17:04:52 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 17:04:52 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18363 which is not our child. We'll most likely not notice when it exits. Nov 3 17:04:52 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 17:04:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:04:52 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 3 17:04:52 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 3 17:04:52 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 17:04:52 kjcf05n02 dcs-collectord[5618]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 17:04:52 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 17:04:52 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 17:04:52 kjcf05n02 systemd[1]: Startup finished in 50.279s (kernel) + 2min 29.808s (userspace) = 3min 20.087s. Nov 3 17:04:52 kjcf05n02 openhpid[18363]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 17:04:52 kjcf05n02 openhpid[18363]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 17:04:52 kjcf05n02 openhpid[18363]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 17:04:52 kjcf05n02 openhpid[18363]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 17:04:52 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18421 (bash) Nov 3 17:04:52 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 17:04:52 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 17:04:52 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 17:04:52 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 17:04:52 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 17:04:52 kjcf05n02 LCNmon[17817]: 10.16.100.56 is unreachable via ib1 Nov 3 17:04:52 kjcf05n02 LCNmon[17817]: 10.16.100.60 is unreachable via ib1 Nov 3 17:04:52 kjcf05n02 LCNmon[17817]: Can ping through interface ib1 Nov 3 17:04:52 kjcf05n02 LCNmon[17817]: NIC ib0, initial state UP Nov 3 17:04:52 kjcf05n02 LCNmon[17817]: NIC ib1, initial state UP Nov 3 17:04:52 kjcf05n02 LCNmon[17817]: LCNstat initial state UP Nov 3 17:04:52 kjcf05n02 LCNmon[17817]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 3 17:04:52 kjcf05n00 mcfcli[3673891]: %3|1730675092.830|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:04:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 17:04:56 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 17:05:02 kjcf05n02 dcs-collectord[5618]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 17:05:02 kjcf05n02 dcs-collectord[5618]: WARNING No data collected (hpi_parser.py:353) Nov 3 17:05:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730675105', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.63, 1.84, 0.87'}"] Nov 3 17:05:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 1.63, 1.84, 0.87', 'message': 'OK - load average: 1.63, 1.84, 0.87', 'value': 'ok', 'timestamp': '1730675105'} Nov 3 17:05:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:05:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730675106', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 355 processes with STATE = RSZDT '}"] Nov 3 17:05:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 355 processes with STATE = RSZDT ', 'message': 'PROCS OK: 355 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730675106'} Nov 3 17:05:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:05:13 kjcf05n00 python3.9[1426804]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 17:05:16 kjcf05n02 ipmievd[3959]: System Event sensor - Timestamp Clock Sync Nov 3 17:05:17 kjcf05n02 ipmievd[3147]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:05:17 kjcf05n02 dcs-collectord[5618]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 17:05:18 kjcf05n00 mcfcli[3673891]: %3|1730675118.751|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:05:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730674831', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 17:05:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730674831'} Nov 3 17:05:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:05:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730674831', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 17:05:26 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730674831'} Nov 3 17:05:26 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 17:05:29 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 17:05:31 kjcf05n00 mcfcli[3673891]: %3|1730675131.617|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:05:32 kjcf05n02 dcs-collectord[5618]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 17:05:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730675132', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 17:05:32 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730675132'} Nov 3 17:05:32 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:05:36 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '22f7a856-9a38-11ef-a753-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 17:05:36 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '22f7a856-9a38-11ef-a753-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 17:05:36 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '22f7a856-9a38-11ef-a753-00093d0695e3', 'response ID': '2311c0e2-9a38-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 17:05:36 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 2311c0e2-9a38-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 17:05:37 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db01007002538450000000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 17:05:37 kjcf05n02 ras-resource-manager-agent[5882]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "22f7a856-9a38-11ef-a753-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 17:05:37 kjcf05n02 ras-resource-manager-agent[5882]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '22f7a856-9a38-11ef-a753-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 17:05:37 kjcf05n02 ras-resource-manager-agent[5882]: INFO Submitting new device inserted signal, starting to qualify drive: 22f7a856-9a38-11ef-a753-00093d0695e3 (admin_action.py:110) Nov 3 17:05:37 kjcf05n03 firmware-update-orc-server[5845]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "0a117bdf-bb94-4693-80fd-5d1382ebfd05"} (logger.py:65) Nov 3 17:05:37 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 140912 (get_disk_device) Nov 3 17:05:37 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 17:05:37 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 17:05:37 kjcf05n02 diskmonitor[17427]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 17:05:37 kjcf05n02 ras-resource-manager-agent[5882]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "2347130a-9a38-11ef-a753-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 17:05:37 kjcf05n02 ras-resource-manager-agent[5882]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '2347130a-9a38-11ef-a753-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 17:05:37 kjcf05n02 ras-resource-manager-agent[5882]: INFO Submitting new device inserted signal, starting to qualify drive: 2347130a-9a38-11ef-a753-00093d0695e3 (admin_action.py:110) Nov 3 17:05:37 kjcf05n02 firmware-update-orc-server[5838]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "a385b1c0-c40a-4915-940b-5dc2b15bc4ad"} (logger.py:65) Nov 3 17:05:37 kjcf05n03 ccp-client[140935]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 17:05:37 kjcf05n03 ccp-client[140935]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 17:05:37 kjcf05n03 ccp-client[140944]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 17:05:37 kjcf05n03 ccp-client[140935]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 17:05:37 kjcf05n03 ccp-client[140935]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 17:05:37 kjcf05n03 ccp-client[140944]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 17:05:37 kjcf05n03 ccp-client[140944]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 17:05:37 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '2347130a-9a38-11ef-a753-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 17:05:37 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '2347130a-9a38-11ef-a753-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 17:05:37 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '2347130a-9a38-11ef-a753-00093d0695e3', 'response ID': '234e9d5a-9a38-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 17:05:37 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 234e9d5a-9a38-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 17:05:40 kjcf05n03 DRVFW[141069]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 17:05:40 kjcf05n03 ccp-client[141070]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 17:05:40 kjcf05n03 ccp-client[141070]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 17:05:40 kjcf05n03 ccp-client[141079]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 17:05:40 kjcf05n03 ccp-client[141070]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 17:05:40 kjcf05n03 ccp-client[141070]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 17:05:40 kjcf05n03 ccp-client[141079]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 17:05:40 kjcf05n03 ccp-client[141079]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 17:05:40 kjcf05n03 firmware-update-orc-server[5845]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 17:05:40 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 2311c0e2-9a38-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 17:05:40 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '22f7a856-9a38-11ef-a753-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '22f7a856-9a38-11ef-a753-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}}} (logger.py:65) Nov 3 17:05:41 kjcf05n02 ras-resource-manager-agent[5882]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '22f7a856-9a38-11ef-a753-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 17:05:41 kjcf05n02 ras-resource-manager-agent[5882]: INFO Drive qualification complete responding: 22f7a856-9a38-11ef-a753-00093d0695e3 (admin_action.py:205) Nov 3 17:05:41 kjcf05n02 ras-resource-manager-agent[5882]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "22f7a856-9a38-11ef-a753-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (interesting_event.py:59) Nov 3 17:05:44 kjcf05n02 diskmonitor[17427]: 4 Nov 3 17:05:44 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 17:05:44 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 17:05:44 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 17:05:44 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 17:05:44 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 17:05:44 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 17:05:44 kjcf05n02 diskmonitor[17427]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 17:05:44 kjcf05n02 diskmonitor[17427]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 17:05:44 kjcf05n02 diskmonitor[17427]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 17:05:44 kjcf05n02 diskmonitor[17427]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 17:05:44 kjcf05n02 diskmonitor[17427]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 17:05:44 kjcf05n02 diskmonitor[17427]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "22f7a856-9a38-11ef-a753-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 17:05:44 kjcf05n02 diskmonitor[17427]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 17:05:44 kjcf05n02 diskmonitor[17427]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 17:05:44 kjcf05n02 diskmonitor[17427]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "2347130a-9a38-11ef-a753-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 17:05:44 kjcf05n02 diskmonitor[17427]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 17:05:44 kjcf05n02 diskmonitor[17427]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 17:05:47 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22386 (get_disk_device) Nov 3 17:05:47 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 17:05:47 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 17:05:47 kjcf05n02 ccp-client[22408]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 17:05:47 kjcf05n02 ccp-client[22408]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 17:05:47 kjcf05n02 ccp-client[22417]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 17:05:47 kjcf05n02 ccp-client[22408]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 17:05:47 kjcf05n02 ccp-client[22408]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 17:05:47 kjcf05n02 ccp-client[22417]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 17:05:47 kjcf05n02 ccp-client[22417]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 17:05:48 kjcf05n02 chronyd[5126]: Selected source 172.16.2.1 Nov 3 17:05:48 kjcf05n00 mcfcli[3673891]: %3|1730675148.751|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 17:05:50 kjcf05n02 DRVFW[22535]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 17:05:51 kjcf05n02 ccp-client[22536]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 17:05:51 kjcf05n02 ccp-client[22536]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 17:05:51 kjcf05n02 ccp-client[22550]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 17:05:51 kjcf05n02 ccp-client[22536]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 17:05:51 kjcf05n02 ccp-client[22536]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 17:05:51 kjcf05n02 ccp-client[22550]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 17:05:51 kjcf05n02 ccp-client[22550]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 17:05:51 kjcf05n02 firmware-update-orc-server[5838]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 17:05:51 kjcf05n02 ras-resource-manager-agent[5882]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "22f7a856-9a38-11ef-a753-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (service_main_handler.py:66) Nov 3 17:05:51 kjcf05n02 ras-resource-manager-agent[5882]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '22f7a856-9a38-11ef-a753-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 17:05:51 kjcf05n02 ras-resource-manager-agent[5882]: INFO Device qualification response has been acknowledged: 22f7a856-9a38-11ef-a753-00093d0695e3 (admin_action.py:151) Nov 3 17:05:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730675151}"] Nov 3 17:05:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730675151, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:05:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730675151}"] Nov 3 17:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730675151, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:05:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:05:52 kjcf05n02 ras-resource-manager-agent[5882]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '2347130a-9a38-11ef-a753-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 13}}} (resource_admin.py:98) Nov 3 17:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730675151}"] Nov 3 17:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730675151, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:05:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730675151}"] Nov 3 17:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730675151, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:05:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:05:52 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 234e9d5a-9a38-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 17:05:52 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '2347130a-9a38-11ef-a753-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '2347130a-9a38-11ef-a753-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 13}}}} (logger.py:65) Nov 3 17:05:52 kjcf05n02 ras-resource-manager-agent[5882]: INFO Drive qualification complete responding: 2347130a-9a38-11ef-a753-00093d0695e3 (admin_action.py:205) Nov 3 17:05:52 kjcf05n02 ras-resource-manager-agent[5882]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "2347130a-9a38-11ef-a753-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 13}}} (interesting_event.py:59) Nov 3 17:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730675151}"] Nov 3 17:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730675151, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:05:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730675151}"] Nov 3 17:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730675151, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:05:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:05:52 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 3 17:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730675151}"] Nov 3 17:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730675151, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:05:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730675151}"] Nov 3 17:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730675151, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:05:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:05:53 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 17:05:53 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 3 17:05:56 kjcf05n02 diskmonitor[17427]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 17:05:56 kjcf05n02 python3.9[5189]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 17:05:56 kjcf05n02 python3.9[3147]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:05:56 kjcf05n02 diskmonitor[17427]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 17:05:56 kjcf05n02 ras-resource-manager-agent[5882]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "2e9671ce-9a38-11ef-a753-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 17:05:56 kjcf05n02 ras-resource-manager-agent[5882]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '2e9671ce-9a38-11ef-a753-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 17:05:56 kjcf05n02 ras-resource-manager-agent[5882]: INFO Requests ['2347130a-9a38-11ef-a753-00093d0695e3', '2e9671ce-9a38-11ef-a753-00093d0695e3'] already in progress (admin_action.py:99) Nov 3 17:05:56 kjcf05n02 ras-resource-manager-agent[5882]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '2e9671ce-9a38-11ef-a753-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 13}}} (resource_admin.py:98) Nov 3 17:05:56 kjcf05n02 ras-resource-manager-agent[5882]: INFO Drive qualification complete responding: 2e9671ce-9a38-11ef-a753-00093d0695e3 (admin_action.py:205) Nov 3 17:05:56 kjcf05n02 ras-resource-manager-agent[5882]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "2347130a-9a38-11ef-a753-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 13}}} (interesting_event.py:59) Nov 3 17:05:56 kjcf05n02 ras-resource-manager-agent[5882]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "2e9671ce-9a38-11ef-a753-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 13}}} (interesting_event.py:59) Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "22f7a856-9a38-11ef-a753-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: Dbus, handle_ingress_ras_signals, uuid: 22f7a856-9a38-11ef-a753-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "22f7a856-9a38-11ef-a753-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: main: Pending firmware leveling requests exist, rescanning disks Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "2e9671ce-9a38-11ef-a753-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: leaving test state: 1 next state: 2 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: lock req: no timeout Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: leaving test state: 2 next state: 4 Nov 3 17:06:02 kjcf05n02 diskmonitor[17427]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 17:06:03 kjcf05n02 ras-resource-manager-agent[5882]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2347130a-9a38-11ef-a753-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 13}}} (service_main_handler.py:66) Nov 3 17:06:03 kjcf05n02 ras-resource-manager-agent[5882]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '2347130a-9a38-11ef-a753-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 13}}} (resource_admin.py:98) Nov 3 17:06:03 kjcf05n02 ras-resource-manager-agent[5882]: INFO Device qualification response has been acknowledged: 2347130a-9a38-11ef-a753-00093d0695e3 (admin_action.py:151) Nov 3 17:06:03 kjcf05n02 ras-resource-manager-agent[5882]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2347130a-9a38-11ef-a753-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 13}}} (service_main_handler.py:66) Nov 3 17:06:03 kjcf05n02 ras-resource-manager-agent[5882]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '2347130a-9a38-11ef-a753-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 13}}} (resource_admin.py:98) Nov 3 17:06:03 kjcf05n02 ras-resource-manager-agent[5882]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2e9671ce-9a38-11ef-a753-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 13}}} (service_main_handler.py:66) Nov 3 17:06:03 kjcf05n02 ras-resource-manager-agent[5882]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '2e9671ce-9a38-11ef-a753-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 13}}} (resource_admin.py:98) Nov 3 17:06:03 kjcf05n02 ras-resource-manager-agent[5882]: INFO Device qualification response has been acknowledged: 2e9671ce-9a38-11ef-a753-00093d0695e3 (admin_action.py:151) Nov 3 17:06:04 kjcf05n02 diskmonitor[17427]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 17:06:08 kjcf05n00 mcfcli[3673891]: %3|1730675168.895|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:06:18 kjcf05n00 mcfcli[3673891]: %3|1730675178.751|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 17:06:23 kjcf05n02 diskmonitor[17427]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "2347130a-9a38-11ef-a753-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 13}}} Nov 3 17:06:23 kjcf05n02 diskmonitor[17427]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 17:06:23 kjcf05n02 diskmonitor[17427]: Dbus, handle_ingress_ras_signals, uuid: 2347130a-9a38-11ef-a753-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 17:06:23 kjcf05n02 diskmonitor[17427]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 17:06:23 kjcf05n02 diskmonitor[17427]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2347130a-9a38-11ef-a753-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 13}}} Nov 3 17:06:23 kjcf05n02 diskmonitor[17427]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "2347130a-9a38-11ef-a753-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 13}}} Nov 3 17:06:23 kjcf05n02 diskmonitor[17427]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 17:06:23 kjcf05n02 diskmonitor[17427]: Dbus, handle_ingress_ras_signals, uuid: 2347130a-9a38-11ef-a753-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 17:06:23 kjcf05n02 diskmonitor[17427]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2347130a-9a38-11ef-a753-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 13}}} Nov 3 17:06:23 kjcf05n02 diskmonitor[17427]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "2e9671ce-9a38-11ef-a753-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 13}}} Nov 3 17:06:23 kjcf05n02 diskmonitor[17427]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 17:06:23 kjcf05n02 diskmonitor[17427]: Dbus, handle_ingress_ras_signals, uuid: 2e9671ce-9a38-11ef-a753-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 17:06:23 kjcf05n02 diskmonitor[17427]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2e9671ce-9a38-11ef-a753-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 13}}} Nov 3 17:06:23 kjcf05n02 diskmonitor[17427]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 17:06:23 kjcf05n02 diskmonitor[17427]: lock acquired Nov 3 17:06:23 kjcf05n02 diskmonitor[17427]: leaving test state: 4 next state: 8 Nov 3 17:06:23 kjcf05n02 diskmonitor[17427]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 17:06:42 kjcf05n02 diskmonitor[17427]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 17:06:42 kjcf05n02 diskmonitor[17427]: leaving test state: 8 next state: 20 Nov 3 17:06:42 kjcf05n02 diskmonitor[17427]: leaving test state: 20 next state: 40 Nov 3 17:06:42 kjcf05n02 diskmonitor[17427]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 76ab3d0000 Nov 3 17:06:42 kjcf05n02 diskmonitor[17427]: leaving test state: 40 next state: 80 Nov 3 17:06:44 kjcf05n00 mcfcli[3673891]: %3|1730675204.236|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:06:48 kjcf05n00 mcfcli[3673891]: %3|1730675208.751|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 17:06:58 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 17:06:58 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 17:06:58 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 17:06:59 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 17:07:08 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 17:07:08 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 17:07:08 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 17:07:13 kjcf05n02 dcs-collectord[5618]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 17:07:17 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 17:07:17 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 17:07:17 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 17:07:18 kjcf05n00 mcfcli[3673891]: %3|1730675238.752|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:07:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730675241}"] Nov 3 17:07:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730675241, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:07:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:07:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:07:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:07:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:07:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:07:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:07:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:07:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:07:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:07:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:07:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:07:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:07:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:07:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.207213ms Nov 3 17:07:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:07:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.207213ms Nov 3 17:07:22 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:07:22 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:07:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:07:22 kjcf05n00 mcfcli[3673891]: %3|1730675242.766|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:07:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730675247}"] Nov 3 17:07:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730675247, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:07:27 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:07:27-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:07:27 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:07:27-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:07:27 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:07:27-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:07:27 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:07:27-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:07:27 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:07:27-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:07:27 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:07:27-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:07:27 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:07:27-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.78333ms Nov 3 17:07:27 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:07:27-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.78333ms Nov 3 17:07:27 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:07:27 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:07:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:07:38 kjcf05n02 diskmonitor[17427]: leaving test state: 80 next state: 100 Nov 3 17:07:38 kjcf05n02 diskmonitor[17427]: lock release: time: Sun Nov 3 17:07:33 2024 Nov 3 17:07:38 kjcf05n02 diskmonitor[17427]: leaving test state: 100 next state: 1 Nov 3 17:07:48 kjcf05n00 mcfcli[3673891]: %3|1730675268.752|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:07:54 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 17:08:00 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 3 17:08:00 kjcf05n00 mcfcli[3673891]: %3|1730675280.855|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:08:18 kjcf05n00 mcfcli[3673891]: %3|1730675298.753|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:08:28 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 3 17:08:28 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 3 17:08:32 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 17:08:32 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 17:08:32 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 17:08:38 kjcf05n00 mcfcli[3673891]: %3|1730675318.244|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:08:49 kjcf05n00 mcfcli[3673891]: %3|1730675329.252|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 17:09:17 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 3 17:09:17 kjcf05n00 mcfcli[3673891]: %3|1730675357.071|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:09:19 kjcf05n00 mcfcli[3673891]: %3|1730675359.253|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:09:21 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 3 17:09:21 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 3 17:09:21 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 3 17:09:30 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 3 17:09:30 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 3 17:09:30 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 3 17:09:45 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 3 17:09:45 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 3 17:09:49 kjcf05n00 mcfcli[3673891]: %3|1730675389.253|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 17:09:55 kjcf05n00 mcfcli[3673891]: %3|1730675395.378|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 17:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 17:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 17:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 17:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 17:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 17:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 17:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 17:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 17:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 17:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 17:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 17:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 17:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 17:10:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 17:10:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:10:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 17:10:19 kjcf05n00 mcfcli[3673891]: %3|1730675419.253|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:10:20 kjcf05n00 python3.9[1429779]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 17:10:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730674831', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 17:10:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730674831'} Nov 3 17:10:33 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:10:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730674831', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 17:10:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730674831'} Nov 3 17:10:33 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:10:35 kjcf05n00 mcfcli[3673891]: %3|1730675435.375|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:10:49 kjcf05n00 mcfcli[3673891]: %3|1730675449.254|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 17:11:15 kjcf05n00 mcfcli[3673891]: %3|1730675475.372|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:11:19 kjcf05n00 mcfcli[3673891]: %3|1730675479.254|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:11:49 kjcf05n00 mcfcli[3673891]: %3|1730675509.255|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:11:54 kjcf05n00 mcfcli[3673891]: %3|1730675514.051|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:12:19 kjcf05n00 mcfcli[3673891]: %3|1730675539.370|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 17:12:32 kjcf05n00 mcfcli[3673891]: %3|1730675552.666|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:12:49 kjcf05n00 mcfcli[3673891]: %3|1730675569.370|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:13:11 kjcf05n00 mcfcli[3673891]: %3|1730675591.067|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:13:19 kjcf05n00 mcfcli[3673891]: %3|1730675599.370|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T17:13:27.254909993-06:00 level=info msg="Completed cleanup jobs" duration=28.479035ms Nov 3 17:13:48 kjcf05n00 mcfcli[3673891]: %3|1730675628.957|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:13:49 kjcf05n00 mcfcli[3673891]: %3|1730675629.370|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 17:14:19 kjcf05n00 mcfcli[3673891]: %3|1730675659.370|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:14:27 kjcf05n00 mcfcli[3673891]: %3|1730675667.267|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:14:49 kjcf05n00 mcfcli[3673891]: %3|1730675689.371|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:15:07 kjcf05n00 mcfcli[3673891]: %3|1730675707.264|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:15:14 kjcf05n00 python3.9[1432720]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 17:15:19 kjcf05n00 mcfcli[3673891]: %3|1730675719.371|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:15:23 kjcf05n00 zabbix-server[1433231]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 17:15:23 kjcf05n00 zabbix-server[1433231]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 118.13\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 104.66\\"}}"' Nov 3 17:15:23 kjcf05n00 log_interesting_event.py[1433231]: Event '46453' acknowledged Nov 3 17:15:26 kjcf05n02 root[42090]: failback_xyraid Nov 3 17:15:27 kjcf05n03 nslcd[6919]: [45e146] ldap_result() failed: Can't contact LDAP server Nov 3 17:15:28 kjcf05n02 root[42211]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 17:15:29 kjcf05n02 root[42365]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 17:15:32 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 3 17:15:35 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme8n1 Nov 3 17:15:35 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme18n1 Nov 3 17:15:35 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme9n1 Nov 3 17:15:35 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme24n1 Nov 3 17:15:35 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme2n1 Nov 3 17:15:35 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme19n1 Nov 3 17:15:35 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme4n1 Nov 3 17:15:35 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme25n1 Nov 3 17:15:35 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme17n1 Nov 3 17:15:35 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme23n1 Nov 3 17:15:35 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme3n1 Nov 3 17:15:37 kjcf05n02 dwd[5160]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 17:15:37 kjcf05n02 dwd[5160]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 17:15:37 kjcf05n02 dwd[5160]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 17:15:37 kjcf05n02 dwd[5160]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 17:15:37 kjcf05n02 dwd[5160]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 17:15:37 kjcf05n02 dwd[5160]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 17:15:37 kjcf05n02 dwd[5160]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 17:15:37 kjcf05n02 dwd[5160]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 17:15:37 kjcf05n02 dwd[5160]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 17:15:37 kjcf05n02 dwd[5160]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 17:15:37 kjcf05n02 dwd[5160]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 17:15:37 kjcf05n02 dwd[5160]: Starting NVME thread for nvme2n1 Nov 3 17:15:37 kjcf05n02 dwd[5160]: Starting NVME thread for nvme18n1 Nov 3 17:15:38 kjcf05n02 dwd[5160]: Starting NVME thread for nvme19n1 Nov 3 17:15:38 kjcf05n02 dwd[5160]: Starting NVME thread for nvme9n1 Nov 3 17:15:38 kjcf05n02 dwd[5160]: Starting NVME thread for nvme3n1 Nov 3 17:15:38 kjcf05n02 systemd-udevd[45067]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45070]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45068]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45072]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45067]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45070]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45072]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45068]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45067]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45070]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45068]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45072]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45067]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45070]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45068]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45072]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45088]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45067]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45068]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45070]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45072]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45091]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45089]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45093]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45088]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45067]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45070]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45072]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45068]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45091]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45089]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45088]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45067]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45070]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45072]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45068]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45091]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45089]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45067]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45070]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45072]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45068]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45089]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45067]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45091]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45091]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45072]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45070]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45091]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45067]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45091]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45067]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:15:38 kjcf05n02 systemd-udevd[45068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 17:15:39 kjcf05n02 systemd-udevd[45067]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 17:15:39 kjcf05n02 systemd-udevd[45068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:15:39 kjcf05n02 systemd-udevd[45067]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 17:15:39 kjcf05n02 systemd-udevd[45068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:15:39 kjcf05n02 systemd-udevd[45068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:15:39 kjcf05n02 systemd-udevd[45068]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:15:39 kjcf05n02 dwd[5160]: Starting NVME thread for nvme24n1 Nov 3 17:15:39 kjcf05n02 dwd[5160]: Starting NVME thread for nvme4n1 Nov 3 17:15:39 kjcf05n02 dwd[5160]: Starting NVME thread for nvme23n1 Nov 3 17:15:39 kjcf05n02 dwd[5160]: Starting NVME thread for nvme17n1 Nov 3 17:15:39 kjcf05n02 dwd[5160]: Starting NVME thread for nvme25n1 Nov 3 17:15:39 kjcf05n02 dwd[5160]: Starting NVME thread for nvme8n1 Nov 3 17:15:40 kjcf05n02 dcs-bulk-data-sender[6149]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 3 17:15:40 kjcf05n02 nslcd[6901]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 17:15:46 kjcf05n02 diskmonitor[17427]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 17:15:47 kjcf05n00 mcfcli[3673891]: %3|1730675747.261|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:15:49 kjcf05n00 mcfcli[3673891]: %3|1730675749.371|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 17:15:53 kjcf05n02 diskmonitor[17427]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 17:15:53 kjcf05n02 diskmonitor[17427]: Scan for ReadErrorMax change for md65 Nov 3 17:15:53 kjcf05n02 diskmonitor[17427]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 17:15:53 kjcf05n02 diskmonitor[17427]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 17:15:53 kjcf05n02 diskmonitor[17427]: read_saved_file: md65 no saved speed Nov 3 17:15:53 kjcf05n02 diskmonitor[17427]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 17:15:53 kjcf05n02 diskmonitor[17427]: Set sync_speed_min (10000) for md65 Nov 3 17:15:53 kjcf05n02 diskmonitor[17427]: Set sync_speed_max (200000) for md65 Nov 3 17:15:53 kjcf05n02 diskmonitor[17427]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 17:16:00 kjcf05n03 diskmonitor[17811]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 17:16:00 kjcf05n03 diskmonitor[17811]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 17:16:19 kjcf05n00 mcfcli[3673891]: %3|1730675779.371|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:16:27 kjcf05n00 mcfcli[3673891]: %3|1730675787.258|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:16:32 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 17:16:32 kjcf05n02 systemd-tmpfiles[48731]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 17:16:32 kjcf05n02 systemd-tmpfiles[48731]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 17:16:32 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 17:16:32 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 17:16:35 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 49000 (bash) Nov 3 17:16:35 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 17:16:35 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 17:16:49 kjcf05n00 mcfcli[3673891]: %3|1730675809.757|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 17:17:04 kjcf05n00 mcfcli[3673891]: %3|1730675824.489|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:17:19 kjcf05n00 mcfcli[3673891]: %3|1730675839.758|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:17:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730675842}"] Nov 3 17:17:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730675842, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:17:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.128767ms Nov 3 17:17:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.128767ms Nov 3 17:17:22 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:17:22 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:17:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:17:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730675842}"] Nov 3 17:17:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730675842, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:17:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.261385ms Nov 3 17:17:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.261385ms Nov 3 17:17:22 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:17:22 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:17:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:17:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730675842}"] Nov 3 17:17:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730675842, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:17:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.641998ms Nov 3 17:17:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.641998ms Nov 3 17:17:22 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:17:22 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:17:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:17:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730675842}"] Nov 3 17:17:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730675842, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:17:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.115552ms Nov 3 17:17:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.115552ms Nov 3 17:17:22 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:17:22 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:17:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:17:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730675842}"] Nov 3 17:17:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730675842, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:17:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.086918ms Nov 3 17:17:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.086918ms Nov 3 17:17:22 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:17:22 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:17:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:17:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730675842}"] Nov 3 17:17:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730675842, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:17:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.999705ms Nov 3 17:17:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.999705ms Nov 3 17:17:23 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:17:23 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:17:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:17:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730675842}"] Nov 3 17:17:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730675842, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:17:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.923993ms Nov 3 17:17:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.923993ms Nov 3 17:17:23 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:17:23 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:17:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:17:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730675842}"] Nov 3 17:17:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730675842, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:17:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.664701ms Nov 3 17:17:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.664701ms Nov 3 17:17:23 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:17:23 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:17:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:17:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730675842}"] Nov 3 17:17:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730675842, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:17:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.973465ms Nov 3 17:17:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.973465ms Nov 3 17:17:23 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:17:23 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:17:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:17:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730675842}"] Nov 3 17:17:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730675842, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:17:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.091226ms Nov 3 17:17:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.091226ms Nov 3 17:17:23 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:17:23 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:17:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:17:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730675842}"] Nov 3 17:17:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730675842, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:17:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:17:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:17:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:17:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:17:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:17:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:17:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.270963ms Nov 3 17:17:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:17:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.270963ms Nov 3 17:17:23 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:17:23 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:17:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:17:44 kjcf05n00 mcfcli[3673891]: %3|1730675864.486|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:17:49 kjcf05n00 mcfcli[3673891]: %3|1730675869.758|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:18:19 kjcf05n00 mcfcli[3673891]: %3|1730675899.759|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:18:24 kjcf05n00 mcfcli[3673891]: %3|1730675904.483|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:18:49 kjcf05n00 mcfcli[3673891]: %3|1730675929.759|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:19:04 kjcf05n00 mcfcli[3673891]: %3|1730675944.480|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:19:08 kjcf05n00 zabbix-server[1435330]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 17:19:08 kjcf05n00 zabbix-server[1435330]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46454' Nov 3 17:19:09 kjcf05n00 zabbix-server[1435330]: Filesystem 'kjcf05' has been mounted Nov 3 17:19:09 kjcf05n00 zabbix-server[1435330]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 17:19:09 kjcf05n00 zabbix-server[1435330]: Running puppet on 'None' Nov 3 17:19:11 kjcf05n05 puppet-agent[3791712]: Using configured environment 'production' Nov 3 17:19:11 kjcf05n05 puppet-agent[3791712]: Retrieving pluginfacts Nov 3 17:19:11 kjcf05n05 puppet-agent[3791712]: Retrieving plugin Nov 3 17:19:11 kjcf05n03 puppet-agent[164540]: Using configured environment 'production' Nov 3 17:19:11 kjcf05n03 puppet-agent[164540]: Retrieving pluginfacts Nov 3 17:19:11 kjcf05n03 puppet-agent[164540]: Retrieving plugin Nov 3 17:19:11 kjcf05n06 puppet-agent[3624878]: Using configured environment 'production' Nov 3 17:19:11 kjcf05n06 puppet-agent[3624878]: Retrieving pluginfacts Nov 3 17:19:11 kjcf05n06 puppet-agent[3624878]: Retrieving plugin Nov 3 17:19:11 kjcf05n04 puppet-agent[3626406]: Using configured environment 'production' Nov 3 17:19:11 kjcf05n04 puppet-agent[3626406]: Retrieving pluginfacts Nov 3 17:19:11 kjcf05n04 puppet-agent[3626406]: Retrieving plugin Nov 3 17:19:11 kjcf05n02 puppet-agent[53161]: Using configured environment 'production' Nov 3 17:19:11 kjcf05n02 puppet-agent[53161]: Retrieving pluginfacts Nov 3 17:19:11 kjcf05n02 puppet-agent[53161]: Retrieving plugin Nov 3 17:19:11 kjcf05n02 puppet-agent[53161]: Loading facts Nov 3 17:19:11 kjcf05n07 puppet-agent[3622126]: Using configured environment 'production' Nov 3 17:19:11 kjcf05n07 puppet-agent[3622126]: Retrieving pluginfacts Nov 3 17:19:11 kjcf05n07 puppet-agent[3622126]: Retrieving plugin Nov 3 17:19:11 kjcf05n07 puppet-agent[3622126]: Loading facts Nov 3 17:19:12 kjcf05n04 puppet-agent[3626406]: Loading facts Nov 3 17:19:12 kjcf05n03 puppet-agent[164540]: Loading facts Nov 3 17:19:12 kjcf05n05 puppet-agent[3791712]: Loading facts Nov 3 17:19:12 kjcf05n06 puppet-agent[3624878]: Loading facts Nov 3 17:19:12 kjcf05n01 puppet-agent[3208436]: Using configured environment 'production' Nov 3 17:19:12 kjcf05n01 puppet-agent[3208436]: Retrieving pluginfacts Nov 3 17:19:12 kjcf05n01 puppet-agent[3208436]: Retrieving plugin Nov 3 17:19:12 kjcf05n00 puppet-agent[1435396]: Using configured environment 'production' Nov 3 17:19:12 kjcf05n00 puppet-agent[1435396]: Retrieving pluginfacts Nov 3 17:19:12 kjcf05n00 puppet-agent[1435396]: Retrieving plugin Nov 3 17:19:12 kjcf05n00 puppet-agent[1435396]: Loading facts Nov 3 17:19:12 kjcf05n01 puppet-agent[3208436]: Loading facts Nov 3 17:19:14 kjcf05n02 puppet-agent[53161]: Caching catalog for kjcf05n02 Nov 3 17:19:14 kjcf05n02 puppet-agent[53161]: Applying configuration version '1730675953' Nov 3 17:19:14 kjcf05n06 puppet-agent[3624878]: Caching catalog for kjcf05n06 Nov 3 17:19:14 kjcf05n06 puppet-agent[3624878]: Applying configuration version '1730675953' Nov 3 17:19:14 kjcf05n03 puppet-agent[164540]: Caching catalog for kjcf05n03 Nov 3 17:19:14 kjcf05n03 puppet-agent[164540]: Applying configuration version '1730675953' Nov 3 17:19:14 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 17:19:14 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 17:19:15 kjcf05n07 puppet-agent[3622126]: Caching catalog for kjcf05n07 Nov 3 17:19:15 kjcf05n07 puppet-agent[3622126]: Applying configuration version '1730675953' Nov 3 17:19:16 kjcf05n01 puppet-agent[3208436]: Caching catalog for kjcf05n01 Nov 3 17:19:15 kjcf05n00 puppet-agent[1435396]: Caching catalog for kjcf05n00 Nov 3 17:19:15 kjcf05n00 puppet-agent[1435396]: Applying configuration version '1730675954' Nov 3 17:19:16 kjcf05n01 puppet-agent[3208436]: Applying configuration version '1730675954' Nov 3 17:19:16 kjcf05n02 puppet-agent[53161]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 17:19:16 kjcf05n02 puppet-agent[53161]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 17:19:16 kjcf05n02 puppet-agent[53161]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 17:19:16 kjcf05n06 puppet-agent[3624878]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 17:19:16 kjcf05n06 puppet-agent[3624878]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 17:19:16 kjcf05n06 puppet-agent[3624878]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 17:19:17 kjcf05n03 puppet-agent[164540]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 17:19:17 kjcf05n03 puppet-agent[164540]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 17:19:17 kjcf05n03 puppet-agent[164540]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 17:19:17 kjcf05n07 puppet-agent[3622126]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 17:19:17 kjcf05n07 puppet-agent[3622126]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 17:19:17 kjcf05n07 puppet-agent[3622126]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 17:19:17 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 17:19:17 kjcf05n03 zabbix_agent2[108898]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 17:19:17 kjcf05n03 zabbix_agent2[3145]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 17:19:17 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 17:19:17 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 17:19:17 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 17:19:17 kjcf05n03 puppet-agent[164540]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: Press Ctrl+C to exit. Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: Plugin support version 1.0 Nov 3 17:19:17 kjcf05n03 zabbix_agent2[165141]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 17:19:17 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3572686]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 17:19:17 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 17:19:17 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 17:19:17 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 17:19:17 kjcf05n06 puppet-agent[3624878]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: Press Ctrl+C to exit. Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: Plugin support version 1.0 Nov 3 17:19:17 kjcf05n06 zabbix_agent2[3625278]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 17:19:17 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 17:19:17 kjcf05n02 zabbix_agent2[5966]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 17:19:17 kjcf05n02 zabbix_agent2[3147]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:19:17 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 17:19:17 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 17:19:17 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 17:19:17 kjcf05n02 puppet-agent[53161]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: Press Ctrl+C to exit. Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: Plugin support version 1.0 Nov 3 17:19:17 kjcf05n02 zabbix_agent2[53776]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 17:19:17 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3570175]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 17:19:17 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 17:19:17 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 17:19:17 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 17:19:17 kjcf05n07 puppet-agent[3622126]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: Press Ctrl+C to exit. Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: Plugin support version 1.0 Nov 3 17:19:17 kjcf05n07 zabbix_agent2[3622872]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 17:19:18 kjcf05n00 puppet-agent[1435396]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 17:19:19 kjcf05n06 puppet-agent[3624878]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 17:19:19 kjcf05n06 puppet-agent[3624878]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 17:19:19 kjcf05n06 puppet-agent[3624878]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 17:19:19 kjcf05n06 puppet-agent[3624878]: Applied catalog in 4.71 seconds Nov 3 17:19:19 kjcf05n01 puppet-agent[3208436]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 17:19:19 kjcf05n07 puppet-agent[3622126]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 17:19:19 kjcf05n07 puppet-agent[3622126]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 17:19:19 kjcf05n07 puppet-agent[3622126]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 17:19:19 kjcf05n02 puppet-agent[53161]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 17:19:19 kjcf05n02 puppet-agent[53161]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 17:19:19 kjcf05n02 puppet-agent[53161]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 17:19:19 kjcf05n02 puppet-agent[53161]: Applied catalog in 5.12 seconds Nov 3 17:19:19 kjcf05n03 puppet-agent[164540]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 17:19:19 kjcf05n03 puppet-agent[164540]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 17:19:19 kjcf05n03 puppet-agent[164540]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 17:19:19 kjcf05n01 puppet-agent[3208436]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-16:57:31]/mode) mode changed '0755' to '0750' Nov 3 17:19:19 kjcf05n01 puppet-agent[3208436]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-16:57:31/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 17:19:19 kjcf05n01 puppet-agent[3208436]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-16:57:31/vmcore]/mode) mode changed '0600' to '0640' Nov 3 17:19:19 kjcf05n01 puppet-agent[3208436]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-16:57:31/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 17:19:19 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 17:19:19 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 17:19:19 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 17:19:20 kjcf05n07 puppet-agent[3622126]: Applied catalog in 4.83 seconds Nov 3 17:19:19 kjcf05n00 puppet-agent[1435396]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 17:19:19 kjcf05n00 puppet-agent[1435396]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 17:19:19 kjcf05n00 puppet-agent[1435396]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 17:19:19 kjcf05n00 mcfcli[3673891]: %3|1730675959.760|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:19:20 kjcf05n03 puppet-agent[164540]: Applied catalog in 5.13 seconds Nov 3 17:19:20 kjcf05n01 puppet-agent[3208436]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 17:19:20 kjcf05n01 puppet-agent[3208436]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 17:19:20 kjcf05n01 puppet-agent[3208436]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 17:19:20 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1416469]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 17:19:20 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 17:19:20 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 17:19:20 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 17:19:20 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 17:19:20 kjcf05n00 puppet-agent[1435396]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: Press Ctrl+C to exit. Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: Plugin support version 1.0 Nov 3 17:19:20 kjcf05n00 zabbix_agent2[1435876]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 17:19:21 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3196810]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 17:19:21 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 17:19:21 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 17:19:21 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 17:19:21 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 17:19:21 kjcf05n01 puppet-agent[3208436]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: Press Ctrl+C to exit. Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: Plugin support version 1.0 Nov 3 17:19:21 kjcf05n01 zabbix_agent2[3208785]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 17:19:20 kjcf05n00 zabbix-server[1435899]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 17:19:21 kjcf05n00 zabbix-server[1435900]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 17:19:21 kjcf05n00 zabbix-server[1435909]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 17:19:22 kjcf05n00 zabbix-server[1435911]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 17:19:22 kjcf05n00 puppet-agent[1435396]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 17:19:23 kjcf05n01 puppet-agent[3208436]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_170452.log]/mode) mode changed '0644' to '0640' Nov 3 17:19:23 kjcf05n01 puppet-agent[3208436]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_171635.log]/mode) mode changed '0644' to '0640' Nov 3 17:19:23 kjcf05n01 puppet-agent[3208436]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_171636]/mode) mode changed '0755' to '0750' Nov 3 17:19:23 kjcf05n01 puppet-agent[3208436]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_171636/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 17:19:23 kjcf05n01 puppet-agent[3208436]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_170452.log]/mode) mode changed '0644' to '0640' Nov 3 17:19:23 kjcf05n01 puppet-agent[3208436]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_171635.log]/mode) mode changed '0644' to '0640' Nov 3 17:19:23 kjcf05n01 puppet-agent[3208436]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 17:19:23 kjcf05n01 puppet-agent[3208436]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 17:19:23 kjcf05n01 puppet-agent[3208436]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 17:19:23 kjcf05n00 puppet-agent[1435396]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 17:19:23 kjcf05n00 puppet-agent[1435396]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 17:19:23 kjcf05n00 puppet-agent[1435396]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 17:19:24 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 17:19:24 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 17:19:24 kjcf05n00 puppet-agent[1435396]: Applied catalog in 8.32 seconds Nov 3 17:19:25 kjcf05n01 puppet-agent[3208436]: Applied catalog in 8.89 seconds Nov 3 17:19:29 kjcf05n04 puppet-agent[3626406]: Caching catalog for kjcf05n04 Nov 3 17:19:29 kjcf05n04 puppet-agent[3626406]: Applying configuration version '1730675967' Nov 3 17:19:31 kjcf05n04 puppet-agent[3626406]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 17:19:31 kjcf05n04 puppet-agent[3626406]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 17:19:31 kjcf05n04 puppet-agent[3626406]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 17:19:31 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3570053]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 17:19:31 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 17:19:31 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 17:19:31 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 17:19:31 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 17:19:31 kjcf05n04 puppet-agent[3626406]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: Press Ctrl+C to exit. Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: Plugin support version 1.0 Nov 3 17:19:31 kjcf05n04 zabbix_agent2[3627381]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 17:19:33 kjcf05n04 puppet-agent[3626406]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 17:19:33 kjcf05n04 puppet-agent[3626406]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 17:19:33 kjcf05n04 puppet-agent[3626406]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 17:19:33 kjcf05n04 puppet-agent[3626406]: Applied catalog in 4.75 seconds Nov 3 17:19:40 kjcf05n05 puppet-agent[3791712]: Caching catalog for kjcf05n05 Nov 3 17:19:40 kjcf05n05 puppet-agent[3791712]: Applying configuration version '1730675979' Nov 3 17:19:42 kjcf05n00 mcfcli[3673891]: %3|1730675982.086|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:19:42 kjcf05n05 puppet-agent[3791712]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 17:19:42 kjcf05n05 puppet-agent[3791712]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 17:19:42 kjcf05n05 puppet-agent[3791712]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 17:19:43 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3733375]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 17:19:43 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 17:19:43 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 17:19:43 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 17:19:43 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 17:19:43 kjcf05n05 puppet-agent[3791712]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: Press Ctrl+C to exit. Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: Plugin support version 1.0 Nov 3 17:19:43 kjcf05n05 zabbix_agent2[3793824]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 17:19:44 kjcf05n05 puppet-agent[3791712]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 17:19:44 kjcf05n05 puppet-agent[3791712]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 17:19:44 kjcf05n05 puppet-agent[3791712]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 17:19:45 kjcf05n05 puppet-agent[3791712]: Applied catalog in 4.80 seconds Nov 3 17:19:45 kjcf05n00 zabbix-server[1435330]: puppet completed status:(0): '' Nov 3 17:19:45 kjcf05n00 zabbix-server[1435330]: Event '46454' acknowledged Nov 3 17:19:45 kjcf05n00 zabbix-server[1435330]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 3 17:19:49 kjcf05n00 mcfcli[3673891]: %3|1730675989.760|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 17:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 17:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 17:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 17:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 17:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 17:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 17:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 17:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 17:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 17:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 17:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 17:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 17:20:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 17:20:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:20:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 17:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 17:20:14 kjcf05n00 python3.9[1436398]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 17:20:19 kjcf05n00 mcfcli[3673891]: %3|1730676019.760|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:20:22 kjcf05n00 mcfcli[3673891]: %3|1730676022.083|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:20:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730676027', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 17:20:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730676027'} Nov 3 17:20:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:20:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730676027', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 17:20:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730676027'} Nov 3 17:20:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:20:49 kjcf05n00 mcfcli[3673891]: %3|1730676049.760|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 17:20:54 kjcf05n02 dwd[5160]: nvme17n1 passed periodic SMART status check Nov 3 17:20:54 kjcf05n02 dwd[5160]: nvme9n1 passed periodic SMART status check Nov 3 17:20:54 kjcf05n02 dwd[5160]: nvme25n1 passed periodic SMART status check Nov 3 17:20:54 kjcf05n02 dwd[5160]: nvme2n1 passed periodic SMART status check Nov 3 17:20:54 kjcf05n02 dwd[5160]: nvme8n1 passed periodic SMART status check Nov 3 17:20:54 kjcf05n02 dwd[5160]: nvme24n1 passed periodic SMART status check Nov 3 17:20:54 kjcf05n02 dwd[5160]: nvme19n1 passed periodic SMART status check Nov 3 17:20:54 kjcf05n02 dwd[5160]: nvme4n1 passed periodic SMART status check Nov 3 17:20:54 kjcf05n02 dwd[5160]: nvme3n1 passed periodic SMART status check Nov 3 17:20:54 kjcf05n02 dwd[5160]: nvme23n1 passed periodic SMART status check Nov 3 17:20:54 kjcf05n02 dwd[5160]: nvme18n1 passed periodic SMART status check Nov 3 17:21:01 kjcf05n00 mcfcli[3673891]: %3|1730676061.550|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:21:19 kjcf05n00 mcfcli[3673891]: %3|1730676079.760|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:21:37 kjcf05n00 mcfcli[3673891]: %3|1730676097.438|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:21:49 kjcf05n00 mcfcli[3673891]: %3|1730676109.762|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:22:17 kjcf05n00 mcfcli[3673891]: %3|1730676137.434|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:22:19 kjcf05n00 mcfcli[3673891]: %3|1730676139.762|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:22:49 kjcf05n00 mcfcli[3673891]: %3|1730676169.762|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:22:56 kjcf05n00 mcfcli[3673891]: %3|1730676176.566|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T23:23:15.867813Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 17:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T23:23:15.867879Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.087ms Nov 3 17:23:19 kjcf05n00 mcfcli[3673891]: %3|1730676199.762|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T17:23:27.268352997-06:00 level=info msg="Completed cleanup jobs" duration=41.280321ms Nov 3 17:23:36 kjcf05n00 mcfcli[3673891]: %3|1730676216.563|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:23:49 kjcf05n00 mcfcli[3673891]: %3|1730676229.763|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 17:24:10 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 3 17:24:10 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 9 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007881 sec, idle for 1 hour(s)] Nov 3 17:24:15 kjcf05n00 mcfcli[3673891]: %3|1730676255.746|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:24:19 kjcf05n00 mcfcli[3673891]: %3|1730676259.763|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:24:49 kjcf05n00 mcfcli[3673891]: %3|1730676289.764|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:24:55 kjcf05n00 mcfcli[3673891]: %3|1730676295.743|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:25:14 kjcf05n00 python3.9[1439229]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 17:25:19 kjcf05n00 mcfcli[3673891]: %3|1730676319.764|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 17:25:25 kjcf05n03 chronyd[5130]: Selected source 16.110.135.123 Nov 3 17:25:30 kjcf05n00 mcfcli[3673891]: %3|1730676330.572|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:25:49 kjcf05n00 mcfcli[3673891]: %3|1730676349.764|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 17:26:08 kjcf05n00 mcfcli[3673891]: %3|1730676368.553|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:26:19 kjcf05n00 mcfcli[3673891]: %3|1730676379.765|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 17:26:46 kjcf05n00 mcfcli[3673891]: %3|1730676406.039|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:26:49 kjcf05n00 mcfcli[3673891]: %3|1730676409.765|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:27:19 kjcf05n00 mcfcli[3673891]: %3|1730676439.765|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:27:23 kjcf05n00 mcfcli[3673891]: %3|1730676443.625|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 17:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 17:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 17:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 17:27:42 kjcf05n00 zabbix_server[15749]: Zabbix agent item "dcs.lustre.device.ost.count[{$LUSTRE_FS_NAME}]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 3 17:27:43 kjcf05n00 zabbix_server[15729]: Zabbix agent item "net.if.in["ib1",dropped]" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 3 17:27:46 kjcf05n03 fstonithd.py[15375]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 3 17:27:46 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 17:27:46 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 17:27:46 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 17:27:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 17:27:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 17:27:48 kjcf05n03 root[179232]: is_enc_ipmi_off starts Nov 3 17:27:48 kjcf05n03 root[179233]: is_viking_off starts Nov 3 17:27:48 kjcf05n03 root[179249]: is_lan_ipmi_off leaves Nov 3 17:27:48 kjcf05n03 root[179251]: is_lan_ipmi_sec_off leaves Nov 3 17:27:48 kjcf05n03 root[179254]: I am master Nov 3 17:27:48 kjcf05n03 root[179257]: I am in slot 1; partner is in slot 0 Nov 3 17:27:49 kjcf05n00 mcfcli[3673891]: %3|1730676469.766|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:27:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 17:27:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 17:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 17:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 17:27:55 kjcf05n03 root[179572]: is_viking_off leaves Nov 3 17:27:55 kjcf05n03 root[179575]: kjcf05n02 not already off look at kdump Nov 3 17:27:55 kjcf05n03 root[179580]: is_kdump_off starts Nov 3 17:27:55 kjcf05n03 fence_kdump[179584]: waiting for message from '172.16.2.5' Nov 3 17:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 17:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 17:27:56 kjcf05n03 fence_kdump[179584]: received valid message from '172.16.2.5' Nov 3 17:27:56 kjcf05n03 root[179639]: is_kdump_off detected kdump on kjcf05n02 Nov 3 17:27:56 kjcf05n03 root[179640]: kjcf05n02 is kdumping Nov 3 17:27:56 kjcf05n03 root[179777]: is_enc_ipmi_off starts Nov 3 17:27:56 kjcf05n03 root[179778]: is_viking_off starts Nov 3 17:27:56 kjcf05n03 root[179802]: is_lan_ipmi_off leaves Nov 3 17:27:56 kjcf05n03 root[179804]: is_lan_ipmi_sec_off leaves Nov 3 17:27:56 kjcf05n03 root[179807]: I am master Nov 3 17:27:56 kjcf05n03 root[179810]: I am in slot 1; partner is in slot 0 Nov 3 17:27:57 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.count[{$LUSTRE_FS_NAME}]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 17:27:58 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.swap.size[,pfree]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 17:27:58 kjcf05n00 zabbix_server[15743]: Zabbix agent item "dcs.lustre.device.ost.name[OST0003,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 17:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 17:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 17:28:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 17:28:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 17:27:59 kjcf05n00 zabbix_server[15752]: Zabbix agent item "net.if.out["icl0",dropped]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 17:28:00 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 17:28:00 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 17:28:01 kjcf05n00 mcfcli[3673891]: %3|1730676481.863|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:28:04 kjcf05n03 root[180059]: is_viking_off leaves Nov 3 17:28:04 kjcf05n03 root[180062]: kjcf05n02 not already off look at kdump Nov 3 17:28:04 kjcf05n03 root[180063]: is_kdump_off starts Nov 3 17:28:04 kjcf05n03 fence_kdump[180064]: waiting for message from '172.16.2.5' Nov 3 17:28:04 kjcf05n03 fence_kdump[180064]: received valid message from '172.16.2.5' Nov 3 17:28:04 kjcf05n03 root[180077]: is_kdump_off detected kdump on kjcf05n02 Nov 3 17:28:04 kjcf05n03 root[180078]: kjcf05n02 is kdumping Nov 3 17:28:09 kjcf05n03 dwd[5162]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 17:28:09 kjcf05n03 dwd[5162]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 17:28:09 kjcf05n03 dwd[5162]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 17:28:09 kjcf05n03 dwd[5162]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 17:28:09 kjcf05n03 dwd[5162]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 17:28:09 kjcf05n03 dwd[5162]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 17:28:09 kjcf05n03 dwd[5162]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 17:28:09 kjcf05n03 dwd[5162]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 17:28:09 kjcf05n03 dwd[5162]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 17:28:09 kjcf05n03 dwd[5162]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 17:28:09 kjcf05n03 dwd[5162]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 17:28:09 kjcf05n03 systemd-udevd[182338]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182340]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182338]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182342]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182343]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182340]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182338]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182343]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182342]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182340]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182338]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182342]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182340]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182343]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182338]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182342]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182357]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182343]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182358]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182340]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182362]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182338]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182364]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182357]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182342]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182343]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182358]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182362]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182338]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182364]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182357]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182342]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182358]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182343]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182362]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182338]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182342]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182364]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182343]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182358]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182342]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182364]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182343]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182358]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182342]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182364]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182362]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182358]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182342]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182358]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182364]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182342]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182343]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182364]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182364]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182364]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182343]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182364]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182343]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182364]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182343]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182364]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182343]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 systemd-udevd[182343]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:28:09 kjcf05n03 dwd[5162]: Starting NVME thread for nvme2n1 Nov 3 17:28:09 kjcf05n03 dwd[5162]: Starting NVME thread for nvme8n1 Nov 3 17:28:09 kjcf05n03 dwd[5162]: Starting NVME thread for nvme24n1 Nov 3 17:28:10 kjcf05n03 dwd[5162]: Starting NVME thread for nvme17n1 Nov 3 17:28:10 kjcf05n03 dwd[5162]: Starting NVME thread for nvme3n1 Nov 3 17:28:10 kjcf05n03 dwd[5162]: Starting NVME thread for nvme25n1 Nov 3 17:28:10 kjcf05n03 dwd[5162]: Starting NVME thread for nvme19n1 Nov 3 17:28:10 kjcf05n03 dwd[5162]: Starting NVME thread for nvme4n1 Nov 3 17:28:10 kjcf05n03 dwd[5162]: Starting NVME thread for nvme18n1 Nov 3 17:28:10 kjcf05n03 dwd[5162]: Starting NVME thread for nvme23n1 Nov 3 17:28:10 kjcf05n03 dwd[5162]: Starting NVME thread for nvme9n1 Nov 3 17:28:11 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='39', error='Connection reset by peer (104)' Nov 3 17:28:11 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='39', client='AF_INET(172.16.2.5:35209)', local='AF_INET(0.0.0.0:601)' Nov 3 17:28:13 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0001,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 3 17:28:14 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vfs.fs.size[/var/lib/reboot_cnt,used]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 3 17:28:19 kjcf05n03 diskmonitor[17811]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 17:28:19 kjcf05n00 mcfcli[3673891]: %3|1730676499.766|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 17:28:28 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 3 17:28:29 kjcf05n03 diskmonitor[17811]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 17:28:29 kjcf05n03 diskmonitor[17811]: Scan for ReadErrorMax change for md65 Nov 3 17:28:29 kjcf05n03 diskmonitor[17811]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 17:28:29 kjcf05n03 diskmonitor[17811]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 17:28:29 kjcf05n03 diskmonitor[17811]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.min.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 17:28:29 kjcf05n03 diskmonitor[17811]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.max.794fe8ae1f0100877de04f0b557d9e3f file Nov 3 17:28:29 kjcf05n03 diskmonitor[17811]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 17:28:29 kjcf05n03 diskmonitor[17811]: Set sync_speed_min (10000) for md65 Nov 3 17:28:29 kjcf05n03 diskmonitor[17811]: Set sync_speed_max (200000) for md65 Nov 3 17:28:29 kjcf05n03 diskmonitor[17811]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 17:28:29 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 3 17:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 17:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 17:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 17:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 17:28:40 kjcf05n00 mcfcli[3673891]: %3|1730676520.294|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:28:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 17:28:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 17:28:49 kjcf05n00 mcfcli[3673891]: %3|1730676529.766|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:28:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 17:28:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 17:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 17:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 17:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 17:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 17:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 17:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 17:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 17:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 17:29:17 kjcf05n03 nslcd[6919]: ldap_result() failed: Can't contact LDAP server Nov 3 17:29:17 kjcf05n03 nslcd[6919]: [b127f8] ldap_result() failed: Can't contact LDAP server Nov 3 17:29:19 kjcf05n03 nslcd[6919]: [16231b] ldap_result() failed: Can't contact LDAP server Nov 3 17:29:19 kjcf05n00 mcfcli[3673891]: %3|1730676559.044|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:29:19 kjcf05n00 mcfcli[3673891]: %3|1730676559.766|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 17:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 17:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 17:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 17:29:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 17:29:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 17:29:49 kjcf05n00 mcfcli[3673891]: %3|1730676589.766|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 17:29:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 17:29:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 17:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 17:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 17:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 17:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 17:29:57 kjcf05n00 mcfcli[3673891]: %3|1730676597.791|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 17:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 17:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 17:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 17:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 17:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 17:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 17:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 17:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 17:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 17:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 17:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 17:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 17:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 17:30:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 17:30:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:30:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 17:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 17:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 17:30:12 kjcf05n06 diskmonitor[19372]: Unable to send RAW command (channel=0x0 netfn=0x3c lun=0x0 cmd=0x33 rsp=0xc1): Invalid command Nov 3 17:30:12 kjcf05n06 diskmonitor[19372]: read_master_remote: unable to read master status: -1 Nov 3 17:30:12 kjcf05n06 diskmonitor[19372]: run_on_master: ntry=1/10, error getting remote master (2) Nov 3 17:30:19 kjcf05n00 mcfcli[3673891]: %3|1730676619.766|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:30:33 kjcf05n00 python3.9[1442197]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 17:30:33 kjcf05n00 mcfcli[3673891]: %3|1730676633.487|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 17:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 17:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 17:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 17:30:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730676646', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 17:30:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730676646'} Nov 3 17:30:46 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:30:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730676646', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 17:30:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730676646'} Nov 3 17:30:46 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:30:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 17:30:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 17:30:49 kjcf05n00 mcfcli[3673891]: %3|1730676649.767|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 17:30:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 17:30:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 17:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 17:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 17:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 17:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 17:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 17:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 17:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 17:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 17:31:11 kjcf05n00 zabbix-server[1442916]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 17:31:11 kjcf05n00 zabbix-server[1442916]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 17:31:11 kjcf05n00 mcfcli[3673891]: %3|1730676671.740|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:31:11 kjcf05n00 log_interesting_event.py[1442916]: Event '46457' acknowledged Nov 3 17:31:19 kjcf05n00 mcfcli[3673891]: %3|1730676679.767|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 17:31:34 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 3 17:31:34 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 17:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 17:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 17:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 17:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 17:31:38 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 3 17:31:38 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 3 17:31:38 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 3 17:31:38 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 17:31:38 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 3 17:31:38 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 3 17:31:38 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 3 17:31:41 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 3 17:31:44 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 3 17:31:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 17:31:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 17:31:48 kjcf05n00 mcfcli[3673891]: %3|1730676708.740|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:31:49 kjcf05n00 mcfcli[3673891]: %3|1730676709.769|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:31:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 17:31:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 17:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 17:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 17:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 17:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 17:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 17:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 17:31:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 17:31:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 17:32:03 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 17:32:19 kjcf05n00 mcfcli[3673891]: %3|1730676739.769|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:32:28 kjcf05n00 mcfcli[3673891]: %3|1730676748.738|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:32:31 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:38352). Nov 3 17:32:31 kjcf05n01 rsyncd[3213992]: connect from kjcf05n02 (172.16.2.5) Nov 3 17:32:31 kjcf05n01 rsyncd[3213992]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 17:32:31 kjcf05n01 rsyncd[3213992]: building file list Nov 3 17:32:31 kjcf05n01 rsyncd[3213992]: sent 11450 bytes received 136 bytes total size 10905 Nov 3 17:32:31 kjcf05n01 systemd[1]: rsyncd@647-172.16.2.2:873-172.16.2.5:38352.service: Succeeded. Nov 3 17:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 17:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 17:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 17:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 17:32:46 kjcf05n03 fstonithd.py[15375]: Listening for kdump packets from partner Nov 3 17:32:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 17:32:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 17:32:49 kjcf05n00 mcfcli[3673891]: %3|1730676769.770|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 17:32:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 17:32:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 17:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 17:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 17:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 17:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 17:32:59 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 17:32:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 17:32:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 17:32:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 17:32:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 17:33:04 kjcf05n00 mcfcli[3673891]: %3|1730676784.028|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:33:19 kjcf05n00 mcfcli[3673891]: %3|1730676799.770|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:33:24 kjcf05n03 dwd[5162]: nvme24n1 passed periodic SMART status check Nov 3 17:33:24 kjcf05n03 dwd[5162]: nvme8n1 passed periodic SMART status check Nov 3 17:33:24 kjcf05n03 dwd[5162]: nvme2n1 passed periodic SMART status check Nov 3 17:33:25 kjcf05n03 dwd[5162]: nvme19n1 passed periodic SMART status check Nov 3 17:33:25 kjcf05n03 dwd[5162]: nvme25n1 passed periodic SMART status check Nov 3 17:33:25 kjcf05n03 dwd[5162]: nvme18n1 passed periodic SMART status check Nov 3 17:33:25 kjcf05n03 dwd[5162]: nvme4n1 passed periodic SMART status check Nov 3 17:33:25 kjcf05n03 dwd[5162]: nvme17n1 passed periodic SMART status check Nov 3 17:33:25 kjcf05n03 dwd[5162]: nvme3n1 passed periodic SMART status check Nov 3 17:33:25 kjcf05n03 dwd[5162]: nvme23n1 passed periodic SMART status check Nov 3 17:33:26 kjcf05n03 dwd[5162]: nvme9n1 passed periodic SMART status check Nov 3 17:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T17:33:27.25320649-06:00 level=info msg="Completed cleanup jobs" duration=26.291289ms Nov 3 17:33:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 17:33:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 17:33:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 17:33:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 17:33:42 kjcf05n00 mcfcli[3673891]: %3|1730676822.195|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:33:48 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib0 Nov 3 17:33:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 17:33:49 kjcf05n00 mcfcli[3673891]: %3|1730676829.770|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:33:52 kjcf05n03 LCNmon[18219]: 10.16.100.52 is unreachable via ib1 Nov 3 17:33:52 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib1 Nov 3 17:33:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 3 17:33:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 3 17:33:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 3 17:33:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 3 17:33:55 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='34', client='AF_INET(172.16.2.5:35359)', local='AF_INET(0.0.0.0:601)' Nov 3 17:33:55 kjcf05n02 syslog-ng[3127]: Configuration reload request received, reloading configuration; Nov 3 17:33:55 kjcf05n02 syslog-ng[3127]: Configuration reload finished; Nov 3 17:33:55 kjcf05n02 syslog-ng[3127]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 17:33:56 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 3 17:33:56 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 17:33:56 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 3 17:33:56 kjcf05n02 dracut: Self testing crypto algorithms Nov 3 17:33:56 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 3 17:33:56 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 17:33:56 kjcf05n02 Copying live image to RAM... Nov 3 17:33:56 kjcf05n02 (this may take a minute) Nov 3 17:33:56 kjcf05n02 Done copying live image to RAM. Nov 3 17:33:56 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 17:33:56 kjcf05n02 dracut: Checking integrity of kernel Nov 3 17:33:56 kjcf05n02 dracut: All initrd crypto checks done Nov 3 17:33:56 kjcf05n02 dracut: Switching root Nov 3 17:33:56 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 17:33:56 kjcf05n02 systemd: Detected architecture x86-64. Nov 3 17:33:56 kjcf05n02 systemd: Set hostname to . Nov 3 17:33:56 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 17:33:56 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 17:33:56 kjcf05n02 systemd: Started Dispatch Password Requests to Console Directory Watch. Nov 3 17:33:56 kjcf05n02 systemd: Reached target CXI Retry Handlers Started. Nov 3 17:33:56 kjcf05n02 systemd: Listening on udev Kernel Socket. Nov 3 17:33:56 kjcf05n02 systemd: Reached target rpc_pipefs.target. Nov 3 17:33:56 kjcf05n02 systemd: Created slice system-sshd\x2dkeygen.slice. Nov 3 17:33:56 kjcf05n02 systemd-journald[1507]: Journal started Nov 3 17:33:56 kjcf05n02 systemd-journald[1507]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 17:33:56 kjcf05n02 systemd-modules-load[1506]: Inserted module 'fuse' Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Load Kernel Modules. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Create list of required static device nodes for the current kernel. Nov 3 17:33:56 kjcf05n02 systemd[1]: Mounted /WIBS. Nov 3 17:33:56 kjcf05n02 systemd[1]: Mounted /data. Nov 3 17:33:56 kjcf05n02 systemd[1]: Mounted Huge Pages File System. Nov 3 17:33:56 kjcf05n02 systemd[1]: Mounted POSIX Message Queue File System. Nov 3 17:33:56 kjcf05n02 systemd[1]: Mounted Kernel Debug File System. Nov 3 17:33:56 kjcf05n02 systemd[1]: Mounted Temporary Directory (/tmp). Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Remount Root and Kernel File Systems. Nov 3 17:33:56 kjcf05n02 systemd[1]: Mounted /mnt. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Create System Users... Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Rebuild Hardware Database... Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Load/Save Random Seed... Nov 3 17:33:56 kjcf05n02 systemd[1]: Mounting Kernel Configuration File System... Nov 3 17:33:56 kjcf05n02 systemd[1]: Mounting FUSE Control File System... Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Apply Kernel Variables... Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 17:33:56 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Create System Users. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 3 17:33:56 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 17:33:56 kjcf05n02 systemd-sysctl[1545]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 17:33:56 kjcf05n02 systemd-sysctl[1545]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 3 17:33:56 kjcf05n02 systemd-journald[1507]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 17:33:56 kjcf05n02 systemd-tmpfiles[1549]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 17:33:56 kjcf05n02 systemd-tmpfiles[1549]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 3 17:33:56 kjcf05n02 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 3 17:33:56 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 3 17:33:56 kjcf05n02 systemd-udevd[1631]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:33:56 kjcf05n02 systemd-udevd[1588]: Using default interface naming scheme 'rhel-8.0'. Nov 3 17:33:56 kjcf05n02 systemd-udevd[1588]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:33:56 kjcf05n02 systemd-udevd[1621]: Using default interface naming scheme 'rhel-8.0'. Nov 3 17:33:56 kjcf05n02 systemd-udevd[1621]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:33:56 kjcf05n02 systemd-udevd[1606]: Using default interface naming scheme 'rhel-8.0'. Nov 3 17:33:56 kjcf05n02 systemd-udevd[1606]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 17:33:56 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 3 17:33:56 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 17:33:56 kjcf05n02 root[1764]: openibd: running in auto mode Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 17:33:56 kjcf05n02 systemd-tmpfiles[1766]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 17:33:56 kjcf05n02 systemd-tmpfiles[1766]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 17:33:56 kjcf05n02 systemd-tmpfiles[1766]: "/var/tmp" already exists and is not a directory. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started RPC Bind. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 17:33:56 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 17:33:56 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 17:33:56 kjcf05n02 systemd-modules-load[1924]: Inserted module 'ib_iser' Nov 3 17:33:56 kjcf05n02 systemd-modules-load[1924]: Inserted module 'ib_isert' Nov 3 17:33:56 kjcf05n02 systemd-modules-load[1924]: Inserted module 'ib_srpt' Nov 3 17:33:56 kjcf05n02 systemd-udevd[1578]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:33:56 kjcf05n02 systemd-udevd[1631]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:33:56 kjcf05n02 systemd-modules-load[1923]: Inserted module 'ib_ipoib' Nov 3 17:33:56 kjcf05n02 systemd-modules-load[1924]: Inserted module 'rdma_ucm' Nov 3 17:33:56 kjcf05n02 systemd-modules-load[1924]: Module 'svcrdma' is blacklisted Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 17:33:56 kjcf05n02 systemd-udevd[1631]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 17:33:56 kjcf05n02 systemd-udevd[1578]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 17:33:56 kjcf05n02 systemd-modules-load[1923]: Inserted module 'ib_umad' Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 17:33:56 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 3 17:33:56 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 3 17:33:56 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 17:33:56 kjcf05n02 systemd[3127]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:33:56 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 17:33:56 kjcf05n02 openibd[1754]: Loading HCA driver and Access Layer:[ OK ] Nov 3 17:33:56 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Update is Completed. Nov 3 17:33:56 kjcf05n02 setup-icl[1746]: Setting LAN IP Address to 203.0.113.3 Nov 3 17:33:56 kjcf05n02 setup-icl[1746]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 17:33:56 kjcf05n02 setup-icl[1746]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 17:33:56 kjcf05n02 setup-icl[1746]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 17:33:56 kjcf05n02 systemd-udevd[1578]: Using default interface naming scheme 'rhel-8.0'. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 17:33:56 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 3 17:33:56 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 17:33:56 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 17:33:56 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 17:33:56 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 17:33:56 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 3 17:33:56 kjcf05n02 systemd[1]: Reached target Sockets. Nov 3 17:33:56 kjcf05n02 systemd[1]: Reached target Basic System. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 17:33:56 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 17:33:56 kjcf05n02 mdraid-phy[2052]: no Cutlass to worry about Nov 3 17:33:56 kjcf05n02 chronyd[2072]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 0 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 1 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 2 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 3 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 4 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 5 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 6 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 7 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 8 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 9 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 10 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 11 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 12 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 13 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 14 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 15 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 16 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 17 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 18 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 19 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 20 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 21 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 22 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 23 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 24 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 25 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 26 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 27 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 28 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 29 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 30 Nov 3 17:33:56 kjcf05n02 cpupower[2076]: Setting cpu: 31 Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[2068]: Setting up Mellanox network interface: ib0 Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 17:33:56 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 17:33:56 kjcf05n02 network[2100]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 17:33:56 kjcf05n02 network[2129]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 17:33:56 kjcf05n02 network[2100]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:33:56 kjcf05n02 chronyd[2072]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 17:33:56 kjcf05n02 chronyd[2072]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 17:33:56 kjcf05n02 beSetMlxConfig[2116]: ConnectX-3 multiport not detected Nov 3 17:33:56 kjcf05n02 dbus-daemon[2093]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 17:33:56 kjcf05n02 mcelog[2149]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 17:33:56 kjcf05n02 mcelog[2149]: CPU is unsupported Nov 3 17:33:56 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[2142]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 17:33:56 kjcf05n02 network[2143]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:33:56 kjcf05n02 network[2100]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[2148]: Setting up Mellanox network interface: ib1 Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 3 17:33:56 kjcf05n02 nscd[2208]: 2208 monitoring file `/etc/hosts` (1) Nov 3 17:33:56 kjcf05n02 nscd[2208]: 2208 monitoring directory `/etc` (2) Nov 3 17:33:56 kjcf05n02 nscd[2208]: 2208 monitoring file `/etc/resolv.conf` (3) Nov 3 17:33:56 kjcf05n02 nscd[2208]: 2208 monitoring directory `/etc` (2) Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 17:33:56 kjcf05n02 network[2163]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[2190]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 17:33:56 kjcf05n02 dwd[2164]: dwd: vMay 29 2024 : 15:38:26 Nov 3 17:33:56 kjcf05n02 dwd[2164]: /usr/sbin/dwd -d --standalone=0 Nov 3 17:33:56 kjcf05n02 dwd[2164]: dwd: option Lethal: 0 Nov 3 17:33:56 kjcf05n02 dwd[2164]: dwd: option Interval: 60 Nov 3 17:33:56 kjcf05n02 dwd[2164]: dwd: option abrtlimit: 10 Nov 3 17:33:56 kjcf05n02 dwd[2164]: dwd: option DZPeriod: 604800 Nov 3 17:33:56 kjcf05n02 dwd[2164]: dwd: option SmartPeriod: 43200 Nov 3 17:33:56 kjcf05n02 dwd[2164]: dwd: option SDDEnabled: 1 Nov 3 17:33:56 kjcf05n02 dwd[2164]: dwd: option SDDAwaitScale: 3 Nov 3 17:33:56 kjcf05n02 dwd[2164]: dwd: option SDDAwaitMin: 100 Nov 3 17:33:56 kjcf05n02 dwd[2164]: dwd: option Verbosity: 1 Nov 3 17:33:56 kjcf05n02 dwd[2164]: dwd: option StandAlone: 0 Nov 3 17:33:56 kjcf05n02 dwd[2164]: option Lethal: 0 Nov 3 17:33:56 kjcf05n02 dwd[2164]: option Interval: 60 Nov 3 17:33:56 kjcf05n02 dwd[2164]: option abrtlimit: 10 Nov 3 17:33:56 kjcf05n02 dwd[2164]: option DZPeriod: 604800 Nov 3 17:33:56 kjcf05n02 dwd[2164]: option SmartPeriod: 43200 Nov 3 17:33:56 kjcf05n02 dwd[2164]: option SDDEnabled: 1 Nov 3 17:33:56 kjcf05n02 dwd[2164]: option SDDAwaitScale: 3 Nov 3 17:33:56 kjcf05n02 dwd[2164]: option SDDAwaitMin: 100 Nov 3 17:33:56 kjcf05n02 dwd[2164]: option Verbosity: 1 Nov 3 17:33:56 kjcf05n02 dwd[2164]: option StandAlone: 0 Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 3 17:33:56 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 17:33:56 kjcf05n02 beSetMlxConfig[2116]: Starting MST (Mellanox Software Tools) driver set Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[2225]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 0 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 1 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 2 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 3 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 4 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 5 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 6 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 7 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 8 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 9 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 10 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 11 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 12 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 13 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 14 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 15 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 16 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 17 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 18 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 19 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 20 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 21 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 22 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 23 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 24 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 25 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 26 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 27 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 28 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 29 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 30 Nov 3 17:33:56 kjcf05n02 cpupower[2246]: Idlestate 2 disabled on CPU 31 Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[2228]: No configuration found for ib0 Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 17:33:56 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 17:33:56 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 17:33:56 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 17:33:56 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 17:33:56 kjcf05n02 beSetMlxConfig[2116]: Loading MST PCI module - Success Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[2258]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[2259]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 17:33:56 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[2271]: No configuration found for ib1 Nov 3 17:33:56 kjcf05n02 mlnx_conf_mgr[2293]: INFO: No configurations found for mlx5_0, skipping. Nov 3 17:33:56 kjcf05n02 beSetMlxConfig[2116]: Loading MST PCI configuration module - Success Nov 3 17:33:56 kjcf05n02 beSetMlxConfig[2116]: Create devices Nov 3 17:33:56 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[2298]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 17:33:56 kjcf05n02 mlnx_conf_mgr[2348]: INFO: No configurations found for mlx5_1, skipping. Nov 3 17:33:56 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 17:33:56 kjcf05n02 sssd[sssd][2218]: Starting up Nov 3 17:33:56 kjcf05n02 sssd[be[implicit_files]][2407]: Starting up Nov 3 17:33:56 kjcf05n02 sssd[nss][2498]: Starting up Nov 3 17:33:56 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 17:33:56 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Login Service... Nov 3 17:33:56 kjcf05n02 systemd-logind[2627]: New seat seat0. Nov 3 17:33:56 kjcf05n02 systemd-logind[2627]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Login Service. Nov 3 17:33:56 kjcf05n02 python3.9[2232]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 17:33:56 kjcf05n02 python3.9[3127]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 17:33:56 kjcf05n02 systemd-sysctl[2715]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 17:33:56 kjcf05n02 systemd-sysctl[2715]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 17:33:56 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 17:33:56 kjcf05n02 network[2100]: Bringing up loopback interface: [ OK ] Nov 3 17:33:56 kjcf05n02 python3.9[2934]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 17:33:56 kjcf05n02 python3.9[3127]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 17:33:56 kjcf05n02 systemd-sysctl[3047]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 17:33:56 kjcf05n02 systemd-sysctl[3047]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 17:33:56 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 3 17:33:56 kjcf05n02 systemd[1]: Reached target Network. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 17:33:56 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 17:33:56 kjcf05n02 sm-notify[3116]: Version 2.3.3 starting Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 3 17:33:56 kjcf05n02 sshd[3094]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 17:33:56 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 17:33:56 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 17:33:56 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 3 17:33:56 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 17:33:56 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 3 17:33:56 kjcf05n02 lldpad[3093]: setsockopt nearest_bridge: Invalid argument Nov 3 17:33:56 kjcf05n02 lldpad[3127]: Last message 'setsockopt nearest_b' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 3 17:33:56 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 3 17:33:56 kjcf05n02 python3.9[3141]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 17:33:56 kjcf05n02 python3.9[3127]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 17:33:56 kjcf05n02 syslog-ng[3127]: [2024-11-03T23:32:43.385884] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 17:33:56 kjcf05n02 syslog-ng[3127]: [2024-11-03T23:32:43.386178] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 17:33:56 kjcf05n02 syslog-ng[3127]: [2024-11-03T23:32:43.386213] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 17:33:56 kjcf05n02 syslog-ng[3127]: [2024-11-03T23:32:43.386428] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 17:33:56 kjcf05n02 syslog-ng[3127]: [2024-11-03T23:32:43.386627] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 17:33:56 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 3 17:33:56 kjcf05n02 beSetMlxConfig[2116]: Unloading MST PCI module (unused) - Success Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 17:33:56 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 17:33:56 kjcf05n02 python3.9[3376]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 17:33:56 kjcf05n02 python3.9[3127]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 17:33:56 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 17:33:56 kjcf05n02 python3.9[3379]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 17:33:56 kjcf05n02 python3.9[3127]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 17:33:56 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 17:33:56 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 17:33:56 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 17:33:56 kjcf05n02 chronyd[2072]: System's initial offset : 0.002314 seconds slow of true (slew) Nov 3 17:33:56 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 17:33:56 kjcf05n02 beSetMlxConfig[2116]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 17:33:56 kjcf05n02 beSetMlxConfig[2116]: ib mode Nov 3 17:33:56 kjcf05n02 root[3399]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 3 17:33:56 kjcf05n02 root[3401]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 3 17:33:56 kjcf05n02 beSetMlxConfig[2116]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 17:33:56 kjcf05n02 beSetMlxConfig[2116]: ib mode Nov 3 17:33:56 kjcf05n02 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 17:33:56 kjcf05n02 systemd-udevd[3417]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:33:56 kjcf05n02 systemd-udevd[3416]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:33:56 kjcf05n02 systemd-udevd[3420]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:33:56 kjcf05n02 systemd-udevd[3421]: Using default interface naming scheme 'rhel-8.0'. Nov 3 17:33:56 kjcf05n02 systemd-udevd[3421]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:33:56 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 17:33:56 kjcf05n02 systemd[3127]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:33:56 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[3459]: Setting up Mellanox network interface: ib1 Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[3458]: Setting up Mellanox network interface: ib0 Nov 3 17:33:56 kjcf05n02 systemd-udevd[3418]: Using default interface naming scheme 'rhel-8.0'. Nov 3 17:33:56 kjcf05n02 systemd-udevd[3419]: Using default interface naming scheme 'rhel-8.0'. Nov 3 17:33:56 kjcf05n02 systemd-udevd[3418]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:33:56 kjcf05n02 systemd-udevd[3419]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[3510]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[3512]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[3539]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[3540]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[3542]: No configuration found for ib0 Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[3541]: No configuration found for ib1 Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[3549]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[3550]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 17:33:56 kjcf05n02 mlnx_conf_mgr[3589]: INFO: No configurations found for mlx5_0, skipping. Nov 3 17:33:56 kjcf05n02 mlnx_conf_mgr[3590]: INFO: No configurations found for mlx5_1, skipping. Nov 3 17:33:56 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 17:33:56 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 17:33:56 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 3 17:33:56 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 3 17:33:56 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 17:33:56 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 3 17:33:56 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 3 17:33:56 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 17:33:56 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 17:33:56 kjcf05n02 lldpad[3093]: init_ports: Error adding device ib0 Nov 3 17:33:56 kjcf05n02 lldpad[3093]: init_ports: Error adding device ib1 Nov 3 17:33:56 kjcf05n02 lldpad[3093]: Signal 15 received - terminating Nov 3 17:33:56 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 3 17:33:56 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 17:33:56 kjcf05n02 systemd[1]: Reloading. Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 17:33:56 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 3 17:33:56 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 17:33:56 kjcf05n02 systemd[1]: Reloading. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 3 17:33:56 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 3 17:33:56 kjcf05n02 systemd[1]: Reloading. Nov 3 17:33:56 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:33:56 kjcf05n02 systemd[1]: Reloading. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 1 | Nov-03-2024 | 23:03:09 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 2 | Nov-03-2024 | 23:04:00 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 3 | Nov-03-2024 | 23:04:01 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 4 | Nov-03-2024 | 23:05:07 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 5 | Nov-03-2024 | 23:05:07 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 6 | Nov-03-2024 | 23:30:03 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 7 | Nov-03-2024 | 23:30:03 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 8 | Nov-03-2024 | 23:30:03 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 9 | Nov-03-2024 | 23:30:03 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 10 | Nov-03-2024 | 23:30:03 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 11 | Nov-03-2024 | 23:30:03 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 12 | Nov-03-2024 | 23:30:03 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 13 | Nov-03-2024 | 23:30:03 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 14 | Nov-03-2024 | 23:30:03 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 15 | Nov-03-2024 | 23:30:03 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 16 | Nov-03-2024 | 23:30:03 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 17 | Nov-03-2024 | 23:30:03 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 18 | Nov-03-2024 | 23:30:33 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 19 | Nov-03-2024 | 23:30:33 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 20 | Nov-03-2024 | 23:30:33 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 21 | Nov-03-2024 | 23:30:33 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 22 | Nov-03-2024 | 23:30:33 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 23 | Nov-03-2024 | 23:30:33 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 24 | Nov-03-2024 | 23:30:33 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 25 | Nov-03-2024 | 23:30:33 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 26 | Nov-03-2024 | 23:30:33 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 27 | Nov-03-2024 | 23:30:33 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 28 | Nov-03-2024 | 23:30:33 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 17:33:56 kjcf05n02 ipmievd[3935]: 29 | Nov-03-2024 | 23:30:33 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 17:33:56 kjcf05n02 ipmievd[3938]: Reading sensors... Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 3 17:33:56 kjcf05n02 systemd[1]: Reloading. Nov 3 17:33:56 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 17:33:56 kjcf05n02 nscd[2208]: 2208 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 17:33:56 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 17:33:56 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 3 17:33:56 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 3 17:33:56 kjcf05n02 beSetMlxConfig[3994]: ConnectX-3 multiport not detected Nov 3 17:33:56 kjcf05n02 beSetMlxConfig[3994]: Starting MST (Mellanox Software Tools) driver set Nov 3 17:33:56 kjcf05n02 beSetMlxConfig[3994]: Loading MST PCI module - Success Nov 3 17:33:56 kjcf05n02 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 17:33:56 kjcf05n02 beSetMlxConfig[3994]: [warn] mst_pciconf is already loaded, skipping Nov 3 17:33:56 kjcf05n02 beSetMlxConfig[3994]: Create devices Nov 3 17:33:56 kjcf05n02 beSetMlxConfig[3994]: Unloading MST PCI module (unused) - Success Nov 3 17:33:56 kjcf05n02 ipmievd[3938]: Waiting for events... Nov 3 17:33:56 kjcf05n02 beSetMlxConfig[3994]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 17:33:56 kjcf05n02 beSetMlxConfig[3994]: ib mode Nov 3 17:33:56 kjcf05n02 beSetMlxConfig[3994]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 17:33:56 kjcf05n02 beSetMlxConfig[3994]: ib mode Nov 3 17:33:56 kjcf05n02 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 17:33:56 kjcf05n02 systemd-udevd[4896]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:33:56 kjcf05n02 systemd-udevd[4895]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:33:56 kjcf05n02 systemd-udevd[4899]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:33:56 kjcf05n02 systemd-udevd[4900]: Using default interface naming scheme 'rhel-8.0'. Nov 3 17:33:56 kjcf05n02 systemd-udevd[4900]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:33:56 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 17:33:56 kjcf05n02 systemd[3127]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:33:56 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[4937]: Setting up Mellanox network interface: ib1 Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[4938]: Setting up Mellanox network interface: ib0 Nov 3 17:33:56 kjcf05n02 systemd-udevd[4898]: Using default interface naming scheme 'rhel-8.0'. Nov 3 17:33:56 kjcf05n02 systemd-udevd[4898]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:33:56 kjcf05n02 systemd-udevd[4897]: Using default interface naming scheme 'rhel-8.0'. Nov 3 17:33:56 kjcf05n02 systemd-udevd[4897]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[4993]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[4995]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[5017]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[5019]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[5020]: No configuration found for ib1 Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[5021]: No configuration found for ib0 Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[5025]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 17:33:56 kjcf05n02 mlnx_interface_mgr[5029]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 17:33:56 kjcf05n02 mlnx_conf_mgr[5065]: INFO: No configurations found for mlx5_1, skipping. Nov 3 17:33:56 kjcf05n02 mlnx_conf_mgr[5069]: INFO: No configurations found for mlx5_0, skipping. Nov 3 17:33:56 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 17:33:56 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}42f6855ef48b5111328f6caec8fe85c891a86b2cbe235f9deef34a215cf1b939' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}42f6855ef48b5111328f6caec8fe85c891a86b2cbe235f9deef34a215cf1b939' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}edbd3dcf31e997460dc19de25bf4d1c4fe0d4a4f99b10aa64c27e44b1a060177' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}edbd3dcf31e997460dc19de25bf4d1c4fe0d4a4f99b10aa64c27e44b1a060177' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}1a5010a3ca8100b2f434eb3711e41b7d77b9e9370c0052b2f831e04a577dd523' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}1a5010a3ca8100b2f434eb3711e41b7d77b9e9370c0052b2f831e04a577dd523' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}27a727c31da55529786a1efb7e4de4115f0cb6c2046b81352d5cd9e3717d7db0' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}27a727c31da55529786a1efb7e4de4115f0cb6c2046b81352d5cd9e3717d7db0' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 17:33:56 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 3 17:33:56 kjcf05n02 chronyd[2072]: chronyd exiting Nov 3 17:33:56 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 3 17:33:56 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 3 17:33:56 kjcf05n02 chronyd[5105]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 17:33:56 kjcf05n02 chronyd[5105]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 17:33:56 kjcf05n02 chronyd[5105]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 17:33:56 kjcf05n02 chronyd[5105]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 17:33:56 kjcf05n02 systemd[1]: Started NTP client/server. Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 17:33:56 kjcf05n02 systemd[1]: Reloading. Nov 3 17:33:56 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 17:33:56 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 3 17:33:56 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 17:33:56 kjcf05n02 dwd[5137]: dwd: vMay 29 2024 : 15:38:26 Nov 3 17:33:56 kjcf05n02 dwd[5137]: /usr/sbin/dwd -i 15 -d Nov 3 17:33:56 kjcf05n02 dwd[5137]: dwd: option Lethal: 0 Nov 3 17:33:56 kjcf05n02 dwd[5137]: dwd: option Interval: 15 Nov 3 17:33:56 kjcf05n02 dwd[5137]: dwd: option abrtlimit: 10 Nov 3 17:33:56 kjcf05n02 dwd[5137]: dwd: option DZPeriod: 604800 Nov 3 17:33:56 kjcf05n02 dwd[5137]: dwd: option SmartPeriod: 43200 Nov 3 17:33:56 kjcf05n02 dwd[5137]: dwd: option SDDEnabled: 1 Nov 3 17:33:56 kjcf05n02 dwd[5137]: dwd: option SDDAwaitScale: 3 Nov 3 17:33:56 kjcf05n02 dwd[5137]: dwd: option SDDAwaitMin: 100 Nov 3 17:33:56 kjcf05n02 dwd[5137]: dwd: option Verbosity: 1 Nov 3 17:33:56 kjcf05n02 dwd[5137]: dwd: option StandAlone: 0 Nov 3 17:33:56 kjcf05n02 dwd[5137]: option Lethal: 0 Nov 3 17:33:56 kjcf05n02 dwd[5137]: option Interval: 15 Nov 3 17:33:56 kjcf05n02 dwd[5137]: option abrtlimit: 10 Nov 3 17:33:56 kjcf05n02 dwd[5137]: option DZPeriod: 604800 Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 17:33:56 kjcf05n02 dwd[5137]: option SmartPeriod: 43200 Nov 3 17:33:56 kjcf05n02 dwd[5137]: option SDDEnabled: 1 Nov 3 17:33:56 kjcf05n02 dwd[5137]: option SDDAwaitScale: 3 Nov 3 17:33:56 kjcf05n02 dwd[5137]: option SDDAwaitMin: 100 Nov 3 17:33:56 kjcf05n02 dwd[5137]: option Verbosity: 1 Nov 3 17:33:56 kjcf05n02 dwd[5137]: option StandAlone: 0 Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 17:33:56 kjcf05n02 dwd[5139]: option Lethal now set to 1 Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 17:33:56 kjcf05n02 dwd[5139]: option abrtlimit now set to 1 Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 17:33:56 kjcf05n02 dwd[5139]: option SmartPeriod now set to 86400 Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 17:33:56 kjcf05n02 systemd[1]: Reloading. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 17:33:56 kjcf05n02 systemd[1]: Reloading. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:33:56 kjcf05n02 systemd[1]: Reloading. Nov 3 17:33:56 kjcf05n02 python3.9[5168]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 17:33:56 kjcf05n02 python3.9[3127]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 17:33:56 kjcf05n02 systemd[1]: Reloading. Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:33:56 kjcf05n02 systemd[1]: Reloading. Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 17:33:56 kjcf05n02 systemd[1]: Reloading. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 3 17:33:56 kjcf05n02 sedcpwrkr[5307]: Using config script: /etc/sedcpwrkr.conf Nov 3 17:33:56 kjcf05n02 sedcpwrkr[5307]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 17:33:56 kjcf05n02 sedcpwrkr[5307]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 17:33:56 kjcf05n02 sedcpwrkr[5307]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 17:33:56 kjcf05n02 sedcpwrkr[5307]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 17:33:56 kjcf05n02 sedcpwrkr[5307]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 17:33:56 kjcf05n02 sedcpwrkr[5307]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 17:33:56 kjcf05n02 sedcpwrkr-server[5338]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 17:33:56 kjcf05n02 sedcpwrkr[5307]: celery multi v5.2.7 (dawn-chorus) Nov 3 17:33:56 kjcf05n02 sedcpwrkr[5307]: > Starting nodes... Nov 3 17:33:56 kjcf05n02 sedcpwrkr[5307]: > sedcpwrkr@kjcf05n02: OK Nov 3 17:33:56 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 17:33:56 kjcf05n02 sedcpwrkr-server[5340]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 17:33:56 kjcf05n02 sedcpwrkr-server[5340]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 17:33:56 kjcf05n02 sedcpwrkr-server[5340]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 17:33:56 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 17:33:56 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 3 17:33:56 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 17:33:56 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 17:33:56 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 17:33:56 kjcf05n02 systemd[1]: Reloading. Nov 3 17:33:56 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 17:33:56 kjcf05n02 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 17:33:56 kjcf05n02 iptables.init[5407]: iptables: Applying firewall rules: [ OK ] Nov 3 17:33:56 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 3 17:33:56 kjcf05n02 systemd[1]: Reloading. Nov 3 17:33:57 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 17:33:57 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 17:33:57 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 17:33:57 kjcf05n02 systemd[1]: Reloading. Nov 3 17:33:57 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 17:33:58 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5505 which is not our child. We'll most likely not notice when it exits. Nov 3 17:33:58 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 17:33:58 kjcf05n02 systemd[1]: Reloading. Nov 3 17:33:58 kjcf05n02 openhpid[5505]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 17:33:58 kjcf05n02 openhpid[5505]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 17:33:58 kjcf05n02 openhpid[5505]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 17:33:58 kjcf05n02 openhpid[5505]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 17:33:58 kjcf05n02 systemd[1]: Reloading. Nov 3 17:33:58 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:33:58 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:33:58 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 17:33:58 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 3 17:33:58 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 17:33:58 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 17:33:58 kjcf05n02 systemd[1]: Reloading. Nov 3 17:33:58 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 17:33:59 kjcf05n02 dcs-collectord[5596]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 17:33:59 kjcf05n02 hpi.inv.log[5596]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 17:33:59 kjcf05n02 dcs-collectord[5596]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 17:33:59 kjcf05n02 dcs-collectord[5596]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 17:33:59 kjcf05n02 dcs-collector[5587]: Starting dcs-collector:[ OK ] Nov 3 17:33:59 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 17:33:59 kjcf05n02 dcs-collectord[5599]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 17:33:59 kjcf05n02 dcs-collectord[5599]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 17:33:59 kjcf05n02 dcs-collectord[5599]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 17:33:59 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 17:33:59 kjcf05n02 dcs-collectord[5599]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 17:33:59 kjcf05n02 dcs-collectord[5599]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 17:33:59 kjcf05n02 dcs-collectord[5599]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 17:33:59 kjcf05n02 dcs-collectord[5599]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 17:33:59 kjcf05n02 dcs-collectord[5599]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259345732", "units": "kB"}, {"name": "MemAvailable", "value": "258625116", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821276", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686980", "units": "kB"}, {"name": "Inactive", "value": "961116", "units": "kB"}, {"name": "Active(anon)", "value": "1520908", "units": "kB"}, {"name": "Inactive(anon)", "value": "824860", "units": "kB"}, {"name": "Active(file)", "value": "166072", "units": "kB"}, {"name": "Inactive(file)", "value": "136256", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "752456", "units": "kB"}, {"name": "Mapped", "value": "85840", "units": "kB"}, {"name": "Shmem", "value": "1593400", "units": "kB"}, {"name": "KReclaimable", "value": "108604", "units": "kB"}, {"name": "Slab", "value": "275532", "units": "kB"}, {"name": "SReclaimable", "value": "108604", "units": "kB"}, {"name": "SUnreclaim", "value": "166928", "units": "kB"}, {"name": "KernelStack", "value": "9648", "units": "kB"}, {"name": "PageTables", "value": "19524", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3341400", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11264", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "6144", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "307528", "units": "kB"}, {"name": "DirectMap2M", "value": "21577728", "units": "kB"}, {"name": "DirectMap1G", "value": "246415360", "units": "kB"}]}' Nov 3 17:33:59 kjcf05n02 dcs-collectord[5599]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 17:33:59 kjcf05n02 systemd[1]: Reloading. Nov 3 17:33:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 3 17:33:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 3 17:33:59 kjcf05n02 dcs-collectord[5599]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 17:33:59 kjcf05n02 dcs-collectord[5599]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730676839.291272], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730676839.5406492], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730676839.2246008, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 17:33:59 kjcf05n02 systemd[1]: Reloading. Nov 3 17:33:59 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 17:33:59 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:33:59 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:33:59 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 17:33:59 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 3 17:33:59 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 17:33:59 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 17:33:59 kjcf05n02 systemd[1]: Reloading. Nov 3 17:33:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 3 17:33:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 3 17:34:00 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 17:34:00 kjcf05n02 firmware-update-orc[5705]: Using config script: /etc/firmware_update_orc.conf Nov 3 17:34:00 kjcf05n02 firmware-update-orc[5705]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 17:34:00 kjcf05n02 firmware-update-orc[5705]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 17:34:00 kjcf05n02 firmware-update-orc[5705]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 17:34:00 kjcf05n02 firmware-update-orc[5705]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 17:34:00 kjcf05n02 firmware-update-orc[5705]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 17:34:00 kjcf05n02 firmware-update-orc[5705]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 17:34:00 kjcf05n02 firmware-update-orc-server[5743]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 17:34:00 kjcf05n02 firmware-update-orc[5705]: celery multi v5.2.7 (dawn-chorus) Nov 3 17:34:00 kjcf05n02 firmware-update-orc[5705]: > Starting nodes... Nov 3 17:34:00 kjcf05n02 firmware-update-orc[5705]: > worker1@kjcf05n02: OK Nov 3 17:34:00 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 17:34:00 kjcf05n02 firmware-update-orc-server[5745]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 17:34:00 kjcf05n02 firmware-update-orc-server[5745]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 17:34:00 kjcf05n02 firmware-update-orc-server[5745]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 17:34:00 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 17:34:00 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:01 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:34:01 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:34:01 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:34:01 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 17:34:01 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 17:34:01 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 17:34:01 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 17:34:01 kjcf05n02 dbus-daemon[2093]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 17:34:01 kjcf05n02 dbus-daemon[2093]: [system] Reloaded configuration Nov 3 17:34:01 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 17:34:01 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 17:34:01 kjcf05n02 dbus-daemon[2093]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 17:34:01 kjcf05n02 dbus-daemon[2093]: [system] Reloaded configuration Nov 3 17:34:01 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 17:34:01 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 17:34:01 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 17:34:01 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 17:34:01 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:01 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 3 17:34:02 kjcf05n02 ras-resource-manager-agent[5861]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 17:34:02 kjcf05n02 ras-resource-manager-agent[5847]: Starting ras-resource-manager-agent:[ OK ] Nov 3 17:34:02 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 17:34:02 kjcf05n02 ras-resource-manager-agent[5863]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 17:34:02 kjcf05n02 ras-resource-manager-client[5863]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 17:34:02 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 3 17:34:02 kjcf05n02 ras-resource-manager-client[5863]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 17:34:02 kjcf05n02 ras-resource-manager-client[5873]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 17:34:02 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:02 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:34:02 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:34:02 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:34:02 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 17:34:02 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 17:34:03 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:03 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 17:34:03 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:03 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: Press Ctrl+C to exit. Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: Plugin support version 1.0 Nov 3 17:34:03 kjcf05n02 zabbix_agent2[5947]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 17:34:03 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:34:03 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:34:03 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:04 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 17:34:04 kjcf05n02 dcs-notification-sender[6024]: dcs-notification-senderd is stopped Nov 3 17:34:04 kjcf05n02 zabbix-agent2[6038]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 17:34:04 kjcf05n02 dcs-notification-sender[6024]: Starting notification-sender:[ OK ] Nov 3 17:34:04 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 17:34:04 kjcf05n02 zabbix-agent2[6041]: INFO DCS notification agent started. (agent.py:61) Nov 3 17:34:04 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 17:34:04 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:04 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:34:04 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:34:04 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:34:04 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:04 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 17:34:05 kjcf05n02 dcs-collectord[6127]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 17:34:05 kjcf05n02 dcs-collectord[6127]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 17:34:05 kjcf05n02 dcs-bulk-data-sender[6127]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 17:34:05 kjcf05n02 dcs-bulk-data-sender[6118]: Starting bulk-data-sender:[ OK ] Nov 3 17:34:05 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 17:34:05 kjcf05n02 dcs-collectord[6129]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 17:34:05 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 17:34:05 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:05 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:34:05 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:34:05 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:34:05 kjcf05n02 nscd[2208]: 2208 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 17:34:05 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 17:34:05 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 17:34:05 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 17:34:05 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 17:34:05 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 17:34:05 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 17:34:05 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 17:34:05 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 3 17:34:05 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 17:34:05 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 3 17:34:05 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 17:34:05 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 17:34:05 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 17:34:05 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 17:34:06 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 17:34:06 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 17:34:06 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 17:34:06 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 17:34:06 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 17:34:06 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 17:34:06 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 3 17:34:06 kjcf05n02 sssd[nss][2498]: Shutting down (status = 0) Nov 3 17:34:06 kjcf05n02 sssd[be[implicit_files]][2407]: Shutting down (status = 0) Nov 3 17:34:06 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 3 17:34:06 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 3 17:34:06 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 3 17:34:06 kjcf05n02 python3.9[5168]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 17:34:06 kjcf05n02 python3.9[3127]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:34:06 kjcf05n02 sssd[sssd][6217]: Starting up Nov 3 17:34:06 kjcf05n02 sssd[be[implicit_files]][6218]: Starting up Nov 3 17:34:07 kjcf05n02 sssd[nss][6219]: Starting up Nov 3 17:34:07 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 3 17:34:07 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 17:34:07 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 17:34:08 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 17:34:08 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 3 17:34:08 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 17:34:08 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 3 17:34:08 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 17:34:08 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 17:34:08 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 17:34:08 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 17:34:08 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 17:34:08 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 17:34:08 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:08 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 17:34:08 kjcf05n02 icinga2[6280]: [2024-11-03 17:34:08 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 17:34:08 kjcf05n02 icinga2[6280]: [2024-11-03 17:34:08 -0600] information/cli: Loading configuration file(s). Nov 3 17:34:08 kjcf05n02 icinga2[6280]: [2024-11-03 17:34:08 -0600] information/ConfigItem: Committing config item(s). Nov 3 17:34:08 kjcf05n02 icinga2[6280]: [2024-11-03 17:34:08 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 3 17:34:08 kjcf05n02 icinga2[6280]: [2024-11-03 17:34:08 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 17:34:08 kjcf05n02 icinga2[6280]: [2024-11-03 17:34:08 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 17:34:08 kjcf05n02 icinga2[6280]: [2024-11-03 17:34:08 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 17:34:08 kjcf05n02 icinga2[6280]: [2024-11-03 17:34:08 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 17:34:08 kjcf05n02 icinga2[6280]: [2024-11-03 17:34:08 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 17:34:08 kjcf05n02 icinga2[6280]: [2024-11-03 17:34:08 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 17:34:08 kjcf05n02 icinga2[6280]: [2024-11-03 17:34:08 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 17:34:08 kjcf05n02 icinga2[6280]: [2024-11-03 17:34:08 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 17:34:08 kjcf05n02 icinga2[6280]: [2024-11-03 17:34:08 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 17:34:08 kjcf05n02 icinga2[6280]: [2024-11-03 17:34:08 -0600] information/cli: Closing console log. Nov 3 17:34:08 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 17:34:08 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:09 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:34:09 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:34:09 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:34:09 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 17:34:09 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 17:34:09 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:09 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 3 17:34:10 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:10 kjcf05n02 dcs-bulk-data-sender[6129]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 17:34:10 kjcf05n02 dcs-collectord[6129]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 17:34:10 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:10 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:34:10 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:34:10 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 17:34:10 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 17:34:10 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 17:34:10 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 17:34:10 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 17:34:10 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 17:34:11 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 17:34:11 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 17:34:11 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 17:34:11 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 17:34:11 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 17:34:11 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 17:34:11 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 17:34:11 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 17:34:11 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:11 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 17:34:11 kjcf05n02 nslcd[6896]: version 0.9.9 starting Nov 3 17:34:11 kjcf05n02 nslcd[6896]: accepting connections Nov 3 17:34:11 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 17:34:11 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:12 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:34:12 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:34:12 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:34:12 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 17:34:12 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 17:34:12 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 17:34:12 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 17:34:12 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 17:34:12 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 17:34:13 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 17:34:13 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 17:34:13 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:13 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 17:34:13 kjcf05n02 dearcpw[6998]: Using config script: /etc/dearcpw.conf Nov 3 17:34:13 kjcf05n02 dearcpw[6998]: - Creating default directory: '/var/log/dearcpw' Nov 3 17:34:13 kjcf05n02 dearcpw[6998]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 17:34:13 kjcf05n02 dearcpw[6998]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 17:34:13 kjcf05n02 dearcpw[6998]: - Creating default directory: '/var/run/dearcpw' Nov 3 17:34:13 kjcf05n02 dearcpw[6998]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 17:34:13 kjcf05n02 dearcpw[6998]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 17:34:13 kjcf05n02 dearcpw-server[7038]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 17:34:13 kjcf05n02 dearcpw[6998]: celery multi v5.2.7 (dawn-chorus) Nov 3 17:34:13 kjcf05n02 dearcpw[6998]: > Starting nodes... Nov 3 17:34:13 kjcf05n02 dearcpw[6998]: > dearcpw@kjcf05n02: OK Nov 3 17:34:13 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 17:34:13 kjcf05n02 dearcpw-server[7040]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 17:34:13 kjcf05n02 dearcpw-server[7040]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 17:34:13 kjcf05n02 dearcpw-server[7040]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 17:34:14 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 3 17:34:14 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:34:14 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:34:14 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 17:34:14 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 17:34:14 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 17:34:14 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 17:34:14 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 17:34:14 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 17:34:14 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 17:34:14 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 17:34:14 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 17:34:14 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 17:34:14 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:38386). Nov 3 17:34:14 kjcf05n01 rsyncd[3214656]: connect from kjcf05n02 (172.16.2.5) Nov 3 17:34:14 kjcf05n01 rsyncd[3214656]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 3 17:34:14 kjcf05n01 rsyncd[3214656]: receiving file list Nov 3 17:34:14 kjcf05n01 rsyncd[3214656]: sent 29 bytes received 325 bytes total size 10905 Nov 3 17:34:14 kjcf05n01 systemd[1]: rsyncd@648-172.16.2.2:873-172.16.2.5:38386.service: Succeeded. Nov 3 17:34:14 kjcf05n02 puppet[7077]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 3 17:34:14 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 17:34:14 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 17:34:14 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 17:34:14 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 17:34:14 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 17:34:14 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 17:34:14 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 17:34:14 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 17:34:14 kjcf05n02 dcs-collectord[5599]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 17:34:14 kjcf05n02 dcs-collectord[5599]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 17:34:14 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 17:34:14 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 17:34:15 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 17:34:15 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 17:34:15 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 17:34:15 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 17:34:15 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 17:34:15 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 17:34:15 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 17:34:15 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 17:34:16 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 17:34:16 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 17:34:16 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 17:34:16 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 17:34:17 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 17:34:17 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 17:34:17 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:17 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 17:34:17 kjcf05n02 ipmievd[3938]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 17:34:17 kjcf05n02 ipmievd[3938]: System Event sensor - Timestamp Clock Sync Nov 3 17:34:17 kjcf05n02 ipmievd[15617]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 17:34:17 kjcf05n02 diskless-swap[7563]: HA_PS_000: recovering journal Nov 3 17:34:17 kjcf05n02 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 17:34:17 kjcf05n02 diskless-swap[7563]: HA_PS_000: clean, 2285/6400 files, 7077/25600 blocks Nov 3 17:34:17 kjcf05n02 diskless-swap[7563]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 17:34:17 kjcf05n02 diskless-swap[7563]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 17:34:17 kjcf05n02 diskless-swap[7563]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 17:34:17 kjcf05n02 diskless-swap[7563]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 17:34:17 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 17:34:17 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:34:17 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:34:17 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 17:34:17 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 17:34:17 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 17:34:17 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 17:34:18 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 3 17:34:18 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 3 17:34:18 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 3 17:34:18 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 3 17:34:18 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 3 17:34:18 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 3 17:34:18 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 3 17:34:18 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 3 17:34:18 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 17:34:18 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 17:34:18 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 17:34:18 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 17:34:18 kjcf05n00 mcfcli[3673891]: %3|1730676858.097|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:34:19 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 17:34:19 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 17:34:19 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 17:34:19 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 17:34:19 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 17:34:19 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 17:34:19 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 17:34:19 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 17:34:19 kjcf05n00 mcfcli[3673891]: %3|1730676859.770|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:34:20 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 17:34:20 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 17:34:20 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 17:34:20 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 17:34:20 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 17:34:21 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 17:34:21 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 17:34:21 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 17:34:21 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:21 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 3 17:34:21 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:34:21 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:34:21 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 17:34:21 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 3 17:34:21 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:22 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 3 17:34:22 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:34:22 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:34:22 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 17:34:22 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 17:34:22 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:22 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 3 17:34:22 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:34:22 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:34:22 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 17:34:22 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 17:34:22 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 17:34:22 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 17:34:22 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 17:34:22 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 17:34:22 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 17:34:22 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 17:34:22 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 17:34:22 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 17:34:22 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:22 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 3 17:34:22 kjcf05n02 kdumpctl[7792]: kdump: No kdump initial ramdisk found. Nov 3 17:34:22 kjcf05n02 kdumpctl[7792]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 17:34:22 kjcf05n02 dracut[7904]: dracut-049-135.git20210121.el8 Nov 3 17:34:23 kjcf05n02 dracut[7906]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 17:34:23 kjcf05n02 dracut[7906]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 17:34:23 kjcf05n02 dracut[7906]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 17:34:23 kjcf05n02 dracut[7906]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 17:34:23 kjcf05n02 dracut[7906]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 17:34:23 kjcf05n02 dracut[7906]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 17:34:23 kjcf05n02 dracut[7906]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 17:34:23 kjcf05n02 dracut[7906]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + is_func check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ type -t check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 0 -ne 0 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check -h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local dev holder Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + require_binaries mdadm expr Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _module_name=90hperaid Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ mdadm = \-\m ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for cmd in "$@" Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + find_binary mdadm Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for cmd in "$@" Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + find_binary expr Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n -h ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for dev in "${!host_fs_types[@]}" Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ nfs != *_raid_member ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + continue Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _ret=255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + ret=255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ 255 = 0 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ 255 = 255 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ module_depends hperaid Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: +++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: +++ set -x Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ depends Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo rootfs-block Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ return 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ _ret=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ return 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for _moddep in $(module_depends $_mod) Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all == *\ hperaid\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + add_dracutmodules+=' rootfs-block ' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ == *\ hperaid\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check_module rootfs-block Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _mod=rootfs-block Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddep Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ == *\ rootfs-block\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n '' ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all == *\ rootfs-block\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + module_check rootfs-block 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 17:34:23 kjcf05n02 kdumpctl[3127]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _forced=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 2 -eq 2 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _forced=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + is_func check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ type -t check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 0 -ne 0 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check -h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _ret=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + ret=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ 0 = 0 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ module_depends rootfs-block Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: +++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 17:34:23 kjcf05n02 kdumpctl[3127]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ depends Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo fs-lib Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ _ret=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ return 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for _moddep in $(module_depends $_mod) Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all == *\ rootfs-block\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + add_dracutmodules+=' fs-lib ' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ == *\ rootfs-block\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check_module fs-lib Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _mod=fs-lib Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddep Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n '' ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + mods_checked_as_dep+=' fs-lib ' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all == *\ fs-lib\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + module_check fs-lib 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _forced=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 2 -eq 2 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _forced=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + is_func check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ type -t check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 0 -ne 0 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check -h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _ret=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + ret=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ 0 = 0 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ module_depends fs-lib Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: +++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ depends Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ return 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ _ret=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ return 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + mods_to_load+=' fs-lib ' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + mods_to_load+=' rootfs-block ' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + mods_to_load+=' hperaid ' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _mod=90kernel-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _mod=kernel-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check_module kernel-modules 1 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _mod=kernel-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddep Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n 1 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all = all ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + module_check kernel-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _forced=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 1 -eq 2 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + is_func check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ type -t check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 0 -ne 0 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check -h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + true Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _ret=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + ret=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ 0 != 0 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ module_depends kernel-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: +++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ depends Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ true Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ _ret=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ return 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + mods_to_load+=' kernel-modules ' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _mod=90kernel-modules-extra Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _mod=kernel-modules-extra Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check_module kernel-modules-extra 1 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _mod=kernel-modules-extra Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddep Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n 1 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all = all ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + module_check kernel-modules-extra Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _forced=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 1 -eq 2 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + is_func check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ type -t check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 0 -ne 0 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check -h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + true Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _ret=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + ret=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ 0 != 0 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ module_depends kernel-modules-extra Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: +++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ depends Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ true Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ _ret=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ return 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + mods_to_load+=' kernel-modules-extra ' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _mod=90kernel-network-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _mod=kernel-network-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check_module kernel-network-modules 1 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _mod=kernel-network-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddep Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n 1 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all = all ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + module_check kernel-network-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _forced=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 1 -eq 2 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + is_func check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ type -t check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 0 -ne 0 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check -h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _ret=255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + ret=255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ 255 != 0 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n 1 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 1 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _mod=90livenet Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _mod=livenet Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check_module livenet 1 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _mod=livenet Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddep Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n 1 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all = all ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + module_check livenet Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _forced=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 1 -eq 2 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + is_func check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ type -t check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 0 -ne 0 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check -h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _ret=255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + ret=255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ 255 != 0 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n 1 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 1 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _mod=90lvm Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _mod=lvm Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check_module lvm 1 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _mod=lvm Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddep Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n 1 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all = all ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + module_check lvm Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _forced=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 1 -eq 2 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + is_func check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ type -t check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 0 -ne 0 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check -h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + require_binaries lvm Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _module_name=90lvm Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ lvm = \-\m ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for cmd in "$@" Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + find_binary lvm Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n -h ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for fs in "${host_fs_types[@]}" Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ nfs = LVM*_member ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _ret=255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + ret=255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ 255 != 0 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n 1 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 1 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _mod=90mdraid Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _mod=mdraid Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check_module mdraid 1 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _mod=mdraid Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddep Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n 1 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all = all ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + module_check mdraid Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _forced=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 1 -eq 2 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + is_func check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ type -t check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 0 -ne 0 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check -h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _rootdev Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + require_binaries mdadm expr Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _module_name=90mdraid Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ mdadm = \-\m ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for cmd in "$@" Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + find_binary mdadm Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for cmd in "$@" Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + find_binary expr Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n -h ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for dev in "${!host_fs_types[@]}" Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ nfs != *_raid_member ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + continue Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _ret=255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + ret=255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ 255 != 0 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n 1 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 1 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _mod=90multipath Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _mod=multipath Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check_module multipath 1 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _mod=multipath Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddep Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n 1 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all = all ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + module_check multipath Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _forced=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 1 -eq 2 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + is_func check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ type -t check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 0 -ne 0 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check -h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _rootdev Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n -h ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for_each_host_dev_and_slaves is_mpath Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _func=is_mpath Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _dev Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for _dev in "${host_devs[@]}" Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + continue Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 1 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _ret=255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + ret=255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ 255 != 0 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n 1 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 1 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _mod=90qemu Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _mod=qemu Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check_module qemu 1 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _mod=qemu Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddep Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n 1 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all = all ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + module_check qemu Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _forced=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 1 -eq 2 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + is_func check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ type -t check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 0 -ne 0 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check -h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n -h ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + type -P systemd-detect-virt Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ systemd-detect-virt --vm Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + vm=none Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + (( 1 != 0 )) Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _ret=255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + ret=255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ 255 != 0 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n 1 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 1 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _mod=90qemu-net Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _mod=qemu-net Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check_module qemu-net 1 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _mod=qemu-net Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddep Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n 1 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all = all ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + module_check qemu-net Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _forced=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 1 -eq 2 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + is_func check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ type -t check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 0 -ne 0 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check -h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n -h ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + type -P systemd-detect-virt Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ systemd-detect-virt --vm Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + vm= Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + (( 1 != 0 )) Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _ret=255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + ret=255 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ 255 != 0 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n 1 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + return 1 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _mod=90stratis Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + _mod=stratis Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check_module stratis 1 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _mod=stratis Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddep Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -n 1 ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ all = all ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + module_check stratis Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ read a b Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _forced=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _hostonly=-h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 1 -eq 2 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + is_func check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: ++ type -t check Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + '[' 0 -ne 0 ']' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + check -h Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _module_name=90stratis Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + local _ret=0 Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + [[ stratisd-init = \-\m ]] Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + for cmd in "$@" Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + find_binary stratisd-init Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 17:34:23 kjcf05n02 kdumpctl[7792]: + set +x Nov 3 17:34:23 kjcf05n02 dracut[7906]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 17:34:23 kjcf05n02 dracut[7906]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 17:34:23 kjcf05n02 dracut[7906]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 17:34:24 kjcf05n02 dracut[7906]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 17:34:24 kjcf05n02 dracut[7906]: memstrack is available Nov 3 17:34:24 kjcf05n02 dracut[7906]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 17:34:24 kjcf05n02 dracut[7906]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 17:34:24 kjcf05n02 dracut[7906]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 17:34:23 kjcf05n00 zabbix-server[1444751]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 17:34:23 kjcf05n00 zabbix-server[1444751]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 117.49\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 138.3\\"}}"' Nov 3 17:34:24 kjcf05n00 log_interesting_event.py[1444751]: Event '46458' acknowledged Nov 3 17:34:24 kjcf05n02 dracut[7906]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 17:34:24 kjcf05n02 dracut[7906]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 17:34:24 kjcf05n02 dracut[7906]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 17:34:24 kjcf05n02 dracut[7906]: *** Including module: bash *** Nov 3 17:34:24 kjcf05n02 dracut[7906]: *** Including module: systemd *** Nov 3 17:34:25 kjcf05n02 dracut[7906]: *** Including module: fips *** Nov 3 17:34:25 kjcf05n02 dracut[7906]: *** Including module: systemd-initrd *** Nov 3 17:34:25 kjcf05n02 dracut[7906]: *** Including module: watchdog-modules *** Nov 3 17:34:25 kjcf05n02 dracut[7906]: *** Including module: nss-softokn *** Nov 3 17:34:25 kjcf05n02 dracut[7906]: *** Including module: i18n *** Nov 3 17:34:25 kjcf05n02 dracut[7906]: No KEYMAP configured. Nov 3 17:34:25 kjcf05n02 dracut[7906]: *** Including module: network-legacy *** Nov 3 17:34:26 kjcf05n02 dracut[7906]: *** Including module: network *** Nov 3 17:34:26 kjcf05n02 dracut[7906]: *** Including module: ib_bonding *** Nov 3 17:34:26 kjcf05n02 dracut[7906]: *** Including module: drm *** Nov 3 17:34:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730676867', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 17:34:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730676867'} Nov 3 17:34:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:34:29 kjcf05n02 dcs-collectord[5599]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 17:34:29 kjcf05n02 dcs-collectord[5599]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 17:34:30 kjcf05n02 dracut[7906]: *** Including module: hperaid *** Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + install Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + local rule rule_path Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + inst_multiple cat expr Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.e1xFD5/initramfs -a -f cat expr Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + _ret=0 Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + (( 0 != 0 )) Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + : Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + return 0 Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + inst_multiple -o mdmon Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.e1xFD5/initramfs -a -f -o mdmon Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + _ret=0 Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + (( 0 != 0 )) Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + : Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + return 0 Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: ++ command -v partx Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + inst /usr/sbin/partx /sbin/partx Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + local _hostonly_install Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + [[ -e /tmp/dracut.e1xFD5/initramfs//sbin/partx ]] Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.e1xFD5/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + (( 0 != 0 )) Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + : Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: ++ command -v mdadm Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + local _hostonly_install Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + [[ -e /tmp/dracut.e1xFD5/initramfs//sbin/mdadm ]] Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.e1xFD5/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + (( 0 != 0 )) Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + : Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + [[ yes == \y\e\s ]] Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + local _raidconf Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: ++ cmdline Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: ++ local _activated dev line UUID Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: ++ declare -A _activated Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: ++ for dev in "${!host_fs_types[@]}" Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: ++ [[ nfs != *_raid_member ]] Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: ++ continue Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + _raidconf= Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + [[ -n '' ]] Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + inst_rules 64-md-raid.rules Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + local _target=/etc/udev/rules.d _rule _found Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + inst_dir /usr/lib/udev/rules.d Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + [[ -e /tmp/dracut.e1xFD5/initramfs//usr/lib/udev/rules.d ]] Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + return 0 Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + inst_dir /etc/udev/rules.d Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + [[ -e /tmp/dracut.e1xFD5/initramfs//etc/udev/rules.d ]] Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + return 0 Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + for _rule in "$@" Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + continue Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + continue Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + for r in '' $dracutbasedir/rules.d/ Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + [[ 64-md-raid.rules != /* ]] Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + continue Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + for r in '' $dracutbasedir/rules.d/ Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + continue Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + [[ -n '' ]] Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + set +x Nov 3 17:34:30 kjcf05n02 dracut[7906]: Skipping udev rule: 64-md-raid.rules Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + installkernel Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + instmods =drivers/md Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + local _optional=-o Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + local _silent Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + local _ret Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + [[ '' = yes ]] Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + [[ =drivers/md = \-\c ]] Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + [[ =drivers/md = \-\s ]] Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + (( 1 == 0 )) Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.e1xFD5/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + _ret=0 Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + (( 0 != 0 )) Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + [[ -n '' ]] Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + return 0 Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + _ret=0 Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + unset check depends cmdline install installkernel Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + return 0 Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + modules_loaded+='hperaid ' Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + '[' -n '' ']' Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + _d_mod=90kernel-modules Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + _d_mod=kernel-modules Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + [[ '' = yes ]] Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + dinfo '*** Including module: kernel-modules ***' Nov 3 17:34:30 kjcf05n02 kdumpctl[7792]: + set +x Nov 3 17:34:30 kjcf05n02 dracut[7906]: *** Including module: kernel-modules *** Nov 3 17:34:30 kjcf05n02 dracut[7906]: *** Including module: kernel-modules-extra *** Nov 3 17:34:30 kjcf05n02 dracut[7906]: *** Including module: kernel-network-modules *** Nov 3 17:34:31 kjcf05n02 dracut[7906]: *** Including module: diskless-mod *** Nov 3 17:34:31 kjcf05n02 dracut[7906]: *** Including module: fstab-sys *** Nov 3 17:34:31 kjcf05n02 dracut[7906]: *** Including module: nfs *** Nov 3 17:34:31 kjcf05n02 dracut[7906]: *** Including module: rootfs-block *** Nov 3 17:34:31 kjcf05n02 dracut[7906]: *** Including module: terminfo *** Nov 3 17:34:31 kjcf05n02 dracut[7906]: *** Including module: udev-rules *** Nov 3 17:34:32 kjcf05n02 dracut[7906]: Skipping udev rule: 91-permissions.rules Nov 3 17:34:32 kjcf05n02 dracut[7906]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 17:34:32 kjcf05n02 dracut[7906]: *** Including module: dracut-systemd *** Nov 3 17:34:32 kjcf05n02 dracut[7906]: *** Including module: usrmount *** Nov 3 17:34:32 kjcf05n02 dracut[7906]: *** Including module: base *** Nov 3 17:34:33 kjcf05n02 dracut[7906]: *** Including module: fs-lib *** Nov 3 17:34:33 kjcf05n02 dracut[7906]: *** Including module: kdumpbase *** Nov 3 17:34:33 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 3 17:34:33 kjcf05n02 dracut[7906]: *** Including module: memstrack *** Nov 3 17:34:33 kjcf05n02 dracut[7906]: *** Including module: shutdown *** Nov 3 17:34:33 kjcf05n02 dracut[7906]: *** Including module: squash *** Nov 3 17:34:34 kjcf05n02 dracut[7906]: *** Including modules done *** Nov 3 17:34:34 kjcf05n02 dracut[7906]: *** Installing kernel module dependencies *** Nov 3 17:34:34 kjcf05n02 dracut[7906]: *** Installing kernel module dependencies done *** Nov 3 17:34:34 kjcf05n02 dracut[7906]: *** Resolving executable dependencies *** Nov 3 17:34:35 kjcf05n02 dracut[7906]: *** Resolving executable dependencies done*** Nov 3 17:34:35 kjcf05n02 dracut[7906]: *** Hardlinking files *** Nov 3 17:34:35 kjcf05n02 dracut[7906]: *** Hardlinking files done *** Nov 3 17:34:35 kjcf05n02 dracut[7906]: *** Generating early-microcode cpio image *** Nov 3 17:34:35 kjcf05n02 dracut[7906]: *** Constructing AuthenticAMD.bin **** Nov 3 17:34:35 kjcf05n02 dracut[7906]: *** Store current command line parameters *** Nov 3 17:34:35 kjcf05n02 dracut[7906]: Stored kernel commandline: Nov 3 17:34:35 kjcf05n02 dracut[7906]: rd.driver.pre=sd_mod Nov 3 17:34:35 kjcf05n02 dracut[7906]: rd.driver.pre=nvme Nov 3 17:34:35 kjcf05n02 dracut[7906]: rd.driver.pre=ipmi_si Nov 3 17:34:35 kjcf05n02 dracut[7906]: rd.driver.pre=ipmi_devintf Nov 3 17:34:35 kjcf05n02 dracut[7906]: rd.driver.pre=ipmi_msghandler Nov 3 17:34:35 kjcf05n02 dracut[7906]: nameserver=172.16.2.2 Nov 3 17:34:35 kjcf05n02 dracut[7906]: nameserver=127.0.0.1 Nov 3 17:34:35 kjcf05n02 dracut[7906]: nameserver=172.16.2.2 Nov 3 17:34:35 kjcf05n02 dracut[7906]: nameserver=127.0.0.1 Nov 3 17:34:35 kjcf05n02 dracut[7906]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 3 17:34:35 kjcf05n02 dracut[7906]: rd.neednet Nov 3 17:34:35 kjcf05n02 dracut[7906]: kdumpnic=mgmt0 Nov 3 17:34:35 kjcf05n02 dracut[7906]: bootdev=mgmt0 Nov 3 17:34:35 kjcf05n02 dracut[7906]: *** Install squash loader *** Nov 3 17:34:36 kjcf05n02 dracut[7906]: *** Squashing the files inside the initramfs *** Nov 3 17:34:36 kjcf05n02 dracut[7906]: *** Squashing the files inside the initramfs done *** Nov 3 17:34:36 kjcf05n02 dracut[7906]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 17:34:36 kjcf05n02 dracut[7906]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 17:34:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730676876', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 17:34:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730676876'} Nov 3 17:34:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:34:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730676876', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 17:34:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730676876'} Nov 3 17:34:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:34:37 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 3 17:34:37 kjcf05n02 kdumpctl[7792]: kdump: kexec: loaded kdump kernel Nov 3 17:34:37 kjcf05n02 kdumpctl[7792]: kdump: Starting kdump: [OK] Nov 3 17:34:37 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 3 17:34:37 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 3 17:34:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 3 17:34:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 3 17:34:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 3 17:34:37 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:34:37 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:34:37 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:34:37 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 17:34:37 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 3 17:34:37 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 17:34:37 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 3 17:34:37 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 17:34:37 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 3 17:34:37 kjcf05n02 ifdown[14492]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 17:34:37 kjcf05n02 ifdown[14493]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:34:37 kjcf05n02 ifdown[14494]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:34:38 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 17:34:38 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 17:34:38 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 17:34:38 kjcf05n02 ifup[14570]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 17:34:38 kjcf05n02 ifup[14571]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:34:38 kjcf05n02 ifup[14572]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:34:40 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 17:34:41 kjcf05n00 zabbix-server[1444954]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 17:34:41 kjcf05n00 zabbix-server[1444954]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:53\\"}}"' Nov 3 17:34:41 kjcf05n00 log_interesting_event.py[1444954]: Event '46463' acknowledged Nov 3 17:34:42 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 17:34:42 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 17:34:42 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:34:42 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 17:34:42 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:34:42 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:34:42 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:34:42 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 17:34:42 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 17:34:42 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 17:34:42 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 17:34:42 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:34:42 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:34:42 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:34:42 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:34:42 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 17:34:42 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 17:34:42 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 17:34:42 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 17:34:42 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 17:34:42 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 17:34:42 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 17:34:42 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 17:34:42 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 17:34:42 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 17:34:42 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 17:34:42 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 17:34:42 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 17:34:42 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 17:34:42 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 17:34:42 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 3 17:34:42 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 17:34:42 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 3 17:34:42 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 17:34:42 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 3 17:34:42 kjcf05n02 ifdown[14746]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 17:34:42 kjcf05n02 ifdown[14747]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:34:42 kjcf05n02 ifdown[14748]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:34:43 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 17:34:43 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 17:34:43 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 17:34:43 kjcf05n02 ifup[14823]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 17:34:43 kjcf05n02 ifup[14825]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:34:43 kjcf05n02 ifup[14826]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:34:44 kjcf05n02 dcs-collectord[5599]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 17:34:44 kjcf05n02 dcs-collectord[5599]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 17:34:44 kjcf05n00 zabbix-server[1444955]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 17:34:44 kjcf05n00 zabbix-server[1444955]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 227.25\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 123.29\\"}}"' Nov 3 17:34:44 kjcf05n00 log_interesting_event.py[1444955]: Event '46470' acknowledged Nov 3 17:34:44 kjcf05n00 zabbix-server[1444956]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 17:34:44 kjcf05n00 zabbix-server[1444956]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 3 17:34:44 kjcf05n00 log_interesting_event.py[1444956]: Event '46471' acknowledged Nov 3 17:34:46 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 17:34:47 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 17:34:47 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 17:34:47 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 17:34:47 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:48 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 3 17:34:48 kjcf05n02 await_ha_peer[15030]: Waiting for HA peer kjcf05n03 Nov 3 17:34:48 kjcf05n03 LCNmon[18219]: 10.16.100.58 is unreachable via ib0 Nov 3 17:34:49 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 17:34:49 kjcf05n02 await_ha_peer[15030]: Peer kjcf05n03 has started, starting HA Nov 3 17:34:49 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 3 17:34:49 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 3 17:34:49 kjcf05n02 fstonithd.py[15068]: Listening for kdump packets from partner Nov 3 17:34:49 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:49 kjcf05n00 mcfcli[3673891]: %3|1730676889.771|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:34:50 kjcf05n02 systemd[3127]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:34:50 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:34:50 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:34:50 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:50 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 3 17:34:50 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 17:34:50 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:51 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 17:34:51 kjcf05n02 puppet-agent[3524]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 17:34:51 kjcf05n02 puppet[3524]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 17:34:51 kjcf05n02 puppet-agent[3524]: Applied catalog in 92.12 seconds Nov 3 17:34:51 kjcf05n02 puppet[3524]: Notice: Applied catalog in 92.12 seconds Nov 3 17:34:51 kjcf05n02 systemd[1]: Started Puppet agent. Nov 3 17:34:51 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 17:34:51 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 3 17:34:51 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 17:34:51 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 17:34:51 kjcf05n02 systemd[1]: Reached target Timers. Nov 3 17:34:51 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 17:34:51 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 17:34:51 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 17:34:51 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 17:34:51 kjcf05n02 wce-disable.sh[15225]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 17:34:51 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 17:34:51 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 17:34:51 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 17:34:51 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 17:34:51 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 3 17:34:51 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 3 17:34:51 kjcf05n02 python3.9[15227]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 17:34:51 kjcf05n02 gateway-ec-node.py[15228]: Starting gateway-ec-node service Nov 3 17:34:51 kjcf05n02 python3.9[15227]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 17:34:51 kjcf05n02 RFSF-API[15226]: INFO[2024-11-03T17:34:51-06:00] Datapath API RESTful Service starting Nov 3 17:34:51 kjcf05n02 dp-api-server-node[15226]: INFO[2024-11-03T17:34:51-06:00] Datapath API RESTful Service starting Nov 3 17:34:51 kjcf05n02 RFSF-API[15226]: INFO[2024-11-03T17:34:51-06:00] Running in production mode, starting dbus event listener Nov 3 17:34:51 kjcf05n02 dp-api-server-node[15226]: INFO[2024-11-03T17:34:51-06:00] Running in production mode, starting dbus event listener Nov 3 17:34:51 kjcf05n02 RFSF-API[15226]: INFO[2024-11-03T17:34:51-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 17:34:51 kjcf05n02 dp-api-server-node[15226]: INFO[2024-11-03T17:34:51-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 17:34:51 kjcf05n02 RFSF-API[15226]: INFO[2024-11-03T17:34:51-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 17:34:51 kjcf05n02 dp-api-server-node[15226]: INFO[2024-11-03T17:34:51-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 17:34:51 kjcf05n02 RFSF-API[15226]: INFO[2024-11-03T17:34:51-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 17:34:51 kjcf05n02 dp-api-server-node[15226]: INFO[2024-11-03T17:34:51-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 17:34:51 kjcf05n02 RFSF-API[15226]: INFO[2024-11-03T17:34:51-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 17:34:51 kjcf05n02 dp-api-server-node[15226]: INFO[2024-11-03T17:34:51-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 17:34:51 kjcf05n02 RFSF-API[15226]: INFO[2024-11-03T17:34:51-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 17:34:51 kjcf05n02 dp-api-server-node[15226]: INFO[2024-11-03T17:34:51-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 17:34:51 kjcf05n02 RFSF-API[15226]: INFO[2024-11-03T17:34:51-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 17:34:51 kjcf05n02 dp-api-server-node[15226]: INFO[2024-11-03T17:34:51-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 17:34:51 kjcf05n02 RFSF-API[15226]: INFO[2024-11-03T17:34:51-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 17:34:51 kjcf05n02 dp-api-server-node[15226]: INFO[2024-11-03T17:34:51-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 17:34:51 kjcf05n02 RFSF-API[15226]: INFO[2024-11-03T17:34:51-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 17:34:51 kjcf05n02 dp-api-server-node[15226]: INFO[2024-11-03T17:34:51-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 17:34:51 kjcf05n02 RFSF-API[15226]: INFO[2024-11-03T17:34:51-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 17:34:51 kjcf05n02 dp-api-server-node[15226]: INFO[2024-11-03T17:34:51-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 17:34:51 kjcf05n02 RFSF-API[15226]: INFO[2024-11-03T17:34:51-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 17:34:51 kjcf05n02 dp-api-server-node[15226]: INFO[2024-11-03T17:34:51-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 17:34:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730676894', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(1736.0B/1368.0B), ib1=(1316.0B/1160.0B), icl0=(5.4kB/8.6kB), lo=(600.0B/600.0B), meth0=(1541.1MB/7.8MB), mgmt0=(1477.9MB/7.8MB)'}"] Nov 3 17:34:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(1736.0B/1368.0B), ib1=(1316.0B/1160.0B), icl0=(5.4kB/8.6kB), lo=(600.0B/600.0B), meth0=(1541.1MB/7.8MB), mgmt0=(1477.9MB/7.8MB)', 'message': 'NET OK - (Rx/Tx) ib0=(1736.0B/1368.0B), ib1=(1316.0B/1160.0B), icl0=(5.4kB/8.6kB), lo=(600.0B/600.0B), meth0=(1541.1MB/7.8MB), mgmt0=(1477.9MB/7.8MB)', 'value': 'ok', 'timestamp': '1730676894'} Nov 3 17:34:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:34:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730676895', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 17:34:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730676895'} Nov 3 17:34:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:34:57 kjcf05n00 mcfcli[3673891]: %3|1730676897.837|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:34:58 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:58 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 17:34:58 kjcf05n02 systemd[1]: Reloading. Nov 3 17:34:58 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 17:34:59 kjcf05n02 diskmonitor_pre[15709]: Key management is currently disabled.DEAR disabled Nov 3 17:34:59 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 17:34:59 kjcf05n02 dcs-collectord[5599]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 17:34:59 kjcf05n02 dcs-collectord[5599]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 17:34:59 kjcf05n02 dcs-collectord[5599]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 17:35:01 kjcf05n02 sh[15770]: LNET configured: New Created Nov 3 17:35:01 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 17:35:01 kjcf05n02 LCNmon[17786]: Interface ib0 is up Nov 3 17:35:01 kjcf05n02 LCNmon[17786]: Interface ib1 is up Nov 3 17:35:01 kjcf05n02 LCNmon[17786]: Can ping through interface ib0 Nov 3 17:35:01 kjcf05n02 LCNmon[17786]: Can ping through interface ib1 Nov 3 17:35:01 kjcf05n02 LCNmon[17786]: NIC ib0, initial state UP Nov 3 17:35:01 kjcf05n02 LCNmon[17786]: NIC ib1, initial state UP Nov 3 17:35:01 kjcf05n02 LCNmon[17786]: LCNstat initial state UP Nov 3 17:35:01 kjcf05n00 httpd[902564]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 17:35:01 kjcf05n02 LCNmon[17786]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 3 17:35:01 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: /var/run/diskmonitor does not exist, creating Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: Creating /var/run/diskmonitor/disk Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: Creating /var/run/diskmonitor/encl Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: Creating /var/run/diskmonitor/cli Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: RAS_Interlocks_enabled: 1 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: add handler for sig: 14 sa_flags: 10000004 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: add handler for sig: 1 sa_flags: 10000004 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: add handler for sig: 2 sa_flags: 00000004 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: add handler for sig: 15 sa_flags: 00000004 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: add handler for sig: 6 sa_flags: 00000004 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: add handler for sig: 3 sa_flags: 00000004 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: add handler for sig: 30 sa_flags: 00000004 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: add handler for sig: 20 sa_flags: 00000004 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: add handler for sig: 10 sa_flags: 10000004 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: add handler for sig: 11 sa_flags: 00000004 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: add handler for sig: 7 sa_flags: 00000004 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: add handler for sig: 4 sa_flags: 00000004 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: add handler for sig: 8 sa_flags: 00000004 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: Using HA Baton locks - key: diskmonitor Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: Baton will be held for at most 570 seconds Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: DMMP Enabled: 0 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: random seed: cf43a1b6 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: NVMe Enclosure: 1 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: ZFS Enclosure: 0 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: Dbus, Initialized Connection Successfully Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: int_catcher_thread: thread start Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: Received dbus message 4 org.freedesktop.DBus -> :1.92 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 17:35:03 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 17:35:04 kjcf05n02 openhpid[5505]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 17:35:04 kjcf05n02 openhpid[5505]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 17:35:04 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 3 17:35:04 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 17:35:04 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 17:35:04 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18214 which is not our child. We'll most likely not notice when it exits. Nov 3 17:35:04 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 17:35:04 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 3 17:35:04 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 3 17:35:04 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 17:35:04 kjcf05n02 dcs-collectord[5599]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 17:35:04 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 17:35:04 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 17:35:04 kjcf05n02 systemd[1]: Startup finished in 50.161s (kernel) + 2min 28.071s (userspace) = 3min 18.232s. Nov 3 17:35:04 kjcf05n02 openhpid[18214]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 17:35:04 kjcf05n02 openhpid[18214]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 17:35:04 kjcf05n02 openhpid[18214]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 17:35:04 kjcf05n02 openhpid[18214]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 17:35:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730676905', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 4.75, 2.77, 1.17'}"] Nov 3 17:35:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 4.75, 2.77, 1.17', 'message': 'OK - load average: 4.75, 2.77, 1.17', 'value': 'ok', 'timestamp': '1730676905'} Nov 3 17:35:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:35:08 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18540 (bash) Nov 3 17:35:08 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: check_run_sedcmd, No Device name provided Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 17:35:08 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 17:35:08 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 17:35:08 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 17:35:08 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 17:35:08 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 17:35:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730676909', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 355 processes with STATE = RSZDT '}"] Nov 3 17:35:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 355 processes with STATE = RSZDT ', 'message': 'PROCS OK: 355 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730676909'} Nov 3 17:35:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:35:14 kjcf05n02 dcs-collectord[5599]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 17:35:14 kjcf05n02 dcs-collectord[5599]: WARNING No data collected (hpi_parser.py:353) Nov 3 17:35:16 kjcf05n00 python3.9[1445183]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 17:35:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730676919', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.7% (4392512 kB) used.'}"] Nov 3 17:35:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.7% (4392512 kB) used.', 'message': 'OK - 1.7% (4392512 kB) used.', 'value': 'ok', 'timestamp': '1730676919'} Nov 3 17:35:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:35:19 kjcf05n00 mcfcli[3673891]: %3|1730676919.771|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:35:27 kjcf05n02 ipmievd[3938]: System Event sensor - Timestamp Clock Sync Nov 3 17:35:29 kjcf05n02 ipmievd[3127]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:35:29 kjcf05n02 dcs-collectord[5599]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 17:35:29 kjcf05n03 nslcd[6919]: [16e9e8] ldap_result() failed: Can't contact LDAP server Nov 3 17:35:29 kjcf05n03 nslcd[6919]: [90cde7] ldap_result() failed: Can't contact LDAP server Nov 3 17:35:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730676646', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 17:35:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730676646'} Nov 3 17:35:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:35:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730676646', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 17:35:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730676646'} Nov 3 17:35:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:35:37 kjcf05n00 mcfcli[3673891]: %3|1730676937.834|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:35:40 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730676939', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 17:35:40 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730676939'} Nov 3 17:35:40 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 17:35:41 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 17:35:44 kjcf05n02 dcs-collectord[5599]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 17:35:49 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '5b6d984a-9a3c-11ef-b2aa-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 17:35:49 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '5b6d984a-9a3c-11ef-b2aa-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 17:35:49 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '5b6d984a-9a3c-11ef-b2aa-00093d0695e3', 'response ID': '5b780a28-9a3c-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 17:35:49 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 5b780a28-9a3c-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 17:35:49 kjcf05n03 firmware-update-orc-server[5845]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "d4c69472-a734-4608-b549-281a12f35cf1"} (logger.py:65) Nov 3 17:35:49 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 197223 (get_disk_device) Nov 3 17:35:49 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 17:35:49 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 17:35:49 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 17:35:49 kjcf05n02 ras-resource-manager-agent[5863]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "5b6d984a-9a3c-11ef-b2aa-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 17:35:49 kjcf05n02 ras-resource-manager-agent[5863]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '5b6d984a-9a3c-11ef-b2aa-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 17:35:49 kjcf05n02 ras-resource-manager-agent[5863]: INFO Submitting new device inserted signal, starting to qualify drive: 5b6d984a-9a3c-11ef-b2aa-00093d0695e3 (admin_action.py:110) Nov 3 17:35:49 kjcf05n00 mcfcli[3673891]: %3|1730676949.771|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 17:35:50 kjcf05n03 ccp-client[197244]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 17:35:50 kjcf05n03 ccp-client[197244]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 17:35:50 kjcf05n03 ccp-client[197253]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 17:35:50 kjcf05n03 ccp-client[197244]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 17:35:50 kjcf05n03 ccp-client[197244]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 17:35:50 kjcf05n03 ccp-client[197253]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 17:35:50 kjcf05n03 ccp-client[197253]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 17:35:50 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '5bc10034-9a3c-11ef-b2aa-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 17:35:50 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '5bc10034-9a3c-11ef-b2aa-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 17:35:50 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '5bc10034-9a3c-11ef-b2aa-00093d0695e3', 'response ID': '5bc814f0-9a3c-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 17:35:50 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 5bc814f0-9a3c-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 17:35:50 kjcf05n02 diskmonitor[17328]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 17:35:50 kjcf05n02 ras-resource-manager-agent[5863]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "5bc10034-9a3c-11ef-b2aa-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 17:35:50 kjcf05n02 ras-resource-manager-agent[5863]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '5bc10034-9a3c-11ef-b2aa-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 17:35:50 kjcf05n02 ras-resource-manager-agent[5863]: INFO Submitting new device inserted signal, starting to qualify drive: 5bc10034-9a3c-11ef-b2aa-00093d0695e3 (admin_action.py:110) Nov 3 17:35:50 kjcf05n02 firmware-update-orc-server[5820]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "4195a460-2b98-40bd-b2c1-a9393270200a"} (logger.py:65) Nov 3 17:35:53 kjcf05n03 DRVFW[197386]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 17:35:53 kjcf05n03 ccp-client[197387]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 17:35:53 kjcf05n03 ccp-client[197387]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 17:35:53 kjcf05n03 ccp-client[197410]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 17:35:53 kjcf05n03 ccp-client[197387]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 17:35:53 kjcf05n03 ccp-client[197387]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 17:35:53 kjcf05n03 ccp-client[197410]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 17:35:53 kjcf05n03 ccp-client[197410]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 17:35:53 kjcf05n03 firmware-update-orc-server[5845]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 17:35:54 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 5b780a28-9a3c-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 17:35:54 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '5b6d984a-9a3c-11ef-b2aa-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '5b6d984a-9a3c-11ef-b2aa-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}}} (logger.py:65) Nov 3 17:35:54 kjcf05n02 ras-resource-manager-agent[5863]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '5b6d984a-9a3c-11ef-b2aa-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 17:35:54 kjcf05n02 ras-resource-manager-agent[5863]: INFO Drive qualification complete responding: 5b6d984a-9a3c-11ef-b2aa-00093d0695e3 (admin_action.py:205) Nov 3 17:35:54 kjcf05n02 ras-resource-manager-agent[5863]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "5b6d984a-9a3c-11ef-b2aa-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (interesting_event.py:59) Nov 3 17:35:57 kjcf05n02 diskmonitor[17328]: drive: eui.345950304db010240025384500000004 Nov 3 17:35:57 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 17:35:57 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 17:35:57 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 17:35:57 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 17:35:57 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 17:35:57 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 17:35:57 kjcf05n02 diskmonitor[17328]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 17:35:57 kjcf05n02 diskmonitor[17328]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 17:35:57 kjcf05n02 diskmonitor[17328]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 17:35:57 kjcf05n02 diskmonitor[17328]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 17:35:57 kjcf05n02 diskmonitor[17328]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 17:35:57 kjcf05n02 diskmonitor[17328]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "5b6d984a-9a3c-11ef-b2aa-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 17:35:57 kjcf05n02 diskmonitor[17328]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 17:35:57 kjcf05n02 diskmonitor[17328]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 17:35:57 kjcf05n02 diskmonitor[17328]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "5bc10034-9a3c-11ef-b2aa-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 17:35:57 kjcf05n02 diskmonitor[17328]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 17:35:57 kjcf05n02 diskmonitor[17328]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 17:36:00 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22351 (get_disk_device) Nov 3 17:36:00 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 17:36:00 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 17:36:00 kjcf05n02 ccp-client[22373]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 17:36:00 kjcf05n02 ccp-client[22373]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 17:36:00 kjcf05n02 ccp-client[22373]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 17:36:00 kjcf05n02 ccp-client[22382]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 17:36:00 kjcf05n02 ccp-client[22373]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 17:36:00 kjcf05n02 ccp-client[22382]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 17:36:00 kjcf05n02 ccp-client[22382]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 17:36:01 kjcf05n02 chronyd[5105]: Selected source 172.16.2.1 Nov 3 17:36:03 kjcf05n02 DRVFW[22566]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 17:36:03 kjcf05n02 ccp-client[22568]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 17:36:03 kjcf05n02 ccp-client[22568]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 17:36:03 kjcf05n02 ccp-client[22580]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 17:36:03 kjcf05n02 ccp-client[22568]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 17:36:03 kjcf05n02 ccp-client[22568]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 17:36:03 kjcf05n02 ccp-client[22580]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 17:36:03 kjcf05n02 ccp-client[22580]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 17:36:03 kjcf05n02 firmware-update-orc-server[5820]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 17:36:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730676964}"] Nov 3 17:36:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730676964, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:36:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:36:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730676964}"] Nov 3 17:36:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730676964, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:36:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:36:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730676964}"] Nov 3 17:36:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730676964, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:36:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:36:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730676964}"] Nov 3 17:36:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730676964, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:36:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:36:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730676964}"] Nov 3 17:36:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730676964, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:36:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:36:04 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 5bc814f0-9a3c-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 17:36:04 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '5bc10034-9a3c-11ef-b2aa-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '5bc10034-9a3c-11ef-b2aa-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 13}}}} (logger.py:65) Nov 3 17:36:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730676964}"] Nov 3 17:36:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730676964, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:36:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:36:05 kjcf05n02 ras-resource-manager-agent[5863]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '5bc10034-9a3c-11ef-b2aa-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 13}}} (resource_admin.py:98) Nov 3 17:36:05 kjcf05n02 ras-resource-manager-agent[5863]: INFO Drive qualification complete responding: 5bc10034-9a3c-11ef-b2aa-00093d0695e3 (admin_action.py:205) Nov 3 17:36:05 kjcf05n02 ras-resource-manager-agent[5863]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "5bc10034-9a3c-11ef-b2aa-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 13}}} (interesting_event.py:59) Nov 3 17:36:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730676964}"] Nov 3 17:36:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730676964, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:36:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:36:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730676964}"] Nov 3 17:36:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730676964, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:36:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:36:05 kjcf05n02 ras-resource-manager-agent[5863]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "5b6d984a-9a3c-11ef-b2aa-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (service_main_handler.py:66) Nov 3 17:36:05 kjcf05n02 ras-resource-manager-agent[5863]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '5b6d984a-9a3c-11ef-b2aa-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 17:36:05 kjcf05n02 ras-resource-manager-agent[5863]: INFO Device qualification response has been acknowledged: 5b6d984a-9a3c-11ef-b2aa-00093d0695e3 (admin_action.py:151) Nov 3 17:36:05 kjcf05n02 ras-resource-manager-agent[5863]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "5bc10034-9a3c-11ef-b2aa-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 13}}} (service_main_handler.py:66) Nov 3 17:36:05 kjcf05n02 ras-resource-manager-agent[5863]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '5bc10034-9a3c-11ef-b2aa-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 13}}} (resource_admin.py:98) Nov 3 17:36:05 kjcf05n02 ras-resource-manager-agent[5863]: INFO Device qualification response has been acknowledged: 5bc10034-9a3c-11ef-b2aa-00093d0695e3 (admin_action.py:151) Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "5b6d984a-9a3c-11ef-b2aa-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: Dbus, handle_ingress_ras_signals, uuid: 5b6d984a-9a3c-11ef-b2aa-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "5b6d984a-9a3c-11ef-b2aa-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "5bc10034-9a3c-11ef-b2aa-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 13}}} Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: Dbus, handle_ingress_ras_signals, uuid: 5bc10034-9a3c-11ef-b2aa-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "5bc10034-9a3c-11ef-b2aa-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 13}}} Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 17:36:08 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 17:36:08 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 3 17:36:08 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 17:36:08 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 3 17:36:09 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 17:36:10 kjcf05n02 diskmonitor[17328]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 17:36:13 kjcf05n02 python3.9[5168]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 17:36:16 kjcf05n02 python3.9[3127]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:36:16 kjcf05n02 diskmonitor[17328]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 17:36:16 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 17:36:16 kjcf05n02 diskmonitor[17328]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 17:36:16 kjcf05n02 diskmonitor[17328]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 17:36:16 kjcf05n02 diskmonitor[17328]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 17:36:16 kjcf05n02 diskmonitor[17328]: leaving test state: 1 next state: 2 Nov 3 17:36:16 kjcf05n02 diskmonitor[17328]: lock req: no timeout Nov 3 17:36:16 kjcf05n02 diskmonitor[17328]: leaving test state: 2 next state: 4 Nov 3 17:36:16 kjcf05n02 diskmonitor[17328]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 17:36:17 kjcf05n00 mcfcli[3673891]: %3|1730676977.831|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:36:19 kjcf05n00 mcfcli[3673891]: %3|1730676979.771|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:36:45 kjcf05n03 nslcd[6919]: [ef438d] ldap_result() failed: Can't contact LDAP server Nov 3 17:36:49 kjcf05n00 mcfcli[3673891]: %3|1730677009.771|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:36:56 kjcf05n00 mcfcli[3673891]: %3|1730677016.893|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:37:04 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 3 17:37:10 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 17:37:10 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 17:37:10 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 17:37:19 kjcf05n00 mcfcli[3673891]: %3|1730677039.771|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:37:21 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 17:37:21 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 17:37:21 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 17:37:25 kjcf05n02 dcs-collectord[5599]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 3 17:37:25 kjcf05n02 diskmonitor[17328]: lock acquired Nov 3 17:37:25 kjcf05n02 diskmonitor[17328]: leaving test state: 4 next state: 8 Nov 3 17:37:34 kjcf05n00 mcfcli[3673891]: %3|1730677054.829|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:37:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730677055}"] Nov 3 17:37:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730677055, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:37:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:37:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:37:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:37:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:37:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:37:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:37:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:37:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:37:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:37:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:37:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:37:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:37:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:37:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.035843ms Nov 3 17:37:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:37:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.035843ms Nov 3 17:37:35 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:37:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:37:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:37:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730677055}"] Nov 3 17:37:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730677055, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:37:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:37:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:37:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:37:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:37:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:37:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:37:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:37:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:37:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:37:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:37:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:37:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:37:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:37:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.750889ms Nov 3 17:37:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:37:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.750889ms Nov 3 17:37:35 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:37:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:37:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:37:44 kjcf05n02 diskmonitor[17328]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 17:37:44 kjcf05n02 diskmonitor[17328]: leaving test state: 8 next state: 20 Nov 3 17:37:44 kjcf05n02 diskmonitor[17328]: leaving test state: 20 next state: 40 Nov 3 17:37:44 kjcf05n02 diskmonitor[17328]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 15d840a0000 Nov 3 17:37:44 kjcf05n02 diskmonitor[17328]: leaving test state: 40 next state: 80 Nov 3 17:37:49 kjcf05n00 mcfcli[3673891]: %3|1730677069.773|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:38:00 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 17:38:01 kjcf05n02 diskmonitor[17328]: leaving test state: 80 next state: 100 Nov 3 17:38:01 kjcf05n02 diskmonitor[17328]: lock release: time: Sun Nov 3 17:37:55 2024 Nov 3 17:38:01 kjcf05n02 diskmonitor[17328]: leaving test state: 100 next state: 1 Nov 3 17:38:14 kjcf05n00 mcfcli[3673891]: %3|1730677094.324|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:38:19 kjcf05n00 mcfcli[3673891]: %3|1730677099.773|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:38:49 kjcf05n00 mcfcli[3673891]: %3|1730677129.773|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 17:38:53 kjcf05n00 mcfcli[3673891]: %3|1730677133.219|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:39:19 kjcf05n00 mcfcli[3673891]: %3|1730677159.773|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:39:29 kjcf05n00 mcfcli[3673891]: %3|1730677169.355|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:39:45 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31456 deleted. Nov 3 17:39:49 kjcf05n00 mcfcli[3673891]: %3|1730677189.773|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 17:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 17:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 17:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 17:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 17:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 17:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 17:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 17:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 17:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 17:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 17:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 17:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 17:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 17:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 17:40:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 17:40:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:40:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 17:40:06 kjcf05n00 mcfcli[3673891]: %3|1730677206.201|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:40:14 kjcf05n00 python3.9[1448357]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 17:40:19 kjcf05n00 mcfcli[3673891]: %3|1730677219.774|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:40:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730676646', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 17:40:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730676646'} Nov 3 17:40:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:40:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730676646', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 17:40:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730676646'} Nov 3 17:40:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:40:45 kjcf05n00 mcfcli[3673891]: %3|1730677245.197|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:40:49 kjcf05n00 mcfcli[3673891]: %3|1730677249.775|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 17:41:19 kjcf05n00 mcfcli[3673891]: %3|1730677279.775|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 17:41:23 kjcf05n00 mcfcli[3673891]: %3|1730677283.777|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:41:49 kjcf05n00 mcfcli[3673891]: %3|1730677309.775|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:42:02 kjcf05n00 mcfcli[3673891]: %3|1730677322.671|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:42:19 kjcf05n00 mcfcli[3673891]: %3|1730677339.776|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 17:42:41 kjcf05n00 mcfcli[3673891]: %3|1730677361.393|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:42:49 kjcf05n00 mcfcli[3673891]: %3|1730677369.777|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:43:19 kjcf05n00 mcfcli[3673891]: %3|1730677399.326|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:43:19 kjcf05n00 mcfcli[3673891]: %3|1730677399.777|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 17:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T17:43:27.253160814-06:00 level=info msg="Completed cleanup jobs" duration=26.172066ms Nov 3 17:43:49 kjcf05n00 mcfcli[3673891]: %3|1730677429.777|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:43:56 kjcf05n00 mcfcli[3673891]: %3|1730677436.860|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:44:19 kjcf05n00 mcfcli[3673891]: %3|1730677459.778|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:44:34 kjcf05n00 mcfcli[3673891]: %3|1730677474.674|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:44:49 kjcf05n00 mcfcli[3673891]: %3|1730677489.778|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 17:45:11 kjcf05n00 mcfcli[3673891]: %3|1730677511.263|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:45:19 kjcf05n00 mcfcli[3673891]: %3|1730677519.778|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:45:20 kjcf05n00 python3.9[1451276]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 17:45:42 kjcf05n02 root[41870]: failback_xyraid Nov 3 17:45:43 kjcf05n02 root[41989]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 17:45:45 kjcf05n02 root[42126]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 17:45:48 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 3 17:45:49 kjcf05n00 mcfcli[3673891]: %3|1730677549.779|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 17:45:51 kjcf05n00 mcfcli[3673891]: %3|1730677551.019|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:45:51 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme9n1 Nov 3 17:45:51 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme18n1 Nov 3 17:45:51 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme3n1 Nov 3 17:45:51 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme24n1 Nov 3 17:45:51 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme23n1 Nov 3 17:45:51 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme25n1 Nov 3 17:45:51 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme8n1 Nov 3 17:45:51 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme17n1 Nov 3 17:45:51 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme19n1 Nov 3 17:45:51 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme4n1 Nov 3 17:45:51 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme2n1 Nov 3 17:45:55 kjcf05n02 dwd[5139]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 3 17:45:55 kjcf05n02 dwd[5139]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 3 17:45:55 kjcf05n02 dwd[5139]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 3 17:45:55 kjcf05n02 dwd[5139]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 3 17:45:55 kjcf05n02 dwd[5139]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 3 17:45:55 kjcf05n02 dwd[5139]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 3 17:45:55 kjcf05n02 dwd[5139]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 3 17:45:55 kjcf05n02 dwd[5139]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 3 17:45:55 kjcf05n02 dwd[5139]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 3 17:45:55 kjcf05n02 dwd[5139]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 3 17:45:55 kjcf05n02 dwd[5139]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 3 17:45:55 kjcf05n02 dwd[5139]: Starting NVME thread for nvme2n1 Nov 3 17:45:55 kjcf05n02 dwd[5139]: Starting NVME thread for nvme18n1 Nov 3 17:45:56 kjcf05n02 dwd[5139]: Starting NVME thread for nvme19n1 Nov 3 17:45:56 kjcf05n02 dwd[5139]: Starting NVME thread for nvme9n1 Nov 3 17:45:56 kjcf05n02 dwd[5139]: Starting NVME thread for nvme3n1 Nov 3 17:45:56 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45011]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45009]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45013]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45009]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45011]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45013]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45009]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45013]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45011]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45009]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45013]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45025]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45011]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45029]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45009]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45032]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45034]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45013]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45011]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45025]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45009]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45029]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45032]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45013]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45011]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45025]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45009]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45029]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45011]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45032]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45025]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45009]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45032]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45011]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45025]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45009]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45029]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45025]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45032]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45009]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45029]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45025]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45009]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45009]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45009]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45009]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45009]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:45:56 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:45:57 kjcf05n02 dwd[5139]: Starting NVME thread for nvme24n1 Nov 3 17:45:57 kjcf05n02 nslcd[6896]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 17:45:57 kjcf05n02 dwd[5139]: Starting NVME thread for nvme4n1 Nov 3 17:45:57 kjcf05n02 dwd[5139]: Starting NVME thread for nvme23n1 Nov 3 17:45:57 kjcf05n02 dwd[5139]: Starting NVME thread for nvme17n1 Nov 3 17:45:57 kjcf05n02 dwd[5139]: Starting NVME thread for nvme25n1 Nov 3 17:45:57 kjcf05n02 dwd[5139]: Starting NVME thread for nvme8n1 Nov 3 17:46:00 kjcf05n02 diskmonitor[17328]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 3 17:46:00 kjcf05n02 dcs-bulk-data-sender[6129]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 142}' Nov 3 17:46:07 kjcf05n03 diskmonitor[17811]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 17:46:07 kjcf05n03 diskmonitor[17811]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 17:46:08 kjcf05n02 diskmonitor[17328]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 3 17:46:08 kjcf05n02 diskmonitor[17328]: Scan for ReadErrorMax change for md65 Nov 3 17:46:08 kjcf05n02 diskmonitor[17328]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 3 17:46:08 kjcf05n02 diskmonitor[17328]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 3 17:46:08 kjcf05n02 diskmonitor[17328]: read_saved_file: md65 no saved speed Nov 3 17:46:08 kjcf05n02 diskmonitor[17328]: reconstruction_policy: sync_action prev = current = resync - md65 Nov 3 17:46:08 kjcf05n02 diskmonitor[17328]: Set sync_speed_min (10000) for md65 Nov 3 17:46:08 kjcf05n02 diskmonitor[17328]: Set sync_speed_max (200000) for md65 Nov 3 17:46:08 kjcf05n02 diskmonitor[17328]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 17:46:19 kjcf05n00 mcfcli[3673891]: %3|1730677579.780|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:46:28 kjcf05n00 mcfcli[3673891]: %3|1730677588.343|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:46:48 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 17:46:48 kjcf05n02 systemd-tmpfiles[47723]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 17:46:48 kjcf05n02 systemd-tmpfiles[47723]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 17:46:48 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 17:46:48 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 17:46:50 kjcf05n00 mcfcli[3673891]: %3|1730677610.280|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 17:46:51 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47973 (bash) Nov 3 17:46:51 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 3 17:46:51 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 3 17:47:04 kjcf05n00 mcfcli[3673891]: %3|1730677624.637|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:47:20 kjcf05n00 mcfcli[3673891]: %3|1730677640.383|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 17:47:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730677654}"] Nov 3 17:47:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730677654, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:47:34 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:34-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:34 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:34-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:34 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:34-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:34 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:34-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:34 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:34-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:34 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:34-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:34 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:34-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.49373ms Nov 3 17:47:34 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:34-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.49373ms Nov 3 17:47:34 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:47:34 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:47:34 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:47:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730677654}"] Nov 3 17:47:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730677654, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:47:34 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:34-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:34 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:34-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:34 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:34-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:34 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:34-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:34 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:34-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:34 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:34-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:34 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:34-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.801624ms Nov 3 17:47:34 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:34-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.801624ms Nov 3 17:47:34 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:47:34 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:47:34 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:47:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730677654}"] Nov 3 17:47:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730677654, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:47:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.245515ms Nov 3 17:47:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.245515ms Nov 3 17:47:35 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:47:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:47:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:47:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730677654}"] Nov 3 17:47:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730677654, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:47:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.186154ms Nov 3 17:47:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.186154ms Nov 3 17:47:35 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:47:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:47:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:47:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730677654}"] Nov 3 17:47:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730677654, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:47:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.7938ms Nov 3 17:47:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.7938ms Nov 3 17:47:35 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:47:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:47:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:47:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730677654}"] Nov 3 17:47:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730677654, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:47:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.551478ms Nov 3 17:47:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.551478ms Nov 3 17:47:35 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:47:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:47:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:47:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730677654}"] Nov 3 17:47:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730677654, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:47:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.052173ms Nov 3 17:47:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.052173ms Nov 3 17:47:35 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:47:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:47:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:47:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730677654}"] Nov 3 17:47:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730677654, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:47:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.935465ms Nov 3 17:47:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.935465ms Nov 3 17:47:35 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:47:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:47:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:47:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730677654}"] Nov 3 17:47:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730677654, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:47:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.181986ms Nov 3 17:47:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.181986ms Nov 3 17:47:35 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:47:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:47:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:47:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730677654}"] Nov 3 17:47:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730677654, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:47:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.090876ms Nov 3 17:47:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.090876ms Nov 3 17:47:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:47:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:47:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:47:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730677654}"] Nov 3 17:47:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730677654, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 17:47:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 17:47:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T17:47:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 17:47:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T17:47:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 17:47:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T17:47:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.84266ms Nov 3 17:47:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T17:47:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.84266ms Nov 3 17:47:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:17:47:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 17:47:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:47:40 kjcf05n00 mcfcli[3673891]: %3|1730677660.366|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:47:50 kjcf05n00 mcfcli[3673891]: %3|1730677670.781|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:48:20 kjcf05n00 mcfcli[3673891]: %3|1730677700.363|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:48:20 kjcf05n00 mcfcli[3673891]: %3|1730677700.781|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:48:50 kjcf05n00 mcfcli[3673891]: %3|1730677730.781|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 17:48:57 kjcf05n00 mcfcli[3673891]: %3|1730677737.890|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:49:09 kjcf05n00 zabbix-server[1453617]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 17:49:09 kjcf05n00 zabbix-server[1453617]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46476' Nov 3 17:49:09 kjcf05n00 zabbix-server[1453617]: Filesystem 'kjcf05' has been mounted Nov 3 17:49:10 kjcf05n00 zabbix-server[1453617]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 17:49:10 kjcf05n00 zabbix-server[1453617]: Running puppet on 'None' Nov 3 17:49:11 kjcf05n03 puppet-agent[220601]: Using configured environment 'production' Nov 3 17:49:11 kjcf05n03 puppet-agent[220601]: Retrieving pluginfacts Nov 3 17:49:11 kjcf05n03 puppet-agent[220601]: Retrieving plugin Nov 3 17:49:11 kjcf05n02 puppet-agent[52646]: Using configured environment 'production' Nov 3 17:49:11 kjcf05n02 puppet-agent[52646]: Retrieving pluginfacts Nov 3 17:49:11 kjcf05n02 puppet-agent[52646]: Retrieving plugin Nov 3 17:49:12 kjcf05n05 puppet-agent[3839480]: Using configured environment 'production' Nov 3 17:49:12 kjcf05n05 puppet-agent[3839480]: Retrieving pluginfacts Nov 3 17:49:12 kjcf05n05 puppet-agent[3839480]: Retrieving plugin Nov 3 17:49:12 kjcf05n05 puppet-agent[3839480]: Loading facts Nov 3 17:49:12 kjcf05n04 puppet-agent[3673326]: Using configured environment 'production' Nov 3 17:49:12 kjcf05n04 puppet-agent[3673326]: Retrieving pluginfacts Nov 3 17:49:12 kjcf05n04 puppet-agent[3673326]: Retrieving plugin Nov 3 17:49:12 kjcf05n04 puppet-agent[3673326]: Loading facts Nov 3 17:49:12 kjcf05n06 puppet-agent[3677315]: Using configured environment 'production' Nov 3 17:49:12 kjcf05n06 puppet-agent[3677315]: Retrieving pluginfacts Nov 3 17:49:12 kjcf05n06 puppet-agent[3677315]: Retrieving plugin Nov 3 17:49:12 kjcf05n07 puppet-agent[3674384]: Using configured environment 'production' Nov 3 17:49:12 kjcf05n07 puppet-agent[3674384]: Retrieving pluginfacts Nov 3 17:49:12 kjcf05n07 puppet-agent[3674384]: Retrieving plugin Nov 3 17:49:12 kjcf05n07 puppet-agent[3674384]: Loading facts Nov 3 17:49:12 kjcf05n02 puppet-agent[52646]: Loading facts Nov 3 17:49:12 kjcf05n03 puppet-agent[220601]: Loading facts Nov 3 17:49:12 kjcf05n01 puppet-agent[3220381]: Using configured environment 'production' Nov 3 17:49:12 kjcf05n01 puppet-agent[3220381]: Retrieving pluginfacts Nov 3 17:49:12 kjcf05n01 puppet-agent[3220381]: Retrieving plugin Nov 3 17:49:12 kjcf05n01 puppet-agent[3220381]: Loading facts Nov 3 17:49:12 kjcf05n06 puppet-agent[3677315]: Loading facts Nov 3 17:49:12 kjcf05n00 puppet-agent[1453716]: Using configured environment 'production' Nov 3 17:49:12 kjcf05n00 puppet-agent[1453716]: Retrieving pluginfacts Nov 3 17:49:12 kjcf05n00 puppet-agent[1453716]: Retrieving plugin Nov 3 17:49:12 kjcf05n00 puppet-agent[1453716]: Loading facts Nov 3 17:49:14 kjcf05n03 puppet-agent[220601]: Caching catalog for kjcf05n03 Nov 3 17:49:14 kjcf05n03 puppet-agent[220601]: Applying configuration version '1730677753' Nov 3 17:49:15 kjcf05n02 puppet-agent[52646]: Caching catalog for kjcf05n02 Nov 3 17:49:15 kjcf05n02 puppet-agent[52646]: Applying configuration version '1730677753' Nov 3 17:49:14 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 17:49:14 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 17:49:15 kjcf05n07 puppet-agent[3674384]: Caching catalog for kjcf05n07 Nov 3 17:49:15 kjcf05n06 puppet-agent[3677315]: Caching catalog for kjcf05n06 Nov 3 17:49:15 kjcf05n06 puppet-agent[3677315]: Applying configuration version '1730677753' Nov 3 17:49:15 kjcf05n07 puppet-agent[3674384]: Applying configuration version '1730677753' Nov 3 17:49:16 kjcf05n01 puppet-agent[3220381]: Caching catalog for kjcf05n01 Nov 3 17:49:16 kjcf05n00 puppet-agent[1453716]: Caching catalog for kjcf05n00 Nov 3 17:49:16 kjcf05n00 puppet-agent[1453716]: Applying configuration version '1730677754' Nov 3 17:49:16 kjcf05n01 puppet-agent[3220381]: Applying configuration version '1730677754' Nov 3 17:49:16 kjcf05n02 puppet-agent[52646]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 17:49:16 kjcf05n02 puppet-agent[52646]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 17:49:16 kjcf05n02 puppet-agent[52646]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 17:49:16 kjcf05n03 puppet-agent[220601]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 17:49:16 kjcf05n03 puppet-agent[220601]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 17:49:16 kjcf05n03 puppet-agent[220601]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 17:49:17 kjcf05n06 puppet-agent[3677315]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 17:49:17 kjcf05n06 puppet-agent[3677315]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 17:49:17 kjcf05n06 puppet-agent[3677315]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 17:49:17 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 17:49:17 kjcf05n02 zabbix_agent2[5947]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 17:49:17 kjcf05n02 zabbix_agent2[3127]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 17:49:17 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 17:49:17 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 17:49:17 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 17:49:17 kjcf05n02 puppet-agent[52646]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: Press Ctrl+C to exit. Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: Plugin support version 1.0 Nov 3 17:49:17 kjcf05n02 zabbix_agent2[53006]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 17:49:17 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 17:49:17 kjcf05n03 zabbix_agent2[165141]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 17:49:17 kjcf05n03 zabbix_agent2[3145]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 17:49:17 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 17:49:17 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 17:49:17 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 17:49:17 kjcf05n03 puppet-agent[220601]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: Press Ctrl+C to exit. Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: Plugin support version 1.0 Nov 3 17:49:17 kjcf05n03 zabbix_agent2[221154]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 17:49:17 kjcf05n07 puppet-agent[3674384]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 17:49:17 kjcf05n07 puppet-agent[3674384]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 17:49:17 kjcf05n07 puppet-agent[3674384]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 17:49:18 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3625278]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 17:49:18 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 17:49:18 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 17:49:18 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 17:49:18 kjcf05n06 puppet-agent[3677315]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: Press Ctrl+C to exit. Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: Plugin support version 1.0 Nov 3 17:49:18 kjcf05n06 zabbix_agent2[3677913]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 17:49:18 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3622872]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 17:49:18 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 17:49:18 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 17:49:18 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 17:49:18 kjcf05n07 puppet-agent[3674384]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: Press Ctrl+C to exit. Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: Plugin support version 1.0 Nov 3 17:49:18 kjcf05n07 zabbix_agent2[3675510]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 17:49:19 kjcf05n01 puppet-agent[3220381]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 17:49:19 kjcf05n01 puppet-agent[3220381]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-17:27:45]/mode) mode changed '0755' to '0750' Nov 3 17:49:19 kjcf05n00 puppet-agent[1453716]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 17:49:19 kjcf05n02 puppet-agent[52646]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 17:49:19 kjcf05n02 puppet-agent[52646]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 17:49:19 kjcf05n02 puppet-agent[52646]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 17:49:19 kjcf05n05 puppet-agent[3839480]: Caching catalog for kjcf05n05 Nov 3 17:49:19 kjcf05n05 puppet-agent[3839480]: Applying configuration version '1730677758' Nov 3 17:49:19 kjcf05n03 puppet-agent[220601]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 17:49:19 kjcf05n03 puppet-agent[220601]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 17:49:19 kjcf05n03 puppet-agent[220601]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 17:49:19 kjcf05n06 puppet-agent[3677315]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 17:49:19 kjcf05n06 puppet-agent[3677315]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 17:49:19 kjcf05n06 puppet-agent[3677315]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 17:49:19 kjcf05n01 puppet-agent[3220381]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-17:27:45/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 17:49:19 kjcf05n01 puppet-agent[3220381]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-17:27:45/vmcore]/mode) mode changed '0600' to '0640' Nov 3 17:49:19 kjcf05n01 puppet-agent[3220381]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-03-17:27:45/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 17:49:19 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 17:49:19 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 17:49:19 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 17:49:20 kjcf05n02 puppet-agent[52646]: Applied catalog in 5.06 seconds Nov 3 17:49:20 kjcf05n07 puppet-agent[3674384]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 17:49:20 kjcf05n07 puppet-agent[3674384]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 17:49:20 kjcf05n07 puppet-agent[3674384]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 17:49:20 kjcf05n03 puppet-agent[220601]: Applied catalog in 5.14 seconds Nov 3 17:49:20 kjcf05n06 puppet-agent[3677315]: Applied catalog in 4.74 seconds Nov 3 17:49:20 kjcf05n01 puppet-agent[3220381]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 17:49:20 kjcf05n01 puppet-agent[3220381]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 17:49:20 kjcf05n01 puppet-agent[3220381]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 17:49:20 kjcf05n00 puppet-agent[1453716]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 17:49:20 kjcf05n00 puppet-agent[1453716]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 17:49:20 kjcf05n00 puppet-agent[1453716]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 17:49:20 kjcf05n07 puppet-agent[3674384]: Applied catalog in 4.86 seconds Nov 3 17:49:21 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3208785]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 17:49:21 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 17:49:21 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 17:49:21 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 17:49:21 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 17:49:21 kjcf05n01 puppet-agent[3220381]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: Press Ctrl+C to exit. Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: Plugin support version 1.0 Nov 3 17:49:21 kjcf05n01 zabbix_agent2[3220731]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 17:49:20 kjcf05n00 mcfcli[3673891]: %3|1730677760.781|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 17:49:20 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1435876]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 17:49:21 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 17:49:20 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 17:49:20 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 17:49:20 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 17:49:20 kjcf05n00 puppet-agent[1453716]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: Press Ctrl+C to exit. Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: Plugin support version 1.0 Nov 3 17:49:20 kjcf05n00 zabbix_agent2[1454246]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 17:49:21 kjcf05n00 zabbix-server[1454270]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 17:49:21 kjcf05n05 puppet-agent[3839480]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 17:49:21 kjcf05n05 puppet-agent[3839480]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 17:49:21 kjcf05n05 puppet-agent[3839480]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 17:49:21 kjcf05n00 zabbix-server[1454274]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 17:49:22 kjcf05n00 zabbix-server[1454279]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 17:49:22 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3793824]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 17:49:22 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 17:49:22 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 17:49:22 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 17:49:22 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 17:49:22 kjcf05n05 puppet-agent[3839480]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: Press Ctrl+C to exit. Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: Plugin support version 1.0 Nov 3 17:49:22 kjcf05n05 zabbix_agent2[3840261]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 17:49:22 kjcf05n00 zabbix-server[1454281]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 17:49:23 kjcf05n01 puppet-agent[3220381]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_173507.log]/mode) mode changed '0644' to '0640' Nov 3 17:49:23 kjcf05n01 puppet-agent[3220381]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_174651.log]/mode) mode changed '0644' to '0640' Nov 3 17:49:23 kjcf05n01 puppet-agent[3220381]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_174651]/mode) mode changed '0755' to '0750' Nov 3 17:49:23 kjcf05n01 puppet-agent[3220381]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241103_174651/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 17:49:22 kjcf05n00 puppet-agent[1453716]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 17:49:23 kjcf05n01 puppet-agent[3220381]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_173506.log]/mode) mode changed '0644' to '0640' Nov 3 17:49:23 kjcf05n01 puppet-agent[3220381]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_174651.log]/mode) mode changed '0644' to '0640' Nov 3 17:49:23 kjcf05n01 puppet-agent[3220381]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 17:49:24 kjcf05n01 puppet-agent[3220381]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 17:49:24 kjcf05n01 puppet-agent[3220381]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 17:49:23 kjcf05n00 puppet-agent[1453716]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 17:49:23 kjcf05n00 puppet-agent[1453716]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 17:49:23 kjcf05n00 puppet-agent[1453716]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 17:49:24 kjcf05n05 puppet-agent[3839480]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 17:49:24 kjcf05n05 puppet-agent[3839480]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 17:49:24 kjcf05n05 puppet-agent[3839480]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 17:49:24 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 17:49:24 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 17:49:24 kjcf05n00 puppet-agent[1453716]: Applied catalog in 8.36 seconds Nov 3 17:49:24 kjcf05n05 puppet-agent[3839480]: Applied catalog in 4.84 seconds Nov 3 17:49:25 kjcf05n01 puppet-agent[3220381]: Applied catalog in 8.90 seconds Nov 3 17:49:35 kjcf05n00 mcfcli[3673891]: %3|1730677775.083|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:49:47 kjcf05n04 puppet-agent[3673326]: Caching catalog for kjcf05n04 Nov 3 17:49:47 kjcf05n04 puppet-agent[3673326]: Applying configuration version '1730677786' Nov 3 17:49:50 kjcf05n04 puppet-agent[3673326]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 17:49:50 kjcf05n04 puppet-agent[3673326]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 17:49:50 kjcf05n04 puppet-agent[3673326]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 17:49:50 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3627381]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 17:49:50 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 17:49:50 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 17:49:50 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 17:49:50 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 17:49:50 kjcf05n04 puppet-agent[3673326]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: Starting Zabbix Agent 2 (6.2.1) Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: Press Ctrl+C to exit. Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: Plugin support version 1.0 Nov 3 17:49:50 kjcf05n04 zabbix_agent2[3674868]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 17:49:50 kjcf05n00 mcfcli[3673891]: %3|1730677790.781|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:49:52 kjcf05n04 puppet-agent[3673326]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 17:49:52 kjcf05n04 puppet-agent[3673326]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 17:49:52 kjcf05n04 puppet-agent[3673326]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 17:49:52 kjcf05n04 puppet-agent[3673326]: Applied catalog in 4.86 seconds Nov 3 17:49:52 kjcf05n00 zabbix-server[1453617]: puppet completed status:(0): '' Nov 3 17:49:52 kjcf05n00 zabbix-server[1453617]: Event '46476' acknowledged Nov 3 17:49:52 kjcf05n00 zabbix-server[1453617]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 3 17:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 17:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 17:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 17:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 17:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 17:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 17:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 17:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 17:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 17:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 17:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 17:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 17:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 17:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 17:50:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 17:50:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 17:50:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 17:50:10 kjcf05n00 mcfcli[3673891]: %3|1730677810.105|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:50:15 kjcf05n00 python3.9[1454723]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 17:50:20 kjcf05n00 mcfcli[3673891]: %3|1730677820.781|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 17:50:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730677828', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 17:50:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730677828'} Nov 3 17:50:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:50:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730677828', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 17:50:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730677828'} Nov 3 17:50:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 17:50:50 kjcf05n00 mcfcli[3673891]: %3|1730677850.102|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:50:50 kjcf05n00 mcfcli[3673891]: %3|1730677850.783|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 17:51:10 kjcf05n02 dwd[5139]: nvme18n1 passed periodic SMART status check Nov 3 17:51:10 kjcf05n02 dwd[5139]: nvme2n1 passed periodic SMART status check Nov 3 17:51:11 kjcf05n02 dwd[5139]: nvme9n1 passed periodic SMART status check Nov 3 17:51:11 kjcf05n02 dwd[5139]: nvme3n1 passed periodic SMART status check Nov 3 17:51:11 kjcf05n02 dwd[5139]: nvme24n1 passed periodic SMART status check Nov 3 17:51:11 kjcf05n02 dwd[5139]: nvme19n1 passed periodic SMART status check Nov 3 17:51:12 kjcf05n02 dwd[5139]: nvme25n1 passed periodic SMART status check Nov 3 17:51:12 kjcf05n02 dwd[5139]: nvme17n1 passed periodic SMART status check Nov 3 17:51:12 kjcf05n02 dwd[5139]: nvme23n1 passed periodic SMART status check Nov 3 17:51:12 kjcf05n02 dwd[5139]: nvme8n1 passed periodic SMART status check Nov 3 17:51:12 kjcf05n02 dwd[5139]: nvme4n1 passed periodic SMART status check Nov 3 17:51:20 kjcf05n00 mcfcli[3673891]: %3|1730677880.783|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:51:29 kjcf05n00 mcfcli[3673891]: %3|1730677889.698|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:51:50 kjcf05n00 mcfcli[3673891]: %3|1730677910.783|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:52:08 kjcf05n00 mcfcli[3673891]: %3|1730677928.950|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:52:20 kjcf05n00 mcfcli[3673891]: %3|1730677940.783|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:52:22 kjcf05n00 zabbix-server[1456188]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 17:52:22 kjcf05n00 zabbix-server[1456188]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 60.77\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 61.76\\"}}"' Nov 3 17:52:22 kjcf05n00 log_interesting_event.py[1456188]: Event '46477' acknowledged Nov 3 17:52:45 kjcf05n00 mcfcli[3673891]: %3|1730677965.729|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:52:50 kjcf05n00 mcfcli[3673891]: %3|1730677970.783|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T23:53:15.868103Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 17:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-03T23:53:15.868181Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.100ms Nov 3 17:53:20 kjcf05n00 mcfcli[3673891]: %3|1730678000.783|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:53:25 kjcf05n00 mcfcli[3673891]: %3|1730678005.442|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T17:53:27.255173528-06:00 level=info msg="Completed cleanup jobs" duration=28.712223ms Nov 3 17:53:50 kjcf05n00 mcfcli[3673891]: %3|1730678030.783|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 17:54:05 kjcf05n00 mcfcli[3673891]: %3|1730678045.215|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:54:20 kjcf05n00 mcfcli[3673891]: %3|1730678060.784|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:54:42 kjcf05n00 mcfcli[3673891]: %3|1730678082.641|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:54:50 kjcf05n00 mcfcli[3673891]: %3|1730678090.785|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 17:55:14 kjcf05n00 python3.9[1457599]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 17:55:20 kjcf05n00 mcfcli[3673891]: %3|1730678120.219|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:55:20 kjcf05n00 mcfcli[3673891]: %3|1730678120.785|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:55:29 kjcf05n03 nslcd[6919]: [0e0f76] ldap_result() failed: Can't contact LDAP server Nov 3 17:55:29 kjcf05n03 nslcd[6919]: [52255a] ldap_result() failed: Can't contact LDAP server Nov 3 17:55:50 kjcf05n00 mcfcli[3673891]: %3|1730678150.785|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 17:55:57 kjcf05n00 mcfcli[3673891]: %3|1730678157.122|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:56:20 kjcf05n00 mcfcli[3673891]: %3|1730678180.785|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 17:56:34 kjcf05n00 mcfcli[3673891]: %3|1730678194.787|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:56:50 kjcf05n00 mcfcli[3673891]: %3|1730678210.785|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 17:57:13 kjcf05n00 mcfcli[3673891]: %3|1730678233.356|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:57:20 kjcf05n00 mcfcli[3673891]: %3|1730678240.785|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 17:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 17:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 17:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 17:57:49 kjcf05n00 mcfcli[3673891]: %3|1730678269.838|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:57:50 kjcf05n00 mcfcli[3673891]: %3|1730678270.786|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 17:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 17:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 17:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 17:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 17:57:56 kjcf05n00 zabbix_server[15734]: Zabbix agent item "net.if.out["ib0"]" on host "kjcf05n03" failed: first network error, wait for 15 seconds Nov 3 17:58:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 17:58:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 17:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 17:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 17:58:01 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='15', error='Connection reset by peer (104)' Nov 3 17:58:01 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='15', client='AF_INET(172.16.2.6:44009)', local='AF_INET(0.0.0.0:601)' Nov 3 17:58:02 kjcf05n02 fstonithd.py[15068]: My partner 172.16.2.6 is kdumping. Forcing HA into GATHER state. Nov 3 17:58:03 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 17:58:03 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 17:58:03 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 17:58:03 kjcf05n02 root[68062]: is_viking_off starts Nov 3 17:58:03 kjcf05n02 root[68061]: is_enc_ipmi_off starts Nov 3 17:58:03 kjcf05n02 root[68082]: is_lan_ipmi_off leaves Nov 3 17:58:04 kjcf05n02 root[68084]: is_lan_ipmi_sec_off leaves Nov 3 17:58:04 kjcf05n02 root[68090]: I am in slot 0; partner is in slot 1 Nov 3 17:58:04 kjcf05n02 root[68094]: I am not master; I will get master Nov 3 17:58:05 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib0 Nov 3 17:58:05 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib0 Nov 3 17:58:09 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib1 Nov 3 17:58:09 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib1 Nov 3 17:58:10 kjcf05n02 root[68369]: I am now master Nov 3 17:58:11 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vfs.fs.size[/var/lib/mdraidscripts,used]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 17:58:12 kjcf05n00 zabbix_server[15766]: Zabbix agent item "vfs.fs.inode[/var/lib/reboot_cnt,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 17:58:13 kjcf05n00 zabbix_server[15758]: Zabbix agent item "vfs.fs.inode[/etc/ganesha,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 17:58:14 kjcf05n00 zabbix_server[15764]: Zabbix agent item "vfs.fs.size[/mnt/persistent_ha_data,pused]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 17:58:15 kjcf05n00 zabbix_server[15743]: Zabbix agent item "vfs.fs.size[/var/lib/pacemaker,pused]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 17:58:16 kjcf05n00 zabbix_server[15729]: Zabbix agent item "vfs.fs.size[/var/lib/mdraidscripts,pused]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 17:58:17 kjcf05n02 root[68775]: is_viking_off leaves Nov 3 17:58:17 kjcf05n02 root[68778]: kjcf05n03 not already off look at kdump Nov 3 17:58:17 kjcf05n02 root[68779]: is_kdump_off starts Nov 3 17:58:17 kjcf05n02 fence_kdump[68780]: waiting for message from '172.16.2.6' Nov 3 17:58:18 kjcf05n02 fence_kdump[68780]: received valid message from '172.16.2.6' Nov 3 17:58:18 kjcf05n02 root[68831]: is_kdump_off detected kdump on kjcf05n03 Nov 3 17:58:18 kjcf05n02 root[68834]: kjcf05n03 is kdumping Nov 3 17:58:19 kjcf05n02 root[68927]: is_enc_ipmi_off starts Nov 3 17:58:19 kjcf05n02 root[68928]: is_viking_off starts Nov 3 17:58:19 kjcf05n02 root[68944]: is_lan_ipmi_off leaves Nov 3 17:58:19 kjcf05n02 root[68946]: is_lan_ipmi_sec_off leaves Nov 3 17:58:19 kjcf05n02 root[68968]: I am in slot 0; partner is in slot 1 Nov 3 17:58:19 kjcf05n02 root[68971]: I am master Nov 3 17:58:20 kjcf05n02 diskmonitor[17328]: run_on_master: ntry=1/10, neither node is master, retrying Nov 3 17:58:20 kjcf05n02 diskmonitor[17328]: run_on_master: ntry=2/10, neither node is master, retrying Nov 3 17:58:20 kjcf05n00 mcfcli[3673891]: %3|1730678300.787|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:58:22 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 17:58:22 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 17:58:23 kjcf05n00 zabbix-server[1459688]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 17:58:23 kjcf05n00 zabbix-server[1459688]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 86.1\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 79.68\\"}}"' Nov 3 17:58:23 kjcf05n00 log_interesting_event.py[1459688]: Event '46480' acknowledged Nov 3 17:58:27 kjcf05n02 root[69146]: is_viking_off leaves Nov 3 17:58:27 kjcf05n02 root[69152]: kjcf05n03 not already off look at kdump Nov 3 17:58:27 kjcf05n02 root[69153]: is_kdump_off starts Nov 3 17:58:27 kjcf05n02 fence_kdump[69154]: waiting for message from '172.16.2.6' Nov 3 17:58:27 kjcf05n02 fence_kdump[69154]: received valid message from '172.16.2.6' Nov 3 17:58:27 kjcf05n00 mcfcli[3673891]: %3|1730678307.083|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:58:27 kjcf05n02 root[69155]: is_kdump_off detected kdump on kjcf05n03 Nov 3 17:58:27 kjcf05n02 root[69156]: kjcf05n03 is kdumping Nov 3 17:58:31 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.array.discovery" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 17:58:31 kjcf05n02 systemd-udevd[71473]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71474]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71476]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71479]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71473]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71474]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71476]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71479]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71473]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71474]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71476]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71473]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71479]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71476]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71474]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71473]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71479]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71476]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71474]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71473]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71479]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71476]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71479]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71474]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71473]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71476]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71474]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71473]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71479]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71476]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71474]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71473]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71479]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71511]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71476]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71512]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71473]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71511]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71512]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71473]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71476]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71511]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71512]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71474]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71511]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71474]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71511]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71512]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71511]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71512]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71511]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71512]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71511]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71512]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71512]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71511]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71512]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71511]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71512]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71511]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71512]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71511]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71511]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:58:31 kjcf05n02 systemd-udevd[71511]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 17:58:32 kjcf05n02 dwd[5139]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 17:58:32 kjcf05n02 dwd[5139]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 17:58:32 kjcf05n02 dwd[5139]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 17:58:32 kjcf05n02 dwd[5139]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 17:58:32 kjcf05n02 dwd[5139]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 17:58:32 kjcf05n02 dwd[5139]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 17:58:32 kjcf05n02 dwd[5139]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 17:58:32 kjcf05n02 dwd[5139]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 17:58:32 kjcf05n02 dwd[5139]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 17:58:32 kjcf05n02 dwd[5139]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 17:58:32 kjcf05n02 dwd[5139]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 17:58:32 kjcf05n02 dwd[5139]: Starting NVME thread for nvme16n1 Nov 3 17:58:32 kjcf05n02 dwd[5139]: Starting NVME thread for nvme22n1 Nov 3 17:58:32 kjcf05n02 dwd[5139]: Starting NVME thread for nvme15n1 Nov 3 17:58:32 kjcf05n02 dwd[5139]: Starting NVME thread for nvme6n1 Nov 3 17:58:33 kjcf05n02 dwd[5139]: Starting NVME thread for nvme11n1 Nov 3 17:58:33 kjcf05n02 dwd[5139]: Starting NVME thread for nvme7n1 Nov 3 17:58:33 kjcf05n02 dwd[5139]: Starting NVME thread for nvme10n1 Nov 3 17:58:33 kjcf05n02 dwd[5139]: Starting NVME thread for nvme20n1 Nov 3 17:58:33 kjcf05n02 dwd[5139]: Starting NVME thread for nvme21n1 Nov 3 17:58:33 kjcf05n02 dwd[5139]: Starting NVME thread for nvme5n1 Nov 3 17:58:33 kjcf05n02 dwd[5139]: Starting NVME thread for nvme12n1 Nov 3 17:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 17:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 17:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 17:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 17:58:41 kjcf05n02 diskmonitor[17328]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 17:58:46 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n03": interface unavailable Nov 3 17:58:50 kjcf05n00 mcfcli[3673891]: %3|1730678330.787|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 17:58:53 kjcf05n02 diskmonitor[17328]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 17:58:53 kjcf05n02 diskmonitor[17328]: Scan for ReadErrorMax change for md66 Nov 3 17:58:53 kjcf05n02 diskmonitor[17328]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 17:58:53 kjcf05n02 diskmonitor[17328]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 17:58:53 kjcf05n02 diskmonitor[17328]: read_saved_file: md66 no saved speed Nov 3 17:58:53 kjcf05n02 diskmonitor[17328]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 17:58:53 kjcf05n02 diskmonitor[17328]: Set sync_speed_min (10000) for md66 Nov 3 17:58:53 kjcf05n02 diskmonitor[17328]: Set sync_speed_max (200000) for md66 Nov 3 17:58:53 kjcf05n02 diskmonitor[17328]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 17:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 17:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 17:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 17:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 17:59:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 17:59:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 17:59:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 17:59:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 17:59:03 kjcf05n00 mcfcli[3673891]: %3|1730678343.340|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:59:05 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib0 Nov 3 17:59:05 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib0 Nov 3 17:59:09 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib1 Nov 3 17:59:09 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib1 Nov 3 17:59:20 kjcf05n00 mcfcli[3673891]: %3|1730678360.787|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:59:33 kjcf05n02 nslcd[6896]: ldap_result() failed: Can't contact LDAP server Nov 3 17:59:33 kjcf05n02 nslcd[6896]: (re)loading /etc/nsswitch.conf Nov 3 17:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 17:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 17:59:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 17:59:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 17:59:43 kjcf05n00 mcfcli[3673891]: %3|1730678383.337|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 17:59:50 kjcf05n00 mcfcli[3673891]: %3|1730678390.788|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 17:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 17:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 17:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 17:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 18:00:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 18:00:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 18:00:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 18:00:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 18:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 18:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 18:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 18:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 18:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 18:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 18:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 18:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 18:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 18:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 18:00:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 18:00:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:00:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 18:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 18:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 18:00:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730678405}"] Nov 3 18:00:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730678405, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:00:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.338901ms Nov 3 18:00:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.338901ms Nov 3 18:00:05 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:00:05 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:00:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:00:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730678405}"] Nov 3 18:00:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730678405, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:00:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.629442ms Nov 3 18:00:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.629442ms Nov 3 18:00:05 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:00:05 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:00:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:00:05 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib0 Nov 3 18:00:05 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib0 Nov 3 18:00:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730678405}"] Nov 3 18:00:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730678405, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:00:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.343329ms Nov 3 18:00:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.343329ms Nov 3 18:00:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:00:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:00:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:00:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730678406}"] Nov 3 18:00:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730678406, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:00:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.153863ms Nov 3 18:00:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.153863ms Nov 3 18:00:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:00:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:00:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:00:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730678406}"] Nov 3 18:00:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730678406, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:00:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.042636ms Nov 3 18:00:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.042636ms Nov 3 18:00:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:00:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:00:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:00:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730678406}"] Nov 3 18:00:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730678406, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:00:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.419151ms Nov 3 18:00:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.419151ms Nov 3 18:00:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:00:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:00:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:00:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730678406}"] Nov 3 18:00:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730678406, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:00:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.158212ms Nov 3 18:00:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.158212ms Nov 3 18:00:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:00:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:00:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:00:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730678406}"] Nov 3 18:00:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730678406, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:00:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.100834ms Nov 3 18:00:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.100834ms Nov 3 18:00:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:00:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:00:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:00:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730678406}"] Nov 3 18:00:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730678406, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:00:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.870744ms Nov 3 18:00:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.870744ms Nov 3 18:00:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:00:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:00:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:00:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730678406}"] Nov 3 18:00:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730678406, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:00:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.151219ms Nov 3 18:00:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.151219ms Nov 3 18:00:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:00:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:00:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:00:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730678406}"] Nov 3 18:00:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730678406, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:00:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:07-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:00:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:07 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:00:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:07-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:00:07 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:00:07-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:00:07 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:00:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.807184ms Nov 3 18:00:07 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:00:07-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.807184ms Nov 3 18:00:07 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:00:07 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:00:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:00:09 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib1 Nov 3 18:00:09 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib1 Nov 3 18:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:00:10.413075Z lvl=info msg="index opened with 8 partitions" log_id=0s8llxRG000 service=storage-engine index=tsi Nov 3 18:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:00:10.413258Z lvl=info msg="loading changes (start)" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name="field indices" op_event=start Nov 3 18:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:00:10.413308Z lvl=info msg="loading changes (end)" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name="field indices" op_event=end op_elapsed=0.051ms Nov 3 18:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:00:10.413641Z lvl=info msg="Reindexing TSM data" log_id=0s8llxRG000 service=storage-engine engine=tsm1 db_shard_id=675 Nov 3 18:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:00:10.413649Z lvl=info msg="Reindexing WAL data" log_id=0s8llxRG000 service=storage-engine engine=tsm1 db_shard_id=675 Nov 3 18:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:00:10.414821Z lvl=info msg="saving field index changes (start)" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name=MeasurementFieldSet op_event=start Nov 3 18:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:00:10.415066Z lvl=info msg="saving field index changes (end)" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name=MeasurementFieldSet op_event=end op_elapsed=0.270ms Nov 3 18:00:20 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:00:20.408546Z lvl=info msg="saving field index changes (start)" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name=MeasurementFieldSet op_event=start Nov 3 18:00:20 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:00:20.408734Z lvl=info msg="saving field index changes (end)" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name=MeasurementFieldSet op_event=end op_elapsed=0.221ms Nov 3 18:00:20 kjcf05n00 mcfcli[3673891]: %3|1730678420.788|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:00:21 kjcf05n00 mcfcli[3673891]: %3|1730678421.497|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:00:24 kjcf05n00 python3.9[1460890]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 18:00:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730678437', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 18:00:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730678437'} Nov 3 18:00:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:00:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730678437', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 18:00:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730678437'} Nov 3 18:00:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 18:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 18:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 18:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 18:00:40 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:00:40.409322Z lvl=info msg="saving field index changes (start)" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name=MeasurementFieldSet op_event=start Nov 3 18:00:40 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:00:40.409481Z lvl=info msg="saving field index changes (end)" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name=MeasurementFieldSet op_event=end op_elapsed=0.170ms Nov 3 18:00:50 kjcf05n00 mcfcli[3673891]: %3|1730678450.789|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 18:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 18:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 18:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 18:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 18:01:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 18:01:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 18:01:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 18:01:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 18:01:00 kjcf05n00 mcfcli[3673891]: %3|1730678460.317|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:01:05 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib0 Nov 3 18:01:05 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib0 Nov 3 18:01:09 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib1 Nov 3 18:01:09 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib1 Nov 3 18:01:20 kjcf05n00 mcfcli[3673891]: %3|1730678480.790|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:01:32 kjcf05n00 zabbix-server[1461844]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:01:32 kjcf05n00 zabbix-server[1461844]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n03:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 18:01:32 kjcf05n00 log_interesting_event.py[1461844]: Event '46482' acknowledged Nov 3 18:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 18:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 18:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 18:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 18:01:39 kjcf05n00 mcfcli[3673891]: %3|1730678499.551|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:01:50 kjcf05n00 mcfcli[3673891]: %3|1730678510.790|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:01:51 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:9a:1a Nov 3 18:01:51 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 18:01:55 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 18:01:55 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a kjcf05n03 Nov 3 18:01:55 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.6 Nov 3 18:01:55 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 18:01:55 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 18:01:55 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.6 Nov 3 18:01:55 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/pxelinux.cfg to 172.16.2.6 Nov 3 18:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 18:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 18:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 18:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 18:01:57 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/vmlinuz_diskless to 172.16.2.6 Nov 3 18:02:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 18:02:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 18:02:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 18:02:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 18:02:00 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/initramfs-diskless.img to 172.16.2.6 Nov 3 18:02:05 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib0 Nov 3 18:02:05 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib0 Nov 3 18:02:09 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib1 Nov 3 18:02:09 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib1 Nov 3 18:02:19 kjcf05n00 mcfcli[3673891]: %3|1730678539.548|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:02:20 kjcf05n00 mcfcli[3673891]: %3|1730678540.790|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 18:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 18:02:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 18:02:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 18:02:47 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:56416). Nov 3 18:02:47 kjcf05n01 rsyncd[3226164]: connect from kjcf05n03 (172.16.2.6) Nov 3 18:02:47 kjcf05n01 rsyncd[3226164]: rsync on puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 18:02:47 kjcf05n01 rsyncd[3226164]: building file list Nov 3 18:02:47 kjcf05n01 rsyncd[3226164]: sent 11446 bytes received 136 bytes total size 10901 Nov 3 18:02:47 kjcf05n01 systemd[1]: rsyncd@649-172.16.2.2:873-172.16.2.6:56416.service: Succeeded. Nov 3 18:02:50 kjcf05n00 mcfcli[3673891]: %3|1730678570.790|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 18:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 18:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 18:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 18:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 18:02:57 kjcf05n00 mcfcli[3673891]: %3|1730678577.238|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:02:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 18:02:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 18:03:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 18:03:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 18:03:02 kjcf05n02 fstonithd.py[15068]: Listening for kdump packets from partner Nov 3 18:03:05 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib0 Nov 3 18:03:05 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib0 Nov 3 18:03:05 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 18:03:09 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib1 Nov 3 18:03:09 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib1 Nov 3 18:03:20 kjcf05n00 mcfcli[3673891]: %3|1730678600.790|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T18:03:27.254448636-06:00 level=info msg="Completed cleanup jobs" duration=28.040765ms Nov 3 18:03:37 kjcf05n00 mcfcli[3673891]: %3|1730678617.235|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:03:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 18:03:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 18:03:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 18:03:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 18:03:50 kjcf05n00 mcfcli[3673891]: %3|1730678630.792|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:03:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 18:03:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 18:03:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 18:03:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 18:03:58 kjcf05n02 dwd[5139]: nvme16n1 passed periodic SMART status check Nov 3 18:03:58 kjcf05n02 dwd[5139]: nvme11n1 passed periodic SMART status check Nov 3 18:03:58 kjcf05n02 dwd[5139]: nvme22n1 passed periodic SMART status check Nov 3 18:03:58 kjcf05n02 dwd[5139]: nvme6n1 passed periodic SMART status check Nov 3 18:03:58 kjcf05n02 dwd[5139]: nvme15n1 passed periodic SMART status check Nov 3 18:03:59 kjcf05n02 dwd[5139]: nvme7n1 passed periodic SMART status check Nov 3 18:03:59 kjcf05n02 dwd[5139]: nvme20n1 passed periodic SMART status check Nov 3 18:03:59 kjcf05n02 dwd[5139]: nvme12n1 passed periodic SMART status check Nov 3 18:03:59 kjcf05n02 dwd[5139]: nvme10n1 passed periodic SMART status check Nov 3 18:03:59 kjcf05n02 dwd[5139]: nvme5n1 passed periodic SMART status check Nov 3 18:03:59 kjcf05n02 dwd[5139]: nvme21n1 passed periodic SMART status check Nov 3 18:04:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 18:04:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 18:04:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 18:04:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 18:04:05 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib0 Nov 3 18:04:05 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib0 Nov 3 18:04:09 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib1 Nov 3 18:04:09 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib1 Nov 3 18:04:13 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='15', client='AF_INET(172.16.2.6:43145)', local='AF_INET(0.0.0.0:601)' Nov 3 18:04:13 kjcf05n03 syslog-ng[3128]: Configuration reload request received, reloading configuration; Nov 3 18:04:13 kjcf05n03 syslog-ng[3128]: Configuration reload finished; Nov 3 18:04:13 kjcf05n03 syslog-ng[3128]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 18:04:13 kjcf05n03 dracut: dracut-049-135.git20210121.el8 Nov 3 18:04:13 kjcf05n03 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 18:04:13 kjcf05n03 dracut: Loading and integrity checking all crypto modules Nov 3 18:04:13 kjcf05n03 dracut: Self testing crypto algorithms Nov 3 18:04:13 kjcf05n03 dracut: rd.md=0: removing MD RAID activation Nov 3 18:04:13 kjcf05n03 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 18:04:13 kjcf05n03 Copying live image to RAM... Nov 3 18:04:13 kjcf05n03 (this may take a minute) Nov 3 18:04:13 kjcf05n03 Done copying live image to RAM. Nov 3 18:04:13 kjcf05n03 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 18:04:13 kjcf05n03 dracut: Checking integrity of kernel Nov 3 18:04:13 kjcf05n03 dracut: All initrd crypto checks done Nov 3 18:04:13 kjcf05n03 dracut: Switching root Nov 3 18:04:13 kjcf05n03 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 18:04:13 kjcf05n03 systemd: Detected architecture x86-64. Nov 3 18:04:13 kjcf05n03 systemd: Set hostname to . Nov 3 18:04:13 kjcf05n03 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 18:04:13 kjcf05n03 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 18:04:13 kjcf05n03 systemd: Listening on udev Control Socket. Nov 3 18:04:13 kjcf05n03 systemd: Listening on Journal Socket. Nov 3 18:04:13 kjcf05n03 systemd: Listening on udev Kernel Socket. Nov 3 18:04:13 kjcf05n03 systemd: Mounting /mnt... Nov 3 18:04:13 kjcf05n03 systemd: Listening on Device-mapper event daemon FIFOs. Nov 3 18:04:13 kjcf05n03 systemd-journald[1550]: Journal started Nov 3 18:04:13 kjcf05n03 systemd-journald[1550]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 18:04:13 kjcf05n03 systemd-modules-load[1537]: Inserted module 'fuse' Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Load Kernel Modules. Nov 3 18:04:13 kjcf05n03 systemd[1]: Mounted /WIBS. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Create list of required static device nodes for the current kernel. Nov 3 18:04:13 kjcf05n03 systemd[1]: Mounted Kernel Debug File System. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Remount Root and Kernel File Systems. Nov 3 18:04:13 kjcf05n03 systemd[1]: Mounted POSIX Message Queue File System. Nov 3 18:04:13 kjcf05n03 systemd[1]: Mounted Temporary Directory (/tmp). Nov 3 18:04:13 kjcf05n03 systemd[1]: Mounted /data. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Load/Save Random Seed... Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Create System Users... Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Rebuild Hardware Database... Nov 3 18:04:13 kjcf05n03 systemd[1]: Mounting FUSE Control File System... Nov 3 18:04:13 kjcf05n03 systemd[1]: Mounting Kernel Configuration File System... Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Apply Kernel Variables... Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Load/Save Random Seed. Nov 3 18:04:13 kjcf05n03 systemd[1]: Mounted FUSE Control File System. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Create System Users. Nov 3 18:04:13 kjcf05n03 systemd[1]: Mounted Kernel Configuration File System. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 18:04:13 kjcf05n03 systemd-sysctl[1574]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 18:04:13 kjcf05n03 systemd-sysctl[1574]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Apply Kernel Variables. Nov 3 18:04:13 kjcf05n03 systemd-journald[1550]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 18:04:13 kjcf05n03 systemd-tmpfiles[1579]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 18:04:13 kjcf05n03 systemd-tmpfiles[1579]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started udev Coldplug all Devices. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Rebuild Hardware Database. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting udev Kernel Device Manager... Nov 3 18:04:13 kjcf05n03 systemd-udevd[1589]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started udev Kernel Device Manager. Nov 3 18:04:13 kjcf05n03 systemd[1]: Found device /dev/ttyS0. Nov 3 18:04:13 kjcf05n03 systemd-udevd[1655]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:04:13 kjcf05n03 systemd-udevd[1640]: Using default interface naming scheme 'rhel-8.0'. Nov 3 18:04:13 kjcf05n03 systemd-udevd[1640]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:04:13 kjcf05n03 systemd-udevd[1621]: Using default interface naming scheme 'rhel-8.0'. Nov 3 18:04:13 kjcf05n03 systemd-udevd[1621]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:04:13 kjcf05n03 systemd-udevd[1630]: Using default interface naming scheme 'rhel-8.0'. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 18:04:13 kjcf05n03 systemd-udevd[1630]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:04:13 kjcf05n03 systemd[1]: Reached target Local File Systems (Pre). Nov 3 18:04:13 kjcf05n03 systemd[1]: Reached target Local File Systems. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 18:04:13 kjcf05n03 root[1815]: openibd: running in auto mode Nov 3 18:04:13 kjcf05n03 systemd-tmpfiles[1814]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 18:04:13 kjcf05n03 systemd-tmpfiles[1814]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Rebuild Journal Catalog. Nov 3 18:04:13 kjcf05n03 systemd-tmpfiles[1814]: "/var/tmp" already exists and is not a directory. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Create Volatile Files and Directories. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting RPC Bind... Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started RPC Bind. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 18:04:13 kjcf05n03 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 18:04:13 kjcf05n03 systemd[1]: Started RDMA Node Description Daemon. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 18:04:13 kjcf05n03 systemd-modules-load[1940]: Inserted module 'ib_iser' Nov 3 18:04:13 kjcf05n03 systemd-modules-load[1940]: Inserted module 'ib_isert' Nov 3 18:04:13 kjcf05n03 systemd-modules-load[1940]: Inserted module 'ib_srpt' Nov 3 18:04:13 kjcf05n03 systemd-udevd[1628]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:04:13 kjcf05n03 systemd-modules-load[1939]: Inserted module 'ib_ipoib' Nov 3 18:04:13 kjcf05n03 systemd-udevd[1616]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:04:13 kjcf05n03 systemd-modules-load[1940]: Inserted module 'rdma_ucm' Nov 3 18:04:13 kjcf05n03 systemd-modules-load[1940]: Module 'svcrdma' is blacklisted Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 18:04:13 kjcf05n03 systemd-udevd[1616]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 18:04:13 kjcf05n03 systemd-udevd[1628]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 18:04:13 kjcf05n03 systemd-modules-load[1939]: Inserted module 'ib_umad' Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 18:04:13 kjcf05n03 systemd[1]: Reached target Network (Pre). Nov 3 18:04:13 kjcf05n03 systemd[1]: Reached target RDMA Hardware. Nov 3 18:04:13 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 18:04:13 kjcf05n03 systemd[3128]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:13 kjcf05n03 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 18:04:13 kjcf05n03 openibd[1801]: Loading HCA driver and Access Layer:[ OK ] Nov 3 18:04:13 kjcf05n03 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Update is Completed... Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Update is Completed. Nov 3 18:04:13 kjcf05n03 setup-icl[1792]: Setting LAN IP Address to 203.0.113.4 Nov 3 18:04:13 kjcf05n03 setup-icl[1792]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 18:04:13 kjcf05n03 setup-icl[1792]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 18:04:13 kjcf05n03 setup-icl[1792]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 18:04:13 kjcf05n03 systemd-udevd[1628]: Using default interface naming scheme 'rhel-8.0'. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 18:04:13 kjcf05n03 systemd[1]: Reached target System Initialization. Nov 3 18:04:13 kjcf05n03 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 18:04:13 kjcf05n03 systemd[1]: Listening on lldpad.socket. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 18:04:13 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 18:04:13 kjcf05n03 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 18:04:13 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 18:04:13 kjcf05n03 systemd[1]: Reached target Sockets. Nov 3 18:04:13 kjcf05n03 systemd[1]: Reached target Basic System. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 18:04:13 kjcf05n03 network[2104]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Name Service Cache Daemon... Nov 3 18:04:13 kjcf05n03 network[2121]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 18:04:13 kjcf05n03 network[2104]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 18:04:13 kjcf05n03 beSetMlxConfig[2120]: ConnectX-3 multiport not detected Nov 3 18:04:13 kjcf05n03 nscd[2144]: 2144 monitoring file `/etc/hosts` (1) Nov 3 18:04:13 kjcf05n03 nscd[2144]: 2144 monitoring directory `/etc` (2) Nov 3 18:04:13 kjcf05n03 nscd[2144]: 2144 monitoring file `/etc/resolv.conf` (3) Nov 3 18:04:13 kjcf05n03 nscd[2144]: 2144 monitoring directory `/etc` (2) Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started D-Bus System Message Bus. Nov 3 18:04:13 kjcf05n03 mcelog[2153]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 18:04:13 kjcf05n03 mcelog[2153]: CPU is unsupported Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 0 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 1 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 2 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 3 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 4 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 5 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 6 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 7 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 8 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 9 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 10 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 11 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 12 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 13 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 14 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 15 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 16 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 17 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 18 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 19 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 20 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 21 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 22 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 23 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 24 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 25 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 26 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 27 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 28 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 29 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 30 Nov 3 18:04:13 kjcf05n03 cpupower[2140]: Setting cpu: 31 Nov 3 18:04:13 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 18:04:13 kjcf05n03 network[2138]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:04:13 kjcf05n03 network[2104]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 18:04:13 kjcf05n03 systemd[1]: Started irqbalance daemon. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 18:04:13 kjcf05n03 network[2159]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Resets System Activity Logs... Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[2171]: Setting up Mellanox network interface: ib0 Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[2195]: Setting up Mellanox network interface: ib1 Nov 3 18:04:13 kjcf05n03 beSetMlxConfig[2120]: Starting MST (Mellanox Software Tools) driver set Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 18:04:13 kjcf05n03 dbus-daemon[2155]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 18:04:13 kjcf05n03 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 18:04:13 kjcf05n03 chronyd[2252]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 18:04:13 kjcf05n03 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 18:04:13 kjcf05n03 dwd[2218]: dwd: vMay 29 2024 : 15:38:26 Nov 3 18:04:13 kjcf05n03 dwd[2218]: /usr/sbin/dwd -d --standalone=0 Nov 3 18:04:13 kjcf05n03 dwd[2218]: dwd: option Lethal: 0 Nov 3 18:04:13 kjcf05n03 dwd[2218]: dwd: option Interval: 60 Nov 3 18:04:13 kjcf05n03 dwd[2218]: dwd: option abrtlimit: 10 Nov 3 18:04:13 kjcf05n03 dwd[2218]: dwd: option DZPeriod: 604800 Nov 3 18:04:13 kjcf05n03 dwd[2218]: dwd: option SmartPeriod: 43200 Nov 3 18:04:13 kjcf05n03 dwd[2218]: dwd: option SDDEnabled: 1 Nov 3 18:04:13 kjcf05n03 dwd[2218]: dwd: option SDDAwaitScale: 3 Nov 3 18:04:13 kjcf05n03 dwd[2218]: dwd: option SDDAwaitMin: 100 Nov 3 18:04:13 kjcf05n03 dwd[2218]: dwd: option Verbosity: 1 Nov 3 18:04:13 kjcf05n03 dwd[2218]: dwd: option StandAlone: 0 Nov 3 18:04:13 kjcf05n03 dwd[2218]: option Lethal: 0 Nov 3 18:04:13 kjcf05n03 dwd[2218]: option Interval: 60 Nov 3 18:04:13 kjcf05n03 dwd[2218]: option abrtlimit: 10 Nov 3 18:04:13 kjcf05n03 dwd[2218]: option DZPeriod: 604800 Nov 3 18:04:13 kjcf05n03 dwd[2218]: option SmartPeriod: 43200 Nov 3 18:04:13 kjcf05n03 dwd[2218]: option SDDEnabled: 1 Nov 3 18:04:13 kjcf05n03 dwd[2218]: option SDDAwaitScale: 3 Nov 3 18:04:13 kjcf05n03 dwd[2218]: option SDDAwaitMin: 100 Nov 3 18:04:13 kjcf05n03 dwd[2218]: option Verbosity: 1 Nov 3 18:04:13 kjcf05n03 dwd[2218]: option StandAlone: 0 Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 18:04:13 kjcf05n03 mdraid-phy[2234]: no Cutlass to worry about Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Name Service Cache Daemon. Nov 3 18:04:13 kjcf05n03 beSetMlxConfig[2120]: Loading MST PCI module - Success Nov 3 18:04:13 kjcf05n03 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 18:04:13 kjcf05n03 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Resets System Activity Logs. Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 0 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 1 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 2 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 3 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 4 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 5 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 6 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 7 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 8 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 9 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 10 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 11 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 12 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 13 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 14 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 15 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 16 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 17 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 18 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 19 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 20 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 21 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 22 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 23 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 24 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 25 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 26 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 27 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 28 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 29 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 30 Nov 3 18:04:13 kjcf05n03 cpupower[2294]: Idlestate 2 disabled on CPU 31 Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 18:04:13 kjcf05n03 chronyd[2252]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 18:04:13 kjcf05n03 chronyd[2252]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 18:04:13 kjcf05n03 beSetMlxConfig[2120]: Loading MST PCI configuration module - Success Nov 3 18:04:13 kjcf05n03 beSetMlxConfig[2120]: Create devices Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Manage Cutlass PHYs. Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[2293]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[2292]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[2317]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[2316]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[2340]: No configuration found for ib1 Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[2341]: No configuration found for ib0 Nov 3 18:04:13 kjcf05n03 sssd[sssd][2214]: Starting up Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[2366]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[2368]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 18:04:13 kjcf05n03 mlnx_conf_mgr[2433]: INFO: No configurations found for mlx5_1, skipping. Nov 3 18:04:13 kjcf05n03 mlnx_conf_mgr[2434]: INFO: No configurations found for mlx5_0, skipping. Nov 3 18:04:13 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 18:04:13 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 18:04:13 kjcf05n03 sssd[be[implicit_files]][2379]: Starting up Nov 3 18:04:13 kjcf05n03 sssd[nss][2533]: Starting up Nov 3 18:04:13 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 18:04:13 kjcf05n03 systemd[1]: Reached target User and Group Name Lookups. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Login Service... Nov 3 18:04:13 kjcf05n03 systemd-logind[2650]: New seat seat0. Nov 3 18:04:13 kjcf05n03 systemd-logind[2650]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Login Service. Nov 3 18:04:13 kjcf05n03 python3.9[2107]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 18:04:13 kjcf05n03 python3.9[3128]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 18:04:13 kjcf05n03 systemd-sysctl[2752]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 18:04:13 kjcf05n03 systemd-sysctl[2752]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 18:04:13 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 18:04:13 kjcf05n03 python3.9[2846]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 18:04:13 kjcf05n03 python3.9[3128]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 18:04:13 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 18:04:13 kjcf05n03 network[2104]: Bringing up loopback interface: [ OK ] Nov 3 18:04:13 kjcf05n03 systemd-sysctl[3082]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 18:04:13 kjcf05n03 systemd-sysctl[3082]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 18:04:13 kjcf05n03 systemd[1]: Started LSB: Bring up/down networking. Nov 3 18:04:13 kjcf05n03 systemd[1]: Reached target Network. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 18:04:13 kjcf05n03 systemd[1]: Reached target Network is Online. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting System Logger Daemon... Nov 3 18:04:13 kjcf05n03 python3.9[3026]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 18:04:13 kjcf05n03 python3.9[3128]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 18:04:13 kjcf05n03 sm-notify[3127]: Version 2.3.3 starting Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Notify NFS peers of a restart. Nov 3 18:04:13 kjcf05n03 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 18:04:13 kjcf05n03 systemd[1]: Reached target NFS client services. Nov 3 18:04:13 kjcf05n03 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 18:04:13 kjcf05n03 systemd[1]: Reached target Remote File Systems. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Permit User Sessions... Nov 3 18:04:13 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 18:04:13 kjcf05n03 lldpad[3117]: setsockopt nearest_bridge: Invalid argument Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Permit User Sessions. Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 18:04:13 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 18:04:13 kjcf05n03 lldpad[3117]: setsockopt nearest_bridge: Invalid argument Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 18:04:13 kjcf05n03 sshd[3192]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Getty on tty1. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Serial Getty on ttyS0. Nov 3 18:04:13 kjcf05n03 systemd[1]: Reached target Login Prompts. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 18:04:13 kjcf05n03 syslog-ng[3128]: [2024-11-04T00:03:00.357226] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 18:04:13 kjcf05n03 syslog-ng[3128]: [2024-11-04T00:03:00.357589] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 18:04:13 kjcf05n03 syslog-ng[3128]: [2024-11-04T00:03:00.357630] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 18:04:13 kjcf05n03 syslog-ng[3128]: [2024-11-04T00:03:00.358246] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 18:04:13 kjcf05n03 syslog-ng[3128]: [2024-11-04T00:03:00.358567] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 18:04:13 kjcf05n03 systemd[1]: Started System Logger Daemon. Nov 3 18:04:13 kjcf05n03 beSetMlxConfig[2120]: Unloading MST PCI module (unused) - Success Nov 3 18:04:13 kjcf05n03 python3.9[3195]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 18:04:13 kjcf05n03 python3.9[3128]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 18:04:13 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 18:04:13 kjcf05n03 python3.9[3428]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 18:04:13 kjcf05n03 python3.9[3128]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 18:04:13 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 18:04:13 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 18:04:13 kjcf05n03 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 18:04:13 kjcf05n03 chronyd[2252]: System's initial offset : 0.004693 seconds slow of true (slew) Nov 3 18:04:13 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 18:04:13 kjcf05n03 beSetMlxConfig[2120]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 18:04:13 kjcf05n03 beSetMlxConfig[2120]: ib mode Nov 3 18:04:13 kjcf05n03 beSetMlxConfig[2120]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 18:04:13 kjcf05n03 root[3449]: openibd: Set node_desc for mlx5_0: kjcf05n03 HCA-1 Nov 3 18:04:13 kjcf05n03 root[3454]: openibd: Set node_desc for mlx5_1: kjcf05n03 HCA-2 Nov 3 18:04:13 kjcf05n03 beSetMlxConfig[2120]: ib mode Nov 3 18:04:13 kjcf05n03 systemd-udevd[1589]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 18:04:13 kjcf05n03 systemd-udevd[3464]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:04:13 kjcf05n03 systemd-udevd[3465]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:04:13 kjcf05n03 systemd-udevd[3468]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:04:13 kjcf05n03 systemd-udevd[3471]: Using default interface naming scheme 'rhel-8.0'. Nov 3 18:04:13 kjcf05n03 systemd-udevd[3471]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:04:13 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 18:04:13 kjcf05n03 systemd[3128]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:13 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[3506]: Setting up Mellanox network interface: ib0 Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[3507]: Setting up Mellanox network interface: ib1 Nov 3 18:04:13 kjcf05n03 systemd-udevd[3467]: Using default interface naming scheme 'rhel-8.0'. Nov 3 18:04:13 kjcf05n03 systemd-udevd[3466]: Using default interface naming scheme 'rhel-8.0'. Nov 3 18:04:13 kjcf05n03 systemd-udevd[3467]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:04:13 kjcf05n03 systemd-udevd[3466]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Puppet agent... Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[3556]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[3557]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[3586]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[3588]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[3589]: No configuration found for ib0 Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[3590]: No configuration found for ib1 Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[3594]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[3598]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 18:04:13 kjcf05n03 mlnx_conf_mgr[3634]: INFO: No configurations found for mlx5_0, skipping. Nov 3 18:04:13 kjcf05n03 mlnx_conf_mgr[3638]: INFO: No configurations found for mlx5_1, skipping. Nov 3 18:04:13 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 18:04:13 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 18:04:13 kjcf05n03 systemd[1]: Stopping Command Scheduler... Nov 3 18:04:13 kjcf05n03 systemd[1]: crond.service: Succeeded. Nov 3 18:04:13 kjcf05n03 systemd[1]: Stopped Command Scheduler. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 18:04:13 kjcf05n03 systemd[1]: Stopping Job spooling tools... Nov 3 18:04:13 kjcf05n03 systemd[1]: atd.service: Succeeded. Nov 3 18:04:13 kjcf05n03 systemd[1]: Stopped Job spooling tools. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 18:04:13 kjcf05n03 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 18:04:13 kjcf05n03 lldpad[3117]: init_ports: Error adding device ib0 Nov 3 18:04:13 kjcf05n03 lldpad[3117]: init_ports: Error adding device ib1 Nov 3 18:04:13 kjcf05n03 lldpad[3117]: Signal 15 received - terminating Nov 3 18:04:13 kjcf05n03 systemd[1]: lldpad.service: Succeeded. Nov 3 18:04:13 kjcf05n03 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 18:04:13 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 18:04:13 kjcf05n03 systemd[1]: lldpad.socket: Succeeded. Nov 3 18:04:13 kjcf05n03 systemd[1]: Closed lldpad.socket. Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 18:04:13 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting IPMI Driver... Nov 3 18:04:13 kjcf05n03 systemd[1]: Started IPMI Driver. Nov 3 18:04:13 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:13 kjcf05n03 systemd[3128]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:13 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Ipmievd Daemon... Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 1 | Nov-03-2024 | 22:03:03 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 2 | Nov-03-2024 | 22:03:55 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 3 | Nov-03-2024 | 22:03:55 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 4 | Nov-03-2024 | 22:05:21 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 5 | Nov-03-2024 | 22:05:22 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 6 | Nov-04-2024 | 00:00:19 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 7 | Nov-04-2024 | 00:00:19 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 8 | Nov-04-2024 | 00:00:19 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 9 | Nov-04-2024 | 00:00:19 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 10 | Nov-04-2024 | 00:00:19 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 11 | Nov-04-2024 | 00:00:19 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 12 | Nov-04-2024 | 00:00:19 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 13 | Nov-04-2024 | 00:00:19 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 14 | Nov-04-2024 | 00:00:19 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 15 | Nov-04-2024 | 00:00:19 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 16 | Nov-04-2024 | 00:00:19 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 17 | Nov-04-2024 | 00:00:19 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 18 | Nov-04-2024 | 00:00:50 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 19 | Nov-04-2024 | 00:00:50 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 20 | Nov-04-2024 | 00:00:50 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 21 | Nov-04-2024 | 00:00:50 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 22 | Nov-04-2024 | 00:00:50 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 23 | Nov-04-2024 | 00:00:50 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 24 | Nov-04-2024 | 00:00:50 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 25 | Nov-04-2024 | 00:00:50 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 26 | Nov-04-2024 | 00:00:50 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 27 | Nov-04-2024 | 00:00:50 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 28 | Nov-04-2024 | 00:00:50 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 29 | Nov-04-2024 | 00:00:50 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 30 | Nov-04-2024 | 00:00:50 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 31 | Nov-04-2024 | 00:00:50 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 32 | Nov-04-2024 | 00:00:50 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 33 | Nov-04-2024 | 00:00:50 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 34 | Nov-04-2024 | 00:00:50 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 35 | Nov-04-2024 | 00:00:50 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 36 | Nov-04-2024 | 00:00:50 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 37 | Nov-04-2024 | 00:00:50 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 38 | Nov-04-2024 | 00:00:50 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 39 | Nov-04-2024 | 00:00:50 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 40 | Nov-04-2024 | 00:00:51 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 41 | Nov-04-2024 | 00:00:51 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 42 | Nov-04-2024 | 00:00:51 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 43 | Nov-04-2024 | 00:00:51 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 44 | Nov-04-2024 | 00:00:51 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 45 | Nov-04-2024 | 00:00:51 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 46 | Nov-04-2024 | 00:00:51 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 47 | Nov-04-2024 | 00:00:51 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 48 | Nov-04-2024 | 00:00:51 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3980]: 49 | Nov-04-2024 | 00:00:51 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:04:13 kjcf05n03 ipmievd[3983]: Reading sensors... Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Ipmievd Daemon. Nov 3 18:04:13 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:13 kjcf05n03 systemd[3128]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 18:04:13 kjcf05n03 nscd[2144]: 2144 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 18:04:13 kjcf05n03 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 18:04:13 kjcf05n03 systemd[1]: Stopped Set Mellanox configuration. Nov 3 18:04:13 kjcf05n03 systemd[1]: Stopping Set Mellanox configuration... Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 18:04:13 kjcf05n03 beSetMlxConfig[4040]: ConnectX-3 multiport not detected Nov 3 18:04:13 kjcf05n03 beSetMlxConfig[4040]: Starting MST (Mellanox Software Tools) driver set Nov 3 18:04:13 kjcf05n03 beSetMlxConfig[4040]: Loading MST PCI module - Success Nov 3 18:04:13 kjcf05n03 systemd-udevd[1589]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 18:04:13 kjcf05n03 beSetMlxConfig[4040]: [warn] mst_pciconf is already loaded, skipping Nov 3 18:04:13 kjcf05n03 beSetMlxConfig[4040]: Create devices Nov 3 18:04:13 kjcf05n03 beSetMlxConfig[4040]: Unloading MST PCI module (unused) - Success Nov 3 18:04:13 kjcf05n03 ipmievd[3983]: Waiting for events... Nov 3 18:04:13 kjcf05n03 beSetMlxConfig[4040]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 18:04:13 kjcf05n03 beSetMlxConfig[4040]: ib mode Nov 3 18:04:13 kjcf05n03 beSetMlxConfig[4040]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 18:04:13 kjcf05n03 beSetMlxConfig[4040]: ib mode Nov 3 18:04:13 kjcf05n03 systemd-udevd[1589]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 18:04:13 kjcf05n03 systemd-udevd[4940]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:04:13 kjcf05n03 systemd-udevd[4941]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:04:13 kjcf05n03 systemd-udevd[4944]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:04:13 kjcf05n03 systemd-udevd[4947]: Using default interface naming scheme 'rhel-8.0'. Nov 3 18:04:13 kjcf05n03 systemd-udevd[4947]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:04:13 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 18:04:13 kjcf05n03 systemd[3128]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:13 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[4982]: Setting up Mellanox network interface: ib1 Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[4983]: Setting up Mellanox network interface: ib0 Nov 3 18:04:13 kjcf05n03 systemd-udevd[4942]: Using default interface naming scheme 'rhel-8.0'. Nov 3 18:04:13 kjcf05n03 systemd-udevd[4943]: Using default interface naming scheme 'rhel-8.0'. Nov 3 18:04:13 kjcf05n03 systemd-udevd[4942]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:04:13 kjcf05n03 systemd-udevd[4943]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[5032]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[5034]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[5063]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[5064]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[5065]: No configuration found for ib1 Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[5066]: No configuration found for ib0 Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[5073]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 18:04:13 kjcf05n03 mlnx_interface_mgr[5074]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 18:04:13 kjcf05n03 mlnx_conf_mgr[5113]: INFO: No configurations found for mlx5_1, skipping. Nov 3 18:04:13 kjcf05n03 mlnx_conf_mgr[5114]: INFO: No configurations found for mlx5_0, skipping. Nov 3 18:04:13 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 18:04:13 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}d8a921620a6aa20c8737ce2737aa411c3fb285101a5b801f23a48e7acbe7d018' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}d8a921620a6aa20c8737ce2737aa411c3fb285101a5b801f23a48e7acbe7d018' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}1f5a9a4cec4c2f21e04070cbed2167d856cdc9a86d28f93d82d3c87576814bc2' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}1f5a9a4cec4c2f21e04070cbed2167d856cdc9a86d28f93d82d3c87576814bc2' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}2572ab9d38a30726de8d3d5d7ca30645248a56665eced684efdb7c9ad420fc19' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}2572ab9d38a30726de8d3d5d7ca30645248a56665eced684efdb7c9ad420fc19' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}0b6889b2f629958c5001eb1879bc46f44b1e861c70650c237a4a7f17b6f65b38' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}0b6889b2f629958c5001eb1879bc46f44b1e861c70650c237a4a7f17b6f65b38' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 18:04:13 kjcf05n03 systemd[1]: Stopping NTP client/server... Nov 3 18:04:13 kjcf05n03 chronyd[2252]: chronyd exiting Nov 3 18:04:13 kjcf05n03 systemd[1]: chronyd.service: Succeeded. Nov 3 18:04:13 kjcf05n03 systemd[1]: Stopped NTP client/server. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 18:04:13 kjcf05n03 chronyd[5148]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 18:04:13 kjcf05n03 chronyd[5148]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 18:04:13 kjcf05n03 chronyd[5148]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 18:04:13 kjcf05n03 chronyd[5148]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 18:04:13 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 18:04:13 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:13 kjcf05n03 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 18:04:13 kjcf05n03 systemd[1]: dwd.service: Succeeded. Nov 3 18:04:13 kjcf05n03 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 18:04:13 kjcf05n03 dwd[5179]: dwd: vMay 29 2024 : 15:38:26 Nov 3 18:04:13 kjcf05n03 dwd[5179]: /usr/sbin/dwd -i 15 -d Nov 3 18:04:13 kjcf05n03 dwd[5179]: dwd: option Lethal: 0 Nov 3 18:04:13 kjcf05n03 dwd[5179]: dwd: option Interval: 15 Nov 3 18:04:13 kjcf05n03 dwd[5179]: dwd: option abrtlimit: 10 Nov 3 18:04:13 kjcf05n03 dwd[5179]: dwd: option DZPeriod: 604800 Nov 3 18:04:13 kjcf05n03 dwd[5179]: dwd: option SmartPeriod: 43200 Nov 3 18:04:13 kjcf05n03 dwd[5179]: dwd: option SDDEnabled: 1 Nov 3 18:04:13 kjcf05n03 dwd[5179]: dwd: option SDDAwaitScale: 3 Nov 3 18:04:13 kjcf05n03 dwd[5179]: dwd: option SDDAwaitMin: 100 Nov 3 18:04:13 kjcf05n03 dwd[5179]: dwd: option Verbosity: 1 Nov 3 18:04:13 kjcf05n03 dwd[5179]: dwd: option StandAlone: 0 Nov 3 18:04:13 kjcf05n03 dwd[5179]: option Lethal: 0 Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 18:04:13 kjcf05n03 dwd[5179]: option Interval: 15 Nov 3 18:04:13 kjcf05n03 dwd[5179]: option abrtlimit: 10 Nov 3 18:04:13 kjcf05n03 dwd[5179]: option DZPeriod: 604800 Nov 3 18:04:13 kjcf05n03 dwd[5179]: option SmartPeriod: 43200 Nov 3 18:04:13 kjcf05n03 dwd[5179]: option SDDEnabled: 1 Nov 3 18:04:13 kjcf05n03 dwd[5179]: option SDDAwaitScale: 3 Nov 3 18:04:13 kjcf05n03 dwd[5179]: option SDDAwaitMin: 100 Nov 3 18:04:13 kjcf05n03 dwd[5179]: option Verbosity: 1 Nov 3 18:04:13 kjcf05n03 dwd[5179]: option StandAlone: 0 Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 18:04:13 kjcf05n03 dwd[5181]: option Lethal now set to 1 Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 18:04:13 kjcf05n03 dwd[5181]: option abrtlimit now set to 1 Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 18:04:13 kjcf05n03 dwd[5181]: option SmartPeriod now set to 86400 Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 18:04:13 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 18:04:13 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Discard unused blocks. Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:13 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 18:04:13 kjcf05n03 python3.9[5210]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 18:04:13 kjcf05n03 python3.9[3128]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:13 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Periodic ZFS scrub. Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:13 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 18:04:13 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting Sed Control Plane worker process... Nov 3 18:04:13 kjcf05n03 sedcpwrkr[5349]: Using config script: /etc/sedcpwrkr.conf Nov 3 18:04:13 kjcf05n03 sedcpwrkr[5349]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 18:04:13 kjcf05n03 sedcpwrkr[5349]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 18:04:13 kjcf05n03 sedcpwrkr[5349]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 18:04:13 kjcf05n03 sedcpwrkr[5349]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 18:04:13 kjcf05n03 sedcpwrkr[5349]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 18:04:13 kjcf05n03 sedcpwrkr[5349]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 18:04:13 kjcf05n03 sedcpwrkr-server[5380]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 18:04:13 kjcf05n03 sedcpwrkr[5349]: celery multi v5.2.7 (dawn-chorus) Nov 3 18:04:13 kjcf05n03 sedcpwrkr[5349]: > Starting nodes... Nov 3 18:04:13 kjcf05n03 sedcpwrkr[5349]: > sedcpwrkr@kjcf05n03: OK Nov 3 18:04:13 kjcf05n03 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 18:04:13 kjcf05n03 sedcpwrkr-server[5382]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 18:04:13 kjcf05n03 sedcpwrkr-server[5382]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 18:04:13 kjcf05n03 sedcpwrkr-server[5382]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 18:04:13 kjcf05n03 systemd[1]: Started Sed Control Plane worker process. Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 18:04:13 kjcf05n03 systemd[1]: Reloading System Logger Daemon. Nov 3 18:04:13 kjcf05n03 systemd[1]: Reloaded System Logger Daemon. Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 18:04:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 18:04:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 18:04:13 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:13 kjcf05n03 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 18:04:13 kjcf05n03 systemd-udevd[1589]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 18:04:13 kjcf05n03 iptables.init[5450]: iptables: Applying firewall rules: [ OK ] Nov 3 18:04:13 kjcf05n03 systemd[1]: Started IPv4 firewall with iptables. Nov 3 18:04:13 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:14 kjcf05n03 systemd[3128]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:14 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:14 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:14 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 18:04:14 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 18:04:14 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 18:04:14 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 18:04:14 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 18:04:14 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 18:04:14 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 18:04:14 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 18:04:14 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 18:04:14 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 18:04:15 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 18:04:15 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 18:04:15 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 18:04:15 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 18:04:15 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 18:04:15 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 18:04:15 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 18:04:15 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 18:04:15 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 18:04:15 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 18:04:15 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 18:04:15 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 18:04:15 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 18:04:15 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 18:04:15 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 18:04:15 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 18:04:15 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 18:04:15 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 18:04:15 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 18:04:15 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 18:04:15 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 18:04:15 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 18:04:15 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 18:04:15 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 18:04:15 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 18:04:15 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 18:04:15 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 18:04:15 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 18:04:15 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 18:04:15 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 18:04:15 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 18:04:15 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 18:04:15 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 18:04:15 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 18:04:15 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 18:04:15 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 18:04:15 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 18:04:15 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 18:04:15 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 18:04:15 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 18:04:15 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:15 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 18:04:15 kjcf05n03 systemd[1]: openhpid.service: Supervising process 5547 which is not our child. We'll most likely not notice when it exits. Nov 3 18:04:15 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 18:04:15 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:15 kjcf05n03 openhpid[5547]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 18:04:15 kjcf05n03 openhpid[5547]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 18:04:15 kjcf05n03 openhpid[5547]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 18:04:15 kjcf05n03 openhpid[5547]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 18:04:15 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:15 kjcf05n00 mcfcli[3673891]: %3|1730678655.436|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:04:16 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:16 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:16 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 18:04:16 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 18:04:16 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 18:04:16 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 18:04:16 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:16 kjcf05n03 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 18:04:16 kjcf05n03 dcs-collectord[5638]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 18:04:16 kjcf05n03 hpi.inv.log[5638]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 18:04:16 kjcf05n03 dcs-collectord[5638]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 18:04:16 kjcf05n03 dcs-collectord[5638]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 18:04:16 kjcf05n03 dcs-collector[5629]: Starting dcs-collector:[ OK ] Nov 3 18:04:16 kjcf05n03 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 18:04:16 kjcf05n03 dcs-collectord[5641]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 18:04:16 kjcf05n03 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 18:04:16 kjcf05n03 dcs-collectord[5641]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 18:04:16 kjcf05n03 dcs-collectord[5641]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 18:04:16 kjcf05n03 dcs-collectord[5641]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 18:04:16 kjcf05n03 dcs-collectord[5641]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 18:04:16 kjcf05n03 dcs-collectord[5641]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 18:04:16 kjcf05n03 dcs-collectord[5641]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 18:04:16 kjcf05n03 dcs-collectord[5641]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259339084", "units": "kB"}, {"name": "MemAvailable", "value": "258618972", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821324", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686508", "units": "kB"}, {"name": "Inactive", "value": "961636", "units": "kB"}, {"name": "Active(anon)", "value": "1520808", "units": "kB"}, {"name": "Inactive(anon)", "value": "825008", "units": "kB"}, {"name": "Active(file)", "value": "165700", "units": "kB"}, {"name": "Inactive(file)", "value": "136628", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "752936", "units": "kB"}, {"name": "Mapped", "value": "85708", "units": "kB"}, {"name": "Shmem", "value": "1593448", "units": "kB"}, {"name": "KReclaimable", "value": "109608", "units": "kB"}, {"name": "Slab", "value": "275660", "units": "kB"}, {"name": "SReclaimable", "value": "109608", "units": "kB"}, {"name": "SUnreclaim", "value": "166052", "units": "kB"}, {"name": "KernelStack", "value": "9712", "units": "kB"}, {"name": "PageTables", "value": "20244", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3274580", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11264", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "4096", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "260424", "units": "kB"}, {"name": "DirectMap2M", "value": "22673408", "units": "kB"}, {"name": "DirectMap1G", "value": "245366784", "units": "kB"}]}' Nov 3 18:04:16 kjcf05n03 dcs-collectord[5641]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 18:04:16 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:17 kjcf05n03 systemd[3128]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:17 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:17 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:17 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 18:04:17 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 18:04:17 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 18:04:17 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 18:04:17 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:17 kjcf05n03 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 18:04:17 kjcf05n03 firmware-update-orc[5722]: Using config script: /etc/firmware_update_orc.conf Nov 3 18:04:17 kjcf05n03 firmware-update-orc[5722]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 18:04:17 kjcf05n03 firmware-update-orc[5722]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 18:04:17 kjcf05n03 firmware-update-orc[5722]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 18:04:17 kjcf05n03 firmware-update-orc[5722]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 18:04:17 kjcf05n03 firmware-update-orc[5722]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 18:04:17 kjcf05n03 firmware-update-orc[5722]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 18:04:18 kjcf05n03 dcs-collectord[5641]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 18:04:18 kjcf05n03 dcs-collectord[5641]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730678656.5328698], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730678657.711958], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730678656.4625463, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 18:04:18 kjcf05n03 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 18:04:18 kjcf05n03 firmware-update-orc-server[5770]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 18:04:18 kjcf05n03 firmware-update-orc[5722]: celery multi v5.2.7 (dawn-chorus) Nov 3 18:04:18 kjcf05n03 firmware-update-orc[5722]: > Starting nodes... Nov 3 18:04:18 kjcf05n03 firmware-update-orc[5722]: > worker1@kjcf05n03: OK Nov 3 18:04:18 kjcf05n03 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 18:04:18 kjcf05n03 firmware-update-orc-server[5787]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 18:04:18 kjcf05n03 firmware-update-orc-server[5787]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 18:04:18 kjcf05n03 firmware-update-orc-server[5787]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 18:04:18 kjcf05n03 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 18:04:18 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:18 kjcf05n03 systemd[3128]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:18 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:18 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:18 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 18:04:18 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 18:04:18 kjcf05n03 dbus-daemon[2155]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 18:04:18 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 18:04:18 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 18:04:18 kjcf05n03 dbus-daemon[2155]: [system] Reloaded configuration Nov 3 18:04:18 kjcf05n03 dbus-daemon[2155]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 18:04:18 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 18:04:18 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 18:04:18 kjcf05n03 dbus-daemon[2155]: [system] Reloaded configuration Nov 3 18:04:18 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 18:04:18 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 18:04:18 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 18:04:18 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 18:04:19 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:19 kjcf05n03 systemd[1]: Starting Manages hardware resources... Nov 3 18:04:19 kjcf05n03 ras-resource-manager-agent[5903]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 18:04:19 kjcf05n03 ras-resource-manager-agent[5889]: Starting ras-resource-manager-agent:[ OK ] Nov 3 18:04:19 kjcf05n03 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 18:04:19 kjcf05n03 ras-resource-manager-agent[5905]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 18:04:19 kjcf05n03 ras-resource-manager-client[5905]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 18:04:19 kjcf05n03 systemd[1]: Started Manages hardware resources. Nov 3 18:04:19 kjcf05n03 ras-resource-manager-client[5905]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 18:04:19 kjcf05n03 ras-resource-manager-client[5915]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 18:04:19 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:20 kjcf05n03 systemd[3128]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 18:04:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 18:04:20 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:20 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 18:04:20 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:21 kjcf05n03 systemd[3128]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: Press Ctrl+C to exit. Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: Plugin support version 1.0 Nov 3 18:04:21 kjcf05n03 zabbix_agent2[5989]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 18:04:21 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:21 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:21 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:20 kjcf05n00 mcfcli[3673891]: %3|1730678660.792|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 18:04:21 kjcf05n03 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 18:04:21 kjcf05n03 dcs-notification-sender[6070]: dcs-notification-senderd is stopped Nov 3 18:04:21 kjcf05n03 zabbix-agent2[6084]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 18:04:21 kjcf05n03 dcs-notification-sender[6070]: Starting notification-sender:[ OK ] Nov 3 18:04:21 kjcf05n03 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 18:04:21 kjcf05n03 zabbix-agent2[6086]: INFO DCS notification agent started. (agent.py:61) Nov 3 18:04:21 kjcf05n03 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 18:04:21 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:22 kjcf05n03 systemd[3128]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:22 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:22 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:22 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:22 kjcf05n03 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 18:04:22 kjcf05n03 dcs-collectord[6193]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 18:04:22 kjcf05n03 dcs-collectord[6193]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 18:04:22 kjcf05n03 dcs-bulk-data-sender[6193]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 18:04:22 kjcf05n03 dcs-bulk-data-sender[6184]: Starting bulk-data-sender:[ OK ] Nov 3 18:04:22 kjcf05n03 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 18:04:22 kjcf05n03 dcs-collectord[6195]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 18:04:22 kjcf05n03 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 18:04:22 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:23 kjcf05n03 systemd[3128]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:23 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:23 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:23 kjcf05n03 nscd[2144]: 2144 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 18:04:23 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 18:04:23 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 18:04:23 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 18:04:23 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 18:04:23 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 18:04:23 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 18:04:23 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 18:04:23 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 18:04:23 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 18:04:23 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 18:04:23 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 18:04:23 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 18:04:23 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 18:04:23 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 18:04:23 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 18:04:23 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 18:04:23 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 18:04:23 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 18:04:24 kjcf05n03 python3.9[5210]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 18:04:24 kjcf05n03 python3.9[3128]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:24 kjcf05n03 systemd[1]: Stopping System Security Services Daemon... Nov 3 18:04:24 kjcf05n03 sssd[nss][2533]: Shutting down (status = 0) Nov 3 18:04:24 kjcf05n03 sssd[be[implicit_files]][2379]: Shutting down (status = 0) Nov 3 18:04:24 kjcf05n03 systemd[1]: sssd.service: Succeeded. Nov 3 18:04:24 kjcf05n03 systemd[1]: Stopped System Security Services Daemon. Nov 3 18:04:24 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 18:04:24 kjcf05n03 sssd[sssd][6264]: Starting up Nov 3 18:04:24 kjcf05n03 sssd[be[implicit_files]][6276]: Starting up Nov 3 18:04:24 kjcf05n03 sssd[nss][6277]: Starting up Nov 3 18:04:24 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 18:04:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 18:04:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 18:04:25 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 18:04:25 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 18:04:25 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 18:04:25 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 18:04:25 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 18:04:25 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 18:04:25 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure) defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 18:04:25 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure: defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 18:04:25 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure) defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 18:04:25 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure: defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 18:04:25 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 18:04:25 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 18:04:25 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 18:04:25 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 18:04:25 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:04:25 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:04:25 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:25 kjcf05n03 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 18:04:26 kjcf05n03 icinga2[6323]: [2024-11-03 18:04:26 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 18:04:26 kjcf05n03 icinga2[6323]: [2024-11-03 18:04:26 -0600] information/cli: Loading configuration file(s). Nov 3 18:04:26 kjcf05n03 icinga2[6323]: [2024-11-03 18:04:26 -0600] information/ConfigItem: Committing config item(s). Nov 3 18:04:26 kjcf05n03 icinga2[6323]: [2024-11-03 18:04:26 -0600] information/ApiListener: My API identity: kjcf05n03 Nov 3 18:04:26 kjcf05n03 icinga2[6323]: [2024-11-03 18:04:26 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 18:04:26 kjcf05n03 icinga2[6323]: [2024-11-03 18:04:26 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 18:04:26 kjcf05n03 icinga2[6323]: [2024-11-03 18:04:26 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 18:04:26 kjcf05n03 icinga2[6323]: [2024-11-03 18:04:26 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 18:04:26 kjcf05n03 icinga2[6323]: [2024-11-03 18:04:26 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 18:04:26 kjcf05n03 icinga2[6323]: [2024-11-03 18:04:26 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 18:04:26 kjcf05n03 icinga2[6323]: [2024-11-03 18:04:26 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 18:04:26 kjcf05n03 icinga2[6323]: [2024-11-03 18:04:26 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 18:04:26 kjcf05n03 icinga2[6323]: [2024-11-03 18:04:26 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 18:04:26 kjcf05n03 icinga2[6323]: [2024-11-03 18:04:26 -0600] information/cli: Closing console log. Nov 3 18:04:26 kjcf05n03 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 18:04:26 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:26 kjcf05n03 systemd[3128]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:26 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:26 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:27 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 18:04:27 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 18:04:27 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:27 kjcf05n03 systemd[1]: Started Icinga2 network monitor. Nov 3 18:04:27 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:28 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 18:04:28 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:28 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:28 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 18:04:28 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 18:04:28 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 18:04:28 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 18:04:28 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 18:04:28 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 18:04:28 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 18:04:28 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 18:04:28 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 18:04:28 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 18:04:28 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 18:04:28 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 18:04:28 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 18:04:28 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 18:04:28 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:28 kjcf05n03 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 18:04:28 kjcf05n03 nslcd[6935]: version 0.9.9 starting Nov 3 18:04:28 kjcf05n03 nslcd[6935]: accepting connections Nov 3 18:04:28 kjcf05n03 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 18:04:28 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:29 kjcf05n03 systemd[3128]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:29 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:29 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:29 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 18:04:29 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 18:04:29 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 18:04:29 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 18:04:30 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 18:04:30 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 18:04:30 kjcf05n03 dcs-bulk-data-sender[6195]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 18:04:30 kjcf05n03 dcs-collectord[6195]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 18:04:30 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 18:04:30 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 18:04:30 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:30 kjcf05n03 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 18:04:31 kjcf05n03 dearcpw[7038]: Using config script: /etc/dearcpw.conf Nov 3 18:04:31 kjcf05n03 dearcpw[7038]: - Creating default directory: '/var/log/dearcpw' Nov 3 18:04:31 kjcf05n03 dearcpw[7038]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 18:04:31 kjcf05n03 dearcpw[7038]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 18:04:31 kjcf05n03 dearcpw[7038]: - Creating default directory: '/var/run/dearcpw' Nov 3 18:04:31 kjcf05n03 dearcpw[7038]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 18:04:31 kjcf05n03 dearcpw[7038]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 18:04:31 kjcf05n03 dearcpw-server[7078]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 18:04:31 kjcf05n03 dearcpw[7038]: celery multi v5.2.7 (dawn-chorus) Nov 3 18:04:31 kjcf05n03 dearcpw[7038]: > Starting nodes... Nov 3 18:04:31 kjcf05n03 dearcpw[7038]: > dearcpw@kjcf05n03: OK Nov 3 18:04:31 kjcf05n03 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 18:04:31 kjcf05n03 dearcpw-server[7093]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 18:04:31 kjcf05n03 dearcpw-server[7093]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 18:04:31 kjcf05n03 dearcpw-server[7093]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 18:04:31 kjcf05n03 systemd[1]: Started DEAR Control Plane worker process. Nov 3 18:04:31 kjcf05n03 dcs-collectord[5641]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 18:04:31 kjcf05n03 dcs-collectord[5641]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 18:04:31 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:31 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:31 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 18:04:31 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 18:04:31 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 18:04:31 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 18:04:31 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 18:04:31 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 18:04:31 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 18:04:31 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 18:04:32 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:56452). Nov 3 18:04:32 kjcf05n01 rsyncd[3226646]: connect from kjcf05n03 (172.16.2.6) Nov 3 18:04:32 kjcf05n01 rsyncd[3226646]: rsync to puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 18:04:32 kjcf05n01 rsyncd[3226646]: receiving file list Nov 3 18:04:32 kjcf05n01 rsyncd[3226646]: sent 29 bytes received 325 bytes total size 10901 Nov 3 18:04:32 kjcf05n01 systemd[1]: rsyncd@650-172.16.2.2:873-172.16.2.6:56452.service: Succeeded. Nov 3 18:04:32 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 18:04:32 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 18:04:32 kjcf05n03 puppet[7122]: IEC: 017000000: Node is up and running: { "node": "kjcf05n03" } Nov 3 18:04:32 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 18:04:32 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 18:04:32 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 18:04:32 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 18:04:32 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 18:04:32 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 18:04:32 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 18:04:32 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 18:04:32 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 18:04:32 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 18:04:33 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 18:04:33 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 18:04:33 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 18:04:33 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 18:04:33 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 18:04:33 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 18:04:33 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 18:04:33 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 18:04:34 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 18:04:34 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 18:04:34 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 18:04:34 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 18:04:35 kjcf05n03 ipmievd[3983]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 18:04:35 kjcf05n03 ipmievd[3983]: System Event sensor - Timestamp Clock Sync Nov 3 18:04:35 kjcf05n03 ipmievd[3128]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:35 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 18:04:35 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 18:04:35 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:35 kjcf05n03 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 18:04:35 kjcf05n03 diskless-swap[7356]: HA_PS_000: recovering journal Nov 3 18:04:35 kjcf05n03 systemd-udevd[1589]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 18:04:35 kjcf05n03 diskless-swap[7356]: HA_PS_000: clean, 2284/6400 files, 7053/25600 blocks Nov 3 18:04:35 kjcf05n03 diskless-swap[7356]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 18:04:35 kjcf05n03 diskless-swap[7356]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 18:04:35 kjcf05n03 diskless-swap[7356]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 18:04:35 kjcf05n03 diskless-swap[7356]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 18:04:35 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 18:04:35 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:35 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:35 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 18:04:35 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 18:04:35 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 18:04:35 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 18:04:35 kjcf05n03 systemd[1]: Stopping OpenSSH server daemon... Nov 3 18:04:36 kjcf05n03 systemd[1]: sshd.service: Succeeded. Nov 3 18:04:36 kjcf05n03 systemd[1]: Stopped OpenSSH server daemon. Nov 3 18:04:36 kjcf05n03 systemd[1]: Stopped target sshd-keygen.target. Nov 3 18:04:36 kjcf05n03 systemd[1]: Stopping sshd-keygen.target. Nov 3 18:04:36 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 18:04:36 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 18:04:36 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 18:04:36 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 18:04:36 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 18:04:36 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 18:04:36 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 18:04:36 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 18:04:36 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 18:04:36 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 18:04:36 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 18:04:37 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 18:04:37 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 18:04:37 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 18:04:37 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 18:04:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 18:04:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 18:04:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 18:04:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 18:04:38 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 18:04:38 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 18:04:38 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 18:04:38 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 18:04:39 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 18:04:39 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 18:04:39 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 18:04:39 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 18:04:39 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:39 kjcf05n03 systemd[1]: Set up automount opt-firmware.automount. Nov 3 18:04:39 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:39 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:39 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 18:04:39 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 18:04:39 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:39 kjcf05n03 systemd[1]: Set up automount mnt-llog.automount. Nov 3 18:04:39 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:39 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:39 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 18:04:39 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 18:04:39 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:40 kjcf05n03 systemd[1]: Set up automount usr-share-man.automount. Nov 3 18:04:40 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:40 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:40 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 18:04:40 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 18:04:40 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 18:04:40 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 18:04:40 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 18:04:40 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 18:04:40 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 18:04:40 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 18:04:40 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 18:04:40 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 18:04:40 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:40 kjcf05n03 systemd[1]: Starting Crash recovery kernel arming... Nov 3 18:04:40 kjcf05n03 kdumpctl[7840]: kdump: No kdump initial ramdisk found. Nov 3 18:04:40 kjcf05n03 kdumpctl[7840]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 18:04:40 kjcf05n03 dracut[7952]: dracut-049-135.git20210121.el8 Nov 3 18:04:41 kjcf05n03 dracut[7954]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 18:04:41 kjcf05n03 dracut[7954]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 18:04:41 kjcf05n03 dracut[7954]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 18:04:41 kjcf05n03 dracut[7954]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 18:04:41 kjcf05n03 dracut[7954]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 18:04:41 kjcf05n03 dracut[7954]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 18:04:41 kjcf05n03 dracut[7954]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 18:04:41 kjcf05n03 dracut[7954]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + is_func check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ type -t check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 0 -ne 0 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check -h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local dev holder Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + require_binaries mdadm expr Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _module_name=90hperaid Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ mdadm = \-\m ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for cmd in "$@" Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + find_binary mdadm Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for cmd in "$@" Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + find_binary expr Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n -h ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for dev in "${!host_fs_types[@]}" Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ nfs != *_raid_member ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + continue Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _ret=255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + ret=255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ 255 = 0 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ 255 = 255 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ module_depends hperaid Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: +++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: +++ set -x Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ depends Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo rootfs-block Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ return 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ _ret=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ return 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for _moddep in $(module_depends $_mod) Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all == *\ hperaid\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + add_dracutmodules+=' rootfs-block ' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ == *\ hperaid\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check_module rootfs-block Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _mod=rootfs-block Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddep Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ == *\ rootfs-block\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n '' ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all == *\ rootfs-block\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + module_check rootfs-block 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _forced=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 2 -eq 2 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _forced=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + is_func check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ type -t check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 0 -ne 0 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check -h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _ret=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + ret=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ 0 = 0 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ module_depends rootfs-block Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: +++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 18:04:41 kjcf05n03 kdumpctl[3128]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ depends Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo fs-lib Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ _ret=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ return 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for _moddep in $(module_depends $_mod) Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all == *\ rootfs-block\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + add_dracutmodules+=' fs-lib ' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ == *\ rootfs-block\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check_module fs-lib Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _mod=fs-lib Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddep Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n '' ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + mods_checked_as_dep+=' fs-lib ' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all == *\ fs-lib\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + module_check fs-lib 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _forced=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 2 -eq 2 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _forced=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + is_func check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ type -t check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 0 -ne 0 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check -h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _ret=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + ret=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ 0 = 0 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ module_depends fs-lib Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: +++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ depends Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ return 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ _ret=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ return 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + mods_to_load+=' fs-lib ' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + mods_to_load+=' rootfs-block ' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + mods_to_load+=' hperaid ' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _mod=90kernel-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _mod=kernel-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check_module kernel-modules 1 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _mod=kernel-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddep Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n 1 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all = all ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + module_check kernel-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _forced=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 1 -eq 2 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + is_func check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ type -t check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 0 -ne 0 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check -h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + true Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _ret=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + ret=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ 0 != 0 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ module_depends kernel-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: +++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ depends Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ true Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ _ret=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ return 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + mods_to_load+=' kernel-modules ' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _mod=90kernel-modules-extra Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _mod=kernel-modules-extra Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check_module kernel-modules-extra 1 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _mod=kernel-modules-extra Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddep Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n 1 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all = all ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + module_check kernel-modules-extra Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _forced=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 1 -eq 2 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + is_func check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ type -t check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 0 -ne 0 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check -h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + true Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _ret=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + ret=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ 0 != 0 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ module_depends kernel-modules-extra Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: +++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ depends Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ true Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ _ret=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ return 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + mods_to_load+=' kernel-modules-extra ' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _mod=90kernel-network-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _mod=kernel-network-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check_module kernel-network-modules 1 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _mod=kernel-network-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddep Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n 1 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all = all ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + module_check kernel-network-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _forced=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 1 -eq 2 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + is_func check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ type -t check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 0 -ne 0 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check -h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _ret=255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + ret=255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ 255 != 0 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n 1 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 1 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _mod=90livenet Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _mod=livenet Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check_module livenet 1 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _mod=livenet Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddep Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n 1 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all = all ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + module_check livenet Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _forced=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 1 -eq 2 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + is_func check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ type -t check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 0 -ne 0 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check -h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _ret=255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + ret=255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ 255 != 0 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n 1 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 1 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _mod=90lvm Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _mod=lvm Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check_module lvm 1 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _mod=lvm Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddep Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n 1 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all = all ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + module_check lvm Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _forced=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 1 -eq 2 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + is_func check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ type -t check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 0 -ne 0 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check -h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + require_binaries lvm Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _module_name=90lvm Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ lvm = \-\m ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for cmd in "$@" Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + find_binary lvm Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n -h ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for fs in "${host_fs_types[@]}" Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ nfs = LVM*_member ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _ret=255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + ret=255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ 255 != 0 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n 1 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 1 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _mod=90mdraid Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _mod=mdraid Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check_module mdraid 1 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _mod=mdraid Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddep Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n 1 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all = all ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + module_check mdraid Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _forced=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 1 -eq 2 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + is_func check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ type -t check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 0 -ne 0 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check -h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _rootdev Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + require_binaries mdadm expr Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _module_name=90mdraid Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ mdadm = \-\m ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for cmd in "$@" Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + find_binary mdadm Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for cmd in "$@" Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + find_binary expr Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n -h ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for dev in "${!host_fs_types[@]}" Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ nfs != *_raid_member ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + continue Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _ret=255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + ret=255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ 255 != 0 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n 1 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 1 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _mod=90multipath Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _mod=multipath Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check_module multipath 1 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _mod=multipath Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddep Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n 1 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all = all ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + module_check multipath Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _forced=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 1 -eq 2 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + is_func check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ type -t check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 0 -ne 0 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check -h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _rootdev Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n -h ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for_each_host_dev_and_slaves is_mpath Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _func=is_mpath Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _dev Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for _dev in "${host_devs[@]}" Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + continue Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 1 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _ret=255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + ret=255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ 255 != 0 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n 1 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 1 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _mod=90qemu Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _mod=qemu Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check_module qemu 1 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _mod=qemu Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddep Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n 1 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all = all ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + module_check qemu Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _forced=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 1 -eq 2 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + is_func check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ type -t check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 0 -ne 0 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check -h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n -h ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + type -P systemd-detect-virt Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ systemd-detect-virt --vm Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + vm=none Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + (( 1 != 0 )) Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _ret=255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + ret=255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ 255 != 0 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n 1 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 1 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _mod=90qemu-net Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _mod=qemu-net Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check_module qemu-net 1 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _mod=qemu-net Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddep Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n 1 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all = all ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + module_check qemu-net Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _forced=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 1 -eq 2 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + is_func check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ type -t check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 0 -ne 0 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check -h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n -h ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + type -P systemd-detect-virt Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ systemd-detect-virt --vm Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + vm= Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + (( 1 != 0 )) Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _ret=255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + ret=255 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ 255 != 0 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n 1 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + return 1 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _mod=90stratis Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + _mod=stratis Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check_module stratis 1 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _mod=stratis Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddep Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -n 1 ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ all = all ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + module_check stratis Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ read a b Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _forced=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _hostonly=-h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 1 -eq 2 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + is_func check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: ++ type -t check Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + '[' 0 -ne 0 ']' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + check -h Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _module_name=90stratis Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + local _ret=0 Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + [[ stratisd-init = \-\m ]] Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + for cmd in "$@" Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + find_binary stratisd-init Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 18:04:41 kjcf05n03 kdumpctl[7840]: + set +x Nov 3 18:04:41 kjcf05n03 dracut[7954]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 18:04:41 kjcf05n03 dracut[7954]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 18:04:41 kjcf05n03 dracut[7954]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 18:04:41 kjcf05n03 dracut[7954]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 18:04:41 kjcf05n03 dracut[7954]: memstrack is available Nov 3 18:04:41 kjcf05n03 dracut[7954]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 18:04:41 kjcf05n03 dracut[7954]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 18:04:42 kjcf05n03 dracut[7954]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 18:04:42 kjcf05n03 dracut[7954]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 18:04:42 kjcf05n03 dracut[7954]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 18:04:42 kjcf05n03 dracut[7954]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 18:04:42 kjcf05n03 dracut[7954]: *** Including module: bash *** Nov 3 18:04:42 kjcf05n03 dracut[7954]: *** Including module: systemd *** Nov 3 18:04:43 kjcf05n03 dracut[7954]: *** Including module: fips *** Nov 3 18:04:43 kjcf05n03 dracut[7954]: *** Including module: systemd-initrd *** Nov 3 18:04:43 kjcf05n03 dracut[7954]: *** Including module: watchdog-modules *** Nov 3 18:04:43 kjcf05n03 dracut[7954]: *** Including module: nss-softokn *** Nov 3 18:04:43 kjcf05n03 dracut[7954]: *** Including module: i18n *** Nov 3 18:04:43 kjcf05n03 dracut[7954]: No KEYMAP configured. Nov 3 18:04:43 kjcf05n03 dracut[7954]: *** Including module: network-legacy *** Nov 3 18:04:44 kjcf05n03 dracut[7954]: *** Including module: network *** Nov 3 18:04:44 kjcf05n03 dracut[7954]: *** Including module: ib_bonding *** Nov 3 18:04:44 kjcf05n03 dracut[7954]: *** Including module: drm *** Nov 3 18:04:44 kjcf05n00 zabbix-server[1463399]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:04:44 kjcf05n00 zabbix-server[1463399]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 333.95\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 202.06\\"}}"' Nov 3 18:04:44 kjcf05n00 log_interesting_event.py[1463399]: Event '46483' acknowledged Nov 3 18:04:46 kjcf05n03 dcs-collectord[5641]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 18:04:46 kjcf05n03 dcs-collectord[5641]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 18:04:48 kjcf05n03 dracut[7954]: *** Including module: hperaid *** Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + install Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + local rule rule_path Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + inst_multiple cat expr Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.9kdV5R/initramfs -a -f cat expr Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + _ret=0 Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + (( 0 != 0 )) Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + : Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + return 0 Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + inst_multiple -o mdmon Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.9kdV5R/initramfs -a -f -o mdmon Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + _ret=0 Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + (( 0 != 0 )) Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + : Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + return 0 Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: ++ command -v partx Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + inst /usr/sbin/partx /sbin/partx Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + local _hostonly_install Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + [[ -e /tmp/dracut.9kdV5R/initramfs//sbin/partx ]] Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.9kdV5R/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + (( 0 != 0 )) Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + : Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: ++ command -v mdadm Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + local _hostonly_install Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + [[ -e /tmp/dracut.9kdV5R/initramfs//sbin/mdadm ]] Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.9kdV5R/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + (( 0 != 0 )) Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + : Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + [[ yes == \y\e\s ]] Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + local _raidconf Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: ++ cmdline Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: ++ local _activated dev line UUID Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: ++ declare -A _activated Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: ++ for dev in "${!host_fs_types[@]}" Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: ++ [[ nfs != *_raid_member ]] Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: ++ continue Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + _raidconf= Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + [[ -n '' ]] Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + inst_rules 64-md-raid.rules Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + local _target=/etc/udev/rules.d _rule _found Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + inst_dir /usr/lib/udev/rules.d Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + [[ -e /tmp/dracut.9kdV5R/initramfs//usr/lib/udev/rules.d ]] Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + return 0 Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + inst_dir /etc/udev/rules.d Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + [[ -e /tmp/dracut.9kdV5R/initramfs//etc/udev/rules.d ]] Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + return 0 Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + for _rule in "$@" Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + continue Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + continue Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + for r in '' $dracutbasedir/rules.d/ Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + [[ 64-md-raid.rules != /* ]] Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + continue Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + for r in '' $dracutbasedir/rules.d/ Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + continue Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + [[ -n '' ]] Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + set +x Nov 3 18:04:48 kjcf05n03 dracut[7954]: Skipping udev rule: 64-md-raid.rules Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + installkernel Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + instmods =drivers/md Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + local _optional=-o Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + local _silent Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + local _ret Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + [[ '' = yes ]] Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + [[ =drivers/md = \-\c ]] Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + [[ =drivers/md = \-\s ]] Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + (( 1 == 0 )) Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.9kdV5R/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + _ret=0 Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + (( 0 != 0 )) Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + [[ -n '' ]] Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + return 0 Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + _ret=0 Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + unset check depends cmdline install installkernel Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + return 0 Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + modules_loaded+='hperaid ' Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + '[' -n '' ']' Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + _d_mod=90kernel-modules Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + _d_mod=kernel-modules Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + [[ '' = yes ]] Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + dinfo '*** Including module: kernel-modules ***' Nov 3 18:04:48 kjcf05n03 kdumpctl[7840]: + set +x Nov 3 18:04:48 kjcf05n03 dracut[7954]: *** Including module: kernel-modules *** Nov 3 18:04:48 kjcf05n03 dracut[7954]: *** Including module: kernel-modules-extra *** Nov 3 18:04:49 kjcf05n03 dracut[7954]: *** Including module: kernel-network-modules *** Nov 3 18:04:49 kjcf05n03 dracut[7954]: *** Including module: diskless-mod *** Nov 3 18:04:49 kjcf05n03 dracut[7954]: *** Including module: fstab-sys *** Nov 3 18:04:49 kjcf05n03 dracut[7954]: *** Including module: nfs *** Nov 3 18:04:49 kjcf05n03 dracut[7954]: *** Including module: rootfs-block *** Nov 3 18:04:49 kjcf05n03 dracut[7954]: *** Including module: terminfo *** Nov 3 18:04:49 kjcf05n03 dracut[7954]: *** Including module: udev-rules *** Nov 3 18:04:50 kjcf05n03 dracut[7954]: Skipping udev rule: 91-permissions.rules Nov 3 18:04:50 kjcf05n03 dracut[7954]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 18:04:50 kjcf05n03 dracut[7954]: *** Including module: dracut-systemd *** Nov 3 18:04:50 kjcf05n03 dracut[7954]: *** Including module: usrmount *** Nov 3 18:04:50 kjcf05n03 dracut[7954]: *** Including module: base *** Nov 3 18:04:50 kjcf05n00 mcfcli[3673891]: %3|1730678690.792|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:04:50 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n03": interface became available Nov 3 18:04:51 kjcf05n03 dracut[7954]: *** Including module: fs-lib *** Nov 3 18:04:51 kjcf05n03 dracut[7954]: *** Including module: kdumpbase *** Nov 3 18:04:51 kjcf05n03 dracut[7954]: *** Including module: memstrack *** Nov 3 18:04:51 kjcf05n03 dracut[7954]: *** Including module: shutdown *** Nov 3 18:04:51 kjcf05n03 dracut[7954]: *** Including module: squash *** Nov 3 18:04:52 kjcf05n03 dracut[7954]: *** Including modules done *** Nov 3 18:04:52 kjcf05n03 dracut[7954]: *** Installing kernel module dependencies *** Nov 3 18:04:52 kjcf05n03 dracut[7954]: *** Installing kernel module dependencies done *** Nov 3 18:04:52 kjcf05n03 dracut[7954]: *** Resolving executable dependencies *** Nov 3 18:04:53 kjcf05n00 mcfcli[3673891]: %3|1730678693.041|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:04:54 kjcf05n03 dracut[7954]: *** Resolving executable dependencies done*** Nov 3 18:04:54 kjcf05n03 dracut[7954]: *** Hardlinking files *** Nov 3 18:04:54 kjcf05n03 dracut[7954]: *** Hardlinking files done *** Nov 3 18:04:54 kjcf05n03 dracut[7954]: *** Generating early-microcode cpio image *** Nov 3 18:04:54 kjcf05n03 dracut[7954]: *** Constructing AuthenticAMD.bin **** Nov 3 18:04:54 kjcf05n03 dracut[7954]: *** Store current command line parameters *** Nov 3 18:04:54 kjcf05n03 dracut[7954]: Stored kernel commandline: Nov 3 18:04:54 kjcf05n03 dracut[7954]: rd.driver.pre=sd_mod Nov 3 18:04:54 kjcf05n03 dracut[7954]: rd.driver.pre=nvme Nov 3 18:04:54 kjcf05n03 dracut[7954]: rd.driver.pre=ipmi_si Nov 3 18:04:54 kjcf05n03 dracut[7954]: rd.driver.pre=ipmi_devintf Nov 3 18:04:54 kjcf05n03 dracut[7954]: rd.driver.pre=ipmi_msghandler Nov 3 18:04:54 kjcf05n03 dracut[7954]: nameserver=172.16.2.2 Nov 3 18:04:54 kjcf05n03 dracut[7954]: nameserver=127.0.0.1 Nov 3 18:04:54 kjcf05n03 dracut[7954]: nameserver=172.16.2.2 Nov 3 18:04:54 kjcf05n03 dracut[7954]: nameserver=127.0.0.1 Nov 3 18:04:54 kjcf05n03 dracut[7954]: ifname=kdump-meth0:00:09:3d:06:9a:1a team=mgmt0:kdump-meth0 Nov 3 18:04:54 kjcf05n03 dracut[7954]: rd.neednet Nov 3 18:04:54 kjcf05n03 dracut[7954]: kdumpnic=mgmt0 Nov 3 18:04:54 kjcf05n03 dracut[7954]: bootdev=mgmt0 Nov 3 18:04:54 kjcf05n03 dracut[7954]: *** Install squash loader *** Nov 3 18:04:53 kjcf05n00 zabbix-server[1463446]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:04:53 kjcf05n00 zabbix-server[1463446]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n03 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n03:system.uptime): 00:02:50\\"}}"' Nov 3 18:04:54 kjcf05n00 log_interesting_event.py[1463446]: Event '46486' acknowledged Nov 3 18:04:54 kjcf05n00 zabbix-server[1463468]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:04:54 kjcf05n00 zabbix-server[1463468]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 3 18:04:54 kjcf05n00 log_interesting_event.py[1463468]: Event '46488' acknowledged Nov 3 18:04:54 kjcf05n03 dracut[7954]: *** Squashing the files inside the initramfs *** Nov 3 18:04:54 kjcf05n00 zabbix-server[1463469]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:04:54 kjcf05n00 zabbix-server[1463469]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 3 18:04:54 kjcf05n00 log_interesting_event.py[1463469]: Event '46489' acknowledged Nov 3 18:04:54 kjcf05n03 dracut[7954]: *** Squashing the files inside the initramfs done *** Nov 3 18:04:54 kjcf05n03 dracut[7954]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 18:04:54 kjcf05n03 dracut[7954]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 18:04:55 kjcf05n03 kdumpctl[7840]: kdump: kexec: loaded kdump kernel Nov 3 18:04:55 kjcf05n03 kdumpctl[7840]: kdump: Starting kdump: [OK] Nov 3 18:04:55 kjcf05n03 systemd[1]: Started Crash recovery kernel arming. Nov 3 18:04:55 kjcf05n03 systemd[1]: Reloading. Nov 3 18:04:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 18:04:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 18:04:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 18:04:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 18:04:55 kjcf05n03 systemd[3128]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:04:55 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:04:55 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:04:55 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 18:04:55 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 18:04:55 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 18:04:55 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 18:04:55 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 18:04:55 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 18:04:55 kjcf05n03 ifdown[14567]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 18:04:55 kjcf05n03 ifdown[14568]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:04:55 kjcf05n03 ifdown[14570]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:04:56 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 18:04:56 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 18:04:56 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 18:04:56 kjcf05n03 ifup[14662]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 18:04:56 kjcf05n03 ifup[14680]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:04:56 kjcf05n03 ifup[14681]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:04:57 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 18:04:57 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 18:04:57 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 18:04:57 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running Nov 3 18:04:57 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 18:04:59 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 18:05:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 18:05:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 18:05:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 18:05:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 18:05:00 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 18:05:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 18:05:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 18:05:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:05:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:05:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:05:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:05:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 18:05:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 18:05:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 18:05:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 18:05:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:05:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:05:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:05:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:05:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 18:05:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 18:05:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 18:05:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 18:05:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 18:05:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 18:05:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 18:05:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 18:05:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 18:05:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 18:05:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 18:05:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 18:05:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 18:05:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 18:05:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 18:05:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 18:05:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 18:05:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 18:05:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 18:05:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 18:05:01 kjcf05n03 ifdown[14855]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 18:05:01 kjcf05n03 ifdown[14856]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:05:01 kjcf05n03 ifdown[14857]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:05:01 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 18:05:01 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 18:05:01 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 18:05:01 kjcf05n03 ifup[14931]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 18:05:01 kjcf05n03 ifup[14933]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:05:01 kjcf05n03 ifup[14934]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:05:02 kjcf05n03 dcs-collectord[5641]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 18:05:02 kjcf05n03 dcs-collectord[5641]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 18:05:03 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 18:05:05 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib0 Nov 3 18:05:05 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 18:05:06 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 18:05:06 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 18:05:06 kjcf05n03 systemd[1]: Reloading. Nov 3 18:05:06 kjcf05n03 systemd[1]: Starting Corosync Cluster Engine... Nov 3 18:05:06 kjcf05n03 await_ha_peer[15250]: Waiting for HA peer kjcf05n02 Nov 3 18:05:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730678705', 'host':'kjcf05n03', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 18:05:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730678705', 'host':'kjcf05n03', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 18:05:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730678705'} Nov 3 18:05:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:05:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730678705'} Nov 3 18:05:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:05:06 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 18:05:06 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 18:05:06 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 18:05:06 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running Nov 3 18:05:06 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 18:05:07 kjcf05n03 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 18:05:07 kjcf05n03 check_diskmonit[15355]: DISKMONITOR CHECK: ERROR: Failed to run dm_report. Exit code: 1. Error output: b'Error: diskmonitor not running\n' Nov 3 18:05:07 kjcf05n03 await_ha_peer[15250]: Peer kjcf05n02 has started, starting HA Nov 3 18:05:08 kjcf05n03 systemd[1]: Started Corosync Cluster Engine. Nov 3 18:05:08 kjcf05n03 systemd[1]: Started Fast STONITH daemon. Nov 3 18:05:08 kjcf05n03 fstonithd.py[15382]: Listening for kdump packets from partner Nov 3 18:05:08 kjcf05n03 systemd[1]: Reloading. Nov 3 18:05:08 kjcf05n03 systemd[3128]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:05:08 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:05:08 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:05:08 kjcf05n03 systemd[1]: Reloading. Nov 3 18:05:08 kjcf05n03 systemd[1]: Reached target resource-agents dependencies. Nov 3 18:05:08 kjcf05n03 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 18:05:09 kjcf05n03 systemd[1]: Reloading. Nov 3 18:05:09 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 18:05:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:05:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:05:09 kjcf05n03 puppet-agent[3572]: Applied catalog in 93.45 seconds Nov 3 18:05:09 kjcf05n03 puppet[3572]: Notice: Applied catalog in 93.45 seconds Nov 3 18:05:09 kjcf05n03 systemd[1]: Started Puppet agent. Nov 3 18:05:09 kjcf05n03 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 18:05:09 kjcf05n03 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 18:05:09 kjcf05n03 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 18:05:09 kjcf05n03 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 18:05:09 kjcf05n03 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 18:05:09 kjcf05n03 systemd[1]: Reached target Timers. Nov 3 18:05:09 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 18:05:09 kjcf05n03 systemd[1]: Starting Set absolute GEM time... Nov 3 18:05:09 kjcf05n03 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 18:05:09 kjcf05n03 wce-disable.sh[15535]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 18:05:09 kjcf05n03 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 18:05:09 kjcf05n03 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 18:05:09 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 18:05:09 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 18:05:09 kjcf05n03 systemd[1]: set_gem_time.service: Succeeded. Nov 3 18:05:09 kjcf05n03 systemd[1]: Started Set absolute GEM time. Nov 3 18:05:09 kjcf05n03 python3.9[15531]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 18:05:09 kjcf05n03 python3.9[15531]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 18:05:09 kjcf05n03 gateway-ec-node.py[15530]: Starting gateway-ec-node service Nov 3 18:05:09 kjcf05n03 RFSF-API[15529]: INFO[2024-11-03T18:05:09-06:00] Datapath API RESTful Service starting Nov 3 18:05:09 kjcf05n03 dp-api-server-node[15529]: INFO[2024-11-03T18:05:09-06:00] Datapath API RESTful Service starting Nov 3 18:05:09 kjcf05n03 RFSF-API[15529]: INFO[2024-11-03T18:05:09-06:00] Running in production mode, starting dbus event listener Nov 3 18:05:09 kjcf05n03 dp-api-server-node[15529]: INFO[2024-11-03T18:05:09-06:00] Running in production mode, starting dbus event listener Nov 3 18:05:09 kjcf05n03 RFSF-API[15529]: INFO[2024-11-03T18:05:09-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 18:05:09 kjcf05n03 dp-api-server-node[15529]: INFO[2024-11-03T18:05:09-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 18:05:09 kjcf05n03 RFSF-API[15529]: INFO[2024-11-03T18:05:09-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 18:05:09 kjcf05n03 dp-api-server-node[15529]: INFO[2024-11-03T18:05:09-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 18:05:09 kjcf05n03 RFSF-API[15529]: INFO[2024-11-03T18:05:09-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 18:05:09 kjcf05n03 dp-api-server-node[15529]: INFO[2024-11-03T18:05:09-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 18:05:09 kjcf05n03 RFSF-API[15529]: INFO[2024-11-03T18:05:09-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 18:05:09 kjcf05n03 dp-api-server-node[15529]: INFO[2024-11-03T18:05:09-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 18:05:09 kjcf05n03 RFSF-API[15529]: INFO[2024-11-03T18:05:09-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 18:05:09 kjcf05n03 dp-api-server-node[15529]: INFO[2024-11-03T18:05:09-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 18:05:09 kjcf05n03 RFSF-API[15529]: INFO[2024-11-03T18:05:09-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 18:05:09 kjcf05n03 dp-api-server-node[15529]: INFO[2024-11-03T18:05:09-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 18:05:09 kjcf05n03 RFSF-API[15529]: INFO[2024-11-03T18:05:09-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 18:05:09 kjcf05n03 dp-api-server-node[15529]: INFO[2024-11-03T18:05:09-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 18:05:09 kjcf05n03 dp-api-server-node[15529]: INFO[2024-11-03T18:05:09-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 18:05:09 kjcf05n03 dp-api-server-node[15529]: INFO[2024-11-03T18:05:09-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 18:05:09 kjcf05n03 dp-api-server-node[15529]: INFO[2024-11-03T18:05:09-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 18:05:09 kjcf05n03 RFSF-API[15529]: INFO[2024-11-03T18:05:09-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 18:05:09 kjcf05n03 RFSF-API[15529]: INFO[2024-11-03T18:05:09-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 18:05:09 kjcf05n03 RFSF-API[15529]: INFO[2024-11-03T18:05:09-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 18:05:13 kjcf05n03 systemd[1]: Reloading. Nov 3 18:05:13 kjcf05n03 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 18:05:13 kjcf05n03 systemd[1]: Reloading. Nov 3 18:05:13 kjcf05n03 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 18:05:14 kjcf05n03 diskmonitor_pre[15863]: Key management is currently disabled.DEAR disabled Nov 3 18:05:14 kjcf05n03 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 18:05:14 kjcf05n00 python3.9[1463974]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 18:05:15 kjcf05n03 sh[15931]: LNET configured: New Created Nov 3 18:05:15 kjcf05n03 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 18:05:15 kjcf05n03 LCNmon[18096]: Interface ib0 is up Nov 3 18:05:15 kjcf05n03 LCNmon[18096]: Interface ib1 is up Nov 3 18:05:15 kjcf05n03 LCNmon[18096]: Can ping through interface ib0 Nov 3 18:05:17 kjcf05n03 dcs-collectord[5641]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 18:05:17 kjcf05n03 dcs-collectord[5641]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 18:05:17 kjcf05n03 dcs-collectord[5641]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: /var/run/diskmonitor does not exist, creating Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: Creating /var/run/diskmonitor/disk Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: Creating /var/run/diskmonitor/encl Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: Creating /var/run/diskmonitor/cli Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: RAS_Interlocks_enabled: 1 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: add handler for sig: 14 sa_flags: 10000004 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: add handler for sig: 1 sa_flags: 10000004 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: add handler for sig: 2 sa_flags: 00000004 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: add handler for sig: 15 sa_flags: 00000004 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: add handler for sig: 6 sa_flags: 00000004 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: add handler for sig: 3 sa_flags: 00000004 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: add handler for sig: 30 sa_flags: 00000004 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: add handler for sig: 20 sa_flags: 00000004 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: add handler for sig: 10 sa_flags: 10000004 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: add handler for sig: 11 sa_flags: 00000004 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: add handler for sig: 7 sa_flags: 00000004 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: add handler for sig: 4 sa_flags: 00000004 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: add handler for sig: 8 sa_flags: 00000004 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: Using HA Baton locks - key: diskmonitor Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: Baton will be held for at most 570 seconds Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: DMMP Enabled: 0 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: random seed: 18077c3b Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: NVMe Enclosure: 1 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: ZFS Enclosure: 0 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: Dbus, Initialized Connection Successfully Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: int_catcher_thread: thread start Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: Received dbus message 4 org.freedesktop.DBus -> :1.111 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b07bec_S4EUNF0MA05386M encl_slot: 0 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b07bed_S4EUNF0MA05387D encl_slot: 0 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 18:05:18 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 18:05:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730678719', 'host':'kjcf05n03', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 18:05:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730678719', 'host':'kjcf05n03', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 18:05:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730678719'} Nov 3 18:05:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730678719'} Nov 3 18:05:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:05:19 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 18:05:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730678719', 'host':'kjcf05n03', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.62, 1.91, 0.88'}"] Nov 3 18:05:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Load', 'description': 'OK - load average: 1.62, 1.91, 0.88', 'message': 'OK - load average: 1.62, 1.91, 0.88', 'value': 'ok', 'timestamp': '1730678719'} Nov 3 18:05:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:05:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730678719', 'host':'kjcf05n03', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 373 processes with STATE = RSZDT '}"] Nov 3 18:05:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Total Processes', 'description': 'PROCS OK: 373 processes with STATE = RSZDT ', 'message': 'PROCS OK: 373 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730678719'} Nov 3 18:05:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:05:20 kjcf05n03 LCNmon[18096]: 10.16.100.60 is unreachable via ib1 Nov 3 18:05:20 kjcf05n03 LCNmon[18096]: Can ping through interface ib1 Nov 3 18:05:20 kjcf05n03 LCNmon[18096]: NIC ib0, initial state UP Nov 3 18:05:20 kjcf05n03 LCNmon[18096]: NIC ib1, initial state UP Nov 3 18:05:20 kjcf05n03 LCNmon[18096]: LCNstat initial state UP Nov 3 18:05:20 kjcf05n03 LCNmon[18096]: LCNmon monitoring hosts kjcf05n03 and kjcf05n02 Nov 3 18:05:20 kjcf05n00 mcfcli[3673891]: %3|1730678720.792|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 18:05:21 kjcf05n03 openhpid[5547]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 18:05:21 kjcf05n03 openhpid[5547]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 18:05:21 kjcf05n03 systemd[1]: openhpid.service: Succeeded. Nov 3 18:05:21 kjcf05n03 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 18:05:21 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 18:05:21 kjcf05n03 systemd[1]: openhpid.service: Supervising process 18760 which is not our child. We'll most likely not notice when it exits. Nov 3 18:05:21 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 18:05:21 kjcf05n03 systemd[1]: Reached target Multi-User System. Nov 3 18:05:21 kjcf05n03 systemd[1]: Reached target Graphical Interface. Nov 3 18:05:21 kjcf05n03 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 18:05:21 kjcf05n03 dcs-collectord[5641]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 18:05:21 kjcf05n03 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 18:05:21 kjcf05n03 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 18:05:21 kjcf05n03 systemd[1]: Startup finished in 50.801s (kernel) + 2min 28.110s (userspace) = 3min 18.912s. Nov 3 18:05:21 kjcf05n03 openhpid[18760]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 18:05:21 kjcf05n03 openhpid[18760]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 18:05:21 kjcf05n03 openhpid[18760]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 18:05:21 kjcf05n03 openhpid[18760]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 18:05:22 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18811 (bash) Nov 3 18:05:22 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 18:05:22 kjcf05n03 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 18:05:22 kjcf05n03 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 18:05:22 kjcf05n03 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 18:05:22 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 18:05:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730678722', 'host':'kjcf05n03', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 18:05:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730678722'} Nov 3 18:05:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:05:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730678722', 'host':'kjcf05n03', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(3528.0B/2200.0B), ib1=(2604.0B/2736.0B), icl0=(7.6kB/9.4kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.3MB), mgmt0=(1478.3MB/8.3MB)'}"] Nov 3 18:05:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(3528.0B/2200.0B), ib1=(2604.0B/2736.0B), icl0=(7.6kB/9.4kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.3MB), mgmt0=(1478.3MB/8.3MB)', 'message': 'NET OK - (Rx/Tx) ib0=(3528.0B/2200.0B), ib1=(2604.0B/2736.0B), icl0=(7.6kB/9.4kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.3MB), mgmt0=(1478.3MB/8.3MB)', 'value': 'ok', 'timestamp': '1730678722'} Nov 3 18:05:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b07bed_S4EUNF0MA05387D encl_sn: USE26000024VS001, slot: 2 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: check_run_sedcmd, No Device name provided Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 18:05:23 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 18:05:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730678723', 'host':'kjcf05n03', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.7% (4427968 kB) used.'}"] Nov 3 18:05:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'RAM usage', 'description': 'OK - 1.7% (4427968 kB) used.', 'message': 'OK - 1.7% (4427968 kB) used.', 'value': 'ok', 'timestamp': '1730678723'} Nov 3 18:05:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:05:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730678727', 'host':'kjcf05n03', 'service_name':'Arrays and Disk Status', 'value':'UNKNOWN', 'message':'Diskmonitor not running'}"] Nov 3 18:05:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Arrays and Disk Status', 'description': 'Diskmonitor not running', 'message': 'Diskmonitor not running', 'value': 'unknown', 'timestamp': '1730678727'} Nov 3 18:05:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:05:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730678437', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 18:05:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730678437'} Nov 3 18:05:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:05:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730678437', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 18:05:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730678437'} Nov 3 18:05:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:05:30 kjcf05n00 mcfcli[3673891]: %3|1730678730.615|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:05:32 kjcf05n03 dcs-collectord[5641]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 18:05:32 kjcf05n03 dcs-collectord[5641]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 18:05:34 kjcf05n00 httpd[902564]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-B): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n03', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 18:05:35 kjcf05n03 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 18:05:47 kjcf05n03 dcs-collectord[5641]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 18:05:47 kjcf05n03 dcs-collectord[5641]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 18:05:51 kjcf05n00 mcfcli[3673891]: %3|1730678751.291|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 18:05:53 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31452 deleted. Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b07bec_S4EUNF0MA05386M encl_sn: USE26000024VS001, slot: 1 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 18:05:58 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 18:06:02 kjcf05n03 dcs-collectord[5641]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 18:06:02 kjcf05n03 dcs-collectord[5641]: WARNING No data collected (hpi_parser.py:353) Nov 3 18:06:05 kjcf05n03 ipmievd[3983]: System Event sensor - Timestamp Clock Sync Nov 3 18:06:06 kjcf05n02 firmware-update-orc-server[5820]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "debd6af5-30dc-49dd-9efe-20f07b6e4c89"} (logger.py:65) Nov 3 18:06:06 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 86270 (get_disk_device) Nov 3 18:06:06 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 18:06:06 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 18:06:06 kjcf05n03 ipmievd[3128]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:06:06 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked thIEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 18:06:06 kjcf05n03 ras-resource-manager-agent[5905]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "963d6668-9a40-11ef-8ef0-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 18:06:06 kjcf05n03 ras-resource-manager-agent[5905]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '963d6668-9a40-11ef-8ef0-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 18:06:06 kjcf05n03 ras-resource-manager-agent[5905]: INFO Submitting new device inserted signal, starting to qualify drive: 963d6668-9a40-11ef-8ef0-00093d069a1b (admin_action.py:110) Nov 3 18:06:06 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '963d6668-9a40-11ef-8ef0-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 18:06:06 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '963d6668-9a40-11ef-8ef0-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 18:06:06 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '963d6668-9a40-11ef-8ef0-00093d069a1b', 'response ID': '9648fe88-9a40-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 18:06:06 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 9648fe88-9a40-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 18:06:06 kjcf05n02 ccp-client[86291]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 18:06:06 kjcf05n02 ccp-client[86291]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 18:06:06 kjcf05n02 ccp-client[86300]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 18:06:06 kjcf05n02 ccp-client[86300]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 18:06:06 kjcf05n02 ccp-client[86300]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 18:06:06 kjcf05n02 ccp-client[86291]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 18:06:06 kjcf05n02 ccp-client[86291]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 18:06:07 kjcf05n03 diskmonitor[17660]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 18:06:07 kjcf05n03 ras-resource-manager-agent[5905]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "96916c40-9a40-11ef-8ef0-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 18:06:07 kjcf05n03 ras-resource-manager-agent[5905]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '96916c40-9a40-11ef-8ef0-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 18:06:07 kjcf05n03 ras-resource-manager-agent[5905]: INFO Submitting new device inserted signal, starting to qualify drive: 96916c40-9a40-11ef-8ef0-00093d069a1b (admin_action.py:110) Nov 3 18:06:07 kjcf05n03 firmware-update-orc-server[5861]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "31859215-46db-4814-a8a5-74909c76afc6"} (logger.py:65) Nov 3 18:06:06 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '96916c40-9a40-11ef-8ef0-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 18:06:06 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '96916c40-9a40-11ef-8ef0-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 18:06:06 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '96916c40-9a40-11ef-8ef0-00093d069a1b', 'response ID': '96994686-9a40-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 18:06:06 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 96994686-9a40-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 18:06:09 kjcf05n02 DRVFW[86413]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 18:06:09 kjcf05n02 ccp-client[86416]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 18:06:09 kjcf05n02 ccp-client[86416]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 18:06:09 kjcf05n02 ccp-client[86425]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 18:06:09 kjcf05n02 ccp-client[86416]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 18:06:09 kjcf05n02 ccp-client[86425]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 18:06:09 kjcf05n02 ccp-client[86425]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 18:06:09 kjcf05n02 ccp-client[86416]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 18:06:09 kjcf05n02 firmware-update-orc-server[5820]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 18:06:10 kjcf05n00 mcfcli[3673891]: %3|1730678770.320|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:06:11 kjcf05n03 ras-resource-manager-agent[5905]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '963d6668-9a40-11ef-8ef0-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 18:06:11 kjcf05n03 ras-resource-manager-agent[5905]: INFO Drive qualification complete responding: 963d6668-9a40-11ef-8ef0-00093d069a1b (admin_action.py:205) Nov 3 18:06:11 kjcf05n03 ras-resource-manager-agent[5905]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "963d6668-9a40-11ef-8ef0-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} (interesting_event.py:59) Nov 3 18:06:11 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 9648fe88-9a40-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 18:06:11 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '963d6668-9a40-11ef-8ef0-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': '963d6668-9a40-11ef-8ef0-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}}} (logger.py:65) Nov 3 18:06:13 kjcf05n03 diskmonitor[17660]: e drive: eui.345950304db010120025384500000004 Nov 3 18:06:13 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 18:06:13 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 18:06:13 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 18:06:13 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 18:06:13 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 18:06:13 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 18:06:13 kjcf05n03 diskmonitor[17660]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 18:06:13 kjcf05n03 diskmonitor[17660]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 18:06:13 kjcf05n03 diskmonitor[17660]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 18:06:13 kjcf05n03 diskmonitor[17660]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 18:06:13 kjcf05n03 diskmonitor[17660]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 18:06:13 kjcf05n03 diskmonitor[17660]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "963d6668-9a40-11ef-8ef0-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 18:06:13 kjcf05n03 diskmonitor[17660]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 18:06:13 kjcf05n03 diskmonitor[17660]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 18:06:13 kjcf05n03 diskmonitor[17660]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "96916c40-9a40-11ef-8ef0-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 18:06:13 kjcf05n03 diskmonitor[17660]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 18:06:13 kjcf05n03 diskmonitor[17660]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 18:06:17 kjcf05n03 dcs-collectord[5641]: INFO Successfully collected data dmreport after 8 failures (dm_report_collection_process.py:204) Nov 3 18:06:17 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22467 (get_disk_device) Nov 3 18:06:17 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 18:06:17 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 18:06:17 kjcf05n03 ccp-client[22488]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 18:06:17 kjcf05n03 ccp-client[22488]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 18:06:17 kjcf05n03 ccp-client[22511]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 18:06:17 kjcf05n03 ccp-client[22488]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 18:06:17 kjcf05n03 ccp-client[22488]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 18:06:17 kjcf05n03 ccp-client[22511]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 18:06:17 kjcf05n03 ccp-client[22511]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 18:06:19 kjcf05n03 chronyd[5148]: Selected source 172.16.2.1 Nov 3 18:06:20 kjcf05n03 DRVFW[22622]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 18:06:20 kjcf05n03 ccp-client[22623]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 18:06:20 kjcf05n03 ccp-client[22623]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 18:06:20 kjcf05n03 ccp-client[22632]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 18:06:20 kjcf05n03 ccp-client[22623]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 18:06:20 kjcf05n03 ccp-client[22623]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 18:06:20 kjcf05n03 ccp-client[22632]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 18:06:20 kjcf05n03 ccp-client[22632]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 18:06:20 kjcf05n03 firmware-update-orc-server[5861]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 18:06:21 kjcf05n03 ras-resource-manager-agent[5905]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '96916c40-9a40-11ef-8ef0-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 3 18:06:21 kjcf05n03 ras-resource-manager-agent[5905]: INFO Drive qualification complete responding: 96916c40-9a40-11ef-8ef0-00093d069a1b (admin_action.py:205) Nov 3 18:06:21 kjcf05n03 ras-resource-manager-agent[5905]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "96916c40-9a40-11ef-8ef0-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (interesting_event.py:59) Nov 3 18:06:20 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 96994686-9a40-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 18:06:20 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '96916c40-9a40-11ef-8ef0-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': '96916c40-9a40-11ef-8ef0-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}}} (logger.py:65) Nov 3 18:06:21 kjcf05n00 mcfcli[3673891]: %3|1730678781.292|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:06:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Inactive', 'timestamp': 1730678781}"] Nov 3 18:06:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730678781, 'value': 'Inactive', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:06:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:06:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:06:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:06:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:06:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:06:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:06:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:06:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:06:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:06:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:06:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:06:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:06:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:06:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.350291ms Nov 3 18:06:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:06:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.350291ms Nov 3 18:06:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:06:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:06:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Inactive', 'timestamp': 1730678781}"] Nov 3 18:06:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730678781, 'value': 'Inactive', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:06:22 kjcf05n03 systemd[1]: Unmounting /mnt/llog... Nov 3 18:06:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:06:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:06:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:06:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:06:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:06:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:06:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:06:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:06:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:06:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:06:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:06:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:06:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:06:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.036494ms Nov 3 18:06:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:06:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.036494ms Nov 3 18:06:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:06:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:06:22 kjcf05n03 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 18:06:22 kjcf05n03 systemd[1]: Unmounted /mnt/llog. Nov 3 18:06:22 kjcf05n03 ras-resource-manager-agent[5905]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "963d6668-9a40-11ef-8ef0-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} (service_main_handler.py:66) Nov 3 18:06:22 kjcf05n03 ras-resource-manager-agent[5905]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '963d6668-9a40-11ef-8ef0-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}} (resource_admin.py:98) Nov 3 18:06:22 kjcf05n03 ras-resource-manager-agent[5905]: INFO Device qualification response has been acknowledged: 963d6668-9a40-11ef-8ef0-00093d069a1b (admin_action.py:151) Nov 3 18:06:22 kjcf05n03 ras-resource-manager-agent[5905]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "96916c40-9a40-11ef-8ef0-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (service_main_handler.py:66) Nov 3 18:06:22 kjcf05n03 ras-resource-manager-agent[5905]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '96916c40-9a40-11ef-8ef0-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 3 18:06:22 kjcf05n03 ras-resource-manager-agent[5905]: INFO Device qualification response has been acknowledged: 96916c40-9a40-11ef-8ef0-00093d069a1b (admin_action.py:151) Nov 3 18:06:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730678783}"] Nov 3 18:06:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730678783, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:06:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:06:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730678783}"] Nov 3 18:06:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730678783, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:06:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:06:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730678783}"] Nov 3 18:06:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730678783, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:06:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:06:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730678783}"] Nov 3 18:06:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730678783, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:06:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:06:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730678783}"] Nov 3 18:06:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730678783, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:06:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:06:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730678783}"] Nov 3 18:06:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730678783, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:06:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:06:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730678783}"] Nov 3 18:06:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730678783, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:06:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:06:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730678783}"] Nov 3 18:06:24 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730678783, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:06:24 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "963d6668-9a40-11ef-8ef0-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: Dbus, handle_ingress_ras_signals, uuid: 963d6668-9a40-11ef-8ef0-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "963d6668-9a40-11ef-8ef0-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "96916c40-9a40-11ef-8ef0-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: Dbus, handle_ingress_ras_signals, uuid: 96916c40-9a40-11ef-8ef0-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "96916c40-9a40-11ef-8ef0-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 18:06:25 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 18:06:25 kjcf05n03 python3.9[5210]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 18:06:26 kjcf05n03 python3.9[3128]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:06:26 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 18:06:27 kjcf05n03 diskmonitor[17660]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 18:06:31 kjcf05n03 diskmonitor[17660]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 18:06:31 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 18:06:31 kjcf05n03 diskmonitor[17660]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 18:06:31 kjcf05n03 diskmonitor[17660]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 18:06:31 kjcf05n03 diskmonitor[17660]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 18:06:31 kjcf05n03 diskmonitor[17660]: leaving test state: 1 next state: 2 Nov 3 18:06:31 kjcf05n03 diskmonitor[17660]: lock req: no timeout Nov 3 18:06:31 kjcf05n03 diskmonitor[17660]: leaving test state: 2 next state: 4 Nov 3 18:06:31 kjcf05n03 diskmonitor[17660]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 18:06:50 kjcf05n00 mcfcli[3673891]: %3|1730678810.257|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:06:51 kjcf05n00 mcfcli[3673891]: %3|1730678811.292|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:07:21 kjcf05n00 mcfcli[3673891]: %3|1730678841.292|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 18:07:27 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 18:07:27 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 18:07:27 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 18:07:30 kjcf05n00 mcfcli[3673891]: %3|1730678850.093|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:07:38 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 18:07:38 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 18:07:38 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 18:07:46 kjcf05n03 diskmonitor[17660]: lock acquired Nov 3 18:07:46 kjcf05n03 diskmonitor[17660]: leaving test state: 4 next state: 8 Nov 3 18:07:49 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 3 18:07:51 kjcf05n00 mcfcli[3673891]: %3|1730678871.292|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 18:07:59 kjcf05n03 diskmonitor[17660]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 18:07:59 kjcf05n03 diskmonitor[17660]: leaving test state: 8 next state: 20 Nov 3 18:07:59 kjcf05n03 diskmonitor[17660]: leaving test state: 20 next state: 40 Nov 3 18:07:59 kjcf05n03 diskmonitor[17660]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 33072780000 Nov 3 18:07:59 kjcf05n03 diskmonitor[17660]: leaving test state: 40 next state: 80 Nov 3 18:08:07 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 18:08:07 kjcf05n00 mcfcli[3673891]: %3|1730678887.110|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:08:10 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 3 18:08:10 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 3 18:08:10 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 3 18:08:17 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 3 18:08:17 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 3 18:08:21 kjcf05n00 mcfcli[3673891]: %3|1730678901.293|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 18:08:32 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 18:08:32 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 18:08:32 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 18:08:47 kjcf05n00 mcfcli[3673891]: %3|1730678927.107|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:08:51 kjcf05n00 mcfcli[3673891]: %3|1730678931.293|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:08:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730678931}"] Nov 3 18:08:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730678931, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:08:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:08:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:08:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:08:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:08:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:08:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:08:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:08:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:08:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:08:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:08:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:08:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:08:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:08:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.315096ms Nov 3 18:08:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:08:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.315096ms Nov 3 18:08:51 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:08:51 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:08:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:08:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730678931}"] Nov 3 18:08:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730678931, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:08:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:08:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:08:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:08:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:08:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:08:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:08:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:08:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:08:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:08:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:08:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:08:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:08:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:08:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.297853ms Nov 3 18:08:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:08:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.297853ms Nov 3 18:08:51 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:08:51 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:08:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:08:54 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31453 deleted. Nov 3 18:09:06 kjcf05n03 diskmonitor[17660]: leaving test state: 80 next state: 100 Nov 3 18:09:06 kjcf05n03 diskmonitor[17660]: lock release: time: Sun Nov 3 18:08:58 2024 Nov 3 18:09:06 kjcf05n03 diskmonitor[17660]: leaving test state: 100 next state: 1 Nov 3 18:09:21 kjcf05n00 mcfcli[3673891]: %3|1730678961.293|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:09:25 kjcf05n00 mcfcli[3673891]: %3|1730678965.149|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:09:40 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 3 18:09:51 kjcf05n00 mcfcli[3673891]: %3|1730678991.295|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 18:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 18:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 18:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 18:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 18:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 18:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 18:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 18:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 18:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 18:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 18:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 18:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 18:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 18:10:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 18:10:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:10:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 18:10:01 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:10:01.110727Z lvl=info msg="Cache snapshot (start)" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name=tsm1_cache_snapshot op_event=start Nov 3 18:10:01 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:10:01.124227Z lvl=info msg="Snapshot for path written" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name=tsm1_cache_snapshot path=/mnt/mgmt/var/lib/influxdb/engine/data/f75a8c5868320c8d/autogen/673 duration=13.501ms Nov 3 18:10:01 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:10:01.124269Z lvl=info msg="Cache snapshot (end)" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name=tsm1_cache_snapshot op_event=end op_elapsed=13.565ms Nov 3 18:10:02 kjcf05n00 mcfcli[3673891]: %3|1730679002.548|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:10:08 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 3 18:10:08 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 3 18:10:14 kjcf05n00 python3.9[1467224]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 18:10:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730679020', 'host':'kjcf05n03', 'service_name':'Arrays and Disk Status', 'value':'OK', 'message':'No arrays found, T10PI: Not relevant on this system\\nTotal number of disk slots available: 24\\nTotal number of disks found: 24\\n\\nslot: 1, wwn: eui.345950304db010370025384500000004, cap: 3840755982336, dev: nvme14n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\nslot: 13, wwn: eui.345950304db010210025384500000004, cap: 3840755982336, dev: nvme13n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\n\\nMD RAID to Lustre mapping\\n\\n\\n\\n\\nDegraded Array information:\\n\\nAll arrays are in clean state on node kjcf05n03'}"] Nov 3 18:10:20 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Arrays and Disk Status', 'description': 'No arrays found, T10PI: Not relevant on this system\\nTotal number of disk slots available: 24\\nTotal number of disks found: 24\\n\\nslot: 1, wwn: eui.345950304db010370025384500000004, cap: 3840755982336, dev: nvme14n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\nslot: 13, wwn: eui.345950304db010210025384500000004, cap: 3840755982336, dev: nvme13n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\n\\nMD RAID to Lustre mapping\\n\\n\\n\\n\\nDegraded Array information:\\n\\nAll arrays are in clean state on node kjcf05n03', 'message': 'No arrays found, T10PI: Not relevant on this system\\nTotal number of disk slots available: 24\\nTotal number of disks found: 24\\n\\nslot: 1, wwn: eui.345950304db010370025384500000004, cap: 3840755982336, dev: nvme14n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\nslot: 13, wwn: eui.345950304db010210025384500000004, cap: 3840755982336, dev: nvme13n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\n\\nMD RAID to Lustre mapping\\n\\n\\n\\n\\nDegraded Array information:\\n\\nAll arrays are in clean state on node kjcf05n03', 'value': 'ok', 'timestamp': '1730679020'} Nov 3 18:10:20 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:10:21 kjcf05n00 mcfcli[3673891]: %3|1730679021.392|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 18:10:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730678437', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 18:10:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730678437'} Nov 3 18:10:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:10:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730678437', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 18:10:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730678437'} Nov 3 18:10:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:10:40 kjcf05n00 mcfcli[3673891]: %3|1730679040.119|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:10:51 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 3 18:10:51 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 3 18:10:51 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 3 18:10:51 kjcf05n00 mcfcli[3673891]: %3|1730679051.393|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 18:11:09 kjcf05n00 zabbix-server[1468027]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:11:09 kjcf05n00 zabbix-server[1468027]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n03' from event '46504' Nov 3 18:11:10 kjcf05n00 zabbix-server[1468027]: Host created 'enclosure_USE26000024VS001' Nov 3 18:11:10 kjcf05n00 zabbix-server[1468027]: Running puppet on 'kjcf05n03' Nov 3 18:11:12 kjcf05n03 puppet-agent[34096]: Using configured environment 'production' Nov 3 18:11:12 kjcf05n03 puppet-agent[34096]: Retrieving pluginfacts Nov 3 18:11:12 kjcf05n03 puppet-agent[34096]: Retrieving plugin Nov 3 18:11:12 kjcf05n03 puppet-agent[34096]: Loading facts Nov 3 18:11:15 kjcf05n03 puppet-agent[34096]: Caching catalog for kjcf05n03 Nov 3 18:11:15 kjcf05n03 puppet-agent[34096]: Applying configuration version '1730679073' Nov 3 18:11:17 kjcf05n03 puppet-agent[34096]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 18:11:17 kjcf05n03 puppet-agent[34096]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 18:11:17 kjcf05n03 puppet-agent[34096]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 18:11:18 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 18:11:18 kjcf05n03 zabbix_agent2[5989]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 18:11:18 kjcf05n03 zabbix_agent2[3128]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:11:18 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 18:11:18 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 18:11:18 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 18:11:18 kjcf05n03 puppet-agent[34096]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: Press Ctrl+C to exit. Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: Plugin support version 1.0 Nov 3 18:11:18 kjcf05n03 zabbix_agent2[34670]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 18:11:20 kjcf05n03 puppet-agent[34096]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 18:11:20 kjcf05n03 puppet-agent[34096]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 18:11:20 kjcf05n03 puppet-agent[34096]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 18:11:20 kjcf05n03 puppet-agent[34096]: Applied catalog in 5.19 seconds Nov 3 18:11:20 kjcf05n00 mcfcli[3673891]: %3|1730679080.116|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:11:20 kjcf05n00 zabbix-server[1468027]: puppet completed status:(0): '' Nov 3 18:11:20 kjcf05n00 zabbix-server[1468027]: Event '46504' acknowledged Nov 3 18:11:20 kjcf05n00 zabbix-server[1468027]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n03"}' Nov 3 18:11:21 kjcf05n00 mcfcli[3673891]: %3|1730679081.393|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:11:38 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 18:11:38 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 18:11:38 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 18:11:51 kjcf05n00 mcfcli[3673891]: %3|1730679111.393|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:11:58 kjcf05n00 mcfcli[3673891]: %3|1730679118.510|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:12:21 kjcf05n00 mcfcli[3673891]: %3|1730679141.393|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 18:12:38 kjcf05n00 mcfcli[3673891]: %3|1730679158.265|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:12:51 kjcf05n00 mcfcli[3673891]: %3|1730679171.394|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:13:18 kjcf05n00 mcfcli[3673891]: %3|1730679198.262|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:13:21 kjcf05n00 mcfcli[3673891]: %3|1730679201.394|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T18:13:27.253146956-06:00 level=info msg="Completed cleanup jobs" duration=26.184448ms Nov 3 18:13:51 kjcf05n00 mcfcli[3673891]: %3|1730679231.394|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 18:13:54 kjcf05n00 mcfcli[3673891]: %3|1730679234.371|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:14:21 kjcf05n00 mcfcli[3673891]: %3|1730679261.798|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 18:14:34 kjcf05n00 mcfcli[3673891]: %3|1730679274.043|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:14:51 kjcf05n00 mcfcli[3673891]: %3|1730679291.798|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:15:12 kjcf05n00 mcfcli[3673891]: %3|1730679312.540|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:15:14 kjcf05n00 python3.9[1470193]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 18:15:21 kjcf05n00 mcfcli[3673891]: %3|1730679321.798|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:15:51 kjcf05n00 mcfcli[3673891]: %3|1730679351.798|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 18:15:52 kjcf05n00 mcfcli[3673891]: %3|1730679352.537|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:15:56 kjcf05n03 root[41616]: failback_xyraid Nov 3 18:15:57 kjcf05n03 root[41742]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 18:15:58 kjcf05n03 root[41817]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 18:16:02 kjcf05n02 systemd[1]: data-kjcf05n03:md66.mount: Succeeded. Nov 3 18:16:06 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme16n1 Nov 3 18:16:06 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme10n1 Nov 3 18:16:06 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme12n1 Nov 3 18:16:06 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme7n1 Nov 3 18:16:06 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme6n1 Nov 3 18:16:06 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme15n1 Nov 3 18:16:06 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme20n1 Nov 3 18:16:06 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme5n1 Nov 3 18:16:06 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme22n1 Nov 3 18:16:06 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme11n1 Nov 3 18:16:06 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme21n1 Nov 3 18:16:10 kjcf05n03 dwd[5181]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 18:16:10 kjcf05n03 dwd[5181]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 18:16:10 kjcf05n03 dwd[5181]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 18:16:10 kjcf05n03 dwd[5181]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 18:16:10 kjcf05n03 dwd[5181]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 18:16:10 kjcf05n03 dwd[5181]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 18:16:10 kjcf05n03 dwd[5181]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 18:16:10 kjcf05n03 dwd[5181]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 18:16:10 kjcf05n03 dwd[5181]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 18:16:10 kjcf05n03 dwd[5181]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 18:16:10 kjcf05n03 dwd[5181]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 18:16:10 kjcf05n03 dwd[5181]: Starting NVME thread for nvme10n1 Nov 3 18:16:10 kjcf05n03 dwd[5181]: Starting NVME thread for nvme15n1 Nov 3 18:16:11 kjcf05n03 dwd[5181]: Starting NVME thread for nvme21n1 Nov 3 18:16:11 kjcf05n03 dwd[5181]: Starting NVME thread for nvme11n1 Nov 3 18:16:11 kjcf05n03 dwd[5181]: Starting NVME thread for nvme20n1 Nov 3 18:16:11 kjcf05n03 systemd-udevd[44659]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44661]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44662]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44664]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44659]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44661]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44664]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44662]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44659]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44661]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44662]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44659]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44664]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44661]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44664]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44659]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44662]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44661]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44659]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44662]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44664]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44661]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44662]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44659]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44664]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44661]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44662]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44664]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44659]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44661]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44664]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44662]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44697]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44699]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44701]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44697]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44703]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44699]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44701]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44703]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44697]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44699]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44703]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44697]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44703]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44697]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44699]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44703]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44697]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44703]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44697]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44703]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44697]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44703]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44703]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44703]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44697]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44703]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44697]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44703]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44697]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44703]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44703]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 systemd-udevd[44703]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:16:11 kjcf05n03 dwd[5181]: Starting NVME thread for nvme12n1 Nov 3 18:16:12 kjcf05n03 diskmonitor[17660]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 18:16:12 kjcf05n03 dwd[5181]: Starting NVME thread for nvme7n1 Nov 3 18:16:12 kjcf05n03 dwd[5181]: Starting NVME thread for nvme6n1 Nov 3 18:16:12 kjcf05n03 dwd[5181]: Starting NVME thread for nvme5n1 Nov 3 18:16:12 kjcf05n03 dwd[5181]: Starting NVME thread for nvme16n1 Nov 3 18:16:12 kjcf05n03 dwd[5181]: Starting NVME thread for nvme22n1 Nov 3 18:16:14 kjcf05n03 nslcd[6935]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 18:16:15 kjcf05n03 dcs-bulk-data-sender[6195]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 141}' Nov 3 18:16:18 kjcf05n03 diskmonitor[17660]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 18:16:18 kjcf05n03 diskmonitor[17660]: Scan for ReadErrorMax change for md66 Nov 3 18:16:18 kjcf05n03 diskmonitor[17660]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 18:16:18 kjcf05n03 diskmonitor[17660]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 18:16:18 kjcf05n03 diskmonitor[17660]: read_saved_file: md66 no saved speed Nov 3 18:16:18 kjcf05n03 diskmonitor[17660]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 18:16:18 kjcf05n03 diskmonitor[17660]: Set sync_speed_min (10000) for md66 Nov 3 18:16:18 kjcf05n03 diskmonitor[17660]: Set sync_speed_max (200000) for md66 Nov 3 18:16:18 kjcf05n03 diskmonitor[17660]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 18:16:21 kjcf05n00 mcfcli[3673891]: %3|1730679381.798|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 18:16:30 kjcf05n00 mcfcli[3673891]: %3|1730679390.861|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:16:33 kjcf05n02 diskmonitor[17328]: Removed MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 18:16:33 kjcf05n02 diskmonitor[17328]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 18:16:51 kjcf05n00 mcfcli[3673891]: %3|1730679411.798|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 18:17:03 kjcf05n03 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 18:17:03 kjcf05n03 systemd-tmpfiles[47678]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 18:17:03 kjcf05n03 systemd-tmpfiles[47678]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 18:17:03 kjcf05n03 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 18:17:03 kjcf05n03 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 18:17:05 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47843 (bash) Nov 3 18:17:05 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 18:17:05 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 18:17:09 kjcf05n00 mcfcli[3673891]: %3|1730679429.806|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:17:21 kjcf05n00 mcfcli[3673891]: %3|1730679441.798|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 18:17:48 kjcf05n00 mcfcli[3673891]: %3|1730679468.045|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:17:51 kjcf05n00 mcfcli[3673891]: %3|1730679471.799|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:18:21 kjcf05n00 mcfcli[3673891]: %3|1730679501.799|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:18:28 kjcf05n00 mcfcli[3673891]: %3|1730679508.042|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:18:51 kjcf05n00 mcfcli[3673891]: %3|1730679531.799|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 18:18:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730679532}"] Nov 3 18:18:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730679532, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:18:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.030713ms Nov 3 18:18:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.030713ms Nov 3 18:18:52 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:18:52 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:18:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:18:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730679532}"] Nov 3 18:18:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730679532, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:18:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.949821ms Nov 3 18:18:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.949821ms Nov 3 18:18:52 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:18:52 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:18:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:18:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730679532}"] Nov 3 18:18:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730679532, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:18:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.876043ms Nov 3 18:18:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.876043ms Nov 3 18:18:52 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:18:52 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:18:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:18:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730679532}"] Nov 3 18:18:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730679532, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:18:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.943139ms Nov 3 18:18:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.943139ms Nov 3 18:18:52 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:18:52 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:18:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:18:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730679532}"] Nov 3 18:18:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730679532, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:18:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.630474ms Nov 3 18:18:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.630474ms Nov 3 18:18:52 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:18:52 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:18:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:18:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730679532}"] Nov 3 18:18:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730679532, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:18:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.596841ms Nov 3 18:18:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.596841ms Nov 3 18:18:52 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:18:52 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:18:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:18:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730679532}"] Nov 3 18:18:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730679532, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:18:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.719681ms Nov 3 18:18:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.719681ms Nov 3 18:18:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:18:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:18:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:18:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730679532}"] Nov 3 18:18:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730679532, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:18:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.470496ms Nov 3 18:18:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.470496ms Nov 3 18:18:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:18:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:18:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:18:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730679532}"] Nov 3 18:18:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730679532, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:18:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.047275ms Nov 3 18:18:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.047275ms Nov 3 18:18:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:18:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:18:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:18:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730679532}"] Nov 3 18:18:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730679532, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:18:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.118718ms Nov 3 18:18:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.118718ms Nov 3 18:18:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:18:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:18:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:18:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730679532}"] Nov 3 18:18:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730679532, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:18:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:18:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:18:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:18:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:18:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:18:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:18:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.997501ms Nov 3 18:18:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:18:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.997501ms Nov 3 18:18:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:18:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:18:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:19:03 kjcf05n00 mcfcli[3673891]: %3|1730679543.439|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:19:12 kjcf05n00 zabbix-server[1472607]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:19:12 kjcf05n00 zabbix-server[1472607]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n03' from event '46506' Nov 3 18:19:12 kjcf05n00 zabbix-server[1472607]: Filesystem 'kjcf05' has been mounted Nov 3 18:19:13 kjcf05n00 zabbix-server[1472607]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 18:19:13 kjcf05n00 zabbix-server[1472607]: Running puppet on 'None' Nov 3 18:19:15 kjcf05n07 puppet-agent[3727877]: Using configured environment 'production' Nov 3 18:19:15 kjcf05n07 puppet-agent[3727877]: Retrieving pluginfacts Nov 3 18:19:15 kjcf05n07 puppet-agent[3727877]: Retrieving plugin Nov 3 18:19:15 kjcf05n03 puppet-agent[51267]: Using configured environment 'production' Nov 3 18:19:15 kjcf05n03 puppet-agent[51267]: Retrieving pluginfacts Nov 3 18:19:15 kjcf05n03 puppet-agent[51267]: Retrieving plugin Nov 3 18:19:15 kjcf05n03 puppet-agent[51267]: Loading facts Nov 3 18:19:15 kjcf05n02 puppet-agent[111186]: Using configured environment 'production' Nov 3 18:19:15 kjcf05n02 puppet-agent[111186]: Retrieving pluginfacts Nov 3 18:19:15 kjcf05n02 puppet-agent[111186]: Retrieving plugin Nov 3 18:19:15 kjcf05n05 puppet-agent[3899036]: Using configured environment 'production' Nov 3 18:19:15 kjcf05n05 puppet-agent[3899036]: Retrieving pluginfacts Nov 3 18:19:15 kjcf05n05 puppet-agent[3899036]: Retrieving plugin Nov 3 18:19:15 kjcf05n06 puppet-agent[3730017]: Using configured environment 'production' Nov 3 18:19:15 kjcf05n06 puppet-agent[3730017]: Retrieving pluginfacts Nov 3 18:19:15 kjcf05n06 puppet-agent[3730017]: Retrieving plugin Nov 3 18:19:15 kjcf05n04 puppet-agent[3731906]: Using configured environment 'production' Nov 3 18:19:15 kjcf05n04 puppet-agent[3731906]: Retrieving pluginfacts Nov 3 18:19:15 kjcf05n04 puppet-agent[3731906]: Retrieving plugin Nov 3 18:19:15 kjcf05n07 puppet-agent[3727877]: Loading facts Nov 3 18:19:15 kjcf05n02 puppet-agent[111186]: Loading facts Nov 3 18:19:15 kjcf05n01 puppet-agent[3232595]: Using configured environment 'production' Nov 3 18:19:15 kjcf05n01 puppet-agent[3232595]: Retrieving pluginfacts Nov 3 18:19:15 kjcf05n01 puppet-agent[3232595]: Retrieving plugin Nov 3 18:19:15 kjcf05n01 puppet-agent[3232595]: Loading facts Nov 3 18:19:15 kjcf05n05 puppet-agent[3899036]: Loading facts Nov 3 18:19:15 kjcf05n06 puppet-agent[3730017]: Loading facts Nov 3 18:19:16 kjcf05n04 puppet-agent[3731906]: Loading facts Nov 3 18:19:15 kjcf05n00 puppet-agent[1472708]: Using configured environment 'production' Nov 3 18:19:15 kjcf05n00 puppet-agent[1472708]: Retrieving pluginfacts Nov 3 18:19:15 kjcf05n00 puppet-agent[1472708]: Retrieving plugin Nov 3 18:19:16 kjcf05n00 puppet-agent[1472708]: Loading facts Nov 3 18:19:18 kjcf05n03 puppet-agent[51267]: Caching catalog for kjcf05n03 Nov 3 18:19:18 kjcf05n03 puppet-agent[51267]: Applying configuration version '1730679556' Nov 3 18:19:18 kjcf05n02 puppet-agent[111186]: Caching catalog for kjcf05n02 Nov 3 18:19:18 kjcf05n02 puppet-agent[111186]: Applying configuration version '1730679556' Nov 3 18:19:18 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 18:19:18 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 18:19:18 kjcf05n07 puppet-agent[3727877]: Caching catalog for kjcf05n07 Nov 3 18:19:18 kjcf05n07 puppet-agent[3727877]: Applying configuration version '1730679557' Nov 3 18:19:18 kjcf05n06 puppet-agent[3730017]: Caching catalog for kjcf05n06 Nov 3 18:19:18 kjcf05n06 puppet-agent[3730017]: Applying configuration version '1730679557' Nov 3 18:19:19 kjcf05n01 puppet-agent[3232595]: Caching catalog for kjcf05n01 Nov 3 18:19:20 kjcf05n01 puppet-agent[3232595]: Applying configuration version '1730679557' Nov 3 18:19:19 kjcf05n00 puppet-agent[1472708]: Caching catalog for kjcf05n00 Nov 3 18:19:19 kjcf05n00 puppet-agent[1472708]: Applying configuration version '1730679557' Nov 3 18:19:20 kjcf05n06 puppet-agent[3730017]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 18:19:20 kjcf05n02 puppet-agent[111186]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 18:19:20 kjcf05n02 puppet-agent[111186]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 18:19:20 kjcf05n02 puppet-agent[111186]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 18:19:20 kjcf05n03 puppet-agent[51267]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 18:19:20 kjcf05n03 puppet-agent[51267]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 18:19:20 kjcf05n03 puppet-agent[51267]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 18:19:20 kjcf05n06 puppet-agent[3730017]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 18:19:20 kjcf05n06 puppet-agent[3730017]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 18:19:21 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 18:19:21 kjcf05n03 zabbix_agent2[34670]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 18:19:21 kjcf05n03 zabbix_agent2[3128]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:19:21 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 18:19:21 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 18:19:21 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 18:19:21 kjcf05n03 puppet-agent[51267]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: Press Ctrl+C to exit. Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: Plugin support version 1.0 Nov 3 18:19:21 kjcf05n03 zabbix_agent2[51731]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 18:19:21 kjcf05n07 puppet-agent[3727877]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 18:19:21 kjcf05n07 puppet-agent[3727877]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 18:19:21 kjcf05n07 puppet-agent[3727877]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 18:19:21 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 18:19:21 kjcf05n02 zabbix_agent2[53006]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 18:19:21 kjcf05n02 zabbix_agent2[3127]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 18:19:21 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 18:19:21 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 18:19:21 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 18:19:21 kjcf05n02 puppet-agent[111186]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: Press Ctrl+C to exit. Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: Plugin support version 1.0 Nov 3 18:19:21 kjcf05n02 zabbix_agent2[111756]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 18:19:21 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3677913]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 18:19:21 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 18:19:21 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 18:19:21 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 18:19:21 kjcf05n06 puppet-agent[3730017]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: Press Ctrl+C to exit. Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: Plugin support version 1.0 Nov 3 18:19:21 kjcf05n06 zabbix_agent2[3730733]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 18:19:21 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3675510]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 18:19:21 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 18:19:21 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 18:19:21 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 18:19:21 kjcf05n07 puppet-agent[3727877]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: Press Ctrl+C to exit. Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: Plugin support version 1.0 Nov 3 18:19:21 kjcf05n07 zabbix_agent2[3728467]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 18:19:21 kjcf05n00 mcfcli[3673891]: %3|1730679561.800|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 18:19:22 kjcf05n00 puppet-agent[1472708]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 18:19:22 kjcf05n01 puppet-agent[3232595]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 18:19:22 kjcf05n06 puppet-agent[3730017]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 18:19:22 kjcf05n06 puppet-agent[3730017]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 18:19:22 kjcf05n06 puppet-agent[3730017]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 18:19:23 kjcf05n01 puppet-agent[3232595]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-17:58:01]/mode) mode changed '0755' to '0750' Nov 3 18:19:23 kjcf05n01 puppet-agent[3232595]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-17:58:01/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 18:19:23 kjcf05n01 puppet-agent[3232595]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-17:58:01/vmcore]/mode) mode changed '0600' to '0640' Nov 3 18:19:23 kjcf05n01 puppet-agent[3232595]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-17:58:01/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 18:19:23 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 18:19:23 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 18:19:23 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 18:19:23 kjcf05n03 puppet-agent[51267]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 18:19:23 kjcf05n03 puppet-agent[51267]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 18:19:23 kjcf05n03 puppet-agent[51267]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 18:19:23 kjcf05n02 puppet-agent[111186]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 18:19:23 kjcf05n02 puppet-agent[111186]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 18:19:23 kjcf05n02 puppet-agent[111186]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 18:19:23 kjcf05n02 puppet-agent[111186]: Applied catalog in 5.15 seconds Nov 3 18:19:23 kjcf05n07 puppet-agent[3727877]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 18:19:23 kjcf05n07 puppet-agent[3727877]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 18:19:23 kjcf05n07 puppet-agent[3727877]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 18:19:23 kjcf05n06 puppet-agent[3730017]: Applied catalog in 4.72 seconds Nov 3 18:19:23 kjcf05n03 puppet-agent[51267]: Applied catalog in 4.98 seconds Nov 3 18:19:23 kjcf05n01 puppet-agent[3232595]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 18:19:23 kjcf05n01 puppet-agent[3232595]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 18:19:23 kjcf05n01 puppet-agent[3232595]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 18:19:23 kjcf05n00 puppet-agent[1472708]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 18:19:23 kjcf05n00 puppet-agent[1472708]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 18:19:23 kjcf05n00 puppet-agent[1472708]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 18:19:23 kjcf05n07 puppet-agent[3727877]: Applied catalog in 4.82 seconds Nov 3 18:19:24 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3220731]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 18:19:24 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 18:19:24 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 18:19:24 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 18:19:24 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 18:19:24 kjcf05n01 puppet-agent[3232595]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: Press Ctrl+C to exit. Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: Plugin support version 1.0 Nov 3 18:19:24 kjcf05n01 zabbix_agent2[3233042]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 18:19:24 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1454246]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 18:19:24 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 18:19:24 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 18:19:24 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 18:19:24 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 18:19:24 kjcf05n00 puppet-agent[1472708]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: Press Ctrl+C to exit. Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: Plugin support version 1.0 Nov 3 18:19:24 kjcf05n00 zabbix_agent2[1473305]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 18:19:24 kjcf05n00 zabbix-server[1473331]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:19:25 kjcf05n00 zabbix-server[1473332]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:19:25 kjcf05n00 zabbix-server[1473341]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:19:25 kjcf05n00 zabbix-server[1473343]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:19:26 kjcf05n01 puppet-agent[3232595]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_180521.log]/mode) mode changed '0644' to '0640' Nov 3 18:19:26 kjcf05n01 puppet-agent[3232595]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_181704.log]/mode) mode changed '0644' to '0640' Nov 3 18:19:26 kjcf05n00 puppet-agent[1472708]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 18:19:27 kjcf05n01 puppet-agent[3232595]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_180521.log]/mode) mode changed '0644' to '0640' Nov 3 18:19:27 kjcf05n01 puppet-agent[3232595]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_181704.log]/mode) mode changed '0644' to '0640' Nov 3 18:19:27 kjcf05n01 puppet-agent[3232595]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_181705]/mode) mode changed '0755' to '0750' Nov 3 18:19:27 kjcf05n01 puppet-agent[3232595]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_181705/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 18:19:27 kjcf05n01 puppet-agent[3232595]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 18:19:27 kjcf05n01 puppet-agent[3232595]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 18:19:27 kjcf05n01 puppet-agent[3232595]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 18:19:27 kjcf05n00 puppet-agent[1472708]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 18:19:27 kjcf05n00 puppet-agent[1472708]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 18:19:27 kjcf05n00 puppet-agent[1472708]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 18:19:27 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 18:19:28 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 18:19:27 kjcf05n00 puppet-agent[1472708]: Applied catalog in 8.41 seconds Nov 3 18:19:28 kjcf05n01 puppet-agent[3232595]: Applied catalog in 8.87 seconds Nov 3 18:19:31 kjcf05n04 puppet-agent[3731906]: Caching catalog for kjcf05n04 Nov 3 18:19:31 kjcf05n04 puppet-agent[3731906]: Applying configuration version '1730679569' Nov 3 18:19:33 kjcf05n04 puppet-agent[3731906]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 18:19:33 kjcf05n04 puppet-agent[3731906]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 18:19:33 kjcf05n04 puppet-agent[3731906]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 18:19:34 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3674868]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 18:19:34 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 18:19:34 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 18:19:34 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 18:19:34 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 18:19:34 kjcf05n04 puppet-agent[3731906]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: Press Ctrl+C to exit. Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: Plugin support version 1.0 Nov 3 18:19:34 kjcf05n04 zabbix_agent2[3732993]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 18:19:35 kjcf05n04 puppet-agent[3731906]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 18:19:35 kjcf05n04 puppet-agent[3731906]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 18:19:35 kjcf05n04 puppet-agent[3731906]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 18:19:35 kjcf05n04 puppet-agent[3731906]: Applied catalog in 4.80 seconds Nov 3 18:19:37 kjcf05n05 puppet-agent[3899036]: Caching catalog for kjcf05n05 Nov 3 18:19:37 kjcf05n05 puppet-agent[3899036]: Applying configuration version '1730679575' Nov 3 18:19:39 kjcf05n05 puppet-agent[3899036]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 18:19:39 kjcf05n05 puppet-agent[3899036]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 18:19:39 kjcf05n05 puppet-agent[3899036]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 18:19:39 kjcf05n00 mcfcli[3673891]: %3|1730679579.400|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:19:40 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3840261]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 18:19:40 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 18:19:40 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 18:19:40 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 18:19:40 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 18:19:40 kjcf05n05 puppet-agent[3899036]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: Press Ctrl+C to exit. Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: Plugin support version 1.0 Nov 3 18:19:40 kjcf05n05 zabbix_agent2[3900472]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 18:19:41 kjcf05n05 puppet-agent[3899036]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 18:19:41 kjcf05n05 puppet-agent[3899036]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 18:19:41 kjcf05n05 puppet-agent[3899036]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 18:19:42 kjcf05n05 puppet-agent[3899036]: Applied catalog in 4.72 seconds Nov 3 18:19:41 kjcf05n00 zabbix-server[1472607]: puppet completed status:(0): '' Nov 3 18:19:42 kjcf05n00 zabbix-server[1472607]: Event '46506' acknowledged Nov 3 18:19:42 kjcf05n00 zabbix-server[1472607]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n03"}' Nov 3 18:19:52 kjcf05n00 mcfcli[3673891]: %3|1730679592.301|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 18:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 18:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 18:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 18:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 18:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 18:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 18:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 18:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 18:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 18:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 18:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 18:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 18:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 18:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 18:20:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 18:20:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:20:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 18:20:14 kjcf05n00 python3.9[1473686]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 18:20:19 kjcf05n00 mcfcli[3673891]: %3|1730679619.397|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:20:22 kjcf05n00 mcfcli[3673891]: %3|1730679622.396|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 18:20:24 kjcf05n00 zabbix-server[1474011]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:20:24 kjcf05n00 zabbix-server[1474011]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 51.91\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 52.94\\"}}"' Nov 3 18:20:24 kjcf05n00 log_interesting_event.py[1474011]: Event '46507' acknowledged Nov 3 18:20:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730679637', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 18:20:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730679637'} Nov 3 18:20:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:20:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730679637', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 18:20:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730679637'} Nov 3 18:20:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:20:52 kjcf05n00 mcfcli[3673891]: %3|1730679652.397|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 18:20:58 kjcf05n00 mcfcli[3673891]: %3|1730679658.860|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:21:22 kjcf05n00 mcfcli[3673891]: %3|1730679682.397|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:21:25 kjcf05n03 dwd[5181]: nvme15n1 passed periodic SMART status check Nov 3 18:21:25 kjcf05n03 dwd[5181]: nvme10n1 passed periodic SMART status check Nov 3 18:21:26 kjcf05n03 dwd[5181]: nvme12n1 passed periodic SMART status check Nov 3 18:21:26 kjcf05n03 dwd[5181]: nvme21n1 passed periodic SMART status check Nov 3 18:21:26 kjcf05n03 dwd[5181]: nvme20n1 passed periodic SMART status check Nov 3 18:21:26 kjcf05n03 dwd[5181]: nvme11n1 passed periodic SMART status check Nov 3 18:21:27 kjcf05n03 dwd[5181]: nvme22n1 passed periodic SMART status check Nov 3 18:21:27 kjcf05n03 dwd[5181]: nvme5n1 passed periodic SMART status check Nov 3 18:21:27 kjcf05n03 dwd[5181]: nvme7n1 passed periodic SMART status check Nov 3 18:21:27 kjcf05n03 dwd[5181]: nvme16n1 passed periodic SMART status check Nov 3 18:21:27 kjcf05n03 dwd[5181]: nvme6n1 passed periodic SMART status check Nov 3 18:21:35 kjcf05n00 mcfcli[3673891]: %3|1730679695.843|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:21:52 kjcf05n00 mcfcli[3673891]: %3|1730679712.397|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:22:15 kjcf05n00 mcfcli[3673891]: %3|1730679735.840|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:22:22 kjcf05n00 mcfcli[3673891]: %3|1730679742.397|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:22:52 kjcf05n00 mcfcli[3673891]: %3|1730679772.803|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 18:22:55 kjcf05n00 mcfcli[3673891]: %3|1730679775.351|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:23:15.867510Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 18:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:23:15.867809Z lvl=info msg="Deleted shard group" log_id=0s8llxRG000 service=retention op_name=retention_delete_check db_instance=f75a8c5868320c8d db_shard_group=659 db_rp=autogen Nov 3 18:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:23:15.867948Z lvl=info msg="Deleted shard group" log_id=0s8llxRG000 service=retention op_name=retention_delete_check db_instance=062bb96ccbd0518a db_shard_group=660 db_rp=autogen Nov 3 18:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:23:15.877256Z lvl=info msg="Deleted shard" log_id=0s8llxRG000 service=retention op_name=retention_delete_check db_instance=f75a8c5868320c8d db_shard_id=659 db_rp=autogen Nov 3 18:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:23:15.878601Z lvl=info msg="Deleted shard" log_id=0s8llxRG000 service=retention op_name=retention_delete_check db_instance=062bb96ccbd0518a db_shard_id=660 db_rp=autogen Nov 3 18:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:23:15.878831Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=11.375ms Nov 3 18:23:22 kjcf05n00 mcfcli[3673891]: %3|1730679802.803|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T18:23:27.267713754-06:00 level=info msg="Completed cleanup jobs" duration=41.18949ms Nov 3 18:23:31 kjcf05n00 mcfcli[3673891]: %3|1730679811.287|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:23:52 kjcf05n00 mcfcli[3673891]: %3|1730679832.803|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 18:24:10 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 3 18:24:10 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 14 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007767 sec, idle for 1 hour(s)] Nov 3 18:24:10 kjcf05n00 mcfcli[3673891]: %3|1730679850.944|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:24:22 kjcf05n00 mcfcli[3673891]: %3|1730679862.803|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:24:44 kjcf05n00 mcfcli[3673891]: %3|1730679884.892|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:24:52 kjcf05n00 mcfcli[3673891]: %3|1730679892.804|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 18:25:15 kjcf05n00 python3.9[1476670]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 18:25:23 kjcf05n00 mcfcli[3673891]: %3|1730679923.303|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 18:25:24 kjcf05n00 mcfcli[3673891]: %3|1730679924.889|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:25:53 kjcf05n00 mcfcli[3673891]: %3|1730679953.303|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:25:58 kjcf05n02 nslcd[6896]: [e87ccd] ldap_result() failed: Can't contact LDAP server Nov 3 18:26:01 kjcf05n00 mcfcli[3673891]: %3|1730679961.773|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:26:23 kjcf05n00 mcfcli[3673891]: %3|1730679983.304|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 18:26:39 kjcf05n00 mcfcli[3673891]: %3|1730679999.330|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:26:53 kjcf05n00 mcfcli[3673891]: %3|1730680013.304|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 18:27:17 kjcf05n00 mcfcli[3673891]: %3|1730680037.191|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:27:23 kjcf05n00 mcfcli[3673891]: %3|1730680043.305|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:27:53 kjcf05n00 mcfcli[3673891]: %3|1730680073.399|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 18:27:55 kjcf05n00 mcfcli[3673891]: %3|1730680075.408|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 18:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 18:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 18:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 18:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 18:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 18:28:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 18:28:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 18:28:05 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib0 Nov 3 18:28:05 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib0 Nov 3 18:28:09 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib1 Nov 3 18:28:09 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib1 Nov 3 18:28:10 kjcf05n00 zabbix_server[15718]: Zabbix agent item "dcs.lustre.filesystem_name[kjcf05]" on host "kjcf05n03" failed: first network error, wait for 15 seconds Nov 3 18:28:16 kjcf05n02 fstonithd.py[15068]: My partner 172.16.2.6 is kdumping. Forcing HA into GATHER state. Nov 3 18:28:16 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 18:28:16 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 18:28:16 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 18:28:18 kjcf05n02 root[127207]: is_enc_ipmi_off starts Nov 3 18:28:18 kjcf05n02 root[127209]: is_viking_off starts Nov 3 18:28:18 kjcf05n02 root[127225]: is_lan_ipmi_off leaves Nov 3 18:28:18 kjcf05n02 root[127227]: is_lan_ipmi_sec_off leaves Nov 3 18:28:18 kjcf05n02 root[127230]: I am master Nov 3 18:28:18 kjcf05n02 root[127233]: I am in slot 0; partner is in slot 1 Nov 3 18:28:23 kjcf05n00 mcfcli[3673891]: %3|1730680103.400|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:28:24 kjcf05n02 root[127368]: is_viking_off leaves Nov 3 18:28:24 kjcf05n02 root[127371]: kjcf05n03 not already off look at kdump Nov 3 18:28:24 kjcf05n02 root[127372]: is_kdump_off starts Nov 3 18:28:24 kjcf05n02 fence_kdump[127373]: waiting for message from '172.16.2.6' Nov 3 18:28:25 kjcf05n02 fence_kdump[127373]: received valid message from '172.16.2.6' Nov 3 18:28:25 kjcf05n02 root[127390]: is_kdump_off detected kdump on kjcf05n03 Nov 3 18:28:25 kjcf05n00 zabbix_server[15719]: Zabbix agent item "proc.num[,,run]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 18:28:25 kjcf05n02 root[127391]: kjcf05n03 is kdumping Nov 3 18:28:25 kjcf05n02 root[127489]: is_viking_off starts Nov 3 18:28:25 kjcf05n02 root[127488]: is_enc_ipmi_off starts Nov 3 18:28:25 kjcf05n02 root[127508]: I am master Nov 3 18:28:25 kjcf05n02 root[127511]: I am in slot 0; partner is in slot 1 Nov 3 18:28:25 kjcf05n02 root[127513]: is_lan_ipmi_off leaves Nov 3 18:28:25 kjcf05n02 root[127526]: is_lan_ipmi_sec_off leaves Nov 3 18:28:26 kjcf05n00 zabbix_server[15743]: Zabbix agent item "vfs.fs.size[/var/lib/mdraidscripts,used]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 18:28:27 kjcf05n00 zabbix_server[15752]: Zabbix agent item "system.cpu.intr" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 18:28:28 kjcf05n00 zabbix_server[15754]: Zabbix agent item "system.cpu.load[all,avg15]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 18:28:29 kjcf05n00 zabbix_server[15730]: Zabbix agent item "system.cpu.load[all,avg1]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 18:28:32 kjcf05n02 root[127708]: is_viking_off leaves Nov 3 18:28:32 kjcf05n02 root[127711]: kjcf05n03 not already off look at kdump Nov 3 18:28:32 kjcf05n02 root[127712]: is_kdump_off starts Nov 3 18:28:32 kjcf05n02 fence_kdump[127713]: waiting for message from '172.16.2.6' Nov 3 18:28:32 kjcf05n02 fence_kdump[127713]: received valid message from '172.16.2.6' Nov 3 18:28:32 kjcf05n02 root[127730]: is_kdump_off detected kdump on kjcf05n03 Nov 3 18:28:32 kjcf05n02 root[127731]: kjcf05n03 is kdumping Nov 3 18:28:34 kjcf05n00 mcfcli[3673891]: %3|1730680114.345|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:28:34 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 3 18:28:34 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 3 18:28:36 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='15', error='Connection reset by peer (104)' Nov 3 18:28:36 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='15', client='AF_INET(172.16.2.6:43145)', local='AF_INET(0.0.0.0:601)' Nov 3 18:28:37 kjcf05n02 systemd-udevd[130010]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130007]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130012]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130010]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130012]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130007]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130010]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130012]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130007]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130010]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130012]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130007]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130010]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130012]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130007]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130012]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130010]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130007]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130010]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130012]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130007]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130012]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130010]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130007]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130050]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130052]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130054]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130056]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130049]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130054]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130050]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130056]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130049]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130052]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130056]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130049]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130049]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130056]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130052]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130049]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130049]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130052]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130049]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130052]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130049]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130052]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130049]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130049]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130052]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130049]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130049]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130052]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130049]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130052]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130049]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 systemd-udevd[130049]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:28:37 kjcf05n02 dwd[5139]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 18:28:37 kjcf05n02 dwd[5139]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 18:28:37 kjcf05n02 dwd[5139]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 18:28:37 kjcf05n02 dwd[5139]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 18:28:37 kjcf05n02 dwd[5139]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 18:28:37 kjcf05n02 dwd[5139]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 18:28:37 kjcf05n02 dwd[5139]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 18:28:37 kjcf05n02 dwd[5139]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 18:28:37 kjcf05n02 dwd[5139]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 18:28:37 kjcf05n02 dwd[5139]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 18:28:37 kjcf05n02 dwd[5139]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 18:28:37 kjcf05n02 dwd[5139]: Starting NVME thread for nvme6n1 Nov 3 18:28:37 kjcf05n02 dwd[5139]: Starting NVME thread for nvme15n1 Nov 3 18:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 18:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 18:28:37 kjcf05n02 dwd[5139]: Starting NVME thread for nvme16n1 Nov 3 18:28:37 kjcf05n02 dwd[5139]: Starting NVME thread for nvme5n1 Nov 3 18:28:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 18:28:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 18:28:38 kjcf05n02 dwd[5139]: Starting NVME thread for nvme20n1 Nov 3 18:28:38 kjcf05n02 dwd[5139]: Starting NVME thread for nvme11n1 Nov 3 18:28:38 kjcf05n02 dwd[5139]: Starting NVME thread for nvme22n1 Nov 3 18:28:38 kjcf05n02 dwd[5139]: Starting NVME thread for nvme21n1 Nov 3 18:28:38 kjcf05n02 dwd[5139]: Starting NVME thread for nvme12n1 Nov 3 18:28:38 kjcf05n02 dwd[5139]: Starting NVME thread for nvme10n1 Nov 3 18:28:39 kjcf05n02 dwd[5139]: Starting NVME thread for nvme7n1 Nov 3 18:28:44 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vm.memory.size[free]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 3 18:28:46 kjcf05n02 diskmonitor[17328]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 18:28:53 kjcf05n00 mcfcli[3673891]: %3|1730680133.806|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 18:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 18:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 18:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 18:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 18:28:56 kjcf05n02 diskmonitor[17328]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 18:28:56 kjcf05n02 diskmonitor[17328]: Scan for ReadErrorMax change for md66 Nov 3 18:28:56 kjcf05n02 diskmonitor[17328]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 18:28:56 kjcf05n02 diskmonitor[17328]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 18:28:56 kjcf05n02 diskmonitor[17328]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.min.76c05c063fa0949b68ee86c1978c2ca8 file Nov 3 18:28:56 kjcf05n02 diskmonitor[17328]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.max.76c05c063fa0949b68ee86c1978c2ca8 file Nov 3 18:28:56 kjcf05n02 diskmonitor[17328]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 18:28:56 kjcf05n02 diskmonitor[17328]: Set sync_speed_min (10000) for md66 Nov 3 18:28:56 kjcf05n02 diskmonitor[17328]: Set sync_speed_max (200000) for md66 Nov 3 18:28:56 kjcf05n02 diskmonitor[17328]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 18:28:59 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n03": interface unavailable Nov 3 18:29:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 18:29:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 18:29:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 18:29:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 18:29:05 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib0 Nov 3 18:29:05 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib0 Nov 3 18:29:09 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib1 Nov 3 18:29:09 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib1 Nov 3 18:29:14 kjcf05n00 mcfcli[3673891]: %3|1730680154.342|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:29:23 kjcf05n00 mcfcli[3673891]: %3|1730680163.806|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 18:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 18:29:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 18:29:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 18:29:47 kjcf05n02 nslcd[6896]: [b141f2] ldap_result() failed: Can't contact LDAP server Nov 3 18:29:47 kjcf05n02 nslcd[6896]: [b71efb] ldap_result() failed: Can't contact LDAP server Nov 3 18:29:53 kjcf05n00 mcfcli[3673891]: %3|1730680193.806|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:29:53 kjcf05n00 mcfcli[3673891]: %3|1730680193.833|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 18:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 18:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 18:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 18:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 18:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 18:30:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 18:30:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 18:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 18:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 18:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 18:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 18:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 18:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 18:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 18:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 18:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 18:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 18:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 18:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 18:30:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 18:30:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:30:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 18:30:05 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib0 Nov 3 18:30:05 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib0 Nov 3 18:30:09 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib1 Nov 3 18:30:09 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib1 Nov 3 18:30:18 kjcf05n00 python3.9[1479569]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 18:30:23 kjcf05n00 mcfcli[3673891]: %3|1730680223.806|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 18:30:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730680230', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 18:30:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730680230'} Nov 3 18:30:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:30:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730680230', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 18:30:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730680230'} Nov 3 18:30:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:30:33 kjcf05n00 mcfcli[3673891]: %3|1730680233.060|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 18:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 18:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 18:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 18:30:45 kjcf05n00 zabbix-server[1480031]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:30:45 kjcf05n00 zabbix-server[1480031]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 72.69\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 94.83\\"}}"' Nov 3 18:30:45 kjcf05n00 log_interesting_event.py[1480031]: Event '46510' acknowledged Nov 3 18:30:53 kjcf05n00 mcfcli[3673891]: %3|1730680253.807|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 18:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 18:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 18:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 18:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 18:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 18:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 18:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 18:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 18:31:05 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib0 Nov 3 18:31:05 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib0 Nov 3 18:31:09 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib1 Nov 3 18:31:09 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib1 Nov 3 18:31:12 kjcf05n00 mcfcli[3673891]: %3|1730680272.311|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:31:23 kjcf05n00 mcfcli[3673891]: %3|1730680283.808|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 18:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 18:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 18:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 18:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 18:31:48 kjcf05n00 mcfcli[3673891]: %3|1730680308.853|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:31:53 kjcf05n00 mcfcli[3673891]: %3|1730680313.808|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 18:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 18:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 18:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 18:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 18:32:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 18:32:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 18:32:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 18:32:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 18:32:04 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:9a:1a Nov 3 18:32:04 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 18:32:05 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib0 Nov 3 18:32:05 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib0 Nov 3 18:32:08 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 3 18:32:08 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a kjcf05n03 Nov 3 18:32:08 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.6 Nov 3 18:32:08 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 18:32:08 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 3 18:32:08 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.6 Nov 3 18:32:08 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/pxelinux.cfg to 172.16.2.6 Nov 3 18:32:09 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib1 Nov 3 18:32:09 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib1 Nov 3 18:32:12 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/vmlinuz_diskless to 172.16.2.6 Nov 3 18:32:14 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/initramfs-diskless.img to 172.16.2.6 Nov 3 18:32:23 kjcf05n00 mcfcli[3673891]: %3|1730680343.809|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:32:26 kjcf05n00 mcfcli[3673891]: %3|1730680346.741|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:32:33 kjcf05n00 zabbix-server[1481180]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:32:33 kjcf05n00 zabbix-server[1481180]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n03:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 3 18:32:33 kjcf05n00 log_interesting_event.py[1481180]: Event '46511' acknowledged Nov 3 18:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 18:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 18:32:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 18:32:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 18:32:53 kjcf05n00 mcfcli[3673891]: %3|1730680373.809|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 18:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 18:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 18:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 18:33:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 18:33:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 18:33:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 18:33:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 18:33:02 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:55348). Nov 3 18:33:02 kjcf05n01 rsyncd[3238527]: connect from kjcf05n03 (172.16.2.6) Nov 3 18:33:02 kjcf05n01 rsyncd[3238527]: rsync on puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 18:33:02 kjcf05n01 rsyncd[3238527]: building file list Nov 3 18:33:02 kjcf05n01 rsyncd[3238527]: sent 11446 bytes received 136 bytes total size 10901 Nov 3 18:33:02 kjcf05n01 systemd[1]: rsyncd@651-172.16.2.2:873-172.16.2.6:55348.service: Succeeded. Nov 3 18:33:05 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib0 Nov 3 18:33:05 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib0 Nov 3 18:33:06 kjcf05n00 mcfcli[3673891]: %3|1730680386.738|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:33:09 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib1 Nov 3 18:33:09 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib1 Nov 3 18:33:12 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 18:33:16 kjcf05n02 fstonithd.py[15068]: Listening for kdump packets from partner Nov 3 18:33:23 kjcf05n00 mcfcli[3673891]: %3|1730680403.810|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T18:33:27.252994096-06:00 level=info msg="Completed cleanup jobs" duration=26.22877ms Nov 3 18:33:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 18:33:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 18:33:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 18:33:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 18:33:43 kjcf05n00 mcfcli[3673891]: %3|1730680423.105|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:33:52 kjcf05n02 dwd[5139]: nvme5n1 passed periodic SMART status check Nov 3 18:33:52 kjcf05n02 dwd[5139]: nvme15n1 passed periodic SMART status check Nov 3 18:33:52 kjcf05n02 dwd[5139]: nvme11n1 passed periodic SMART status check Nov 3 18:33:52 kjcf05n02 dwd[5139]: nvme16n1 passed periodic SMART status check Nov 3 18:33:52 kjcf05n02 dwd[5139]: nvme6n1 passed periodic SMART status check Nov 3 18:33:52 kjcf05n02 dwd[5139]: nvme20n1 passed periodic SMART status check Nov 3 18:33:53 kjcf05n02 dwd[5139]: nvme12n1 passed periodic SMART status check Nov 3 18:33:53 kjcf05n02 dwd[5139]: nvme22n1 passed periodic SMART status check Nov 3 18:33:53 kjcf05n02 dwd[5139]: nvme21n1 passed periodic SMART status check Nov 3 18:33:53 kjcf05n02 dwd[5139]: nvme7n1 passed periodic SMART status check Nov 3 18:33:53 kjcf05n02 dwd[5139]: nvme10n1 passed periodic SMART status check Nov 3 18:33:53 kjcf05n00 mcfcli[3673891]: %3|1730680433.810|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 18:33:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 18:33:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 18:33:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 18:33:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 18:34:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 18:34:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 18:34:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 18:34:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 18:34:05 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib0 Nov 3 18:34:05 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib0 Nov 3 18:34:09 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib1 Nov 3 18:34:09 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib1 Nov 3 18:34:19 kjcf05n00 mcfcli[3673891]: %3|1730680459.054|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:34:22 kjcf05n00 zabbix-server[1482216]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:34:22 kjcf05n00 zabbix-server[1482216]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 63.36\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 76.19\\"}}"' Nov 3 18:34:22 kjcf05n00 log_interesting_event.py[1482216]: Event '46512' acknowledged Nov 3 18:34:23 kjcf05n00 mcfcli[3673891]: %3|1730680463.810|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:34:27 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='39', client='AF_INET(172.16.2.6:37477)', local='AF_INET(0.0.0.0:601)' Nov 3 18:34:27 kjcf05n03 syslog-ng[3182]: Configuration reload request received, reloading configuration; Nov 3 18:34:27 kjcf05n03 syslog-ng[3182]: Configuration reload finished; Nov 3 18:34:27 kjcf05n03 syslog-ng[3182]: Syslog connection established; fd='16', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 3 18:34:27 kjcf05n03 dracut: dracut-049-135.git20210121.el8 Nov 3 18:34:27 kjcf05n03 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 18:34:27 kjcf05n03 dracut: Loading and integrity checking all crypto modules Nov 3 18:34:27 kjcf05n03 dracut: Self testing crypto algorithms Nov 3 18:34:27 kjcf05n03 dracut: rd.md=0: removing MD RAID activation Nov 3 18:34:27 kjcf05n03 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 3 18:34:27 kjcf05n03 Copying live image to RAM... Nov 3 18:34:27 kjcf05n03 (this may take a minute) Nov 3 18:34:27 kjcf05n03 Done copying live image to RAM. Nov 3 18:34:27 kjcf05n03 dracut: Mounted root filesystem LiveOS_rootfs Nov 3 18:34:27 kjcf05n03 dracut: Checking integrity of kernel Nov 3 18:34:27 kjcf05n03 dracut: All initrd crypto checks done Nov 3 18:34:27 kjcf05n03 dracut: Switching root Nov 3 18:34:27 kjcf05n03 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 3 18:34:27 kjcf05n03 systemd: Detected architecture x86-64. Nov 3 18:34:27 kjcf05n03 systemd: Set hostname to . Nov 3 18:34:27 kjcf05n03 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 3 18:34:27 kjcf05n03 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 3 18:34:27 kjcf05n03 systemd: Started Forward Password Requests to Wall Directory Watch. Nov 3 18:34:27 kjcf05n03 systemd: Listening on Journal Socket (/dev/log). Nov 3 18:34:27 kjcf05n03 systemd: Created slice User and Session Slice. Nov 3 18:34:27 kjcf05n03 systemd: Reached target Slices. Nov 3 18:34:27 kjcf05n03 systemd: Started Dispatch Password Requests to Console Directory Watch. Nov 3 18:34:27 kjcf05n03 systemd-journald[1544]: Journal started Nov 3 18:34:27 kjcf05n03 systemd-journald[1544]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 18:34:27 kjcf05n03 systemd-modules-load[1515]: Inserted module 'fuse' Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Load/Save Random Seed. Nov 3 18:34:27 kjcf05n03 systemd-sysctl[1551]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 18:34:27 kjcf05n03 systemd-sysctl[1551]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Create System Users. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Apply Kernel Variables. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 3 18:34:27 kjcf05n03 systemd-tmpfiles[1560]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 18:34:27 kjcf05n03 systemd-tmpfiles[1560]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Create Static Device Nodes in /dev. Nov 3 18:34:27 kjcf05n03 systemd-journald[1544]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started udev Coldplug all Devices. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Flush Journal to Persistent Storage. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Rebuild Hardware Database. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting udev Kernel Device Manager... Nov 3 18:34:27 kjcf05n03 systemd-udevd[1568]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started udev Kernel Device Manager. Nov 3 18:34:27 kjcf05n03 systemd[1]: Found device /dev/ttyS0. Nov 3 18:34:27 kjcf05n03 systemd-udevd[1569]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:34:27 kjcf05n03 systemd-udevd[1626]: Using default interface naming scheme 'rhel-8.0'. Nov 3 18:34:27 kjcf05n03 systemd-udevd[1626]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:34:27 kjcf05n03 systemd-udevd[1614]: Using default interface naming scheme 'rhel-8.0'. Nov 3 18:34:27 kjcf05n03 systemd-udevd[1614]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:34:27 kjcf05n03 systemd-udevd[1619]: Using default interface naming scheme 'rhel-8.0'. Nov 3 18:34:27 kjcf05n03 systemd-udevd[1619]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 3 18:34:27 kjcf05n03 systemd[1]: Reached target Local File Systems (Pre). Nov 3 18:34:27 kjcf05n03 systemd[1]: Reached target Local File Systems. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Mark the need to relabel after reboot... Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Rebuild Journal Catalog... Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting openibd - configure Mellanox devices... Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Create Volatile Files and Directories... Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Mark the need to relabel after reboot. Nov 3 18:34:27 kjcf05n03 root[1808]: openibd: running in auto mode Nov 3 18:34:27 kjcf05n03 systemd-tmpfiles[1800]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 18:34:27 kjcf05n03 systemd-tmpfiles[1800]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Rebuild Journal Catalog. Nov 3 18:34:27 kjcf05n03 systemd-tmpfiles[1800]: "/var/tmp" already exists and is not a directory. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Create Volatile Files and Directories. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting RPC Bind... Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting RDMA Node Description Daemon... Nov 3 18:34:27 kjcf05n03 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 3 18:34:27 kjcf05n03 systemd[1]: Started RPC Bind. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started RDMA Node Description Daemon. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 3 18:34:27 kjcf05n03 systemd-modules-load[1871]: Inserted module 'ib_iser' Nov 3 18:34:27 kjcf05n03 systemd-modules-load[1871]: Inserted module 'ib_isert' Nov 3 18:34:27 kjcf05n03 systemd-modules-load[1871]: Inserted module 'ib_srpt' Nov 3 18:34:27 kjcf05n03 systemd-udevd[1569]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:34:27 kjcf05n03 systemd-udevd[1626]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:34:27 kjcf05n03 systemd-udevd[1569]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 18:34:27 kjcf05n03 systemd-udevd[1626]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 3 18:34:27 kjcf05n03 systemd-modules-load[1875]: Inserted module 'ib_ipoib' Nov 3 18:34:27 kjcf05n03 systemd-modules-load[1871]: Inserted module 'rdma_ucm' Nov 3 18:34:27 kjcf05n03 systemd-modules-load[1871]: Module 'svcrdma' is blacklisted Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 3 18:34:27 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 18:34:27 kjcf05n03 systemd[3182]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:34:27 kjcf05n03 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 3 18:34:27 kjcf05n03 systemd-modules-load[1875]: Inserted module 'ib_umad' Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 3 18:34:27 kjcf05n03 systemd[1]: Reached target RDMA Hardware. Nov 3 18:34:27 kjcf05n03 systemd[1]: Reached target Network (Pre). Nov 3 18:34:27 kjcf05n03 openibd[1790]: Loading HCA driver and Access Layer:[ OK ] Nov 3 18:34:27 kjcf05n03 systemd[1]: Started openibd - configure Mellanox devices. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Update is Completed... Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Update is Completed. Nov 3 18:34:27 kjcf05n03 setup-icl[1769]: Setting LAN IP Address to 203.0.113.4 Nov 3 18:34:27 kjcf05n03 setup-icl[1769]: Setting LAN Subnet Mask to 255.255.255.0 Nov 3 18:34:27 kjcf05n03 setup-icl[1769]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 3 18:34:27 kjcf05n03 setup-icl[1769]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 3 18:34:27 kjcf05n03 systemd-udevd[1569]: Using default interface naming scheme 'rhel-8.0'. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 3 18:34:27 kjcf05n03 systemd[1]: Reached target System Initialization. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 3 18:34:27 kjcf05n03 systemd[1]: Listening on lldpad.socket. Nov 3 18:34:27 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 3 18:34:27 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 3 18:34:27 kjcf05n03 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 3 18:34:27 kjcf05n03 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 3 18:34:27 kjcf05n03 systemd[1]: Reached target Sockets. Nov 3 18:34:27 kjcf05n03 systemd[1]: Reached target Basic System. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting LSB: Bring up/down networking... Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 3 18:34:27 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Resets System Activity Logs... Nov 3 18:34:27 kjcf05n03 network[2116]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Manage Cutlass PHYs... Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[2144]: Setting up Mellanox network interface: ib1 Nov 3 18:34:27 kjcf05n03 mcelog[2147]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 3 18:34:27 kjcf05n03 mcelog[2147]: CPU is unsupported Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 18:34:27 kjcf05n03 network[2146]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 3 18:34:27 kjcf05n03 network[2116]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started irqbalance daemon. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 18:34:27 kjcf05n03 mdraid-phy[2152]: no Cutlass to worry about Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 18:34:27 kjcf05n03 beSetMlxConfig[2163]: ConnectX-3 multiport not detected Nov 3 18:34:27 kjcf05n03 network[2164]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:34:27 kjcf05n03 network[2116]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 3 18:34:27 kjcf05n03 dwd[2177]: dwd: vMay 29 2024 : 15:38:26 Nov 3 18:34:27 kjcf05n03 dwd[2177]: dwd: option Lethal: 0 Nov 3 18:34:27 kjcf05n03 dwd[2177]: dwd: option Interval: 60 Nov 3 18:34:27 kjcf05n03 dwd[2177]: dwd: option abrtlimit: 10 Nov 3 18:34:27 kjcf05n03 dwd[2177]: dwd: option DZPeriod: 604800 Nov 3 18:34:27 kjcf05n03 dwd[2177]: dwd: option SmartPeriod: 43200 Nov 3 18:34:27 kjcf05n03 dwd[2177]: dwd: option SDDEnabled: 1 Nov 3 18:34:27 kjcf05n03 dwd[2177]: dwd: option SDDAwaitScale: 3 Nov 3 18:34:27 kjcf05n03 dwd[2177]: dwd: option SDDAwaitMin: 100 Nov 3 18:34:27 kjcf05n03 dwd[2177]: dwd: option Verbosity: 1 Nov 3 18:34:27 kjcf05n03 dwd[2177]: dwd: option StandAlone: 0 Nov 3 18:34:27 kjcf05n03 dwd[2177]: /usr/sbin/dwd -d --standalone=0 Nov 3 18:34:27 kjcf05n03 dwd[2177]: option Lethal: 0 Nov 3 18:34:27 kjcf05n03 dwd[2177]: option Interval: 60 Nov 3 18:34:27 kjcf05n03 dwd[2177]: option abrtlimit: 10 Nov 3 18:34:27 kjcf05n03 dwd[2177]: option DZPeriod: 604800 Nov 3 18:34:27 kjcf05n03 dwd[2177]: option SmartPeriod: 43200 Nov 3 18:34:27 kjcf05n03 dwd[2177]: option SDDEnabled: 1 Nov 3 18:34:27 kjcf05n03 dwd[2177]: option SDDAwaitScale: 3 Nov 3 18:34:27 kjcf05n03 dwd[2177]: option SDDAwaitMin: 100 Nov 3 18:34:27 kjcf05n03 dwd[2177]: option Verbosity: 1 Nov 3 18:34:27 kjcf05n03 dwd[2177]: option StandAlone: 0 Nov 3 18:34:27 kjcf05n03 network[2191]: It is advised to switch to 'NetworkManager' instead for network management. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started D-Bus System Message Bus. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 0 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 1 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 2 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 3 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 4 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 5 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 6 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 7 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 8 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 9 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 10 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 11 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 12 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 13 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 14 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 15 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 16 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 17 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 18 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 19 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 20 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 21 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 22 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 23 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 24 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 25 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 26 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 27 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 28 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 29 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 30 Nov 3 18:34:27 kjcf05n03 cpupower[2236]: Setting cpu: 31 Nov 3 18:34:27 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[2211]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Name Service Cache Daemon... Nov 3 18:34:27 kjcf05n03 beSetMlxConfig[2163]: Starting MST (Mellanox Software Tools) driver set Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 3 18:34:27 kjcf05n03 nscd[2269]: 2269 monitoring file `/etc/hosts` (1) Nov 3 18:34:27 kjcf05n03 nscd[2269]: 2269 monitoring directory `/etc` (2) Nov 3 18:34:27 kjcf05n03 nscd[2269]: 2269 monitoring file `/etc/resolv.conf` (3) Nov 3 18:34:27 kjcf05n03 nscd[2269]: 2269 monitoring directory `/etc` (2) Nov 3 18:34:27 kjcf05n03 chronyd[2277]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[2252]: Setting up Mellanox network interface: ib0 Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[2261]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 18:34:27 kjcf05n03 dbus-daemon[2213]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Resets System Activity Logs. Nov 3 18:34:27 kjcf05n03 beSetMlxConfig[2163]: Loading MST PCI module - Success Nov 3 18:34:27 kjcf05n03 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 3 18:34:27 kjcf05n03 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Manage Cutlass PHYs. Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[2301]: No configuration found for ib1 Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 18:34:27 kjcf05n03 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[2313]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 18:34:27 kjcf05n03 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 3 18:34:27 kjcf05n03 beSetMlxConfig[2163]: Loading MST PCI configuration module - Success Nov 3 18:34:27 kjcf05n03 beSetMlxConfig[2163]: Create devices Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[2318]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 18:34:27 kjcf05n03 chronyd[2277]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 18:34:27 kjcf05n03 chronyd[2277]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Name Service Cache Daemon. Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 0 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 1 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 2 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 3 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 4 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 5 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 6 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 7 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 8 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 9 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 10 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 11 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 12 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 13 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 14 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 15 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 16 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 17 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 18 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 19 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 20 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 21 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 22 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 23 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 24 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 25 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 26 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 27 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 28 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 29 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 30 Nov 3 18:34:27 kjcf05n03 cpupower[2334]: Idlestate 2 disabled on CPU 31 Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[2331]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 18:34:27 kjcf05n03 mlnx_conf_mgr[2355]: INFO: No configurations found for mlx5_1, skipping. Nov 3 18:34:27 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[2376]: No configuration found for ib0 Nov 3 18:34:27 kjcf05n03 sssd[sssd][2226]: Starting up Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[2406]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 18:34:27 kjcf05n03 mlnx_conf_mgr[2449]: INFO: No configurations found for mlx5_0, skipping. Nov 3 18:34:27 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 18:34:27 kjcf05n03 sssd[be[implicit_files]][2450]: Starting up Nov 3 18:34:27 kjcf05n03 sssd[nss][2560]: Starting up Nov 3 18:34:27 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 18:34:27 kjcf05n03 systemd[1]: Reached target User and Group Name Lookups. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Login Service... Nov 3 18:34:27 kjcf05n03 systemd-logind[2690]: New seat seat0. Nov 3 18:34:27 kjcf05n03 systemd-logind[2690]: Watching system buttons on /dev/input/event0 (Power Button) Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Login Service. Nov 3 18:34:27 kjcf05n03 python3.9[2181]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 18:34:27 kjcf05n03 python3.9[3182]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 18:34:27 kjcf05n03 systemd-sysctl[2778]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 18:34:27 kjcf05n03 systemd-sysctl[2778]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 3 18:34:27 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 18:34:27 kjcf05n03 network[2116]: Bringing up loopback interface: [ OK ] Nov 3 18:34:27 kjcf05n03 systemd-sysctl[3124]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 3 18:34:27 kjcf05n03 systemd-sysctl[3124]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 3 18:34:27 kjcf05n03 python3.9[3047]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 18:34:27 kjcf05n03 python3.9[3182]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:34:27 kjcf05n03 systemd[1]: Started LSB: Bring up/down networking. Nov 3 18:34:27 kjcf05n03 systemd[1]: Reached target Network. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 3 18:34:27 kjcf05n03 systemd[1]: Reached target Network is Online. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting System Logger Daemon... Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Notify NFS peers of a restart... Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started GSSAPI Proxy Daemon. Nov 3 18:34:27 kjcf05n03 sm-notify[3183]: Version 2.3.3 starting Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Notify NFS peers of a restart. Nov 3 18:34:27 kjcf05n03 systemd[1]: Reached target NFS client services. Nov 3 18:34:27 kjcf05n03 systemd[1]: Reached target Remote File Systems (Pre). Nov 3 18:34:27 kjcf05n03 systemd[1]: Reached target Remote File Systems. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Permit User Sessions... Nov 3 18:34:27 kjcf05n03 lldpad[3172]: setsockopt nearest_bridge: Invalid argument Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Permit User Sessions. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Serial Getty on ttyS0. Nov 3 18:34:27 kjcf05n03 lldpad[3172]: setsockopt nearest_bridge: Invalid argument Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Getty on tty1. Nov 3 18:34:27 kjcf05n03 systemd[1]: Reached target Login Prompts. Nov 3 18:34:27 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 18:34:27 kjcf05n03 beSetMlxConfig[2163]: Unloading MST PCI module (unused) - Success Nov 3 18:34:27 kjcf05n03 syslog-ng[3182]: [2024-11-04T00:33:14.884392] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 3 18:34:27 kjcf05n03 syslog-ng[3182]: [2024-11-04T00:33:14.884659] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 3 18:34:27 kjcf05n03 syslog-ng[3182]: [2024-11-04T00:33:14.884695] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 3 18:34:27 kjcf05n03 syslog-ng[3182]: [2024-11-04T00:33:14.885245] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 3 18:34:27 kjcf05n03 syslog-ng[3182]: [2024-11-04T00:33:14.885416] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 3 18:34:27 kjcf05n03 systemd[1]: Started System Logger Daemon. Nov 3 18:34:27 kjcf05n03 python3.9[3209]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 18:34:27 kjcf05n03 python3.9[3182]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 18:34:27 kjcf05n03 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 3 18:34:27 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 18:34:27 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 18:34:27 kjcf05n03 sshd[3438]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 3 18:34:27 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 18:34:27 kjcf05n03 python3.9[3437]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 18:34:27 kjcf05n03 python3.9[3182]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 3 18:34:27 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 18:34:27 kjcf05n03 python3.9[3441]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 3 18:34:27 kjcf05n03 python3.9[3182]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 3 18:34:27 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 3 18:34:27 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 3 18:34:27 kjcf05n03 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 3 18:34:27 kjcf05n03 chronyd[2277]: System's initial offset : 0.002820 seconds slow of true (slew) Nov 3 18:34:27 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 18:34:27 kjcf05n03 beSetMlxConfig[2163]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 18:34:27 kjcf05n03 beSetMlxConfig[2163]: ib mode Nov 3 18:34:27 kjcf05n03 root[3463]: openibd: Set node_desc for mlx5_0: kjcf05n03 HCA-1 Nov 3 18:34:27 kjcf05n03 root[3465]: openibd: Set node_desc for mlx5_1: kjcf05n03 HCA-2 Nov 3 18:34:27 kjcf05n03 beSetMlxConfig[2163]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 18:34:27 kjcf05n03 beSetMlxConfig[2163]: ib mode Nov 3 18:34:27 kjcf05n03 systemd-udevd[1568]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 18:34:27 kjcf05n03 systemd-udevd[3480]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:34:27 kjcf05n03 systemd-udevd[3481]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:34:27 kjcf05n03 systemd-udevd[3484]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:34:27 kjcf05n03 systemd-udevd[3487]: Using default interface naming scheme 'rhel-8.0'. Nov 3 18:34:27 kjcf05n03 systemd-udevd[3487]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:34:27 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 18:34:27 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 18:34:27 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 18:34:27 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[3522]: Setting up Mellanox network interface: ib1 Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[3523]: Setting up Mellanox network interface: ib0 Nov 3 18:34:27 kjcf05n03 systemd-udevd[3482]: Using default interface naming scheme 'rhel-8.0'. Nov 3 18:34:27 kjcf05n03 systemd-udevd[3483]: Using default interface naming scheme 'rhel-8.0'. Nov 3 18:34:27 kjcf05n03 systemd-udevd[3482]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:34:27 kjcf05n03 systemd-udevd[3483]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Puppet agent... Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[3572]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[3573]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[3603]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[3604]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[3605]: No configuration found for ib0 Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[3606]: No configuration found for ib1 Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[3613]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[3614]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 18:34:27 kjcf05n03 mlnx_conf_mgr[3654]: INFO: No configurations found for mlx5_0, skipping. Nov 3 18:34:27 kjcf05n03 mlnx_conf_mgr[3653]: INFO: No configurations found for mlx5_1, skipping. Nov 3 18:34:27 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 18:34:27 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 3 18:34:27 kjcf05n03 systemd[1]: Stopping Command Scheduler... Nov 3 18:34:27 kjcf05n03 systemd[1]: crond.service: Succeeded. Nov 3 18:34:27 kjcf05n03 systemd[1]: Stopped Command Scheduler. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 3 18:34:27 kjcf05n03 systemd[1]: Stopping Job spooling tools... Nov 3 18:34:27 kjcf05n03 systemd[1]: atd.service: Succeeded. Nov 3 18:34:27 kjcf05n03 systemd[1]: Stopped Job spooling tools. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 3 18:34:27 kjcf05n03 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 3 18:34:27 kjcf05n03 lldpad[3172]: init_ports: Error adding device ib0 Nov 3 18:34:27 kjcf05n03 lldpad[3172]: init_ports: Error adding device ib1 Nov 3 18:34:27 kjcf05n03 lldpad[3172]: Signal 15 received - terminating Nov 3 18:34:27 kjcf05n03 systemd[1]: lldpad.service: Succeeded. Nov 3 18:34:27 kjcf05n03 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 3 18:34:27 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 3 18:34:27 kjcf05n03 systemd[1]: lldpad.socket: Succeeded. Nov 3 18:34:27 kjcf05n03 systemd[1]: Closed lldpad.socket. Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 3 18:34:27 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting IPMI Driver... Nov 3 18:34:27 kjcf05n03 systemd[1]: Started IPMI Driver. Nov 3 18:34:27 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:27 kjcf05n03 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:27 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Ipmievd Daemon... Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 1 | Nov-04-2024 | 00:03:39 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 2 | Nov-04-2024 | 00:04:30 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 3 | Nov-04-2024 | 00:04:30 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 4 | Nov-04-2024 | 00:05:56 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 5 | Nov-04-2024 | 00:05:57 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 6 | Nov-04-2024 | 00:30:33 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 7 | Nov-04-2024 | 00:30:33 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 8 | Nov-04-2024 | 00:30:33 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 9 | Nov-04-2024 | 00:30:33 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 10 | Nov-04-2024 | 00:30:33 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 11 | Nov-04-2024 | 00:30:33 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 12 | Nov-04-2024 | 00:30:33 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 13 | Nov-04-2024 | 00:30:33 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 14 | Nov-04-2024 | 00:30:33 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 15 | Nov-04-2024 | 00:30:33 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 16 | Nov-04-2024 | 00:30:33 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 17 | Nov-04-2024 | 00:30:33 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 18 | Nov-04-2024 | 00:30:33 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 19 | Nov-04-2024 | 00:30:33 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 20 | Nov-04-2024 | 00:30:33 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 21 | Nov-04-2024 | 00:30:33 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 22 | Nov-04-2024 | 00:30:33 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 23 | Nov-04-2024 | 00:30:33 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 24 | Nov-04-2024 | 00:30:33 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 25 | Nov-04-2024 | 00:30:33 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 26 | Nov-04-2024 | 00:30:33 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 27 | Nov-04-2024 | 00:30:33 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 28 | Nov-04-2024 | 00:30:34 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 29 | Nov-04-2024 | 00:30:34 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 30 | Nov-04-2024 | 00:30:34 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 31 | Nov-04-2024 | 00:30:34 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 32 | Nov-04-2024 | 00:30:34 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 33 | Nov-04-2024 | 00:30:34 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 34 | Nov-04-2024 | 00:30:34 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 35 | Nov-04-2024 | 00:30:34 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 36 | Nov-04-2024 | 00:30:34 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 37 | Nov-04-2024 | 00:30:34 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 38 | Nov-04-2024 | 00:31:04 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 39 | Nov-04-2024 | 00:31:04 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 40 | Nov-04-2024 | 00:31:04 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 41 | Nov-04-2024 | 00:31:04 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 42 | Nov-04-2024 | 00:31:04 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 43 | Nov-04-2024 | 00:31:04 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 44 | Nov-04-2024 | 00:31:04 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 45 | Nov-04-2024 | 00:31:04 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 46 | Nov-04-2024 | 00:31:04 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 47 | Nov-04-2024 | 00:31:04 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 48 | Nov-04-2024 | 00:31:04 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 3 18:34:27 kjcf05n03 ipmievd[4001]: 49 | Nov-04-2024 | 00:31:04 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 3 18:34:27 kjcf05n03 ipmievd[4004]: Reading sensors... Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Ipmievd Daemon. Nov 3 18:34:27 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:27 kjcf05n03 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 3 18:34:27 kjcf05n03 nscd[2269]: 2269 monitored file `/etc/hosts` was moved into place, adding watch Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 3 18:34:27 kjcf05n03 systemd[1]: set-mlx-config.service: Succeeded. Nov 3 18:34:27 kjcf05n03 systemd[1]: Stopped Set Mellanox configuration. Nov 3 18:34:27 kjcf05n03 systemd[1]: Stopping Set Mellanox configuration... Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 3 18:34:27 kjcf05n03 beSetMlxConfig[4062]: ConnectX-3 multiport not detected Nov 3 18:34:27 kjcf05n03 beSetMlxConfig[4062]: Starting MST (Mellanox Software Tools) driver set Nov 3 18:34:27 kjcf05n03 beSetMlxConfig[4062]: Loading MST PCI module - Success Nov 3 18:34:27 kjcf05n03 systemd-udevd[1568]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 18:34:27 kjcf05n03 beSetMlxConfig[4062]: [warn] mst_pciconf is already loaded, skipping Nov 3 18:34:27 kjcf05n03 beSetMlxConfig[4062]: Create devices Nov 3 18:34:27 kjcf05n03 beSetMlxConfig[4062]: Unloading MST PCI module (unused) - Success Nov 3 18:34:27 kjcf05n03 ipmievd[4004]: Waiting for events... Nov 3 18:34:27 kjcf05n03 beSetMlxConfig[4062]: Configuring /dev/mst/mt4123_pciconf1 Nov 3 18:34:27 kjcf05n03 beSetMlxConfig[4062]: ib mode Nov 3 18:34:27 kjcf05n03 beSetMlxConfig[4062]: Configuring /dev/mst/mt4123_pciconf0 Nov 3 18:34:27 kjcf05n03 beSetMlxConfig[4062]: ib mode Nov 3 18:34:27 kjcf05n03 systemd-udevd[1568]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 18:34:27 kjcf05n03 systemd-udevd[4963]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:34:27 kjcf05n03 systemd-udevd[4964]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:34:27 kjcf05n03 systemd-udevd[4967]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:34:27 kjcf05n03 systemd-udevd[4970]: Using default interface naming scheme 'rhel-8.0'. Nov 3 18:34:27 kjcf05n03 systemd-udevd[4970]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:34:27 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 3 18:34:27 kjcf05n03 systemd[3182]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:34:27 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[5005]: Setting up Mellanox network interface: ib1 Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[5006]: Setting up Mellanox network interface: ib0 Nov 3 18:34:27 kjcf05n03 systemd-udevd[4965]: Using default interface naming scheme 'rhel-8.0'. Nov 3 18:34:27 kjcf05n03 systemd-udevd[4965]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[5056]: set_ipoib_cm: ib0 connection mode set to connected Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[5055]: set_ipoib_cm: ib1 connection mode set to connected Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[5072]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[5071]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[5074]: No configuration found for ib1 Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[5073]: No configuration found for ib0 Nov 3 18:34:27 kjcf05n03 systemd-udevd[4966]: Using default interface naming scheme 'rhel-8.0'. Nov 3 18:34:27 kjcf05n03 systemd-udevd[4966]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[5081]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 3 18:34:27 kjcf05n03 mlnx_interface_mgr[5082]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 3 18:34:27 kjcf05n03 mlnx_conf_mgr[5137]: INFO: No configurations found for mlx5_0, skipping. Nov 3 18:34:27 kjcf05n03 mlnx_conf_mgr[5136]: INFO: No configurations found for mlx5_1, skipping. Nov 3 18:34:27 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 3 18:34:27 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}6b781c6ad47764dc15b5935f85181e7febd4c2765217b5d5e981d20c1fb55e79' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}6b781c6ad47764dc15b5935f85181e7febd4c2765217b5d5e981d20c1fb55e79' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}0153a6f193de3ddad8172dcc28962bca37c886bae1867289256937011a9efe93' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}0153a6f193de3ddad8172dcc28962bca37c886bae1867289256937011a9efe93' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}b6a71ca80727531b543a2a7b6a0f74ce25ea661b26175ce6ed8909aa9dd8e851' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}b6a71ca80727531b543a2a7b6a0f74ce25ea661b26175ce6ed8909aa9dd8e851' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}afcf2622e89098167521c7a181a926b82db931614049b60afe3757db45e8b660' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}afcf2622e89098167521c7a181a926b82db931614049b60afe3757db45e8b660' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 3 18:34:27 kjcf05n03 systemd[1]: Stopping NTP client/server... Nov 3 18:34:27 kjcf05n03 chronyd[2277]: chronyd exiting Nov 3 18:34:27 kjcf05n03 systemd[1]: chronyd.service: Succeeded. Nov 3 18:34:27 kjcf05n03 systemd[1]: Stopped NTP client/server. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 3 18:34:27 kjcf05n03 chronyd[5171]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 3 18:34:27 kjcf05n03 chronyd[5171]: Wrong owner of /var/run/chrony (UID != 991) Nov 3 18:34:27 kjcf05n03 chronyd[5171]: Disabled command socket /var/run/chrony/chronyd.sock Nov 3 18:34:27 kjcf05n03 chronyd[5171]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 3 18:34:27 kjcf05n03 systemd[1]: Started NTP client/server. Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 3 18:34:27 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:27 kjcf05n03 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 3 18:34:27 kjcf05n03 systemd[1]: dwd.service: Succeeded. Nov 3 18:34:27 kjcf05n03 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 3 18:34:27 kjcf05n03 dwd[5202]: dwd: vMay 29 2024 : 15:38:26 Nov 3 18:34:27 kjcf05n03 dwd[5202]: /usr/sbin/dwd -i 15 -d Nov 3 18:34:27 kjcf05n03 dwd[5202]: dwd: option Lethal: 0 Nov 3 18:34:27 kjcf05n03 dwd[5202]: dwd: option Interval: 15 Nov 3 18:34:27 kjcf05n03 dwd[5202]: dwd: option abrtlimit: 10 Nov 3 18:34:27 kjcf05n03 dwd[5202]: dwd: option DZPeriod: 604800 Nov 3 18:34:27 kjcf05n03 dwd[5202]: dwd: option SmartPeriod: 43200 Nov 3 18:34:27 kjcf05n03 dwd[5202]: dwd: option SDDEnabled: 1 Nov 3 18:34:27 kjcf05n03 dwd[5202]: dwd: option SDDAwaitScale: 3 Nov 3 18:34:27 kjcf05n03 dwd[5202]: dwd: option SDDAwaitMin: 100 Nov 3 18:34:27 kjcf05n03 dwd[5202]: dwd: option Verbosity: 1 Nov 3 18:34:27 kjcf05n03 dwd[5202]: dwd: option StandAlone: 0 Nov 3 18:34:27 kjcf05n03 dwd[5202]: option Lethal: 0 Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 3 18:34:27 kjcf05n03 dwd[5202]: option Interval: 15 Nov 3 18:34:27 kjcf05n03 dwd[5202]: option abrtlimit: 10 Nov 3 18:34:27 kjcf05n03 dwd[5202]: option DZPeriod: 604800 Nov 3 18:34:27 kjcf05n03 dwd[5202]: option SmartPeriod: 43200 Nov 3 18:34:27 kjcf05n03 dwd[5202]: option SDDEnabled: 1 Nov 3 18:34:27 kjcf05n03 dwd[5202]: option SDDAwaitScale: 3 Nov 3 18:34:27 kjcf05n03 dwd[5202]: option SDDAwaitMin: 100 Nov 3 18:34:27 kjcf05n03 dwd[5202]: option Verbosity: 1 Nov 3 18:34:27 kjcf05n03 dwd[5202]: option StandAlone: 0 Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 3 18:34:27 kjcf05n03 dwd[5203]: option Lethal now set to 1 Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 18:34:27 kjcf05n03 dwd[5203]: option abrtlimit now set to 1 Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 3 18:34:27 kjcf05n03 dwd[5203]: option SmartPeriod now set to 86400 Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 3 18:34:27 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 3 18:34:27 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Discard unused blocks. Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:27 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:27 kjcf05n03 python3.9[5232]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 3 18:34:27 kjcf05n03 python3.9[3182]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 3 18:34:27 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Periodic ZFS scrub. Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:27 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 3 18:34:27 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:27 kjcf05n03 systemd[1]: Starting Sed Control Plane worker process... Nov 3 18:34:27 kjcf05n03 sedcpwrkr[5369]: Using config script: /etc/sedcpwrkr.conf Nov 3 18:34:27 kjcf05n03 sedcpwrkr[5369]: - Creating default directory: '/var/log/sedcpwrkr' Nov 3 18:34:27 kjcf05n03 sedcpwrkr[5369]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 3 18:34:27 kjcf05n03 sedcpwrkr[5369]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 3 18:34:27 kjcf05n03 sedcpwrkr[5369]: - Creating default directory: '/var/run/sedcpwrkr' Nov 3 18:34:27 kjcf05n03 sedcpwrkr[5369]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 3 18:34:27 kjcf05n03 sedcpwrkr[5369]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 3 18:34:27 kjcf05n03 sedcpwrkr-server[5400]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 18:34:27 kjcf05n03 sedcpwrkr[5369]: celery multi v5.2.7 (dawn-chorus) Nov 3 18:34:27 kjcf05n03 sedcpwrkr[5369]: > Starting nodes... Nov 3 18:34:27 kjcf05n03 sedcpwrkr[5369]: > sedcpwrkr@kjcf05n03: OK Nov 3 18:34:27 kjcf05n03 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 3 18:34:27 kjcf05n03 sedcpwrkr-server[5402]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 3 18:34:27 kjcf05n03 sedcpwrkr-server[5402]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 18:34:27 kjcf05n03 sedcpwrkr-server[5402]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 3 18:34:27 kjcf05n03 systemd[1]: Started Sed Control Plane worker process. Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 3 18:34:27 kjcf05n03 systemd[1]: Reloading System Logger Daemon. Nov 3 18:34:27 kjcf05n03 systemd[1]: Reloaded System Logger Daemon. Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 3 18:34:27 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 3 18:34:27 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 3 18:34:28 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:28 kjcf05n03 systemd[1]: Starting IPv4 firewall with iptables... Nov 3 18:34:28 kjcf05n03 systemd-udevd[1568]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 18:34:28 kjcf05n03 iptables.init[5468]: iptables: Applying firewall rules: [ OK ] Nov 3 18:34:28 kjcf05n03 systemd[1]: Started IPv4 firewall with iptables. Nov 3 18:34:28 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:29 kjcf05n03 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 3 18:34:29 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 18:34:29 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 3 18:34:29 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:29 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 18:34:29 kjcf05n03 systemd[1]: openhpid.service: Supervising process 5567 which is not our child. We'll most likely not notice when it exits. Nov 3 18:34:29 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 18:34:29 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:30 kjcf05n03 openhpid[5567]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 18:34:30 kjcf05n03 openhpid[5567]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 18:34:30 kjcf05n03 openhpid[5567]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 18:34:30 kjcf05n03 openhpid[5567]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 18:34:30 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:30 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:30 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:30 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 18:34:30 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 3 18:34:30 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 18:34:30 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 3 18:34:30 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:30 kjcf05n03 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 3 18:34:31 kjcf05n03 dcs-collectord[5658]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 3 18:34:31 kjcf05n03 hpi.inv.log[5658]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 3 18:34:31 kjcf05n03 dcs-collectord[5658]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 3 18:34:31 kjcf05n03 dcs-collectord[5658]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 3 18:34:31 kjcf05n03 dcs-collector[5649]: Starting dcs-collector:[ OK ] Nov 3 18:34:31 kjcf05n03 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 3 18:34:31 kjcf05n03 dcs-collectord[5661]: INFO Starting collection for memory_info (collection_process.py:52) Nov 3 18:34:31 kjcf05n03 dcs-collectord[5661]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 18:34:31 kjcf05n03 dcs-collectord[5661]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 18:34:31 kjcf05n03 dcs-collectord[5661]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 18:34:31 kjcf05n03 dcs-collectord[5661]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 3 18:34:31 kjcf05n03 dcs-collectord[5661]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 3 18:34:31 kjcf05n03 dcs-collectord[5661]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 3 18:34:31 kjcf05n03 dcs-collectord[5661]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259334332", "units": "kB"}, {"name": "MemAvailable", "value": "258613948", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1820968", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686844", "units": "kB"}, {"name": "Inactive", "value": "961696", "units": "kB"}, {"name": "Active(anon)", "value": "1520880", "units": "kB"}, {"name": "Inactive(anon)", "value": "825636", "units": "kB"}, {"name": "Active(file)", "value": "165964", "units": "kB"}, {"name": "Inactive(file)", "value": "136060", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "753188", "units": "kB"}, {"name": "Mapped", "value": "86312", "units": "kB"}, {"name": "Shmem", "value": "1593348", "units": "kB"}, {"name": "KReclaimable", "value": "109372", "units": "kB"}, {"name": "Slab", "value": "276380", "units": "kB"}, {"name": "SReclaimable", "value": "109372", "units": "kB"}, {"name": "SUnreclaim", "value": "167008", "units": "kB"}, {"name": "KernelStack", "value": "9840", "units": "kB"}, {"name": "PageTables", "value": "20624", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3231520", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11264", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "6144", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "299336", "units": "kB"}, {"name": "DirectMap2M", "value": "22634496", "units": "kB"}, {"name": "DirectMap1G", "value": "245366784", "units": "kB"}]}' Nov 3 18:34:31 kjcf05n03 dcs-collectord[5661]: INFO Completed collection for memory_info (collection_process.py:59) Nov 3 18:34:31 kjcf05n03 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 3 18:34:31 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:31 kjcf05n03 dcs-collectord[5661]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 3 18:34:31 kjcf05n03 dcs-collectord[5661]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730680470.9669526], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730680471.2031243], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730680470.895612, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 3 18:34:31 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:31 kjcf05n03 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 3 18:34:31 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:31 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:31 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 18:34:31 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 3 18:34:31 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 18:34:31 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 3 18:34:32 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:32 kjcf05n03 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 3 18:34:32 kjcf05n03 firmware-update-orc[5767]: Using config script: /etc/firmware_update_orc.conf Nov 3 18:34:32 kjcf05n03 firmware-update-orc[5767]: - Creating default directory: '/var/log/firmware-update-orc' Nov 3 18:34:32 kjcf05n03 firmware-update-orc[5767]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 3 18:34:32 kjcf05n03 firmware-update-orc[5767]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 3 18:34:32 kjcf05n03 firmware-update-orc[5767]: - Creating default directory: '/var/run/firmware-update-orc' Nov 3 18:34:32 kjcf05n03 firmware-update-orc[5767]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 3 18:34:32 kjcf05n03 firmware-update-orc[5767]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 3 18:34:32 kjcf05n03 firmware-update-orc-server[5803]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 18:34:32 kjcf05n03 firmware-update-orc[5767]: celery multi v5.2.7 (dawn-chorus) Nov 3 18:34:32 kjcf05n03 firmware-update-orc[5767]: > Starting nodes... Nov 3 18:34:32 kjcf05n03 firmware-update-orc[5767]: > worker1@kjcf05n03: OK Nov 3 18:34:32 kjcf05n03 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 3 18:34:32 kjcf05n03 firmware-update-orc-server[5807]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 3 18:34:32 kjcf05n03 firmware-update-orc-server[5807]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 18:34:32 kjcf05n03 firmware-update-orc-server[5807]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 3 18:34:32 kjcf05n03 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 3 18:34:32 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:33 kjcf05n03 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:34:33 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:33 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:33 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 18:34:33 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 3 18:34:33 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 3 18:34:33 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 3 18:34:33 kjcf05n03 dbus-daemon[2213]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 18:34:33 kjcf05n03 dbus-daemon[2213]: [system] Reloaded configuration Nov 3 18:34:33 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 3 18:34:33 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 3 18:34:33 kjcf05n03 dbus-daemon[2213]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 3 18:34:33 kjcf05n03 dbus-daemon[2213]: [system] Reloaded configuration Nov 3 18:34:33 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 18:34:33 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 3 18:34:33 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 18:34:33 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 3 18:34:33 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:33 kjcf05n03 systemd[1]: Starting Manages hardware resources... Nov 3 18:34:33 kjcf05n03 ras-resource-manager-agent[5923]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 3 18:34:33 kjcf05n03 ras-resource-manager-agent[5909]: Starting ras-resource-manager-agent:[ OK ] Nov 3 18:34:33 kjcf05n03 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 3 18:34:33 kjcf05n03 ras-resource-manager-agent[5925]: INFO Starting the service handler (service_main_handler.py:98) Nov 3 18:34:33 kjcf05n03 ras-resource-manager-client[5925]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 3 18:34:33 kjcf05n03 systemd[1]: Started Manages hardware resources. Nov 3 18:34:33 kjcf05n03 ras-resource-manager-client[5925]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 18:34:33 kjcf05n03 ras-resource-manager-client[5935]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 18:34:33 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:34 kjcf05n03 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:34:34 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:34 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:34 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 18:34:34 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 3 18:34:34 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:34 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 18:34:34 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:35 kjcf05n03 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: Press Ctrl+C to exit. Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: Plugin support version 1.0 Nov 3 18:34:35 kjcf05n03 zabbix_agent2[6009]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 18:34:35 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:35 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:35 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:35 kjcf05n03 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 3 18:34:35 kjcf05n03 dcs-notification-sender[6085]: dcs-notification-senderd is stopped Nov 3 18:34:35 kjcf05n03 zabbix-agent2[6099]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 3 18:34:35 kjcf05n03 dcs-notification-sender[6085]: Starting notification-sender:[ OK ] Nov 3 18:34:35 kjcf05n03 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 3 18:34:35 kjcf05n03 zabbix-agent2[6101]: INFO DCS notification agent started. (agent.py:61) Nov 3 18:34:35 kjcf05n03 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 3 18:34:35 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:36 kjcf05n03 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:34:36 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:36 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:36 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:36 kjcf05n03 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 3 18:34:36 kjcf05n03 dcs-collectord[6206]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 3 18:34:36 kjcf05n03 dcs-collectord[6206]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 3 18:34:36 kjcf05n03 dcs-bulk-data-sender[6206]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 3 18:34:36 kjcf05n03 dcs-bulk-data-sender[6197]: Starting bulk-data-sender:[ OK ] Nov 3 18:34:36 kjcf05n03 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 3 18:34:36 kjcf05n03 dcs-collectord[6208]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 3 18:34:36 kjcf05n03 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 3 18:34:36 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:37 kjcf05n03 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:34:37 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:37 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:37 kjcf05n03 nscd[2269]: 2269 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 3 18:34:37 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 18:34:37 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 18:34:37 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 18:34:37 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 3 18:34:37 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 18:34:37 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 3 18:34:37 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 18:34:37 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 3 18:34:37 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 18:34:37 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 3 18:34:37 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 18:34:37 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 3 18:34:37 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 18:34:37 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 3 18:34:37 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 18:34:37 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 18:34:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 18:34:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 3 18:34:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 3 18:34:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 3 18:34:38 kjcf05n03 systemd[1]: Stopping System Security Services Daemon... Nov 3 18:34:38 kjcf05n03 sssd[nss][2560]: Shutting down (status = 0) Nov 3 18:34:38 kjcf05n03 sssd[be[implicit_files]][2450]: Shutting down (status = 0) Nov 3 18:34:38 kjcf05n03 systemd[1]: sssd.service: Succeeded. Nov 3 18:34:38 kjcf05n03 systemd[1]: Stopped System Security Services Daemon. Nov 3 18:34:38 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 3 18:34:38 kjcf05n03 sssd[sssd][6279]: Starting up Nov 3 18:34:38 kjcf05n03 sssd[be[implicit_files]][6293]: Starting up Nov 3 18:34:38 kjcf05n03 python3.9[5232]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 3 18:34:38 kjcf05n03 python3.9[3182]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:34:38 kjcf05n03 sssd[nss][6294]: Starting up Nov 3 18:34:38 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 3 18:34:38 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 18:34:38 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 3 18:34:39 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 18:34:39 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 3 18:34:39 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 18:34:39 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 3 18:34:38 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n03": interface became available Nov 3 18:34:39 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 18:34:39 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 3 18:34:39 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure) defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 18:34:39 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure: defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 3 18:34:39 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure) defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 18:34:39 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure: defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 3 18:34:39 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 18:34:39 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 3 18:34:39 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 18:34:39 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 3 18:34:39 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 3 18:34:39 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 3 18:34:39 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:39 kjcf05n03 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 3 18:34:39 kjcf05n00 zabbix_server[15697]: item "kjcf05n03:vfs.fs.inode[/mnt/persistent_ha_data,pfree]" became not supported: no such file or directory Nov 3 18:34:40 kjcf05n03 icinga2[6339]: [2024-11-03 18:34:40 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 3 18:34:40 kjcf05n03 icinga2[6339]: [2024-11-03 18:34:40 -0600] information/cli: Loading configuration file(s). Nov 3 18:34:40 kjcf05n03 icinga2[6339]: [2024-11-03 18:34:40 -0600] information/ConfigItem: Committing config item(s). Nov 3 18:34:40 kjcf05n03 icinga2[6339]: [2024-11-03 18:34:40 -0600] information/ApiListener: My API identity: kjcf05n03 Nov 3 18:34:40 kjcf05n03 icinga2[6339]: [2024-11-03 18:34:40 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 3 18:34:40 kjcf05n03 icinga2[6339]: [2024-11-03 18:34:40 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 3 18:34:40 kjcf05n03 icinga2[6339]: [2024-11-03 18:34:40 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 3 18:34:40 kjcf05n03 icinga2[6339]: [2024-11-03 18:34:40 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 3 18:34:40 kjcf05n03 icinga2[6339]: [2024-11-03 18:34:40 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 3 18:34:40 kjcf05n03 icinga2[6339]: [2024-11-03 18:34:40 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 3 18:34:40 kjcf05n03 icinga2[6339]: [2024-11-03 18:34:40 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 3 18:34:40 kjcf05n03 icinga2[6339]: [2024-11-03 18:34:40 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 3 18:34:40 kjcf05n03 icinga2[6339]: [2024-11-03 18:34:40 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 3 18:34:40 kjcf05n03 icinga2[6339]: [2024-11-03 18:34:40 -0600] information/cli: Closing console log. Nov 3 18:34:40 kjcf05n03 systemd[1]: Started Icinga host/service/network monitoring system. Nov 3 18:34:40 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:40 kjcf05n03 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:34:40 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:40 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:41 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 18:34:41 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 3 18:34:41 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:40 kjcf05n00 zabbix_server[15702]: item "kjcf05n03:vfs.fs.size[/mnt/persistent_ha_data,total]" became not supported: no such file or directory Nov 3 18:34:40 kjcf05n00 zabbix_server[15702]: item "kjcf05n03:vfs.fs.size[/mnt/persistent_ha_data,used]" became not supported: no such file or directory Nov 3 18:34:40 kjcf05n00 zabbix_server[15702]: item "kjcf05n03:vfs.fs.size[/mnt/persistent_ha_data,pused]" became not supported: no such file or directory Nov 3 18:34:41 kjcf05n03 systemd[1]: Started Icinga2 network monitor. Nov 3 18:34:41 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:42 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 18:34:42 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:42 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:42 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 18:34:42 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 3 18:34:42 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 18:34:42 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 3 18:34:42 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 3 18:34:42 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 3 18:34:42 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 3 18:34:42 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 3 18:34:42 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 18:34:42 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 3 18:34:42 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 18:34:42 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 3 18:34:42 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 3 18:34:42 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 3 18:34:42 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:42 kjcf05n03 systemd[1]: Starting Naming services LDAP client daemon.... Nov 3 18:34:42 kjcf05n03 nslcd[6958]: version 0.9.9 starting Nov 3 18:34:42 kjcf05n03 nslcd[6958]: accepting connections Nov 3 18:34:42 kjcf05n03 systemd[1]: Started Naming services LDAP client daemon.. Nov 3 18:34:42 kjcf05n00 zabbix-server[1482380]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:34:42 kjcf05n00 zabbix-server[1482380]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n03 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n03:system.uptime): 00:02:24\\"}}"' Nov 3 18:34:42 kjcf05n00 log_interesting_event.py[1482380]: Event '46517' acknowledged Nov 3 18:34:43 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:43 kjcf05n03 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:34:43 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:43 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:43 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 18:34:43 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 3 18:34:43 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 18:34:43 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 3 18:34:43 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 18:34:43 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 3 18:34:44 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 18:34:44 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 3 18:34:44 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:44 kjcf05n03 systemd[1]: Starting DEAR Control Plane worker process... Nov 3 18:34:44 kjcf05n03 dearcpw[7056]: Using config script: /etc/dearcpw.conf Nov 3 18:34:44 kjcf05n03 dearcpw[7056]: - Creating default directory: '/var/log/dearcpw' Nov 3 18:34:44 kjcf05n03 dearcpw[7056]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 3 18:34:44 kjcf05n03 dearcpw[7056]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 3 18:34:44 kjcf05n03 dearcpw[7056]: - Creating default directory: '/var/run/dearcpw' Nov 3 18:34:44 kjcf05n03 dearcpw[7056]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 3 18:34:44 kjcf05n03 dearcpw[7056]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 3 18:34:44 kjcf05n03 dearcpw-server[7234]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 18:34:45 kjcf05n03 dearcpw[7056]: celery multi v5.2.7 (dawn-chorus) Nov 3 18:34:45 kjcf05n03 dearcpw[7056]: > Starting nodes... Nov 3 18:34:45 kjcf05n03 dearcpw[7056]: > dearcpw@kjcf05n03: OK Nov 3 18:34:45 kjcf05n03 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 3 18:34:45 kjcf05n03 dcs-bulk-data-sender[6208]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 3 18:34:45 kjcf05n03 dcs-collectord[6208]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 3 18:34:45 kjcf05n03 dearcpw-server[7236]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 3 18:34:45 kjcf05n03 dearcpw-server[7236]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 18:34:45 kjcf05n03 dearcpw-server[7236]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 3 18:34:45 kjcf05n03 systemd[1]: Started DEAR Control Plane worker process. Nov 3 18:34:45 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:45 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:45 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 3 18:34:45 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 3 18:34:45 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 3 18:34:45 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 3 18:34:45 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 3 18:34:45 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 3 18:34:45 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 3 18:34:45 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 3 18:34:45 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:55382). Nov 3 18:34:45 kjcf05n01 rsyncd[3238995]: connect from kjcf05n03 (172.16.2.6) Nov 3 18:34:45 kjcf05n01 rsyncd[3238995]: rsync to puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 3 18:34:45 kjcf05n01 rsyncd[3238995]: receiving file list Nov 3 18:34:45 kjcf05n01 rsyncd[3238995]: sent 29 bytes received 323 bytes total size 10901 Nov 3 18:34:45 kjcf05n01 systemd[1]: rsyncd@652-172.16.2.2:873-172.16.2.6:55382.service: Succeeded. Nov 3 18:34:45 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 3 18:34:45 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 3 18:34:45 kjcf05n03 puppet[7446]: IEC: 017000000: Node is up and running: { "node": "kjcf05n03" } Nov 3 18:34:45 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 3 18:34:45 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 3 18:34:45 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 3 18:34:45 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 3 18:34:45 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 3 18:34:45 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 3 18:34:45 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 18:34:45 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 3 18:34:45 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 18:34:45 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 3 18:34:46 kjcf05n03 dcs-collectord[5661]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 18:34:46 kjcf05n03 dcs-collectord[5661]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 18:34:46 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 18:34:46 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 3 18:34:46 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 18:34:46 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 18:34:47 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 18:34:47 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 18:34:47 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 18:34:47 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 18:34:48 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 18:34:48 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 18:34:48 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 18:34:48 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 18:34:48 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 18:34:48 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 18:34:48 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:48 kjcf05n03 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 3 18:34:49 kjcf05n03 diskless-swap[7630]: HA_PS_000: recovering journal Nov 3 18:34:49 kjcf05n03 systemd-udevd[1568]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 3 18:34:49 kjcf05n03 diskless-swap[7630]: HA_PS_000: clean, 2284/6400 files, 7053/25600 blocks Nov 3 18:34:49 kjcf05n03 diskless-swap[7630]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 3 18:34:49 kjcf05n03 diskless-swap[7630]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 3 18:34:49 kjcf05n03 diskless-swap[7630]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 3 18:34:49 kjcf05n03 diskless-swap[7630]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 3 18:34:49 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 3 18:34:49 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:49 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:49 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 3 18:34:49 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 3 18:34:49 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 18:34:49 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 3 18:34:49 kjcf05n03 systemd[1]: Stopping OpenSSH server daemon... Nov 3 18:34:49 kjcf05n03 systemd[1]: sshd.service: Succeeded. Nov 3 18:34:49 kjcf05n03 systemd[1]: Stopped OpenSSH server daemon. Nov 3 18:34:49 kjcf05n03 systemd[1]: Stopped target sshd-keygen.target. Nov 3 18:34:49 kjcf05n03 systemd[1]: Stopping sshd-keygen.target. Nov 3 18:34:49 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 3 18:34:49 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 3 18:34:49 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 3 18:34:49 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 3 18:34:49 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 3 18:34:49 kjcf05n03 ipmievd[4004]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 3 18:34:49 kjcf05n03 ipmievd[4004]: System Event sensor - Timestamp Clock Sync Nov 3 18:34:50 kjcf05n03 ipmievd[3182]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:34:50 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 18:34:50 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 3 18:34:50 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 18:34:50 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 3 18:34:49 kjcf05n00 zabbix_server[15651]: item "kjcf05n03:vfs.fs.size[/mnt/persistent_ha_data,total]" became supported Nov 3 18:34:50 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 18:34:50 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 3 18:34:51 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 18:34:51 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 3 18:34:51 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 3 18:34:51 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 3 18:34:52 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 18:34:52 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 3 18:34:52 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 3 18:34:52 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 3 18:34:52 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 3 18:34:52 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 3 18:34:52 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 18:34:52 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 3 18:34:53 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:53 kjcf05n03 systemd[1]: Set up automount opt-firmware.automount. Nov 3 18:34:53 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:53 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:53 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 18:34:53 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 3 18:34:53 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:53 kjcf05n03 systemd[1]: Set up automount mnt-llog.automount. Nov 3 18:34:53 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:53 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:53 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 18:34:53 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 3 18:34:53 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:53 kjcf05n03 systemd[1]: Set up automount usr-share-man.automount. Nov 3 18:34:53 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:34:53 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:34:53 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 3 18:34:53 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 3 18:34:53 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 3 18:34:53 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 3 18:34:54 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 3 18:34:54 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 3 18:34:54 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 18:34:54 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 3 18:34:54 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 18:34:54 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 3 18:34:54 kjcf05n03 systemd[1]: Reloading. Nov 3 18:34:53 kjcf05n00 mcfcli[3673891]: %3|1730680493.811|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:34:54 kjcf05n03 systemd[1]: Starting Crash recovery kernel arming... Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: kdump: No kdump initial ramdisk found. Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 3 18:34:54 kjcf05n03 dracut[7981]: dracut-049-135.git20210121.el8 Nov 3 18:34:54 kjcf05n03 dracut[7983]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 3 18:34:54 kjcf05n03 dracut[7983]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 18:34:54 kjcf05n03 dracut[7983]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 18:34:54 kjcf05n03 dracut[7983]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 3 18:34:54 kjcf05n03 dracut[7983]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 3 18:34:54 kjcf05n03 dracut[7983]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 18:34:54 kjcf05n03 dracut[7983]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 18:34:54 kjcf05n03 dracut[7983]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + is_func check Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ type -t check Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + '[' 0 -ne 0 ']' Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + check -h Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + local dev holder Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + require_binaries mdadm expr Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + local _module_name=90hperaid Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + local _ret=0 Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + [[ mdadm = \-\m ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + for cmd in "$@" Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + find_binary mdadm Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + for cmd in "$@" Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + find_binary expr Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + return 0 Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + [[ -n -h ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + for dev in "${!host_fs_types[@]}" Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + [[ nfs != *_raid_member ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + continue Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + return 255 Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + _ret=255 Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + hostonly=-h Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + return 255 Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + ret=255 Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + [[ 255 = 0 ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + [[ 255 = 255 ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ module_depends hperaid Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: +++ read a b Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ local _ret Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ unset check depends cmdline install installkernel Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: +++ set -x Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ depends Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ echo rootfs-block Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ return 0 Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ _ret=0 Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ unset check depends cmdline install installkernel Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ return 0 Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + for _moddep in $(module_depends $_mod) Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + [[ all == *\ hperaid\ * ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + add_dracutmodules+=' rootfs-block ' Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + [[ == *\ hperaid\ * ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + check_module rootfs-block Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + local _mod=rootfs-block Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + local _moddep Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + [[ == *\ rootfs-block\ * ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + [[ -n '' ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + mods_checked_as_dep+=' rootfs-block ' Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + [[ all == *\ rootfs-block\ * ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + module_check rootfs-block 0 Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + local _forced=0 Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + local _hostonly=-h Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + '[' 2 -eq 2 ']' Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + _forced=0 Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + is_func check Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ type -t check Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + '[' 0 -ne 0 ']' Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + check -h Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + return 0 Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + _ret=0 Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + hostonly=-h Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + return 0 Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + ret=0 Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: + [[ 0 = 0 ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ module_depends rootfs-block Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: +++ read a b Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 3 18:34:54 kjcf05n03 kdumpctl[3182]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ local _ret Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ unset check depends cmdline install installkernel Nov 3 18:34:54 kjcf05n03 kdumpctl[7869]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ depends Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo fs-lib Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ _ret=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ return 0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + for _moddep in $(module_depends $_mod) Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all == *\ rootfs-block\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + add_dracutmodules+=' fs-lib ' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ == *\ rootfs-block\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check_module fs-lib Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _mod=fs-lib Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddep Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n '' ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + mods_checked_as_dep+=' fs-lib ' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all == *\ fs-lib\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + module_check fs-lib 0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _forced=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _hostonly=-h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 2 -eq 2 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _forced=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + is_func check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ type -t check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 0 -ne 0 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check -h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _ret=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + hostonly=-h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + ret=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ 0 = 0 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ module_depends fs-lib Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: +++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ depends Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ return 0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ _ret=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ return 0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + mods_to_load+=' fs-lib ' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + mods_to_load+=' rootfs-block ' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + mods_to_load+=' hperaid ' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _mod=90kernel-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _mod=kernel-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check_module kernel-modules 1 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _mod=kernel-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddep Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n 1 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all = all ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + module_check kernel-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _forced=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _hostonly=-h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 1 -eq 2 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + is_func check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ type -t check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 0 -ne 0 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check -h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + true Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _ret=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + hostonly=-h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + ret=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ 0 != 0 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ module_depends kernel-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: +++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ depends Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ true Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ _ret=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ return 0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + mods_to_load+=' kernel-modules ' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _mod=90kernel-modules-extra Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _mod=kernel-modules-extra Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check_module kernel-modules-extra 1 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _mod=kernel-modules-extra Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddep Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n 1 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all = all ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + module_check kernel-modules-extra Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _forced=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _hostonly=-h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 1 -eq 2 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + is_func check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ type -t check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 0 -ne 0 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check -h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + true Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _ret=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + hostonly=-h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + ret=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ 0 != 0 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ module_depends kernel-modules-extra Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: +++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ depends Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ true Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ _ret=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ return 0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + mods_to_load+=' kernel-modules-extra ' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _mod=90kernel-network-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _mod=kernel-network-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check_module kernel-network-modules 1 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _mod=kernel-network-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddep Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n 1 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all = all ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + module_check kernel-network-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _forced=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _hostonly=-h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 1 -eq 2 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + is_func check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ type -t check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 0 -ne 0 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check -h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _ret=255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + hostonly=-h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + ret=255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ 255 != 0 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n 1 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 1 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _mod=90livenet Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _mod=livenet Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check_module livenet 1 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _mod=livenet Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddep Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n 1 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all = all ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + module_check livenet Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _forced=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _hostonly=-h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 1 -eq 2 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + is_func check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ type -t check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 0 -ne 0 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check -h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _ret=255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + hostonly=-h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + ret=255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ 255 != 0 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n 1 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 1 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _mod=90lvm Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _mod=lvm Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check_module lvm 1 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _mod=lvm Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddep Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n 1 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all = all ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + module_check lvm Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _forced=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _hostonly=-h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 1 -eq 2 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + is_func check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ type -t check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 0 -ne 0 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check -h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + require_binaries lvm Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _module_name=90lvm Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ lvm = \-\m ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + for cmd in "$@" Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + find_binary lvm Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n -h ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + for fs in "${host_fs_types[@]}" Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ nfs = LVM*_member ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _ret=255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + hostonly=-h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + ret=255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ 255 != 0 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n 1 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 1 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _mod=90mdraid Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _mod=mdraid Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check_module mdraid 1 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _mod=mdraid Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddep Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n 1 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all = all ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + module_check mdraid Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _forced=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _hostonly=-h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 1 -eq 2 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + is_func check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ type -t check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 0 -ne 0 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check -h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _rootdev Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + require_binaries mdadm expr Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _module_name=90mdraid Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ mdadm = \-\m ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + for cmd in "$@" Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + find_binary mdadm Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + for cmd in "$@" Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + find_binary expr Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n -h ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + for dev in "${!host_fs_types[@]}" Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ nfs != *_raid_member ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + continue Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _ret=255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + hostonly=-h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + ret=255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ 255 != 0 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n 1 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 1 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _mod=90multipath Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _mod=multipath Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check_module multipath 1 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _mod=multipath Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddep Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n 1 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all = all ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + module_check multipath Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _forced=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _hostonly=-h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 1 -eq 2 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + is_func check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ type -t check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 0 -ne 0 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check -h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _rootdev Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n -h ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + for_each_host_dev_and_slaves is_mpath Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _func=is_mpath Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _dev Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + for _dev in "${host_devs[@]}" Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + continue Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 1 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _ret=255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + hostonly=-h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + ret=255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ 255 != 0 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n 1 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 1 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _mod=90qemu Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _mod=qemu Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check_module qemu 1 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _mod=qemu Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddep Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n 1 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all = all ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + module_check qemu Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _forced=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _hostonly=-h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 1 -eq 2 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + is_func check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ type -t check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 0 -ne 0 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check -h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n -h ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + type -P systemd-detect-virt Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ systemd-detect-virt --vm Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + vm=none Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + (( 1 != 0 )) Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _ret=255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + hostonly=-h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + ret=255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ 255 != 0 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n 1 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 1 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _mod=90qemu-net Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _mod=qemu-net Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check_module qemu-net 1 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _mod=qemu-net Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddep Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n 1 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all = all ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + module_check qemu-net Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _forced=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _hostonly=-h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 1 -eq 2 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + is_func check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ type -t check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 0 -ne 0 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check -h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n -h ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + type -P systemd-detect-virt Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ systemd-detect-virt --vm Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + vm= Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + (( 1 != 0 )) Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _ret=255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + hostonly=-h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + ret=255 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ 255 != 0 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n 1 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + return 1 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _mod=90stratis Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + _mod=stratis Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check_module stratis 1 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _mod=stratis Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddep Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -n 1 ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ all = all ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + module_check stratis Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ read a b Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _forced=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _hostonly=-h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 1 -eq 2 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + is_func check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: ++ type -t check Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + '[' 0 -ne 0 ']' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + check -h Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _module_name=90stratis Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + local _ret=0 Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + [[ stratisd-init = \-\m ]] Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + for cmd in "$@" Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + find_binary stratisd-init Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 3 18:34:55 kjcf05n03 kdumpctl[7869]: + set +x Nov 3 18:34:55 kjcf05n03 dracut[7983]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 18:34:55 kjcf05n03 dracut[7983]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 3 18:34:55 kjcf05n03 dracut[7983]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 3 18:34:55 kjcf05n03 dracut[7983]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 3 18:34:54 kjcf05n00 zabbix_server[15689]: item "kjcf05n03:vfs.fs.size[/mnt/persistent_ha_data,used]" became supported Nov 3 18:34:55 kjcf05n03 dracut[7983]: memstrack is available Nov 3 18:34:55 kjcf05n03 dracut[7983]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 3 18:34:55 kjcf05n03 dracut[7983]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 3 18:34:55 kjcf05n03 dracut[7983]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 3 18:34:55 kjcf05n03 dracut[7983]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 3 18:34:55 kjcf05n03 dracut[7983]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 3 18:34:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 3 18:34:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 3 18:34:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 3 18:34:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 3 18:34:56 kjcf05n03 dracut[7983]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 3 18:34:56 kjcf05n03 dracut[7983]: *** Including module: bash *** Nov 3 18:34:56 kjcf05n03 dracut[7983]: *** Including module: systemd *** Nov 3 18:34:56 kjcf05n03 dracut[7983]: *** Including module: fips *** Nov 3 18:34:57 kjcf05n00 mcfcli[3673891]: %3|1730680497.021|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:34:57 kjcf05n03 dracut[7983]: *** Including module: systemd-initrd *** Nov 3 18:34:57 kjcf05n03 dracut[7983]: *** Including module: watchdog-modules *** Nov 3 18:34:57 kjcf05n03 dracut[7983]: *** Including module: nss-softokn *** Nov 3 18:34:57 kjcf05n03 dracut[7983]: *** Including module: i18n *** Nov 3 18:34:57 kjcf05n03 dracut[7983]: No KEYMAP configured. Nov 3 18:34:57 kjcf05n03 dracut[7983]: *** Including module: network-legacy *** Nov 3 18:34:57 kjcf05n03 dracut[7983]: *** Including module: network *** Nov 3 18:34:57 kjcf05n03 dracut[7983]: *** Including module: ib_bonding *** Nov 3 18:34:57 kjcf05n03 dracut[7983]: *** Including module: drm *** Nov 3 18:35:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 3 18:35:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 3 18:35:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 3 18:35:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 3 18:34:59 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 18:34:59 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 18:34:59 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 18:34:59 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running Nov 3 18:34:59 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 18:35:01 kjcf05n03 dracut[7983]: *** Including module: hperaid *** Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + install Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + local rule rule_path Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + inst_multiple cat expr Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.vfdfwv/initramfs -a -f cat expr Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + _ret=0 Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + (( 0 != 0 )) Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + : Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + return 0 Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + inst_multiple -o mdmon Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.vfdfwv/initramfs -a -f -o mdmon Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + _ret=0 Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + (( 0 != 0 )) Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + : Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + return 0 Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: ++ command -v partx Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + inst /usr/sbin/partx /sbin/partx Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + local _hostonly_install Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + [[ /usr/sbin/partx == \-\H ]] Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + [[ -e /tmp/dracut.vfdfwv/initramfs//sbin/partx ]] Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.vfdfwv/initramfs -f /usr/sbin/partx /sbin/partx Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + (( 0 != 0 )) Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + : Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: ++ command -v mdadm Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + local _hostonly_install Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + [[ -e /tmp/dracut.vfdfwv/initramfs//sbin/mdadm ]] Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.vfdfwv/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 3 18:35:01 kjcf05n03 dcs-collectord[5661]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 18:35:01 kjcf05n03 dcs-collectord[5661]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + (( 0 != 0 )) Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + : Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + [[ yes == \y\e\s ]] Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + local _raidconf Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: ++ cmdline Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: ++ local _activated dev line UUID Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: ++ declare -A _activated Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: ++ for dev in "${!host_fs_types[@]}" Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: ++ [[ nfs != *_raid_member ]] Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: ++ continue Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + _raidconf= Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + [[ -n '' ]] Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + inst_rules 64-md-raid.rules Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + local _target=/etc/udev/rules.d _rule _found Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + inst_dir /usr/lib/udev/rules.d Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + [[ -e /tmp/dracut.vfdfwv/initramfs//usr/lib/udev/rules.d ]] Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + return 0 Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + inst_dir /etc/udev/rules.d Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + [[ -e /tmp/dracut.vfdfwv/initramfs//etc/udev/rules.d ]] Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + return 0 Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + for _rule in "$@" Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + continue Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + continue Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + for r in '' $dracutbasedir/rules.d/ Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + [[ 64-md-raid.rules != /* ]] Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + continue Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + for r in '' $dracutbasedir/rules.d/ Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + continue Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + [[ -n '' ]] Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + set +x Nov 3 18:35:01 kjcf05n03 dracut[7983]: Skipping udev rule: 64-md-raid.rules Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + installkernel Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + instmods =drivers/md Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + local _optional=-o Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + local _silent Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + local _ret Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + [[ '' = yes ]] Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + [[ =drivers/md = \-\c ]] Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + [[ =drivers/md = \-\s ]] Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + (( 1 == 0 )) Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.vfdfwv/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + _ret=0 Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + (( 0 != 0 )) Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + [[ -n '' ]] Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + return 0 Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + _ret=0 Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + unset check depends cmdline install installkernel Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + return 0 Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + modules_loaded+='hperaid ' Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + '[' -n '' ']' Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + _d_mod=90kernel-modules Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + _d_mod=kernel-modules Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + [[ '' = yes ]] Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + dinfo '*** Including module: kernel-modules ***' Nov 3 18:35:01 kjcf05n03 kdumpctl[7869]: + set +x Nov 3 18:35:01 kjcf05n03 dracut[7983]: *** Including module: kernel-modules *** Nov 3 18:35:01 kjcf05n03 dracut[7983]: *** Including module: kernel-modules-extra *** Nov 3 18:35:02 kjcf05n03 dracut[7983]: *** Including module: kernel-network-modules *** Nov 3 18:35:02 kjcf05n03 dracut[7983]: *** Including module: diskless-mod *** Nov 3 18:35:02 kjcf05n03 dracut[7983]: *** Including module: fstab-sys *** Nov 3 18:35:02 kjcf05n03 dracut[7983]: *** Including module: nfs *** Nov 3 18:35:03 kjcf05n03 dracut[7983]: *** Including module: rootfs-block *** Nov 3 18:35:03 kjcf05n03 dracut[7983]: *** Including module: terminfo *** Nov 3 18:35:03 kjcf05n03 dracut[7983]: *** Including module: udev-rules *** Nov 3 18:35:03 kjcf05n03 dracut[7983]: Skipping udev rule: 91-permissions.rules Nov 3 18:35:03 kjcf05n03 dracut[7983]: Skipping udev rule: 80-drivers-modprobe.rules Nov 3 18:35:03 kjcf05n03 dracut[7983]: *** Including module: dracut-systemd *** Nov 3 18:35:04 kjcf05n03 dracut[7983]: *** Including module: usrmount *** Nov 3 18:35:04 kjcf05n03 dracut[7983]: *** Including module: base *** Nov 3 18:35:04 kjcf05n03 dracut[7983]: *** Including module: fs-lib *** Nov 3 18:35:04 kjcf05n03 dracut[7983]: *** Including module: kdumpbase *** Nov 3 18:35:04 kjcf05n03 dracut[7983]: *** Including module: memstrack *** Nov 3 18:35:04 kjcf05n03 dracut[7983]: *** Including module: shutdown *** Nov 3 18:35:04 kjcf05n03 dracut[7983]: *** Including module: squash *** Nov 3 18:35:04 kjcf05n03 dracut[7983]: *** Including modules done *** Nov 3 18:35:05 kjcf05n03 dracut[7983]: *** Installing kernel module dependencies *** Nov 3 18:35:05 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib0 Nov 3 18:35:05 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib0 Nov 3 18:35:05 kjcf05n03 dracut[7983]: *** Installing kernel module dependencies done *** Nov 3 18:35:05 kjcf05n03 dracut[7983]: *** Resolving executable dependencies *** Nov 3 18:35:06 kjcf05n03 dracut[7983]: *** Resolving executable dependencies done*** Nov 3 18:35:06 kjcf05n03 dracut[7983]: *** Hardlinking files *** Nov 3 18:35:06 kjcf05n03 dracut[7983]: *** Hardlinking files done *** Nov 3 18:35:06 kjcf05n03 dracut[7983]: *** Generating early-microcode cpio image *** Nov 3 18:35:06 kjcf05n03 dracut[7983]: *** Constructing AuthenticAMD.bin **** Nov 3 18:35:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730680505', 'host':'kjcf05n03', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 3 18:35:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730680505', 'host':'kjcf05n03', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 3 18:35:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730680505'} Nov 3 18:35:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730680505'} Nov 3 18:35:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:35:06 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 18:35:06 kjcf05n03 dracut[7983]: *** Store current command line parameters *** Nov 3 18:35:06 kjcf05n03 dracut[7983]: Stored kernel commandline: Nov 3 18:35:06 kjcf05n03 dracut[7983]: rd.driver.pre=sd_mod Nov 3 18:35:06 kjcf05n03 dracut[7983]: rd.driver.pre=nvme Nov 3 18:35:06 kjcf05n03 dracut[7983]: rd.driver.pre=ipmi_si Nov 3 18:35:06 kjcf05n03 dracut[7983]: rd.driver.pre=ipmi_devintf Nov 3 18:35:06 kjcf05n03 dracut[7983]: rd.driver.pre=ipmi_msghandler Nov 3 18:35:06 kjcf05n03 dracut[7983]: nameserver=172.16.2.2 Nov 3 18:35:06 kjcf05n03 dracut[7983]: nameserver=127.0.0.1 Nov 3 18:35:06 kjcf05n03 dracut[7983]: nameserver=172.16.2.2 Nov 3 18:35:06 kjcf05n03 dracut[7983]: nameserver=127.0.0.1 Nov 3 18:35:06 kjcf05n03 dracut[7983]: ifname=kdump-meth0:00:09:3d:06:9a:1a team=mgmt0:kdump-meth0 Nov 3 18:35:06 kjcf05n03 dracut[7983]: rd.neednet Nov 3 18:35:06 kjcf05n03 dracut[7983]: kdumpnic=mgmt0 Nov 3 18:35:06 kjcf05n03 dracut[7983]: bootdev=mgmt0 Nov 3 18:35:06 kjcf05n03 dracut[7983]: *** Install squash loader *** Nov 3 18:35:07 kjcf05n03 dracut[7983]: *** Squashing the files inside the initramfs *** Nov 3 18:35:07 kjcf05n03 dracut[7983]: *** Squashing the files inside the initramfs done *** Nov 3 18:35:07 kjcf05n03 dracut[7983]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 3 18:35:07 kjcf05n03 dracut[7983]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 3 18:35:08 kjcf05n03 kdumpctl[7869]: kdump: kexec: loaded kdump kernel Nov 3 18:35:08 kjcf05n03 kdumpctl[7869]: kdump: Starting kdump: [OK] Nov 3 18:35:08 kjcf05n03 systemd[1]: Started Crash recovery kernel arming. Nov 3 18:35:08 kjcf05n03 systemd[1]: Reloading. Nov 3 18:35:08 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 18:35:08 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 18:35:08 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 18:35:08 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running Nov 3 18:35:08 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 18:35:08 kjcf05n03 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:35:08 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:35:08 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:35:08 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 18:35:08 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 3 18:35:08 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 18:35:08 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 3 18:35:08 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 18:35:08 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 3 18:35:08 kjcf05n03 ifdown[14802]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 18:35:08 kjcf05n03 ifdown[14803]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:35:08 kjcf05n03 ifdown[14804]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:35:09 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 18:35:09 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 18:35:09 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 18:35:09 kjcf05n03 ifup[14874]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 18:35:09 kjcf05n03 ifup[14875]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:35:09 kjcf05n03 ifup[14876]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:35:09 kjcf05n02 LCNmon[17786]: 10.16.100.53 is unreachable via ib1 Nov 3 18:35:09 kjcf05n02 LCNmon[17786]: 10.16.100.59 is unreachable via ib1 Nov 3 18:35:11 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 3 18:35:13 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 3 18:35:14 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 18:35:14 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 18:35:14 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:35:14 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:35:14 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:35:14 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:35:14 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 18:35:14 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 18:35:14 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 18:35:14 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 18:35:14 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:35:14 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:35:14 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:35:14 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:35:14 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 3 18:35:14 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 3 18:35:14 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 3 18:35:14 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 3 18:35:14 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 3 18:35:14 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 3 18:35:14 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 3 18:35:14 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 3 18:35:14 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 3 18:35:14 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 3 18:35:14 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 3 18:35:14 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 3 18:35:14 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 3 18:35:14 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 3 18:35:14 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 18:35:14 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 3 18:35:14 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 18:35:14 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 3 18:35:14 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 18:35:14 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 3 18:35:14 kjcf05n03 ifdown[15048]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 18:35:14 kjcf05n03 ifdown[15049]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:35:14 kjcf05n03 ifdown[15050]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:35:14 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 3 18:35:14 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 3 18:35:14 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 18:35:14 kjcf05n03 ifup[15110]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 18:35:14 kjcf05n03 ifup[15121]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:35:14 kjcf05n03 ifup[15122]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:35:15 kjcf05n00 python3.9[1482942]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 18:35:16 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 3 18:35:16 kjcf05n03 dcs-collectord[5661]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 18:35:16 kjcf05n03 dcs-collectord[5661]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 18:35:16 kjcf05n03 check_diskmonit[15224]: DISKMONITOR CHECK: ERROR: Failed to run dm_report. Exit code: 1. Error output: b'Error: diskmonitor not running\n' Nov 3 18:35:18 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 3 18:35:18 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 18:35:18 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 3 18:35:18 kjcf05n03 systemd[1]: Reloading. Nov 3 18:35:19 kjcf05n03 systemd[1]: Starting Corosync Cluster Engine... Nov 3 18:35:19 kjcf05n03 await_ha_peer[15416]: Waiting for HA peer kjcf05n02 Nov 3 18:35:18 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 3 18:35:18 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 18:35:18 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 3 18:35:18 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running Nov 3 18:35:18 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 3 18:35:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730680519', 'host':'kjcf05n03', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 3 18:35:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730680519'} Nov 3 18:35:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:35:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730680519', 'host':'kjcf05n03', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 5.31, 2.66, 1.10'}"] Nov 3 18:35:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Load', 'description': 'OK - load average: 5.31, 2.66, 1.10', 'message': 'OK - load average: 5.31, 2.66, 1.10', 'value': 'ok', 'timestamp': '1730680519'} Nov 3 18:35:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:35:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730680519', 'host':'kjcf05n03', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 334 processes with STATE = RSZDT '}"] Nov 3 18:35:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Total Processes', 'description': 'PROCS OK: 334 processes with STATE = RSZDT ', 'message': 'PROCS OK: 334 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730680519'} Nov 3 18:35:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:35:20 kjcf05n03 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 3 18:35:20 kjcf05n03 await_ha_peer[15416]: Peer kjcf05n02 has started, starting HA Nov 3 18:35:20 kjcf05n03 systemd[1]: Started Corosync Cluster Engine. Nov 3 18:35:20 kjcf05n03 systemd[1]: Started Fast STONITH daemon. Nov 3 18:35:20 kjcf05n03 fstonithd.py[15492]: Listening for kdump packets from partner Nov 3 18:35:20 kjcf05n03 systemd[1]: Reloading. Nov 3 18:35:21 kjcf05n03 systemd[3182]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:35:21 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:35:21 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:35:21 kjcf05n03 systemd[1]: Reloading. Nov 3 18:35:21 kjcf05n03 systemd[1]: Reached target resource-agents dependencies. Nov 3 18:35:21 kjcf05n03 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 3 18:35:21 kjcf05n03 systemd[1]: Reloading. Nov 3 18:35:22 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 18:35:22 kjcf05n03 puppet-agent[3588]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 3 18:35:22 kjcf05n03 puppet[3588]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 3 18:35:22 kjcf05n03 puppet-agent[3588]: Applied catalog in 91.25 seconds Nov 3 18:35:22 kjcf05n03 puppet[3588]: Notice: Applied catalog in 91.25 seconds Nov 3 18:35:22 kjcf05n03 systemd[1]: Started Puppet agent. Nov 3 18:35:22 kjcf05n03 systemd[1]: Started Service to do FW and inventory check on boot. Nov 3 18:35:22 kjcf05n03 systemd[1]: Starting Set absolute GEM time... Nov 3 18:35:22 kjcf05n03 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 3 18:35:22 kjcf05n03 systemd[1]: Started Collect SAS Health Report every hour. Nov 3 18:35:22 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 18:35:22 kjcf05n03 systemd[1]: Reached target Timers. Nov 3 18:35:22 kjcf05n03 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 3 18:35:22 kjcf05n03 systemd[1]: Started Startup script for gateway-ec-node. Nov 3 18:35:22 kjcf05n03 systemd[1]: Started Startup script for monitoring-ec-node. Nov 3 18:35:22 kjcf05n03 wce-disable.sh[15631]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 3 18:35:22 kjcf05n03 systemd[1]: disable-write-cache.service: Succeeded. Nov 3 18:35:22 kjcf05n03 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 3 18:35:22 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 18:35:22 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 18:35:22 kjcf05n03 systemd[1]: set_gem_time.service: Succeeded. Nov 3 18:35:22 kjcf05n03 systemd[1]: Started Set absolute GEM time. Nov 3 18:35:22 kjcf05n03 gateway-ec-node.py[15634]: Starting gateway-ec-node service Nov 3 18:35:22 kjcf05n03 python3.9[15635]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 3 18:35:22 kjcf05n03 python3.9[15635]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 3 18:35:22 kjcf05n03 RFSF-API[15633]: INFO[2024-11-03T18:35:22-06:00] Datapath API RESTful Service starting Nov 3 18:35:22 kjcf05n03 dp-api-server-node[15633]: INFO[2024-11-03T18:35:22-06:00] Datapath API RESTful Service starting Nov 3 18:35:22 kjcf05n03 RFSF-API[15633]: INFO[2024-11-03T18:35:22-06:00] Running in production mode, starting dbus event listener Nov 3 18:35:22 kjcf05n03 dp-api-server-node[15633]: INFO[2024-11-03T18:35:22-06:00] Running in production mode, starting dbus event listener Nov 3 18:35:22 kjcf05n03 RFSF-API[15633]: INFO[2024-11-03T18:35:22-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 18:35:22 kjcf05n03 dp-api-server-node[15633]: INFO[2024-11-03T18:35:22-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 3 18:35:22 kjcf05n03 RFSF-API[15633]: INFO[2024-11-03T18:35:22-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 18:35:22 kjcf05n03 dp-api-server-node[15633]: INFO[2024-11-03T18:35:22-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 3 18:35:22 kjcf05n03 RFSF-API[15633]: INFO[2024-11-03T18:35:22-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 18:35:22 kjcf05n03 dp-api-server-node[15633]: INFO[2024-11-03T18:35:22-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 3 18:35:22 kjcf05n03 RFSF-API[15633]: INFO[2024-11-03T18:35:22-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 18:35:22 kjcf05n03 dp-api-server-node[15633]: INFO[2024-11-03T18:35:22-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 3 18:35:22 kjcf05n03 RFSF-API[15633]: INFO[2024-11-03T18:35:22-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 18:35:22 kjcf05n03 dp-api-server-node[15633]: INFO[2024-11-03T18:35:22-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 3 18:35:22 kjcf05n03 RFSF-API[15633]: INFO[2024-11-03T18:35:22-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 18:35:22 kjcf05n03 dp-api-server-node[15633]: INFO[2024-11-03T18:35:22-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 3 18:35:22 kjcf05n03 RFSF-API[15633]: INFO[2024-11-03T18:35:22-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 18:35:22 kjcf05n03 dp-api-server-node[15633]: INFO[2024-11-03T18:35:22-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 3 18:35:22 kjcf05n03 RFSF-API[15633]: INFO[2024-11-03T18:35:22-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 18:35:22 kjcf05n03 dp-api-server-node[15633]: INFO[2024-11-03T18:35:22-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 3 18:35:22 kjcf05n03 RFSF-API[15633]: INFO[2024-11-03T18:35:22-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 18:35:22 kjcf05n03 dp-api-server-node[15633]: INFO[2024-11-03T18:35:22-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 3 18:35:22 kjcf05n03 RFSF-API[15633]: INFO[2024-11-03T18:35:22-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 18:35:22 kjcf05n03 dp-api-server-node[15633]: INFO[2024-11-03T18:35:22-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 3 18:35:23 kjcf05n00 mcfcli[3673891]: %3|1730680523.811|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 18:35:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730680230', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 18:35:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730680230'} Nov 3 18:35:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:35:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730680230', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 18:35:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730680230'} Nov 3 18:35:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:35:29 kjcf05n03 systemd[1]: Reloading. Nov 3 18:35:29 kjcf05n03 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 3 18:35:29 kjcf05n03 systemd[1]: Reloading. Nov 3 18:35:29 kjcf05n03 systemd[1]: Starting Cluster Controlled lcnmon... Nov 3 18:35:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730680529', 'host':'kjcf05n03', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(336.0B/360.0B), ib1=(56.0B/360.0B), icl0=(7.2kB/8.9kB), lo=(600.0B/600.0B), meth0=(1541.5MB/8.0MB), mgmt0=(1478.4MB/8.0MB)'}"] Nov 3 18:35:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(336.0B/360.0B), ib1=(56.0B/360.0B), icl0=(7.2kB/8.9kB), lo=(600.0B/600.0B), meth0=(1541.5MB/8.0MB), mgmt0=(1478.4MB/8.0MB)', 'message': 'NET OK - (Rx/Tx) ib0=(336.0B/360.0B), ib1=(56.0B/360.0B), icl0=(7.2kB/8.9kB), lo=(600.0B/600.0B), meth0=(1541.5MB/8.0MB), mgmt0=(1478.4MB/8.0MB)', 'value': 'ok', 'timestamp': '1730680529'} Nov 3 18:35:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:35:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730680529', 'host':'kjcf05n03', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 3 18:35:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730680529'} Nov 3 18:35:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:35:30 kjcf05n03 diskmonitor_pre[16193]: Key management is currently disabled.DEAR disabled Nov 3 18:35:30 kjcf05n03 systemd[1]: Started Cluster Controlled diskmonitor. Nov 3 18:35:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730680530', 'host':'kjcf05n03', 'service_name':'Arrays and Disk Status', 'value':'UNKNOWN', 'message':'Diskmonitor not running'}"] Nov 3 18:35:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Arrays and Disk Status', 'description': 'Diskmonitor not running', 'message': 'Diskmonitor not running', 'value': 'unknown', 'timestamp': '1730680530'} Nov 3 18:35:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:35:31 kjcf05n03 dcs-collectord[5661]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 3 18:35:31 kjcf05n03 dcs-collectord[5661]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 18:35:31 kjcf05n03 dcs-collectord[5661]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 18:35:31 kjcf05n03 sh[16253]: LNET configured: New Created Nov 3 18:35:31 kjcf05n03 systemd[1]: Started Cluster Controlled lcnmon. Nov 3 18:35:31 kjcf05n03 LCNmon[18290]: Interface ib0 is up Nov 3 18:35:31 kjcf05n03 LCNmon[18290]: Interface ib1 is up Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: /var/run/diskmonitor does not exist, creating Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: Creating /var/run/diskmonitor/disk Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: Creating /var/run/diskmonitor/encl Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: Creating /var/run/diskmonitor/cli Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: RAS_Interlocks_enabled: 1 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: Using default ssd ids: HUSSL4010ASS600 , Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: add handler for sig: 14 sa_flags: 10000004 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: add handler for sig: 1 sa_flags: 10000004 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: add handler for sig: 2 sa_flags: 00000004 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: add handler for sig: 15 sa_flags: 00000004 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: add handler for sig: 6 sa_flags: 00000004 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: add handler for sig: 3 sa_flags: 00000004 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: add handler for sig: 30 sa_flags: 00000004 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: add handler for sig: 20 sa_flags: 00000004 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: add handler for sig: 10 sa_flags: 10000004 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: add handler for sig: 11 sa_flags: 00000004 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: add handler for sig: 7 sa_flags: 00000004 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: add handler for sig: 4 sa_flags: 00000004 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: add handler for sig: 8 sa_flags: 00000004 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: init_watch: /var/run/diskmonitor/encl initialized Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: init_watch: /var/run/diskmonitor/disk initialized Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: Using HA Baton locks - key: diskmonitor Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: Baton will be held for at most 570 seconds Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: DMMP Enabled: 0 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: random seed: 510c62a Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: NVMe Enclosure: 1 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: ZFS Enclosure: 0 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: Dbus, Initialized Connection Successfully Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: int_catcher_thread: thread start Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: Received dbus message 4 org.freedesktop.DBus -> :1.122 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b07bec_S4EUNF0MA05386M encl_slot: 0 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b07bed_S4EUNF0MA05387D encl_slot: 0 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 3 18:35:34 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 18:35:35 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18792 (bash) Nov 3 18:35:35 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 18:35:35 kjcf05n03 openhpid[5567]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 3 18:35:35 kjcf05n03 openhpid[5567]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 3 18:35:35 kjcf05n03 systemd[1]: Reached target Host and Network Name Lookups. Nov 3 18:35:35 kjcf05n03 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 3 18:35:35 kjcf05n03 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 3 18:35:35 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 18:35:35 kjcf05n03 LCNmon[18290]: 10.16.100.52 is unreachable via ib0 Nov 3 18:35:35 kjcf05n03 LCNmon[18290]: 10.16.100.55 is unreachable via ib0 Nov 3 18:35:35 kjcf05n03 LCNmon[18290]: 10.16.100.56 is unreachable via ib0 Nov 3 18:35:35 kjcf05n03 LCNmon[18290]: 10.16.100.61 is unreachable via ib0 Nov 3 18:35:35 kjcf05n03 LCNmon[18290]: Can ping through interface ib0 Nov 3 18:35:35 kjcf05n03 LCNmon[18290]: Can ping through interface ib1 Nov 3 18:35:35 kjcf05n03 LCNmon[18290]: NIC ib0, initial state UP Nov 3 18:35:35 kjcf05n03 LCNmon[18290]: NIC ib1, initial state UP Nov 3 18:35:35 kjcf05n03 LCNmon[18290]: LCNstat initial state UP Nov 3 18:35:36 kjcf05n03 systemd[1]: openhpid.service: Succeeded. Nov 3 18:35:36 kjcf05n03 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 3 18:35:36 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 3 18:35:36 kjcf05n03 LCNmon[18290]: LCNmon monitoring hosts kjcf05n03 and kjcf05n02 Nov 3 18:35:36 kjcf05n03 systemd[1]: openhpid.service: Supervising process 18854 which is not our child. We'll most likely not notice when it exits. Nov 3 18:35:36 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 3 18:35:36 kjcf05n03 systemd[1]: Reached target Multi-User System. Nov 3 18:35:36 kjcf05n03 systemd[1]: Reached target Graphical Interface. Nov 3 18:35:36 kjcf05n03 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 3 18:35:36 kjcf05n03 dcs-collectord[5661]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 3 18:35:36 kjcf05n03 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 3 18:35:36 kjcf05n03 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 3 18:35:36 kjcf05n03 systemd[1]: Startup finished in 50.300s (kernel) + 2min 28.690s (userspace) = 3min 18.991s. Nov 3 18:35:36 kjcf05n03 openhpid[18854]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 3 18:35:36 kjcf05n03 openhpid[18854]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 3 18:35:36 kjcf05n03 openhpid[18854]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 3 18:35:36 kjcf05n03 openhpid[18854]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 3 18:35:37 kjcf05n00 mcfcli[3673891]: %3|1730680537.018|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:35:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 3 18:35:39 kjcf05n00 httpd[902566]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-B): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n03', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 3 18:35:39 kjcf05n00 zabbix_server[15689]: item "kjcf05n03:vfs.fs.inode[/mnt/persistent_ha_data,pfree]" became supported Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b07bec_S4EUNF0MA05386M encl_sn: USE26000024VS001, slot: 1 Nov 3 18:35:40 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 3 18:35:40 kjcf05n03 systemd[1]: nodebootchecks.service: Succeeded. Nov 3 18:35:42 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31458 deleted. Nov 3 18:35:44 kjcf05n00 zabbix_server[15651]: item "kjcf05n03:vfs.fs.size[/mnt/persistent_ha_data,pused]" became supported Nov 3 18:35:46 kjcf05n03 dcs-collectord[5661]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 18:35:46 kjcf05n03 dcs-collectord[5661]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 3 18:35:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730680548', 'host':'kjcf05n03', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.7% (4404372 kB) used.'}"] Nov 3 18:35:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'RAM usage', 'description': 'OK - 1.7% (4404372 kB) used.', 'message': 'OK - 1.7% (4404372 kB) used.', 'value': 'ok', 'timestamp': '1730680548'} Nov 3 18:35:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:35:54 kjcf05n00 mcfcli[3673891]: %3|1730680554.311|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 18:36:01 kjcf05n03 dcs-collectord[5661]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 18:36:01 kjcf05n03 dcs-collectord[5661]: WARNING No data collected (hpi_parser.py:353) Nov 3 18:36:10 kjcf05n03 ipmievd[4004]: System Event sensor - Timestamp Clock Sync Nov 3 18:36:13 kjcf05n03 ipmievd[3182]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b07bed_S4EUNF0MA05387D encl_sn: USE26000024VS001, slot: 2 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 3 18:36:13 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 3 18:36:16 kjcf05n03 dcs-collectord[5661]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 3 18:36:16 kjcf05n00 mcfcli[3673891]: %3|1730680576.402|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:36:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730680576', 'host':'kjcf05n03', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 3 18:36:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730680576'} Nov 3 18:36:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:36:20 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db01037002538450000000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 18:36:20 kjcf05n03 ras-resource-manager-agent[5925]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "cfb3a732-9a44-11ef-8896-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 3 18:36:20 kjcf05n03 ras-resource-manager-agent[5925]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'cfb3a732-9a44-11ef-8896-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 3 18:36:20 kjcf05n03 ras-resource-manager-agent[5925]: INFO Submitting new device inserted signal, starting to qualify drive: cfb3a732-9a44-11ef-8896-00093d069a1b (admin_action.py:110) Nov 3 18:36:20 kjcf05n02 firmware-update-orc-server[5820]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "a7deab3c-93c1-46c7-a4f4-4fc55b4f9118"} (logger.py:65) Nov 3 18:36:20 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 145189 (get_disk_device) Nov 3 18:36:20 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 3 18:36:20 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 3 18:36:20 kjcf05n02 ccp-client[145210]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 18:36:20 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'cfb3a732-9a44-11ef-8896-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 18:36:20 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'cfb3a732-9a44-11ef-8896-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 3 18:36:20 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': 'cfb3a732-9a44-11ef-8896-00093d069a1b', 'response ID': 'cfbe4d0e-9a44-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 18:36:20 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: cfbe4d0e-9a44-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 18:36:21 kjcf05n02 ccp-client[145210]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 18:36:21 kjcf05n02 ccp-client[145219]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 18:36:21 kjcf05n02 ccp-client[145210]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 18:36:21 kjcf05n02 ccp-client[145210]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 18:36:21 kjcf05n02 ccp-client[145219]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 18:36:21 kjcf05n02 ccp-client[145219]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 18:36:21 kjcf05n03 diskmonitor[17871]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 18:36:21 kjcf05n03 ras-resource-manager-agent[5925]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "d0056a5e-9a44-11ef-8896-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 18:36:21 kjcf05n03 ras-resource-manager-agent[5925]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'd0056a5e-9a44-11ef-8896-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 18:36:21 kjcf05n03 ras-resource-manager-agent[5925]: INFO Submitting new device inserted signal, starting to qualify drive: d0056a5e-9a44-11ef-8896-00093d069a1b (admin_action.py:110) Nov 3 18:36:21 kjcf05n03 firmware-update-orc-server[5884]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "d68ab365-ee08-45b8-8b92-5a67c93df9a4"} (logger.py:65) Nov 3 18:36:21 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'd0056a5e-9a44-11ef-8896-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 18:36:21 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'd0056a5e-9a44-11ef-8896-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 3 18:36:21 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': 'd0056a5e-9a44-11ef-8896-00093d069a1b', 'response ID': 'd00cf51c-9a44-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 3 18:36:21 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: d00cf51c-9a44-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 18:36:24 kjcf05n02 DRVFW[145338]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 18:36:24 kjcf05n02 ccp-client[145349]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 18:36:24 kjcf05n02 ccp-client[145349]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 18:36:24 kjcf05n02 ccp-client[145358]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 18:36:24 kjcf05n02 ccp-client[145349]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 18:36:24 kjcf05n02 ccp-client[145349]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 18:36:24 kjcf05n02 ccp-client[145358]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 18:36:24 kjcf05n02 ccp-client[145358]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 18:36:24 kjcf05n02 firmware-update-orc-server[5820]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 3 18:36:24 kjcf05n00 mcfcli[3673891]: %3|1730680584.311|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 18:36:25 kjcf05n03 ras-resource-manager-agent[5925]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'cfb3a732-9a44-11ef-8896-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 18:36:25 kjcf05n03 ras-resource-manager-agent[5925]: INFO Drive qualification complete responding: cfb3a732-9a44-11ef-8896-00093d069a1b (admin_action.py:205) Nov 3 18:36:25 kjcf05n03 ras-resource-manager-agent[5925]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "cfb3a732-9a44-11ef-8896-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (interesting_event.py:59) Nov 3 18:36:24 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: cfbe4d0e-9a44-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 18:36:24 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': 'cfb3a732-9a44-11ef-8896-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'cfb3a732-9a44-11ef-8896-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}}} (logger.py:65) Nov 3 18:36:27 kjcf05n03 diskmonitor[17871]: 4 Nov 3 18:36:27 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 3 18:36:27 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 3 18:36:27 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 3 18:36:27 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 3 18:36:27 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 3 18:36:27 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 3 18:36:27 kjcf05n03 diskmonitor[17871]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 3 18:36:27 kjcf05n03 diskmonitor[17871]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 3 18:36:27 kjcf05n03 diskmonitor[17871]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 3 18:36:27 kjcf05n03 diskmonitor[17871]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 18:36:27 kjcf05n03 diskmonitor[17871]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 3 18:36:27 kjcf05n03 diskmonitor[17871]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "cfb3a732-9a44-11ef-8896-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 3 18:36:27 kjcf05n03 diskmonitor[17871]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 18:36:27 kjcf05n03 diskmonitor[17871]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 18:36:27 kjcf05n03 diskmonitor[17871]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "d0056a5e-9a44-11ef-8896-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 18:36:27 kjcf05n03 diskmonitor[17871]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 18:36:27 kjcf05n03 diskmonitor[17871]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 18:36:33 kjcf05n03 chronyd[5171]: Selected source 172.16.2.1 Nov 3 18:36:35 kjcf05n03 ras-resource-manager-agent[5925]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "cfb3a732-9a44-11ef-8896-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (service_main_handler.py:66) Nov 3 18:36:35 kjcf05n03 ras-resource-manager-agent[5925]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'cfb3a732-9a44-11ef-8896-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 3 18:36:35 kjcf05n03 ras-resource-manager-agent[5925]: INFO Device qualification response has been acknowledged: cfb3a732-9a44-11ef-8896-00093d069a1b (admin_action.py:151) Nov 3 18:36:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730680595}"] Nov 3 18:36:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730680595, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:36:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:36:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730680595}"] Nov 3 18:36:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730680595, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:36:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:36:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730680595}"] Nov 3 18:36:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730680595, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:36:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:36:36 kjcf05n03 systemd[1]: Unmounting /mnt/llog... Nov 3 18:36:36 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 23027 (get_disk_device) Nov 3 18:36:36 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 3 18:36:36 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 3 18:36:36 kjcf05n03 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 18:36:36 kjcf05n03 systemd[1]: Unmounted /mnt/llog. Nov 3 18:36:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730680595}"] Nov 3 18:36:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730680595, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:36:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:36:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730680595}"] Nov 3 18:36:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730680595, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:36:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:36:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730680595}"] Nov 3 18:36:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730680595, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:36:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:36:36 kjcf05n03 ccp-client[23077]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 18:36:36 kjcf05n03 ccp-client[23077]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 18:36:36 kjcf05n03 ccp-client[23116]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 18:36:36 kjcf05n03 ccp-client[23077]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 18:36:36 kjcf05n03 ccp-client[23077]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 18:36:36 kjcf05n03 ccp-client[23116]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 18:36:36 kjcf05n03 ccp-client[23116]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 18:36:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730680595}"] Nov 3 18:36:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730680595, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:36:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:36:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730680595}"] Nov 3 18:36:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730680595, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:36:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:36:38 kjcf05n03 diskmonitor[17871]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 18:36:39 kjcf05n03 diskmonitor[17871]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 18:36:39 kjcf05n03 ras-resource-manager-agent[5925]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "dad2fad2-9a44-11ef-8896-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 3 18:36:39 kjcf05n03 ras-resource-manager-agent[5925]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'dad2fad2-9a44-11ef-8896-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 3 18:36:39 kjcf05n03 ras-resource-manager-agent[5925]: INFO Requests ['d0056a5e-9a44-11ef-8896-00093d069a1b', 'dad2fad2-9a44-11ef-8896-00093d069a1b'] already in progress (admin_action.py:99) Nov 3 18:36:40 kjcf05n03 DRVFW[24144]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 3 18:36:40 kjcf05n03 ccp-client[24147]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 3 18:36:40 kjcf05n03 ccp-client[24147]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 3 18:36:40 kjcf05n03 ccp-client[24166]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 3 18:36:40 kjcf05n03 ccp-client[24147]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 3 18:36:40 kjcf05n03 ccp-client[24147]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 3 18:36:40 kjcf05n03 ccp-client[24166]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 3 18:36:40 kjcf05n03 ccp-client[24166]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 3 18:36:40 kjcf05n03 python3.9[5232]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 3 18:36:40 kjcf05n03 python3.9[3182]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:36:40 kjcf05n03 firmware-update-orc-server[5884]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 3 18:36:41 kjcf05n03 ras-resource-manager-agent[5925]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'd0056a5e-9a44-11ef-8896-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 18:36:41 kjcf05n03 ras-resource-manager-agent[5925]: INFO Drive qualification complete responding: d0056a5e-9a44-11ef-8896-00093d069a1b (admin_action.py:205) Nov 3 18:36:41 kjcf05n03 ras-resource-manager-agent[5925]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "d0056a5e-9a44-11ef-8896-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (interesting_event.py:59) Nov 3 18:36:41 kjcf05n03 ras-resource-manager-agent[5925]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "dad2fad2-9a44-11ef-8896-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (interesting_event.py:59) Nov 3 18:36:41 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: d00cf51c-9a44-11ef-acfe-00093d0696a6 (logger.py:65) Nov 3 18:36:41 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': 'd0056a5e-9a44-11ef-8896-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'd0056a5e-9a44-11ef-8896-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}}} (logger.py:65) Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "cfb3a732-9a44-11ef-8896-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: Dbus, handle_ingress_ras_signals, uuid: cfb3a732-9a44-11ef-8896-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "cfb3a732-9a44-11ef-8896-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: main: Pending firmware leveling requests exist, rescanning disks Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "dad2fad2-9a44-11ef-8896-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: leaving test state: 1 next state: 2 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: lock req: no timeout Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: leaving test state: 2 next state: 4 Nov 3 18:36:44 kjcf05n03 diskmonitor[17871]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 18:36:54 kjcf05n00 mcfcli[3673891]: %3|1730680614.312|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:36:56 kjcf05n00 mcfcli[3673891]: %3|1730680616.399|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:37:24 kjcf05n00 mcfcli[3673891]: %3|1730680644.312|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:37:35 kjcf05n00 mcfcli[3673891]: %3|1730680655.795|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:37:36 kjcf05n03 ras-resource-manager-agent[5925]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "d0056a5e-9a44-11ef-8896-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (service_main_handler.py:66) Nov 3 18:37:36 kjcf05n03 ras-resource-manager-agent[5925]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'd0056a5e-9a44-11ef-8896-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 18:37:36 kjcf05n03 ras-resource-manager-agent[5925]: INFO Device qualification response has been acknowledged: d0056a5e-9a44-11ef-8896-00093d069a1b (admin_action.py:151) Nov 3 18:37:36 kjcf05n03 ras-resource-manager-agent[5925]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "dad2fad2-9a44-11ef-8896-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (service_main_handler.py:66) Nov 3 18:37:36 kjcf05n03 ras-resource-manager-agent[5925]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'dad2fad2-9a44-11ef-8896-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}} (resource_admin.py:98) Nov 3 18:37:36 kjcf05n03 ras-resource-manager-agent[5925]: INFO Device qualification response has been acknowledged: dad2fad2-9a44-11ef-8896-00093d069a1b (admin_action.py:151) Nov 3 18:37:37 kjcf05n03 diskmonitor[17871]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 3 18:37:41 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 3 18:37:41 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 18:37:41 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 3 18:37:54 kjcf05n03 diskmonitor[17871]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "d0056a5e-9a44-11ef-8896-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 3 18:37:54 kjcf05n03 diskmonitor[17871]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 18:37:54 kjcf05n03 diskmonitor[17871]: Dbus, handle_ingress_ras_signals, uuid: d0056a5e-9a44-11ef-8896-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 18:37:54 kjcf05n03 diskmonitor[17871]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 3 18:37:54 kjcf05n03 diskmonitor[17871]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "d0056a5e-9a44-11ef-8896-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 3 18:37:54 kjcf05n03 diskmonitor[17871]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "dad2fad2-9a44-11ef-8896-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 3 18:37:54 kjcf05n03 diskmonitor[17871]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 3 18:37:54 kjcf05n03 diskmonitor[17871]: Dbus, handle_ingress_ras_signals, uuid: dad2fad2-9a44-11ef-8896-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 3 18:37:54 kjcf05n03 diskmonitor[17871]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "dad2fad2-9a44-11ef-8896-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 3 18:37:54 kjcf05n03 diskmonitor[17871]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 3 18:37:54 kjcf05n03 diskmonitor[17871]: lock acquired Nov 3 18:37:54 kjcf05n03 diskmonitor[17871]: leaving test state: 4 next state: 8 Nov 3 18:37:54 kjcf05n03 diskmonitor[17871]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 18:37:54 kjcf05n00 mcfcli[3673891]: %3|1730680674.313|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 18:37:57 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 3 18:37:57 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 3 18:37:57 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 3 18:38:07 kjcf05n03 dcs-collectord[5661]: INFO Successfully collected data dmreport after 8 failures (dm_report_collection_process.py:204) Nov 3 18:38:12 kjcf05n00 mcfcli[3673891]: %3|1730680692.505|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:38:13 kjcf05n03 diskmonitor[17871]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 3 18:38:13 kjcf05n03 diskmonitor[17871]: leaving test state: 8 next state: 20 Nov 3 18:38:13 kjcf05n03 diskmonitor[17871]: leaving test state: 20 next state: 40 Nov 3 18:38:13 kjcf05n03 diskmonitor[17871]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 2965b8a8000 Nov 3 18:38:13 kjcf05n03 diskmonitor[17871]: leaving test state: 40 next state: 80 Nov 3 18:38:13 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 3 18:38:24 kjcf05n00 mcfcli[3673891]: %3|1730680704.313|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:38:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730680715}"] Nov 3 18:38:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730680715, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:38:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:38:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:38:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:38:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:38:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:38:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:38:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:38:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:38:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:38:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:38:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:38:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:38:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:38:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.171347ms Nov 3 18:38:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:38:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.171347ms Nov 3 18:38:35 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:38:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:38:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:38:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730680715}"] Nov 3 18:38:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730680715, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:38:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:38:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:38:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:38:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:38:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:38:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:38:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:38:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:38:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:38:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:38:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:38:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:38:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:38:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.901161ms Nov 3 18:38:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:38:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.901161ms Nov 3 18:38:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:38:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:38:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:38:47 kjcf05n00 mcfcli[3673891]: %3|1730680727.594|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:38:54 kjcf05n00 mcfcli[3673891]: %3|1730680734.314|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 18:39:08 kjcf05n03 diskmonitor[17871]: leaving test state: 80 next state: 100 Nov 3 18:39:08 kjcf05n03 diskmonitor[17871]: lock release: time: Sun Nov 3 18:39:04 2024 Nov 3 18:39:08 kjcf05n03 diskmonitor[17871]: leaving test state: 100 next state: 1 Nov 3 18:39:24 kjcf05n00 mcfcli[3673891]: %3|1730680764.314|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:39:25 kjcf05n00 mcfcli[3673891]: %3|1730680765.080|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:39:42 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31459 deleted. Nov 3 18:39:54 kjcf05n00 mcfcli[3673891]: %3|1730680794.315|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 18:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 18:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 18:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 18:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 18:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 18:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 18:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 18:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 18:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 18:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 18:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 18:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 18:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 18:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 18:40:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 18:40:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:40:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 18:40:04 kjcf05n00 mcfcli[3673891]: %3|1730680804.078|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:40:15 kjcf05n00 python3.9[1486341]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 18:40:24 kjcf05n00 mcfcli[3673891]: %3|1730680824.405|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 18:40:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730680230', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 3 18:40:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730680230'} Nov 3 18:40:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:40:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730680230', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 3 18:40:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730680230'} Nov 3 18:40:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:40:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730680833', 'host':'kjcf05n03', 'service_name':'Arrays and Disk Status', 'value':'OK', 'message':'No arrays found, T10PI: Not relevant on this system\\nTotal number of disk slots available: 24\\nTotal number of disks found: 24\\n\\nslot: 1, wwn: eui.345950304db010370025384500000004, cap: 3840755982336, dev: nvme14n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\nslot: 13, wwn: eui.345950304db010210025384500000004, cap: 3840755982336, dev: nvme13n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\n\\nMD RAID to Lustre mapping\\n\\n\\n\\n\\nDegraded Array information:\\n\\nAll arrays are in clean state on node kjcf05n03'}"] Nov 3 18:40:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Arrays and Disk Status', 'description': 'No arrays found, T10PI: Not relevant on this system\\nTotal number of disk slots available: 24\\nTotal number of disks found: 24\\n\\nslot: 1, wwn: eui.345950304db010370025384500000004, cap: 3840755982336, dev: nvme14n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\nslot: 13, wwn: eui.345950304db010210025384500000004, cap: 3840755982336, dev: nvme13n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\n\\nMD RAID to Lustre mapping\\n\\n\\n\\n\\nDegraded Array information:\\n\\nAll arrays are in clean state on node kjcf05n03', 'message': 'No arrays found, T10PI: Not relevant on this system\\nTotal number of disk slots available: 24\\nTotal number of disks found: 24\\n\\nslot: 1, wwn: eui.345950304db010370025384500000004, cap: 3840755982336, dev: nvme14n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\nslot: 13, wwn: eui.345950304db010210025384500000004, cap: 3840755982336, dev: nvme13n1, parts: 0, status: Hot Spare, t10: 11110711100, type: ssd, sect: 4096, reason: normal, dwpd: 1\\n\\nMD RAID to Lustre mapping\\n\\n\\n\\n\\nDegraded Array information:\\n\\nAll arrays are in clean state on node kjcf05n03', 'value': 'ok', 'timestamp': '1730680833'} Nov 3 18:40:34 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:40:44 kjcf05n00 mcfcli[3673891]: %3|1730680844.075|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:40:54 kjcf05n00 mcfcli[3673891]: %3|1730680854.816|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:41:14 kjcf05n00 zabbix-server[1487072]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:41:14 kjcf05n00 zabbix-server[1487072]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n03' from event '46541' Nov 3 18:41:14 kjcf05n00 zabbix-server[1487072]: Host created 'enclosure_USE26000024VS001' Nov 3 18:41:14 kjcf05n00 zabbix-server[1487072]: Running puppet on 'kjcf05n03' Nov 3 18:41:16 kjcf05n03 puppet-agent[34060]: Using configured environment 'production' Nov 3 18:41:16 kjcf05n03 puppet-agent[34060]: Retrieving pluginfacts Nov 3 18:41:16 kjcf05n03 puppet-agent[34060]: Retrieving plugin Nov 3 18:41:16 kjcf05n03 puppet-agent[34060]: Loading facts Nov 3 18:41:19 kjcf05n03 puppet-agent[34060]: Caching catalog for kjcf05n03 Nov 3 18:41:19 kjcf05n03 puppet-agent[34060]: Applying configuration version '1730680877' Nov 3 18:41:21 kjcf05n03 puppet-agent[34060]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 18:41:21 kjcf05n03 puppet-agent[34060]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 18:41:21 kjcf05n03 puppet-agent[34060]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 18:41:22 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 18:41:22 kjcf05n03 zabbix_agent2[6009]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 18:41:22 kjcf05n03 zabbix_agent2[3182]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:41:22 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 18:41:22 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 18:41:22 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 18:41:22 kjcf05n03 puppet-agent[34060]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: Press Ctrl+C to exit. Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: Plugin support version 1.0 Nov 3 18:41:22 kjcf05n03 zabbix_agent2[34591]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 18:41:23 kjcf05n00 mcfcli[3673891]: %3|1730680883.402|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:41:24 kjcf05n03 puppet-agent[34060]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 18:41:24 kjcf05n03 puppet-agent[34060]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 18:41:24 kjcf05n03 puppet-agent[34060]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 18:41:24 kjcf05n03 puppet-agent[34060]: Applied catalog in 5.03 seconds Nov 3 18:41:24 kjcf05n00 zabbix-server[1487072]: puppet completed status:(0): '' Nov 3 18:41:24 kjcf05n00 zabbix-server[1487072]: Event '46541' acknowledged Nov 3 18:41:24 kjcf05n00 zabbix-server[1487072]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n03"}' Nov 3 18:41:24 kjcf05n00 mcfcli[3673891]: %3|1730680884.816|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:41:54 kjcf05n00 mcfcli[3673891]: %3|1730680914.816|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 18:42:00 kjcf05n00 mcfcli[3673891]: %3|1730680920.972|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:42:24 kjcf05n00 mcfcli[3673891]: %3|1730680944.816|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 18:42:38 kjcf05n00 mcfcli[3673891]: %3|1730680958.163|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:42:54 kjcf05n00 mcfcli[3673891]: %3|1730680974.816|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 18:43:18 kjcf05n00 mcfcli[3673891]: %3|1730680998.160|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:43:24 kjcf05n00 mcfcli[3673891]: %3|1730681004.817|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T18:43:27.254294055-06:00 level=info msg="Completed cleanup jobs" duration=27.680499ms Nov 3 18:43:54 kjcf05n00 mcfcli[3673891]: %3|1730681034.817|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:43:58 kjcf05n00 mcfcli[3673891]: %3|1730681038.157|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:44:24 kjcf05n00 mcfcli[3673891]: %3|1730681064.818|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:44:35 kjcf05n00 mcfcli[3673891]: %3|1730681075.071|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:44:54 kjcf05n00 mcfcli[3673891]: %3|1730681094.818|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:45:12 kjcf05n00 mcfcli[3673891]: %3|1730681112.637|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:45:15 kjcf05n00 python3.9[1489207]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 18:45:24 kjcf05n00 mcfcli[3673891]: %3|1730681124.818|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 18:45:48 kjcf05n00 mcfcli[3673891]: %3|1730681148.339|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:45:54 kjcf05n00 mcfcli[3673891]: %3|1730681154.818|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 18:46:10 kjcf05n03 root[41785]: failback_xyraid Nov 3 18:46:11 kjcf05n03 root[41915]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 3 18:46:12 kjcf05n03 root[41993]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 3 18:46:16 kjcf05n02 systemd[1]: data-kjcf05n03:md66.mount: Succeeded. Nov 3 18:46:24 kjcf05n00 mcfcli[3673891]: %3|1730681184.818|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:46:26 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme15n1 Nov 3 18:46:26 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme22n1 Nov 3 18:46:26 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme20n1 Nov 3 18:46:26 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme12n1 Nov 3 18:46:26 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme21n1 Nov 3 18:46:26 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme10n1 Nov 3 18:46:26 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme7n1 Nov 3 18:46:26 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme16n1 Nov 3 18:46:26 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme6n1 Nov 3 18:46:26 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme5n1 Nov 3 18:46:26 kjcf05n02 dwd[5139]: Drive path is missing, purging: nvme11n1 Nov 3 18:46:28 kjcf05n03 dwd[5203]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 3 18:46:28 kjcf05n03 dwd[5203]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 3 18:46:28 kjcf05n03 dwd[5203]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 3 18:46:28 kjcf05n03 dwd[5203]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 3 18:46:28 kjcf05n03 dwd[5203]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 3 18:46:28 kjcf05n03 dwd[5203]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 3 18:46:28 kjcf05n03 dwd[5203]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 3 18:46:28 kjcf05n03 dwd[5203]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 3 18:46:28 kjcf05n03 dwd[5203]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 3 18:46:28 kjcf05n03 dwd[5203]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 3 18:46:28 kjcf05n03 dwd[5203]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 3 18:46:28 kjcf05n03 dwd[5203]: Starting NVME thread for nvme10n1 Nov 3 18:46:28 kjcf05n03 dwd[5203]: Starting NVME thread for nvme15n1 Nov 3 18:46:28 kjcf05n00 mcfcli[3673891]: %3|1730681188.250|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:46:28 kjcf05n03 dwd[5203]: Starting NVME thread for nvme21n1 Nov 3 18:46:28 kjcf05n03 dwd[5203]: Starting NVME thread for nvme11n1 Nov 3 18:46:29 kjcf05n03 dwd[5203]: Starting NVME thread for nvme20n1 Nov 3 18:46:29 kjcf05n03 dwd[5203]: Starting NVME thread for nvme12n1 Nov 3 18:46:29 kjcf05n03 systemd-udevd[45139]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45137]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45141]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45142]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45137]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45139]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45142]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45141]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45137]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45139]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45142]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45141]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45137]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45139]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45142]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45141]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45137]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45139]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45142]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45141]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45137]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45139]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45142]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45141]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45137]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45139]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45142]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45141]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45137]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45139]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45141]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45142]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45175]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45177]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45179]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45181]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45175]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45179]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45177]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45181]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45175]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45177]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45175]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45181]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45175]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45181]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45177]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45175]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45177]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45175]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45177]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45175]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45177]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45175]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45175]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45177]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45175]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45177]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45175]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45177]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45175]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45175]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45175]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 systemd-udevd[45175]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 3 18:46:29 kjcf05n03 dwd[5203]: Starting NVME thread for nvme7n1 Nov 3 18:46:29 kjcf05n03 dwd[5203]: Starting NVME thread for nvme6n1 Nov 3 18:46:29 kjcf05n03 dwd[5203]: Starting NVME thread for nvme5n1 Nov 3 18:46:30 kjcf05n03 dwd[5203]: Starting NVME thread for nvme16n1 Nov 3 18:46:30 kjcf05n03 dwd[5203]: Starting NVME thread for nvme22n1 Nov 3 18:46:30 kjcf05n03 dcs-bulk-data-sender[6208]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 141}' Nov 3 18:46:32 kjcf05n03 nslcd[6958]: [8b4567] (re)loading /etc/nsswitch.conf Nov 3 18:46:39 kjcf05n03 diskmonitor[17871]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 3 18:46:46 kjcf05n03 diskmonitor[17871]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 3 18:46:46 kjcf05n03 diskmonitor[17871]: Scan for ReadErrorMax change for md66 Nov 3 18:46:46 kjcf05n03 diskmonitor[17871]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 3 18:46:46 kjcf05n03 diskmonitor[17871]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 18:46:46 kjcf05n03 diskmonitor[17871]: read_saved_file: md66 no saved speed Nov 3 18:46:46 kjcf05n03 diskmonitor[17871]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 3 18:46:46 kjcf05n03 diskmonitor[17871]: Set sync_speed_min (10000) for md66 Nov 3 18:46:46 kjcf05n03 diskmonitor[17871]: Set sync_speed_max (200000) for md66 Nov 3 18:46:46 kjcf05n03 diskmonitor[17871]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 18:46:54 kjcf05n00 mcfcli[3673891]: %3|1730681214.819|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:47:05 kjcf05n00 mcfcli[3673891]: %3|1730681225.667|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:47:17 kjcf05n03 systemd[1]: Starting Cleanup of Temporary Directories... Nov 3 18:47:17 kjcf05n03 systemd-tmpfiles[47728]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 18:47:17 kjcf05n03 systemd-tmpfiles[47728]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 3 18:47:17 kjcf05n03 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 3 18:47:17 kjcf05n03 systemd[1]: Started Cleanup of Temporary Directories. Nov 3 18:47:18 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47905 (bash) Nov 3 18:47:18 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 3 18:47:18 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 3 18:47:24 kjcf05n00 mcfcli[3673891]: %3|1730681244.820|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:47:26 kjcf05n02 diskmonitor[17328]: Removed MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 3 18:47:26 kjcf05n02 diskmonitor[17328]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 3 18:47:43 kjcf05n00 mcfcli[3673891]: %3|1730681263.573|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:47:55 kjcf05n00 mcfcli[3673891]: %3|1730681275.320|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 18:48:00 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 18:48:23 kjcf05n00 mcfcli[3673891]: %3|1730681303.570|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:48:25 kjcf05n00 mcfcli[3673891]: %3|1730681305.426|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 18:48:31 kjcf05n04 systemd[1]: Unmounting /mnt/llog... Nov 3 18:48:31 kjcf05n04 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 18:48:31 kjcf05n04 systemd[1]: Unmounted /mnt/llog. Nov 3 18:48:35 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 3 18:48:35 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 18:48:35 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 3 18:48:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730681316}"] Nov 3 18:48:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730681316, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:48:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.236869ms Nov 3 18:48:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.236869ms Nov 3 18:48:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:48:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:48:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:48:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730681316}"] Nov 3 18:48:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730681316, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:48:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.112666ms Nov 3 18:48:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.112666ms Nov 3 18:48:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:48:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:48:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:48:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730681316}"] Nov 3 18:48:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730681316, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:48:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.47227ms Nov 3 18:48:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.47227ms Nov 3 18:48:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:48:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:48:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:48:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730681316}"] Nov 3 18:48:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730681316, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:48:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.781507ms Nov 3 18:48:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.781507ms Nov 3 18:48:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:48:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:48:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:48:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730681316}"] Nov 3 18:48:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730681316, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:48:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.125431ms Nov 3 18:48:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.125431ms Nov 3 18:48:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:48:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:48:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:48:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730681316}"] Nov 3 18:48:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730681316, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:48:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.845716ms Nov 3 18:48:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.845716ms Nov 3 18:48:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:48:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:48:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:48:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730681316}"] Nov 3 18:48:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730681316, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:48:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.491466ms Nov 3 18:48:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.491466ms Nov 3 18:48:37 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:48:37 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:48:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:48:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730681316}"] Nov 3 18:48:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730681316, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:48:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.706088ms Nov 3 18:48:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.706088ms Nov 3 18:48:37 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:48:37 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:48:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:48:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730681316}"] Nov 3 18:48:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730681316, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:48:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.193348ms Nov 3 18:48:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.193348ms Nov 3 18:48:37 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:48:37 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:48:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:48:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730681316}"] Nov 3 18:48:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730681316, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:48:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.790263ms Nov 3 18:48:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.790263ms Nov 3 18:48:37 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:48:37 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:48:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:48:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730681316}"] Nov 3 18:48:37 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730681316, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 3 18:48:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:37-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 3 18:48:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:37 kjcf05n00 RFSF-API[9864]: INFO[2024-11-03T18:48:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:37-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 3 18:48:37 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-03T18:48:37-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 3 18:48:37 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T18:48:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.839595ms Nov 3 18:48:37 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T18:48:37-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.839595ms Nov 3 18:48:37 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [03/Nov/2024:18:48:37 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 3 18:48:37 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:48:40 kjcf05n03 systemd[1]: Unmounting /mnt/llog... Nov 3 18:48:40 kjcf05n03 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 18:48:40 kjcf05n03 systemd[1]: Unmounted /mnt/llog. Nov 3 18:48:40 kjcf05n06 systemd[1]: Unmounting /mnt/llog... Nov 3 18:48:40 kjcf05n06 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 18:48:40 kjcf05n06 systemd[1]: Unmounted /mnt/llog. Nov 3 18:48:43 kjcf05n07 systemd[1]: Unmounting /mnt/llog... Nov 3 18:48:43 kjcf05n07 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 18:48:43 kjcf05n07 systemd[1]: Unmounted /mnt/llog. Nov 3 18:48:49 kjcf05n05 systemd[1]: Unmounting /mnt/llog... Nov 3 18:48:49 kjcf05n05 systemd[1]: mnt-llog.mount: Succeeded. Nov 3 18:48:49 kjcf05n05 systemd[1]: Unmounted /mnt/llog. Nov 3 18:48:55 kjcf05n00 mcfcli[3673891]: %3|1730681335.426|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:49:01 kjcf05n00 mcfcli[3673891]: %3|1730681341.984|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:49:13 kjcf05n00 zabbix-server[1491697]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:49:13 kjcf05n00 zabbix-server[1491697]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n03' from event '46545' Nov 3 18:49:13 kjcf05n00 zabbix-server[1491697]: Filesystem 'kjcf05' has been mounted Nov 3 18:49:14 kjcf05n00 zabbix-server[1491697]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 3 18:49:14 kjcf05n00 zabbix-server[1491697]: Running puppet on 'None' Nov 3 18:49:16 kjcf05n07 puppet-agent[3780955]: Using configured environment 'production' Nov 3 18:49:16 kjcf05n07 puppet-agent[3780955]: Retrieving pluginfacts Nov 3 18:49:16 kjcf05n07 puppet-agent[3780955]: Retrieving plugin Nov 3 18:49:16 kjcf05n04 puppet-agent[3779432]: Using configured environment 'production' Nov 3 18:49:16 kjcf05n04 puppet-agent[3779432]: Retrieving pluginfacts Nov 3 18:49:16 kjcf05n04 puppet-agent[3779432]: Retrieving plugin Nov 3 18:49:16 kjcf05n05 puppet-agent[3947068]: Using configured environment 'production' Nov 3 18:49:16 kjcf05n05 puppet-agent[3947068]: Retrieving pluginfacts Nov 3 18:49:16 kjcf05n05 puppet-agent[3947068]: Retrieving plugin Nov 3 18:49:16 kjcf05n05 puppet-agent[3947068]: Loading facts Nov 3 18:49:16 kjcf05n03 puppet-agent[51160]: Using configured environment 'production' Nov 3 18:49:16 kjcf05n03 puppet-agent[51160]: Retrieving pluginfacts Nov 3 18:49:16 kjcf05n03 puppet-agent[51160]: Retrieving plugin Nov 3 18:49:16 kjcf05n03 puppet-agent[51160]: Loading facts Nov 3 18:49:16 kjcf05n02 puppet-agent[169901]: Using configured environment 'production' Nov 3 18:49:16 kjcf05n02 puppet-agent[169901]: Retrieving pluginfacts Nov 3 18:49:16 kjcf05n02 puppet-agent[169901]: Retrieving plugin Nov 3 18:49:16 kjcf05n06 puppet-agent[3783203]: Using configured environment 'production' Nov 3 18:49:16 kjcf05n06 puppet-agent[3783203]: Retrieving pluginfacts Nov 3 18:49:16 kjcf05n06 puppet-agent[3783203]: Retrieving plugin Nov 3 18:49:16 kjcf05n06 puppet-agent[3783203]: Loading facts Nov 3 18:49:16 kjcf05n04 puppet-agent[3779432]: Loading facts Nov 3 18:49:16 kjcf05n07 puppet-agent[3780955]: Loading facts Nov 3 18:49:16 kjcf05n01 puppet-agent[3244954]: Using configured environment 'production' Nov 3 18:49:16 kjcf05n01 puppet-agent[3244954]: Retrieving pluginfacts Nov 3 18:49:16 kjcf05n01 puppet-agent[3244954]: Retrieving plugin Nov 3 18:49:16 kjcf05n01 puppet-agent[3244954]: Loading facts Nov 3 18:49:16 kjcf05n02 puppet-agent[169901]: Loading facts Nov 3 18:49:16 kjcf05n00 puppet-agent[1491760]: Using configured environment 'production' Nov 3 18:49:16 kjcf05n00 puppet-agent[1491760]: Retrieving pluginfacts Nov 3 18:49:16 kjcf05n00 puppet-agent[1491760]: Retrieving plugin Nov 3 18:49:17 kjcf05n00 puppet-agent[1491760]: Loading facts Nov 3 18:49:19 kjcf05n03 puppet-agent[51160]: Caching catalog for kjcf05n03 Nov 3 18:49:19 kjcf05n03 puppet-agent[51160]: Applying configuration version '1730681357' Nov 3 18:49:19 kjcf05n02 puppet-agent[169901]: Caching catalog for kjcf05n02 Nov 3 18:49:19 kjcf05n02 puppet-agent[169901]: Applying configuration version '1730681357' Nov 3 18:49:19 kjcf05n06 puppet-agent[3783203]: Caching catalog for kjcf05n06 Nov 3 18:49:19 kjcf05n06 puppet-agent[3783203]: Applying configuration version '1730681358' Nov 3 18:49:19 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 3 18:49:19 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 3 18:49:19 kjcf05n07 puppet-agent[3780955]: Caching catalog for kjcf05n07 Nov 3 18:49:19 kjcf05n07 puppet-agent[3780955]: Applying configuration version '1730681358' Nov 3 18:49:21 kjcf05n01 puppet-agent[3244954]: Caching catalog for kjcf05n01 Nov 3 18:49:20 kjcf05n00 puppet-agent[1491760]: Caching catalog for kjcf05n00 Nov 3 18:49:21 kjcf05n00 puppet-agent[1491760]: Applying configuration version '1730681358' Nov 3 18:49:21 kjcf05n01 puppet-agent[3244954]: Applying configuration version '1730681358' Nov 3 18:49:21 kjcf05n03 puppet-agent[51160]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 18:49:21 kjcf05n03 puppet-agent[51160]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 18:49:21 kjcf05n03 puppet-agent[51160]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 18:49:21 kjcf05n02 puppet-agent[169901]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 18:49:21 kjcf05n02 puppet-agent[169901]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 18:49:21 kjcf05n02 puppet-agent[169901]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 18:49:21 kjcf05n05 puppet-agent[3947068]: Caching catalog for kjcf05n05 Nov 3 18:49:21 kjcf05n05 puppet-agent[3947068]: Applying configuration version '1730681360' Nov 3 18:49:21 kjcf05n06 puppet-agent[3783203]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 18:49:21 kjcf05n06 puppet-agent[3783203]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 18:49:21 kjcf05n06 puppet-agent[3783203]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 18:49:21 kjcf05n07 puppet-agent[3780955]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 18:49:21 kjcf05n07 puppet-agent[3780955]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 18:49:21 kjcf05n07 puppet-agent[3780955]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 18:49:22 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 3 18:49:22 kjcf05n03 zabbix_agent2[34591]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 18:49:22 kjcf05n03 zabbix_agent2[3182]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 3 18:49:22 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 18:49:22 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 3 18:49:22 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 3 18:49:22 kjcf05n03 puppet-agent[51160]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: Press Ctrl+C to exit. Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: Plugin support version 1.0 Nov 3 18:49:22 kjcf05n03 zabbix_agent2[51516]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 18:49:22 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 3 18:49:22 kjcf05n02 zabbix_agent2[111756]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 18:49:22 kjcf05n02 zabbix_agent2[3127]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 3 18:49:22 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 18:49:22 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 3 18:49:22 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 3 18:49:22 kjcf05n02 puppet-agent[169901]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: Press Ctrl+C to exit. Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: Plugin support version 1.0 Nov 3 18:49:22 kjcf05n02 zabbix_agent2[170302]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 3 18:49:22 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3730733]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 3 18:49:22 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 18:49:22 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 3 18:49:22 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 3 18:49:22 kjcf05n06 puppet-agent[3783203]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: Press Ctrl+C to exit. Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: Plugin support version 1.0 Nov 3 18:49:22 kjcf05n06 zabbix_agent2[3783746]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 18:49:22 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3728467]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 3 18:49:22 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 18:49:22 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 3 18:49:22 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 3 18:49:22 kjcf05n07 puppet-agent[3780955]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: Press Ctrl+C to exit. Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: Plugin support version 1.0 Nov 3 18:49:22 kjcf05n07 zabbix_agent2[3781454]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 3 18:49:23 kjcf05n05 puppet-agent[3947068]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 18:49:23 kjcf05n05 puppet-agent[3947068]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 18:49:23 kjcf05n05 puppet-agent[3947068]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 18:49:23 kjcf05n00 puppet-agent[1491760]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 18:49:24 kjcf05n01 puppet-agent[3244954]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 3 18:49:24 kjcf05n01 puppet-agent[3244954]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-18:28:16]/mode) mode changed '0755' to '0750' Nov 3 18:49:24 kjcf05n06 puppet-agent[3783203]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 18:49:24 kjcf05n06 puppet-agent[3783203]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 18:49:24 kjcf05n06 puppet-agent[3783203]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 18:49:24 kjcf05n06 puppet-agent[3783203]: Applied catalog in 4.81 seconds Nov 3 18:49:24 kjcf05n03 puppet-agent[51160]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 18:49:24 kjcf05n03 puppet-agent[51160]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 18:49:24 kjcf05n03 puppet-agent[51160]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 18:49:24 kjcf05n03 puppet-agent[51160]: Applied catalog in 5.11 seconds Nov 3 18:49:24 kjcf05n07 puppet-agent[3780955]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 18:49:24 kjcf05n07 puppet-agent[3780955]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 18:49:24 kjcf05n07 puppet-agent[3780955]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 18:49:24 kjcf05n07 puppet-agent[3780955]: Applied catalog in 4.91 seconds Nov 3 18:49:24 kjcf05n02 puppet-agent[169901]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 18:49:24 kjcf05n02 puppet-agent[169901]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 18:49:24 kjcf05n02 puppet-agent[169901]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 18:49:24 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3900472]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 18:49:24 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 3 18:49:24 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 18:49:24 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 3 18:49:24 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 3 18:49:24 kjcf05n05 puppet-agent[3947068]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: Press Ctrl+C to exit. Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: Plugin support version 1.0 Nov 3 18:49:24 kjcf05n05 zabbix_agent2[3947670]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 18:49:24 kjcf05n01 puppet-agent[3244954]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-18:28:16/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 3 18:49:24 kjcf05n01 puppet-agent[3244954]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-18:28:16/vmcore]/mode) mode changed '0600' to '0640' Nov 3 18:49:24 kjcf05n01 puppet-agent[3244954]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-03-18:28:16/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 3 18:49:24 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 3 18:49:24 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 3 18:49:24 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 3 18:49:24 kjcf05n02 puppet-agent[169901]: Applied catalog in 5.25 seconds Nov 3 18:49:25 kjcf05n01 puppet-agent[3244954]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 18:49:25 kjcf05n01 puppet-agent[3244954]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 18:49:25 kjcf05n01 puppet-agent[3244954]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 18:49:24 kjcf05n00 puppet-agent[1491760]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 18:49:24 kjcf05n00 puppet-agent[1491760]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 18:49:24 kjcf05n00 puppet-agent[1491760]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 18:49:25 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3233042]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 18:49:25 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 3 18:49:25 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 18:49:25 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 3 18:49:25 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 3 18:49:25 kjcf05n01 puppet-agent[3244954]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: Press Ctrl+C to exit. Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: Plugin support version 1.0 Nov 3 18:49:25 kjcf05n01 zabbix_agent2[3245304]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 3 18:49:25 kjcf05n00 mcfcli[3673891]: %3|1730681365.426|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:49:25 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1473305]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 18:49:25 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 3 18:49:25 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 18:49:25 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 3 18:49:25 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 3 18:49:25 kjcf05n00 puppet-agent[1491760]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: Press Ctrl+C to exit. Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: Plugin support version 1.0 Nov 3 18:49:25 kjcf05n00 zabbix_agent2[1492295]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 3 18:49:25 kjcf05n00 zabbix-server[1492347]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:49:26 kjcf05n05 puppet-agent[3947068]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 18:49:26 kjcf05n05 puppet-agent[3947068]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 18:49:26 kjcf05n05 puppet-agent[3947068]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 18:49:26 kjcf05n05 puppet-agent[3947068]: Applied catalog in 4.83 seconds Nov 3 18:49:26 kjcf05n00 zabbix-server[1492383]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:49:26 kjcf05n00 zabbix-server[1492392]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:49:27 kjcf05n00 zabbix-server[1492417]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 18:49:27 kjcf05n01 puppet-agent[3244954]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_183535.log]/mode) mode changed '0644' to '0640' Nov 3 18:49:27 kjcf05n01 puppet-agent[3244954]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241103_184718.log]/mode) mode changed '0644' to '0640' Nov 3 18:49:27 kjcf05n00 puppet-agent[1491760]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 3 18:49:28 kjcf05n01 puppet-agent[3244954]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_183535.log]/mode) mode changed '0644' to '0640' Nov 3 18:49:28 kjcf05n01 puppet-agent[3244954]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241103_184718.log]/mode) mode changed '0644' to '0640' Nov 3 18:49:28 kjcf05n01 puppet-agent[3244954]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_184719]/mode) mode changed '0755' to '0750' Nov 3 18:49:28 kjcf05n01 puppet-agent[3244954]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241103_184719/screenlog.0]/mode) mode changed '0644' to '0640' Nov 3 18:49:28 kjcf05n01 puppet-agent[3244954]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 18:49:28 kjcf05n01 puppet-agent[3244954]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 18:49:28 kjcf05n01 puppet-agent[3244954]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 18:49:28 kjcf05n00 puppet-agent[1491760]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 18:49:28 kjcf05n00 puppet-agent[1491760]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 18:49:28 kjcf05n00 puppet-agent[1491760]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 18:49:29 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 3 18:49:29 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 3 18:49:29 kjcf05n00 puppet-agent[1491760]: Applied catalog in 8.29 seconds Nov 3 18:49:30 kjcf05n01 puppet-agent[3244954]: Applied catalog in 8.95 seconds Nov 3 18:49:32 kjcf05n04 puppet-agent[3779432]: Caching catalog for kjcf05n04 Nov 3 18:49:32 kjcf05n04 puppet-agent[3779432]: Applying configuration version '1730681370' Nov 3 18:49:34 kjcf05n04 puppet-agent[3779432]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 3 18:49:34 kjcf05n04 puppet-agent[3779432]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 3 18:49:34 kjcf05n04 puppet-agent[3779432]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 3 18:49:35 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3732993]: Zabbix Agent 2 stopped. (6.2.1) Nov 3 18:49:35 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 3 18:49:35 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 3 18:49:35 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 3 18:49:35 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 3 18:49:35 kjcf05n04 puppet-agent[3779432]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: Starting Zabbix Agent 2 (6.2.1) Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: Press Ctrl+C to exit. Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: Plugin support version 1.0 Nov 3 18:49:35 kjcf05n04 zabbix_agent2[3780290]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 3 18:49:36 kjcf05n04 puppet-agent[3779432]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 3 18:49:36 kjcf05n04 puppet-agent[3779432]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 3 18:49:36 kjcf05n04 puppet-agent[3779432]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 3 18:49:36 kjcf05n00 mcfcli[3673891]: %3|1730681376.465|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:49:37 kjcf05n04 puppet-agent[3779432]: Applied catalog in 4.77 seconds Nov 3 18:49:36 kjcf05n00 zabbix-server[1491697]: puppet completed status:(0): '' Nov 3 18:49:36 kjcf05n00 zabbix-server[1491697]: Event '46545' acknowledged Nov 3 18:49:36 kjcf05n00 zabbix-server[1491697]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n03"}' Nov 3 18:49:55 kjcf05n00 mcfcli[3673891]: %3|1730681395.821|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 18:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 18:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 18:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 18:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 18:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 18:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 18:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 18:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 18:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 18:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 18:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 18:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 18:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 18:50:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 18:50:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 18:50:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 18:50:15 kjcf05n00 mcfcli[3673891]: %3|1730681415.372|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:50:15 kjcf05n00 python3.9[1492805]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 18:50:25 kjcf05n00 mcfcli[3673891]: %3|1730681425.821|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 18:50:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730681428', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 3 18:50:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730681428'} Nov 3 18:50:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:50:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730681428', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 3 18:50:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730681428'} Nov 3 18:50:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 3 18:50:50 kjcf05n00 mcfcli[3673891]: %3|1730681450.951|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:50:56 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 18:50:55 kjcf05n00 mcfcli[3673891]: %3|1730681455.821|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 18:51:25 kjcf05n00 mcfcli[3673891]: %3|1730681485.822|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:51:27 kjcf05n00 mcfcli[3673891]: %3|1730681487.817|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:51:30 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 18:51:43 kjcf05n03 dwd[5203]: nvme10n1 passed periodic SMART status check Nov 3 18:51:43 kjcf05n03 dwd[5203]: nvme21n1 passed periodic SMART status check Nov 3 18:51:43 kjcf05n03 dwd[5203]: nvme11n1 passed periodic SMART status check Nov 3 18:51:43 kjcf05n03 dwd[5203]: nvme20n1 passed periodic SMART status check Nov 3 18:51:43 kjcf05n03 dwd[5203]: nvme15n1 passed periodic SMART status check Nov 3 18:51:44 kjcf05n03 dwd[5203]: nvme6n1 passed periodic SMART status check Nov 3 18:51:44 kjcf05n03 dwd[5203]: nvme5n1 passed periodic SMART status check Nov 3 18:51:44 kjcf05n03 dwd[5203]: nvme12n1 passed periodic SMART status check Nov 3 18:51:44 kjcf05n03 dwd[5203]: nvme22n1 passed periodic SMART status check Nov 3 18:51:44 kjcf05n03 dwd[5203]: nvme16n1 passed periodic SMART status check Nov 3 18:51:44 kjcf05n03 dwd[5203]: nvme7n1 passed periodic SMART status check Nov 3 18:51:55 kjcf05n00 mcfcli[3673891]: %3|1730681515.822|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:52:07 kjcf05n00 mcfcli[3673891]: %3|1730681527.814|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:52:25 kjcf05n00 mcfcli[3673891]: %3|1730681545.822|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:52:47 kjcf05n00 mcfcli[3673891]: %3|1730681567.811|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:52:55 kjcf05n00 mcfcli[3673891]: %3|1730681575.824|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:53:15.867812Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 18:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T00:53:15.867884Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.092ms Nov 3 18:53:25 kjcf05n00 mcfcli[3673891]: %3|1730681605.824|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T18:53:27.254010124-06:00 level=info msg="Completed cleanup jobs" duration=27.402037ms Nov 3 18:53:27 kjcf05n00 mcfcli[3673891]: %3|1730681607.808|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:53:55 kjcf05n00 mcfcli[3673891]: %3|1730681635.824|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:54:07 kjcf05n00 mcfcli[3673891]: %3|1730681647.805|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:54:25 kjcf05n00 mcfcli[3673891]: %3|1730681665.825|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:54:46 kjcf05n00 mcfcli[3673891]: %3|1730681686.440|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:54:55 kjcf05n00 mcfcli[3673891]: %3|1730681695.826|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 18:55:17 kjcf05n00 python3.9[1495656]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 18:55:25 kjcf05n00 mcfcli[3673891]: %3|1730681725.826|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 18:55:25 kjcf05n00 mcfcli[3673891]: %3|1730681725.947|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:55:55 kjcf05n00 mcfcli[3673891]: %3|1730681755.827|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 18:56:05 kjcf05n00 mcfcli[3673891]: %3|1730681765.346|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:56:25 kjcf05n00 mcfcli[3673891]: %3|1730681785.827|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 18:56:31 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 18:56:41 kjcf05n00 mcfcli[3673891]: %3|1730681801.579|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:56:56 kjcf05n00 mcfcli[3673891]: %3|1730681816.328|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:57:21 kjcf05n00 mcfcli[3673891]: %3|1730681841.576|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:57:26 kjcf05n00 mcfcli[3673891]: %3|1730681846.430|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 18:57:56 kjcf05n00 mcfcli[3673891]: %3|1730681876.829|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:58:00 kjcf05n00 mcfcli[3673891]: %3|1730681880.304|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:58:26 kjcf05n00 mcfcli[3673891]: %3|1730681906.829|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 18:58:39 kjcf05n00 mcfcli[3673891]: %3|1730681919.741|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:58:56 kjcf05n00 mcfcli[3673891]: %3|1730681936.829|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:59:17 kjcf05n00 mcfcli[3673891]: %3|1730681957.991|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:59:26 kjcf05n00 mcfcli[3673891]: %3|1730681966.830|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 18:59:56 kjcf05n00 mcfcli[3673891]: %3|1730681996.049|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 18:59:56 kjcf05n00 mcfcli[3673891]: %3|1730681996.830|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 19:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 19:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 19:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 19:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 19:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 19:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 19:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 19:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 19:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 19:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 19:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 19:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 19:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 19:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 19:00:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 19:00:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:00:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 19:00:15 kjcf05n00 python3.9[1498620]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 19:00:26 kjcf05n00 mcfcli[3673891]: %3|1730682026.830|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 19:00:36 kjcf05n00 mcfcli[3673891]: %3|1730682036.046|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:00:56 kjcf05n00 mcfcli[3673891]: %3|1730682056.831|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:01:10 kjcf05n00 mcfcli[3673891]: %3|1730682070.906|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:01:26 kjcf05n00 mcfcli[3673891]: %3|1730682086.831|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:01:48 kjcf05n00 mcfcli[3673891]: %3|1730682108.680|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:01:51 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 19:01:56 kjcf05n00 mcfcli[3673891]: %3|1730682116.831|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:02:26 kjcf05n00 mcfcli[3673891]: %3|1730682146.831|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:02:27 kjcf05n00 mcfcli[3673891]: %3|1730682147.358|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:02:56 kjcf05n00 mcfcli[3673891]: %3|1730682176.832|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 19:03:05 kjcf05n00 mcfcli[3673891]: %3|1730682185.496|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:03:22 kjcf05n00 zabbix-server[1500425]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 19:03:22 kjcf05n00 zabbix-server[1500425]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 74.77\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 61.7\\"}}"' Nov 3 19:03:22 kjcf05n00 log_interesting_event.py[1500425]: Event '46546' acknowledged Nov 3 19:03:26 kjcf05n00 mcfcli[3673891]: %3|1730682206.832|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T19:03:27.267638307-06:00 level=info msg="Completed cleanup jobs" duration=41.173756ms Nov 3 19:03:42 kjcf05n00 mcfcli[3673891]: %3|1730682222.866|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:03:56 kjcf05n00 mcfcli[3673891]: %3|1730682236.833|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:04:21 kjcf05n00 mcfcli[3673891]: %3|1730682261.849|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:04:26 kjcf05n00 mcfcli[3673891]: %3|1730682266.833|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:04:56 kjcf05n00 mcfcli[3673891]: %3|1730682296.834|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 19:04:59 kjcf05n00 mcfcli[3673891]: %3|1730682299.666|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:05:18 kjcf05n00 python3.9[1501402]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 19:05:26 kjcf05n01 ansible-ansible.builtin.authorized_key[3251534]: Invoked with state=present user=admin key=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC/oUUDoJsLDVMDUIjFUH/12VqXJ7ZBG0KaKSrZ4SWrtdchcqFr8O34hWmwZXkGT17l/CzoQUsUcVx80LY6C2RJvHL1mS8+WP87RXmMxboYwG4ZYcL5N4wTmoIkEkdGpwPOMjp5pkOKJ86q45FuJwk3cTx57ryy+Gh2JhU2bT26HmuaK1Jq23N7/BpH7kWjlZX9P67mdaB8Gx5HFX486b1zmKALAg2SXvSHEhCGUgmuza7EwAWz717PQLrZ6z9ghg7aqqjT0R6ghXXJHEuIRkw5ON/oD5emg72bzZT49o6oDAd6VxTHIvfqgvQTpKshetLfIH/0xCiyyJR6mw12uAi0ZrthygOG1AB4VYhmLoXuN5tqIieYf2tymZFSXcTfxDjWPZt4PrY6fvgTDmkOuRD2VcbDb/bCI6c/qmexds2/AcT72IdBCzVlG+KyG1uuo0oQT1YW9wrL7XDx+/SPN4QIGEL0DVue+L1horC6ax33IlBmTLoijqK3Krsco36zIZNGcjGm4X+DSdUMnq8DE/IIw1sdBD3p1DxT8VWrvQ+QF/wwQodW0qeKCE9+KXbc2f1wxBtCIHFNSvxeGASBgwZvoHayEm7Qz3gHKuRn71JzFmmoOm6EQ08XsiMZa30yz9NaSawsjaaXgO6UzoBxzE8r0x+pLnhCAprc7vGaFU6ckw== filesystem-test manage_dir=True exclusive=False validate_certs=True follow=False path=None key_options=None comment=None Nov 3 19:05:26 kjcf05n00 ansible-ansible.builtin.authorized_key[1501921]: Invoked with state=present user=admin key=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC/oUUDoJsLDVMDUIjFUH/12VqXJ7ZBG0KaKSrZ4SWrtdchcqFr8O34hWmwZXkGT17l/CzoQUsUcVx80LY6C2RJvHL1mS8+WP87RXmMxboYwG4ZYcL5N4wTmoIkEkdGpwPOMjp5pkOKJ86q45FuJwk3cTx57ryy+Gh2JhU2bT26HmuaK1Jq23N7/BpH7kWjlZX9P67mdaB8Gx5HFX486b1zmKALAg2SXvSHEhCGUgmuza7EwAWz717PQLrZ6z9ghg7aqqjT0R6ghXXJHEuIRkw5ON/oD5emg72bzZT49o6oDAd6VxTHIvfqgvQTpKshetLfIH/0xCiyyJR6mw12uAi0ZrthygOG1AB4VYhmLoXuN5tqIieYf2tymZFSXcTfxDjWPZt4PrY6fvgTDmkOuRD2VcbDb/bCI6c/qmexds2/AcT72IdBCzVlG+KyG1uuo0oQT1YW9wrL7XDx+/SPN4QIGEL0DVue+L1horC6ax33IlBmTLoijqK3Krsco36zIZNGcjGm4X+DSdUMnq8DE/IIw1sdBD3p1DxT8VWrvQ+QF/wwQodW0qeKCE9+KXbc2f1wxBtCIHFNSvxeGASBgwZvoHayEm7Qz3gHKuRn71JzFmmoOm6EQ08XsiMZa30yz9NaSawsjaaXgO6UzoBxzE8r0x+pLnhCAprc7vGaFU6ckw== filesystem-test manage_dir=True exclusive=False validate_certs=True follow=False path=None key_options=None comment=None Nov 3 19:05:26 kjcf05n00 mcfcli[3673891]: %3|1730682326.834|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:05:28 kjcf05n01 ansible-ansible.builtin.command[3251577]: Invoked with _raw_params=chmod 600 ~/.ssh/authorized_keys warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:05:28 kjcf05n01 ansible-ansible.builtin.command[3251577]: [WARNING] Consider using the file module with mode rather than running 'chmod'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. Nov 3 19:05:28 kjcf05n00 ansible-ansible.builtin.command[1501963]: Invoked with _raw_params=chmod 600 ~/.ssh/authorized_keys warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:05:28 kjcf05n00 ansible-ansible.builtin.command[1501963]: [WARNING] Consider using the file module with mode rather than running 'chmod'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. Nov 3 19:05:33 kjcf05n01 ansible-ansible.builtin.file[3251620]: Invoked with access_time=preserve modification_time=preserve state=touch mode=0600 path=/etc/sudoers.d/admin recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:05:33 kjcf05n00 ansible-ansible.builtin.file[1502013]: Invoked with access_time=preserve modification_time=preserve state=touch mode=0600 path=/etc/sudoers.d/admin recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:05:36 kjcf05n00 mcfcli[3673891]: %3|1730682336.677|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:05:36 kjcf05n01 ansible-ansible.builtin.lineinfile[3251661]: Invoked with regexp=admin ALL=(ALL) NOPASSWD:ALL path=/etc/sudoers.d/admin line=admin ALL=(ALL) NOPASSWD:ALL state=present backrefs=False create=False backup=False firstmatch=False follow=False unsafe_writes=False insertafter=None insertbefore=None validate=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None src=None force=None content=NOT_LOGGING_PARAMETER remote_src=None delimiter=None directory_mode=None Nov 3 19:05:36 kjcf05n00 ansible-ansible.builtin.lineinfile[1502065]: Invoked with regexp=admin ALL=(ALL) NOPASSWD:ALL path=/etc/sudoers.d/admin line=admin ALL=(ALL) NOPASSWD:ALL state=present backrefs=False create=False backup=False firstmatch=False follow=False unsafe_writes=False insertafter=None insertbefore=None validate=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None src=None force=None content=NOT_LOGGING_PARAMETER remote_src=None delimiter=None directory_mode=None Nov 3 19:05:41 kjcf05n01 ansible-ansible.builtin.authorized_key[3251709]: Invoked with state=present user=root key=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC/oUUDoJsLDVMDUIjFUH/12VqXJ7ZBG0KaKSrZ4SWrtdchcqFr8O34hWmwZXkGT17l/CzoQUsUcVx80LY6C2RJvHL1mS8+WP87RXmMxboYwG4ZYcL5N4wTmoIkEkdGpwPOMjp5pkOKJ86q45FuJwk3cTx57ryy+Gh2JhU2bT26HmuaK1Jq23N7/BpH7kWjlZX9P67mdaB8Gx5HFX486b1zmKALAg2SXvSHEhCGUgmuza7EwAWz717PQLrZ6z9ghg7aqqjT0R6ghXXJHEuIRkw5ON/oD5emg72bzZT49o6oDAd6VxTHIvfqgvQTpKshetLfIH/0xCiyyJR6mw12uAi0ZrthygOG1AB4VYhmLoXuN5tqIieYf2tymZFSXcTfxDjWPZt4PrY6fvgTDmkOuRD2VcbDb/bCI6c/qmexds2/AcT72IdBCzVlG+KyG1uuo0oQT1YW9wrL7XDx+/SPN4QIGEL0DVue+L1horC6ax33IlBmTLoijqK3Krsco36zIZNGcjGm4X+DSdUMnq8DE/IIw1sdBD3p1DxT8VWrvQ+QF/wwQodW0qeKCE9+KXbc2f1wxBtCIHFNSvxeGASBgwZvoHayEm7Qz3gHKuRn71JzFmmoOm6EQ08XsiMZa30yz9NaSawsjaaXgO6UzoBxzE8r0x+pLnhCAprc7vGaFU6ckw== filesystem-test manage_dir=True exclusive=False validate_certs=True follow=False path=None key_options=None comment=None Nov 3 19:05:41 kjcf05n00 ansible-ansible.builtin.authorized_key[1502119]: Invoked with state=present user=root key=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC/oUUDoJsLDVMDUIjFUH/12VqXJ7ZBG0KaKSrZ4SWrtdchcqFr8O34hWmwZXkGT17l/CzoQUsUcVx80LY6C2RJvHL1mS8+WP87RXmMxboYwG4ZYcL5N4wTmoIkEkdGpwPOMjp5pkOKJ86q45FuJwk3cTx57ryy+Gh2JhU2bT26HmuaK1Jq23N7/BpH7kWjlZX9P67mdaB8Gx5HFX486b1zmKALAg2SXvSHEhCGUgmuza7EwAWz717PQLrZ6z9ghg7aqqjT0R6ghXXJHEuIRkw5ON/oD5emg72bzZT49o6oDAd6VxTHIvfqgvQTpKshetLfIH/0xCiyyJR6mw12uAi0ZrthygOG1AB4VYhmLoXuN5tqIieYf2tymZFSXcTfxDjWPZt4PrY6fvgTDmkOuRD2VcbDb/bCI6c/qmexds2/AcT72IdBCzVlG+KyG1uuo0oQT1YW9wrL7XDx+/SPN4QIGEL0DVue+L1horC6ax33IlBmTLoijqK3Krsco36zIZNGcjGm4X+DSdUMnq8DE/IIw1sdBD3p1DxT8VWrvQ+QF/wwQodW0qeKCE9+KXbc2f1wxBtCIHFNSvxeGASBgwZvoHayEm7Qz3gHKuRn71JzFmmoOm6EQ08XsiMZa30yz9NaSawsjaaXgO6UzoBxzE8r0x+pLnhCAprc7vGaFU6ckw== filesystem-test manage_dir=True exclusive=False validate_certs=True follow=False path=None key_options=None comment=None Nov 3 19:05:42 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 19:05:43 kjcf05n01 ansible-ansible.builtin.file[3251750]: Invoked with state=file mode=0600 path=/root/.ssh/authorized_keys recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:05:43 kjcf05n00 ansible-ansible.builtin.file[1502161]: Invoked with state=file mode=0600 path=/root/.ssh/authorized_keys recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:05:54 kjcf05n01 ansible-setup[3252010]: Invoked with gather_subset=['!all', '!min', 'date_time', 'default_ipv4', 'all_ipv4_addresses', 'distribution', 'pkg_mgr', 'hardware'] gather_timeout=10 filter=* fact_path=/etc/ansible/facts.d Nov 3 19:05:54 kjcf05n00 ansible-setup[1502365]: Invoked with gather_subset=['!all', '!min', 'date_time', 'default_ipv4', 'all_ipv4_addresses', 'distribution', 'pkg_mgr', 'hardware'] gather_timeout=10 filter=* fact_path=/etc/ansible/facts.d Nov 3 19:05:57 kjcf05n00 mcfcli[3673891]: %3|1730682357.333|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 19:05:58 kjcf05n02 nslcd[6896]: ldap_result() failed: Can't contact LDAP server Nov 3 19:06:01 kjcf05n01 ansible-ansible.builtin.tempfile[3252179]: Invoked with suffix=.library_script_cache state=directory prefix=ansible. path=None Nov 3 19:06:01 kjcf05n00 ansible-ansible.builtin.tempfile[1502539]: Invoked with suffix=.library_script_cache state=directory prefix=ansible. path=None Nov 3 19:06:05 kjcf05n01 ansible-stat[3252268]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh get_md5=False get_mime=True get_attributes=True Nov 3 19:06:05 kjcf05n00 ansible-stat[1502725]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh get_md5=False get_mime=True get_attributes=True Nov 3 19:06:07 kjcf05n01 ansible-copy[3252442]: Invoked with dest=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh _original_basename=link-if-identical.sh follow=False src=/tmp/ansible-admin/ansible-tmp-1730682363.51-17226-41855534791935/source checksum=7d4e3ae1ba7f279e4db8384a9daa8b0da64a674a backup=False force=True unsafe_writes=False content=NOT_LOGGING_PARAMETER validate=None directory_mode=None remote_src=None local_follow=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None regexp=None delimiter=None Nov 3 19:06:09 kjcf05n00 ansible-copy[1502859]: Invoked with dest=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh _original_basename=link-if-identical.sh follow=False src=/tmp/ansible-admin/ansible-tmp-1730682363.41-17202-19840083290106/source checksum=7d4e3ae1ba7f279e4db8384a9daa8b0da64a674a backup=False force=True unsafe_writes=False content=NOT_LOGGING_PARAMETER validate=None directory_mode=None remote_src=None local_follow=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None regexp=None delimiter=None Nov 3 19:06:09 kjcf05n01 ansible-stat[3252571]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh get_md5=False get_mime=True get_attributes=True Nov 3 19:06:11 kjcf05n01 ansible-copy[3252689]: Invoked with dest=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh _original_basename=set-execute.sh follow=False src=/tmp/ansible-admin/ansible-tmp-1730682367.89-17226-223576648181848/source checksum=12ad96fee0decaa0abd38199a687126eecc20c04 backup=False force=True unsafe_writes=False content=NOT_LOGGING_PARAMETER validate=None directory_mode=None remote_src=None local_follow=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None regexp=None delimiter=None Nov 3 19:06:12 kjcf05n00 ansible-stat[1502988]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh get_md5=False get_mime=True get_attributes=True Nov 3 19:06:13 kjcf05n00 mcfcli[3673891]: %3|1730682373.769|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:06:15 kjcf05n00 ansible-copy[1503182]: Invoked with dest=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh _original_basename=set-execute.sh follow=False src=/tmp/ansible-admin/ansible-tmp-1730682370.16-17202-143409319953813/source checksum=12ad96fee0decaa0abd38199a687126eecc20c04 backup=False force=True unsafe_writes=False content=NOT_LOGGING_PARAMETER validate=None directory_mode=None remote_src=None local_follow=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None regexp=None delimiter=None Nov 3 19:06:18 kjcf05n01 ansible-ansible.builtin.command[3252777]: Invoked with _raw_params=chmod 755 "/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:06:18 kjcf05n01 ansible-ansible.builtin.command[3252777]: [WARNING] Consider using the file module with mode rather than running 'chmod'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. Nov 3 19:06:18 kjcf05n00 ansible-ansible.builtin.command[1503273]: Invoked with _raw_params=chmod 755 "/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:06:18 kjcf05n00 ansible-ansible.builtin.command[1503273]: [WARNING] Consider using the file module with mode rather than running 'chmod'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. Nov 3 19:06:19 kjcf05n01 ansible-ansible.builtin.command[3252819]: Invoked with _raw_params=chmod 755 "/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:06:19 kjcf05n01 ansible-ansible.builtin.command[3252819]: [WARNING] Consider using the file module with mode rather than running 'chmod'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. Nov 3 19:06:20 kjcf05n00 ansible-ansible.builtin.command[1503326]: Invoked with _raw_params=chmod 755 "/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:06:20 kjcf05n00 ansible-ansible.builtin.command[1503326]: [WARNING] Consider using the file module with mode rather than running 'chmod'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. Nov 3 19:06:27 kjcf05n00 mcfcli[3673891]: %3|1730682387.334|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:06:31 kjcf05n03 nslcd[6958]: (re)loading /etc/nsswitch.conf Nov 3 19:06:31 kjcf05n03 nslcd[6958]: [b0dc51] ldap_result() failed: Can't contact LDAP server Nov 3 19:06:46 kjcf05n02 nslcd[6896]: [16231b] ldap_result() failed: Can't contact LDAP server Nov 3 19:06:50 kjcf05n00 mcfcli[3673891]: %3|1730682410.354|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:06:57 kjcf05n00 mcfcli[3673891]: %3|1730682417.334|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:07:27 kjcf05n00 mcfcli[3673891]: %3|1730682447.265|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:07:27 kjcf05n00 mcfcli[3673891]: %3|1730682447.335|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:07:32 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 3 19:07:32 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 3 19:07:32 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 3 19:07:46 kjcf05n00 ansible-command[1504092]: Invoked with _uses_shell=True _raw_params=set -o pipefail && ssh -o IdentityFile=~/.ssh/cs_id_ecdsa -o IdentitiesOnly=yes puppet hostname warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:07:49 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 19:07:49 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 19:07:49 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 19:07:55 kjcf05n00 ansible-command[1504182]: Invoked with _uses_shell=True _raw_params=set -o pipefail && ssh -o IdentityFile=~/.ssh/cs_id_ecdsa -o IdentitiesOnly=yes nfsserv hostname warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:07:57 kjcf05n00 mcfcli[3673891]: %3|1730682477.335|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:08:04 kjcf05n00 mcfcli[3673891]: %3|1730682484.960|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:08:05 kjcf05n00 ansible-command[1504417]: Invoked with _uses_shell=True _raw_params=cscli show_node_versions -g mgmt=primary | awk '{print $2}' | sed 's#/#_#g' warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:08:14 kjcf05n00 ansible-command[1504624]: Invoked with _raw_params=cscli t0 property get --name mgsNID warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:08:23 kjcf05n00 ansible-command[1504691]: Invoked with _uses_shell=True _raw_params=set -o pipefail && PDSH_SSH_ARGS_APPEND="-o IdentityFile=~/.ssh/cs_id_ecdsa -o IdentitiesOnly=yes" pdsh -SNg mds=primary 'lctl get_param -n mdt.*.recovery_time_hard' | sort -u warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:08:27 kjcf05n00 mcfcli[3673891]: %3|1730682507.434|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 19:08:38 kjcf05n00 ansible-command[1504850]: Invoked with _uses_shell=True _raw_params=set -o pipefail && ssh -o IdentityFile=~/.ssh/cs_id_ecdsa -o IdentitiesOnly=yes puppet cscli list | grep ean warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:08:42 kjcf05n00 mcfcli[3673891]: %3|1730682522.153|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:08:48 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 3 19:08:51 kjcf05n00 ansible-command[1504945]: Invoked with _uses_shell=True _raw_params=ip route list | grep 10.101.48.0/22 | awk '{print $9}' warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:08:51 kjcf05n01 ansible-command[3253966]: Invoked with _uses_shell=True _raw_params=ip route list | grep 10.101.48.0/22 | awk '{print $9}' warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:08:56 kjcf05n01 ansible-ansible.builtin.stat[3254084]: Invoked with path=/etc/sysconfig/network-scripts/ifcfg-pub0 follow=False get_md5=False get_checksum=True get_mime=True get_attributes=True checksum_algorithm=sha1 Nov 3 19:08:56 kjcf05n00 ansible-ansible.builtin.stat[1505066]: Invoked with path=/etc/sysconfig/network-scripts/ifcfg-pub0 follow=False get_md5=False get_checksum=True get_mime=True get_attributes=True checksum_algorithm=sha1 Nov 3 19:08:57 kjcf05n00 mcfcli[3673891]: %3|1730682537.836|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 19:09:16 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 3 19:09:16 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 3 19:09:17 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 3 19:09:17 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 3 19:09:17 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 3 19:09:20 kjcf05n00 mcfcli[3673891]: %3|1730682560.193|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:09:27 kjcf05n00 mcfcli[3673891]: %3|1730682567.836|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:09:32 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 19:09:42 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 19:09:42 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 19:09:42 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 19:09:57 kjcf05n00 mcfcli[3673891]: %3|1730682597.836|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:09:57 kjcf05n00 mcfcli[3673891]: %3|1730682597.960|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 19:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 19:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 19:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 19:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 19:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 19:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 19:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 19:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 19:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 19:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 19:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 19:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 19:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 19:10:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 19:10:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:10:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 19:10:18 kjcf05n01 ansible-ansible.builtin.stat[3254547]: Invoked with path=/home/admin/talbers follow=False get_md5=False get_checksum=True get_mime=True get_attributes=True checksum_algorithm=sha1 Nov 3 19:10:18 kjcf05n00 ansible-ansible.builtin.stat[1505765]: Invoked with path=/home/admin/talbers follow=False get_md5=False get_checksum=True get_mime=True get_attributes=True checksum_algorithm=sha1 Nov 3 19:10:19 kjcf05n00 python3.9[1505710]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 19:10:24 kjcf05n01 ansible-ansible.builtin.file[3254596]: Invoked with state=directory path=/home/users/filesystem-test/bin recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:10:24 kjcf05n00 ansible-ansible.builtin.file[1506107]: Invoked with state=directory path=/home/users/filesystem-test/bin recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:10:25 kjcf05n01 ansible-ansible.builtin.file[3254637]: Invoked with state=directory path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:10:26 kjcf05n00 ansible-ansible.builtin.file[1506153]: Invoked with state=directory path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:10:26 kjcf05n01 ansible-ansible.builtin.file[3254678]: Invoked with state=directory path=/home/users/filesystem-test/performance recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:10:27 kjcf05n01 ansible-ansible.builtin.file[3254719]: Invoked with state=directory path=/home/users/filesystem-test/performance/testruns recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:10:27 kjcf05n00 ansible-ansible.builtin.file[1506194]: Invoked with state=directory path=/home/users/filesystem-test/performance recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:10:27 kjcf05n00 mcfcli[3673891]: %3|1730682627.838|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:10:28 kjcf05n01 ansible-ansible.builtin.file[3254778]: Invoked with state=directory path=/home/users/filesystem-test/performance/baselines/kjcf05 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:10:28 kjcf05n00 ansible-ansible.builtin.file[1506315]: Invoked with state=directory path=/home/users/filesystem-test/performance/testruns recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:10:29 kjcf05n00 ansible-ansible.builtin.file[1506431]: Invoked with state=directory path=/home/users/filesystem-test/performance/baselines/kjcf05 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:10:31 kjcf05n01 ansible-ansible.builtin.file[3254909]: Invoked with state=directory mode=511 path=/home/users/filesystem-test/log recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:10:31 kjcf05n00 ansible-ansible.builtin.file[1506521]: Invoked with state=directory mode=511 path=/home/users/filesystem-test/log recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:10:36 kjcf05n00 mcfcli[3673891]: %3|1730682636.359|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:10:52 kjcf05n01 ansible-stat[3255162]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/tuning_params_table.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:10:53 kjcf05n01 ansible-file[3255206]: Invoked with dest=/home/users/filesystem-test/bin/tuning_params_table.sh.latest recurse=False _original_basename=tuning_params_table.sh state=file path=/home/users/filesystem-test/bin/tuning_params_table.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:10:52 kjcf05n00 ansible-stat[1506727]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/tuning_params_table.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:10:54 kjcf05n00 ansible-file[1506773]: Invoked with dest=/home/users/filesystem-test/bin/tuning_params_table.sh.latest recurse=False _original_basename=tuning_params_table.sh state=file path=/home/users/filesystem-test/bin/tuning_params_table.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:10:57 kjcf05n00 ansible-ansible.builtin.command[1506892]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/tuning_params_table.sh.latest" "/home/users/filesystem-test/bin/tuning_params_table.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:10:57 kjcf05n01 ansible-ansible.builtin.command[3255293]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/tuning_params_table.sh.latest" "/home/users/filesystem-test/bin/tuning_params_table.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:10:57 kjcf05n00 mcfcli[3673891]: %3|1730682657.838|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 19:10:59 kjcf05n01 ansible-ansible.builtin.command[3255344]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/tuning_params_table.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:10:59 kjcf05n00 ansible-ansible.builtin.command[1506938]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/tuning_params_table.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:11:09 kjcf05n01 ansible-stat[3255494]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/filesystem-test-common.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:11:09 kjcf05n01 ansible-file[3255539]: Invoked with dest=/home/users/filesystem-test/bin/filesystem-test-common.sh.latest _original_basename=filesystem-test-common.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/filesystem-test-common.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:11:09 kjcf05n00 ansible-stat[1507150]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/filesystem-test-common.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:11:10 kjcf05n00 ansible-file[1507193]: Invoked with dest=/home/users/filesystem-test/bin/filesystem-test-common.sh.latest _original_basename=filesystem-test-common.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/filesystem-test-common.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:11:13 kjcf05n01 ansible-ansible.builtin.command[3255619]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/filesystem-test-common.sh.latest" "/home/users/filesystem-test/bin/filesystem-test-common.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:11:13 kjcf05n00 ansible-ansible.builtin.command[1507274]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/filesystem-test-common.sh.latest" "/home/users/filesystem-test/bin/filesystem-test-common.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:11:15 kjcf05n01 ansible-ansible.builtin.command[3255665]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/filesystem-test-common.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:11:15 kjcf05n00 ansible-ansible.builtin.command[1507318]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/filesystem-test-common.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:11:16 kjcf05n00 mcfcli[3673891]: %3|1730682676.356|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:11:27 kjcf05n00 mcfcli[3673891]: %3|1730682687.838|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 19:11:51 kjcf05n00 mcfcli[3673891]: %3|1730682711.873|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:11:52 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 3 19:11:57 kjcf05n00 mcfcli[3673891]: %3|1730682717.838|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 19:12:20 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 3 19:12:20 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 3 19:12:27 kjcf05n00 mcfcli[3673891]: %3|1730682747.838|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 19:12:29 kjcf05n00 mcfcli[3673891]: %3|1730682749.765|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:12:46 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 19:12:46 kjcf05n00 zabbix-server[1508062]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 3 19:12:46 kjcf05n00 zabbix-server[1508062]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 54.51\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 65.85\\"}}"' Nov 3 19:12:47 kjcf05n00 log_interesting_event.py[1508062]: Event '46547' acknowledged Nov 3 19:12:57 kjcf05n00 mcfcli[3673891]: %3|1730682777.839|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:13:09 kjcf05n00 mcfcli[3673891]: %3|1730682789.762|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T19:13:27.253080535-06:00 level=info msg="Completed cleanup jobs" duration=26.133853ms Nov 3 19:13:27 kjcf05n00 mcfcli[3673891]: %3|1730682807.840|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:13:45 kjcf05n00 mcfcli[3673891]: %3|1730682825.393|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:13:57 kjcf05n00 mcfcli[3673891]: %3|1730682837.840|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:14:23 kjcf05n00 mcfcli[3673891]: %3|1730682863.445|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:14:27 kjcf05n00 mcfcli[3673891]: %3|1730682867.840|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 19:14:57 kjcf05n00 mcfcli[3673891]: %3|1730682897.840|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:14:59 kjcf05n00 mcfcli[3673891]: %3|1730682899.599|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:15:16 kjcf05n00 python3.9[1509472]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 19:15:27 kjcf05n00 mcfcli[3673891]: %3|1730682927.840|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 19:15:38 kjcf05n00 mcfcli[3673891]: %3|1730682938.993|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:15:57 kjcf05n00 mcfcli[3673891]: %3|1730682957.841|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:16:18 kjcf05n00 mcfcli[3673891]: %3|1730682978.990|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:16:27 kjcf05n00 mcfcli[3673891]: %3|1730682987.842|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:16:56 kjcf05n00 mcfcli[3673891]: %3|1730683016.628|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:16:57 kjcf05n00 mcfcli[3673891]: %3|1730683017.843|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 19:17:28 kjcf05n00 mcfcli[3673891]: %3|1730683048.342|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 19:17:34 kjcf05n00 mcfcli[3673891]: %3|1730683054.994|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:17:43 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 19:17:58 kjcf05n00 mcfcli[3673891]: %3|1730683078.342|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:18:14 kjcf05n00 mcfcli[3673891]: %3|1730683094.735|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:18:28 kjcf05n00 mcfcli[3673891]: %3|1730683108.342|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:18:32 kjcf05n01 ansible-file[3258594]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:32 kjcf05n00 ansible-file[1511374]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:33 kjcf05n01 ansible-file[3258635]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:33 kjcf05n01 ansible-file[3258676]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:33 kjcf05n00 ansible-file[1511419]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:34 kjcf05n01 ansible-file[3258717]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:34 kjcf05n00 ansible-file[1511461]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:35 kjcf05n01 ansible-file[3258758]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:36 kjcf05n01 ansible-file[3258799]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:35 kjcf05n00 ansible-file[1511502]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:37 kjcf05n00 ansible-file[1511628]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:37 kjcf05n01 ansible-file[3258854]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:38 kjcf05n01 ansible-file[3258910]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:38 kjcf05n00 ansible-file[1511713]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:38 kjcf05n01 ansible-file[3258977]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:39 kjcf05n01 ansible-file[3259048]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:39 kjcf05n00 ansible-file[1511836]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:40 kjcf05n01 ansible-file[3259130]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:40 kjcf05n00 ansible-file[1511940]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:41 kjcf05n01 ansible-file[3259186]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:42 kjcf05n00 ansible-file[1511993]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:42 kjcf05n01 ansible-file[3259227]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/LUS-11101 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:43 kjcf05n01 ansible-file[3259268]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/LUS-9595 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:43 kjcf05n00 ansible-file[1512037]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:43 kjcf05n01 ansible-file[3259309]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:44 kjcf05n01 ansible-file[3259350]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/LUS-10934 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:44 kjcf05n00 ansible-file[1512079]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:45 kjcf05n01 ansible-file[3259411]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/ZFS-513 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:45 kjcf05n00 ansible-file[1512120]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:46 kjcf05n01 ansible-file[3259477]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:47 kjcf05n00 ansible-file[1512163]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/LUS-11101 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:48 kjcf05n00 ansible-file[1512208]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/LUS-9595 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:49 kjcf05n00 ansible-file[1512257]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:50 kjcf05n00 ansible-file[1512302]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/LUS-10934 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:52 kjcf05n00 ansible-file[1512344]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/ZFS-513 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:53 kjcf05n00 ansible-file[1512385]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:18:54 kjcf05n00 mcfcli[3673891]: %3|1730683134.527|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:18:58 kjcf05n01 ansible-stat[3259583]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/panic_mdt0.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:18:58 kjcf05n00 mcfcli[3673891]: %3|1730683138.343|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:18:58 kjcf05n00 ansible-stat[1512513]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/panic_mdt0.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:18:59 kjcf05n01 ansible-file[3259627]: Invoked with dest=/home/users/filesystem-test/bin/debug/panic_mdt0.sh.latest _original_basename=panic_mdt0.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/panic_mdt0.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:19:00 kjcf05n00 ansible-file[1512558]: Invoked with dest=/home/users/filesystem-test/bin/debug/panic_mdt0.sh.latest _original_basename=panic_mdt0.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/panic_mdt0.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:19:02 kjcf05n01 ansible-ansible.builtin.command[3259809]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/panic_mdt0.sh.latest" "/home/users/filesystem-test/bin/debug/panic_mdt0.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:02 kjcf05n00 ansible-ansible.builtin.command[1512652]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/panic_mdt0.sh.latest" "/home/users/filesystem-test/bin/debug/panic_mdt0.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:04 kjcf05n01 ansible-ansible.builtin.command[3259875]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/panic_mdt0.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:04 kjcf05n00 ansible-ansible.builtin.command[1512697]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/panic_mdt0.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:08 kjcf05n01 ansible-stat[3259974]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/ftrace_capture.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:19:09 kjcf05n01 ansible-file[3260017]: Invoked with dest=/home/users/filesystem-test/bin/debug/ftrace_capture.sh.latest _original_basename=ftrace_capture.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/ftrace_capture.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:19:08 kjcf05n00 ansible-stat[1512962]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/ftrace_capture.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:19:10 kjcf05n00 ansible-file[1513018]: Invoked with dest=/home/users/filesystem-test/bin/debug/ftrace_capture.sh.latest _original_basename=ftrace_capture.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/ftrace_capture.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:19:12 kjcf05n01 ansible-ansible.builtin.command[3260104]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/ftrace_capture.sh.latest" "/home/users/filesystem-test/bin/debug/ftrace_capture.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:12 kjcf05n00 ansible-ansible.builtin.command[1513099]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/ftrace_capture.sh.latest" "/home/users/filesystem-test/bin/debug/ftrace_capture.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:14 kjcf05n01 ansible-ansible.builtin.command[3260148]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/ftrace_capture.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:14 kjcf05n00 ansible-ansible.builtin.command[1513143]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/ftrace_capture.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:18 kjcf05n01 ansible-stat[3260236]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:19:18 kjcf05n00 ansible-stat[1513283]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:19:19 kjcf05n01 ansible-file[3260279]: Invoked with dest=/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh.latest _original_basename=dklogs-capture-oneshot.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:19:19 kjcf05n00 ansible-file[1513337]: Invoked with dest=/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh.latest _original_basename=dklogs-capture-oneshot.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:19:22 kjcf05n01 ansible-ansible.builtin.command[3260367]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh.latest" "/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:22 kjcf05n00 ansible-ansible.builtin.command[1513421]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh.latest" "/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:23 kjcf05n01 ansible-ansible.builtin.command[3260411]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:23 kjcf05n00 ansible-ansible.builtin.command[1513470]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:27 kjcf05n01 ansible-stat[3260500]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:19:28 kjcf05n01 ansible-file[3260543]: Invoked with dest=/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh.latest _original_basename=panic-mdt0-oneshot.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:19:28 kjcf05n00 ansible-stat[1513557]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:19:28 kjcf05n00 mcfcli[3673891]: %3|1730683168.344|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:19:29 kjcf05n00 ansible-file[1513606]: Invoked with dest=/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh.latest _original_basename=panic-mdt0-oneshot.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:19:31 kjcf05n01 ansible-ansible.builtin.command[3260628]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh.latest" "/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:31 kjcf05n00 ansible-ansible.builtin.command[1513686]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh.latest" "/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:32 kjcf05n00 mcfcli[3673891]: %3|1730683172.678|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:19:33 kjcf05n01 ansible-ansible.builtin.command[3260672]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:33 kjcf05n00 ansible-ansible.builtin.command[1513731]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:37 kjcf05n01 ansible-stat[3260758]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/dklogs_capture.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:19:37 kjcf05n00 ansible-stat[1513817]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/dklogs_capture.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:19:38 kjcf05n01 ansible-file[3260801]: Invoked with dest=/home/users/filesystem-test/bin/debug/dklogs_capture.sh.latest _original_basename=dklogs_capture.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/dklogs_capture.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:19:38 kjcf05n00 ansible-file[1513864]: Invoked with dest=/home/users/filesystem-test/bin/debug/dklogs_capture.sh.latest _original_basename=dklogs_capture.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/dklogs_capture.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:19:41 kjcf05n01 ansible-ansible.builtin.command[3260889]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/dklogs_capture.sh.latest" "/home/users/filesystem-test/bin/debug/dklogs_capture.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:41 kjcf05n00 ansible-ansible.builtin.command[1513946]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/dklogs_capture.sh.latest" "/home/users/filesystem-test/bin/debug/dklogs_capture.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:42 kjcf05n01 ansible-ansible.builtin.command[3260933]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/dklogs_capture.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:42 kjcf05n00 ansible-ansible.builtin.command[1513990]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/dklogs_capture.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:46 kjcf05n01 ansible-stat[3261019]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:19:47 kjcf05n00 ansible-stat[1514076]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:19:47 kjcf05n01 ansible-file[3261062]: Invoked with dest=/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh.latest _original_basename=panic_server_on_kern_log.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:19:48 kjcf05n00 ansible-file[1514120]: Invoked with dest=/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh.latest _original_basename=panic_server_on_kern_log.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:19:50 kjcf05n01 ansible-ansible.builtin.command[3261224]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh.latest" "/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:50 kjcf05n00 ansible-ansible.builtin.command[1514332]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh.latest" "/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:52 kjcf05n01 ansible-ansible.builtin.command[3261289]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:52 kjcf05n00 ansible-ansible.builtin.command[1514399]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:19:56 kjcf05n01 ansible-stat[3261420]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/panic_all_mds.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:19:56 kjcf05n00 ansible-stat[1514489]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/panic_all_mds.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:19:56 kjcf05n01 ansible-file[3261463]: Invoked with dest=/home/users/filesystem-test/bin/debug/panic_all_mds.sh.latest _original_basename=panic_all_mds.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/panic_all_mds.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:19:57 kjcf05n00 ansible-file[1514533]: Invoked with dest=/home/users/filesystem-test/bin/debug/panic_all_mds.sh.latest _original_basename=panic_all_mds.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/panic_all_mds.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:19:58 kjcf05n00 mcfcli[3673891]: %3|1730683198.438|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 19:20:00 kjcf05n01 ansible-ansible.builtin.command[3261624]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/panic_all_mds.sh.latest" "/home/users/filesystem-test/bin/debug/panic_all_mds.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 19:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 19:20:00 kjcf05n00 ansible-ansible.builtin.command[1514621]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/panic_all_mds.sh.latest" "/home/users/filesystem-test/bin/debug/panic_all_mds.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 19:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 19:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 19:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 19:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 19:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 19:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 19:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 19:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 19:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 19:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 19:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 19:20:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 19:20:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:20:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 19:20:01 kjcf05n01 ansible-ansible.builtin.command[3261679]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/panic_all_mds.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:01 kjcf05n00 ansible-ansible.builtin.command[1514677]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/panic_all_mds.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:05 kjcf05n01 ansible-stat[3261815]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/trigger-service-start.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:20:06 kjcf05n00 ansible-stat[1514861]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/trigger-service-start.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:20:06 kjcf05n01 ansible-file[3261859]: Invoked with dest=/home/users/filesystem-test/bin/debug/trigger-service-start.sh.latest _original_basename=trigger-service-start.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/trigger-service-start.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:20:07 kjcf05n00 ansible-file[1515021]: Invoked with dest=/home/users/filesystem-test/bin/debug/trigger-service-start.sh.latest _original_basename=trigger-service-start.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/trigger-service-start.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:20:09 kjcf05n01 ansible-ansible.builtin.command[3261948]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/trigger-service-start.sh.latest" "/home/users/filesystem-test/bin/debug/trigger-service-start.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:09 kjcf05n00 ansible-ansible.builtin.command[1515141]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/trigger-service-start.sh.latest" "/home/users/filesystem-test/bin/debug/trigger-service-start.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:11 kjcf05n01 ansible-ansible.builtin.command[3261997]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/trigger-service-start.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:11 kjcf05n00 ansible-ansible.builtin.command[1515185]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/trigger-service-start.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:12 kjcf05n00 mcfcli[3673891]: %3|1730683212.100|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:20:15 kjcf05n01 ansible-stat[3262099]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:20:15 kjcf05n00 ansible-stat[1515271]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:20:16 kjcf05n01 ansible-file[3262142]: Invoked with dest=/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh.latest _original_basename=ftrace-capture-oneshot.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:20:16 kjcf05n00 python3.9[1515112]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 19:20:17 kjcf05n00 ansible-file[1515388]: Invoked with dest=/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh.latest _original_basename=ftrace-capture-oneshot.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:20:19 kjcf05n01 ansible-ansible.builtin.command[3262222]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh.latest" "/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:19 kjcf05n00 ansible-ansible.builtin.command[1515695]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh.latest" "/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:21 kjcf05n01 ansible-ansible.builtin.command[3262274]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:21 kjcf05n00 ansible-ansible.builtin.command[1515745]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:24 kjcf05n01 ansible-stat[3262363]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:20:25 kjcf05n00 ansible-stat[1515839]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:20:25 kjcf05n01 ansible-file[3262406]: Invoked with dest=/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch.latest _original_basename=XYMNTR_filesystem-test.patch.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:20:26 kjcf05n00 ansible-file[1515883]: Invoked with dest=/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch.latest _original_basename=XYMNTR_filesystem-test.patch.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:20:28 kjcf05n01 ansible-ansible.builtin.command[3262486]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch.latest" "/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:28 kjcf05n00 mcfcli[3673891]: %3|1730683228.438|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 19:20:28 kjcf05n00 ansible-ansible.builtin.command[1515967]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch.latest" "/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:30 kjcf05n01 ansible-ansible.builtin.command[3262530]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:30 kjcf05n00 ansible-ansible.builtin.command[1516013]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:34 kjcf05n01 ansible-stat[3262621]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:20:34 kjcf05n00 ansible-stat[1516099]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:20:34 kjcf05n01 ansible-file[3262664]: Invoked with dest=/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh.latest _original_basename=panic-all-mds-oneshot.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:20:35 kjcf05n00 ansible-file[1516142]: Invoked with dest=/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh.latest _original_basename=panic-all-mds-oneshot.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:20:38 kjcf05n01 ansible-ansible.builtin.command[3262744]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh.latest" "/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:38 kjcf05n00 ansible-ansible.builtin.command[1516306]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh.latest" "/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:39 kjcf05n01 ansible-ansible.builtin.command[3262788]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:39 kjcf05n00 ansible-ansible.builtin.command[1516357]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:43 kjcf05n01 ansible-stat[3262881]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:20:44 kjcf05n01 ansible-file[3262924]: Invoked with dest=/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh.latest _original_basename=dklogs_extended_capture.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:20:43 kjcf05n00 ansible-stat[1516443]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:20:44 kjcf05n00 ansible-file[1516487]: Invoked with dest=/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh.latest _original_basename=dklogs_extended_capture.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:20:47 kjcf05n01 ansible-ansible.builtin.command[3263004]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh.latest" "/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:47 kjcf05n00 ansible-ansible.builtin.command[1516568]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh.latest" "/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:48 kjcf05n01 ansible-ansible.builtin.command[3263048]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:48 kjcf05n00 ansible-ansible.builtin.command[1516616]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:51 kjcf05n00 mcfcli[3673891]: %3|1730683251.657|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:20:52 kjcf05n01 ansible-stat[3263210]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:20:53 kjcf05n01 ansible-file[3263253]: Invoked with dest=/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh.latest _original_basename=panic_server_on_LUS-11101.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:20:52 kjcf05n00 ansible-stat[1516712]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:20:54 kjcf05n00 ansible-file[1516755]: Invoked with dest=/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh.latest _original_basename=panic_server_on_LUS-11101.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:20:56 kjcf05n01 ansible-ansible.builtin.command[3263333]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh.latest" "/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:56 kjcf05n00 ansible-ansible.builtin.command[1516838]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh.latest" "/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:58 kjcf05n01 ansible-ansible.builtin.command[3263386]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:58 kjcf05n00 ansible-ansible.builtin.command[1516885]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:20:58 kjcf05n00 mcfcli[3673891]: %3|1730683258.439|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:21:01 kjcf05n01 ansible-stat[3263576]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:21:02 kjcf05n01 ansible-file[3263663]: Invoked with dest=/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template.latest _original_basename=libcfs_LUS-9595.conf.template.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:21:02 kjcf05n00 ansible-stat[1517133]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:21:03 kjcf05n00 ansible-file[1517180]: Invoked with dest=/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template.latest _original_basename=libcfs_LUS-9595.conf.template.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:21:06 kjcf05n01 ansible-ansible.builtin.command[3263750]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template.latest" "/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:06 kjcf05n00 ansible-ansible.builtin.command[1517264]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template.latest" "/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:07 kjcf05n01 ansible-ansible.builtin.command[3263798]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:07 kjcf05n00 ansible-ansible.builtin.command[1517411]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:11 kjcf05n01 ansible-stat[3263893]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:21:11 kjcf05n00 ansible-stat[1517510]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:21:12 kjcf05n01 ansible-file[3263936]: Invoked with dest=/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.latest _original_basename=trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:21:12 kjcf05n00 ansible-file[1517554]: Invoked with dest=/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.latest _original_basename=trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:21:15 kjcf05n01 ansible-ansible.builtin.command[3264020]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.latest" "/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:15 kjcf05n00 ansible-ansible.builtin.command[1517634]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.latest" "/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:16 kjcf05n01 ansible-ansible.builtin.command[3264064]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:16 kjcf05n00 ansible-ansible.builtin.command[1517678]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:20 kjcf05n01 ansible-stat[3264154]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:21:21 kjcf05n01 ansible-file[3264201]: Invoked with dest=/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh.latest _original_basename=XYMNTR_filesystem-test_LUS-10934.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:21:20 kjcf05n00 ansible-stat[1517899]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:21:22 kjcf05n00 ansible-file[1517944]: Invoked with dest=/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh.latest _original_basename=XYMNTR_filesystem-test_LUS-10934.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:21:24 kjcf05n01 ansible-ansible.builtin.command[3264284]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh.latest" "/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:24 kjcf05n00 ansible-ansible.builtin.command[1518029]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh.latest" "/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:26 kjcf05n01 ansible-ansible.builtin.command[3264328]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:26 kjcf05n00 ansible-ansible.builtin.command[1518075]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:28 kjcf05n00 mcfcli[3673891]: %3|1730683288.439|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:21:29 kjcf05n01 ansible-stat[3264414]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:21:30 kjcf05n01 ansible-file[3264457]: Invoked with dest=/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh.latest _original_basename=panic_server_on_ZFS-513.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:21:30 kjcf05n00 ansible-stat[1518168]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:21:31 kjcf05n00 ansible-file[1518211]: Invoked with dest=/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh.latest _original_basename=panic_server_on_ZFS-513.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:21:31 kjcf05n00 mcfcli[3673891]: %3|1730683291.654|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:21:34 kjcf05n01 ansible-ansible.builtin.command[3264542]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh.latest" "/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:34 kjcf05n00 ansible-ansible.builtin.command[1518293]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh.latest" "/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:35 kjcf05n01 ansible-ansible.builtin.command[3264586]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:35 kjcf05n00 ansible-ansible.builtin.command[1518338]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:39 kjcf05n01 ansible-stat[3264672]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:21:39 kjcf05n01 ansible-file[3264715]: Invoked with dest=/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.latest _original_basename=XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:21:39 kjcf05n00 ansible-stat[1518433]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:21:40 kjcf05n00 ansible-file[1518476]: Invoked with dest=/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.latest _original_basename=XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:21:43 kjcf05n01 ansible-ansible.builtin.command[3264802]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.latest" "/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:43 kjcf05n00 ansible-ansible.builtin.command[1518556]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.latest" "/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:44 kjcf05n01 ansible-ansible.builtin.command[3264846]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:44 kjcf05n00 ansible-ansible.builtin.command[1518600]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:52 kjcf05n01 ansible-stat[3265008]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:21:53 kjcf05n01 ansible-file[3265051]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours.latest _original_basename=lus-ho.sh_kill_and_panic_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:21:53 kjcf05n00 ansible-stat[1518698]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:21:54 kjcf05n00 ansible-file[1518741]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours.latest _original_basename=lus-ho.sh_kill_and_panic_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:21:56 kjcf05n01 ansible-ansible.builtin.command[3265175]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:56 kjcf05n00 ansible-ansible.builtin.command[1518828]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:58 kjcf05n01 ansible-ansible.builtin.command[3265228]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:58 kjcf05n00 ansible-ansible.builtin.command[1518873]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:21:58 kjcf05n00 mcfcli[3673891]: %3|1730683318.439|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:22:01 kjcf05n01 ansible-stat[3265319]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:22:02 kjcf05n01 ansible-file[3265370]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours.latest _original_basename=lus-ho.sh_cscli_only_oss_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:22:02 kjcf05n00 ansible-stat[1518979]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:22:03 kjcf05n00 ansible-file[1519023]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours.latest _original_basename=lus-ho.sh_cscli_only_oss_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:22:06 kjcf05n01 ansible-ansible.builtin.command[3265711]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:05 kjcf05n00 ansible-ansible.builtin.command[1519107]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:07 kjcf05n01 ansible-ansible.builtin.command[3265834]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:07 kjcf05n00 ansible-ansible.builtin.command[1519250]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:09 kjcf05n00 mcfcli[3673891]: %3|1730683329.831|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:22:11 kjcf05n01 ansible-stat[3266025]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/check_bitmaps_loop.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:22:11 kjcf05n00 ansible-stat[1519491]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/check_bitmaps_loop.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:22:12 kjcf05n01 ansible-file[3266072]: Invoked with dest=/home/users/filesystem-test/bin/check_bitmaps_loop.sh.latest _original_basename=check_bitmaps_loop.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/check_bitmaps_loop.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:22:12 kjcf05n00 ansible-file[1519541]: Invoked with dest=/home/users/filesystem-test/bin/check_bitmaps_loop.sh.latest _original_basename=check_bitmaps_loop.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/check_bitmaps_loop.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:22:15 kjcf05n01 ansible-ansible.builtin.command[3266154]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/check_bitmaps_loop.sh.latest" "/home/users/filesystem-test/bin/check_bitmaps_loop.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:15 kjcf05n00 ansible-ansible.builtin.command[1519665]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/check_bitmaps_loop.sh.latest" "/home/users/filesystem-test/bin/check_bitmaps_loop.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:16 kjcf05n01 ansible-ansible.builtin.command[3266198]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/check_bitmaps_loop.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:16 kjcf05n00 ansible-ansible.builtin.command[1519709]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/check_bitmaps_loop.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:20 kjcf05n01 ansible-stat[3266338]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/backup.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:22:21 kjcf05n01 ansible-file[3266381]: Invoked with dest=/home/users/filesystem-test/bin/backup.sh.latest _original_basename=backup.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/backup.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:22:20 kjcf05n00 ansible-stat[1519885]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/backup.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:22:22 kjcf05n00 ansible-file[1519928]: Invoked with dest=/home/users/filesystem-test/bin/backup.sh.latest _original_basename=backup.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/backup.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:22:24 kjcf05n01 ansible-ansible.builtin.command[3266471]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/backup.sh.latest" "/home/users/filesystem-test/bin/backup.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:24 kjcf05n00 ansible-ansible.builtin.command[1520016]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/backup.sh.latest" "/home/users/filesystem-test/bin/backup.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:26 kjcf05n01 ansible-ansible.builtin.command[3266515]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/backup.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:26 kjcf05n00 ansible-ansible.builtin.command[1520060]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/backup.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:28 kjcf05n00 mcfcli[3673891]: %3|1730683348.439|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 19:22:30 kjcf05n01 ansible-stat[3266601]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:22:30 kjcf05n00 ansible-stat[1520155]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:22:30 kjcf05n01 ansible-file[3266644]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours.latest _original_basename=lus-ho.sh_panic_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:22:31 kjcf05n00 ansible-file[1520198]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours.latest _original_basename=lus-ho.sh_panic_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:22:34 kjcf05n01 ansible-ansible.builtin.command[3266732]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:34 kjcf05n00 ansible-ansible.builtin.command[1520278]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:35 kjcf05n01 ansible-ansible.builtin.command[3266776]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:35 kjcf05n00 ansible-ansible.builtin.command[1520328]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:39 kjcf05n01 ansible-stat[3266862]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:22:39 kjcf05n00 ansible-stat[1520504]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:22:40 kjcf05n01 ansible-file[3266905]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours.latest _original_basename=lus-ho.sh_cscli_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:22:40 kjcf05n00 ansible-file[1520547]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours.latest _original_basename=lus-ho.sh_cscli_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:22:43 kjcf05n01 ansible-ansible.builtin.command[3266992]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:43 kjcf05n00 ansible-ansible.builtin.command[1520627]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:44 kjcf05n01 ansible-ansible.builtin.command[3267036]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:44 kjcf05n00 ansible-ansible.builtin.command[1520671]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:48 kjcf05n01 ansible-stat[3267122]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:22:49 kjcf05n01 ansible-file[3267165]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours.latest _original_basename=lus-ho.sh_panic_only_oss_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:22:48 kjcf05n00 ansible-stat[1520757]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:22:49 kjcf05n00 mcfcli[3673891]: %3|1730683369.314|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:22:50 kjcf05n00 ansible-file[1520806]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours.latest _original_basename=lus-ho.sh_panic_only_oss_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:22:52 kjcf05n01 ansible-ansible.builtin.command[3267249]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:52 kjcf05n00 ansible-ansible.builtin.command[1520886]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:54 kjcf05n01 ansible-ansible.builtin.command[3267293]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:54 kjcf05n00 ansible-ansible.builtin.command[1520930]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:22:57 kjcf05n01 ansible-stat[3267387]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:22:58 kjcf05n00 ansible-stat[1521024]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:22:58 kjcf05n00 mcfcli[3673891]: %3|1730683378.440|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 19:22:58 kjcf05n01 ansible-file[3267433]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours.latest _original_basename=lus-ho.sh_handoff_and_kill_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:22:59 kjcf05n00 ansible-file[1521075]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours.latest _original_basename=lus-ho.sh_handoff_and_kill_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:23:01 kjcf05n01 ansible-ansible.builtin.command[3267518]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:01 kjcf05n00 ansible-ansible.builtin.command[1521168]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:03 kjcf05n01 ansible-ansible.builtin.command[3267606]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:03 kjcf05n00 ansible-ansible.builtin.command[1521215]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:06 kjcf05n01 ansible-stat[3267773]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:23:07 kjcf05n00 ansible-stat[1521405]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:23:07 kjcf05n01 ansible-file[3267821]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours.latest _original_basename=lus-ho.sh_passive_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:23:08 kjcf05n00 ansible-file[1521450]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours.latest _original_basename=lus-ho.sh_passive_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:23:10 kjcf05n01 ansible-ansible.builtin.command[3267905]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:10 kjcf05n00 ansible-ansible.builtin.command[1521611]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:12 kjcf05n01 ansible-ansible.builtin.command[3267956]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:12 kjcf05n00 ansible-ansible.builtin.command[1521655]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:15 kjcf05n01 ansible-stat[3268044]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/e2fsck-helper.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:23:16 kjcf05n01 ansible-file[3268087]: Invoked with dest=/home/users/filesystem-test/bin/e2fsck-helper.sh.latest _original_basename=e2fsck-helper.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/e2fsck-helper.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T01:23:15.868509Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 19:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T01:23:15.868572Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.082ms Nov 3 19:23:16 kjcf05n00 ansible-stat[1521742]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/e2fsck-helper.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:23:17 kjcf05n00 ansible-file[1521785]: Invoked with dest=/home/users/filesystem-test/bin/e2fsck-helper.sh.latest _original_basename=e2fsck-helper.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/e2fsck-helper.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:23:19 kjcf05n01 ansible-ansible.builtin.command[3268204]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/e2fsck-helper.sh.latest" "/home/users/filesystem-test/bin/e2fsck-helper.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:19 kjcf05n00 ansible-ansible.builtin.command[1522026]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/e2fsck-helper.sh.latest" "/home/users/filesystem-test/bin/e2fsck-helper.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:21 kjcf05n01 ansible-ansible.builtin.command[3268305]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/e2fsck-helper.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:21 kjcf05n00 ansible-ansible.builtin.command[1522109]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/e2fsck-helper.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:24 kjcf05n01 ansible-stat[3268407]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:23:25 kjcf05n00 ansible-stat[1522208]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:23:25 kjcf05n01 ansible-file[3268450]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull.latest _original_basename=lus-ho.sh_passive_cable_pull.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:23:26 kjcf05n00 ansible-file[1522253]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull.latest _original_basename=lus-ho.sh_passive_cable_pull.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T19:23:27.268111571-06:00 level=info msg="Completed cleanup jobs" duration=41.133235ms Nov 3 19:23:27 kjcf05n00 mcfcli[3673891]: %3|1730683407.324|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:23:28 kjcf05n00 mcfcli[3673891]: %3|1730683408.440|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 19:23:28 kjcf05n01 ansible-ansible.builtin.command[3268530]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull.latest" "/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:28 kjcf05n00 ansible-ansible.builtin.command[1522334]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull.latest" "/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:30 kjcf05n01 ansible-ansible.builtin.command[3268574]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:30 kjcf05n00 ansible-ansible.builtin.command[1522387]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:33 kjcf05n01 ansible-stat[3268665]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:23:34 kjcf05n01 ansible-file[3268708]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours.latest _original_basename=lus-ho.sh_cscli_and_kill_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:23:34 kjcf05n00 ansible-stat[1522476]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:23:35 kjcf05n00 ansible-file[1522519]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours.latest _original_basename=lus-ho.sh_cscli_and_kill_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:23:38 kjcf05n01 ansible-ansible.builtin.command[3268788]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:38 kjcf05n00 ansible-ansible.builtin.command[1522599]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:39 kjcf05n01 ansible-ansible.builtin.command[3268832]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:39 kjcf05n00 ansible-ansible.builtin.command[1522645]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:42 kjcf05n01 ansible-stat[3268925]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:23:43 kjcf05n01 ansible-file[3268968]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours.latest _original_basename=lus-ho.sh_kill_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:23:43 kjcf05n00 ansible-stat[1522737]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:23:44 kjcf05n00 ansible-file[1522780]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours.latest _original_basename=lus-ho.sh_kill_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:23:47 kjcf05n01 ansible-ansible.builtin.command[3269048]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:46 kjcf05n00 ansible-ansible.builtin.command[1522860]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:48 kjcf05n01 ansible-ansible.builtin.command[3269092]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:48 kjcf05n00 ansible-ansible.builtin.command[1522904]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:52 kjcf05n01 ansible-stat[3269183]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:23:52 kjcf05n01 ansible-file[3269226]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours.latest _original_basename=lus-ho.sh_kill_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:23:52 kjcf05n00 ansible-stat[1522998]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:23:53 kjcf05n00 ansible-file[1523042]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours.latest _original_basename=lus-ho.sh_kill_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:23:56 kjcf05n01 ansible-ansible.builtin.command[3269350]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:56 kjcf05n00 ansible-ansible.builtin.command[1523122]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:57 kjcf05n01 ansible-ansible.builtin.command[3269400]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:57 kjcf05n00 ansible-ansible.builtin.command[1523170]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:23:58 kjcf05n00 mcfcli[3673891]: %3|1730683438.440|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:24:01 kjcf05n01 ansible-stat[3269489]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:24:01 kjcf05n00 ansible-stat[1523351]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:24:02 kjcf05n01 ansible-file[3269533]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours.latest _original_basename=lus-ho.sh_cscli_and_kill_and_panic_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:24:02 kjcf05n00 ansible-file[1523396]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours.latest _original_basename=lus-ho.sh_cscli_and_kill_and_panic_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:24:03 kjcf05n00 mcfcli[3673891]: %3|1730683443.677|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:24:05 kjcf05n01 ansible-ansible.builtin.command[3269672]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:05 kjcf05n00 ansible-ansible.builtin.command[1523482]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:06 kjcf05n01 ansible-ansible.builtin.command[3269785]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:06 kjcf05n00 ansible-ansible.builtin.command[1523529]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:10 kjcf05n01 ansible-stat[3269880]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:24:10 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 3 19:24:10 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 12 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.008013 sec, idle for 1 hour(s)] Nov 3 19:24:10 kjcf05n00 ansible-stat[1523725]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:24:11 kjcf05n01 ansible-file[3269923]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours.latest _original_basename=lus-ho.sh_cscli_only_oss_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:24:12 kjcf05n00 ansible-file[1523772]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours.latest _original_basename=lus-ho.sh_cscli_only_oss_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:24:14 kjcf05n01 ansible-ansible.builtin.command[3270009]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:14 kjcf05n00 ansible-ansible.builtin.command[1523853]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:16 kjcf05n01 ansible-ansible.builtin.command[3270053]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:16 kjcf05n00 ansible-ansible.builtin.command[1523899]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:19 kjcf05n01 ansible-stat[3270139]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:24:20 kjcf05n01 ansible-file[3270186]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours.latest _original_basename=lus-ho.sh_panic_only_mds_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:24:19 kjcf05n00 ansible-stat[1524008]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:24:21 kjcf05n00 ansible-file[1524052]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours.latest _original_basename=lus-ho.sh_panic_only_mds_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:24:23 kjcf05n01 ansible-ansible.builtin.command[3270270]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:23 kjcf05n00 ansible-ansible.builtin.command[1524141]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:25 kjcf05n01 ansible-ansible.builtin.command[3270317]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:25 kjcf05n00 ansible-ansible.builtin.command[1524186]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:28 kjcf05n00 mcfcli[3673891]: %3|1730683468.440|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:24:28 kjcf05n01 ansible-stat[3270403]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:24:29 kjcf05n01 ansible-file[3270481]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours.latest _original_basename=lus-ho.sh_cscli_and_panic_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:24:29 kjcf05n00 ansible-stat[1524317]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:24:30 kjcf05n00 ansible-file[1524424]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours.latest _original_basename=lus-ho.sh_cscli_and_panic_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:24:32 kjcf05n01 ansible-ansible.builtin.command[3270632]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:32 kjcf05n00 ansible-ansible.builtin.command[1524600]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:34 kjcf05n01 ansible-ansible.builtin.command[3270718]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:34 kjcf05n00 ansible-ansible.builtin.command[1524648]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:37 kjcf05n01 ansible-stat[3270804]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:24:38 kjcf05n01 ansible-file[3270847]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours.latest _original_basename=lus-ho.sh_panic_only_oss_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:24:38 kjcf05n00 ansible-stat[1524822]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:24:39 kjcf05n00 ansible-file[1524869]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours.latest _original_basename=lus-ho.sh_panic_only_oss_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:24:41 kjcf05n01 ansible-ansible.builtin.command[3270930]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:41 kjcf05n00 ansible-ansible.builtin.command[1524959]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:43 kjcf05n00 mcfcli[3673891]: %3|1730683483.199|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:24:43 kjcf05n01 ansible-ansible.builtin.command[3270978]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:43 kjcf05n00 ansible-ansible.builtin.command[1525005]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:46 kjcf05n01 ansible-stat[3271064]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lfsck-helper.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:24:47 kjcf05n01 ansible-file[3271107]: Invoked with dest=/home/users/filesystem-test/bin/lfsck-helper.sh.latest _original_basename=lfsck-helper.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lfsck-helper.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:24:47 kjcf05n00 ansible-stat[1525093]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lfsck-helper.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:24:48 kjcf05n00 ansible-file[1525138]: Invoked with dest=/home/users/filesystem-test/bin/lfsck-helper.sh.latest _original_basename=lfsck-helper.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lfsck-helper.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:24:50 kjcf05n01 ansible-ansible.builtin.command[3271187]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lfsck-helper.sh.latest" "/home/users/filesystem-test/bin/lfsck-helper.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:50 kjcf05n00 ansible-ansible.builtin.command[1525226]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lfsck-helper.sh.latest" "/home/users/filesystem-test/bin/lfsck-helper.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:52 kjcf05n01 ansible-ansible.builtin.command[3271236]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lfsck-helper.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:52 kjcf05n00 ansible-ansible.builtin.command[1525270]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lfsck-helper.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:55 kjcf05n01 ansible-stat[3271322]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:24:56 kjcf05n00 ansible-stat[1525437]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:24:56 kjcf05n01 ansible-file[3271365]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours.latest _original_basename=lus-ho.sh_cscli_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:24:57 kjcf05n00 ansible-file[1525485]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours.latest _original_basename=lus-ho.sh_cscli_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:24:58 kjcf05n00 mcfcli[3673891]: %3|1730683498.440|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:25:00 kjcf05n01 ansible-ansible.builtin.command[3271526]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:24:59 kjcf05n00 ansible-ansible.builtin.command[1525574]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:01 kjcf05n01 ansible-ansible.builtin.command[3271571]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:01 kjcf05n00 ansible-ansible.builtin.command[1525630]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:05 kjcf05n01 ansible-stat[3271708]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:25:05 kjcf05n00 ansible-stat[1525728]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:25:05 kjcf05n01 ansible-file[3271755]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours.latest _original_basename=lus-ho.sh_panic_only_mdt1_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:25:06 kjcf05n00 ansible-file[1525779]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours.latest _original_basename=lus-ho.sh_panic_only_mdt1_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:25:09 kjcf05n01 ansible-ansible.builtin.command[3271843]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:09 kjcf05n00 ansible-ansible.builtin.command[1525999]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:10 kjcf05n01 ansible-ansible.builtin.command[3271889]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:10 kjcf05n00 ansible-ansible.builtin.command[1526057]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:14 kjcf05n01 ansible-stat[3271979]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:25:14 kjcf05n01 ansible-file[3272024]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours.latest _original_basename=lus-ho.sh_panic_only_mdt1_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:25:14 kjcf05n00 ansible-stat[1526149]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:25:15 kjcf05n00 ansible-file[1526192]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours.latest _original_basename=lus-ho.sh_panic_only_mdt1_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:25:16 kjcf05n00 python3.9[1526005]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 19:25:18 kjcf05n01 ansible-ansible.builtin.command[3272104]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:18 kjcf05n00 ansible-ansible.builtin.command[1526531]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:19 kjcf05n01 ansible-ansible.builtin.command[3272148]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:19 kjcf05n00 ansible-ansible.builtin.command[1526659]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:22 kjcf05n00 mcfcli[3673891]: %3|1730683522.049|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:25:23 kjcf05n01 ansible-stat[3272242]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:25:23 kjcf05n00 ansible-stat[1526752]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:25:24 kjcf05n01 ansible-file[3272285]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours.latest _original_basename=lus-ho.sh_cscli_and_kill_and_panic_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:25:24 kjcf05n00 ansible-file[1526800]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours.latest _original_basename=lus-ho.sh_cscli_and_kill_and_panic_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:25:27 kjcf05n01 ansible-ansible.builtin.command[3272368]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:27 kjcf05n00 ansible-ansible.builtin.command[1526883]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:28 kjcf05n01 ansible-ansible.builtin.command[3272412]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:28 kjcf05n00 mcfcli[3673891]: %3|1730683528.441|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 19:25:28 kjcf05n00 ansible-ansible.builtin.command[1526927]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:32 kjcf05n01 ansible-stat[3272499]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:25:33 kjcf05n01 ansible-file[3272547]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours.latest _original_basename=lus-ho.sh_panic_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:25:32 kjcf05n00 ansible-stat[1527021]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:25:33 kjcf05n00 ansible-file[1527066]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours.latest _original_basename=lus-ho.sh_panic_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:25:36 kjcf05n01 ansible-ansible.builtin.command[3272627]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:36 kjcf05n00 ansible-ansible.builtin.command[1527147]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:37 kjcf05n01 ansible-ansible.builtin.command[3272672]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:37 kjcf05n00 ansible-ansible.builtin.command[1527192]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:41 kjcf05n01 ansible-stat[3272834]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:25:41 kjcf05n00 ansible-stat[1527414]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:25:42 kjcf05n01 ansible-file[3272904]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours.latest _original_basename=lus-ho.sh_passive_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:25:43 kjcf05n00 ansible-file[1527472]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours.latest _original_basename=lus-ho.sh_passive_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:25:45 kjcf05n01 ansible-ansible.builtin.command[3272988]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:45 kjcf05n00 ansible-ansible.builtin.command[1527552]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:46 kjcf05n01 ansible-ansible.builtin.command[3273032]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:46 kjcf05n00 ansible-ansible.builtin.command[1527614]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:50 kjcf05n01 ansible-stat[3273190]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:25:51 kjcf05n01 ansible-file[3273233]: Invoked with dest=/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.latest _original_basename=restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:25:50 kjcf05n00 ansible-stat[1527739]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:25:52 kjcf05n00 ansible-file[1527783]: Invoked with dest=/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.latest _original_basename=restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:25:54 kjcf05n01 ansible-ansible.builtin.command[3273414]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.latest" "/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:54 kjcf05n00 ansible-ansible.builtin.command[1527864]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.latest" "/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:56 kjcf05n01 ansible-ansible.builtin.command[3273458]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:56 kjcf05n00 ansible-ansible.builtin.command[1527908]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:25:58 kjcf05n00 mcfcli[3673891]: %3|1730683558.008|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:25:58 kjcf05n00 mcfcli[3673891]: %3|1730683558.441|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 19:25:59 kjcf05n01 ansible-stat[3273553]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:25:59 kjcf05n00 ansible-stat[1527998]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:26:00 kjcf05n01 ansible-file[3273596]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours.latest _original_basename=lus-ho.sh_cscli_and_panic_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:26:01 kjcf05n00 ansible-file[1528056]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours.latest _original_basename=lus-ho.sh_cscli_and_panic_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:26:03 kjcf05n01 ansible-ansible.builtin.command[3273684]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:03 kjcf05n00 ansible-ansible.builtin.command[1528144]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:05 kjcf05n01 ansible-ansible.builtin.command[3273729]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:04 kjcf05n00 ansible-ansible.builtin.command[1528194]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:08 kjcf05n01 ansible-stat[3273869]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:26:08 kjcf05n00 ansible-stat[1528386]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:26:09 kjcf05n01 ansible-file[3273912]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours.latest _original_basename=lus-ho.sh_panic_only_mds_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:26:10 kjcf05n00 ansible-file[1528496]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours.latest _original_basename=lus-ho.sh_panic_only_mds_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:26:12 kjcf05n01 ansible-ansible.builtin.command[3273998]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:12 kjcf05n00 ansible-ansible.builtin.command[1528602]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:14 kjcf05n01 ansible-ansible.builtin.command[3274056]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:14 kjcf05n00 ansible-ansible.builtin.command[1528649]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:17 kjcf05n01 ansible-stat[3274145]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:26:18 kjcf05n01 ansible-file[3274188]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours.latest _original_basename=lus-ho.sh_cscli_and_kill_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:26:18 kjcf05n00 ansible-stat[1528740]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:26:19 kjcf05n00 ansible-file[1528785]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours.latest _original_basename=lus-ho.sh_cscli_and_kill_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:26:21 kjcf05n01 ansible-ansible.builtin.command[3274275]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:21 kjcf05n00 ansible-ansible.builtin.command[1528879]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:23 kjcf05n01 ansible-ansible.builtin.command[3274324]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:23 kjcf05n00 ansible-ansible.builtin.command[1528924]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:26 kjcf05n01 ansible-stat[3274413]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/zpool-scrub-helper.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:26:27 kjcf05n01 ansible-file[3274456]: Invoked with dest=/home/users/filesystem-test/bin/zpool-scrub-helper.sh.latest _original_basename=zpool-scrub-helper.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/zpool-scrub-helper.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:26:27 kjcf05n00 ansible-stat[1529015]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/zpool-scrub-helper.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:26:28 kjcf05n00 ansible-file[1529058]: Invoked with dest=/home/users/filesystem-test/bin/zpool-scrub-helper.sh.latest _original_basename=zpool-scrub-helper.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/zpool-scrub-helper.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:26:28 kjcf05n00 mcfcli[3673891]: %3|1730683588.441|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:26:30 kjcf05n01 ansible-ansible.builtin.command[3274537]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/zpool-scrub-helper.sh.latest" "/home/users/filesystem-test/bin/zpool-scrub-helper.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:30 kjcf05n00 ansible-ansible.builtin.command[1529144]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/zpool-scrub-helper.sh.latest" "/home/users/filesystem-test/bin/zpool-scrub-helper.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:32 kjcf05n01 ansible-ansible.builtin.command[3274581]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/zpool-scrub-helper.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:32 kjcf05n00 ansible-ansible.builtin.command[1529192]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/zpool-scrub-helper.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:35 kjcf05n01 ansible-stat[3274671]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:26:36 kjcf05n00 ansible-stat[1529280]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:26:36 kjcf05n01 ansible-file[3274714]: Invoked with dest=/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh.latest _original_basename=cs_control_lustre_nxd.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:26:37 kjcf05n00 ansible-file[1529407]: Invoked with dest=/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh.latest _original_basename=cs_control_lustre_nxd.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:26:38 kjcf05n00 mcfcli[3673891]: %3|1730683598.005|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:26:39 kjcf05n01 ansible-ansible.builtin.command[3274829]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh.latest" "/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:39 kjcf05n00 ansible-ansible.builtin.command[1529489]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh.latest" "/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:41 kjcf05n01 ansible-ansible.builtin.command[3274874]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:41 kjcf05n00 ansible-ansible.builtin.command[1529537]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:44 kjcf05n01 ansible-stat[3274965]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:26:45 kjcf05n00 ansible-stat[1529623]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:26:45 kjcf05n01 ansible-file[3275034]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours.latest _original_basename=lus-ho.sh_handoff_and_kill_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:26:46 kjcf05n00 ansible-file[1529666]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours.latest _original_basename=lus-ho.sh_handoff_and_kill_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:26:48 kjcf05n01 ansible-ansible.builtin.command[3275174]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:48 kjcf05n00 ansible-ansible.builtin.command[1529807]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:50 kjcf05n01 ansible-ansible.builtin.command[3275255]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:50 kjcf05n00 ansible-ansible.builtin.command[1529909]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:54 kjcf05n01 ansible-stat[3275394]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:26:54 kjcf05n01 ansible-file[3275437]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours.latest _original_basename=lus-ho.sh_kill_and_panic_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:26:54 kjcf05n00 ansible-stat[1530030]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:26:55 kjcf05n00 ansible-file[1530074]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours.latest _original_basename=lus-ho.sh_kill_and_panic_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:26:58 kjcf05n01 ansible-ansible.builtin.command[3275526]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:58 kjcf05n00 ansible-ansible.builtin.command[1530156]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:58 kjcf05n00 mcfcli[3673891]: %3|1730683618.441|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:26:59 kjcf05n01 ansible-ansible.builtin.command[3275570]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:26:59 kjcf05n00 ansible-ansible.builtin.command[1530234]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:27:14 kjcf05n00 mcfcli[3673891]: %3|1730683634.756|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:27:28 kjcf05n00 mcfcli[3673891]: %3|1730683648.441|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:27:30 kjcf05n01 ansible-stat[3276092]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lfsck_errors.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:27:31 kjcf05n01 ansible-file[3276137]: Invoked with dest=/home/users/filesystem-test/bin/lfsck_errors.sh.latest recurse=False _original_basename=lfsck_errors.sh state=file path=/home/users/filesystem-test/bin/lfsck_errors.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:27:30 kjcf05n00 ansible-stat[1530667]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lfsck_errors.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:27:31 kjcf05n00 ansible-file[1530710]: Invoked with dest=/home/users/filesystem-test/bin/lfsck_errors.sh.latest recurse=False _original_basename=lfsck_errors.sh state=file path=/home/users/filesystem-test/bin/lfsck_errors.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:27:34 kjcf05n01 ansible-ansible.builtin.command[3276224]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lfsck_errors.sh.latest" "/home/users/filesystem-test/bin/lfsck_errors.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:27:34 kjcf05n00 ansible-ansible.builtin.command[1530792]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lfsck_errors.sh.latest" "/home/users/filesystem-test/bin/lfsck_errors.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:27:36 kjcf05n01 ansible-ansible.builtin.command[3276269]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lfsck_errors.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:27:36 kjcf05n00 ansible-ansible.builtin.command[1530837]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lfsck_errors.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:27:39 kjcf05n01 ansible-stat[3276355]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:27:39 kjcf05n00 ansible-stat[1530929]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:27:40 kjcf05n01 ansible-file[3276401]: Invoked with dest=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh.latest recurse=False _original_basename=lustre_benchmark_params_setup_snx11281.sh state=file path=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:27:41 kjcf05n00 ansible-file[1530976]: Invoked with dest=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh.latest recurse=False _original_basename=lustre_benchmark_params_setup_snx11281.sh state=file path=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:27:43 kjcf05n01 ansible-ansible.builtin.command[3276485]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh.latest" "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:27:43 kjcf05n00 ansible-ansible.builtin.command[1531056]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh.latest" "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:27:45 kjcf05n01 ansible-ansible.builtin.command[3276529]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:27:45 kjcf05n00 ansible-ansible.builtin.command[1531100]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:27:48 kjcf05n01 ansible-stat[3276615]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_failover.pl.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:27:49 kjcf05n01 ansible-file[3276658]: Invoked with dest=/home/users/filesystem-test/bin/lustre_failover.pl.latest recurse=False _original_basename=lustre_failover.pl state=file path=/home/users/filesystem-test/bin/lustre_failover.pl.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:27:48 kjcf05n00 ansible-stat[1531186]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_failover.pl.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:27:50 kjcf05n00 ansible-file[1531232]: Invoked with dest=/home/users/filesystem-test/bin/lustre_failover.pl.latest recurse=False _original_basename=lustre_failover.pl state=file path=/home/users/filesystem-test/bin/lustre_failover.pl.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:27:52 kjcf05n00 mcfcli[3673891]: %3|1730683672.417|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:27:53 kjcf05n01 ansible-ansible.builtin.command[3276738]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_failover.pl.latest" "/home/users/filesystem-test/bin/lustre_failover.pl" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:27:52 kjcf05n00 ansible-ansible.builtin.command[1531316]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_failover.pl.latest" "/home/users/filesystem-test/bin/lustre_failover.pl" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:27:54 kjcf05n01 ansible-ansible.builtin.command[3276788]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_failover.pl.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:27:54 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 19:27:54 kjcf05n00 ansible-ansible.builtin.command[1531360]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_failover.pl.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:27:57 kjcf05n01 ansible-stat[3276924]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:27:58 kjcf05n00 ansible-stat[1531448]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:27:58 kjcf05n01 ansible-file[3277020]: Invoked with dest=/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh.latest recurse=False _original_basename=obdfilter-survey_kjcf09.sh state=file path=/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:27:58 kjcf05n00 mcfcli[3673891]: %3|1730683678.442|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:27:59 kjcf05n00 ansible-file[1531618]: Invoked with dest=/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh.latest recurse=False _original_basename=obdfilter-survey_kjcf09.sh state=file path=/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:28:02 kjcf05n01 ansible-ansible.builtin.command[3277226]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh.latest" "/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:02 kjcf05n00 ansible-ansible.builtin.command[1531808]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh.latest" "/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:03 kjcf05n01 ansible-ansible.builtin.command[3277277]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:03 kjcf05n00 ansible-ansible.builtin.command[1531853]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:06 kjcf05n01 ansible-stat[3277411]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:28:07 kjcf05n00 ansible-stat[1531958]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:28:07 kjcf05n01 ansible-file[3277459]: Invoked with dest=/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh.latest recurse=False _original_basename=lustre_benchmark_params_check.sh state=file path=/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:28:08 kjcf05n00 ansible-file[1532094]: Invoked with dest=/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh.latest recurse=False _original_basename=lustre_benchmark_params_check.sh state=file path=/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:28:11 kjcf05n01 ansible-ansible.builtin.command[3277543]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh.latest" "/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:11 kjcf05n00 ansible-ansible.builtin.command[1532181]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh.latest" "/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:12 kjcf05n01 ansible-ansible.builtin.command[3277587]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:12 kjcf05n00 ansible-ansible.builtin.command[1532225]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:16 kjcf05n01 ansible-stat[3277679]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/error_check_server_evictions.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:28:16 kjcf05n00 ansible-stat[1532313]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/error_check_server_evictions.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:28:16 kjcf05n01 ansible-file[3277722]: Invoked with dest=/home/users/filesystem-test/bin/error_check_server_evictions.sh.latest recurse=False _original_basename=error_check_server_evictions.sh state=file path=/home/users/filesystem-test/bin/error_check_server_evictions.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:28:17 kjcf05n00 ansible-file[1532359]: Invoked with dest=/home/users/filesystem-test/bin/error_check_server_evictions.sh.latest recurse=False _original_basename=error_check_server_evictions.sh state=file path=/home/users/filesystem-test/bin/error_check_server_evictions.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:28:20 kjcf05n01 ansible-ansible.builtin.command[3277806]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/error_check_server_evictions.sh.latest" "/home/users/filesystem-test/bin/error_check_server_evictions.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:20 kjcf05n00 ansible-ansible.builtin.command[1532455]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/error_check_server_evictions.sh.latest" "/home/users/filesystem-test/bin/error_check_server_evictions.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:21 kjcf05n01 ansible-ansible.builtin.command[3277850]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/error_check_server_evictions.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:21 kjcf05n00 ansible-ansible.builtin.command[1532505]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/error_check_server_evictions.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:25 kjcf05n01 ansible-stat[3277943]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:28:25 kjcf05n00 ansible-stat[1532595]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:28:26 kjcf05n01 ansible-file[3277986]: Invoked with dest=/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh.latest recurse=False _original_basename=obdfilter-survey_kjcf04.sh state=file path=/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:28:26 kjcf05n00 ansible-file[1532639]: Invoked with dest=/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh.latest recurse=False _original_basename=obdfilter-survey_kjcf04.sh state=file path=/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:28:27 kjcf05n00 mcfcli[3673891]: %3|1730683707.924|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:28:28 kjcf05n00 mcfcli[3673891]: %3|1730683708.442|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:28:29 kjcf05n01 ansible-ansible.builtin.command[3278066]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh.latest" "/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:29 kjcf05n00 ansible-ansible.builtin.command[1532721]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh.latest" "/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:31 kjcf05n01 ansible-ansible.builtin.command[3278111]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:30 kjcf05n00 ansible-ansible.builtin.command[1532769]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:34 kjcf05n01 ansible-stat[3278201]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/cs_system_check.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:28:34 kjcf05n00 ansible-stat[1532855]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/cs_system_check.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:28:35 kjcf05n01 ansible-file[3278244]: Invoked with dest=/home/users/filesystem-test/bin/cs_system_check.sh.latest recurse=False _original_basename=cs_system_check.sh state=file path=/home/users/filesystem-test/bin/cs_system_check.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:28:35 kjcf05n00 ansible-file[1532903]: Invoked with dest=/home/users/filesystem-test/bin/cs_system_check.sh.latest recurse=False _original_basename=cs_system_check.sh state=file path=/home/users/filesystem-test/bin/cs_system_check.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:28:38 kjcf05n01 ansible-ansible.builtin.command[3278324]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/cs_system_check.sh.latest" "/home/users/filesystem-test/bin/cs_system_check.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:38 kjcf05n00 ansible-ansible.builtin.command[1533070]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/cs_system_check.sh.latest" "/home/users/filesystem-test/bin/cs_system_check.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:40 kjcf05n01 ansible-ansible.builtin.command[3278371]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/cs_system_check.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:40 kjcf05n00 ansible-ansible.builtin.command[1533120]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/cs_system_check.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:43 kjcf05n01 ansible-stat[3278462]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:28:44 kjcf05n01 ansible-file[3278505]: Invoked with dest=/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py.latest recurse=False _original_basename=calculate_avg_recovery_duration.py state=file path=/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:28:43 kjcf05n00 ansible-stat[1533211]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:28:44 kjcf05n00 ansible-file[1533254]: Invoked with dest=/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py.latest recurse=False _original_basename=calculate_avg_recovery_duration.py state=file path=/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:28:47 kjcf05n01 ansible-ansible.builtin.command[3278585]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py.latest" "/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:47 kjcf05n00 ansible-ansible.builtin.command[1533334]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py.latest" "/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:49 kjcf05n01 ansible-ansible.builtin.command[3278629]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:49 kjcf05n00 ansible-ansible.builtin.command[1533378]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:52 kjcf05n01 ansible-stat[3278715]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/find-unknown-stack-traces.py.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:28:53 kjcf05n01 ansible-file[3278762]: Invoked with dest=/home/users/filesystem-test/bin/find-unknown-stack-traces.py.latest recurse=False _original_basename=find-unknown-stack-traces.py state=file path=/home/users/filesystem-test/bin/find-unknown-stack-traces.py.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:28:52 kjcf05n00 ansible-stat[1533521]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/find-unknown-stack-traces.py.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:28:54 kjcf05n00 ansible-file[1533586]: Invoked with dest=/home/users/filesystem-test/bin/find-unknown-stack-traces.py.latest recurse=False _original_basename=find-unknown-stack-traces.py state=file path=/home/users/filesystem-test/bin/find-unknown-stack-traces.py.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:28:57 kjcf05n01 ansible-ansible.builtin.command[3278914]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/find-unknown-stack-traces.py.latest" "/home/users/filesystem-test/bin/find-unknown-stack-traces.py" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:57 kjcf05n00 ansible-ansible.builtin.command[1533669]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/find-unknown-stack-traces.py.latest" "/home/users/filesystem-test/bin/find-unknown-stack-traces.py" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:58 kjcf05n01 ansible-ansible.builtin.command[3278967]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/find-unknown-stack-traces.py.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:58 kjcf05n00 ansible-ansible.builtin.command[1533714]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/find-unknown-stack-traces.py.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:28:58 kjcf05n00 mcfcli[3673891]: %3|1730683738.848|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 19:29:01 kjcf05n01 ansible-stat[3279054]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:29:02 kjcf05n01 ansible-file[3279098]: Invoked with dest=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh.latest recurse=False _original_basename=lustre_benchmark_params_setup_E1000_kjcf05.sh state=file path=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:29:02 kjcf05n00 ansible-stat[1533818]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:29:03 kjcf05n00 ansible-file[1533862]: Invoked with dest=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh.latest recurse=False _original_basename=lustre_benchmark_params_setup_E1000_kjcf05.sh state=file path=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:29:03 kjcf05n00 mcfcli[3673891]: %3|1730683743.785|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:29:06 kjcf05n01 ansible-ansible.builtin.command[3279232]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh.latest" "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:06 kjcf05n00 ansible-ansible.builtin.command[1533949]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh.latest" "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:07 kjcf05n01 ansible-ansible.builtin.command[3279283]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:07 kjcf05n00 ansible-ansible.builtin.command[1534002]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:09 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 19:29:11 kjcf05n01 ansible-stat[3279448]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:29:12 kjcf05n01 ansible-file[3279514]: Invoked with dest=/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh.latest recurse=False _original_basename=lustre_pool_check_kjcf05.sh state=file path=/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:29:11 kjcf05n00 ansible-stat[1534332]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:29:12 kjcf05n00 ansible-file[1534389]: Invoked with dest=/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh.latest recurse=False _original_basename=lustre_pool_check_kjcf05.sh state=file path=/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:29:15 kjcf05n01 ansible-ansible.builtin.command[3279602]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh.latest" "/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:15 kjcf05n00 ansible-ansible.builtin.command[1534469]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh.latest" "/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:17 kjcf05n01 ansible-ansible.builtin.command[3279646]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:17 kjcf05n00 ansible-ansible.builtin.command[1534513]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:20 kjcf05n01 ansible-stat[3279736]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:29:20 kjcf05n00 ansible-stat[1534685]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:29:21 kjcf05n01 ansible-file[3279779]: Invoked with dest=/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh.latest recurse=False _original_basename=lustre_pool_setup_kjcf05.sh state=file path=/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:29:22 kjcf05n00 ansible-file[1534754]: Invoked with dest=/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh.latest recurse=False _original_basename=lustre_pool_setup_kjcf05.sh state=file path=/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:29:25 kjcf05n01 ansible-ansible.builtin.command[3279867]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh.latest" "/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:24 kjcf05n00 ansible-ansible.builtin.command[1534845]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh.latest" "/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:26 kjcf05n01 ansible-ansible.builtin.command[3279918]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:26 kjcf05n00 ansible-ansible.builtin.command[1534889]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:28 kjcf05n00 mcfcli[3673891]: %3|1730683768.848|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:29:29 kjcf05n01 ansible-stat[3280048]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:29:30 kjcf05n01 ansible-file[3280091]: Invoked with dest=/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh.latest recurse=False _original_basename=lustre_pool_unset_kjcf05.sh state=file path=/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:29:29 kjcf05n00 ansible-stat[1534978]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:29:31 kjcf05n00 ansible-file[1535025]: Invoked with dest=/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh.latest recurse=False _original_basename=lustre_pool_unset_kjcf05.sh state=file path=/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:29:33 kjcf05n01 ansible-ansible.builtin.command[3280180]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh.latest" "/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:33 kjcf05n00 ansible-ansible.builtin.command[1535105]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh.latest" "/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:35 kjcf05n01 ansible-ansible.builtin.command[3280224]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:35 kjcf05n00 ansible-ansible.builtin.command[1535153]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:38 kjcf05n01 ansible-command[3280266]: Invoked with _uses_shell=True _raw_params=rm -f /home/users/filesystem-test/bin/fstrim_*.sh* warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:38 kjcf05n01 ansible-command[3280266]: [WARNING] Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. Nov 3 19:29:38 kjcf05n00 ansible-command[1535197]: Invoked with _uses_shell=True _raw_params=rm -f /home/users/filesystem-test/bin/fstrim_*.sh* warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:38 kjcf05n00 ansible-command[1535197]: [WARNING] Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. Nov 3 19:29:38 kjcf05n00 mcfcli[3673891]: %3|1730683778.833|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:29:41 kjcf05n01 ansible-stat[3280355]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/fstrim.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:29:42 kjcf05n01 ansible-file[3280398]: Invoked with dest=/home/users/filesystem-test/bin/fstrim.sh.latest _original_basename=fstrim.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/fstrim.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:29:41 kjcf05n00 ansible-stat[1535291]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/fstrim.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:29:43 kjcf05n00 ansible-file[1535335]: Invoked with dest=/home/users/filesystem-test/bin/fstrim.sh.latest _original_basename=fstrim.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/fstrim.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:29:45 kjcf05n01 ansible-ansible.builtin.command[3280482]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/fstrim.sh.latest" "/home/users/filesystem-test/bin/fstrim.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:45 kjcf05n00 ansible-ansible.builtin.command[1535487]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/fstrim.sh.latest" "/home/users/filesystem-test/bin/fstrim.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:47 kjcf05n01 ansible-ansible.builtin.command[3280526]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/fstrim.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:47 kjcf05n00 ansible-ansible.builtin.command[1535532]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/fstrim.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:51 kjcf05n01 ansible-stat[3280612]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:29:51 kjcf05n00 ansible-stat[1535625]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh.latest get_md5=False get_mime=True get_attributes=True Nov 3 19:29:51 kjcf05n01 ansible-file[3280655]: Invoked with dest=/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh.latest recurse=False _original_basename=process_obdfilter_survey_results.sh state=file path=/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:29:52 kjcf05n00 ansible-file[1535668]: Invoked with dest=/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh.latest recurse=False _original_basename=process_obdfilter_survey_results.sh state=file path=/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:29:55 kjcf05n01 ansible-ansible.builtin.command[3280857]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh.latest" "/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:55 kjcf05n00 ansible-ansible.builtin.command[1535750]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh.latest" "/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:56 kjcf05n01 ansible-ansible.builtin.command[3280901]: Invoked with _raw_params=/tmp/ansible.4byqbykv.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:56 kjcf05n00 ansible-ansible.builtin.command[1535795]: Invoked with _raw_params=/tmp/ansible.2b6gohf9.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:29:59 kjcf05n00 mcfcli[3673891]: %3|1730683799.348|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 19:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 19:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 19:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 19:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 19:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 19:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 19:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 19:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 19:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 19:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 19:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 19:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 19:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 19:30:00 kjcf05n00 ansible-command[1535850]: Invoked with _raw_params=cscli set_timezone --show warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:30:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 19:30:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:30:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 19:30:16 kjcf05n00 python3.9[1536014]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 19:30:18 kjcf05n00 mcfcli[3673891]: %3|1730683818.830|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:30:29 kjcf05n00 mcfcli[3673891]: %3|1730683829.348|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:30:35 kjcf05n01 ansible-ansible.builtin.file[3281143]: Invoked with state=absent path=/tmp/ansible.4byqbykv.library_script_cache recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:30:35 kjcf05n00 ansible-ansible.builtin.file[1536541]: Invoked with state=absent path=/tmp/ansible.2b6gohf9.library_script_cache recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 3 19:30:36 kjcf05n01 ansible-command[3281185]: Invoked with _uses_shell=True _raw_params=rm -rf /tmp/ansible*library_script_cache warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:30:36 kjcf05n01 ansible-command[3281185]: [WARNING] Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. Nov 3 19:30:36 kjcf05n00 ansible-command[1536667]: Invoked with _uses_shell=True _raw_params=rm -rf /tmp/ansible*library_script_cache warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 3 19:30:36 kjcf05n00 ansible-command[1536667]: [WARNING] Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. Nov 3 19:30:56 kjcf05n00 mcfcli[3673891]: %3|1730683856.866|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:30:59 kjcf05n00 mcfcli[3673891]: %3|1730683859.349|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 19:31:29 kjcf05n00 mcfcli[3673891]: %3|1730683889.349|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:31:34 kjcf05n00 mcfcli[3673891]: %3|1730683894.464|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:31:59 kjcf05n00 mcfcli[3673891]: %3|1730683919.350|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 19:32:12 kjcf05n00 mcfcli[3673891]: %3|1730683932.848|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:32:29 kjcf05n00 mcfcli[3673891]: %3|1730683949.443|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:32:48 kjcf05n00 mcfcli[3673891]: %3|1730683968.270|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:32:59 kjcf05n00 mcfcli[3673891]: %3|1730683979.443|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T19:33:27.252793654-06:00 level=info msg="Completed cleanup jobs" duration=26.2763ms Nov 3 19:33:28 kjcf05n00 mcfcli[3673891]: %3|1730684008.267|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:33:29 kjcf05n00 mcfcli[3673891]: %3|1730684009.444|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:33:59 kjcf05n00 mcfcli[3673891]: %3|1730684039.444|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:34:08 kjcf05n00 mcfcli[3673891]: %3|1730684048.264|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:34:29 kjcf05n00 mcfcli[3673891]: %3|1730684069.444|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:34:46 kjcf05n00 mcfcli[3673891]: %3|1730684086.736|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:34:59 kjcf05n00 mcfcli[3673891]: %3|1730684099.444|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:35:16 kjcf05n00 python3.9[1539092]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 19:35:25 kjcf05n00 mcfcli[3673891]: %3|1730684125.725|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:35:29 kjcf05n00 mcfcli[3673891]: %3|1730684129.444|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 19:35:59 kjcf05n00 mcfcli[3673891]: %3|1730684159.444|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:36:04 kjcf05n00 mcfcli[3673891]: %3|1730684164.211|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:36:29 kjcf05n00 mcfcli[3673891]: %3|1730684189.444|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:36:41 kjcf05n00 mcfcli[3673891]: %3|1730684201.448|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:36:59 kjcf05n00 mcfcli[3673891]: %3|1730684219.445|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 19:37:19 kjcf05n00 mcfcli[3673891]: %3|1730684239.605|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:37:29 kjcf05n00 mcfcli[3673891]: %3|1730684249.445|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 19:37:56 kjcf05n00 mcfcli[3673891]: %3|1730684276.773|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:37:59 kjcf05n00 mcfcli[3673891]: %3|1730684279.445|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:38:29 kjcf05n00 mcfcli[3673891]: %3|1730684309.853|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:38:33 kjcf05n00 mcfcli[3673891]: %3|1730684313.589|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:39:00 kjcf05n00 mcfcli[3673891]: %3|1730684340.352|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 19:39:13 kjcf05n00 mcfcli[3673891]: %3|1730684353.246|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:39:30 kjcf05n00 mcfcli[3673891]: %3|1730684370.353|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:39:50 kjcf05n00 mcfcli[3673891]: %3|1730684390.962|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 19:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 19:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 19:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 19:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 19:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 19:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 19:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 19:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 19:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 19:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 19:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 19:40:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 19:40:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:40:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 19:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 19:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 19:40:00 kjcf05n00 mcfcli[3673891]: %3|1730684400.354|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:40:21 kjcf05n00 python3.9[1541875]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 19:40:30 kjcf05n00 mcfcli[3673891]: %3|1730684430.446|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 19:40:30 kjcf05n00 mcfcli[3673891]: %3|1730684430.959|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:41:00 kjcf05n00 mcfcli[3673891]: %3|1730684460.447|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:41:05 kjcf05n00 mcfcli[3673891]: %3|1730684465.366|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:41:30 kjcf05n00 mcfcli[3673891]: %3|1730684490.856|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:41:43 kjcf05n00 mcfcli[3673891]: %3|1730684503.056|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:41:55 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 19:42:00 kjcf05n00 mcfcli[3673891]: %3|1730684520.856|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:42:21 kjcf05n00 mcfcli[3673891]: %3|1730684541.573|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:42:31 kjcf05n00 mcfcli[3673891]: %3|1730684551.356|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 19:42:58 kjcf05n00 mcfcli[3673891]: %3|1730684578.781|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:43:01 kjcf05n00 mcfcli[3673891]: %3|1730684581.356|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T19:43:27.268715263-06:00 level=info msg="Completed cleanup jobs" duration=41.530176ms Nov 3 19:43:31 kjcf05n00 mcfcli[3673891]: %3|1730684611.357|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:43:38 kjcf05n00 mcfcli[3673891]: %3|1730684618.009|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:44:01 kjcf05n00 mcfcli[3673891]: %3|1730684641.357|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 19:44:13 kjcf05n00 mcfcli[3673891]: %3|1730684653.967|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:44:31 kjcf05n00 mcfcli[3673891]: %3|1730684671.357|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:44:53 kjcf05n00 mcfcli[3673891]: %3|1730684693.597|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:45:01 kjcf05n00 mcfcli[3673891]: %3|1730684701.359|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:45:16 kjcf05n00 python3.9[1544677]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 19:45:31 kjcf05n00 mcfcli[3673891]: %3|1730684731.448|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:45:31 kjcf05n00 mcfcli[3673891]: %3|1730684731.870|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:45:32 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 19:46:01 kjcf05n00 mcfcli[3673891]: %3|1730684761.448|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 19:46:06 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 19:46:10 kjcf05n00 mcfcli[3673891]: %3|1730684770.523|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:46:31 kjcf05n00 mcfcli[3673891]: %3|1730684791.859|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 19:46:48 kjcf05n00 mcfcli[3673891]: %3|1730684808.438|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:47:01 kjcf05n00 mcfcli[3673891]: %3|1730684821.860|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 19:47:26 kjcf05n00 mcfcli[3673891]: %3|1730684846.222|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:47:31 kjcf05n00 mcfcli[3673891]: %3|1730684851.860|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 19:48:01 kjcf05n00 mcfcli[3673891]: %3|1730684881.860|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:48:05 kjcf05n00 mcfcli[3673891]: %3|1730684885.923|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:48:31 kjcf05n00 mcfcli[3673891]: %3|1730684911.860|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 19:48:44 kjcf05n00 mcfcli[3673891]: %3|1730684924.801|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:49:01 kjcf05n00 mcfcli[3673891]: %3|1730684941.861|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:49:22 kjcf05n00 mcfcli[3673891]: %3|1730684962.260|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:49:31 kjcf05n00 mcfcli[3673891]: %3|1730684971.861|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 19:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 19:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 19:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 19:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 19:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 19:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 19:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 19:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 19:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 19:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 19:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 19:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 19:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 19:50:00 kjcf05n00 mcfcli[3673891]: %3|1730685000.743|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:50:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 19:50:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 19:50:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 19:50:01 kjcf05n00 mcfcli[3673891]: %3|1730685001.861|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 19:50:16 kjcf05n00 python3.9[1547439]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 19:50:31 kjcf05n00 mcfcli[3673891]: %3|1730685031.861|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 19:50:40 kjcf05n00 mcfcli[3673891]: %3|1730685040.741|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:51:01 kjcf05n00 mcfcli[3673891]: %3|1730685061.861|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:51:18 kjcf05n00 mcfcli[3673891]: %3|1730685078.125|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:51:26 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 3 19:51:31 kjcf05n00 mcfcli[3673891]: %3|1730685091.863|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:51:57 kjcf05n00 mcfcli[3673891]: %3|1730685117.672|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:52:01 kjcf05n00 mcfcli[3673891]: %3|1730685121.863|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:52:31 kjcf05n00 mcfcli[3673891]: %3|1730685151.863|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:52:33 kjcf05n00 mcfcli[3673891]: %3|1730685153.968|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:53:01 kjcf05n00 mcfcli[3673891]: %3|1730685181.863|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:53:13 kjcf05n00 mcfcli[3673891]: %3|1730685193.965|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T01:53:15.867549Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 19:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T01:53:15.867609Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.083ms Nov 3 19:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T19:53:27.269560779-06:00 level=info msg="Completed cleanup jobs" duration=42.971985ms Nov 3 19:53:31 kjcf05n00 mcfcli[3673891]: %3|1730685211.863|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:53:53 kjcf05n00 mcfcli[3673891]: %3|1730685233.962|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:54:01 kjcf05n00 mcfcli[3673891]: %3|1730685241.864|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:54:30 kjcf05n00 mcfcli[3673891]: %3|1730685270.711|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:54:31 kjcf05n00 mcfcli[3673891]: %3|1730685271.865|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 19:55:01 kjcf05n00 mcfcli[3673891]: %3|1730685301.865|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 19:55:09 kjcf05n00 mcfcli[3673891]: %3|1730685309.377|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:55:19 kjcf05n00 python3.9[1550387]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 19:55:31 kjcf05n00 mcfcli[3673891]: %3|1730685331.865|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:55:45 kjcf05n00 mcfcli[3673891]: %3|1730685345.869|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:56:01 kjcf05n00 mcfcli[3673891]: %3|1730685361.865|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 19:56:21 kjcf05n00 mcfcli[3673891]: %3|1730685381.883|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:56:28 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 3 19:56:31 kjcf05n00 mcfcli[3673891]: %3|1730685391.866|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 19:57:00 kjcf05n00 mcfcli[3673891]: %3|1730685420.183|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:57:01 kjcf05n00 mcfcli[3673891]: %3|1730685421.867|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 19:57:31 kjcf05n00 mcfcli[3673891]: %3|1730685451.867|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:57:39 kjcf05n00 mcfcli[3673891]: %3|1730685459.149|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:58:01 kjcf05n00 mcfcli[3673891]: %3|1730685481.867|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:58:16 kjcf05n00 mcfcli[3673891]: %3|1730685496.559|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:58:31 kjcf05n00 mcfcli[3673891]: %3|1730685511.867|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 19:58:54 kjcf05n00 mcfcli[3673891]: %3|1730685534.834|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 19:59:01 kjcf05n00 mcfcli[3673891]: %3|1730685541.868|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 19:59:31 kjcf05n00 mcfcli[3673891]: %3|1730685571.869|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 19:59:32 kjcf05n00 mcfcli[3673891]: %3|1730685572.497|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 20:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 20:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 20:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 20:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 20:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 20:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 20:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 20:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 20:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 20:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 20:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 20:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 20:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 20:00:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 20:00:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:00:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 20:00:01 kjcf05n00 mcfcli[3673891]: %3|1730685601.869|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 20:00:10 kjcf05n00 mcfcli[3673891]: %3|1730685610.945|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:00:16 kjcf05n00 python3.9[1553253]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 20:00:31 kjcf05n00 mcfcli[3673891]: %3|1730685631.870|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 20:00:50 kjcf05n00 mcfcli[3673891]: %3|1730685650.034|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:01:01 kjcf05n00 mcfcli[3673891]: %3|1730685661.870|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 20:01:26 kjcf05n00 mcfcli[3673891]: %3|1730685686.914|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:01:31 kjcf05n00 mcfcli[3673891]: %3|1730685691.870|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 20:02:01 kjcf05n00 mcfcli[3673891]: %3|1730685721.870|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 20:02:06 kjcf05n00 mcfcli[3673891]: %3|1730685726.911|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:02:31 kjcf05n00 mcfcli[3673891]: %3|1730685751.870|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 20:02:45 kjcf05n00 mcfcli[3673891]: %3|1730685765.353|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:03:01 kjcf05n00 mcfcli[3673891]: %3|1730685781.871|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 20:03:24 kjcf05n00 mcfcli[3673891]: %3|1730685804.031|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T20:03:27.252724708-06:00 level=info msg="Completed cleanup jobs" duration=26.334075ms Nov 3 20:03:31 kjcf05n00 mcfcli[3673891]: %3|1730685811.871|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:04:00 kjcf05n00 mcfcli[3673891]: %3|1730685840.460|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:04:01 kjcf05n00 mcfcli[3673891]: %3|1730685841.872|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:04:31 kjcf05n00 mcfcli[3673891]: %3|1730685871.872|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:04:38 kjcf05n00 mcfcli[3673891]: %3|1730685878.552|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:05:01 kjcf05n00 mcfcli[3673891]: %3|1730685901.872|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:05:16 kjcf05n00 python3.9[1556044]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 20:05:18 kjcf05n00 mcfcli[3673891]: %3|1730685918.548|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:05:31 kjcf05n00 mcfcli[3673891]: %3|1730685931.872|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:05:58 kjcf05n00 mcfcli[3673891]: %3|1730685958.358|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:06:01 kjcf05n00 mcfcli[3673891]: %3|1730685961.873|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 20:06:31 kjcf05n00 mcfcli[3673891]: %3|1730685991.873|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 20:06:33 kjcf05n00 mcfcli[3673891]: %3|1730685993.393|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:07:02 kjcf05n00 mcfcli[3673891]: %3|1730686022.373|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 20:07:11 kjcf05n00 mcfcli[3673891]: %3|1730686031.304|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:07:32 kjcf05n00 mcfcli[3673891]: %3|1730686052.374|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 20:07:48 kjcf05n00 mcfcli[3673891]: %3|1730686068.222|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:08:02 kjcf05n00 mcfcli[3673891]: %3|1730686082.374|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 20:08:28 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 20:08:28 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 20:08:28 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 20:08:27 kjcf05n00 mcfcli[3673891]: %3|1730686107.718|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:08:32 kjcf05n00 mcfcli[3673891]: %3|1730686112.374|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:08:52 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 3 20:08:52 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 3 20:08:52 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 3 20:09:00 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 20:09:00 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 20:09:00 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 20:09:02 kjcf05n00 mcfcli[3673891]: %3|1730686142.376|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:09:06 kjcf05n00 mcfcli[3673891]: %3|1730686146.261|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:09:32 kjcf05n00 mcfcli[3673891]: %3|1730686172.376|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:09:43 kjcf05n00 mcfcli[3673891]: %3|1730686183.991|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:09:53 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 3 20:09:53 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 3 20:09:53 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 3 20:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 20:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 20:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 20:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 20:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 20:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 20:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 20:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 20:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 20:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 20:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 20:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 20:10:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 20:10:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:10:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 20:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 20:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 20:10:02 kjcf05n00 mcfcli[3673891]: %3|1730686202.457|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 20:10:07 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 3 20:10:16 kjcf05n00 python3.9[1558977]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 20:10:23 kjcf05n00 mcfcli[3673891]: %3|1730686223.393|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:10:32 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 3 20:10:32 kjcf05n00 mcfcli[3673891]: %3|1730686232.458|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:10:35 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 3 20:10:35 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 3 20:10:59 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 3 20:10:59 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 3 20:11:01 kjcf05n00 mcfcli[3673891]: %3|1730686261.534|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:11:02 kjcf05n00 mcfcli[3673891]: %3|1730686262.458|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:11:32 kjcf05n00 mcfcli[3673891]: %3|1730686292.877|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 20:11:41 kjcf05n00 mcfcli[3673891]: %3|1730686301.307|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:12:02 kjcf05n00 mcfcli[3673891]: %3|1730686322.878|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:12:19 kjcf05n00 mcfcli[3673891]: %3|1730686339.508|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:12:32 kjcf05n00 mcfcli[3673891]: %3|1730686352.878|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 20:12:56 kjcf05n00 mcfcli[3673891]: %3|1730686376.521|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:13:02 kjcf05n00 mcfcli[3673891]: %3|1730686382.878|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 20:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T20:13:27.269453106-06:00 level=info msg="Completed cleanup jobs" duration=42.663396ms Nov 3 20:13:32 kjcf05n00 mcfcli[3673891]: %3|1730686412.878|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:13:36 kjcf05n00 mcfcli[3673891]: %3|1730686416.518|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:14:02 kjcf05n00 mcfcli[3673891]: %3|1730686442.879|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 20:14:16 kjcf05n00 mcfcli[3673891]: %3|1730686456.493|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:14:32 kjcf05n00 mcfcli[3673891]: %3|1730686472.880|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 20:14:51 kjcf05n00 mcfcli[3673891]: %3|1730686491.377|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:15:03 kjcf05n00 mcfcli[3673891]: %3|1730686503.379|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 20:15:23 kjcf05n00 python3.9[1561807]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 20:15:31 kjcf05n00 mcfcli[3673891]: %3|1730686531.374|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:15:33 kjcf05n00 mcfcli[3673891]: %3|1730686533.379|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 20:16:03 kjcf05n00 mcfcli[3673891]: %3|1730686563.379|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 20:16:11 kjcf05n00 mcfcli[3673891]: %3|1730686571.034|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:16:33 kjcf05n00 mcfcli[3673891]: %3|1730686593.380|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:16:49 kjcf05n00 mcfcli[3673891]: %3|1730686609.621|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:17:03 kjcf05n00 mcfcli[3673891]: %3|1730686623.460|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 20:17:28 kjcf05n00 mcfcli[3673891]: %3|1730686648.106|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:17:33 kjcf05n00 mcfcli[3673891]: %3|1730686653.460|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 20:18:03 kjcf05n00 mcfcli[3673891]: %3|1730686683.461|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:18:07 kjcf05n00 mcfcli[3673891]: %3|1730686687.126|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:18:33 kjcf05n00 mcfcli[3673891]: %3|1730686713.461|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:18:45 kjcf05n00 mcfcli[3673891]: %3|1730686725.740|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:19:03 kjcf05n00 mcfcli[3673891]: %3|1730686743.461|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:19:23 kjcf05n00 mcfcli[3673891]: %3|1730686763.949|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:19:33 kjcf05n00 mcfcli[3673891]: %3|1730686773.882|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 20:19:59 kjcf05n00 mcfcli[3673891]: %3|1730686799.541|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 20:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 20:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 20:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 20:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 20:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 20:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 20:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 20:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 20:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 20:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 20:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 20:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 20:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 20:20:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 20:20:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:20:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 20:20:03 kjcf05n00 mcfcli[3673891]: %3|1730686803.882|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:20:16 kjcf05n00 python3.9[1564614]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 20:20:33 kjcf05n00 mcfcli[3673891]: %3|1730686833.883|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:20:35 kjcf05n00 mcfcli[3673891]: %3|1730686835.866|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:21:03 kjcf05n00 mcfcli[3673891]: %3|1730686863.883|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 20:21:15 kjcf05n00 mcfcli[3673891]: %3|1730686875.360|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:21:33 kjcf05n00 mcfcli[3673891]: %3|1730686893.883|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 20:21:55 kjcf05n00 mcfcli[3673891]: %3|1730686915.357|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:22:03 kjcf05n00 mcfcli[3673891]: %3|1730686923.883|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 20:22:33 kjcf05n00 mcfcli[3673891]: %3|1730686953.884|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:22:34 kjcf05n00 mcfcli[3673891]: %3|1730686954.526|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:23:03 kjcf05n00 mcfcli[3673891]: %3|1730686983.884|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 20:23:11 kjcf05n00 mcfcli[3673891]: %3|1730686991.394|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T02:23:15.867519Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 20:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T02:23:15.867589Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.091ms Nov 3 20:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T20:23:27.268069886-06:00 level=info msg="Completed cleanup jobs" duration=41.607348ms Nov 3 20:23:33 kjcf05n00 mcfcli[3673891]: %3|1730687013.885|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 20:23:49 kjcf05n00 mcfcli[3673891]: %3|1730687029.636|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:24:03 kjcf05n00 mcfcli[3673891]: %3|1730687043.885|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:24:10 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 3 20:24:10 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 6 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.006754 sec, idle for 1 hour(s)] Nov 3 20:24:27 kjcf05n00 mcfcli[3673891]: %3|1730687067.312|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:24:33 kjcf05n00 mcfcli[3673891]: %3|1730687073.886|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:25:03 kjcf05n00 mcfcli[3673891]: %3|1730687103.886|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:25:04 kjcf05n00 mcfcli[3673891]: %3|1730687104.862|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:25:16 kjcf05n00 python3.9[1567433]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 20:25:33 kjcf05n00 mcfcli[3673891]: %3|1730687133.886|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 20:25:40 kjcf05n00 mcfcli[3673891]: %3|1730687140.885|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:26:03 kjcf05n00 mcfcli[3673891]: %3|1730687163.887|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 20:26:19 kjcf05n00 mcfcli[3673891]: %3|1730687179.288|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:26:33 kjcf05n00 mcfcli[3673891]: %3|1730687193.888|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:26:57 kjcf05n00 mcfcli[3673891]: %3|1730687217.364|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:27:03 kjcf05n00 mcfcli[3673891]: %3|1730687223.888|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 20:27:33 kjcf05n00 mcfcli[3673891]: %3|1730687253.889|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 20:27:36 kjcf05n00 mcfcli[3673891]: %3|1730687256.771|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:28:04 kjcf05n00 mcfcli[3673891]: %3|1730687284.388|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:28:13 kjcf05n00 mcfcli[3673891]: %3|1730687293.825|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:28:34 kjcf05n00 mcfcli[3673891]: %3|1730687314.389|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:28:53 kjcf05n00 mcfcli[3673891]: %3|1730687333.391|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:29:04 kjcf05n00 mcfcli[3673891]: %3|1730687344.464|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 20:29:31 kjcf05n00 mcfcli[3673891]: %3|1730687371.165|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:29:34 kjcf05n00 mcfcli[3673891]: %3|1730687374.464|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 20:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 20:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 20:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 20:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 20:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 20:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 20:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 20:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 20:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 20:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 20:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 20:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 20:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 20:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 20:30:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 20:30:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:30:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 20:30:04 kjcf05n00 mcfcli[3673891]: %3|1730687404.465|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:30:07 kjcf05n00 mcfcli[3673891]: %3|1730687407.029|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:30:16 kjcf05n00 python3.9[1570393]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 20:30:34 kjcf05n00 mcfcli[3673891]: %3|1730687434.465|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 20:30:47 kjcf05n00 mcfcli[3673891]: %3|1730687447.026|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:31:04 kjcf05n00 mcfcli[3673891]: %3|1730687464.891|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 20:31:25 kjcf05n00 mcfcli[3673891]: %3|1730687485.377|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:31:34 kjcf05n00 mcfcli[3673891]: %3|1730687494.892|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:32:02 kjcf05n00 mcfcli[3673891]: %3|1730687522.773|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:32:04 kjcf05n00 mcfcli[3673891]: %3|1730687524.892|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:32:34 kjcf05n00 mcfcli[3673891]: %3|1730687554.892|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:32:38 kjcf05n00 mcfcli[3673891]: %3|1730687558.821|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:33:04 kjcf05n00 mcfcli[3673891]: %3|1730687584.892|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:33:18 kjcf05n00 mcfcli[3673891]: %3|1730687598.818|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T20:33:27.253498495-06:00 level=info msg="Completed cleanup jobs" duration=26.375785ms Nov 3 20:33:34 kjcf05n00 mcfcli[3673891]: %3|1730687614.892|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:33:54 kjcf05n00 mcfcli[3673891]: %3|1730687634.695|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:34:04 kjcf05n00 mcfcli[3673891]: %3|1730687644.893|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 20:34:32 kjcf05n00 mcfcli[3673891]: %3|1730687672.560|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:34:34 kjcf05n00 mcfcli[3673891]: %3|1730687674.893|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 20:35:04 kjcf05n00 mcfcli[3673891]: %3|1730687704.894|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:35:12 kjcf05n00 mcfcli[3673891]: %3|1730687712.004|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:35:16 kjcf05n00 python3.9[1573227]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 20:35:34 kjcf05n00 mcfcli[3673891]: %3|1730687734.894|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 20:35:50 kjcf05n00 mcfcli[3673891]: %3|1730687750.285|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:36:04 kjcf05n00 mcfcli[3673891]: %3|1730687764.895|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:36:30 kjcf05n00 mcfcli[3673891]: %3|1730687790.282|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:36:34 kjcf05n00 mcfcli[3673891]: %3|1730687794.895|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:37:04 kjcf05n00 mcfcli[3673891]: %3|1730687824.896|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:37:10 kjcf05n00 mcfcli[3673891]: %3|1730687830.279|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:37:34 kjcf05n00 mcfcli[3673891]: %3|1730687854.896|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:37:48 kjcf05n00 mcfcli[3673891]: %3|1730687868.105|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:38:04 kjcf05n00 mcfcli[3673891]: %3|1730687884.896|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:38:24 kjcf05n00 mcfcli[3673891]: %3|1730687904.894|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:38:34 kjcf05n00 mcfcli[3673891]: %3|1730687914.896|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 20:39:00 kjcf05n00 mcfcli[3673891]: %3|1730687940.118|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:39:04 kjcf05n00 mcfcli[3673891]: %3|1730687944.896|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:39:34 kjcf05n00 mcfcli[3673891]: %3|1730687974.897|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:39:39 kjcf05n00 mcfcli[3673891]: %3|1730687979.826|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 20:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 20:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 20:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 20:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 20:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 20:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 20:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 20:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 20:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 20:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 20:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 20:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 20:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 20:40:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 20:40:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:40:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 20:40:04 kjcf05n00 mcfcli[3673891]: %3|1730688004.897|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:40:16 kjcf05n00 python3.9[1576007]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 20:40:17 kjcf05n00 mcfcli[3673891]: %3|1730688017.834|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:40:34 kjcf05n00 mcfcli[3673891]: %3|1730688034.897|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 20:40:57 kjcf05n00 mcfcli[3673891]: %3|1730688057.831|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:41:04 kjcf05n00 mcfcli[3673891]: %3|1730688064.897|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:41:34 kjcf05n00 mcfcli[3673891]: %3|1730688094.899|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:41:36 kjcf05n00 mcfcli[3673891]: %3|1730688096.006|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:42:04 kjcf05n00 mcfcli[3673891]: %3|1730688124.899|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:42:16 kjcf05n00 mcfcli[3673891]: %3|1730688136.003|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:42:34 kjcf05n00 mcfcli[3673891]: %3|1730688154.899|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:42:53 kjcf05n00 mcfcli[3673891]: %3|1730688173.797|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:43:04 kjcf05n00 mcfcli[3673891]: %3|1730688184.899|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 20:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T20:43:27.247840996-06:00 level=info msg="Completed cleanup jobs" duration=21.411217ms Nov 3 20:43:32 kjcf05n00 mcfcli[3673891]: %3|1730688212.625|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:43:34 kjcf05n00 mcfcli[3673891]: %3|1730688214.899|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:44:04 kjcf05n00 mcfcli[3673891]: %3|1730688244.899|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:44:11 kjcf05n00 mcfcli[3673891]: %3|1730688251.117|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:44:34 kjcf05n00 mcfcli[3673891]: %3|1730688274.899|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:44:47 kjcf05n00 mcfcli[3673891]: %3|1730688287.132|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:45:04 kjcf05n00 mcfcli[3673891]: %3|1730688304.901|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:45:16 kjcf05n00 python3.9[1578999]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 20:45:25 kjcf05n00 mcfcli[3673891]: %3|1730688325.844|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:45:34 kjcf05n00 mcfcli[3673891]: %3|1730688334.901|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 20:46:03 kjcf05n00 mcfcli[3673891]: %3|1730688363.759|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:46:04 kjcf05n00 mcfcli[3673891]: %3|1730688364.901|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 20:46:34 kjcf05n00 mcfcli[3673891]: %3|1730688394.902|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 20:46:41 kjcf05n00 mcfcli[3673891]: %3|1730688401.740|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:47:04 kjcf05n00 mcfcli[3673891]: %3|1730688424.902|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:47:19 kjcf05n00 mcfcli[3673891]: %3|1730688439.129|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:47:34 kjcf05n00 mcfcli[3673891]: %3|1730688454.902|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:47:59 kjcf05n00 mcfcli[3673891]: %3|1730688479.126|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:48:01 kjcf05n01 diskmonitor[1331407]: leaving test state: 1 next state: 2 Nov 3 20:48:01 kjcf05n01 diskmonitor[1331407]: lock req: no timeout Nov 3 20:48:01 kjcf05n01 diskmonitor[1331407]: leaving test state: 2 next state: 4 Nov 3 20:48:04 kjcf05n00 mcfcli[3673891]: %3|1730688484.902|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:48:34 kjcf05n00 mcfcli[3673891]: %3|1730688514.903|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 20:48:35 kjcf05n00 mcfcli[3673891]: %3|1730688515.198|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:49:04 kjcf05n00 mcfcli[3673891]: %3|1730688544.903|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:49:11 kjcf05n01 diskmonitor[1331407]: lock acquired Nov 3 20:49:11 kjcf05n01 diskmonitor[1331407]: leaving test state: 4 next state: 8 Nov 3 20:49:14 kjcf05n00 mcfcli[3673891]: %3|1730688554.498|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:49:28 kjcf05n01 diskmonitor[1331407]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 3 20:49:28 kjcf05n01 diskmonitor[1331407]: leaving test state: 8 next state: 20 Nov 3 20:49:28 kjcf05n01 diskmonitor[1331407]: leaving test state: 20 next state: 40 Nov 3 20:49:28 kjcf05n01 diskmonitor[1331407]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset 3462f98000 Nov 3 20:49:28 kjcf05n01 diskmonitor[1331407]: leaving test state: 40 next state: 80 Nov 3 20:49:34 kjcf05n00 mcfcli[3673891]: %3|1730688574.903|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 20:49:52 kjcf05n00 mcfcli[3673891]: %3|1730688592.390|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 20:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 20:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 20:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 20:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 20:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 20:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 20:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 20:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 20:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 20:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 20:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 20:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 20:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 20:50:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 20:50:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 20:50:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 20:50:04 kjcf05n00 mcfcli[3673891]: %3|1730688604.904|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 20:50:21 kjcf05n01 diskmonitor[1331407]: leaving test state: 80 next state: 100 Nov 3 20:50:21 kjcf05n01 diskmonitor[1331407]: lock release: time: Sun Nov 3 20:50:19 2024 Nov 3 20:50:21 kjcf05n01 diskmonitor[1331407]: leaving test state: 100 next state: 1 Nov 3 20:50:21 kjcf05n00 python3.9[1581798]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 20:50:29 kjcf05n00 mcfcli[3673891]: %3|1730688629.968|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:50:34 kjcf05n00 mcfcli[3673891]: %3|1730688634.904|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 20:51:04 kjcf05n00 mcfcli[3673891]: %3|1730688664.905|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:51:09 kjcf05n00 mcfcli[3673891]: %3|1730688669.965|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:51:34 kjcf05n00 mcfcli[3673891]: %3|1730688694.905|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:51:49 kjcf05n00 mcfcli[3673891]: %3|1730688709.962|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:52:04 kjcf05n00 mcfcli[3673891]: %3|1730688724.906|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:52:27 kjcf05n00 mcfcli[3673891]: %3|1730688747.123|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:52:34 kjcf05n00 mcfcli[3673891]: %3|1730688754.906|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:53:04 kjcf05n00 mcfcli[3673891]: %3|1730688784.906|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:53:07 kjcf05n00 mcfcli[3673891]: %3|1730688787.016|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T02:53:15.868069Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 20:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T02:53:15.868130Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.083ms Nov 3 20:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T20:53:27.26180509-06:00 level=info msg="Completed cleanup jobs" duration=35.380648ms Nov 3 20:53:34 kjcf05n00 mcfcli[3673891]: %3|1730688814.906|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:53:44 kjcf05n00 mcfcli[3673891]: %3|1730688824.905|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:54:04 kjcf05n00 mcfcli[3673891]: %3|1730688844.906|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 20:54:23 kjcf05n00 mcfcli[3673891]: %3|1730688863.519|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:54:34 kjcf05n00 mcfcli[3673891]: %3|1730688874.906|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 20:55:02 kjcf05n00 mcfcli[3673891]: %3|1730688902.096|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:55:04 kjcf05n00 mcfcli[3673891]: %3|1730688904.908|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:55:17 kjcf05n00 python3.9[1584581]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 20:55:34 kjcf05n00 mcfcli[3673891]: %3|1730688934.908|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 20:55:35 kjcf05n00 mcfcli[3673891]: %3|1730688935.513|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:56:04 kjcf05n00 mcfcli[3673891]: %3|1730688964.908|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:56:13 kjcf05n00 mcfcli[3673891]: %3|1730688973.152|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:56:34 kjcf05n00 mcfcli[3673891]: %3|1730688994.908|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 20:56:50 kjcf05n00 mcfcli[3673891]: %3|1730689010.884|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:57:04 kjcf05n00 mcfcli[3673891]: %3|1730689024.908|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 20:57:28 kjcf05n00 mcfcli[3673891]: %3|1730689048.422|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:57:34 kjcf05n00 mcfcli[3673891]: %3|1730689054.908|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 20:58:04 kjcf05n00 mcfcli[3673891]: %3|1730689084.899|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:58:05 kjcf05n00 mcfcli[3673891]: %3|1730689085.408|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 20:58:35 kjcf05n00 mcfcli[3673891]: %3|1730689115.409|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 20:58:43 kjcf05n00 mcfcli[3673891]: %3|1730689123.936|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:59:05 kjcf05n00 mcfcli[3673891]: %3|1730689145.409|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 20:59:22 kjcf05n00 mcfcli[3673891]: %3|1730689162.439|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 20:59:35 kjcf05n00 mcfcli[3673891]: %3|1730689175.409|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 21:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 21:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 21:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 21:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 21:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 21:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 21:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 21:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 21:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 21:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 21:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 21:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 21:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 21:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 21:00:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 21:00:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:00:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 21:00:02 kjcf05n00 mcfcli[3673891]: %3|1730689202.205|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:00:05 kjcf05n00 mcfcli[3673891]: %3|1730689205.409|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 21:00:17 kjcf05n00 python3.9[1587381]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 21:00:35 kjcf05n00 mcfcli[3673891]: %3|1730689235.410|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 21:00:40 kjcf05n00 mcfcli[3673891]: %3|1730689240.662|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:01:05 kjcf05n00 mcfcli[3673891]: %3|1730689265.410|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:01:18 kjcf05n00 mcfcli[3673891]: %3|1730689278.578|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:01:19 kjcf05n00 diskmonitor[2758297]: leaving test state: 1 next state: 2 Nov 3 21:01:19 kjcf05n00 diskmonitor[2758297]: lock req: no timeout Nov 3 21:01:19 kjcf05n00 diskmonitor[2758297]: leaving test state: 2 next state: 4 Nov 3 21:01:35 kjcf05n00 mcfcli[3673891]: %3|1730689295.411|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:01:58 kjcf05n00 mcfcli[3673891]: %3|1730689318.575|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:02:05 kjcf05n00 mcfcli[3673891]: %3|1730689325.411|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:02:24 kjcf05n00 diskmonitor[2758297]: lock acquired Nov 3 21:02:24 kjcf05n00 diskmonitor[2758297]: leaving test state: 4 next state: 8 Nov 3 21:02:33 kjcf05n00 diskmonitor[2758297]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 3 21:02:33 kjcf05n00 diskmonitor[2758297]: leaving test state: 8 next state: 20 Nov 3 21:02:33 kjcf05n00 diskmonitor[2758297]: leaving test state: 20 next state: 40 Nov 3 21:02:33 kjcf05n00 diskmonitor[2758297]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset 13738b30000 Nov 3 21:02:33 kjcf05n00 diskmonitor[2758297]: leaving test state: 40 next state: 80 Nov 3 21:02:35 kjcf05n00 mcfcli[3673891]: %3|1730689355.475|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 21:02:36 kjcf05n00 mcfcli[3673891]: %3|1730689356.937|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:03:05 kjcf05n00 mcfcli[3673891]: %3|1730689385.476|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:03:12 kjcf05n00 mcfcli[3673891]: %3|1730689392.587|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T21:03:27.268589378-06:00 level=info msg="Completed cleanup jobs" duration=41.601508ms Nov 3 21:03:33 kjcf05n00 diskmonitor[2758297]: leaving test state: 80 next state: 100 Nov 3 21:03:33 kjcf05n00 diskmonitor[2758297]: lock release: time: Sun Nov 3 21:03:33 2024 Nov 3 21:03:33 kjcf05n00 diskmonitor[2758297]: leaving test state: 100 next state: 1 Nov 3 21:03:35 kjcf05n00 mcfcli[3673891]: %3|1730689415.476|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:03:51 kjcf05n00 mcfcli[3673891]: %3|1730689431.736|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:04:05 kjcf05n00 mcfcli[3673891]: %3|1730689445.477|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:04:29 kjcf05n00 mcfcli[3673891]: %3|1730689469.311|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:04:35 kjcf05n00 mcfcli[3673891]: %3|1730689475.913|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 21:05:05 kjcf05n00 mcfcli[3673891]: %3|1730689505.548|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:05:05 kjcf05n00 mcfcli[3673891]: %3|1730689505.914|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 21:05:17 kjcf05n00 python3.9[1591185]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 21:05:18 kjcf05n00 diskmonitor[2758297]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 21:05:36 kjcf05n00 mcfcli[3673891]: %3|1730689536.415|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 21:05:42 kjcf05n00 mcfcli[3673891]: %3|1730689542.948|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:06:06 kjcf05n00 mcfcli[3673891]: %3|1730689566.477|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 21:06:22 kjcf05n00 mcfcli[3673891]: %3|1730689582.703|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:06:36 kjcf05n00 mcfcli[3673891]: %3|1730689596.478|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:07:01 kjcf05n00 mcfcli[3673891]: %3|1730689621.844|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:07:05 kjcf05n01 diskmonitor[1331407]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 21:07:06 kjcf05n00 mcfcli[3673891]: %3|1730689626.916|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 21:07:36 kjcf05n00 mcfcli[3673891]: %3|1730689656.916|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:07:40 kjcf05n00 mcfcli[3673891]: %3|1730689660.989|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:08:06 kjcf05n00 mcfcli[3673891]: %3|1730689686.916|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:08:15 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 21:08:15 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 21:08:15 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 21:08:20 kjcf05n00 mcfcli[3673891]: %3|1730689700.986|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:08:34 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 3 21:08:34 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 3 21:08:34 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 3 21:08:36 kjcf05n00 mcfcli[3673891]: %3|1730689716.918|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 21:08:55 kjcf05n00 mcfcli[3673891]: %3|1730689735.914|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:09:04 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 21:09:04 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 21:09:04 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 21:09:06 kjcf05n00 mcfcli[3673891]: %3|1730689746.918|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 21:09:27 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 3 21:09:27 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 3 21:09:27 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 3 21:09:32 kjcf05n00 mcfcli[3673891]: %3|1730689772.946|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:09:36 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 3 21:09:36 kjcf05n00 mcfcli[3673891]: %3|1730689776.918|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 21:09:38 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 3 21:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 21:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 21:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 21:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 21:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 21:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 21:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 21:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 21:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 21:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 21:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 21:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 21:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 21:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 21:10:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 21:10:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:10:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 21:10:03 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 3 21:10:03 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 3 21:10:06 kjcf05n00 mcfcli[3673891]: %3|1730689806.919|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:10:09 kjcf05n00 mcfcli[3673891]: %3|1730689809.841|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:10:11 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 3 21:10:11 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 3 21:10:19 kjcf05n00 python3.9[1593989]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 21:10:36 kjcf05n00 mcfcli[3673891]: %3|1730689836.919|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 21:10:49 kjcf05n00 mcfcli[3673891]: %3|1730689849.838|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:11:06 kjcf05n00 mcfcli[3673891]: %3|1730689866.920|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:11:26 kjcf05n00 mcfcli[3673891]: %3|1730689886.399|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:11:36 kjcf05n00 mcfcli[3673891]: %3|1730689896.920|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 21:12:03 kjcf05n00 mcfcli[3673891]: %3|1730689923.087|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:12:06 kjcf05n00 mcfcli[3673891]: %3|1730689926.920|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 21:12:36 kjcf05n00 mcfcli[3673891]: %3|1730689956.920|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 21:12:38 kjcf05n00 mcfcli[3673891]: %3|1730689958.459|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:13:06 kjcf05n00 mcfcli[3673891]: %3|1730689986.921|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 3 21:13:18 kjcf05n00 mcfcli[3673891]: %3|1730689998.396|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T21:13:27.253065969-06:00 level=info msg="Completed cleanup jobs" duration=26.549452ms Nov 3 21:13:36 kjcf05n00 mcfcli[3673891]: %3|1730690016.921|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 21:13:54 kjcf05n00 mcfcli[3673891]: %3|1730690034.125|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:14:06 kjcf05n00 mcfcli[3673891]: %3|1730690046.922|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 21:14:34 kjcf05n00 mcfcli[3673891]: %3|1730690074.122|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:14:36 kjcf05n00 mcfcli[3673891]: %3|1730690076.922|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:15:06 kjcf05n00 mcfcli[3673891]: %3|1730690106.922|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:15:13 kjcf05n00 mcfcli[3673891]: %3|1730690113.417|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:15:17 kjcf05n00 python3.9[1596886]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 21:15:36 kjcf05n00 mcfcli[3673891]: %3|1730690136.922|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 21:15:51 kjcf05n00 mcfcli[3673891]: %3|1730690151.672|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:16:06 kjcf05n00 mcfcli[3673891]: %3|1730690166.922|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 21:16:31 kjcf05n00 mcfcli[3673891]: %3|1730690191.669|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:16:36 kjcf05n00 mcfcli[3673891]: %3|1730690196.922|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:17:06 kjcf05n00 mcfcli[3673891]: %3|1730690226.922|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:17:11 kjcf05n00 mcfcli[3673891]: %3|1730690231.666|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:17:36 kjcf05n00 mcfcli[3673891]: %3|1730690256.923|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:17:51 kjcf05n00 mcfcli[3673891]: %3|1730690271.663|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:18:06 kjcf05n00 mcfcli[3673891]: %3|1730690286.923|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:18:28 kjcf05n00 mcfcli[3673891]: %3|1730690308.993|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:18:36 kjcf05n00 mcfcli[3673891]: %3|1730690316.923|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 21:19:06 kjcf05n00 mcfcli[3673891]: %3|1730690346.923|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:19:08 kjcf05n00 mcfcli[3673891]: %3|1730690348.990|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:19:36 kjcf05n00 mcfcli[3673891]: %3|1730690376.924|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:19:48 kjcf05n00 mcfcli[3673891]: %3|1730690388.987|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 21:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 21:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 21:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 21:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 21:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 21:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 21:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 21:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 21:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 21:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 21:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 21:20:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 21:20:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:20:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 21:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 21:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 21:20:06 kjcf05n00 mcfcli[3673891]: %3|1730690406.925|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:20:17 kjcf05n00 python3.9[1599923]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 21:20:26 kjcf05n00 mcfcli[3673891]: %3|1730690426.959|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:20:36 kjcf05n00 mcfcli[3673891]: %3|1730690436.925|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 21:21:05 kjcf05n00 mcfcli[3673891]: %3|1730690465.210|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:21:06 kjcf05n00 mcfcli[3673891]: %3|1730690466.925|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:21:36 kjcf05n00 mcfcli[3673891]: %3|1730690496.925|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:21:45 kjcf05n00 mcfcli[3673891]: %3|1730690505.206|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:22:06 kjcf05n00 mcfcli[3673891]: %3|1730690526.926|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:22:25 kjcf05n00 mcfcli[3673891]: %3|1730690545.203|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:22:36 kjcf05n00 mcfcli[3673891]: %3|1730690556.926|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:23:02 kjcf05n00 mcfcli[3673891]: %3|1730690582.898|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:23:06 kjcf05n00 mcfcli[3673891]: %3|1730690586.926|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 21:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T03:23:15.867976Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 21:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T03:23:15.868042Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.087ms Nov 3 21:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T21:23:27.25326352-06:00 level=info msg="Completed cleanup jobs" duration=26.474792ms Nov 3 21:23:36 kjcf05n00 mcfcli[3673891]: %3|1730690616.928|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:23:40 kjcf05n00 mcfcli[3673891]: %3|1730690620.544|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:24:06 kjcf05n00 mcfcli[3673891]: %3|1730690646.928|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:24:10 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 3 21:24:10 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 11 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007540 sec, idle for 1 hour(s)] Nov 3 21:24:17 kjcf05n00 mcfcli[3673891]: %3|1730690657.577|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:24:36 kjcf05n00 mcfcli[3673891]: %3|1730690676.928|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:24:57 kjcf05n00 mcfcli[3673891]: %3|1730690697.535|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:25:06 kjcf05n00 mcfcli[3673891]: %3|1730690706.928|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:25:17 kjcf05n00 python3.9[1602676]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 21:25:36 kjcf05n00 mcfcli[3673891]: %3|1730690736.929|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:25:37 kjcf05n00 mcfcli[3673891]: %3|1730690737.532|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:26:06 kjcf05n00 mcfcli[3673891]: %3|1730690766.929|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 21:26:15 kjcf05n00 mcfcli[3673891]: %3|1730690775.649|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:26:36 kjcf05n00 mcfcli[3673891]: %3|1730690796.930|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:26:55 kjcf05n00 mcfcli[3673891]: %3|1730690815.645|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:27:06 kjcf05n00 mcfcli[3673891]: %3|1730690826.930|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:27:32 kjcf05n00 mcfcli[3673891]: %3|1730690852.459|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:27:37 kjcf05n00 mcfcli[3673891]: %3|1730690857.430|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 21:28:07 kjcf05n00 mcfcli[3673891]: %3|1730690887.431|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 21:28:12 kjcf05n00 mcfcli[3673891]: %3|1730690892.300|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:28:37 kjcf05n00 mcfcli[3673891]: %3|1730690917.485|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 21:28:50 kjcf05n00 mcfcli[3673891]: %3|1730690930.227|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:29:07 kjcf05n00 mcfcli[3673891]: %3|1730690947.600|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 21:29:26 kjcf05n00 mcfcli[3673891]: %3|1730690966.589|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:29:37 kjcf05n00 mcfcli[3673891]: %3|1730690977.932|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 21:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 21:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 21:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 21:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 21:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 21:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 21:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 21:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 21:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 21:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 21:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 21:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 21:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 21:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 21:30:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 21:30:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:30:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 21:30:05 kjcf05n00 mcfcli[3673891]: %3|1730691005.703|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:30:07 kjcf05n00 mcfcli[3673891]: %3|1730691007.932|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:30:17 kjcf05n00 python3.9[1605534]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 21:30:37 kjcf05n00 mcfcli[3673891]: %3|1730691037.932|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 3 21:30:43 kjcf05n00 mcfcli[3673891]: %3|1730691043.788|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:31:07 kjcf05n00 mcfcli[3673891]: %3|1730691067.932|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:31:23 kjcf05n00 mcfcli[3673891]: %3|1730691083.252|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:31:37 kjcf05n00 mcfcli[3673891]: %3|1730691097.933|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:32:00 kjcf05n00 mcfcli[3673891]: %3|1730691120.865|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:32:07 kjcf05n00 mcfcli[3673891]: %3|1730691127.934|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:32:37 kjcf05n00 mcfcli[3673891]: %3|1730691157.934|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:32:40 kjcf05n00 mcfcli[3673891]: %3|1730691160.707|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:33:07 kjcf05n00 mcfcli[3673891]: %3|1730691187.935|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:33:19 kjcf05n00 mcfcli[3673891]: %3|1730691199.669|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T21:33:27.253109176-06:00 level=info msg="Completed cleanup jobs" duration=26.238439ms Nov 3 21:33:37 kjcf05n00 mcfcli[3673891]: %3|1730691217.935|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:33:59 kjcf05n00 mcfcli[3673891]: %3|1730691239.549|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:34:07 kjcf05n00 mcfcli[3673891]: %3|1730691247.937|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:34:37 kjcf05n00 mcfcli[3673891]: %3|1730691277.937|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:34:38 kjcf05n00 mcfcli[3673891]: %3|1730691278.998|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:35:07 kjcf05n00 mcfcli[3673891]: %3|1730691307.937|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:35:16 kjcf05n00 mcfcli[3673891]: %3|1730691316.262|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:35:23 kjcf05n00 python3.9[1608327]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 21:35:37 kjcf05n00 mcfcli[3673891]: %3|1730691337.937|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 3 21:35:56 kjcf05n00 mcfcli[3673891]: %3|1730691356.259|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:36:07 kjcf05n00 mcfcli[3673891]: %3|1730691367.937|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 3 21:36:31 kjcf05n00 mcfcli[3673891]: %3|1730691391.948|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:36:37 kjcf05n00 mcfcli[3673891]: %3|1730691397.938|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 3 21:37:07 kjcf05n00 mcfcli[3673891]: %3|1730691427.938|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 3 21:37:08 kjcf05n00 mcfcli[3673891]: %3|1730691428.507|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:37:37 kjcf05n00 mcfcli[3673891]: %3|1730691457.939|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 86 identical error(s) suppressed) Nov 3 21:37:48 kjcf05n00 mcfcli[3673891]: %3|1730691468.503|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:38:07 kjcf05n00 mcfcli[3673891]: %3|1730691487.939|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 87 identical error(s) suppressed) Nov 3 21:38:28 kjcf05n00 mcfcli[3673891]: %3|1730691508.500|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:38:37 kjcf05n00 mcfcli[3673891]: %3|1730691517.939|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 81 identical error(s) suppressed) Nov 3 21:39:07 kjcf05n00 mcfcli[3673891]: %3|1730691547.039|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:39:07 kjcf05n00 mcfcli[3673891]: %3|1730691547.940|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 67 identical error(s) suppressed) Nov 3 21:39:37 kjcf05n00 mcfcli[3673891]: %3|1730691577.941|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:39:43 kjcf05n00 mcfcli[3673891]: %3|1730691583.133|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 21:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 21:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 21:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 21:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 21:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 21:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 21:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 21:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 21:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 21:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 21:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 21:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 21:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 21:40:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 21:40:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:40:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 21:40:07 kjcf05n00 mcfcli[3673891]: %3|1730691607.941|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:40:17 kjcf05n00 python3.9[1611275]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 21:40:21 kjcf05n00 mcfcli[3673891]: %3|1730691621.205|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:40:37 kjcf05n00 mcfcli[3673891]: %3|1730691637.942|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 21:40:56 kjcf05n00 mcfcli[3673891]: %3|1730691656.644|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:41:07 kjcf05n00 mcfcli[3673891]: %3|1730691667.942|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 21:41:34 kjcf05n00 mcfcli[3673891]: %3|1730691694.426|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:41:37 kjcf05n00 mcfcli[3673891]: %3|1730691697.942|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:42:07 kjcf05n00 mcfcli[3673891]: %3|1730691727.943|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:42:12 kjcf05n00 mcfcli[3673891]: %3|1730691732.340|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:42:37 kjcf05n00 mcfcli[3673891]: %3|1730691757.944|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:42:50 kjcf05n00 mcfcli[3673891]: %3|1730691770.699|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:43:07 kjcf05n00 mcfcli[3673891]: %3|1730691787.944|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T21:43:27.253307848-06:00 level=info msg="Completed cleanup jobs" duration=26.652044ms Nov 3 21:43:28 kjcf05n00 mcfcli[3673891]: %3|1730691808.344|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:43:37 kjcf05n00 mcfcli[3673891]: %3|1730691817.944|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:44:07 kjcf05n00 mcfcli[3673891]: %3|1730691847.944|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:44:08 kjcf05n00 mcfcli[3673891]: %3|1730691848.341|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:44:37 kjcf05n00 mcfcli[3673891]: %3|1730691877.946|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:44:48 kjcf05n00 mcfcli[3673891]: %3|1730691888.338|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:45:07 kjcf05n00 mcfcli[3673891]: %3|1730691907.946|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:45:18 kjcf05n02 diskmonitor[17328]: leaving test state: 1 next state: 2 Nov 3 21:45:18 kjcf05n02 diskmonitor[17328]: lock req: no timeout Nov 3 21:45:18 kjcf05n02 diskmonitor[17328]: leaving test state: 2 next state: 4 Nov 3 21:45:17 kjcf05n00 python3.9[1614116]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 21:45:26 kjcf05n00 mcfcli[3673891]: %3|1730691926.964|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:45:37 kjcf05n00 mcfcli[3673891]: %3|1730691937.946|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 21:46:06 kjcf05n00 mcfcli[3673891]: %3|1730691966.961|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:46:07 kjcf05n00 mcfcli[3673891]: %3|1730691967.946|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 3 21:46:34 kjcf05n02 diskmonitor[17328]: lock acquired Nov 3 21:46:34 kjcf05n02 diskmonitor[17328]: leaving test state: 4 next state: 8 Nov 3 21:46:37 kjcf05n00 mcfcli[3673891]: %3|1730691997.946|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 3 21:46:46 kjcf05n00 mcfcli[3673891]: %3|1730692006.272|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:46:59 kjcf05n02 diskmonitor[17328]: Test selected disk: eui.345950304db010210025384500000004_S4YPNE0MB01021 Nov 3 21:46:59 kjcf05n02 diskmonitor[17328]: leaving test state: 8 next state: 20 Nov 3 21:46:59 kjcf05n02 diskmonitor[17328]: leaving test state: 20 next state: 40 Nov 3 21:46:59 kjcf05n02 diskmonitor[17328]: Test /dev/disk/by-id/nvme-eui.345950304db010210025384500000004_S4YPNE0MB01021, offset 155a98d0000 Nov 3 21:46:59 kjcf05n02 diskmonitor[17328]: leaving test state: 40 next state: 80 Nov 3 21:47:07 kjcf05n00 mcfcli[3673891]: %3|1730692027.946|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:47:18 kjcf05n00 mcfcli[3673891]: %3|1730692038.754|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:47:35 kjcf05n04 diskmonitor[39342]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 21:47:37 kjcf05n00 mcfcli[3673891]: %3|1730692057.947|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:47:57 kjcf05n00 mcfcli[3673891]: %3|1730692077.531|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:48:06 kjcf05n02 diskmonitor[17328]: leaving test state: 80 next state: 100 Nov 3 21:48:06 kjcf05n02 diskmonitor[17328]: lock release: time: Sun Nov 3 21:47:58 2024 Nov 3 21:48:06 kjcf05n02 diskmonitor[17328]: leaving test state: 100 next state: 1 Nov 3 21:48:07 kjcf05n00 mcfcli[3673891]: %3|1730692087.948|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:48:19 kjcf05n06 diskmonitor[19372]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 21:48:36 kjcf05n00 mcfcli[3673891]: %3|1730692116.181|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:48:37 kjcf05n00 mcfcli[3673891]: %3|1730692117.948|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:49:07 kjcf05n00 mcfcli[3673891]: %3|1730692147.949|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:49:14 kjcf05n07 diskmonitor[19063]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 21:49:14 kjcf05n00 mcfcli[3673891]: %3|1730692154.067|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:49:37 kjcf05n00 mcfcli[3673891]: %3|1730692177.949|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:49:40 kjcf05n05 diskmonitor[40540]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 21:49:51 kjcf05n00 mcfcli[3673891]: %3|1730692191.751|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 21:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 21:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 21:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 21:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 21:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 21:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 21:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 21:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 21:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 21:50:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 21:50:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:50:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 21:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 21:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 21:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 21:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 21:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 21:50:07 kjcf05n00 mcfcli[3673891]: %3|1730692207.949|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:50:18 kjcf05n00 python3.9[1616882]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 21:50:27 kjcf05n00 mcfcli[3673891]: %3|1730692227.808|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:50:37 kjcf05n00 mcfcli[3673891]: %3|1730692237.950|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 65 identical error(s) suppressed) Nov 3 21:51:04 kjcf05n00 mcfcli[3673891]: %3|1730692264.212|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:51:07 kjcf05n00 mcfcli[3673891]: %3|1730692267.951|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:51:37 kjcf05n00 mcfcli[3673891]: %3|1730692297.951|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:51:42 kjcf05n00 mcfcli[3673891]: %3|1730692302.330|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:52:07 kjcf05n00 mcfcli[3673891]: %3|1730692327.951|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:52:21 kjcf05n00 mcfcli[3673891]: %3|1730692341.566|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:52:37 kjcf05n00 mcfcli[3673891]: %3|1730692357.951|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:52:59 kjcf05n00 mcfcli[3673891]: %3|1730692379.767|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:53:07 kjcf05n00 mcfcli[3673891]: %3|1730692387.951|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T03:53:15.867473Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 21:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T03:53:15.867541Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.091ms Nov 3 21:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T21:53:27.276695585-06:00 level=info msg="Completed cleanup jobs" duration=49.889965ms Nov 3 21:53:37 kjcf05n00 mcfcli[3673891]: %3|1730692417.951|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 21:53:37 kjcf05n00 mcfcli[3673891]: %3|1730692417.998|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:54:07 kjcf05n00 mcfcli[3673891]: %3|1730692447.953|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 3 21:54:16 kjcf05n00 mcfcli[3673891]: %3|1730692456.830|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:54:37 kjcf05n00 mcfcli[3673891]: %3|1730692477.953|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:54:54 kjcf05n00 mcfcli[3673891]: %3|1730692494.725|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:55:07 kjcf05n00 mcfcli[3673891]: %3|1730692507.953|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:55:18 kjcf05n00 python3.9[1619838]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 21:55:33 kjcf05n00 mcfcli[3673891]: %3|1730692533.558|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:55:37 kjcf05n00 mcfcli[3673891]: %3|1730692537.953|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 21:56:07 kjcf05n00 mcfcli[3673891]: %3|1730692567.955|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:56:13 kjcf05n00 mcfcli[3673891]: %3|1730692573.555|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:56:37 kjcf05n00 mcfcli[3673891]: %3|1730692597.955|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:56:51 kjcf05n00 mcfcli[3673891]: %3|1730692611.802|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:57:07 kjcf05n00 mcfcli[3673891]: %3|1730692627.955|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:57:29 kjcf05n00 mcfcli[3673891]: %3|1730692649.893|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:57:37 kjcf05n00 mcfcli[3673891]: %3|1730692657.955|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 21:58:05 kjcf05n00 mcfcli[3673891]: %3|1730692685.982|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:58:07 kjcf05n00 mcfcli[3673891]: %3|1730692687.955|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 21:58:37 kjcf05n00 mcfcli[3673891]: %3|1730692717.956|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:58:44 kjcf05n00 mcfcli[3673891]: %3|1730692724.517|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:59:07 kjcf05n00 mcfcli[3673891]: %3|1730692747.956|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 21:59:23 kjcf05n00 mcfcli[3673891]: %3|1730692763.165|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 21:59:37 kjcf05n00 mcfcli[3673891]: %3|1730692777.956|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 22:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 22:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 22:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 22:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 22:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 22:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 22:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 22:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 22:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 22:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 22:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 22:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 22:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 22:00:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 22:00:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:00:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 22:00:01 kjcf05n00 mcfcli[3673891]: %3|1730692801.811|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:00:07 kjcf05n00 mcfcli[3673891]: %3|1730692807.956|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.106298Z lvl=info msg="TSI log compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=5 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=start Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.106311Z lvl=info msg="TSI log compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=8 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=start Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.106313Z lvl=info msg="TSI log compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=2 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=start Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.106332Z lvl=info msg="TSI log compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=4 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=start Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.106311Z lvl=info msg="TSI log compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=1 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=start Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.106311Z lvl=info msg="TSI log compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=3 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=start Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.106424Z lvl=info msg="TSI log compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=7 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=start Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.106311Z lvl=info msg="TSI log compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=6 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=start Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.108756Z lvl=info msg="Log file compacted" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=6 op_name=tsi1_compact_log_file tsi1_log_file_id=1 elapsed=2ms bytes=21386 kb_per_sec=8461 Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.108758Z lvl=info msg="Log file compacted" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=1 op_name=tsi1_compact_log_file tsi1_log_file_id=1 elapsed=2ms bytes=22547 kb_per_sec=8911 Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.108761Z lvl=info msg="Log file compacted" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=2 op_name=tsi1_compact_log_file tsi1_log_file_id=1 elapsed=2ms bytes=22586 kb_per_sec=8836 Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.108756Z lvl=info msg="Log file compacted" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=3 op_name=tsi1_compact_log_file tsi1_log_file_id=1 elapsed=2ms bytes=21009 kb_per_sec=8311 Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.108770Z lvl=info msg="Log file compacted" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=7 op_name=tsi1_compact_log_file tsi1_log_file_id=1 elapsed=2ms bytes=17152 kb_per_sec=7117 Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.108770Z lvl=info msg="Log file compacted" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=4 op_name=tsi1_compact_log_file tsi1_log_file_id=1 elapsed=2ms bytes=20057 kb_per_sec=7844 Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.108789Z lvl=info msg="TSI log compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=6 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=end op_elapsed=2.500ms Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.108796Z lvl=info msg="TSI log compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=1 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=end op_elapsed=2.507ms Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.108803Z lvl=info msg="TSI log compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=3 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=end op_elapsed=2.513ms Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.108760Z lvl=info msg="Log file compacted" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=8 op_name=tsi1_compact_log_file tsi1_log_file_id=1 elapsed=2ms bytes=24611 kb_per_sec=9718 Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.108802Z lvl=info msg="TSI log compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=2 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=end op_elapsed=2.535ms Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.108815Z lvl=info msg="Log file compacted" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=5 op_name=tsi1_compact_log_file tsi1_log_file_id=1 elapsed=2ms bytes=20960 kb_per_sec=8019 Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.108824Z lvl=info msg="TSI log compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=4 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=end op_elapsed=2.551ms Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.108825Z lvl=info msg="TSI log compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=7 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=end op_elapsed=2.408ms Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.108837Z lvl=info msg="TSI log compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=8 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=end op_elapsed=2.548ms Nov 3 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:00:10.108845Z lvl=info msg="TSI log compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=5 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=end op_elapsed=2.582ms Nov 3 22:00:18 kjcf05n00 python3.9[1622712]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 22:00:37 kjcf05n00 mcfcli[3673891]: %3|1730692837.958|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 22:00:39 kjcf05n00 mcfcli[3673891]: %3|1730692839.728|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:01:07 kjcf05n00 mcfcli[3673891]: %3|1730692867.958|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:01:18 kjcf05n00 mcfcli[3673891]: %3|1730692878.518|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:01:37 kjcf05n00 mcfcli[3673891]: %3|1730692897.958|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 22:01:50 kjcf05n00 mcfcli[3673891]: %3|1730692910.986|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:02:07 kjcf05n00 mcfcli[3673891]: %3|1730692927.958|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 3 22:02:29 kjcf05n00 mcfcli[3673891]: %3|1730692949.133|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:02:37 kjcf05n00 mcfcli[3673891]: %3|1730692957.959|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 3 22:03:05 kjcf05n00 mcfcli[3673891]: %3|1730692985.840|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:03:07 kjcf05n00 mcfcli[3673891]: %3|1730692987.959|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T22:03:27.254014664-06:00 level=info msg="Completed cleanup jobs" duration=27.485825ms Nov 3 22:03:37 kjcf05n00 mcfcli[3673891]: %3|1730693017.959|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:03:45 kjcf05n00 mcfcli[3673891]: %3|1730693025.837|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:04:07 kjcf05n00 mcfcli[3673891]: %3|1730693047.960|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:04:24 kjcf05n00 mcfcli[3673891]: %3|1730693064.763|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:04:37 kjcf05n00 mcfcli[3673891]: %3|1730693077.961|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:05:04 kjcf05n00 mcfcli[3673891]: %3|1730693104.760|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:05:07 kjcf05n00 mcfcli[3673891]: %3|1730693107.961|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:05:17 kjcf05n00 python3.9[1625513]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 22:05:37 kjcf05n00 mcfcli[3673891]: %3|1730693137.962|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 22:05:44 kjcf05n00 mcfcli[3673891]: %3|1730693144.757|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:06:07 kjcf05n00 mcfcli[3673891]: %3|1730693167.962|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:06:24 kjcf05n00 mcfcli[3673891]: %3|1730693184.754|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:06:37 kjcf05n00 mcfcli[3673891]: %3|1730693197.962|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:07:04 kjcf05n00 mcfcli[3673891]: %3|1730693224.435|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:07:07 kjcf05n00 mcfcli[3673891]: %3|1730693227.964|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:07:31 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 3 22:07:31 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 3 22:07:31 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 3 22:07:37 kjcf05n00 mcfcli[3673891]: %3|1730693257.964|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:07:41 kjcf05n00 mcfcli[3673891]: %3|1730693261.744|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:08:07 kjcf05n00 mcfcli[3673891]: %3|1730693287.964|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 3 22:08:19 kjcf05n00 mcfcli[3673891]: %3|1730693299.452|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:08:37 kjcf05n00 mcfcli[3673891]: %3|1730693317.965|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 3 22:08:59 kjcf05n00 mcfcli[3673891]: %3|1730693339.156|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:09:07 kjcf05n00 mcfcli[3673891]: %3|1730693347.965|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:09:16 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 22:09:16 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 22:09:16 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 22:09:36 kjcf05n00 mcfcli[3673891]: %3|1730693376.560|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:09:37 kjcf05n00 mcfcli[3673891]: %3|1730693377.966|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 22:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 22:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 22:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 22:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 22:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 22:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 22:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 22:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 22:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 22:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 22:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 22:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 22:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 22:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 22:10:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 22:10:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:10:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 22:10:07 kjcf05n00 mcfcli[3673891]: %3|1730693407.966|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:10:13 kjcf05n00 mcfcli[3673891]: %3|1730693413.148|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:10:23 kjcf05n00 python3.9[1628259]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 22:10:24 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 3 22:10:24 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 3 22:10:24 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 3 22:10:26 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 22:10:26 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 22:10:26 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 22:10:37 kjcf05n00 mcfcli[3673891]: %3|1730693437.966|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 22:10:45 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 3 22:10:47 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 3 22:10:53 kjcf05n00 mcfcli[3673891]: %3|1730693453.145|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:11:07 kjcf05n00 mcfcli[3673891]: %3|1730693467.966|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:11:12 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 3 22:11:12 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 3 22:11:20 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 3 22:11:20 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 3 22:11:33 kjcf05n00 mcfcli[3673891]: %3|1730693493.142|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:11:37 kjcf05n00 mcfcli[3673891]: %3|1730693497.966|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:12:07 kjcf05n00 mcfcli[3673891]: %3|1730693527.967|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:12:12 kjcf05n00 mcfcli[3673891]: %3|1730693532.273|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:12:37 kjcf05n00 mcfcli[3673891]: %3|1730693557.967|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:12:52 kjcf05n00 mcfcli[3673891]: %3|1730693572.270|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:13:07 kjcf05n00 mcfcli[3673891]: %3|1730693587.967|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T22:13:27.269836867-06:00 level=info msg="Completed cleanup jobs" duration=43.088517ms Nov 3 22:13:27 kjcf05n00 mcfcli[3673891]: %3|1730693607.669|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:13:37 kjcf05n00 mcfcli[3673891]: %3|1730693617.967|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 22:14:04 kjcf05n00 mcfcli[3673891]: %3|1730693644.838|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:14:07 kjcf05n00 mcfcli[3673891]: %3|1730693647.967|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:14:37 kjcf05n00 mcfcli[3673891]: %3|1730693677.967|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:14:43 kjcf05n00 mcfcli[3673891]: %3|1730693683.764|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:15:07 kjcf05n00 mcfcli[3673891]: %3|1730693707.968|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:15:18 kjcf05n00 python3.9[1631269]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 22:15:22 kjcf05n00 mcfcli[3673891]: %3|1730693722.427|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:15:37 kjcf05n00 mcfcli[3673891]: %3|1730693737.968|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 22:16:00 kjcf05n00 mcfcli[3673891]: %3|1730693760.268|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:16:07 kjcf05n00 mcfcli[3673891]: %3|1730693767.968|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:16:37 kjcf05n00 mcfcli[3673891]: %3|1730693797.968|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:16:39 kjcf05n00 mcfcli[3673891]: %3|1730693799.827|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:17:07 kjcf05n00 mcfcli[3673891]: %3|1730693827.969|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:17:17 kjcf05n00 mcfcli[3673891]: %3|1730693837.768|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:17:37 kjcf05n00 mcfcli[3673891]: %3|1730693857.969|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 22:17:54 kjcf05n00 mcfcli[3673891]: %3|1730693874.079|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:18:07 kjcf05n00 mcfcli[3673891]: %3|1730693887.970|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:18:34 kjcf05n00 mcfcli[3673891]: %3|1730693914.076|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:18:37 kjcf05n00 mcfcli[3673891]: %3|1730693917.971|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:19:07 kjcf05n00 mcfcli[3673891]: %3|1730693947.971|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:19:13 kjcf05n00 mcfcli[3673891]: %3|1730693953.429|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:19:37 kjcf05n00 mcfcli[3673891]: %3|1730693977.971|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:19:53 kjcf05n00 mcfcli[3673891]: %3|1730693993.426|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 22:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 22:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 22:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 22:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 22:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 22:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 22:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 22:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 22:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 22:20:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 22:20:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:20:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 22:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 22:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 22:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 22:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 22:20:07 kjcf05n00 mcfcli[3673891]: %3|1730694007.971|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:20:18 kjcf05n00 python3.9[1634102]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 22:20:32 kjcf05n00 mcfcli[3673891]: %3|1730694032.414|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:20:37 kjcf05n00 mcfcli[3673891]: %3|1730694037.971|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 22:21:07 kjcf05n00 mcfcli[3673891]: %3|1730694067.973|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:21:10 kjcf05n00 mcfcli[3673891]: %3|1730694070.168|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:21:37 kjcf05n00 mcfcli[3673891]: %3|1730694097.973|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:21:48 kjcf05n00 mcfcli[3673891]: %3|1730694108.328|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:22:07 kjcf05n00 mcfcli[3673891]: %3|1730694127.973|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 22:22:26 kjcf05n00 mcfcli[3673891]: %3|1730694146.515|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:22:37 kjcf05n00 mcfcli[3673891]: %3|1730694157.974|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 3 22:23:05 kjcf05n00 mcfcli[3673891]: %3|1730694185.768|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:23:07 kjcf05n00 mcfcli[3673891]: %3|1730694187.974|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 3 22:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:23:15.868216Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 22:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:23:15.868306Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.114ms Nov 3 22:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T22:23:27.267946466-06:00 level=info msg="Completed cleanup jobs" duration=41.171547ms Nov 3 22:23:37 kjcf05n00 mcfcli[3673891]: %3|1730694217.974|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:23:45 kjcf05n00 mcfcli[3673891]: %3|1730694225.765|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:24:07 kjcf05n00 mcfcli[3673891]: %3|1730694247.975|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:24:10 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 3 22:24:10 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 13 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.008191 sec, idle for 1 hour(s)] Nov 3 22:24:22 kjcf05n00 mcfcli[3673891]: %3|1730694262.607|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:24:37 kjcf05n00 mcfcli[3673891]: %3|1730694277.975|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:24:58 kjcf05n00 mcfcli[3673891]: %3|1730694298.861|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:25:07 kjcf05n00 mcfcli[3673891]: %3|1730694307.976|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 22:25:18 kjcf05n00 python3.9[1636977]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 22:25:37 kjcf05n00 mcfcli[3673891]: %3|1730694337.751|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:25:38 kjcf05n00 mcfcli[3673891]: %3|1730694338.475|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 65 identical error(s) suppressed) Nov 3 22:26:08 kjcf05n00 mcfcli[3673891]: %3|1730694368.475|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 22:26:13 kjcf05n00 mcfcli[3673891]: %3|1730694373.734|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:26:38 kjcf05n00 mcfcli[3673891]: %3|1730694398.476|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:26:52 kjcf05n00 mcfcli[3673891]: %3|1730694412.256|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:27:08 kjcf05n00 mcfcli[3673891]: %3|1730694428.476|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:27:31 kjcf05n00 mcfcli[3673891]: %3|1730694451.528|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:27:38 kjcf05n00 mcfcli[3673891]: %3|1730694458.476|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 22:28:08 kjcf05n00 mcfcli[3673891]: %3|1730694488.476|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:28:09 kjcf05n00 mcfcli[3673891]: %3|1730694489.658|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:28:38 kjcf05n00 mcfcli[3673891]: %3|1730694518.477|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:28:49 kjcf05n00 mcfcli[3673891]: %3|1730694529.655|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:29:08 kjcf05n00 mcfcli[3673891]: %3|1730694548.977|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 65 identical error(s) suppressed) Nov 3 22:29:27 kjcf05n00 mcfcli[3673891]: %3|1730694567.819|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:29:38 kjcf05n00 mcfcli[3673891]: %3|1730694578.978|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 22:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 22:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 22:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 22:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 22:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 22:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 22:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 22:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 22:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 22:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 22:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 22:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 22:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 22:30:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 22:30:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:30:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 22:30:06 kjcf05n00 mcfcli[3673891]: %3|1730694606.069|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:30:08 kjcf05n00 mcfcli[3673891]: %3|1730694608.978|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:30:18 kjcf05n00 python3.9[1639804]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 22:30:38 kjcf05n00 mcfcli[3673891]: %3|1730694638.978|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 22:30:45 kjcf05n00 mcfcli[3673891]: %3|1730694645.223|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:31:08 kjcf05n00 mcfcli[3673891]: %3|1730694668.978|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:31:25 kjcf05n00 mcfcli[3673891]: %3|1730694685.220|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:31:38 kjcf05n00 mcfcli[3673891]: %3|1730694698.979|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:32:05 kjcf05n00 mcfcli[3673891]: %3|1730694725.217|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:32:08 kjcf05n00 mcfcli[3673891]: %3|1730694728.979|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:32:38 kjcf05n00 mcfcli[3673891]: %3|1730694758.979|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:32:44 kjcf05n00 mcfcli[3673891]: %3|1730694764.100|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:33:08 kjcf05n00 mcfcli[3673891]: %3|1730694788.979|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:33:21 kjcf05n00 mcfcli[3673891]: %3|1730694801.412|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:33:26 kjcf05n02 nslcd[6896]: [90cde7] ldap_result() failed: Can't contact LDAP server Nov 3 22:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T22:33:27.254180133-06:00 level=info msg="Completed cleanup jobs" duration=27.261726ms Nov 3 22:33:38 kjcf05n00 mcfcli[3673891]: %3|1730694818.980|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:34:00 kjcf05n00 mcfcli[3673891]: %3|1730694840.579|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:34:08 kjcf05n00 mcfcli[3673891]: %3|1730694848.981|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:34:38 kjcf05n00 mcfcli[3673891]: %3|1730694878.981|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:34:39 kjcf05n00 mcfcli[3673891]: %3|1730694879.863|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:35:08 kjcf05n00 mcfcli[3673891]: %3|1730694908.981|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 22:35:16 kjcf05n00 mcfcli[3673891]: %3|1730694916.466|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:35:18 kjcf05n00 python3.9[1642670]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 22:35:38 kjcf05n00 mcfcli[3673891]: %3|1730694938.982|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:35:52 kjcf05n00 mcfcli[3673891]: %3|1730694952.401|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:36:08 kjcf05n00 mcfcli[3673891]: %3|1730694968.982|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:36:30 kjcf05n00 mcfcli[3673891]: %3|1730694990.762|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:36:38 kjcf05n00 mcfcli[3673891]: %3|1730694998.984|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:37:08 kjcf05n00 mcfcli[3673891]: %3|1730695028.357|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:37:08 kjcf05n00 mcfcli[3673891]: %3|1730695028.984|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 22:37:38 kjcf05n00 mcfcli[3673891]: %3|1730695058.984|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 3 22:37:47 kjcf05n00 mcfcli[3673891]: %3|1730695067.946|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:38:08 kjcf05n00 mcfcli[3673891]: %3|1730695088.985|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 22:38:25 kjcf05n00 mcfcli[3673891]: %3|1730695105.628|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:38:38 kjcf05n00 mcfcli[3673891]: %3|1730695118.985|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:39:01 kjcf05n00 mcfcli[3673891]: %3|1730695141.056|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:39:08 kjcf05n00 mcfcli[3673891]: %3|1730695148.985|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:39:38 kjcf05n00 mcfcli[3673891]: %3|1730695178.869|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:39:38 kjcf05n00 mcfcli[3673891]: %3|1730695178.986|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 22:39:46 kjcf05n03 diskmonitor[17871]: leaving test state: 1 next state: 2 Nov 3 22:39:46 kjcf05n03 diskmonitor[17871]: lock req: no timeout Nov 3 22:39:46 kjcf05n03 diskmonitor[17871]: leaving test state: 2 next state: 4 Nov 3 22:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 22:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 22:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 22:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 22:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 22:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 22:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 22:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 22:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 22:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 22:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 22:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 22:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 22:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 22:40:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 22:40:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:40:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 22:40:09 kjcf05n00 mcfcli[3673891]: %3|1730695209.487|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 22:40:17 kjcf05n00 mcfcli[3673891]: %3|1730695217.207|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:40:19 kjcf05n00 python3.9[1645456]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 22:40:39 kjcf05n03 diskmonitor[17871]: lock acquired Nov 3 22:40:39 kjcf05n03 diskmonitor[17871]: leaving test state: 4 next state: 8 Nov 3 22:40:39 kjcf05n00 mcfcli[3673891]: %3|1730695239.987|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 65 identical error(s) suppressed) Nov 3 22:40:49 kjcf05n03 diskmonitor[17871]: Test selected disk: eui.345950304db010210025384500000004_S4YPNE0MB01021 Nov 3 22:40:49 kjcf05n03 diskmonitor[17871]: leaving test state: 8 next state: 20 Nov 3 22:40:49 kjcf05n03 diskmonitor[17871]: leaving test state: 20 next state: 40 Nov 3 22:40:49 kjcf05n03 diskmonitor[17871]: Test /dev/disk/by-id/nvme-eui.345950304db010210025384500000004_S4YPNE0MB01021, offset 341dcbb0000 Nov 3 22:40:49 kjcf05n03 diskmonitor[17871]: leaving test state: 40 next state: 80 Nov 3 22:40:55 kjcf05n00 mcfcli[3673891]: %3|1730695255.974|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:41:09 kjcf05n00 mcfcli[3673891]: %3|1730695269.987|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 3 22:41:32 kjcf05n00 mcfcli[3673891]: %3|1730695292.358|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:41:39 kjcf05n00 mcfcli[3673891]: %3|1730695299.987|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:41:49 kjcf05n03 diskmonitor[17871]: leaving test state: 80 next state: 100 Nov 3 22:41:49 kjcf05n03 diskmonitor[17871]: lock release: time: Sun Nov 3 22:41:43 2024 Nov 3 22:41:49 kjcf05n03 diskmonitor[17871]: leaving test state: 100 next state: 1 Nov 3 22:42:09 kjcf05n00 mcfcli[3673891]: %3|1730695329.987|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:42:11 kjcf05n00 mcfcli[3673891]: %3|1730695331.290|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:42:39 kjcf05n00 mcfcli[3673891]: %3|1730695359.988|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:42:51 kjcf05n00 mcfcli[3673891]: %3|1730695371.287|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:43:09 kjcf05n00 mcfcli[3673891]: %3|1730695389.989|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 22:43:26 kjcf05n00 mcfcli[3673891]: %3|1730695406.531|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T22:43:27.252992771-06:00 level=info msg="Completed cleanup jobs" duration=26.350879ms Nov 3 22:43:39 kjcf05n00 mcfcli[3673891]: %3|1730695419.989|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 3 22:44:06 kjcf05n00 mcfcli[3673891]: %3|1730695446.140|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:44:09 kjcf05n00 mcfcli[3673891]: %3|1730695449.989|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 22:44:39 kjcf05n00 mcfcli[3673891]: %3|1730695479.989|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:44:44 kjcf05n00 mcfcli[3673891]: %3|1730695484.590|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:45:09 kjcf05n00 mcfcli[3673891]: %3|1730695509.989|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:45:18 kjcf05n00 python3.9[1648306]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 22:45:23 kjcf05n00 mcfcli[3673891]: %3|1730695523.479|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:45:39 kjcf05n00 mcfcli[3673891]: %3|1730695539.989|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 3 22:46:02 kjcf05n00 mcfcli[3673891]: %3|1730695562.953|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:46:09 kjcf05n00 mcfcli[3673891]: %3|1730695569.990|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 3 22:46:39 kjcf05n00 mcfcli[3673891]: %3|1730695599.991|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 22:46:40 kjcf05n00 mcfcli[3673891]: %3|1730695600.775|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:47:09 kjcf05n00 mcfcli[3673891]: %3|1730695629.991|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:47:18 kjcf05n00 mcfcli[3673891]: %3|1730695638.367|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:47:39 kjcf05n00 mcfcli[3673891]: %3|1730695659.992|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:47:58 kjcf05n00 mcfcli[3673891]: %3|1730695678.027|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:48:09 kjcf05n00 mcfcli[3673891]: %3|1730695689.992|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 3 22:48:38 kjcf05n00 mcfcli[3673891]: %3|1730695718.024|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:48:39 kjcf05n00 mcfcli[3673891]: %3|1730695719.993|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 3 22:49:09 kjcf05n00 mcfcli[3673891]: %3|1730695749.993|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 22:49:17 kjcf05n00 mcfcli[3673891]: %3|1730695757.385|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:49:39 kjcf05n00 mcfcli[3673891]: %3|1730695779.994|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 3 22:49:56 kjcf05n00 mcfcli[3673891]: %3|1730695796.474|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 22:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 22:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 22:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 22:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 22:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 22:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 22:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 22:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 22:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 22:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 22:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 22:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 22:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 22:50:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 22:50:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 22:50:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 22:50:09 kjcf05n00 mcfcli[3673891]: %3|1730695809.995|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 3 22:50:18 kjcf05n00 python3.9[1651248]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 22:50:34 kjcf05n00 mcfcli[3673891]: %3|1730695834.405|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:50:39 kjcf05n00 mcfcli[3673891]: %3|1730695839.995|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 22:51:09 kjcf05n00 mcfcli[3673891]: %3|1730695869.995|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:51:13 kjcf05n00 mcfcli[3673891]: %3|1730695873.638|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:51:39 kjcf05n00 mcfcli[3673891]: %3|1730695899.996|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:51:50 kjcf05n00 mcfcli[3673891]: %3|1730695910.810|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:52:09 kjcf05n00 mcfcli[3673891]: %3|1730695929.997|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 22:52:12 kjcf05n00 RFSF-API[8976]: INFO[2024-11-03T22:52:12-06:00] Checking for stale sessions... Nov 3 22:52:12 kjcf05n00 dp-api-server[8976]: INFO[2024-11-03T22:52:12-06:00] Checking for stale sessions... Nov 3 22:52:27 kjcf05n00 mcfcli[3673891]: %3|1730695947.088|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:52:39 kjcf05n00 mcfcli[3673891]: %3|1730695959.998|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:53:04 kjcf05n00 mcfcli[3673891]: %3|1730695984.540|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:53:09 kjcf05n00 mcfcli[3673891]: %3|1730695989.998|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 3 22:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:53:15.867558Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 22:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T04:53:15.867633Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.103ms Nov 3 22:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T22:53:27.261877244-06:00 level=info msg="Completed cleanup jobs" duration=35.488101ms Nov 3 22:53:39 kjcf05n00 mcfcli[3673891]: %3|1730696019.998|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 22:53:42 kjcf05n00 mcfcli[3673891]: %3|1730696022.662|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:54:09 kjcf05n00 mcfcli[3673891]: %3|1730696049.999|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:54:21 kjcf05n00 mcfcli[3673891]: %3|1730696061.413|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:54:40 kjcf05n00 mcfcli[3673891]: %3|1730696080.000|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:55:00 kjcf05n00 mcfcli[3673891]: %3|1730696100.973|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:55:10 kjcf05n00 mcfcli[3673891]: %3|1730696110.500|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:55:21 kjcf05n00 python3.9[1653996]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 22:55:37 kjcf05n00 mcfcli[3673891]: %3|1730696137.174|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:55:41 kjcf05n00 mcfcli[3673891]: %3|1730696141.000|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 66 identical error(s) suppressed) Nov 3 22:56:11 kjcf05n00 mcfcli[3673891]: %3|1730696171.000|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:56:14 kjcf05n00 mcfcli[3673891]: %3|1730696174.398|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:56:41 kjcf05n00 mcfcli[3673891]: %3|1730696201.000|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 22:56:50 kjcf05n00 mcfcli[3673891]: %3|1730696210.465|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:57:11 kjcf05n00 mcfcli[3673891]: %3|1730696231.000|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:57:30 kjcf05n00 mcfcli[3673891]: %3|1730696250.007|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:57:41 kjcf05n00 mcfcli[3673891]: %3|1730696261.000|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 3 22:58:05 kjcf05n00 mcfcli[3673891]: %3|1730696285.782|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:58:11 kjcf05n00 mcfcli[3673891]: %3|1730696291.001|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:58:41 kjcf05n00 mcfcli[3673891]: %3|1730696321.001|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:58:43 kjcf05n00 mcfcli[3673891]: %3|1730696323.859|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:59:11 kjcf05n00 mcfcli[3673891]: %3|1730696351.001|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 22:59:19 kjcf05n00 mcfcli[3673891]: %3|1730696359.526|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 22:59:41 kjcf05n00 mcfcli[3673891]: %3|1730696381.001|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 3 22:59:58 kjcf05n00 mcfcli[3673891]: %3|1730696398.845|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 23:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 23:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 23:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 23:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 23:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 23:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 23:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 23:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 23:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 23:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 23:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 23:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 23:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 23:00:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 23:00:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:00:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 23:00:11 kjcf05n00 mcfcli[3673891]: %3|1730696411.001|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 23:00:18 kjcf05n00 python3.9[1656859]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 23:00:36 kjcf05n00 mcfcli[3673891]: %3|1730696436.816|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:00:41 kjcf05n00 mcfcli[3673891]: %3|1730696441.001|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:01:11 kjcf05n00 mcfcli[3673891]: %3|1730696471.002|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:01:16 kjcf05n00 mcfcli[3673891]: %3|1730696476.813|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:01:41 kjcf05n00 mcfcli[3673891]: %3|1730696501.002|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:01:56 kjcf05n00 mcfcli[3673891]: %3|1730696516.811|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:02:11 kjcf05n00 mcfcli[3673891]: %3|1730696531.002|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:02:35 kjcf05n00 mcfcli[3673891]: %3|1730696555.888|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:02:41 kjcf05n00 mcfcli[3673891]: %3|1730696561.004|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:03:11 kjcf05n00 mcfcli[3673891]: %3|1730696591.004|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:03:15 kjcf05n00 mcfcli[3673891]: %3|1730696595.885|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T23:03:27.267721212-06:00 level=info msg="Completed cleanup jobs" duration=41.259319ms Nov 3 23:03:41 kjcf05n00 mcfcli[3673891]: %3|1730696621.005|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:03:52 kjcf05n00 mcfcli[3673891]: %3|1730696632.959|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:04:11 kjcf05n00 mcfcli[3673891]: %3|1730696651.005|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 3 23:04:30 kjcf05n00 mcfcli[3673891]: %3|1730696670.713|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:04:41 kjcf05n00 mcfcli[3673891]: %3|1730696681.006|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:05:06 kjcf05n00 mcfcli[3673891]: %3|1730696706.535|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:05:11 kjcf05n00 mcfcli[3673891]: %3|1730696711.505|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 23:05:18 kjcf05n02 nslcd[6896]: [ef438d] ldap_result() failed: Can't contact LDAP server Nov 3 23:05:18 kjcf05n00 python3.9[1659695]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 23:05:41 kjcf05n00 mcfcli[3673891]: %3|1730696741.506|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 23:05:42 kjcf05n00 mcfcli[3673891]: %3|1730696742.915|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:06:11 kjcf05n00 mcfcli[3673891]: %3|1730696771.506|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:06:20 kjcf05n00 mcfcli[3673891]: %3|1730696780.135|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:06:41 kjcf05n00 mcfcli[3673891]: %3|1730696801.506|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:06:57 kjcf05n00 mcfcli[3673891]: %3|1730696817.210|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:07:11 kjcf05n00 mcfcli[3673891]: %3|1730696831.507|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 23:07:23 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 3 23:07:23 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 3 23:07:23 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 3 23:07:35 kjcf05n00 mcfcli[3673891]: %3|1730696855.044|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:07:41 kjcf05n00 mcfcli[3673891]: %3|1730696861.507|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 3 23:08:11 kjcf05n00 mcfcli[3673891]: %3|1730696891.508|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:08:11 kjcf05n00 mcfcli[3673891]: %3|1730696891.661|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:08:29 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 3 23:08:29 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 3 23:08:29 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 3 23:08:41 kjcf05n00 mcfcli[3673891]: %3|1730696921.508|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:08:50 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 3 23:08:51 kjcf05n00 mcfcli[3673891]: %3|1730696931.658|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:09:11 kjcf05n00 mcfcli[3673891]: %3|1730696951.508|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:09:17 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 3 23:09:17 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 3 23:09:29 kjcf05n00 mcfcli[3673891]: %3|1730696969.507|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:09:38 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 3 23:09:41 kjcf05n00 mcfcli[3673891]: %3|1730696981.508|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 23:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 23:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 23:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 23:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 23:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 23:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 23:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 23:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 23:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 23:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 23:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 23:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 23:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 23:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 23:10:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 23:10:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:10:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 23:10:06 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 3 23:10:06 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 3 23:10:07 kjcf05n00 mcfcli[3673891]: %3|1730697007.725|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:10:11 kjcf05n00 mcfcli[3673891]: %3|1730697011.508|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 23:10:11 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 3 23:10:11 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 3 23:10:11 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 3 23:10:18 kjcf05n00 python3.9[1662596]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 23:10:22 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 3 23:10:22 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 3 23:10:22 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 3 23:10:41 kjcf05n00 mcfcli[3673891]: %3|1730697041.509|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:10:45 kjcf05n00 mcfcli[3673891]: %3|1730697045.764|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:11:11 kjcf05n00 mcfcli[3673891]: %3|1730697071.509|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:11:23 kjcf05n00 mcfcli[3673891]: %3|1730697083.967|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:11:41 kjcf05n00 mcfcli[3673891]: %3|1730697101.509|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 3 23:12:03 kjcf05n00 mcfcli[3673891]: %3|1730697123.157|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:12:11 kjcf05n00 mcfcli[3673891]: %3|1730697131.509|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 3 23:12:41 kjcf05n00 mcfcli[3673891]: %3|1730697161.510|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:12:43 kjcf05n00 mcfcli[3673891]: %3|1730697163.154|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:13:11 kjcf05n00 mcfcli[3673891]: %3|1730697191.510|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:13:21 kjcf05n00 mcfcli[3673891]: %3|1730697201.295|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T23:13:27.26891039-06:00 level=info msg="Completed cleanup jobs" duration=42.327138ms Nov 3 23:13:41 kjcf05n00 mcfcli[3673891]: %3|1730697221.511|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:14:01 kjcf05n00 mcfcli[3673891]: %3|1730697241.292|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:14:12 kjcf05n00 mcfcli[3673891]: %3|1730697252.010|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:14:40 kjcf05n00 mcfcli[3673891]: %3|1730697280.323|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:14:41 kjcf05n01 chronyd[2671]: Selected source 172.16.2.1 Nov 3 23:14:42 kjcf05n00 mcfcli[3673891]: %3|1730697282.010|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:15:12 kjcf05n00 mcfcli[3673891]: %3|1730697312.011|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:15:15 kjcf05n00 mcfcli[3673891]: %3|1730697315.612|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:15:19 kjcf05n00 python3.9[1665450]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 23:15:42 kjcf05n00 mcfcli[3673891]: %3|1730697342.012|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:15:53 kjcf05n00 mcfcli[3673891]: %3|1730697353.389|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:16:12 kjcf05n00 mcfcli[3673891]: %3|1730697372.012|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:16:31 kjcf05n00 mcfcli[3673891]: %3|1730697391.746|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:16:42 kjcf05n00 mcfcli[3673891]: %3|1730697402.012|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:17:09 kjcf05n00 mcfcli[3673891]: %3|1730697429.649|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:17:12 kjcf05n00 mcfcli[3673891]: %3|1730697432.512|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:17:42 kjcf05n00 mcfcli[3673891]: %3|1730697462.513|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:17:48 kjcf05n00 mcfcli[3673891]: %3|1730697468.914|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:18:13 kjcf05n00 mcfcli[3673891]: %3|1730697493.014|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:18:27 kjcf05n00 mcfcli[3673891]: %3|1730697507.004|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:18:43 kjcf05n00 mcfcli[3673891]: %3|1730697523.014|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 23:19:03 kjcf05n00 mcfcli[3673891]: %3|1730697543.953|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:19:13 kjcf05n00 mcfcli[3673891]: %3|1730697553.015|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 23:19:42 kjcf05n00 mcfcli[3673891]: %3|1730697582.714|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:19:43 kjcf05n00 mcfcli[3673891]: %3|1730697583.515|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 65 identical error(s) suppressed) Nov 3 23:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 23:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 23:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 23:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 23:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 23:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 23:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 23:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 23:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 23:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 23:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 23:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 23:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 23:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 23:20:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 23:20:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:20:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 23:20:13 kjcf05n00 mcfcli[3673891]: %3|1730697613.515|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:20:19 kjcf05n00 python3.9[1668280]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 23:20:21 kjcf05n00 mcfcli[3673891]: %3|1730697621.175|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:20:43 kjcf05n00 mcfcli[3673891]: %3|1730697643.517|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:21:01 kjcf05n00 mcfcli[3673891]: %3|1730697661.172|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:21:14 kjcf05n00 mcfcli[3673891]: %3|1730697674.017|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:21:39 kjcf05n00 mcfcli[3673891]: %3|1730697699.314|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:21:44 kjcf05n00 mcfcli[3673891]: %3|1730697704.017|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:22:14 kjcf05n00 mcfcli[3673891]: %3|1730697734.017|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:22:18 kjcf05n00 mcfcli[3673891]: %3|1730697738.127|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:22:44 kjcf05n00 mcfcli[3673891]: %3|1730697764.017|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:22:55 kjcf05n00 mcfcli[3673891]: %3|1730697775.744|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:23:14 kjcf05n00 mcfcli[3673891]: %3|1730697794.018|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T05:23:15.868024Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 23:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T05:23:15.868086Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.083ms Nov 3 23:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T23:23:27.252505838-06:00 level=info msg="Completed cleanup jobs" duration=26.070044ms Nov 3 23:23:34 kjcf05n00 mcfcli[3673891]: %3|1730697814.977|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:23:44 kjcf05n00 mcfcli[3673891]: %3|1730697824.019|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 3 23:24:10 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 3 23:24:10 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 13 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007207 sec, idle for 1 hour(s)] Nov 3 23:24:12 kjcf05n00 mcfcli[3673891]: %3|1730697852.447|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:24:14 kjcf05n00 mcfcli[3673891]: %3|1730697854.019|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:24:44 kjcf05n00 mcfcli[3673891]: %3|1730697884.019|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 23:24:50 kjcf05n00 mcfcli[3673891]: %3|1730697890.525|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:25:14 kjcf05n00 mcfcli[3673891]: %3|1730697914.019|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 23:25:19 kjcf05n00 python3.9[1671227]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 23:25:30 kjcf05n00 mcfcli[3673891]: %3|1730697930.469|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:25:44 kjcf05n00 mcfcli[3673891]: %3|1730697944.019|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:26:06 kjcf05n00 mcfcli[3673891]: %3|1730697966.286|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:26:14 kjcf05n00 mcfcli[3673891]: %3|1730697974.019|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:26:44 kjcf05n00 mcfcli[3673891]: %3|1730698004.020|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:26:46 kjcf05n00 mcfcli[3673891]: %3|1730698006.283|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:27:14 kjcf05n00 mcfcli[3673891]: %3|1730698034.021|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:27:25 kjcf05n00 mcfcli[3673891]: %3|1730698045.182|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:27:44 kjcf05n00 mcfcli[3673891]: %3|1730698064.021|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:28:02 kjcf05n00 mcfcli[3673891]: %3|1730698082.871|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:28:14 kjcf05n00 mcfcli[3673891]: %3|1730698094.021|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:28:42 kjcf05n00 mcfcli[3673891]: %3|1730698122.445|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:28:44 kjcf05n00 mcfcli[3673891]: %3|1730698124.021|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:29:14 kjcf05n00 mcfcli[3673891]: %3|1730698154.021|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:29:22 kjcf05n00 mcfcli[3673891]: %3|1730698162.442|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:29:44 kjcf05n00 mcfcli[3673891]: %3|1730698184.022|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 23:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 23:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 23:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 23:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 23:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 23:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 23:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 23:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 23:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 23:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 23:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 23:30:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 23:30:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:30:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 23:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 23:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 23:30:02 kjcf05n00 mcfcli[3673891]: %3|1730698202.439|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:30:14 kjcf05n00 mcfcli[3673891]: %3|1730698214.023|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:30:20 kjcf05n00 python3.9[1674095]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 23:30:42 kjcf05n00 mcfcli[3673891]: %3|1730698242.436|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:30:44 kjcf05n00 mcfcli[3673891]: %3|1730698244.023|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:31:14 kjcf05n00 mcfcli[3673891]: %3|1730698274.023|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 3 23:31:19 kjcf05n00 mcfcli[3673891]: %3|1730698279.079|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:31:27 kjcf05n02 nslcd[6896]: [0e0f76] ldap_result() failed: Can't contact LDAP server Nov 3 23:31:44 kjcf05n00 mcfcli[3673891]: %3|1730698304.023|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:31:58 kjcf05n00 mcfcli[3673891]: %3|1730698318.143|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:32:14 kjcf05n00 mcfcli[3673891]: %3|1730698334.023|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:32:36 kjcf05n00 mcfcli[3673891]: %3|1730698356.778|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:32:44 kjcf05n00 mcfcli[3673891]: %3|1730698364.025|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:33:14 kjcf05n00 mcfcli[3673891]: %3|1730698394.025|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 23:33:14 kjcf05n00 mcfcli[3673891]: %3|1730698394.495|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T23:33:27.25324108-06:00 level=info msg="Completed cleanup jobs" duration=26.634671ms Nov 3 23:33:44 kjcf05n00 mcfcli[3673891]: %3|1730698424.025|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 3 23:33:52 kjcf05n00 mcfcli[3673891]: %3|1730698432.334|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:34:14 kjcf05n00 mcfcli[3673891]: %3|1730698454.025|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:34:30 kjcf05n00 mcfcli[3673891]: %3|1730698470.438|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:34:44 kjcf05n00 mcfcli[3673891]: %3|1730698484.025|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:35:09 kjcf05n00 mcfcli[3673891]: %3|1730698509.522|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:35:14 kjcf05n00 mcfcli[3673891]: %3|1730698514.025|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 3 23:35:19 kjcf05n00 python3.9[1676867]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 23:35:44 kjcf05n00 mcfcli[3673891]: %3|1730698544.025|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 3 23:35:49 kjcf05n00 mcfcli[3673891]: %3|1730698549.519|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:36:04 kjcf05n02 nslcd[6896]: [52255a] ldap_result() failed: Can't contact LDAP server Nov 3 23:36:14 kjcf05n00 mcfcli[3673891]: %3|1730698574.027|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 3 23:36:29 kjcf05n00 mcfcli[3673891]: %3|1730698589.516|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:36:34 kjcf05n02 diskmonitor[17328]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 3 23:36:44 kjcf05n00 mcfcli[3673891]: %3|1730698604.027|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 3 23:37:07 kjcf05n00 mcfcli[3673891]: %3|1730698627.554|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:37:14 kjcf05n00 mcfcli[3673891]: %3|1730698634.027|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 3 23:37:44 kjcf05n00 mcfcli[3673891]: %3|1730698664.027|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 23:37:46 kjcf05n00 mcfcli[3673891]: %3|1730698666.523|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:38:14 kjcf05n00 mcfcli[3673891]: %3|1730698694.028|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 23:38:22 kjcf05n00 mcfcli[3673891]: %3|1730698702.962|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:38:44 kjcf05n00 mcfcli[3673891]: %3|1730698724.028|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:39:00 kjcf05n00 mcfcli[3673891]: %3|1730698740.748|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:39:14 kjcf05n00 mcfcli[3673891]: %3|1730698754.029|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:39:38 kjcf05n00 mcfcli[3673891]: %3|1730698778.963|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:39:44 kjcf05n00 mcfcli[3673891]: %3|1730698784.029|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 23:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 23:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 23:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 23:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 23:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 23:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 23:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 23:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 23:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 23:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 23:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 23:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 23:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 23:40:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 23:40:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:40:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 23:40:14 kjcf05n00 mcfcli[3673891]: %3|1730698814.029|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:40:16 kjcf05n00 mcfcli[3673891]: %3|1730698816.777|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:40:20 kjcf05n00 python3.9[1679617]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 23:40:44 kjcf05n00 mcfcli[3673891]: %3|1730698844.029|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:40:56 kjcf05n00 mcfcli[3673891]: %3|1730698856.067|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:41:14 kjcf05n00 mcfcli[3673891]: %3|1730698874.029|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 3 23:41:35 kjcf05n00 mcfcli[3673891]: %3|1730698895.512|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:41:44 kjcf05n00 mcfcli[3673891]: %3|1730698904.029|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 3 23:42:13 kjcf05n00 mcfcli[3673891]: %3|1730698933.786|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:42:14 kjcf05n00 mcfcli[3673891]: %3|1730698934.030|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 3 23:42:44 kjcf05n00 mcfcli[3673891]: %3|1730698964.529|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:42:50 kjcf05n00 mcfcli[3673891]: %3|1730698970.659|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:43:14 kjcf05n00 mcfcli[3673891]: %3|1730698994.529|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 23:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T23:43:27.254812978-06:00 level=info msg="Completed cleanup jobs" duration=27.649712ms Nov 3 23:43:29 kjcf05n00 mcfcli[3673891]: %3|1730699009.053|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:43:44 kjcf05n00 mcfcli[3673891]: %3|1730699024.530|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 3 23:44:05 kjcf05n00 mcfcli[3673891]: %3|1730699045.326|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:44:14 kjcf05n00 mcfcli[3673891]: %3|1730699054.530|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:44:44 kjcf05n00 mcfcli[3673891]: %3|1730699084.530|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:44:45 kjcf05n00 mcfcli[3673891]: %3|1730699085.323|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:45:14 kjcf05n00 mcfcli[3673891]: %3|1730699114.531|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:45:19 kjcf05n00 python3.9[1682652]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 23:45:22 kjcf05n00 mcfcli[3673891]: %3|1730699122.931|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:45:44 kjcf05n00 mcfcli[3673891]: %3|1730699144.532|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:45:59 kjcf05n00 mcfcli[3673891]: %3|1730699159.842|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:46:15 kjcf05n00 mcfcli[3673891]: %3|1730699175.032|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:46:39 kjcf05n00 mcfcli[3673891]: %3|1730699199.712|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:46:45 kjcf05n00 mcfcli[3673891]: %3|1730699205.032|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:47:15 kjcf05n00 mcfcli[3673891]: %3|1730699235.033|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:47:16 kjcf05n00 mcfcli[3673891]: %3|1730699236.727|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:47:45 kjcf05n00 mcfcli[3673891]: %3|1730699265.033|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:47:55 kjcf05n00 mcfcli[3673891]: %3|1730699275.971|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:48:15 kjcf05n00 mcfcli[3673891]: %3|1730699295.035|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:48:33 kjcf05n00 mcfcli[3673891]: %3|1730699313.667|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:48:45 kjcf05n00 mcfcli[3673891]: %3|1730699325.533|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:49:12 kjcf05n00 mcfcli[3673891]: %3|1730699352.201|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:49:16 kjcf05n00 mcfcli[3673891]: %3|1730699356.036|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:49:46 kjcf05n00 mcfcli[3673891]: %3|1730699386.036|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 3 23:49:48 kjcf05n00 mcfcli[3673891]: %3|1730699388.068|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 3 23:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 3 23:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 3 23:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 3 23:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 3 23:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 3 23:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 3 23:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 3 23:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 3 23:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 3 23:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 3 23:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 3 23:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 3 23:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 3 23:50:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 3 23:50:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 3 23:50:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 3 23:50:16 kjcf05n00 mcfcli[3673891]: %3|1730699416.037|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 3 23:50:19 kjcf05n00 python3.9[1685427]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 23:50:28 kjcf05n00 mcfcli[3673891]: %3|1730699428.065|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:50:46 kjcf05n00 mcfcli[3673891]: %3|1730699446.038|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:51:04 kjcf05n00 mcfcli[3673891]: %3|1730699464.892|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:51:16 kjcf05n00 mcfcli[3673891]: %3|1730699476.039|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:51:44 kjcf05n00 mcfcli[3673891]: %3|1730699504.814|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:51:46 kjcf05n00 mcfcli[3673891]: %3|1730699506.535|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:52:16 kjcf05n00 mcfcli[3673891]: %3|1730699536.536|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:52:22 kjcf05n00 mcfcli[3673891]: %3|1730699542.023|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:52:47 kjcf05n00 mcfcli[3673891]: %3|1730699567.041|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:53:01 kjcf05n00 mcfcli[3673891]: %3|1730699581.228|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T05:53:15.868304Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 3 23:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T05:53:15.868377Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.095ms Nov 3 23:53:17 kjcf05n00 mcfcli[3673891]: %3|1730699597.042|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-03T23:53:27.253168075-06:00 level=info msg="Completed cleanup jobs" duration=26.779543ms Nov 3 23:53:40 kjcf05n00 mcfcli[3673891]: %3|1730699620.400|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:53:47 kjcf05n00 mcfcli[3673891]: %3|1730699627.042|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:54:17 kjcf05n00 mcfcli[3673891]: %3|1730699657.043|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:54:17 kjcf05n00 mcfcli[3673891]: %3|1730699657.852|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:54:47 kjcf05n00 mcfcli[3673891]: %3|1730699687.044|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:54:54 kjcf05n00 mcfcli[3673891]: %3|1730699694.541|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:55:17 kjcf05n00 mcfcli[3673891]: %3|1730699717.045|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 3 23:55:19 kjcf05n00 python3.9[1688252]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 3 23:55:32 kjcf05n00 mcfcli[3673891]: %3|1730699732.690|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:55:47 kjcf05n00 mcfcli[3673891]: %3|1730699747.046|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:56:11 kjcf05n00 mcfcli[3673891]: %3|1730699771.495|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:56:17 kjcf05n00 mcfcli[3673891]: %3|1730699777.047|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 3 23:56:47 kjcf05n00 mcfcli[3673891]: %3|1730699807.539|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:56:51 kjcf05n00 mcfcli[3673891]: %3|1730699811.492|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:57:18 kjcf05n00 mcfcli[3673891]: %3|1730699838.047|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:57:28 kjcf05n00 mcfcli[3673891]: %3|1730699848.665|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:57:48 kjcf05n00 mcfcli[3673891]: %3|1730699868.048|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 3 23:58:05 kjcf05n00 mcfcli[3673891]: %3|1730699885.597|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:58:18 kjcf05n00 mcfcli[3673891]: %3|1730699898.049|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:58:45 kjcf05n00 mcfcli[3673891]: %3|1730699925.594|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:58:48 kjcf05n00 mcfcli[3673891]: %3|1730699928.050|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:59:18 kjcf05n00 mcfcli[3673891]: %3|1730699958.052|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 3 23:59:24 kjcf05n00 mcfcli[3673891]: %3|1730699964.824|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 3 23:59:48 kjcf05n00 mcfcli[3673891]: %3|1730699988.540|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 4 00:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 00:00:00 kjcf05n05 systemd[1]: Started Discard unused blocks (verbose). Nov 4 00:00:00 kjcf05n05 systemd[1]: Starting update of the root trust anchor for DNSSEC validation in unbound... Nov 4 00:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 00:00:00 kjcf05n05 fstrim_wrapper[299584]: /WIBS/kjcf05n04:md1: 403.9 MiB (423448576 bytes) trimmed Nov 4 00:00:00 kjcf05n05 fstrim_wrapper[299584]: /mnt/persistent_ha_data: 72.6 MiB (76079104 bytes) trimmed Nov 4 00:00:00 kjcf05n05 systemd[1]: fstrim.service: Succeeded. Nov 4 00:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 00:00:00 kjcf05n07 systemd[1]: Starting update of the root trust anchor for DNSSEC validation in unbound... Nov 4 00:00:00 kjcf05n07 systemd[1]: Started Discard unused blocks (verbose). Nov 4 00:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 00:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 00:00:00 kjcf05n02 systemd[1]: Started Discard unused blocks (verbose). Nov 4 00:00:00 kjcf05n02 systemd[1]: Starting update of the root trust anchor for DNSSEC validation in unbound... Nov 4 00:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 00:00:00 kjcf05n02 fstrim[693415]: freezing md65 for fstrim Nov 4 00:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 00:00:00 kjcf05n06 systemd[1]: Started Discard unused blocks (verbose). Nov 4 00:00:00 kjcf05n06 systemd[1]: Starting update of the root trust anchor for DNSSEC validation in unbound... Nov 4 00:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 00:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 00:00:00 kjcf05n04 systemd[1]: Started Discard unused blocks (verbose). Nov 4 00:00:00 kjcf05n04 systemd[1]: Starting update of the root trust anchor for DNSSEC validation in unbound... Nov 4 00:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 00:00:00 kjcf05n04 fstrim_wrapper[122913]: /WIBS/kjcf05n04:md0: 403.9 MiB (423448576 bytes) trimmed Nov 4 00:00:00 kjcf05n04 fstrim_wrapper[122913]: /mnt/persistent_ha_data: 71.9 MiB (75386880 bytes) trimmed Nov 4 00:00:00 kjcf05n04 systemd[1]: fstrim.service: Succeeded. Nov 4 00:00:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 00:00:00 kjcf05n01 systemd[1]: Started Discard unused blocks (verbose). Nov 4 00:00:00 kjcf05n01 systemd[1]: Starting update of the root trust anchor for DNSSEC validation in unbound... Nov 4 00:00:00 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 00:00:00 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 00:00:00 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 00:00:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:00:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 00:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 00:00:00 kjcf05n03 systemd[1]: Starting update of the root trust anchor for DNSSEC validation in unbound... Nov 4 00:00:00 kjcf05n03 systemd[1]: Started Discard unused blocks (verbose). Nov 4 00:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 00:00:00 kjcf05n03 fstrim[550225]: freezing md66 for fstrim Nov 4 00:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 00:00:00 kjcf05n00 systemd[1]: Started Discard unused blocks (verbose). Nov 4 00:00:00 kjcf05n00 systemd[1]: Starting update of the root trust anchor for DNSSEC validation in unbound... Nov 4 00:00:00 kjcf05n00 systemd[1]: Starting "vmcore cleanup"... Nov 4 00:00:00 kjcf05n00 systemd[1]: clean_kdump.service: Succeeded. Nov 4 00:00:00 kjcf05n00 systemd[1]: Started "vmcore cleanup". Nov 4 00:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 00:00:01 kjcf05n00 fstrim_wrapper[1690895]: /mnt/mgmt: 10.1 GiB (10820866048 bytes) trimmed Nov 4 00:00:01 kjcf05n00 fstrim_wrapper[1690895]: /bkup: 23.9 MiB (25051136 bytes) trimmed Nov 4 00:00:01 kjcf05n00 fstrim_wrapper[1690895]: /boot: 0 B (0 bytes) trimmed Nov 4 00:00:01 kjcf05n00 systemd[1]: fstrim.service: Succeeded. Nov 4 00:00:02 kjcf05n02 nslcd[6896]: [ed7263] ldap_result() failed: Can't contact LDAP server Nov 4 00:00:02 kjcf05n00 mcfcli[3673891]: %3|1730700002.522|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:00:18 kjcf05n00 mcfcli[3673891]: %3|1730700018.540|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 4 00:00:19 kjcf05n00 python3.9[1691159]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 00:00:25 kjcf05n02 diskmonitor[17328]: reconstruction_policy: sync_action prev = resync current = frozen - md65 Nov 4 00:00:25 kjcf05n02 diskmonitor[17328]: Restore sync_speed_min (system) for md65 Nov 4 00:00:25 kjcf05n02 diskmonitor[17328]: Restore sync_speed_max (system) for md65 Nov 4 00:00:27 kjcf05n03 diskmonitor[17871]: reconstruction_policy: sync_action prev = resync current = frozen - md66 Nov 4 00:00:27 kjcf05n03 diskmonitor[17871]: Restore sync_speed_min (system) for md66 Nov 4 00:00:27 kjcf05n03 diskmonitor[17871]: Restore sync_speed_max (system) for md66 Nov 4 00:00:40 kjcf05n00 mcfcli[3673891]: %3|1730700040.384|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:00:47 kjcf05n01 fstrim_wrapper[3384898]: /mnt/nfsdata: 587.8 GiB (631123693568 bytes) trimmed Nov 4 00:00:47 kjcf05n01 fstrim_wrapper[3384898]: /bkup: 0 B (0 bytes) trimmed Nov 4 00:00:47 kjcf05n01 fstrim_wrapper[3384898]: /boot: 0 B (0 bytes) trimmed Nov 4 00:00:47 kjcf05n01 systemd[1]: fstrim.service: Succeeded. Nov 4 00:00:49 kjcf05n00 mcfcli[3673891]: %3|1730700049.054|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 4 00:01:19 kjcf05n00 mcfcli[3673891]: %3|1730700079.054|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:01:20 kjcf05n00 mcfcli[3673891]: %3|1730700080.381|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:01:49 kjcf05n00 mcfcli[3673891]: %3|1730700109.055|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:01:52 kjcf05n02 fstrim_wrapper[693404]: /data/kjcf05n03:md65: 15 TiB (16534203002880 bytes) trimmed Nov 4 00:01:52 kjcf05n02 fstrim_wrapper[693404]: /mnt/persistent_ha_data: 72.3 MiB (75792384 bytes) trimmed Nov 4 00:01:52 kjcf05n02 fstrim[696484]: thawing md65 after fstrim Nov 4 00:01:52 kjcf05n02 systemd[1]: fstrim.service: Succeeded. Nov 4 00:01:53 kjcf05n03 fstrim_wrapper[550215]: /data/kjcf05n03:md66: 15 TiB (16527689322496 bytes) trimmed Nov 4 00:01:53 kjcf05n03 fstrim_wrapper[550215]: /mnt/persistent_ha_data: 72.5 MiB (75964416 bytes) trimmed Nov 4 00:01:53 kjcf05n03 fstrim[553660]: thawing md66 after fstrim Nov 4 00:01:53 kjcf05n03 systemd[1]: fstrim.service: Succeeded. Nov 4 00:02:00 kjcf05n00 mcfcli[3673891]: %3|1730700120.378|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:02:19 kjcf05n00 mcfcli[3673891]: %3|1730700139.057|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:02:20 kjcf05n02 diskmonitor[17328]: reconstruction_policy: sync_action prev = frozen current = resync - md65 Nov 4 00:02:20 kjcf05n02 diskmonitor[17328]: Set sync_speed_min (10000) for md65 Nov 4 00:02:20 kjcf05n02 diskmonitor[17328]: Set sync_speed_max (200000) for md65 Nov 4 00:02:37 kjcf05n03 diskmonitor[17871]: reconstruction_policy: sync_action prev = frozen current = resync - md66 Nov 4 00:02:37 kjcf05n03 diskmonitor[17871]: Set sync_speed_min (10000) for md66 Nov 4 00:02:37 kjcf05n03 diskmonitor[17871]: Set sync_speed_max (200000) for md66 Nov 4 00:02:38 kjcf05n00 mcfcli[3673891]: %3|1730700158.087|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:02:49 kjcf05n00 mcfcli[3673891]: %3|1730700169.058|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 4 00:02:59 kjcf05n01 systemd[1]: unbound-anchor.service: Succeeded. Nov 4 00:02:59 kjcf05n01 systemd[1]: Started update of the root trust anchor for DNSSEC validation in unbound. Nov 4 00:03:17 kjcf05n00 mcfcli[3673891]: %3|1730700197.776|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:03:19 kjcf05n00 mcfcli[3673891]: %3|1730700199.059|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 4 00:03:26 kjcf05n02 systemd[1]: unbound-anchor.service: Succeeded. Nov 4 00:03:26 kjcf05n02 systemd[1]: Started update of the root trust anchor for DNSSEC validation in unbound. Nov 4 00:03:26 kjcf05n05 systemd[1]: unbound-anchor.service: Succeeded. Nov 4 00:03:26 kjcf05n05 systemd[1]: Started update of the root trust anchor for DNSSEC validation in unbound. Nov 4 00:03:27 kjcf05n06 systemd[1]: unbound-anchor.service: Succeeded. Nov 4 00:03:27 kjcf05n06 systemd[1]: Started update of the root trust anchor for DNSSEC validation in unbound. Nov 4 00:03:27 kjcf05n00 systemd[1]: unbound-anchor.service: Succeeded. Nov 4 00:03:27 kjcf05n00 systemd[1]: Started update of the root trust anchor for DNSSEC validation in unbound. Nov 4 00:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T00:03:27.268639113-06:00 level=info msg="Completed cleanup jobs" duration=41.73474ms Nov 4 00:03:28 kjcf05n03 systemd[1]: unbound-anchor.service: Succeeded. Nov 4 00:03:28 kjcf05n03 systemd[1]: Started update of the root trust anchor for DNSSEC validation in unbound. Nov 4 00:03:29 kjcf05n04 systemd[1]: unbound-anchor.service: Succeeded. Nov 4 00:03:29 kjcf05n04 systemd[1]: Started update of the root trust anchor for DNSSEC validation in unbound. Nov 4 00:03:29 kjcf05n07 systemd[1]: unbound-anchor.service: Succeeded. Nov 4 00:03:29 kjcf05n07 systemd[1]: Started update of the root trust anchor for DNSSEC validation in unbound. Nov 4 00:03:49 kjcf05n00 mcfcli[3673891]: %3|1730700229.059|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:03:55 kjcf05n00 mcfcli[3673891]: %3|1730700235.385|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:04:19 kjcf05n00 mcfcli[3673891]: %3|1730700259.542|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 4 00:04:32 kjcf05n00 mcfcli[3673891]: %3|1730700272.719|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:04:49 kjcf05n00 mcfcli[3673891]: %3|1730700289.543|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:05:10 kjcf05n00 mcfcli[3673891]: %3|1730700310.843|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:05:19 kjcf05n00 mcfcli[3673891]: %3|1730700319.544|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:05:25 kjcf05n00 python3.9[1694006]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 00:05:48 kjcf05n00 mcfcli[3673891]: %3|1730700348.471|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:05:49 kjcf05n00 mcfcli[3673891]: %3|1730700349.544|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 65 identical error(s) suppressed) Nov 4 00:06:20 kjcf05n00 mcfcli[3673891]: %3|1730700380.062|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 4 00:06:27 kjcf05n00 mcfcli[3673891]: %3|1730700387.964|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:06:50 kjcf05n00 mcfcli[3673891]: %3|1730700410.063|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:07:00 kjcf05n02 systemd[1]: Starting Generate a daily summary of process accounting... Nov 4 00:07:00 kjcf05n00 systemd[1]: Starting Generate a daily summary of process accounting... Nov 4 00:07:00 kjcf05n00 systemd[1]: sysstat-summary.service: Succeeded. Nov 4 00:07:00 kjcf05n00 systemd[1]: Started Generate a daily summary of process accounting. Nov 4 00:07:00 kjcf05n07 systemd[1]: Starting Generate a daily summary of process accounting... Nov 4 00:07:00 kjcf05n07 systemd[1]: sysstat-summary.service: Succeeded. Nov 4 00:07:00 kjcf05n07 systemd[1]: Started Generate a daily summary of process accounting. Nov 4 00:07:00 kjcf05n02 systemd[1]: sysstat-summary.service: Succeeded. Nov 4 00:07:00 kjcf05n02 systemd[1]: Started Generate a daily summary of process accounting. Nov 4 00:07:00 kjcf05n05 systemd[1]: Starting Generate a daily summary of process accounting... Nov 4 00:07:00 kjcf05n05 systemd[1]: sysstat-summary.service: Succeeded. Nov 4 00:07:00 kjcf05n05 systemd[1]: Started Generate a daily summary of process accounting. Nov 4 00:07:00 kjcf05n06 systemd[1]: Starting Generate a daily summary of process accounting... Nov 4 00:07:00 kjcf05n06 systemd[1]: sysstat-summary.service: Succeeded. Nov 4 00:07:00 kjcf05n06 systemd[1]: Started Generate a daily summary of process accounting. Nov 4 00:07:00 kjcf05n04 systemd[1]: Starting Generate a daily summary of process accounting... Nov 4 00:07:00 kjcf05n04 systemd[1]: sysstat-summary.service: Succeeded. Nov 4 00:07:00 kjcf05n04 systemd[1]: Started Generate a daily summary of process accounting. Nov 4 00:07:00 kjcf05n03 systemd[1]: Starting Generate a daily summary of process accounting... Nov 4 00:07:00 kjcf05n03 systemd[1]: sysstat-summary.service: Succeeded. Nov 4 00:07:00 kjcf05n03 systemd[1]: Started Generate a daily summary of process accounting. Nov 4 00:07:01 kjcf05n01 systemd[1]: Starting Generate a daily summary of process accounting... Nov 4 00:07:01 kjcf05n01 systemd[1]: sysstat-summary.service: Succeeded. Nov 4 00:07:01 kjcf05n01 systemd[1]: Started Generate a daily summary of process accounting. Nov 4 00:07:06 kjcf05n00 mcfcli[3673891]: %3|1730700426.636|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:07:20 kjcf05n00 mcfcli[3673891]: %3|1730700440.063|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:07:44 kjcf05n00 mcfcli[3673891]: %3|1730700464.875|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:07:50 kjcf05n00 mcfcli[3673891]: %3|1730700470.064|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:08:07 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 00:08:20 kjcf05n00 mcfcli[3673891]: %3|1730700500.066|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:08:24 kjcf05n00 mcfcli[3673891]: %3|1730700504.872|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:08:35 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 00:08:35 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 00:08:50 kjcf05n00 mcfcli[3673891]: %3|1730700530.067|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:09:01 kjcf05n00 mcfcli[3673891]: %3|1730700541.262|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:09:06 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 00:09:06 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 00:09:06 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 00:09:20 kjcf05n00 mcfcli[3673891]: %3|1730700560.067|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:09:41 kjcf05n00 mcfcli[3673891]: %3|1730700581.259|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:09:42 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 00:09:42 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 00:09:42 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 00:09:46 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 00:09:46 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 00:09:46 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 00:09:50 kjcf05n00 mcfcli[3673891]: %3|1730700590.068|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 00:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 00:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 00:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 00:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 00:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 00:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 00:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 00:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 00:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 00:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 00:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 00:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 00:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 00:10:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 00:10:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:10:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 00:10:17 kjcf05n00 mcfcli[3673891]: %3|1730700617.831|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:10:19 kjcf05n00 python3.9[1696828]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 00:10:20 kjcf05n00 mcfcli[3673891]: %3|1730700620.069|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 4 00:10:33 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 00:10:33 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 00:10:33 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 00:10:44 kjcf05n02 nslcd[6896]: [dcc233] ldap_result() failed: Can't contact LDAP server Nov 4 00:10:50 kjcf05n00 mcfcli[3673891]: %3|1730700650.547|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 4 00:10:57 kjcf05n00 mcfcli[3673891]: %3|1730700657.561|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:11:20 kjcf05n00 mcfcli[3673891]: %3|1730700680.547|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 4 00:11:36 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 00:11:37 kjcf05n00 mcfcli[3673891]: %3|1730700697.558|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:11:51 kjcf05n00 mcfcli[3673891]: %3|1730700711.071|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 4 00:12:04 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 00:12:04 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 00:12:17 kjcf05n00 mcfcli[3673891]: %3|1730700737.555|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:12:21 kjcf05n00 mcfcli[3673891]: %3|1730700741.072|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 4 00:12:51 kjcf05n00 mcfcli[3673891]: %3|1730700771.073|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 4 00:12:53 kjcf05n00 mcfcli[3673891]: %3|1730700773.834|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:13:21 kjcf05n00 mcfcli[3673891]: %3|1730700801.549|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 4 00:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T00:13:27.253710181-06:00 level=info msg="Completed cleanup jobs" duration=27.18972ms Nov 4 00:13:33 kjcf05n00 mcfcli[3673891]: %3|1730700813.093|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:13:52 kjcf05n00 mcfcli[3673891]: %3|1730700832.074|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 4 00:14:09 kjcf05n00 mcfcli[3673891]: %3|1730700849.389|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:14:22 kjcf05n00 mcfcli[3673891]: %3|1730700862.074|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:14:47 kjcf05n00 mcfcli[3673891]: %3|1730700887.422|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:14:52 kjcf05n00 mcfcli[3673891]: %3|1730700892.076|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:15:19 kjcf05n00 python3.9[1699675]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 00:15:22 kjcf05n00 mcfcli[3673891]: %3|1730700922.549|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 4 00:15:27 kjcf05n00 mcfcli[3673891]: %3|1730700927.419|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:15:53 kjcf05n00 mcfcli[3673891]: %3|1730700953.077|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 65 identical error(s) suppressed) Nov 4 00:16:07 kjcf05n00 mcfcli[3673891]: %3|1730700967.416|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:16:23 kjcf05n00 mcfcli[3673891]: %3|1730700983.078|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:16:44 kjcf05n00 mcfcli[3673891]: %3|1730701004.572|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:16:53 kjcf05n00 mcfcli[3673891]: %3|1730701013.551|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 4 00:17:23 kjcf05n00 mcfcli[3673891]: %3|1730701043.552|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 4 00:17:24 kjcf05n00 mcfcli[3673891]: %3|1730701044.569|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:17:54 kjcf05n00 mcfcli[3673891]: %3|1730701074.079|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:18:00 kjcf05n00 mcfcli[3673891]: %3|1730701080.623|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:18:22 kjcf05n07 fstrim_wrapper[130067]: /data/kjcf05n06:md1: 21.7 TiB (23803957485568 bytes) trimmed Nov 4 00:18:22 kjcf05n07 fstrim_wrapper[130067]: /WIBS/kjcf05n06:md1: 1.6 GiB (1722994688 bytes) trimmed Nov 4 00:18:22 kjcf05n07 fstrim_wrapper[130067]: /mnt/persistent_ha_data: 71 MiB (74424320 bytes) trimmed Nov 4 00:18:22 kjcf05n07 systemd[1]: fstrim.service: Succeeded. Nov 4 00:18:24 kjcf05n00 mcfcli[3673891]: %3|1730701104.081|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 4 00:18:40 kjcf05n00 mcfcli[3673891]: %3|1730701120.572|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:18:42 kjcf05n06 fstrim_wrapper[130604]: /data/kjcf05n06:md0: 22.1 TiB (24262991937536 bytes) trimmed Nov 4 00:18:42 kjcf05n06 fstrim_wrapper[130604]: /WIBS/kjcf05n06:md0: 1.6 GiB (1722994688 bytes) trimmed Nov 4 00:18:42 kjcf05n06 fstrim_wrapper[130604]: /mnt/persistent_ha_data: 72.9 MiB (76386304 bytes) trimmed Nov 4 00:18:42 kjcf05n06 systemd[1]: fstrim.service: Succeeded. Nov 4 00:18:54 kjcf05n00 mcfcli[3673891]: %3|1730701134.553|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 4 00:19:17 kjcf05n00 mcfcli[3673891]: %3|1730701157.003|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:19:25 kjcf05n00 mcfcli[3673891]: %3|1730701165.081|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 4 00:19:53 kjcf05n00 mcfcli[3673891]: %3|1730701193.282|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:19:55 kjcf05n00 mcfcli[3673891]: %3|1730701195.083|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 00:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 00:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 00:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 00:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 00:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 00:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 00:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 00:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 00:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 00:20:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 00:20:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:20:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 00:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 00:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 00:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 00:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 00:20:20 kjcf05n00 python3.9[1702661]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 00:20:25 kjcf05n00 mcfcli[3673891]: %3|1730701225.084|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 4 00:20:33 kjcf05n00 mcfcli[3673891]: %3|1730701233.024|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:20:55 kjcf05n00 mcfcli[3673891]: %3|1730701255.085|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:21:11 kjcf05n00 mcfcli[3673891]: %3|1730701271.653|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:21:25 kjcf05n00 mcfcli[3673891]: %3|1730701285.086|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:21:46 kjcf05n00 mcfcli[3673891]: %3|1730701306.043|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:21:55 kjcf05n00 mcfcli[3673891]: %3|1730701315.087|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 4 00:22:21 kjcf05n00 mcfcli[3673891]: %3|1730701341.435|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:22:25 kjcf05n00 mcfcli[3673891]: %3|1730701345.087|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:22:55 kjcf05n00 mcfcli[3673891]: %3|1730701375.554|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:22:59 kjcf05n00 mcfcli[3673891]: %3|1730701379.249|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T06:23:15.868222Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 00:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T06:23:15.868289Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.088ms Nov 4 00:23:25 kjcf05n00 mcfcli[3673891]: %3|1730701405.555|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T00:23:27.252790955-06:00 level=info msg="Completed cleanup jobs" duration=26.39378ms Nov 4 00:23:38 kjcf05n00 mcfcli[3673891]: %3|1730701418.667|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:23:55 kjcf05n00 mcfcli[3673891]: %3|1730701435.555|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:24:11 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 00:24:11 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 10 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.006988 sec, idle for 1 hour(s)] Nov 4 00:24:14 kjcf05n00 mcfcli[3673891]: %3|1730701454.060|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:24:25 kjcf05n00 mcfcli[3673891]: %3|1730701465.556|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 4 00:24:54 kjcf05n00 mcfcli[3673891]: %3|1730701494.057|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:24:56 kjcf05n00 mcfcli[3673891]: %3|1730701496.092|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 4 00:25:20 kjcf05n00 python3.9[1705418]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 00:25:26 kjcf05n00 mcfcli[3673891]: %3|1730701526.557|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 65 identical error(s) suppressed) Nov 4 00:25:33 kjcf05n00 mcfcli[3673891]: %3|1730701533.706|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:25:57 kjcf05n00 mcfcli[3673891]: %3|1730701557.092|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 4 00:26:12 kjcf05n00 mcfcli[3673891]: %3|1730701572.183|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:26:27 kjcf05n00 mcfcli[3673891]: %3|1730701587.093|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:26:50 kjcf05n00 mcfcli[3673891]: %3|1730701610.644|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:26:57 kjcf05n00 mcfcli[3673891]: %3|1730701617.095|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:27:27 kjcf05n00 mcfcli[3673891]: %3|1730701647.095|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:27:29 kjcf05n00 mcfcli[3673891]: %3|1730701649.609|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:27:57 kjcf05n00 mcfcli[3673891]: %3|1730701677.097|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 4 00:28:09 kjcf05n00 mcfcli[3673891]: %3|1730701689.108|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:28:27 kjcf05n00 mcfcli[3673891]: %3|1730701707.558|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 4 00:28:40 kjcf05n02 nslcd[6896]: [a7c4c9] ldap_result() failed: Can't contact LDAP server Nov 4 00:28:46 kjcf05n00 mcfcli[3673891]: %3|1730701726.632|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:28:57 kjcf05n00 mcfcli[3673891]: %3|1730701737.558|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 4 00:29:26 kjcf05n00 mcfcli[3673891]: %3|1730701766.457|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:29:27 kjcf05n00 mcfcli[3673891]: %3|1730701767.559|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:29:57 kjcf05n00 mcfcli[3673891]: %3|1730701797.559|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 00:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 00:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 00:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 00:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 00:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 00:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 00:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 00:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 00:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 00:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 00:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 00:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 00:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 00:30:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 00:30:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:30:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 00:30:05 kjcf05n00 mcfcli[3673891]: %3|1730701805.632|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:30:20 kjcf05n00 python3.9[1708245]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 00:30:27 kjcf05n00 mcfcli[3673891]: %3|1730701827.560|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 4 00:30:43 kjcf05n00 mcfcli[3673891]: %3|1730701843.646|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:30:57 kjcf05n00 mcfcli[3673891]: %3|1730701857.560|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:31:23 kjcf05n00 mcfcli[3673891]: %3|1730701883.643|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:31:27 kjcf05n00 mcfcli[3673891]: %3|1730701887.561|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:31:57 kjcf05n00 mcfcli[3673891]: %3|1730701917.561|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:32:01 kjcf05n00 mcfcli[3673891]: %3|1730701921.875|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:32:27 kjcf05n00 mcfcli[3673891]: %3|1730701947.562|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:32:35 kjcf05n00 mcfcli[3673891]: %3|1730701955.595|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:32:57 kjcf05n00 mcfcli[3673891]: %3|1730701977.562|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 61 identical error(s) suppressed) Nov 4 00:33:15 kjcf05n00 mcfcli[3673891]: %3|1730701995.592|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T00:33:27.252700916-06:00 level=info msg="Completed cleanup jobs" duration=26.189026ms Nov 4 00:33:27 kjcf05n00 mcfcli[3673891]: %3|1730702007.563|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 60 identical error(s) suppressed) Nov 4 00:33:49 kjcf05n00 mcfcli[3673891]: %3|1730702029.404|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:33:58 kjcf05n00 mcfcli[3673891]: %3|1730702038.105|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 4 00:34:28 kjcf05n00 mcfcli[3673891]: %3|1730702068.106|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:34:28 kjcf05n00 mcfcli[3673891]: %3|1730702068.265|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:34:58 kjcf05n00 mcfcli[3673891]: %3|1730702098.106|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:35:08 kjcf05n00 mcfcli[3673891]: %3|1730702108.171|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:35:20 kjcf05n00 python3.9[1711230]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 00:35:28 kjcf05n00 mcfcli[3673891]: %3|1730702128.107|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 65 identical error(s) suppressed) Nov 4 00:35:45 kjcf05n00 mcfcli[3673891]: %3|1730702145.032|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:35:58 kjcf05n00 mcfcli[3673891]: %3|1730702158.108|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:36:21 kjcf05n00 mcfcli[3673891]: %3|1730702181.516|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:36:28 kjcf05n00 mcfcli[3673891]: %3|1730702188.110|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:36:42 kjcf05n03 diskmonitor[17871]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 00:36:58 kjcf05n00 mcfcli[3673891]: %3|1730702218.110|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 4 00:36:59 kjcf05n00 mcfcli[3673891]: %3|1730702219.601|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:37:28 kjcf05n00 mcfcli[3673891]: %3|1730702248.111|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed) Nov 4 00:37:37 kjcf05n00 mcfcli[3673891]: %3|1730702257.734|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:37:58 kjcf05n00 mcfcli[3673891]: %3|1730702278.112|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:38:15 kjcf05n00 mcfcli[3673891]: %3|1730702295.547|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:38:28 kjcf05n00 mcfcli[3673891]: %3|1730702308.114|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:38:55 kjcf05n00 mcfcli[3673891]: %3|1730702335.544|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:38:58 kjcf05n00 mcfcli[3673891]: %3|1730702338.114|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:39:28 kjcf05n00 mcfcli[3673891]: %3|1730702368.115|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:39:32 kjcf05n00 mcfcli[3673891]: %3|1730702372.662|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:39:58 kjcf05n00 mcfcli[3673891]: %3|1730702398.115|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 4 00:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 00:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 00:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 00:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 00:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 00:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 00:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 00:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 00:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 00:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 00:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 00:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 00:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 00:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 00:40:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 00:40:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:40:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 00:40:12 kjcf05n00 mcfcli[3673891]: %3|1730702412.659|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:40:26 kjcf05n00 python3.9[1714039]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 00:40:28 kjcf05n00 mcfcli[3673891]: %3|1730702428.117|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 4 00:40:52 kjcf05n00 mcfcli[3673891]: %3|1730702452.450|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:40:58 kjcf05n00 mcfcli[3673891]: %3|1730702458.117|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 70 identical error(s) suppressed) Nov 4 00:41:28 kjcf05n00 mcfcli[3673891]: %3|1730702488.119|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 00:41:31 kjcf05n00 mcfcli[3673891]: %3|1730702491.099|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:41:58 kjcf05n00 mcfcli[3673891]: %3|1730702518.120|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 00:42:09 kjcf05n00 mcfcli[3673891]: %3|1730702529.773|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:42:28 kjcf05n00 mcfcli[3673891]: %3|1730702548.568|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 00:42:49 kjcf05n00 mcfcli[3673891]: %3|1730702569.770|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:42:58 kjcf05n00 mcfcli[3673891]: %3|1730702578.569|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 00:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T00:43:27.252584185-06:00 level=info msg="Completed cleanup jobs" duration=26.189808ms Nov 4 00:43:27 kjcf05n00 mcfcli[3673891]: %3|1730702607.822|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:43:28 kjcf05n00 mcfcli[3673891]: %3|1730702608.621|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 00:43:58 kjcf05n00 mcfcli[3673891]: %3|1730702638.621|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 00:44:07 kjcf05n00 mcfcli[3673891]: %3|1730702647.819|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:44:28 kjcf05n00 mcfcli[3673891]: %3|1730702668.623|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 00:44:46 kjcf05n00 mcfcli[3673891]: %3|1730702686.576|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:44:58 kjcf05n00 mcfcli[3673891]: %3|1730702698.623|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 00:45:20 kjcf05n00 python3.9[1716849]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 00:45:26 kjcf05n00 mcfcli[3673891]: %3|1730702726.573|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:45:28 kjcf05n00 mcfcli[3673891]: %3|1730702728.623|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 00:45:58 kjcf05n00 mcfcli[3673891]: %3|1730702758.623|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 00:46:03 kjcf05n00 mcfcli[3673891]: %3|1730702763.404|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:46:28 kjcf05n00 mcfcli[3673891]: %3|1730702788.624|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 00:46:42 kjcf05n00 mcfcli[3673891]: %3|1730702802.849|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:46:58 kjcf05n00 mcfcli[3673891]: %3|1730702818.625|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 00:47:19 kjcf05n00 mcfcli[3673891]: %3|1730702839.761|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:47:28 kjcf05n00 mcfcli[3673891]: %3|1730702848.626|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 00:47:39 kjcf05n01 chronyd[2671]: Selected source 16.110.135.123 Nov 4 00:47:57 kjcf05n00 mcfcli[3673891]: %3|1730702877.627|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:47:58 kjcf05n00 mcfcli[3673891]: %3|1730702878.626|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 00:48:28 kjcf05n00 mcfcli[3673891]: %3|1730702908.627|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 00:48:37 kjcf05n00 mcfcli[3673891]: %3|1730702917.624|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:48:46 kjcf05n06 chronyd[5469]: Selected source 172.16.2.1 Nov 4 00:48:58 kjcf05n00 mcfcli[3673891]: %3|1730702938.627|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 00:49:16 kjcf05n00 mcfcli[3673891]: %3|1730702956.446|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:49:28 kjcf05n00 mcfcli[3673891]: %3|1730702968.627|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 00:49:52 kjcf05n00 mcfcli[3673891]: %3|1730702992.989|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:49:58 kjcf05n00 mcfcli[3673891]: %3|1730702998.629|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 00:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 00:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 00:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 00:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 00:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 00:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 00:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 00:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 00:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 00:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 00:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 00:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 00:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 00:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 00:50:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 00:50:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 00:50:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 00:50:20 kjcf05n00 python3.9[1719629]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 00:50:28 kjcf05n00 mcfcli[3673891]: %3|1730703028.629|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 00:50:28 kjcf05n00 mcfcli[3673891]: %3|1730703028.708|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:50:58 kjcf05n00 mcfcli[3673891]: %3|1730703058.631|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 00:51:06 kjcf05n00 mcfcli[3673891]: %3|1730703066.177|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:51:28 kjcf05n00 mcfcli[3673891]: %3|1730703088.631|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 00:51:45 kjcf05n00 mcfcli[3673891]: %3|1730703105.814|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:51:58 kjcf05n00 mcfcli[3673891]: %3|1730703118.631|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 00:52:25 kjcf05n00 mcfcli[3673891]: %3|1730703145.811|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:52:28 kjcf05n00 mcfcli[3673891]: %3|1730703148.632|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 00:52:58 kjcf05n00 mcfcli[3673891]: %3|1730703178.633|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 00:53:05 kjcf05n00 mcfcli[3673891]: %3|1730703185.808|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T06:53:15.867621Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 00:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T06:53:15.867702Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.099ms Nov 4 00:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T00:53:27.261920877-06:00 level=info msg="Completed cleanup jobs" duration=35.520292ms Nov 4 00:53:28 kjcf05n00 mcfcli[3673891]: %3|1730703208.633|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 00:53:44 kjcf05n00 mcfcli[3673891]: %3|1730703224.195|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:53:58 kjcf05n00 mcfcli[3673891]: %3|1730703238.635|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 00:54:22 kjcf05n00 mcfcli[3673891]: %3|1730703262.048|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:54:28 kjcf05n00 mcfcli[3673891]: %3|1730703268.635|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 00:54:50 kjcf05n02 nslcd[6896]: [68079a] ldap_result() failed: Can't contact LDAP server Nov 4 00:54:58 kjcf05n00 mcfcli[3673891]: %3|1730703298.637|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 00:54:59 kjcf05n00 mcfcli[3673891]: %3|1730703299.998|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:55:20 kjcf05n00 python3.9[1722624]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 00:55:28 kjcf05n00 mcfcli[3673891]: %3|1730703328.637|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 00:55:35 kjcf05n00 mcfcli[3673891]: %3|1730703335.587|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:55:58 kjcf05n01 diskmonitor[1331407]: leaving test state: 1 next state: 2 Nov 4 00:55:58 kjcf05n01 diskmonitor[1331407]: lock req: no timeout Nov 4 00:55:58 kjcf05n01 diskmonitor[1331407]: leaving test state: 2 next state: 4 Nov 4 00:55:58 kjcf05n00 mcfcli[3673891]: %3|1730703358.638|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 00:56:12 kjcf05n00 mcfcli[3673891]: %3|1730703372.530|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:56:28 kjcf05n00 mcfcli[3673891]: %3|1730703388.638|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 00:56:50 kjcf05n00 mcfcli[3673891]: %3|1730703410.437|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:56:58 kjcf05n00 mcfcli[3673891]: %3|1730703418.639|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 00:57:05 kjcf05n01 diskmonitor[1331407]: lock acquired Nov 4 00:57:05 kjcf05n01 diskmonitor[1331407]: leaving test state: 4 next state: 8 Nov 4 00:57:19 kjcf05n01 diskmonitor[1331407]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 4 00:57:19 kjcf05n01 diskmonitor[1331407]: leaving test state: 8 next state: 20 Nov 4 00:57:19 kjcf05n01 diskmonitor[1331407]: leaving test state: 20 next state: 40 Nov 4 00:57:19 kjcf05n01 diskmonitor[1331407]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset d671c28000 Nov 4 00:57:19 kjcf05n01 diskmonitor[1331407]: leaving test state: 40 next state: 80 Nov 4 00:57:22 kjcf05n01 diskmonitor[1331407]: leaving test state: 80 next state: 100 Nov 4 00:57:22 kjcf05n01 diskmonitor[1331407]: lock release: time: Mon Nov 4 00:57:20 2024 Nov 4 00:57:22 kjcf05n01 diskmonitor[1331407]: leaving test state: 100 next state: 1 Nov 4 00:57:28 kjcf05n00 mcfcli[3673891]: %3|1730703448.639|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 00:57:30 kjcf05n00 mcfcli[3673891]: %3|1730703450.434|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:57:58 kjcf05n00 mcfcli[3673891]: %3|1730703478.639|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 00:58:05 kjcf05n00 mcfcli[3673891]: %3|1730703485.948|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:58:28 kjcf05n00 mcfcli[3673891]: %3|1730703508.640|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 00:58:42 kjcf05n00 mcfcli[3673891]: %3|1730703522.521|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:58:58 kjcf05n00 mcfcli[3673891]: %3|1730703538.642|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 00:59:20 kjcf05n00 mcfcli[3673891]: %3|1730703560.943|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 00:59:28 kjcf05n00 mcfcli[3673891]: %3|1730703568.642|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 00:59:58 kjcf05n00 mcfcli[3673891]: %3|1730703598.642|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 00:59:59 kjcf05n00 mcfcli[3673891]: %3|1730703599.723|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 01:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 01:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 01:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 01:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 01:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 01:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 01:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 01:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 01:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 01:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 01:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 01:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 01:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 01:00:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 01:00:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:00:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 01:00:20 kjcf05n00 python3.9[1725453]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 01:00:28 kjcf05n00 mcfcli[3673891]: %3|1730703628.643|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 01:00:37 kjcf05n00 mcfcli[3673891]: %3|1730703637.715|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:00:58 kjcf05n00 mcfcli[3673891]: %3|1730703658.644|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 01:01:12 kjcf05n00 mcfcli[3673891]: %3|1730703672.970|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:01:28 kjcf05n00 mcfcli[3673891]: %3|1730703688.644|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 01:01:50 kjcf05n00 mcfcli[3673891]: %3|1730703710.475|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:01:58 kjcf05n00 mcfcli[3673891]: %3|1730703718.646|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:02:28 kjcf05n00 mcfcli[3673891]: %3|1730703748.242|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:02:28 kjcf05n00 mcfcli[3673891]: %3|1730703748.646|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 01:02:58 kjcf05n00 mcfcli[3673891]: %3|1730703778.646|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:03:07 kjcf05n00 mcfcli[3673891]: %3|1730703787.311|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:03:07 kjcf05n00 diskmonitor[2758297]: leaving test state: 1 next state: 2 Nov 4 01:03:07 kjcf05n00 diskmonitor[2758297]: lock req: no timeout Nov 4 01:03:07 kjcf05n00 diskmonitor[2758297]: leaving test state: 2 next state: 4 Nov 4 01:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T01:03:27.252788603-06:00 level=info msg="Completed cleanup jobs" duration=26.325462ms Nov 4 01:03:28 kjcf05n00 mcfcli[3673891]: %3|1730703808.646|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:03:43 kjcf05n00 mcfcli[3673891]: %3|1730703823.300|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:03:58 kjcf05n00 mcfcli[3673891]: %3|1730703838.647|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:04:17 kjcf05n00 diskmonitor[2758297]: lock acquired Nov 4 01:04:17 kjcf05n00 diskmonitor[2758297]: leaving test state: 4 next state: 8 Nov 4 01:04:19 kjcf05n00 mcfcli[3673891]: %3|1730703859.636|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:04:28 kjcf05n00 mcfcli[3673891]: %3|1730703868.647|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 01:04:31 kjcf05n00 diskmonitor[2758297]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 4 01:04:31 kjcf05n00 diskmonitor[2758297]: leaving test state: 8 next state: 20 Nov 4 01:04:31 kjcf05n00 diskmonitor[2758297]: leaving test state: 20 next state: 40 Nov 4 01:04:31 kjcf05n00 diskmonitor[2758297]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset a49da28000 Nov 4 01:04:31 kjcf05n00 diskmonitor[2758297]: leaving test state: 40 next state: 80 Nov 4 01:04:58 kjcf05n00 mcfcli[3673891]: %3|1730703898.145|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:04:58 kjcf05n00 mcfcli[3673891]: %3|1730703898.648|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 01:05:20 kjcf05n00 python3.9[1728731]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 01:05:21 kjcf05n00 diskmonitor[2758297]: leaving test state: 80 next state: 100 Nov 4 01:05:21 kjcf05n00 diskmonitor[2758297]: lock release: time: Mon Nov 4 01:05:20 2024 Nov 4 01:05:21 kjcf05n00 diskmonitor[2758297]: leaving test state: 100 next state: 1 Nov 4 01:05:28 kjcf05n00 mcfcli[3673891]: %3|1730703928.648|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 01:05:36 kjcf05n00 mcfcli[3673891]: %3|1730703936.857|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:05:58 kjcf05n00 mcfcli[3673891]: %3|1730703958.649|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:06:10 kjcf05n02 chronyd[5105]: Selected source 16.110.135.123 Nov 4 01:06:15 kjcf05n00 mcfcli[3673891]: %3|1730703975.731|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:06:28 kjcf05n00 mcfcli[3673891]: %3|1730703988.650|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:06:55 kjcf05n00 mcfcli[3673891]: %3|1730704015.728|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:06:58 kjcf05n00 mcfcli[3673891]: %3|1730704018.650|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:07:27 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 01:07:27 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 01:07:27 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 01:07:28 kjcf05n00 mcfcli[3673891]: %3|1730704048.651|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:07:33 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 01:07:33 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 01:07:33 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 01:07:34 kjcf05n00 mcfcli[3673891]: %3|1730704054.113|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:07:58 kjcf05n00 mcfcli[3673891]: %3|1730704078.651|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 01:08:11 kjcf05n00 mcfcli[3673891]: %3|1730704091.422|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:08:28 kjcf05n00 mcfcli[3673891]: %3|1730704108.653|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:08:49 kjcf05n00 mcfcli[3673891]: %3|1730704129.437|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:08:58 kjcf05n00 mcfcli[3673891]: %3|1730704138.653|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 01:09:22 kjcf05n00 mcfcli[3673891]: %3|1730704162.880|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:09:28 kjcf05n00 mcfcli[3673891]: %3|1730704168.654|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:09:58 kjcf05n00 mcfcli[3673891]: %3|1730704198.654|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 01:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 01:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 01:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 01:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 01:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 01:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 01:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 01:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 01:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 01:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 01:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 01:10:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 01:10:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:10:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 01:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 01:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 01:10:02 kjcf05n00 mcfcli[3673891]: %3|1730704202.877|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:10:15 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 01:10:15 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 01:10:15 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 01:10:20 kjcf05n00 python3.9[1731930]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 01:10:24 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 01:10:28 kjcf05n00 mcfcli[3673891]: %3|1730704228.656|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:10:42 kjcf05n00 mcfcli[3673891]: %3|1730704242.170|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:10:52 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 01:10:52 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 01:10:58 kjcf05n00 mcfcli[3673891]: %3|1730704258.656|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 01:11:19 kjcf05n00 mcfcli[3673891]: %3|1730704279.461|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:11:21 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 01:11:28 kjcf05n00 mcfcli[3673891]: %3|1730704288.657|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:11:49 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 01:11:49 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 01:11:56 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 01:11:56 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 01:11:56 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 01:11:55 kjcf05n00 mcfcli[3673891]: %3|1730704315.773|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:11:58 kjcf05n00 mcfcli[3673891]: %3|1730704318.657|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 01:12:28 kjcf05n00 mcfcli[3673891]: %3|1730704348.659|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 01:12:31 kjcf05n00 mcfcli[3673891]: %3|1730704351.683|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:12:58 kjcf05n00 mcfcli[3673891]: %3|1730704378.659|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 01:13:10 kjcf05n00 mcfcli[3673891]: %3|1730704390.452|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T01:13:27.268823553-06:00 level=info msg="Completed cleanup jobs" duration=41.634664ms Nov 4 01:13:28 kjcf05n00 mcfcli[3673891]: %3|1730704408.659|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 01:13:47 kjcf05n00 mcfcli[3673891]: %3|1730704427.646|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:13:58 kjcf05n00 mcfcli[3673891]: %3|1730704438.660|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:14:21 kjcf05n00 mcfcli[3673891]: %3|1730704461.768|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:14:28 kjcf05n00 mcfcli[3673891]: %3|1730704468.661|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:14:50 kjcf05n02 nslcd[6896]: [6afb66] ldap_result() failed: Can't contact LDAP server Nov 4 01:14:58 kjcf05n00 mcfcli[3673891]: %3|1730704498.604|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:14:58 kjcf05n00 mcfcli[3673891]: %3|1730704498.662|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:15:20 kjcf05n00 python3.9[1734800]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 01:15:28 kjcf05n00 mcfcli[3673891]: %3|1730704528.663|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 01:15:38 kjcf05n00 mcfcli[3673891]: %3|1730704538.601|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:15:58 kjcf05n00 mcfcli[3673891]: %3|1730704558.663|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 01:16:15 kjcf05n00 mcfcli[3673891]: %3|1730704575.321|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:16:28 kjcf05n00 mcfcli[3673891]: %3|1730704588.664|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:16:55 kjcf05n00 mcfcli[3673891]: %3|1730704615.236|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:16:58 kjcf05n00 mcfcli[3673891]: %3|1730704618.664|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:17:28 kjcf05n00 mcfcli[3673891]: %3|1730704648.665|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:17:34 kjcf05n00 mcfcli[3673891]: %3|1730704654.725|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:17:58 kjcf05n00 mcfcli[3673891]: %3|1730704678.665|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:18:12 kjcf05n00 mcfcli[3673891]: %3|1730704692.076|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:18:28 kjcf05n00 mcfcli[3673891]: %3|1730704708.665|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 01:18:47 kjcf05n00 mcfcli[3673891]: %3|1730704727.256|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:18:58 kjcf05n00 mcfcli[3673891]: %3|1730704738.666|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 01:19:26 kjcf05n00 mcfcli[3673891]: %3|1730704766.828|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:19:28 kjcf05n00 mcfcli[3673891]: %3|1730704768.667|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:19:58 kjcf05n00 mcfcli[3673891]: %3|1730704798.667|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 01:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 01:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 01:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 01:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 01:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 01:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 01:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 01:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 01:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 01:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 01:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 01:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 01:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 01:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 01:20:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 01:20:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:20:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 01:20:04 kjcf05n00 mcfcli[3673891]: %3|1730704804.226|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:20:21 kjcf05n00 python3.9[1737651]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 01:20:28 kjcf05n00 mcfcli[3673891]: %3|1730704828.668|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:20:43 kjcf05n00 mcfcli[3673891]: %3|1730704843.488|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:20:58 kjcf05n00 mcfcli[3673891]: %3|1730704858.669|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 01:21:22 kjcf05n00 mcfcli[3673891]: %3|1730704882.160|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:21:28 kjcf05n00 mcfcli[3673891]: %3|1730704888.669|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 01:21:58 kjcf05n00 mcfcli[3673891]: %3|1730704918.669|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 01:22:01 kjcf05n00 mcfcli[3673891]: %3|1730704921.346|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:22:28 kjcf05n00 mcfcli[3673891]: %3|1730704948.671|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:22:40 kjcf05n00 mcfcli[3673891]: %3|1730704960.776|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:22:58 kjcf05n00 mcfcli[3673891]: %3|1730704978.672|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T07:23:15.868106Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 01:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T07:23:15.868178Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.122ms Nov 4 01:23:19 kjcf05n00 mcfcli[3673891]: %3|1730704999.306|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T01:23:27.268031696-06:00 level=info msg="Completed cleanup jobs" duration=41.199167ms Nov 4 01:23:28 kjcf05n00 mcfcli[3673891]: %3|1730705008.672|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:23:57 kjcf05n00 mcfcli[3673891]: %3|1730705037.107|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:23:58 kjcf05n00 mcfcli[3673891]: %3|1730705038.673|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 01:24:11 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 01:24:11 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 10 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007290 sec, idle for 1 hour(s)] Nov 4 01:24:28 kjcf05n00 mcfcli[3673891]: %3|1730705068.673|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 01:24:35 kjcf05n00 mcfcli[3673891]: %3|1730705075.145|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:24:58 kjcf05n00 mcfcli[3673891]: %3|1730705098.675|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 01:25:14 kjcf05n00 mcfcli[3673891]: %3|1730705114.663|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:25:22 kjcf05n00 python3.9[1740464]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 01:25:28 kjcf05n00 mcfcli[3673891]: %3|1730705128.675|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 01:25:51 kjcf05n00 mcfcli[3673891]: %3|1730705151.122|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:25:58 kjcf05n00 mcfcli[3673891]: %3|1730705158.675|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:26:28 kjcf05n00 mcfcli[3673891]: %3|1730705188.676|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:26:31 kjcf05n00 mcfcli[3673891]: %3|1730705191.119|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:26:58 kjcf05n00 mcfcli[3673891]: %3|1730705218.676|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:27:08 kjcf05n00 mcfcli[3673891]: %3|1730705228.416|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:27:28 kjcf05n00 mcfcli[3673891]: %3|1730705248.678|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 01:27:48 kjcf05n00 mcfcli[3673891]: %3|1730705268.413|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:27:58 kjcf05n00 mcfcli[3673891]: %3|1730705278.679|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:28:25 kjcf05n00 mcfcli[3673891]: %3|1730705305.407|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:28:28 kjcf05n00 mcfcli[3673891]: %3|1730705308.679|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:28:58 kjcf05n00 mcfcli[3673891]: %3|1730705338.536|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:28:58 kjcf05n00 mcfcli[3673891]: %3|1730705338.680|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 01:29:28 kjcf05n00 mcfcli[3673891]: %3|1730705368.680|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:29:37 kjcf05n00 mcfcli[3673891]: %3|1730705377.886|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:29:58 kjcf05n00 mcfcli[3673891]: %3|1730705398.682|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 01:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 01:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 01:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 01:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 01:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 01:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 01:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 01:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 01:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 01:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 01:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 01:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 01:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 01:30:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 01:30:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:30:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 01:30:17 kjcf05n00 mcfcli[3673891]: %3|1730705417.883|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:30:21 kjcf05n00 python3.9[1743404]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 01:30:28 kjcf05n00 mcfcli[3673891]: %3|1730705428.682|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:30:57 kjcf05n00 mcfcli[3673891]: %3|1730705457.880|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:30:58 kjcf05n00 mcfcli[3673891]: %3|1730705458.683|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:31:28 kjcf05n00 mcfcli[3673891]: %3|1730705488.683|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 01:31:34 kjcf05n00 mcfcli[3673891]: %3|1730705494.646|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:31:58 kjcf05n00 mcfcli[3673891]: %3|1730705518.684|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 01:32:11 kjcf05n00 mcfcli[3673891]: %3|1730705531.896|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:32:28 kjcf05n00 mcfcli[3673891]: %3|1730705548.684|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:32:51 kjcf05n00 mcfcli[3673891]: %3|1730705571.889|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:32:58 kjcf05n00 mcfcli[3673891]: %3|1730705578.685|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T01:33:27.254688101-06:00 level=info msg="Completed cleanup jobs" duration=27.648961ms Nov 4 01:33:28 kjcf05n00 mcfcli[3673891]: %3|1730705608.685|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:33:29 kjcf05n00 mcfcli[3673891]: %3|1730705609.057|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:33:58 kjcf05n00 mcfcli[3673891]: %3|1730705638.686|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 01:34:07 kjcf05n00 mcfcli[3673891]: %3|1730705647.419|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:34:28 kjcf05n00 mcfcli[3673891]: %3|1730705668.686|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 01:34:42 kjcf05n00 mcfcli[3673891]: %3|1730705682.422|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:34:50 kjcf05n02 nslcd[6896]: [e45d32] ldap_result() failed: Can't contact LDAP server Nov 4 01:34:58 kjcf05n00 mcfcli[3673891]: %3|1730705698.687|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:35:21 kjcf05n00 python3.9[1746213]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 01:35:22 kjcf05n00 mcfcli[3673891]: %3|1730705722.419|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:35:28 kjcf05n00 mcfcli[3673891]: %3|1730705728.688|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:35:58 kjcf05n00 mcfcli[3673891]: %3|1730705758.624|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:35:58 kjcf05n00 mcfcli[3673891]: %3|1730705758.689|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:36:29 kjcf05n00 mcfcli[3673891]: %3|1730705789.189|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 01:36:37 kjcf05n00 mcfcli[3673891]: %3|1730705797.186|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:36:59 kjcf05n00 mcfcli[3673891]: %3|1730705819.189|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 01:37:17 kjcf05n00 mcfcli[3673891]: %3|1730705837.183|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:37:29 kjcf05n00 mcfcli[3673891]: %3|1730705849.191|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 01:37:57 kjcf05n00 mcfcli[3673891]: %3|1730705877.058|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:37:59 kjcf05n00 mcfcli[3673891]: %3|1730705879.191|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 01:38:29 kjcf05n00 mcfcli[3673891]: %3|1730705909.192|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 01:38:35 kjcf05n00 mcfcli[3673891]: %3|1730705915.162|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:38:59 kjcf05n00 mcfcli[3673891]: %3|1730705939.193|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 01:39:14 kjcf05n00 mcfcli[3673891]: %3|1730705954.283|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:39:29 kjcf05n00 mcfcli[3673891]: %3|1730705969.193|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 01:39:52 kjcf05n00 mcfcli[3673891]: %3|1730705992.516|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:39:59 kjcf05n00 mcfcli[3673891]: %3|1730705999.605|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 01:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 01:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 01:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 01:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 01:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 01:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 01:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 01:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 01:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 01:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 01:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 01:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 01:40:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 01:40:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:40:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 01:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 01:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 01:40:21 kjcf05n00 python3.9[1749006]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 01:40:29 kjcf05n00 mcfcli[3673891]: %3|1730706029.694|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 01:40:29 kjcf05n00 mcfcli[3673891]: %3|1730706029.975|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:40:59 kjcf05n00 mcfcli[3673891]: %3|1730706059.695|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 01:41:07 kjcf05n00 mcfcli[3673891]: %3|1730706067.524|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:41:30 kjcf05n00 mcfcli[3673891]: %3|1730706090.195|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 01:41:46 kjcf05n00 mcfcli[3673891]: %3|1730706106.340|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:42:00 kjcf05n00 mcfcli[3673891]: %3|1730706120.197|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 01:42:24 kjcf05n00 mcfcli[3673891]: %3|1730706144.499|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:42:30 kjcf05n00 mcfcli[3673891]: %3|1730706150.198|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 01:43:00 kjcf05n00 mcfcli[3673891]: %3|1730706180.198|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:43:03 kjcf05n00 mcfcli[3673891]: %3|1730706183.082|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T01:43:27.268278469-06:00 level=info msg="Completed cleanup jobs" duration=41.26423ms Nov 4 01:43:30 kjcf05n00 mcfcli[3673891]: %3|1730706210.199|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:43:41 kjcf05n00 mcfcli[3673891]: %3|1730706221.935|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:44:00 kjcf05n00 mcfcli[3673891]: %3|1730706240.200|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 01:44:19 kjcf05n00 mcfcli[3673891]: %3|1730706259.195|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:44:30 kjcf05n00 mcfcli[3673891]: %3|1730706270.200|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 01:44:59 kjcf05n00 mcfcli[3673891]: %3|1730706299.192|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:45:00 kjcf05n00 mcfcli[3673891]: %3|1730706300.201|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 01:45:21 kjcf05n00 python3.9[1752022]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 01:45:30 kjcf05n00 mcfcli[3673891]: %3|1730706330.608|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 01:45:39 kjcf05n00 mcfcli[3673891]: %3|1730706339.189|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:46:00 kjcf05n00 mcfcli[3673891]: %3|1730706360.701|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 01:46:17 kjcf05n00 mcfcli[3673891]: %3|1730706377.626|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:46:30 kjcf05n00 mcfcli[3673891]: %3|1730706390.702|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 01:46:48 kjcf05n00 su[1753054]: (to root) admin on pts/22 Nov 4 01:46:56 kjcf05n00 mcfcli[3673891]: %3|1730706416.651|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:47:00 kjcf05n00 mcfcli[3673891]: %3|1730706420.702|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 01:47:30 kjcf05n00 mcfcli[3673891]: %3|1730706450.702|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 01:47:36 kjcf05n00 mcfcli[3673891]: %3|1730706456.648|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:48:00 kjcf05n00 mcfcli[3673891]: %3|1730706480.702|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 01:48:12 kjcf05n00 mcfcli[3673891]: %3|1730706492.597|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:48:30 kjcf05n00 mcfcli[3673891]: %3|1730706510.703|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 01:48:50 kjcf05n00 mcfcli[3673891]: %3|1730706530.831|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:49:00 kjcf05n00 mcfcli[3673891]: %3|1730706540.704|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:49:28 kjcf05n00 mcfcli[3673891]: %3|1730706568.719|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:49:30 kjcf05n00 mcfcli[3673891]: %3|1730706570.704|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 01:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 01:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 01:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 01:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 01:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 01:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 01:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 01:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 01:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 01:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 01:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 01:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 01:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 01:50:00 kjcf05n00 mcfcli[3673891]: %3|1730706600.704|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 01:50:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 01:50:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 01:50:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 01:50:08 kjcf05n00 mcfcli[3673891]: %3|1730706608.716|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:50:21 kjcf05n00 python3.9[1755114]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 01:50:30 kjcf05n00 mcfcli[3673891]: %3|1730706630.705|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 01:50:47 kjcf05n00 mcfcli[3673891]: %3|1730706647.067|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:51:00 kjcf05n00 mcfcli[3673891]: %3|1730706660.706|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 01:51:27 kjcf05n00 mcfcli[3673891]: %3|1730706687.064|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:51:30 kjcf05n00 mcfcli[3673891]: %3|1730706690.706|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:52:00 kjcf05n00 mcfcli[3673891]: %3|1730706720.707|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:52:03 kjcf05n00 mcfcli[3673891]: %3|1730706723.816|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:52:30 kjcf05n00 mcfcli[3673891]: %3|1730706750.707|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:52:40 kjcf05n00 mcfcli[3673891]: %3|1730706760.229|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:52:40 kjcf05n02 diskmonitor[17328]: leaving test state: 1 next state: 2 Nov 4 01:52:40 kjcf05n02 diskmonitor[17328]: lock req: no timeout Nov 4 01:52:40 kjcf05n02 diskmonitor[17328]: leaving test state: 2 next state: 4 Nov 4 01:53:00 kjcf05n00 mcfcli[3673891]: %3|1730706780.708|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 01:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T07:53:15.867841Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 01:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T07:53:15.867903Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.081ms Nov 4 01:53:20 kjcf05n00 mcfcli[3673891]: %3|1730706800.226|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:53:22 kjcf05n02 diskmonitor[17328]: lock acquired Nov 4 01:53:22 kjcf05n02 diskmonitor[17328]: leaving test state: 4 next state: 8 Nov 4 01:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T01:53:27.267954917-06:00 level=info msg="Completed cleanup jobs" duration=41.396677ms Nov 4 01:53:29 kjcf05n02 diskmonitor[17328]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 4 01:53:29 kjcf05n02 diskmonitor[17328]: leaving test state: 8 next state: 20 Nov 4 01:53:29 kjcf05n02 diskmonitor[17328]: leaving test state: 20 next state: 40 Nov 4 01:53:29 kjcf05n02 diskmonitor[17328]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 248d2c0000 Nov 4 01:53:29 kjcf05n02 diskmonitor[17328]: leaving test state: 40 next state: 80 Nov 4 01:53:30 kjcf05n00 mcfcli[3673891]: %3|1730706810.709|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 01:53:58 kjcf05n00 mcfcli[3673891]: %3|1730706838.548|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:54:00 kjcf05n00 mcfcli[3673891]: %3|1730706840.709|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:54:30 kjcf05n00 mcfcli[3673891]: %3|1730706870.711|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:54:31 kjcf05n02 diskmonitor[17328]: leaving test state: 80 next state: 100 Nov 4 01:54:31 kjcf05n02 diskmonitor[17328]: lock release: time: Mon Nov 4 01:54:24 2024 Nov 4 01:54:31 kjcf05n02 diskmonitor[17328]: leaving test state: 100 next state: 1 Nov 4 01:54:36 kjcf05n00 mcfcli[3673891]: %3|1730706876.715|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:55:00 kjcf05n00 mcfcli[3673891]: %3|1730706900.711|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 01:55:15 kjcf05n00 mcfcli[3673891]: %3|1730706915.362|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:55:21 kjcf05n00 python3.9[1757888]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 01:55:30 kjcf05n00 mcfcli[3673891]: %3|1730706930.711|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:55:53 kjcf05n00 mcfcli[3673891]: %3|1730706953.059|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:56:00 kjcf05n00 mcfcli[3673891]: %3|1730706960.712|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:56:30 kjcf05n00 mcfcli[3673891]: %3|1730706990.712|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:56:33 kjcf05n00 mcfcli[3673891]: %3|1730706993.056|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:57:00 kjcf05n00 mcfcli[3673891]: %3|1730707020.712|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:57:11 kjcf05n00 mcfcli[3673891]: %3|1730707031.488|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:57:30 kjcf05n00 mcfcli[3673891]: %3|1730707050.713|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:57:51 kjcf05n00 mcfcli[3673891]: %3|1730707071.156|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:58:00 kjcf05n00 mcfcli[3673891]: %3|1730707080.713|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:58:30 kjcf05n00 mcfcli[3673891]: %3|1730707110.085|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:58:30 kjcf05n00 mcfcli[3673891]: %3|1730707110.714|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 01:59:00 kjcf05n00 mcfcli[3673891]: %3|1730707140.714|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 01:59:08 kjcf05n00 mcfcli[3673891]: %3|1730707148.283|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 01:59:30 kjcf05n00 mcfcli[3673891]: %3|1730707170.715|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 01:59:46 kjcf05n00 mcfcli[3673891]: %3|1730707186.862|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 02:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 02:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 02:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 02:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 02:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 02:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 02:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 02:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 02:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 02:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 02:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 02:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 02:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 02:00:00 kjcf05n00 mcfcli[3673891]: %3|1730707200.716|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 02:00:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 02:00:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:00:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 02:00:21 kjcf05n00 mcfcli[3673891]: %3|1730707221.945|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:00:23 kjcf05n00 python3.9[1760762]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 02:00:30 kjcf05n00 mcfcli[3673891]: %3|1730707230.716|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:01:00 kjcf05n00 mcfcli[3673891]: %3|1730707260.716|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:01:01 kjcf05n00 mcfcli[3673891]: %3|1730707261.942|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:01:30 kjcf05n00 mcfcli[3673891]: %3|1730707290.717|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:01:41 kjcf05n00 mcfcli[3673891]: %3|1730707301.939|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:02:00 kjcf05n00 mcfcli[3673891]: %3|1730707320.717|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 02:02:18 kjcf05n00 mcfcli[3673891]: %3|1730707338.369|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:02:30 kjcf05n00 mcfcli[3673891]: %3|1730707350.717|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:02:58 kjcf05n00 mcfcli[3673891]: %3|1730707378.366|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:03:00 kjcf05n00 mcfcli[3673891]: %3|1730707380.717|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T02:03:27.252648639-06:00 level=info msg="Completed cleanup jobs" duration=26.218742ms Nov 4 02:03:30 kjcf05n00 mcfcli[3673891]: %3|1730707410.719|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 02:03:35 kjcf05n00 mcfcli[3673891]: %3|1730707415.240|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:04:00 kjcf05n00 mcfcli[3673891]: %3|1730707440.720|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 02:04:13 kjcf05n00 mcfcli[3673891]: %3|1730707453.526|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:04:30 kjcf05n00 mcfcli[3673891]: %3|1730707470.720|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:04:53 kjcf05n00 mcfcli[3673891]: %3|1730707493.524|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:05:00 kjcf05n00 mcfcli[3673891]: %3|1730707500.722|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:05:21 kjcf05n00 python3.9[1763702]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 02:05:30 kjcf05n00 mcfcli[3673891]: %3|1730707530.722|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:05:33 kjcf05n00 mcfcli[3673891]: %3|1730707533.521|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:06:00 kjcf05n00 mcfcli[3673891]: %3|1730707560.722|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:06:12 kjcf05n00 mcfcli[3673891]: %3|1730707572.561|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:06:30 kjcf05n00 mcfcli[3673891]: %3|1730707590.724|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 02:06:50 kjcf05n00 mcfcli[3673891]: %3|1730707610.133|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:07:00 kjcf05n00 mcfcli[3673891]: %3|1730707620.724|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 02:07:28 kjcf05n00 mcfcli[3673891]: %3|1730707648.236|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:07:30 kjcf05n00 mcfcli[3673891]: %3|1730707650.724|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 02:07:50 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 02:07:50 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 02:07:50 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 02:08:00 kjcf05n00 mcfcli[3673891]: %3|1730707680.725|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 02:08:08 kjcf05n00 mcfcli[3673891]: %3|1730707688.154|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:08:30 kjcf05n00 mcfcli[3673891]: %3|1730707710.725|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:08:47 kjcf05n00 mcfcli[3673891]: %3|1730707727.737|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:09:00 kjcf05n00 mcfcli[3673891]: %3|1730707740.727|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 02:09:03 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 02:09:03 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 02:09:03 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 02:09:06 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 02:09:06 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 02:09:06 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 02:09:27 kjcf05n00 mcfcli[3673891]: %3|1730707767.263|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:09:30 kjcf05n00 mcfcli[3673891]: %3|1730707770.727|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 02:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 02:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 02:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 02:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 02:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 02:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 02:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 02:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 02:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 02:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 02:10:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 02:10:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:10:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 02:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 02:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 02:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 02:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 02:10:00 kjcf05n00 mcfcli[3673891]: %3|1730707800.727|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:10:02 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 02:10:04 kjcf05n00 mcfcli[3673891]: %3|1730707804.561|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:10:24 kjcf05n00 python3.9[1766504]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 02:10:30 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 02:10:30 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 02:10:31 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 02:10:30 kjcf05n00 mcfcli[3673891]: %3|1730707830.728|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:10:44 kjcf05n00 mcfcli[3673891]: %3|1730707844.558|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:10:59 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 02:10:59 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 02:11:00 kjcf05n00 mcfcli[3673891]: %3|1730707860.728|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:11:22 kjcf05n00 mcfcli[3673891]: %3|1730707882.108|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:11:25 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 02:11:25 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 02:11:25 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 02:11:30 kjcf05n00 mcfcli[3673891]: %3|1730707890.730|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:12:00 kjcf05n00 mcfcli[3673891]: %3|1730707920.730|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:12:02 kjcf05n00 mcfcli[3673891]: %3|1730707922.105|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:12:30 kjcf05n00 mcfcli[3673891]: %3|1730707950.730|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:12:41 kjcf05n00 mcfcli[3673891]: %3|1730707961.173|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:13:00 kjcf05n00 mcfcli[3673891]: %3|1730707980.731|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:13:21 kjcf05n00 mcfcli[3673891]: %3|1730708001.170|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T02:13:27.267759317-06:00 level=info msg="Completed cleanup jobs" duration=41.255192ms Nov 4 02:13:30 kjcf05n00 mcfcli[3673891]: %3|1730708010.731|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:13:59 kjcf05n00 mcfcli[3673891]: %3|1730708039.803|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:14:00 kjcf05n00 mcfcli[3673891]: %3|1730708040.731|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 02:14:30 kjcf05n00 mcfcli[3673891]: %3|1730708070.732|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:14:37 kjcf05n00 mcfcli[3673891]: %3|1730708077.339|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:14:50 kjcf05n02 nslcd[6896]: [1bd7b7] ldap_result() failed: Can't contact LDAP server Nov 4 02:15:00 kjcf05n00 mcfcli[3673891]: %3|1730708100.732|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:15:14 kjcf05n00 mcfcli[3673891]: %3|1730708114.896|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:15:21 kjcf05n00 python3.9[1769311]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 02:15:30 kjcf05n00 mcfcli[3673891]: %3|1730708130.733|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:15:54 kjcf05n00 mcfcli[3673891]: %3|1730708154.555|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:16:00 kjcf05n00 mcfcli[3673891]: %3|1730708160.734|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:16:30 kjcf05n00 mcfcli[3673891]: %3|1730708190.734|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:16:34 kjcf05n00 mcfcli[3673891]: %3|1730708194.552|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:17:00 kjcf05n00 mcfcli[3673891]: %3|1730708220.734|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:17:13 kjcf05n00 mcfcli[3673891]: %3|1730708233.461|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:17:30 kjcf05n00 mcfcli[3673891]: %3|1730708250.735|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:17:50 kjcf05n00 mcfcli[3673891]: %3|1730708270.931|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:18:01 kjcf05n00 mcfcli[3673891]: %3|1730708281.236|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 02:18:30 kjcf05n00 mcfcli[3673891]: %3|1730708310.094|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:18:31 kjcf05n00 mcfcli[3673891]: %3|1730708311.236|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 02:19:01 kjcf05n00 mcfcli[3673891]: %3|1730708341.237|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:19:10 kjcf05n00 mcfcli[3673891]: %3|1730708350.091|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:19:31 kjcf05n00 mcfcli[3673891]: %3|1730708371.239|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:19:48 kjcf05n00 mcfcli[3673891]: %3|1730708388.472|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 02:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 02:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 02:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 02:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 02:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 02:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 02:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 02:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 02:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 02:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 02:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 02:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 02:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 02:20:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 02:20:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:20:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 02:20:01 kjcf05n00 mcfcli[3673891]: %3|1730708401.627|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 02:20:21 kjcf05n00 python3.9[1772175]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 02:20:26 kjcf05n00 mcfcli[3673891]: %3|1730708426.884|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:20:31 kjcf05n00 mcfcli[3673891]: %3|1730708431.740|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 02:21:01 kjcf05n00 mcfcli[3673891]: %3|1730708461.740|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:21:05 kjcf05n00 mcfcli[3673891]: %3|1730708465.831|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:21:31 kjcf05n00 mcfcli[3673891]: %3|1730708491.740|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:21:45 kjcf05n00 mcfcli[3673891]: %3|1730708505.828|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:22:01 kjcf05n00 mcfcli[3673891]: %3|1730708521.741|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:22:20 kjcf05n00 mcfcli[3673891]: %3|1730708540.521|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:22:31 kjcf05n00 mcfcli[3673891]: %3|1730708551.741|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:22:59 kjcf05n00 mcfcli[3673891]: %3|1730708579.665|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:23:01 kjcf05n00 mcfcli[3673891]: %3|1730708581.743|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 02:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T08:23:15.867984Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 02:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T08:23:15.868052Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.089ms Nov 4 02:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T02:23:27.252976803-06:00 level=info msg="Completed cleanup jobs" duration=26.136508ms Nov 4 02:23:31 kjcf05n00 mcfcli[3673891]: %3|1730708611.743|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 02:23:37 kjcf05n00 mcfcli[3673891]: %3|1730708617.706|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:24:01 kjcf05n00 mcfcli[3673891]: %3|1730708641.743|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 02:24:11 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 02:24:11 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 11 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007845 sec, idle for 1 hour(s)] Nov 4 02:24:16 kjcf05n00 mcfcli[3673891]: %3|1730708656.250|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:24:31 kjcf05n00 mcfcli[3673891]: %3|1730708671.744|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 02:24:55 kjcf05n00 mcfcli[3673891]: %3|1730708695.543|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:25:02 kjcf05n00 mcfcli[3673891]: %3|1730708702.245|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 02:25:21 kjcf05n00 python3.9[1775095]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 02:25:32 kjcf05n00 mcfcli[3673891]: %3|1730708732.629|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 02:25:34 kjcf05n00 mcfcli[3673891]: %3|1730708734.426|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:26:02 kjcf05n00 mcfcli[3673891]: %3|1730708762.746|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 02:26:14 kjcf05n00 mcfcli[3673891]: %3|1730708774.350|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:26:32 kjcf05n00 mcfcli[3673891]: %3|1730708792.746|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:26:54 kjcf05n00 mcfcli[3673891]: %3|1730708814.347|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:27:02 kjcf05n00 mcfcli[3673891]: %3|1730708822.746|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:27:32 kjcf05n00 mcfcli[3673891]: %3|1730708852.746|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:27:34 kjcf05n00 mcfcli[3673891]: %3|1730708854.344|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:28:03 kjcf05n00 mcfcli[3673891]: %3|1730708883.247|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 02:28:11 kjcf05n00 mcfcli[3673891]: %3|1730708891.499|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:28:33 kjcf05n00 mcfcli[3673891]: %3|1730708913.247|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:28:48 kjcf05n00 mcfcli[3673891]: %3|1730708928.378|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:29:03 kjcf05n00 mcfcli[3673891]: %3|1730708943.247|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 02:29:26 kjcf05n00 mcfcli[3673891]: %3|1730708966.281|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:29:33 kjcf05n00 mcfcli[3673891]: %3|1730708973.248|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 02:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 02:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 02:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 02:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 02:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 02:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 02:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 02:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 02:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 02:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 02:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 02:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 02:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 02:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 02:30:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 02:30:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:30:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 02:30:02 kjcf05n00 mcfcli[3673891]: %3|1730709002.568|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:30:03 kjcf05n00 mcfcli[3673891]: %3|1730709003.248|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 02:30:21 kjcf05n00 python3.9[1777899]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 02:30:33 kjcf05n00 mcfcli[3673891]: %3|1730709033.249|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 02:30:40 kjcf05n00 mcfcli[3673891]: %3|1730709040.788|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:31:03 kjcf05n00 mcfcli[3673891]: %3|1730709063.250|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 02:31:19 kjcf05n00 mcfcli[3673891]: %3|1730709079.152|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:31:33 kjcf05n00 mcfcli[3673891]: %3|1730709093.632|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 02:31:59 kjcf05n00 mcfcli[3673891]: %3|1730709119.149|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:32:03 kjcf05n00 mcfcli[3673891]: %3|1730709123.750|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 02:32:33 kjcf05n00 mcfcli[3673891]: %3|1730709153.751|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:32:37 kjcf05n00 mcfcli[3673891]: %3|1730709157.116|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:33:03 kjcf05n00 mcfcli[3673891]: %3|1730709183.751|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:33:17 kjcf05n00 mcfcli[3673891]: %3|1730709197.113|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T02:33:27.253855473-06:00 level=info msg="Completed cleanup jobs" duration=27.231949ms Nov 4 02:33:33 kjcf05n00 mcfcli[3673891]: %3|1730709213.751|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:33:57 kjcf05n00 mcfcli[3673891]: %3|1730709237.110|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:34:03 kjcf05n00 mcfcli[3673891]: %3|1730709243.752|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:34:33 kjcf05n00 mcfcli[3673891]: %3|1730709273.234|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:34:33 kjcf05n00 mcfcli[3673891]: %3|1730709273.753|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:34:50 kjcf05n02 nslcd[6896]: [2dba31] ldap_result() failed: Can't contact LDAP server Nov 4 02:35:03 kjcf05n00 mcfcli[3673891]: %3|1730709303.753|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:35:06 kjcf05n00 mcfcli[3673891]: %3|1730709306.906|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:35:25 kjcf05n00 python3.9[1780761]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 02:35:33 kjcf05n00 mcfcli[3673891]: %3|1730709333.754|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:35:41 kjcf05n00 mcfcli[3673891]: %3|1730709341.534|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:36:03 kjcf05n00 mcfcli[3673891]: %3|1730709363.754|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 02:36:16 kjcf05n00 mcfcli[3673891]: %3|1730709376.559|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:36:33 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 4 02:36:33 kjcf05n00 mcfcli[3673891]: %3|1730709393.755|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:36:53 kjcf05n00 mcfcli[3673891]: %3|1730709413.853|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:37:03 kjcf05n00 mcfcli[3673891]: %3|1730709423.756|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:37:32 kjcf05n00 mcfcli[3673891]: %3|1730709452.017|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:37:33 kjcf05n00 mcfcli[3673891]: %3|1730709453.757|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:38:03 kjcf05n00 mcfcli[3673891]: %3|1730709483.757|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:38:08 kjcf05n00 mcfcli[3673891]: %3|1730709488.927|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:38:33 kjcf05n00 mcfcli[3673891]: %3|1730709513.757|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:38:48 kjcf05n00 mcfcli[3673891]: %3|1730709528.407|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:39:03 kjcf05n00 mcfcli[3673891]: %3|1730709543.758|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:39:26 kjcf05n00 mcfcli[3673891]: %3|1730709566.357|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:39:33 kjcf05n00 mcfcli[3673891]: %3|1730709573.759|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 02:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 02:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 02:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 02:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 02:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 02:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 02:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 02:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 02:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 02:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 02:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 02:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 02:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 02:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 02:40:03 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 02:40:03 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:40:03 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 02:40:03 kjcf05n00 mcfcli[3673891]: %3|1730709603.760|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 02:40:04 kjcf05n00 mcfcli[3673891]: %3|1730709604.593|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:40:22 kjcf05n00 python3.9[1783655]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 02:40:33 kjcf05n00 mcfcli[3673891]: %3|1730709633.760|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 02:40:36 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 4 02:40:36 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/22', errno='Permission denied (13)' Nov 4 02:40:42 kjcf05n00 mcfcli[3673891]: %3|1730709642.191|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:41:03 kjcf05n00 mcfcli[3673891]: %3|1730709663.762|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 02:41:21 kjcf05n00 mcfcli[3673891]: %3|1730709681.297|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:41:33 kjcf05n00 mcfcli[3673891]: %3|1730709693.762|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 02:41:33 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 4 02:42:01 kjcf05n00 mcfcli[3673891]: %3|1730709721.294|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:42:03 kjcf05n00 mcfcli[3673891]: %3|1730709723.762|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 02:42:33 kjcf05n00 mcfcli[3673891]: %3|1730709753.763|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 02:42:41 kjcf05n00 mcfcli[3673891]: %3|1730709761.291|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:43:03 kjcf05n00 mcfcli[3673891]: %3|1730709783.763|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 02:43:17 kjcf05n00 mcfcli[3673891]: %3|1730709797.335|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T02:43:27.252615478-06:00 level=info msg="Completed cleanup jobs" duration=26.112463ms Nov 4 02:43:33 kjcf05n00 mcfcli[3673891]: %3|1730709813.765|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 02:43:55 kjcf05n00 mcfcli[3673891]: %3|1730709835.123|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:44:03 kjcf05n00 mcfcli[3673891]: %3|1730709843.765|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:44:32 kjcf05n00 mcfcli[3673891]: %3|1730709872.341|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:44:33 kjcf05n00 mcfcli[3673891]: %3|1730709873.765|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 02:45:03 kjcf05n00 mcfcli[3673891]: %3|1730709903.765|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:45:11 kjcf05n00 mcfcli[3673891]: %3|1730709911.997|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:45:22 kjcf05n00 python3.9[1786507]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 02:45:33 kjcf05n03 diskmonitor[17871]: leaving test state: 1 next state: 2 Nov 4 02:45:33 kjcf05n03 diskmonitor[17871]: lock req: no timeout Nov 4 02:45:33 kjcf05n03 diskmonitor[17871]: leaving test state: 2 next state: 4 Nov 4 02:45:33 kjcf05n00 mcfcli[3673891]: %3|1730709933.766|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 02:45:48 kjcf05n00 mcfcli[3673891]: %3|1730709948.376|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:45:53 kjcf05n03 diskmonitor[17871]: lock acquired Nov 4 02:45:53 kjcf05n03 diskmonitor[17871]: leaving test state: 4 next state: 8 Nov 4 02:46:03 kjcf05n00 mcfcli[3673891]: %3|1730709963.766|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 02:46:09 kjcf05n03 diskmonitor[17871]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 4 02:46:09 kjcf05n03 diskmonitor[17871]: leaving test state: 8 next state: 20 Nov 4 02:46:09 kjcf05n03 diskmonitor[17871]: leaving test state: 20 next state: 40 Nov 4 02:46:09 kjcf05n03 diskmonitor[17871]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 34ea97d0000 Nov 4 02:46:09 kjcf05n03 diskmonitor[17871]: leaving test state: 40 next state: 80 Nov 4 02:46:14 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 4 02:46:27 kjcf05n00 mcfcli[3673891]: %3|1730709987.770|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:46:33 kjcf05n00 mcfcli[3673891]: %3|1730709993.767|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 02:47:03 kjcf05n00 mcfcli[3673891]: %3|1730710023.767|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 02:47:07 kjcf05n00 mcfcli[3673891]: %3|1730710027.767|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:47:14 kjcf05n03 diskmonitor[17871]: leaving test state: 80 next state: 100 Nov 4 02:47:14 kjcf05n03 diskmonitor[17871]: lock release: time: Mon Nov 4 02:47:05 2024 Nov 4 02:47:14 kjcf05n03 diskmonitor[17871]: leaving test state: 100 next state: 1 Nov 4 02:47:33 kjcf05n00 mcfcli[3673891]: %3|1730710053.768|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 02:47:43 kjcf05n00 mcfcli[3673891]: %3|1730710063.906|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:48:03 kjcf05n00 mcfcli[3673891]: %3|1730710083.768|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:48:22 kjcf05n00 mcfcli[3673891]: %3|1730710102.592|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:48:33 kjcf05n00 mcfcli[3673891]: %3|1730710113.770|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 02:49:01 kjcf05n00 mcfcli[3673891]: %3|1730710141.286|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:49:03 kjcf05n00 mcfcli[3673891]: %3|1730710143.770|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 02:49:33 kjcf05n00 mcfcli[3673891]: %3|1730710173.770|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 02:49:40 kjcf05n00 mcfcli[3673891]: %3|1730710180.916|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 02:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 02:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 02:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 02:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 02:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 02:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 02:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 02:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 02:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 02:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 02:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 02:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 02:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 02:50:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 02:50:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 02:50:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 02:50:03 kjcf05n00 mcfcli[3673891]: %3|1730710203.771|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:50:19 kjcf05n00 mcfcli[3673891]: %3|1730710219.514|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:50:22 kjcf05n00 python3.9[1789304]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 02:50:33 kjcf05n00 mcfcli[3673891]: %3|1730710233.773|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:50:59 kjcf05n00 mcfcli[3673891]: %3|1730710259.511|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:51:03 kjcf05n00 mcfcli[3673891]: %3|1730710263.773|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:51:31 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 4 02:51:31 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/22', errno='Permission denied (13)' Nov 4 02:51:33 kjcf05n00 mcfcli[3673891]: %3|1730710293.774|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:51:34 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 4 02:51:39 kjcf05n00 mcfcli[3673891]: %3|1730710299.144|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:52:03 kjcf05n00 mcfcli[3673891]: %3|1730710323.774|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 02:52:12 kjcf05n00 mcfcli[3673891]: %3|1730710332.671|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:52:33 kjcf05n00 mcfcli[3673891]: %3|1730710353.776|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 02:52:52 kjcf05n00 mcfcli[3673891]: %3|1730710372.414|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:53:03 kjcf05n00 mcfcli[3673891]: %3|1730710383.776|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T08:53:15.867506Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 02:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T08:53:15.867564Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.076ms Nov 4 02:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T02:53:27.296375341-06:00 level=info msg="Completed cleanup jobs" duration=69.992521ms Nov 4 02:53:32 kjcf05n00 mcfcli[3673891]: %3|1730710412.411|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:53:33 kjcf05n00 mcfcli[3673891]: %3|1730710413.776|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:54:03 kjcf05n00 mcfcli[3673891]: %3|1730710443.777|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:54:11 kjcf05n00 mcfcli[3673891]: %3|1730710451.924|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:54:33 kjcf05n00 mcfcli[3673891]: %3|1730710473.777|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:54:50 kjcf05n02 nslcd[6896]: [83e458] ldap_result() failed: Can't contact LDAP server Nov 4 02:54:51 kjcf05n00 mcfcli[3673891]: %3|1730710491.695|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:55:03 kjcf05n00 mcfcli[3673891]: %3|1730710503.779|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 02:55:22 kjcf05n00 python3.9[1792084]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 02:55:30 kjcf05n00 mcfcli[3673891]: %3|1730710530.152|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:55:33 kjcf05n00 mcfcli[3673891]: %3|1730710533.779|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 02:56:03 kjcf05n00 mcfcli[3673891]: %3|1730710563.779|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:56:09 kjcf05n00 mcfcli[3673891]: %3|1730710569.860|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:56:33 kjcf05n00 mcfcli[3673891]: %3|1730710593.781|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 02:56:47 kjcf05n00 mcfcli[3673891]: %3|1730710607.763|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:57:03 kjcf05n00 mcfcli[3673891]: %3|1730710623.781|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 02:57:26 kjcf05n00 mcfcli[3673891]: %3|1730710646.954|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:57:33 kjcf05n00 mcfcli[3673891]: %3|1730710653.781|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 02:57:55 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 4 02:58:02 kjcf05n00 mcfcli[3673891]: %3|1730710682.833|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:58:03 kjcf05n00 mcfcli[3673891]: %3|1730710683.783|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 02:58:13 kjcf05n03 chronyd[5171]: Selected source 16.110.135.123 Nov 4 02:58:33 kjcf05n00 mcfcli[3673891]: %3|1730710713.783|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 02:58:42 kjcf05n00 mcfcli[3673891]: %3|1730710722.691|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:59:03 kjcf05n00 mcfcli[3673891]: %3|1730710743.783|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 02:59:19 kjcf05n00 mcfcli[3673891]: %3|1730710759.739|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 02:59:33 kjcf05n00 mcfcli[3673891]: %3|1730710773.784|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 02:59:59 kjcf05n00 mcfcli[3673891]: %3|1730710799.290|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 03:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 03:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 03:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 03:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 03:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 03:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 03:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 03:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 03:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 03:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 03:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 03:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 03:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 03:00:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 03:00:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:00:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 03:00:03 kjcf05n00 mcfcli[3673891]: %3|1730710803.784|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:00:22 kjcf05n00 python3.9[1795065]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 03:00:33 kjcf05n00 mcfcli[3673891]: %3|1730710833.785|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:00:38 kjcf05n00 mcfcli[3673891]: %3|1730710838.618|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:01:03 kjcf05n00 mcfcli[3673891]: %3|1730710863.786|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:01:16 kjcf05n00 mcfcli[3673891]: %3|1730710876.237|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:01:33 kjcf05n00 mcfcli[3673891]: %3|1730710893.786|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 03:01:54 kjcf05n00 mcfcli[3673891]: %3|1730710914.184|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:02:03 kjcf05n00 mcfcli[3673891]: %3|1730710923.786|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:02:27 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 4 03:02:27 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/22', errno='Permission denied (13)' Nov 4 03:02:32 kjcf05n00 mcfcli[3673891]: %3|1730710952.767|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:02:33 kjcf05n00 mcfcli[3673891]: %3|1730710953.787|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:03:03 kjcf05n00 mcfcli[3673891]: %3|1730710983.787|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 03:03:06 kjcf05n00 mcfcli[3673891]: %3|1730710986.460|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:03:16 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 4 03:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T03:03:27.267772124-06:00 level=info msg="Completed cleanup jobs" duration=41.261835ms Nov 4 03:03:33 kjcf05n00 mcfcli[3673891]: %3|1730711013.787|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 03:03:42 kjcf05n00 mcfcli[3673891]: %3|1730711022.311|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:04:03 kjcf05n00 mcfcli[3673891]: %3|1730711043.788|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:04:20 kjcf05n00 mcfcli[3673891]: %3|1730711060.201|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:04:33 kjcf05n00 mcfcli[3673891]: %3|1730711073.789|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 03:04:56 kjcf05n00 mcfcli[3673891]: %3|1730711096.910|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:05:03 kjcf05n00 mcfcli[3673891]: %3|1730711103.789|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 03:05:22 kjcf05n00 python3.9[1798148]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 03:05:24 kjcf05n00 diskmonitor[2758297]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 03:05:30 kjcf05n00 mcfcli[3673891]: %3|1730711130.335|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:05:33 kjcf05n00 mcfcli[3673891]: %3|1730711133.790|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 03:06:03 kjcf05n00 mcfcli[3673891]: %3|1730711163.790|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:06:09 kjcf05n00 mcfcli[3673891]: %3|1730711169.873|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:06:33 kjcf05n00 mcfcli[3673891]: %3|1730711193.791|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:06:48 kjcf05n00 mcfcli[3673891]: %3|1730711208.410|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:07:03 kjcf05n00 mcfcli[3673891]: %3|1730711223.792|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:07:10 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 03:07:10 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 03:07:10 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 03:07:11 kjcf05n01 diskmonitor[1331407]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 03:07:27 kjcf05n00 mcfcli[3673891]: %3|1730711247.213|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:07:33 kjcf05n00 mcfcli[3673891]: %3|1730711253.792|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:08:02 kjcf05n01 syslog-ng[15072]: Configuration reload request received, reloading configuration; Nov 4 03:08:02 kjcf05n01 syslog-ng[15072]: Configuration reload finished; Nov 4 03:08:03 kjcf05n00 mcfcli[3673891]: %3|1730711283.793|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:08:05 kjcf05n00 mcfcli[3673891]: %3|1730711285.134|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:08:27 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 03:08:27 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 03:08:27 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 03:08:33 kjcf05n00 mcfcli[3673891]: %3|1730711313.793|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 03:08:40 kjcf05n00 mcfcli[3673891]: %3|1730711320.455|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:09:03 kjcf05n00 mcfcli[3673891]: %3|1730711343.794|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:09:04 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 03:09:04 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 03:09:04 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 03:09:12 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 03:09:19 kjcf05n00 mcfcli[3673891]: %3|1730711359.449|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:09:28 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 03:09:33 kjcf05n00 mcfcli[3673891]: %3|1730711373.795|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:09:40 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 03:09:40 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 03:09:59 kjcf05n00 mcfcli[3673891]: %3|1730711399.446|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 03:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 03:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 03:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 03:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 03:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 03:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 03:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 03:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 03:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 03:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 03:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 03:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 03:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 03:10:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 03:10:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:10:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 03:10:03 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 03:10:03 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 03:10:03 kjcf05n00 mcfcli[3673891]: %3|1730711403.795|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:10:28 kjcf05n00 python3.9[1801243]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 03:10:33 kjcf05n00 mcfcli[3673891]: %3|1730711433.795|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:10:36 kjcf05n00 mcfcli[3673891]: %3|1730711436.661|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:10:40 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 03:10:40 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 03:10:40 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 03:11:03 kjcf05n00 mcfcli[3673891]: %3|1730711463.796|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:11:16 kjcf05n00 mcfcli[3673891]: %3|1730711476.658|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:11:33 kjcf05n00 mcfcli[3673891]: %3|1730711493.797|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:11:54 kjcf05n00 mcfcli[3673891]: %3|1730711514.899|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:12:03 kjcf05n00 mcfcli[3673891]: %3|1730711523.797|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 03:12:33 kjcf05n00 mcfcli[3673891]: %3|1730711553.798|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:12:34 kjcf05n00 mcfcli[3673891]: %3|1730711554.702|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:13:03 kjcf05n00 mcfcli[3673891]: %3|1730711583.798|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:13:13 kjcf05n00 mcfcli[3673891]: %3|1730711593.817|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T03:13:27.26824298-06:00 level=info msg="Completed cleanup jobs" duration=41.266613ms Nov 4 03:13:33 kjcf05n00 mcfcli[3673891]: %3|1730711613.799|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:13:52 kjcf05n00 mcfcli[3673891]: %3|1730711632.199|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:14:03 kjcf05n00 mcfcli[3673891]: %3|1730711643.799|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 03:14:31 kjcf05n00 mcfcli[3673891]: %3|1730711671.912|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:14:33 kjcf05n00 mcfcli[3673891]: %3|1730711673.799|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:15:03 kjcf05n00 mcfcli[3673891]: %3|1730711703.800|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 03:15:09 kjcf05n00 mcfcli[3673891]: %3|1730711709.178|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:15:25 kjcf05n00 python3.9[1804265]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 03:15:33 kjcf05n00 mcfcli[3673891]: %3|1730711733.800|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 03:15:46 kjcf05n00 mcfcli[3673891]: %3|1730711746.783|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:16:03 kjcf05n00 mcfcli[3673891]: %3|1730711763.801|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 03:16:25 kjcf05n00 mcfcli[3673891]: %3|1730711785.584|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:16:33 kjcf05n00 mcfcli[3673891]: %3|1730711793.801|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:17:03 kjcf05n00 mcfcli[3673891]: %3|1730711823.370|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:17:03 kjcf05n00 mcfcli[3673891]: %3|1730711823.801|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 03:17:33 kjcf05n00 mcfcli[3673891]: %3|1730711853.802|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:17:36 kjcf05n00 mcfcli[3673891]: %3|1730711856.199|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:18:03 kjcf05n00 mcfcli[3673891]: %3|1730711883.802|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 03:18:11 kjcf05n00 mcfcli[3673891]: %3|1730711891.961|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:18:33 kjcf05n00 mcfcli[3673891]: %3|1730711913.804|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:18:49 kjcf05n00 mcfcli[3673891]: %3|1730711929.878|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:19:03 kjcf05n00 mcfcli[3673891]: %3|1730711943.804|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:19:29 kjcf05n00 mcfcli[3673891]: %3|1730711969.875|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:19:33 kjcf05n00 mcfcli[3673891]: %3|1730711973.804|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 03:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 03:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 03:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 03:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 03:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 03:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 03:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 03:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 03:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 03:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 03:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 03:20:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 03:20:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:20:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 03:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 03:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 03:20:03 kjcf05n00 mcfcli[3673891]: %3|1730712003.804|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:20:09 kjcf05n00 mcfcli[3673891]: %3|1730712009.872|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:20:22 kjcf05n00 python3.9[1807062]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 03:20:33 kjcf05n00 mcfcli[3673891]: %3|1730712033.806|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:20:45 kjcf05n00 mcfcli[3673891]: %3|1730712045.247|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:21:03 kjcf05n00 mcfcli[3673891]: %3|1730712063.806|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:21:25 kjcf05n00 mcfcli[3673891]: %3|1730712085.244|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:21:33 kjcf05n00 mcfcli[3673891]: %3|1730712093.806|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:22:03 kjcf05n00 mcfcli[3673891]: %3|1730712123.251|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:22:03 kjcf05n00 mcfcli[3673891]: %3|1730712123.807|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 03:22:33 kjcf05n00 mcfcli[3673891]: %3|1730712153.808|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:22:43 kjcf05n00 mcfcli[3673891]: %3|1730712163.248|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:23:03 kjcf05n00 mcfcli[3673891]: %3|1730712183.808|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T09:23:15.867911Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 03:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T09:23:15.867967Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.079ms Nov 4 03:23:22 kjcf05n00 mcfcli[3673891]: %3|1730712202.041|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T03:23:27.246694956-06:00 level=info msg="Completed cleanup jobs" duration=20.266665ms Nov 4 03:23:33 kjcf05n00 mcfcli[3673891]: %3|1730712213.808|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 03:24:00 kjcf05n00 mcfcli[3673891]: %3|1730712240.323|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:24:03 kjcf05n00 mcfcli[3673891]: %3|1730712243.809|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:24:11 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 03:24:11 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 11 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007215 sec, idle for 1 hour(s)] Nov 4 03:24:33 kjcf05n00 mcfcli[3673891]: %3|1730712273.810|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 03:24:38 kjcf05n00 mcfcli[3673891]: %3|1730712278.162|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:25:03 kjcf05n00 mcfcli[3673891]: %3|1730712303.810|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:25:18 kjcf05n00 mcfcli[3673891]: %3|1730712318.159|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:25:22 kjcf05n00 python3.9[1809879]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 03:25:33 kjcf05n00 mcfcli[3673891]: %3|1730712333.810|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:25:57 kjcf05n00 mcfcli[3673891]: %3|1730712357.142|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:26:03 kjcf05n00 mcfcli[3673891]: %3|1730712363.811|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:26:33 kjcf05n00 mcfcli[3673891]: %3|1730712393.811|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:26:33 kjcf05n00 mcfcli[3673891]: %3|1730712393.862|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:27:03 kjcf05n00 mcfcli[3673891]: %3|1730712423.811|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:27:11 kjcf05n00 mcfcli[3673891]: %3|1730712431.783|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:27:33 kjcf05n00 mcfcli[3673891]: %3|1730712453.812|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:27:51 kjcf05n00 mcfcli[3673891]: %3|1730712471.780|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:28:03 kjcf05n00 mcfcli[3673891]: %3|1730712483.812|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:28:31 kjcf05n00 mcfcli[3673891]: %3|1730712511.648|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:28:33 kjcf05n00 mcfcli[3673891]: %3|1730712513.814|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:29:01 kjcf05n00 systemd[1]: Stopping Cluster Controlled httpd... Nov 4 03:29:03 kjcf05n00 systemd[1]: httpd.service: Succeeded. Nov 4 03:29:03 kjcf05n00 systemd[1]: Stopped Cluster Controlled httpd. Nov 4 03:29:03 kjcf05n00 systemd[1]: Starting One-time temporary TLS key generation for httpd.service... Nov 4 03:29:03 kjcf05n00 systemd[1]: httpd-init.service: Succeeded. Nov 4 03:29:03 kjcf05n00 systemd[1]: Started One-time temporary TLS key generation for httpd.service. Nov 4 03:29:03 kjcf05n00 systemd[1]: Starting Cluster Controlled httpd... Nov 4 03:29:03 kjcf05n00 httpd[1812011]: [Mon Nov 04 03:29:03.124170 2024] [so:warn] [pid 1812011:tid 139987446192448] AH01574: module ssl_module is already loaded, skipping Nov 4 03:29:03 kjcf05n00 httpd[1812011]: AH00558: httpd: Could not reliably determine the server's fully qualified domain name, using 172.16.2.3. Set the 'ServerName' directive globally to suppress this message Nov 4 03:29:03 kjcf05n00 systemd[1]: Started Cluster Controlled httpd. Nov 4 03:29:03 kjcf05n00 httpd[1812011]: Server configured, listening on: port 4242, port 443, port 80 Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Accepting connections; addr='AF_INET(0.0.0.0:601)' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/account_lockout.pdb', version='5', pub_date='2015-04-07' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/lustre_iem.pdb', version='5', pub_date='2015-05-22' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/locdrv_iem.pdb', version='4', pub_date='2018-04-27' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/ip-monitor-link.pdb', version='5', pub_date='2019-06-08' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/ext4err.pdb', version='4', pub_date='2016-11-16' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Configuration reload request received, reloading configuration; Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Configuration reload finished; Nov 4 03:29:03 kjcf05n00 mcfcli[3673891]: %3|1730712543.814|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Accepting connections; addr='AF_INET(0.0.0.0:601)' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/account_lockout.pdb', version='5', pub_date='2015-04-07' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/lustre_iem.pdb', version='5', pub_date='2015-05-22' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/locdrv_iem.pdb', version='4', pub_date='2018-04-27' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/ip-monitor-link.pdb', version='5', pub_date='2019-06-08' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/ext4err.pdb', version='4', pub_date='2016-11-16' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Configuration reload request received, reloading configuration; Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Configuration reload finished; Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Accepting connections; addr='AF_INET(0.0.0.0:601)' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/account_lockout.pdb', version='5', pub_date='2015-04-07' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/lustre_iem.pdb', version='5', pub_date='2015-05-22' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/locdrv_iem.pdb', version='4', pub_date='2018-04-27' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/ip-monitor-link.pdb', version='5', pub_date='2019-06-08' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/ext4err.pdb', version='4', pub_date='2016-11-16' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Configuration reload request received, reloading configuration; Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Configuration reload finished; Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Accepting connections; addr='AF_INET(0.0.0.0:601)' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/account_lockout.pdb', version='5', pub_date='2015-04-07' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/lustre_iem.pdb', version='5', pub_date='2015-05-22' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/locdrv_iem.pdb', version='4', pub_date='2018-04-27' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/ip-monitor-link.pdb', version='5', pub_date='2019-06-08' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Log pattern database reloaded; file='/etc/syslog-ng/patterndb.d/ext4err.pdb', version='4', pub_date='2016-11-16' Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Configuration reload request received, reloading configuration; Nov 4 03:29:04 kjcf05n00 syslog-ng[15617]: Configuration reload finished; Nov 4 03:29:08 kjcf05n00 mcfcli[3673891]: %3|1730712548.942|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:29:33 kjcf05n00 mcfcli[3673891]: %3|1730712573.814|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 03:29:47 kjcf05n00 mcfcli[3673891]: %3|1730712587.060|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 03:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 03:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 03:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 03:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 03:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 03:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 03:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 03:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 03:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 03:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 03:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 03:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 03:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 03:30:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 03:30:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:30:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 03:30:03 kjcf05n00 mcfcli[3673891]: %3|1730712603.814|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 03:30:23 kjcf05n00 python3.9[1813434]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 03:30:25 kjcf05n00 mcfcli[3673891]: %3|1730712625.913|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:30:33 kjcf05n00 mcfcli[3673891]: %3|1730712633.815|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:31:03 kjcf05n00 mcfcli[3673891]: %3|1730712663.535|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:31:03 kjcf05n00 mcfcli[3673891]: %3|1730712663.815|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 03:31:33 kjcf05n00 mcfcli[3673891]: %3|1730712693.817|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:31:41 kjcf05n00 mcfcli[3673891]: %3|1730712701.121|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:32:03 kjcf05n00 mcfcli[3673891]: %3|1730712723.817|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:32:18 kjcf05n00 mcfcli[3673891]: %3|1730712738.420|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:32:33 kjcf05n00 mcfcli[3673891]: %3|1730712753.817|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 03:32:54 kjcf05n00 mcfcli[3673891]: %3|1730712774.914|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:33:03 kjcf05n00 mcfcli[3673891]: %3|1730712783.818|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 03:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T03:33:27.267885074-06:00 level=info msg="Completed cleanup jobs" duration=41.282383ms Nov 4 03:33:33 kjcf05n00 mcfcli[3673891]: %3|1730712813.441|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:33:33 kjcf05n00 mcfcli[3673891]: %3|1730712813.819|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 03:34:03 kjcf05n00 mcfcli[3673891]: %3|1730712843.820|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 03:34:12 kjcf05n00 mcfcli[3673891]: %3|1730712852.666|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:34:18 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 4 03:34:33 kjcf05n00 mcfcli[3673891]: %3|1730712873.821|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:34:50 kjcf05n02 nslcd[6896]: [bbd95a] ldap_result() failed: Can't contact LDAP server Nov 4 03:34:51 kjcf05n00 mcfcli[3673891]: %3|1730712891.754|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:35:03 kjcf05n00 mcfcli[3673891]: %3|1730712903.821|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 03:35:13 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 4 03:35:13 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/23', errno='Permission denied (13)' Nov 4 03:35:13 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/24', errno='Permission denied (13)' Nov 4 03:35:19 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 4 03:35:22 kjcf05n00 python3.9[1816382]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 03:35:30 kjcf05n00 mcfcli[3673891]: %3|1730712930.087|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:35:33 kjcf05n00 mcfcli[3673891]: %3|1730712933.822|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:36:03 kjcf05n00 mcfcli[3673891]: %3|1730712963.823|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:36:09 kjcf05n00 mcfcli[3673891]: %3|1730712969.709|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:36:33 kjcf05n00 mcfcli[3673891]: %3|1730712993.823|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:36:49 kjcf05n00 mcfcli[3673891]: %3|1730713009.225|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:37:03 kjcf05n00 mcfcli[3673891]: %3|1730713023.823|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:37:28 kjcf05n00 mcfcli[3673891]: %3|1730713048.659|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:37:33 kjcf05n00 mcfcli[3673891]: %3|1730713053.825|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 03:38:03 kjcf05n00 mcfcli[3673891]: %3|1730713083.825|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 03:38:04 kjcf05n00 mcfcli[3673891]: %3|1730713084.974|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:38:33 kjcf05n00 mcfcli[3673891]: %3|1730713113.825|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 03:38:42 kjcf05n00 mcfcli[3673891]: %3|1730713122.617|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:39:03 kjcf05n00 mcfcli[3673891]: %3|1730713143.825|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:39:18 kjcf05n00 mcfcli[3673891]: %3|1730713158.236|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:39:33 kjcf05n00 mcfcli[3673891]: %3|1730713173.826|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:39:57 kjcf05n00 mcfcli[3673891]: %3|1730713197.360|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 03:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 03:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 03:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 03:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 03:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 03:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 03:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 03:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 03:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 03:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 03:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 03:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 03:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 03:40:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 03:40:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:40:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 03:40:03 kjcf05n00 mcfcli[3673891]: %3|1730713203.826|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:40:23 kjcf05n00 python3.9[1819185]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 03:40:33 kjcf05n00 mcfcli[3673891]: %3|1730713233.827|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 03:40:33 kjcf05n00 mcfcli[3673891]: %3|1730713233.856|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:40:49 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 4 03:41:03 kjcf05n00 mcfcli[3673891]: %3|1730713263.828|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:41:13 kjcf05n00 mcfcli[3673891]: %3|1730713273.854|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:41:33 kjcf05n00 mcfcli[3673891]: %3|1730713293.828|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:41:53 kjcf05n00 mcfcli[3673891]: %3|1730713313.850|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:42:03 kjcf05n00 mcfcli[3673891]: %3|1730713323.829|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 03:42:32 kjcf05n00 mcfcli[3673891]: %3|1730713352.601|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:42:33 kjcf05n00 mcfcli[3673891]: %3|1730713353.830|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:43:03 kjcf05n00 mcfcli[3673891]: %3|1730713383.830|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:43:08 kjcf05n00 mcfcli[3673891]: %3|1730713388.428|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T03:43:27.268055848-06:00 level=info msg="Completed cleanup jobs" duration=41.295578ms Nov 4 03:43:33 kjcf05n00 mcfcli[3673891]: %3|1730713413.830|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:43:47 kjcf05n00 mcfcli[3673891]: %3|1730713427.694|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:44:03 kjcf05n00 mcfcli[3673891]: %3|1730713443.830|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 03:44:26 kjcf05n00 mcfcli[3673891]: %3|1730713466.376|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:44:33 kjcf05n00 mcfcli[3673891]: %3|1730713473.830|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:44:47 kjcf05n05 dwd[10696]: md1 read await report (#disks=53, min #ops=1.5e6): mean=27.8, sd=1.4, min=23.4, q1=27.3, q2=27.9, q3=28.7, max=30.2 (dm-93/0x5000c500c9adadcf) Nov 4 03:44:47 kjcf05n05 dwd[10696]: md1 write await report (#disks=53, min #ops=1.3e6): mean=29.7, sd=1.1, min=28.0, q1=29.0, q2=29.6, q3=30.2, max=33.8 (dm-93/0x5000c500c9adadcf) Nov 4 03:45:03 kjcf05n00 mcfcli[3673891]: %3|1730713503.832|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:45:06 kjcf05n00 mcfcli[3673891]: %3|1730713506.373|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:45:23 kjcf05n00 python3.9[1822045]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 03:45:33 kjcf05n00 mcfcli[3673891]: %3|1730713533.832|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:45:40 kjcf05n04 dwd[10437]: md0 read await report (#disks=53, min #ops=1.5e6): mean=25.9, sd=1.0, min=22.7, q1=25.5, q2=26.0, q3=26.4, max=29.1 (dm-83/0x5000c500c9adb153) Nov 4 03:45:40 kjcf05n04 dwd[10437]: md0 write await report (#disks=53, min #ops=1.2e6): mean=29.3, sd=1.2, min=27.2, q1=28.6, q2=28.9, q3=30.0, max=32.5 (dm-83/0x5000c500c9adb153) Nov 4 03:45:44 kjcf05n00 mcfcli[3673891]: %3|1730713544.753|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:45:58 kjcf05n06 dwd[5504]: md128 write await report (#disks=12, min #ops=1.0e5): mean=0.0, sd=0.0, min=0.0, q1=0.0, q2=0.0, q3=0.0, max=0.0 (nvme18n1p1/eui.345950304e3005900025384500000003) Nov 4 03:45:58 kjcf05n06 dwd[5504]: md0 read await report (#disks=12, min #ops=9.6e6): mean=0.3, sd=0.0, min=0.3, q1=0.3, q2=0.3, q3=0.3, max=0.3 (nvme4n1p3/eui.345950304e3006210025384500000003) Nov 4 03:45:58 kjcf05n06 dwd[5504]: md0 write await report (#disks=12, min #ops=1.3e7): mean=0.3, sd=0.0, min=0.3, q1=0.3, q2=0.3, q3=0.3, max=0.3 (nvme4n1p3/eui.345950304e3006210025384500000003) Nov 4 03:45:58 kjcf05n06 dwd[5504]: md129 write await report (#disks=12, min #ops=6.3e4): mean=0.1, sd=0.0, min=0.1, q1=0.1, q2=0.1, q3=0.1, max=0.1 (nvme23n1p2/eui.345950304e3005880025384500000003) Nov 4 03:46:03 kjcf05n00 mcfcli[3673891]: %3|1730713563.832|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:46:08 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 4 03:46:08 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/23', errno='Permission denied (13)' Nov 4 03:46:08 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/24', errno='Permission denied (13)' Nov 4 03:46:23 kjcf05n00 mcfcli[3673891]: %3|1730713583.406|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:46:30 kjcf05n07 dwd[5489]: md130 write await report (#disks=12, min #ops=1.0e5): mean=0.0, sd=0.0, min=0.0, q1=0.0, q2=0.0, q3=0.0, max=0.0 (nvme11n1p1/eui.345950304e3006080025384500000003) Nov 4 03:46:30 kjcf05n07 dwd[5489]: md1 read await report (#disks=12, min #ops=1.0e7): mean=0.3, sd=0.0, min=0.3, q1=0.3, q2=0.3, q3=0.3, max=0.3 (nvme7n1p3/eui.345950304e3006150025384500000003) Nov 4 03:46:30 kjcf05n07 dwd[5489]: md1 write await report (#disks=12, min #ops=1.4e7): mean=0.3, sd=0.0, min=0.3, q1=0.3, q2=0.3, q3=0.3, max=0.4 (nvme7n1p3/eui.345950304e3006150025384500000003) Nov 4 03:46:30 kjcf05n07 dwd[5489]: md131 write await report (#disks=12, min #ops=6.8e4): mean=0.1, sd=0.0, min=0.1, q1=0.1, q2=0.1, q3=0.1, max=0.1 (nvme5n1p2/eui.345950304e3006240025384500000003) Nov 4 03:46:33 kjcf05n00 mcfcli[3673891]: %3|1730713593.832|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 03:47:02 kjcf05n00 mcfcli[3673891]: %3|1730713622.083|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:47:03 kjcf05n00 mcfcli[3673891]: %3|1730713623.834|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:47:33 kjcf05n00 mcfcli[3673891]: %3|1730713653.834|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:47:39 kjcf05n00 mcfcli[3673891]: %3|1730713659.126|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:47:45 kjcf05n04 diskmonitor[39342]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 03:48:03 kjcf05n00 mcfcli[3673891]: %3|1730713683.834|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:48:10 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 4 03:48:17 kjcf05n00 mcfcli[3673891]: %3|1730713697.076|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:48:33 kjcf05n00 mcfcli[3673891]: %3|1730713713.834|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:48:57 kjcf05n00 mcfcli[3673891]: %3|1730713737.073|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:49:03 kjcf05n00 mcfcli[3673891]: %3|1730713743.836|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:49:07 kjcf05n06 diskmonitor[19372]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 03:49:20 kjcf05n07 diskmonitor[19063]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 03:49:33 kjcf05n00 mcfcli[3673891]: %3|1730713773.836|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:49:35 kjcf05n00 mcfcli[3673891]: %3|1730713775.125|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:49:42 kjcf05n05 diskmonitor[40540]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 03:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 03:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 03:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 03:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 03:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 03:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 03:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 03:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 03:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 03:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 03:50:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 03:50:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:50:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 03:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 03:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 03:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 03:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 03:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 03:50:03 kjcf05n00 mcfcli[3673891]: %3|1730713803.836|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:50:14 kjcf05n00 mcfcli[3673891]: %3|1730713814.664|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:50:23 kjcf05n00 python3.9[1824827]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 03:50:33 kjcf05n00 mcfcli[3673891]: %3|1730713833.836|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:50:54 kjcf05n00 mcfcli[3673891]: %3|1730713854.661|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:51:03 kjcf05n00 mcfcli[3673891]: %3|1730713863.837|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:51:29 kjcf05n00 mcfcli[3673891]: %3|1730713889.545|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:51:33 kjcf05n00 mcfcli[3673891]: %3|1730713893.838|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 03:52:03 kjcf05n00 mcfcli[3673891]: %3|1730713923.838|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 03:52:07 kjcf05n00 mcfcli[3673891]: %3|1730713927.610|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:52:33 kjcf05n00 mcfcli[3673891]: %3|1730713953.839|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:52:45 kjcf05n00 mcfcli[3673891]: %3|1730713965.961|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:53:03 kjcf05n00 mcfcli[3673891]: %3|1730713983.840|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T09:53:15.867473Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 03:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T09:53:15.867537Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.085ms Nov 4 03:53:23 kjcf05n00 mcfcli[3673891]: %3|1730714003.705|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T03:53:27.2621296-06:00 level=info msg="Completed cleanup jobs" duration=35.527355ms Nov 4 03:53:33 kjcf05n00 mcfcli[3673891]: %3|1730714013.840|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 03:54:01 kjcf05n00 mcfcli[3673891]: %3|1730714041.528|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:54:04 kjcf05n00 mcfcli[3673891]: %3|1730714044.341|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 03:54:11 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 4 03:54:34 kjcf05n00 mcfcli[3673891]: %3|1730714074.342|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:54:39 kjcf05n00 mcfcli[3673891]: %3|1730714079.135|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:54:50 kjcf05n02 nslcd[6896]: [6c6125] ldap_result() failed: Can't contact LDAP server Nov 4 03:55:04 kjcf05n00 mcfcli[3673891]: %3|1730714104.681|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 03:55:15 kjcf05n00 mcfcli[3673891]: %3|1730714115.376|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:55:29 kjcf05n00 python3.9[1827660]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 03:55:34 kjcf05n00 mcfcli[3673891]: %3|1730714134.842|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:55:54 kjcf05n00 mcfcli[3673891]: %3|1730714154.516|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:56:04 kjcf05n00 mcfcli[3673891]: %3|1730714164.842|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 03:56:32 kjcf05n00 mcfcli[3673891]: %3|1730714192.110|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:56:34 kjcf05n00 mcfcli[3673891]: %3|1730714194.842|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:57:04 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 4 03:57:04 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/23', errno='Permission denied (13)' Nov 4 03:57:04 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/24', errno='Permission denied (13)' Nov 4 03:57:04 kjcf05n00 mcfcli[3673891]: %3|1730714224.843|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:57:12 kjcf05n00 mcfcli[3673891]: %3|1730714232.107|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:57:34 kjcf05n00 mcfcli[3673891]: %3|1730714254.843|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:57:52 kjcf05n00 mcfcli[3673891]: %3|1730714272.104|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:58:04 kjcf05n00 mcfcli[3673891]: %3|1730714284.845|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:58:31 kjcf05n00 mcfcli[3673891]: %3|1730714311.082|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:58:34 kjcf05n00 mcfcli[3673891]: %3|1730714314.845|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 03:59:04 kjcf05n00 mcfcli[3673891]: %3|1730714344.845|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:59:09 kjcf05n00 mcfcli[3673891]: %3|1730714349.381|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 03:59:34 kjcf05n00 mcfcli[3673891]: %3|1730714374.845|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 03:59:49 kjcf05n00 mcfcli[3673891]: %3|1730714389.378|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 04:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 04:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 04:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 04:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 04:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 04:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 04:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 04:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 04:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 04:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 04:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 04:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 04:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 04:00:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 04:00:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:00:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 04:00:01 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 4 04:00:04 kjcf05n00 mcfcli[3673891]: %3|1730714404.845|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 04:00:23 kjcf05n00 python3.9[1830509]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 04:00:27 kjcf05n00 mcfcli[3673891]: %3|1730714427.628|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:00:34 kjcf05n00 mcfcli[3673891]: %3|1730714434.846|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:01:04 kjcf05n00 mcfcli[3673891]: %3|1730714464.846|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:01:07 kjcf05n00 mcfcli[3673891]: %3|1730714467.092|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:01:34 kjcf05n00 mcfcli[3673891]: %3|1730714494.847|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 04:01:44 kjcf05n00 mcfcli[3673891]: %3|1730714504.874|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:02:04 kjcf05n00 mcfcli[3673891]: %3|1730714524.847|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 04:02:23 kjcf05n00 mcfcli[3673891]: %3|1730714543.985|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:02:32 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 4 04:02:34 kjcf05n00 mcfcli[3673891]: %3|1730714554.849|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:03:01 kjcf05n00 mcfcli[3673891]: %3|1730714581.624|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:03:04 kjcf05n00 mcfcli[3673891]: %3|1730714584.849|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T04:03:27.252580356-06:00 level=info msg="Completed cleanup jobs" duration=26.15366ms Nov 4 04:03:34 kjcf05n00 mcfcli[3673891]: %3|1730714614.849|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:03:38 kjcf05n00 mcfcli[3673891]: %3|1730714618.964|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:04:04 kjcf05n00 mcfcli[3673891]: %3|1730714644.849|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 04:04:16 kjcf05n00 mcfcli[3673891]: %3|1730714656.711|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:04:34 kjcf05n00 mcfcli[3673891]: %3|1730714674.849|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 04:04:52 kjcf05n00 mcfcli[3673891]: %3|1730714692.795|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:05:04 kjcf05n00 mcfcli[3673891]: %3|1730714704.850|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:05:23 kjcf05n00 python3.9[1833358]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 04:05:30 kjcf05n00 mcfcli[3673891]: %3|1730714730.913|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:05:34 kjcf05n00 mcfcli[3673891]: %3|1730714734.851|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 04:06:04 kjcf05n00 mcfcli[3673891]: %3|1730714764.851|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:06:09 kjcf05n00 mcfcli[3673891]: %3|1730714769.054|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:06:34 kjcf05n00 mcfcli[3673891]: %3|1730714794.852|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 04:06:46 kjcf05n00 mcfcli[3673891]: %3|1730714806.496|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:07:04 kjcf05n00 mcfcli[3673891]: %3|1730714824.852|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:07:26 kjcf05n00 mcfcli[3673891]: %3|1730714846.493|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:07:30 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 04:07:34 kjcf05n00 mcfcli[3673891]: %3|1730714854.853|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:07:53 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 04:07:58 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 04:07:58 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 04:07:59 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/17', errno='Permission denied (13)' Nov 4 04:07:59 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/23', errno='Permission denied (13)' Nov 4 04:07:59 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/24', errno='Permission denied (13)' Nov 4 04:08:02 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 04:08:02 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 04:08:02 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 04:08:04 kjcf05n00 mcfcli[3673891]: %3|1730714884.853|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:08:05 kjcf05n00 mcfcli[3673891]: %3|1730714885.536|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:08:21 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 04:08:21 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 04:08:34 kjcf05n00 mcfcli[3673891]: %3|1730714914.855|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:08:45 kjcf05n00 mcfcli[3673891]: %3|1730714925.533|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:09:04 kjcf05n00 mcfcli[3673891]: %3|1730714944.855|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:09:07 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 04:09:07 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 04:09:07 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 04:09:20 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 04:09:20 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 04:09:20 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 04:09:24 kjcf05n00 mcfcli[3673891]: %3|1730714964.755|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:09:34 kjcf05n00 mcfcli[3673891]: %3|1730714974.855|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 04:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 04:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 04:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 04:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 04:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 04:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 04:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 04:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 04:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 04:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 04:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 04:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 04:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 04:10:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 04:10:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:10:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 04:10:03 kjcf05n00 mcfcli[3673891]: %3|1730715003.046|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:10:04 kjcf05n00 mcfcli[3673891]: %3|1730715004.856|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 04:10:23 kjcf05n00 python3.9[1836237]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 04:10:34 kjcf05n00 mcfcli[3673891]: %3|1730715034.856|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 04:10:38 kjcf05n00 mcfcli[3673891]: %3|1730715038.667|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:10:39 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 04:10:39 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 04:10:39 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 04:11:04 kjcf05n00 mcfcli[3673891]: %3|1730715064.856|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 04:11:17 kjcf05n00 mcfcli[3673891]: %3|1730715077.552|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:11:34 kjcf05n00 mcfcli[3673891]: %3|1730715094.856|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:11:57 kjcf05n00 mcfcli[3673891]: %3|1730715117.549|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:12:04 kjcf05n00 mcfcli[3673891]: %3|1730715124.857|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:12:34 kjcf05n00 mcfcli[3673891]: %3|1730715154.857|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:12:36 kjcf05n00 mcfcli[3673891]: %3|1730715156.834|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:13:04 kjcf05n00 mcfcli[3673891]: %3|1730715184.857|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 04:13:12 kjcf05n00 mcfcli[3673891]: %3|1730715192.757|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T04:13:27.254480689-06:00 level=info msg="Completed cleanup jobs" duration=27.416776ms Nov 4 04:13:34 kjcf05n00 mcfcli[3673891]: %3|1730715214.859|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:13:52 kjcf05n00 mcfcli[3673891]: %3|1730715232.149|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:14:04 kjcf05n00 mcfcli[3673891]: %3|1730715244.859|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:14:32 kjcf05n00 mcfcli[3673891]: %3|1730715272.146|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:14:34 kjcf05n00 mcfcli[3673891]: %3|1730715274.859|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:15:04 kjcf05n00 mcfcli[3673891]: %3|1730715304.859|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:15:12 kjcf05n00 mcfcli[3673891]: %3|1730715312.046|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:15:23 kjcf05n00 python3.9[1839087]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 04:15:34 kjcf05n00 mcfcli[3673891]: %3|1730715334.859|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 04:15:48 kjcf05n00 mcfcli[3673891]: %3|1730715348.335|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:16:04 kjcf05n00 mcfcli[3673891]: %3|1730715364.861|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 04:16:25 kjcf05n00 mcfcli[3673891]: %3|1730715385.186|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:16:34 kjcf05n00 mcfcli[3673891]: %3|1730715394.861|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 04:17:04 kjcf05n00 mcfcli[3673891]: %3|1730715424.595|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:17:04 kjcf05n00 mcfcli[3673891]: %3|1730715424.862|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 04:17:34 kjcf05n00 mcfcli[3673891]: %3|1730715454.862|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 04:17:43 kjcf05n00 mcfcli[3673891]: %3|1730715463.331|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:18:04 kjcf05n00 mcfcli[3673891]: %3|1730715484.862|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 04:18:22 kjcf05n00 mcfcli[3673891]: %3|1730715502.845|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:18:34 kjcf05n00 mcfcli[3673891]: %3|1730715514.863|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 04:18:59 kjcf05n00 mcfcli[3673891]: %3|1730715539.620|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:19:04 kjcf05n00 mcfcli[3673891]: %3|1730715544.863|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 04:19:33 kjcf05n00 mcfcli[3673891]: %3|1730715573.453|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:19:34 kjcf05n00 mcfcli[3673891]: %3|1730715574.864|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 04:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 04:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 04:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 04:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 04:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 04:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 04:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 04:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 04:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 04:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 04:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 04:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 04:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 04:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 04:20:03 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 04:20:03 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:20:03 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 04:20:04 kjcf05n00 mcfcli[3673891]: %3|1730715604.865|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:20:11 kjcf05n00 mcfcli[3673891]: %3|1730715611.947|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:20:23 kjcf05n00 python3.9[1841953]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 04:20:34 kjcf05n00 mcfcli[3673891]: %3|1730715634.865|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 04:20:51 kjcf05n00 mcfcli[3673891]: %3|1730715651.944|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:21:04 kjcf05n00 mcfcli[3673891]: %3|1730715664.865|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:21:28 kjcf05n00 mcfcli[3673891]: %3|1730715688.854|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:21:34 kjcf05n00 mcfcli[3673891]: %3|1730715694.865|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 04:22:00 kjcf05n00 mcfcli[3673891]: %3|1730715720.921|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:22:04 kjcf05n00 mcfcli[3673891]: %3|1730715724.865|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 04:22:34 kjcf05n00 mcfcli[3673891]: %3|1730715754.867|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 04:22:39 kjcf05n00 mcfcli[3673891]: %3|1730715759.702|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:23:04 kjcf05n00 mcfcli[3673891]: %3|1730715784.867|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 04:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T10:23:15.867862Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 04:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T10:23:15.867923Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.081ms Nov 4 04:23:19 kjcf05n00 mcfcli[3673891]: %3|1730715799.335|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T04:23:27.253428006-06:00 level=info msg="Completed cleanup jobs" duration=26.643177ms Nov 4 04:23:34 kjcf05n00 mcfcli[3673891]: %3|1730715814.868|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 04:23:57 kjcf05n00 mcfcli[3673891]: %3|1730715837.623|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:24:04 kjcf05n00 mcfcli[3673891]: %3|1730715844.868|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:24:11 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 04:24:11 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 10 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007292 sec, idle for 1 hour(s)] Nov 4 04:24:34 kjcf05n00 mcfcli[3673891]: %3|1730715874.868|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:24:35 kjcf05n00 mcfcli[3673891]: %3|1730715875.804|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:25:04 kjcf05n00 mcfcli[3673891]: %3|1730715904.869|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:25:15 kjcf05n00 mcfcli[3673891]: %3|1730715915.424|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:25:23 kjcf05n00 python3.9[1844918]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 04:25:34 kjcf05n00 mcfcli[3673891]: %3|1730715934.870|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 04:25:53 kjcf05n00 mcfcli[3673891]: %3|1730715953.436|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:26:04 kjcf05n00 mcfcli[3673891]: %3|1730715964.870|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:26:31 kjcf05n00 mcfcli[3673891]: %3|1730715991.756|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:26:34 kjcf05n00 mcfcli[3673891]: %3|1730715994.871|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:27:04 kjcf05n00 mcfcli[3673891]: %3|1730716024.871|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 04:27:10 kjcf05n00 mcfcli[3673891]: %3|1730716030.734|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:27:34 kjcf05n00 mcfcli[3673891]: %3|1730716054.872|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 04:27:47 kjcf05n00 mcfcli[3673891]: %3|1730716067.324|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:28:04 kjcf05n00 mcfcli[3673891]: %3|1730716084.873|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 04:28:26 kjcf05n00 mcfcli[3673891]: %3|1730716106.227|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:28:34 kjcf05n00 mcfcli[3673891]: %3|1730716114.873|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:29:04 kjcf05n00 mcfcli[3673891]: %3|1730716144.874|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 04:29:05 kjcf05n00 mcfcli[3673891]: %3|1730716145.916|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:29:34 kjcf05n00 mcfcli[3673891]: %3|1730716174.874|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 04:29:43 kjcf05n00 mcfcli[3673891]: %3|1730716183.965|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 04:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 04:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 04:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 04:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 04:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 04:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 04:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 04:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 04:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 04:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 04:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 04:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 04:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 04:30:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 04:30:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:30:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 04:30:04 kjcf05n00 mcfcli[3673891]: %3|1730716204.875|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:30:22 kjcf05n00 mcfcli[3673891]: %3|1730716222.549|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:30:27 kjcf05n00 python3.9[1847730]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 04:30:34 kjcf05n00 mcfcli[3673891]: %3|1730716234.876|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 04:31:00 kjcf05n00 mcfcli[3673891]: %3|1730716260.142|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:31:04 kjcf05n00 mcfcli[3673891]: %3|1730716264.876|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:31:34 kjcf05n00 mcfcli[3673891]: %3|1730716294.876|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 04:31:37 kjcf05n00 mcfcli[3673891]: %3|1730716297.306|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:32:04 kjcf05n00 mcfcli[3673891]: %3|1730716324.877|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:32:15 kjcf05n00 mcfcli[3673891]: %3|1730716335.580|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:32:34 kjcf05n00 mcfcli[3673891]: %3|1730716354.878|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:32:53 kjcf05n00 mcfcli[3673891]: %3|1730716373.571|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:33:04 kjcf05n00 mcfcli[3673891]: %3|1730716384.879|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 04:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T04:33:27.267912257-06:00 level=info msg="Completed cleanup jobs" duration=41.320044ms Nov 4 04:33:31 kjcf05n00 mcfcli[3673891]: %3|1730716411.676|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:33:34 kjcf05n00 mcfcli[3673891]: %3|1730716414.879|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 04:33:42 kjcf05n04 python3.9[10466]: [ses_monitor.py:863 - send_syslog_gem_msg() ] [INFO] CSM:Generic : GEM /dev/sg10 SGFGD20025060FF: 2024-11-04 05:33:52.211; HAL; hal; 02; Bad CRC on IPC frame on expected 00000001 got 2efa46e2 on endpoint I2C Transport 5:1 Nov 4 04:34:04 kjcf05n00 mcfcli[3673891]: %3|1730716444.879|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 04:34:10 kjcf05n00 mcfcli[3673891]: %3|1730716450.332|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:34:34 kjcf05n00 mcfcli[3673891]: %3|1730716474.879|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 04:34:47 kjcf05n00 mcfcli[3673891]: %3|1730716487.551|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:35:04 kjcf05n00 mcfcli[3673891]: %3|1730716504.880|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 04:35:23 kjcf05n00 python3.9[1850510]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 04:35:27 kjcf05n00 mcfcli[3673891]: %3|1730716527.548|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:35:34 kjcf05n00 mcfcli[3673891]: %3|1730716534.881|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 04:36:04 kjcf05n00 mcfcli[3673891]: %3|1730716564.881|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:36:06 kjcf05n00 mcfcli[3673891]: %3|1730716566.958|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:36:34 kjcf05n00 mcfcli[3673891]: %3|1730716594.881|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:36:46 kjcf05n00 mcfcli[3673891]: %3|1730716606.955|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:37:04 kjcf05n00 mcfcli[3673891]: %3|1730716624.881|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:37:26 kjcf05n00 mcfcli[3673891]: %3|1730716646.952|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:37:34 kjcf05n00 mcfcli[3673891]: %3|1730716654.883|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:38:04 kjcf05n00 mcfcli[3673891]: %3|1730716684.883|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:38:04 kjcf05n00 mcfcli[3673891]: %3|1730716684.936|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:38:34 kjcf05n00 mcfcli[3673891]: %3|1730716714.883|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 04:38:42 kjcf05n00 mcfcli[3673891]: %3|1730716722.793|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:39:04 kjcf05n00 mcfcli[3673891]: %3|1730716744.883|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:39:20 kjcf05n00 mcfcli[3673891]: %3|1730716760.393|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:39:34 kjcf05n00 mcfcli[3673891]: %3|1730716774.884|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 04:39:56 kjcf05n00 mcfcli[3673891]: %3|1730716796.971|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 04:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 04:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 04:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 04:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 04:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 04:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 04:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 04:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 04:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 04:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 04:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 04:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 04:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 04:40:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 04:40:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:40:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 04:40:04 kjcf05n00 mcfcli[3673891]: %3|1730716804.884|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:40:25 kjcf05n00 python3.9[1853280]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 04:40:34 kjcf05n00 mcfcli[3673891]: %3|1730716834.886|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 04:40:36 kjcf05n00 mcfcli[3673891]: %3|1730716836.968|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:41:04 kjcf05n00 mcfcli[3673891]: %3|1730716864.886|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 04:41:11 kjcf05n00 mcfcli[3673891]: %3|1730716871.769|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:41:34 kjcf05n00 mcfcli[3673891]: %3|1730716894.886|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:41:51 kjcf05n00 mcfcli[3673891]: %3|1730716911.767|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:42:04 kjcf05n00 mcfcli[3673891]: %3|1730716924.886|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:42:31 kjcf05n00 mcfcli[3673891]: %3|1730716951.764|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:42:34 kjcf05n00 mcfcli[3673891]: %3|1730716954.886|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:43:04 kjcf05n00 mcfcli[3673891]: %3|1730716984.886|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:43:11 kjcf05n00 mcfcli[3673891]: %3|1730716991.761|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T04:43:27.252944685-06:00 level=info msg="Completed cleanup jobs" duration=26.461076ms Nov 4 04:43:34 kjcf05n00 mcfcli[3673891]: %3|1730717014.888|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:43:50 kjcf05n00 mcfcli[3673891]: %3|1730717030.530|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:44:04 kjcf05n00 mcfcli[3673891]: %3|1730717044.888|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:44:28 kjcf05n00 mcfcli[3673891]: %3|1730717068.240|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:44:34 kjcf05n00 mcfcli[3673891]: %3|1730717074.888|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:45:04 kjcf05n00 mcfcli[3673891]: %3|1730717104.037|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:45:04 kjcf05n00 mcfcli[3673891]: %3|1730717104.888|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 04:45:24 kjcf05n00 python3.9[1856302]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 04:45:34 kjcf05n00 mcfcli[3673891]: %3|1730717134.888|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 04:45:42 kjcf05n00 mcfcli[3673891]: %3|1730717142.289|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:46:04 kjcf05n00 mcfcli[3673891]: %3|1730717164.890|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:46:21 kjcf05n00 mcfcli[3673891]: %3|1730717181.993|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:46:34 kjcf05n00 mcfcli[3673891]: %3|1730717194.890|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:47:01 kjcf05n00 mcfcli[3673891]: %3|1730717221.990|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:47:04 kjcf05n00 mcfcli[3673891]: %3|1730717224.890|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:47:34 kjcf05n00 mcfcli[3673891]: %3|1730717254.890|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 04:47:39 kjcf05n00 mcfcli[3673891]: %3|1730717259.088|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:48:04 kjcf05n00 mcfcli[3673891]: %3|1730717284.891|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 04:48:15 kjcf05n00 mcfcli[3673891]: %3|1730717295.288|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:48:34 kjcf05n00 mcfcli[3673891]: %3|1730717314.891|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 04:48:54 kjcf05n00 mcfcli[3673891]: %3|1730717334.085|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:49:04 kjcf05n00 mcfcli[3673891]: %3|1730717344.892|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 04:49:32 kjcf05n00 mcfcli[3673891]: %3|1730717372.921|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:49:34 kjcf05n00 mcfcli[3673891]: %3|1730717374.892|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 04:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 04:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 04:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 04:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 04:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 04:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 04:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 04:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 04:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 04:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 04:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 04:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 04:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 04:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 04:50:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 04:50:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 04:50:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 04:50:04 kjcf05n00 mcfcli[3673891]: %3|1730717404.892|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 04:50:12 kjcf05n00 mcfcli[3673891]: %3|1730717412.918|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:50:24 kjcf05n00 python3.9[1859113]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 04:50:34 kjcf05n00 mcfcli[3673891]: %3|1730717434.893|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 04:50:51 kjcf05n00 mcfcli[3673891]: %3|1730717451.337|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:51:04 kjcf05n00 mcfcli[3673891]: %3|1730717464.894|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 04:51:31 kjcf05n00 mcfcli[3673891]: %3|1730717491.334|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:51:34 kjcf05n00 mcfcli[3673891]: %3|1730717494.894|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:52:04 kjcf05n00 mcfcli[3673891]: %3|1730717524.894|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:52:09 kjcf05n00 mcfcli[3673891]: %3|1730717529.818|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:52:34 kjcf05n00 mcfcli[3673891]: %3|1730717554.894|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 04:52:49 kjcf05n00 mcfcli[3673891]: %3|1730717569.439|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:53:04 kjcf05n00 mcfcli[3673891]: %3|1730717584.896|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 04:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T10:53:15.868247Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 04:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T10:53:15.868310Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.084ms Nov 4 04:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T04:53:27.2540261-06:00 level=info msg="Completed cleanup jobs" duration=27.389334ms Nov 4 04:53:28 kjcf05n00 mcfcli[3673891]: %3|1730717608.707|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:53:34 kjcf05n00 mcfcli[3673891]: %3|1730717614.896|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 04:54:04 kjcf05n00 mcfcli[3673891]: %3|1730717644.896|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 04:54:06 kjcf05n00 mcfcli[3673891]: %3|1730717646.283|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:54:34 kjcf05n00 mcfcli[3673891]: %3|1730717674.898|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 04:54:42 kjcf05n00 mcfcli[3673891]: %3|1730717682.764|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:54:50 kjcf05n02 nslcd[6896]: [1da317] ldap_result() failed: Can't contact LDAP server Nov 4 04:55:04 kjcf05n00 mcfcli[3673891]: %3|1730717704.898|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:55:19 kjcf05n00 mcfcli[3673891]: %3|1730717719.431|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:55:24 kjcf05n00 python3.9[1861841]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 04:55:34 kjcf05n00 mcfcli[3673891]: %3|1730717734.898|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 04:55:58 kjcf05n00 mcfcli[3673891]: %3|1730717758.098|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:56:04 kjcf05n00 mcfcli[3673891]: %3|1730717764.898|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:56:34 kjcf05n00 mcfcli[3673891]: %3|1730717794.898|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:56:35 kjcf05n00 mcfcli[3673891]: %3|1730717795.674|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:57:05 kjcf05n00 mcfcli[3673891]: %3|1730717825.399|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 04:57:13 kjcf05n00 mcfcli[3673891]: %3|1730717833.137|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:57:35 kjcf05n00 mcfcli[3673891]: %3|1730717855.400|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:57:53 kjcf05n00 mcfcli[3673891]: %3|1730717873.134|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:58:05 kjcf05n00 mcfcli[3673891]: %3|1730717885.708|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 04:58:33 kjcf05n00 mcfcli[3673891]: %3|1730717913.131|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:58:35 kjcf05n00 mcfcli[3673891]: %3|1730717915.709|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 04:59:05 kjcf05n00 mcfcli[3673891]: %3|1730717945.709|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 04:59:12 kjcf05n00 mcfcli[3673891]: %3|1730717952.886|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 04:59:35 kjcf05n00 mcfcli[3673891]: %3|1730717975.709|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 04:59:50 kjcf05n00 mcfcli[3673891]: %3|1730717990.587|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 05:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 05:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 05:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 05:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 05:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 05:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 05:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 05:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 05:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 05:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 05:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 05:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 05:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 05:00:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 05:00:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:00:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 05:00:05 kjcf05n00 mcfcli[3673891]: %3|1730718005.710|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:00:23 kjcf05n00 python3.9[1864791]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 05:00:28 kjcf05n00 mcfcli[3673891]: %3|1730718028.920|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:00:35 kjcf05n00 mcfcli[3673891]: %3|1730718035.903|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:01:05 kjcf05n00 mcfcli[3673891]: %3|1730718065.903|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 05:01:06 kjcf05n00 mcfcli[3673891]: %3|1730718066.724|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:01:35 kjcf05n00 mcfcli[3673891]: %3|1730718095.903|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 05:01:45 kjcf05n00 mcfcli[3673891]: %3|1730718105.852|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:02:05 kjcf05n00 mcfcli[3673891]: %3|1730718125.904|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:02:23 kjcf05n00 mcfcli[3673891]: %3|1730718143.549|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:02:35 kjcf05n00 mcfcli[3673891]: %3|1730718155.905|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:02:59 kjcf05n00 mcfcli[3673891]: %3|1730718179.584|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:03:05 kjcf05n00 mcfcli[3673891]: %3|1730718185.905|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:03:09 kjcf05n01 diskmonitor[1331407]: leaving test state: 1 next state: 2 Nov 4 05:03:09 kjcf05n01 diskmonitor[1331407]: lock req: no timeout Nov 4 05:03:09 kjcf05n01 diskmonitor[1331407]: leaving test state: 2 next state: 4 Nov 4 05:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T05:03:27.252950396-06:00 level=info msg="Completed cleanup jobs" duration=26.172035ms Nov 4 05:03:35 kjcf05n00 mcfcli[3673891]: %3|1730718215.905|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:03:39 kjcf05n00 mcfcli[3673891]: %3|1730718219.581|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:04:05 kjcf05n00 mcfcli[3673891]: %3|1730718245.906|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:04:19 kjcf05n01 diskmonitor[1331407]: lock acquired Nov 4 05:04:19 kjcf05n01 diskmonitor[1331407]: leaving test state: 4 next state: 8 Nov 4 05:04:19 kjcf05n00 mcfcli[3673891]: %3|1730718259.578|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:04:35 kjcf05n01 diskmonitor[1331407]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 4 05:04:35 kjcf05n01 diskmonitor[1331407]: leaving test state: 8 next state: 20 Nov 4 05:04:35 kjcf05n01 diskmonitor[1331407]: leaving test state: 20 next state: 40 Nov 4 05:04:35 kjcf05n01 diskmonitor[1331407]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset e1a9280000 Nov 4 05:04:35 kjcf05n01 diskmonitor[1331407]: leaving test state: 40 next state: 80 Nov 4 05:04:35 kjcf05n00 mcfcli[3673891]: %3|1730718275.906|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:04:57 kjcf05n00 mcfcli[3673891]: %3|1730718297.839|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:05:05 kjcf05n00 mcfcli[3673891]: %3|1730718305.907|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:05:24 kjcf05n00 python3.9[1867666]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 05:05:28 kjcf05n01 diskmonitor[1331407]: leaving test state: 80 next state: 100 Nov 4 05:05:28 kjcf05n01 diskmonitor[1331407]: lock release: time: Mon Nov 4 05:05:27 2024 Nov 4 05:05:28 kjcf05n01 diskmonitor[1331407]: leaving test state: 100 next state: 1 Nov 4 05:05:35 kjcf05n00 mcfcli[3673891]: %3|1730718335.907|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 05:05:36 kjcf05n00 mcfcli[3673891]: %3|1730718336.388|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:06:05 kjcf05n00 mcfcli[3673891]: %3|1730718365.908|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 05:06:13 kjcf05n00 mcfcli[3673891]: %3|1730718373.240|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:06:36 kjcf05n00 mcfcli[3673891]: %3|1730718396.408|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 05:06:53 kjcf05n00 mcfcli[3673891]: %3|1730718413.237|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:07:06 kjcf05n00 mcfcli[3673891]: %3|1730718426.408|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:07:29 kjcf05n00 mcfcli[3673891]: %3|1730718449.866|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:07:36 kjcf05n00 mcfcli[3673891]: %3|1730718456.409|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 05:08:06 kjcf05n00 mcfcli[3673891]: %3|1730718486.409|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 05:08:09 kjcf05n00 mcfcli[3673891]: %3|1730718489.863|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:08:12 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 05:08:12 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 05:08:12 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 05:08:13 kjcf05n00 diskmonitor[2758297]: leaving test state: 1 next state: 2 Nov 4 05:08:13 kjcf05n00 diskmonitor[2758297]: lock req: no timeout Nov 4 05:08:13 kjcf05n00 diskmonitor[2758297]: leaving test state: 2 next state: 4 Nov 4 05:08:36 kjcf05n00 mcfcli[3673891]: %3|1730718516.409|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 05:08:49 kjcf05n00 mcfcli[3673891]: %3|1730718529.310|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:09:06 kjcf05n00 mcfcli[3673891]: %3|1730718546.410|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:09:18 kjcf05n00 diskmonitor[2758297]: lock acquired Nov 4 05:09:18 kjcf05n00 diskmonitor[2758297]: leaving test state: 4 next state: 8 Nov 4 05:09:25 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 05:09:25 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 05:09:25 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 05:09:27 kjcf05n00 mcfcli[3673891]: %3|1730718567.735|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:09:32 kjcf05n00 diskmonitor[2758297]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 4 05:09:32 kjcf05n00 diskmonitor[2758297]: leaving test state: 8 next state: 20 Nov 4 05:09:32 kjcf05n00 diskmonitor[2758297]: leaving test state: 20 next state: 40 Nov 4 05:09:32 kjcf05n00 diskmonitor[2758297]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset 7f82b10000 Nov 4 05:09:32 kjcf05n00 diskmonitor[2758297]: leaving test state: 40 next state: 80 Nov 4 05:09:36 kjcf05n00 mcfcli[3673891]: %3|1730718576.410|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 05:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 05:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 05:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 05:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 05:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 05:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 05:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 05:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 05:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 05:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 05:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 05:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 05:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 05:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 05:10:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 05:10:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:10:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 05:10:06 kjcf05n00 mcfcli[3673891]: %3|1730718606.410|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 05:10:07 kjcf05n00 mcfcli[3673891]: %3|1730718607.732|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:10:24 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 05:10:24 kjcf05n00 python3.9[1870871]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 05:10:25 kjcf05n00 diskmonitor[2758297]: leaving test state: 80 next state: 100 Nov 4 05:10:25 kjcf05n00 diskmonitor[2758297]: lock release: time: Mon Nov 4 05:10:24 2024 Nov 4 05:10:25 kjcf05n00 diskmonitor[2758297]: leaving test state: 100 next state: 1 Nov 4 05:10:36 kjcf05n00 mcfcli[3673891]: %3|1730718636.411|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:10:44 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 05:10:44 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 05:10:44 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 05:10:47 kjcf05n00 mcfcli[3673891]: %3|1730718647.083|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:10:52 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 05:10:52 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 05:11:06 kjcf05n00 mcfcli[3673891]: %3|1730718666.411|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 05:11:23 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 05:11:25 kjcf05n00 mcfcli[3673891]: %3|1730718685.815|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:11:31 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 05:11:31 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 05:11:31 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 05:11:36 kjcf05n00 mcfcli[3673891]: %3|1730718696.411|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:11:51 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 05:11:51 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 05:12:05 kjcf05n00 mcfcli[3673891]: %3|1730718725.812|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:12:06 kjcf05n00 mcfcli[3673891]: %3|1730718726.412|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:12:36 kjcf05n00 mcfcli[3673891]: %3|1730718756.412|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:12:45 kjcf05n00 mcfcli[3673891]: %3|1730718765.809|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:13:06 kjcf05n00 mcfcli[3673891]: %3|1730718786.413|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:13:23 kjcf05n00 mcfcli[3673891]: %3|1730718803.545|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T05:13:27.268217495-06:00 level=info msg="Completed cleanup jobs" duration=41.785946ms Nov 4 05:13:36 kjcf05n00 mcfcli[3673891]: %3|1730718816.413|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:13:58 kjcf05n00 mcfcli[3673891]: %3|1730718838.237|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:14:06 kjcf05n00 mcfcli[3673891]: %3|1730718846.414|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 05:14:36 kjcf05n00 mcfcli[3673891]: %3|1730718876.414|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:14:38 kjcf05n00 mcfcli[3673891]: %3|1730718878.200|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:15:06 kjcf05n00 mcfcli[3673891]: %3|1730718906.415|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:15:18 kjcf05n00 mcfcli[3673891]: %3|1730718918.002|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:15:28 kjcf05n00 python3.9[1874089]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 05:15:36 kjcf05n00 mcfcli[3673891]: %3|1730718936.415|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 05:15:58 kjcf05n00 mcfcli[3673891]: %3|1730718957.999|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:16:06 kjcf05n00 mcfcli[3673891]: %3|1730718966.415|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:16:36 kjcf05n00 mcfcli[3673891]: %3|1730718996.059|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:16:36 kjcf05n00 mcfcli[3673891]: %3|1730718996.417|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 05:17:06 kjcf05n00 mcfcli[3673891]: %3|1730719026.418|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 05:17:12 kjcf05n00 mcfcli[3673891]: %3|1730719032.839|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:17:36 kjcf05n00 mcfcli[3673891]: %3|1730719056.418|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:17:49 kjcf05n00 mcfcli[3673891]: %3|1730719069.341|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:18:06 kjcf05n00 mcfcli[3673891]: %3|1730719086.718|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 05:18:29 kjcf05n00 mcfcli[3673891]: %3|1730719109.338|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:18:36 kjcf05n00 mcfcli[3673891]: %3|1730719116.718|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:19:04 kjcf05n00 mcfcli[3673891]: %3|1730719144.915|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:19:06 kjcf05n00 mcfcli[3673891]: %3|1730719146.718|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 05:19:36 kjcf05n00 mcfcli[3673891]: %3|1730719176.920|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 05:19:40 kjcf05n00 mcfcli[3673891]: %3|1730719180.964|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 05:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 05:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 05:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 05:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 05:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 05:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 05:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 05:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 05:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 05:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 05:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 05:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 05:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 05:20:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 05:20:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:20:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 05:20:06 kjcf05n00 mcfcli[3673891]: %3|1730719206.920|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 05:20:17 kjcf05n00 mcfcli[3673891]: %3|1730719217.911|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:20:24 kjcf05n00 python3.9[1876992]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 05:20:36 kjcf05n00 mcfcli[3673891]: %3|1730719236.920|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 05:20:54 kjcf05n00 mcfcli[3673891]: %3|1730719254.622|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:21:06 kjcf05n00 mcfcli[3673891]: %3|1730719266.921|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:21:33 kjcf05n00 mcfcli[3673891]: %3|1730719293.977|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:21:36 kjcf05n00 mcfcli[3673891]: %3|1730719296.921|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:22:06 kjcf05n00 mcfcli[3673891]: %3|1730719326.921|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 05:22:12 kjcf05n00 mcfcli[3673891]: %3|1730719332.417|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:22:36 kjcf05n00 mcfcli[3673891]: %3|1730719356.923|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 05:22:51 kjcf05n00 mcfcli[3673891]: %3|1730719371.274|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:23:06 kjcf05n00 mcfcli[3673891]: %3|1730719386.923|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:23:12 kjcf05n02 diskmonitor[17328]: reconstruction_policy: sync_action prev = resync current = idle - md65 Nov 4 05:23:12 kjcf05n02 diskmonitor[17328]: Restore sync_speed_min (system) for md65 Nov 4 05:23:12 kjcf05n02 diskmonitor[17328]: Restore sync_speed_max (system) for md65 Nov 4 05:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T11:23:15.867881Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 05:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T11:23:15.867945Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.088ms Nov 4 05:23:21 kjcf05n01 rsnapshot[3510541]: /usr/bin/rsnapshot -c /etc/rsnapshot.kjcf05n00.conf sync: completed successfully Nov 4 05:23:22 kjcf05n01 rsnapshot[3510545]: /usr/bin/rsnapshot -c /etc/rsnapshot.kjcf05n00.conf daily: completed successfully Nov 4 05:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T05:23:27.25401907-06:00 level=info msg="Completed cleanup jobs" duration=27.513908ms Nov 4 05:23:27 kjcf05n00 mcfcli[3673891]: %3|1730719407.374|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:23:31 kjcf05n01 rsnapshot[3510656]: /usr/bin/rsnapshot -c /etc/rsnapshot.kjcf05n01.conf sync: completed successfully Nov 4 05:23:32 kjcf05n01 rsnapshot[3510659]: /usr/bin/rsnapshot -c /etc/rsnapshot.kjcf05n01.conf daily: completed successfully Nov 4 05:23:36 kjcf05n00 mcfcli[3673891]: %3|1730719416.923|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 05:23:41 kjcf05n01 rsnapshot[3510839]: /usr/bin/rsnapshot -c /etc/rsnapshot.mysql.conf sync: completed successfully Nov 4 05:23:41 kjcf05n01 rsnapshot[3510842]: /usr/bin/rsnapshot -c /etc/rsnapshot.mysql.conf daily: completed successfully Nov 4 05:24:06 kjcf05n00 mcfcli[3673891]: %3|1730719446.217|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:24:06 kjcf05n00 mcfcli[3673891]: %3|1730719446.923|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:24:11 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 05:24:11 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 9 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007075 sec, idle for 1 hour(s)] Nov 4 05:24:36 kjcf05n00 mcfcli[3673891]: %3|1730719476.923|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:24:45 kjcf05n00 mcfcli[3673891]: %3|1730719485.121|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:25:06 kjcf05n00 mcfcli[3673891]: %3|1730719506.923|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 05:25:24 kjcf05n00 python3.9[1880192]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 05:25:24 kjcf05n00 mcfcli[3673891]: %3|1730719524.331|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:25:36 kjcf05n00 mcfcli[3673891]: %3|1730719536.924|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 05:26:04 kjcf05n00 mcfcli[3673891]: %3|1730719564.328|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:26:06 kjcf05n00 mcfcli[3673891]: %3|1730719566.924|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:26:36 kjcf05n00 mcfcli[3673891]: %3|1730719596.924|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 05:26:41 kjcf05n00 mcfcli[3673891]: %3|1730719601.759|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:27:06 kjcf05n00 mcfcli[3673891]: %3|1730719626.925|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 05:27:18 kjcf05n00 mcfcli[3673891]: %3|1730719638.268|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:27:36 kjcf05n00 mcfcli[3673891]: %3|1730719656.925|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:27:57 kjcf05n00 mcfcli[3673891]: %3|1730719677.583|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:28:06 kjcf05n00 mcfcli[3673891]: %3|1730719686.926|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:28:36 kjcf05n00 mcfcli[3673891]: %3|1730719716.926|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:28:37 kjcf05n00 mcfcli[3673891]: %3|1730719717.580|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:29:06 kjcf05n00 mcfcli[3673891]: %3|1730719746.927|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:29:17 kjcf05n00 mcfcli[3673891]: %3|1730719757.577|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:29:36 kjcf05n00 mcfcli[3673891]: %3|1730719776.927|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 05:29:55 kjcf05n00 mcfcli[3673891]: %3|1730719795.284|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 05:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 05:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 05:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 05:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 05:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 05:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 05:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 05:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 05:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 05:30:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 05:30:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:30:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 05:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 05:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 05:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 05:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 05:30:06 kjcf05n00 mcfcli[3673891]: %3|1730719806.928|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:30:24 kjcf05n00 python3.9[1883057]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 05:30:34 kjcf05n00 mcfcli[3673891]: %3|1730719834.423|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:30:36 kjcf05n00 mcfcli[3673891]: %3|1730719836.928|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:31:06 kjcf05n00 mcfcli[3673891]: %3|1730719866.928|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:31:12 kjcf05n00 mcfcli[3673891]: %3|1730719872.123|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:31:36 kjcf05n00 mcfcli[3673891]: %3|1730719896.929|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:31:49 kjcf05n00 mcfcli[3673891]: %3|1730719909.837|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:32:06 kjcf05n00 mcfcli[3673891]: %3|1730719926.929|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:32:28 kjcf05n00 mcfcli[3673891]: %3|1730719948.039|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:32:36 kjcf05n00 mcfcli[3673891]: %3|1730719956.930|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:33:03 kjcf05n00 mcfcli[3673891]: %3|1730719983.605|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:33:06 kjcf05n00 mcfcli[3673891]: %3|1730719986.930|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 05:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T05:33:27.268579917-06:00 level=info msg="Completed cleanup jobs" duration=41.540484ms Nov 4 05:33:36 kjcf05n00 mcfcli[3673891]: %3|1730720016.930|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:33:41 kjcf05n00 mcfcli[3673891]: %3|1730720021.589|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:34:06 kjcf05n00 mcfcli[3673891]: %3|1730720046.931|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:34:21 kjcf05n00 mcfcli[3673891]: %3|1730720061.586|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:34:31 kjcf05n02 dwd[5139]: md65 read await report (#disks=11, min #ops=6.1e7): mean=0.5, sd=0.0, min=0.5, q1=0.5, q2=0.5, q3=0.5, max=0.5 (nvme25n1/eui.345950304db009960025384500000004) Nov 4 05:34:36 kjcf05n00 mcfcli[3673891]: %3|1730720076.932|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:34:50 kjcf05n02 nslcd[6896]: [1d5ae9] ldap_result() failed: Can't contact LDAP server Nov 4 05:35:01 kjcf05n00 mcfcli[3673891]: %3|1730720101.583|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:35:06 kjcf05n00 mcfcli[3673891]: %3|1730720106.932|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:35:24 kjcf05n00 python3.9[1885921]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 05:35:36 kjcf05n00 mcfcli[3673891]: %3|1730720136.932|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 05:35:39 kjcf05n00 mcfcli[3673891]: %3|1730720139.343|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:36:06 kjcf05n00 mcfcli[3673891]: %3|1730720166.934|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:36:17 kjcf05n00 mcfcli[3673891]: %3|1730720177.111|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:36:36 kjcf05n00 mcfcli[3673891]: %3|1730720196.934|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:36:54 kjcf05n00 mcfcli[3673891]: %3|1730720214.014|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:37:06 kjcf05n00 mcfcli[3673891]: %3|1730720226.934|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 05:37:09 kjcf05n02 diskmonitor[17328]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 05:37:30 kjcf05n00 mcfcli[3673891]: %3|1730720250.771|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:37:36 kjcf05n00 mcfcli[3673891]: %3|1730720256.934|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 05:38:06 kjcf05n00 mcfcli[3673891]: %3|1730720286.934|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 05:38:09 kjcf05n00 mcfcli[3673891]: %3|1730720289.564|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:38:37 kjcf05n00 mcfcli[3673891]: %3|1730720317.434|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 05:38:47 kjcf05n00 mcfcli[3673891]: %3|1730720327.487|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:39:07 kjcf05n00 mcfcli[3673891]: %3|1730720347.434|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 05:39:24 kjcf05n00 mcfcli[3673891]: %3|1730720364.293|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:39:37 kjcf05n00 mcfcli[3673891]: %3|1730720377.435|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 05:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 05:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 05:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 05:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 05:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 05:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 05:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 05:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 05:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 05:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 05:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 05:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 05:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 05:40:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 05:40:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:40:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 05:40:02 kjcf05n00 mcfcli[3673891]: %3|1730720402.984|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:40:07 kjcf05n00 mcfcli[3673891]: %3|1730720407.435|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 05:40:24 kjcf05n00 python3.9[1888774]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 05:40:37 kjcf05n00 mcfcli[3673891]: %3|1730720437.436|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 05:40:42 kjcf05n00 mcfcli[3673891]: %3|1730720442.981|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:41:07 kjcf05n00 mcfcli[3673891]: %3|1730720467.729|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 05:41:22 kjcf05n00 mcfcli[3673891]: %3|1730720482.842|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:41:37 kjcf05n00 mcfcli[3673891]: %3|1730720497.729|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 05:42:02 kjcf05n00 mcfcli[3673891]: %3|1730720522.793|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:42:07 kjcf05n00 mcfcli[3673891]: %3|1730720527.938|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 05:42:37 kjcf05n00 mcfcli[3673891]: %3|1730720557.938|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:42:42 kjcf05n00 mcfcli[3673891]: %3|1730720562.790|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:43:07 kjcf05n00 mcfcli[3673891]: %3|1730720587.938|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 05:43:21 kjcf05n00 mcfcli[3673891]: %3|1730720601.096|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T05:43:27.268160006-06:00 level=info msg="Completed cleanup jobs" duration=41.224444ms Nov 4 05:43:37 kjcf05n00 mcfcli[3673891]: %3|1730720617.938|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 05:44:00 kjcf05n00 mcfcli[3673891]: %3|1730720640.409|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:44:07 kjcf05n00 mcfcli[3673891]: %3|1730720647.938|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 05:44:37 kjcf05n00 mcfcli[3673891]: %3|1730720677.939|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 05:44:38 kjcf05n00 mcfcli[3673891]: %3|1730720678.980|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:45:07 kjcf05n00 mcfcli[3673891]: %3|1730720707.940|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 05:45:14 kjcf05n00 mcfcli[3673891]: %3|1730720714.405|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:45:24 kjcf05n00 python3.9[1891647]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 05:45:37 kjcf05n00 mcfcli[3673891]: %3|1730720737.940|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:45:53 kjcf05n00 mcfcli[3673891]: %3|1730720753.860|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:46:07 kjcf05n00 mcfcli[3673891]: %3|1730720767.940|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:46:32 kjcf05n00 mcfcli[3673891]: %3|1730720792.369|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:46:37 kjcf05n00 mcfcli[3673891]: %3|1730720797.941|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:47:07 kjcf05n00 mcfcli[3673891]: %3|1730720827.942|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 05:47:10 kjcf05n00 mcfcli[3673891]: %3|1730720830.486|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:47:37 kjcf05n00 mcfcli[3673891]: %3|1730720857.942|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 05:47:50 kjcf05n00 mcfcli[3673891]: %3|1730720870.446|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:48:07 kjcf05n00 mcfcli[3673891]: %3|1730720887.942|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 05:48:29 kjcf05n00 mcfcli[3673891]: %3|1730720909.881|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:48:37 kjcf05n00 mcfcli[3673891]: %3|1730720917.942|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 05:49:04 kjcf05n00 mcfcli[3673891]: %3|1730720944.739|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:49:07 kjcf05n00 mcfcli[3673891]: %3|1730720947.943|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 05:49:37 kjcf05n00 mcfcli[3673891]: %3|1730720977.943|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 05:49:44 kjcf05n00 mcfcli[3673891]: %3|1730720984.403|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 05:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 05:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 05:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 05:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 05:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 05:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 05:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 05:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 05:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 05:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 05:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 05:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 05:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 05:50:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 05:50:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 05:50:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 05:50:07 kjcf05n00 mcfcli[3673891]: %3|1730721007.944|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 05:50:22 kjcf05n00 mcfcli[3673891]: %3|1730721022.651|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:50:27 kjcf05n00 python3.9[1894407]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 05:50:37 kjcf05n00 mcfcli[3673891]: %3|1730721037.945|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:51:01 kjcf05n00 mcfcli[3673891]: %3|1730721061.494|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:51:07 kjcf05n00 mcfcli[3673891]: %3|1730721067.945|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 05:51:37 kjcf05n00 mcfcli[3673891]: %3|1730721097.945|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:51:40 kjcf05n00 mcfcli[3673891]: %3|1730721100.064|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:52:07 kjcf05n00 mcfcli[3673891]: %3|1730721127.945|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:52:19 kjcf05n00 mcfcli[3673891]: %3|1730721139.589|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:52:37 kjcf05n00 mcfcli[3673891]: %3|1730721157.946|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:52:59 kjcf05n00 mcfcli[3673891]: %3|1730721179.586|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:53:07 kjcf05n00 mcfcli[3673891]: %3|1730721187.946|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T11:53:15.868451Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 05:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T11:53:15.868523Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.092ms Nov 4 05:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T05:53:27.237229983-06:00 level=info msg="Completed cleanup jobs" duration=10.113721ms Nov 4 05:53:37 kjcf05n00 mcfcli[3673891]: %3|1730721217.946|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:53:39 kjcf05n00 mcfcli[3673891]: %3|1730721219.583|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:54:07 kjcf05n00 mcfcli[3673891]: %3|1730721247.946|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:54:18 kjcf05n00 mcfcli[3673891]: %3|1730721258.099|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:54:37 kjcf05n00 mcfcli[3673891]: %3|1730721277.947|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 05:54:56 kjcf05n00 mcfcli[3673891]: %3|1730721296.942|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:55:07 kjcf05n00 mcfcli[3673891]: %3|1730721307.947|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 05:55:26 kjcf05n00 python3.9[1897368]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 05:55:33 kjcf05n00 mcfcli[3673891]: %3|1730721333.088|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:55:37 kjcf05n00 mcfcli[3673891]: %3|1730721337.948|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:56:07 kjcf05n00 mcfcli[3673891]: %3|1730721367.949|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:56:11 kjcf05n00 mcfcli[3673891]: %3|1730721371.616|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:56:38 kjcf05n00 mcfcli[3673891]: %3|1730721398.448|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 05:56:47 kjcf05n00 mcfcli[3673891]: %3|1730721407.819|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:57:08 kjcf05n00 mcfcli[3673891]: %3|1730721428.449|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:57:25 kjcf05n00 mcfcli[3673891]: %3|1730721445.480|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:57:38 kjcf05n00 mcfcli[3673891]: %3|1730721458.450|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 05:58:05 kjcf05n00 mcfcli[3673891]: %3|1730721485.477|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:58:08 kjcf05n00 mcfcli[3673891]: %3|1730721488.737|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 05:58:38 kjcf05n00 mcfcli[3673891]: %3|1730721518.737|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 05:58:44 kjcf05n00 mcfcli[3673891]: %3|1730721524.132|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:59:08 kjcf05n00 mcfcli[3673891]: %3|1730721548.737|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 05:59:22 kjcf05n00 mcfcli[3673891]: %3|1730721562.657|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 05:59:38 kjcf05n00 mcfcli[3673891]: %3|1730721578.738|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 06:00:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 06:00:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:00:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 06:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 06:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 06:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 06:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 06:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 06:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 06:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 06:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 06:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 06:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 06:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 06:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 06:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 06:00:01 kjcf05n00 mcfcli[3673891]: %3|1730721601.137|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:00:08 kjcf05n00 mcfcli[3673891]: %3|1730721608.738|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:00:16 kjcf05n02 diskmonitor[17328]: leaving test state: 1 next state: 2 Nov 4 06:00:16 kjcf05n02 diskmonitor[17328]: lock req: no timeout Nov 4 06:00:16 kjcf05n02 diskmonitor[17328]: leaving test state: 2 next state: 4 Nov 4 06:00:24 kjcf05n00 python3.9[1900195]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 06:00:38 kjcf05n00 mcfcli[3673891]: %3|1730721638.738|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 06:00:39 kjcf05n00 mcfcli[3673891]: %3|1730721639.075|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:01:08 kjcf05n00 mcfcli[3673891]: %3|1730721668.953|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 06:01:19 kjcf05n00 mcfcli[3673891]: %3|1730721679.072|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:01:22 kjcf05n02 diskmonitor[17328]: lock acquired Nov 4 06:01:22 kjcf05n02 diskmonitor[17328]: leaving test state: 4 next state: 8 Nov 4 06:01:36 kjcf05n02 diskmonitor[17328]: Test selected disk: eui.345950304db010210025384500000004_S4YPNE0MB01021 Nov 4 06:01:36 kjcf05n02 diskmonitor[17328]: leaving test state: 8 next state: 20 Nov 4 06:01:36 kjcf05n02 diskmonitor[17328]: leaving test state: 20 next state: 40 Nov 4 06:01:36 kjcf05n02 diskmonitor[17328]: Test /dev/disk/by-id/nvme-eui.345950304db010210025384500000004_S4YPNE0MB01021, offset d183588000 Nov 4 06:01:36 kjcf05n02 diskmonitor[17328]: leaving test state: 40 next state: 80 Nov 4 06:01:38 kjcf05n00 mcfcli[3673891]: %3|1730721698.953|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:01:59 kjcf05n00 mcfcli[3673891]: %3|1730721719.069|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:02:08 kjcf05n00 mcfcli[3673891]: %3|1730721728.953|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:02:34 kjcf05n02 diskmonitor[17328]: leaving test state: 80 next state: 100 Nov 4 06:02:34 kjcf05n02 diskmonitor[17328]: lock release: time: Mon Nov 4 06:02:29 2024 Nov 4 06:02:34 kjcf05n02 diskmonitor[17328]: leaving test state: 100 next state: 1 Nov 4 06:02:36 kjcf05n00 mcfcli[3673891]: %3|1730721756.343|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:02:38 kjcf05n00 mcfcli[3673891]: %3|1730721758.953|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 06:03:08 kjcf05n00 mcfcli[3673891]: %3|1730721788.955|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:03:16 kjcf05n00 mcfcli[3673891]: %3|1730721796.340|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T06:03:27.253472496-06:00 level=info msg="Completed cleanup jobs" duration=26.340861ms Nov 4 06:03:38 kjcf05n00 mcfcli[3673891]: %3|1730721818.955|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:03:55 kjcf05n00 mcfcli[3673891]: %3|1730721835.597|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:04:08 kjcf05n00 mcfcli[3673891]: %3|1730721848.955|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:04:33 kjcf05n00 mcfcli[3673891]: %3|1730721873.861|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:04:38 kjcf05n00 mcfcli[3673891]: %3|1730721878.955|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:05:08 kjcf05n00 mcfcli[3673891]: %3|1730721908.956|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 06:05:11 kjcf05n00 mcfcli[3673891]: %3|1730721911.050|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:05:25 kjcf05n00 python3.9[1902978]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 06:05:38 kjcf05n00 mcfcli[3673891]: %3|1730721938.957|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 06:05:51 kjcf05n00 mcfcli[3673891]: %3|1730721951.047|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:06:08 kjcf05n00 mcfcli[3673891]: %3|1730721968.957|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:06:31 kjcf05n00 mcfcli[3673891]: %3|1730721991.044|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:06:38 kjcf05n00 mcfcli[3673891]: %3|1730721998.957|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:07:08 kjcf05n00 mcfcli[3673891]: %3|1730722028.958|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:07:10 kjcf05n00 mcfcli[3673891]: %3|1730722030.227|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:07:38 kjcf05n00 mcfcli[3673891]: %3|1730722058.958|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:07:48 kjcf05n00 mcfcli[3673891]: %3|1730722068.002|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:07:59 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 06:07:59 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 06:07:59 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 06:08:08 kjcf05n00 mcfcli[3673891]: %3|1730722088.959|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 06:08:26 kjcf05n00 mcfcli[3673891]: %3|1730722106.536|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:08:38 kjcf05n00 mcfcli[3673891]: %3|1730722118.959|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:09:04 kjcf05n00 mcfcli[3673891]: %3|1730722144.739|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:09:08 kjcf05n00 mcfcli[3673891]: %3|1730722148.960|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 06:09:10 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 06:09:10 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 06:09:10 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 06:09:32 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 06:09:32 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 06:09:32 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 06:09:39 kjcf05n00 mcfcli[3673891]: %3|1730722179.459|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 06:09:44 kjcf05n00 mcfcli[3673891]: %3|1730722184.736|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:09:59 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 06:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 06:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 06:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 06:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 06:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 06:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 06:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 06:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 06:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 06:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 06:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 06:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 06:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 06:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 06:10:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 06:10:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:10:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 06:10:02 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 06:10:02 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 06:10:02 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 06:10:09 kjcf05n00 mcfcli[3673891]: %3|1730722209.460|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 06:10:24 kjcf05n00 mcfcli[3673891]: %3|1730722224.733|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:10:25 kjcf05n00 python3.9[1905796]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 06:10:28 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 06:10:28 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 06:10:39 kjcf05n00 mcfcli[3673891]: %3|1730722239.460|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 06:11:04 kjcf05n00 mcfcli[3673891]: %3|1730722264.548|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:11:09 kjcf05n00 mcfcli[3673891]: %3|1730722269.461|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:11:39 kjcf05n00 mcfcli[3673891]: %3|1730722299.461|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 06:11:42 kjcf05n00 mcfcli[3673891]: %3|1730722302.572|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:11:56 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 06:12:09 kjcf05n00 mcfcli[3673891]: %3|1730722329.462|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:12:18 kjcf05n00 mcfcli[3673891]: %3|1730722338.924|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:12:25 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 06:12:25 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 06:12:39 kjcf05n00 mcfcli[3673891]: %3|1730722359.462|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 06:12:54 kjcf05n00 mcfcli[3673891]: %3|1730722374.696|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:13:09 kjcf05n00 mcfcli[3673891]: %3|1730722389.462|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 06:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T06:13:27.25466778-06:00 level=info msg="Completed cleanup jobs" duration=27.508057ms Nov 4 06:13:32 kjcf05n00 mcfcli[3673891]: %3|1730722412.765|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:13:39 kjcf05n00 mcfcli[3673891]: %3|1730722419.462|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 06:14:09 kjcf05n00 mcfcli[3673891]: %3|1730722449.464|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 06:14:10 kjcf05n00 mcfcli[3673891]: %3|1730722450.198|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:14:39 kjcf05n00 mcfcli[3673891]: %3|1730722479.464|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 06:14:48 kjcf05n00 mcfcli[3673891]: %3|1730722488.163|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:15:09 kjcf05n00 mcfcli[3673891]: %3|1730722509.464|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:15:25 kjcf05n00 python3.9[1908775]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 06:15:28 kjcf05n00 mcfcli[3673891]: %3|1730722528.160|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:15:39 kjcf05n00 mcfcli[3673891]: %3|1730722539.746|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 06:16:05 kjcf05n00 mcfcli[3673891]: %3|1730722565.829|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:16:09 kjcf05n00 mcfcli[3673891]: %3|1730722569.965|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 06:16:39 kjcf05n00 mcfcli[3673891]: %3|1730722599.965|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:16:43 kjcf05n00 mcfcli[3673891]: %3|1730722603.562|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:17:09 kjcf05n00 mcfcli[3673891]: %3|1730722629.967|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:17:21 kjcf05n00 mcfcli[3673891]: %3|1730722641.650|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:17:39 kjcf05n00 mcfcli[3673891]: %3|1730722659.967|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:17:59 kjcf05n00 mcfcli[3673891]: %3|1730722679.547|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:18:09 kjcf05n00 mcfcli[3673891]: %3|1730722689.967|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 06:18:38 kjcf05n00 mcfcli[3673891]: %3|1730722718.105|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:18:39 kjcf05n00 mcfcli[3673891]: %3|1730722719.967|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:19:09 kjcf05n00 mcfcli[3673891]: %3|1730722749.967|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:19:16 kjcf05n00 mcfcli[3673891]: %3|1730722756.295|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:19:39 kjcf05n00 mcfcli[3673891]: %3|1730722779.969|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:19:55 kjcf05n00 mcfcli[3673891]: %3|1730722795.728|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 06:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 06:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 06:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 06:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 06:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 06:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 06:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 06:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 06:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 06:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 06:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 06:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 06:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 06:20:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 06:20:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:20:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 06:20:09 kjcf05n00 mcfcli[3673891]: %3|1730722809.969|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 06:20:25 kjcf05n00 python3.9[1911636]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 06:20:33 kjcf05n00 mcfcli[3673891]: %3|1730722833.368|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:20:39 kjcf05n00 mcfcli[3673891]: %3|1730722839.969|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 06:21:09 kjcf05n00 mcfcli[3673891]: %3|1730722869.969|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:21:13 kjcf05n00 mcfcli[3673891]: %3|1730722873.365|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:21:39 kjcf05n00 mcfcli[3673891]: %3|1730722899.969|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:21:51 kjcf05n00 mcfcli[3673891]: %3|1730722911.215|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:22:09 kjcf05n00 mcfcli[3673891]: %3|1730722929.970|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 06:22:28 kjcf05n00 mcfcli[3673891]: %3|1730722948.433|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:22:39 kjcf05n00 mcfcli[3673891]: %3|1730722959.971|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 06:23:06 kjcf05n00 mcfcli[3673891]: %3|1730722986.144|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:23:09 kjcf05n00 mcfcli[3673891]: %3|1730722989.971|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T12:23:15.868102Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 06:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T12:23:15.868171Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.090ms Nov 4 06:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T06:23:27.254668126-06:00 level=info msg="Completed cleanup jobs" duration=27.582055ms Nov 4 06:23:39 kjcf05n00 mcfcli[3673891]: %3|1730723019.971|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 06:23:43 kjcf05n00 mcfcli[3673891]: %3|1730723023.933|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:24:09 kjcf05n00 mcfcli[3673891]: %3|1730723049.971|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 06:24:11 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 06:24:11 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 10 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007339 sec, idle for 1 hour(s)] Nov 4 06:24:22 kjcf05n00 mcfcli[3673891]: %3|1730723062.751|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:24:39 kjcf05n00 mcfcli[3673891]: %3|1730723079.971|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 06:25:01 kjcf05n00 mcfcli[3673891]: %3|1730723101.049|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:25:09 kjcf05n00 mcfcli[3673891]: %3|1730723109.972|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 06:25:28 kjcf05n00 python3.9[1914421]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 06:25:38 kjcf05n00 mcfcli[3673891]: %3|1730723138.659|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:25:39 kjcf05n00 mcfcli[3673891]: %3|1730723139.972|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 06:26:09 kjcf05n00 mcfcli[3673891]: %3|1730723169.972|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 06:26:16 kjcf05n00 mcfcli[3673891]: %3|1730723176.749|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:26:39 kjcf05n00 mcfcli[3673891]: %3|1730723199.974|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 06:26:55 kjcf05n00 mcfcli[3673891]: %3|1730723215.616|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:27:09 kjcf05n00 mcfcli[3673891]: %3|1730723229.974|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:27:35 kjcf05n00 mcfcli[3673891]: %3|1730723255.613|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:27:39 kjcf05n00 mcfcli[3673891]: %3|1730723259.974|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:28:09 kjcf05n00 mcfcli[3673891]: %3|1730723289.974|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 06:28:11 kjcf05n00 mcfcli[3673891]: %3|1730723291.781|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:28:39 kjcf05n00 mcfcli[3673891]: %3|1730723319.974|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 06:28:49 kjcf05n00 mcfcli[3673891]: %3|1730723329.317|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:29:09 kjcf05n00 mcfcli[3673891]: %3|1730723349.974|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:29:26 kjcf05n00 mcfcli[3673891]: %3|1730723366.995|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:29:39 kjcf05n00 mcfcli[3673891]: %3|1730723379.975|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 06:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 06:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 06:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 06:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 06:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 06:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 06:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 06:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 06:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 06:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 06:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 06:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 06:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 06:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 06:30:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 06:30:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:30:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 06:30:02 kjcf05n00 mcfcli[3673891]: %3|1730723402.504|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:30:09 kjcf05n00 mcfcli[3673891]: %3|1730723409.975|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 06:30:27 kjcf05n00 python3.9[1917374]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 06:30:39 kjcf05n00 mcfcli[3673891]: %3|1730723439.975|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:30:40 kjcf05n00 mcfcli[3673891]: %3|1730723440.884|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:31:09 kjcf05n00 mcfcli[3673891]: %3|1730723469.975|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 06:31:20 kjcf05n00 mcfcli[3673891]: %3|1730723480.438|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:31:39 kjcf05n00 mcfcli[3673891]: %3|1730723499.976|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 06:31:57 kjcf05n00 mcfcli[3673891]: %3|1730723517.226|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:32:09 kjcf05n00 mcfcli[3673891]: %3|1730723529.977|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 06:32:34 kjcf05n00 mcfcli[3673891]: %3|1730723554.877|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:32:39 kjcf05n00 mcfcli[3673891]: %3|1730723559.977|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:33:09 kjcf05n00 mcfcli[3673891]: %3|1730723589.977|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:33:14 kjcf05n00 mcfcli[3673891]: %3|1730723594.874|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T06:33:27.26807746-06:00 level=info msg="Completed cleanup jobs" duration=41.257246ms Nov 4 06:33:39 kjcf05n00 mcfcli[3673891]: %3|1730723619.977|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:33:51 kjcf05n00 mcfcli[3673891]: %3|1730723631.379|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:34:09 kjcf05n00 mcfcli[3673891]: %3|1730723649.978|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:34:30 kjcf05n00 mcfcli[3673891]: %3|1730723670.167|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:34:39 kjcf05n00 mcfcli[3673891]: %3|1730723679.978|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:35:09 kjcf05n00 mcfcli[3673891]: %3|1730723709.979|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:35:10 kjcf05n00 mcfcli[3673891]: %3|1730723710.034|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:35:21 kjcf05n03 dwd[5203]: md66 read await report (#disks=11, min #ops=6.4e7): mean=0.5, sd=0.0, min=0.5, q1=0.5, q2=0.5, q3=0.5, max=0.5 (nvme6n1/eui.345950304e3006180025384500000003) Nov 4 06:35:25 kjcf05n00 python3.9[1920249]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 06:35:39 kjcf05n00 mcfcli[3673891]: %3|1730723739.980|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 06:35:47 kjcf05n00 mcfcli[3673891]: %3|1730723747.782|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:36:09 kjcf05n00 mcfcli[3673891]: %3|1730723769.980|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 06:36:27 kjcf05n00 mcfcli[3673891]: %3|1730723787.779|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:36:39 kjcf05n00 mcfcli[3673891]: %3|1730723799.981|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 06:36:46 kjcf05n03 diskmonitor[17871]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 06:37:05 kjcf05n00 mcfcli[3673891]: %3|1730723825.249|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:37:09 kjcf05n00 mcfcli[3673891]: %3|1730723829.981|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:37:39 kjcf05n00 mcfcli[3673891]: %3|1730723859.982|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:37:45 kjcf05n00 mcfcli[3673891]: %3|1730723865.246|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:38:09 kjcf05n00 mcfcli[3673891]: %3|1730723889.982|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:38:25 kjcf05n00 mcfcli[3673891]: %3|1730723905.243|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:38:39 kjcf05n00 mcfcli[3673891]: %3|1730723919.982|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:39:03 kjcf05n00 mcfcli[3673891]: %3|1730723943.250|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:39:09 kjcf05n00 mcfcli[3673891]: %3|1730723949.983|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:39:39 kjcf05n00 mcfcli[3673891]: %3|1730723979.984|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:39:42 kjcf05n00 mcfcli[3673891]: %3|1730723982.348|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 06:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 06:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 06:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 06:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 06:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 06:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 06:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 06:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 06:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 06:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 06:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 06:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 06:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 06:40:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 06:40:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:40:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 06:40:09 kjcf05n00 mcfcli[3673891]: %3|1730724009.984|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:40:20 kjcf05n00 mcfcli[3673891]: %3|1730724020.178|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:40:25 kjcf05n00 python3.9[1923029]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 06:40:39 kjcf05n00 mcfcli[3673891]: %3|1730724039.984|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 06:40:58 kjcf05n00 mcfcli[3673891]: %3|1730724058.054|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:41:09 kjcf05n00 mcfcli[3673891]: %3|1730724069.984|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:41:34 kjcf05n00 mcfcli[3673891]: %3|1730724094.473|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:41:39 kjcf05n00 mcfcli[3673891]: %3|1730724099.985|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 06:42:09 kjcf05n00 mcfcli[3673891]: %3|1730724129.985|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 06:42:13 kjcf05n00 mcfcli[3673891]: %3|1730724133.684|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:42:39 kjcf05n00 mcfcli[3673891]: %3|1730724159.986|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:42:53 kjcf05n00 mcfcli[3673891]: %3|1730724173.682|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:43:09 kjcf05n00 mcfcli[3673891]: %3|1730724189.986|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T06:43:27.268195994-06:00 level=info msg="Completed cleanup jobs" duration=41.271523ms Nov 4 06:43:31 kjcf05n00 mcfcli[3673891]: %3|1730724211.193|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:43:39 kjcf05n00 mcfcli[3673891]: %3|1730724219.986|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:44:09 kjcf05n00 mcfcli[3673891]: %3|1730724249.987|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:44:11 kjcf05n00 mcfcli[3673891]: %3|1730724251.190|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:44:39 kjcf05n00 mcfcli[3673891]: %3|1730724279.988|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:44:51 kjcf05n00 mcfcli[3673891]: %3|1730724291.124|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:45:09 kjcf05n00 mcfcli[3673891]: %3|1730724309.988|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:45:25 kjcf05n00 python3.9[1925916]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 06:45:30 kjcf05n00 mcfcli[3673891]: %3|1730724330.243|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:45:39 kjcf05n00 mcfcli[3673891]: %3|1730724339.988|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 06:46:09 kjcf05n00 mcfcli[3673891]: %3|1730724369.988|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:46:10 kjcf05n00 mcfcli[3673891]: %3|1730724370.240|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:46:39 kjcf05n00 mcfcli[3673891]: %3|1730724399.990|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 06:46:48 kjcf05n00 mcfcli[3673891]: %3|1730724408.001|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:47:09 kjcf05n00 mcfcli[3673891]: %3|1730724429.990|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 06:47:24 kjcf05n00 mcfcli[3673891]: %3|1730724444.828|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:47:39 kjcf05n00 mcfcli[3673891]: %3|1730724459.990|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 06:48:04 kjcf05n00 mcfcli[3673891]: %3|1730724484.825|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:48:09 kjcf05n00 mcfcli[3673891]: %3|1730724489.990|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:48:39 kjcf05n00 mcfcli[3673891]: %3|1730724519.991|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:48:43 kjcf05n00 mcfcli[3673891]: %3|1730724523.678|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:49:09 kjcf05n00 mcfcli[3673891]: %3|1730724549.991|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:49:22 kjcf05n00 mcfcli[3673891]: %3|1730724562.565|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:49:39 kjcf05n00 mcfcli[3673891]: %3|1730724579.992|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 06:49:59 kjcf05n00 mcfcli[3673891]: %3|1730724599.280|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 06:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 06:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 06:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 06:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 06:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 06:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 06:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 06:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 06:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 06:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 06:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 06:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 06:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 06:50:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 06:50:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 06:50:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 06:50:09 kjcf05n00 mcfcli[3673891]: %3|1730724609.992|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 06:50:25 kjcf05n00 python3.9[1928821]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 06:50:37 kjcf05n00 mcfcli[3673891]: %3|1730724637.397|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:50:39 kjcf05n00 mcfcli[3673891]: %3|1730724639.992|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 06:51:09 kjcf05n00 mcfcli[3673891]: %3|1730724669.992|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:51:14 kjcf05n00 mcfcli[3673891]: %3|1730724674.412|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:51:39 kjcf05n00 mcfcli[3673891]: %3|1730724699.993|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:51:54 kjcf05n00 mcfcli[3673891]: %3|1730724714.409|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:52:09 kjcf05n00 mcfcli[3673891]: %3|1730724729.994|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:52:12 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T06:52:12-06:00] Checking for stale sessions... Nov 4 06:52:12 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T06:52:12-06:00] Checking for stale sessions... Nov 4 06:52:33 kjcf05n00 mcfcli[3673891]: %3|1730724753.691|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:52:39 kjcf05n00 mcfcli[3673891]: %3|1730724759.994|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:52:48 kjcf05n03 diskmonitor[17871]: leaving test state: 1 next state: 2 Nov 4 06:52:48 kjcf05n03 diskmonitor[17871]: lock req: no timeout Nov 4 06:52:48 kjcf05n03 diskmonitor[17871]: leaving test state: 2 next state: 4 Nov 4 06:53:09 kjcf05n00 mcfcli[3673891]: %3|1730724789.994|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:53:11 kjcf05n00 mcfcli[3673891]: %3|1730724791.654|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T12:53:15.867475Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 06:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T12:53:15.867534Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.082ms Nov 4 06:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T06:53:27.254855354-06:00 level=info msg="Completed cleanup jobs" duration=28.476951ms Nov 4 06:53:39 kjcf05n00 mcfcli[3673891]: %3|1730724819.995|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:53:51 kjcf05n00 mcfcli[3673891]: %3|1730724831.579|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:54:01 kjcf05n03 diskmonitor[17871]: lock acquired Nov 4 06:54:01 kjcf05n03 diskmonitor[17871]: leaving test state: 4 next state: 8 Nov 4 06:54:09 kjcf05n00 mcfcli[3673891]: %3|1730724849.996|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 06:54:18 kjcf05n03 diskmonitor[17871]: Test selected disk: eui.345950304db010210025384500000004_S4YPNE0MB01021 Nov 4 06:54:18 kjcf05n03 diskmonitor[17871]: leaving test state: 8 next state: 20 Nov 4 06:54:18 kjcf05n03 diskmonitor[17871]: leaving test state: 20 next state: 40 Nov 4 06:54:18 kjcf05n03 diskmonitor[17871]: Test /dev/disk/by-id/nvme-eui.345950304db010210025384500000004_S4YPNE0MB01021, offset 1fc5a168000 Nov 4 06:54:18 kjcf05n03 diskmonitor[17871]: leaving test state: 40 next state: 80 Nov 4 06:54:28 kjcf05n00 mcfcli[3673891]: %3|1730724868.855|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:54:39 kjcf05n00 mcfcli[3673891]: %3|1730724879.996|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:55:07 kjcf05n00 mcfcli[3673891]: %3|1730724907.936|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:55:09 kjcf05n00 mcfcli[3673891]: %3|1730724909.996|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:55:23 kjcf05n03 diskmonitor[17871]: leaving test state: 80 next state: 100 Nov 4 06:55:23 kjcf05n03 diskmonitor[17871]: lock release: time: Mon Nov 4 06:55:16 2024 Nov 4 06:55:23 kjcf05n03 diskmonitor[17871]: leaving test state: 100 next state: 1 Nov 4 06:55:25 kjcf05n00 python3.9[1931617]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 06:55:39 kjcf05n00 mcfcli[3673891]: %3|1730724939.997|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 06:55:43 kjcf05n00 mcfcli[3673891]: %3|1730724943.931|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:56:09 kjcf05n00 mcfcli[3673891]: %3|1730724969.997|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 06:56:19 kjcf05n00 mcfcli[3673891]: %3|1730724979.480|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:56:39 kjcf05n00 mcfcli[3673891]: %3|1730724999.998|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 06:56:56 kjcf05n00 mcfcli[3673891]: %3|1730725016.609|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:57:09 kjcf05n00 mcfcli[3673891]: %3|1730725029.999|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:57:36 kjcf05n00 mcfcli[3673891]: %3|1730725056.606|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:57:39 kjcf05n00 mcfcli[3673891]: %3|1730725059.999|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:58:10 kjcf05n00 mcfcli[3673891]: %3|1730725090.000|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:58:14 kjcf05n00 mcfcli[3673891]: %3|1730725094.735|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:58:40 kjcf05n00 mcfcli[3673891]: %3|1730725120.000|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 06:58:51 kjcf05n00 mcfcli[3673891]: %3|1730725131.694|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:59:10 kjcf05n00 mcfcli[3673891]: %3|1730725150.000|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 06:59:31 kjcf05n00 mcfcli[3673891]: %3|1730725171.691|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 06:59:40 kjcf05n00 mcfcli[3673891]: %3|1730725180.002|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 07:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 07:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 07:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 07:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 07:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 07:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 07:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 07:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 07:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 07:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 07:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 07:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 07:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 07:00:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 07:00:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:00:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 07:00:09 kjcf05n00 mcfcli[3673891]: %3|1730725209.087|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:00:10 kjcf05n00 mcfcli[3673891]: %3|1730725210.002|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 07:00:29 kjcf05n00 python3.9[1934472]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 07:00:40 kjcf05n00 mcfcli[3673891]: %3|1730725240.002|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 07:00:45 kjcf05n00 mcfcli[3673891]: %3|1730725245.111|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:01:10 kjcf05n00 mcfcli[3673891]: %3|1730725270.002|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 07:01:24 kjcf05n00 mcfcli[3673891]: %3|1730725284.976|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:01:40 kjcf05n00 mcfcli[3673891]: %3|1730725300.004|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 07:02:03 kjcf05n00 mcfcli[3673891]: %3|1730725323.900|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:02:10 kjcf05n00 mcfcli[3673891]: %3|1730725330.004|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:02:40 kjcf05n00 mcfcli[3673891]: %3|1730725360.004|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:02:43 kjcf05n00 mcfcli[3673891]: %3|1730725363.897|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:03:10 kjcf05n00 mcfcli[3673891]: %3|1730725390.004|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 07:03:18 kjcf05n00 mcfcli[3673891]: %3|1730725398.796|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T07:03:27.269036383-06:00 level=info msg="Completed cleanup jobs" duration=42.305028ms Nov 4 07:03:40 kjcf05n00 mcfcli[3673891]: %3|1730725420.005|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 07:03:58 kjcf05n00 mcfcli[3673891]: %3|1730725438.792|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:04:10 kjcf05n00 mcfcli[3673891]: %3|1730725450.005|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 07:04:36 kjcf05n00 mcfcli[3673891]: %3|1730725476.220|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:04:40 kjcf05n00 mcfcli[3673891]: %3|1730725480.005|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:05:10 kjcf05n00 mcfcli[3673891]: %3|1730725510.005|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:05:16 kjcf05n00 mcfcli[3673891]: %3|1730725516.217|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:05:25 kjcf05n00 python3.9[1937455]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 07:05:40 kjcf05n00 mcfcli[3673891]: %3|1730725540.006|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 07:05:54 kjcf05n00 mcfcli[3673891]: %3|1730725554.102|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:06:10 kjcf05n00 mcfcli[3673891]: %3|1730725570.006|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 07:06:30 kjcf05n00 mcfcli[3673891]: %3|1730725590.418|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:06:40 kjcf05n00 mcfcli[3673891]: %3|1730725600.006|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 07:07:10 kjcf05n00 mcfcli[3673891]: %3|1730725630.006|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:07:10 kjcf05n00 mcfcli[3673891]: %3|1730725630.415|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:07:15 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 07:07:40 kjcf05n00 mcfcli[3673891]: %3|1730725660.007|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 07:07:43 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 07:07:43 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 07:07:46 kjcf05n00 mcfcli[3673891]: %3|1730725666.235|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:08:10 kjcf05n00 mcfcli[3673891]: %3|1730725690.008|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:08:23 kjcf05n00 mcfcli[3673891]: %3|1730725703.962|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:08:40 kjcf05n00 mcfcli[3673891]: %3|1730725720.008|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 07:08:52 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 07:08:52 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 07:08:52 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 07:09:03 kjcf05n00 mcfcli[3673891]: %3|1730725743.038|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:09:10 kjcf05n00 mcfcli[3673891]: %3|1730725750.009|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 07:09:21 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 07:09:21 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 07:09:21 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 07:09:40 kjcf05n00 mcfcli[3673891]: %3|1730725780.009|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 07:09:42 kjcf05n00 mcfcli[3673891]: %3|1730725782.814|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 07:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 07:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 07:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 07:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 07:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 07:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 07:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 07:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 07:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 07:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 07:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 07:10:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 07:10:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:10:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 07:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 07:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 07:10:07 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 07:10:07 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 07:10:07 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 07:10:10 kjcf05n00 mcfcli[3673891]: %3|1730725810.009|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 07:10:20 kjcf05n00 mcfcli[3673891]: %3|1730725820.993|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:10:28 kjcf05n00 python3.9[1940422]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 07:10:40 kjcf05n00 mcfcli[3673891]: %3|1730725840.011|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 07:10:57 kjcf05n00 mcfcli[3673891]: %3|1730725857.797|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:11:10 kjcf05n00 mcfcli[3673891]: %3|1730725870.011|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 07:11:13 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 07:11:19 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 07:11:19 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 07:11:19 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 07:11:35 kjcf05n00 mcfcli[3673891]: %3|1730725895.456|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:11:40 kjcf05n00 mcfcli[3673891]: %3|1730725900.011|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:11:41 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 07:11:41 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 07:12:10 kjcf05n00 mcfcli[3673891]: %3|1730725930.011|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:12:15 kjcf05n00 mcfcli[3673891]: %3|1730725935.244|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:12:40 kjcf05n00 mcfcli[3673891]: %3|1730725960.012|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:12:55 kjcf05n00 mcfcli[3673891]: %3|1730725975.241|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:13:10 kjcf05n00 mcfcli[3673891]: %3|1730725990.012|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T07:13:27.267894491-06:00 level=info msg="Completed cleanup jobs" duration=41.2703ms Nov 4 07:13:34 kjcf05n00 mcfcli[3673891]: %3|1730726014.323|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:13:40 kjcf05n00 mcfcli[3673891]: %3|1730726020.013|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:14:10 kjcf05n00 mcfcli[3673891]: %3|1730726050.014|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 07:14:11 kjcf05n00 mcfcli[3673891]: %3|1730726051.012|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:14:40 kjcf05n00 mcfcli[3673891]: %3|1730726080.014|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:14:49 kjcf05n00 mcfcli[3673891]: %3|1730726089.118|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:15:10 kjcf05n00 mcfcli[3673891]: %3|1730726110.015|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:15:26 kjcf05n00 python3.9[1943804]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 07:15:29 kjcf05n00 mcfcli[3673891]: %3|1730726129.115|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:15:40 kjcf05n00 mcfcli[3673891]: %3|1730726140.015|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 07:16:07 kjcf05n00 mcfcli[3673891]: %3|1730726167.714|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:16:10 kjcf05n00 mcfcli[3673891]: %3|1730726170.016|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:16:40 kjcf05n00 mcfcli[3673891]: %3|1730726200.017|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 07:16:43 kjcf05n00 mcfcli[3673891]: %3|1730726203.479|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:17:10 kjcf05n00 mcfcli[3673891]: %3|1730726230.017|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 07:17:21 kjcf05n00 mcfcli[3673891]: %3|1730726241.102|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:17:40 kjcf05n00 mcfcli[3673891]: %3|1730726260.017|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 07:17:59 kjcf05n00 mcfcli[3673891]: %3|1730726279.160|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:18:10 kjcf05n00 mcfcli[3673891]: %3|1730726290.017|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:18:37 kjcf05n00 mcfcli[3673891]: %3|1730726317.855|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:18:40 kjcf05n00 mcfcli[3673891]: %3|1730726320.018|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:19:10 kjcf05n00 mcfcli[3673891]: %3|1730726350.018|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:19:17 kjcf05n00 mcfcli[3673891]: %3|1730726357.366|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:19:40 kjcf05n00 mcfcli[3673891]: %3|1730726380.018|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:19:55 kjcf05n00 mcfcli[3673891]: %3|1730726395.385|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 07:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 07:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 07:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 07:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 07:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 07:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 07:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 07:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 07:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 07:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 07:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 07:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 07:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 07:20:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 07:20:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:20:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 07:20:10 kjcf05n00 mcfcli[3673891]: %3|1730726410.019|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 07:20:26 kjcf05n00 python3.9[1946631]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 07:20:33 kjcf05n00 mcfcli[3673891]: %3|1730726433.141|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:20:40 kjcf05n00 mcfcli[3673891]: %3|1730726440.019|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:21:10 kjcf05n00 mcfcli[3673891]: %3|1730726470.019|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 07:21:10 kjcf05n00 mcfcli[3673891]: %3|1730726470.132|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:21:40 kjcf05n00 mcfcli[3673891]: %3|1730726500.020|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 07:21:45 kjcf05n00 mcfcli[3673891]: %3|1730726505.936|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:22:10 kjcf05n00 mcfcli[3673891]: %3|1730726530.020|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:22:24 kjcf05n00 mcfcli[3673891]: %3|1730726544.999|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:22:40 kjcf05n00 mcfcli[3673891]: %3|1730726560.021|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 07:23:02 kjcf05n00 mcfcli[3673891]: %3|1730726582.074|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:23:10 kjcf05n00 mcfcli[3673891]: %3|1730726590.021|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T13:23:15.867478Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 07:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T13:23:15.867543Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.087ms Nov 4 07:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T07:23:27.267992426-06:00 level=info msg="Completed cleanup jobs" duration=41.125799ms Nov 4 07:23:40 kjcf05n00 mcfcli[3673891]: %3|1730726620.021|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:23:41 kjcf05n00 mcfcli[3673891]: %3|1730726621.966|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:24:10 kjcf05n00 mcfcli[3673891]: %3|1730726650.023|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:24:11 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 07:24:11 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 13 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.006922 sec, idle for 1 hour(s)] Nov 4 07:24:21 kjcf05n00 mcfcli[3673891]: %3|1730726661.279|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:24:40 kjcf05n00 mcfcli[3673891]: %3|1730726680.023|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 07:25:00 kjcf05n00 mcfcli[3673891]: %3|1730726700.438|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:25:10 kjcf05n00 mcfcli[3673891]: %3|1730726710.023|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 07:25:26 kjcf05n00 python3.9[1949590]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 07:25:40 kjcf05n00 mcfcli[3673891]: %3|1730726740.023|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 07:25:40 kjcf05n00 mcfcli[3673891]: %3|1730726740.435|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:26:10 kjcf05n00 mcfcli[3673891]: %3|1730726770.024|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 07:26:17 kjcf05n00 mcfcli[3673891]: %3|1730726777.074|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:26:40 kjcf05n00 mcfcli[3673891]: %3|1730726800.024|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 07:26:54 kjcf05n00 mcfcli[3673891]: %3|1730726814.332|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:27:10 kjcf05n00 mcfcli[3673891]: %3|1730726830.024|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:27:33 kjcf05n00 mcfcli[3673891]: %3|1730726853.909|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:27:40 kjcf05n00 mcfcli[3673891]: %3|1730726860.025|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:28:10 kjcf05n00 mcfcli[3673891]: %3|1730726890.025|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:28:13 kjcf05n00 mcfcli[3673891]: %3|1730726893.697|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:28:40 kjcf05n00 mcfcli[3673891]: %3|1730726920.026|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:28:51 kjcf05n00 mcfcli[3673891]: %3|1730726931.312|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:29:10 kjcf05n00 mcfcli[3673891]: %3|1730726950.026|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 07:29:26 kjcf05n00 mcfcli[3673891]: %3|1730726966.463|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:29:40 kjcf05n00 mcfcli[3673891]: %3|1730726980.027|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 07:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 07:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 07:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 07:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 07:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 07:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 07:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 07:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 07:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 07:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 07:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 07:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 07:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 07:30:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 07:30:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:30:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 07:30:04 kjcf05n00 mcfcli[3673891]: %3|1730727004.042|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:30:10 kjcf05n00 mcfcli[3673891]: %3|1730727010.027|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 07:30:26 kjcf05n00 python3.9[1952420]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 07:30:40 kjcf05n00 mcfcli[3673891]: %3|1730727040.027|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 07:30:42 kjcf05n00 mcfcli[3673891]: %3|1730727042.722|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:31:10 kjcf05n00 mcfcli[3673891]: %3|1730727070.029|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 07:31:21 kjcf05n00 mcfcli[3673891]: %3|1730727081.300|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:31:40 kjcf05n00 mcfcli[3673891]: %3|1730727100.029|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:32:01 kjcf05n00 mcfcli[3673891]: %3|1730727121.298|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:32:10 kjcf05n00 mcfcli[3673891]: %3|1730727130.029|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:32:39 kjcf05n00 mcfcli[3673891]: %3|1730727159.864|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:32:40 kjcf05n00 mcfcli[3673891]: %3|1730727160.030|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:33:10 kjcf05n00 mcfcli[3673891]: %3|1730727190.530|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 07:33:18 kjcf05n00 mcfcli[3673891]: %3|1730727198.532|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T07:33:27.268004703-06:00 level=info msg="Completed cleanup jobs" duration=41.619872ms Nov 4 07:33:40 kjcf05n00 mcfcli[3673891]: %3|1730727220.782|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 07:33:54 kjcf05n00 mcfcli[3673891]: %3|1730727234.122|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:34:11 kjcf05n00 mcfcli[3673891]: %3|1730727251.031|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 07:34:31 kjcf05n00 mcfcli[3673891]: %3|1730727271.681|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:34:41 kjcf05n00 mcfcli[3673891]: %3|1730727281.031|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 07:35:10 kjcf05n00 mcfcli[3673891]: %3|1730727310.991|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:35:11 kjcf05n00 mcfcli[3673891]: %3|1730727311.532|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 07:35:32 kjcf05n00 python3.9[1955161]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 07:35:41 kjcf05n00 mcfcli[3673891]: %3|1730727341.533|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 07:35:45 kjcf05n00 mcfcli[3673891]: %3|1730727345.102|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:36:11 kjcf05n00 mcfcli[3673891]: %3|1730727371.533|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 07:36:20 kjcf05n04 python3.9[10466]: [ses_monitor.py:863 - send_syslog_gem_msg() ] [INFO] CSM:Generic : GEM /dev/sg10 SGFGD20025060FF: 2024-11-04 08:36:16.183; HAL; hal; 02; Bad CRC on IPC frame on expected 00000150 got ccd08e34 on endpoint I2C Transport 5:1 Nov 4 07:36:22 kjcf05n00 mcfcli[3673891]: %3|1730727382.953|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:36:41 kjcf05n00 mcfcli[3673891]: %3|1730727401.533|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 07:36:57 kjcf05n00 mcfcli[3673891]: %3|1730727417.058|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:37:11 kjcf05n00 mcfcli[3673891]: %3|1730727431.534|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 07:37:31 kjcf05n00 mcfcli[3673891]: %3|1730727451.524|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:37:41 kjcf05n00 mcfcli[3673891]: %3|1730727461.783|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 07:38:09 kjcf05n00 mcfcli[3673891]: %3|1730727489.660|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:38:11 kjcf05n00 mcfcli[3673891]: %3|1730727491.783|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 07:38:41 kjcf05n00 mcfcli[3673891]: %3|1730727521.784|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 07:38:47 kjcf05n00 mcfcli[3673891]: %3|1730727527.517|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:39:11 kjcf05n00 mcfcli[3673891]: %3|1730727551.784|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 07:39:26 kjcf05n00 mcfcli[3673891]: %3|1730727566.197|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:39:42 kjcf05n00 mcfcli[3673891]: %3|1730727582.036|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 07:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 07:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 07:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 07:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 07:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 07:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 07:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 07:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 07:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 07:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 07:40:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 07:40:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:40:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 07:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 07:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 07:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 07:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 07:40:05 kjcf05n00 mcfcli[3673891]: %3|1730727605.605|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:40:12 kjcf05n00 mcfcli[3673891]: %3|1730727612.037|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:40:26 kjcf05n00 python3.9[1958123]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 07:40:42 kjcf05n00 mcfcli[3673891]: %3|1730727642.037|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 07:40:45 kjcf05n00 mcfcli[3673891]: %3|1730727645.602|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:41:12 kjcf05n00 mcfcli[3673891]: %3|1730727672.037|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 07:41:22 kjcf05n00 mcfcli[3673891]: %3|1730727682.317|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:41:42 kjcf05n00 mcfcli[3673891]: %3|1730727702.038|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:42:02 kjcf05n00 mcfcli[3673891]: %3|1730727722.315|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:42:12 kjcf05n00 mcfcli[3673891]: %3|1730727732.039|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:42:42 kjcf05n00 mcfcli[3673891]: %3|1730727762.039|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:42:42 kjcf05n00 mcfcli[3673891]: %3|1730727762.312|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:43:12 kjcf05n00 mcfcli[3673891]: %3|1730727792.039|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 07:43:20 kjcf05n00 mcfcli[3673891]: %3|1730727800.101|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T07:43:27.254288228-06:00 level=info msg="Completed cleanup jobs" duration=27.344489ms Nov 4 07:43:42 kjcf05n00 mcfcli[3673891]: %3|1730727822.039|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:43:59 kjcf05n00 mcfcli[3673891]: %3|1730727839.071|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:44:12 kjcf05n00 mcfcli[3673891]: %3|1730727852.039|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 07:44:37 kjcf05n00 mcfcli[3673891]: %3|1730727877.374|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:44:42 kjcf05n00 mcfcli[3673891]: %3|1730727882.040|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:45:12 kjcf05n00 mcfcli[3673891]: %3|1730727912.041|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:45:13 kjcf05n00 mcfcli[3673891]: %3|1730727913.960|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:45:26 kjcf05n00 python3.9[1961015]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 07:45:42 kjcf05n00 mcfcli[3673891]: %3|1730727942.041|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 07:45:53 kjcf05n00 mcfcli[3673891]: %3|1730727953.957|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:46:12 kjcf05n00 mcfcli[3673891]: %3|1730727972.041|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:46:33 kjcf05n00 mcfcli[3673891]: %3|1730727993.954|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:46:42 kjcf05n00 mcfcli[3673891]: %3|1730728002.042|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:47:12 kjcf05n00 mcfcli[3673891]: %3|1730728032.042|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:47:13 kjcf05n00 mcfcli[3673891]: %3|1730728033.740|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:47:42 kjcf05n00 mcfcli[3673891]: %3|1730728062.043|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 07:47:51 kjcf05n00 mcfcli[3673891]: %3|1730728071.631|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:48:12 kjcf05n00 mcfcli[3673891]: %3|1730728092.043|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 07:48:31 kjcf05n00 mcfcli[3673891]: %3|1730728111.628|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:48:42 kjcf05n00 mcfcli[3673891]: %3|1730728122.044|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:49:11 kjcf05n00 mcfcli[3673891]: %3|1730728151.625|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:49:12 kjcf05n00 mcfcli[3673891]: %3|1730728152.044|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:49:42 kjcf05n00 mcfcli[3673891]: %3|1730728182.044|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 07:49:50 kjcf05n00 mcfcli[3673891]: %3|1730728190.016|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 07:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 07:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 07:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 07:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 07:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 07:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 07:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 07:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 07:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 07:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 07:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 07:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 07:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 07:50:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 07:50:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 07:50:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 07:50:12 kjcf05n00 mcfcli[3673891]: %3|1730728212.045|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 07:50:26 kjcf05n00 python3.9[1963807]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 07:50:29 kjcf05n00 mcfcli[3673891]: %3|1730728229.644|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:50:42 kjcf05n00 mcfcli[3673891]: %3|1730728242.045|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 07:51:07 kjcf05n00 mcfcli[3673891]: %3|1730728267.304|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:51:12 kjcf05n00 mcfcli[3673891]: %3|1730728272.045|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:51:42 kjcf05n00 mcfcli[3673891]: %3|1730728302.045|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 07:51:45 kjcf05n00 mcfcli[3673891]: %3|1730728305.518|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:52:12 kjcf05n00 mcfcli[3673891]: %3|1730728332.045|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 07:52:23 kjcf05n00 mcfcli[3673891]: %3|1730728343.793|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:52:42 kjcf05n00 mcfcli[3673891]: %3|1730728362.046|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 07:52:58 kjcf05n00 mcfcli[3673891]: %3|1730728378.948|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:53:12 kjcf05n00 mcfcli[3673891]: %3|1730728392.047|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T13:53:15.867479Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 07:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T13:53:15.867543Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.087ms Nov 4 07:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T07:53:27.269501239-06:00 level=info msg="Completed cleanup jobs" duration=43.022331ms Nov 4 07:53:34 kjcf05n00 mcfcli[3673891]: %3|1730728414.363|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:53:42 kjcf05n00 mcfcli[3673891]: %3|1730728422.047|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:54:12 kjcf05n00 mcfcli[3673891]: %3|1730728452.047|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:54:14 kjcf05n00 mcfcli[3673891]: %3|1730728454.360|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:54:42 kjcf05n00 mcfcli[3673891]: %3|1730728482.047|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:54:52 kjcf05n00 mcfcli[3673891]: %3|1730728492.738|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:55:12 kjcf05n00 mcfcli[3673891]: %3|1730728512.047|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 07:55:26 kjcf05n00 python3.9[1966601]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 07:55:30 kjcf05n00 mcfcli[3673891]: %3|1730728530.152|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:55:42 kjcf05n00 mcfcli[3673891]: %3|1730728542.048|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 07:56:08 kjcf05n00 mcfcli[3673891]: %3|1730728568.272|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:56:12 kjcf05n00 mcfcli[3673891]: %3|1730728572.048|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:56:42 kjcf05n00 mcfcli[3673891]: %3|1730728602.049|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:56:46 kjcf05n00 mcfcli[3673891]: %3|1730728606.686|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:57:12 kjcf05n00 mcfcli[3673891]: %3|1730728632.050|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 07:57:21 kjcf05n00 mcfcli[3673891]: %3|1730728641.772|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:57:42 kjcf05n00 mcfcli[3673891]: %3|1730728662.050|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 07:57:59 kjcf05n00 mcfcli[3673891]: %3|1730728679.621|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:58:12 kjcf05n00 mcfcli[3673891]: %3|1730728692.050|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:58:39 kjcf05n00 mcfcli[3673891]: %3|1730728719.618|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:58:42 kjcf05n00 mcfcli[3673891]: %3|1730728722.050|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:59:12 kjcf05n00 mcfcli[3673891]: %3|1730728752.050|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 07:59:18 kjcf05n00 mcfcli[3673891]: %3|1730728758.808|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 07:59:42 kjcf05n00 mcfcli[3673891]: %3|1730728782.051|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 07:59:58 kjcf05n00 mcfcli[3673891]: %3|1730728798.198|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 08:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 08:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 08:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 08:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 08:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 08:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 08:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 08:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 08:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 08:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 08:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 08:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 08:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 08:00:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 08:00:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:00:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 08:00:12 kjcf05n00 mcfcli[3673891]: %3|1730728812.051|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:00:26 kjcf05n00 python3.9[1969542]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 08:00:36 kjcf05n00 mcfcli[3673891]: %3|1730728836.300|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:00:42 kjcf05n00 mcfcli[3673891]: %3|1730728842.052|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 08:01:12 kjcf05n00 mcfcli[3673891]: %3|1730728872.052|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 08:01:16 kjcf05n00 mcfcli[3673891]: %3|1730728876.089|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:01:42 kjcf05n00 mcfcli[3673891]: %3|1730728902.052|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 08:01:51 kjcf05n00 mcfcli[3673891]: %3|1730728911.975|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:02:12 kjcf05n00 mcfcli[3673891]: %3|1730728932.552|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 08:02:29 kjcf05n00 mcfcli[3673891]: %3|1730728949.945|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:02:42 kjcf05n00 mcfcli[3673891]: %3|1730728962.553|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 08:03:07 kjcf05n00 mcfcli[3673891]: %3|1730728987.221|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:03:12 kjcf05n00 mcfcli[3673891]: %3|1730728992.553|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T08:03:27.253767708-06:00 level=info msg="Completed cleanup jobs" duration=27.172465ms Nov 4 08:03:42 kjcf05n00 mcfcli[3673891]: %3|1730729022.553|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:03:44 kjcf05n00 mcfcli[3673891]: %3|1730729024.252|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:04:12 kjcf05n00 mcfcli[3673891]: %3|1730729052.553|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:04:20 kjcf05n00 mcfcli[3673891]: %3|1730729060.533|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:04:42 kjcf05n00 mcfcli[3673891]: %3|1730729082.554|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 08:04:57 kjcf05n00 mcfcli[3673891]: %3|1730729097.159|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:05:12 kjcf05n00 mcfcli[3673891]: %3|1730729112.554|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 08:05:26 kjcf05n00 python3.9[1972593]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 08:05:35 kjcf05n00 mcfcli[3673891]: %3|1730729135.618|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:05:42 kjcf05n00 mcfcli[3673891]: %3|1730729142.554|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 08:06:12 kjcf05n00 mcfcli[3673891]: %3|1730729172.555|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:06:15 kjcf05n00 mcfcli[3673891]: %3|1730729175.615|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:06:42 kjcf05n00 mcfcli[3673891]: %3|1730729202.556|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:06:55 kjcf05n00 mcfcli[3673891]: %3|1730729215.612|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:07:12 kjcf05n00 mcfcli[3673891]: %3|1730729232.557|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 08:07:34 kjcf05n00 mcfcli[3673891]: %3|1730729254.525|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:07:37 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 08:07:37 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 08:07:37 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 08:07:42 kjcf05n00 mcfcli[3673891]: %3|1730729262.796|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 08:08:12 kjcf05n00 mcfcli[3673891]: %3|1730729292.556|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:08:12 kjcf05n00 mcfcli[3673891]: %3|1730729292.797|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 08:08:42 kjcf05n00 mcfcli[3673891]: %3|1730729322.797|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:08:50 kjcf05n00 mcfcli[3673891]: %3|1730729330.276|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:08:57 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 08:08:57 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 08:08:57 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 08:09:07 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 08:09:12 kjcf05n00 mcfcli[3673891]: %3|1730729352.797|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 08:09:26 kjcf05n00 mcfcli[3673891]: %3|1730729366.064|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:09:35 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 08:09:35 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 08:09:43 kjcf05n00 mcfcli[3673891]: %3|1730729383.059|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 08:09:55 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 08:09:55 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 08:09:55 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 08:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 08:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 08:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 08:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 08:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 08:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 08:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 08:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 08:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 08:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 08:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 08:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 08:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 08:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 08:10:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 08:10:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:10:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 08:10:04 kjcf05n00 mcfcli[3673891]: %3|1730729404.232|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:10:12 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 08:10:13 kjcf05n00 mcfcli[3673891]: %3|1730729413.059|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:10:30 kjcf05n00 python3.9[1975594]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 08:10:40 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 08:10:40 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 08:10:40 kjcf05n00 mcfcli[3673891]: %3|1730729440.223|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:10:43 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 08:10:43 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 08:10:43 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 08:10:43 kjcf05n00 mcfcli[3673891]: %3|1730729443.059|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 08:11:13 kjcf05n00 mcfcli[3673891]: %3|1730729473.059|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:11:20 kjcf05n00 mcfcli[3673891]: %3|1730729480.220|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:11:43 kjcf05n00 mcfcli[3673891]: %3|1730729503.060|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:12:00 kjcf05n00 mcfcli[3673891]: %3|1730729520.217|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:12:13 kjcf05n00 mcfcli[3673891]: %3|1730729533.060|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:12:37 kjcf05n00 mcfcli[3673891]: %3|1730729557.574|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:12:43 kjcf05n00 mcfcli[3673891]: %3|1730729563.061|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 08:13:13 kjcf05n00 mcfcli[3673891]: %3|1730729593.062|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 08:13:15 kjcf05n00 mcfcli[3673891]: %3|1730729595.264|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T08:13:27.252689553-06:00 level=info msg="Completed cleanup jobs" duration=26.260989ms Nov 4 08:13:43 kjcf05n00 mcfcli[3673891]: %3|1730729623.062|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:13:55 kjcf05n00 mcfcli[3673891]: %3|1730729635.261|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:14:13 kjcf05n00 mcfcli[3673891]: %3|1730729653.062|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:14:33 kjcf05n00 mcfcli[3673891]: %3|1730729673.840|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:14:43 kjcf05n00 mcfcli[3673891]: %3|1730729683.062|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 08:15:13 kjcf05n00 mcfcli[3673891]: %3|1730729713.062|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 08:15:13 kjcf05n00 mcfcli[3673891]: %3|1730729713.077|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:15:27 kjcf05n00 python3.9[1978570]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 08:15:43 kjcf05n00 mcfcli[3673891]: %3|1730729743.062|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 08:15:50 kjcf05n00 mcfcli[3673891]: %3|1730729750.793|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:16:13 kjcf05n00 mcfcli[3673891]: %3|1730729773.063|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 08:16:29 kjcf05n00 mcfcli[3673891]: %3|1730729789.400|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:16:43 kjcf05n00 mcfcli[3673891]: %3|1730729803.064|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 08:17:07 kjcf05n00 mcfcli[3673891]: %3|1730729827.514|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:17:13 kjcf05n00 mcfcli[3673891]: %3|1730729833.064|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 08:17:43 kjcf05n00 mcfcli[3673891]: %3|1730729863.064|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:17:45 kjcf05n00 mcfcli[3673891]: %3|1730729865.629|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:18:13 kjcf05n00 mcfcli[3673891]: %3|1730729893.064|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:18:24 kjcf05n00 mcfcli[3673891]: %3|1730729904.184|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:18:43 kjcf05n00 mcfcli[3673891]: %3|1730729923.064|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:19:04 kjcf05n00 mcfcli[3673891]: %3|1730729944.181|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:19:13 kjcf05n00 mcfcli[3673891]: %3|1730729953.064|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:19:43 kjcf05n00 mcfcli[3673891]: %3|1730729983.065|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:19:44 kjcf05n00 mcfcli[3673891]: %3|1730729984.178|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 08:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 08:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 08:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 08:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 08:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 08:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 08:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 08:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 08:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 08:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 08:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 08:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 08:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 08:20:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 08:20:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:20:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 08:20:13 kjcf05n00 mcfcli[3673891]: %3|1730730013.065|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 08:20:21 kjcf05n00 mcfcli[3673891]: %3|1730730021.841|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:20:27 kjcf05n00 python3.9[1981279]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 08:20:43 kjcf05n00 mcfcli[3673891]: %3|1730730043.066|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 08:21:00 kjcf05n00 mcfcli[3673891]: %3|1730730060.155|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:21:13 kjcf05n00 mcfcli[3673891]: %3|1730730073.067|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:21:39 kjcf05n00 mcfcli[3673891]: %3|1730730099.862|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:21:43 kjcf05n00 mcfcli[3673891]: %3|1730730103.067|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:22:13 kjcf05n00 mcfcli[3673891]: %3|1730730133.067|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:22:15 kjcf05n00 mcfcli[3673891]: %3|1730730135.547|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:22:43 kjcf05n00 mcfcli[3673891]: %3|1730730163.068|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 08:22:55 kjcf05n00 mcfcli[3673891]: %3|1730730175.392|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:23:13 kjcf05n00 mcfcli[3673891]: %3|1730730193.068|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T14:23:15.867988Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 08:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T14:23:15.868053Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.086ms Nov 4 08:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T08:23:27.253279566-06:00 level=info msg="Completed cleanup jobs" duration=26.580919ms Nov 4 08:23:33 kjcf05n00 mcfcli[3673891]: %3|1730730213.440|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:23:43 kjcf05n00 mcfcli[3673891]: %3|1730730223.069|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:24:11 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 08:24:11 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 14 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007635 sec, idle for 1 hour(s)] Nov 4 08:24:13 kjcf05n00 mcfcli[3673891]: %3|1730730253.287|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:24:13 kjcf05n00 mcfcli[3673891]: %3|1730730253.287|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 08:24:43 kjcf05n00 mcfcli[3673891]: %3|1730730283.569|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 08:24:52 kjcf05n00 mcfcli[3673891]: %3|1730730292.240|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:25:13 kjcf05n00 mcfcli[3673891]: %3|1730730313.569|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:25:27 kjcf05n00 python3.9[1984214]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 08:25:29 kjcf05n00 mcfcli[3673891]: %3|1730730329.901|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:25:43 kjcf05n00 mcfcli[3673891]: %3|1730730343.570|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 08:26:05 kjcf05n00 mcfcli[3673891]: %3|1730730365.866|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:26:13 kjcf05n00 mcfcli[3673891]: %3|1730730373.804|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 08:26:43 kjcf05n00 mcfcli[3673891]: %3|1730730403.804|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 08:26:44 kjcf05n00 mcfcli[3673891]: %3|1730730404.374|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:27:13 kjcf05n00 mcfcli[3673891]: %3|1730730433.804|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 08:27:19 kjcf05n00 mcfcli[3673891]: %3|1730730439.889|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:27:43 kjcf05n00 mcfcli[3673891]: %3|1730730463.804|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 08:27:58 kjcf05n00 mcfcli[3673891]: %3|1730730478.083|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:28:13 kjcf05n00 mcfcli[3673891]: %3|1730730493.805|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 08:28:36 kjcf05n00 mcfcli[3673891]: %3|1730730516.003|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:28:43 kjcf05n00 mcfcli[3673891]: %3|1730730523.805|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:29:13 kjcf05n00 mcfcli[3673891]: %3|1730730553.805|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:29:15 kjcf05n00 mcfcli[3673891]: %3|1730730555.164|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:29:43 kjcf05n00 mcfcli[3673891]: %3|1730730583.806|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 08:29:52 kjcf05n00 mcfcli[3673891]: %3|1730730592.850|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 08:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 08:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 08:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 08:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 08:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 08:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 08:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 08:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 08:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 08:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 08:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 08:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 08:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 08:30:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 08:30:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:30:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 08:30:13 kjcf05n00 mcfcli[3673891]: %3|1730730613.806|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 08:30:26 kjcf05n00 python3.9[1986970]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 08:30:30 kjcf05n00 mcfcli[3673891]: %3|1730730630.818|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:30:43 kjcf05n00 mcfcli[3673891]: %3|1730730643.806|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 08:31:09 kjcf05n00 mcfcli[3673891]: %3|1730730669.323|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:31:13 kjcf05n00 mcfcli[3673891]: %3|1730730673.806|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 08:31:44 kjcf05n00 mcfcli[3673891]: %3|1730730704.074|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 08:31:48 kjcf05n00 mcfcli[3673891]: %3|1730730708.482|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:32:14 kjcf05n00 mcfcli[3673891]: %3|1730730734.074|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 08:32:27 kjcf05n00 mcfcli[3673891]: %3|1730730747.558|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:32:44 kjcf05n00 mcfcli[3673891]: %3|1730730764.074|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 08:33:04 kjcf05n00 mcfcli[3673891]: %3|1730730784.183|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:33:14 kjcf05n00 mcfcli[3673891]: %3|1730730794.074|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 08:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T08:33:27.268588776-06:00 level=info msg="Completed cleanup jobs" duration=41.551936ms Nov 4 08:33:44 kjcf05n00 mcfcli[3673891]: %3|1730730824.074|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:33:44 kjcf05n00 mcfcli[3673891]: %3|1730730824.180|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:34:14 kjcf05n00 mcfcli[3673891]: %3|1730730854.574|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 08:34:23 kjcf05n00 mcfcli[3673891]: %3|1730730863.858|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:34:44 kjcf05n00 mcfcli[3673891]: %3|1730730884.574|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 08:35:00 kjcf05n00 mcfcli[3673891]: %3|1730730900.545|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:35:14 kjcf05n00 mcfcli[3673891]: %3|1730730914.575|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 08:35:26 kjcf05n00 python3.9[1989928]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 08:35:38 kjcf05n00 mcfcli[3673891]: %3|1730730938.996|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:35:44 kjcf05n00 mcfcli[3673891]: %3|1730730944.575|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 08:36:14 kjcf05n00 mcfcli[3673891]: %3|1730730974.576|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:36:15 kjcf05n00 mcfcli[3673891]: %3|1730730975.363|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:36:44 kjcf05n00 mcfcli[3673891]: %3|1730731004.576|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 08:36:53 kjcf05n00 mcfcli[3673891]: %3|1730731013.879|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:37:14 kjcf05n00 mcfcli[3673891]: %3|1730731034.577|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:37:31 kjcf05n00 mcfcli[3673891]: %3|1730731051.717|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:37:44 kjcf05n00 mcfcli[3673891]: %3|1730731064.577|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 08:38:09 kjcf05n00 mcfcli[3673891]: %3|1730731089.535|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:38:14 kjcf05n00 mcfcli[3673891]: %3|1730731094.577|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 08:38:44 kjcf05n00 mcfcli[3673891]: %3|1730731124.578|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 08:38:48 kjcf05n00 mcfcli[3673891]: %3|1730731128.280|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:39:14 kjcf05n00 mcfcli[3673891]: %3|1730731154.578|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:39:25 kjcf05n00 mcfcli[3673891]: %3|1730731165.939|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:39:44 kjcf05n00 mcfcli[3673891]: %3|1730731184.578|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 08:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 08:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 08:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 08:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 08:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 08:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 08:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 08:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 08:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 08:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 08:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 08:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 08:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 08:40:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 08:40:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:40:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 08:40:03 kjcf05n00 mcfcli[3673891]: %3|1730731203.815|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:40:14 kjcf05n00 mcfcli[3673891]: %3|1730731214.578|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 08:40:27 kjcf05n00 python3.9[1992653]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 08:40:37 kjcf05n00 mcfcli[3673891]: %3|1730731237.296|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:40:44 kjcf05n00 mcfcli[3673891]: %3|1730731244.580|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:41:14 kjcf05n00 mcfcli[3673891]: %3|1730731274.810|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 08:41:17 kjcf05n00 mcfcli[3673891]: %3|1730731277.181|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:41:44 kjcf05n00 mcfcli[3673891]: %3|1730731304.873|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 08:41:54 kjcf05n00 mcfcli[3673891]: %3|1730731314.872|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:42:15 kjcf05n00 mcfcli[3673891]: %3|1730731335.080|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 08:42:32 kjcf05n00 mcfcli[3673891]: %3|1730731352.090|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:42:45 kjcf05n00 mcfcli[3673891]: %3|1730731365.080|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 08:43:12 kjcf05n00 mcfcli[3673891]: %3|1730731392.088|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:43:15 kjcf05n00 mcfcli[3673891]: %3|1730731395.081|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 08:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T08:43:27.262065746-06:00 level=info msg="Completed cleanup jobs" duration=35.600861ms Nov 4 08:43:45 kjcf05n00 mcfcli[3673891]: %3|1730731425.081|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 08:43:52 kjcf05n00 mcfcli[3673891]: %3|1730731432.084|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:44:15 kjcf05n00 mcfcli[3673891]: %3|1730731455.082|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 08:44:30 kjcf05n00 mcfcli[3673891]: %3|1730731470.688|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:44:45 kjcf05n00 mcfcli[3673891]: %3|1730731485.082|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:45:10 kjcf05n00 mcfcli[3673891]: %3|1730731510.520|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:45:15 kjcf05n00 mcfcli[3673891]: %3|1730731515.082|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:45:27 kjcf05n00 python3.9[1995479]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 08:45:45 kjcf05n00 mcfcli[3673891]: %3|1730731545.083|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 08:45:49 kjcf05n00 mcfcli[3673891]: %3|1730731549.445|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:46:15 kjcf05n00 mcfcli[3673891]: %3|1730731575.083|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:46:29 kjcf05n00 mcfcli[3673891]: %3|1730731589.442|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:46:45 kjcf05n00 mcfcli[3673891]: %3|1730731605.083|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:47:07 kjcf05n00 mcfcli[3673891]: %3|1730731627.443|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:47:15 kjcf05n00 mcfcli[3673891]: %3|1730731635.083|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:47:45 kjcf05n00 mcfcli[3673891]: %3|1730731665.084|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:47:47 kjcf05n00 mcfcli[3673891]: %3|1730731667.440|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:48:15 kjcf05n00 mcfcli[3673891]: %3|1730731695.084|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:48:25 kjcf05n00 mcfcli[3673891]: %3|1730731705.636|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:48:45 kjcf05n00 mcfcli[3673891]: %3|1730731725.084|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:49:04 kjcf05n00 mcfcli[3673891]: %3|1730731744.182|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:49:15 kjcf05n00 mcfcli[3673891]: %3|1730731755.084|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 08:49:43 kjcf05n00 mcfcli[3673891]: %3|1730731783.144|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:49:45 kjcf05n00 mcfcli[3673891]: %3|1730731785.085|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 08:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 08:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 08:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 08:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 08:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 08:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 08:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 08:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 08:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 08:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 08:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 08:50:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 08:50:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:50:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 08:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 08:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 08:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 08:50:15 kjcf05n00 mcfcli[3673891]: %3|1730731815.085|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:50:21 kjcf05n00 mcfcli[3673891]: %3|1730731821.357|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:50:27 kjcf05n00 python3.9[1998395]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 08:50:45 kjcf05n00 mcfcli[3673891]: %3|1730731845.085|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:50:59 kjcf05n00 mcfcli[3673891]: %3|1730731859.687|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:51:15 kjcf05n00 mcfcli[3673891]: %3|1730731875.086|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:51:37 kjcf05n00 mcfcli[3673891]: %3|1730731897.929|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:51:45 kjcf05n00 mcfcli[3673891]: %3|1730731905.087|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:52:15 kjcf05n00 mcfcli[3673891]: %3|1730731935.087|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:52:17 kjcf05n00 mcfcli[3673891]: %3|1730731937.376|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:52:45 kjcf05n00 mcfcli[3673891]: %3|1730731965.588|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 08:52:55 kjcf05n00 mcfcli[3673891]: %3|1730731975.053|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:53:15 kjcf05n00 mcfcli[3673891]: %3|1730731995.589|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 08:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T14:53:15.867560Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 08:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T14:53:15.867623Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.080ms Nov 4 08:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T08:53:27.270172488-06:00 level=info msg="Completed cleanup jobs" duration=43.383012ms Nov 4 08:53:31 kjcf05n00 mcfcli[3673891]: %3|1730732011.408|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:53:45 kjcf05n00 mcfcli[3673891]: %3|1730732025.815|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 08:54:09 kjcf05n00 mcfcli[3673891]: %3|1730732049.828|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:54:15 kjcf05n00 mcfcli[3673891]: %3|1730732055.815|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 08:54:45 kjcf05n00 mcfcli[3673891]: %3|1730732085.816|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 08:54:46 kjcf05n00 mcfcli[3673891]: %3|1730732086.511|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:55:15 kjcf05n00 mcfcli[3673891]: %3|1730732115.816|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 08:55:24 kjcf05n00 mcfcli[3673891]: %3|1730732124.296|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:55:34 kjcf05n00 python3.9[2001217]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 08:55:46 kjcf05n00 mcfcli[3673891]: %3|1730732146.090|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 08:56:03 kjcf05n00 mcfcli[3673891]: %3|1730732163.998|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:56:16 kjcf05n00 mcfcli[3673891]: %3|1730732176.090|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:56:40 kjcf05n00 mcfcli[3673891]: %3|1730732200.246|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:56:46 kjcf05n00 mcfcli[3673891]: %3|1730732206.091|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:57:16 kjcf05n00 mcfcli[3673891]: %3|1730732236.091|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 08:57:19 kjcf05n00 mcfcli[3673891]: %3|1730732239.777|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:57:46 kjcf05n00 mcfcli[3673891]: %3|1730732266.091|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 08:57:57 kjcf05n00 mcfcli[3673891]: %3|1730732277.599|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:58:16 kjcf05n00 mcfcli[3673891]: %3|1730732296.091|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 08:58:37 kjcf05n00 mcfcli[3673891]: %3|1730732317.596|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:58:46 kjcf05n00 mcfcli[3673891]: %3|1730732326.093|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 08:59:15 kjcf05n00 mcfcli[3673891]: %3|1730732355.580|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 08:59:16 kjcf05n00 mcfcli[3673891]: %3|1730732356.093|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 08:59:46 kjcf05n00 mcfcli[3673891]: %3|1730732386.094|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 08:59:55 kjcf05n00 mcfcli[3673891]: %3|1730732395.577|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 09:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 09:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 09:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 09:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 09:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 09:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 09:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 09:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 09:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 09:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 09:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 09:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 09:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 09:00:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 09:00:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:00:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 09:00:16 kjcf05n00 mcfcli[3673891]: %3|1730732416.094|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 09:00:29 kjcf05n00 python3.9[2004077]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 09:00:33 kjcf05n00 mcfcli[3673891]: %3|1730732433.975|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:00:46 kjcf05n00 mcfcli[3673891]: %3|1730732446.094|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:01:13 kjcf05n00 mcfcli[3673891]: %3|1730732473.972|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:01:16 kjcf05n00 mcfcli[3673891]: %3|1730732476.094|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:01:46 kjcf05n00 mcfcli[3673891]: %3|1730732506.095|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 09:01:50 kjcf05n00 mcfcli[3673891]: %3|1730732510.118|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:02:16 kjcf05n00 mcfcli[3673891]: %3|1730732536.096|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 09:02:30 kjcf05n00 mcfcli[3673891]: %3|1730732550.114|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:02:46 kjcf05n00 mcfcli[3673891]: %3|1730732566.096|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 09:03:08 kjcf05n00 mcfcli[3673891]: %3|1730732588.800|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:03:16 kjcf05n00 mcfcli[3673891]: %3|1730732596.096|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 09:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T09:03:27.248011397-06:00 level=info msg="Completed cleanup jobs" duration=21.580032ms Nov 4 09:03:45 kjcf05n00 mcfcli[3673891]: %3|1730732625.934|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:03:46 kjcf05n00 mcfcli[3673891]: %3|1730732626.096|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 09:04:16 kjcf05n00 mcfcli[3673891]: %3|1730732656.097|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:04:25 kjcf05n00 mcfcli[3673891]: %3|1730732665.931|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:04:46 kjcf05n00 mcfcli[3673891]: %3|1730732686.097|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:05:03 kjcf05n00 mcfcli[3673891]: %3|1730732703.125|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:05:16 kjcf05n00 mcfcli[3673891]: %3|1730732716.098|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 09:05:27 kjcf05n00 python3.9[2006806]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 09:05:28 kjcf05n00 diskmonitor[2758297]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 09:05:40 kjcf05n00 mcfcli[3673891]: %3|1730732740.379|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:05:46 kjcf05n00 mcfcli[3673891]: %3|1730732746.098|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:06:16 kjcf05n00 mcfcli[3673891]: %3|1730732776.098|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:06:20 kjcf05n00 mcfcli[3673891]: %3|1730732780.376|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:06:46 kjcf05n00 mcfcli[3673891]: %3|1730732806.098|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:06:58 kjcf05n00 mcfcli[3673891]: %3|1730732818.543|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:07:16 kjcf05n01 diskmonitor[1331407]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 09:07:16 kjcf05n00 mcfcli[3673891]: %3|1730732836.098|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:07:32 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 09:07:32 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 09:07:32 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 09:07:38 kjcf05n00 mcfcli[3673891]: %3|1730732858.540|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:07:46 kjcf05n00 mcfcli[3673891]: %3|1730732866.099|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:08:02 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 09:08:02 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 09:08:02 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 09:08:13 kjcf05n00 mcfcli[3673891]: %3|1730732893.285|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:08:16 kjcf05n00 mcfcli[3673891]: %3|1730732896.100|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 09:08:24 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 09:08:24 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 09:08:24 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 09:08:46 kjcf05n00 mcfcli[3673891]: %3|1730732926.100|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:08:53 kjcf05n00 mcfcli[3673891]: %3|1730732933.282|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:09:09 kjcf05n01 diskmonitor[1331407]: leaving test state: 1 next state: 2 Nov 4 09:09:09 kjcf05n01 diskmonitor[1331407]: lock req: no timeout Nov 4 09:09:09 kjcf05n01 diskmonitor[1331407]: leaving test state: 2 next state: 4 Nov 4 09:09:16 kjcf05n00 mcfcli[3673891]: %3|1730732956.100|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:09:33 kjcf05n00 mcfcli[3673891]: %3|1730732973.186|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:09:46 kjcf05n00 mcfcli[3673891]: %3|1730732986.101|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 09:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 09:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 09:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 09:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 09:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 09:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 09:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 09:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 09:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 09:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 09:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 09:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 09:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 09:10:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 09:10:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:10:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 09:10:11 kjcf05n00 mcfcli[3673891]: %3|1730733011.722|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:10:16 kjcf05n00 mcfcli[3673891]: %3|1730733016.102|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:10:18 kjcf05n01 diskmonitor[1331407]: lock acquired Nov 4 09:10:18 kjcf05n01 diskmonitor[1331407]: leaving test state: 4 next state: 8 Nov 4 09:10:26 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 09:10:26 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 09:10:26 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 09:10:27 kjcf05n00 python3.9[2009786]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 09:10:30 kjcf05n01 diskmonitor[1331407]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 4 09:10:30 kjcf05n01 diskmonitor[1331407]: leaving test state: 8 next state: 20 Nov 4 09:10:30 kjcf05n01 diskmonitor[1331407]: leaving test state: 20 next state: 40 Nov 4 09:10:30 kjcf05n01 diskmonitor[1331407]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset 52dc380000 Nov 4 09:10:30 kjcf05n01 diskmonitor[1331407]: leaving test state: 40 next state: 80 Nov 4 09:10:46 kjcf05n00 mcfcli[3673891]: %3|1730733046.102|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 09:10:50 kjcf05n00 mcfcli[3673891]: %3|1730733050.173|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:11:16 kjcf05n00 mcfcli[3673891]: %3|1730733076.103|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:11:23 kjcf05n01 diskmonitor[1331407]: leaving test state: 80 next state: 100 Nov 4 09:11:23 kjcf05n01 diskmonitor[1331407]: lock release: time: Mon Nov 4 09:11:21 2024 Nov 4 09:11:23 kjcf05n01 diskmonitor[1331407]: leaving test state: 100 next state: 1 Nov 4 09:11:26 kjcf05n00 mcfcli[3673891]: %3|1730733086.429|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:11:36 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 09:11:46 kjcf05n00 mcfcli[3673891]: %3|1730733106.103|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 09:11:53 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 09:12:03 kjcf05n00 mcfcli[3673891]: %3|1730733123.956|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:12:04 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 09:12:04 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 09:12:16 kjcf05n00 mcfcli[3673891]: %3|1730733136.104|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:12:28 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 09:12:28 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 09:12:41 kjcf05n00 mcfcli[3673891]: %3|1730733161.477|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:12:46 kjcf05n00 mcfcli[3673891]: %3|1730733166.104|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:13:16 kjcf05n00 mcfcli[3673891]: %3|1730733196.104|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:13:20 kjcf05n00 mcfcli[3673891]: %3|1730733200.499|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T09:13:27.253289954-06:00 level=info msg="Completed cleanup jobs" duration=26.237306ms Nov 4 09:13:46 kjcf05n00 mcfcli[3673891]: %3|1730733226.104|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:13:59 kjcf05n00 mcfcli[3673891]: %3|1730733239.511|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:14:16 kjcf05n00 mcfcli[3673891]: %3|1730733256.105|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:14:39 kjcf05n00 mcfcli[3673891]: %3|1730733279.508|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:14:46 kjcf05n00 mcfcli[3673891]: %3|1730733286.105|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:15:15 kjcf05n00 mcfcli[3673891]: %3|1730733315.854|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:15:16 kjcf05n00 mcfcli[3673891]: %3|1730733316.106|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:15:27 kjcf05n00 python3.9[2012668]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 09:15:28 kjcf05n00 diskmonitor[2758297]: leaving test state: 1 next state: 2 Nov 4 09:15:28 kjcf05n00 diskmonitor[2758297]: lock req: no timeout Nov 4 09:15:28 kjcf05n00 diskmonitor[2758297]: leaving test state: 2 next state: 4 Nov 4 09:15:46 kjcf05n00 mcfcli[3673891]: %3|1730733346.605|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:15:54 kjcf05n00 mcfcli[3673891]: %3|1730733354.695|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:16:16 kjcf05n00 mcfcli[3673891]: %3|1730733376.605|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 09:16:29 kjcf05n00 mcfcli[3673891]: %3|1730733389.393|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:16:38 kjcf05n00 diskmonitor[2758297]: lock acquired Nov 4 09:16:38 kjcf05n00 diskmonitor[2758297]: leaving test state: 4 next state: 8 Nov 4 09:16:46 kjcf05n00 mcfcli[3673891]: %3|1730733406.605|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:16:53 kjcf05n00 diskmonitor[2758297]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 4 09:16:53 kjcf05n00 diskmonitor[2758297]: leaving test state: 8 next state: 20 Nov 4 09:16:53 kjcf05n00 diskmonitor[2758297]: leaving test state: 20 next state: 40 Nov 4 09:16:53 kjcf05n00 diskmonitor[2758297]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset 272aca0000 Nov 4 09:16:53 kjcf05n00 diskmonitor[2758297]: leaving test state: 40 next state: 80 Nov 4 09:17:09 kjcf05n00 mcfcli[3673891]: %3|1730733429.391|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:17:16 kjcf05n00 mcfcli[3673891]: %3|1730733436.605|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:17:44 kjcf05n00 mcfcli[3673891]: %3|1730733464.885|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:17:46 kjcf05n00 diskmonitor[2758297]: leaving test state: 80 next state: 100 Nov 4 09:17:46 kjcf05n00 diskmonitor[2758297]: lock release: time: Mon Nov 4 09:17:44 2024 Nov 4 09:17:46 kjcf05n00 diskmonitor[2758297]: leaving test state: 100 next state: 1 Nov 4 09:17:46 kjcf05n00 mcfcli[3673891]: %3|1730733466.606|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 09:18:16 kjcf05n00 mcfcli[3673891]: %3|1730733496.606|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:18:24 kjcf05n00 mcfcli[3673891]: %3|1730733504.269|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:18:46 kjcf05n00 mcfcli[3673891]: %3|1730733526.607|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:18:59 kjcf05n00 mcfcli[3673891]: %3|1730733539.263|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:19:16 kjcf05n00 mcfcli[3673891]: %3|1730733556.607|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:19:36 kjcf05n00 mcfcli[3673891]: %3|1730733576.393|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:19:46 kjcf05n00 mcfcli[3673891]: %3|1730733586.608|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 09:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 09:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 09:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 09:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 09:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 09:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 09:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 09:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 09:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 09:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 09:20:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 09:20:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:20:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 09:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 09:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 09:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 09:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 09:20:15 kjcf05n00 mcfcli[3673891]: %3|1730733615.075|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:20:16 kjcf05n00 mcfcli[3673891]: %3|1730733616.825|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 09:20:27 kjcf05n00 python3.9[2016497]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 09:20:46 kjcf05n00 mcfcli[3673891]: %3|1730733646.826|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 09:20:53 kjcf05n00 mcfcli[3673891]: %3|1730733653.178|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:21:16 kjcf05n00 mcfcli[3673891]: %3|1730733676.826|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:21:30 kjcf05n00 mcfcli[3673891]: %3|1730733690.091|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:21:47 kjcf05n00 mcfcli[3673891]: %3|1730733707.110|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 09:22:10 kjcf05n00 mcfcli[3673891]: %3|1730733730.088|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:22:17 kjcf05n00 mcfcli[3673891]: %3|1730733737.110|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 09:22:47 kjcf05n00 mcfcli[3673891]: %3|1730733767.110|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 09:22:48 kjcf05n00 mcfcli[3673891]: %3|1730733768.844|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T15:23:15.867993Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 09:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T15:23:15.868120Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.145ms Nov 4 09:23:17 kjcf05n00 mcfcli[3673891]: %3|1730733797.110|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 09:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T09:23:27.253401182-06:00 level=info msg="Completed cleanup jobs" duration=26.467306ms Nov 4 09:23:27 kjcf05n00 mcfcli[3673891]: %3|1730733807.920|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:23:47 kjcf05n00 mcfcli[3673891]: %3|1730733827.111|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:24:05 kjcf05n00 mcfcli[3673891]: %3|1730733845.297|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:24:11 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 09:24:11 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 10 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007051 sec, idle for 1 hour(s)] Nov 4 09:24:17 kjcf05n00 mcfcli[3673891]: %3|1730733857.111|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:24:44 kjcf05n00 mcfcli[3673891]: %3|1730733884.005|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:24:47 kjcf05n00 mcfcli[3673891]: %3|1730733887.112|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:25:17 kjcf05n00 mcfcli[3673891]: %3|1730733917.112|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:25:23 kjcf05n00 mcfcli[3673891]: %3|1730733923.277|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:25:27 kjcf05n00 python3.9[2019309]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 09:25:47 kjcf05n00 mcfcli[3673891]: %3|1730733947.112|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:26:02 kjcf05n00 mcfcli[3673891]: %3|1730733962.469|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:26:17 kjcf05n00 mcfcli[3673891]: %3|1730733977.112|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:26:42 kjcf05n00 mcfcli[3673891]: %3|1730734002.466|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:26:47 kjcf05n00 mcfcli[3673891]: %3|1730734007.112|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:27:17 kjcf05n00 mcfcli[3673891]: %3|1730734037.113|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 09:27:20 kjcf05n00 mcfcli[3673891]: %3|1730734040.808|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:27:47 kjcf05n00 mcfcli[3673891]: %3|1730734067.113|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 09:27:57 kjcf05n00 mcfcli[3673891]: %3|1730734077.513|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:28:17 kjcf05n00 mcfcli[3673891]: %3|1730734097.114|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:28:35 kjcf05n00 mcfcli[3673891]: %3|1730734115.444|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:28:47 kjcf05n00 mcfcli[3673891]: %3|1730734127.114|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 09:29:13 kjcf05n00 mcfcli[3673891]: %3|1730734153.302|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:29:17 kjcf05n00 mcfcli[3673891]: %3|1730734157.114|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:29:47 kjcf05n00 mcfcli[3673891]: %3|1730734187.115|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:29:51 kjcf05n00 mcfcli[3673891]: %3|1730734191.510|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 09:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 09:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 09:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 09:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 09:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 09:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 09:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 09:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 09:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 09:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 09:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 09:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 09:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 09:30:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 09:30:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:30:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 09:30:17 kjcf05n00 mcfcli[3673891]: %3|1730734217.116|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:30:31 kjcf05n00 mcfcli[3673891]: %3|1730734231.507|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:30:33 kjcf05n00 python3.9[2022269]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 09:30:47 kjcf05n00 mcfcli[3673891]: %3|1730734247.116|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:31:10 kjcf05n00 mcfcli[3673891]: %3|1730734270.339|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:31:17 kjcf05n00 mcfcli[3673891]: %3|1730734277.116|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:31:47 kjcf05n00 mcfcli[3673891]: %3|1730734307.116|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:31:49 kjcf05n00 mcfcli[3673891]: %3|1730734309.043|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:32:17 kjcf05n00 mcfcli[3673891]: %3|1730734337.117|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:32:26 kjcf05n00 mcfcli[3673891]: %3|1730734346.838|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:32:47 kjcf05n00 mcfcli[3673891]: %3|1730734367.117|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 09:33:06 kjcf05n00 mcfcli[3673891]: %3|1730734386.835|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:33:17 kjcf05n00 mcfcli[3673891]: %3|1730734397.617|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 09:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T09:33:27.252480821-06:00 level=info msg="Completed cleanup jobs" duration=26.034025ms Nov 4 09:33:43 kjcf05n00 mcfcli[3673891]: %3|1730734423.976|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:33:47 kjcf05n00 mcfcli[3673891]: %3|1730734427.617|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 09:34:17 kjcf05n00 mcfcli[3673891]: %3|1730734457.618|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:34:23 kjcf05n00 mcfcli[3673891]: %3|1730734463.760|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:34:47 kjcf05n00 mcfcli[3673891]: %3|1730734487.618|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:35:01 kjcf05n00 mcfcli[3673891]: %3|1730734501.279|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:35:17 kjcf05n00 mcfcli[3673891]: %3|1730734517.618|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:35:28 kjcf05n00 python3.9[2025056]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 09:35:36 kjcf05n00 mcfcli[3673891]: %3|1730734536.704|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:35:47 kjcf05n00 mcfcli[3673891]: %3|1730734547.619|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:36:14 kjcf05n00 mcfcli[3673891]: %3|1730734574.817|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:36:17 kjcf05n00 mcfcli[3673891]: %3|1730734577.619|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 09:36:47 kjcf05n00 mcfcli[3673891]: %3|1730734607.621|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 09:36:54 kjcf05n00 mcfcli[3673891]: %3|1730734614.814|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:37:17 kjcf05n00 mcfcli[3673891]: %3|1730734637.832|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 09:37:32 kjcf05n00 mcfcli[3673891]: %3|1730734652.321|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:37:47 kjcf05n00 mcfcli[3673891]: %3|1730734667.832|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:38:12 kjcf05n00 mcfcli[3673891]: %3|1730734692.318|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:38:17 kjcf05n00 mcfcli[3673891]: %3|1730734697.832|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:38:47 kjcf05n00 mcfcli[3673891]: %3|1730734727.833|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:38:48 kjcf05n00 mcfcli[3673891]: %3|1730734728.946|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:39:18 kjcf05n00 mcfcli[3673891]: %3|1730734758.122|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 09:39:28 kjcf05n00 mcfcli[3673891]: %3|1730734768.866|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:39:48 kjcf05n00 mcfcli[3673891]: %3|1730734788.122|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 09:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 09:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 09:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 09:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 09:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 09:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 09:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 09:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 09:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 09:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 09:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 09:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 09:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 09:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 09:40:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 09:40:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:40:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 09:40:05 kjcf05n03 ipmievd[4004]: Voltage sensor V1P8_S5 Upper Non-critical going high Asserted (Reading 2.40 > Threshold 2 Volts) Nov 4 09:40:05 kjcf05n03 ipmievd[4004]: Voltage sensor V1P8_S5 Upper Critical going high Asserted (Reading 2.40 > Threshold 2.10 Volts) Nov 4 09:40:05 kjcf05n03 ipmievd[4004]: Voltage sensor V1P8_S5 Upper Non-recoverable going high Asserted (Reading 2.40 > Threshold 2.20 Volts) Nov 4 09:40:05 kjcf05n03 ipmievd[4004]: Voltage sensor V1P8_S5 Upper Non-recoverable going high Deasserted (Reading 1.80 > Threshold 2.20 Volts) Nov 4 09:40:05 kjcf05n03 ipmievd[4004]: Voltage sensor V1P8_S5 Upper Critical going high Deasserted (Reading 1.80 > Threshold 2.10 Volts) Nov 4 09:40:05 kjcf05n03 ipmievd[4004]: Voltage sensor V1P8_S5 Upper Non-critical going high Deasserted (Reading 1.80 > Threshold 2 Volts) Nov 4 09:40:06 kjcf05n00 mcfcli[3673891]: %3|1730734806.764|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:40:18 kjcf05n00 mcfcli[3673891]: %3|1730734818.123|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:40:27 kjcf05n00 python3.9[2027859]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 09:40:42 kjcf05n00 mcfcli[3673891]: %3|1730734842.430|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:40:48 kjcf05n00 mcfcli[3673891]: %3|1730734848.123|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:41:18 kjcf05n00 mcfcli[3673891]: %3|1730734878.123|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:41:22 kjcf05n00 mcfcli[3673891]: %3|1730734882.427|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:41:48 kjcf05n00 mcfcli[3673891]: %3|1730734908.123|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:42:02 kjcf05n00 mcfcli[3673891]: %3|1730734922.424|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:42:18 kjcf05n00 mcfcli[3673891]: %3|1730734938.124|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:42:41 kjcf05n00 mcfcli[3673891]: %3|1730734961.005|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:42:48 kjcf05n00 mcfcli[3673891]: %3|1730734968.124|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:43:18 kjcf05n00 mcfcli[3673891]: %3|1730734998.125|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:43:21 kjcf05n00 mcfcli[3673891]: %3|1730735001.003|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T09:43:27.253145947-06:00 level=info msg="Completed cleanup jobs" duration=26.63968ms Nov 4 09:43:48 kjcf05n00 mcfcli[3673891]: %3|1730735028.126|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:43:59 kjcf05n00 mcfcli[3673891]: %3|1730735039.339|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:44:18 kjcf05n00 mcfcli[3673891]: %3|1730735058.126|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:44:37 kjcf05n00 mcfcli[3673891]: %3|1730735077.496|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:44:48 kjcf05n00 mcfcli[3673891]: %3|1730735088.127|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 09:45:14 kjcf05n00 mcfcli[3673891]: %3|1730735114.702|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:45:18 kjcf05n00 mcfcli[3673891]: %3|1730735118.127|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 09:45:32 kjcf05n00 python3.9[2030862]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 09:45:48 kjcf05n00 mcfcli[3673891]: %3|1730735148.127|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:45:52 kjcf05n00 mcfcli[3673891]: %3|1730735152.920|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:46:18 kjcf05n00 mcfcli[3673891]: %3|1730735178.127|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:46:29 kjcf05n00 mcfcli[3673891]: %3|1730735189.702|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:46:48 kjcf05n00 mcfcli[3673891]: %3|1730735208.127|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 09:47:05 kjcf05n00 mcfcli[3673891]: %3|1730735225.921|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:47:18 kjcf05n00 mcfcli[3673891]: %3|1730735238.129|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:47:45 kjcf05n00 mcfcli[3673891]: %3|1730735265.918|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:47:48 kjcf05n00 mcfcli[3673891]: %3|1730735268.129|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:47:52 kjcf05n04 diskmonitor[39342]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 09:48:18 kjcf05n00 mcfcli[3673891]: %3|1730735298.129|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:48:23 kjcf05n00 mcfcli[3673891]: %3|1730735303.711|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:48:48 kjcf05n00 mcfcli[3673891]: %3|1730735328.129|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:49:03 kjcf05n00 mcfcli[3673891]: %3|1730735343.708|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:49:18 kjcf05n00 mcfcli[3673891]: %3|1730735358.629|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 09:49:24 kjcf05n07 diskmonitor[19063]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 09:49:24 kjcf05n06 diskmonitor[19372]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 09:49:40 kjcf05n00 mcfcli[3673891]: %3|1730735380.767|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:49:48 kjcf05n00 mcfcli[3673891]: %3|1730735388.629|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:49:52 kjcf05n05 diskmonitor[40540]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 09:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 09:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 09:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 09:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 09:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 09:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 09:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 09:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 09:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 09:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 09:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 09:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 09:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 09:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 09:50:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 09:50:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 09:50:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 09:50:18 kjcf05n00 mcfcli[3673891]: %3|1730735418.629|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:50:18 kjcf05n00 mcfcli[3673891]: %3|1730735418.745|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:50:27 kjcf05n00 python3.9[2033617]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 09:50:48 kjcf05n00 mcfcli[3673891]: %3|1730735448.631|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 09:50:56 kjcf05n00 mcfcli[3673891]: %3|1730735456.829|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:51:18 kjcf05n00 mcfcli[3673891]: %3|1730735478.837|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 09:51:34 kjcf05n00 mcfcli[3673891]: %3|1730735494.733|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:51:48 kjcf05n00 mcfcli[3673891]: %3|1730735508.837|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 09:52:13 kjcf05n00 mcfcli[3673891]: %3|1730735533.461|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:52:18 kjcf05n00 mcfcli[3673891]: %3|1730735538.838|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:52:48 kjcf05n00 mcfcli[3673891]: %3|1730735568.838|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:52:52 kjcf05n00 mcfcli[3673891]: %3|1730735572.316|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T15:53:15.867833Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 09:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T15:53:15.867897Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.086ms Nov 4 09:53:18 kjcf05n00 mcfcli[3673891]: %3|1730735598.838|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T09:53:27.270046388-06:00 level=info msg="Completed cleanup jobs" duration=43.617325ms Nov 4 09:53:28 kjcf05n00 mcfcli[3673891]: %3|1730735608.051|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:53:48 kjcf05n00 mcfcli[3673891]: %3|1730735628.839|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:54:04 kjcf05n00 mcfcli[3673891]: %3|1730735644.709|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:54:19 kjcf05n00 mcfcli[3673891]: %3|1730735659.133|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 09:54:44 kjcf05n00 mcfcli[3673891]: %3|1730735684.706|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:54:49 kjcf05n00 mcfcli[3673891]: %3|1730735689.133|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:55:19 kjcf05n00 mcfcli[3673891]: %3|1730735719.133|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 09:55:22 kjcf05n00 mcfcli[3673891]: %3|1730735722.653|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:55:28 kjcf05n00 python3.9[2036431]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 09:55:49 kjcf05n00 mcfcli[3673891]: %3|1730735749.133|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 09:55:59 kjcf05n00 mcfcli[3673891]: %3|1730735759.825|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:56:19 kjcf05n00 mcfcli[3673891]: %3|1730735779.135|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:56:35 kjcf05n00 mcfcli[3673891]: %3|1730735795.352|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:56:49 kjcf05n00 mcfcli[3673891]: %3|1730735809.135|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:57:13 kjcf05n00 mcfcli[3673891]: %3|1730735833.985|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:57:19 kjcf05n00 mcfcli[3673891]: %3|1730735839.135|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:57:49 kjcf05n00 mcfcli[3673891]: %3|1730735869.135|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:57:53 kjcf05n00 mcfcli[3673891]: %3|1730735873.926|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:58:19 kjcf05n00 mcfcli[3673891]: %3|1730735899.135|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:58:32 kjcf05n00 mcfcli[3673891]: %3|1730735912.618|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:58:49 kjcf05n00 mcfcli[3673891]: %3|1730735929.136|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 09:59:10 kjcf05n00 mcfcli[3673891]: %3|1730735950.501|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:59:19 kjcf05n00 mcfcli[3673891]: %3|1730735959.136|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 09:59:48 kjcf05n00 mcfcli[3673891]: %3|1730735988.446|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 09:59:49 kjcf05n00 mcfcli[3673891]: %3|1730735989.136|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 10:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 10:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 10:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 10:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 10:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 10:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 10:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 10:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 10:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 10:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 10:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 10:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 10:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 10:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 10:00:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 10:00:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:00:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 10:00:19 kjcf05n00 mcfcli[3673891]: %3|1730736019.136|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:00:23 kjcf05n00 mcfcli[3673891]: %3|1730736023.957|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:00:28 kjcf05n00 python3.9[2039253]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 10:00:49 kjcf05n00 mcfcli[3673891]: %3|1730736049.136|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:01:03 kjcf05n00 mcfcli[3673891]: %3|1730736063.119|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:01:19 kjcf05n00 mcfcli[3673891]: %3|1730736079.136|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 10:01:41 kjcf05n00 mcfcli[3673891]: %3|1730736101.735|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:01:49 kjcf05n00 mcfcli[3673891]: %3|1730736109.136|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:02:19 kjcf05n00 mcfcli[3673891]: %3|1730736139.137|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:02:21 kjcf05n00 mcfcli[3673891]: %3|1730736141.733|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:02:49 kjcf05n00 mcfcli[3673891]: %3|1730736169.138|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:02:59 kjcf05n00 mcfcli[3673891]: %3|1730736179.902|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:03:19 kjcf05n00 mcfcli[3673891]: %3|1730736199.138|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T10:03:27.252714938-06:00 level=info msg="Completed cleanup jobs" duration=26.212759ms Nov 4 10:03:36 kjcf05n00 mcfcli[3673891]: %3|1730736216.281|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:03:49 kjcf05n00 mcfcli[3673891]: %3|1730736229.138|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 10:04:16 kjcf05n00 mcfcli[3673891]: %3|1730736256.278|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:04:19 kjcf05n00 mcfcli[3673891]: %3|1730736259.138|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:04:49 kjcf05n00 mcfcli[3673891]: %3|1730736289.139|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:04:56 kjcf05n00 mcfcli[3673891]: %3|1730736296.275|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:05:15 kjcf05n02 diskmonitor[17328]: leaving test state: 1 next state: 2 Nov 4 10:05:15 kjcf05n02 diskmonitor[17328]: lock req: no timeout Nov 4 10:05:15 kjcf05n02 diskmonitor[17328]: leaving test state: 2 next state: 4 Nov 4 10:05:19 kjcf05n00 mcfcli[3673891]: %3|1730736319.139|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:05:28 kjcf05n00 python3.9[2042231]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 10:05:33 kjcf05n00 mcfcli[3673891]: %3|1730736333.914|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:05:49 kjcf05n00 mcfcli[3673891]: %3|1730736349.140|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 10:06:10 kjcf05n00 mcfcli[3673891]: %3|1730736370.895|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:06:19 kjcf05n00 mcfcli[3673891]: %3|1730736379.140|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:06:26 kjcf05n02 diskmonitor[17328]: lock acquired Nov 4 10:06:26 kjcf05n02 diskmonitor[17328]: leaving test state: 4 next state: 8 Nov 4 10:06:43 kjcf05n02 diskmonitor[17328]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 4 10:06:43 kjcf05n02 diskmonitor[17328]: leaving test state: 8 next state: 20 Nov 4 10:06:43 kjcf05n02 diskmonitor[17328]: leaving test state: 20 next state: 40 Nov 4 10:06:43 kjcf05n02 diskmonitor[17328]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 2d01d1b8000 Nov 4 10:06:43 kjcf05n02 diskmonitor[17328]: leaving test state: 40 next state: 80 Nov 4 10:06:49 kjcf05n00 mcfcli[3673891]: %3|1730736409.141|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:06:50 kjcf05n00 mcfcli[3673891]: %3|1730736410.061|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:07:12 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 10:07:19 kjcf05n00 mcfcli[3673891]: %3|1730736439.142|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:07:27 kjcf05n00 mcfcli[3673891]: %3|1730736447.190|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:07:32 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 10:07:40 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 10:07:40 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 10:07:43 kjcf05n02 diskmonitor[17328]: leaving test state: 80 next state: 100 Nov 4 10:07:43 kjcf05n02 diskmonitor[17328]: lock release: time: Mon Nov 4 10:07:39 2024 Nov 4 10:07:43 kjcf05n02 diskmonitor[17328]: leaving test state: 100 next state: 1 Nov 4 10:07:49 kjcf05n00 mcfcli[3673891]: %3|1730736469.142|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 10:08:02 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 10:08:02 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 10:08:06 kjcf05n00 mcfcli[3673891]: %3|1730736486.879|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:08:11 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 10:08:11 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 10:08:11 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 10:08:19 kjcf05n00 mcfcli[3673891]: %3|1730736499.142|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 10:08:45 kjcf05n00 mcfcli[3673891]: %3|1730736525.311|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:08:46 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 10:08:46 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 10:08:46 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 10:08:49 kjcf05n00 mcfcli[3673891]: %3|1730736529.142|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:09:19 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 10:09:19 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 10:09:19 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 10:09:19 kjcf05n00 mcfcli[3673891]: %3|1730736559.143|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:09:25 kjcf05n00 mcfcli[3673891]: %3|1730736565.308|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:09:49 kjcf05n00 mcfcli[3673891]: %3|1730736589.143|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 10:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 10:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 10:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 10:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 10:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 10:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 10:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 10:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 10:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 10:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 10:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 10:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 10:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 10:10:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 10:10:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:10:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 10:10:04 kjcf05n00 mcfcli[3673891]: %3|1730736604.949|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:10:19 kjcf05n00 mcfcli[3673891]: %3|1730736619.144|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:10:28 kjcf05n00 python3.9[2045038]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 10:10:43 kjcf05n00 mcfcli[3673891]: %3|1730736643.057|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:10:49 kjcf05n00 mcfcli[3673891]: %3|1730736649.144|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:11:19 kjcf05n00 mcfcli[3673891]: %3|1730736679.144|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:11:22 kjcf05n00 mcfcli[3673891]: %3|1730736682.085|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:11:36 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 10:11:36 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 10:11:36 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 10:11:49 kjcf05n00 mcfcli[3673891]: %3|1730736709.144|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 10:11:59 kjcf05n00 mcfcli[3673891]: %3|1730736719.689|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:12:19 kjcf05n00 mcfcli[3673891]: %3|1730736739.144|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 10:12:38 kjcf05n00 mcfcli[3673891]: %3|1730736758.264|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:12:49 kjcf05n00 mcfcli[3673891]: %3|1730736769.146|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:13:15 kjcf05n00 mcfcli[3673891]: %3|1730736795.032|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:13:19 kjcf05n00 mcfcli[3673891]: %3|1730736799.146|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T10:13:27.262052389-06:00 level=info msg="Completed cleanup jobs" duration=35.614285ms Nov 4 10:13:49 kjcf05n00 mcfcli[3673891]: %3|1730736829.146|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:13:52 kjcf05n00 mcfcli[3673891]: %3|1730736832.824|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:14:19 kjcf05n00 mcfcli[3673891]: %3|1730736859.146|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 10:14:32 kjcf05n00 mcfcli[3673891]: %3|1730736872.255|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:14:49 kjcf05n00 mcfcli[3673891]: %3|1730736889.146|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:15:10 kjcf05n00 mcfcli[3673891]: %3|1730736910.742|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:15:19 kjcf05n00 mcfcli[3673891]: %3|1730736919.146|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:15:32 kjcf05n00 python3.9[2047841]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 10:15:49 kjcf05n00 mcfcli[3673891]: %3|1730736949.147|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:15:50 kjcf05n00 mcfcli[3673891]: %3|1730736950.220|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:16:19 kjcf05n00 mcfcli[3673891]: %3|1730736979.147|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:16:27 kjcf05n00 mcfcli[3673891]: %3|1730736987.968|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:16:49 kjcf05n00 mcfcli[3673891]: %3|1730737009.147|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:17:05 kjcf05n00 mcfcli[3673891]: %3|1730737025.700|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:17:19 kjcf05n00 mcfcli[3673891]: %3|1730737039.147|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 10:17:45 kjcf05n00 mcfcli[3673891]: %3|1730737065.698|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:17:49 kjcf05n00 mcfcli[3673891]: %3|1730737069.148|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:18:19 kjcf05n00 mcfcli[3673891]: %3|1730737099.148|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 10:18:22 kjcf05n00 mcfcli[3673891]: %3|1730737102.942|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:18:49 kjcf05n00 mcfcli[3673891]: %3|1730737129.149|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 10:19:01 kjcf05n00 mcfcli[3673891]: %3|1730737141.813|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:19:19 kjcf05n00 mcfcli[3673891]: %3|1730737159.149|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 10:19:38 kjcf05n00 mcfcli[3673891]: %3|1730737178.354|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:19:49 kjcf05n00 mcfcli[3673891]: %3|1730737189.149|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 10:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 10:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 10:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 10:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 10:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 10:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 10:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 10:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 10:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 10:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 10:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 10:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 10:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 10:20:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 10:20:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:20:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 10:20:16 kjcf05n00 mcfcli[3673891]: %3|1730737216.989|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:20:19 kjcf05n00 mcfcli[3673891]: %3|1730737219.150|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:20:28 kjcf05n00 python3.9[2050825]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 10:20:49 kjcf05n00 mcfcli[3673891]: %3|1730737249.151|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 10:20:53 kjcf05n00 mcfcli[3673891]: %3|1730737253.997|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:21:19 kjcf05n00 mcfcli[3673891]: %3|1730737279.151|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:21:31 kjcf05n00 mcfcli[3673891]: %3|1730737291.249|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:21:49 kjcf05n00 mcfcli[3673891]: %3|1730737309.151|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:22:06 kjcf05n00 mcfcli[3673891]: %3|1730737326.703|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:22:19 kjcf05n00 mcfcli[3673891]: %3|1730737339.151|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 10:22:43 kjcf05n00 mcfcli[3673891]: %3|1730737363.592|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:22:49 kjcf05n00 mcfcli[3673891]: %3|1730737369.151|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T16:23:15.867516Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 10:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T16:23:15.867579Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.083ms Nov 4 10:23:19 kjcf05n00 mcfcli[3673891]: %3|1730737399.152|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:23:23 kjcf05n00 mcfcli[3673891]: %3|1730737403.589|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T10:23:27.252628719-06:00 level=info msg="Completed cleanup jobs" duration=26.102986ms Nov 4 10:23:49 kjcf05n00 mcfcli[3673891]: %3|1730737429.153|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:24:03 kjcf05n00 mcfcli[3673891]: %3|1730737443.586|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:24:11 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 10:24:11 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 10 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007111 sec, idle for 1 hour(s)] Nov 4 10:24:19 kjcf05n00 mcfcli[3673891]: %3|1730737459.153|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:24:41 kjcf05n00 mcfcli[3673891]: %3|1730737481.184|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:24:49 kjcf05n00 mcfcli[3673891]: %3|1730737489.153|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 10:25:19 kjcf05n00 mcfcli[3673891]: %3|1730737519.153|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 10:25:19 kjcf05n00 mcfcli[3673891]: %3|1730737519.203|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:25:28 kjcf05n00 python3.9[2053624]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 10:25:49 kjcf05n00 mcfcli[3673891]: %3|1730737549.153|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 10:25:55 kjcf05n00 mcfcli[3673891]: %3|1730737555.412|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:26:19 kjcf05n00 mcfcli[3673891]: %3|1730737579.153|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:26:34 kjcf05n00 mcfcli[3673891]: %3|1730737594.993|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:26:49 kjcf05n00 mcfcli[3673891]: %3|1730737609.154|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:27:13 kjcf05n00 mcfcli[3673891]: %3|1730737633.432|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:27:19 kjcf05n00 mcfcli[3673891]: %3|1730737639.155|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:27:46 kjcf05n00 mcfcli[3673891]: %3|1730737666.224|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:27:49 kjcf05n00 mcfcli[3673891]: %3|1730737669.155|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 10:28:19 kjcf05n00 mcfcli[3673891]: %3|1730737699.155|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:28:25 kjcf05n00 mcfcli[3673891]: %3|1730737705.676|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:28:49 kjcf05n00 mcfcli[3673891]: %3|1730737729.155|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 10:29:04 kjcf05n00 mcfcli[3673891]: %3|1730737744.538|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:29:19 kjcf05n00 mcfcli[3673891]: %3|1730737759.157|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:29:41 kjcf05n00 mcfcli[3673891]: %3|1730737781.791|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:29:49 kjcf05n00 mcfcli[3673891]: %3|1730737789.157|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 10:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 10:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 10:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 10:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 10:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 10:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 10:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 10:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 10:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 10:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 10:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 10:30:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 10:30:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:30:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 10:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 10:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 10:30:19 kjcf05n00 mcfcli[3673891]: %3|1730737819.157|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:30:21 kjcf05n00 mcfcli[3673891]: %3|1730737821.788|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:30:29 kjcf05n00 python3.9[2056498]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 10:30:49 kjcf05n00 mcfcli[3673891]: %3|1730737849.157|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:31:01 kjcf05n00 mcfcli[3673891]: %3|1730737861.785|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:31:19 kjcf05n00 mcfcli[3673891]: %3|1730737879.157|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:31:41 kjcf05n00 mcfcli[3673891]: %3|1730737901.782|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:31:49 kjcf05n00 mcfcli[3673891]: %3|1730737909.158|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:32:17 kjcf05n00 mcfcli[3673891]: %3|1730737937.481|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:32:19 kjcf05n00 mcfcli[3673891]: %3|1730737939.158|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 10:32:49 kjcf05n00 mcfcli[3673891]: %3|1730737969.158|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:32:57 kjcf05n00 mcfcli[3673891]: %3|1730737977.478|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:33:19 kjcf05n00 mcfcli[3673891]: %3|1730737999.158|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T10:33:27.253337271-06:00 level=info msg="Completed cleanup jobs" duration=26.208423ms Nov 4 10:33:36 kjcf05n00 mcfcli[3673891]: %3|1730738016.741|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:33:49 kjcf05n00 mcfcli[3673891]: %3|1730738029.158|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:34:13 kjcf05n00 mcfcli[3673891]: %3|1730738053.184|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:34:19 kjcf05n00 mcfcli[3673891]: %3|1730738059.159|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 10:34:47 kjcf05n00 mcfcli[3673891]: %3|1730738087.398|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:34:49 kjcf05n00 mcfcli[3673891]: %3|1730738089.160|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 10:35:19 kjcf05n00 mcfcli[3673891]: %3|1730738119.160|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:35:27 kjcf05n00 mcfcli[3673891]: %3|1730738127.396|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:35:29 kjcf05n00 python3.9[2059279]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 10:35:49 kjcf05n00 mcfcli[3673891]: %3|1730738149.160|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:36:07 kjcf05n00 mcfcli[3673891]: %3|1730738167.393|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:36:19 kjcf05n00 mcfcli[3673891]: %3|1730738179.160|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:36:46 kjcf05n00 mcfcli[3673891]: %3|1730738206.742|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:36:49 kjcf05n00 mcfcli[3673891]: %3|1730738209.160|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:37:19 kjcf05n00 mcfcli[3673891]: %3|1730738239.161|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 10:37:25 kjcf05n00 mcfcli[3673891]: %3|1730738245.782|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:37:49 kjcf05n00 mcfcli[3673891]: %3|1730738269.161|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:38:04 kjcf05n00 mcfcli[3673891]: %3|1730738284.812|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:38:19 kjcf05n00 mcfcli[3673891]: %3|1730738299.161|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 10:38:44 kjcf05n00 mcfcli[3673891]: %3|1730738324.647|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:38:49 kjcf05n00 mcfcli[3673891]: %3|1730738329.162|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 10:39:19 kjcf05n00 mcfcli[3673891]: %3|1730738359.162|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 10:39:23 kjcf05n00 mcfcli[3673891]: %3|1730738363.698|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:39:49 kjcf05n00 mcfcli[3673891]: %3|1730738389.162|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 10:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 10:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 10:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 10:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 10:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 10:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 10:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 10:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 10:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 10:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 10:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 10:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 10:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 10:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 10:40:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 10:40:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:40:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 10:40:01 kjcf05n00 mcfcli[3673891]: %3|1730738401.653|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:40:19 kjcf05n00 mcfcli[3673891]: %3|1730738419.162|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 10:40:28 kjcf05n00 python3.9[2062186]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 10:40:41 kjcf05n00 mcfcli[3673891]: %3|1730738441.650|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:40:49 kjcf05n00 mcfcli[3673891]: %3|1730738449.163|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 10:41:19 kjcf05n00 mcfcli[3673891]: %3|1730738479.164|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 10:41:21 kjcf05n00 mcfcli[3673891]: %3|1730738481.647|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:41:49 kjcf05n00 mcfcli[3673891]: %3|1730738509.164|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 10:41:58 kjcf05n00 mcfcli[3673891]: %3|1730738518.389|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:42:19 kjcf05n00 mcfcli[3673891]: %3|1730738539.164|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:42:37 kjcf05n00 mcfcli[3673891]: %3|1730738557.673|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:42:49 kjcf05n00 mcfcli[3673891]: %3|1730738569.165|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 10:43:13 kjcf05n00 mcfcli[3673891]: %3|1730738593.627|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:43:19 kjcf05n00 mcfcli[3673891]: %3|1730738599.165|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 10:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T10:43:27.267977551-06:00 level=info msg="Completed cleanup jobs" duration=41.351762ms Nov 4 10:43:49 kjcf05n00 mcfcli[3673891]: %3|1730738629.165|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:43:51 kjcf05n00 mcfcli[3673891]: %3|1730738631.606|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:44:19 kjcf05n00 mcfcli[3673891]: %3|1730738659.165|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 10:44:31 kjcf05n00 mcfcli[3673891]: %3|1730738671.143|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:44:49 kjcf05n00 mcfcli[3673891]: %3|1730738689.165|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 10:45:11 kjcf05n00 mcfcli[3673891]: %3|1730738711.140|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:45:19 kjcf05n00 mcfcli[3673891]: %3|1730738719.165|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 10:45:29 kjcf05n00 python3.9[2065072]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 10:45:48 kjcf05n00 mcfcli[3673891]: %3|1730738748.111|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:45:49 kjcf05n00 mcfcli[3673891]: %3|1730738749.165|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:46:19 kjcf05n00 mcfcli[3673891]: %3|1730738779.165|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:46:28 kjcf05n00 mcfcli[3673891]: %3|1730738788.108|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:46:49 kjcf05n00 mcfcli[3673891]: %3|1730738809.166|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:47:08 kjcf05n00 mcfcli[3673891]: %3|1730738828.106|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:47:19 kjcf05n00 mcfcli[3673891]: %3|1730738839.166|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:47:46 kjcf05n00 mcfcli[3673891]: %3|1730738866.417|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:47:49 kjcf05n00 mcfcli[3673891]: %3|1730738869.167|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:48:19 kjcf05n00 mcfcli[3673891]: %3|1730738899.167|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:48:25 kjcf05n00 mcfcli[3673891]: %3|1730738905.976|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:48:49 kjcf05n00 mcfcli[3673891]: %3|1730738929.168|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:49:03 kjcf05n00 mcfcli[3673891]: %3|1730738943.200|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:49:19 kjcf05n00 mcfcli[3673891]: %3|1730738959.168|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 10:49:41 kjcf05n00 mcfcli[3673891]: %3|1730738981.155|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:49:49 kjcf05n00 mcfcli[3673891]: %3|1730738989.168|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 10:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 10:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 10:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 10:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 10:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 10:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 10:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 10:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 10:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 10:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 10:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 10:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 10:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 10:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 10:50:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 10:50:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 10:50:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 10:50:17 kjcf05n00 mcfcli[3673891]: %3|1730739017.206|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:50:19 kjcf05n00 mcfcli[3673891]: %3|1730739019.168|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 10:50:31 kjcf05n00 python3.9[2067860]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 10:50:49 kjcf05n00 mcfcli[3673891]: %3|1730739049.168|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 10:50:56 kjcf05n00 mcfcli[3673891]: %3|1730739056.389|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:51:19 kjcf05n00 mcfcli[3673891]: %3|1730739079.169|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:51:33 kjcf05n00 mcfcli[3673891]: %3|1730739093.601|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:51:49 kjcf05n00 mcfcli[3673891]: %3|1730739109.169|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:52:13 kjcf05n00 mcfcli[3673891]: %3|1730739133.331|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:52:19 kjcf05n00 mcfcli[3673891]: %3|1730739139.170|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:52:49 kjcf05n00 mcfcli[3673891]: %3|1730739169.170|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:52:50 kjcf05n00 mcfcli[3673891]: %3|1730739170.043|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T16:53:15.868186Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 10:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T16:53:15.868251Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.084ms Nov 4 10:53:19 kjcf05n00 mcfcli[3673891]: %3|1730739199.171|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T10:53:27.254038444-06:00 level=info msg="Completed cleanup jobs" duration=27.24869ms Nov 4 10:53:30 kjcf05n00 mcfcli[3673891]: %3|1730739210.040|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:53:49 kjcf05n00 mcfcli[3673891]: %3|1730739229.171|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 10:54:07 kjcf05n00 mcfcli[3673891]: %3|1730739247.776|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:54:19 kjcf05n00 mcfcli[3673891]: %3|1730739259.171|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:54:46 kjcf05n00 mcfcli[3673891]: %3|1730739286.168|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:54:49 kjcf05n00 mcfcli[3673891]: %3|1730739289.171|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 10:55:19 kjcf05n00 mcfcli[3673891]: %3|1730739319.171|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 10:55:26 kjcf05n00 mcfcli[3673891]: %3|1730739326.165|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:55:29 kjcf05n00 python3.9[2070809]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 10:55:41 kjcf05n03 diskmonitor[17871]: leaving test state: 1 next state: 2 Nov 4 10:55:41 kjcf05n03 diskmonitor[17871]: lock req: no timeout Nov 4 10:55:41 kjcf05n03 diskmonitor[17871]: leaving test state: 2 next state: 4 Nov 4 10:55:49 kjcf05n00 mcfcli[3673891]: %3|1730739349.671|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 10:56:00 kjcf05n03 diskmonitor[17871]: lock acquired Nov 4 10:56:00 kjcf05n03 diskmonitor[17871]: leaving test state: 4 next state: 8 Nov 4 10:56:04 kjcf05n00 mcfcli[3673891]: %3|1730739364.202|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:56:16 kjcf05n03 diskmonitor[17871]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 4 10:56:16 kjcf05n03 diskmonitor[17871]: leaving test state: 8 next state: 20 Nov 4 10:56:16 kjcf05n03 diskmonitor[17871]: leaving test state: 20 next state: 40 Nov 4 10:56:16 kjcf05n03 diskmonitor[17871]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 2a771d8000 Nov 4 10:56:16 kjcf05n03 diskmonitor[17871]: leaving test state: 40 next state: 80 Nov 4 10:56:19 kjcf05n00 mcfcli[3673891]: %3|1730739379.672|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 10:56:44 kjcf05n00 mcfcli[3673891]: %3|1730739404.199|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:56:49 kjcf05n00 mcfcli[3673891]: %3|1730739409.861|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 10:57:15 kjcf05n03 diskmonitor[17871]: leaving test state: 80 next state: 100 Nov 4 10:57:15 kjcf05n03 diskmonitor[17871]: lock release: time: Mon Nov 4 10:57:06 2024 Nov 4 10:57:15 kjcf05n03 diskmonitor[17871]: leaving test state: 100 next state: 1 Nov 4 10:57:19 kjcf05n00 mcfcli[3673891]: %3|1730739439.862|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 10:57:22 kjcf05n00 mcfcli[3673891]: %3|1730739442.509|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:57:49 kjcf05n00 mcfcli[3673891]: %3|1730739469.862|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:58:01 kjcf05n00 mcfcli[3673891]: %3|1730739481.515|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:58:19 kjcf05n00 mcfcli[3673891]: %3|1730739499.862|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 10:58:37 kjcf05n00 mcfcli[3673891]: %3|1730739517.962|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:58:49 kjcf05n00 mcfcli[3673891]: %3|1730739529.863|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 10:59:17 kjcf05n00 mcfcli[3673891]: %3|1730739557.028|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 10:59:19 kjcf05n00 mcfcli[3673891]: %3|1730739559.863|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 10:59:50 kjcf05n00 mcfcli[3673891]: %3|1730739590.174|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 10:59:56 kjcf05n00 mcfcli[3673891]: %3|1730739596.730|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:00:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 11:00:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:00:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 11:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 11:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 11:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 11:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 11:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 11:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 11:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 11:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 11:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 11:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 11:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 11:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 11:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 11:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 11:00:20 kjcf05n00 mcfcli[3673891]: %3|1730739620.174|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:00:29 kjcf05n00 python3.9[2073606]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 11:00:36 kjcf05n00 mcfcli[3673891]: %3|1730739636.727|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:00:50 kjcf05n00 mcfcli[3673891]: %3|1730739650.174|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:01:14 kjcf05n00 mcfcli[3673891]: %3|1730739674.843|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:01:20 kjcf05n00 mcfcli[3673891]: %3|1730739680.175|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:01:50 kjcf05n00 mcfcli[3673891]: %3|1730739710.175|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:01:54 kjcf05n00 mcfcli[3673891]: %3|1730739714.840|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:02:20 kjcf05n00 mcfcli[3673891]: %3|1730739740.175|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:02:31 kjcf05n00 mcfcli[3673891]: %3|1730739751.069|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:02:50 kjcf05n00 mcfcli[3673891]: %3|1730739770.175|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:03:09 kjcf05n00 mcfcli[3673891]: %3|1730739789.629|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:03:20 kjcf05n00 mcfcli[3673891]: %3|1730739800.175|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 11:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T11:03:27.268253441-06:00 level=info msg="Completed cleanup jobs" duration=41.391626ms Nov 4 11:03:49 kjcf05n00 mcfcli[3673891]: %3|1730739829.291|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:03:50 kjcf05n00 mcfcli[3673891]: %3|1730739830.175|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:04:20 kjcf05n00 mcfcli[3673891]: %3|1730739860.176|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 11:04:26 kjcf05n00 mcfcli[3673891]: %3|1730739866.458|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:04:50 kjcf05n00 mcfcli[3673891]: %3|1730739890.177|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:05:04 kjcf05n00 mcfcli[3673891]: %3|1730739904.048|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:05:20 kjcf05n00 mcfcli[3673891]: %3|1730739920.177|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:05:28 kjcf05n00 python3.9[2076414]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 11:05:41 kjcf05n00 mcfcli[3673891]: %3|1730739941.656|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:05:50 kjcf05n00 mcfcli[3673891]: %3|1730739950.177|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 11:06:19 kjcf05n00 mcfcli[3673891]: %3|1730739979.327|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:06:20 kjcf05n00 mcfcli[3673891]: %3|1730739980.177|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:06:50 kjcf05n00 mcfcli[3673891]: %3|1730740010.178|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:06:57 kjcf05n00 mcfcli[3673891]: %3|1730740017.734|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:07:20 kjcf05n00 mcfcli[3673891]: %3|1730740040.179|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:07:36 kjcf05n00 mcfcli[3673891]: %3|1730740056.692|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:07:50 kjcf05n00 mcfcli[3673891]: %3|1730740070.179|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:08:02 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 11:08:02 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 11:08:02 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 11:08:15 kjcf05n00 mcfcli[3673891]: %3|1730740095.600|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:08:20 kjcf05n00 mcfcli[3673891]: %3|1730740100.179|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 11:08:50 kjcf05n00 mcfcli[3673891]: %3|1730740130.180|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:08:54 kjcf05n00 mcfcli[3673891]: %3|1730740134.336|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:09:20 kjcf05n00 mcfcli[3673891]: %3|1730740160.180|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:09:31 kjcf05n00 mcfcli[3673891]: %3|1730740171.106|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:09:33 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 11:09:33 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 11:09:33 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 11:09:46 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 11:09:46 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 11:09:46 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 11:09:50 kjcf05n00 mcfcli[3673891]: %3|1730740190.181|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 11:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 11:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 11:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 11:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 11:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 11:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 11:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 11:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 11:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 11:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 11:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 11:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 11:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 11:10:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 11:10:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:10:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 11:10:07 kjcf05n00 mcfcli[3673891]: %3|1730740207.946|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:10:20 kjcf05n00 mcfcli[3673891]: %3|1730740220.181|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 11:10:23 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 11:10:23 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 11:10:23 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 11:10:28 kjcf05n00 python3.9[2079221]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 11:10:34 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 11:10:47 kjcf05n00 mcfcli[3673891]: %3|1730740247.499|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:10:50 kjcf05n00 mcfcli[3673891]: %3|1730740250.182|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 11:11:02 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 11:11:02 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 11:11:20 kjcf05n00 mcfcli[3673891]: %3|1730740280.182|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 11:11:25 kjcf05n00 mcfcli[3673891]: %3|1730740285.183|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:11:50 kjcf05n00 mcfcli[3673891]: %3|1730740310.182|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 11:11:52 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 11:12:03 kjcf05n00 mcfcli[3673891]: %3|1730740323.287|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:12:20 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 11:12:20 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 11:12:20 kjcf05n00 mcfcli[3673891]: %3|1730740340.182|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:12:38 kjcf05n00 mcfcli[3673891]: %3|1730740358.975|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:12:50 kjcf05n00 mcfcli[3673891]: %3|1730740370.182|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:13:11 kjcf05n00 mcfcli[3673891]: %3|1730740391.906|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:13:20 kjcf05n00 mcfcli[3673891]: %3|1730740400.182|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 11:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T11:13:27.269457584-06:00 level=info msg="Completed cleanup jobs" duration=42.536978ms Nov 4 11:13:50 kjcf05n00 mcfcli[3673891]: %3|1730740430.183|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:13:51 kjcf05n00 mcfcli[3673891]: %3|1730740431.069|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:14:20 kjcf05n00 mcfcli[3673891]: %3|1730740460.183|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:14:31 kjcf05n00 mcfcli[3673891]: %3|1730740471.066|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:14:50 kjcf05n00 mcfcli[3673891]: %3|1730740490.183|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 11:15:09 kjcf05n00 mcfcli[3673891]: %3|1730740509.274|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:15:20 kjcf05n00 mcfcli[3673891]: %3|1730740520.183|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:15:28 kjcf05n00 python3.9[2082223]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 11:15:49 kjcf05n00 mcfcli[3673891]: %3|1730740549.196|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:15:50 kjcf05n00 mcfcli[3673891]: %3|1730740550.184|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 11:16:20 kjcf05n00 mcfcli[3673891]: %3|1730740580.184|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 11:16:24 kjcf05n00 mcfcli[3673891]: %3|1730740584.601|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:16:50 kjcf05n00 mcfcli[3673891]: %3|1730740610.185|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:17:00 kjcf05n00 mcfcli[3673891]: %3|1730740620.152|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:17:20 kjcf05n00 mcfcli[3673891]: %3|1730740640.685|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 11:17:40 kjcf05n00 mcfcli[3673891]: %3|1730740660.002|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:17:50 kjcf05n00 mcfcli[3673891]: %3|1730740670.686|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:18:19 kjcf05n00 mcfcli[3673891]: %3|1730740699.999|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:18:20 kjcf05n00 mcfcli[3673891]: %3|1730740700.870|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 11:18:51 kjcf05n00 mcfcli[3673891]: %3|1730740731.186|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 11:18:59 kjcf05n00 mcfcli[3673891]: %3|1730740739.996|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:19:21 kjcf05n00 mcfcli[3673891]: %3|1730740761.187|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:19:37 kjcf05n00 mcfcli[3673891]: %3|1730740777.571|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:19:51 kjcf05n00 mcfcli[3673891]: %3|1730740791.187|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 11:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 11:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 11:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 11:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 11:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 11:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 11:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 11:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 11:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 11:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 11:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 11:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 11:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 11:20:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 11:20:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:20:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 11:20:17 kjcf05n00 mcfcli[3673891]: %3|1730740817.568|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:20:21 kjcf05n00 mcfcli[3673891]: %3|1730740821.187|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:20:29 kjcf05n00 python3.9[2085028]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 11:20:51 kjcf05n00 mcfcli[3673891]: %3|1730740851.188|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 11:20:55 kjcf05n00 mcfcli[3673891]: %3|1730740855.842|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:21:21 kjcf05n00 mcfcli[3673891]: %3|1730740881.189|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:21:34 kjcf05n00 mcfcli[3673891]: %3|1730740894.748|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:21:51 kjcf05n00 mcfcli[3673891]: %3|1730740911.189|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:22:11 kjcf05n00 mcfcli[3673891]: %3|1730740931.710|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:22:21 kjcf05n00 mcfcli[3673891]: %3|1730740941.189|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 11:22:50 kjcf05n00 mcfcli[3673891]: %3|1730740970.695|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:22:51 kjcf05n00 mcfcli[3673891]: %3|1730740971.189|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T17:23:15.867805Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 11:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T17:23:15.867865Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.081ms Nov 4 11:23:21 kjcf05n00 mcfcli[3673891]: %3|1730741001.189|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T11:23:27.253092749-06:00 level=info msg="Completed cleanup jobs" duration=26.664785ms Nov 4 11:23:30 kjcf05n00 mcfcli[3673891]: %3|1730741010.692|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:23:51 kjcf05n00 mcfcli[3673891]: %3|1730741031.191|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:24:08 kjcf05n00 mcfcli[3673891]: %3|1730741048.409|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:24:11 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 11:24:11 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 9 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007807 sec, idle for 1 hour(s)] Nov 4 11:24:21 kjcf05n00 mcfcli[3673891]: %3|1730741061.191|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:24:45 kjcf05n00 mcfcli[3673891]: %3|1730741085.168|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:24:51 kjcf05n00 mcfcli[3673891]: %3|1730741091.191|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 11:25:21 kjcf05n00 mcfcli[3673891]: %3|1730741121.191|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 11:25:21 kjcf05n00 mcfcli[3673891]: %3|1730741121.343|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:25:32 kjcf05n00 python3.9[2087824]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 11:25:51 kjcf05n00 mcfcli[3673891]: %3|1730741151.191|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 11:25:55 kjcf05n00 mcfcli[3673891]: %3|1730741155.504|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:26:21 kjcf05n00 mcfcli[3673891]: %3|1730741181.191|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:26:32 kjcf05n00 mcfcli[3673891]: %3|1730741192.231|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:26:51 kjcf05n00 mcfcli[3673891]: %3|1730741211.192|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:27:09 kjcf05n00 mcfcli[3673891]: %3|1730741229.450|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:27:21 kjcf05n00 mcfcli[3673891]: %3|1730741241.192|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:27:46 kjcf05n00 mcfcli[3673891]: %3|1730741266.355|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:27:51 kjcf05n00 mcfcli[3673891]: %3|1730741271.192|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:28:21 kjcf05n00 mcfcli[3673891]: %3|1730741301.192|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:28:24 kjcf05n00 mcfcli[3673891]: %3|1730741304.933|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:28:51 kjcf05n00 mcfcli[3673891]: %3|1730741331.192|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 11:29:03 kjcf05n00 mcfcli[3673891]: %3|1730741343.771|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:29:21 kjcf05n00 mcfcli[3673891]: %3|1730741361.192|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 11:29:42 kjcf05n00 mcfcli[3673891]: %3|1730741382.232|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:29:51 kjcf05n00 mcfcli[3673891]: %3|1730741391.194|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 11:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 11:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 11:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 11:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 11:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 11:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 11:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 11:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 11:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 11:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 11:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 11:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 11:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 11:30:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 11:30:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:30:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 11:30:21 kjcf05n00 mcfcli[3673891]: %3|1730741421.194|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:30:22 kjcf05n00 mcfcli[3673891]: %3|1730741422.229|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:30:34 kjcf05n00 python3.9[2090820]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 11:30:51 kjcf05n00 mcfcli[3673891]: %3|1730741451.194|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 11:31:01 kjcf05n00 mcfcli[3673891]: %3|1730741461.818|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:31:21 kjcf05n00 mcfcli[3673891]: %3|1730741481.194|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 11:31:38 kjcf05n00 mcfcli[3673891]: %3|1730741498.868|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:31:51 kjcf05n00 mcfcli[3673891]: %3|1730741511.195|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:32:18 kjcf05n00 mcfcli[3673891]: %3|1730741538.865|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:32:21 kjcf05n00 mcfcli[3673891]: %3|1730741541.196|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:32:51 kjcf05n00 mcfcli[3673891]: %3|1730741571.196|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:32:58 kjcf05n00 mcfcli[3673891]: %3|1730741578.067|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:33:21 kjcf05n00 mcfcli[3673891]: %3|1730741601.196|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 11:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T11:33:27.253181462-06:00 level=info msg="Completed cleanup jobs" duration=26.617826ms Nov 4 11:33:35 kjcf05n00 mcfcli[3673891]: %3|1730741615.901|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:33:51 kjcf05n00 mcfcli[3673891]: %3|1730741631.196|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:34:15 kjcf05n00 mcfcli[3673891]: %3|1730741655.898|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:34:21 kjcf05n00 mcfcli[3673891]: %3|1730741661.196|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:34:51 kjcf05n00 mcfcli[3673891]: %3|1730741691.196|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:34:55 kjcf05n00 mcfcli[3673891]: %3|1730741695.895|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:35:21 kjcf05n00 mcfcli[3673891]: %3|1730741721.196|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 11:35:29 kjcf05n00 python3.9[2093614]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 11:35:32 kjcf05n00 mcfcli[3673891]: %3|1730741732.815|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:35:51 kjcf05n00 mcfcli[3673891]: %3|1730741751.197|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 11:36:07 kjcf05n00 mcfcli[3673891]: %3|1730741767.474|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:36:21 kjcf05n00 mcfcli[3673891]: %3|1730741781.197|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 11:36:44 kjcf05n00 mcfcli[3673891]: %3|1730741804.663|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:36:51 kjcf05n00 mcfcli[3673891]: %3|1730741811.198|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:37:14 kjcf05n02 diskmonitor[17328]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 11:37:21 kjcf05n00 mcfcli[3673891]: %3|1730741841.198|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:37:23 kjcf05n00 mcfcli[3673891]: %3|1730741843.846|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:37:51 kjcf05n00 mcfcli[3673891]: %3|1730741871.198|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:38:02 kjcf05n00 mcfcli[3673891]: %3|1730741882.072|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:38:21 kjcf05n00 mcfcli[3673891]: %3|1730741901.199|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:38:42 kjcf05n00 mcfcli[3673891]: %3|1730741922.069|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:38:51 kjcf05n00 mcfcli[3673891]: %3|1730741931.199|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:39:20 kjcf05n00 mcfcli[3673891]: %3|1730741960.728|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:39:21 kjcf05n00 mcfcli[3673891]: %3|1730741961.199|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:39:51 kjcf05n00 mcfcli[3673891]: %3|1730741991.200|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 11:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 11:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 11:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 11:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 11:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 11:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 11:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 11:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 11:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 11:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 11:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 11:40:00 kjcf05n00 mcfcli[3673891]: %3|1730742000.211|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 11:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 11:40:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 11:40:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:40:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 11:40:20 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T17:40:20.867345Z lvl=info msg="TSI log compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=3 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=start Nov 4 11:40:20 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T17:40:20.868789Z lvl=info msg="Log file compacted" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=3 op_name=tsi1_compact_log_file tsi1_log_file_id=1 elapsed=1ms bytes=12902 kb_per_sec=8561 Nov 4 11:40:20 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T17:40:20.868831Z lvl=info msg="TSI log compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=3 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=end op_elapsed=1.514ms Nov 4 11:40:21 kjcf05n00 mcfcli[3673891]: %3|1730742021.200|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:40:29 kjcf05n00 python3.9[2096406]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 11:40:38 kjcf05n00 mcfcli[3673891]: %3|1730742038.754|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:40:51 kjcf05n00 mcfcli[3673891]: %3|1730742051.201|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 11:41:16 kjcf05n00 mcfcli[3673891]: %3|1730742076.904|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:41:21 kjcf05n00 mcfcli[3673891]: %3|1730742081.201|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:41:51 kjcf05n00 mcfcli[3673891]: %3|1730742111.201|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:41:53 kjcf05n00 mcfcli[3673891]: %3|1730742113.780|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:42:21 kjcf05n00 mcfcli[3673891]: %3|1730742141.201|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:42:32 kjcf05n00 mcfcli[3673891]: %3|1730742152.272|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:42:51 kjcf05n00 mcfcli[3673891]: %3|1730742171.201|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:43:12 kjcf05n00 mcfcli[3673891]: %3|1730742192.269|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:43:21 kjcf05n00 mcfcli[3673891]: %3|1730742201.202|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T11:43:27.267901266-06:00 level=info msg="Completed cleanup jobs" duration=41.305324ms Nov 4 11:43:51 kjcf05n00 mcfcli[3673891]: %3|1730742231.202|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:43:52 kjcf05n00 mcfcli[3673891]: %3|1730742232.092|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:44:21 kjcf05n00 mcfcli[3673891]: %3|1730742261.202|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 11:44:29 kjcf05n00 mcfcli[3673891]: %3|1730742269.238|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:44:51 kjcf05n00 mcfcli[3673891]: %3|1730742291.203|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:45:09 kjcf05n00 mcfcli[3673891]: %3|1730742309.235|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:45:21 kjcf05n00 mcfcli[3673891]: %3|1730742321.203|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:45:29 kjcf05n00 python3.9[2099211]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 11:45:49 kjcf05n00 mcfcli[3673891]: %3|1730742349.232|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:45:51 kjcf05n00 mcfcli[3673891]: %3|1730742351.203|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 11:46:21 kjcf05n00 mcfcli[3673891]: %3|1730742381.203|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:46:27 kjcf05n00 mcfcli[3673891]: %3|1730742387.417|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:46:51 kjcf05n00 mcfcli[3673891]: %3|1730742411.204|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:47:05 kjcf05n00 mcfcli[3673891]: %3|1730742425.688|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:47:21 kjcf05n00 mcfcli[3673891]: %3|1730742441.205|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:47:45 kjcf05n00 mcfcli[3673891]: %3|1730742465.015|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:47:51 kjcf05n00 mcfcli[3673891]: %3|1730742471.205|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 11:48:21 kjcf05n00 mcfcli[3673891]: %3|1730742501.205|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:48:23 kjcf05n00 mcfcli[3673891]: %3|1730742503.525|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:48:51 kjcf05n00 mcfcli[3673891]: %3|1730742531.205|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:49:02 kjcf05n00 mcfcli[3673891]: %3|1730742542.324|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:49:21 kjcf05n00 mcfcli[3673891]: %3|1730742561.205|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:49:40 kjcf05n00 mcfcli[3673891]: %3|1730742580.846|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:49:51 kjcf05n00 mcfcli[3673891]: %3|1730742591.206|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 11:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 11:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 11:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 11:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 11:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 11:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 11:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 11:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 11:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 11:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 11:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 11:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 11:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 11:50:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 11:50:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 11:50:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 11:50:18 kjcf05n00 mcfcli[3673891]: %3|1730742618.431|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:50:21 kjcf05n00 mcfcli[3673891]: %3|1730742621.207|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 11:50:29 kjcf05n00 python3.9[2102163]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 11:50:30 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T17:50:30.872290Z lvl=info msg="TSI log compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=4 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=start Nov 4 11:50:30 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T17:50:30.873473Z lvl=info msg="Log file compacted" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=4 op_name=tsi1_compact_log_file tsi1_log_file_id=1 elapsed=1ms bytes=12490 kb_per_sec=10116 Nov 4 11:50:30 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T17:50:30.873500Z lvl=info msg="TSI log compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=4 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=end op_elapsed=1.232ms Nov 4 11:50:51 kjcf05n00 mcfcli[3673891]: %3|1730742651.207|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 11:50:54 kjcf05n00 mcfcli[3673891]: %3|1730742654.272|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:51:21 kjcf05n00 mcfcli[3673891]: %3|1730742681.207|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:51:31 kjcf05n00 mcfcli[3673891]: %3|1730742691.821|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:51:51 kjcf05n00 mcfcli[3673891]: %3|1730742711.207|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:52:08 kjcf05n00 mcfcli[3673891]: %3|1730742728.787|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:52:21 kjcf05n00 mcfcli[3673891]: %3|1730742741.207|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:52:45 kjcf05n00 mcfcli[3673891]: %3|1730742765.659|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:52:51 kjcf05n00 mcfcli[3673891]: %3|1730742771.207|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T17:53:15.867474Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 11:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T17:53:15.867530Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.078ms Nov 4 11:53:21 kjcf05n00 mcfcli[3673891]: %3|1730742801.208|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 11:53:22 kjcf05n00 mcfcli[3673891]: %3|1730742802.860|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T11:53:27.270316437-06:00 level=info msg="Completed cleanup jobs" duration=43.769709ms Nov 4 11:53:51 kjcf05n00 mcfcli[3673891]: %3|1730742831.208|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 11:54:02 kjcf05n00 mcfcli[3673891]: %3|1730742842.033|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:54:21 kjcf05n00 mcfcli[3673891]: %3|1730742861.208|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:54:41 kjcf05n00 mcfcli[3673891]: %3|1730742881.547|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:54:51 kjcf05n00 mcfcli[3673891]: %3|1730742891.209|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:55:21 kjcf05n00 mcfcli[3673891]: %3|1730742921.209|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:55:21 kjcf05n00 mcfcli[3673891]: %3|1730742921.544|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:55:29 kjcf05n00 python3.9[2104996]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 11:55:51 kjcf05n00 mcfcli[3673891]: %3|1730742951.209|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 11:55:58 kjcf05n00 mcfcli[3673891]: %3|1730742958.307|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:56:21 kjcf05n00 mcfcli[3673891]: %3|1730742981.210|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:56:38 kjcf05n00 mcfcli[3673891]: %3|1730742998.304|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:56:51 kjcf05n00 mcfcli[3673891]: %3|1730743011.210|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:57:18 kjcf05n00 mcfcli[3673891]: %3|1730743038.301|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:57:21 kjcf05n00 mcfcli[3673891]: %3|1730743041.210|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:57:51 kjcf05n00 mcfcli[3673891]: %3|1730743071.210|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 11:57:54 kjcf05n00 mcfcli[3673891]: %3|1730743074.204|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:58:21 kjcf05n00 mcfcli[3673891]: %3|1730743101.210|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:58:34 kjcf05n00 mcfcli[3673891]: %3|1730743114.201|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:58:51 kjcf05n00 mcfcli[3673891]: %3|1730743131.210|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 11:59:12 kjcf05n00 mcfcli[3673891]: %3|1730743152.262|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:59:21 kjcf05n00 mcfcli[3673891]: %3|1730743161.211|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 11:59:50 kjcf05n00 mcfcli[3673891]: %3|1730743190.421|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 11:59:51 kjcf05n00 mcfcli[3673891]: %3|1730743191.211|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 12:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 12:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 12:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 12:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 12:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 12:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 12:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 12:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 12:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 12:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 12:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 12:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 12:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 12:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 12:00:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 12:00:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:00:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 12:00:21 kjcf05n00 mcfcli[3673891]: %3|1730743221.211|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 12:00:24 kjcf05n00 mcfcli[3673891]: %3|1730743224.393|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:00:34 kjcf05n00 python3.9[2107730]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 12:00:51 kjcf05n00 mcfcli[3673891]: %3|1730743251.211|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 12:01:04 kjcf05n00 mcfcli[3673891]: %3|1730743264.378|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:01:21 kjcf05n00 mcfcli[3673891]: %3|1730743281.213|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:01:44 kjcf05n00 mcfcli[3673891]: %3|1730743304.375|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:01:51 kjcf05n00 mcfcli[3673891]: %3|1730743311.213|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:02:21 kjcf05n00 mcfcli[3673891]: %3|1730743341.213|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:02:22 kjcf05n00 mcfcli[3673891]: %3|1730743342.555|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:02:51 kjcf05n00 mcfcli[3673891]: %3|1730743371.213|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 12:03:01 kjcf05n00 mcfcli[3673891]: %3|1730743381.255|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:03:21 kjcf05n00 mcfcli[3673891]: %3|1730743401.213|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 12:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T12:03:27.267670288-06:00 level=info msg="Completed cleanup jobs" duration=41.21642ms Nov 4 12:03:37 kjcf05n00 mcfcli[3673891]: %3|1730743417.340|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:03:51 kjcf05n00 mcfcli[3673891]: %3|1730743431.214|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 12:04:13 kjcf05n00 mcfcli[3673891]: %3|1730743453.969|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:04:21 kjcf05n00 mcfcli[3673891]: %3|1730743461.215|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 12:04:51 kjcf05n00 mcfcli[3673891]: %3|1730743491.215|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:04:51 kjcf05n00 mcfcli[3673891]: %3|1730743491.820|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:05:21 kjcf05n00 mcfcli[3673891]: %3|1730743521.215|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 12:05:27 kjcf05n00 mcfcli[3673891]: %3|1730743527.576|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:05:30 kjcf05n00 python3.9[2110617]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 12:05:51 kjcf05n00 mcfcli[3673891]: %3|1730743551.215|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 12:06:07 kjcf05n00 mcfcli[3673891]: %3|1730743567.370|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:06:21 kjcf05n00 mcfcli[3673891]: %3|1730743581.216|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:06:45 kjcf05n00 mcfcli[3673891]: %3|1730743605.580|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:06:51 kjcf05n00 mcfcli[3673891]: %3|1730743611.216|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:07:15 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 12:07:15 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 12:07:15 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 12:07:21 kjcf05n00 mcfcli[3673891]: %3|1730743641.216|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:07:23 kjcf05n00 mcfcli[3673891]: %3|1730743643.517|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:07:35 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 12:07:35 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 12:07:35 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 12:07:51 kjcf05n00 mcfcli[3673891]: %3|1730743671.216|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 12:08:01 kjcf05n00 mcfcli[3673891]: %3|1730743681.939|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:08:21 kjcf05n00 mcfcli[3673891]: %3|1730743701.216|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:08:39 kjcf05n00 mcfcli[3673891]: %3|1730743719.863|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:08:51 kjcf05n00 mcfcli[3673891]: %3|1730743731.216|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 12:09:19 kjcf05n00 mcfcli[3673891]: %3|1730743759.043|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:09:21 kjcf05n00 mcfcli[3673891]: %3|1730743761.217|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 12:09:51 kjcf05n00 mcfcli[3673891]: %3|1730743791.217|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:09:55 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 12:09:55 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 12:09:55 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 12:09:57 kjcf05n00 mcfcli[3673891]: %3|1730743797.660|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 12:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 12:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 12:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 12:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 12:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 12:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 12:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 12:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 12:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 12:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 12:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 12:10:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 12:10:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:10:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 12:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 12:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 12:10:21 kjcf05n00 mcfcli[3673891]: %3|1730743821.217|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:10:30 kjcf05n00 python3.9[2113452]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 12:10:37 kjcf05n00 mcfcli[3673891]: %3|1730743837.484|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:10:51 kjcf05n00 mcfcli[3673891]: %3|1730743851.217|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 12:11:05 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 12:11:15 kjcf05n00 mcfcli[3673891]: %3|1730743875.046|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:11:21 kjcf05n00 mcfcli[3673891]: %3|1730743881.219|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:11:32 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 12:11:32 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 12:11:48 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 12:11:48 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 12:11:48 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 12:11:51 kjcf05n00 mcfcli[3673891]: %3|1730743911.219|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:11:53 kjcf05n00 mcfcli[3673891]: %3|1730743913.483|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:11:54 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 12:12:21 kjcf05n00 mcfcli[3673891]: %3|1730743941.219|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:12:22 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 12:12:22 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 12:12:29 kjcf05n00 mcfcli[3673891]: %3|1730743949.841|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:12:51 kjcf05n00 mcfcli[3673891]: %3|1730743971.219|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 12:13:09 kjcf05n00 mcfcli[3673891]: %3|1730743989.838|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:13:21 kjcf05n00 mcfcli[3673891]: %3|1730744001.219|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 12:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T12:13:27.25420222-06:00 level=info msg="Completed cleanup jobs" duration=27.715406ms Nov 4 12:13:45 kjcf05n00 mcfcli[3673891]: %3|1730744025.644|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:13:51 kjcf05n00 mcfcli[3673891]: %3|1730744031.219|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 12:14:21 kjcf05n00 mcfcli[3673891]: %3|1730744061.220|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 12:14:21 kjcf05n00 mcfcli[3673891]: %3|1730744061.790|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:14:51 kjcf05n00 mcfcli[3673891]: %3|1730744091.220|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:15:01 kjcf05n00 mcfcli[3673891]: %3|1730744101.571|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:15:21 kjcf05n00 mcfcli[3673891]: %3|1730744121.220|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:15:30 kjcf05n00 python3.9[2116299]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 12:15:41 kjcf05n00 mcfcli[3673891]: %3|1730744141.568|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:15:51 kjcf05n00 mcfcli[3673891]: %3|1730744151.221|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 12:16:17 kjcf05n00 mcfcli[3673891]: %3|1730744177.645|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:16:21 kjcf05n00 mcfcli[3673891]: %3|1730744181.222|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:16:51 kjcf05n00 mcfcli[3673891]: %3|1730744211.222|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:16:57 kjcf05n00 mcfcli[3673891]: %3|1730744217.642|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:17:21 kjcf05n00 mcfcli[3673891]: %3|1730744241.222|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:17:37 kjcf05n00 mcfcli[3673891]: %3|1730744257.604|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:17:51 kjcf05n00 mcfcli[3673891]: %3|1730744271.222|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:18:15 kjcf05n00 mcfcli[3673891]: %3|1730744295.201|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:18:21 kjcf05n00 mcfcli[3673891]: %3|1730744301.223|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 12:18:51 kjcf05n00 mcfcli[3673891]: %3|1730744331.223|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 12:18:54 kjcf05n00 mcfcli[3673891]: %3|1730744334.196|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:19:21 kjcf05n00 mcfcli[3673891]: %3|1730744361.223|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 12:19:32 kjcf05n00 mcfcli[3673891]: %3|1730744372.512|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:19:51 kjcf05n00 mcfcli[3673891]: %3|1730744391.224|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 12:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 12:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 12:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 12:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 12:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 12:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 12:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 12:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 12:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 12:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 12:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 12:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 12:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 12:20:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 12:20:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:20:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 12:20:12 kjcf05n00 mcfcli[3673891]: %3|1730744412.509|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:20:21 kjcf05n00 mcfcli[3673891]: %3|1730744421.224|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:20:30 kjcf05n00 python3.9[2119158]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 12:20:50 kjcf05n00 mcfcli[3673891]: %3|1730744450.230|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:20:51 kjcf05n00 mcfcli[3673891]: %3|1730744451.224|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 12:21:21 kjcf05n00 mcfcli[3673891]: %3|1730744481.224|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 12:21:30 kjcf05n00 mcfcli[3673891]: %3|1730744490.226|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:21:51 kjcf05n00 mcfcli[3673891]: %3|1730744511.224|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 12:22:07 kjcf05n00 mcfcli[3673891]: %3|1730744527.564|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:22:21 kjcf05n00 mcfcli[3673891]: %3|1730744541.224|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:22:45 kjcf05n00 mcfcli[3673891]: %3|1730744565.001|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:22:51 kjcf05n00 mcfcli[3673891]: %3|1730744571.225|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T18:23:15.868136Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 12:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T18:23:15.868201Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.084ms Nov 4 12:23:21 kjcf05n00 mcfcli[3673891]: %3|1730744601.225|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:23:22 kjcf05n00 mcfcli[3673891]: %3|1730744602.818|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T12:23:27.246756705-06:00 level=info msg="Completed cleanup jobs" duration=20.299546ms Nov 4 12:23:51 kjcf05n00 mcfcli[3673891]: %3|1730744631.225|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:24:01 kjcf05n00 mcfcli[3673891]: %3|1730744641.359|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:24:12 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 12:24:12 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 14 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.008265 sec, idle for 1 hour(s)] Nov 4 12:24:21 kjcf05n00 mcfcli[3673891]: %3|1730744661.225|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 12:24:40 kjcf05n00 mcfcli[3673891]: %3|1730744680.320|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:24:51 kjcf05n00 mcfcli[3673891]: %3|1730744691.225|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:25:18 kjcf05n00 mcfcli[3673891]: %3|1730744718.032|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:25:21 kjcf05n00 mcfcli[3673891]: %3|1730744721.225|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:25:30 kjcf05n00 python3.9[2122090]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 12:25:51 kjcf05n00 mcfcli[3673891]: %3|1730744751.225|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:25:55 kjcf05n00 mcfcli[3673891]: %3|1730744755.659|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:26:21 kjcf05n00 mcfcli[3673891]: %3|1730744781.226|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 12:26:30 kjcf05n00 mcfcli[3673891]: %3|1730744790.634|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:26:51 kjcf05n00 mcfcli[3673891]: %3|1730744811.226|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 12:27:09 kjcf05n00 mcfcli[3673891]: %3|1730744829.880|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:27:21 kjcf05n00 mcfcli[3673891]: %3|1730744841.226|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 12:27:46 kjcf05n00 mcfcli[3673891]: %3|1730744866.840|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:27:51 kjcf05n00 mcfcli[3673891]: %3|1730744871.226|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 12:28:21 kjcf05n00 mcfcli[3673891]: %3|1730744901.228|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:28:25 kjcf05n00 mcfcli[3673891]: %3|1730744905.110|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:28:51 kjcf05n00 mcfcli[3673891]: %3|1730744931.228|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 12:29:03 kjcf05n00 mcfcli[3673891]: %3|1730744943.854|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:29:21 kjcf05n00 mcfcli[3673891]: %3|1730744961.228|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 12:29:39 kjcf05n00 mcfcli[3673891]: %3|1730744979.845|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:29:51 kjcf05n00 mcfcli[3673891]: %3|1730744991.228|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 12:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 12:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 12:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 12:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 12:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 12:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 12:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 12:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 12:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 12:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 12:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 12:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 12:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 12:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 12:30:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 12:30:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:30:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 12:30:17 kjcf05n00 mcfcli[3673891]: %3|1730745017.039|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:30:21 kjcf05n00 mcfcli[3673891]: %3|1730745021.228|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 12:30:30 kjcf05n00 python3.9[2124873]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 12:30:51 kjcf05n00 mcfcli[3673891]: %3|1730745051.228|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 12:30:56 kjcf05n00 mcfcli[3673891]: %3|1730745056.702|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:31:21 kjcf05n00 mcfcli[3673891]: %3|1730745081.229|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 12:31:34 kjcf05n00 mcfcli[3673891]: %3|1730745094.836|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:31:51 kjcf05n00 mcfcli[3673891]: %3|1730745111.229|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 12:32:10 kjcf05n00 mcfcli[3673891]: %3|1730745130.696|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:32:21 kjcf05n00 mcfcli[3673891]: %3|1730745141.730|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 12:32:50 kjcf05n00 mcfcli[3673891]: %3|1730745170.693|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:32:51 kjcf05n00 mcfcli[3673891]: %3|1730745171.898|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 12:33:21 kjcf05n00 mcfcli[3673891]: %3|1730745201.898|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 12:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T12:33:27.252712911-06:00 level=info msg="Completed cleanup jobs" duration=26.106261ms Nov 4 12:33:27 kjcf05n00 mcfcli[3673891]: %3|1730745207.733|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:33:52 kjcf05n00 mcfcli[3673891]: %3|1730745232.231|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 12:34:06 kjcf05n00 mcfcli[3673891]: %3|1730745246.003|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:34:22 kjcf05n00 mcfcli[3673891]: %3|1730745262.231|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:34:43 kjcf05n00 mcfcli[3673891]: %3|1730745283.813|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:34:52 kjcf05n00 mcfcli[3673891]: %3|1730745292.231|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:35:22 kjcf05n00 mcfcli[3673891]: %3|1730745322.231|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:35:22 kjcf05n00 mcfcli[3673891]: %3|1730745322.714|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:35:37 kjcf05n00 python3.9[2127714]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 12:35:52 kjcf05n00 mcfcli[3673891]: %3|1730745352.231|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 12:36:01 kjcf05n00 mcfcli[3673891]: %3|1730745361.101|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:36:22 kjcf05n00 mcfcli[3673891]: %3|1730745382.233|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:36:40 kjcf05n00 mcfcli[3673891]: %3|1730745400.907|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:36:52 kjcf05n00 mcfcli[3673891]: %3|1730745412.233|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 12:36:56 kjcf05n03 diskmonitor[17871]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 12:37:18 kjcf05n00 mcfcli[3673891]: %3|1730745438.506|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:37:22 kjcf05n00 mcfcli[3673891]: %3|1730745442.233|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:37:52 kjcf05n00 mcfcli[3673891]: %3|1730745472.233|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:37:56 kjcf05n00 mcfcli[3673891]: %3|1730745476.965|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:38:22 kjcf05n00 mcfcli[3673891]: %3|1730745502.233|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:38:36 kjcf05n00 mcfcli[3673891]: %3|1730745516.962|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:38:52 kjcf05n00 mcfcli[3673891]: %3|1730745532.233|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:39:15 kjcf05n00 mcfcli[3673891]: %3|1730745555.540|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:39:22 kjcf05n00 mcfcli[3673891]: %3|1730745562.234|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 12:39:52 kjcf05n00 mcfcli[3673891]: %3|1730745592.234|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:39:54 kjcf05n00 mcfcli[3673891]: %3|1730745594.846|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 12:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 12:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 12:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 12:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 12:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 12:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 12:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 12:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 12:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 12:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 12:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 12:40:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 12:40:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:40:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 12:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 12:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 12:40:22 kjcf05n00 mcfcli[3673891]: %3|1730745622.235|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 12:40:30 kjcf05n00 python3.9[2130526]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 12:40:31 kjcf05n00 mcfcli[3673891]: %3|1730745631.753|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:40:52 kjcf05n00 mcfcli[3673891]: %3|1730745652.235|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 12:41:09 kjcf05n00 mcfcli[3673891]: %3|1730745669.141|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:41:22 kjcf05n00 mcfcli[3673891]: %3|1730745682.235|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:41:48 kjcf05n00 mcfcli[3673891]: %3|1730745708.010|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:41:52 kjcf05n00 mcfcli[3673891]: %3|1730745712.235|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:42:22 kjcf05n00 mcfcli[3673891]: %3|1730745742.237|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:42:28 kjcf05n00 mcfcli[3673891]: %3|1730745748.007|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:42:52 kjcf05n00 mcfcli[3673891]: %3|1730745772.237|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:43:07 kjcf05n00 mcfcli[3673891]: %3|1730745787.655|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:43:22 kjcf05n00 mcfcli[3673891]: %3|1730745802.237|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T12:43:27.252725247-06:00 level=info msg="Completed cleanup jobs" duration=26.204957ms Nov 4 12:43:46 kjcf05n00 mcfcli[3673891]: %3|1730745826.644|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:43:52 kjcf05n00 mcfcli[3673891]: %3|1730745832.237|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:44:22 kjcf05n00 mcfcli[3673891]: %3|1730745862.237|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:44:26 kjcf05n00 mcfcli[3673891]: %3|1730745866.642|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:44:52 kjcf05n00 mcfcli[3673891]: %3|1730745892.238|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:45:05 kjcf05n00 mcfcli[3673891]: %3|1730745905.380|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:45:22 kjcf05n00 mcfcli[3673891]: %3|1730745922.239|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:45:30 kjcf05n00 python3.9[2133522]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 12:45:43 kjcf05n00 mcfcli[3673891]: %3|1730745943.387|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:45:52 kjcf05n00 mcfcli[3673891]: %3|1730745952.239|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 12:46:22 kjcf05n00 mcfcli[3673891]: %3|1730745982.239|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:46:23 kjcf05n00 mcfcli[3673891]: %3|1730745983.384|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:46:52 kjcf05n00 mcfcli[3673891]: %3|1730746012.239|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:47:02 kjcf05n00 mcfcli[3673891]: %3|1730746022.636|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:47:22 kjcf05n00 mcfcli[3673891]: %3|1730746042.240|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 12:47:41 kjcf05n00 mcfcli[3673891]: %3|1730746061.964|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:47:52 kjcf05n00 mcfcli[3673891]: %3|1730746072.241|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:48:17 kjcf05n00 mcfcli[3673891]: %3|1730746097.955|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:48:22 kjcf05n00 mcfcli[3673891]: %3|1730746102.241|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:48:52 kjcf05n00 mcfcli[3673891]: %3|1730746132.241|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 12:48:55 kjcf05n00 mcfcli[3673891]: %3|1730746135.329|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:49:22 kjcf05n00 mcfcli[3673891]: %3|1730746162.241|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 12:49:30 kjcf05n00 mcfcli[3673891]: %3|1730746170.664|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:49:52 kjcf05n00 mcfcli[3673891]: %3|1730746192.241|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 12:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 12:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 12:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 12:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 12:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 12:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 12:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 12:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 12:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 12:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 12:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 12:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 12:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 12:50:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 12:50:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 12:50:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 12:50:10 kjcf05n00 mcfcli[3673891]: %3|1730746210.661|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:50:22 kjcf05n00 mcfcli[3673891]: %3|1730746222.242|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:50:30 kjcf05n00 python3.9[2136296]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 12:50:49 kjcf05n00 mcfcli[3673891]: %3|1730746249.600|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:50:52 kjcf05n00 mcfcli[3673891]: %3|1730746252.242|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 12:51:22 kjcf05n00 mcfcli[3673891]: %3|1730746282.242|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:51:26 kjcf05n00 mcfcli[3673891]: %3|1730746286.442|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:51:52 kjcf05n00 mcfcli[3673891]: %3|1730746312.242|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:52:04 kjcf05n00 mcfcli[3673891]: %3|1730746324.644|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:52:22 kjcf05n00 mcfcli[3673891]: %3|1730746342.243|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:52:43 kjcf05n00 mcfcli[3673891]: %3|1730746363.415|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:52:52 kjcf05n00 mcfcli[3673891]: %3|1730746372.244|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T18:53:15.867799Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 12:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T18:53:15.867861Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.081ms Nov 4 12:53:21 kjcf05n00 mcfcli[3673891]: %3|1730746401.772|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:53:22 kjcf05n00 mcfcli[3673891]: %3|1730746402.244|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T12:53:27.264865301-06:00 level=info msg="Completed cleanup jobs" duration=38.480454ms Nov 4 12:53:52 kjcf05n00 mcfcli[3673891]: %3|1730746432.244|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 12:53:58 kjcf05n00 mcfcli[3673891]: %3|1730746438.370|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:54:22 kjcf05n00 mcfcli[3673891]: %3|1730746462.244|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 12:54:35 kjcf05n00 mcfcli[3673891]: %3|1730746475.945|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:54:52 kjcf05n00 mcfcli[3673891]: %3|1730746492.244|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 12:55:15 kjcf05n00 mcfcli[3673891]: %3|1730746515.942|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:55:22 kjcf05n00 mcfcli[3673891]: %3|1730746522.244|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 12:55:30 kjcf05n00 python3.9[2139064]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 12:55:52 kjcf05n00 mcfcli[3673891]: %3|1730746552.245|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 12:55:55 kjcf05n00 mcfcli[3673891]: %3|1730746555.939|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:56:22 kjcf05n00 mcfcli[3673891]: %3|1730746582.245|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 12:56:33 kjcf05n00 mcfcli[3673891]: %3|1730746593.308|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:56:52 kjcf05n00 mcfcli[3673891]: %3|1730746612.245|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 12:57:09 kjcf05n00 mcfcli[3673891]: %3|1730746629.419|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:57:22 kjcf05n00 mcfcli[3673891]: %3|1730746642.245|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:57:47 kjcf05n00 mcfcli[3673891]: %3|1730746667.204|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:57:52 kjcf05n00 mcfcli[3673891]: %3|1730746672.246|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 12:58:22 kjcf05n00 mcfcli[3673891]: %3|1730746702.246|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 12:58:27 kjcf05n00 mcfcli[3673891]: %3|1730746707.123|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:58:52 kjcf05n00 mcfcli[3673891]: %3|1730746732.246|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 12:59:06 kjcf05n00 mcfcli[3673891]: %3|1730746746.157|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:59:22 kjcf05n00 mcfcli[3673891]: %3|1730746762.246|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 12:59:44 kjcf05n00 mcfcli[3673891]: %3|1730746784.943|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 12:59:52 kjcf05n00 mcfcli[3673891]: %3|1730746792.248|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 13:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 13:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 13:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 13:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 13:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 13:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 13:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 13:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 13:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 13:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 13:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 13:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 13:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 13:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 13:00:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 13:00:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:00:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 13:00:22 kjcf05n00 mcfcli[3673891]: %3|1730746822.248|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 13:00:24 kjcf05n00 mcfcli[3673891]: %3|1730746824.940|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:00:30 kjcf05n00 python3.9[2142068]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 13:00:52 kjcf05n00 mcfcli[3673891]: %3|1730746852.248|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 13:01:00 kjcf05n00 mcfcli[3673891]: %3|1730746860.651|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:01:22 kjcf05n00 mcfcli[3673891]: %3|1730746882.248|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:01:40 kjcf05n00 mcfcli[3673891]: %3|1730746900.648|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:01:52 kjcf05n00 mcfcli[3673891]: %3|1730746912.248|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:02:18 kjcf05n00 mcfcli[3673891]: %3|1730746938.604|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:02:22 kjcf05n00 mcfcli[3673891]: %3|1730746942.250|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:02:52 kjcf05n00 mcfcli[3673891]: %3|1730746972.250|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:02:55 kjcf05n00 mcfcli[3673891]: %3|1730746975.082|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:03:22 kjcf05n00 mcfcli[3673891]: %3|1730747002.250|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T13:03:27.268697932-06:00 level=info msg="Completed cleanup jobs" duration=41.560983ms Nov 4 13:03:35 kjcf05n00 mcfcli[3673891]: %3|1730747015.079|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:03:52 kjcf05n00 mcfcli[3673891]: %3|1730747032.251|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:04:12 kjcf05n00 mcfcli[3673891]: %3|1730747052.943|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:04:22 kjcf05n00 mcfcli[3673891]: %3|1730747062.251|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 13:04:51 kjcf05n00 mcfcli[3673891]: %3|1730747091.433|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:04:52 kjcf05n00 mcfcli[3673891]: %3|1730747092.252|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:05:22 kjcf05n00 mcfcli[3673891]: %3|1730747122.252|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:05:30 kjcf05n00 mcfcli[3673891]: %3|1730747130.471|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:05:30 kjcf05n00 python3.9[2144883]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 13:05:52 kjcf05n00 mcfcli[3673891]: %3|1730747152.252|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 13:06:10 kjcf05n00 mcfcli[3673891]: %3|1730747170.468|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:06:22 kjcf05n00 mcfcli[3673891]: %3|1730747182.252|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:06:49 kjcf05n00 mcfcli[3673891]: %3|1730747209.616|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:06:52 kjcf05n00 mcfcli[3673891]: %3|1730747212.252|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:07:22 kjcf05n00 mcfcli[3673891]: %3|1730747242.252|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:07:28 kjcf05n00 mcfcli[3673891]: %3|1730747248.689|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:07:40 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 13:07:40 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 13:07:40 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 13:07:52 kjcf05n00 mcfcli[3673891]: %3|1730747272.253|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:08:08 kjcf05n00 mcfcli[3673891]: %3|1730747288.686|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:08:22 kjcf05n00 mcfcli[3673891]: %3|1730747302.253|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:08:48 kjcf05n00 mcfcli[3673891]: %3|1730747328.684|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:08:52 kjcf05n00 mcfcli[3673891]: %3|1730747332.254|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:09:22 kjcf05n00 mcfcli[3673891]: %3|1730747362.254|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:09:28 kjcf05n00 mcfcli[3673891]: %3|1730747368.681|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:09:52 kjcf05n00 mcfcli[3673891]: %3|1730747392.254|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:09:57 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 13:09:57 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 13:09:57 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 13:09:58 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 13:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 13:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 13:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 13:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 13:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 13:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 13:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 13:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 13:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 13:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 13:10:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 13:10:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:10:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 13:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 13:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 13:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 13:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 13:10:06 kjcf05n00 mcfcli[3673891]: %3|1730747406.606|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:10:08 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 13:10:22 kjcf05n00 mcfcli[3673891]: %3|1730747422.255|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:10:26 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 13:10:26 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 13:10:27 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 13:10:27 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 13:10:27 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 13:10:30 kjcf05n00 python3.9[2147701]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 13:10:36 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 13:10:36 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 13:10:45 kjcf05n00 mcfcli[3673891]: %3|1730747445.398|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:10:52 kjcf05n00 mcfcli[3673891]: %3|1730747452.255|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 13:11:21 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 13:11:21 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 13:11:21 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 13:11:21 kjcf05n00 mcfcli[3673891]: %3|1730747481.261|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:11:22 kjcf05n00 mcfcli[3673891]: %3|1730747482.255|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 13:11:52 kjcf05n00 mcfcli[3673891]: %3|1730747512.255|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 13:11:59 kjcf05n00 mcfcli[3673891]: %3|1730747519.818|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:12:22 kjcf05n00 mcfcli[3673891]: %3|1730747542.255|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:12:39 kjcf05n00 mcfcli[3673891]: %3|1730747559.815|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:12:52 kjcf05n00 mcfcli[3673891]: %3|1730747572.256|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:13:17 kjcf05n00 mcfcli[3673891]: %3|1730747597.186|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:13:22 kjcf05n00 mcfcli[3673891]: %3|1730747602.257|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:13:23 kjcf05n01 diskmonitor[1331407]: leaving test state: 1 next state: 2 Nov 4 13:13:23 kjcf05n01 diskmonitor[1331407]: lock req: no timeout Nov 4 13:13:23 kjcf05n01 diskmonitor[1331407]: leaving test state: 2 next state: 4 Nov 4 13:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T13:13:27.247271006-06:00 level=info msg="Completed cleanup jobs" duration=20.874622ms Nov 4 13:13:52 kjcf05n00 mcfcli[3673891]: %3|1730747632.257|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 13:13:56 kjcf05n00 mcfcli[3673891]: %3|1730747636.751|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:14:22 kjcf05n00 mcfcli[3673891]: %3|1730747662.258|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 13:14:33 kjcf05n01 diskmonitor[1331407]: lock acquired Nov 4 13:14:33 kjcf05n01 diskmonitor[1331407]: leaving test state: 4 next state: 8 Nov 4 13:14:36 kjcf05n00 mcfcli[3673891]: %3|1730747676.748|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:14:43 kjcf05n01 diskmonitor[1331407]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 4 13:14:43 kjcf05n01 diskmonitor[1331407]: leaving test state: 8 next state: 20 Nov 4 13:14:43 kjcf05n01 diskmonitor[1331407]: leaving test state: 20 next state: 40 Nov 4 13:14:43 kjcf05n01 diskmonitor[1331407]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset 123afe50000 Nov 4 13:14:43 kjcf05n01 diskmonitor[1331407]: leaving test state: 40 next state: 80 Nov 4 13:14:52 kjcf05n00 mcfcli[3673891]: %3|1730747692.258|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 13:15:16 kjcf05n00 mcfcli[3673891]: %3|1730747716.745|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:15:22 kjcf05n00 mcfcli[3673891]: %3|1730747722.258|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 13:15:30 kjcf05n00 python3.9[2150527]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 13:15:41 kjcf05n01 diskmonitor[1331407]: leaving test state: 80 next state: 100 Nov 4 13:15:41 kjcf05n01 diskmonitor[1331407]: lock release: time: Mon Nov 4 13:15:39 2024 Nov 4 13:15:41 kjcf05n01 diskmonitor[1331407]: leaving test state: 100 next state: 1 Nov 4 13:15:52 kjcf05n00 mcfcli[3673891]: %3|1730747752.258|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 13:15:56 kjcf05n00 mcfcli[3673891]: %3|1730747756.742|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:16:22 kjcf05n00 mcfcli[3673891]: %3|1730747782.258|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 13:16:34 kjcf05n00 mcfcli[3673891]: %3|1730747794.451|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:16:52 kjcf05n00 mcfcli[3673891]: %3|1730747812.258|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 13:17:12 kjcf05n00 mcfcli[3673891]: %3|1730747832.990|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:17:22 kjcf05n00 mcfcli[3673891]: %3|1730747842.259|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:17:49 kjcf05n00 mcfcli[3673891]: %3|1730747869.335|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:17:52 kjcf05n00 mcfcli[3673891]: %3|1730747872.260|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 13:18:22 kjcf05n00 mcfcli[3673891]: %3|1730747902.260|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:18:28 kjcf05n00 mcfcli[3673891]: %3|1730747908.327|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:18:52 kjcf05n00 mcfcli[3673891]: %3|1730747932.260|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:19:07 kjcf05n00 mcfcli[3673891]: %3|1730747947.807|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:19:22 kjcf05n00 mcfcli[3673891]: %3|1730747962.260|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 13:19:47 kjcf05n00 mcfcli[3673891]: %3|1730747987.804|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:19:52 kjcf05n00 mcfcli[3673891]: %3|1730747992.260|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 13:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 13:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 13:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 13:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 13:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 13:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 13:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 13:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 13:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 13:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 13:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 13:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 13:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 13:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 13:20:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 13:20:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:20:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 13:20:22 kjcf05n00 mcfcli[3673891]: %3|1730748022.261|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 13:20:24 kjcf05n00 mcfcli[3673891]: %3|1730748024.371|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:20:30 kjcf05n00 python3.9[2153476]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 13:20:52 kjcf05n00 mcfcli[3673891]: %3|1730748052.261|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:21:02 kjcf05n00 mcfcli[3673891]: %3|1730748062.431|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:21:22 kjcf05n00 mcfcli[3673891]: %3|1730748082.261|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 13:21:40 kjcf05n00 mcfcli[3673891]: %3|1730748100.851|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:21:52 kjcf05n00 mcfcli[3673891]: %3|1730748112.262|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 13:22:20 kjcf05n00 mcfcli[3673891]: %3|1730748140.848|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:22:22 kjcf05n00 mcfcli[3673891]: %3|1730748142.262|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:22:52 kjcf05n00 mcfcli[3673891]: %3|1730748172.262|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 13:22:59 kjcf05n00 mcfcli[3673891]: %3|1730748179.759|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T19:23:15.868502Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 13:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T19:23:15.868568Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.085ms Nov 4 13:23:22 kjcf05n00 mcfcli[3673891]: %3|1730748202.263|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 13:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T13:23:27.268423343-06:00 level=info msg="Completed cleanup jobs" duration=41.602489ms Nov 4 13:23:35 kjcf05n00 mcfcli[3673891]: %3|1730748215.616|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:23:52 kjcf05n00 mcfcli[3673891]: %3|1730748232.763|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:24:10 kjcf05n00 mcfcli[3673891]: %3|1730748250.336|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:24:12 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 13:24:12 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 12 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.008136 sec, idle for 1 hour(s)] Nov 4 13:24:22 kjcf05n00 mcfcli[3673891]: %3|1730748262.764|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:24:50 kjcf05n00 mcfcli[3673891]: %3|1730748290.333|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:24:52 kjcf05n00 mcfcli[3673891]: %3|1730748292.918|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 13:25:16 kjcf05n00 diskmonitor[2758297]: leaving test state: 1 next state: 2 Nov 4 13:25:16 kjcf05n00 diskmonitor[2758297]: lock req: no timeout Nov 4 13:25:16 kjcf05n00 diskmonitor[2758297]: leaving test state: 2 next state: 4 Nov 4 13:25:22 kjcf05n00 mcfcli[3673891]: %3|1730748322.918|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:25:30 kjcf05n00 mcfcli[3673891]: %3|1730748330.074|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:25:31 kjcf05n00 python3.9[2156375]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 13:25:43 kjcf05n00 diskmonitor[2758297]: lock acquired Nov 4 13:25:43 kjcf05n00 diskmonitor[2758297]: leaving test state: 4 next state: 8 Nov 4 13:25:46 kjcf05n00 diskmonitor[2758297]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 4 13:25:46 kjcf05n00 diskmonitor[2758297]: leaving test state: 8 next state: 20 Nov 4 13:25:46 kjcf05n00 diskmonitor[2758297]: leaving test state: 20 next state: 40 Nov 4 13:25:46 kjcf05n00 diskmonitor[2758297]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset 7969dc0000 Nov 4 13:25:46 kjcf05n00 diskmonitor[2758297]: leaving test state: 40 next state: 80 Nov 4 13:25:52 kjcf05n00 mcfcli[3673891]: %3|1730748352.918|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 13:26:10 kjcf05n00 mcfcli[3673891]: %3|1730748370.071|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:26:22 kjcf05n00 mcfcli[3673891]: %3|1730748382.919|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:26:45 kjcf05n00 diskmonitor[2758297]: leaving test state: 80 next state: 100 Nov 4 13:26:45 kjcf05n00 diskmonitor[2758297]: lock release: time: Mon Nov 4 13:26:44 2024 Nov 4 13:26:45 kjcf05n00 diskmonitor[2758297]: leaving test state: 100 next state: 1 Nov 4 13:26:48 kjcf05n00 mcfcli[3673891]: %3|1730748408.419|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:26:53 kjcf05n00 mcfcli[3673891]: %3|1730748413.266|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 13:27:23 kjcf05n00 mcfcli[3673891]: %3|1730748443.266|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:27:26 kjcf05n00 mcfcli[3673891]: %3|1730748446.161|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:27:53 kjcf05n00 mcfcli[3673891]: %3|1730748473.266|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:28:06 kjcf05n00 mcfcli[3673891]: %3|1730748486.158|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:28:23 kjcf05n00 mcfcli[3673891]: %3|1730748503.267|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:28:46 kjcf05n00 mcfcli[3673891]: %3|1730748526.155|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:28:53 kjcf05n00 mcfcli[3673891]: %3|1730748533.267|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:29:23 kjcf05n00 mcfcli[3673891]: %3|1730748563.268|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 13:29:24 kjcf05n00 mcfcli[3673891]: %3|1730748564.920|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:29:53 kjcf05n00 mcfcli[3673891]: %3|1730748593.268|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 13:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 13:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 13:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 13:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 13:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 13:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 13:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 13:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 13:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 13:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 13:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 13:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 13:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 13:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 13:30:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 13:30:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:30:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 13:30:03 kjcf05n00 mcfcli[3673891]: %3|1730748603.358|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:30:23 kjcf05n00 mcfcli[3673891]: %3|1730748623.357|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 13:30:31 kjcf05n00 python3.9[2159947]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 13:30:41 kjcf05n00 mcfcli[3673891]: %3|1730748641.844|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:30:53 kjcf05n00 mcfcli[3673891]: %3|1730748653.769|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 13:31:21 kjcf05n00 mcfcli[3673891]: %3|1730748681.841|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:31:23 kjcf05n00 mcfcli[3673891]: %3|1730748683.921|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 13:31:53 kjcf05n00 mcfcli[3673891]: %3|1730748713.921|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:31:59 kjcf05n00 mcfcli[3673891]: %3|1730748719.615|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:32:24 kjcf05n00 mcfcli[3673891]: %3|1730748744.270|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 13:32:37 kjcf05n00 mcfcli[3673891]: %3|1730748757.156|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:32:54 kjcf05n00 mcfcli[3673891]: %3|1730748774.270|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:33:14 kjcf05n00 mcfcli[3673891]: %3|1730748794.245|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:33:24 kjcf05n00 mcfcli[3673891]: %3|1730748804.770|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 13:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T13:33:27.254176695-06:00 level=info msg="Completed cleanup jobs" duration=27.654659ms Nov 4 13:33:50 kjcf05n00 mcfcli[3673891]: %3|1730748830.583|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:33:54 kjcf05n00 mcfcli[3673891]: %3|1730748834.770|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 13:34:24 kjcf05n00 mcfcli[3673891]: %3|1730748864.771|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:34:27 kjcf05n00 mcfcli[3673891]: %3|1730748867.395|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:34:54 kjcf05n00 mcfcli[3673891]: %3|1730748894.921|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 13:35:05 kjcf05n00 mcfcli[3673891]: %3|1730748905.516|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:35:24 kjcf05n00 mcfcli[3673891]: %3|1730748924.921|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 13:35:30 kjcf05n00 python3.9[2162872]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 13:35:44 kjcf05n00 mcfcli[3673891]: %3|1730748944.782|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:35:54 kjcf05n00 mcfcli[3673891]: %3|1730748954.922|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:36:20 kjcf05n00 mcfcli[3673891]: %3|1730748980.527|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:36:25 kjcf05n00 mcfcli[3673891]: %3|1730748985.271|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 13:36:55 kjcf05n00 mcfcli[3673891]: %3|1730749015.271|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:36:58 kjcf05n00 mcfcli[3673891]: %3|1730749018.173|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:37:25 kjcf05n00 mcfcli[3673891]: %3|1730749045.272|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:37:38 kjcf05n00 mcfcli[3673891]: %3|1730749058.170|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:37:55 kjcf05n00 mcfcli[3673891]: %3|1730749075.272|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:38:13 kjcf05n00 mcfcli[3673891]: %3|1730749093.724|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:38:25 kjcf05n00 mcfcli[3673891]: %3|1730749105.272|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 13:38:51 kjcf05n00 mcfcli[3673891]: %3|1730749131.572|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:38:55 kjcf05n00 mcfcli[3673891]: %3|1730749135.273|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:39:15 kjcf05n06 chronyd[5469]: Selected source 16.110.135.123 Nov 4 13:39:25 kjcf05n00 mcfcli[3673891]: %3|1730749165.273|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:39:29 kjcf05n00 mcfcli[3673891]: %3|1730749169.465|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:39:55 kjcf05n00 mcfcli[3673891]: %3|1730749195.273|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 13:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 13:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 13:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 13:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 13:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 13:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 13:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 13:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 13:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 13:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 13:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 13:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 13:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 13:40:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 13:40:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:40:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 13:40:04 kjcf05n00 mcfcli[3673891]: %3|1730749204.977|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:40:25 kjcf05n00 mcfcli[3673891]: %3|1730749225.274|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 13:40:30 kjcf05n00 python3.9[2165651]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 13:40:44 kjcf05n00 mcfcli[3673891]: %3|1730749244.974|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:40:55 kjcf05n00 mcfcli[3673891]: %3|1730749255.274|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 13:41:24 kjcf05n00 mcfcli[3673891]: %3|1730749284.971|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:41:25 kjcf05n00 mcfcli[3673891]: %3|1730749285.275|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 13:41:55 kjcf05n00 mcfcli[3673891]: %3|1730749315.275|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 13:42:03 kjcf05n00 mcfcli[3673891]: %3|1730749323.805|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:42:25 kjcf05n00 mcfcli[3673891]: %3|1730749345.275|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 13:42:39 kjcf05n00 mcfcli[3673891]: %3|1730749359.295|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:42:55 kjcf05n00 mcfcli[3673891]: %3|1730749375.275|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 13:43:17 kjcf05n00 mcfcli[3673891]: %3|1730749397.090|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:43:25 kjcf05n00 mcfcli[3673891]: %3|1730749405.275|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 13:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T13:43:27.252722089-06:00 level=info msg="Completed cleanup jobs" duration=26.120506ms Nov 4 13:43:55 kjcf05n00 mcfcli[3673891]: %3|1730749435.233|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:43:55 kjcf05n00 mcfcli[3673891]: %3|1730749435.776|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:44:25 kjcf05n00 mcfcli[3673891]: %3|1730749465.776|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:44:32 kjcf05n00 mcfcli[3673891]: %3|1730749472.445|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:44:55 kjcf05n00 mcfcli[3673891]: %3|1730749495.777|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:45:09 kjcf05n00 mcfcli[3673891]: %3|1730749509.597|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:45:25 kjcf05n00 mcfcli[3673891]: %3|1730749525.925|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 13:45:31 kjcf05n00 python3.9[2168476]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 13:45:46 kjcf05n00 mcfcli[3673891]: %3|1730749546.189|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:45:55 kjcf05n00 mcfcli[3673891]: %3|1730749555.925|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:46:24 kjcf05n00 mcfcli[3673891]: %3|1730749584.303|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:46:26 kjcf05n00 mcfcli[3673891]: %3|1730749586.278|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 13:46:56 kjcf05n00 mcfcli[3673891]: %3|1730749616.278|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 13:47:02 kjcf05n00 mcfcli[3673891]: %3|1730749622.571|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:47:26 kjcf05n00 mcfcli[3673891]: %3|1730749646.278|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:47:41 kjcf05n00 mcfcli[3673891]: %3|1730749661.277|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:47:56 kjcf05n00 mcfcli[3673891]: %3|1730749676.278|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 13:48:19 kjcf05n00 mcfcli[3673891]: %3|1730749699.334|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:48:26 kjcf05n00 mcfcli[3673891]: %3|1730749706.278|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 13:48:56 kjcf05n00 mcfcli[3673891]: %3|1730749736.279|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:48:59 kjcf05n00 mcfcli[3673891]: %3|1730749739.331|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:49:26 kjcf05n00 mcfcli[3673891]: %3|1730749766.279|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:49:39 kjcf05n00 mcfcli[3673891]: %3|1730749779.328|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:49:56 kjcf05n00 mcfcli[3673891]: %3|1730749796.279|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 13:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 13:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 13:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 13:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 13:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 13:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 13:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 13:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 13:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 13:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 13:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 13:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 13:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 13:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 13:50:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 13:50:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 13:50:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 13:50:19 kjcf05n00 mcfcli[3673891]: %3|1730749819.325|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:50:26 kjcf05n00 mcfcli[3673891]: %3|1730749826.279|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 13:50:31 kjcf05n00 python3.9[2171344]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 13:50:55 kjcf05n00 mcfcli[3673891]: %3|1730749855.952|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:50:56 kjcf05n00 mcfcli[3673891]: %3|1730749856.279|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:51:26 kjcf05n00 mcfcli[3673891]: %3|1730749886.279|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 13:51:33 kjcf05n00 mcfcli[3673891]: %3|1730749893.105|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:51:56 kjcf05n00 mcfcli[3673891]: %3|1730749916.280|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:52:13 kjcf05n00 mcfcli[3673891]: %3|1730749933.102|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:52:26 kjcf05n00 mcfcli[3673891]: %3|1730749946.280|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:52:52 kjcf05n00 mcfcli[3673891]: %3|1730749972.963|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:52:56 kjcf05n00 mcfcli[3673891]: %3|1730749976.280|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 13:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T19:53:15.868193Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 13:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T19:53:15.868257Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.089ms Nov 4 13:53:26 kjcf05n00 mcfcli[3673891]: %3|1730750006.280|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 13:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T13:53:27.252445931-06:00 level=info msg="Completed cleanup jobs" duration=26.044796ms Nov 4 13:53:30 kjcf05n00 mcfcli[3673891]: %3|1730750010.862|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:53:56 kjcf05n00 mcfcli[3673891]: %3|1730750036.281|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:54:06 kjcf05n00 mcfcli[3673891]: %3|1730750046.043|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:54:26 kjcf05n00 mcfcli[3673891]: %3|1730750066.281|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 13:54:42 kjcf05n00 mcfcli[3673891]: %3|1730750082.710|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:54:56 kjcf05n00 mcfcli[3673891]: %3|1730750096.282|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:55:22 kjcf05n00 mcfcli[3673891]: %3|1730750122.707|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:55:26 kjcf05n00 mcfcli[3673891]: %3|1730750126.282|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 13:55:31 kjcf05n00 python3.9[2174285]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 13:55:56 kjcf05n00 mcfcli[3673891]: %3|1730750156.282|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 13:56:01 kjcf05n00 mcfcli[3673891]: %3|1730750161.800|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:56:26 kjcf05n00 mcfcli[3673891]: %3|1730750186.282|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 13:56:41 kjcf05n00 mcfcli[3673891]: %3|1730750201.797|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:56:56 kjcf05n00 mcfcli[3673891]: %3|1730750216.283|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 13:57:21 kjcf05n00 mcfcli[3673891]: %3|1730750241.632|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:57:26 kjcf05n00 mcfcli[3673891]: %3|1730750246.284|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:57:56 kjcf05n00 mcfcli[3673891]: %3|1730750276.284|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:58:01 kjcf05n00 mcfcli[3673891]: %3|1730750281.629|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:58:26 kjcf05n00 mcfcli[3673891]: %3|1730750306.284|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:58:38 kjcf05n00 mcfcli[3673891]: %3|1730750318.611|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:58:56 kjcf05n00 mcfcli[3673891]: %3|1730750336.285|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 13:59:16 kjcf05n00 mcfcli[3673891]: %3|1730750356.948|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:59:26 kjcf05n00 mcfcli[3673891]: %3|1730750366.285|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 13:59:55 kjcf05n00 mcfcli[3673891]: %3|1730750395.283|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 13:59:56 kjcf05n00 mcfcli[3673891]: %3|1730750396.285|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 14:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 14:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 14:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 14:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 14:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 14:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 14:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 14:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 14:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 14:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 14:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 14:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 14:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 14:00:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 14:00:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:00:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 14:00:26 kjcf05n00 mcfcli[3673891]: %3|1730750426.286|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 14:00:31 kjcf05n00 python3.9[2177082]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 14:00:35 kjcf05n00 mcfcli[3673891]: %3|1730750435.280|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:00:56 kjcf05n00 mcfcli[3673891]: %3|1730750456.287|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:01:13 kjcf05n00 mcfcli[3673891]: %3|1730750473.771|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:01:26 kjcf05n00 mcfcli[3673891]: %3|1730750486.787|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 14:01:49 kjcf05n00 mcfcli[3673891]: %3|1730750509.205|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:01:56 kjcf05n00 mcfcli[3673891]: %3|1730750516.788|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:02:26 kjcf05n00 mcfcli[3673891]: %3|1730750546.931|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 14:02:27 kjcf05n00 mcfcli[3673891]: %3|1730750547.844|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:02:56 kjcf05n00 mcfcli[3673891]: %3|1730750576.931|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:03:07 kjcf05n00 mcfcli[3673891]: %3|1730750587.841|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:03:26 kjcf05n00 mcfcli[3673891]: %3|1730750606.931|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T14:03:27.26888909-06:00 level=info msg="Completed cleanup jobs" duration=41.776287ms Nov 4 14:03:46 kjcf05n00 mcfcli[3673891]: %3|1730750626.770|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:03:56 kjcf05n00 mcfcli[3673891]: %3|1730750636.932|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:04:24 kjcf05n00 mcfcli[3673891]: %3|1730750664.634|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:04:26 kjcf05n00 mcfcli[3673891]: %3|1730750666.932|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 14:04:56 kjcf05n00 mcfcli[3673891]: %3|1730750696.932|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 14:05:02 kjcf05n00 mcfcli[3673891]: %3|1730750702.068|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:05:26 kjcf05n00 mcfcli[3673891]: %3|1730750726.932|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:05:31 kjcf05n00 python3.9[2179910]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 14:05:40 kjcf05n00 mcfcli[3673891]: %3|1730750740.474|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:05:56 kjcf05n00 mcfcli[3673891]: %3|1730750756.932|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:06:15 kjcf05n00 mcfcli[3673891]: %3|1730750775.483|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:06:26 kjcf05n00 mcfcli[3673891]: %3|1730750786.933|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 14:06:54 kjcf05n00 mcfcli[3673891]: %3|1730750814.124|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:06:56 kjcf05n00 mcfcli[3673891]: %3|1730750816.933|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:07:26 kjcf05n00 mcfcli[3673891]: %3|1730750846.933|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 14:07:31 kjcf05n00 mcfcli[3673891]: %3|1730750851.782|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:07:56 kjcf05n00 mcfcli[3673891]: %3|1730750876.933|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:08:11 kjcf05n00 mcfcli[3673891]: %3|1730750891.779|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:08:16 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 14:08:16 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 14:08:16 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 14:08:19 kjcf05n02 diskmonitor[17328]: leaving test state: 1 next state: 2 Nov 4 14:08:19 kjcf05n02 diskmonitor[17328]: lock req: no timeout Nov 4 14:08:19 kjcf05n02 diskmonitor[17328]: leaving test state: 2 next state: 4 Nov 4 14:08:27 kjcf05n00 mcfcli[3673891]: %3|1730750907.294|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 14:08:36 kjcf05n02 diskmonitor[17328]: lock acquired Nov 4 14:08:36 kjcf05n02 diskmonitor[17328]: leaving test state: 4 next state: 8 Nov 4 14:08:51 kjcf05n00 mcfcli[3673891]: %3|1730750931.776|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:08:53 kjcf05n02 diskmonitor[17328]: Test selected disk: eui.345950304db010210025384500000004_S4YPNE0MB01021 Nov 4 14:08:53 kjcf05n02 diskmonitor[17328]: leaving test state: 8 next state: 20 Nov 4 14:08:53 kjcf05n02 diskmonitor[17328]: leaving test state: 20 next state: 40 Nov 4 14:08:53 kjcf05n02 diskmonitor[17328]: Test /dev/disk/by-id/nvme-eui.345950304db010210025384500000004_S4YPNE0MB01021, offset 2ea64da8000 Nov 4 14:08:53 kjcf05n02 diskmonitor[17328]: leaving test state: 40 next state: 80 Nov 4 14:08:57 kjcf05n00 mcfcli[3673891]: %3|1730750937.295|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:09:16 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 14:09:21 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 14:09:21 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 14:09:21 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 14:09:27 kjcf05n00 mcfcli[3673891]: %3|1730750967.794|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 14:09:30 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 14:09:30 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 14:09:30 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 14:09:31 kjcf05n00 mcfcli[3673891]: %3|1730750971.534|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:09:44 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 14:09:44 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 14:09:53 kjcf05n02 diskmonitor[17328]: leaving test state: 80 next state: 100 Nov 4 14:09:53 kjcf05n02 diskmonitor[17328]: lock release: time: Mon Nov 4 14:09:48 2024 Nov 4 14:09:53 kjcf05n02 diskmonitor[17328]: leaving test state: 100 next state: 1 Nov 4 14:09:57 kjcf05n00 mcfcli[3673891]: %3|1730750997.795|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 14:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 14:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 14:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 14:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 14:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 14:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 14:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 14:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 14:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 14:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 14:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 14:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 14:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 14:10:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 14:10:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:10:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 14:10:11 kjcf05n00 mcfcli[3673891]: %3|1730751011.260|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:10:27 kjcf05n00 mcfcli[3673891]: %3|1730751027.795|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 14:10:31 kjcf05n00 python3.9[2182853]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 14:10:49 kjcf05n00 mcfcli[3673891]: %3|1730751049.113|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:10:53 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 14:10:57 kjcf05n00 mcfcli[3673891]: %3|1730751057.796|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:11:21 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 14:11:21 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 14:11:27 kjcf05n00 mcfcli[3673891]: %3|1730751087.796|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:11:28 kjcf05n00 mcfcli[3673891]: %3|1730751088.642|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:11:30 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 14:11:30 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 14:11:30 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 14:11:57 kjcf05n00 mcfcli[3673891]: %3|1730751117.796|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:12:08 kjcf05n00 mcfcli[3673891]: %3|1730751128.123|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:12:27 kjcf05n00 mcfcli[3673891]: %3|1730751147.796|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:12:46 kjcf05n00 mcfcli[3673891]: %3|1730751166.328|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:12:57 kjcf05n00 mcfcli[3673891]: %3|1730751177.797|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:13:23 kjcf05n00 mcfcli[3673891]: %3|1730751203.617|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T14:13:27.253287878-06:00 level=info msg="Completed cleanup jobs" duration=26.212951ms Nov 4 14:13:27 kjcf05n00 mcfcli[3673891]: %3|1730751207.797|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:13:57 kjcf05n00 mcfcli[3673891]: %3|1730751237.798|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:14:03 kjcf05n00 mcfcli[3673891]: %3|1730751243.298|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:14:27 kjcf05n00 mcfcli[3673891]: %3|1730751267.798|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:14:41 kjcf05n00 mcfcli[3673891]: %3|1730751281.524|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:14:57 kjcf05n00 mcfcli[3673891]: %3|1730751297.798|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 14:15:19 kjcf05n00 mcfcli[3673891]: %3|1730751319.768|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:15:27 kjcf05n00 mcfcli[3673891]: %3|1730751327.798|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:15:31 kjcf05n00 python3.9[2185703]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 14:15:57 kjcf05n00 mcfcli[3673891]: %3|1730751357.798|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:15:59 kjcf05n00 mcfcli[3673891]: %3|1730751359.765|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:16:27 kjcf05n00 mcfcli[3673891]: %3|1730751387.798|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:16:39 kjcf05n00 mcfcli[3673891]: %3|1730751399.762|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:16:57 kjcf05n00 mcfcli[3673891]: %3|1730751417.799|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:17:19 kjcf05n00 mcfcli[3673891]: %3|1730751439.636|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:17:27 kjcf05n00 mcfcli[3673891]: %3|1730751447.799|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 14:17:57 kjcf05n00 mcfcli[3673891]: %3|1730751477.799|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:17:58 kjcf05n00 mcfcli[3673891]: %3|1730751478.120|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:18:27 kjcf05n00 mcfcli[3673891]: %3|1730751507.800|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 14:18:36 kjcf05n00 mcfcli[3673891]: %3|1730751516.191|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:18:57 kjcf05n00 mcfcli[3673891]: %3|1730751537.800|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:19:15 kjcf05n00 mcfcli[3673891]: %3|1730751555.332|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:19:27 kjcf05n00 mcfcli[3673891]: %3|1730751567.800|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 14:19:55 kjcf05n00 mcfcli[3673891]: %3|1730751595.329|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:19:57 kjcf05n00 mcfcli[3673891]: %3|1730751597.800|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 14:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 14:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 14:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 14:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 14:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 14:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 14:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 14:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 14:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 14:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 14:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 14:20:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 14:20:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:20:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 14:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 14:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 14:20:27 kjcf05n00 mcfcli[3673891]: %3|1730751627.800|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 14:20:31 kjcf05n00 python3.9[2188542]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 14:20:35 kjcf05n00 mcfcli[3673891]: %3|1730751635.326|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:20:57 kjcf05n00 mcfcli[3673891]: %3|1730751657.801|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 14:21:13 kjcf05n00 mcfcli[3673891]: %3|1730751673.047|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:21:27 kjcf05n00 mcfcli[3673891]: %3|1730751687.801|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:21:52 kjcf05n00 mcfcli[3673891]: %3|1730751712.217|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:21:57 kjcf05n00 mcfcli[3673891]: %3|1730751717.801|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:22:27 kjcf05n00 mcfcli[3673891]: %3|1730751747.802|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:22:32 kjcf05n00 mcfcli[3673891]: %3|1730751752.214|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:22:57 kjcf05n00 mcfcli[3673891]: %3|1730751777.938|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 14:23:10 kjcf05n00 mcfcli[3673891]: %3|1730751790.719|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T20:23:15.868235Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 14:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T20:23:15.868311Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.154ms Nov 4 14:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T14:23:27.268621269-06:00 level=info msg="Completed cleanup jobs" duration=41.66008ms Nov 4 14:23:28 kjcf05n00 mcfcli[3673891]: %3|1730751808.303|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 14:23:45 kjcf05n00 mcfcli[3673891]: %3|1730751825.512|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:23:58 kjcf05n00 mcfcli[3673891]: %3|1730751838.303|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:24:12 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 14:24:12 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 5 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.006908 sec, idle for 1 hour(s)] Nov 4 14:24:23 kjcf05n00 mcfcli[3673891]: %3|1730751863.531|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:24:28 kjcf05n00 mcfcli[3673891]: %3|1730751868.303|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 14:24:58 kjcf05n00 mcfcli[3673891]: %3|1730751898.304|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:25:01 kjcf05n00 mcfcli[3673891]: %3|1730751901.989|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:25:28 kjcf05n00 mcfcli[3673891]: %3|1730751928.304|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 14:25:31 kjcf05n00 python3.9[2191284]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 14:25:41 kjcf05n00 mcfcli[3673891]: %3|1730751941.986|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:25:58 kjcf05n00 mcfcli[3673891]: %3|1730751958.305|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:26:17 kjcf05n00 mcfcli[3673891]: %3|1730751977.769|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:26:28 kjcf05n00 mcfcli[3673891]: %3|1730751988.804|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 14:26:55 kjcf05n00 mcfcli[3673891]: %3|1730752015.898|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:26:58 kjcf05n00 mcfcli[3673891]: %3|1730752018.939|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 14:27:28 kjcf05n00 mcfcli[3673891]: %3|1730752048.940|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:27:35 kjcf05n00 mcfcli[3673891]: %3|1730752055.895|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:27:52 kjcf05n02 chronyd[5105]: Selected source 172.16.2.1 Nov 4 14:27:59 kjcf05n00 mcfcli[3673891]: %3|1730752079.305|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 14:28:15 kjcf05n00 mcfcli[3673891]: %3|1730752095.729|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:28:29 kjcf05n00 mcfcli[3673891]: %3|1730752109.305|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:28:54 kjcf05n00 mcfcli[3673891]: %3|1730752134.774|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:28:59 kjcf05n00 mcfcli[3673891]: %3|1730752139.305|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 14:29:29 kjcf05n00 mcfcli[3673891]: %3|1730752169.306|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 14:29:29 kjcf05n00 mcfcli[3673891]: %3|1730752169.691|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:29:59 kjcf05n00 mcfcli[3673891]: %3|1730752199.306|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 14:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 14:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 14:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 14:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 14:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 14:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 14:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 14:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 14:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 14:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 14:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 14:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 14:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 14:30:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 14:30:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:30:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 14:30:09 kjcf05n00 mcfcli[3673891]: %3|1730752209.688|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:30:29 kjcf05n00 mcfcli[3673891]: %3|1730752229.306|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 14:30:33 kjcf05n00 python3.9[2194271]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 14:30:47 kjcf05n00 mcfcli[3673891]: %3|1730752247.407|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:30:59 kjcf05n00 mcfcli[3673891]: %3|1730752259.307|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:31:24 kjcf05n00 mcfcli[3673891]: %3|1730752284.675|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:31:29 kjcf05n00 mcfcli[3673891]: %3|1730752289.307|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:31:59 kjcf05n00 mcfcli[3673891]: %3|1730752319.308|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:32:00 kjcf05n00 mcfcli[3673891]: %3|1730752320.719|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:32:29 kjcf05n00 mcfcli[3673891]: %3|1730752349.308|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:32:39 kjcf05n00 mcfcli[3673891]: %3|1730752359.357|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:32:59 kjcf05n00 mcfcli[3673891]: %3|1730752379.308|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:33:19 kjcf05n00 mcfcli[3673891]: %3|1730752399.354|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T14:33:27.252952621-06:00 level=info msg="Completed cleanup jobs" duration=26.212295ms Nov 4 14:33:29 kjcf05n00 mcfcli[3673891]: %3|1730752409.308|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:33:56 kjcf05n00 mcfcli[3673891]: %3|1730752436.883|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:33:59 kjcf05n00 mcfcli[3673891]: %3|1730752439.309|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:34:29 kjcf05n00 mcfcli[3673891]: %3|1730752469.309|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 14:34:32 kjcf05n00 mcfcli[3673891]: %3|1730752472.803|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:34:59 kjcf05n00 mcfcli[3673891]: %3|1730752499.310|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 14:35:10 kjcf05n00 mcfcli[3673891]: %3|1730752510.613|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:35:29 kjcf05n00 mcfcli[3673891]: %3|1730752529.310|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:35:31 kjcf05n00 python3.9[2197074]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 14:35:45 kjcf05n00 mcfcli[3673891]: %3|1730752545.026|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:35:59 kjcf05n00 mcfcli[3673891]: %3|1730752559.310|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 14:36:23 kjcf05n00 mcfcli[3673891]: %3|1730752583.904|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:36:29 kjcf05n00 mcfcli[3673891]: %3|1730752589.310|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 14:36:59 kjcf05n00 mcfcli[3673891]: %3|1730752619.310|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:37:03 kjcf05n00 mcfcli[3673891]: %3|1730752623.901|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:37:29 kjcf05n00 mcfcli[3673891]: %3|1730752649.310|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:37:43 kjcf05n00 mcfcli[3673891]: %3|1730752663.203|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:37:59 kjcf05n00 mcfcli[3673891]: %3|1730752679.311|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:38:20 kjcf05n00 mcfcli[3673891]: %3|1730752700.747|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:38:29 kjcf05n00 mcfcli[3673891]: %3|1730752709.311|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:38:59 kjcf05n00 mcfcli[3673891]: %3|1730752739.311|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:39:00 kjcf05n00 mcfcli[3673891]: %3|1730752740.744|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:39:29 kjcf05n00 mcfcli[3673891]: %3|1730752769.312|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:39:40 kjcf05n00 mcfcli[3673891]: %3|1730752780.742|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:39:59 kjcf05n00 mcfcli[3673891]: %3|1730752799.312|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 14:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 14:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 14:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 14:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 14:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 14:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 14:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 14:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 14:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 14:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 14:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 14:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 14:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 14:40:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 14:40:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:40:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 14:40:19 kjcf05n00 mcfcli[3673891]: %3|1730752819.992|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:40:29 kjcf05n00 mcfcli[3673891]: %3|1730752829.312|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 14:40:34 kjcf05n00 python3.9[2199847]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 14:40:57 kjcf05n00 mcfcli[3673891]: %3|1730752857.318|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:40:59 kjcf05n00 mcfcli[3673891]: %3|1730752859.312|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 14:41:29 kjcf05n00 mcfcli[3673891]: %3|1730752889.313|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:41:36 kjcf05n00 mcfcli[3673891]: %3|1730752896.724|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:41:59 kjcf05n00 mcfcli[3673891]: %3|1730752919.313|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:42:12 kjcf05n00 mcfcli[3673891]: %3|1730752932.576|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:42:29 kjcf05n00 mcfcli[3673891]: %3|1730752949.315|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:42:50 kjcf05n00 mcfcli[3673891]: %3|1730752970.127|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:42:59 kjcf05n00 mcfcli[3673891]: %3|1730752979.315|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T14:43:27.269450096-06:00 level=info msg="Completed cleanup jobs" duration=42.352877ms Nov 4 14:43:29 kjcf05n00 mcfcli[3673891]: %3|1730753009.315|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:43:29 kjcf05n00 mcfcli[3673891]: %3|1730753009.533|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:43:44 kjcf05n00 su[2201766]: (to root) admin on pts/22 Nov 4 14:43:59 kjcf05n00 mcfcli[3673891]: %3|1730753039.315|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 14:44:07 kjcf05n00 mcfcli[3673891]: %3|1730753047.893|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:44:29 kjcf05n00 mcfcli[3673891]: %3|1730753069.315|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:44:47 kjcf05n00 mcfcli[3673891]: %3|1730753087.843|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:44:59 kjcf05n00 mcfcli[3673891]: %3|1730753099.316|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:45:24 kjcf05n00 mcfcli[3673891]: %3|1730753124.010|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:45:29 kjcf05n00 mcfcli[3673891]: %3|1730753129.316|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 14:45:32 kjcf05n00 python3.9[2202980]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 14:45:59 kjcf05n00 mcfcli[3673891]: %3|1730753159.316|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:46:01 kjcf05n00 mcfcli[3673891]: %3|1730753161.558|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:46:29 kjcf05n00 mcfcli[3673891]: %3|1730753189.317|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:46:40 kjcf05n00 mcfcli[3673891]: %3|1730753200.825|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:46:59 kjcf05n00 mcfcli[3673891]: %3|1730753219.317|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:47:20 kjcf05n00 mcfcli[3673891]: %3|1730753240.822|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:47:29 kjcf05n00 mcfcli[3673891]: %3|1730753249.317|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:47:59 kjcf05n00 mcfcli[3673891]: %3|1730753279.079|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:47:59 kjcf05n00 mcfcli[3673891]: %3|1730753279.818|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 14:48:29 kjcf05n00 mcfcli[3673891]: %3|1730753309.948|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 14:48:39 kjcf05n00 mcfcli[3673891]: %3|1730753319.076|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:49:00 kjcf05n00 mcfcli[3673891]: %3|1730753340.319|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 14:49:17 kjcf05n00 mcfcli[3673891]: %3|1730753357.461|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:49:30 kjcf05n00 mcfcli[3673891]: %3|1730753370.319|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:49:57 kjcf05n00 mcfcli[3673891]: %3|1730753397.458|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 14:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 14:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 14:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 14:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 14:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 14:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 14:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 14:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 14:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 14:50:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 14:50:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:50:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 14:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 14:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 14:50:00 kjcf05n00 mcfcli[3673891]: %3|1730753400.319|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 14:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 14:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 14:50:30 kjcf05n00 mcfcli[3673891]: %3|1730753430.319|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 14:50:32 kjcf05n00 python3.9[2205785]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 14:50:34 kjcf05n00 mcfcli[3673891]: %3|1730753434.597|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:51:00 kjcf05n00 mcfcli[3673891]: %3|1730753460.319|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:51:10 kjcf05n00 mcfcli[3673891]: %3|1730753470.960|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:51:30 kjcf05n00 mcfcli[3673891]: %3|1730753490.319|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:51:49 kjcf05n00 mcfcli[3673891]: %3|1730753509.029|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:52:00 kjcf05n00 mcfcli[3673891]: %3|1730753520.320|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:52:12 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T14:52:12-06:00] Checking for stale sessions... Nov 4 14:52:12 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T14:52:12-06:00] Checking for stale sessions... Nov 4 14:52:29 kjcf05n00 mcfcli[3673891]: %3|1730753549.026|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:52:30 kjcf05n00 mcfcli[3673891]: %3|1730753550.320|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:53:00 kjcf05n00 mcfcli[3673891]: %3|1730753580.320|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:53:07 kjcf05n00 mcfcli[3673891]: %3|1730753587.266|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T20:53:15.867479Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 14:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T20:53:15.867546Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.091ms Nov 4 14:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T14:53:27.254333964-06:00 level=info msg="Completed cleanup jobs" duration=27.92437ms Nov 4 14:53:30 kjcf05n00 mcfcli[3673891]: %3|1730753610.320|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:53:47 kjcf05n00 mcfcli[3673891]: %3|1730753627.037|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:54:00 kjcf05n00 mcfcli[3673891]: %3|1730753640.320|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:54:27 kjcf05n00 mcfcli[3673891]: %3|1730753667.034|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:54:30 kjcf05n00 mcfcli[3673891]: %3|1730753670.320|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:55:00 kjcf05n00 mcfcli[3673891]: %3|1730753700.322|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 14:55:06 kjcf05n00 mcfcli[3673891]: %3|1730753706.835|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:55:30 kjcf05n00 mcfcli[3673891]: %3|1730753730.322|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 14:55:32 kjcf05n00 python3.9[2208592]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 14:55:45 kjcf05n00 mcfcli[3673891]: %3|1730753745.380|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:56:00 kjcf05n00 mcfcli[3673891]: %3|1730753760.322|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:56:25 kjcf05n00 mcfcli[3673891]: %3|1730753785.377|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:56:30 kjcf05n00 mcfcli[3673891]: %3|1730753790.322|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:56:36 kjcf05n01 systemd[1]: Starting Cleanup of Temporary Directories... Nov 4 14:56:36 kjcf05n01 systemd-tmpfiles[3732434]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 14:56:36 kjcf05n01 systemd-tmpfiles[3732434]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 14:56:36 kjcf05n01 systemd-tmpfiles[3732434]: [/usr/lib/tmpfiles.d/powerman.conf:1] Line references path below legacy directory /var/run/, updating /var/run/powerman → /run/powerman; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 14:56:36 kjcf05n01 systemd-tmpfiles[3732434]: [/usr/lib/tmpfiles.d/puppetserver.conf:1] Line references path below legacy directory /var/run/, updating /var/run/puppetlabs/puppetserver → /run/puppetlabs/puppetserver; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 14:56:36 kjcf05n01 systemd-tmpfiles[3732434]: [/usr/lib/tmpfiles.d/rabbitmq-server.conf:1] Line references path below legacy directory /var/run/, updating /var/run/rabbitmq → /run/rabbitmq; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 14:56:36 kjcf05n01 systemd-tmpfiles[3732434]: [/usr/lib/tmpfiles.d/slapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/openldap → /run/openldap; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 14:56:36 kjcf05n01 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 4 14:56:36 kjcf05n01 systemd[1]: Started Cleanup of Temporary Directories. Nov 4 14:57:00 kjcf05n00 mcfcli[3673891]: %3|1730753820.322|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:57:05 kjcf05n00 mcfcli[3673891]: %3|1730753825.374|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:57:30 kjcf05n00 mcfcli[3673891]: %3|1730753850.322|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:57:45 kjcf05n00 mcfcli[3673891]: %3|1730753865.371|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:57:47 kjcf05n03 diskmonitor[17871]: leaving test state: 1 next state: 2 Nov 4 14:57:47 kjcf05n03 diskmonitor[17871]: lock req: no timeout Nov 4 14:57:47 kjcf05n03 diskmonitor[17871]: leaving test state: 2 next state: 4 Nov 4 14:58:00 kjcf05n00 mcfcli[3673891]: %3|1730753880.322|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 14:58:23 kjcf05n00 mcfcli[3673891]: %3|1730753903.713|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:58:30 kjcf05n00 mcfcli[3673891]: %3|1730753910.323|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 14:58:58 kjcf05n00 mcfcli[3673891]: %3|1730753938.701|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 14:59:00 kjcf05n00 mcfcli[3673891]: %3|1730753940.323|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 14:59:06 kjcf05n03 diskmonitor[17871]: lock acquired Nov 4 14:59:06 kjcf05n03 diskmonitor[17871]: leaving test state: 4 next state: 8 Nov 4 14:59:28 kjcf05n03 diskmonitor[17871]: Test selected disk: eui.345950304db010210025384500000004_S4YPNE0MB01021 Nov 4 14:59:28 kjcf05n03 diskmonitor[17871]: leaving test state: 8 next state: 20 Nov 4 14:59:28 kjcf05n03 diskmonitor[17871]: leaving test state: 20 next state: 40 Nov 4 14:59:28 kjcf05n03 diskmonitor[17871]: Test /dev/disk/by-id/nvme-eui.345950304db010210025384500000004_S4YPNE0MB01021, offset e280af0000 Nov 4 14:59:28 kjcf05n03 diskmonitor[17871]: leaving test state: 40 next state: 80 Nov 4 14:59:30 kjcf05n00 mcfcli[3673891]: %3|1730753970.323|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 14:59:35 kjcf05n00 mcfcli[3673891]: %3|1730753975.170|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 15:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 15:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 15:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 15:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 15:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 15:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 15:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 15:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 15:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 15:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 15:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 15:00:00 kjcf05n00 mcfcli[3673891]: %3|1730754000.323|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 15:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 15:00:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 15:00:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:00:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 15:00:10 kjcf05n00 mcfcli[3673891]: %3|1730754010.478|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:00:30 kjcf05n03 diskmonitor[17871]: leaving test state: 80 next state: 100 Nov 4 15:00:30 kjcf05n03 diskmonitor[17871]: lock release: time: Mon Nov 4 15:00:23 2024 Nov 4 15:00:30 kjcf05n03 diskmonitor[17871]: leaving test state: 100 next state: 1 Nov 4 15:00:30 kjcf05n00 mcfcli[3673891]: %3|1730754030.324|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 15:00:32 kjcf05n00 python3.9[2211442]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 15:00:48 kjcf05n00 mcfcli[3673891]: %3|1730754048.681|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:01:00 kjcf05n00 mcfcli[3673891]: %3|1730754060.325|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:01:03 kjcf05n01 dwd[7573]: nvme1n1 passed periodic SMART status check Nov 4 15:01:03 kjcf05n01 dwd[7573]: nvme0n1 passed periodic SMART status check Nov 4 15:01:09 kjcf05n00 dwd[5498]: nvme1n1 passed periodic SMART status check Nov 4 15:01:09 kjcf05n00 dwd[5498]: nvme0n1 passed periodic SMART status check Nov 4 15:01:17 kjcf05n01 dwd[7573]: nvme2n1 passed periodic SMART status check Nov 4 15:01:23 kjcf05n00 mcfcli[3673891]: %3|1730754083.588|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:01:30 kjcf05n00 mcfcli[3673891]: %3|1730754090.325|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:01:31 kjcf05n01 dwd[7573]: nvme4n1 passed periodic SMART status check Nov 4 15:01:37 kjcf05n00 dwd[5498]: nvme5n1 passed periodic SMART status check Nov 4 15:01:38 kjcf05n00 dwd[5498]: nvme6n1 passed periodic SMART status check Nov 4 15:02:00 kjcf05n00 mcfcli[3673891]: %3|1730754120.325|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:02:02 kjcf05n00 mcfcli[3673891]: %3|1730754122.239|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:02:30 kjcf05n00 mcfcli[3673891]: %3|1730754150.325|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:02:39 kjcf05n00 mcfcli[3673891]: %3|1730754159.411|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:03:00 kjcf05n00 mcfcli[3673891]: %3|1730754180.325|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 15:03:00 kjcf05n00 plex[12314]: IEC: info: 004001002: MRPD package generation started Nov 4 15:03:01 kjcf05n00 zabbix-server[2213125]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 15:03:01 kjcf05n00 drive_health_mrpd_tool[2213125]: No data found for drive health in enclosure USE26000024VS001 Nov 4 15:03:01 kjcf05n00 cscli[2213131]: [csinfo_handler.py:82 - csinfo() ] [INFO] CSM:Observers : Executing ['csinfo', '--yaml', '/tmp/tmpl3z05mg7'] command. Nov 4 15:03:01 kjcf05n00 drive_health_mrpd_tool[2213125]: No data found for drive health in enclosure USE26000024VS00F Nov 4 15:03:01 kjcf05n00 drive_health_mrpd_tool[2213125]: No data found for drive health in enclosure SGFGD20025060FF Nov 4 15:03:01 kjcf05n00 drive_health_mrpd_tool[2213125]: No data found for drive health in enclosure USE26000024VS00B Nov 4 15:03:01 kjcf05n00 drive_health_mrpd_tool[2213125]: No data found for drive health in enclosure USE26000024VS005 Nov 4 15:03:02 kjcf05n00 csman[2213168]: plex_external pubsub_rpc: INFO Adding channel close callback (pubsub_rpc.py:142) Nov 4 15:03:02 kjcf05n00 csman[2213168]: plex_external pubsub_rpc: INFO Binding plex_pubsub to cli_responses.2dd6a570-9af0-11ef-9a47-00093d0696a6 with plex.app.dcs.system.cli.show.reply (pubsub_rpc.py:212) Nov 4 15:03:02 kjcf05n00 csman[2213168]: plex_external pubsub_rpc: INFO Publishing message {'id': '2dd6a570-9af0-11ef-9a47-00093d0696a6', 'body': {}} to topic 'plex.app.dcs.system.cli.show' (pubsub_rpc.py:314) Nov 4 15:03:02 kjcf05n00 csman[2213168]: plex_external pubsub_rpc: INFO Received message: b'{"reply": "ACK", "id": "2dd6a570-9af0-11ef-9a47-00093d0696a6"}' (pubsub_rpc.py:268) Nov 4 15:03:02 kjcf05n00 csman[2213168]: plex_external pubsub_rpc: INFO Received message: b'{"reply": "System settings: \\n\\tSystem serial number: 10011838\\n\\tSystem identifier name: [not-set]\\n", "id": "2dd6a570-9af0-11ef-9a47-00093d0696a6", "terminator": true}' (pubsub_rpc.py:268) Nov 4 15:03:04 kjcf05n01 su[3735184]: (to nobody) root on none Nov 4 15:03:04 kjcf05n00 cscli[2213131]: [csinfo_handler.py:90 - csinfo() ] [INFO] CSM:Observers : done! Nov 4 15:03:04 kjcf05n00 plex[12314]: IEC: info: 004001003: MRPD package collection completed: {"total_collectors": 14, "passed": 12, "failed": 2} Nov 4 15:03:04 kjcf05n00 plex[12314]: IEC: info: 004001005: MPRD package generation completed with errors Nov 4 15:03:13 kjcf05n00 mcfcli[3673891]: %3|1730754193.957|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T15:03:27.253212758-06:00 level=info msg="Completed cleanup jobs" duration=26.302151ms Nov 4 15:03:30 kjcf05n00 mcfcli[3673891]: %3|1730754210.325|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 15:03:52 kjcf05n00 mcfcli[3673891]: %3|1730754232.803|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:04:00 kjcf05n00 mcfcli[3673891]: %3|1730754240.325|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 15:04:30 kjcf05n00 mcfcli[3673891]: %3|1730754270.326|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 15:04:31 kjcf05n00 mcfcli[3673891]: %3|1730754271.744|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:04:41 kjcf05n00 systemd[1]: Starting Cleanup of Temporary Directories... Nov 4 15:04:42 kjcf05n00 systemd-tmpfiles[2213918]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 15:04:42 kjcf05n00 systemd-tmpfiles[2213918]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 15:04:42 kjcf05n00 systemd-tmpfiles[2213918]: [/usr/lib/tmpfiles.d/powerman.conf:1] Line references path below legacy directory /var/run/, updating /var/run/powerman → /run/powerman; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 15:04:42 kjcf05n00 systemd-tmpfiles[2213918]: [/usr/lib/tmpfiles.d/puppetserver.conf:1] Line references path below legacy directory /var/run/, updating /var/run/puppetlabs/puppetserver → /run/puppetlabs/puppetserver; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 15:04:42 kjcf05n00 systemd-tmpfiles[2213918]: [/usr/lib/tmpfiles.d/rabbitmq-server.conf:1] Line references path below legacy directory /var/run/, updating /var/run/rabbitmq → /run/rabbitmq; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 15:04:42 kjcf05n00 systemd-tmpfiles[2213918]: [/usr/lib/tmpfiles.d/slapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/openldap → /run/openldap; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 15:04:42 kjcf05n00 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 4 15:04:42 kjcf05n00 systemd[1]: Started Cleanup of Temporary Directories. Nov 4 15:05:00 kjcf05n00 mcfcli[3673891]: %3|1730754300.326|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:05:11 kjcf05n00 mcfcli[3673891]: %3|1730754311.209|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:05:30 kjcf05n00 mcfcli[3673891]: %3|1730754330.326|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 15:05:37 kjcf05n00 python3.9[2214474]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 15:05:38 kjcf05n00 diskmonitor[2758297]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 15:05:48 kjcf05n00 mcfcli[3673891]: %3|1730754348.711|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:06:00 kjcf05n00 mcfcli[3673891]: %3|1730754360.326|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:06:25 kjcf05n00 mcfcli[3673891]: %3|1730754385.888|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:06:30 kjcf05n00 mcfcli[3673891]: %3|1730754390.326|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:07:00 kjcf05n00 mcfcli[3673891]: %3|1730754420.328|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:07:04 kjcf05n00 mcfcli[3673891]: %3|1730754424.922|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:07:22 kjcf05n01 diskmonitor[1331407]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 15:07:30 kjcf05n00 mcfcli[3673891]: %3|1730754450.328|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 15:07:43 kjcf05n00 mcfcli[3673891]: %3|1730754463.292|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:08:00 kjcf05n00 mcfcli[3673891]: %3|1730754480.328|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 15:08:23 kjcf05n00 mcfcli[3673891]: %3|1730754503.289|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:08:30 kjcf05n00 mcfcli[3673891]: %3|1730754510.328|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 15:09:00 kjcf05n00 mcfcli[3673891]: %3|1730754540.329|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 15:09:02 kjcf05n00 mcfcli[3673891]: %3|1730754542.501|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:09:17 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 15:09:17 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 15:09:17 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 15:09:24 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 15:09:30 kjcf05n00 mcfcli[3673891]: %3|1730754570.330|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:09:32 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 15:09:41 kjcf05n00 mcfcli[3673891]: %3|1730754581.423|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:09:53 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 15:09:53 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 15:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 15:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 15:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 15:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 15:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 15:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 15:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 15:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 15:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 15:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 15:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 15:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 15:10:00 kjcf05n00 mcfcli[3673891]: %3|1730754600.330|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 15:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 15:10:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 15:10:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:10:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 15:10:05 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 15:10:05 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 15:10:21 kjcf05n00 mcfcli[3673891]: %3|1730754621.052|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:10:30 kjcf05n00 mcfcli[3673891]: %3|1730754630.330|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 15:10:32 kjcf05n00 python3.9[2217240]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 15:10:46 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 15:10:46 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 15:10:46 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 15:10:59 kjcf05n00 mcfcli[3673891]: %3|1730754659.028|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:11:00 kjcf05n00 mcfcli[3673891]: %3|1730754660.330|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:11:13 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 15:11:13 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 15:11:13 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 15:11:30 kjcf05n00 mcfcli[3673891]: %3|1730754690.332|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:11:37 kjcf05n00 mcfcli[3673891]: %3|1730754697.199|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:11:51 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 15:11:51 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 15:11:51 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 15:12:00 kjcf05n00 mcfcli[3673891]: %3|1730754720.332|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:12:16 kjcf05n00 mcfcli[3673891]: %3|1730754736.240|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:12:30 kjcf05n00 mcfcli[3673891]: %3|1730754750.332|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:12:56 kjcf05n00 mcfcli[3673891]: %3|1730754776.237|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:13:00 kjcf05n00 mcfcli[3673891]: %3|1730754780.333|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T15:13:27.268897663-06:00 level=info msg="Completed cleanup jobs" duration=41.82497ms Nov 4 15:13:30 kjcf05n00 mcfcli[3673891]: %3|1730754810.333|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:13:34 kjcf05n00 mcfcli[3673891]: %3|1730754814.254|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:14:00 kjcf05n00 mcfcli[3673891]: %3|1730754840.333|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:14:14 kjcf05n00 mcfcli[3673891]: %3|1730754854.251|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:14:30 kjcf05n00 mcfcli[3673891]: %3|1730754870.333|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:14:54 kjcf05n00 mcfcli[3673891]: %3|1730754894.248|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:15:00 kjcf05n00 mcfcli[3673891]: %3|1730754900.334|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:15:30 kjcf05n00 mcfcli[3673891]: %3|1730754930.334|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 15:15:31 kjcf05n00 mcfcli[3673891]: %3|1730754931.827|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:15:32 kjcf05n00 python3.9[2220120]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 15:16:00 kjcf05n00 mcfcli[3673891]: %3|1730754960.334|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:16:09 kjcf05n00 mcfcli[3673891]: %3|1730754969.448|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:16:30 kjcf05n00 mcfcli[3673891]: %3|1730754990.334|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:16:47 kjcf05n00 mcfcli[3673891]: %3|1730755007.615|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:17:00 kjcf05n00 mcfcli[3673891]: %3|1730755020.334|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:17:24 kjcf05n00 mcfcli[3673891]: %3|1730755044.192|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:17:30 kjcf05n00 mcfcli[3673891]: %3|1730755050.334|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:17:51 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 4 15:18:00 kjcf05n00 mcfcli[3673891]: %3|1730755080.335|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:18:01 kjcf05n00 mcfcli[3673891]: %3|1730755081.908|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:18:30 kjcf05n00 mcfcli[3673891]: %3|1730755110.335|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:18:39 kjcf05n00 mcfcli[3673891]: %3|1730755119.134|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:19:00 kjcf05n00 mcfcli[3673891]: %3|1730755140.335|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:19:17 kjcf05n00 mcfcli[3673891]: %3|1730755157.665|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:19:30 kjcf05n00 mcfcli[3673891]: %3|1730755170.335|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:19:55 kjcf05n00 mcfcli[3673891]: %3|1730755195.510|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 15:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 15:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 15:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 15:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 15:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 15:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 15:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 15:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 15:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 15:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 15:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 15:20:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 15:20:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:20:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 15:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 15:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 15:20:00 kjcf05n00 mcfcli[3673891]: %3|1730755200.336|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:20:30 kjcf05n00 mcfcli[3673891]: %3|1730755230.338|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 15:20:32 kjcf05n00 python3.9[2223048]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 15:20:33 kjcf05n00 mcfcli[3673891]: %3|1730755233.961|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:21:00 kjcf05n00 mcfcli[3673891]: %3|1730755260.338|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 15:21:11 kjcf05n00 mcfcli[3673891]: %3|1730755271.736|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:21:30 kjcf05n00 mcfcli[3673891]: %3|1730755290.338|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:21:47 kjcf05n00 mcfcli[3673891]: %3|1730755307.731|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:22:00 kjcf05n00 mcfcli[3673891]: %3|1730755320.338|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:22:27 kjcf05n00 mcfcli[3673891]: %3|1730755347.261|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:22:30 kjcf05n00 mcfcli[3673891]: %3|1730755350.338|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:22:52 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 4 15:23:00 kjcf05n00 mcfcli[3673891]: %3|1730755380.338|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 15:23:06 kjcf05n00 mcfcli[3673891]: %3|1730755386.876|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T21:23:15.867520Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 15:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T21:23:15.867584Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.084ms Nov 4 15:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T15:23:27.253265303-06:00 level=info msg="Completed cleanup jobs" duration=26.16403ms Nov 4 15:23:30 kjcf05n00 mcfcli[3673891]: %3|1730755410.339|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 15:23:46 kjcf05n00 mcfcli[3673891]: %3|1730755426.873|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:24:00 kjcf05n00 mcfcli[3673891]: %3|1730755440.339|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 15:24:12 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 15:24:12 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 11 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007936 sec, idle for 1 hour(s)] Nov 4 15:24:24 kjcf05n00 mcfcli[3673891]: %3|1730755464.413|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:24:30 kjcf05n00 mcfcli[3673891]: %3|1730755470.339|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 15:25:00 kjcf05n00 mcfcli[3673891]: %3|1730755500.339|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 15:25:03 kjcf05n00 mcfcli[3673891]: %3|1730755503.803|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:25:30 kjcf05n00 mcfcli[3673891]: %3|1730755530.339|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:25:32 kjcf05n00 python3.9[2225889]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 15:25:42 kjcf05n00 mcfcli[3673891]: %3|1730755542.100|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:26:00 kjcf05n00 mcfcli[3673891]: %3|1730755560.340|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:26:20 kjcf05n00 mcfcli[3673891]: %3|1730755580.838|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:26:30 kjcf05n00 mcfcli[3673891]: %3|1730755590.340|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 15:26:54 kjcf05n00 mcfcli[3673891]: %3|1730755614.070|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:27:00 kjcf05n00 mcfcli[3673891]: %3|1730755620.341|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:27:30 kjcf05n00 mcfcli[3673891]: %3|1730755650.341|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:27:33 kjcf05n00 mcfcli[3673891]: %3|1730755653.006|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:28:00 kjcf05n00 mcfcli[3673891]: %3|1730755680.341|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 15:28:12 kjcf05n00 mcfcli[3673891]: %3|1730755692.606|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:28:30 kjcf05n00 mcfcli[3673891]: %3|1730755710.341|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 15:28:50 kjcf05n00 mcfcli[3673891]: %3|1730755730.016|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:29:00 kjcf05n00 mcfcli[3673891]: %3|1730755740.341|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 15:29:27 kjcf05n00 mcfcli[3673891]: %3|1730755767.102|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:29:30 kjcf05n00 mcfcli[3673891]: %3|1730755770.341|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 15:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 15:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 15:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 15:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 15:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 15:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 15:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 15:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 15:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 15:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 15:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 15:30:00 kjcf05n00 mcfcli[3673891]: %3|1730755800.342|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 15:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 15:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 15:30:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 15:30:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:30:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 15:30:03 kjcf05n00 mcfcli[3673891]: %3|1730755803.820|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:30:30 kjcf05n00 mcfcli[3673891]: %3|1730755830.342|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 15:30:32 kjcf05n00 python3.9[2228697]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 15:30:42 kjcf05n00 mcfcli[3673891]: %3|1730755842.377|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:31:00 kjcf05n00 mcfcli[3673891]: %3|1730755860.342|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 15:31:21 kjcf05n00 mcfcli[3673891]: %3|1730755881.479|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:31:30 kjcf05n00 mcfcli[3673891]: %3|1730755890.342|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:31:58 kjcf05n00 mcfcli[3673891]: %3|1730755918.145|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:32:00 kjcf05n00 mcfcli[3673891]: %3|1730755920.343|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:32:30 kjcf05n00 mcfcli[3673891]: %3|1730755950.343|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:32:37 kjcf05n00 mcfcli[3673891]: %3|1730755957.014|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:33:00 kjcf05n00 mcfcli[3673891]: %3|1730755980.344|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:33:15 kjcf05n00 mcfcli[3673891]: %3|1730755995.793|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T15:33:27.253946315-06:00 level=info msg="Completed cleanup jobs" duration=27.207253ms Nov 4 15:33:30 kjcf05n00 mcfcli[3673891]: %3|1730756010.344|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:33:55 kjcf05n00 mcfcli[3673891]: %3|1730756035.790|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:34:00 kjcf05n00 mcfcli[3673891]: %3|1730756040.344|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:34:30 kjcf05n00 mcfcli[3673891]: %3|1730756070.344|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 15:34:31 kjcf05n00 mcfcli[3673891]: %3|1730756071.509|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:35:00 kjcf05n00 mcfcli[3673891]: %3|1730756100.344|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:35:11 kjcf05n00 mcfcli[3673891]: %3|1730756111.149|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:35:30 kjcf05n00 mcfcli[3673891]: %3|1730756130.344|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:35:32 kjcf05n00 python3.9[2231487]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 15:35:50 kjcf05n00 mcfcli[3673891]: %3|1730756150.949|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:36:00 kjcf05n00 mcfcli[3673891]: %3|1730756160.344|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 15:36:30 kjcf05n00 mcfcli[3673891]: %3|1730756190.345|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 15:36:30 kjcf05n00 mcfcli[3673891]: %3|1730756190.732|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:37:00 kjcf05n00 mcfcli[3673891]: %3|1730756220.345|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:37:09 kjcf05n00 mcfcli[3673891]: %3|1730756229.343|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:37:30 kjcf05n00 mcfcli[3673891]: %3|1730756250.345|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 15:37:45 kjcf05n00 mcfcli[3673891]: %3|1730756265.735|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:38:00 kjcf05n00 mcfcli[3673891]: %3|1730756280.345|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:38:25 kjcf05n00 mcfcli[3673891]: %3|1730756305.732|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:38:30 kjcf05n00 mcfcli[3673891]: %3|1730756310.345|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:39:00 kjcf05n00 mcfcli[3673891]: %3|1730756340.345|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:39:05 kjcf05n00 mcfcli[3673891]: %3|1730756345.729|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:39:30 kjcf05n00 mcfcli[3673891]: %3|1730756370.346|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:39:44 kjcf05n00 mcfcli[3673891]: %3|1730756384.239|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 15:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 15:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 15:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 15:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 15:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 15:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 15:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 15:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 15:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 15:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 15:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 15:40:00 kjcf05n00 mcfcli[3673891]: %3|1730756400.346|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 15:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 15:40:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 15:40:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:40:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 15:40:19 kjcf05n00 mcfcli[3673891]: %3|1730756419.710|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:40:30 kjcf05n00 mcfcli[3673891]: %3|1730756430.346|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 15:40:37 kjcf05n00 python3.9[2234439]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 15:40:58 kjcf05n00 mcfcli[3673891]: %3|1730756458.167|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:41:00 kjcf05n00 mcfcli[3673891]: %3|1730756460.346|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:41:30 kjcf05n00 mcfcli[3673891]: %3|1730756490.346|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 15:41:36 kjcf05n00 mcfcli[3673891]: %3|1730756496.374|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:42:00 kjcf05n00 mcfcli[3673891]: %3|1730756520.348|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 15:42:14 kjcf05n00 mcfcli[3673891]: %3|1730756534.717|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:42:30 kjcf05n00 mcfcli[3673891]: %3|1730756550.348|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:42:53 kjcf05n00 mcfcli[3673891]: %3|1730756573.539|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:43:00 kjcf05n00 mcfcli[3673891]: %3|1730756580.348|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T15:43:27.246749571-06:00 level=info msg="Completed cleanup jobs" duration=20.315195ms Nov 4 15:43:30 kjcf05n00 mcfcli[3673891]: %3|1730756610.348|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:43:31 kjcf05n00 mcfcli[3673891]: %3|1730756611.466|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:44:00 kjcf05n00 mcfcli[3673891]: %3|1730756640.348|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:44:11 kjcf05n00 mcfcli[3673891]: %3|1730756651.463|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:44:30 kjcf05n00 mcfcli[3673891]: %3|1730756670.349|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:44:51 kjcf05n00 mcfcli[3673891]: %3|1730756691.460|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:45:00 kjcf05n00 mcfcli[3673891]: %3|1730756700.349|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:45:30 kjcf05n00 mcfcli[3673891]: %3|1730756730.349|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 15:45:31 kjcf05n00 mcfcli[3673891]: %3|1730756731.457|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:45:32 kjcf05n00 python3.9[2237231]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 15:46:00 kjcf05n00 mcfcli[3673891]: %3|1730756760.349|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:46:10 kjcf05n00 mcfcli[3673891]: %3|1730756770.587|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:46:30 kjcf05n00 mcfcli[3673891]: %3|1730756790.349|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:46:48 kjcf05n00 mcfcli[3673891]: %3|1730756808.348|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:47:00 kjcf05n00 mcfcli[3673891]: %3|1730756820.350|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:47:25 kjcf05n00 mcfcli[3673891]: %3|1730756845.137|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:47:30 kjcf05n00 mcfcli[3673891]: %3|1730756850.351|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:48:00 kjcf05n00 mcfcli[3673891]: %3|1730756880.351|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 15:48:02 kjcf05n04 diskmonitor[39342]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 15:48:02 kjcf05n00 mcfcli[3673891]: %3|1730756882.971|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:48:30 kjcf05n00 mcfcli[3673891]: %3|1730756910.351|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 15:48:42 kjcf05n00 mcfcli[3673891]: %3|1730756922.237|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:49:00 kjcf05n00 mcfcli[3673891]: %3|1730756940.351|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:49:22 kjcf05n00 mcfcli[3673891]: %3|1730756962.045|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:49:25 kjcf05n06 diskmonitor[19372]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 15:49:29 kjcf05n07 diskmonitor[19063]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 15:49:30 kjcf05n00 mcfcli[3673891]: %3|1730756970.351|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 15:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 15:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 15:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 15:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 15:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 15:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 15:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 15:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 15:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 15:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 15:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 15:50:00 kjcf05n00 mcfcli[3673891]: %3|1730757000.351|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 15:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 15:50:00 kjcf05n00 mcfcli[3673891]: %3|1730757000.408|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:50:01 kjcf05n05 diskmonitor[40540]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 15:50:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 15:50:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 15:50:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 15:50:30 kjcf05n00 mcfcli[3673891]: %3|1730757030.351|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:50:30 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T21:50:30.980939Z lvl=info msg="TSI log compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=8 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=start Nov 4 15:50:30 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T21:50:30.982536Z lvl=info msg="Log file compacted" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=8 op_name=tsi1_compact_log_file tsi1_log_file_id=1 elapsed=1ms bytes=14777 kb_per_sec=8740 Nov 4 15:50:30 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T21:50:30.982565Z lvl=info msg="TSI log compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=8 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=end op_elapsed=1.674ms Nov 4 15:50:32 kjcf05n00 python3.9[2240093]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 15:50:38 kjcf05n00 mcfcli[3673891]: %3|1730757038.351|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:51:00 kjcf05n00 mcfcli[3673891]: %3|1730757060.352|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 15:51:18 kjcf05n00 mcfcli[3673891]: %3|1730757077.999|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:51:30 kjcf05n00 mcfcli[3673891]: %3|1730757090.352|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 15:51:57 kjcf05n00 mcfcli[3673891]: %3|1730757117.996|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:52:00 kjcf05n00 mcfcli[3673891]: %3|1730757120.352|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 15:52:30 kjcf05n00 mcfcli[3673891]: %3|1730757150.352|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 15:52:36 kjcf05n00 mcfcli[3673891]: %3|1730757156.819|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:52:50 kjcf05n06 tune_prealloc_table[1787460]: Starting parse of /proc/fs/ldiskfs/md0/mb_groups Nov 4 15:52:51 kjcf05n06 tune_prealloc_table[1787463]: Tuning md0 prealloc_table with 1 2 4 8 16 32 64 128 256 512 1024 2048 4096 8192 Nov 4 15:52:58 kjcf05n04 tune_prealloc_table[1773946]: Starting parse of /proc/fs/ldiskfs/md0/mb_groups Nov 4 15:53:00 kjcf05n00 mcfcli[3673891]: %3|1730757180.354|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 15:53:03 kjcf05n04 tune_prealloc_table[1774799]: Tuning md0 prealloc_table with 1 2 4 8 16 32 64 128 256 512 1024 2048 4096 8192 Nov 4 15:53:05 kjcf05n07 tune_prealloc_table[1790486]: Starting parse of /proc/fs/ldiskfs/md1/mb_groups Nov 4 15:53:06 kjcf05n07 tune_prealloc_table[1790501]: Tuning md1 prealloc_table with 1 2 4 8 16 32 64 128 256 512 1024 2048 4096 8192 Nov 4 15:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T21:53:15.868056Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 15:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T21:53:15.868125Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.089ms Nov 4 15:53:16 kjcf05n00 mcfcli[3673891]: %3|1730757196.817|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:53:17 kjcf05n05 tune_prealloc_table[1969851]: Starting parse of /proc/fs/ldiskfs/md1/mb_groups Nov 4 15:53:22 kjcf05n05 tune_prealloc_table[1969929]: Tuning md1 prealloc_table with 1 2 4 8 16 32 64 128 256 512 1024 2048 4096 8192 Nov 4 15:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T15:53:27.255377722-06:00 level=info msg="Completed cleanup jobs" duration=28.725276ms Nov 4 15:53:30 kjcf05n00 mcfcli[3673891]: %3|1730757210.354|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 15:53:54 kjcf05n00 mcfcli[3673891]: %3|1730757234.341|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:54:00 kjcf05n00 mcfcli[3673891]: %3|1730757240.354|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 15:54:05 kjcf05n06 systemd[1]: Starting Cleanup of Temporary Directories... Nov 4 15:54:05 kjcf05n06 systemd-tmpfiles[1789500]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 15:54:05 kjcf05n06 systemd-tmpfiles[1789500]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 15:54:05 kjcf05n06 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 4 15:54:05 kjcf05n06 systemd[1]: Started Cleanup of Temporary Directories. Nov 4 15:54:05 kjcf05n04 systemd[1]: Starting Cleanup of Temporary Directories... Nov 4 15:54:05 kjcf05n04 systemd-tmpfiles[1776408]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 15:54:05 kjcf05n04 systemd-tmpfiles[1776408]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 15:54:05 kjcf05n04 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 4 15:54:05 kjcf05n04 systemd[1]: Started Cleanup of Temporary Directories. Nov 4 15:54:07 kjcf05n05 systemd[1]: Starting Cleanup of Temporary Directories... Nov 4 15:54:07 kjcf05n05 systemd-tmpfiles[1971050]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 15:54:07 kjcf05n05 systemd-tmpfiles[1971050]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 15:54:07 kjcf05n05 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 4 15:54:07 kjcf05n05 systemd[1]: Started Cleanup of Temporary Directories. Nov 4 15:54:07 kjcf05n07 systemd[1]: Starting Cleanup of Temporary Directories... Nov 4 15:54:07 kjcf05n07 systemd-tmpfiles[1792212]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 15:54:07 kjcf05n07 systemd-tmpfiles[1792212]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 15:54:07 kjcf05n07 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 4 15:54:07 kjcf05n07 systemd[1]: Started Cleanup of Temporary Directories. Nov 4 15:54:30 kjcf05n00 mcfcli[3673891]: %3|1730757270.354|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 15:54:32 kjcf05n00 mcfcli[3673891]: %3|1730757272.310|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:55:00 kjcf05n00 mcfcli[3673891]: %3|1730757300.354|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 15:55:12 kjcf05n00 mcfcli[3673891]: %3|1730757312.307|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:55:30 kjcf05n00 mcfcli[3673891]: %3|1730757330.355|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:55:33 kjcf05n00 python3.9[2242992]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 15:55:50 kjcf05n00 mcfcli[3673891]: %3|1730757350.213|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:55:56 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 15:55:56 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 15:55:56 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 15:55:56 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 15:55:56 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 15:55:56 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 15:55:56 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 15:55:56 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 15:55:56 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 15:55:56 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 15:55:57 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 15:55:57 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 15:55:57 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 15:55:57 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 15:55:57 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 15:55:57 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:55:57 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:55:57 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:55:57 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:55:57 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:55:57 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:55:58 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:55:58 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:55:58 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:55:58 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:55:58 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:55:58 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:55:59 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:55:59 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:55:59 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:55:59 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:55:59 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:55:59 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:55:59 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:55:59 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:55:59 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:55:59 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:55:59 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:55:59 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:00 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:00 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:00 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:00 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:00 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:00 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:00 kjcf05n00 mcfcli[3673891]: %3|1730757360.355|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:56:01 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:01 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:01 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:02 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:02 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:02 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:02 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:02 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:02 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:02 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:02 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:02 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:03 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:03 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:03 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:03 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:03 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:03 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:04 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:04 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:04 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:04 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:04 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:04 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:05 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:05 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:05 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:05 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:05 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:05 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:06 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:06 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:06 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:07 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 15:56:07 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 15:56:07 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 15:56:07 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 15:56:07 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 15:56:07 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 15:56:08 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 15:56:08 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 15:56:08 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 15:56:08 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 15:56:08 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 15:56:08 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 15:56:08 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 15:56:08 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 15:56:08 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 15:56:08 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:08 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:08 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:08 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:08 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:08 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:08 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:08 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:08 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:08 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:08 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:08 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:09 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:09 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:09 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:09 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:09 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:09 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:09 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:09 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:09 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:09 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:09 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:09 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:09 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:09 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:09 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:10 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:10 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:10 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:10 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:10 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:10 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:10 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:10 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:10 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:10 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:10 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:10 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:11 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:11 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:11 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:11 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:11 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:11 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:12 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:12 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:12 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:13 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:13 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:13 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:13 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:13 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:13 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:14 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:14 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:14 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:14 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:14 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:14 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:15 kjcf05n01 systemd[1]: clean_kdump.service: Start request repeated too quickly. Nov 4 15:56:15 kjcf05n01 systemd[1]: clean_kdump.service: Failed with result 'start-limit-hit'. Nov 4 15:56:15 kjcf05n01 systemd[1]: Failed to start "vmcore cleanup". Nov 4 15:56:30 kjcf05n00 mcfcli[3673891]: %3|1730757390.210|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:56:30 kjcf05n00 mcfcli[3673891]: %3|1730757390.356|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:57:00 kjcf05n00 mcfcli[3673891]: %3|1730757420.356|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 15:57:06 kjcf05n00 mcfcli[3673891]: %3|1730757426.395|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:57:30 kjcf05n00 mcfcli[3673891]: %3|1730757450.356|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 15:57:42 kjcf05n00 mcfcli[3673891]: %3|1730757462.647|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:58:00 kjcf05n00 mcfcli[3673891]: %3|1730757480.357|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 15:58:04 kjcf05n06 root[1796523]: IEC: 007013001: Trigger kdump on STONITH {"method": "1"} Nov 4 15:58:04 kjcf05n04 root[1782662]: IEC: 007013001: Trigger kdump on STONITH {"method": "1"} Nov 4 15:58:04 kjcf05n03 root[2092587]: IEC: 007013001: Trigger kdump on STONITH {"method": "1"} Nov 4 15:58:21 kjcf05n00 mcfcli[3673891]: %3|1730757501.717|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:58:30 kjcf05n00 mcfcli[3673891]: %3|1730757510.357|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-41 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-5 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-65 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-98 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-10 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-25 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-49 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-17 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-73 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-85 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-60 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-97 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-36 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-61 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-4 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-82 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-0 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-42 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-11 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-52 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-24 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-53 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-13 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-22 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-46 passed periodic SMART status check Nov 4 15:58:33 kjcf05n04 dwd[10437]: dm-12 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-89 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-71 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-94 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-48 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-72 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-35 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-76 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-29 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-95 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-83 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-77 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-59 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-84 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-23 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-90 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-66 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-47 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-1 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-70 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-18 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-28 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-34 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-37 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-96 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-99 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-100 passed periodic SMART status check Nov 4 15:58:34 kjcf05n04 dwd[10437]: dm-58 passed periodic SMART status check Nov 4 15:58:36 kjcf05n05 dwd[10696]: dm-55 passed periodic SMART status check Nov 4 15:58:36 kjcf05n05 dwd[10696]: dm-67 passed periodic SMART status check Nov 4 15:58:36 kjcf05n05 dwd[10696]: dm-62 passed periodic SMART status check Nov 4 15:58:36 kjcf05n05 dwd[10696]: dm-30 passed periodic SMART status check Nov 4 15:58:36 kjcf05n05 dwd[10696]: dm-6 passed periodic SMART status check Nov 4 15:58:36 kjcf05n05 dwd[10696]: dm-88 passed periodic SMART status check Nov 4 15:58:36 kjcf05n05 dwd[10696]: dm-44 passed periodic SMART status check Nov 4 15:58:36 kjcf05n05 dwd[10696]: dm-104 passed periodic SMART status check Nov 4 15:58:36 kjcf05n05 dwd[10696]: dm-50 passed periodic SMART status check Nov 4 15:58:36 kjcf05n05 dwd[10696]: dm-75 passed periodic SMART status check Nov 4 15:58:36 kjcf05n05 dwd[10696]: dm-68 passed periodic SMART status check Nov 4 15:58:36 kjcf05n05 dwd[10696]: dm-51 passed periodic SMART status check Nov 4 15:58:36 kjcf05n05 dwd[10696]: dm-26 passed periodic SMART status check Nov 4 15:58:36 kjcf05n05 dwd[10696]: dm-2 passed periodic SMART status check Nov 4 15:58:36 kjcf05n05 dwd[10696]: dm-27 passed periodic SMART status check Nov 4 15:58:36 kjcf05n05 dwd[10696]: dm-14 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-54 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-93 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-15 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-20 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-8 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-57 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-87 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-69 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-80 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-63 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-45 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-39 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-3 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-91 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-74 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-64 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-79 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-101 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-40 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-21 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-33 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-31 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-86 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-38 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-19 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-16 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-56 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-43 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-7 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-103 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-32 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-78 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-9 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-102 passed periodic SMART status check Nov 4 15:58:37 kjcf05n05 dwd[10696]: dm-105 passed periodic SMART status check Nov 4 15:58:57 kjcf05n00 mcfcli[3673891]: %3|1730757537.039|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:59:00 kjcf05n00 mcfcli[3673891]: %3|1730757540.357|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:59:30 kjcf05n00 mcfcli[3673891]: %3|1730757570.357|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 15:59:37 kjcf05n00 mcfcli[3673891]: %3|1730757577.036|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 15:59:50 kjcf05n05 dwd[10696]: nvme2n1 passed periodic SMART status check Nov 4 16:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 16:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 16:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 16:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 16:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 16:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 16:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 16:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 16:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 16:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 16:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 16:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 16:00:00 kjcf05n00 mcfcli[3673891]: %3|1730757600.357|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 16:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 16:00:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 16:00:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:00:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 16:00:17 kjcf05n00 mcfcli[3673891]: %3|1730757617.033|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:00:28 kjcf05n04 dwd[10437]: nvme3n1 passed periodic SMART status check Nov 4 16:00:30 kjcf05n00 mcfcli[3673891]: %3|1730757630.358|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:00:30 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T22:00:30.985674Z lvl=info msg="TSI log compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=7 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=start Nov 4 16:00:30 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T22:00:30.987174Z lvl=info msg="Log file compacted" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=7 op_name=tsi1_compact_log_file tsi1_log_file_id=1 elapsed=1ms bytes=13931 kb_per_sec=8456 Nov 4 16:00:30 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T22:00:30.987207Z lvl=info msg="TSI log compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=7 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=end op_elapsed=1.642ms Nov 4 16:00:32 kjcf05n04 dwd[10437]: nvme2n1 passed periodic SMART status check Nov 4 16:00:32 kjcf05n00 python3.9[2245885]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 16:00:37 kjcf05n05 dwd[10696]: dm-92 passed periodic SMART status check Nov 4 16:00:37 kjcf05n05 dwd[10696]: dm-81 passed periodic SMART status check Nov 4 16:00:47 kjcf05n07 dwd[5489]: nvme15n1 passed periodic SMART status check Nov 4 16:00:47 kjcf05n07 dwd[5489]: nvme11n1 passed periodic SMART status check Nov 4 16:00:47 kjcf05n07 dwd[5489]: nvme13n1 passed periodic SMART status check Nov 4 16:00:47 kjcf05n07 dwd[5489]: nvme16n1 passed periodic SMART status check Nov 4 16:00:47 kjcf05n07 dwd[5489]: nvme5n1 passed periodic SMART status check Nov 4 16:00:52 kjcf05n07 dwd[5489]: nvme6n1 passed periodic SMART status check Nov 4 16:00:52 kjcf05n07 dwd[5489]: nvme22n1 passed periodic SMART status check Nov 4 16:00:52 kjcf05n07 dwd[5489]: nvme12n1 passed periodic SMART status check Nov 4 16:00:54 kjcf05n05 dwd[10696]: nvme3n1 passed periodic SMART status check Nov 4 16:00:55 kjcf05n00 mcfcli[3673891]: %3|1730757655.327|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:00:58 kjcf05n07 dwd[5489]: nvme7n1 passed periodic SMART status check Nov 4 16:00:58 kjcf05n07 dwd[5489]: nvme14n1 passed periodic SMART status check Nov 4 16:00:58 kjcf05n06 dwd[5504]: nvme24n1 passed periodic SMART status check Nov 4 16:00:58 kjcf05n06 dwd[5504]: nvme18n1 passed periodic SMART status check Nov 4 16:00:58 kjcf05n06 dwd[5504]: nvme8n1 passed periodic SMART status check Nov 4 16:00:58 kjcf05n06 dwd[5504]: nvme19n1 passed periodic SMART status check Nov 4 16:00:58 kjcf05n06 dwd[5504]: nvme2n1 passed periodic SMART status check Nov 4 16:01:00 kjcf05n00 mcfcli[3673891]: %3|1730757660.359|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 16:01:05 kjcf05n07 dwd[5489]: nvme21n1 passed periodic SMART status check Nov 4 16:01:05 kjcf05n07 dwd[5489]: nvme20n1 passed periodic SMART status check Nov 4 16:01:06 kjcf05n06 dwd[5504]: nvme23n1 passed periodic SMART status check Nov 4 16:01:06 kjcf05n06 dwd[5504]: nvme17n1 passed periodic SMART status check Nov 4 16:01:06 kjcf05n06 dwd[5504]: nvme25n1 passed periodic SMART status check Nov 4 16:01:06 kjcf05n06 dwd[5504]: nvme10n1 passed periodic SMART status check Nov 4 16:01:06 kjcf05n06 dwd[5504]: nvme4n1 passed periodic SMART status check Nov 4 16:01:06 kjcf05n06 dwd[5504]: nvme9n1 passed periodic SMART status check Nov 4 16:01:12 kjcf05n06 dwd[5504]: nvme3n1 passed periodic SMART status check Nov 4 16:01:30 kjcf05n00 mcfcli[3673891]: %3|1730757690.359|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 16:01:35 kjcf05n00 mcfcli[3673891]: %3|1730757695.038|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:02:00 kjcf05n00 mcfcli[3673891]: %3|1730757720.359|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 16:02:10 kjcf05n00 mcfcli[3673891]: %3|1730757730.167|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:02:30 kjcf05n00 mcfcli[3673891]: %3|1730757750.858|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 16:02:50 kjcf05n00 mcfcli[3673891]: %3|1730757770.164|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:03:00 kjcf05n00 mcfcli[3673891]: %3|1730757780.859|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T16:03:27.253597216-06:00 level=info msg="Completed cleanup jobs" duration=27.165624ms Nov 4 16:03:28 kjcf05n00 mcfcli[3673891]: %3|1730757808.280|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:03:30 kjcf05n00 mcfcli[3673891]: %3|1730757810.859|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:04:00 kjcf05n00 mcfcli[3673891]: %3|1730757840.859|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:04:08 kjcf05n00 mcfcli[3673891]: %3|1730757848.277|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:04:30 kjcf05n00 mcfcli[3673891]: %3|1730757870.860|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:04:43 kjcf05n00 mcfcli[3673891]: %3|1730757883.035|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:05:00 kjcf05n00 mcfcli[3673891]: %3|1730757900.860|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:05:21 kjcf05n00 mcfcli[3673891]: %3|1730757921.662|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:05:30 kjcf05n00 mcfcli[3673891]: %3|1730757930.860|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 16:05:32 kjcf05n00 python3.9[2248723]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 16:05:56 kjcf05n00 mcfcli[3673891]: %3|1730757956.614|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:06:00 kjcf05n00 mcfcli[3673891]: %3|1730757960.861|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:06:30 kjcf05n00 mcfcli[3673891]: %3|1730757990.861|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:06:36 kjcf05n00 mcfcli[3673891]: %3|1730757996.611|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:07:00 kjcf05n00 mcfcli[3673891]: %3|1730758020.861|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 16:07:15 kjcf05n00 mcfcli[3673891]: %3|1730758035.272|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:07:30 kjcf05n00 mcfcli[3673891]: %3|1730758050.861|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:07:55 kjcf05n00 mcfcli[3673891]: %3|1730758075.269|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:08:00 kjcf05n00 mcfcli[3673891]: %3|1730758080.862|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:08:07 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 16:08:18 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 16:08:18 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 16:08:18 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 16:08:30 kjcf05n00 mcfcli[3673891]: %3|1730758110.863|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:08:33 kjcf05n00 mcfcli[3673891]: %3|1730758113.168|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:08:35 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 16:08:35 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 16:09:00 kjcf05n00 mcfcli[3673891]: %3|1730758140.975|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 16:09:08 kjcf05n00 mcfcli[3673891]: %3|1730758148.893|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:09:30 kjcf05n00 mcfcli[3673891]: %3|1730758170.976|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 16:09:46 kjcf05n00 mcfcli[3673891]: %3|1730758186.710|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 16:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 16:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 16:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 16:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 16:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 16:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 16:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 16:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 16:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 16:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 16:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 16:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 16:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 16:10:00 kjcf05n00 mcfcli[3673891]: %3|1730758200.976|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 16:10:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 16:10:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:10:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 16:10:06 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 16:10:06 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 16:10:06 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 16:10:25 kjcf05n00 mcfcli[3673891]: %3|1730758225.437|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:10:30 kjcf05n00 mcfcli[3673891]: %3|1730758230.976|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 16:10:33 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 16:10:33 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 16:10:33 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 16:10:38 kjcf05n00 python3.9[2251490]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 16:11:00 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 16:11:00 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 16:11:00 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 16:11:00 kjcf05n00 mcfcli[3673891]: %3|1730758260.976|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 16:11:01 kjcf05n00 mcfcli[3673891]: %3|1730758261.811|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:11:30 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 16:11:30 kjcf05n00 mcfcli[3673891]: %3|1730758290.977|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 16:11:39 kjcf05n00 mcfcli[3673891]: %3|1730758299.444|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:11:57 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 16:11:57 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 16:12:00 kjcf05n00 mcfcli[3673891]: %3|1730758320.978|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:12:19 kjcf05n00 mcfcli[3673891]: %3|1730758339.441|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:12:30 kjcf05n00 mcfcli[3673891]: %3|1730758350.978|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:12:59 kjcf05n00 mcfcli[3673891]: %3|1730758379.438|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:13:01 kjcf05n00 mcfcli[3673891]: %3|1730758381.366|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 16:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T16:13:27.268115102-06:00 level=info msg="Completed cleanup jobs" duration=41.599364ms Nov 4 16:13:31 kjcf05n00 mcfcli[3673891]: %3|1730758411.366|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:13:39 kjcf05n00 mcfcli[3673891]: %3|1730758419.088|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:14:01 kjcf05n00 mcfcli[3673891]: %3|1730758441.366|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:14:16 kjcf05n00 mcfcli[3673891]: %3|1730758456.122|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:14:31 kjcf05n00 mcfcli[3673891]: %3|1730758471.867|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 16:14:56 kjcf05n00 mcfcli[3673891]: %3|1730758496.119|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:15:01 kjcf05n00 mcfcli[3673891]: %3|1730758501.978|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 16:15:31 kjcf05n00 mcfcli[3673891]: %3|1730758531.979|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 16:15:33 kjcf05n00 python3.9[2254477]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 16:15:33 kjcf05n00 mcfcli[3673891]: %3|1730758533.981|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:16:01 kjcf05n00 mcfcli[3673891]: %3|1730758561.979|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 16:16:13 kjcf05n00 mcfcli[3673891]: %3|1730758573.825|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:16:31 kjcf05n00 mcfcli[3673891]: %3|1730758591.980|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 16:16:50 kjcf05n00 mcfcli[3673891]: %3|1730758610.723|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:17:01 kjcf05n00 mcfcli[3673891]: %3|1730758621.980|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 16:17:26 kjcf05n00 mcfcli[3673891]: %3|1730758646.558|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:17:31 kjcf05n00 mcfcli[3673891]: %3|1730758651.980|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:18:02 kjcf05n00 mcfcli[3673891]: %3|1730758682.343|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:18:02 kjcf05n00 mcfcli[3673891]: %3|1730758682.343|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 16:18:32 kjcf05n00 mcfcli[3673891]: %3|1730758712.868|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 16:18:42 kjcf05n00 mcfcli[3673891]: %3|1730758722.016|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:19:02 kjcf05n00 mcfcli[3673891]: %3|1730758742.869|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 16:19:22 kjcf05n00 mcfcli[3673891]: %3|1730758762.013|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:19:32 kjcf05n00 mcfcli[3673891]: %3|1730758772.869|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 16:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 16:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 16:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 16:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 16:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 16:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 16:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 16:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 16:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 16:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 16:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 16:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 16:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 16:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 16:20:01 kjcf05n00 mcfcli[3673891]: %3|1730758801.483|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:20:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 16:20:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:20:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 16:20:02 kjcf05n00 mcfcli[3673891]: %3|1730758802.869|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 16:20:32 kjcf05n00 mcfcli[3673891]: %3|1730758832.870|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 16:20:33 kjcf05n00 python3.9[2257214]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 16:20:41 kjcf05n00 mcfcli[3673891]: %3|1730758841.480|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:21:02 kjcf05n00 mcfcli[3673891]: %3|1730758862.870|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:21:21 kjcf05n00 mcfcli[3673891]: %3|1730758881.477|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:21:32 kjcf05n00 mcfcli[3673891]: %3|1730758892.870|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:22:00 kjcf05n00 mcfcli[3673891]: %3|1730758920.164|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:22:02 kjcf05n00 mcfcli[3673891]: %3|1730758922.871|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:22:32 kjcf05n00 mcfcli[3673891]: %3|1730758952.871|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:22:40 kjcf05n00 mcfcli[3673891]: %3|1730758960.073|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:23:02 kjcf05n00 mcfcli[3673891]: %3|1730758982.871|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 16:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T22:23:15.867829Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 16:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T22:23:15.867900Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.090ms Nov 4 16:23:18 kjcf05n00 mcfcli[3673891]: %3|1730758998.914|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T16:23:27.268845071-06:00 level=info msg="Completed cleanup jobs" duration=42.440902ms Nov 4 16:23:32 kjcf05n00 mcfcli[3673891]: %3|1730759012.871|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 16:23:58 kjcf05n00 mcfcli[3673891]: %3|1730759038.655|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:24:02 kjcf05n00 mcfcli[3673891]: %3|1730759042.873|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:24:12 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 16:24:12 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 11 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007239 sec, idle for 1 hour(s)] Nov 4 16:24:32 kjcf05n00 mcfcli[3673891]: %3|1730759072.982|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 16:24:35 kjcf05n00 mcfcli[3673891]: %3|1730759075.516|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:25:02 kjcf05n00 mcfcli[3673891]: %3|1730759102.982|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:25:13 kjcf05n00 mcfcli[3673891]: %3|1730759113.548|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:25:32 kjcf05n00 mcfcli[3673891]: %3|1730759132.982|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 16:25:40 kjcf05n00 python3.9[2260071]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 16:25:50 kjcf05n00 mcfcli[3673891]: %3|1730759150.613|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:26:02 kjcf05n00 mcfcli[3673891]: %3|1730759162.983|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:26:27 kjcf05n00 mcfcli[3673891]: %3|1730759187.294|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:26:32 kjcf05n00 mcfcli[3673891]: %3|1730759192.983|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:27:01 kjcf05n00 mcfcli[3673891]: %3|1730759221.739|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:27:02 kjcf05n00 mcfcli[3673891]: %3|1730759222.983|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 16:27:32 kjcf05n00 mcfcli[3673891]: %3|1730759252.983|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:27:36 kjcf05n00 mcfcli[3673891]: %3|1730759256.852|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:28:02 kjcf05n00 mcfcli[3673891]: %3|1730759282.984|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 16:28:14 kjcf05n00 mcfcli[3673891]: %3|1730759294.961|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:28:32 kjcf05n00 mcfcli[3673891]: %3|1730759312.984|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 16:28:51 kjcf05n00 mcfcli[3673891]: %3|1730759331.025|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:29:03 kjcf05n00 mcfcli[3673891]: %3|1730759343.374|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 16:29:31 kjcf05n00 mcfcli[3673891]: %3|1730759371.022|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:29:33 kjcf05n00 mcfcli[3673891]: %3|1730759373.374|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 16:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 16:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 16:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 16:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 16:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 16:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 16:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 16:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 16:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 16:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 16:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 16:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 16:30:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 16:30:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:30:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 16:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 16:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 16:30:03 kjcf05n00 mcfcli[3673891]: %3|1730759403.375|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 16:30:07 kjcf05n00 mcfcli[3673891]: %3|1730759407.987|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:30:33 kjcf05n00 mcfcli[3673891]: %3|1730759433.375|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 16:30:34 kjcf05n00 python3.9[2262942]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 16:30:45 kjcf05n00 mcfcli[3673891]: %3|1730759445.590|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:31:03 kjcf05n00 mcfcli[3673891]: %3|1730759463.375|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 16:31:23 kjcf05n00 mcfcli[3673891]: %3|1730759483.957|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:31:33 kjcf05n00 mcfcli[3673891]: %3|1730759493.375|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 16:32:00 kjcf05n00 mcfcli[3673891]: %3|1730759520.718|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:32:03 kjcf05n00 mcfcli[3673891]: %3|1730759523.375|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 16:32:33 kjcf05n00 mcfcli[3673891]: %3|1730759553.376|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:32:40 kjcf05n00 mcfcli[3673891]: %3|1730759560.715|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:33:03 kjcf05n00 mcfcli[3673891]: %3|1730759583.376|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:33:20 kjcf05n00 mcfcli[3673891]: %3|1730759600.712|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T16:33:27.252647448-06:00 level=info msg="Completed cleanup jobs" duration=26.196319ms Nov 4 16:33:33 kjcf05n00 mcfcli[3673891]: %3|1730759613.376|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:33:58 kjcf05n00 mcfcli[3673891]: %3|1730759638.013|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:34:03 kjcf05n06 chronyd[5469]: Selected source 172.16.2.1 Nov 4 16:34:03 kjcf05n00 mcfcli[3673891]: %3|1730759643.377|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 16:34:33 kjcf05n00 mcfcli[3673891]: %3|1730759673.377|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 16:34:36 kjcf05n00 mcfcli[3673891]: %3|1730759676.422|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:35:03 kjcf05n00 mcfcli[3673891]: %3|1730759703.378|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 16:35:15 kjcf05n00 mcfcli[3673891]: %3|1730759715.491|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:35:33 kjcf05n00 python3.9[2265901]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 16:35:33 kjcf05n00 mcfcli[3673891]: %3|1730759733.378|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 16:35:53 kjcf05n00 mcfcli[3673891]: %3|1730759753.607|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:36:03 kjcf05n00 mcfcli[3673891]: %3|1730759763.378|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:36:31 kjcf05n00 mcfcli[3673891]: %3|1730759791.172|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:36:33 kjcf05n00 mcfcli[3673891]: %3|1730759793.378|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 16:37:03 kjcf05n00 mcfcli[3673891]: %3|1730759823.378|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:37:11 kjcf05n00 mcfcli[3673891]: %3|1730759831.169|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:37:33 kjcf05n00 mcfcli[3673891]: %3|1730759853.379|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:37:51 kjcf05n00 mcfcli[3673891]: %3|1730759871.167|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:38:03 kjcf05n00 mcfcli[3673891]: %3|1730759883.379|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 16:38:29 kjcf05n00 mcfcli[3673891]: %3|1730759909.839|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:38:33 kjcf05n00 mcfcli[3673891]: %3|1730759913.379|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 16:39:03 kjcf05n00 mcfcli[3673891]: %3|1730759943.380|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 16:39:09 kjcf05n00 mcfcli[3673891]: %3|1730759949.692|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:39:33 kjcf05n00 mcfcli[3673891]: %3|1730759973.381|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:39:49 kjcf05n00 mcfcli[3673891]: %3|1730759989.444|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 16:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 16:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 16:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 16:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 16:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 16:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 16:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 16:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 16:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 16:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 16:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 16:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 16:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 16:40:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 16:40:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:40:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 16:40:03 kjcf05n00 mcfcli[3673891]: %3|1730760003.381|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:40:29 kjcf05n00 mcfcli[3673891]: %3|1730760029.441|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:40:33 kjcf05n00 python3.9[2268616]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 16:40:33 kjcf05n00 mcfcli[3673891]: %3|1730760033.381|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 16:41:03 kjcf05n00 mcfcli[3673891]: %3|1730760063.381|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 16:41:06 kjcf05n00 mcfcli[3673891]: %3|1730760066.284|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:41:33 kjcf05n00 mcfcli[3673891]: %3|1730760093.381|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:41:43 kjcf05n00 mcfcli[3673891]: %3|1730760103.486|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:42:03 kjcf05n00 mcfcli[3673891]: %3|1730760123.381|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:42:23 kjcf05n00 mcfcli[3673891]: %3|1730760143.482|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:42:33 kjcf05n00 mcfcli[3673891]: %3|1730760153.382|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 16:43:01 kjcf05n00 mcfcli[3673891]: %3|1730760181.342|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:43:03 kjcf05n00 mcfcli[3673891]: %3|1730760183.382|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 16:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T16:43:27.268195947-06:00 level=info msg="Completed cleanup jobs" duration=41.315681ms Nov 4 16:43:33 kjcf05n00 mcfcli[3673891]: %3|1730760213.382|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 16:43:38 kjcf05n00 mcfcli[3673891]: %3|1730760218.906|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:44:03 kjcf05n00 mcfcli[3673891]: %3|1730760243.382|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 16:44:14 kjcf05n00 mcfcli[3673891]: %3|1730760254.314|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:44:33 kjcf05n00 mcfcli[3673891]: %3|1730760273.383|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:44:51 kjcf05n00 mcfcli[3673891]: %3|1730760291.505|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:45:03 kjcf05n00 mcfcli[3673891]: %3|1730760303.383|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:45:30 kjcf05n00 mcfcli[3673891]: %3|1730760330.518|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:45:33 kjcf05n00 mcfcli[3673891]: %3|1730760333.384|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 16:45:33 kjcf05n00 python3.9[2271512]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 16:46:03 kjcf05n00 mcfcli[3673891]: %3|1730760363.384|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:46:06 kjcf05n00 mcfcli[3673891]: %3|1730760366.894|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:46:33 kjcf05n00 mcfcli[3673891]: %3|1730760393.384|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 16:46:43 kjcf05n00 mcfcli[3673891]: %3|1730760403.112|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:47:03 kjcf05n00 mcfcli[3673891]: %3|1730760423.384|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 16:47:22 kjcf05n00 mcfcli[3673891]: %3|1730760442.031|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:47:33 kjcf05n00 mcfcli[3673891]: %3|1730760453.384|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 16:47:59 kjcf05n00 mcfcli[3673891]: %3|1730760479.735|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:48:03 kjcf05n00 mcfcli[3673891]: %3|1730760483.384|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 16:48:33 kjcf05n00 mcfcli[3673891]: %3|1730760513.384|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:48:38 kjcf05n00 mcfcli[3673891]: %3|1730760518.748|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:49:03 kjcf05n00 mcfcli[3673891]: %3|1730760543.385|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:49:16 kjcf05n00 mcfcli[3673891]: %3|1730760556.605|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:49:33 kjcf05n00 mcfcli[3673891]: %3|1730760573.385|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:49:53 kjcf05n00 mcfcli[3673891]: %3|1730760593.621|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 16:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 16:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 16:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 16:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 16:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 16:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 16:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 16:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 16:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 16:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 16:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 16:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 16:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 16:50:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 16:50:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 16:50:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 16:50:03 kjcf05n00 mcfcli[3673891]: %3|1730760603.385|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:50:33 kjcf05n00 mcfcli[3673891]: %3|1730760633.385|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:50:33 kjcf05n00 mcfcli[3673891]: %3|1730760633.618|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:50:33 kjcf05n00 python3.9[2274428]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 16:51:03 kjcf05n00 mcfcli[3673891]: %3|1730760663.385|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:51:13 kjcf05n00 mcfcli[3673891]: %3|1730760673.615|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:51:33 kjcf05n00 mcfcli[3673891]: %3|1730760693.385|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:51:53 kjcf05n00 mcfcli[3673891]: %3|1730760713.401|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:52:03 kjcf05n00 mcfcli[3673891]: %3|1730760723.386|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 16:52:32 kjcf05n00 mcfcli[3673891]: %3|1730760752.798|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:52:33 kjcf05n00 mcfcli[3673891]: %3|1730760753.386|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:53:03 kjcf05n00 mcfcli[3673891]: %3|1730760783.386|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 16:53:11 kjcf05n00 mcfcli[3673891]: %3|1730760791.131|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T22:53:15.868038Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 16:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T22:53:15.868105Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.088ms Nov 4 16:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T16:53:27.2545108-06:00 level=info msg="Completed cleanup jobs" duration=28.090738ms Nov 4 16:53:33 kjcf05n00 mcfcli[3673891]: %3|1730760813.387|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 16:53:48 kjcf05n00 mcfcli[3673891]: %3|1730760828.233|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:54:03 kjcf05n00 mcfcli[3673891]: %3|1730760843.387|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 16:54:26 kjcf05n00 mcfcli[3673891]: %3|1730760866.350|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:54:33 kjcf05n00 mcfcli[3673891]: %3|1730760873.387|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 16:55:03 kjcf05n00 mcfcli[3673891]: %3|1730760903.388|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 16:55:04 kjcf05n00 mcfcli[3673891]: %3|1730760904.796|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:55:33 kjcf05n00 mcfcli[3673891]: %3|1730760933.388|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 16:55:33 kjcf05n00 python3.9[2277262]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 16:55:42 kjcf05n00 mcfcli[3673891]: %3|1730760942.346|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:56:03 kjcf05n00 mcfcli[3673891]: %3|1730760963.887|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 16:56:21 kjcf05n00 mcfcli[3673891]: %3|1730760981.963|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:56:33 kjcf05n00 mcfcli[3673891]: %3|1730760993.889|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 16:57:01 kjcf05n00 mcfcli[3673891]: %3|1730761021.398|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:57:03 kjcf05n00 mcfcli[3673891]: %3|1730761023.994|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 16:57:33 kjcf05n00 mcfcli[3673891]: %3|1730761053.995|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 16:57:39 kjcf05n00 mcfcli[3673891]: %3|1730761059.335|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:58:04 kjcf05n00 mcfcli[3673891]: %3|1730761084.389|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 16:58:18 kjcf05n00 mcfcli[3673891]: %3|1730761098.389|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:58:34 kjcf05n00 mcfcli[3673891]: %3|1730761114.390|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 16:58:58 kjcf05n00 mcfcli[3673891]: %3|1730761138.386|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 16:59:04 kjcf05n00 mcfcli[3673891]: %3|1730761144.390|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 16:59:34 kjcf05n00 mcfcli[3673891]: %3|1730761174.390|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 16:59:36 kjcf05n00 mcfcli[3673891]: %3|1730761176.065|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 17:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 17:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 17:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 17:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 17:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 17:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 17:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 17:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 17:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 17:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 17:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 17:00:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 17:00:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:00:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 17:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 17:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 17:00:04 kjcf05n00 mcfcli[3673891]: %3|1730761204.390|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:00:13 kjcf05n00 mcfcli[3673891]: %3|1730761213.831|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:00:34 kjcf05n00 mcfcli[3673891]: %3|1730761234.391|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 17:00:41 kjcf05n00 python3.9[2280105]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 17:00:53 kjcf05n00 mcfcli[3673891]: %3|1730761253.828|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:01:04 kjcf05n00 mcfcli[3673891]: %3|1730761264.392|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:01:30 kjcf05n00 mcfcli[3673891]: %3|1730761290.921|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:01:34 kjcf05n00 mcfcli[3673891]: %3|1730761294.392|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 17:02:04 kjcf05n00 mcfcli[3673891]: %3|1730761324.392|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 17:02:09 kjcf05n00 mcfcli[3673891]: %3|1730761329.286|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:02:34 kjcf05n00 mcfcli[3673891]: %3|1730761354.392|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:02:49 kjcf05n00 mcfcli[3673891]: %3|1730761369.283|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:03:04 kjcf05n00 mcfcli[3673891]: %3|1730761384.392|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T17:03:27.252751665-06:00 level=info msg="Completed cleanup jobs" duration=26.101131ms Nov 4 17:03:27 kjcf05n00 mcfcli[3673891]: %3|1730761407.925|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:03:34 kjcf05n00 mcfcli[3673891]: %3|1730761414.392|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 17:04:03 kjcf05n00 mcfcli[3673891]: %3|1730761443.483|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:04:04 kjcf05n00 mcfcli[3673891]: %3|1730761444.393|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 17:04:34 kjcf05n00 mcfcli[3673891]: %3|1730761474.393|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 17:04:41 kjcf05n00 mcfcli[3673891]: %3|1730761481.983|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:05:04 kjcf05n00 mcfcli[3673891]: %3|1730761504.393|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 17:05:20 kjcf05n00 mcfcli[3673891]: %3|1730761520.919|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:05:33 kjcf05n00 python3.9[2282864]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 17:05:34 kjcf05n00 mcfcli[3673891]: %3|1730761534.393|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 17:05:59 kjcf05n00 mcfcli[3673891]: %3|1730761559.884|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:06:04 kjcf05n00 mcfcli[3673891]: %3|1730761564.393|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 17:06:34 kjcf05n00 mcfcli[3673891]: %3|1730761594.393|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:06:38 kjcf05n00 mcfcli[3673891]: %3|1730761598.214|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:07:04 kjcf05n00 mcfcli[3673891]: %3|1730761624.394|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:07:18 kjcf05n00 mcfcli[3673891]: %3|1730761638.165|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:07:22 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 17:07:22 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 17:07:22 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 17:07:34 kjcf05n00 mcfcli[3673891]: %3|1730761654.395|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:07:50 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 17:07:50 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 17:07:50 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 17:07:56 kjcf05n00 mcfcli[3673891]: %3|1730761676.139|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:08:04 kjcf05n00 mcfcli[3673891]: %3|1730761684.395|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:08:32 kjcf05n00 mcfcli[3673891]: %3|1730761712.938|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:08:34 kjcf05n00 mcfcli[3673891]: %3|1730761714.395|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 17:09:04 kjcf05n00 mcfcli[3673891]: %3|1730761744.395|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 17:09:11 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 17:09:11 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 17:09:11 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 17:09:11 kjcf05n00 mcfcli[3673891]: %3|1730761751.302|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:09:34 kjcf05n00 mcfcli[3673891]: %3|1730761774.395|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:09:50 kjcf05n00 mcfcli[3673891]: %3|1730761790.540|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:10:00 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 17:10:00 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 17:10:00 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 17:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 17:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 17:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 17:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 17:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 17:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 17:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 17:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 17:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 17:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 17:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 17:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 17:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 17:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 17:10:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 17:10:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:10:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 17:10:04 kjcf05n00 mcfcli[3673891]: %3|1730761804.396|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:10:30 kjcf05n00 mcfcli[3673891]: %3|1730761830.537|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:10:33 kjcf05n00 python3.9[2285823]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 17:10:34 kjcf05n00 mcfcli[3673891]: %3|1730761834.396|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 17:10:38 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 17:11:04 kjcf05n00 mcfcli[3673891]: %3|1730761864.396|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:11:06 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 17:11:06 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 17:11:08 kjcf05n00 mcfcli[3673891]: %3|1730761868.263|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:11:31 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 17:11:34 kjcf05n00 mcfcli[3673891]: %3|1730761894.396|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:11:48 kjcf05n00 mcfcli[3673891]: %3|1730761908.260|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:11:59 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 17:11:59 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 17:12:04 kjcf05n00 mcfcli[3673891]: %3|1730761924.396|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:12:25 kjcf05n00 mcfcli[3673891]: %3|1730761945.180|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:12:34 kjcf05n00 mcfcli[3673891]: %3|1730761954.396|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:13:04 kjcf05n00 mcfcli[3673891]: %3|1730761984.396|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:13:05 kjcf05n00 mcfcli[3673891]: %3|1730761985.102|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T17:13:27.253035617-06:00 level=info msg="Completed cleanup jobs" duration=26.232758ms Nov 4 17:13:34 kjcf05n00 mcfcli[3673891]: %3|1730762014.397|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 17:13:41 kjcf05n00 mcfcli[3673891]: %3|1730762021.055|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:14:04 kjcf05n00 mcfcli[3673891]: %3|1730762044.397|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:14:19 kjcf05n00 mcfcli[3673891]: %3|1730762059.465|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:14:34 kjcf05n00 mcfcli[3673891]: %3|1730762074.397|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:14:55 kjcf05n00 mcfcli[3673891]: %3|1730762095.492|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:15:04 kjcf05n00 mcfcli[3673891]: %3|1730762104.397|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:15:34 kjcf05n00 mcfcli[3673891]: %3|1730762134.397|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 17:15:34 kjcf05n00 python3.9[2288697]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 17:15:35 kjcf05n00 mcfcli[3673891]: %3|1730762135.489|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:16:04 kjcf05n00 mcfcli[3673891]: %3|1730762164.397|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 17:16:05 kjcf05n01 diskmonitor[1331407]: leaving test state: 1 next state: 2 Nov 4 17:16:05 kjcf05n01 diskmonitor[1331407]: lock req: no timeout Nov 4 17:16:05 kjcf05n01 diskmonitor[1331407]: leaving test state: 2 next state: 4 Nov 4 17:16:12 kjcf05n00 mcfcli[3673891]: %3|1730762172.839|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:16:34 kjcf05n00 mcfcli[3673891]: %3|1730762194.397|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 17:16:49 kjcf05n00 mcfcli[3673891]: %3|1730762209.241|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:17:04 kjcf05n00 mcfcli[3673891]: %3|1730762224.398|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 17:17:06 kjcf05n01 diskmonitor[1331407]: lock acquired Nov 4 17:17:06 kjcf05n01 diskmonitor[1331407]: leaving test state: 4 next state: 8 Nov 4 17:17:20 kjcf05n01 diskmonitor[1331407]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 4 17:17:20 kjcf05n01 diskmonitor[1331407]: leaving test state: 8 next state: 20 Nov 4 17:17:20 kjcf05n01 diskmonitor[1331407]: leaving test state: 20 next state: 40 Nov 4 17:17:20 kjcf05n01 diskmonitor[1331407]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset a218ae0000 Nov 4 17:17:20 kjcf05n01 diskmonitor[1331407]: leaving test state: 40 next state: 80 Nov 4 17:17:25 kjcf05n01 diskmonitor[1331407]: leaving test state: 80 next state: 100 Nov 4 17:17:25 kjcf05n01 diskmonitor[1331407]: lock release: time: Mon Nov 4 17:17:23 2024 Nov 4 17:17:25 kjcf05n01 diskmonitor[1331407]: leaving test state: 100 next state: 1 Nov 4 17:17:28 kjcf05n00 mcfcli[3673891]: %3|1730762248.329|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:17:34 kjcf05n00 mcfcli[3673891]: %3|1730762254.399|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:18:04 kjcf05n00 mcfcli[3673891]: %3|1730762284.399|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 17:18:06 kjcf05n00 mcfcli[3673891]: %3|1730762286.226|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:18:34 kjcf05n00 mcfcli[3673891]: %3|1730762314.399|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 17:18:42 kjcf05n00 mcfcli[3673891]: %3|1730762322.069|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:19:04 kjcf05n00 mcfcli[3673891]: %3|1730762344.399|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 17:19:17 kjcf05n00 mcfcli[3673891]: %3|1730762357.608|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:19:34 kjcf05n00 mcfcli[3673891]: %3|1730762374.399|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 17:19:57 kjcf05n00 mcfcli[3673891]: %3|1730762397.605|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 17:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 17:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 17:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 17:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 17:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 17:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 17:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 17:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 17:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 17:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 17:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 17:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 17:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 17:20:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 17:20:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:20:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 17:20:04 kjcf05n00 mcfcli[3673891]: %3|1730762404.400|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:20:34 kjcf05n00 python3.9[2291533]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 17:20:34 kjcf05n00 mcfcli[3673891]: %3|1730762434.400|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 17:20:37 kjcf05n00 mcfcli[3673891]: %3|1730762437.602|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:21:04 kjcf05n00 mcfcli[3673891]: %3|1730762464.400|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 17:21:14 kjcf05n00 mcfcli[3673891]: %3|1730762474.734|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:21:34 kjcf05n00 mcfcli[3673891]: %3|1730762494.400|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:21:53 kjcf05n00 mcfcli[3673891]: %3|1730762513.621|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:22:04 kjcf05n00 mcfcli[3673891]: %3|1730762524.400|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 17:22:31 kjcf05n00 mcfcli[3673891]: %3|1730762551.120|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:22:34 kjcf05n00 mcfcli[3673891]: %3|1730762554.402|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:23:04 kjcf05n00 mcfcli[3673891]: %3|1730762584.402|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 17:23:08 kjcf05n00 mcfcli[3673891]: %3|1730762588.459|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T23:23:15.867540Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 17:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T23:23:15.867605Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.085ms Nov 4 17:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T17:23:27.26823584-06:00 level=info msg="Completed cleanup jobs" duration=41.599686ms Nov 4 17:23:34 kjcf05n00 mcfcli[3673891]: %3|1730762614.402|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:23:47 kjcf05n00 mcfcli[3673891]: %3|1730762627.464|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:24:04 kjcf05n00 mcfcli[3673891]: %3|1730762644.402|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:24:12 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 17:24:12 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 10 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007998 sec, idle for 1 hour(s)] Nov 4 17:24:26 kjcf05n00 mcfcli[3673891]: %3|1730762666.702|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:24:34 kjcf05n00 mcfcli[3673891]: %3|1730762674.402|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 17:25:04 kjcf05n00 mcfcli[3673891]: %3|1730762704.402|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 17:25:05 kjcf05n00 mcfcli[3673891]: %3|1730762705.991|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:25:34 kjcf05n00 python3.9[2294446]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 17:25:34 kjcf05n00 mcfcli[3673891]: %3|1730762734.403|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 17:25:45 kjcf05n00 mcfcli[3673891]: %3|1730762745.256|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:26:04 kjcf05n00 mcfcli[3673891]: %3|1730762764.403|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 17:26:22 kjcf05n00 mcfcli[3673891]: %3|1730762782.831|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:26:34 kjcf05n00 mcfcli[3673891]: %3|1730762794.403|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:27:01 kjcf05n00 mcfcli[3673891]: %3|1730762821.135|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:27:04 kjcf05n00 mcfcli[3673891]: %3|1730762824.403|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:27:34 kjcf05n00 mcfcli[3673891]: %3|1730762854.403|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 17:27:37 kjcf05n00 mcfcli[3673891]: %3|1730762857.853|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:28:04 kjcf05n00 mcfcli[3673891]: %3|1730762884.403|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 17:28:13 kjcf05n00 mcfcli[3673891]: %3|1730762893.498|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:28:34 kjcf05n00 mcfcli[3673891]: %3|1730762914.403|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:28:51 kjcf05n00 mcfcli[3673891]: %3|1730762931.908|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:29:04 kjcf05n00 mcfcli[3673891]: %3|1730762944.404|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 17:29:29 kjcf05n00 mcfcli[3673891]: %3|1730762969.295|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:29:34 kjcf05n00 mcfcli[3673891]: %3|1730762974.404|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 17:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 17:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 17:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 17:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 17:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 17:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 17:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 17:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 17:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 17:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 17:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 17:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 17:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 17:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 17:30:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 17:30:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:30:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 17:30:04 kjcf05n00 mcfcli[3673891]: %3|1730763004.404|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:30:06 kjcf05n00 mcfcli[3673891]: %3|1730763006.608|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:30:34 kjcf05n00 mcfcli[3673891]: %3|1730763034.404|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 17:30:34 kjcf05n00 python3.9[2297272]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 17:30:46 kjcf05n00 mcfcli[3673891]: %3|1730763046.605|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:31:04 kjcf05n00 mcfcli[3673891]: %3|1730763064.405|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:31:26 kjcf05n00 mcfcli[3673891]: %3|1730763086.602|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:31:34 kjcf05n00 mcfcli[3673891]: %3|1730763094.405|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:32:04 kjcf05n00 mcfcli[3673891]: %3|1730763124.406|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:32:04 kjcf05n00 mcfcli[3673891]: %3|1730763124.715|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:32:34 kjcf05n00 diskmonitor[2758297]: leaving test state: 1 next state: 2 Nov 4 17:32:34 kjcf05n00 diskmonitor[2758297]: lock req: no timeout Nov 4 17:32:34 kjcf05n00 diskmonitor[2758297]: leaving test state: 2 next state: 4 Nov 4 17:32:34 kjcf05n00 mcfcli[3673891]: %3|1730763154.406|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:32:44 kjcf05n00 mcfcli[3673891]: %3|1730763164.712|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:33:04 kjcf05n00 mcfcli[3673891]: %3|1730763184.406|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 17:33:22 kjcf05n00 mcfcli[3673891]: %3|1730763202.126|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T17:33:27.247930364-06:00 level=info msg="Completed cleanup jobs" duration=21.39069ms Nov 4 17:33:34 kjcf05n00 mcfcli[3673891]: %3|1730763214.407|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:33:38 kjcf05n00 diskmonitor[2758297]: lock acquired Nov 4 17:33:38 kjcf05n00 diskmonitor[2758297]: leaving test state: 4 next state: 8 Nov 4 17:33:47 kjcf05n00 diskmonitor[2758297]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 4 17:33:47 kjcf05n00 diskmonitor[2758297]: leaving test state: 8 next state: 20 Nov 4 17:33:47 kjcf05n00 diskmonitor[2758297]: leaving test state: 20 next state: 40 Nov 4 17:33:47 kjcf05n00 diskmonitor[2758297]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset 1357a2c0000 Nov 4 17:33:47 kjcf05n00 diskmonitor[2758297]: leaving test state: 40 next state: 80 Nov 4 17:33:58 kjcf05n00 mcfcli[3673891]: %3|1730763238.565|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:34:04 kjcf05n00 mcfcli[3673891]: %3|1730763244.407|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:34:34 kjcf05n00 mcfcli[3673891]: %3|1730763274.407|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:34:38 kjcf05n00 mcfcli[3673891]: %3|1730763278.562|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:34:42 kjcf05n00 diskmonitor[2758297]: leaving test state: 80 next state: 100 Nov 4 17:34:42 kjcf05n00 diskmonitor[2758297]: lock release: time: Mon Nov 4 17:34:41 2024 Nov 4 17:34:42 kjcf05n00 diskmonitor[2758297]: leaving test state: 100 next state: 1 Nov 4 17:35:04 kjcf05n00 mcfcli[3673891]: %3|1730763304.407|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 17:35:16 kjcf05n00 mcfcli[3673891]: %3|1730763316.953|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:35:34 kjcf05n00 python3.9[2300942]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 17:35:34 kjcf05n00 mcfcli[3673891]: %3|1730763334.408|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 17:35:54 kjcf05n00 mcfcli[3673891]: %3|1730763354.852|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:36:04 kjcf05n00 mcfcli[3673891]: %3|1730763364.408|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 17:36:34 kjcf05n00 mcfcli[3673891]: %3|1730763394.408|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:36:34 kjcf05n00 mcfcli[3673891]: %3|1730763394.849|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:37:04 kjcf05n00 mcfcli[3673891]: %3|1730763424.409|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:37:09 kjcf05n00 mcfcli[3673891]: %3|1730763429.857|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:37:24 kjcf05n02 diskmonitor[17328]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 17:37:34 kjcf05n00 mcfcli[3673891]: %3|1730763454.410|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:37:49 kjcf05n00 mcfcli[3673891]: %3|1730763469.855|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:38:04 kjcf05n00 mcfcli[3673891]: %3|1730763484.909|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 17:38:26 kjcf05n00 mcfcli[3673891]: %3|1730763506.532|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:38:34 kjcf05n00 mcfcli[3673891]: %3|1730763514.909|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 17:39:04 kjcf05n00 mcfcli[3673891]: %3|1730763544.910|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 17:39:06 kjcf05n00 mcfcli[3673891]: %3|1730763546.435|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:39:34 kjcf05n00 mcfcli[3673891]: %3|1730763574.910|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 17:39:46 kjcf05n00 mcfcli[3673891]: %3|1730763586.432|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 17:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 17:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 17:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 17:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 17:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 17:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 17:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 17:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 17:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 17:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 17:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 17:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 17:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 17:40:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 17:40:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:40:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 17:40:04 kjcf05n00 mcfcli[3673891]: %3|1730763604.910|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 17:40:26 kjcf05n00 mcfcli[3673891]: %3|1730763626.429|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:40:31 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T23:40:31.033160Z lvl=info msg="TSI log compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=3 op_name=tsi1_compact_log_file tsi1_log_file_id=2 op_event=start Nov 4 17:40:31 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T23:40:31.033733Z lvl=info msg="Log file compacted" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=3 op_name=tsi1_compact_log_file tsi1_log_file_id=2 elapsed=0ms bytes=832 kb_per_sec=1367 Nov 4 17:40:31 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T23:40:31.033760Z lvl=info msg="TSI log compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=3 op_name=tsi1_compact_log_file tsi1_log_file_id=2 op_event=end op_elapsed=0.620ms Nov 4 17:40:31 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T23:40:31.033799Z lvl=info msg="TSI level compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=3 op_name=tsi1_compact_to_level tsi1_level=2 op_event=start Nov 4 17:40:31 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T23:40:31.033817Z lvl=info msg="Performing full compaction" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=3 op_name=tsi1_compact_to_level tsi1_level=2 src=2,1 dst=/mnt/mgmt/var/lib/influxdb/engine/data/f75a8c5868320c8d/autogen/675/index/2/L2-00000004.tsi Nov 4 17:40:31 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T23:40:31.035005Z lvl=info msg="Full compaction complete" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=3 op_name=tsi1_compact_to_level tsi1_level=2 path=/mnt/mgmt/var/lib/influxdb/engine/data/f75a8c5868320c8d/autogen/675/index/2/L2-00000004.tsi elapsed=1ms bytes=13002 kb_per_sec=10582 Nov 4 17:40:31 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T23:40:31.035014Z lvl=info msg="Removing index file" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=3 op_name=tsi1_compact_to_level tsi1_level=2 path=/mnt/mgmt/var/lib/influxdb/engine/data/f75a8c5868320c8d/autogen/675/index/2/L1-00000002.tsi Nov 4 17:40:31 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T23:40:31.035035Z lvl=info msg="Removing index file" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=3 op_name=tsi1_compact_to_level tsi1_level=2 path=/mnt/mgmt/var/lib/influxdb/engine/data/f75a8c5868320c8d/autogen/675/index/2/L1-00000001.tsi Nov 4 17:40:31 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T23:40:31.035058Z lvl=info msg="TSI level compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=3 op_name=tsi1_compact_to_level tsi1_level=2 op_event=end op_elapsed=1.261ms Nov 4 17:40:34 kjcf05n00 python3.9[2303736]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 17:40:34 kjcf05n00 mcfcli[3673891]: %3|1730763634.911|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 17:41:04 kjcf05n00 mcfcli[3673891]: %3|1730763664.911|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 17:41:05 kjcf05n00 mcfcli[3673891]: %3|1730763665.258|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:41:34 kjcf05n00 mcfcli[3673891]: %3|1730763694.911|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 17:41:40 kjcf05n00 mcfcli[3673891]: %3|1730763700.270|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:42:04 kjcf05n00 mcfcli[3673891]: %3|1730763724.911|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:42:20 kjcf05n00 mcfcli[3673891]: %3|1730763740.267|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:42:34 kjcf05n00 mcfcli[3673891]: %3|1730763754.912|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:42:59 kjcf05n00 mcfcli[3673891]: %3|1730763779.672|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:43:04 kjcf05n00 mcfcli[3673891]: %3|1730763784.912|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T17:43:27.268596749-06:00 level=info msg="Completed cleanup jobs" duration=42.031506ms Nov 4 17:43:34 kjcf05n00 mcfcli[3673891]: %3|1730763814.912|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:43:37 kjcf05n00 mcfcli[3673891]: %3|1730763817.102|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:44:04 kjcf05n00 mcfcli[3673891]: %3|1730763844.912|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 17:44:14 kjcf05n00 mcfcli[3673891]: %3|1730763854.736|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:44:34 kjcf05n00 mcfcli[3673891]: %3|1730763874.913|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:44:54 kjcf05n00 mcfcli[3673891]: %3|1730763894.733|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:45:05 kjcf05n00 mcfcli[3673891]: %3|1730763905.010|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 17:45:34 kjcf05n00 mcfcli[3673891]: %3|1730763934.406|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:45:35 kjcf05n00 mcfcli[3673891]: %3|1730763935.414|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 17:45:38 kjcf05n00 python3.9[2306712]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 17:46:05 kjcf05n00 mcfcli[3673891]: %3|1730763965.414|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:46:11 kjcf05n00 mcfcli[3673891]: %3|1730763971.513|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:46:35 kjcf05n00 mcfcli[3673891]: %3|1730763995.414|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:46:48 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 4 17:46:48 kjcf05n02 systemd-tmpfiles[2502571]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 17:46:48 kjcf05n02 systemd-tmpfiles[2502571]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 17:46:48 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 4 17:46:48 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 4 17:46:49 kjcf05n00 mcfcli[3673891]: %3|1730764009.062|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:47:05 kjcf05n00 mcfcli[3673891]: %3|1730764025.415|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 17:47:26 kjcf05n00 mcfcli[3673891]: %3|1730764046.441|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:47:35 kjcf05n00 mcfcli[3673891]: %3|1730764055.416|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 17:48:05 kjcf05n00 mcfcli[3673891]: %3|1730764085.416|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 17:48:05 kjcf05n00 mcfcli[3673891]: %3|1730764085.575|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:48:35 kjcf05n00 mcfcli[3673891]: %3|1730764115.416|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:48:38 kjcf05n00 mcfcli[3673891]: %3|1730764118.438|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:49:05 kjcf05n00 mcfcli[3673891]: %3|1730764145.418|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 17:49:15 kjcf05n00 mcfcli[3673891]: %3|1730764155.972|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:49:35 kjcf05n00 mcfcli[3673891]: %3|1730764175.418|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 17:49:52 kjcf05n00 mcfcli[3673891]: %3|1730764192.589|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 17:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 17:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 17:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 17:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 17:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 17:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 17:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 17:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 17:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 17:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 17:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 17:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 17:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 17:50:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 17:50:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 17:50:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 17:50:05 kjcf05n00 mcfcli[3673891]: %3|1730764205.418|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:50:29 kjcf05n00 mcfcli[3673891]: %3|1730764229.186|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:50:34 kjcf05n00 python3.9[2309470]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 17:50:35 kjcf05n00 mcfcli[3673891]: %3|1730764235.418|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 17:51:05 kjcf05n00 mcfcli[3673891]: %3|1730764265.418|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:51:06 kjcf05n00 mcfcli[3673891]: %3|1730764266.747|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:51:10 kjcf05n02 dwd[5139]: nvme18n1 passed periodic SMART status check Nov 4 17:51:10 kjcf05n02 dwd[5139]: nvme2n1 passed periodic SMART status check Nov 4 17:51:24 kjcf05n02 dwd[5139]: nvme23n1 passed periodic SMART status check Nov 4 17:51:24 kjcf05n02 dwd[5139]: nvme19n1 passed periodic SMART status check Nov 4 17:51:24 kjcf05n02 dwd[5139]: nvme9n1 passed periodic SMART status check Nov 4 17:51:24 kjcf05n02 dwd[5139]: nvme4n1 passed periodic SMART status check Nov 4 17:51:24 kjcf05n02 dwd[5139]: nvme25n1 passed periodic SMART status check Nov 4 17:51:24 kjcf05n02 dwd[5139]: nvme17n1 passed periodic SMART status check Nov 4 17:51:24 kjcf05n02 dwd[5139]: nvme3n1 passed periodic SMART status check Nov 4 17:51:24 kjcf05n02 dwd[5139]: nvme8n1 passed periodic SMART status check Nov 4 17:51:24 kjcf05n02 dwd[5139]: nvme24n1 passed periodic SMART status check Nov 4 17:51:35 kjcf05n00 mcfcli[3673891]: %3|1730764295.419|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:51:43 kjcf05n00 mcfcli[3673891]: %3|1730764303.474|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:52:05 kjcf05n00 mcfcli[3673891]: %3|1730764325.419|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:52:22 kjcf05n00 mcfcli[3673891]: %3|1730764342.577|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:52:35 kjcf05n00 mcfcli[3673891]: %3|1730764355.419|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:53:02 kjcf05n00 mcfcli[3673891]: %3|1730764382.574|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:53:05 kjcf05n00 mcfcli[3673891]: %3|1730764385.420|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T23:53:15.867862Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 17:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-04T23:53:15.867918Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.077ms Nov 4 17:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T17:53:27.255879593-06:00 level=info msg="Completed cleanup jobs" duration=29.041892ms Nov 4 17:53:35 kjcf05n00 mcfcli[3673891]: %3|1730764415.421|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:53:42 kjcf05n00 mcfcli[3673891]: %3|1730764422.571|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:54:05 kjcf05n00 mcfcli[3673891]: %3|1730764445.920|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 17:54:22 kjcf05n00 mcfcli[3673891]: %3|1730764462.569|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:54:35 kjcf05n00 mcfcli[3673891]: %3|1730764475.921|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:54:58 kjcf05n00 mcfcli[3673891]: %3|1730764498.183|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:55:05 kjcf05n00 mcfcli[3673891]: %3|1730764505.921|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 17:55:34 kjcf05n00 python3.9[2312347]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 17:55:35 kjcf05n00 mcfcli[3673891]: %3|1730764535.921|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 17:55:38 kjcf05n00 mcfcli[3673891]: %3|1730764538.180|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:56:05 kjcf05n00 mcfcli[3673891]: %3|1730764565.923|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 17:56:15 kjcf05n00 mcfcli[3673891]: %3|1730764575.547|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:56:36 kjcf05n00 mcfcli[3673891]: %3|1730764596.014|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 17:56:54 kjcf05n00 mcfcli[3673891]: %3|1730764614.034|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:57:06 kjcf05n00 mcfcli[3673891]: %3|1730764626.014|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 17:57:34 kjcf05n00 mcfcli[3673891]: %3|1730764654.031|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:57:36 kjcf05n00 mcfcli[3673891]: %3|1730764656.014|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 17:58:06 kjcf05n00 mcfcli[3673891]: %3|1730764686.014|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 17:58:14 kjcf05n00 mcfcli[3673891]: %3|1730764694.028|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:58:36 kjcf05n00 mcfcli[3673891]: %3|1730764716.015|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 17:58:50 kjcf05n00 mcfcli[3673891]: %3|1730764730.921|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:59:06 kjcf05n00 mcfcli[3673891]: %3|1730764746.015|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 17:59:27 kjcf05n00 mcfcli[3673891]: %3|1730764767.377|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 17:59:36 kjcf05n00 mcfcli[3673891]: %3|1730764776.015|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 18:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 18:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 18:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 18:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 18:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 18:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 18:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 18:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 18:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 18:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 18:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 18:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 18:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 18:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 18:00:01 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:00:01.046930Z lvl=info msg="index opened with 8 partitions" log_id=0s8llxRG000 service=storage-engine index=tsi Nov 4 18:00:01 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:00:01.047098Z lvl=info msg="loading changes (start)" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name="field indices" op_event=start Nov 4 18:00:01 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:00:01.047148Z lvl=info msg="loading changes (end)" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name="field indices" op_event=end op_elapsed=0.051ms Nov 4 18:00:01 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:00:01.047487Z lvl=info msg="Reindexing TSM data" log_id=0s8llxRG000 service=storage-engine engine=tsm1 db_shard_id=677 Nov 4 18:00:01 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:00:01.047495Z lvl=info msg="Reindexing WAL data" log_id=0s8llxRG000 service=storage-engine engine=tsm1 db_shard_id=677 Nov 4 18:00:01 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:00:01.048101Z lvl=info msg="saving field index changes (start)" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name=MeasurementFieldSet op_event=start Nov 4 18:00:01 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:00:01.048257Z lvl=info msg="saving field index changes (end)" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name=MeasurementFieldSet op_event=end op_elapsed=0.169ms Nov 4 18:00:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 18:00:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:00:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 18:00:02 kjcf05n00 mcfcli[3673891]: %3|1730764802.906|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:00:06 kjcf05n00 mcfcli[3673891]: %3|1730764806.015|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 18:00:11 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:00:11.042406Z lvl=info msg="saving field index changes (start)" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name=MeasurementFieldSet op_event=start Nov 4 18:00:11 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:00:11.042571Z lvl=info msg="saving field index changes (end)" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name=MeasurementFieldSet op_event=end op_elapsed=0.172ms Nov 4 18:00:31 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:00:31.042700Z lvl=info msg="saving field index changes (start)" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name=MeasurementFieldSet op_event=start Nov 4 18:00:31 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:00:31.042897Z lvl=info msg="saving field index changes (end)" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name=MeasurementFieldSet op_event=end op_elapsed=0.206ms Nov 4 18:00:34 kjcf05n00 python3.9[2315273]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 18:00:36 kjcf05n00 mcfcli[3673891]: %3|1730764836.425|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 18:00:42 kjcf05n00 mcfcli[3673891]: %3|1730764842.829|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:01:06 kjcf05n00 mcfcli[3673891]: %3|1730764866.425|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:01:18 kjcf05n00 mcfcli[3673891]: %3|1730764878.989|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:01:36 kjcf05n00 mcfcli[3673891]: %3|1730764896.425|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 18:01:54 kjcf05n00 mcfcli[3673891]: %3|1730764914.585|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:02:06 kjcf05n00 mcfcli[3673891]: %3|1730764926.425|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 18:02:34 kjcf05n00 mcfcli[3673891]: %3|1730764954.582|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:02:36 kjcf05n00 mcfcli[3673891]: %3|1730764956.425|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:03:06 kjcf05n00 mcfcli[3673891]: %3|1730764986.425|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 18:03:13 kjcf05n00 mcfcli[3673891]: %3|1730764993.055|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T18:03:27.254684868-06:00 level=info msg="Completed cleanup jobs" duration=27.500626ms Nov 4 18:03:36 kjcf05n00 mcfcli[3673891]: %3|1730765016.426|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 18:03:53 kjcf05n00 mcfcli[3673891]: %3|1730765033.052|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:04:06 kjcf05n00 mcfcli[3673891]: %3|1730765046.426|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 18:04:32 kjcf05n00 mcfcli[3673891]: %3|1730765072.311|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:04:36 kjcf05n00 mcfcli[3673891]: %3|1730765076.427|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:05:06 kjcf05n00 mcfcli[3673891]: %3|1730765106.427|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:05:12 kjcf05n00 mcfcli[3673891]: %3|1730765112.265|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:05:34 kjcf05n00 python3.9[2318118]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 18:05:36 kjcf05n00 mcfcli[3673891]: %3|1730765136.428|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 18:05:52 kjcf05n00 mcfcli[3673891]: %3|1730765152.203|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:06:06 kjcf05n00 mcfcli[3673891]: %3|1730765166.428|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:06:30 kjcf05n00 mcfcli[3673891]: %3|1730765190.447|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:06:36 kjcf05n00 mcfcli[3673891]: %3|1730765196.428|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 18:07:06 kjcf05n00 mcfcli[3673891]: %3|1730765226.428|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:07:08 kjcf05n00 mcfcli[3673891]: %3|1730765228.505|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:07:32 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 18:07:32 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 18:07:32 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 18:07:36 kjcf05n00 mcfcli[3673891]: %3|1730765256.428|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:07:47 kjcf05n00 mcfcli[3673891]: %3|1730765267.866|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:08:01 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 18:08:01 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 18:08:01 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 18:08:06 kjcf05n00 mcfcli[3673891]: %3|1730765286.428|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:08:27 kjcf05n00 mcfcli[3673891]: %3|1730765307.863|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:08:36 kjcf05n00 mcfcli[3673891]: %3|1730765316.429|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:09:05 kjcf05n00 mcfcli[3673891]: %3|1730765345.907|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:09:06 kjcf05n00 mcfcli[3673891]: %3|1730765346.429|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 18:09:29 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 18:09:36 kjcf05n00 mcfcli[3673891]: %3|1730765376.429|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 18:09:45 kjcf05n00 mcfcli[3673891]: %3|1730765385.905|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:09:57 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 18:09:57 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 18:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 18:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 18:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 18:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 18:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 18:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 18:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 18:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 18:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 18:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 18:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 18:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 18:10:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 18:10:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:10:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 18:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 18:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 18:10:01 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:10:01.414528Z lvl=info msg="Cache snapshot (start)" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name=tsm1_cache_snapshot op_event=start Nov 4 18:10:01 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:10:01.425883Z lvl=info msg="Snapshot for path written" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name=tsm1_cache_snapshot path=/mnt/mgmt/var/lib/influxdb/engine/data/f75a8c5868320c8d/autogen/675 duration=11.359ms Nov 4 18:10:01 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:10:01.425913Z lvl=info msg="Cache snapshot (end)" log_id=0s8llxRG000 service=storage-engine engine=tsm1 op_name=tsm1_cache_snapshot op_event=end op_elapsed=11.405ms Nov 4 18:10:06 kjcf05n00 mcfcli[3673891]: %3|1730765406.429|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 18:10:23 kjcf05n00 mcfcli[3673891]: %3|1730765423.467|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:10:35 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 18:10:34 kjcf05n00 python3.9[2320877]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 18:10:36 kjcf05n00 mcfcli[3673891]: %3|1730765436.430|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 18:10:59 kjcf05n00 mcfcli[3673891]: %3|1730765459.902|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:11:03 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 18:11:03 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 18:11:06 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 18:11:06 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 18:11:06 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 18:11:06 kjcf05n00 mcfcli[3673891]: %3|1730765466.430|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 18:11:36 kjcf05n00 mcfcli[3673891]: %3|1730765496.430|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 18:11:38 kjcf05n00 mcfcli[3673891]: %3|1730765498.317|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:11:49 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 18:11:49 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 18:11:49 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 18:12:06 kjcf05n00 mcfcli[3673891]: %3|1730765526.430|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 18:12:17 kjcf05n00 mcfcli[3673891]: %3|1730765537.282|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:12:36 kjcf05n00 mcfcli[3673891]: %3|1730765556.430|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:12:57 kjcf05n00 mcfcli[3673891]: %3|1730765577.279|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:13:06 kjcf05n00 mcfcli[3673891]: %3|1730765586.430|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T18:13:27.253139046-06:00 level=info msg="Completed cleanup jobs" duration=26.160105ms Nov 4 18:13:34 kjcf05n00 mcfcli[3673891]: %3|1730765614.978|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:13:36 kjcf05n00 mcfcli[3673891]: %3|1730765616.430|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 18:14:06 kjcf05n00 mcfcli[3673891]: %3|1730765646.432|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:14:11 kjcf05n00 mcfcli[3673891]: %3|1730765651.633|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:14:36 kjcf05n00 mcfcli[3673891]: %3|1730765676.432|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:14:51 kjcf05n00 mcfcli[3673891]: %3|1730765691.629|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:15:06 kjcf05n00 mcfcli[3673891]: %3|1730765706.432|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:15:27 kjcf05n00 mcfcli[3673891]: %3|1730765727.283|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:15:34 kjcf05n00 python3.9[2323928]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 18:15:36 kjcf05n00 mcfcli[3673891]: %3|1730765736.432|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 18:16:05 kjcf05n00 mcfcli[3673891]: %3|1730765765.691|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:16:06 kjcf05n00 mcfcli[3673891]: %3|1730765766.432|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 18:16:36 kjcf05n00 mcfcli[3673891]: %3|1730765796.433|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:16:43 kjcf05n00 mcfcli[3673891]: %3|1730765803.671|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:17:06 kjcf05n00 mcfcli[3673891]: %3|1730765826.433|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:17:23 kjcf05n00 mcfcli[3673891]: %3|1730765843.328|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:17:36 kjcf05n00 mcfcli[3673891]: %3|1730765856.434|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:18:02 kjcf05n00 mcfcli[3673891]: %3|1730765882.663|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:18:06 kjcf05n00 mcfcli[3673891]: %3|1730765886.435|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:18:12 kjcf05n02 diskmonitor[17328]: leaving test state: 1 next state: 2 Nov 4 18:18:12 kjcf05n02 diskmonitor[17328]: lock req: no timeout Nov 4 18:18:12 kjcf05n02 diskmonitor[17328]: leaving test state: 2 next state: 4 Nov 4 18:18:34 kjcf05n02 diskmonitor[17328]: lock acquired Nov 4 18:18:34 kjcf05n02 diskmonitor[17328]: leaving test state: 4 next state: 8 Nov 4 18:18:36 kjcf05n00 mcfcli[3673891]: %3|1730765916.435|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:18:41 kjcf05n02 diskmonitor[17328]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 4 18:18:41 kjcf05n02 diskmonitor[17328]: leaving test state: 8 next state: 20 Nov 4 18:18:41 kjcf05n02 diskmonitor[17328]: leaving test state: 20 next state: 40 Nov 4 18:18:41 kjcf05n02 diskmonitor[17328]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 6cf6790000 Nov 4 18:18:41 kjcf05n02 diskmonitor[17328]: leaving test state: 40 next state: 80 Nov 4 18:18:42 kjcf05n00 mcfcli[3673891]: %3|1730765922.660|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:19:06 kjcf05n00 mcfcli[3673891]: %3|1730765946.436|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:19:20 kjcf05n00 mcfcli[3673891]: %3|1730765960.786|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:19:36 kjcf05n00 mcfcli[3673891]: %3|1730765976.436|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:19:44 kjcf05n02 diskmonitor[17328]: leaving test state: 80 next state: 100 Nov 4 18:19:44 kjcf05n02 diskmonitor[17328]: lock release: time: Mon Nov 4 18:19:40 2024 Nov 4 18:19:44 kjcf05n02 diskmonitor[17328]: leaving test state: 100 next state: 1 Nov 4 18:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 18:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 18:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 18:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 18:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 18:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 18:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 18:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 18:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 18:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 18:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 18:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 18:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 18:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 18:20:00 kjcf05n00 mcfcli[3673891]: %3|1730766000.783|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:20:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 18:20:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:20:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 18:20:06 kjcf05n00 mcfcli[3673891]: %3|1730766006.436|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:20:36 kjcf05n00 mcfcli[3673891]: %3|1730766036.436|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 18:20:38 kjcf05n00 python3.9[2326915]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 18:20:38 kjcf05n00 mcfcli[3673891]: %3|1730766038.689|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:21:06 kjcf05n00 mcfcli[3673891]: %3|1730766066.436|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:21:15 kjcf05n00 mcfcli[3673891]: %3|1730766075.360|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:21:36 kjcf05n00 mcfcli[3673891]: %3|1730766096.437|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 18:21:50 kjcf05n00 mcfcli[3673891]: %3|1730766110.817|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:22:06 kjcf05n00 mcfcli[3673891]: %3|1730766126.437|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:22:30 kjcf05n00 mcfcli[3673891]: %3|1730766150.406|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:22:36 kjcf05n00 mcfcli[3673891]: %3|1730766156.438|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 18:23:06 kjcf05n00 mcfcli[3673891]: %3|1730766186.438|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 18:23:10 kjcf05n00 mcfcli[3673891]: %3|1730766190.049|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:23:15.867884Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 18:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:23:15.868142Z lvl=info msg="Deleted shard group" log_id=0s8llxRG000 service=retention op_name=retention_delete_check db_instance=f75a8c5868320c8d db_shard_group=661 db_rp=autogen Nov 4 18:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:23:15.868294Z lvl=info msg="Deleted shard group" log_id=0s8llxRG000 service=retention op_name=retention_delete_check db_instance=062bb96ccbd0518a db_shard_group=662 db_rp=autogen Nov 4 18:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:23:15.869749Z lvl=info msg="Deleted shard" log_id=0s8llxRG000 service=retention op_name=retention_delete_check db_instance=062bb96ccbd0518a db_shard_id=662 db_rp=autogen Nov 4 18:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:23:15.876357Z lvl=info msg="Deleted shard" log_id=0s8llxRG000 service=retention op_name=retention_delete_check db_instance=f75a8c5868320c8d db_shard_id=661 db_rp=autogen Nov 4 18:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:23:15.876532Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=8.670ms Nov 4 18:23:23 kjcf05n00 zabbix-server[2328516]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 18:23:23 kjcf05n00 zabbix-server[2328516]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 454.03\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 229.85\\"}}"' Nov 4 18:23:23 kjcf05n00 log_interesting_event.py[2328516]: Event '46550' acknowledged Nov 4 18:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T18:23:27.252820329-06:00 level=info msg="Completed cleanup jobs" duration=26.120398ms Nov 4 18:23:36 kjcf05n00 mcfcli[3673891]: %3|1730766216.438|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 18:23:47 kjcf05n00 zabbix-server[2328816]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 18:23:47 kjcf05n00 zabbix-server[2328816]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 84.35\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 99.06\\"}}"' Nov 4 18:23:47 kjcf05n00 mcfcli[3673891]: %3|1730766227.346|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:23:47 kjcf05n00 log_interesting_event.py[2328816]: Event '46551' acknowledged Nov 4 18:24:06 kjcf05n00 mcfcli[3673891]: %3|1730766246.439|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 18:24:12 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 18:24:12 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 14 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007440 sec, idle for 1 hour(s)] Nov 4 18:24:26 kjcf05n00 mcfcli[3673891]: %3|1730766266.277|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:24:36 kjcf05n00 csman[2329165]: plex_external pubsub_rpc: INFO Adding channel close callback (pubsub_rpc.py:142) Nov 4 18:24:36 kjcf05n00 csman[2329165]: plex_external pubsub_rpc: INFO Binding plex_pubsub to cli_responses.5687bbe6-9b0c-11ef-a96a-00093d0696a6 with plex.app.dcs.system.cli.show.reply (pubsub_rpc.py:212) Nov 4 18:24:36 kjcf05n00 csman[2329165]: plex_external pubsub_rpc: INFO Publishing message {'id': '5687bbe6-9b0c-11ef-a96a-00093d0696a6', 'body': {}} to topic 'plex.app.dcs.system.cli.show' (pubsub_rpc.py:314) Nov 4 18:24:36 kjcf05n00 csman[2329165]: plex_external pubsub_rpc: INFO Received message: b'{"reply": "ACK", "id": "5687bbe6-9b0c-11ef-a96a-00093d0696a6"}' (pubsub_rpc.py:268) Nov 4 18:24:36 kjcf05n00 csman[2329165]: plex_external pubsub_rpc: INFO Received message: b'{"reply": "System settings: \\n\\tSystem serial number: 10011838\\n\\tSystem identifier name: [not-set]\\n", "id": "5687bbe6-9b0c-11ef-a96a-00093d0696a6", "terminator": true}' (pubsub_rpc.py:268) Nov 4 18:24:36 kjcf05n00 mcfcli[3673891]: %3|1730766276.938|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 18:24:38 kjcf05n01 su[3813119]: (to nobody) root on none Nov 4 18:24:42 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 2569417 (mkdir) Nov 4 18:24:42 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 4 18:24:42 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 4 18:24:43 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 2326614 (mkdir) Nov 4 18:24:43 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 4 18:24:43 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 4 18:24:44 kjcf05n04 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 2042176 (mkdir) Nov 4 18:24:44 kjcf05n04 systemd[1]: Mounting /mnt/llog... Nov 4 18:24:44 kjcf05n04 systemd[1]: Mounted /mnt/llog. Nov 4 18:24:45 kjcf05n05 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 2240055 (mkdir) Nov 4 18:24:45 kjcf05n05 systemd[1]: Mounting /mnt/llog... Nov 4 18:24:45 kjcf05n05 systemd[1]: Mounted /mnt/llog. Nov 4 18:24:46 kjcf05n06 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 2052481 (mkdir) Nov 4 18:24:46 kjcf05n06 systemd[1]: Mounting /mnt/llog... Nov 4 18:24:46 kjcf05n06 systemd[1]: Mounted /mnt/llog. Nov 4 18:24:47 kjcf05n07 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 2056774 (mkdir) Nov 4 18:24:47 kjcf05n07 systemd[1]: Mounting /mnt/llog... Nov 4 18:24:47 kjcf05n07 systemd[1]: Mounted /mnt/llog. Nov 4 18:24:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 18:24:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 18:24:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 18:24:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 18:25:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 18:25:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 18:25:06 kjcf05n00 mcfcli[3673891]: %3|1730766306.274|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:25:06 kjcf05n00 mcfcli[3673891]: %3|1730766306.938|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:25:22 kjcf05n00 zabbix_server[15719]: Zabbix agent item "dcs.lustre.device.ost.count[{$LUSTRE_FS_NAME}]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 4 18:25:22 kjcf05n00 zabbix_server[15750]: Zabbix agent item "system.localtime" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 4 18:25:27 kjcf05n03 fstonithd.py[15492]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 4 18:25:27 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 18:25:27 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 18:25:27 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 18:25:28 kjcf05n03 root[2328414]: is_enc_ipmi_off starts Nov 4 18:25:28 kjcf05n03 root[2328416]: is_viking_off starts Nov 4 18:25:28 kjcf05n03 root[2328432]: is_lan_ipmi_sec_off leaves Nov 4 18:25:28 kjcf05n03 root[2328434]: is_lan_ipmi_off leaves Nov 4 18:25:29 kjcf05n03 root[2328439]: I am not master; I will get master Nov 4 18:25:29 kjcf05n03 root[2328441]: I am in slot 1; partner is in slot 0 Nov 4 18:25:33 kjcf05n03 root[2328535]: I am now master Nov 4 18:25:35 kjcf05n03 root[2328550]: is_viking_off leaves Nov 4 18:25:35 kjcf05n03 root[2328553]: kjcf05n02 not already off look at kdump Nov 4 18:25:35 kjcf05n03 root[2328554]: is_kdump_off starts Nov 4 18:25:35 kjcf05n03 fence_kdump[2328555]: waiting for message from '172.16.2.5' Nov 4 18:25:35 kjcf05n03 fence_kdump[2328555]: received valid message from '172.16.2.5' Nov 4 18:25:35 kjcf05n03 root[2328571]: is_kdump_off detected kdump on kjcf05n02 Nov 4 18:25:35 kjcf05n03 root[2328572]: kjcf05n02 is kdumping Nov 4 18:25:35 kjcf05n03 root[2328669]: is_viking_off starts Nov 4 18:25:35 kjcf05n03 root[2328668]: is_enc_ipmi_off starts Nov 4 18:25:35 kjcf05n03 root[2328685]: is_lan_ipmi_off leaves Nov 4 18:25:35 kjcf05n03 root[2328687]: is_lan_ipmi_sec_off leaves Nov 4 18:25:35 kjcf05n03 root[2328690]: I am in slot 1; partner is in slot 0 Nov 4 18:25:35 kjcf05n03 root[2328693]: I am master Nov 4 18:25:36 kjcf05n00 python3.9[2330022]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 18:25:36 kjcf05n00 mcfcli[3673891]: %3|1730766336.939|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 18:25:37 kjcf05n00 zabbix_server[15729]: Zabbix agent item "vm.memory.size[pavailable]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 4 18:25:37 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0000,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 4 18:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 18:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 18:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 18:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 18:25:38 kjcf05n00 zabbix_server[15718]: Zabbix agent item "dcs.lustre.filesystem_name[kjcf05]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 4 18:25:40 kjcf05n03 LCNmon[18290]: 10.16.100.52 is unreachable via ib0 Nov 4 18:25:40 kjcf05n03 LCNmon[18290]: 10.16.100.58 is unreachable via ib0 Nov 4 18:25:41 kjcf05n00 mcfcli[3673891]: %3|1730766341.843|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:25:43 kjcf05n03 root[2329204]: is_viking_off leaves Nov 4 18:25:43 kjcf05n03 root[2329207]: kjcf05n02 not already off look at kdump Nov 4 18:25:43 kjcf05n03 root[2329209]: is_kdump_off starts Nov 4 18:25:43 kjcf05n03 fence_kdump[2329210]: waiting for message from '172.16.2.5' Nov 4 18:25:43 kjcf05n03 fence_kdump[2329210]: received valid message from '172.16.2.5' Nov 4 18:25:43 kjcf05n03 root[2329242]: is_kdump_off detected kdump on kjcf05n02 Nov 4 18:25:43 kjcf05n03 root[2329243]: kjcf05n02 is kdumping Nov 4 18:25:43 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 4 18:25:43 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 4 18:25:44 kjcf05n03 LCNmon[18290]: 10.16.100.52 is unreachable via ib1 Nov 4 18:25:44 kjcf05n03 LCNmon[18290]: 10.16.100.58 is unreachable via ib1 Nov 4 18:25:45 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='34', error='Connection reset by peer (104)' Nov 4 18:25:45 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='34', client='AF_INET(172.16.2.5:35359)', local='AF_INET(0.0.0.0:601)' Nov 4 18:25:47 kjcf05n03 dwd[5203]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 4 18:25:47 kjcf05n03 dwd[5203]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 4 18:25:47 kjcf05n03 dwd[5203]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 4 18:25:47 kjcf05n03 dwd[5203]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 4 18:25:47 kjcf05n03 dwd[5203]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 4 18:25:47 kjcf05n03 dwd[5203]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 4 18:25:47 kjcf05n03 dwd[5203]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 4 18:25:47 kjcf05n03 dwd[5203]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 4 18:25:47 kjcf05n03 dwd[5203]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 4 18:25:47 kjcf05n03 dwd[5203]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 4 18:25:47 kjcf05n03 dwd[5203]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 4 18:25:48 kjcf05n03 dwd[5203]: Starting NVME thread for nvme25n1 Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331579]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331580]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331581]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331583]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331579]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331580]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331581]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331583]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331579]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331581]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331580]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331583]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331579]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331581]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331580]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331583]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331579]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331600]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331601]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331583]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331580]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331581]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331602]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331609]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331579]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331600]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331601]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331581]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331583]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331602]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331609]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331579]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331600]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331601]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331581]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331583]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331602]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331579]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331609]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331601]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331581]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331583]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331579]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331583]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331579]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331579]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331602]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331609]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331579]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331583]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331583]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331583]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331583]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331583]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 systemd-udevd[2331601]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:25:48 kjcf05n03 dwd[5203]: Starting NVME thread for nvme8n1 Nov 4 18:25:48 kjcf05n03 dwd[5203]: Starting NVME thread for nvme18n1 Nov 4 18:25:48 kjcf05n03 dwd[5203]: Starting NVME thread for nvme23n1 Nov 4 18:25:48 kjcf05n03 dwd[5203]: Starting NVME thread for nvme9n1 Nov 4 18:25:48 kjcf05n03 dwd[5203]: Starting NVME thread for nvme4n1 Nov 4 18:25:48 kjcf05n03 dwd[5203]: Starting NVME thread for nvme2n1 Nov 4 18:25:49 kjcf05n03 dwd[5203]: Starting NVME thread for nvme3n1 Nov 4 18:25:49 kjcf05n03 dwd[5203]: Starting NVME thread for nvme19n1 Nov 4 18:25:49 kjcf05n03 dwd[5203]: Starting NVME thread for nvme17n1 Nov 4 18:25:49 kjcf05n03 dwd[5203]: Starting NVME thread for nvme24n1 Nov 4 18:25:52 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0002,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 4 18:25:53 kjcf05n00 zabbix_server[15783]: Zabbix agent item "agent.ping" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 4 18:25:54 kjcf05n03 diskmonitor[17871]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 4 18:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 18:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 18:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 18:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 18:25:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 18:25:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 18:25:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 18:25:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 18:26:00 kjcf05n03 diskmonitor[17871]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 4 18:26:00 kjcf05n03 diskmonitor[17871]: Scan for ReadErrorMax change for md65 Nov 4 18:26:00 kjcf05n03 diskmonitor[17871]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 4 18:26:00 kjcf05n03 diskmonitor[17871]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 4 18:26:00 kjcf05n03 diskmonitor[17871]: read_saved_file: md65 no saved speed Nov 4 18:26:00 kjcf05n03 diskmonitor[17871]: reconstruction_policy: sync_action prev = current = idle - md65 Nov 4 18:26:00 kjcf05n03 diskmonitor[17871]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 18:26:06 kjcf05n00 mcfcli[3673891]: %3|1730766366.939|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 18:26:07 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 4 18:26:08 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 4 18:26:18 kjcf05n00 mcfcli[3673891]: %3|1730766378.873|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:26:36 kjcf05n00 mcfcli[3673891]: %3|1730766396.939|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 18:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 18:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 18:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 18:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 18:26:40 kjcf05n03 LCNmon[18290]: 10.16.100.52 is unreachable via ib0 Nov 4 18:26:40 kjcf05n03 LCNmon[18290]: 10.16.100.58 is unreachable via ib0 Nov 4 18:26:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730766402}"] Nov 4 18:26:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730766402, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:26:42 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:42-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:42 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:42-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:42 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:42-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:42 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:42-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:42 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:42-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:42 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:42-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:42 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:42-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.22687ms Nov 4 18:26:42 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:42-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.22687ms Nov 4 18:26:42 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:26:42 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:26:42 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:26:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730766402}"] Nov 4 18:26:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730766402, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:26:42 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:42-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:42 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:42-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:42 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:42-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:42 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:42-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:42 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:42-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:42 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:42-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:42 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:42-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.030623ms Nov 4 18:26:42 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:42-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.030623ms Nov 4 18:26:42 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:26:42 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:26:42 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:26:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730766402}"] Nov 4 18:26:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730766402, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:26:42 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:42-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:42 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:42-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:42 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:42-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:42 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:42-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:42 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:42-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:42 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:42-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:42 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:42-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.951856ms Nov 4 18:26:42 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:42-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.951856ms Nov 4 18:26:42 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:26:42 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:26:42 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:26:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730766402}"] Nov 4 18:26:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730766402, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:26:42 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:42-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:42 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:42-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:42 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:42-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:42 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:42-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:42 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:42-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:42 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:42-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:42 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:42-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.054468ms Nov 4 18:26:42 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:42-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.054468ms Nov 4 18:26:42 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:26:42 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:26:42 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:26:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730766402}"] Nov 4 18:26:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730766402, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:26:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.052684ms Nov 4 18:26:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.052684ms Nov 4 18:26:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:26:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:26:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:26:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730766402}"] Nov 4 18:26:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730766402, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:26:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.931377ms Nov 4 18:26:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.931377ms Nov 4 18:26:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:26:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:26:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:26:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730766402}"] Nov 4 18:26:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730766402, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:26:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.805391ms Nov 4 18:26:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.805391ms Nov 4 18:26:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:26:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:26:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:26:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730766402}"] Nov 4 18:26:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730766402, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:26:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.758423ms Nov 4 18:26:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.758423ms Nov 4 18:26:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:26:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:26:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:26:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730766402}"] Nov 4 18:26:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730766402, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:26:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.125461ms Nov 4 18:26:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.125461ms Nov 4 18:26:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:26:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:26:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:26:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730766402}"] Nov 4 18:26:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730766402, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:26:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.941336ms Nov 4 18:26:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.941336ms Nov 4 18:26:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:26:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:26:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:26:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730766402}"] Nov 4 18:26:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730766402, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:26:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:26:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:26:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:26:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:26:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:26:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:26:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.804289ms Nov 4 18:26:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:26:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.804289ms Nov 4 18:26:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:26:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:26:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:26:44 kjcf05n03 LCNmon[18290]: 10.16.100.52 is unreachable via ib1 Nov 4 18:26:44 kjcf05n03 LCNmon[18290]: 10.16.100.58 is unreachable via ib1 Nov 4 18:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 18:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 18:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 18:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 18:26:57 kjcf05n00 mcfcli[3673891]: %3|1730766417.468|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:26:58 kjcf05n03 nslcd[6958]: [b71efb] ldap_result() failed: Can't contact LDAP server Nov 4 18:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 18:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 18:26:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 18:26:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 18:27:06 kjcf05n00 mcfcli[3673891]: %3|1730766426.939|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 18:27:34 kjcf05n00 mcfcli[3673891]: %3|1730766454.349|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:27:36 kjcf05n00 mcfcli[3673891]: %3|1730766456.939|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 18:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 18:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 18:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 18:27:40 kjcf05n03 LCNmon[18290]: 10.16.100.52 is unreachable via ib0 Nov 4 18:27:40 kjcf05n03 LCNmon[18290]: 10.16.100.58 is unreachable via ib0 Nov 4 18:27:44 kjcf05n03 LCNmon[18290]: 10.16.100.52 is unreachable via ib1 Nov 4 18:27:44 kjcf05n03 LCNmon[18290]: 10.16.100.58 is unreachable via ib1 Nov 4 18:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 18:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 18:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 18:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 18:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 18:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 18:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 18:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 18:28:06 kjcf05n00 mcfcli[3673891]: %3|1730766486.939|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 18:28:10 kjcf05n00 zabbix-server[2332061]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 18:28:10 kjcf05n00 zabbix-server[2332061]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 4 18:28:10 kjcf05n00 log_interesting_event.py[2332061]: Event '46552' acknowledged Nov 4 18:28:12 kjcf05n00 mcfcli[3673891]: %3|1730766492.439|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:28:21 kjcf05n03 chronyd[5171]: Selected source 172.16.2.1 Nov 4 18:28:36 kjcf05n00 mcfcli[3673891]: %3|1730766516.940|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 18:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 18:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 18:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 18:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 18:28:40 kjcf05n03 LCNmon[18290]: 10.16.100.52 is unreachable via ib0 Nov 4 18:28:40 kjcf05n03 LCNmon[18290]: 10.16.100.58 is unreachable via ib0 Nov 4 18:28:44 kjcf05n03 LCNmon[18290]: 10.16.100.52 is unreachable via ib1 Nov 4 18:28:44 kjcf05n03 LCNmon[18290]: 10.16.100.58 is unreachable via ib1 Nov 4 18:28:48 kjcf05n00 mcfcli[3673891]: %3|1730766528.914|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 18:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 18:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 18:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 18:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 18:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 18:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 18:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 18:29:06 kjcf05n00 mcfcli[3673891]: %3|1730766546.940|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 18:29:15 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 4 18:29:15 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 4 18:29:19 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 4 18:29:19 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 4 18:29:19 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 4 18:29:19 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 4 18:29:19 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 4 18:29:19 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 4 18:29:19 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 4 18:29:22 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 4 18:29:24 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 4 18:29:28 kjcf05n00 mcfcli[3673891]: %3|1730766568.360|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:29:36 kjcf05n00 mcfcli[3673891]: %3|1730766576.940|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 18:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 18:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 18:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 18:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 18:29:40 kjcf05n03 LCNmon[18290]: 10.16.100.52 is unreachable via ib0 Nov 4 18:29:40 kjcf05n03 LCNmon[18290]: 10.16.100.58 is unreachable via ib0 Nov 4 18:29:44 kjcf05n03 LCNmon[18290]: 10.16.100.52 is unreachable via ib1 Nov 4 18:29:44 kjcf05n03 LCNmon[18290]: 10.16.100.58 is unreachable via ib1 Nov 4 18:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 18:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 18:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 18:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 18:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 18:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 18:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 18:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 18:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 18:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 18:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 18:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 18:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 18:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 18:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 18:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 18:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 18:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 18:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 18:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 18:30:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 18:30:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:30:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 18:30:05 kjcf05n00 mcfcli[3673891]: %3|1730766605.610|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:30:06 kjcf05n00 mcfcli[3673891]: %3|1730766606.941|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 18:30:11 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:60902). Nov 4 18:30:11 kjcf05n01 rsyncd[3815491]: connect from kjcf05n02 (172.16.2.5) Nov 4 18:30:11 kjcf05n01 rsyncd[3815491]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 4 18:30:11 kjcf05n01 rsyncd[3815491]: building file list Nov 4 18:30:11 kjcf05n01 rsyncd[3815491]: sent 11450 bytes received 136 bytes total size 10905 Nov 4 18:30:11 kjcf05n01 systemd[1]: rsyncd@653-172.16.2.2:873-172.16.2.5:60902.service: Succeeded. Nov 4 18:30:27 kjcf05n03 fstonithd.py[15492]: Listening for kdump packets from partner Nov 4 18:30:34 kjcf05n00 python3.9[2333491]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 18:30:36 kjcf05n00 mcfcli[3673891]: %3|1730766636.941|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 18:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 18:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 18:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 18:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 18:30:40 kjcf05n03 LCNmon[18290]: 10.16.100.52 is unreachable via ib0 Nov 4 18:30:40 kjcf05n03 LCNmon[18290]: 10.16.100.58 is unreachable via ib0 Nov 4 18:30:43 kjcf05n00 mcfcli[3673891]: %3|1730766643.240|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:30:44 kjcf05n03 LCNmon[18290]: 10.16.100.52 is unreachable via ib1 Nov 4 18:30:44 kjcf05n03 LCNmon[18290]: 10.16.100.58 is unreachable via ib1 Nov 4 18:30:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730766648', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 18:30:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730766648'} Nov 4 18:30:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:30:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730766648', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 18:30:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730766648'} Nov 4 18:30:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 18:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 18:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 18:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 18:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 18:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 18:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 18:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 18:31:06 kjcf05n00 mcfcli[3673891]: %3|1730766666.941|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:31:13 kjcf05n03 dwd[5203]: nvme25n1 passed periodic SMART status check Nov 4 18:31:14 kjcf05n03 dwd[5203]: nvme9n1 passed periodic SMART status check Nov 4 18:31:14 kjcf05n03 dwd[5203]: nvme4n1 passed periodic SMART status check Nov 4 18:31:14 kjcf05n03 dwd[5203]: nvme2n1 passed periodic SMART status check Nov 4 18:31:14 kjcf05n03 dwd[5203]: nvme18n1 passed periodic SMART status check Nov 4 18:31:14 kjcf05n03 dwd[5203]: nvme8n1 passed periodic SMART status check Nov 4 18:31:14 kjcf05n03 dwd[5203]: nvme23n1 passed periodic SMART status check Nov 4 18:31:15 kjcf05n03 dwd[5203]: nvme24n1 passed periodic SMART status check Nov 4 18:31:15 kjcf05n03 dwd[5203]: nvme19n1 passed periodic SMART status check Nov 4 18:31:15 kjcf05n03 dwd[5203]: nvme3n1 passed periodic SMART status check Nov 4 18:31:15 kjcf05n03 dwd[5203]: nvme17n1 passed periodic SMART status check Nov 4 18:31:21 kjcf05n00 mcfcli[3673891]: %3|1730766681.418|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:31:30 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 4 18:31:36 kjcf05n00 mcfcli[3673891]: %3|1730766696.941|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 18:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 18:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 18:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 18:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 18:31:37 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='70', client='AF_INET(172.16.2.5:37913)', local='AF_INET(0.0.0.0:601)' Nov 4 18:31:37 kjcf05n02 syslog-ng[3190]: Configuration reload request received, reloading configuration; Nov 4 18:31:37 kjcf05n02 syslog-ng[3190]: Configuration reload finished; Nov 4 18:31:37 kjcf05n02 syslog-ng[3190]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 4 18:31:37 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 4 18:31:37 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 18:31:37 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 4 18:31:37 kjcf05n02 dracut: Self testing crypto algorithms Nov 4 18:31:37 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 4 18:31:37 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 18:31:37 kjcf05n02 Copying live image to RAM... Nov 4 18:31:37 kjcf05n02 (this may take a minute) Nov 4 18:31:37 kjcf05n02 Done copying live image to RAM. Nov 4 18:31:37 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 4 18:31:37 kjcf05n02 dracut: Checking integrity of kernel Nov 4 18:31:37 kjcf05n02 dracut: All initrd crypto checks done Nov 4 18:31:37 kjcf05n02 dracut: Switching root Nov 4 18:31:37 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 4 18:31:37 kjcf05n02 systemd: Detected architecture x86-64. Nov 4 18:31:37 kjcf05n02 systemd: Set hostname to . Nov 4 18:31:37 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 4 18:31:37 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 4 18:31:37 kjcf05n02 systemd: Listening on Journal Socket. Nov 4 18:31:37 kjcf05n02 systemd: Mounting Kernel Debug File System... Nov 4 18:31:37 kjcf05n02 systemd: Mounting /mnt... Nov 4 18:31:37 kjcf05n02 systemd: Mounting Huge Pages File System... Nov 4 18:31:37 kjcf05n02 systemd: Starting Create list of required static device nodes for the current kernel... Nov 4 18:31:37 kjcf05n02 systemd-journald[1518]: Journal started Nov 4 18:31:37 kjcf05n02 systemd-journald[1518]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 18:31:37 kjcf05n02 systemd-modules-load[1509]: Inserted module 'fuse' Nov 4 18:31:37 kjcf05n02 systemd[1]: Mounted Kernel Debug File System. Nov 4 18:31:37 kjcf05n02 systemd[1]: Mounted /mnt. Nov 4 18:31:37 kjcf05n02 systemd[1]: Mounted Huge Pages File System. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Create list of required static device nodes for the current kernel. Nov 4 18:31:37 kjcf05n02 systemd[1]: Mounted /WIBS. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Load Kernel Modules. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 4 18:31:37 kjcf05n02 systemd[1]: Mounted /data. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Remount Root and Kernel File Systems. Nov 4 18:31:37 kjcf05n02 systemd[1]: Mounted Temporary Directory (/tmp). Nov 4 18:31:37 kjcf05n02 systemd[1]: Mounted POSIX Message Queue File System. Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Rebuild Hardware Database... Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Load/Save Random Seed... Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Create System Users... Nov 4 18:31:37 kjcf05n02 systemd[1]: Mounting Kernel Configuration File System... Nov 4 18:31:37 kjcf05n02 systemd[1]: Mounting FUSE Control File System... Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Apply Kernel Variables... Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 4 18:31:37 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 4 18:31:37 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Create System Users. Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 4 18:31:37 kjcf05n02 systemd-sysctl[1535]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 18:31:37 kjcf05n02 systemd-sysctl[1535]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 4 18:31:37 kjcf05n02 systemd-journald[1518]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 4 18:31:37 kjcf05n02 systemd-tmpfiles[1539]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 18:31:37 kjcf05n02 systemd-tmpfiles[1539]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 4 18:31:37 kjcf05n02 systemd-udevd[1550]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 4 18:31:37 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 4 18:31:37 kjcf05n02 systemd-udevd[1598]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 18:31:37 kjcf05n02 systemd-udevd[1558]: Using default interface naming scheme 'rhel-8.0'. Nov 4 18:31:37 kjcf05n02 systemd-udevd[1558]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 18:31:37 kjcf05n02 systemd-udevd[1577]: Using default interface naming scheme 'rhel-8.0'. Nov 4 18:31:37 kjcf05n02 systemd-udevd[1577]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 18:31:37 kjcf05n02 systemd-udevd[1604]: Using default interface naming scheme 'rhel-8.0'. Nov 4 18:31:37 kjcf05n02 systemd-udevd[1604]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 4 18:31:37 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 4 18:31:37 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 4 18:31:37 kjcf05n02 systemd-tmpfiles[1769]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 18:31:37 kjcf05n02 systemd-tmpfiles[1769]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 4 18:31:37 kjcf05n02 systemd-tmpfiles[1769]: "/var/tmp" already exists and is not a directory. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 4 18:31:37 kjcf05n02 root[1793]: openibd: running in auto mode Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started RPC Bind. Nov 4 18:31:37 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 4 18:31:37 kjcf05n02 systemd-modules-load[1860]: Inserted module 'ib_iser' Nov 4 18:31:37 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 4 18:31:37 kjcf05n02 systemd-modules-load[1860]: Inserted module 'ib_isert' Nov 4 18:31:37 kjcf05n02 systemd-modules-load[1860]: Inserted module 'ib_srpt' Nov 4 18:31:37 kjcf05n02 systemd-udevd[1598]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 18:31:37 kjcf05n02 systemd-modules-load[1855]: Inserted module 'ib_ipoib' Nov 4 18:31:37 kjcf05n02 systemd-udevd[1612]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 18:31:37 kjcf05n02 systemd-modules-load[1860]: Inserted module 'rdma_ucm' Nov 4 18:31:37 kjcf05n02 systemd-modules-load[1860]: Module 'svcrdma' is blacklisted Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 4 18:31:37 kjcf05n02 systemd-udevd[1598]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 18:31:37 kjcf05n02 systemd-udevd[1612]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 18:31:37 kjcf05n02 systemd-modules-load[1855]: Inserted module 'ib_umad' Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 4 18:31:37 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 4 18:31:37 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 4 18:31:37 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 18:31:37 kjcf05n02 systemd[3190]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:31:37 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 4 18:31:37 kjcf05n02 openibd[1776]: Loading HCA driver and Access Layer:[ OK ] Nov 4 18:31:37 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Update is Completed. Nov 4 18:31:37 kjcf05n02 setup-icl[1760]: Setting LAN IP Address to 203.0.113.3 Nov 4 18:31:37 kjcf05n02 setup-icl[1760]: Setting LAN Subnet Mask to 255.255.255.0 Nov 4 18:31:37 kjcf05n02 setup-icl[1760]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 4 18:31:37 kjcf05n02 setup-icl[1760]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 4 18:31:37 kjcf05n02 systemd-udevd[1612]: Using default interface naming scheme 'rhel-8.0'. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 4 18:31:37 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 4 18:31:37 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 4 18:31:37 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 4 18:31:37 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 4 18:31:37 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 4 18:31:37 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 4 18:31:37 kjcf05n02 systemd[1]: Reached target Sockets. Nov 4 18:31:37 kjcf05n02 systemd[1]: Reached target Basic System. Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 4 18:31:37 kjcf05n02 nscd[2119]: 2119 monitoring file `/etc/hosts` (1) Nov 4 18:31:37 kjcf05n02 nscd[2119]: 2119 monitoring directory `/etc` (2) Nov 4 18:31:37 kjcf05n02 nscd[2119]: 2119 monitoring file `/etc/resolv.conf` (3) Nov 4 18:31:37 kjcf05n02 nscd[2119]: 2119 monitoring directory `/etc` (2) Nov 4 18:31:37 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 4 18:31:37 kjcf05n02 mdraid-phy[2113]: no Cutlass to worry about Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 0 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 1 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 2 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 3 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 4 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 5 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 6 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 7 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 8 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 9 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 10 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 11 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 12 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 13 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 14 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 15 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 16 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 17 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 18 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 19 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 20 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 21 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 22 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 23 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 24 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 25 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 26 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 27 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 28 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 29 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 30 Nov 4 18:31:37 kjcf05n02 cpupower[2140]: Setting cpu: 31 Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[2141]: Setting up Mellanox network interface: ib1 Nov 4 18:31:37 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 4 18:31:37 kjcf05n02 chronyd[2174]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 4 18:31:37 kjcf05n02 dwd[2144]: dwd: vMay 29 2024 : 15:38:26 Nov 4 18:31:37 kjcf05n02 dwd[2144]: /usr/sbin/dwd -d --standalone=0 Nov 4 18:31:37 kjcf05n02 dwd[2144]: dwd: option Lethal: 0 Nov 4 18:31:37 kjcf05n02 dwd[2144]: dwd: option Interval: 60 Nov 4 18:31:37 kjcf05n02 dwd[2144]: dwd: option abrtlimit: 10 Nov 4 18:31:37 kjcf05n02 dwd[2144]: dwd: option DZPeriod: 604800 Nov 4 18:31:37 kjcf05n02 dwd[2144]: dwd: option SmartPeriod: 43200 Nov 4 18:31:37 kjcf05n02 dwd[2144]: dwd: option SDDEnabled: 1 Nov 4 18:31:37 kjcf05n02 dwd[2144]: dwd: option SDDAwaitScale: 3 Nov 4 18:31:37 kjcf05n02 dwd[2144]: dwd: option SDDAwaitMin: 100 Nov 4 18:31:37 kjcf05n02 dwd[2144]: dwd: option Verbosity: 1 Nov 4 18:31:37 kjcf05n02 dwd[2144]: dwd: option StandAlone: 0 Nov 4 18:31:37 kjcf05n02 dwd[2144]: option Lethal: 0 Nov 4 18:31:37 kjcf05n02 dwd[2144]: option Interval: 60 Nov 4 18:31:37 kjcf05n02 dwd[2144]: option abrtlimit: 10 Nov 4 18:31:37 kjcf05n02 dwd[2144]: option DZPeriod: 604800 Nov 4 18:31:37 kjcf05n02 dwd[2144]: option SmartPeriod: 43200 Nov 4 18:31:37 kjcf05n02 dwd[2144]: option SDDEnabled: 1 Nov 4 18:31:37 kjcf05n02 dwd[2144]: option SDDAwaitScale: 3 Nov 4 18:31:37 kjcf05n02 dwd[2144]: option SDDAwaitMin: 100 Nov 4 18:31:37 kjcf05n02 dwd[2144]: option Verbosity: 1 Nov 4 18:31:37 kjcf05n02 dwd[2144]: option StandAlone: 0 Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 18:31:37 kjcf05n02 mcelog[2180]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 4 18:31:37 kjcf05n02 mcelog[2180]: CPU is unsupported Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[2166]: Setting up Mellanox network interface: ib0 Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 4 18:31:37 kjcf05n02 dbus-daemon[2169]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 4 18:31:37 kjcf05n02 chronyd[2174]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 18:31:37 kjcf05n02 chronyd[2174]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[2229]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 18:31:37 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 4 18:31:37 kjcf05n02 network[2238]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 18:31:37 kjcf05n02 beSetMlxConfig[2235]: ConnectX-3 multiport not detected Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[2236]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[2265]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 18:31:37 kjcf05n02 network[2269]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 0 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 1 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 2 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 3 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 4 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 5 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 6 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 7 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 8 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 9 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 10 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 11 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 12 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 13 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 14 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 15 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 16 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 17 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 18 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 19 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 20 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 21 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 22 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 23 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 24 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 25 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 26 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 27 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 28 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 29 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 30 Nov 4 18:31:37 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 31 Nov 4 18:31:37 kjcf05n02 network[2238]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 18:31:37 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[2279]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 18:31:37 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 4 18:31:37 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 4 18:31:37 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[2280]: No configuration found for ib1 Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 4 18:31:37 kjcf05n02 network[2284]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 18:31:37 kjcf05n02 network[2238]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[2291]: No configuration found for ib0 Nov 4 18:31:37 kjcf05n02 beSetMlxConfig[2235]: Starting MST (Mellanox Software Tools) driver set Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[2304]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 18:31:37 kjcf05n02 network[2306]: It is advised to switch to 'NetworkManager' instead for network management. Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[2311]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 18:31:37 kjcf05n02 beSetMlxConfig[2235]: Loading MST PCI module - Success Nov 4 18:31:37 kjcf05n02 mlnx_conf_mgr[2344]: INFO: No configurations found for mlx5_1, skipping. Nov 4 18:31:37 kjcf05n02 sssd[sssd][2210]: Starting up Nov 4 18:31:37 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 18:31:37 kjcf05n02 mlnx_conf_mgr[2367]: INFO: No configurations found for mlx5_0, skipping. Nov 4 18:31:37 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 18:31:37 kjcf05n02 beSetMlxConfig[2235]: Loading MST PCI configuration module - Success Nov 4 18:31:37 kjcf05n02 beSetMlxConfig[2235]: Create devices Nov 4 18:31:37 kjcf05n02 sssd[be[implicit_files]][2397]: Starting up Nov 4 18:31:37 kjcf05n02 sssd[nss][2485]: Starting up Nov 4 18:31:37 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 4 18:31:37 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Login Service... Nov 4 18:31:37 kjcf05n02 systemd-logind[2591]: New seat seat0. Nov 4 18:31:37 kjcf05n02 systemd-logind[2591]: Watching system buttons on /dev/input/event0 (Power Button) Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Login Service. Nov 4 18:31:37 kjcf05n02 python3.9[2185]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 18:31:37 kjcf05n02 python3.9[3190]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 18:31:37 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 4 18:31:37 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 18:31:37 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 4 18:31:37 kjcf05n02 systemd-sysctl[2794]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 18:31:37 kjcf05n02 systemd-sysctl[2794]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 18:31:37 kjcf05n02 python3.9[2815]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 18:31:37 kjcf05n02 python3.9[3190]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 4 18:31:37 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 18:31:37 kjcf05n02 network[2238]: Bringing up loopback interface: [ OK ] Nov 4 18:31:37 kjcf05n02 systemd-sysctl[3134]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 18:31:37 kjcf05n02 systemd-sysctl[3134]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 18:31:37 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 4 18:31:37 kjcf05n02 python3.9[3043]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 18:31:37 kjcf05n02 python3.9[3190]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:31:37 kjcf05n02 systemd[1]: Reached target Network. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 4 18:31:37 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 4 18:31:37 kjcf05n02 sm-notify[3193]: Version 2.3.3 starting Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 4 18:31:37 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 4 18:31:37 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 4 18:31:37 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 4 18:31:37 kjcf05n02 lldpad[3170]: setsockopt nearest_bridge: Invalid argument Nov 4 18:31:37 kjcf05n02 sshd[3204]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 4 18:31:37 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 4 18:31:37 kjcf05n02 lldpad[3170]: setsockopt nearest_bridge: Invalid argument Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 4 18:31:37 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 4 18:31:37 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 18:31:37 kjcf05n02 syslog-ng[3190]: [2024-11-05T00:30:24.842057] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 4 18:31:37 kjcf05n02 syslog-ng[3190]: [2024-11-05T00:30:24.842370] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 4 18:31:37 kjcf05n02 syslog-ng[3190]: [2024-11-05T00:30:24.842405] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 4 18:31:37 kjcf05n02 syslog-ng[3190]: [2024-11-05T00:30:24.842955] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 4 18:31:37 kjcf05n02 syslog-ng[3190]: [2024-11-05T00:30:24.843146] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 4 18:31:37 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 4 18:31:37 kjcf05n02 beSetMlxConfig[2235]: Unloading MST PCI module (unused) - Success Nov 4 18:31:37 kjcf05n02 python3.9[3218]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 18:31:37 kjcf05n02 python3.9[3190]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 4 18:31:37 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 18:31:37 kjcf05n02 python3.9[3441]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 18:31:37 kjcf05n02 python3.9[3190]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 4 18:31:37 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 4 18:31:37 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 18:31:37 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 4 18:31:37 kjcf05n02 chronyd[2174]: System's initial offset : 0.004872 seconds slow of true (slew) Nov 4 18:31:37 kjcf05n02 systemd[1]: Started NTP client/server. Nov 4 18:31:37 kjcf05n02 beSetMlxConfig[2235]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 18:31:37 kjcf05n02 beSetMlxConfig[2235]: ib mode Nov 4 18:31:37 kjcf05n02 root[3461]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 4 18:31:37 kjcf05n02 root[3463]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 4 18:31:37 kjcf05n02 beSetMlxConfig[2235]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 18:31:37 kjcf05n02 beSetMlxConfig[2235]: ib mode Nov 4 18:31:37 kjcf05n02 systemd-udevd[1550]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 18:31:37 kjcf05n02 systemd-udevd[3480]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 18:31:37 kjcf05n02 systemd-udevd[3481]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 18:31:37 kjcf05n02 systemd-udevd[3484]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 18:31:37 kjcf05n02 systemd-udevd[3488]: Using default interface naming scheme 'rhel-8.0'. Nov 4 18:31:37 kjcf05n02 systemd-udevd[3488]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 18:31:37 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 18:31:37 kjcf05n02 systemd[3190]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:31:37 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[3522]: Setting up Mellanox network interface: ib1 Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[3523]: Setting up Mellanox network interface: ib0 Nov 4 18:31:37 kjcf05n02 systemd-udevd[3483]: Using default interface naming scheme 'rhel-8.0'. Nov 4 18:31:37 kjcf05n02 systemd-udevd[3483]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[3572]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[3573]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[3588]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[3589]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[3590]: No configuration found for ib0 Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[3591]: No configuration found for ib1 Nov 4 18:31:37 kjcf05n02 systemd-udevd[3482]: Using default interface naming scheme 'rhel-8.0'. Nov 4 18:31:37 kjcf05n02 systemd-udevd[3482]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[3596]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[3599]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 18:31:37 kjcf05n02 mlnx_conf_mgr[3648]: INFO: No configurations found for mlx5_0, skipping. Nov 4 18:31:37 kjcf05n02 mlnx_conf_mgr[3654]: INFO: No configurations found for mlx5_1, skipping. Nov 4 18:31:37 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 18:31:37 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 18:31:37 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 4 18:31:37 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 4 18:31:37 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 4 18:31:37 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 4 18:31:37 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 4 18:31:37 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 18:31:37 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 4 18:31:37 kjcf05n02 lldpad[3170]: init_ports: Error adding device ib0 Nov 4 18:31:37 kjcf05n02 lldpad[3170]: init_ports: Error adding device ib1 Nov 4 18:31:37 kjcf05n02 lldpad[3170]: Signal 15 received - terminating Nov 4 18:31:37 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 4 18:31:37 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 4 18:31:37 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 4 18:31:37 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 4 18:31:37 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 4 18:31:37 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 4 18:31:37 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 4 18:31:37 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:37 kjcf05n02 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:31:37 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 1 | Nov-03-2024 | 23:33:21 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 2 | Nov-03-2024 | 23:34:13 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 3 | Nov-03-2024 | 23:34:14 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 4 | Nov-03-2024 | 23:35:19 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 5 | Nov-03-2024 | 23:35:20 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 6 | Nov-05-2024 | 00:27:44 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 7 | Nov-05-2024 | 00:27:44 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 8 | Nov-05-2024 | 00:27:44 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 9 | Nov-05-2024 | 00:27:44 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 10 | Nov-05-2024 | 00:27:44 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 11 | Nov-05-2024 | 00:27:44 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 12 | Nov-05-2024 | 00:27:44 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 13 | Nov-05-2024 | 00:27:44 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 14 | Nov-05-2024 | 00:27:44 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 15 | Nov-05-2024 | 00:27:44 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 16 | Nov-05-2024 | 00:27:44 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 17 | Nov-05-2024 | 00:27:44 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 18 | Nov-05-2024 | 00:28:14 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 19 | Nov-05-2024 | 00:28:14 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 20 | Nov-05-2024 | 00:28:14 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 21 | Nov-05-2024 | 00:28:14 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 22 | Nov-05-2024 | 00:28:14 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 23 | Nov-05-2024 | 00:28:14 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 24 | Nov-05-2024 | 00:28:14 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 25 | Nov-05-2024 | 00:28:14 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 26 | Nov-05-2024 | 00:28:14 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 27 | Nov-05-2024 | 00:28:14 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 28 | Nov-05-2024 | 00:28:14 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 18:31:37 kjcf05n02 ipmievd[3994]: 29 | Nov-05-2024 | 00:28:14 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 18:31:37 kjcf05n02 ipmievd[3997]: Reading sensors... Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 4 18:31:37 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:37 kjcf05n02 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 4 18:31:37 kjcf05n02 nscd[2119]: 2119 monitored file `/etc/hosts` was moved into place, adding watch Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 18:31:37 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 4 18:31:37 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 4 18:31:37 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 4 18:31:37 kjcf05n02 beSetMlxConfig[4053]: ConnectX-3 multiport not detected Nov 4 18:31:37 kjcf05n02 beSetMlxConfig[4053]: Starting MST (Mellanox Software Tools) driver set Nov 4 18:31:37 kjcf05n02 beSetMlxConfig[4053]: Loading MST PCI module - Success Nov 4 18:31:37 kjcf05n02 systemd-udevd[1550]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 18:31:37 kjcf05n02 beSetMlxConfig[4053]: [warn] mst_pciconf is already loaded, skipping Nov 4 18:31:37 kjcf05n02 beSetMlxConfig[4053]: Create devices Nov 4 18:31:37 kjcf05n02 beSetMlxConfig[4053]: Unloading MST PCI module (unused) - Success Nov 4 18:31:37 kjcf05n02 ipmievd[3997]: Waiting for events... Nov 4 18:31:37 kjcf05n02 beSetMlxConfig[4053]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 18:31:37 kjcf05n02 beSetMlxConfig[4053]: ib mode Nov 4 18:31:37 kjcf05n02 beSetMlxConfig[4053]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 18:31:37 kjcf05n02 beSetMlxConfig[4053]: ib mode Nov 4 18:31:37 kjcf05n02 systemd-udevd[1550]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 18:31:37 kjcf05n02 systemd-udevd[4954]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 18:31:37 kjcf05n02 systemd-udevd[4955]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 18:31:37 kjcf05n02 systemd-udevd[4958]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 18:31:37 kjcf05n02 systemd-udevd[4959]: Using default interface naming scheme 'rhel-8.0'. Nov 4 18:31:37 kjcf05n02 systemd-udevd[4959]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 18:31:37 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 18:31:37 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 18:31:37 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 18:31:37 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[4991]: Setting up Mellanox network interface: ib1 Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[4997]: Setting up Mellanox network interface: ib0 Nov 4 18:31:37 kjcf05n02 systemd-udevd[4956]: Using default interface naming scheme 'rhel-8.0'. Nov 4 18:31:37 kjcf05n02 systemd-udevd[4957]: Using default interface naming scheme 'rhel-8.0'. Nov 4 18:31:37 kjcf05n02 systemd-udevd[4956]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 18:31:37 kjcf05n02 systemd-udevd[4957]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[5042]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[5049]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[5072]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[5079]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[5081]: No configuration found for ib1 Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[5082]: No configuration found for ib0 Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[5086]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 18:31:37 kjcf05n02 mlnx_interface_mgr[5090]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 18:31:37 kjcf05n02 mlnx_conf_mgr[5126]: INFO: No configurations found for mlx5_1, skipping. Nov 4 18:31:37 kjcf05n02 mlnx_conf_mgr[5130]: INFO: No configurations found for mlx5_0, skipping. Nov 4 18:31:37 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 18:31:37 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}da615ae38b0b913fa12f50e3476571b39564218131061b1f05d194720daeb08e' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}da615ae38b0b913fa12f50e3476571b39564218131061b1f05d194720daeb08e' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}779d8618da71cbb283c50d62df9ac3fa6749d6633c0c3c80bf4b7cb294f6c94e' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}779d8618da71cbb283c50d62df9ac3fa6749d6633c0c3c80bf4b7cb294f6c94e' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}d5f968ae9cb78608db0dee27c51ab1fb51bb133375243a5de7ad59198d42187c' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}d5f968ae9cb78608db0dee27c51ab1fb51bb133375243a5de7ad59198d42187c' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}d5dbf84971a5c7e4446631ca7b6888ac46917836e2d0888b360ae53918dcac0d' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}d5dbf84971a5c7e4446631ca7b6888ac46917836e2d0888b360ae53918dcac0d' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 18:31:37 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 4 18:31:37 kjcf05n02 chronyd[2174]: chronyd exiting Nov 4 18:31:37 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 4 18:31:37 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 4 18:31:37 kjcf05n02 chronyd[5164]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 18:31:37 kjcf05n02 chronyd[5164]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 18:31:37 kjcf05n02 chronyd[5164]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 18:31:37 kjcf05n02 chronyd[5164]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 4 18:31:37 kjcf05n02 systemd[1]: Started NTP client/server. Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 18:31:37 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:37 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 4 18:31:37 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 4 18:31:37 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 18:31:37 kjcf05n02 dwd[5195]: dwd: vMay 29 2024 : 15:38:26 Nov 4 18:31:37 kjcf05n02 dwd[5195]: /usr/sbin/dwd -i 15 -d Nov 4 18:31:37 kjcf05n02 dwd[5195]: dwd: option Lethal: 0 Nov 4 18:31:37 kjcf05n02 dwd[5195]: dwd: option Interval: 15 Nov 4 18:31:37 kjcf05n02 dwd[5195]: dwd: option abrtlimit: 10 Nov 4 18:31:37 kjcf05n02 dwd[5195]: dwd: option DZPeriod: 604800 Nov 4 18:31:37 kjcf05n02 dwd[5195]: dwd: option SmartPeriod: 43200 Nov 4 18:31:37 kjcf05n02 dwd[5195]: dwd: option SDDEnabled: 1 Nov 4 18:31:37 kjcf05n02 dwd[5195]: dwd: option SDDAwaitScale: 3 Nov 4 18:31:37 kjcf05n02 dwd[5195]: dwd: option SDDAwaitMin: 100 Nov 4 18:31:37 kjcf05n02 dwd[5195]: dwd: option Verbosity: 1 Nov 4 18:31:37 kjcf05n02 dwd[5195]: dwd: option StandAlone: 0 Nov 4 18:31:37 kjcf05n02 dwd[5195]: option Lethal: 0 Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 18:31:37 kjcf05n02 dwd[5195]: option Interval: 15 Nov 4 18:31:37 kjcf05n02 dwd[5195]: option abrtlimit: 10 Nov 4 18:31:37 kjcf05n02 dwd[5195]: option DZPeriod: 604800 Nov 4 18:31:37 kjcf05n02 dwd[5195]: option SmartPeriod: 43200 Nov 4 18:31:37 kjcf05n02 dwd[5195]: option SDDEnabled: 1 Nov 4 18:31:37 kjcf05n02 dwd[5195]: option SDDAwaitScale: 3 Nov 4 18:31:37 kjcf05n02 dwd[5195]: option SDDAwaitMin: 100 Nov 4 18:31:37 kjcf05n02 dwd[5195]: option Verbosity: 1 Nov 4 18:31:37 kjcf05n02 dwd[5195]: option StandAlone: 0 Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 4 18:31:37 kjcf05n02 dwd[5196]: option Lethal now set to 1 Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 18:31:37 kjcf05n02 dwd[5196]: option abrtlimit now set to 1 Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 18:31:37 kjcf05n02 dwd[5196]: option SmartPeriod now set to 86400 Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 18:31:37 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 18:31:37 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:31:37 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:37 kjcf05n02 python3.9[5225]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 4 18:31:37 kjcf05n02 python3.9[3190]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 18:31:37 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:31:37 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 18:31:37 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:37 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 4 18:31:37 kjcf05n02 sedcpwrkr[5364]: Using config script: /etc/sedcpwrkr.conf Nov 4 18:31:37 kjcf05n02 sedcpwrkr[5364]: - Creating default directory: '/var/log/sedcpwrkr' Nov 4 18:31:37 kjcf05n02 sedcpwrkr[5364]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 4 18:31:37 kjcf05n02 sedcpwrkr[5364]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 4 18:31:37 kjcf05n02 sedcpwrkr[5364]: - Creating default directory: '/var/run/sedcpwrkr' Nov 4 18:31:37 kjcf05n02 sedcpwrkr[5364]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 4 18:31:37 kjcf05n02 sedcpwrkr[5364]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 4 18:31:37 kjcf05n02 sedcpwrkr-server[5395]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 18:31:37 kjcf05n02 sedcpwrkr[5364]: celery multi v5.2.7 (dawn-chorus) Nov 4 18:31:37 kjcf05n02 sedcpwrkr[5364]: > Starting nodes... Nov 4 18:31:37 kjcf05n02 sedcpwrkr[5364]: > sedcpwrkr@kjcf05n02: OK Nov 4 18:31:37 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 4 18:31:37 kjcf05n02 sedcpwrkr-server[5397]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 18:31:37 kjcf05n02 sedcpwrkr-server[5397]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 18:31:37 kjcf05n02 sedcpwrkr-server[5397]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 18:31:37 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 18:31:37 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 4 18:31:37 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 18:31:37 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 4 18:31:37 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 4 18:31:38 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:38 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 4 18:31:38 kjcf05n02 systemd-udevd[1550]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 18:31:38 kjcf05n02 iptables.init[5464]: iptables: Applying firewall rules: [ OK ] Nov 4 18:31:38 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 4 18:31:38 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:39 kjcf05n02 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 18:31:39 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 18:31:39 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 18:31:39 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:40 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 18:31:40 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5562 which is not our child. We'll most likely not notice when it exits. Nov 4 18:31:40 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 18:31:40 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:40 kjcf05n02 openhpid[5562]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 18:31:40 kjcf05n02 openhpid[5562]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 18:31:40 kjcf05n02 openhpid[5562]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 18:31:40 kjcf05n02 openhpid[5562]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 18:31:40 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:40 kjcf05n03 LCNmon[18290]: 10.16.100.52 is unreachable via ib0 Nov 4 18:31:40 kjcf05n03 LCNmon[18290]: 10.16.100.58 is unreachable via ib0 Nov 4 18:31:40 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:31:40 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:31:40 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 4 18:31:40 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 4 18:31:40 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 18:31:40 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 18:31:40 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:41 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 4 18:31:41 kjcf05n02 dcs-collectord[5653]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 4 18:31:41 kjcf05n02 hpi.inv.log[5653]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 4 18:31:41 kjcf05n02 dcs-collectord[5653]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 4 18:31:41 kjcf05n02 dcs-collectord[5653]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 4 18:31:41 kjcf05n02 dcs-collector[5644]: Starting dcs-collector:[ OK ] Nov 4 18:31:41 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 4 18:31:41 kjcf05n02 dcs-collectord[5656]: INFO Starting collection for memory_info (collection_process.py:52) Nov 4 18:31:41 kjcf05n02 dcs-collectord[5656]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 18:31:41 kjcf05n02 dcs-collectord[5656]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 18:31:41 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 4 18:31:41 kjcf05n02 dcs-collectord[5656]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 18:31:41 kjcf05n02 dcs-collectord[5656]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 4 18:31:41 kjcf05n02 dcs-collectord[5656]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 4 18:31:41 kjcf05n02 dcs-collectord[5656]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 4 18:31:41 kjcf05n02 dcs-collectord[5656]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259353172", "units": "kB"}, {"name": "MemAvailable", "value": "258632460", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821184", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686912", "units": "kB"}, {"name": "Inactive", "value": "959796", "units": "kB"}, {"name": "Active(anon)", "value": "1520788", "units": "kB"}, {"name": "Inactive(anon)", "value": "823644", "units": "kB"}, {"name": "Active(file)", "value": "166124", "units": "kB"}, {"name": "Inactive(file)", "value": "136152", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "751116", "units": "kB"}, {"name": "Mapped", "value": "87240", "units": "kB"}, {"name": "Shmem", "value": "1593360", "units": "kB"}, {"name": "KReclaimable", "value": "108460", "units": "kB"}, {"name": "Slab", "value": "271180", "units": "kB"}, {"name": "SReclaimable", "value": "108460", "units": "kB"}, {"name": "SUnreclaim", "value": "162720", "units": "kB"}, {"name": "KernelStack", "value": "9624", "units": "kB"}, {"name": "PageTables", "value": "20096", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3274492", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11136", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "4096", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "252232", "units": "kB"}, {"name": "DirectMap2M", "value": "21633024", "units": "kB"}, {"name": "DirectMap1G", "value": "246415360", "units": "kB"}]}' Nov 4 18:31:41 kjcf05n02 dcs-collectord[5656]: INFO Completed collection for memory_info (collection_process.py:59) Nov 4 18:31:41 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:41 kjcf05n02 dcs-collectord[5656]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 4 18:31:41 kjcf05n02 dcs-collectord[5656]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730766701.193505], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730766701.437369], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730766701.1234758, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 4 18:31:41 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:41 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 4 18:31:41 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:31:41 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:31:41 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 4 18:31:41 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 4 18:31:41 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 18:31:41 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 18:31:42 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:42 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 4 18:31:42 kjcf05n02 firmware-update-orc[5762]: Using config script: /etc/firmware_update_orc.conf Nov 4 18:31:42 kjcf05n02 firmware-update-orc[5762]: - Creating default directory: '/var/log/firmware-update-orc' Nov 4 18:31:42 kjcf05n02 firmware-update-orc[5762]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 4 18:31:42 kjcf05n02 firmware-update-orc[5762]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 4 18:31:42 kjcf05n02 firmware-update-orc[5762]: - Creating default directory: '/var/run/firmware-update-orc' Nov 4 18:31:42 kjcf05n02 firmware-update-orc[5762]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 4 18:31:42 kjcf05n02 firmware-update-orc[5762]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 4 18:31:42 kjcf05n02 firmware-update-orc-server[5800]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 18:31:42 kjcf05n02 firmware-update-orc[5762]: celery multi v5.2.7 (dawn-chorus) Nov 4 18:31:42 kjcf05n02 firmware-update-orc[5762]: > Starting nodes... Nov 4 18:31:42 kjcf05n02 firmware-update-orc[5762]: > worker1@kjcf05n02: OK Nov 4 18:31:42 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 4 18:31:42 kjcf05n02 firmware-update-orc-server[5802]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 18:31:42 kjcf05n02 firmware-update-orc-server[5802]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 18:31:42 kjcf05n02 firmware-update-orc-server[5802]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 18:31:42 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 4 18:31:42 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:43 kjcf05n02 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:31:43 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:31:43 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:31:43 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 18:31:43 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 18:31:43 kjcf05n02 dbus-daemon[2169]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 18:31:43 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 18:31:43 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 18:31:43 kjcf05n02 dbus-daemon[2169]: [system] Reloaded configuration Nov 4 18:31:43 kjcf05n02 dbus-daemon[2169]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 18:31:43 kjcf05n02 dbus-daemon[2169]: [system] Reloaded configuration Nov 4 18:31:43 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 4 18:31:43 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 4 18:31:43 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 18:31:43 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 18:31:43 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 18:31:43 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 18:31:43 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:43 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 4 18:31:44 kjcf05n02 ras-resource-manager-agent[5918]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 4 18:31:44 kjcf05n02 ras-resource-manager-agent[5904]: Starting ras-resource-manager-agent:[ OK ] Nov 4 18:31:44 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 4 18:31:44 kjcf05n02 ras-resource-manager-agent[5920]: INFO Starting the service handler (service_main_handler.py:98) Nov 4 18:31:44 kjcf05n02 ras-resource-manager-client[5920]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 4 18:31:44 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 4 18:31:44 kjcf05n02 ras-resource-manager-client[5920]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 18:31:44 kjcf05n02 ras-resource-manager-client[5930]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 18:31:44 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:44 kjcf05n03 LCNmon[18290]: 10.16.100.52 is unreachable via ib1 Nov 4 18:31:44 kjcf05n03 LCNmon[18290]: 10.16.100.58 is unreachable via ib1 Nov 4 18:31:44 kjcf05n02 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:31:44 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:31:44 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:31:44 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 18:31:44 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 18:31:44 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:44 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 18:31:44 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:45 kjcf05n02 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: Starting Zabbix Agent 2 (6.2.1) Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: Starting Zabbix Agent 2 (6.2.1) Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: Press Ctrl+C to exit. Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: Plugin support version 1.0 Nov 4 18:31:45 kjcf05n02 zabbix_agent2[6004]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 18:31:45 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:31:45 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:31:45 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:45 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 4 18:31:45 kjcf05n02 dcs-notification-sender[6080]: dcs-notification-senderd is stopped Nov 4 18:31:45 kjcf05n02 zabbix-agent2[6094]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 4 18:31:45 kjcf05n02 dcs-notification-sender[6080]: Starting notification-sender:[ OK ] Nov 4 18:31:45 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 4 18:31:46 kjcf05n02 zabbix-agent2[6100]: INFO DCS notification agent started. (agent.py:61) Nov 4 18:31:46 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 4 18:31:46 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:46 kjcf05n02 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:31:46 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:31:46 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:31:46 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:46 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 4 18:31:46 kjcf05n02 dcs-collectord[6182]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 4 18:31:47 kjcf05n02 dcs-collectord[6182]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 4 18:31:47 kjcf05n02 dcs-bulk-data-sender[6182]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 4 18:31:47 kjcf05n02 dcs-bulk-data-sender[6173]: Starting bulk-data-sender:[ OK ] Nov 4 18:31:47 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 4 18:31:47 kjcf05n02 dcs-collectord[6184]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 4 18:31:47 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 4 18:31:47 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:47 kjcf05n02 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:31:47 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:31:47 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:31:47 kjcf05n02 nscd[2119]: 2119 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 4 18:31:47 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 18:31:47 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 18:31:47 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 18:31:47 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 18:31:47 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 18:31:47 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 18:31:47 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 4 18:31:47 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 4 18:31:47 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 4 18:31:47 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 4 18:31:47 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 18:31:47 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 18:31:47 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 18:31:47 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 18:31:48 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 18:31:48 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 18:31:48 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 18:31:48 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 18:31:48 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 4 18:31:48 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 4 18:31:48 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 4 18:31:48 kjcf05n02 sssd[nss][2485]: Shutting down (status = 0) Nov 4 18:31:48 kjcf05n02 sssd[be[implicit_files]][2397]: Shutting down (status = 0) Nov 4 18:31:48 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 4 18:31:48 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 4 18:31:48 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 4 18:31:48 kjcf05n02 python3.9[5225]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 4 18:31:48 kjcf05n02 python3.9[3190]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:31:48 kjcf05n02 sssd[sssd][6276]: Starting up Nov 4 18:31:48 kjcf05n02 sssd[be[implicit_files]][6277]: Starting up Nov 4 18:31:48 kjcf05n02 sssd[nss][6278]: Starting up Nov 4 18:31:49 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 18:31:49 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 4 18:31:49 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:50 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 4 18:31:50 kjcf05n02 icinga2[6339]: [2024-11-04 18:31:50 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 4 18:31:50 kjcf05n02 icinga2[6339]: [2024-11-04 18:31:50 -0600] information/cli: Loading configuration file(s). Nov 4 18:31:50 kjcf05n02 icinga2[6339]: [2024-11-04 18:31:50 -0600] information/ConfigItem: Committing config item(s). Nov 4 18:31:50 kjcf05n02 icinga2[6339]: [2024-11-04 18:31:50 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 4 18:31:50 kjcf05n02 icinga2[6339]: [2024-11-04 18:31:50 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 4 18:31:50 kjcf05n02 icinga2[6339]: [2024-11-04 18:31:50 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 4 18:31:50 kjcf05n02 icinga2[6339]: [2024-11-04 18:31:50 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 4 18:31:50 kjcf05n02 icinga2[6339]: [2024-11-04 18:31:50 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 4 18:31:50 kjcf05n02 icinga2[6339]: [2024-11-04 18:31:50 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 4 18:31:50 kjcf05n02 icinga2[6339]: [2024-11-04 18:31:50 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 4 18:31:50 kjcf05n02 icinga2[6339]: [2024-11-04 18:31:50 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 4 18:31:50 kjcf05n02 icinga2[6339]: [2024-11-04 18:31:50 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 4 18:31:50 kjcf05n02 icinga2[6339]: [2024-11-04 18:31:50 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 4 18:31:50 kjcf05n02 icinga2[6339]: [2024-11-04 18:31:50 -0600] information/cli: Closing console log. Nov 4 18:31:50 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 4 18:31:50 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:51 kjcf05n02 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:31:51 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:31:51 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:31:51 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 18:31:51 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 18:31:51 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:52 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 4 18:31:52 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:52 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 18:31:52 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:31:52 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:31:52 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 18:31:52 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 18:31:52 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 18:31:52 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 18:31:52 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 4 18:31:52 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 4 18:31:52 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 4 18:31:52 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 4 18:31:52 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 18:31:52 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 18:31:52 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 18:31:52 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 18:31:52 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 4 18:31:52 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 4 18:31:52 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:53 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 4 18:31:53 kjcf05n02 nslcd[6957]: version 0.9.9 starting Nov 4 18:31:53 kjcf05n02 nslcd[6957]: accepting connections Nov 4 18:31:53 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 4 18:31:53 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:53 kjcf05n02 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:31:53 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:31:53 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:31:53 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 18:31:53 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 18:31:54 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 18:31:54 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 18:31:54 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 18:31:54 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 18:31:54 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 18:31:54 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 18:31:54 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:55 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 4 18:31:55 kjcf05n02 dearcpw[7041]: Using config script: /etc/dearcpw.conf Nov 4 18:31:55 kjcf05n02 dearcpw[7041]: - Creating default directory: '/var/log/dearcpw' Nov 4 18:31:55 kjcf05n02 dearcpw[7041]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 4 18:31:55 kjcf05n02 dearcpw[7041]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 4 18:31:55 kjcf05n02 dearcpw[7041]: - Creating default directory: '/var/run/dearcpw' Nov 4 18:31:55 kjcf05n02 dearcpw[7041]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 4 18:31:55 kjcf05n02 dearcpw[7041]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 4 18:31:55 kjcf05n02 dcs-bulk-data-sender[6184]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 4 18:31:55 kjcf05n02 dcs-collectord[6184]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 4 18:31:55 kjcf05n02 dearcpw-server[7238]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 18:31:55 kjcf05n02 dearcpw[7041]: celery multi v5.2.7 (dawn-chorus) Nov 4 18:31:55 kjcf05n02 dearcpw[7041]: > Starting nodes... Nov 4 18:31:55 kjcf05n02 dearcpw[7041]: > dearcpw@kjcf05n02: OK Nov 4 18:31:55 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 4 18:31:55 kjcf05n02 dearcpw-server[7240]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 18:31:55 kjcf05n02 dearcpw-server[7240]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 18:31:55 kjcf05n02 dearcpw-server[7240]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 18:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 18:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 18:31:55 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 4 18:31:55 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:31:55 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:31:55 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 4 18:31:55 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 4 18:31:55 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 4 18:31:55 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 4 18:31:55 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 4 18:31:55 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 4 18:31:55 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 4 18:31:55 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 4 18:31:55 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 4 18:31:55 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 4 18:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 18:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 18:31:56 kjcf05n02 puppet[7430]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 4 18:31:56 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 4 18:31:56 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 4 18:31:56 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 4 18:31:56 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 4 18:31:56 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 4 18:31:56 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 4 18:31:56 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 18:31:56 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 18:31:56 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:60936). Nov 4 18:31:56 kjcf05n01 rsyncd[3816018]: connect from kjcf05n02 (172.16.2.5) Nov 4 18:31:56 kjcf05n01 rsyncd[3816018]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 4 18:31:56 kjcf05n01 rsyncd[3816018]: receiving file list Nov 4 18:31:56 kjcf05n01 rsyncd[3816018]: sent 29 bytes received 325 bytes total size 10905 Nov 4 18:31:56 kjcf05n01 systemd[1]: rsyncd@654-172.16.2.2:873-172.16.2.5:60936.service: Succeeded. Nov 4 18:31:56 kjcf05n02 dcs-collectord[5656]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 18:31:56 kjcf05n02 dcs-collectord[5656]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 18:31:56 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 18:31:56 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 18:31:57 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 18:31:57 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 18:31:57 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 18:31:57 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 18:31:57 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 18:31:57 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 18:31:57 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 18:31:57 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 18:31:58 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 18:31:58 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 18:31:58 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 18:31:58 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 18:31:59 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 18:31:59 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 18:31:59 kjcf05n02 systemd[1]: Reloading. Nov 4 18:31:59 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 4 18:31:59 kjcf05n02 diskless-swap[7625]: HA_PS_000: recovering journal Nov 4 18:31:59 kjcf05n02 systemd-udevd[1550]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 18:31:59 kjcf05n02 diskless-swap[7625]: HA_PS_000: clean, 2287/6400 files, 7083/25600 blocks Nov 4 18:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 18:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 18:32:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 18:32:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 18:31:59 kjcf05n00 mcfcli[3673891]: %3|1730766719.718|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:32:00 kjcf05n02 ipmievd[3997]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 4 18:32:00 kjcf05n02 ipmievd[3997]: System Event sensor - Timestamp Clock Sync Nov 4 18:32:00 kjcf05n02 ipmievd[3190]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:32:00 kjcf05n02 diskless-swap[7625]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 4 18:32:00 kjcf05n02 diskless-swap[7625]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 4 18:32:00 kjcf05n02 diskless-swap[7625]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 4 18:32:00 kjcf05n02 diskless-swap[7625]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 4 18:32:00 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 4 18:32:00 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:32:00 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:32:00 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 4 18:32:00 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 4 18:32:00 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 18:32:00 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 18:32:00 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 4 18:32:00 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 4 18:32:00 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 4 18:32:00 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 4 18:32:00 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 4 18:32:00 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 4 18:32:00 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 4 18:32:00 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 4 18:32:00 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 4 18:32:00 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 4 18:32:00 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 18:32:00 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 18:32:01 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 18:32:01 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 18:32:01 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 18:32:01 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 18:32:02 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 18:32:02 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 18:32:02 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 18:32:02 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 18:32:02 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 18:32:02 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 18:32:02 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 18:32:02 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 18:32:03 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 18:32:03 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 18:32:03 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 18:32:03 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 18:32:03 kjcf05n02 systemd[1]: Reloading. Nov 4 18:32:03 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 4 18:32:03 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:32:03 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:32:03 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 4 18:32:03 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 4 18:32:03 kjcf05n02 systemd[1]: Reloading. Nov 4 18:32:04 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 4 18:32:04 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:32:04 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:32:04 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 18:32:04 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 18:32:04 kjcf05n02 systemd[1]: Reloading. Nov 4 18:32:04 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 4 18:32:04 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:32:04 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:32:04 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 4 18:32:04 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 4 18:32:04 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 4 18:32:04 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 4 18:32:04 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 4 18:32:04 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 4 18:32:04 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 18:32:04 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 18:32:04 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 18:32:04 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 18:32:04 kjcf05n02 systemd[1]: Reloading. Nov 4 18:32:05 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 4 18:32:05 kjcf05n02 kdumpctl[7859]: kdump: No kdump initial ramdisk found. Nov 4 18:32:05 kjcf05n02 kdumpctl[7859]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 4 18:32:05 kjcf05n02 dracut[7987]: dracut-049-135.git20210121.el8 Nov 4 18:32:05 kjcf05n02 dracut[7989]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 4 18:32:05 kjcf05n02 dracut[7989]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 18:32:05 kjcf05n02 dracut[7989]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 18:32:05 kjcf05n02 dracut[7989]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 4 18:32:05 kjcf05n02 dracut[7989]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 4 18:32:05 kjcf05n02 dracut[7989]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 18:32:05 kjcf05n02 dracut[7989]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 18:32:05 kjcf05n02 dracut[7989]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + is_func check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check -h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local dev holder Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + require_binaries mdadm expr Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _module_name=90hperaid Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ mdadm = \-\m ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for cmd in "$@" Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + find_binary mdadm Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for cmd in "$@" Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + find_binary expr Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n -h ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for dev in "${!host_fs_types[@]}" Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ nfs != *_raid_member ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + continue Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _ret=255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + ret=255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ 255 = 0 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ 255 = 255 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ module_depends hperaid Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: +++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: +++ set -x Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ depends Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo rootfs-block Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ return 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ _ret=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ return 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for _moddep in $(module_depends $_mod) Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all == *\ hperaid\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + add_dracutmodules+=' rootfs-block ' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ == *\ hperaid\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check_module rootfs-block Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _mod=rootfs-block Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ == *\ rootfs-block\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n '' ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + mods_checked_as_dep+=' rootfs-block ' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all == *\ rootfs-block\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + module_check rootfs-block 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 2 -eq 2 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _forced=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + is_func check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check -h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _ret=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + ret=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ 0 = 0 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ module_depends rootfs-block Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: +++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 18:32:06 kjcf05n02 kdumpctl[3190]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ depends Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo fs-lib Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ _ret=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ return 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for _moddep in $(module_depends $_mod) Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all == *\ rootfs-block\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + add_dracutmodules+=' fs-lib ' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ == *\ rootfs-block\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check_module fs-lib Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _mod=fs-lib Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n '' ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + mods_checked_as_dep+=' fs-lib ' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all == *\ fs-lib\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + module_check fs-lib 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 2 -eq 2 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _forced=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + is_func check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check -h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _ret=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + ret=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ 0 = 0 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ module_depends fs-lib Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: +++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ depends Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ return 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ _ret=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ return 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + mods_to_load+=' fs-lib ' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + mods_to_load+=' rootfs-block ' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + mods_to_load+=' hperaid ' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _mod=90kernel-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _mod=kernel-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check_module kernel-modules 1 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _mod=kernel-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all = all ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + module_check kernel-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 1 -eq 2 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + is_func check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check -h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + true Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _ret=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + ret=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ 0 != 0 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ module_depends kernel-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: +++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ depends Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ true Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ _ret=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ return 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + mods_to_load+=' kernel-modules ' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _mod=90kernel-modules-extra Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _mod=kernel-modules-extra Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check_module kernel-modules-extra 1 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _mod=kernel-modules-extra Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all = all ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + module_check kernel-modules-extra Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 1 -eq 2 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + is_func check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check -h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + true Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _ret=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + ret=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ 0 != 0 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ module_depends kernel-modules-extra Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: +++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ depends Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ true Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ _ret=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ return 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + mods_to_load+=' kernel-modules-extra ' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _mod=90kernel-network-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _mod=kernel-network-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check_module kernel-network-modules 1 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _mod=kernel-network-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all = all ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + module_check kernel-network-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 1 -eq 2 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + is_func check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check -h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _ret=255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + ret=255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ 255 != 0 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 1 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _mod=90livenet Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _mod=livenet Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check_module livenet 1 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _mod=livenet Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all = all ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + module_check livenet Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 1 -eq 2 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + is_func check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check -h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _ret=255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + ret=255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ 255 != 0 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 1 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _mod=90lvm Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _mod=lvm Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check_module lvm 1 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _mod=lvm Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all = all ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + module_check lvm Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 1 -eq 2 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + is_func check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check -h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + require_binaries lvm Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _module_name=90lvm Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ lvm = \-\m ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for cmd in "$@" Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + find_binary lvm Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n -h ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for fs in "${host_fs_types[@]}" Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ nfs = LVM*_member ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _ret=255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + ret=255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ 255 != 0 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 1 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _mod=90mdraid Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _mod=mdraid Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check_module mdraid 1 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _mod=mdraid Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all = all ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + module_check mdraid Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 1 -eq 2 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + is_func check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check -h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _rootdev Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + require_binaries mdadm expr Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _module_name=90mdraid Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ mdadm = \-\m ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for cmd in "$@" Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + find_binary mdadm Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for cmd in "$@" Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + find_binary expr Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n -h ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for dev in "${!host_fs_types[@]}" Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ nfs != *_raid_member ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + continue Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _ret=255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + ret=255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ 255 != 0 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 1 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _mod=90multipath Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _mod=multipath Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check_module multipath 1 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _mod=multipath Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all = all ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + module_check multipath Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 1 -eq 2 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + is_func check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check -h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _rootdev Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n -h ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for_each_host_dev_and_slaves is_mpath Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _func=is_mpath Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _dev Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for _dev in "${host_devs[@]}" Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + continue Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 1 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _ret=255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + ret=255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ 255 != 0 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 1 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _mod=90qemu Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _mod=qemu Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check_module qemu 1 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _mod=qemu Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all = all ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + module_check qemu Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 1 -eq 2 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + is_func check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check -h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n -h ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + type -P systemd-detect-virt Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ systemd-detect-virt --vm Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + vm=none Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + (( 1 != 0 )) Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _ret=255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + ret=255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ 255 != 0 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 1 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _mod=90qemu-net Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _mod=qemu-net Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check_module qemu-net 1 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _mod=qemu-net Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all = all ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + module_check qemu-net Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 1 -eq 2 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + is_func check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check -h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n -h ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + type -P systemd-detect-virt Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ systemd-detect-virt --vm Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + vm= Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + (( 1 != 0 )) Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _ret=255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + ret=255 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ 255 != 0 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + return 1 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _mod=90stratis Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + _mod=stratis Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check_module stratis 1 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _mod=stratis Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddep Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -n 1 ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ all = all ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + module_check stratis Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ read a b Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _forced=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _hostonly=-h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 1 -eq 2 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + is_func check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: ++ type -t check Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + '[' 0 -ne 0 ']' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + check -h Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _module_name=90stratis Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + local _ret=0 Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + [[ stratisd-init = \-\m ]] Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + for cmd in "$@" Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + find_binary stratisd-init Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 4 18:32:06 kjcf05n02 kdumpctl[7859]: + set +x Nov 4 18:32:06 kjcf05n02 dracut[7989]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 18:32:06 kjcf05n02 dracut[7989]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 4 18:32:06 kjcf05n02 dracut[7989]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 4 18:32:06 kjcf05n02 dracut[7989]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 4 18:32:06 kjcf05n02 dracut[7989]: memstrack is available Nov 4 18:32:06 kjcf05n02 dracut[7989]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 18:32:06 kjcf05n02 dracut[7989]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 18:32:06 kjcf05n02 dracut[7989]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 18:32:06 kjcf05n02 dracut[7989]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 18:32:06 kjcf05n02 dracut[7989]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 18:32:06 kjcf05n02 dracut[7989]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 18:32:06 kjcf05n02 dracut[7989]: *** Including module: bash *** Nov 4 18:32:06 kjcf05n02 dracut[7989]: *** Including module: systemd *** Nov 4 18:32:06 kjcf05n00 mcfcli[3673891]: %3|1730766726.942|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 18:32:07 kjcf05n02 dracut[7989]: *** Including module: fips *** Nov 4 18:32:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730766727', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.95, 1.87, 0.82'}"] Nov 4 18:32:08 kjcf05n02 dracut[7989]: *** Including module: systemd-initrd *** Nov 4 18:32:08 kjcf05n02 dracut[7989]: *** Including module: watchdog-modules *** Nov 4 18:32:08 kjcf05n02 dracut[7989]: *** Including module: nss-softokn *** Nov 4 18:32:08 kjcf05n02 dracut[7989]: *** Including module: i18n *** Nov 4 18:32:08 kjcf05n02 dracut[7989]: No KEYMAP configured. Nov 4 18:32:08 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 1.95, 1.87, 0.82', 'message': 'OK - load average: 1.95, 1.87, 0.82', 'value': 'ok', 'timestamp': '1730766727'} Nov 4 18:32:08 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:32:08 kjcf05n02 dracut[7989]: *** Including module: network-legacy *** Nov 4 18:32:08 kjcf05n02 dracut[7989]: *** Including module: network *** Nov 4 18:32:08 kjcf05n02 dracut[7989]: *** Including module: ib_bonding *** Nov 4 18:32:08 kjcf05n02 dracut[7989]: *** Including module: drm *** Nov 4 18:32:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730766729', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 331 processes with STATE = RSZDT '}"] Nov 4 18:32:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 331 processes with STATE = RSZDT ', 'message': 'PROCS OK: 331 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730766729'} Nov 4 18:32:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:32:11 kjcf05n02 dcs-collectord[5656]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 18:32:11 kjcf05n02 dcs-collectord[5656]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 18:32:12 kjcf05n02 dracut[7989]: *** Including module: hperaid *** Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + install Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + local rule rule_path Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + inst_multiple cat expr Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.ZFyg7e/initramfs -a -f cat expr Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + _ret=0 Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + (( 0 != 0 )) Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + : Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + return 0 Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + inst_multiple -o mdmon Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.ZFyg7e/initramfs -a -f -o mdmon Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + _ret=0 Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + (( 0 != 0 )) Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + : Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + return 0 Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: ++ command -v partx Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + inst /usr/sbin/partx /sbin/partx Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + local _hostonly_install Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + [[ /usr/sbin/partx == \-\H ]] Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + [[ -e /tmp/dracut.ZFyg7e/initramfs//sbin/partx ]] Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.ZFyg7e/initramfs -f /usr/sbin/partx /sbin/partx Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + (( 0 != 0 )) Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + : Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: ++ command -v mdadm Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + local _hostonly_install Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + [[ -e /tmp/dracut.ZFyg7e/initramfs//sbin/mdadm ]] Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.ZFyg7e/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + (( 0 != 0 )) Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + : Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + [[ yes == \y\e\s ]] Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + local _raidconf Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: ++ cmdline Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: ++ local _activated dev line UUID Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: ++ declare -A _activated Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: ++ for dev in "${!host_fs_types[@]}" Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: ++ [[ nfs != *_raid_member ]] Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: ++ continue Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + _raidconf= Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + [[ -n '' ]] Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + inst_rules 64-md-raid.rules Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + local _target=/etc/udev/rules.d _rule _found Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + inst_dir /usr/lib/udev/rules.d Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + [[ -e /tmp/dracut.ZFyg7e/initramfs//usr/lib/udev/rules.d ]] Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + return 0 Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + inst_dir /etc/udev/rules.d Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + [[ -e /tmp/dracut.ZFyg7e/initramfs//etc/udev/rules.d ]] Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + return 0 Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + for _rule in "$@" Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + continue Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + continue Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + for r in '' $dracutbasedir/rules.d/ Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + [[ 64-md-raid.rules != /* ]] Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + continue Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + for r in '' $dracutbasedir/rules.d/ Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + continue Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + [[ -n '' ]] Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + set +x Nov 4 18:32:12 kjcf05n02 dracut[7989]: Skipping udev rule: 64-md-raid.rules Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + installkernel Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + instmods =drivers/md Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + local _optional=-o Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + local _silent Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + local _ret Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + [[ '' = yes ]] Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + [[ =drivers/md = \-\c ]] Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + [[ =drivers/md = \-\s ]] Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + (( 1 == 0 )) Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.ZFyg7e/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + _ret=0 Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + (( 0 != 0 )) Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + [[ -n '' ]] Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + return 0 Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + _ret=0 Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + unset check depends cmdline install installkernel Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + return 0 Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + modules_loaded+='hperaid ' Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + '[' -n '' ']' Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + _d_mod=90kernel-modules Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + _d_mod=kernel-modules Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + [[ '' = yes ]] Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + dinfo '*** Including module: kernel-modules ***' Nov 4 18:32:12 kjcf05n02 kdumpctl[7859]: + set +x Nov 4 18:32:12 kjcf05n02 dracut[7989]: *** Including module: kernel-modules *** Nov 4 18:32:12 kjcf05n02 dracut[7989]: *** Including module: kernel-modules-extra *** Nov 4 18:32:13 kjcf05n02 dracut[7989]: *** Including module: kernel-network-modules *** Nov 4 18:32:13 kjcf05n02 dracut[7989]: *** Including module: diskless-mod *** Nov 4 18:32:13 kjcf05n02 dracut[7989]: *** Including module: fstab-sys *** Nov 4 18:32:13 kjcf05n02 dracut[7989]: *** Including module: nfs *** Nov 4 18:32:14 kjcf05n02 dracut[7989]: *** Including module: rootfs-block *** Nov 4 18:32:14 kjcf05n02 dracut[7989]: *** Including module: terminfo *** Nov 4 18:32:14 kjcf05n02 dracut[7989]: *** Including module: udev-rules *** Nov 4 18:32:14 kjcf05n02 dracut[7989]: Skipping udev rule: 91-permissions.rules Nov 4 18:32:14 kjcf05n02 dracut[7989]: Skipping udev rule: 80-drivers-modprobe.rules Nov 4 18:32:14 kjcf05n02 dracut[7989]: *** Including module: dracut-systemd *** Nov 4 18:32:15 kjcf05n02 dracut[7989]: *** Including module: usrmount *** Nov 4 18:32:15 kjcf05n02 dracut[7989]: *** Including module: base *** Nov 4 18:32:15 kjcf05n02 dracut[7989]: *** Including module: fs-lib *** Nov 4 18:32:15 kjcf05n02 dracut[7989]: *** Including module: kdumpbase *** Nov 4 18:32:16 kjcf05n02 dracut[7989]: *** Including module: memstrack *** Nov 4 18:32:16 kjcf05n02 dracut[7989]: *** Including module: shutdown *** Nov 4 18:32:16 kjcf05n02 dracut[7989]: *** Including module: squash *** Nov 4 18:32:16 kjcf05n02 dracut[7989]: *** Including modules done *** Nov 4 18:32:16 kjcf05n02 dracut[7989]: *** Installing kernel module dependencies *** Nov 4 18:32:17 kjcf05n02 dracut[7989]: *** Installing kernel module dependencies done *** Nov 4 18:32:17 kjcf05n02 dracut[7989]: *** Resolving executable dependencies *** Nov 4 18:32:18 kjcf05n02 dracut[7989]: *** Resolving executable dependencies done*** Nov 4 18:32:18 kjcf05n02 dracut[7989]: *** Hardlinking files *** Nov 4 18:32:18 kjcf05n02 dracut[7989]: *** Hardlinking files done *** Nov 4 18:32:18 kjcf05n02 dracut[7989]: *** Generating early-microcode cpio image *** Nov 4 18:32:18 kjcf05n02 dracut[7989]: *** Constructing AuthenticAMD.bin **** Nov 4 18:32:18 kjcf05n02 dracut[7989]: *** Store current command line parameters *** Nov 4 18:32:18 kjcf05n02 dracut[7989]: Stored kernel commandline: Nov 4 18:32:18 kjcf05n02 dracut[7989]: rd.driver.pre=sd_mod Nov 4 18:32:18 kjcf05n02 dracut[7989]: rd.driver.pre=nvme Nov 4 18:32:18 kjcf05n02 dracut[7989]: rd.driver.pre=ipmi_si Nov 4 18:32:18 kjcf05n02 dracut[7989]: rd.driver.pre=ipmi_devintf Nov 4 18:32:18 kjcf05n02 dracut[7989]: rd.driver.pre=ipmi_msghandler Nov 4 18:32:18 kjcf05n02 dracut[7989]: nameserver=172.16.2.2 Nov 4 18:32:18 kjcf05n02 dracut[7989]: nameserver=127.0.0.1 Nov 4 18:32:18 kjcf05n02 dracut[7989]: nameserver=172.16.2.2 Nov 4 18:32:18 kjcf05n02 dracut[7989]: nameserver=127.0.0.1 Nov 4 18:32:18 kjcf05n02 dracut[7989]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 4 18:32:18 kjcf05n02 dracut[7989]: rd.neednet Nov 4 18:32:18 kjcf05n02 dracut[7989]: kdumpnic=mgmt0 Nov 4 18:32:18 kjcf05n02 dracut[7989]: bootdev=mgmt0 Nov 4 18:32:18 kjcf05n02 dracut[7989]: *** Install squash loader *** Nov 4 18:32:18 kjcf05n02 dracut[7989]: *** Squashing the files inside the initramfs *** Nov 4 18:32:19 kjcf05n02 dracut[7989]: *** Squashing the files inside the initramfs done *** Nov 4 18:32:19 kjcf05n02 dracut[7989]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 4 18:32:19 kjcf05n02 dracut[7989]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 4 18:32:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730766739', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.4% (3732600 kB) used.'}"] Nov 4 18:32:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.4% (3732600 kB) used.', 'message': 'OK - 1.4% (3732600 kB) used.', 'value': 'ok', 'timestamp': '1730766739'} Nov 4 18:32:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:32:20 kjcf05n02 kdumpctl[7859]: kdump: kexec: loaded kdump kernel Nov 4 18:32:20 kjcf05n02 kdumpctl[7859]: kdump: Starting kdump: [OK] Nov 4 18:32:20 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 4 18:32:20 kjcf05n02 systemd[1]: Reloading. Nov 4 18:32:20 kjcf05n02 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:32:20 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:32:20 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:32:20 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 4 18:32:20 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 4 18:32:20 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 4 18:32:20 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 4 18:32:20 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 4 18:32:20 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 4 18:32:20 kjcf05n02 ifdown[14563]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 18:32:20 kjcf05n02 ifdown[14564]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 18:32:20 kjcf05n02 ifdown[14565]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 18:32:20 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 18:32:20 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 18:32:20 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 18:32:21 kjcf05n02 ifup[14625]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 18:32:21 kjcf05n02 ifup[14626]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 18:32:21 kjcf05n02 ifup[14627]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 18:32:22 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 4 18:32:25 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 18:32:25 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 18:32:25 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 18:32:25 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 18:32:25 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 18:32:25 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 18:32:25 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 18:32:25 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 18:32:25 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 18:32:25 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 18:32:25 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 18:32:25 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 18:32:25 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 18:32:25 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 18:32:25 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 18:32:25 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 4 18:32:25 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 4 18:32:25 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 4 18:32:25 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 4 18:32:25 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 4 18:32:25 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 4 18:32:25 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 4 18:32:25 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 4 18:32:25 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 4 18:32:25 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 4 18:32:25 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 4 18:32:25 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 4 18:32:25 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 4 18:32:25 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 4 18:32:25 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 4 18:32:25 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 4 18:32:25 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 4 18:32:25 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 4 18:32:25 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 4 18:32:25 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 4 18:32:25 kjcf05n02 ifdown[14812]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 18:32:25 kjcf05n02 ifdown[14813]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 18:32:25 kjcf05n02 ifdown[14814]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 18:32:25 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 18:32:25 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 18:32:25 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 18:32:25 kjcf05n02 ifup[14874]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 18:32:25 kjcf05n02 ifup[14875]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 18:32:25 kjcf05n02 ifup[14876]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 18:32:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730766745', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 4 18:32:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730766745'} Nov 4 18:32:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:32:26 kjcf05n02 dcs-collectord[5656]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 18:32:26 kjcf05n02 dcs-collectord[5656]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 18:32:27 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 4 18:32:30 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 18:32:30 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 18:32:30 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 18:32:30 kjcf05n02 systemd[1]: Reloading. Nov 4 18:32:30 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 4 18:32:30 kjcf05n02 await_ha_peer[15080]: Waiting for HA peer kjcf05n03 Nov 4 18:32:31 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 4 18:32:32 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 4 18:32:32 kjcf05n02 await_ha_peer[15080]: Peer kjcf05n03 has started, starting HA Nov 4 18:32:32 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 4 18:32:32 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 4 18:32:32 kjcf05n02 fstonithd.py[15145]: Listening for kdump packets from partner Nov 4 18:32:32 kjcf05n02 systemd[1]: Reloading. Nov 4 18:32:32 kjcf05n02 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:32:32 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:32:32 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:32:32 kjcf05n02 systemd[1]: Reloading. Nov 4 18:32:33 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 4 18:32:33 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 4 18:32:33 kjcf05n02 systemd[1]: Reloading. Nov 4 18:32:33 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 18:32:33 kjcf05n02 puppet-agent[3614]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 4 18:32:33 kjcf05n02 puppet[3614]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 4 18:32:33 kjcf05n02 puppet-agent[3614]: Applied catalog in 92.77 seconds Nov 4 18:32:33 kjcf05n02 puppet[3614]: Notice: Applied catalog in 92.77 seconds Nov 4 18:32:33 kjcf05n02 systemd[1]: Started Puppet agent. Nov 4 18:32:33 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 4 18:32:33 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 4 18:32:33 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 4 18:32:33 kjcf05n02 systemd[1]: Reached target Timers. Nov 4 18:32:33 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 4 18:32:33 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 18:32:33 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 4 18:32:33 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 4 18:32:33 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 4 18:32:33 kjcf05n02 wce-disable.sh[15288]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 4 18:32:33 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 4 18:32:33 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 4 18:32:33 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 18:32:33 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 18:32:33 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 4 18:32:33 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 4 18:32:34 kjcf05n02 python3.9[15292]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 4 18:32:34 kjcf05n02 python3.9[15292]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 4 18:32:34 kjcf05n02 gateway-ec-node.py[15293]: Starting gateway-ec-node service Nov 4 18:32:34 kjcf05n02 RFSF-API[15291]: INFO[2024-11-04T18:32:33-06:00] Datapath API RESTful Service starting Nov 4 18:32:34 kjcf05n02 dp-api-server-node[15291]: INFO[2024-11-04T18:32:33-06:00] Datapath API RESTful Service starting Nov 4 18:32:34 kjcf05n02 RFSF-API[15291]: INFO[2024-11-04T18:32:33-06:00] Running in production mode, starting dbus event listener Nov 4 18:32:34 kjcf05n02 dp-api-server-node[15291]: INFO[2024-11-04T18:32:33-06:00] Running in production mode, starting dbus event listener Nov 4 18:32:34 kjcf05n02 RFSF-API[15291]: INFO[2024-11-04T18:32:33-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 18:32:34 kjcf05n02 dp-api-server-node[15291]: INFO[2024-11-04T18:32:33-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 18:32:34 kjcf05n02 RFSF-API[15291]: INFO[2024-11-04T18:32:33-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 18:32:34 kjcf05n02 dp-api-server-node[15291]: INFO[2024-11-04T18:32:33-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 18:32:34 kjcf05n02 RFSF-API[15291]: INFO[2024-11-04T18:32:33-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 18:32:34 kjcf05n02 dp-api-server-node[15291]: INFO[2024-11-04T18:32:33-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 18:32:34 kjcf05n02 RFSF-API[15291]: INFO[2024-11-04T18:32:33-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 18:32:34 kjcf05n02 dp-api-server-node[15291]: INFO[2024-11-04T18:32:33-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 18:32:34 kjcf05n02 RFSF-API[15291]: INFO[2024-11-04T18:32:33-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 18:32:34 kjcf05n02 dp-api-server-node[15291]: INFO[2024-11-04T18:32:33-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 18:32:34 kjcf05n02 RFSF-API[15291]: INFO[2024-11-04T18:32:33-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 18:32:34 kjcf05n02 dp-api-server-node[15291]: INFO[2024-11-04T18:32:33-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 18:32:34 kjcf05n02 RFSF-API[15291]: INFO[2024-11-04T18:32:33-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 18:32:34 kjcf05n02 dp-api-server-node[15291]: INFO[2024-11-04T18:32:33-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 18:32:34 kjcf05n02 RFSF-API[15291]: INFO[2024-11-04T18:32:33-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 18:32:34 kjcf05n02 dp-api-server-node[15291]: INFO[2024-11-04T18:32:33-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 18:32:34 kjcf05n02 RFSF-API[15291]: INFO[2024-11-04T18:32:33-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 18:32:34 kjcf05n02 dp-api-server-node[15291]: INFO[2024-11-04T18:32:33-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 18:32:34 kjcf05n02 RFSF-API[15291]: INFO[2024-11-04T18:32:33-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 18:32:34 kjcf05n02 dp-api-server-node[15291]: INFO[2024-11-04T18:32:33-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 18:32:34 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 4 18:32:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730766756', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 4 18:32:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730766756'} Nov 4 18:32:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:32:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730766756', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 4 18:32:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730766756'} Nov 4 18:32:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:32:36 kjcf05n00 mcfcli[3673891]: %3|1730766756.942|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:32:38 kjcf05n00 mcfcli[3673891]: %3|1730766758.627|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:32:39 kjcf05n00 zabbix-server[2334838]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 18:32:39 kjcf05n00 zabbix-server[2334838]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:03:10\\"}}"' Nov 4 18:32:39 kjcf05n00 log_interesting_event.py[2334838]: Event '46554' acknowledged Nov 4 18:32:40 kjcf05n02 systemd[1]: Reloading. Nov 4 18:32:41 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 4 18:32:41 kjcf05n02 systemd[1]: Reloading. Nov 4 18:32:41 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 4 18:32:41 kjcf05n02 dcs-collectord[5656]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 18:32:41 kjcf05n02 dcs-collectord[5656]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 18:32:41 kjcf05n02 dcs-collectord[5656]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 18:32:41 kjcf05n02 diskmonitor_pre[15771]: Key management is currently disabled.DEAR disabled Nov 4 18:32:41 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 4 18:32:43 kjcf05n02 sh[15839]: LNET configured: New Created Nov 4 18:32:43 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 4 18:32:43 kjcf05n02 LCNmon[17967]: Interface ib0 is up Nov 4 18:32:43 kjcf05n02 LCNmon[17967]: Interface ib1 is up Nov 4 18:32:43 kjcf05n02 LCNmon[17967]: Can ping through interface ib0 Nov 4 18:32:43 kjcf05n02 LCNmon[17967]: Can ping through interface ib1 Nov 4 18:32:43 kjcf05n02 LCNmon[17967]: NIC ib0, initial state UP Nov 4 18:32:43 kjcf05n02 LCNmon[17967]: NIC ib1, initial state UP Nov 4 18:32:43 kjcf05n02 LCNmon[17967]: LCNstat initial state UP Nov 4 18:32:43 kjcf05n02 LCNmon[17967]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 4 18:32:43 kjcf05n00 httpd[1812018]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 4 18:32:44 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: /var/run/diskmonitor does not exist, creating Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: Creating /var/run/diskmonitor/disk Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: Creating /var/run/diskmonitor/encl Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: Creating /var/run/diskmonitor/cli Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: RAS_Interlocks_enabled: 1 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: Using default ssd ids: HUSSL4010ASS600 , Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: add handler for sig: 14 sa_flags: 10000004 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: add handler for sig: 1 sa_flags: 10000004 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: add handler for sig: 2 sa_flags: 00000004 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: add handler for sig: 15 sa_flags: 00000004 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: add handler for sig: 6 sa_flags: 00000004 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: add handler for sig: 3 sa_flags: 00000004 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: add handler for sig: 30 sa_flags: 00000004 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: add handler for sig: 20 sa_flags: 00000004 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: add handler for sig: 10 sa_flags: 10000004 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: add handler for sig: 11 sa_flags: 00000004 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: add handler for sig: 7 sa_flags: 00000004 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: add handler for sig: 4 sa_flags: 00000004 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: add handler for sig: 8 sa_flags: 00000004 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: init_watch: /var/run/diskmonitor/encl initialized Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: init_watch: /var/run/diskmonitor/disk initialized Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: Using HA Baton locks - key: diskmonitor Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: Baton will be held for at most 570 seconds Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: DMMP Enabled: 0 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: random seed: 6b6dfdf3 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: NVMe Enclosure: 1 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: ZFS Enclosure: 0 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: Dbus, Initialized Connection Successfully Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: int_catcher_thread: thread start Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: Received dbus message 4 org.freedesktop.DBus -> :1.98 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 4 18:32:45 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 18:32:46 kjcf05n02 openhpid[5562]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 4 18:32:46 kjcf05n02 openhpid[5562]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 4 18:32:46 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 4 18:32:46 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 4 18:32:46 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 18:32:46 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18321 which is not our child. We'll most likely not notice when it exits. Nov 4 18:32:46 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 18:32:46 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 4 18:32:46 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 4 18:32:46 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 4 18:32:46 kjcf05n02 dcs-collectord[5656]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 4 18:32:46 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 4 18:32:46 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 4 18:32:46 kjcf05n02 systemd[1]: Startup finished in 50.648s (kernel) + 2min 28.975s (userspace) = 3min 19.624s. Nov 4 18:32:46 kjcf05n02 openhpid[18321]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 18:32:46 kjcf05n02 openhpid[18321]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 18:32:46 kjcf05n02 openhpid[18321]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 18:32:46 kjcf05n02 openhpid[18321]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 18:32:46 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18473 (bash) Nov 4 18:32:47 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 4 18:32:47 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 4 18:32:47 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 4 18:32:47 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 4 18:32:47 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 4 18:32:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730766768', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(2800.0B/2136.0B), ib1=(2520.0B/2496.0B), icl0=(7.6kB/9.4kB), lo=(1080.0B/1080.0B), meth0=(1541.5MB/8.0MB), mgmt0=(1478.2MB/8.0MB)'}"] Nov 4 18:32:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(2800.0B/2136.0B), ib1=(2520.0B/2496.0B), icl0=(7.6kB/9.4kB), lo=(1080.0B/1080.0B), meth0=(1541.5MB/8.0MB), mgmt0=(1478.2MB/8.0MB)', 'message': 'NET OK - (Rx/Tx) ib0=(2800.0B/2136.0B), ib1=(2520.0B/2496.0B), icl0=(7.6kB/9.4kB), lo=(1080.0B/1080.0B), meth0=(1541.5MB/8.0MB), mgmt0=(1478.2MB/8.0MB)', 'value': 'ok', 'timestamp': '1730766768'} Nov 4 18:32:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:32:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730766768', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 4 18:32:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730766768'} Nov 4 18:32:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 4 18:32:51 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 4 18:32:56 kjcf05n02 dcs-collectord[5656]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 18:32:56 kjcf05n02 dcs-collectord[5656]: WARNING No data collected (hpi_parser.py:353) Nov 4 18:33:06 kjcf05n00 mcfcli[3673891]: %3|1730766786.942|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 18:33:10 kjcf05n02 ipmievd[3997]: System Event sensor - Timestamp Clock Sync Nov 4 18:33:11 kjcf05n02 ipmievd[3190]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:33:11 kjcf05n02 dcs-collectord[5656]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 18:33:15 kjcf05n00 mcfcli[3673891]: %3|1730766795.887|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:33:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730766801', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 4 18:33:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730766801'} Nov 4 18:33:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 4 18:33:24 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 4 18:33:26 kjcf05n02 dcs-collectord[5656]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 18:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T18:33:27.267981842-06:00 level=info msg="Completed cleanup jobs" duration=41.260252ms Nov 4 18:33:32 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db01007002538450000000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 18:33:32 kjcf05n02 ras-resource-manager-agent[5920]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "95a429f8-9b0d-11ef-93ca-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 4 18:33:32 kjcf05n02 ras-resource-manager-agent[5920]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '95a429f8-9b0d-11ef-93ca-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 4 18:33:32 kjcf05n02 ras-resource-manager-agent[5920]: INFO Submitting new device inserted signal, starting to qualify drive: 95a429f8-9b0d-11ef-93ca-00093d0695e3 (admin_action.py:110) Nov 4 18:33:31 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '95a429f8-9b0d-11ef-93ca-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 18:33:31 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '95a429f8-9b0d-11ef-93ca-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 18:33:31 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '95a429f8-9b0d-11ef-93ca-00093d0695e3', 'response ID': '95ae9816-9b0d-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 18:33:31 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 95ae9816-9b0d-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 18:33:32 kjcf05n03 firmware-update-orc-server[5884]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "7bcb70a0-dd4f-45f7-a012-1193e61dfd9c"} (logger.py:65) Nov 4 18:33:32 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 2346266 (get_disk_device) Nov 4 18:33:32 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 4 18:33:32 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 4 18:33:32 kjcf05n03 ccp-client[2346287]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 18:33:32 kjcf05n03 ccp-client[2346287]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 18:33:32 kjcf05n03 ccp-client[2346316]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 18:33:32 kjcf05n03 ccp-client[2346287]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 18:33:32 kjcf05n03 ccp-client[2346287]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 18:33:32 kjcf05n03 ccp-client[2346316]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 18:33:32 kjcf05n03 ccp-client[2346316]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 18:33:32 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '95f67dc0-9b0d-11ef-93ca-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 18:33:32 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '95f67dc0-9b0d-11ef-93ca-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 18:33:32 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '95f67dc0-9b0d-11ef-93ca-00093d0695e3', 'response ID': '95fd7530-9b0d-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 18:33:32 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 95fd7530-9b0d-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 18:33:32 kjcf05n02 diskmonitor[17558]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 18:33:32 kjcf05n02 ras-resource-manager-agent[5920]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "95f67dc0-9b0d-11ef-93ca-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 4 18:33:32 kjcf05n02 ras-resource-manager-agent[5920]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '95f67dc0-9b0d-11ef-93ca-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 4 18:33:32 kjcf05n02 ras-resource-manager-agent[5920]: INFO Submitting new device inserted signal, starting to qualify drive: 95f67dc0-9b0d-11ef-93ca-00093d0695e3 (admin_action.py:110) Nov 4 18:33:32 kjcf05n02 firmware-update-orc-server[5878]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "39e6878a-e218-4764-aaab-4f589d961eca"} (logger.py:65) Nov 4 18:33:35 kjcf05n03 DRVFW[2346423]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 18:33:35 kjcf05n03 ccp-client[2346424]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 18:33:35 kjcf05n03 ccp-client[2346424]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 18:33:35 kjcf05n03 ccp-client[2346433]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 18:33:35 kjcf05n03 ccp-client[2346424]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 18:33:35 kjcf05n03 ccp-client[2346424]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 18:33:35 kjcf05n03 ccp-client[2346433]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 18:33:35 kjcf05n03 ccp-client[2346433]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 18:33:35 kjcf05n03 firmware-update-orc-server[5884]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 4 18:33:36 kjcf05n00 mcfcli[3673891]: %3|1730766816.942|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:33:37 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 95ae9816-9b0d-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 18:33:37 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '95a429f8-9b0d-11ef-93ca-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '95a429f8-9b0d-11ef-93ca-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}}} (logger.py:65) Nov 4 18:33:37 kjcf05n02 ras-resource-manager-agent[5920]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '95a429f8-9b0d-11ef-93ca-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 4 18:33:37 kjcf05n02 ras-resource-manager-agent[5920]: INFO Drive qualification complete responding: 95a429f8-9b0d-11ef-93ca-00093d0695e3 (admin_action.py:205) Nov 4 18:33:37 kjcf05n02 ras-resource-manager-agent[5920]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "95a429f8-9b0d-11ef-93ca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (interesting_event.py:59) Nov 4 18:33:38 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 4 18:33:40 kjcf05n02 diskmonitor[17558]: 4 Nov 4 18:33:40 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 4 18:33:40 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 4 18:33:40 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 4 18:33:40 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 4 18:33:40 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 4 18:33:40 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 4 18:33:40 kjcf05n02 diskmonitor[17558]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 4 18:33:40 kjcf05n02 diskmonitor[17558]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 4 18:33:40 kjcf05n02 diskmonitor[17558]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 4 18:33:40 kjcf05n02 diskmonitor[17558]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 18:33:40 kjcf05n02 diskmonitor[17558]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 4 18:33:40 kjcf05n02 diskmonitor[17558]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "95a429f8-9b0d-11ef-93ca-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 4 18:33:40 kjcf05n02 diskmonitor[17558]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 18:33:40 kjcf05n02 diskmonitor[17558]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 4 18:33:40 kjcf05n02 diskmonitor[17558]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "95f67dc0-9b0d-11ef-93ca-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 4 18:33:40 kjcf05n02 diskmonitor[17558]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 18:33:40 kjcf05n02 diskmonitor[17558]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 18:33:42 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22346 (get_disk_device) Nov 4 18:33:42 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 4 18:33:42 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 4 18:33:42 kjcf05n02 chronyd[5164]: Selected source 172.16.2.1 Nov 4 18:33:42 kjcf05n02 ccp-client[22367]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 18:33:43 kjcf05n02 ccp-client[22367]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 18:33:43 kjcf05n02 ccp-client[22376]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 18:33:43 kjcf05n02 ccp-client[22367]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 18:33:43 kjcf05n02 ccp-client[22367]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 18:33:43 kjcf05n02 ccp-client[22376]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 18:33:43 kjcf05n02 ccp-client[22376]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 18:33:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730766826}"] Nov 4 18:33:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730766826, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:33:46 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:33:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730766826}"] Nov 4 18:33:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730766826, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:33:46 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:33:46 kjcf05n02 DRVFW[22605]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 18:33:46 kjcf05n02 ccp-client[22620]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 18:33:46 kjcf05n02 ccp-client[22620]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 18:33:46 kjcf05n02 ccp-client[22669]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 18:33:46 kjcf05n02 ccp-client[22620]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 18:33:46 kjcf05n02 ccp-client[22620]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 18:33:46 kjcf05n02 ccp-client[22669]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 18:33:46 kjcf05n02 ccp-client[22669]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 18:33:46 kjcf05n02 firmware-update-orc-server[5878]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 4 18:33:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730766826}"] Nov 4 18:33:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730766826, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:33:46 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:33:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730766826}"] Nov 4 18:33:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730766826, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:33:46 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:33:46 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 95fd7530-9b0d-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 18:33:46 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '95f67dc0-9b0d-11ef-93ca-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '95f67dc0-9b0d-11ef-93ca-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}}} (logger.py:65) Nov 4 18:33:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730766826}"] Nov 4 18:33:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730766826, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:33:46 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:33:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730766826}"] Nov 4 18:33:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730766826, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:33:46 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:33:46 kjcf05n02 ras-resource-manager-agent[5920]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '95f67dc0-9b0d-11ef-93ca-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}} (resource_admin.py:98) Nov 4 18:33:46 kjcf05n02 ras-resource-manager-agent[5920]: INFO Drive qualification complete responding: 95f67dc0-9b0d-11ef-93ca-00093d0695e3 (admin_action.py:205) Nov 4 18:33:46 kjcf05n02 ras-resource-manager-agent[5920]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "95f67dc0-9b0d-11ef-93ca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (interesting_event.py:59) Nov 4 18:33:47 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 4 18:33:47 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 4 18:33:47 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 4 18:33:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730766828}"] Nov 4 18:33:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730766828, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:33:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:33:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730766828}"] Nov 4 18:33:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730766828, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:33:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:33:49 kjcf05n02 ras-resource-manager-agent[5920]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "95a429f8-9b0d-11ef-93ca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (service_main_handler.py:66) Nov 4 18:33:49 kjcf05n02 ras-resource-manager-agent[5920]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '95a429f8-9b0d-11ef-93ca-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 4 18:33:49 kjcf05n02 ras-resource-manager-agent[5920]: INFO Device qualification response has been acknowledged: 95a429f8-9b0d-11ef-93ca-00093d0695e3 (admin_action.py:151) Nov 4 18:33:49 kjcf05n02 ras-resource-manager-agent[5920]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "95f67dc0-9b0d-11ef-93ca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (service_main_handler.py:66) Nov 4 18:33:49 kjcf05n02 ras-resource-manager-agent[5920]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '95f67dc0-9b0d-11ef-93ca-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}} (resource_admin.py:98) Nov 4 18:33:49 kjcf05n02 ras-resource-manager-agent[5920]: INFO Device qualification response has been acknowledged: 95f67dc0-9b0d-11ef-93ca-00093d0695e3 (admin_action.py:151) Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "95a429f8-9b0d-11ef-93ca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: Dbus, handle_ingress_ras_signals, uuid: 95a429f8-9b0d-11ef-93ca-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "95a429f8-9b0d-11ef-93ca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "95f67dc0-9b0d-11ef-93ca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: Dbus, handle_ingress_ras_signals, uuid: 95f67dc0-9b0d-11ef-93ca-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "95f67dc0-9b0d-11ef-93ca-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 18:33:51 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 18:33:53 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 18:33:53 kjcf05n02 diskmonitor[17558]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 18:33:54 kjcf05n00 mcfcli[3673891]: %3|1730766834.906|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:33:55 kjcf05n02 python3.9[5225]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 4 18:33:57 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31457 deleted. Nov 4 18:33:58 kjcf05n02 python3.9[3190]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:33:58 kjcf05n02 diskmonitor[17558]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 18:33:58 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 18:33:58 kjcf05n02 diskmonitor[17558]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 18:33:58 kjcf05n02 diskmonitor[17558]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 18:33:58 kjcf05n02 diskmonitor[17558]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 18:33:58 kjcf05n02 diskmonitor[17558]: leaving test state: 1 next state: 2 Nov 4 18:33:58 kjcf05n02 diskmonitor[17558]: lock req: no timeout Nov 4 18:33:58 kjcf05n02 diskmonitor[17558]: leaving test state: 2 next state: 4 Nov 4 18:33:58 kjcf05n02 diskmonitor[17558]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 18:34:06 kjcf05n00 mcfcli[3673891]: %3|1730766846.942|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 18:34:34 kjcf05n00 mcfcli[3673891]: %3|1730766874.903|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:34:36 kjcf05n00 mcfcli[3673891]: %3|1730766876.943|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 18:34:53 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 4 18:34:53 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 18:34:53 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 4 18:35:03 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 4 18:35:03 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 18:35:03 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 4 18:35:06 kjcf05n00 mcfcli[3673891]: %3|1730766906.943|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 18:35:07 kjcf05n02 dcs-collectord[5656]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 4 18:35:12 kjcf05n02 diskmonitor[17558]: lock acquired Nov 4 18:35:12 kjcf05n02 diskmonitor[17558]: leaving test state: 4 next state: 8 Nov 4 18:35:14 kjcf05n00 mcfcli[3673891]: %3|1730766914.900|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:35:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730766916}"] Nov 4 18:35:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730766916, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:35:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:35:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:35:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:35:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:35:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:35:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:35:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:35:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:35:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:35:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:35:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:35:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:35:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:35:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.944592ms Nov 4 18:35:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:35:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.944592ms Nov 4 18:35:16 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:35:16 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:35:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:35:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730766916}"] Nov 4 18:35:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730766916, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:35:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:35:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:35:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:35:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:35:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:35:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:35:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:35:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:35:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:35:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:35:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:35:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:35:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:35:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.923583ms Nov 4 18:35:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:35:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.923583ms Nov 4 18:35:16 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:35:16 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:35:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:35:29 kjcf05n02 diskmonitor[17558]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 4 18:35:29 kjcf05n02 diskmonitor[17558]: leaving test state: 8 next state: 20 Nov 4 18:35:29 kjcf05n02 diskmonitor[17558]: leaving test state: 20 next state: 40 Nov 4 18:35:29 kjcf05n02 diskmonitor[17558]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 1395e500000 Nov 4 18:35:29 kjcf05n02 diskmonitor[17558]: leaving test state: 40 next state: 80 Nov 4 18:35:35 kjcf05n00 python3.9[2336555]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 18:35:36 kjcf05n00 mcfcli[3673891]: %3|1730766936.943|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 18:35:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730766648', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 18:35:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730766648'} Nov 4 18:35:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:35:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730766648', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 18:35:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730766648'} Nov 4 18:35:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:35:51 kjcf05n03 dwd[5203]: md66 read await report (#disks=11, min #ops=6.9e7): mean=0.4, sd=0.0, min=0.4, q1=0.4, q2=0.4, q3=0.4, max=0.4 (nvme10n1/eui.345950304e3006330025384500000003) Nov 4 18:35:52 kjcf05n00 mcfcli[3673891]: %3|1730766952.531|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:36:06 kjcf05n00 mcfcli[3673891]: %3|1730766966.943|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:36:30 kjcf05n02 diskmonitor[17558]: leaving test state: 80 next state: 100 Nov 4 18:36:30 kjcf05n02 diskmonitor[17558]: lock release: time: Mon Nov 4 18:36:24 2024 Nov 4 18:36:30 kjcf05n02 diskmonitor[17558]: leaving test state: 100 next state: 1 Nov 4 18:36:30 kjcf05n00 mcfcli[3673891]: %3|1730766990.754|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:36:31 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 4 18:36:36 kjcf05n00 mcfcli[3673891]: %3|1730766996.944|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:36:59 kjcf05n03 diskmonitor[17871]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 18:37:06 kjcf05n00 mcfcli[3673891]: %3|1730767026.944|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:37:08 kjcf05n00 mcfcli[3673891]: %3|1730767028.364|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:37:36 kjcf05n00 mcfcli[3673891]: %3|1730767056.945|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 18:37:48 kjcf05n00 mcfcli[3673891]: %3|1730767068.064|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:38:07 kjcf05n00 mcfcli[3673891]: %3|1730767087.029|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:38:25 kjcf05n00 mcfcli[3673891]: %3|1730767105.055|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:38:35 kjcf05n03 nslcd[6958]: [45e146] ldap_result() failed: Can't contact LDAP server Nov 4 18:38:37 kjcf05n00 mcfcli[3673891]: %3|1730767117.029|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 18:38:39 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 4 18:38:41 kjcf05n03 nslcd[6958]: [5f007c] ldap_result() failed: Can't contact LDAP server Nov 4 18:39:02 kjcf05n00 mcfcli[3673891]: %3|1730767142.474|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:39:07 kjcf05n00 mcfcli[3673891]: %3|1730767147.029|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 18:39:37 kjcf05n00 mcfcli[3673891]: %3|1730767177.030|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 18:39:41 kjcf05n00 mcfcli[3673891]: %3|1730767181.890|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 18:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 18:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 18:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 18:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 18:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 18:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 18:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 18:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 18:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 18:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 18:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 18:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 18:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 18:40:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 18:40:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:40:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 18:40:07 kjcf05n00 mcfcli[3673891]: %3|1730767207.447|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:40:19 kjcf05n00 mcfcli[3673891]: %3|1730767219.849|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:40:35 kjcf05n00 python3.9[2339358]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 18:40:37 kjcf05n00 mcfcli[3673891]: %3|1730767237.447|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:40:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730766648', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 18:40:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730766648'} Nov 4 18:40:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:40:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730766648', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 18:40:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730766648'} Nov 4 18:40:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:40:59 kjcf05n00 mcfcli[3673891]: %3|1730767259.846|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:41:07 kjcf05n00 mcfcli[3673891]: %3|1730767267.447|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:41:37 kjcf05n00 mcfcli[3673891]: %3|1730767297.447|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:41:39 kjcf05n00 mcfcli[3673891]: %3|1730767299.843|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:42:07 kjcf05n00 mcfcli[3673891]: %3|1730767327.448|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:42:19 kjcf05n00 mcfcli[3673891]: %3|1730767339.840|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:42:37 kjcf05n00 mcfcli[3673891]: %3|1730767357.448|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:42:55 kjcf05n00 mcfcli[3673891]: %3|1730767375.447|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:43:07 kjcf05n00 mcfcli[3673891]: %3|1730767387.448|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 18:43:21 kjcf05n02 root[41668]: failback_xyraid Nov 4 18:43:23 kjcf05n02 root[41793]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 4 18:43:24 kjcf05n02 root[41935]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 4 18:43:26 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 4 18:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T18:43:27.253222673-06:00 level=info msg="Completed cleanup jobs" duration=26.184297ms Nov 4 18:43:30 kjcf05n03 dwd[5203]: Drive path is missing, purging: nvme19n1 Nov 4 18:43:30 kjcf05n03 dwd[5203]: Drive path is missing, purging: nvme2n1 Nov 4 18:43:30 kjcf05n03 dwd[5203]: Drive path is missing, purging: nvme17n1 Nov 4 18:43:30 kjcf05n03 dwd[5203]: Drive path is missing, purging: nvme25n1 Nov 4 18:43:30 kjcf05n03 dwd[5203]: Drive path is missing, purging: nvme24n1 Nov 4 18:43:30 kjcf05n03 dwd[5203]: Drive path is missing, purging: nvme23n1 Nov 4 18:43:30 kjcf05n03 dwd[5203]: Drive path is missing, purging: nvme9n1 Nov 4 18:43:30 kjcf05n03 dwd[5203]: Drive path is missing, purging: nvme18n1 Nov 4 18:43:30 kjcf05n03 dwd[5203]: Drive path is missing, purging: nvme8n1 Nov 4 18:43:30 kjcf05n03 dwd[5203]: Drive path is missing, purging: nvme3n1 Nov 4 18:43:30 kjcf05n03 dwd[5203]: Drive path is missing, purging: nvme4n1 Nov 4 18:43:32 kjcf05n02 dwd[5196]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 4 18:43:32 kjcf05n02 dwd[5196]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 4 18:43:32 kjcf05n02 dwd[5196]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 4 18:43:32 kjcf05n02 dwd[5196]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 4 18:43:32 kjcf05n02 dwd[5196]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 4 18:43:32 kjcf05n02 dwd[5196]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 4 18:43:32 kjcf05n02 dwd[5196]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 4 18:43:32 kjcf05n02 dwd[5196]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 4 18:43:32 kjcf05n02 dwd[5196]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 4 18:43:32 kjcf05n02 dwd[5196]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 4 18:43:32 kjcf05n02 dwd[5196]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 4 18:43:32 kjcf05n02 dwd[5196]: Starting NVME thread for nvme2n1 Nov 4 18:43:32 kjcf05n02 dwd[5196]: Starting NVME thread for nvme18n1 Nov 4 18:43:32 kjcf05n02 dwd[5196]: Starting NVME thread for nvme19n1 Nov 4 18:43:32 kjcf05n02 dwd[5196]: Starting NVME thread for nvme9n1 Nov 4 18:43:32 kjcf05n02 diskmonitor[17558]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 4 18:43:33 kjcf05n02 dwd[5196]: Starting NVME thread for nvme3n1 Nov 4 18:43:33 kjcf05n02 systemd-udevd[44734]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44735]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44738]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44737]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44734]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44738]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44735]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44737]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44734]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44738]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44735]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44737]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44734]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44738]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44735]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44737]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44734]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44738]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44735]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44737]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44734]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44738]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44774]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44737]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44735]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44779]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44776]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44734]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44781]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44737]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44774]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44738]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44735]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44779]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44776]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44737]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44735]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44774]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44734]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44781]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44779]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44737]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44737]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44781]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44737]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44779]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44776]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44735]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44737]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44781]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44737]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44776]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44737]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44781]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44781]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44781]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44737]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44781]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44737]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44781]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44737]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44781]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44781]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 systemd-udevd[44781]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:43:33 kjcf05n02 dwd[5196]: Starting NVME thread for nvme24n1 Nov 4 18:43:33 kjcf05n02 nslcd[6957]: [8b4567] (re)loading /etc/nsswitch.conf Nov 4 18:43:33 kjcf05n02 dwd[5196]: Starting NVME thread for nvme4n1 Nov 4 18:43:33 kjcf05n02 dwd[5196]: Starting NVME thread for nvme23n1 Nov 4 18:43:33 kjcf05n02 dwd[5196]: Starting NVME thread for nvme17n1 Nov 4 18:43:34 kjcf05n02 dwd[5196]: Starting NVME thread for nvme25n1 Nov 4 18:43:34 kjcf05n02 dwd[5196]: Starting NVME thread for nvme8n1 Nov 4 18:43:34 kjcf05n00 mcfcli[3673891]: %3|1730767414.891|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:43:35 kjcf05n02 dcs-bulk-data-sender[6184]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 4 18:43:37 kjcf05n02 diskmonitor[17558]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 4 18:43:37 kjcf05n02 diskmonitor[17558]: Scan for ReadErrorMax change for md65 Nov 4 18:43:37 kjcf05n02 diskmonitor[17558]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 4 18:43:37 kjcf05n02 diskmonitor[17558]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 4 18:43:37 kjcf05n02 diskmonitor[17558]: read_saved_file: md65 no saved speed Nov 4 18:43:37 kjcf05n02 diskmonitor[17558]: reconstruction_policy: sync_action prev = current = frozen - md65 Nov 4 18:43:37 kjcf05n02 diskmonitor[17558]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 18:43:37 kjcf05n00 mcfcli[3673891]: %3|1730767417.448|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 18:43:50 kjcf05n02 diskmonitor[17558]: reconstruction_policy: sync_action prev = frozen current = idle - md65 Nov 4 18:44:07 kjcf05n00 mcfcli[3673891]: %3|1730767447.448|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 18:44:11 kjcf05n00 mcfcli[3673891]: %3|1730767451.943|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:44:12 kjcf05n03 diskmonitor[17871]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 4 18:44:12 kjcf05n03 diskmonitor[17871]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 18:44:14 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47446 (bash) Nov 4 18:44:14 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 4 18:44:14 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 4 18:44:16 kjcf05n00 zabbix-server[2341633]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 18:44:16 kjcf05n00 zabbix-server[2341633]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46572' Nov 4 18:44:16 kjcf05n00 zabbix-server[2341633]: Filesystem 'kjcf05' has been mounted Nov 4 18:44:17 kjcf05n00 zabbix-server[2341633]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 4 18:44:17 kjcf05n00 zabbix-server[2341633]: Running puppet on 'None' Nov 4 18:44:19 kjcf05n07 puppet-agent[2090293]: Using configured environment 'production' Nov 4 18:44:19 kjcf05n07 puppet-agent[2090293]: Retrieving pluginfacts Nov 4 18:44:19 kjcf05n07 puppet-agent[2090293]: Retrieving plugin Nov 4 18:44:19 kjcf05n03 puppet-agent[2366104]: Using configured environment 'production' Nov 4 18:44:19 kjcf05n03 puppet-agent[2366104]: Retrieving pluginfacts Nov 4 18:44:19 kjcf05n03 puppet-agent[2366104]: Retrieving plugin Nov 4 18:44:19 kjcf05n03 puppet-agent[2366104]: Loading facts Nov 4 18:44:19 kjcf05n06 puppet-agent[2086904]: Using configured environment 'production' Nov 4 18:44:19 kjcf05n06 puppet-agent[2086904]: Retrieving pluginfacts Nov 4 18:44:19 kjcf05n06 puppet-agent[2086904]: Retrieving plugin Nov 4 18:44:19 kjcf05n06 puppet-agent[2086904]: Loading facts Nov 4 18:44:19 kjcf05n02 puppet-agent[47788]: Using configured environment 'production' Nov 4 18:44:19 kjcf05n02 puppet-agent[47788]: Retrieving pluginfacts Nov 4 18:44:19 kjcf05n02 puppet-agent[47788]: Retrieving plugin Nov 4 18:44:19 kjcf05n05 puppet-agent[2270872]: Using configured environment 'production' Nov 4 18:44:19 kjcf05n05 puppet-agent[2270872]: Retrieving pluginfacts Nov 4 18:44:19 kjcf05n05 puppet-agent[2270872]: Retrieving plugin Nov 4 18:44:19 kjcf05n04 puppet-agent[2072218]: Using configured environment 'production' Nov 4 18:44:19 kjcf05n04 puppet-agent[2072218]: Retrieving pluginfacts Nov 4 18:44:19 kjcf05n04 puppet-agent[2072218]: Retrieving plugin Nov 4 18:44:19 kjcf05n07 puppet-agent[2090293]: Loading facts Nov 4 18:44:19 kjcf05n01 puppet-agent[3820966]: Using configured environment 'production' Nov 4 18:44:19 kjcf05n01 puppet-agent[3820966]: Retrieving pluginfacts Nov 4 18:44:19 kjcf05n01 puppet-agent[3820966]: Retrieving plugin Nov 4 18:44:19 kjcf05n01 puppet-agent[3820966]: Loading facts Nov 4 18:44:19 kjcf05n02 puppet-agent[47788]: Loading facts Nov 4 18:44:19 kjcf05n05 puppet-agent[2270872]: Loading facts Nov 4 18:44:20 kjcf05n04 puppet-agent[2072218]: Loading facts Nov 4 18:44:19 kjcf05n00 puppet-agent[2341847]: Using configured environment 'production' Nov 4 18:44:19 kjcf05n00 puppet-agent[2341847]: Retrieving pluginfacts Nov 4 18:44:19 kjcf05n00 puppet-agent[2341847]: Retrieving plugin Nov 4 18:44:20 kjcf05n00 puppet-agent[2341847]: Loading facts Nov 4 18:44:22 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 4 18:44:22 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 4 18:44:22 kjcf05n03 puppet-agent[2366104]: Caching catalog for kjcf05n03 Nov 4 18:44:22 kjcf05n03 puppet-agent[2366104]: Applying configuration version '1730767460' Nov 4 18:44:22 kjcf05n02 puppet-agent[47788]: Caching catalog for kjcf05n02 Nov 4 18:44:22 kjcf05n02 puppet-agent[47788]: Applying configuration version '1730767460' Nov 4 18:44:22 kjcf05n06 puppet-agent[2086904]: Caching catalog for kjcf05n06 Nov 4 18:44:22 kjcf05n06 puppet-agent[2086904]: Applying configuration version '1730767461' Nov 4 18:44:22 kjcf05n07 puppet-agent[2090293]: Caching catalog for kjcf05n07 Nov 4 18:44:22 kjcf05n07 puppet-agent[2090293]: Applying configuration version '1730767461' Nov 4 18:44:23 kjcf05n01 puppet-agent[3820966]: Caching catalog for kjcf05n01 Nov 4 18:44:23 kjcf05n00 puppet-agent[2341847]: Caching catalog for kjcf05n00 Nov 4 18:44:23 kjcf05n00 puppet-agent[2341847]: Applying configuration version '1730767461' Nov 4 18:44:24 kjcf05n01 puppet-agent[3820966]: Applying configuration version '1730767461' Nov 4 18:44:24 kjcf05n03 puppet-agent[2366104]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 18:44:24 kjcf05n03 puppet-agent[2366104]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 18:44:24 kjcf05n03 puppet-agent[2366104]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 18:44:24 kjcf05n02 puppet-agent[47788]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 18:44:24 kjcf05n02 puppet-agent[47788]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 18:44:24 kjcf05n02 puppet-agent[47788]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 18:44:24 kjcf05n06 puppet-agent[2086904]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 18:44:24 kjcf05n06 puppet-agent[2086904]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 18:44:24 kjcf05n06 puppet-agent[2086904]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 18:44:24 kjcf05n07 puppet-agent[2090293]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 18:44:24 kjcf05n07 puppet-agent[2090293]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 18:44:24 kjcf05n07 puppet-agent[2090293]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 18:44:25 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 4 18:44:25 kjcf05n03 zabbix_agent2[51516]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 18:44:25 kjcf05n03 zabbix_agent2[3182]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 18:44:25 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 18:44:25 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 4 18:44:25 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 4 18:44:25 kjcf05n03 puppet-agent[2366104]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: Starting Zabbix Agent 2 (6.2.1) Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: Starting Zabbix Agent 2 (6.2.1) Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: Press Ctrl+C to exit. Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: Plugin support version 1.0 Nov 4 18:44:25 kjcf05n03 zabbix_agent2[2366462]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 18:44:25 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 4 18:44:25 kjcf05n02 zabbix_agent2[6004]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 18:44:25 kjcf05n02 zabbix_agent2[3190]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 18:44:25 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 18:44:25 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 4 18:44:25 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 18:44:25 kjcf05n02 puppet-agent[47788]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: Starting Zabbix Agent 2 (6.2.1) Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: Starting Zabbix Agent 2 (6.2.1) Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: Press Ctrl+C to exit. Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: Plugin support version 1.0 Nov 4 18:44:25 kjcf05n02 zabbix_agent2[48267]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 18:44:25 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 4 18:44:25 kjcf05n07 zabbix_agent2[3781454]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 18:44:25 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 4 18:44:25 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 18:44:25 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 4 18:44:25 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 4 18:44:25 kjcf05n07 puppet-agent[2090293]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: Starting Zabbix Agent 2 (6.2.1) Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: Starting Zabbix Agent 2 (6.2.1) Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: Press Ctrl+C to exit. Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: Plugin support version 1.0 Nov 4 18:44:25 kjcf05n07 zabbix_agent2[2090704]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 18:44:25 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 4 18:44:25 kjcf05n06 zabbix_agent2[3783746]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 18:44:25 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 4 18:44:25 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 18:44:25 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 4 18:44:25 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 4 18:44:25 kjcf05n06 puppet-agent[2086904]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: Starting Zabbix Agent 2 (6.2.1) Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: Starting Zabbix Agent 2 (6.2.1) Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: Press Ctrl+C to exit. Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: Plugin support version 1.0 Nov 4 18:44:25 kjcf05n06 zabbix_agent2[2087551]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 18:44:26 kjcf05n00 puppet-agent[2341847]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 18:44:27 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 18:44:27 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-18:25:27]/mode) mode changed '0755' to '0750' Nov 4 18:44:27 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-18:25:27/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 4 18:44:27 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-18:25:27/vmcore]/mode) mode changed '0600' to '0640' Nov 4 18:44:27 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-18:25:27/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 4 18:44:27 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 18:44:27 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 18:44:27 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 18:44:27 kjcf05n03 puppet-agent[2366104]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 18:44:27 kjcf05n03 puppet-agent[2366104]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 18:44:27 kjcf05n03 puppet-agent[2366104]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 18:44:27 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 4 18:44:27 kjcf05n02 systemd-tmpfiles[48349]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 18:44:27 kjcf05n02 systemd-tmpfiles[48349]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 18:44:27 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 4 18:44:27 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 4 18:44:27 kjcf05n02 puppet-agent[47788]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 18:44:27 kjcf05n02 puppet-agent[47788]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 18:44:27 kjcf05n06 puppet-agent[2086904]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 18:44:27 kjcf05n06 puppet-agent[2086904]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 18:44:27 kjcf05n06 puppet-agent[2086904]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 18:44:27 kjcf05n06 puppet-agent[2086904]: Applied catalog in 4.76 seconds Nov 4 18:44:27 kjcf05n07 puppet-agent[2090293]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 18:44:27 kjcf05n07 puppet-agent[2090293]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 18:44:27 kjcf05n07 puppet-agent[2090293]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 18:44:27 kjcf05n02 puppet-agent[47788]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 18:44:27 kjcf05n03 puppet-agent[2366104]: Applied catalog in 5.03 seconds Nov 4 18:44:27 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 18:44:27 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 18:44:27 kjcf05n01 puppet-agent[3820966]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 18:44:27 kjcf05n00 puppet-agent[2341847]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 18:44:27 kjcf05n00 puppet-agent[2341847]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 18:44:27 kjcf05n00 puppet-agent[2341847]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 18:44:27 kjcf05n07 puppet-agent[2090293]: Applied catalog in 4.86 seconds Nov 4 18:44:27 kjcf05n02 puppet-agent[47788]: Applied catalog in 5.20 seconds Nov 4 18:44:28 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3245304]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 18:44:28 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 4 18:44:28 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 18:44:28 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 4 18:44:28 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 4 18:44:28 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: Starting Zabbix Agent 2 (6.2.1) Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: Starting Zabbix Agent 2 (6.2.1) Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: Press Ctrl+C to exit. Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: Plugin support version 1.0 Nov 4 18:44:28 kjcf05n01 zabbix_agent2[3821356]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 18:44:28 kjcf05n00 zabbix_server[15749]: Zabbix agent item "system.cpu.util[,user]" on host "kjcf05n01" failed: first network error, wait for 15 seconds Nov 4 18:44:28 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 4 18:44:28 kjcf05n00 zabbix_agent2[1492295]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 18:44:28 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 18:44:28 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 18:44:28 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 4 18:44:28 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 4 18:44:28 kjcf05n00 puppet-agent[2341847]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: Starting Zabbix Agent 2 (6.2.1) Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: Starting Zabbix Agent 2 (6.2.1) Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: Press Ctrl+C to exit. Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: Plugin support version 1.0 Nov 4 18:44:28 kjcf05n00 zabbix_agent2[2342433]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 18:44:28 kjcf05n00 zabbix-server[2342458]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 18:44:29 kjcf05n00 zabbix-server[2342459]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 18:44:29 kjcf05n00 zabbix-server[2342469]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 18:44:29 kjcf05n00 zabbix-server[2342471]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 18:44:30 kjcf05n00 puppet-agent[2341847]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 4 18:44:30 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_183246.log]/mode) mode changed '0644' to '0640' Nov 4 18:44:30 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_184414.log]/mode) mode changed '0644' to '0640' Nov 4 18:44:30 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241104_182441]/mode) mode changed '0755' to '0750' Nov 4 18:44:30 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241104_182441/screenlog.0]/mode) mode changed '0644' to '0640' Nov 4 18:44:30 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241104_184414]/mode) mode changed '0755' to '0750' Nov 4 18:44:30 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241104_184414/screenlog.0]/mode) mode changed '0644' to '0640' Nov 4 18:44:31 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_183246.log]/mode) mode changed '0644' to '0640' Nov 4 18:44:31 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_184414.log]/mode) mode changed '0644' to '0640' Nov 4 18:44:31 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241104_182442]/mode) mode changed '0755' to '0750' Nov 4 18:44:31 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241104_182442/screenlog.0]/mode) mode changed '0644' to '0640' Nov 4 18:44:31 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n04]/File[/mnt/nfsdata/llog/kjcf05n04/vmstat_kjcf05n04_20241104_182443]/mode) mode changed '0755' to '0750' Nov 4 18:44:31 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n04]/File[/mnt/nfsdata/llog/kjcf05n04/vmstat_kjcf05n04_20241104_182443/screenlog.0]/mode) mode changed '0644' to '0640' Nov 4 18:44:31 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n05]/File[/mnt/nfsdata/llog/kjcf05n05/vmstat_kjcf05n05_20241104_182444]/mode) mode changed '0755' to '0750' Nov 4 18:44:31 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n05]/File[/mnt/nfsdata/llog/kjcf05n05/vmstat_kjcf05n05_20241104_182444/screenlog.0]/mode) mode changed '0644' to '0640' Nov 4 18:44:31 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n06]/File[/mnt/nfsdata/llog/kjcf05n06/vmstat_kjcf05n06_20241104_182445]/mode) mode changed '0755' to '0750' Nov 4 18:44:31 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n06]/File[/mnt/nfsdata/llog/kjcf05n06/vmstat_kjcf05n06_20241104_182445/screenlog.0]/mode) mode changed '0644' to '0640' Nov 4 18:44:31 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n07]/File[/mnt/nfsdata/llog/kjcf05n07/vmstat_kjcf05n07_20241104_182446]/mode) mode changed '0755' to '0750' Nov 4 18:44:31 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n07]/File[/mnt/nfsdata/llog/kjcf05n07/vmstat_kjcf05n07_20241104_182446/screenlog.0]/mode) mode changed '0644' to '0640' Nov 4 18:44:31 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 18:44:31 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 18:44:31 kjcf05n01 puppet-agent[3820966]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 18:44:31 kjcf05n00 puppet-agent[2341847]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 18:44:31 kjcf05n00 puppet-agent[2341847]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 18:44:31 kjcf05n00 puppet-agent[2341847]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 18:44:31 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 4 18:44:32 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 4 18:44:32 kjcf05n00 puppet-agent[2341847]: Applied catalog in 8.34 seconds Nov 4 18:44:32 kjcf05n01 puppet-agent[3820966]: Applied catalog in 8.79 seconds Nov 4 18:44:36 kjcf05n05 puppet-agent[2270872]: Caching catalog for kjcf05n05 Nov 4 18:44:36 kjcf05n05 puppet-agent[2270872]: Applying configuration version '1730767475' Nov 4 18:44:37 kjcf05n00 mcfcli[3673891]: %3|1730767477.448|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 18:44:38 kjcf05n05 puppet-agent[2270872]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 18:44:38 kjcf05n05 puppet-agent[2270872]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 18:44:38 kjcf05n05 puppet-agent[2270872]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 18:44:39 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 4 18:44:39 kjcf05n05 zabbix_agent2[3947670]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 18:44:39 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 4 18:44:39 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 18:44:39 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 4 18:44:39 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 4 18:44:39 kjcf05n05 puppet-agent[2270872]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: Starting Zabbix Agent 2 (6.2.1) Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: Starting Zabbix Agent 2 (6.2.1) Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: Press Ctrl+C to exit. Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: Plugin support version 1.0 Nov 4 18:44:39 kjcf05n05 zabbix_agent2[2271869]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 18:44:40 kjcf05n05 puppet-agent[2270872]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 18:44:40 kjcf05n05 puppet-agent[2270872]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 18:44:40 kjcf05n05 puppet-agent[2270872]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 18:44:41 kjcf05n05 puppet-agent[2270872]: Applied catalog in 4.77 seconds Nov 4 18:44:43 kjcf05n00 zabbix_server[15783]: resuming Zabbix agent checks on host "kjcf05n01": connection restored Nov 4 18:44:49 kjcf05n00 mcfcli[3673891]: %3|1730767489.970|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:45:07 kjcf05n00 mcfcli[3673891]: %3|1730767507.449|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 18:45:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730767516}"] Nov 4 18:45:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730767516, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:45:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.163372ms Nov 4 18:45:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.163372ms Nov 4 18:45:16 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:45:16 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:45:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:45:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730767516}"] Nov 4 18:45:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730767516, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:45:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.057624ms Nov 4 18:45:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.057624ms Nov 4 18:45:16 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:45:16 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:45:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:45:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730767516}"] Nov 4 18:45:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730767516, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:45:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:16-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:16 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:16-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:16 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:16-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:16 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.721764ms Nov 4 18:45:16 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:16-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.721764ms Nov 4 18:45:16 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:45:16 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:45:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730767516}"] Nov 4 18:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730767516, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.508188ms Nov 4 18:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.508188ms Nov 4 18:45:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:45:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:45:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730767516}"] Nov 4 18:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730767516, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.172047ms Nov 4 18:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.172047ms Nov 4 18:45:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:45:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:45:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730767516}"] Nov 4 18:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730767516, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.09837ms Nov 4 18:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.09837ms Nov 4 18:45:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:45:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:45:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730767516}"] Nov 4 18:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730767516, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.297612ms Nov 4 18:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.297612ms Nov 4 18:45:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:45:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:45:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730767516}"] Nov 4 18:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730767516, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.212143ms Nov 4 18:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.212143ms Nov 4 18:45:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:45:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:45:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730767516}"] Nov 4 18:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730767516, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.941506ms Nov 4 18:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.941506ms Nov 4 18:45:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:45:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:45:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730767516}"] Nov 4 18:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730767516, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.971743ms Nov 4 18:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.971743ms Nov 4 18:45:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:45:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:45:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730767516}"] Nov 4 18:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730767516, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.0506ms Nov 4 18:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.0506ms Nov 4 18:45:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:45:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:45:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:45:20 kjcf05n04 puppet-agent[2072218]: Caching catalog for kjcf05n04 Nov 4 18:45:20 kjcf05n04 puppet-agent[2072218]: Applying configuration version '1730767518' Nov 4 18:45:22 kjcf05n04 puppet-agent[2072218]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 18:45:22 kjcf05n04 puppet-agent[2072218]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 18:45:22 kjcf05n04 puppet-agent[2072218]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 18:45:22 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 4 18:45:22 kjcf05n04 zabbix_agent2[3780290]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 18:45:22 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 4 18:45:22 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 18:45:22 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 4 18:45:22 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 4 18:45:22 kjcf05n04 puppet-agent[2072218]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: Starting Zabbix Agent 2 (6.2.1) Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: Starting Zabbix Agent 2 (6.2.1) Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: Press Ctrl+C to exit. Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: Plugin support version 1.0 Nov 4 18:45:22 kjcf05n04 zabbix_agent2[2074140]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 18:45:24 kjcf05n04 puppet-agent[2072218]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 18:45:24 kjcf05n04 puppet-agent[2072218]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 18:45:24 kjcf05n04 puppet-agent[2072218]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 18:45:25 kjcf05n04 puppet-agent[2072218]: Applied catalog in 4.82 seconds Nov 4 18:45:24 kjcf05n00 zabbix-server[2341633]: puppet completed status:(0): '' Nov 4 18:45:24 kjcf05n00 zabbix-server[2341633]: Event '46572' acknowledged Nov 4 18:45:24 kjcf05n00 zabbix-server[2341633]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 4 18:45:29 kjcf05n00 mcfcli[3673891]: %3|1730767529.706|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:45:35 kjcf05n00 python3.9[2343157]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 18:45:37 kjcf05n00 mcfcli[3673891]: %3|1730767537.449|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 18:45:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730767547', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 4 18:45:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730767547'} Nov 4 18:45:47 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730767547', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 4 18:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730767547'} Nov 4 18:45:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:46:07 kjcf05n00 mcfcli[3673891]: %3|1730767567.449|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:46:09 kjcf05n00 mcfcli[3673891]: %3|1730767569.703|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:46:37 kjcf05n00 mcfcli[3673891]: %3|1730767597.449|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:46:48 kjcf05n00 mcfcli[3673891]: %3|1730767608.094|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:47:07 kjcf05n00 mcfcli[3673891]: %3|1730767627.449|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:47:18 kjcf05n03 systemd[1]: Starting Cleanup of Temporary Directories... Nov 4 18:47:18 kjcf05n03 systemd-tmpfiles[2371424]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 18:47:18 kjcf05n03 systemd-tmpfiles[2371424]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 18:47:18 kjcf05n03 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 4 18:47:18 kjcf05n03 systemd[1]: Started Cleanup of Temporary Directories. Nov 4 18:47:25 kjcf05n00 mcfcli[3673891]: %3|1730767645.998|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:47:37 kjcf05n00 mcfcli[3673891]: %3|1730767657.450|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 18:48:03 kjcf05n00 mcfcli[3673891]: %3|1730767683.594|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:48:07 kjcf05n00 mcfcli[3673891]: %3|1730767687.450|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:48:37 kjcf05n00 mcfcli[3673891]: %3|1730767717.451|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:48:42 kjcf05n00 mcfcli[3673891]: %3|1730767722.171|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:48:58 kjcf05n02 dwd[5196]: nvme2n1 passed periodic SMART status check Nov 4 18:48:58 kjcf05n02 dwd[5196]: nvme19n1 passed periodic SMART status check Nov 4 18:48:58 kjcf05n02 dwd[5196]: nvme9n1 passed periodic SMART status check Nov 4 18:48:58 kjcf05n02 dwd[5196]: nvme18n1 passed periodic SMART status check Nov 4 18:48:59 kjcf05n02 dwd[5196]: nvme3n1 passed periodic SMART status check Nov 4 18:48:59 kjcf05n02 dwd[5196]: nvme17n1 passed periodic SMART status check Nov 4 18:48:59 kjcf05n02 dwd[5196]: nvme4n1 passed periodic SMART status check Nov 4 18:48:59 kjcf05n02 dwd[5196]: nvme23n1 passed periodic SMART status check Nov 4 18:48:59 kjcf05n02 dwd[5196]: nvme8n1 passed periodic SMART status check Nov 4 18:48:59 kjcf05n02 dwd[5196]: nvme25n1 passed periodic SMART status check Nov 4 18:49:00 kjcf05n02 dwd[5196]: nvme24n1 passed periodic SMART status check Nov 4 18:49:07 kjcf05n00 mcfcli[3673891]: %3|1730767747.451|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 18:49:22 kjcf05n00 mcfcli[3673891]: %3|1730767762.006|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:49:37 kjcf05n00 mcfcli[3673891]: %3|1730767777.451|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 18:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 18:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 18:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 18:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 18:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 18:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 18:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 18:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 18:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 18:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 18:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 18:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 18:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 18:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 18:50:00 kjcf05n00 mcfcli[3673891]: %3|1730767800.581|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:50:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 18:50:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 18:50:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 18:50:07 kjcf05n00 mcfcli[3673891]: %3|1730767807.451|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 18:50:34 kjcf05n00 mcfcli[3673891]: %3|1730767834.612|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:50:35 kjcf05n00 python3.9[2345972]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 18:50:37 kjcf05n00 mcfcli[3673891]: %3|1730767837.451|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 18:51:07 kjcf05n00 mcfcli[3673891]: %3|1730767867.451|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:51:14 kjcf05n00 mcfcli[3673891]: %3|1730767874.609|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:51:37 kjcf05n00 mcfcli[3673891]: %3|1730767897.452|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:51:54 kjcf05n00 mcfcli[3673891]: %3|1730767914.606|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:51:55 kjcf05n03 dwd[5203]: nvme11n1 passed periodic SMART status check Nov 4 18:51:55 kjcf05n03 dwd[5203]: nvme15n1 passed periodic SMART status check Nov 4 18:51:55 kjcf05n03 dwd[5203]: nvme10n1 passed periodic SMART status check Nov 4 18:51:55 kjcf05n03 dwd[5203]: nvme21n1 passed periodic SMART status check Nov 4 18:51:56 kjcf05n03 dwd[5203]: nvme5n1 passed periodic SMART status check Nov 4 18:51:56 kjcf05n03 dwd[5203]: nvme12n1 passed periodic SMART status check Nov 4 18:51:56 kjcf05n03 dwd[5203]: nvme16n1 passed periodic SMART status check Nov 4 18:51:56 kjcf05n03 dwd[5203]: nvme6n1 passed periodic SMART status check Nov 4 18:51:56 kjcf05n03 dwd[5203]: nvme7n1 passed periodic SMART status check Nov 4 18:51:56 kjcf05n03 dwd[5203]: nvme20n1 passed periodic SMART status check Nov 4 18:51:57 kjcf05n03 dwd[5203]: nvme22n1 passed periodic SMART status check Nov 4 18:52:07 kjcf05n00 mcfcli[3673891]: %3|1730767927.452|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:52:34 kjcf05n00 mcfcli[3673891]: %3|1730767954.603|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:52:37 kjcf05n00 mcfcli[3673891]: %3|1730767957.452|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:53:07 kjcf05n00 mcfcli[3673891]: %3|1730767987.452|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 18:53:12 kjcf05n00 mcfcli[3673891]: %3|1730767992.711|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:53:15.867544Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 18:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T00:53:15.867610Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.086ms Nov 4 18:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T18:53:27.269904045-06:00 level=info msg="Completed cleanup jobs" duration=43.50765ms Nov 4 18:53:37 kjcf05n00 mcfcli[3673891]: %3|1730768017.452|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:53:51 kjcf05n00 mcfcli[3673891]: %3|1730768031.226|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:54:07 kjcf05n00 mcfcli[3673891]: %3|1730768047.453|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:54:29 kjcf05n00 mcfcli[3673891]: %3|1730768069.173|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:54:37 kjcf05n00 mcfcli[3673891]: %3|1730768077.454|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:54:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 18:54:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 18:54:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 18:54:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 18:54:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 18:54:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 18:55:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 18:55:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 18:55:06 kjcf05n00 mcfcli[3673891]: %3|1730768106.861|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:55:07 kjcf05n00 mcfcli[3673891]: %3|1730768107.454|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 18:55:19 kjcf05n00 zabbix_server[15752]: Zabbix agent item "vfs.fs.size[/mnt/persistent_ha_data,total]" on host "kjcf05n03" failed: first network error, wait for 15 seconds Nov 4 18:55:25 kjcf05n02 fstonithd.py[15145]: My partner 172.16.2.6 is kdumping. Forcing HA into GATHER state. Nov 4 18:55:25 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 18:55:25 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 18:55:25 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 18:55:27 kjcf05n02 root[67225]: is_viking_off starts Nov 4 18:55:27 kjcf05n02 root[67226]: is_enc_ipmi_off starts Nov 4 18:55:27 kjcf05n02 root[67242]: is_lan_ipmi_off leaves Nov 4 18:55:27 kjcf05n02 root[67244]: is_lan_ipmi_sec_off leaves Nov 4 18:55:27 kjcf05n02 root[67248]: I am not master; I will get master Nov 4 18:55:27 kjcf05n02 root[67251]: I am in slot 0; partner is in slot 1 Nov 4 18:55:32 kjcf05n02 root[67395]: I am now master Nov 4 18:55:33 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='39', error='Connection reset by peer (104)' Nov 4 18:55:33 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='39', client='AF_INET(172.16.2.6:37477)', local='AF_INET(0.0.0.0:601)' Nov 4 18:55:34 kjcf05n02 root[67416]: is_viking_off leaves Nov 4 18:55:34 kjcf05n02 root[67419]: kjcf05n03 not already off look at kdump Nov 4 18:55:34 kjcf05n02 root[67420]: is_kdump_off starts Nov 4 18:55:34 kjcf05n02 fence_kdump[67421]: waiting for message from '172.16.2.6' Nov 4 18:55:34 kjcf05n00 zabbix_server[15764]: Zabbix agent item "system.cpu.util[,guest_nice]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 18:55:34 kjcf05n02 fence_kdump[67421]: received valid message from '172.16.2.6' Nov 4 18:55:34 kjcf05n02 root[67434]: is_kdump_off detected kdump on kjcf05n03 Nov 4 18:55:34 kjcf05n02 root[67435]: kjcf05n03 is kdumping Nov 4 18:55:34 kjcf05n02 root[67524]: is_enc_ipmi_off starts Nov 4 18:55:34 kjcf05n02 root[67523]: is_viking_off starts Nov 4 18:55:34 kjcf05n02 root[67543]: is_lan_ipmi_off leaves Nov 4 18:55:34 kjcf05n02 root[67548]: is_lan_ipmi_sec_off leaves Nov 4 18:55:34 kjcf05n02 root[67563]: I am master Nov 4 18:55:34 kjcf05n02 root[67566]: I am in slot 0; partner is in slot 1 Nov 4 18:55:35 kjcf05n00 zabbix_server[15780]: Zabbix agent item "system.cpu.util[,idle]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 18:55:35 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 4 18:55:35 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 4 18:55:36 kjcf05n00 zabbix_server[15761]: Zabbix agent item "system.cpu.util[,interrupt]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 18:55:37 kjcf05n00 zabbix_server[15737]: Zabbix agent item "system.cpu.util[,iowait]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 18:55:37 kjcf05n00 mcfcli[3673891]: %3|1730768137.455|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 18:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 18:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 18:55:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 18:55:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 18:55:38 kjcf05n00 zabbix_server[15739]: Zabbix agent item "system.cpu.util[,nice]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 18:55:38 kjcf05n00 python3.9[2348761]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 18:55:39 kjcf05n00 zabbix_server[15732]: Zabbix agent item "system.cpu.util[,softirq]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 18:55:46 kjcf05n00 mcfcli[3673891]: %3|1730768146.858|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:55:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 18:55:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 18:55:51 kjcf05n02 root[68314]: is_viking_off leaves Nov 4 18:55:51 kjcf05n02 root[68317]: kjcf05n03 not already off look at kdump Nov 4 18:55:51 kjcf05n02 root[68319]: is_kdump_off starts Nov 4 18:55:51 kjcf05n02 fence_kdump[68321]: waiting for message from '172.16.2.6' Nov 4 18:55:51 kjcf05n02 fence_kdump[68321]: received valid message from '172.16.2.6' Nov 4 18:55:51 kjcf05n02 root[68345]: is_kdump_off detected kdump on kjcf05n03 Nov 4 18:55:51 kjcf05n02 root[68346]: kjcf05n03 is kdumping Nov 4 18:55:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 18:55:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 18:55:54 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vfs.fs.inode[/mnt/persistent_ha_data,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 18:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 18:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 18:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 18:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 18:55:56 kjcf05n02 dwd[5196]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 4 18:55:56 kjcf05n02 dwd[5196]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 4 18:55:56 kjcf05n02 dwd[5196]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 4 18:55:56 kjcf05n02 dwd[5196]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 4 18:55:56 kjcf05n02 dwd[5196]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 4 18:55:56 kjcf05n02 dwd[5196]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 4 18:55:56 kjcf05n02 dwd[5196]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 4 18:55:56 kjcf05n02 dwd[5196]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 4 18:55:56 kjcf05n02 dwd[5196]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 4 18:55:56 kjcf05n02 dwd[5196]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 4 18:55:56 kjcf05n02 dwd[5196]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 4 18:55:56 kjcf05n02 dwd[5196]: Starting NVME thread for nvme16n1 Nov 4 18:55:56 kjcf05n02 dwd[5196]: Starting NVME thread for nvme22n1 Nov 4 18:55:56 kjcf05n02 systemd-udevd[70620]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70619]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70624]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70622]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70624]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70619]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70622]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70620]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70619]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70624]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70622]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70620]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70619]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70624]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70622]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70620]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70622]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70624]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70619]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70620]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70624]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70622]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70619]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70620]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70624]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70620]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70619]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70622]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70622]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70620]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70619]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70624]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70656]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70622]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70620]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70619]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70656]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70622]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70620]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70619]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70656]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70622]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70624]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70619]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70622]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70619]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70622]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70624]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70622]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70624]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70622]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70624]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70622]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70624]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70624]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70624]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70622]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70624]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70622]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70624]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70622]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70624]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70622]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 systemd-udevd[70622]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 18:55:56 kjcf05n02 dwd[5196]: Starting NVME thread for nvme15n1 Nov 4 18:55:56 kjcf05n02 dwd[5196]: Starting NVME thread for nvme6n1 Nov 4 18:55:57 kjcf05n02 dwd[5196]: Starting NVME thread for nvme11n1 Nov 4 18:55:57 kjcf05n02 dwd[5196]: Starting NVME thread for nvme7n1 Nov 4 18:55:57 kjcf05n02 dwd[5196]: Starting NVME thread for nvme10n1 Nov 4 18:55:57 kjcf05n02 dwd[5196]: Starting NVME thread for nvme20n1 Nov 4 18:55:57 kjcf05n02 dwd[5196]: Starting NVME thread for nvme21n1 Nov 4 18:55:57 kjcf05n02 dwd[5196]: Starting NVME thread for nvme5n1 Nov 4 18:55:57 kjcf05n02 dwd[5196]: Starting NVME thread for nvme12n1 Nov 4 18:55:59 kjcf05n02 diskmonitor[17558]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 4 18:56:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 18:56:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 18:56:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 18:56:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 18:56:07 kjcf05n02 diskmonitor[17558]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 4 18:56:07 kjcf05n02 diskmonitor[17558]: Scan for ReadErrorMax change for md66 Nov 4 18:56:07 kjcf05n02 diskmonitor[17558]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 4 18:56:07 kjcf05n02 diskmonitor[17558]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 4 18:56:07 kjcf05n02 diskmonitor[17558]: read_saved_file: md66 no saved speed Nov 4 18:56:07 kjcf05n02 diskmonitor[17558]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 4 18:56:07 kjcf05n02 diskmonitor[17558]: Set sync_speed_min (10000) for md66 Nov 4 18:56:07 kjcf05n02 diskmonitor[17558]: Set sync_speed_max (200000) for md66 Nov 4 18:56:07 kjcf05n02 diskmonitor[17558]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 18:56:07 kjcf05n00 mcfcli[3673891]: %3|1730768167.954|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 18:56:09 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n03": interface unavailable Nov 4 18:56:22 kjcf05n00 mcfcli[3673891]: %3|1730768182.550|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 18:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 18:56:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 18:56:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 18:56:37 kjcf05n00 mcfcli[3673891]: %3|1730768197.954|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:56:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 18:56:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 18:56:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 18:56:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 18:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 18:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 18:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 18:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 18:56:56 kjcf05n02 nslcd[6957]: ldap_result() failed: Can't contact LDAP server Nov 4 18:56:56 kjcf05n02 nslcd[6957]: (re)loading /etc/nsswitch.conf Nov 4 18:56:58 kjcf05n00 mcfcli[3673891]: %3|1730768218.886|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:57:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 18:57:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 18:57:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 18:57:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 18:57:07 kjcf05n00 mcfcli[3673891]: %3|1730768227.954|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:57:37 kjcf05n00 mcfcli[3673891]: %3|1730768257.182|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 18:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 18:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 18:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 18:57:37 kjcf05n00 mcfcli[3673891]: %3|1730768257.954|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 18:57:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730768267}"] Nov 4 18:57:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730768267, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:57:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.100263ms Nov 4 18:57:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.100263ms Nov 4 18:57:47 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:57:47 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:57:47 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:57:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730768267}"] Nov 4 18:57:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730768267, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:57:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.329643ms Nov 4 18:57:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.329643ms Nov 4 18:57:47 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:57:47 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:57:47 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:57:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730768267}"] Nov 4 18:57:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730768267, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:57:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.174302ms Nov 4 18:57:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.174302ms Nov 4 18:57:47 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:57:47 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:57:47 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:57:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730768267}"] Nov 4 18:57:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730768267, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:57:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.236659ms Nov 4 18:57:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.236659ms Nov 4 18:57:47 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:57:47 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:57:47 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:57:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730768267}"] Nov 4 18:57:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730768267, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:57:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.721126ms Nov 4 18:57:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.721126ms Nov 4 18:57:47 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:57:47 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:57:47 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:57:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730768267}"] Nov 4 18:57:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730768267, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:57:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.048246ms Nov 4 18:57:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.048246ms Nov 4 18:57:47 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:57:47 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:57:47 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:57:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730768267}"] Nov 4 18:57:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730768267, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:57:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.881653ms Nov 4 18:57:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.881653ms Nov 4 18:57:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:57:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:57:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:57:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730768267}"] Nov 4 18:57:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730768267, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:57:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 18:57:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 18:57:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.872457ms Nov 4 18:57:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.872457ms Nov 4 18:57:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:57:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:57:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:57:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730768267}"] Nov 4 18:57:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730768267, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:57:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.803738ms Nov 4 18:57:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.803738ms Nov 4 18:57:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:57:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:57:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:57:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730768267}"] Nov 4 18:57:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730768267, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:57:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.957085ms Nov 4 18:57:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.957085ms Nov 4 18:57:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:57:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:57:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:57:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730768267}"] Nov 4 18:57:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730768267, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 18:57:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 18:57:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T18:57:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 18:57:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T18:57:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 18:57:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T18:57:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.035012ms Nov 4 18:57:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T18:57:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.035012ms Nov 4 18:57:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:18:57:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 18:57:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 18:57:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 18:57:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 18:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 18:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 18:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 18:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 18:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 18:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 18:58:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 18:58:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 18:58:07 kjcf05n00 mcfcli[3673891]: %3|1730768287.954|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 18:58:12 kjcf05n00 mcfcli[3673891]: %3|1730768292.833|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:58:33 kjcf05n00 zabbix-server[2350823]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 18:58:33 kjcf05n00 zabbix-server[2350823]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n03:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 4 18:58:33 kjcf05n00 log_interesting_event.py[2350823]: Event '46574' acknowledged Nov 4 18:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 18:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 18:58:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 18:58:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 18:58:37 kjcf05n00 mcfcli[3673891]: %3|1730768317.955|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:58:43 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 4 18:58:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 18:58:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 18:58:50 kjcf05n00 mcfcli[3673891]: %3|1730768330.701|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:58:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 18:58:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 18:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 18:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 18:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 18:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 18:59:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 18:59:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 18:59:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 18:59:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 18:59:02 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:9a:1a Nov 4 18:59:02 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 4 18:59:06 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 4 18:59:06 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a kjcf05n03 Nov 4 18:59:06 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.6 Nov 4 18:59:06 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 4 18:59:06 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 4 18:59:06 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.6 Nov 4 18:59:06 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/pxelinux.cfg to 172.16.2.6 Nov 4 18:59:07 kjcf05n00 mcfcli[3673891]: %3|1730768347.955|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 18:59:08 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/vmlinuz_diskless to 172.16.2.6 Nov 4 18:59:11 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/initramfs-diskless.img to 172.16.2.6 Nov 4 18:59:29 kjcf05n00 mcfcli[3673891]: %3|1730768369.706|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 18:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 18:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 18:59:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 18:59:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 18:59:38 kjcf05n00 mcfcli[3673891]: %3|1730768378.037|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 18:59:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 18:59:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 18:59:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 18:59:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 18:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 18:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 18:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 18:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 18:59:58 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:56862). Nov 4 18:59:58 kjcf05n01 rsyncd[3827227]: connect from kjcf05n03 (172.16.2.6) Nov 4 18:59:58 kjcf05n01 rsyncd[3827227]: rsync on puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 4 18:59:58 kjcf05n01 rsyncd[3827227]: building file list Nov 4 18:59:58 kjcf05n01 rsyncd[3827227]: sent 11440 bytes received 132 bytes total size 10901 Nov 4 18:59:58 kjcf05n01 systemd[1]: rsyncd@655-172.16.2.2:873-172.16.2.6:56862.service: Succeeded. Nov 4 19:00:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 19:00:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 19:00:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 19:00:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 19:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 19:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 19:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 19:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 19:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 19:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 19:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 19:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 19:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 19:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 19:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 19:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 19:00:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 19:00:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:00:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 19:00:08 kjcf05n00 mcfcli[3673891]: %3|1730768408.037|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:00:09 kjcf05n00 mcfcli[3673891]: %3|1730768409.703|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T01:00:10.409924Z lvl=info msg="TSI log compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=1 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=start Nov 4 19:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T01:00:10.411259Z lvl=info msg="Log file compacted" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=1 op_name=tsi1_compact_log_file tsi1_log_file_id=1 elapsed=1ms bytes=12227 kb_per_sec=8801 Nov 4 19:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T01:00:10.411288Z lvl=info msg="TSI log compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=1 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=end op_elapsed=1.384ms Nov 4 19:00:25 kjcf05n02 fstonithd.py[15145]: Listening for kdump packets from partner Nov 4 19:00:35 kjcf05n00 python3.9[2351830]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 19:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 19:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 19:00:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 19:00:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 19:00:38 kjcf05n00 mcfcli[3673891]: %3|1730768438.037|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 19:00:47 kjcf05n00 mcfcli[3673891]: %3|1730768447.274|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:00:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 19:00:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 19:00:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730768449', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 19:00:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730768449'} Nov 4 19:00:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:00:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730768449', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 19:00:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730768449'} Nov 4 19:00:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:00:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 19:00:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 19:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 19:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 19:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 19:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 19:01:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 19:01:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 19:01:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 19:01:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 19:01:08 kjcf05n00 mcfcli[3673891]: %3|1730768468.037|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:01:11 kjcf05n02 dwd[5196]: nvme22n1 passed periodic SMART status check Nov 4 19:01:11 kjcf05n02 dwd[5196]: nvme16n1 passed periodic SMART status check Nov 4 19:01:11 kjcf05n02 dwd[5196]: nvme11n1 passed periodic SMART status check Nov 4 19:01:11 kjcf05n02 dwd[5196]: nvme15n1 passed periodic SMART status check Nov 4 19:01:11 kjcf05n02 dwd[5196]: nvme6n1 passed periodic SMART status check Nov 4 19:01:12 kjcf05n02 dwd[5196]: nvme7n1 passed periodic SMART status check Nov 4 19:01:12 kjcf05n02 dwd[5196]: nvme21n1 passed periodic SMART status check Nov 4 19:01:12 kjcf05n02 dwd[5196]: nvme12n1 passed periodic SMART status check Nov 4 19:01:12 kjcf05n02 dwd[5196]: nvme10n1 passed periodic SMART status check Nov 4 19:01:12 kjcf05n02 dwd[5196]: nvme20n1 passed periodic SMART status check Nov 4 19:01:12 kjcf05n02 dwd[5196]: nvme5n1 passed periodic SMART status check Nov 4 19:01:23 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='15', client='AF_INET(172.16.2.6:36285)', local='AF_INET(0.0.0.0:601)' Nov 4 19:01:23 kjcf05n03 syslog-ng[3190]: Configuration reload request received, reloading configuration; Nov 4 19:01:23 kjcf05n03 syslog-ng[3190]: Configuration reload finished; Nov 4 19:01:23 kjcf05n03 syslog-ng[3190]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 4 19:01:23 kjcf05n03 dracut: dracut-049-135.git20210121.el8 Nov 4 19:01:23 kjcf05n03 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 19:01:23 kjcf05n03 dracut: Loading and integrity checking all crypto modules Nov 4 19:01:23 kjcf05n03 dracut: Self testing crypto algorithms Nov 4 19:01:23 kjcf05n03 dracut: rd.md=0: removing MD RAID activation Nov 4 19:01:23 kjcf05n03 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 19:01:23 kjcf05n03 Copying live image to RAM... Nov 4 19:01:23 kjcf05n03 (this may take a minute) Nov 4 19:01:23 kjcf05n03 Done copying live image to RAM. Nov 4 19:01:23 kjcf05n03 dracut: Mounted root filesystem LiveOS_rootfs Nov 4 19:01:23 kjcf05n03 dracut: Checking integrity of kernel Nov 4 19:01:23 kjcf05n03 dracut: All initrd crypto checks done Nov 4 19:01:23 kjcf05n03 dracut: Switching root Nov 4 19:01:23 kjcf05n03 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 4 19:01:23 kjcf05n03 systemd: Detected architecture x86-64. Nov 4 19:01:23 kjcf05n03 systemd: Set hostname to . Nov 4 19:01:23 kjcf05n03 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 4 19:01:23 kjcf05n03 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 4 19:01:23 kjcf05n03 systemd: Listening on RPCbind Server Activation Socket. Nov 4 19:01:23 kjcf05n03 systemd: Listening on Process Core Dump Socket. Nov 4 19:01:23 kjcf05n03 systemd: Created slice system-serial\x2dgetty.slice. Nov 4 19:01:23 kjcf05n03 systemd: Listening on initctl Compatibility Named Pipe. Nov 4 19:01:23 kjcf05n03 systemd: Listening on Device-mapper event daemon FIFOs. Nov 4 19:01:23 kjcf05n03 systemd-journald[1526]: Journal started Nov 4 19:01:23 kjcf05n03 systemd-journald[1526]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 19:01:23 kjcf05n03 systemd-modules-load[1507]: Inserted module 'fuse' Nov 4 19:01:23 kjcf05n03 systemd[1]: Mounted /mnt. Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Rebuild Hardware Database... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Create System Users... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Load/Save Random Seed... Nov 4 19:01:23 kjcf05n03 systemd[1]: Mounting Kernel Configuration File System... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Apply Kernel Variables... Nov 4 19:01:23 kjcf05n03 systemd[1]: Mounting FUSE Control File System... Nov 4 19:01:23 kjcf05n03 systemd[1]: Mounted Kernel Configuration File System. Nov 4 19:01:23 kjcf05n03 systemd[1]: Mounted FUSE Control File System. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Create System Users. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Load/Save Random Seed. Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 4 19:01:23 kjcf05n03 systemd-journald[1526]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 19:01:23 kjcf05n03 systemd-sysctl[1543]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 19:01:23 kjcf05n03 systemd-sysctl[1543]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Apply Kernel Variables. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Flush Journal to Persistent Storage. Nov 4 19:01:23 kjcf05n03 systemd-tmpfiles[1548]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 19:01:23 kjcf05n03 systemd-tmpfiles[1548]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Create Static Device Nodes in /dev. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started udev Coldplug all Devices. Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Rebuild Hardware Database. Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting udev Kernel Device Manager... Nov 4 19:01:23 kjcf05n03 systemd-udevd[1557]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started udev Kernel Device Manager. Nov 4 19:01:23 kjcf05n03 systemd[1]: Found device /dev/ttyS0. Nov 4 19:01:23 kjcf05n03 systemd-udevd[1582]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:01:23 kjcf05n03 systemd-udevd[1606]: Using default interface naming scheme 'rhel-8.0'. Nov 4 19:01:23 kjcf05n03 systemd-udevd[1606]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:01:23 kjcf05n03 systemd-udevd[1583]: Using default interface naming scheme 'rhel-8.0'. Nov 4 19:01:23 kjcf05n03 systemd-udevd[1583]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:01:23 kjcf05n03 systemd-udevd[1575]: Using default interface naming scheme 'rhel-8.0'. Nov 4 19:01:23 kjcf05n03 systemd-udevd[1575]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 4 19:01:23 kjcf05n03 systemd[1]: Reached target Local File Systems (Pre). Nov 4 19:01:23 kjcf05n03 systemd[1]: Reached target Local File Systems. Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Rebuild Journal Catalog... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Mark the need to relabel after reboot... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting openibd - configure Mellanox devices... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Create Volatile Files and Directories... Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Rebuild Journal Catalog. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Mark the need to relabel after reboot. Nov 4 19:01:23 kjcf05n03 systemd-tmpfiles[1781]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 19:01:23 kjcf05n03 systemd-tmpfiles[1781]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 19:01:23 kjcf05n03 root[1798]: openibd: running in auto mode Nov 4 19:01:23 kjcf05n03 systemd-tmpfiles[1781]: "/var/tmp" already exists and is not a directory. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Create Volatile Files and Directories. Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting RPC Bind... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting RDMA Node Description Daemon... Nov 4 19:01:23 kjcf05n03 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 4 19:01:23 kjcf05n03 systemd[1]: Started RPC Bind. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started RDMA Node Description Daemon. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 4 19:01:23 kjcf05n03 systemd-modules-load[1856]: Inserted module 'ib_iser' Nov 4 19:01:23 kjcf05n03 systemd-modules-load[1856]: Inserted module 'ib_isert' Nov 4 19:01:23 kjcf05n03 systemd-modules-load[1856]: Inserted module 'ib_srpt' Nov 4 19:01:23 kjcf05n03 systemd-modules-load[1851]: Inserted module 'ib_ipoib' Nov 4 19:01:23 kjcf05n03 systemd-udevd[1560]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:01:23 kjcf05n03 systemd-udevd[1592]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:01:23 kjcf05n03 systemd-modules-load[1856]: Inserted module 'rdma_ucm' Nov 4 19:01:23 kjcf05n03 systemd-modules-load[1856]: Module 'svcrdma' is blacklisted Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 4 19:01:23 kjcf05n03 systemd-udevd[1592]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 19:01:23 kjcf05n03 systemd-udevd[1560]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 19:01:23 kjcf05n03 systemd-modules-load[1851]: Inserted module 'ib_umad' Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 4 19:01:23 kjcf05n03 systemd[1]: Reached target RDMA Hardware. Nov 4 19:01:23 kjcf05n03 systemd[1]: Reached target Network (Pre). Nov 4 19:01:23 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 19:01:23 kjcf05n03 systemd[3190]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:23 kjcf05n03 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 4 19:01:23 kjcf05n03 openibd[1776]: Loading HCA driver and Access Layer:[ OK ] Nov 4 19:01:23 kjcf05n03 systemd[1]: Started openibd - configure Mellanox devices. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Update is Completed... Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Update is Completed. Nov 4 19:01:23 kjcf05n03 setup-icl[1758]: Setting LAN IP Address to 203.0.113.4 Nov 4 19:01:23 kjcf05n03 setup-icl[1758]: Setting LAN Subnet Mask to 255.255.255.0 Nov 4 19:01:23 kjcf05n03 setup-icl[1758]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 4 19:01:23 kjcf05n03 setup-icl[1758]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 4 19:01:23 kjcf05n03 systemd-udevd[1560]: Using default interface naming scheme 'rhel-8.0'. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 4 19:01:23 kjcf05n03 systemd[1]: Reached target System Initialization. Nov 4 19:01:23 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 4 19:01:23 kjcf05n03 systemd[1]: Listening on lldpad.socket. Nov 4 19:01:23 kjcf05n03 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 4 19:01:23 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 4 19:01:23 kjcf05n03 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 4 19:01:23 kjcf05n03 systemd[1]: Reached target Sockets. Nov 4 19:01:23 kjcf05n03 systemd[1]: Reached target Basic System. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Manage Cutlass PHYs... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[2113]: Setting up Mellanox network interface: ib1 Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 4 19:01:23 kjcf05n03 mdraid-phy[2114]: no Cutlass to worry about Nov 4 19:01:23 kjcf05n03 dwd[2112]: dwd: vMay 29 2024 : 15:38:26 Nov 4 19:01:23 kjcf05n03 dwd[2112]: /usr/sbin/dwd -d --standalone=0 Nov 4 19:01:23 kjcf05n03 dwd[2112]: dwd: option Lethal: 0 Nov 4 19:01:23 kjcf05n03 dwd[2112]: dwd: option Interval: 60 Nov 4 19:01:23 kjcf05n03 dwd[2112]: dwd: option abrtlimit: 10 Nov 4 19:01:23 kjcf05n03 dwd[2112]: dwd: option DZPeriod: 604800 Nov 4 19:01:23 kjcf05n03 dwd[2112]: dwd: option SmartPeriod: 43200 Nov 4 19:01:23 kjcf05n03 dwd[2112]: dwd: option SDDEnabled: 1 Nov 4 19:01:23 kjcf05n03 dwd[2112]: dwd: option SDDAwaitScale: 3 Nov 4 19:01:23 kjcf05n03 dwd[2112]: dwd: option SDDAwaitMin: 100 Nov 4 19:01:23 kjcf05n03 dwd[2112]: dwd: option Verbosity: 1 Nov 4 19:01:23 kjcf05n03 dwd[2112]: dwd: option StandAlone: 0 Nov 4 19:01:23 kjcf05n03 dwd[2112]: option Lethal: 0 Nov 4 19:01:23 kjcf05n03 dwd[2112]: option Interval: 60 Nov 4 19:01:23 kjcf05n03 dwd[2112]: option abrtlimit: 10 Nov 4 19:01:23 kjcf05n03 dwd[2112]: option DZPeriod: 604800 Nov 4 19:01:23 kjcf05n03 dwd[2112]: option SmartPeriod: 43200 Nov 4 19:01:23 kjcf05n03 dwd[2112]: option SDDEnabled: 1 Nov 4 19:01:23 kjcf05n03 dwd[2112]: option SDDAwaitScale: 3 Nov 4 19:01:23 kjcf05n03 dwd[2112]: option SDDAwaitMin: 100 Nov 4 19:01:23 kjcf05n03 dwd[2112]: option Verbosity: 1 Nov 4 19:01:23 kjcf05n03 dwd[2112]: option StandAlone: 0 Nov 4 19:01:23 kjcf05n03 systemd[1]: Started D-Bus System Message Bus. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started irqbalance daemon. Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[2152]: Setting up Mellanox network interface: ib0 Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting LSB: Bring up/down networking... Nov 4 19:01:23 kjcf05n03 dbus-daemon[2132]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 19:01:23 kjcf05n03 network[2182]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[2186]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 19:01:23 kjcf05n03 chronyd[2227]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Resets System Activity Logs... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 4 19:01:23 kjcf05n03 network[2225]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 19:01:23 kjcf05n03 network[2182]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 4 19:01:23 kjcf05n03 beSetMlxConfig[2233]: ConnectX-3 multiport not detected Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[2230]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 0 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 1 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 2 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 3 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 4 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 5 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 6 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 7 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 8 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 9 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 10 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 11 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 12 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 13 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 14 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 15 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 16 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 17 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 18 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 19 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 20 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 21 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 22 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 23 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 24 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 25 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 26 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 27 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 28 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 29 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 30 Nov 4 19:01:23 kjcf05n03 cpupower[2243]: Setting cpu: 31 Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[2238]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Name Service Cache Daemon... Nov 4 19:01:23 kjcf05n03 mcelog[2255]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 4 19:01:23 kjcf05n03 mcelog[2255]: CPU is unsupported Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 19:01:23 kjcf05n03 network[2245]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:01:23 kjcf05n03 network[2182]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 4 19:01:23 kjcf05n03 nscd[2268]: 2268 monitoring file `/etc/hosts` (1) Nov 4 19:01:23 kjcf05n03 nscd[2268]: 2268 monitoring directory `/etc` (2) Nov 4 19:01:23 kjcf05n03 nscd[2268]: 2268 monitoring file `/etc/resolv.conf` (3) Nov 4 19:01:23 kjcf05n03 nscd[2268]: 2268 monitoring directory `/etc` (2) Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Manage Cutlass PHYs. Nov 4 19:01:23 kjcf05n03 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[2262]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[2263]: No configuration found for ib1 Nov 4 19:01:23 kjcf05n03 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 4 19:01:23 kjcf05n03 chronyd[2227]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 19:01:23 kjcf05n03 chronyd[2227]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 4 19:01:23 kjcf05n03 network[2269]: It is advised to switch to 'NetworkManager' instead for network management. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Resets System Activity Logs. Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[2277]: No configuration found for ib0 Nov 4 19:01:23 kjcf05n03 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 4 19:01:23 kjcf05n03 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[2283]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Name Service Cache Daemon. Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 0 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 1 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 2 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 3 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 4 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 5 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 6 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 7 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 8 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 9 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 10 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 11 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 12 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 13 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 14 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 15 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 16 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 17 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 18 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 19 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 20 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 21 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 22 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 23 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 24 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 25 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 26 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 27 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 28 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 29 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 30 Nov 4 19:01:23 kjcf05n03 cpupower[2304]: Idlestate 2 disabled on CPU 31 Nov 4 19:01:23 kjcf05n03 beSetMlxConfig[2233]: Starting MST (Mellanox Software Tools) driver set Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[2308]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 19:01:23 kjcf05n03 mlnx_conf_mgr[2335]: INFO: No configurations found for mlx5_1, skipping. Nov 4 19:01:23 kjcf05n03 beSetMlxConfig[2233]: Loading MST PCI module - Success Nov 4 19:01:23 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 19:01:23 kjcf05n03 mlnx_conf_mgr[2357]: INFO: No configurations found for mlx5_0, skipping. Nov 4 19:01:23 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 19:01:23 kjcf05n03 beSetMlxConfig[2233]: Loading MST PCI configuration module - Success Nov 4 19:01:23 kjcf05n03 beSetMlxConfig[2233]: Create devices Nov 4 19:01:23 kjcf05n03 sssd[sssd][2250]: Starting up Nov 4 19:01:23 kjcf05n03 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 4 19:01:23 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 4 19:01:23 kjcf05n03 sssd[be[implicit_files]][2428]: Starting up Nov 4 19:01:23 kjcf05n03 sssd[nss][2532]: Starting up Nov 4 19:01:23 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 4 19:01:23 kjcf05n03 systemd[1]: Reached target User and Group Name Lookups. Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Login Service... Nov 4 19:01:23 kjcf05n03 systemd-logind[2668]: New seat seat0. Nov 4 19:01:23 kjcf05n03 systemd-logind[2668]: Watching system buttons on /dev/input/event0 (Power Button) Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Login Service. Nov 4 19:01:23 kjcf05n03 python3.9[2223]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 19:01:23 kjcf05n03 python3.9[3190]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 19:01:23 kjcf05n03 systemd-sysctl[2789]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 19:01:23 kjcf05n03 systemd-sysctl[2789]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 4 19:01:23 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 19:01:23 kjcf05n03 python3.9[2863]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 19:01:23 kjcf05n03 python3.9[3190]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 4 19:01:23 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 19:01:23 kjcf05n03 network[2182]: Bringing up loopback interface: [ OK ] Nov 4 19:01:23 kjcf05n03 systemd-sysctl[3140]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 19:01:23 kjcf05n03 systemd-sysctl[3140]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 19:01:23 kjcf05n03 systemd[1]: Started LSB: Bring up/down networking. Nov 4 19:01:23 kjcf05n03 python3.9[3065]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 19:01:23 kjcf05n03 python3.9[3190]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:23 kjcf05n03 systemd[1]: Reached target Network. Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 4 19:01:23 kjcf05n03 systemd[1]: Reached target Network is Online. Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Notify NFS peers of a restart... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting System Logger Daemon... Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 19:01:23 kjcf05n03 sm-notify[3187]: Version 2.3.3 starting Nov 4 19:01:23 kjcf05n03 systemd[1]: Started GSSAPI Proxy Daemon. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Notify NFS peers of a restart. Nov 4 19:01:23 kjcf05n03 systemd[1]: Reached target NFS client services. Nov 4 19:01:23 kjcf05n03 sshd[3178]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 4 19:01:23 kjcf05n03 systemd[1]: Reached target Remote File Systems (Pre). Nov 4 19:01:23 kjcf05n03 systemd[1]: Reached target Remote File Systems. Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Permit User Sessions... Nov 4 19:01:23 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 4 19:01:23 kjcf05n03 lldpad[3179]: setsockopt nearest_bridge: Invalid argument Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Permit User Sessions. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Getty on tty1. Nov 4 19:01:23 kjcf05n03 lldpad[3179]: setsockopt nearest_bridge: Invalid argument Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Serial Getty on ttyS0. Nov 4 19:01:23 kjcf05n03 systemd[1]: Reached target Login Prompts. Nov 4 19:01:23 kjcf05n03 beSetMlxConfig[2233]: Unloading MST PCI module (unused) - Success Nov 4 19:01:23 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 19:01:23 kjcf05n03 syslog-ng[3190]: [2024-11-05T01:00:11.238299] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 4 19:01:23 kjcf05n03 syslog-ng[3190]: [2024-11-05T01:00:11.238569] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 4 19:01:23 kjcf05n03 syslog-ng[3190]: [2024-11-05T01:00:11.238604] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 4 19:01:23 kjcf05n03 syslog-ng[3190]: [2024-11-05T01:00:11.239183] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 4 19:01:23 kjcf05n03 syslog-ng[3190]: [2024-11-05T01:00:11.239492] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 4 19:01:23 kjcf05n03 systemd[1]: Started System Logger Daemon. Nov 4 19:01:23 kjcf05n03 python3.9[3230]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 19:01:23 kjcf05n03 python3.9[3190]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 4 19:01:23 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 19:01:23 kjcf05n03 python3.9[3431]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 19:01:23 kjcf05n03 python3.9[3190]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 4 19:01:23 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 4 19:01:23 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 19:01:23 kjcf05n03 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 4 19:01:23 kjcf05n03 chronyd[2227]: System's initial offset : 0.003115 seconds slow of true (slew) Nov 4 19:01:23 kjcf05n03 systemd[1]: Started NTP client/server. Nov 4 19:01:23 kjcf05n03 beSetMlxConfig[2233]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 19:01:23 kjcf05n03 beSetMlxConfig[2233]: ib mode Nov 4 19:01:23 kjcf05n03 beSetMlxConfig[2233]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 19:01:23 kjcf05n03 root[3454]: openibd: Set node_desc for mlx5_0: kjcf05n03 HCA-1 Nov 4 19:01:23 kjcf05n03 root[3456]: openibd: Set node_desc for mlx5_1: kjcf05n03 HCA-2 Nov 4 19:01:23 kjcf05n03 beSetMlxConfig[2233]: ib mode Nov 4 19:01:23 kjcf05n03 systemd-udevd[1557]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 19:01:23 kjcf05n03 systemd-udevd[3470]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:01:23 kjcf05n03 systemd-udevd[3471]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:01:23 kjcf05n03 systemd-udevd[3474]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:01:23 kjcf05n03 systemd-udevd[3477]: Using default interface naming scheme 'rhel-8.0'. Nov 4 19:01:23 kjcf05n03 systemd-udevd[3477]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:01:23 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 19:01:23 kjcf05n03 systemd[3190]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:23 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[3512]: Setting up Mellanox network interface: ib1 Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[3513]: Setting up Mellanox network interface: ib0 Nov 4 19:01:23 kjcf05n03 systemd-udevd[3472]: Using default interface naming scheme 'rhel-8.0'. Nov 4 19:01:23 kjcf05n03 systemd-udevd[3472]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:01:23 kjcf05n03 systemd-udevd[3473]: Using default interface naming scheme 'rhel-8.0'. Nov 4 19:01:23 kjcf05n03 systemd-udevd[3473]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Puppet agent... Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[3562]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[3563]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[3593]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[3594]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[3596]: No configuration found for ib0 Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[3597]: No configuration found for ib1 Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[3601]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[3605]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 19:01:23 kjcf05n03 mlnx_conf_mgr[3638]: INFO: No configurations found for mlx5_0, skipping. Nov 4 19:01:23 kjcf05n03 mlnx_conf_mgr[3645]: INFO: No configurations found for mlx5_1, skipping. Nov 4 19:01:23 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 19:01:23 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 19:01:23 kjcf05n03 systemd[1]: Stopping Command Scheduler... Nov 4 19:01:23 kjcf05n03 systemd[1]: crond.service: Succeeded. Nov 4 19:01:23 kjcf05n03 systemd[1]: Stopped Command Scheduler. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 4 19:01:23 kjcf05n03 systemd[1]: Stopping Job spooling tools... Nov 4 19:01:23 kjcf05n03 systemd[1]: atd.service: Succeeded. Nov 4 19:01:23 kjcf05n03 systemd[1]: Stopped Job spooling tools. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 19:01:23 kjcf05n03 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 4 19:01:23 kjcf05n03 lldpad[3179]: init_ports: Error adding device ib0 Nov 4 19:01:23 kjcf05n03 lldpad[3179]: init_ports: Error adding device ib1 Nov 4 19:01:23 kjcf05n03 lldpad[3179]: Signal 15 received - terminating Nov 4 19:01:23 kjcf05n03 systemd[1]: lldpad.service: Succeeded. Nov 4 19:01:23 kjcf05n03 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 4 19:01:23 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 4 19:01:23 kjcf05n03 systemd[1]: lldpad.socket: Succeeded. Nov 4 19:01:23 kjcf05n03 systemd[1]: Closed lldpad.socket. Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 4 19:01:23 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting IPMI Driver... Nov 4 19:01:23 kjcf05n03 systemd[1]: Started IPMI Driver. Nov 4 19:01:23 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:23 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:23 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Ipmievd Daemon... Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 1 | Nov-04-2024 | 00:33:53 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 2 | Nov-04-2024 | 00:34:45 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 3 | Nov-04-2024 | 00:34:45 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 4 | Nov-04-2024 | 00:36:01 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 5 | Nov-04-2024 | 00:36:01 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 6 | Nov-04-2024 | 15:39:54 | Sensor #7 (Generator ID 20h) | Voltage | Assertion Event | Upper Non-critical - going high ; Sensor Reading = F0h ; Threshold = C8h Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 7 | Nov-04-2024 | 15:39:54 | Sensor #7 (Generator ID 20h) | Voltage | Assertion Event | Upper Critical - going high ; Sensor Reading = F0h ; Threshold = D2h Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 8 | Nov-04-2024 | 15:39:54 | Sensor #7 (Generator ID 20h) | Voltage | Assertion Event | Upper Non-recoverable - going high ; Sensor Reading = F0h ; Threshold = DCh Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 9 | Nov-04-2024 | 15:39:57 | Sensor #7 (Generator ID 20h) | Voltage | Deassertion Event | Upper Non-recoverable - going high ; Sensor Reading = B4h ; Threshold = DCh Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 10 | Nov-04-2024 | 15:39:57 | Sensor #7 (Generator ID 20h) | Voltage | Deassertion Event | Upper Critical - going high ; Sensor Reading = B4h ; Threshold = D2h Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 11 | Nov-04-2024 | 15:39:57 | Sensor #7 (Generator ID 20h) | Voltage | Deassertion Event | Upper Non-critical - going high ; Sensor Reading = B4h ; Threshold = C8h Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 12 | Nov-05-2024 | 00:56:06 | Sensor #0 (Generator ID 21h) | Memory | Assertion Event | Correctable memory error ; OEM Event Data2 code = 30h ; OEM Event Data3 code = 00h Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 13 | Nov-05-2024 | 00:57:31 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 14 | Nov-05-2024 | 00:57:31 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 15 | Nov-05-2024 | 00:57:31 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 16 | Nov-05-2024 | 00:57:31 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 17 | Nov-05-2024 | 00:57:31 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 18 | Nov-05-2024 | 00:57:31 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 19 | Nov-05-2024 | 00:57:31 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 20 | Nov-05-2024 | 00:57:31 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 21 | Nov-05-2024 | 00:57:31 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 22 | Nov-05-2024 | 00:57:31 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 23 | Nov-05-2024 | 00:57:31 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 24 | Nov-05-2024 | 00:57:31 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 25 | Nov-05-2024 | 00:58:02 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 26 | Nov-05-2024 | 00:58:02 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 27 | Nov-05-2024 | 00:58:02 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 28 | Nov-05-2024 | 00:58:02 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 29 | Nov-05-2024 | 00:58:02 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 30 | Nov-05-2024 | 00:58:02 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 31 | Nov-05-2024 | 00:58:02 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 32 | Nov-05-2024 | 00:58:02 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 33 | Nov-05-2024 | 00:58:02 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 34 | Nov-05-2024 | 00:58:02 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 35 | Nov-05-2024 | 00:58:02 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 19:01:23 kjcf05n03 ipmievd[3985]: 36 | Nov-05-2024 | 00:58:02 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 19:01:23 kjcf05n03 ipmievd[3988]: Reading sensors... Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Ipmievd Daemon. Nov 4 19:01:23 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:23 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 4 19:01:23 kjcf05n03 nscd[2268]: 2268 monitored file `/etc/hosts` was moved into place, adding watch Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 19:01:23 kjcf05n03 systemd[1]: set-mlx-config.service: Succeeded. Nov 4 19:01:23 kjcf05n03 systemd[1]: Stopped Set Mellanox configuration. Nov 4 19:01:23 kjcf05n03 systemd[1]: Stopping Set Mellanox configuration... Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 4 19:01:23 kjcf05n03 beSetMlxConfig[4046]: ConnectX-3 multiport not detected Nov 4 19:01:23 kjcf05n03 beSetMlxConfig[4046]: Starting MST (Mellanox Software Tools) driver set Nov 4 19:01:23 kjcf05n03 beSetMlxConfig[4046]: Loading MST PCI module - Success Nov 4 19:01:23 kjcf05n03 systemd-udevd[1557]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 19:01:23 kjcf05n03 beSetMlxConfig[4046]: [warn] mst_pciconf is already loaded, skipping Nov 4 19:01:23 kjcf05n03 beSetMlxConfig[4046]: Create devices Nov 4 19:01:23 kjcf05n03 beSetMlxConfig[4046]: Unloading MST PCI module (unused) - Success Nov 4 19:01:23 kjcf05n03 ipmievd[3988]: Waiting for events... Nov 4 19:01:23 kjcf05n03 beSetMlxConfig[4046]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 19:01:23 kjcf05n03 beSetMlxConfig[4046]: ib mode Nov 4 19:01:23 kjcf05n03 beSetMlxConfig[4046]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 19:01:23 kjcf05n03 beSetMlxConfig[4046]: ib mode Nov 4 19:01:23 kjcf05n03 systemd-udevd[1557]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 19:01:23 kjcf05n03 systemd-udevd[4958]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:01:23 kjcf05n03 systemd-udevd[4959]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:01:23 kjcf05n03 systemd-udevd[4962]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:01:23 kjcf05n03 systemd-udevd[4964]: Using default interface naming scheme 'rhel-8.0'. Nov 4 19:01:23 kjcf05n03 systemd-udevd[4964]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:01:23 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 19:01:23 kjcf05n03 systemd[3190]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:23 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[5001]: Setting up Mellanox network interface: ib1 Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[5000]: Setting up Mellanox network interface: ib0 Nov 4 19:01:23 kjcf05n03 systemd-udevd[4960]: Using default interface naming scheme 'rhel-8.0'. Nov 4 19:01:23 kjcf05n03 systemd-udevd[4961]: Using default interface naming scheme 'rhel-8.0'. Nov 4 19:01:23 kjcf05n03 systemd-udevd[4960]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:01:23 kjcf05n03 systemd-udevd[4961]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[5050]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[5051]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[5081]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[5082]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[5083]: No configuration found for ib1 Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[5084]: No configuration found for ib0 Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[5089]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 19:01:23 kjcf05n03 mlnx_interface_mgr[5092]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 19:01:23 kjcf05n03 mlnx_conf_mgr[5128]: INFO: No configurations found for mlx5_1, skipping. Nov 4 19:01:23 kjcf05n03 mlnx_conf_mgr[5132]: INFO: No configurations found for mlx5_0, skipping. Nov 4 19:01:23 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 19:01:23 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}7c22d4f3aa36654438ab0329deb6ddad4438b2f26eb8eda25190cf7276d2ecbc' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}7c22d4f3aa36654438ab0329deb6ddad4438b2f26eb8eda25190cf7276d2ecbc' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}05510cea4577a52155046b4e8936a96676c1edbdceee6f56edc4cd19d73649ec' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}05510cea4577a52155046b4e8936a96676c1edbdceee6f56edc4cd19d73649ec' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}7e896b8a0d5ef9097c73da4d2641151e7499e52a4582aac0ad2c69dd52266319' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}7e896b8a0d5ef9097c73da4d2641151e7499e52a4582aac0ad2c69dd52266319' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}fef59891fb5915f3035115df840de830d35f6b6486a9249b90f7b0cf45c6eac3' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}fef59891fb5915f3035115df840de830d35f6b6486a9249b90f7b0cf45c6eac3' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 19:01:23 kjcf05n03 systemd[1]: Stopping NTP client/server... Nov 4 19:01:23 kjcf05n03 chronyd[2227]: chronyd exiting Nov 4 19:01:23 kjcf05n03 systemd[1]: chronyd.service: Succeeded. Nov 4 19:01:23 kjcf05n03 systemd[1]: Stopped NTP client/server. Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 4 19:01:23 kjcf05n03 chronyd[5166]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 19:01:23 kjcf05n03 chronyd[5166]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 19:01:23 kjcf05n03 chronyd[5166]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 19:01:23 kjcf05n03 chronyd[5166]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 4 19:01:23 kjcf05n03 systemd[1]: Started NTP client/server. Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 19:01:23 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:23 kjcf05n03 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 4 19:01:23 kjcf05n03 systemd[1]: dwd.service: Succeeded. Nov 4 19:01:23 kjcf05n03 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 19:01:23 kjcf05n03 dwd[5198]: dwd: vMay 29 2024 : 15:38:26 Nov 4 19:01:23 kjcf05n03 dwd[5198]: /usr/sbin/dwd -i 15 -d Nov 4 19:01:23 kjcf05n03 dwd[5198]: dwd: option Lethal: 0 Nov 4 19:01:23 kjcf05n03 dwd[5198]: dwd: option Interval: 15 Nov 4 19:01:23 kjcf05n03 dwd[5198]: dwd: option abrtlimit: 10 Nov 4 19:01:23 kjcf05n03 dwd[5198]: dwd: option DZPeriod: 604800 Nov 4 19:01:23 kjcf05n03 dwd[5198]: dwd: option SmartPeriod: 43200 Nov 4 19:01:23 kjcf05n03 dwd[5198]: dwd: option SDDEnabled: 1 Nov 4 19:01:23 kjcf05n03 dwd[5198]: dwd: option SDDAwaitScale: 3 Nov 4 19:01:23 kjcf05n03 dwd[5198]: dwd: option SDDAwaitMin: 100 Nov 4 19:01:23 kjcf05n03 dwd[5198]: dwd: option Verbosity: 1 Nov 4 19:01:23 kjcf05n03 dwd[5198]: dwd: option StandAlone: 0 Nov 4 19:01:23 kjcf05n03 dwd[5198]: option Lethal: 0 Nov 4 19:01:23 kjcf05n03 dwd[5198]: option Interval: 15 Nov 4 19:01:23 kjcf05n03 dwd[5198]: option abrtlimit: 10 Nov 4 19:01:23 kjcf05n03 dwd[5198]: option DZPeriod: 604800 Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 19:01:23 kjcf05n03 dwd[5198]: option SmartPeriod: 43200 Nov 4 19:01:23 kjcf05n03 dwd[5198]: option SDDEnabled: 1 Nov 4 19:01:23 kjcf05n03 dwd[5198]: option SDDAwaitScale: 3 Nov 4 19:01:23 kjcf05n03 dwd[5198]: option SDDAwaitMin: 100 Nov 4 19:01:23 kjcf05n03 dwd[5198]: option Verbosity: 1 Nov 4 19:01:23 kjcf05n03 dwd[5198]: option StandAlone: 0 Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 4 19:01:23 kjcf05n03 dwd[5199]: option Lethal now set to 1 Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 19:01:23 kjcf05n03 dwd[5199]: option abrtlimit now set to 1 Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 19:01:23 kjcf05n03 dwd[5199]: option SmartPeriod now set to 86400 Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 19:01:23 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 19:01:23 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Discard unused blocks. Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:23 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 19:01:23 kjcf05n03 python3.9[5228]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 4 19:01:23 kjcf05n03 python3.9[3190]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:23 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Periodic ZFS scrub. Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:23 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 19:01:23 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:23 kjcf05n03 systemd[1]: Starting Sed Control Plane worker process... Nov 4 19:01:23 kjcf05n03 sedcpwrkr[5367]: Using config script: /etc/sedcpwrkr.conf Nov 4 19:01:23 kjcf05n03 sedcpwrkr[5367]: - Creating default directory: '/var/log/sedcpwrkr' Nov 4 19:01:23 kjcf05n03 sedcpwrkr[5367]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 4 19:01:23 kjcf05n03 sedcpwrkr[5367]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 4 19:01:23 kjcf05n03 sedcpwrkr[5367]: - Creating default directory: '/var/run/sedcpwrkr' Nov 4 19:01:23 kjcf05n03 sedcpwrkr[5367]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 4 19:01:23 kjcf05n03 sedcpwrkr[5367]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 4 19:01:23 kjcf05n03 sedcpwrkr-server[5398]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 19:01:23 kjcf05n03 sedcpwrkr[5367]: celery multi v5.2.7 (dawn-chorus) Nov 4 19:01:23 kjcf05n03 sedcpwrkr[5367]: > Starting nodes... Nov 4 19:01:23 kjcf05n03 sedcpwrkr[5367]: > sedcpwrkr@kjcf05n03: OK Nov 4 19:01:23 kjcf05n03 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 4 19:01:23 kjcf05n03 sedcpwrkr-server[5400]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 19:01:23 kjcf05n03 sedcpwrkr-server[5400]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 19:01:23 kjcf05n03 sedcpwrkr-server[5400]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 19:01:23 kjcf05n03 systemd[1]: Started Sed Control Plane worker process. Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 19:01:23 kjcf05n03 systemd[1]: Reloading System Logger Daemon. Nov 4 19:01:23 kjcf05n03 systemd[1]: Reloaded System Logger Daemon. Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 19:01:23 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 4 19:01:23 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 4 19:01:23 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:24 kjcf05n03 systemd[1]: Starting IPv4 firewall with iptables... Nov 4 19:01:24 kjcf05n03 systemd-udevd[1557]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 19:01:24 kjcf05n03 iptables.init[5467]: iptables: Applying firewall rules: [ OK ] Nov 4 19:01:24 kjcf05n03 systemd[1]: Started IPv4 firewall with iptables. Nov 4 19:01:24 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:24 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:24 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:24 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:24 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 4 19:01:24 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 4 19:01:24 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 19:01:24 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 19:01:24 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 4 19:01:24 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 4 19:01:24 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 4 19:01:24 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 4 19:01:24 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 4 19:01:24 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 19:01:25 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:24 kjcf05n00 mcfcli[3673891]: %3|1730768484.908|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:01:25 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 19:01:25 kjcf05n03 systemd[1]: openhpid.service: Supervising process 5564 which is not our child. We'll most likely not notice when it exits. Nov 4 19:01:25 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 19:01:25 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:25 kjcf05n03 openhpid[5564]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 19:01:25 kjcf05n03 openhpid[5564]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 19:01:25 kjcf05n03 openhpid[5564]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 19:01:25 kjcf05n03 openhpid[5564]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 19:01:25 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 4 19:01:25 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 19:01:25 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 19:01:26 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:26 kjcf05n03 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 4 19:01:26 kjcf05n03 dcs-collectord[5655]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 4 19:01:26 kjcf05n03 hpi.inv.log[5655]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 4 19:01:26 kjcf05n03 dcs-collectord[5655]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 4 19:01:26 kjcf05n03 dcs-collectord[5655]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 4 19:01:26 kjcf05n03 dcs-collector[5646]: Starting dcs-collector:[ OK ] Nov 4 19:01:26 kjcf05n03 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 4 19:01:26 kjcf05n03 dcs-collectord[5658]: INFO Starting collection for memory_info (collection_process.py:52) Nov 4 19:01:26 kjcf05n03 dcs-collectord[5658]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 19:01:26 kjcf05n03 dcs-collectord[5658]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 19:01:26 kjcf05n03 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 4 19:01:26 kjcf05n03 dcs-collectord[5658]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 19:01:26 kjcf05n03 dcs-collectord[5658]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 4 19:01:26 kjcf05n03 dcs-collectord[5658]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 4 19:01:26 kjcf05n03 dcs-collectord[5658]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 4 19:01:26 kjcf05n03 dcs-collectord[5658]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259344724", "units": "kB"}, {"name": "MemAvailable", "value": "258624780", "units": "kB"}, {"name": "Buffers", "value": "84336", "units": "kB"}, {"name": "Cached", "value": "1821384", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1688152", "units": "kB"}, {"name": "Inactive", "value": "962688", "units": "kB"}, {"name": "Active(anon)", "value": "1521064", "units": "kB"}, {"name": "Inactive(anon)", "value": "827316", "units": "kB"}, {"name": "Active(file)", "value": "167088", "units": "kB"}, {"name": "Inactive(file)", "value": "135372", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "754544", "units": "kB"}, {"name": "Mapped", "value": "86860", "units": "kB"}, {"name": "Shmem", "value": "1593448", "units": "kB"}, {"name": "KReclaimable", "value": "109472", "units": "kB"}, {"name": "Slab", "value": "275304", "units": "kB"}, {"name": "SReclaimable", "value": "109472", "units": "kB"}, {"name": "SUnreclaim", "value": "165832", "units": "kB"}, {"name": "KernelStack", "value": "9840", "units": "kB"}, {"name": "PageTables", "value": "19296", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3096528", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11264", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "4096", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "252232", "units": "kB"}, {"name": "DirectMap2M", "value": "21633024", "units": "kB"}, {"name": "DirectMap1G", "value": "246415360", "units": "kB"}]}' Nov 4 19:01:26 kjcf05n03 dcs-collectord[5658]: INFO Completed collection for memory_info (collection_process.py:59) Nov 4 19:01:26 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:27 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:27 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:27 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:27 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 4 19:01:27 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 4 19:01:27 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 19:01:27 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 19:01:27 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:27 kjcf05n03 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 4 19:01:27 kjcf05n03 firmware-update-orc[5739]: Using config script: /etc/firmware_update_orc.conf Nov 4 19:01:27 kjcf05n03 firmware-update-orc[5739]: - Creating default directory: '/var/log/firmware-update-orc' Nov 4 19:01:27 kjcf05n03 firmware-update-orc[5739]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 4 19:01:27 kjcf05n03 firmware-update-orc[5739]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 4 19:01:27 kjcf05n03 firmware-update-orc[5739]: - Creating default directory: '/var/run/firmware-update-orc' Nov 4 19:01:27 kjcf05n03 firmware-update-orc[5739]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 4 19:01:27 kjcf05n03 firmware-update-orc[5739]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 4 19:01:28 kjcf05n03 dcs-collectord[5658]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 4 19:01:28 kjcf05n03 dcs-collectord[5658]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730768486.565492], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730768487.735372], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730768486.4997165, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 4 19:01:28 kjcf05n03 firmware-update-orc-server[5775]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 19:01:28 kjcf05n03 firmware-update-orc[5739]: celery multi v5.2.7 (dawn-chorus) Nov 4 19:01:28 kjcf05n03 firmware-update-orc[5739]: > Starting nodes... Nov 4 19:01:28 kjcf05n03 firmware-update-orc[5739]: > worker1@kjcf05n03: OK Nov 4 19:01:28 kjcf05n03 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 4 19:01:28 kjcf05n03 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 4 19:01:28 kjcf05n03 firmware-update-orc-server[5804]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 19:01:28 kjcf05n03 firmware-update-orc-server[5804]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 19:01:28 kjcf05n03 firmware-update-orc-server[5804]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 19:01:28 kjcf05n03 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 4 19:01:28 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:28 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:28 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:28 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:28 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 19:01:28 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 19:01:28 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 19:01:28 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 19:01:28 kjcf05n03 dbus-daemon[2132]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 19:01:28 kjcf05n03 dbus-daemon[2132]: [system] Reloaded configuration Nov 4 19:01:28 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 4 19:01:28 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 4 19:01:28 kjcf05n03 dbus-daemon[2132]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 19:01:28 kjcf05n03 dbus-daemon[2132]: [system] Reloaded configuration Nov 4 19:01:28 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 19:01:28 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 19:01:28 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 19:01:28 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 19:01:28 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:28 kjcf05n03 systemd[1]: Starting Manages hardware resources... Nov 4 19:01:29 kjcf05n03 ras-resource-manager-agent[5920]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 4 19:01:29 kjcf05n03 ras-resource-manager-agent[5906]: Starting ras-resource-manager-agent:[ OK ] Nov 4 19:01:29 kjcf05n03 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 4 19:01:29 kjcf05n03 ras-resource-manager-agent[5922]: INFO Starting the service handler (service_main_handler.py:98) Nov 4 19:01:29 kjcf05n03 ras-resource-manager-client[5922]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 4 19:01:29 kjcf05n03 systemd[1]: Started Manages hardware resources. Nov 4 19:01:29 kjcf05n03 ras-resource-manager-client[5922]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 19:01:29 kjcf05n03 ras-resource-manager-client[5932]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 19:01:29 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:29 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:29 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:29 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:29 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 19:01:29 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 19:01:30 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:30 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 4 19:01:30 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:30 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: Press Ctrl+C to exit. Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: Plugin support version 1.0 Nov 4 19:01:30 kjcf05n03 zabbix_agent2[6006]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 19:01:30 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:30 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:30 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:30 kjcf05n03 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 4 19:01:31 kjcf05n03 dcs-notification-sender[6082]: dcs-notification-senderd is stopped Nov 4 19:01:31 kjcf05n03 zabbix-agent2[6096]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 4 19:01:31 kjcf05n03 dcs-notification-sender[6082]: Starting notification-sender:[ OK ] Nov 4 19:01:31 kjcf05n03 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 4 19:01:31 kjcf05n03 zabbix-agent2[6098]: INFO DCS notification agent started. (agent.py:61) Nov 4 19:01:31 kjcf05n03 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 4 19:01:31 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:31 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:31 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:31 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:31 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:31 kjcf05n03 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 4 19:01:32 kjcf05n03 dcs-collectord[6187]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 4 19:01:32 kjcf05n03 dcs-collectord[6187]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 4 19:01:32 kjcf05n03 dcs-bulk-data-sender[6187]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 4 19:01:32 kjcf05n03 dcs-bulk-data-sender[6178]: Starting bulk-data-sender:[ OK ] Nov 4 19:01:32 kjcf05n03 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 4 19:01:32 kjcf05n03 dcs-collectord[6213]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 4 19:01:32 kjcf05n03 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 4 19:01:32 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:32 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:32 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:32 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:32 kjcf05n03 nscd[2268]: 2268 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 4 19:01:32 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 19:01:32 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 19:01:32 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 19:01:32 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 19:01:32 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 19:01:32 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 19:01:32 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 4 19:01:32 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 4 19:01:32 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 4 19:01:32 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 4 19:01:32 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 19:01:32 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 19:01:32 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 19:01:32 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 19:01:33 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 19:01:33 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 19:01:33 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 19:01:33 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 19:01:33 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 4 19:01:33 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 4 19:01:33 kjcf05n03 systemd[1]: Stopping System Security Services Daemon... Nov 4 19:01:33 kjcf05n03 sssd[nss][2532]: Shutting down (status = 0) Nov 4 19:01:33 kjcf05n03 sssd[be[implicit_files]][2428]: Shutting down (status = 0) Nov 4 19:01:33 kjcf05n03 systemd[1]: sssd.service: Succeeded. Nov 4 19:01:33 kjcf05n03 systemd[1]: Stopped System Security Services Daemon. Nov 4 19:01:33 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 4 19:01:33 kjcf05n03 sssd[sssd][6281]: Starting up Nov 4 19:01:33 kjcf05n03 sssd[be[implicit_files]][6282]: Starting up Nov 4 19:01:34 kjcf05n03 python3.9[5228]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 4 19:01:34 kjcf05n03 python3.9[3190]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:34 kjcf05n03 sssd[nss][6283]: Starting up Nov 4 19:01:34 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 19:01:34 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 4 19:01:34 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 4 19:01:35 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 19:01:35 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 19:01:35 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure) defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 4 19:01:35 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure: defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 4 19:01:35 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure) defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 4 19:01:35 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure: defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 4 19:01:35 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 19:01:35 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 19:01:35 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 19:01:35 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 19:01:35 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:01:35 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:01:35 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:35 kjcf05n03 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 4 19:01:35 kjcf05n03 icinga2[6339]: [2024-11-04 19:01:35 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 4 19:01:35 kjcf05n03 icinga2[6339]: [2024-11-04 19:01:35 -0600] information/cli: Loading configuration file(s). Nov 4 19:01:35 kjcf05n03 icinga2[6339]: [2024-11-04 19:01:35 -0600] information/ConfigItem: Committing config item(s). Nov 4 19:01:35 kjcf05n03 icinga2[6339]: [2024-11-04 19:01:35 -0600] information/ApiListener: My API identity: kjcf05n03 Nov 4 19:01:35 kjcf05n03 icinga2[6339]: [2024-11-04 19:01:35 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 4 19:01:35 kjcf05n03 icinga2[6339]: [2024-11-04 19:01:35 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 4 19:01:35 kjcf05n03 icinga2[6339]: [2024-11-04 19:01:35 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 4 19:01:35 kjcf05n03 icinga2[6339]: [2024-11-04 19:01:35 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 4 19:01:35 kjcf05n03 icinga2[6339]: [2024-11-04 19:01:35 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 4 19:01:35 kjcf05n03 icinga2[6339]: [2024-11-04 19:01:35 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 4 19:01:35 kjcf05n03 icinga2[6339]: [2024-11-04 19:01:35 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 4 19:01:35 kjcf05n03 icinga2[6339]: [2024-11-04 19:01:35 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 4 19:01:35 kjcf05n03 icinga2[6339]: [2024-11-04 19:01:35 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 4 19:01:35 kjcf05n03 icinga2[6339]: [2024-11-04 19:01:35 -0600] information/cli: Closing console log. Nov 4 19:01:35 kjcf05n03 systemd[1]: Started Icinga host/service/network monitoring system. Nov 4 19:01:35 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:36 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:36 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:36 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:36 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 19:01:36 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 19:01:36 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:37 kjcf05n03 systemd[1]: Started Icinga2 network monitor. Nov 4 19:01:37 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:37 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 19:01:37 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:37 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 19:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 19:01:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 19:01:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 19:01:38 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 19:01:38 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 19:01:38 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 19:01:38 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 19:01:38 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 4 19:01:38 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 4 19:01:38 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 4 19:01:38 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 4 19:01:38 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 19:01:38 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 19:01:38 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 19:01:38 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 19:01:38 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 4 19:01:38 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 4 19:01:38 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:38 kjcf05n00 mcfcli[3673891]: %3|1730768498.038|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 19:01:38 kjcf05n03 systemd[1]: Starting Naming services LDAP client daemon.... Nov 4 19:01:38 kjcf05n03 nslcd[6951]: version 0.9.9 starting Nov 4 19:01:38 kjcf05n03 nslcd[6951]: accepting connections Nov 4 19:01:38 kjcf05n03 systemd[1]: Started Naming services LDAP client daemon.. Nov 4 19:01:38 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:39 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:39 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:39 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:39 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 19:01:39 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 19:01:39 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 19:01:39 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 19:01:39 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 19:01:39 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 19:01:40 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 19:01:40 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 19:01:40 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:40 kjcf05n03 dcs-bulk-data-sender[6213]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 4 19:01:40 kjcf05n03 dcs-collectord[6213]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 4 19:01:40 kjcf05n03 systemd[1]: Starting DEAR Control Plane worker process... Nov 4 19:01:40 kjcf05n03 dearcpw[7052]: Using config script: /etc/dearcpw.conf Nov 4 19:01:40 kjcf05n03 dearcpw[7052]: - Creating default directory: '/var/log/dearcpw' Nov 4 19:01:40 kjcf05n03 dearcpw[7052]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 4 19:01:40 kjcf05n03 dearcpw[7052]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 4 19:01:40 kjcf05n03 dearcpw[7052]: - Creating default directory: '/var/run/dearcpw' Nov 4 19:01:40 kjcf05n03 dearcpw[7052]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 4 19:01:40 kjcf05n03 dearcpw[7052]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 4 19:01:40 kjcf05n03 dearcpw-server[7092]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 19:01:40 kjcf05n03 dearcpw[7052]: celery multi v5.2.7 (dawn-chorus) Nov 4 19:01:40 kjcf05n03 dearcpw[7052]: > Starting nodes... Nov 4 19:01:40 kjcf05n03 dearcpw[7052]: > dearcpw@kjcf05n03: OK Nov 4 19:01:40 kjcf05n03 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 4 19:01:40 kjcf05n03 dearcpw-server[7094]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 19:01:40 kjcf05n03 dearcpw-server[7094]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 19:01:40 kjcf05n03 dearcpw-server[7094]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 19:01:41 kjcf05n03 systemd[1]: Started DEAR Control Plane worker process. Nov 4 19:01:41 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:41 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:41 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 4 19:01:41 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 4 19:01:41 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 4 19:01:41 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 4 19:01:41 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 4 19:01:41 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 4 19:01:41 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 4 19:01:41 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 4 19:01:41 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 4 19:01:41 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 4 19:01:41 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:56896). Nov 4 19:01:41 kjcf05n01 rsyncd[3827740]: connect from kjcf05n03 (172.16.2.6) Nov 4 19:01:41 kjcf05n01 rsyncd[3827740]: rsync to puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 4 19:01:41 kjcf05n01 rsyncd[3827740]: receiving file list Nov 4 19:01:41 kjcf05n01 rsyncd[3827740]: sent 29 bytes received 325 bytes total size 10901 Nov 4 19:01:41 kjcf05n01 systemd[1]: rsyncd@656-172.16.2.2:873-172.16.2.6:56896.service: Succeeded. Nov 4 19:01:41 kjcf05n03 puppet[7132]: IEC: 017000000: Node is up and running: { "node": "kjcf05n03" } Nov 4 19:01:41 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 4 19:01:41 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 4 19:01:41 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 4 19:01:41 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 4 19:01:41 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 4 19:01:41 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 4 19:01:41 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 19:01:41 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 19:01:41 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 19:01:41 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 19:01:41 kjcf05n03 dcs-collectord[5658]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 19:01:41 kjcf05n03 dcs-collectord[5658]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 19:01:42 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 19:01:42 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 19:01:42 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 19:01:42 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 19:01:42 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 19:01:42 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 19:01:42 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 19:01:42 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 19:01:43 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 19:01:43 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 19:01:43 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 19:01:43 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 19:01:44 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 19:01:44 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 19:01:44 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:44 kjcf05n03 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 4 19:01:44 kjcf05n03 diskless-swap[7217]: HA_PS_000: recovering journal Nov 4 19:01:44 kjcf05n03 systemd-udevd[1557]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 19:01:44 kjcf05n03 diskless-swap[7217]: HA_PS_000: clean, 2285/6400 files, 7056/25600 blocks Nov 4 19:01:45 kjcf05n03 diskless-swap[7217]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 4 19:01:45 kjcf05n03 diskless-swap[7217]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 4 19:01:45 kjcf05n03 diskless-swap[7217]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 4 19:01:45 kjcf05n03 diskless-swap[7217]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 4 19:01:45 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 4 19:01:45 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:45 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:45 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 4 19:01:45 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 4 19:01:45 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 19:01:45 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 19:01:45 kjcf05n03 ipmievd[3988]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 4 19:01:45 kjcf05n03 ipmievd[3988]: System Event sensor - Timestamp Clock Sync Nov 4 19:01:45 kjcf05n03 systemd[1]: Stopping OpenSSH server daemon... Nov 4 19:01:45 kjcf05n03 systemd[1]: sshd.service: Succeeded. Nov 4 19:01:45 kjcf05n03 systemd[1]: Stopped OpenSSH server daemon. Nov 4 19:01:45 kjcf05n03 systemd[1]: Stopped target sshd-keygen.target. Nov 4 19:01:45 kjcf05n03 systemd[1]: Stopping sshd-keygen.target. Nov 4 19:01:45 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 4 19:01:45 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 4 19:01:45 kjcf05n03 ipmievd[3988]: System Event sensor - Timestamp Clock Sync Nov 4 19:01:45 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 4 19:01:45 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 4 19:01:45 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 4 19:01:46 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 19:01:46 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 19:01:46 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 19:01:46 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 19:01:46 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 19:01:46 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 19:01:47 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 19:01:47 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 19:01:47 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 19:01:47 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 19:01:48 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 19:01:48 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 19:01:48 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 19:01:48 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 19:01:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 19:01:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 19:01:48 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 19:01:48 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 19:01:48 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 19:01:48 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 19:01:48 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:49 kjcf05n03 systemd[1]: Set up automount opt-firmware.automount. Nov 4 19:01:49 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:49 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:49 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 4 19:01:49 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 4 19:01:49 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:49 kjcf05n03 systemd[1]: Set up automount mnt-llog.automount. Nov 4 19:01:49 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:49 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:49 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 19:01:49 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 19:01:49 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:49 kjcf05n03 systemd[1]: Set up automount usr-share-man.automount. Nov 4 19:01:49 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:01:49 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:01:49 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 4 19:01:49 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 4 19:01:49 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 4 19:01:49 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 4 19:01:49 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 4 19:01:49 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 4 19:01:49 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 19:01:49 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 19:01:49 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 19:01:49 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 19:01:50 kjcf05n03 systemd[1]: Reloading. Nov 4 19:01:50 kjcf05n03 systemd[1]: Starting Crash recovery kernel arming... Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: kdump: No kdump initial ramdisk found. Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 4 19:01:50 kjcf05n03 dracut[8055]: dracut-049-135.git20210121.el8 Nov 4 19:01:50 kjcf05n03 dracut[8057]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 4 19:01:50 kjcf05n03 dracut[8057]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 19:01:50 kjcf05n03 dracut[8057]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 19:01:50 kjcf05n03 dracut[8057]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 4 19:01:50 kjcf05n03 dracut[8057]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 4 19:01:50 kjcf05n03 dracut[8057]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 19:01:50 kjcf05n03 dracut[8057]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 19:01:50 kjcf05n03 dracut[8057]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + is_func check Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ type -t check Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + '[' 0 -ne 0 ']' Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + check -h Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + local dev holder Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + require_binaries mdadm expr Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + local _module_name=90hperaid Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + local _ret=0 Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + [[ mdadm = \-\m ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + for cmd in "$@" Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + find_binary mdadm Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + for cmd in "$@" Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + find_binary expr Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + return 0 Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + [[ -n -h ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + for dev in "${!host_fs_types[@]}" Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + [[ nfs != *_raid_member ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + continue Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + return 255 Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + _ret=255 Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + hostonly=-h Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + return 255 Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + ret=255 Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + [[ 255 = 0 ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + [[ 255 = 255 ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ module_depends hperaid Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: +++ read a b Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ local _ret Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ unset check depends cmdline install installkernel Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: +++ set -x Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ depends Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ echo rootfs-block Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ return 0 Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ _ret=0 Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ unset check depends cmdline install installkernel Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ return 0 Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + for _moddep in $(module_depends $_mod) Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + [[ all == *\ hperaid\ * ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + add_dracutmodules+=' rootfs-block ' Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + [[ == *\ hperaid\ * ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + check_module rootfs-block Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + local _mod=rootfs-block Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + local _moddep Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + [[ == *\ rootfs-block\ * ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + [[ -n '' ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + mods_checked_as_dep+=' rootfs-block ' Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + [[ all == *\ rootfs-block\ * ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + module_check rootfs-block 0 Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + local _forced=0 Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + local _hostonly=-h Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + '[' 2 -eq 2 ']' Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + _forced=0 Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + is_func check Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ type -t check Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + '[' 0 -ne 0 ']' Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + check -h Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + return 0 Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + _ret=0 Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + hostonly=-h Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + return 0 Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + ret=0 Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: + [[ 0 = 0 ]] Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: ++ module_depends rootfs-block Nov 4 19:01:50 kjcf05n03 kdumpctl[7943]: +++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 19:01:51 kjcf05n03 kdumpctl[3190]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ depends Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo fs-lib Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ _ret=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ return 0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + for _moddep in $(module_depends $_mod) Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all == *\ rootfs-block\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + add_dracutmodules+=' fs-lib ' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ == *\ rootfs-block\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check_module fs-lib Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _mod=fs-lib Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddep Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n '' ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + mods_checked_as_dep+=' fs-lib ' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all == *\ fs-lib\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + module_check fs-lib 0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _forced=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _hostonly=-h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 2 -eq 2 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _forced=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + is_func check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ type -t check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 0 -ne 0 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check -h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _ret=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + hostonly=-h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + ret=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ 0 = 0 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ module_depends fs-lib Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: +++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ depends Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ return 0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ _ret=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ return 0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + mods_to_load+=' fs-lib ' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + mods_to_load+=' rootfs-block ' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + mods_to_load+=' hperaid ' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _mod=90kernel-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _mod=kernel-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check_module kernel-modules 1 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _mod=kernel-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddep Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n 1 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all = all ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + module_check kernel-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _forced=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _hostonly=-h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 1 -eq 2 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + is_func check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ type -t check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 0 -ne 0 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check -h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + true Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _ret=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + hostonly=-h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + ret=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ 0 != 0 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ module_depends kernel-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: +++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ depends Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ true Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ _ret=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ return 0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + mods_to_load+=' kernel-modules ' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _mod=90kernel-modules-extra Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _mod=kernel-modules-extra Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check_module kernel-modules-extra 1 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _mod=kernel-modules-extra Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddep Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n 1 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all = all ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + module_check kernel-modules-extra Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _forced=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _hostonly=-h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 1 -eq 2 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + is_func check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ type -t check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 0 -ne 0 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check -h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + true Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _ret=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + hostonly=-h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + ret=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ 0 != 0 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ module_depends kernel-modules-extra Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: +++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ depends Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ true Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ _ret=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ return 0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + mods_to_load+=' kernel-modules-extra ' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _mod=90kernel-network-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _mod=kernel-network-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check_module kernel-network-modules 1 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _mod=kernel-network-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddep Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n 1 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all = all ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + module_check kernel-network-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _forced=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _hostonly=-h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 1 -eq 2 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + is_func check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ type -t check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 0 -ne 0 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check -h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _ret=255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + hostonly=-h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + ret=255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ 255 != 0 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n 1 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 1 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _mod=90livenet Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _mod=livenet Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check_module livenet 1 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _mod=livenet Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddep Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n 1 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all = all ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + module_check livenet Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _forced=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _hostonly=-h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 1 -eq 2 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + is_func check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ type -t check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 0 -ne 0 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check -h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _ret=255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + hostonly=-h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + ret=255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ 255 != 0 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n 1 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 1 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _mod=90lvm Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _mod=lvm Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check_module lvm 1 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _mod=lvm Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddep Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n 1 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all = all ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + module_check lvm Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _forced=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _hostonly=-h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 1 -eq 2 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + is_func check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ type -t check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 0 -ne 0 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check -h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + require_binaries lvm Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _module_name=90lvm Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ lvm = \-\m ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + for cmd in "$@" Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + find_binary lvm Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n -h ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + for fs in "${host_fs_types[@]}" Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ nfs = LVM*_member ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _ret=255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + hostonly=-h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + ret=255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ 255 != 0 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n 1 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 1 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _mod=90mdraid Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _mod=mdraid Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check_module mdraid 1 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _mod=mdraid Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddep Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n 1 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all = all ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + module_check mdraid Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _forced=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _hostonly=-h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 1 -eq 2 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + is_func check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ type -t check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 0 -ne 0 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check -h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _rootdev Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + require_binaries mdadm expr Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _module_name=90mdraid Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ mdadm = \-\m ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + for cmd in "$@" Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + find_binary mdadm Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + for cmd in "$@" Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + find_binary expr Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n -h ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + for dev in "${!host_fs_types[@]}" Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ nfs != *_raid_member ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + continue Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _ret=255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + hostonly=-h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + ret=255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ 255 != 0 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n 1 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 1 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _mod=90multipath Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _mod=multipath Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check_module multipath 1 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _mod=multipath Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddep Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n 1 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all = all ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + module_check multipath Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _forced=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _hostonly=-h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 1 -eq 2 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + is_func check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ type -t check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 0 -ne 0 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check -h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _rootdev Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n -h ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + for_each_host_dev_and_slaves is_mpath Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _func=is_mpath Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _dev Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + for _dev in "${host_devs[@]}" Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + continue Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 1 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _ret=255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + hostonly=-h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + ret=255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ 255 != 0 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n 1 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 1 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _mod=90qemu Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _mod=qemu Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check_module qemu 1 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _mod=qemu Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddep Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n 1 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all = all ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + module_check qemu Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _forced=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _hostonly=-h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 1 -eq 2 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + is_func check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ type -t check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 0 -ne 0 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check -h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n -h ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + type -P systemd-detect-virt Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ systemd-detect-virt --vm Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + vm=none Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + (( 1 != 0 )) Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _ret=255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + hostonly=-h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + ret=255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ 255 != 0 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n 1 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 1 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _mod=90qemu-net Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _mod=qemu-net Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check_module qemu-net 1 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _mod=qemu-net Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddep Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n 1 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all = all ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + module_check qemu-net Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _forced=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _hostonly=-h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 1 -eq 2 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + is_func check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ type -t check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 0 -ne 0 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check -h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n -h ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + type -P systemd-detect-virt Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ systemd-detect-virt --vm Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + vm= Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + (( 1 != 0 )) Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _ret=255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + hostonly=-h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + ret=255 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ 255 != 0 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n 1 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + return 1 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _mod=90stratis Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + _mod=stratis Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check_module stratis 1 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _mod=stratis Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddep Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -n 1 ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ all = all ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + module_check stratis Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ read a b Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _forced=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _hostonly=-h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 1 -eq 2 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + is_func check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: ++ type -t check Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + '[' 0 -ne 0 ']' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + check -h Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _module_name=90stratis Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + local _ret=0 Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + [[ stratisd-init = \-\m ]] Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + for cmd in "$@" Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + find_binary stratisd-init Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 4 19:01:51 kjcf05n03 kdumpctl[7943]: + set +x Nov 4 19:01:51 kjcf05n03 dracut[8057]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 19:01:51 kjcf05n03 dracut[8057]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 4 19:01:51 kjcf05n03 dracut[8057]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 4 19:01:51 kjcf05n03 dracut[8057]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 4 19:01:50 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 4 19:01:50 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 4 19:01:50 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 4 19:01:50 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running Nov 4 19:01:50 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 4 19:01:51 kjcf05n03 dracut[8057]: memstrack is available Nov 4 19:01:51 kjcf05n03 dracut[8057]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 19:01:51 kjcf05n03 dracut[8057]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 19:01:51 kjcf05n03 dracut[8057]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 19:01:51 kjcf05n03 dracut[8057]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 19:01:51 kjcf05n03 dracut[8057]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 19:01:51 kjcf05n03 dracut[8057]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 19:01:51 kjcf05n03 dracut[8057]: *** Including module: bash *** Nov 4 19:01:51 kjcf05n03 dracut[8057]: *** Including module: systemd *** Nov 4 19:01:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 19:01:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 19:01:52 kjcf05n03 dracut[8057]: *** Including module: fips *** Nov 4 19:01:53 kjcf05n03 dracut[8057]: *** Including module: systemd-initrd *** Nov 4 19:01:53 kjcf05n03 dracut[8057]: *** Including module: watchdog-modules *** Nov 4 19:01:53 kjcf05n03 dracut[8057]: *** Including module: nss-softokn *** Nov 4 19:01:53 kjcf05n03 dracut[8057]: *** Including module: i18n *** Nov 4 19:01:53 kjcf05n03 dracut[8057]: No KEYMAP configured. Nov 4 19:01:53 kjcf05n03 dracut[8057]: *** Including module: network-legacy *** Nov 4 19:01:53 kjcf05n03 dracut[8057]: *** Including module: network *** Nov 4 19:01:53 kjcf05n03 dracut[8057]: *** Including module: ib_bonding *** Nov 4 19:01:53 kjcf05n03 dracut[8057]: *** Including module: drm *** Nov 4 19:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 19:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 19:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 19:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 19:01:56 kjcf05n03 dcs-collectord[5658]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 19:01:56 kjcf05n03 dcs-collectord[5658]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 19:01:57 kjcf05n03 dracut[8057]: *** Including module: hperaid *** Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + install Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + local rule rule_path Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + inst_multiple cat expr Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.bkfTdN/initramfs -a -f cat expr Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + _ret=0 Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + (( 0 != 0 )) Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + : Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + return 0 Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + inst_multiple -o mdmon Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.bkfTdN/initramfs -a -f -o mdmon Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + _ret=0 Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + (( 0 != 0 )) Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + : Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + return 0 Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: ++ command -v partx Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + inst /usr/sbin/partx /sbin/partx Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + local _hostonly_install Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + [[ /usr/sbin/partx == \-\H ]] Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + [[ -e /tmp/dracut.bkfTdN/initramfs//sbin/partx ]] Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.bkfTdN/initramfs -f /usr/sbin/partx /sbin/partx Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + (( 0 != 0 )) Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + : Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: ++ command -v mdadm Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + local _hostonly_install Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + [[ -e /tmp/dracut.bkfTdN/initramfs//sbin/mdadm ]] Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.bkfTdN/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + (( 0 != 0 )) Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + : Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + [[ yes == \y\e\s ]] Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + local _raidconf Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: ++ cmdline Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: ++ local _activated dev line UUID Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: ++ declare -A _activated Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: ++ for dev in "${!host_fs_types[@]}" Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: ++ [[ nfs != *_raid_member ]] Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: ++ continue Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + _raidconf= Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + [[ -n '' ]] Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + inst_rules 64-md-raid.rules Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + local _target=/etc/udev/rules.d _rule _found Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + inst_dir /usr/lib/udev/rules.d Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + [[ -e /tmp/dracut.bkfTdN/initramfs//usr/lib/udev/rules.d ]] Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + return 0 Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + inst_dir /etc/udev/rules.d Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + [[ -e /tmp/dracut.bkfTdN/initramfs//etc/udev/rules.d ]] Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + return 0 Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + for _rule in "$@" Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + continue Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + continue Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + for r in '' $dracutbasedir/rules.d/ Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + [[ 64-md-raid.rules != /* ]] Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + continue Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + for r in '' $dracutbasedir/rules.d/ Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + continue Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + [[ -n '' ]] Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + set +x Nov 4 19:01:57 kjcf05n03 dracut[8057]: Skipping udev rule: 64-md-raid.rules Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + installkernel Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + instmods =drivers/md Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + local _optional=-o Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + local _silent Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + local _ret Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + [[ '' = yes ]] Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + [[ =drivers/md = \-\c ]] Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + [[ =drivers/md = \-\s ]] Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + (( 1 == 0 )) Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.bkfTdN/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + _ret=0 Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + (( 0 != 0 )) Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + [[ -n '' ]] Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + return 0 Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + _ret=0 Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + unset check depends cmdline install installkernel Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + return 0 Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + modules_loaded+='hperaid ' Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + '[' -n '' ']' Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + _d_mod=90kernel-modules Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + _d_mod=kernel-modules Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + [[ '' = yes ]] Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + dinfo '*** Including module: kernel-modules ***' Nov 4 19:01:57 kjcf05n03 kdumpctl[7943]: + set +x Nov 4 19:01:57 kjcf05n03 dracut[8057]: *** Including module: kernel-modules *** Nov 4 19:01:57 kjcf05n03 dracut[8057]: *** Including module: kernel-modules-extra *** Nov 4 19:01:58 kjcf05n03 dracut[8057]: *** Including module: kernel-network-modules *** Nov 4 19:01:58 kjcf05n03 dracut[8057]: *** Including module: diskless-mod *** Nov 4 19:01:58 kjcf05n03 dracut[8057]: *** Including module: fstab-sys *** Nov 4 19:01:58 kjcf05n03 dracut[8057]: *** Including module: nfs *** Nov 4 19:01:58 kjcf05n03 dracut[8057]: *** Including module: rootfs-block *** Nov 4 19:01:58 kjcf05n03 dracut[8057]: *** Including module: terminfo *** Nov 4 19:01:58 kjcf05n03 dracut[8057]: *** Including module: udev-rules *** Nov 4 19:01:59 kjcf05n03 dracut[8057]: Skipping udev rule: 91-permissions.rules Nov 4 19:01:59 kjcf05n03 dracut[8057]: Skipping udev rule: 80-drivers-modprobe.rules Nov 4 19:01:59 kjcf05n03 dracut[8057]: *** Including module: dracut-systemd *** Nov 4 19:02:00 kjcf05n03 dracut[8057]: *** Including module: usrmount *** Nov 4 19:02:00 kjcf05n03 dracut[8057]: *** Including module: base *** Nov 4 19:02:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 19:02:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 19:02:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 19:02:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 19:01:59 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 4 19:01:59 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 4 19:01:59 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 4 19:01:59 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running Nov 4 19:01:59 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 4 19:02:00 kjcf05n03 dracut[8057]: *** Including module: fs-lib *** Nov 4 19:02:00 kjcf05n03 dracut[8057]: *** Including module: kdumpbase *** Nov 4 19:02:00 kjcf05n03 dracut[8057]: *** Including module: memstrack *** Nov 4 19:02:00 kjcf05n03 dracut[8057]: *** Including module: shutdown *** Nov 4 19:02:00 kjcf05n03 dracut[8057]: *** Including module: squash *** Nov 4 19:02:00 kjcf05n03 dracut[8057]: *** Including modules done *** Nov 4 19:02:01 kjcf05n03 dracut[8057]: *** Installing kernel module dependencies *** Nov 4 19:02:01 kjcf05n03 dracut[8057]: *** Installing kernel module dependencies done *** Nov 4 19:02:01 kjcf05n03 dracut[8057]: *** Resolving executable dependencies *** Nov 4 19:02:02 kjcf05n03 dracut[8057]: *** Resolving executable dependencies done*** Nov 4 19:02:02 kjcf05n03 dracut[8057]: *** Hardlinking files *** Nov 4 19:02:02 kjcf05n03 dracut[8057]: *** Hardlinking files done *** Nov 4 19:02:02 kjcf05n03 dracut[8057]: *** Generating early-microcode cpio image *** Nov 4 19:02:02 kjcf05n03 dracut[8057]: *** Constructing AuthenticAMD.bin **** Nov 4 19:02:02 kjcf05n03 dracut[8057]: *** Store current command line parameters *** Nov 4 19:02:02 kjcf05n03 dracut[8057]: Stored kernel commandline: Nov 4 19:02:02 kjcf05n03 dracut[8057]: rd.driver.pre=sd_mod Nov 4 19:02:02 kjcf05n03 dracut[8057]: rd.driver.pre=nvme Nov 4 19:02:02 kjcf05n03 dracut[8057]: rd.driver.pre=ipmi_si Nov 4 19:02:02 kjcf05n03 dracut[8057]: rd.driver.pre=ipmi_devintf Nov 4 19:02:02 kjcf05n03 dracut[8057]: rd.driver.pre=ipmi_msghandler Nov 4 19:02:02 kjcf05n03 dracut[8057]: nameserver=172.16.2.2 Nov 4 19:02:02 kjcf05n03 dracut[8057]: nameserver=127.0.0.1 Nov 4 19:02:02 kjcf05n03 dracut[8057]: nameserver=172.16.2.2 Nov 4 19:02:02 kjcf05n03 dracut[8057]: nameserver=127.0.0.1 Nov 4 19:02:02 kjcf05n03 dracut[8057]: ifname=kdump-meth0:00:09:3d:06:9a:1a team=mgmt0:kdump-meth0 Nov 4 19:02:02 kjcf05n03 dracut[8057]: rd.neednet Nov 4 19:02:02 kjcf05n03 dracut[8057]: kdumpnic=mgmt0 Nov 4 19:02:02 kjcf05n03 dracut[8057]: bootdev=mgmt0 Nov 4 19:02:02 kjcf05n03 dracut[8057]: *** Install squash loader *** Nov 4 19:02:02 kjcf05n03 dracut[8057]: *** Squashing the files inside the initramfs *** Nov 4 19:02:03 kjcf05n03 dracut[8057]: *** Squashing the files inside the initramfs done *** Nov 4 19:02:03 kjcf05n03 dracut[8057]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 4 19:02:03 kjcf05n03 dracut[8057]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 4 19:02:04 kjcf05n03 kdumpctl[7943]: kdump: kexec: loaded kdump kernel Nov 4 19:02:04 kjcf05n03 kdumpctl[7943]: kdump: Starting kdump: [OK] Nov 4 19:02:04 kjcf05n03 systemd[1]: Started Crash recovery kernel arming. Nov 4 19:02:04 kjcf05n03 systemd[1]: Reloading. Nov 4 19:02:04 kjcf05n00 mcfcli[3673891]: %3|1730768524.476|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:02:04 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:02:04 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:02:04 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:02:04 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 4 19:02:04 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 4 19:02:04 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 4 19:02:04 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 4 19:02:04 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 4 19:02:04 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 4 19:02:04 kjcf05n03 ifdown[14697]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 19:02:04 kjcf05n03 ifdown[14698]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:02:04 kjcf05n03 ifdown[14699]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:02:05 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 19:02:05 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 19:02:05 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 19:02:05 kjcf05n03 ifup[14774]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 19:02:05 kjcf05n03 ifup[14775]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:02:05 kjcf05n03 ifup[14776]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:02:07 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 4 19:02:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730768527', 'host':'kjcf05n03', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 4 19:02:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730768527', 'host':'kjcf05n03', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 4 19:02:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730768527'} Nov 4 19:02:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730768527'} Nov 4 19:02:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:02:08 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 19:02:08 kjcf05n00 mcfcli[3673891]: %3|1730768528.038|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:02:09 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 19:02:09 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 19:02:09 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 19:02:09 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:02:09 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:02:09 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:02:09 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:02:09 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 19:02:09 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 19:02:09 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 19:02:09 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 19:02:09 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:02:09 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:02:09 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:02:09 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:02:09 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 4 19:02:09 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 4 19:02:09 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 4 19:02:09 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 4 19:02:09 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 4 19:02:09 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 4 19:02:09 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 4 19:02:09 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 4 19:02:09 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 4 19:02:09 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 4 19:02:09 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 4 19:02:09 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 4 19:02:09 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 4 19:02:09 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 4 19:02:09 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 4 19:02:09 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 4 19:02:09 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 4 19:02:09 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 4 19:02:09 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 4 19:02:09 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 4 19:02:09 kjcf05n03 ifdown[15035]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 19:02:09 kjcf05n03 ifdown[15036]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:02:09 kjcf05n03 ifdown[15037]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:02:10 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 19:02:10 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 19:02:10 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 19:02:09 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 4 19:02:09 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 4 19:02:09 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 4 19:02:09 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running Nov 4 19:02:09 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 4 19:02:10 kjcf05n03 ifup[15111]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 19:02:10 kjcf05n03 ifup[15115]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:02:10 kjcf05n03 ifup[15116]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:02:12 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 4 19:02:12 kjcf05n03 dcs-collectord[5658]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 19:02:12 kjcf05n03 dcs-collectord[5658]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 19:02:14 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 19:02:14 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 19:02:14 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 19:02:14 kjcf05n03 systemd[1]: Reloading. Nov 4 19:02:15 kjcf05n03 systemd[1]: Starting Corosync Cluster Engine... Nov 4 19:02:15 kjcf05n03 await_ha_peer[15299]: Waiting for HA peer kjcf05n02 Nov 4 19:02:16 kjcf05n03 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 4 19:02:16 kjcf05n03 await_ha_peer[15299]: Peer kjcf05n02 has started, starting HA Nov 4 19:02:16 kjcf05n03 systemd[1]: Started Corosync Cluster Engine. Nov 4 19:02:16 kjcf05n03 systemd[1]: Started Fast STONITH daemon. Nov 4 19:02:16 kjcf05n03 fstonithd.py[15352]: Listening for kdump packets from partner Nov 4 19:02:16 kjcf05n03 systemd[1]: Reloading. Nov 4 19:02:17 kjcf05n03 systemd[3190]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:02:17 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:02:17 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:02:17 kjcf05n03 systemd[1]: Reloading. Nov 4 19:02:17 kjcf05n03 systemd[1]: Reached target resource-agents dependencies. Nov 4 19:02:17 kjcf05n03 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 4 19:02:17 kjcf05n03 systemd[1]: Reloading. Nov 4 19:02:17 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 19:02:17 kjcf05n03 puppet-agent[3578]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:02:17 kjcf05n03 puppet[3578]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:02:17 kjcf05n03 puppet-agent[3578]: Applied catalog in 91.32 seconds Nov 4 19:02:17 kjcf05n03 puppet[3578]: Notice: Applied catalog in 91.32 seconds Nov 4 19:02:17 kjcf05n03 systemd[1]: Started Puppet agent. Nov 4 19:02:17 kjcf05n03 systemd[1]: Started Collect SAS Health Report every hour. Nov 4 19:02:17 kjcf05n03 systemd[1]: Reached target Timers. Nov 4 19:02:17 kjcf05n03 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 4 19:02:17 kjcf05n03 systemd[1]: Started Startup script for gateway-ec-node. Nov 4 19:02:17 kjcf05n03 systemd[1]: Started Startup script for monitoring-ec-node. Nov 4 19:02:17 kjcf05n03 systemd[1]: Starting Set absolute GEM time... Nov 4 19:02:17 kjcf05n03 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 4 19:02:17 kjcf05n03 systemd[1]: Started Service to do FW and inventory check on boot. Nov 4 19:02:17 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 19:02:17 kjcf05n03 wce-disable.sh[15536]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 4 19:02:17 kjcf05n03 systemd[1]: disable-write-cache.service: Succeeded. Nov 4 19:02:17 kjcf05n03 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 4 19:02:17 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 19:02:17 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 19:02:17 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n03": interface became available Nov 4 19:02:18 kjcf05n03 systemd[1]: set_gem_time.service: Succeeded. Nov 4 19:02:18 kjcf05n03 systemd[1]: Started Set absolute GEM time. Nov 4 19:02:18 kjcf05n03 python3.9[15534]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 4 19:02:18 kjcf05n03 python3.9[15534]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 4 19:02:18 kjcf05n03 gateway-ec-node.py[15533]: Starting gateway-ec-node service Nov 4 19:02:18 kjcf05n03 RFSF-API[15532]: INFO[2024-11-04T19:02:18-06:00] Datapath API RESTful Service starting Nov 4 19:02:18 kjcf05n03 dp-api-server-node[15532]: INFO[2024-11-04T19:02:18-06:00] Datapath API RESTful Service starting Nov 4 19:02:18 kjcf05n03 RFSF-API[15532]: INFO[2024-11-04T19:02:18-06:00] Running in production mode, starting dbus event listener Nov 4 19:02:18 kjcf05n03 dp-api-server-node[15532]: INFO[2024-11-04T19:02:18-06:00] Running in production mode, starting dbus event listener Nov 4 19:02:18 kjcf05n03 RFSF-API[15532]: INFO[2024-11-04T19:02:18-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 19:02:18 kjcf05n03 dp-api-server-node[15532]: INFO[2024-11-04T19:02:18-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 19:02:18 kjcf05n03 RFSF-API[15532]: INFO[2024-11-04T19:02:18-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 19:02:18 kjcf05n03 dp-api-server-node[15532]: INFO[2024-11-04T19:02:18-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 19:02:18 kjcf05n03 RFSF-API[15532]: INFO[2024-11-04T19:02:18-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 19:02:18 kjcf05n03 dp-api-server-node[15532]: INFO[2024-11-04T19:02:18-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 19:02:18 kjcf05n03 RFSF-API[15532]: INFO[2024-11-04T19:02:18-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 19:02:18 kjcf05n03 dp-api-server-node[15532]: INFO[2024-11-04T19:02:18-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 19:02:18 kjcf05n03 RFSF-API[15532]: INFO[2024-11-04T19:02:18-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 19:02:18 kjcf05n03 dp-api-server-node[15532]: INFO[2024-11-04T19:02:18-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 19:02:18 kjcf05n03 RFSF-API[15532]: INFO[2024-11-04T19:02:18-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 19:02:18 kjcf05n03 dp-api-server-node[15532]: INFO[2024-11-04T19:02:18-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 19:02:18 kjcf05n03 RFSF-API[15532]: INFO[2024-11-04T19:02:18-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 19:02:18 kjcf05n03 dp-api-server-node[15532]: INFO[2024-11-04T19:02:18-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 19:02:18 kjcf05n03 RFSF-API[15532]: INFO[2024-11-04T19:02:18-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 19:02:18 kjcf05n03 dp-api-server-node[15532]: INFO[2024-11-04T19:02:18-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 19:02:18 kjcf05n03 RFSF-API[15532]: INFO[2024-11-04T19:02:18-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 19:02:18 kjcf05n03 dp-api-server-node[15532]: INFO[2024-11-04T19:02:18-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 19:02:18 kjcf05n03 RFSF-API[15532]: INFO[2024-11-04T19:02:18-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 19:02:18 kjcf05n03 dp-api-server-node[15532]: INFO[2024-11-04T19:02:18-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 19:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730768539', 'host':'kjcf05n03', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 4 19:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730768539', 'host':'kjcf05n03', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 4 19:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730768539'} Nov 4 19:02:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730768539'} Nov 4 19:02:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730768539', 'host':'kjcf05n03', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 347 processes with STATE = RSZDT '}"] Nov 4 19:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Total Processes', 'description': 'PROCS OK: 347 processes with STATE = RSZDT ', 'message': 'PROCS OK: 347 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730768539'} Nov 4 19:02:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730768539', 'host':'kjcf05n03', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 4.88, 2.65, 1.11'}"] Nov 4 19:02:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Load', 'description': 'OK - load average: 4.88, 2.65, 1.11', 'message': 'OK - load average: 4.88, 2.65, 1.11', 'value': 'ok', 'timestamp': '1730768539'} Nov 4 19:02:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:02:21 kjcf05n00 zabbix-server[2353588]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 19:02:21 kjcf05n00 zabbix-server[2353588]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n03 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n03:system.uptime): 00:03:06\\"}}"' Nov 4 19:02:21 kjcf05n00 log_interesting_event.py[2353588]: Event '46575' acknowledged Nov 4 19:02:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730768542', 'host':'kjcf05n03', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 4 19:02:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730768542'} Nov 4 19:02:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:02:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730768542', 'host':'kjcf05n03', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(336.0B/360.0B), ib1=(56.0B/360.0B), icl0=(7.0kB/8.7kB), lo=(600.0B/600.0B), meth0=(1541.2MB/7.7MB), mgmt0=(1478.0MB/7.7MB)'}"] Nov 4 19:02:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(336.0B/360.0B), ib1=(56.0B/360.0B), icl0=(7.0kB/8.7kB), lo=(600.0B/600.0B), meth0=(1541.2MB/7.7MB), mgmt0=(1478.0MB/7.7MB)', 'message': 'NET OK - (Rx/Tx) ib0=(336.0B/360.0B), ib1=(56.0B/360.0B), icl0=(7.0kB/8.7kB), lo=(600.0B/600.0B), meth0=(1541.2MB/7.7MB), mgmt0=(1478.0MB/7.7MB)', 'value': 'ok', 'timestamp': '1730768542'} Nov 4 19:02:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:02:23 kjcf05n03 systemd[1]: Reloading. Nov 4 19:02:23 kjcf05n03 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 4 19:02:23 kjcf05n03 systemd[1]: Reloading. Nov 4 19:02:23 kjcf05n03 systemd[1]: Starting Cluster Controlled lcnmon... Nov 4 19:02:23 kjcf05n03 diskmonitor_pre[16005]: Key management is currently disabled.DEAR disabled Nov 4 19:02:23 kjcf05n03 systemd[1]: Started Cluster Controlled diskmonitor. Nov 4 19:02:24 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31460 deleted. Nov 4 19:02:24 kjcf05n00 zabbix-server[2353612]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 19:02:24 kjcf05n00 zabbix-server[2353612]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 339.54\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 262.4\\"}}"' Nov 4 19:02:24 kjcf05n00 log_interesting_event.py[2353612]: Event '46576' acknowledged Nov 4 19:02:25 kjcf05n03 sh[16068]: LNET configured: New Created Nov 4 19:02:25 kjcf05n03 systemd[1]: Started Cluster Controlled lcnmon. Nov 4 19:02:25 kjcf05n03 LCNmon[18150]: Interface ib0 is up Nov 4 19:02:25 kjcf05n03 LCNmon[18150]: Interface ib1 is up Nov 4 19:02:25 kjcf05n03 LCNmon[18150]: Can ping through interface ib0 Nov 4 19:02:25 kjcf05n03 LCNmon[18150]: Can ping through interface ib1 Nov 4 19:02:25 kjcf05n03 LCNmon[18150]: NIC ib0, initial state UP Nov 4 19:02:25 kjcf05n03 LCNmon[18150]: NIC ib1, initial state UP Nov 4 19:02:25 kjcf05n03 LCNmon[18150]: LCNstat initial state UP Nov 4 19:02:26 kjcf05n03 LCNmon[18150]: LCNmon monitoring hosts kjcf05n03 and kjcf05n02 Nov 4 19:02:26 kjcf05n03 dcs-collectord[5658]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 19:02:26 kjcf05n03 dcs-collectord[5658]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 19:02:26 kjcf05n03 dcs-collectord[5658]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: /var/run/diskmonitor does not exist, creating Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: Creating /var/run/diskmonitor/disk Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: Creating /var/run/diskmonitor/encl Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: Creating /var/run/diskmonitor/cli Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: RAS_Interlocks_enabled: 1 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: Using default ssd ids: HUSSL4010ASS600 , Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: add handler for sig: 14 sa_flags: 10000004 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: add handler for sig: 1 sa_flags: 10000004 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: add handler for sig: 2 sa_flags: 00000004 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: add handler for sig: 15 sa_flags: 00000004 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: add handler for sig: 6 sa_flags: 00000004 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: add handler for sig: 3 sa_flags: 00000004 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: add handler for sig: 30 sa_flags: 00000004 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: add handler for sig: 20 sa_flags: 00000004 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: add handler for sig: 10 sa_flags: 10000004 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: add handler for sig: 11 sa_flags: 00000004 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: add handler for sig: 7 sa_flags: 00000004 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: add handler for sig: 4 sa_flags: 00000004 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: add handler for sig: 8 sa_flags: 00000004 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: init_watch: /var/run/diskmonitor/encl initialized Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: init_watch: /var/run/diskmonitor/disk initialized Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: Using HA Baton locks - key: diskmonitor Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: Baton will be held for at most 570 seconds Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: DMMP Enabled: 0 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: random seed: e0a46666 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: NVMe Enclosure: 1 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: ZFS Enclosure: 0 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: Dbus, Initialized Connection Successfully Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: int_catcher_thread: thread start Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: Received dbus message 4 org.freedesktop.DBus -> :1.115 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b07bec_S4EUNF0MA05386M encl_slot: 0 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b07bed_S4EUNF0MA05387D encl_slot: 0 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 4 19:02:28 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 19:02:28 kjcf05n00 httpd[1812021]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-B): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n03', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 4 19:02:29 kjcf05n03 systemd[1]: nodebootchecks.service: Succeeded. Nov 4 19:02:31 kjcf05n03 openhpid[5564]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 4 19:02:31 kjcf05n03 openhpid[5564]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 4 19:02:31 kjcf05n03 systemd[1]: openhpid.service: Succeeded. Nov 4 19:02:31 kjcf05n03 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 4 19:02:31 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 19:02:31 kjcf05n03 systemd[1]: openhpid.service: Supervising process 18736 which is not our child. We'll most likely not notice when it exits. Nov 4 19:02:31 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 19:02:31 kjcf05n03 systemd[1]: Reached target Multi-User System. Nov 4 19:02:31 kjcf05n03 systemd[1]: Reached target Graphical Interface. Nov 4 19:02:31 kjcf05n03 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 4 19:02:31 kjcf05n03 dcs-collectord[5658]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 4 19:02:31 kjcf05n03 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 4 19:02:31 kjcf05n03 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 4 19:02:31 kjcf05n03 systemd[1]: Startup finished in 51.058s (kernel) + 2min 27.341s (userspace) = 3min 18.400s. Nov 4 19:02:31 kjcf05n03 openhpid[18736]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 19:02:31 kjcf05n03 openhpid[18736]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 19:02:31 kjcf05n03 openhpid[18736]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 19:02:31 kjcf05n03 openhpid[18736]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 19:02:33 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18899 (bash) Nov 4 19:02:33 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 4 19:02:33 kjcf05n03 systemd[1]: Reached target Host and Network Name Lookups. Nov 4 19:02:33 kjcf05n03 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 4 19:02:33 kjcf05n03 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 4 19:02:33 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 4 19:02:34 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 4 19:02:38 kjcf05n00 mcfcli[3673891]: %3|1730768558.038|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 19:02:42 kjcf05n03 dcs-collectord[5658]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 19:02:42 kjcf05n03 dcs-collectord[5658]: WARNING No data collected (hpi_parser.py:353) Nov 4 19:02:44 kjcf05n00 mcfcli[3673891]: %3|1730768564.473|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:02:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730768568', 'host':'kjcf05n03', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.7% (4383996 kB) used.'}"] Nov 4 19:02:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'RAM usage', 'description': 'OK - 1.7% (4383996 kB) used.', 'message': 'OK - 1.7% (4383996 kB) used.', 'value': 'ok', 'timestamp': '1730768568'} Nov 4 19:02:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:02:55 kjcf05n03 ipmievd[3988]: System Event sensor - Timestamp Clock Sync Nov 4 19:02:57 kjcf05n03 ipmievd[3190]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:02:57 kjcf05n03 dcs-collectord[5658]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b07bec_S4EUNF0MA05386M encl_sn: USE26000024VS001, slot: 1 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b07bed_S4EUNF0MA05387D encl_sn: USE26000024VS001, slot: 2 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 4 19:03:06 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 4 19:03:08 kjcf05n00 mcfcli[3673891]: %3|1730768588.038|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 19:03:12 kjcf05n03 dcs-collectord[5658]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 19:03:14 kjcf05n02 firmware-update-orc-server[5878]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "d4f2380c-4212-48ef-94b8-1364104541f7"} (logger.py:65) Nov 4 19:03:14 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 85975 (get_disk_device) Nov 4 19:03:14 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 4 19:03:14 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 4 19:03:14 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db01026002538450000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 19:03:14 kjcf05n03 ras-resource-manager-agent[5922]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "bbd658c2-9b11-11ef-a4cf-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 4 19:03:14 kjcf05n03 ras-resource-manager-agent[5922]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'bbd658c2-9b11-11ef-a4cf-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 4 19:03:14 kjcf05n03 ras-resource-manager-agent[5922]: INFO Submitting new device inserted signal, starting to qualify drive: bbd658c2-9b11-11ef-a4cf-00093d069a1b (admin_action.py:110) Nov 4 19:03:14 kjcf05n02 ccp-client[86000]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 19:03:14 kjcf05n02 ccp-client[86000]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 19:03:14 kjcf05n02 ccp-client[86035]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 19:03:14 kjcf05n02 ccp-client[86000]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 19:03:14 kjcf05n02 ccp-client[86000]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 19:03:14 kjcf05n02 ccp-client[86035]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 19:03:14 kjcf05n02 ccp-client[86035]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 19:03:14 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'bbd658c2-9b11-11ef-a4cf-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 19:03:14 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'bbd658c2-9b11-11ef-a4cf-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 19:03:14 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': 'bbd658c2-9b11-11ef-a4cf-00093d069a1b', 'response ID': 'bbe1126c-9b11-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 19:03:14 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: bbe1126c-9b11-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 19:03:14 kjcf05n03 diskmonitor[17748]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 19:03:14 kjcf05n03 ras-resource-manager-agent[5922]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "bc2784a4-9b11-11ef-a4cf-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 4 19:03:14 kjcf05n03 ras-resource-manager-agent[5922]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'bc2784a4-9b11-11ef-a4cf-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 4 19:03:14 kjcf05n03 ras-resource-manager-agent[5922]: INFO Submitting new device inserted signal, starting to qualify drive: bc2784a4-9b11-11ef-a4cf-00093d069a1b (admin_action.py:110) Nov 4 19:03:14 kjcf05n03 firmware-update-orc-server[5878]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "cdcb1735-3daf-4bd3-8255-4fa9d3923c60"} (logger.py:65) Nov 4 19:03:14 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'bc2784a4-9b11-11ef-a4cf-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 19:03:14 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'bc2784a4-9b11-11ef-a4cf-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 19:03:14 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': 'bc2784a4-9b11-11ef-a4cf-00093d069a1b', 'response ID': 'bc2eb756-9b11-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 19:03:14 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: bc2eb756-9b11-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 19:03:17 kjcf05n02 DRVFW[86179]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 19:03:17 kjcf05n02 ccp-client[86180]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 19:03:17 kjcf05n02 ccp-client[86180]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 19:03:17 kjcf05n02 ccp-client[86189]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 19:03:17 kjcf05n02 ccp-client[86180]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 19:03:17 kjcf05n02 ccp-client[86180]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 19:03:17 kjcf05n02 ccp-client[86189]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 19:03:17 kjcf05n02 ccp-client[86189]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 19:03:17 kjcf05n02 firmware-update-orc-server[5878]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 4 19:03:18 kjcf05n03 ras-resource-manager-agent[5922]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'bbd658c2-9b11-11ef-a4cf-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}} (resource_admin.py:98) Nov 4 19:03:18 kjcf05n03 ras-resource-manager-agent[5922]: INFO Drive qualification complete responding: bbd658c2-9b11-11ef-a4cf-00093d069a1b (admin_action.py:205) Nov 4 19:03:18 kjcf05n03 ras-resource-manager-agent[5922]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "bbd658c2-9b11-11ef-a4cf-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} (interesting_event.py:59) Nov 4 19:03:18 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: bbe1126c-9b11-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 19:03:18 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': 'bbd658c2-9b11-11ef-a4cf-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'bbd658c2-9b11-11ef-a4cf-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}}} (logger.py:65) Nov 4 19:03:21 kjcf05n03 diskmonitor[17748]: 0004 Nov 4 19:03:21 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 4 19:03:21 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 4 19:03:21 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 4 19:03:21 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 4 19:03:21 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 4 19:03:21 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 4 19:03:21 kjcf05n03 diskmonitor[17748]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 4 19:03:21 kjcf05n03 diskmonitor[17748]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 4 19:03:21 kjcf05n03 diskmonitor[17748]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 4 19:03:21 kjcf05n03 diskmonitor[17748]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 19:03:21 kjcf05n03 diskmonitor[17748]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 4 19:03:21 kjcf05n03 diskmonitor[17748]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "bbd658c2-9b11-11ef-a4cf-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 4 19:03:21 kjcf05n03 diskmonitor[17748]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 19:03:21 kjcf05n03 diskmonitor[17748]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 4 19:03:21 kjcf05n03 diskmonitor[17748]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "bc2784a4-9b11-11ef-a4cf-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 4 19:03:21 kjcf05n03 diskmonitor[17748]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 19:03:21 kjcf05n03 diskmonitor[17748]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 19:03:22 kjcf05n00 mcfcli[3673891]: %3|1730768602.121|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:03:25 kjcf05n03 ras-resource-manager-agent[5922]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "bbd658c2-9b11-11ef-a4cf-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} (service_main_handler.py:66) Nov 4 19:03:25 kjcf05n03 ras-resource-manager-agent[5922]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'bbd658c2-9b11-11ef-a4cf-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}} (resource_admin.py:98) Nov 4 19:03:25 kjcf05n03 ras-resource-manager-agent[5922]: INFO Device qualification response has been acknowledged: bbd658c2-9b11-11ef-a4cf-00093d069a1b (admin_action.py:151) Nov 4 19:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T19:03:27.262472605-06:00 level=info msg="Completed cleanup jobs" duration=35.955669ms Nov 4 19:03:28 kjcf05n03 chronyd[5166]: Selected source 172.16.2.1 Nov 4 19:03:29 kjcf05n03 diskmonitor[17748]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 19:03:29 kjcf05n03 diskmonitor[17748]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 19:03:29 kjcf05n03 ras-resource-manager-agent[5922]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "c5195786-9b11-11ef-a4cf-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 4 19:03:29 kjcf05n03 ras-resource-manager-agent[5922]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'c5195786-9b11-11ef-a4cf-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 4 19:03:29 kjcf05n03 ras-resource-manager-agent[5922]: INFO Requests ['bc2784a4-9b11-11ef-a4cf-00093d069a1b', 'c5195786-9b11-11ef-a4cf-00093d069a1b'] already in progress (admin_action.py:99) Nov 4 19:03:29 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 23685 (get_disk_device) Nov 4 19:03:29 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 4 19:03:29 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 4 19:03:30 kjcf05n03 ccp-client[23716]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 19:03:30 kjcf05n03 ccp-client[23716]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 19:03:30 kjcf05n03 ccp-client[23736]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 19:03:30 kjcf05n03 ccp-client[23716]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 19:03:30 kjcf05n03 ccp-client[23716]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 19:03:30 kjcf05n03 ccp-client[23736]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 19:03:30 kjcf05n03 ccp-client[23736]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 19:03:33 kjcf05n02 nslcd[6957]: [e8944a] ldap_result() failed: Can't contact LDAP server Nov 4 19:03:33 kjcf05n03 DRVFW[24020]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 19:03:33 kjcf05n03 ccp-client[24021]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 19:03:33 kjcf05n03 ccp-client[24021]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 19:03:33 kjcf05n03 ccp-client[24036]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 19:03:33 kjcf05n03 ccp-client[24021]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 19:03:33 kjcf05n03 ccp-client[24021]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 19:03:33 kjcf05n03 ccp-client[24036]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 19:03:33 kjcf05n03 ccp-client[24036]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 19:03:33 kjcf05n03 firmware-update-orc-server[5878]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 4 19:03:34 kjcf05n03 systemd[1]: Unmounting /mnt/llog... Nov 4 19:03:34 kjcf05n03 systemd[1]: mnt-llog.mount: Succeeded. Nov 4 19:03:34 kjcf05n03 systemd[1]: Unmounted /mnt/llog. Nov 4 19:03:34 kjcf05n03 ras-resource-manager-agent[5922]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'bc2784a4-9b11-11ef-a4cf-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}} (resource_admin.py:98) Nov 4 19:03:34 kjcf05n03 ras-resource-manager-agent[5922]: INFO Drive qualification complete responding: bc2784a4-9b11-11ef-a4cf-00093d069a1b (admin_action.py:205) Nov 4 19:03:34 kjcf05n03 ras-resource-manager-agent[5922]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "bc2784a4-9b11-11ef-a4cf-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (interesting_event.py:59) Nov 4 19:03:34 kjcf05n03 ras-resource-manager-agent[5922]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "c5195786-9b11-11ef-a4cf-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (interesting_event.py:59) Nov 4 19:03:34 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: bc2eb756-9b11-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 19:03:34 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': 'bc2784a4-9b11-11ef-a4cf-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'bc2784a4-9b11-11ef-a4cf-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}}} (logger.py:65) Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "bbd658c2-9b11-11ef-a4cf-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: Dbus, handle_ingress_ras_signals, uuid: bbd658c2-9b11-11ef-a4cf-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "bbd658c2-9b11-11ef-a4cf-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: main: Pending firmware leveling requests exist, rescanning disks Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "c5195786-9b11-11ef-a4cf-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: leaving test state: 1 next state: 2 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: lock req: no timeout Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: leaving test state: 2 next state: 4 Nov 4 19:03:36 kjcf05n03 diskmonitor[17748]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 19:03:37 kjcf05n03 python3.9[5228]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 4 19:03:37 kjcf05n03 python3.9[3190]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:03:37 kjcf05n03 ras-resource-manager-agent[5922]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "bc2784a4-9b11-11ef-a4cf-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (service_main_handler.py:66) Nov 4 19:03:37 kjcf05n03 ras-resource-manager-agent[5922]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'bc2784a4-9b11-11ef-a4cf-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}} (resource_admin.py:98) Nov 4 19:03:37 kjcf05n03 ras-resource-manager-agent[5922]: INFO Device qualification response has been acknowledged: bc2784a4-9b11-11ef-a4cf-00093d069a1b (admin_action.py:151) Nov 4 19:03:37 kjcf05n03 ras-resource-manager-agent[5922]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "c5195786-9b11-11ef-a4cf-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} (service_main_handler.py:66) Nov 4 19:03:37 kjcf05n03 ras-resource-manager-agent[5922]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'c5195786-9b11-11ef-a4cf-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 19}}} (resource_admin.py:98) Nov 4 19:03:37 kjcf05n03 ras-resource-manager-agent[5922]: INFO Device qualification response has been acknowledged: c5195786-9b11-11ef-a4cf-00093d069a1b (admin_action.py:151) Nov 4 19:03:38 kjcf05n03 diskmonitor[17748]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 19:03:38 kjcf05n00 mcfcli[3673891]: %3|1730768618.458|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:03:44 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 4 19:03:54 kjcf05n03 diskmonitor[17748]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "bc2784a4-9b11-11ef-a4cf-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 4 19:03:54 kjcf05n03 diskmonitor[17748]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 4 19:03:54 kjcf05n03 diskmonitor[17748]: Dbus, handle_ingress_ras_signals, uuid: bc2784a4-9b11-11ef-a4cf-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 4 19:03:54 kjcf05n03 diskmonitor[17748]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 19:03:54 kjcf05n03 diskmonitor[17748]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "bc2784a4-9b11-11ef-a4cf-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 4 19:03:54 kjcf05n03 diskmonitor[17748]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "c5195786-9b11-11ef-a4cf-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 4 19:03:54 kjcf05n03 diskmonitor[17748]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 4 19:03:54 kjcf05n03 diskmonitor[17748]: Dbus, handle_ingress_ras_signals, uuid: c5195786-9b11-11ef-a4cf-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 4 19:03:54 kjcf05n03 diskmonitor[17748]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "c5195786-9b11-11ef-a4cf-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 19}}} Nov 4 19:03:54 kjcf05n03 diskmonitor[17748]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 19:03:54 kjcf05n03 diskmonitor[17748]: lock acquired Nov 4 19:03:54 kjcf05n03 diskmonitor[17748]: leaving test state: 4 next state: 8 Nov 4 19:03:54 kjcf05n03 diskmonitor[17748]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 19:03:59 kjcf05n00 mcfcli[3673891]: %3|1730768639.773|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:04:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730768641}"] Nov 4 19:04:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730768641, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:04:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:04:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730768641}"] Nov 4 19:04:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730768641, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:04:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:04:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730768641}"] Nov 4 19:04:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730768641, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:04:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:04:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730768641}"] Nov 4 19:04:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730768641, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:04:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:04:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730768641}"] Nov 4 19:04:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730768641, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:04:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:04:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730768641}"] Nov 4 19:04:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730768641, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:04:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:04:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730768642}"] Nov 4 19:04:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730768642, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:04:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:04:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730768642}"] Nov 4 19:04:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730768642, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:04:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:04:08 kjcf05n00 mcfcli[3673891]: %3|1730768648.458|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:04:12 kjcf05n03 diskmonitor[17748]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 4 19:04:12 kjcf05n03 diskmonitor[17748]: leaving test state: 8 next state: 20 Nov 4 19:04:12 kjcf05n03 diskmonitor[17748]: leaving test state: 20 next state: 40 Nov 4 19:04:12 kjcf05n03 diskmonitor[17748]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 34b91b48000 Nov 4 19:04:12 kjcf05n03 diskmonitor[17748]: leaving test state: 40 next state: 80 Nov 4 19:04:24 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31461 deleted. Nov 4 19:04:35 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 4 19:04:35 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 19:04:35 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 4 19:04:36 kjcf05n00 mcfcli[3673891]: %3|1730768676.048|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:04:38 kjcf05n00 mcfcli[3673891]: %3|1730768678.458|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:04:50 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 4 19:04:50 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 19:04:50 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 4 19:04:52 kjcf05n03 dcs-collectord[5658]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 4 19:05:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730768701}"] Nov 4 19:05:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730768701, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:05:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:05:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:05:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:05:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:05:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:05:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:05:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:05:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:05:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:05:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:05:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:05:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:05:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:05:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.197055ms Nov 4 19:05:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:05:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.197055ms Nov 4 19:05:01 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:05:01 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:05:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:05:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730768706}"] Nov 4 19:05:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730768706, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:05:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:05:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:05:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:05:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:05:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:05:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:05:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:05:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:05:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:05:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:05:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:05:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:05:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:05:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.164474ms Nov 4 19:05:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:05:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.164474ms Nov 4 19:05:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:05:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:05:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:05:08 kjcf05n00 mcfcli[3673891]: %3|1730768708.458|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:05:10 kjcf05n03 diskmonitor[17748]: leaving test state: 80 next state: 100 Nov 4 19:05:10 kjcf05n03 diskmonitor[17748]: lock release: time: Mon Nov 4 19:05:05 2024 Nov 4 19:05:10 kjcf05n03 diskmonitor[17748]: leaving test state: 100 next state: 1 Nov 4 19:05:13 kjcf05n00 mcfcli[3673891]: %3|1730768713.689|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:05:26 kjcf05n01 ansible-ansible.builtin.authorized_key[3829641]: Invoked with state=present user=admin key=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC/oUUDoJsLDVMDUIjFUH/12VqXJ7ZBG0KaKSrZ4SWrtdchcqFr8O34hWmwZXkGT17l/CzoQUsUcVx80LY6C2RJvHL1mS8+WP87RXmMxboYwG4ZYcL5N4wTmoIkEkdGpwPOMjp5pkOKJ86q45FuJwk3cTx57ryy+Gh2JhU2bT26HmuaK1Jq23N7/BpH7kWjlZX9P67mdaB8Gx5HFX486b1zmKALAg2SXvSHEhCGUgmuza7EwAWz717PQLrZ6z9ghg7aqqjT0R6ghXXJHEuIRkw5ON/oD5emg72bzZT49o6oDAd6VxTHIvfqgvQTpKshetLfIH/0xCiyyJR6mw12uAi0ZrthygOG1AB4VYhmLoXuN5tqIieYf2tymZFSXcTfxDjWPZt4PrY6fvgTDmkOuRD2VcbDb/bCI6c/qmexds2/AcT72IdBCzVlG+KyG1uuo0oQT1YW9wrL7XDx+/SPN4QIGEL0DVue+L1horC6ax33IlBmTLoijqK3Krsco36zIZNGcjGm4X+DSdUMnq8DE/IIw1sdBD3p1DxT8VWrvQ+QF/wwQodW0qeKCE9+KXbc2f1wxBtCIHFNSvxeGASBgwZvoHayEm7Qz3gHKuRn71JzFmmoOm6EQ08XsiMZa30yz9NaSawsjaaXgO6UzoBxzE8r0x+pLnhCAprc7vGaFU6ckw== filesystem-test manage_dir=True exclusive=False validate_certs=True follow=False path=None key_options=None comment=None Nov 4 19:05:27 kjcf05n00 ansible-ansible.builtin.authorized_key[2355532]: Invoked with state=present user=admin key=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC/oUUDoJsLDVMDUIjFUH/12VqXJ7ZBG0KaKSrZ4SWrtdchcqFr8O34hWmwZXkGT17l/CzoQUsUcVx80LY6C2RJvHL1mS8+WP87RXmMxboYwG4ZYcL5N4wTmoIkEkdGpwPOMjp5pkOKJ86q45FuJwk3cTx57ryy+Gh2JhU2bT26HmuaK1Jq23N7/BpH7kWjlZX9P67mdaB8Gx5HFX486b1zmKALAg2SXvSHEhCGUgmuza7EwAWz717PQLrZ6z9ghg7aqqjT0R6ghXXJHEuIRkw5ON/oD5emg72bzZT49o6oDAd6VxTHIvfqgvQTpKshetLfIH/0xCiyyJR6mw12uAi0ZrthygOG1AB4VYhmLoXuN5tqIieYf2tymZFSXcTfxDjWPZt4PrY6fvgTDmkOuRD2VcbDb/bCI6c/qmexds2/AcT72IdBCzVlG+KyG1uuo0oQT1YW9wrL7XDx+/SPN4QIGEL0DVue+L1horC6ax33IlBmTLoijqK3Krsco36zIZNGcjGm4X+DSdUMnq8DE/IIw1sdBD3p1DxT8VWrvQ+QF/wwQodW0qeKCE9+KXbc2f1wxBtCIHFNSvxeGASBgwZvoHayEm7Qz3gHKuRn71JzFmmoOm6EQ08XsiMZa30yz9NaSawsjaaXgO6UzoBxzE8r0x+pLnhCAprc7vGaFU6ckw== filesystem-test manage_dir=True exclusive=False validate_certs=True follow=False path=None key_options=None comment=None Nov 4 19:05:29 kjcf05n01 ansible-ansible.builtin.command[3829727]: Invoked with _raw_params=chmod 600 ~/.ssh/authorized_keys warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:05:29 kjcf05n01 ansible-ansible.builtin.command[3829727]: [WARNING] Consider using the file module with mode rather than running 'chmod'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. Nov 4 19:05:29 kjcf05n00 ansible-ansible.builtin.command[2355591]: Invoked with _raw_params=chmod 600 ~/.ssh/authorized_keys warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:05:29 kjcf05n00 ansible-ansible.builtin.command[2355591]: [WARNING] Consider using the file module with mode rather than running 'chmod'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. Nov 4 19:05:34 kjcf05n01 ansible-ansible.builtin.file[3829821]: Invoked with access_time=preserve modification_time=preserve state=touch mode=0600 path=/etc/sudoers.d/admin recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:05:34 kjcf05n00 ansible-ansible.builtin.file[2355644]: Invoked with access_time=preserve modification_time=preserve state=touch mode=0600 path=/etc/sudoers.d/admin recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:05:35 kjcf05n00 python3.9[2355585]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 19:05:38 kjcf05n00 mcfcli[3673891]: %3|1730768738.458|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 19:05:41 kjcf05n01 ansible-ansible.builtin.lineinfile[3829869]: Invoked with regexp=admin ALL=(ALL) NOPASSWD:ALL path=/etc/sudoers.d/admin line=admin ALL=(ALL) NOPASSWD:ALL state=present backrefs=False create=False backup=False firstmatch=False follow=False unsafe_writes=False insertafter=None insertbefore=None validate=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None src=None force=None content=NOT_LOGGING_PARAMETER remote_src=None delimiter=None directory_mode=None Nov 4 19:05:41 kjcf05n00 ansible-ansible.builtin.lineinfile[2356017]: Invoked with regexp=admin ALL=(ALL) NOPASSWD:ALL path=/etc/sudoers.d/admin line=admin ALL=(ALL) NOPASSWD:ALL state=present backrefs=False create=False backup=False firstmatch=False follow=False unsafe_writes=False insertafter=None insertbefore=None validate=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None src=None force=None content=NOT_LOGGING_PARAMETER remote_src=None delimiter=None directory_mode=None Nov 4 19:05:44 kjcf05n01 ansible-ansible.builtin.authorized_key[3829910]: Invoked with state=present user=root key=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC/oUUDoJsLDVMDUIjFUH/12VqXJ7ZBG0KaKSrZ4SWrtdchcqFr8O34hWmwZXkGT17l/CzoQUsUcVx80LY6C2RJvHL1mS8+WP87RXmMxboYwG4ZYcL5N4wTmoIkEkdGpwPOMjp5pkOKJ86q45FuJwk3cTx57ryy+Gh2JhU2bT26HmuaK1Jq23N7/BpH7kWjlZX9P67mdaB8Gx5HFX486b1zmKALAg2SXvSHEhCGUgmuza7EwAWz717PQLrZ6z9ghg7aqqjT0R6ghXXJHEuIRkw5ON/oD5emg72bzZT49o6oDAd6VxTHIvfqgvQTpKshetLfIH/0xCiyyJR6mw12uAi0ZrthygOG1AB4VYhmLoXuN5tqIieYf2tymZFSXcTfxDjWPZt4PrY6fvgTDmkOuRD2VcbDb/bCI6c/qmexds2/AcT72IdBCzVlG+KyG1uuo0oQT1YW9wrL7XDx+/SPN4QIGEL0DVue+L1horC6ax33IlBmTLoijqK3Krsco36zIZNGcjGm4X+DSdUMnq8DE/IIw1sdBD3p1DxT8VWrvQ+QF/wwQodW0qeKCE9+KXbc2f1wxBtCIHFNSvxeGASBgwZvoHayEm7Qz3gHKuRn71JzFmmoOm6EQ08XsiMZa30yz9NaSawsjaaXgO6UzoBxzE8r0x+pLnhCAprc7vGaFU6ckw== filesystem-test manage_dir=True exclusive=False validate_certs=True follow=False path=None key_options=None comment=None Nov 4 19:05:44 kjcf05n00 ansible-ansible.builtin.authorized_key[2356063]: Invoked with state=present user=root key=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC/oUUDoJsLDVMDUIjFUH/12VqXJ7ZBG0KaKSrZ4SWrtdchcqFr8O34hWmwZXkGT17l/CzoQUsUcVx80LY6C2RJvHL1mS8+WP87RXmMxboYwG4ZYcL5N4wTmoIkEkdGpwPOMjp5pkOKJ86q45FuJwk3cTx57ryy+Gh2JhU2bT26HmuaK1Jq23N7/BpH7kWjlZX9P67mdaB8Gx5HFX486b1zmKALAg2SXvSHEhCGUgmuza7EwAWz717PQLrZ6z9ghg7aqqjT0R6ghXXJHEuIRkw5ON/oD5emg72bzZT49o6oDAd6VxTHIvfqgvQTpKshetLfIH/0xCiyyJR6mw12uAi0ZrthygOG1AB4VYhmLoXuN5tqIieYf2tymZFSXcTfxDjWPZt4PrY6fvgTDmkOuRD2VcbDb/bCI6c/qmexds2/AcT72IdBCzVlG+KyG1uuo0oQT1YW9wrL7XDx+/SPN4QIGEL0DVue+L1horC6ax33IlBmTLoijqK3Krsco36zIZNGcjGm4X+DSdUMnq8DE/IIw1sdBD3p1DxT8VWrvQ+QF/wwQodW0qeKCE9+KXbc2f1wxBtCIHFNSvxeGASBgwZvoHayEm7Qz3gHKuRn71JzFmmoOm6EQ08XsiMZa30yz9NaSawsjaaXgO6UzoBxzE8r0x+pLnhCAprc7vGaFU6ckw== filesystem-test manage_dir=True exclusive=False validate_certs=True follow=False path=None key_options=None comment=None Nov 4 19:05:45 kjcf05n01 ansible-ansible.builtin.file[3829951]: Invoked with state=file mode=0600 path=/root/.ssh/authorized_keys recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:05:45 kjcf05n00 ansible-ansible.builtin.file[2356104]: Invoked with state=file mode=0600 path=/root/.ssh/authorized_keys recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:05:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730768449', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 19:05:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730768449'} Nov 4 19:05:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:05:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730768449', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 19:05:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730768449'} Nov 4 19:05:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:05:50 kjcf05n00 mcfcli[3673891]: %3|1730768750.869|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:05:59 kjcf05n01 ansible-setup[3830111]: Invoked with gather_subset=['!all', '!min', 'date_time', 'default_ipv4', 'all_ipv4_addresses', 'distribution', 'pkg_mgr', 'hardware'] gather_timeout=10 filter=* fact_path=/etc/ansible/facts.d Nov 4 19:05:59 kjcf05n00 ansible-setup[2356333]: Invoked with gather_subset=['!all', '!min', 'date_time', 'default_ipv4', 'all_ipv4_addresses', 'distribution', 'pkg_mgr', 'hardware'] gather_timeout=10 filter=* fact_path=/etc/ansible/facts.d Nov 4 19:06:04 kjcf05n01 ansible-ansible.builtin.tempfile[3830270]: Invoked with suffix=.library_script_cache state=directory prefix=ansible. path=None Nov 4 19:06:04 kjcf05n00 ansible-ansible.builtin.tempfile[2356504]: Invoked with suffix=.library_script_cache state=directory prefix=ansible. path=None Nov 4 19:06:07 kjcf05n01 ansible-stat[3830443]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh get_md5=False get_mime=True get_attributes=True Nov 4 19:06:08 kjcf05n00 ansible-stat[2356604]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh get_md5=False get_mime=True get_attributes=True Nov 4 19:06:08 kjcf05n00 mcfcli[3673891]: %3|1730768768.459|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:06:10 kjcf05n01 ansible-copy[3830564]: Invoked with dest=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh _original_basename=link-if-identical.sh follow=False src=/tmp/ansible-admin/ansible-tmp-1730768765.95-17326-41326450300160/source checksum=7d4e3ae1ba7f279e4db8384a9daa8b0da64a674a backup=False force=True unsafe_writes=False content=NOT_LOGGING_PARAMETER validate=None directory_mode=None remote_src=None local_follow=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None regexp=None delimiter=None Nov 4 19:06:11 kjcf05n00 ansible-copy[2356734]: Invoked with dest=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh _original_basename=link-if-identical.sh follow=False src=/tmp/ansible-admin/ansible-tmp-1730768765.78-17296-137203712861509/source checksum=7d4e3ae1ba7f279e4db8384a9daa8b0da64a674a backup=False force=True unsafe_writes=False content=NOT_LOGGING_PARAMETER validate=None directory_mode=None remote_src=None local_follow=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None regexp=None delimiter=None Nov 4 19:06:12 kjcf05n01 ansible-stat[3830690]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh get_md5=False get_mime=True get_attributes=True Nov 4 19:06:14 kjcf05n01 ansible-copy[3830852]: Invoked with dest=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh _original_basename=set-execute.sh follow=False src=/tmp/ansible-admin/ansible-tmp-1730768770.42-17326-109976002562199/source checksum=12ad96fee0decaa0abd38199a687126eecc20c04 backup=False force=True unsafe_writes=False content=NOT_LOGGING_PARAMETER validate=None directory_mode=None remote_src=None local_follow=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None regexp=None delimiter=None Nov 4 19:06:14 kjcf05n00 ansible-stat[2356862]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh get_md5=False get_mime=True get_attributes=True Nov 4 19:06:16 kjcf05n00 zabbix-server[2356916]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 19:06:16 kjcf05n00 zabbix-server[2356916]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n03' from event '46588' Nov 4 19:06:16 kjcf05n00 zabbix-server[2356916]: Host created 'enclosure_USE26000024VS001' Nov 4 19:06:16 kjcf05n00 zabbix-server[2356916]: Running puppet on 'kjcf05n03' Nov 4 19:06:18 kjcf05n00 ansible-copy[2356993]: Invoked with dest=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh _original_basename=set-execute.sh follow=False src=/tmp/ansible-admin/ansible-tmp-1730768772.57-17296-145545439442281/source checksum=12ad96fee0decaa0abd38199a687126eecc20c04 backup=False force=True unsafe_writes=False content=NOT_LOGGING_PARAMETER validate=None directory_mode=None remote_src=None local_follow=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None regexp=None delimiter=None Nov 4 19:06:18 kjcf05n03 puppet-agent[31329]: Using configured environment 'production' Nov 4 19:06:18 kjcf05n03 puppet-agent[31329]: Retrieving pluginfacts Nov 4 19:06:18 kjcf05n03 puppet-agent[31329]: Retrieving plugin Nov 4 19:06:19 kjcf05n03 puppet-agent[31329]: Loading facts Nov 4 19:06:21 kjcf05n01 ansible-ansible.builtin.command[3830945]: Invoked with _raw_params=chmod 755 "/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:06:21 kjcf05n01 ansible-ansible.builtin.command[3830945]: [WARNING] Consider using the file module with mode rather than running 'chmod'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. Nov 4 19:06:21 kjcf05n00 ansible-ansible.builtin.command[2357188]: Invoked with _raw_params=chmod 755 "/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:06:21 kjcf05n00 ansible-ansible.builtin.command[2357188]: [WARNING] Consider using the file module with mode rather than running 'chmod'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. Nov 4 19:06:21 kjcf05n03 puppet-agent[31329]: Caching catalog for kjcf05n03 Nov 4 19:06:21 kjcf05n03 puppet-agent[31329]: Applying configuration version '1730768779' Nov 4 19:06:22 kjcf05n01 ansible-ansible.builtin.command[3830987]: Invoked with _raw_params=chmod 755 "/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:06:22 kjcf05n01 ansible-ansible.builtin.command[3830987]: [WARNING] Consider using the file module with mode rather than running 'chmod'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. Nov 4 19:06:23 kjcf05n00 ansible-ansible.builtin.command[2357236]: Invoked with _raw_params=chmod 755 "/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:06:23 kjcf05n00 ansible-ansible.builtin.command[2357236]: [WARNING] Consider using the file module with mode rather than running 'chmod'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. Nov 4 19:06:23 kjcf05n03 puppet-agent[31329]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 19:06:23 kjcf05n03 puppet-agent[31329]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 19:06:23 kjcf05n03 puppet-agent[31329]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 19:06:24 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 4 19:06:24 kjcf05n03 zabbix_agent2[6006]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 19:06:24 kjcf05n03 zabbix_agent2[3190]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:06:24 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 19:06:24 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 4 19:06:24 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 4 19:06:24 kjcf05n03 puppet-agent[31329]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: Press Ctrl+C to exit. Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: Plugin support version 1.0 Nov 4 19:06:24 kjcf05n03 zabbix_agent2[31656]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 19:06:26 kjcf05n03 puppet-agent[31329]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 19:06:26 kjcf05n03 puppet-agent[31329]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 19:06:26 kjcf05n03 puppet-agent[31329]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 19:06:26 kjcf05n00 zabbix-server[2356916]: puppet completed status:(0): '' Nov 4 19:06:26 kjcf05n00 zabbix-server[2356916]: Event '46588' acknowledged Nov 4 19:06:26 kjcf05n00 zabbix-server[2356916]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n03"}' Nov 4 19:06:26 kjcf05n03 puppet-agent[31329]: Applied catalog in 5.04 seconds Nov 4 19:06:29 kjcf05n00 mcfcli[3673891]: %3|1730768789.722|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:06:38 kjcf05n00 mcfcli[3673891]: %3|1730768798.824|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 19:07:06 kjcf05n00 mcfcli[3673891]: %3|1730768826.777|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:07:08 kjcf05n00 mcfcli[3673891]: %3|1730768828.959|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 19:07:27 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 19:07:27 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 19:07:27 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 19:07:38 kjcf05n00 mcfcli[3673891]: %3|1730768858.959|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:07:45 kjcf05n00 mcfcli[3673891]: %3|1730768865.599|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:07:51 kjcf05n00 ansible-command[2358075]: Invoked with _uses_shell=True _raw_params=set -o pipefail && ssh -o IdentityFile=~/.ssh/cs_id_ecdsa -o IdentitiesOnly=yes puppet hostname warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:07:59 kjcf05n00 ansible-command[2358176]: Invoked with _uses_shell=True _raw_params=set -o pipefail && ssh -o IdentityFile=~/.ssh/cs_id_ecdsa -o IdentitiesOnly=yes nfsserv hostname warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:08:07 kjcf05n00 ansible-command[2358298]: Invoked with _uses_shell=True _raw_params=cscli show_node_versions -g mgmt=primary | awk '{print $2}' | sed 's#/#_#g' warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:08:08 kjcf05n00 mcfcli[3673891]: %3|1730768888.960|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 19:08:15 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 19:08:15 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 19:08:15 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 19:08:16 kjcf05n00 ansible-command[2358473]: Invoked with _raw_params=cscli t0 property get --name mgsNID warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:08:21 kjcf05n00 mcfcli[3673891]: %3|1730768901.193|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:08:25 kjcf05n00 ansible-command[2358638]: Invoked with _uses_shell=True _raw_params=set -o pipefail && PDSH_SSH_ARGS_APPEND="-o IdentityFile=~/.ssh/cs_id_ecdsa -o IdentitiesOnly=yes" pdsh -SNg mds=primary 'lctl get_param -n mdt.*.recovery_time_hard' | sort -u warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:08:33 kjcf05n00 ansible-command[2358776]: Invoked with _uses_shell=True _raw_params=set -o pipefail && PDSH_SSH_ARGS_APPEND="-o IdentityFile=~/.ssh/cs_id_ecdsa -o IdentitiesOnly=yes" pdsh -SNg mds=secondary 'lctl get_param -n mdt.*.recovery_time_hard' | sort -u warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:08:38 kjcf05n00 mcfcli[3673891]: %3|1730768918.960|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:08:41 kjcf05n00 ansible-command[2358836]: Invoked with _uses_shell=True _raw_params=set -o pipefail && ssh -o IdentityFile=~/.ssh/cs_id_ecdsa -o IdentitiesOnly=yes puppet cscli list | grep ean warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:08:53 kjcf05n01 ansible-command[3832144]: Invoked with _uses_shell=True _raw_params=ip route list | grep 10.101.48.0/22 | awk '{print $9}' warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:08:53 kjcf05n00 ansible-command[2358947]: Invoked with _uses_shell=True _raw_params=ip route list | grep 10.101.48.0/22 | awk '{print $9}' warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:08:58 kjcf05n01 ansible-ansible.builtin.stat[3832202]: Invoked with path=/etc/sysconfig/network-scripts/ifcfg-pub0 follow=False get_md5=False get_checksum=True get_mime=True get_attributes=True checksum_algorithm=sha1 Nov 4 19:08:58 kjcf05n00 ansible-ansible.builtin.stat[2359087]: Invoked with path=/etc/sysconfig/network-scripts/ifcfg-pub0 follow=False get_md5=False get_checksum=True get_mime=True get_attributes=True checksum_algorithm=sha1 Nov 4 19:09:01 kjcf05n00 mcfcli[3673891]: %3|1730768941.190|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:09:08 kjcf05n00 mcfcli[3673891]: %3|1730768948.960|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:09:17 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 19:09:17 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 19:09:17 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 19:09:38 kjcf05n00 mcfcli[3673891]: %3|1730768978.960|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:09:40 kjcf05n00 mcfcli[3673891]: %3|1730768980.630|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:09:57 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 19:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 19:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 19:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 19:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 19:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 19:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 19:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 19:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 19:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 19:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 19:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 19:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 19:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 19:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 19:10:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 19:10:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:10:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 19:10:08 kjcf05n00 mcfcli[3673891]: %3|1730769008.960|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:10:20 kjcf05n00 mcfcli[3673891]: %3|1730769020.130|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:10:24 kjcf05n01 ansible-ansible.builtin.stat[3832788]: Invoked with path=/home/admin/talbers follow=False get_md5=False get_checksum=True get_mime=True get_attributes=True checksum_algorithm=sha1 Nov 4 19:10:24 kjcf05n00 ansible-ansible.builtin.stat[2359922]: Invoked with path=/home/admin/talbers follow=False get_md5=False get_checksum=True get_mime=True get_attributes=True checksum_algorithm=sha1 Nov 4 19:10:25 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 19:10:25 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 19:10:31 kjcf05n01 ansible-ansible.builtin.file[3832933]: Invoked with state=directory path=/home/users/filesystem-test/bin recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:10:31 kjcf05n00 ansible-ansible.builtin.file[2360163]: Invoked with state=directory path=/home/users/filesystem-test/bin recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:10:32 kjcf05n01 ansible-ansible.builtin.file[3832974]: Invoked with state=directory path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:10:33 kjcf05n01 ansible-ansible.builtin.file[3833015]: Invoked with state=directory path=/home/users/filesystem-test/performance recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:10:32 kjcf05n00 ansible-ansible.builtin.file[2360210]: Invoked with state=directory path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:10:34 kjcf05n01 ansible-ansible.builtin.file[3833056]: Invoked with state=directory path=/home/users/filesystem-test/performance/testruns recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:10:34 kjcf05n00 ansible-ansible.builtin.file[2360254]: Invoked with state=directory path=/home/users/filesystem-test/performance recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:10:35 kjcf05n01 ansible-ansible.builtin.file[3833097]: Invoked with state=directory path=/home/users/filesystem-test/performance/baselines/kjcf05 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:10:35 kjcf05n00 ansible-ansible.builtin.file[2360295]: Invoked with state=directory path=/home/users/filesystem-test/performance/testruns recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:10:35 kjcf05n00 python3.9[2360036]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 19:10:36 kjcf05n00 ansible-ansible.builtin.file[2360415]: Invoked with state=directory path=/home/users/filesystem-test/performance/baselines/kjcf05 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:10:38 kjcf05n01 ansible-ansible.builtin.file[3833143]: Invoked with state=directory mode=511 path=/home/users/filesystem-test/log recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:10:38 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 19:10:38 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 19:10:38 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 19:10:38 kjcf05n00 ansible-ansible.builtin.file[2360644]: Invoked with state=directory mode=511 path=/home/users/filesystem-test/log recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:10:38 kjcf05n00 mcfcli[3673891]: %3|1730769038.961|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 19:10:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730768449', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 19:10:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730768449'} Nov 4 19:10:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:10:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730768449', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 19:10:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730768449'} Nov 4 19:10:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:10:57 kjcf05n00 mcfcli[3673891]: %3|1730769057.033|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:11:01 kjcf05n01 ansible-stat[3833249]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/tuning_params_table.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:11:01 kjcf05n00 ansible-stat[2360887]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/tuning_params_table.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:11:02 kjcf05n01 ansible-file[3833293]: Invoked with dest=/home/users/filesystem-test/bin/tuning_params_table.sh.latest recurse=False _original_basename=tuning_params_table.sh state=file path=/home/users/filesystem-test/bin/tuning_params_table.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:11:02 kjcf05n00 ansible-file[2360943]: Invoked with dest=/home/users/filesystem-test/bin/tuning_params_table.sh.latest recurse=False _original_basename=tuning_params_table.sh state=file path=/home/users/filesystem-test/bin/tuning_params_table.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:11:06 kjcf05n01 ansible-ansible.builtin.command[3833453]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/tuning_params_table.sh.latest" "/home/users/filesystem-test/bin/tuning_params_table.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:11:06 kjcf05n00 ansible-ansible.builtin.command[2361030]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/tuning_params_table.sh.latest" "/home/users/filesystem-test/bin/tuning_params_table.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:11:08 kjcf05n01 ansible-ansible.builtin.command[3833508]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/tuning_params_table.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:11:07 kjcf05n00 ansible-ansible.builtin.command[2361081]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/tuning_params_table.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:11:09 kjcf05n00 mcfcli[3673891]: %3|1730769069.040|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:11:17 kjcf05n01 ansible-stat[3833599]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/filesystem-test-common.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:11:17 kjcf05n00 ansible-stat[2361189]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/filesystem-test-common.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:11:18 kjcf05n01 ansible-file[3833646]: Invoked with dest=/home/users/filesystem-test/bin/filesystem-test-common.sh.latest _original_basename=filesystem-test-common.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/filesystem-test-common.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:11:19 kjcf05n00 ansible-file[2361233]: Invoked with dest=/home/users/filesystem-test/bin/filesystem-test-common.sh.latest _original_basename=filesystem-test-common.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/filesystem-test-common.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:11:21 kjcf05n01 ansible-ansible.builtin.command[3833730]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/filesystem-test-common.sh.latest" "/home/users/filesystem-test/bin/filesystem-test-common.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:11:21 kjcf05n00 ansible-ansible.builtin.command[2361413]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/filesystem-test-common.sh.latest" "/home/users/filesystem-test/bin/filesystem-test-common.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:11:23 kjcf05n01 ansible-ansible.builtin.command[3833774]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/filesystem-test-common.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:11:23 kjcf05n00 ansible-ansible.builtin.command[2361463]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/filesystem-test-common.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:11:30 kjcf05n00 mcfcli[3673891]: %3|1730769090.868|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:11:39 kjcf05n00 mcfcli[3673891]: %3|1730769099.040|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:11:57 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 19:12:08 kjcf05n00 mcfcli[3673891]: %3|1730769128.024|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:12:09 kjcf05n00 mcfcli[3673891]: %3|1730769129.041|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:12:25 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 19:12:25 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 19:12:39 kjcf05n00 mcfcli[3673891]: %3|1730769159.041|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:12:45 kjcf05n00 mcfcli[3673891]: %3|1730769165.572|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:13:08 kjcf05n03 root[41776]: failback_xyraid Nov 4 19:13:09 kjcf05n00 mcfcli[3673891]: %3|1730769189.041|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:13:09 kjcf05n03 root[41895]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 4 19:13:10 kjcf05n03 root[41972]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 4 19:13:14 kjcf05n02 systemd[1]: data-kjcf05n03:md66.mount: Succeeded. Nov 4 19:13:17 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme12n1 Nov 4 19:13:17 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme5n1 Nov 4 19:13:17 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme20n1 Nov 4 19:13:17 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme16n1 Nov 4 19:13:17 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme15n1 Nov 4 19:13:17 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme22n1 Nov 4 19:13:17 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme7n1 Nov 4 19:13:17 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme10n1 Nov 4 19:13:17 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme21n1 Nov 4 19:13:17 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme6n1 Nov 4 19:13:17 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme11n1 Nov 4 19:13:19 kjcf05n03 dwd[5199]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 4 19:13:19 kjcf05n03 dwd[5199]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 4 19:13:19 kjcf05n03 dwd[5199]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 4 19:13:19 kjcf05n03 dwd[5199]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 4 19:13:19 kjcf05n03 dwd[5199]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 4 19:13:19 kjcf05n03 dwd[5199]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 4 19:13:19 kjcf05n03 dwd[5199]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 4 19:13:19 kjcf05n03 dwd[5199]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 4 19:13:19 kjcf05n03 dwd[5199]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 4 19:13:19 kjcf05n03 dwd[5199]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 4 19:13:19 kjcf05n03 dwd[5199]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 4 19:13:19 kjcf05n03 dwd[5199]: Starting NVME thread for nvme10n1 Nov 4 19:13:19 kjcf05n03 dwd[5199]: Starting NVME thread for nvme15n1 Nov 4 19:13:20 kjcf05n03 dcs-bulk-data-sender[6213]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 4 19:13:20 kjcf05n03 dwd[5199]: Starting NVME thread for nvme21n1 Nov 4 19:13:20 kjcf05n03 dwd[5199]: Starting NVME thread for nvme11n1 Nov 4 19:13:20 kjcf05n03 dwd[5199]: Starting NVME thread for nvme20n1 Nov 4 19:13:21 kjcf05n03 dwd[5199]: Starting NVME thread for nvme12n1 Nov 4 19:13:21 kjcf05n03 systemd-udevd[44726]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44725]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44730]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44728]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44726]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44728]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44725]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44730]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44726]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44728]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44725]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44730]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44726]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44728]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44725]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44730]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44726]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44728]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44725]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44730]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44726]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44728]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44730]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44725]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44726]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44728]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44725]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44730]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44726]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44728]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44730]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44725]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44763]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44767]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44763]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44766]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44769]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44767]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44763]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44766]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44769]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44762]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44763]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44766]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44763]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44766]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44762]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44763]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44766]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44763]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44763]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44766]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44763]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44766]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44763]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44766]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44763]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44763]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44766]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44763]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44766]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44763]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44763]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 systemd-udevd[44763]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:13:21 kjcf05n03 dwd[5199]: Starting NVME thread for nvme7n1 Nov 4 19:13:21 kjcf05n03 dwd[5199]: Starting NVME thread for nvme6n1 Nov 4 19:13:21 kjcf05n03 dwd[5199]: Starting NVME thread for nvme5n1 Nov 4 19:13:21 kjcf05n03 dwd[5199]: Starting NVME thread for nvme16n1 Nov 4 19:13:21 kjcf05n03 dwd[5199]: Starting NVME thread for nvme22n1 Nov 4 19:13:22 kjcf05n03 nslcd[6951]: [8b4567] (re)loading /etc/nsswitch.conf Nov 4 19:13:24 kjcf05n00 mcfcli[3673891]: %3|1730769204.257|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:13:25 kjcf05n03 diskmonitor[17748]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 4 19:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T19:13:27.253500082-06:00 level=info msg="Completed cleanup jobs" duration=26.394027ms Nov 4 19:13:32 kjcf05n03 diskmonitor[17748]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 4 19:13:32 kjcf05n03 diskmonitor[17748]: Scan for ReadErrorMax change for md66 Nov 4 19:13:32 kjcf05n03 diskmonitor[17748]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 4 19:13:32 kjcf05n03 diskmonitor[17748]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 4 19:13:32 kjcf05n03 diskmonitor[17748]: read_saved_file: md66 no saved speed Nov 4 19:13:32 kjcf05n03 diskmonitor[17748]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 4 19:13:32 kjcf05n03 diskmonitor[17748]: Set sync_speed_min (10000) for md66 Nov 4 19:13:32 kjcf05n03 diskmonitor[17748]: Set sync_speed_max (200000) for md66 Nov 4 19:13:32 kjcf05n03 diskmonitor[17748]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 19:13:39 kjcf05n00 mcfcli[3673891]: %3|1730769219.041|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:13:50 kjcf05n02 diskmonitor[17558]: Removed MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 4 19:13:50 kjcf05n02 diskmonitor[17558]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 19:14:02 kjcf05n00 mcfcli[3673891]: %3|1730769242.410|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:14:09 kjcf05n00 mcfcli[3673891]: %3|1730769249.042|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 19:14:14 kjcf05n03 systemd[1]: Starting Cleanup of Temporary Directories... Nov 4 19:14:14 kjcf05n03 systemd-tmpfiles[48126]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 19:14:14 kjcf05n03 systemd-tmpfiles[48126]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 19:14:14 kjcf05n03 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 4 19:14:14 kjcf05n03 systemd[1]: Started Cleanup of Temporary Directories. Nov 4 19:14:17 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 48344 (bash) Nov 4 19:14:17 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 4 19:14:17 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 4 19:14:17 kjcf05n00 zabbix-server[2362901]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 19:14:17 kjcf05n00 zabbix-server[2362901]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n03' from event '46590' Nov 4 19:14:17 kjcf05n00 zabbix-server[2362901]: Filesystem 'kjcf05' has been mounted Nov 4 19:14:18 kjcf05n00 zabbix-server[2362901]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 4 19:14:18 kjcf05n00 zabbix-server[2362901]: Running puppet on 'None' Nov 4 19:14:20 kjcf05n05 puppet-agent[2330910]: Using configured environment 'production' Nov 4 19:14:20 kjcf05n07 puppet-agent[2143074]: Using configured environment 'production' Nov 4 19:14:20 kjcf05n07 puppet-agent[2143074]: Retrieving pluginfacts Nov 4 19:14:20 kjcf05n07 puppet-agent[2143074]: Retrieving plugin Nov 4 19:14:20 kjcf05n03 puppet-agent[48556]: Using configured environment 'production' Nov 4 19:14:20 kjcf05n03 puppet-agent[48556]: Retrieving pluginfacts Nov 4 19:14:20 kjcf05n03 puppet-agent[48556]: Retrieving plugin Nov 4 19:14:20 kjcf05n02 puppet-agent[107277]: Using configured environment 'production' Nov 4 19:14:20 kjcf05n02 puppet-agent[107277]: Retrieving pluginfacts Nov 4 19:14:20 kjcf05n02 puppet-agent[107277]: Retrieving plugin Nov 4 19:14:20 kjcf05n05 puppet-agent[2330910]: Retrieving pluginfacts Nov 4 19:14:20 kjcf05n05 puppet-agent[2330910]: Retrieving plugin Nov 4 19:14:20 kjcf05n06 puppet-agent[2139905]: Using configured environment 'production' Nov 4 19:14:20 kjcf05n06 puppet-agent[2139905]: Retrieving pluginfacts Nov 4 19:14:20 kjcf05n06 puppet-agent[2139905]: Retrieving plugin Nov 4 19:14:20 kjcf05n04 puppet-agent[2130906]: Using configured environment 'production' Nov 4 19:14:20 kjcf05n04 puppet-agent[2130906]: Retrieving pluginfacts Nov 4 19:14:20 kjcf05n04 puppet-agent[2130906]: Retrieving plugin Nov 4 19:14:20 kjcf05n07 puppet-agent[2143074]: Loading facts Nov 4 19:14:20 kjcf05n03 puppet-agent[48556]: Loading facts Nov 4 19:14:20 kjcf05n02 puppet-agent[107277]: Loading facts Nov 4 19:14:20 kjcf05n01 puppet-agent[3835106]: Using configured environment 'production' Nov 4 19:14:20 kjcf05n01 puppet-agent[3835106]: Retrieving pluginfacts Nov 4 19:14:20 kjcf05n01 puppet-agent[3835106]: Retrieving plugin Nov 4 19:14:20 kjcf05n01 puppet-agent[3835106]: Loading facts Nov 4 19:14:20 kjcf05n05 puppet-agent[2330910]: Loading facts Nov 4 19:14:20 kjcf05n06 puppet-agent[2139905]: Loading facts Nov 4 19:14:21 kjcf05n04 puppet-agent[2130906]: Loading facts Nov 4 19:14:20 kjcf05n00 puppet-agent[2362974]: Using configured environment 'production' Nov 4 19:14:20 kjcf05n00 puppet-agent[2362974]: Retrieving pluginfacts Nov 4 19:14:20 kjcf05n00 puppet-agent[2362974]: Retrieving plugin Nov 4 19:14:21 kjcf05n00 puppet-agent[2362974]: Loading facts Nov 4 19:14:23 kjcf05n02 puppet-agent[107277]: Caching catalog for kjcf05n02 Nov 4 19:14:23 kjcf05n02 puppet-agent[107277]: Applying configuration version '1730769261' Nov 4 19:14:23 kjcf05n03 puppet-agent[48556]: Caching catalog for kjcf05n03 Nov 4 19:14:23 kjcf05n03 puppet-agent[48556]: Applying configuration version '1730769261' Nov 4 19:14:23 kjcf05n06 puppet-agent[2139905]: Caching catalog for kjcf05n06 Nov 4 19:14:23 kjcf05n06 puppet-agent[2139905]: Applying configuration version '1730769262' Nov 4 19:14:23 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 4 19:14:23 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 4 19:14:24 kjcf05n07 puppet-agent[2143074]: Caching catalog for kjcf05n07 Nov 4 19:14:24 kjcf05n07 puppet-agent[2143074]: Applying configuration version '1730769262' Nov 4 19:14:24 kjcf05n01 puppet-agent[3835106]: Caching catalog for kjcf05n01 Nov 4 19:14:24 kjcf05n00 puppet-agent[2362974]: Caching catalog for kjcf05n00 Nov 4 19:14:24 kjcf05n00 puppet-agent[2362974]: Applying configuration version '1730769262' Nov 4 19:14:25 kjcf05n01 puppet-agent[3835106]: Applying configuration version '1730769262' Nov 4 19:14:25 kjcf05n03 puppet-agent[48556]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 19:14:25 kjcf05n03 puppet-agent[48556]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 19:14:25 kjcf05n03 puppet-agent[48556]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 19:14:25 kjcf05n02 puppet-agent[107277]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 19:14:25 kjcf05n02 puppet-agent[107277]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 19:14:25 kjcf05n02 puppet-agent[107277]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 19:14:25 kjcf05n06 puppet-agent[2139905]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 19:14:25 kjcf05n06 puppet-agent[2139905]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 19:14:25 kjcf05n06 puppet-agent[2139905]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 19:14:26 kjcf05n07 puppet-agent[2143074]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 19:14:26 kjcf05n07 puppet-agent[2143074]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 19:14:26 kjcf05n07 puppet-agent[2143074]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 19:14:26 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 4 19:14:26 kjcf05n03 zabbix_agent2[31656]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 19:14:26 kjcf05n03 zabbix_agent2[3190]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:14:26 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 19:14:26 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 4 19:14:26 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 4 19:14:26 kjcf05n03 puppet-agent[48556]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: Press Ctrl+C to exit. Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: Plugin support version 1.0 Nov 4 19:14:26 kjcf05n03 zabbix_agent2[48945]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 19:14:26 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 4 19:14:26 kjcf05n02 zabbix_agent2[48267]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 19:14:26 kjcf05n02 zabbix_agent2[3190]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 19:14:26 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 19:14:26 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 4 19:14:26 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 19:14:26 kjcf05n02 puppet-agent[107277]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: Press Ctrl+C to exit. Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: Plugin support version 1.0 Nov 4 19:14:26 kjcf05n02 zabbix_agent2[107646]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 19:14:26 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2087551]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 19:14:26 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 4 19:14:26 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 19:14:26 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 4 19:14:26 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 4 19:14:26 kjcf05n06 puppet-agent[2139905]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: Press Ctrl+C to exit. Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: Plugin support version 1.0 Nov 4 19:14:26 kjcf05n06 zabbix_agent2[2140769]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 19:14:26 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2090704]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 19:14:26 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 4 19:14:26 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 19:14:26 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 4 19:14:26 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 4 19:14:26 kjcf05n07 puppet-agent[2143074]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: Press Ctrl+C to exit. Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: Plugin support version 1.0 Nov 4 19:14:26 kjcf05n07 zabbix_agent2[2143487]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 19:14:28 kjcf05n01 puppet-agent[3835106]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 19:14:28 kjcf05n01 puppet-agent[3835106]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-18:55:25]/mode) mode changed '0755' to '0750' Nov 4 19:14:28 kjcf05n01 puppet-agent[3835106]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-18:55:25/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 4 19:14:28 kjcf05n01 puppet-agent[3835106]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-18:55:25/vmcore]/mode) mode changed '0600' to '0640' Nov 4 19:14:28 kjcf05n01 puppet-agent[3835106]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-18:55:25/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 4 19:14:28 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 19:14:28 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 19:14:28 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 19:14:27 kjcf05n00 puppet-agent[2362974]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 19:14:28 kjcf05n06 puppet-agent[2139905]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 19:14:28 kjcf05n06 puppet-agent[2139905]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 19:14:28 kjcf05n06 puppet-agent[2139905]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 19:14:28 kjcf05n06 puppet-agent[2139905]: Applied catalog in 4.79 seconds Nov 4 19:14:28 kjcf05n02 puppet-agent[107277]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 19:14:28 kjcf05n02 puppet-agent[107277]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 19:14:28 kjcf05n02 puppet-agent[107277]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 19:14:28 kjcf05n03 puppet-agent[48556]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 19:14:28 kjcf05n03 puppet-agent[48556]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 19:14:28 kjcf05n03 puppet-agent[48556]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 19:14:28 kjcf05n03 puppet-agent[48556]: Applied catalog in 5.00 seconds Nov 4 19:14:28 kjcf05n07 puppet-agent[2143074]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 19:14:28 kjcf05n07 puppet-agent[2143074]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 19:14:28 kjcf05n07 puppet-agent[2143074]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 19:14:28 kjcf05n07 puppet-agent[2143074]: Applied catalog in 4.88 seconds Nov 4 19:14:28 kjcf05n02 puppet-agent[107277]: Applied catalog in 5.15 seconds Nov 4 19:14:28 kjcf05n01 puppet-agent[3835106]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 19:14:28 kjcf05n01 puppet-agent[3835106]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 19:14:28 kjcf05n01 puppet-agent[3835106]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 19:14:28 kjcf05n00 puppet-agent[2362974]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 19:14:28 kjcf05n00 puppet-agent[2362974]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 19:14:28 kjcf05n00 puppet-agent[2362974]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 19:14:29 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3821356]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 19:14:29 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 4 19:14:29 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 19:14:29 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 4 19:14:29 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 4 19:14:29 kjcf05n01 puppet-agent[3835106]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: Press Ctrl+C to exit. Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: Plugin support version 1.0 Nov 4 19:14:29 kjcf05n01 zabbix_agent2[3835497]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 19:14:29 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2342433]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 19:14:29 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 19:14:29 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 19:14:29 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 4 19:14:29 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 4 19:14:29 kjcf05n00 puppet-agent[2362974]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: Press Ctrl+C to exit. Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: Plugin support version 1.0 Nov 4 19:14:29 kjcf05n00 zabbix_agent2[2363544]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 19:14:29 kjcf05n00 zabbix-server[2363578]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 19:14:30 kjcf05n00 zabbix-server[2363597]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 19:14:30 kjcf05n00 zabbix-server[2363607]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 19:14:30 kjcf05n00 zabbix-server[2363609]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 19:14:31 kjcf05n01 puppet-agent[3835106]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_190233.log]/mode) mode changed '0644' to '0640' Nov 4 19:14:31 kjcf05n01 puppet-agent[3835106]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_191416.log]/mode) mode changed '0644' to '0640' Nov 4 19:14:31 kjcf05n00 puppet-agent[2362974]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 4 19:14:32 kjcf05n01 puppet-agent[3835106]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_190233.log]/mode) mode changed '0644' to '0640' Nov 4 19:14:32 kjcf05n01 puppet-agent[3835106]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_191416.log]/mode) mode changed '0644' to '0640' Nov 4 19:14:32 kjcf05n01 puppet-agent[3835106]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241104_191417]/mode) mode changed '0755' to '0750' Nov 4 19:14:32 kjcf05n01 puppet-agent[3835106]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241104_191417/screenlog.0]/mode) mode changed '0644' to '0640' Nov 4 19:14:32 kjcf05n01 puppet-agent[3835106]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 19:14:32 kjcf05n01 puppet-agent[3835106]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 19:14:32 kjcf05n01 puppet-agent[3835106]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 19:14:32 kjcf05n00 puppet-agent[2362974]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 19:14:32 kjcf05n00 puppet-agent[2362974]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 19:14:32 kjcf05n00 puppet-agent[2362974]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 19:14:32 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 4 19:14:33 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 4 19:14:33 kjcf05n00 puppet-agent[2362974]: Applied catalog in 8.37 seconds Nov 4 19:14:33 kjcf05n01 puppet-agent[3835106]: Applied catalog in 8.70 seconds Nov 4 19:14:36 kjcf05n00 mcfcli[3673891]: %3|1730769276.828|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:14:39 kjcf05n00 mcfcli[3673891]: %3|1730769279.042|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:14:42 kjcf05n05 puppet-agent[2330910]: Caching catalog for kjcf05n05 Nov 4 19:14:42 kjcf05n05 puppet-agent[2330910]: Applying configuration version '1730769280' Nov 4 19:14:44 kjcf05n05 puppet-agent[2330910]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 19:14:44 kjcf05n05 puppet-agent[2330910]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 19:14:44 kjcf05n05 puppet-agent[2330910]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 19:14:44 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2271869]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 19:14:44 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 4 19:14:44 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 19:14:44 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 4 19:14:44 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 4 19:14:44 kjcf05n05 puppet-agent[2330910]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: Press Ctrl+C to exit. Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: Plugin support version 1.0 Nov 4 19:14:44 kjcf05n05 zabbix_agent2[2331966]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 19:14:46 kjcf05n05 puppet-agent[2330910]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 19:14:46 kjcf05n05 puppet-agent[2330910]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 19:14:46 kjcf05n05 puppet-agent[2330910]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 19:14:47 kjcf05n05 puppet-agent[2330910]: Applied catalog in 4.82 seconds Nov 4 19:15:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730769301}"] Nov 4 19:15:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730769301, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:15:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.278377ms Nov 4 19:15:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.278377ms Nov 4 19:15:01 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:15:01 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:15:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:15:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730769301}"] Nov 4 19:15:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730769301, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:15:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.821432ms Nov 4 19:15:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.821432ms Nov 4 19:15:01 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:15:01 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:15:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730769301}"] Nov 4 19:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730769301, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.202656ms Nov 4 19:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.202656ms Nov 4 19:15:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:15:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:15:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730769301}"] Nov 4 19:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730769301, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.373496ms Nov 4 19:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.373496ms Nov 4 19:15:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:15:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:15:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730769301}"] Nov 4 19:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730769301, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.071279ms Nov 4 19:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.071279ms Nov 4 19:15:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:15:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:15:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730769301}"] Nov 4 19:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730769301, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.034761ms Nov 4 19:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.034761ms Nov 4 19:15:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:15:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:15:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730769301}"] Nov 4 19:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730769301, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.334222ms Nov 4 19:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.334222ms Nov 4 19:15:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:15:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:15:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730769301}"] Nov 4 19:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730769301, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.93807ms Nov 4 19:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.93807ms Nov 4 19:15:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:15:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:15:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730769301}"] Nov 4 19:15:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730769301, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:02-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:02 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:02-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:02 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:02-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:02 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.336517ms Nov 4 19:15:02 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:02-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.336517ms Nov 4 19:15:02 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:15:02 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:15:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:15:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730769301}"] Nov 4 19:15:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730769301, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:15:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.889109ms Nov 4 19:15:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.889109ms Nov 4 19:15:03 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:15:03 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:15:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:15:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730769301}"] Nov 4 19:15:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730769301, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:15:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:03-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:15:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:03 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:15:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:03-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:15:03 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:15:03-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:15:03 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:15:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.992432ms Nov 4 19:15:03 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:15:03-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.992432ms Nov 4 19:15:03 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:15:03 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:15:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:15:09 kjcf05n00 mcfcli[3673891]: %3|1730769309.042|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:15:12 kjcf05n00 mcfcli[3673891]: %3|1730769312.999|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:15:29 kjcf05n04 puppet-agent[2130906]: Caching catalog for kjcf05n04 Nov 4 19:15:29 kjcf05n04 puppet-agent[2130906]: Applying configuration version '1730769327' Nov 4 19:15:31 kjcf05n04 puppet-agent[2130906]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 19:15:31 kjcf05n04 puppet-agent[2130906]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 19:15:31 kjcf05n04 puppet-agent[2130906]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 19:15:31 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2074140]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 19:15:31 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 4 19:15:31 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 19:15:31 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 4 19:15:31 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 4 19:15:31 kjcf05n04 puppet-agent[2130906]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: Press Ctrl+C to exit. Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: Plugin support version 1.0 Nov 4 19:15:31 kjcf05n04 zabbix_agent2[2133006]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 19:15:33 kjcf05n04 puppet-agent[2130906]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 19:15:33 kjcf05n04 puppet-agent[2130906]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 19:15:33 kjcf05n04 puppet-agent[2130906]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 19:15:34 kjcf05n04 puppet-agent[2130906]: Applied catalog in 4.85 seconds Nov 4 19:15:33 kjcf05n00 zabbix-server[2362901]: puppet completed status:(0): '' Nov 4 19:15:33 kjcf05n00 zabbix-server[2362901]: Event '46590' acknowledged Nov 4 19:15:33 kjcf05n00 zabbix-server[2362901]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n03"}' Nov 4 19:15:35 kjcf05n00 python3.9[2364480]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 19:15:39 kjcf05n00 mcfcli[3673891]: %3|1730769339.042|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 19:15:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730769348', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 4 19:15:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730769348'} Nov 4 19:15:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:15:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730769348', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 4 19:15:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730769348'} Nov 4 19:15:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:15:51 kjcf05n00 mcfcli[3673891]: %3|1730769351.674|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:16:09 kjcf05n00 mcfcli[3673891]: %3|1730769369.464|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 19:16:28 kjcf05n00 mcfcli[3673891]: %3|1730769388.591|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:16:39 kjcf05n00 mcfcli[3673891]: %3|1730769399.464|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:17:06 kjcf05n00 mcfcli[3673891]: %3|1730769426.971|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:17:09 kjcf05n00 mcfcli[3673891]: %3|1730769429.464|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 19:17:39 kjcf05n00 mcfcli[3673891]: %3|1730769459.464|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 19:17:46 kjcf05n00 mcfcli[3673891]: %3|1730769466.968|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:18:09 kjcf05n00 mcfcli[3673891]: %3|1730769489.464|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 19:18:26 kjcf05n00 mcfcli[3673891]: %3|1730769506.897|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:18:30 kjcf05n01 ansible-file[3837264]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:30 kjcf05n00 ansible-file[2366223]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:31 kjcf05n01 ansible-file[3837305]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:32 kjcf05n00 ansible-file[2366264]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:32 kjcf05n01 ansible-file[3837346]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:33 kjcf05n01 ansible-file[3837387]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:33 kjcf05n00 ansible-file[2366307]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:34 kjcf05n01 ansible-file[3837428]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:34 kjcf05n03 dwd[5199]: nvme15n1 passed periodic SMART status check Nov 4 19:18:34 kjcf05n03 dwd[5199]: nvme10n1 passed periodic SMART status check Nov 4 19:18:34 kjcf05n00 ansible-file[2366414]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:35 kjcf05n01 ansible-file[3837469]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:35 kjcf05n03 dwd[5199]: nvme20n1 passed periodic SMART status check Nov 4 19:18:35 kjcf05n03 dwd[5199]: nvme11n1 passed periodic SMART status check Nov 4 19:18:35 kjcf05n03 dwd[5199]: nvme21n1 passed periodic SMART status check Nov 4 19:18:35 kjcf05n03 dwd[5199]: nvme12n1 passed periodic SMART status check Nov 4 19:18:35 kjcf05n01 ansible-file[3837510]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:35 kjcf05n00 ansible-file[2366469]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:36 kjcf05n03 dwd[5199]: nvme22n1 passed periodic SMART status check Nov 4 19:18:36 kjcf05n03 dwd[5199]: nvme5n1 passed periodic SMART status check Nov 4 19:18:36 kjcf05n03 dwd[5199]: nvme7n1 passed periodic SMART status check Nov 4 19:18:36 kjcf05n03 dwd[5199]: nvme6n1 passed periodic SMART status check Nov 4 19:18:36 kjcf05n03 dwd[5199]: nvme16n1 passed periodic SMART status check Nov 4 19:18:36 kjcf05n01 ansible-file[3837551]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:37 kjcf05n00 ansible-file[2366518]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:37 kjcf05n01 ansible-file[3837592]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:38 kjcf05n01 ansible-file[3837647]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:38 kjcf05n00 ansible-file[2366616]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:39 kjcf05n01 ansible-file[3837713]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:39 kjcf05n00 mcfcli[3673891]: %3|1730769519.464|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:18:39 kjcf05n00 ansible-file[2366710]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:40 kjcf05n01 ansible-file[3837798]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:40 kjcf05n01 ansible-file[3837864]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/LUS-11101 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:40 kjcf05n00 ansible-file[2366791]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:41 kjcf05n01 ansible-file[3837906]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/LUS-9595 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:41 kjcf05n00 ansible-file[2366835]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:42 kjcf05n01 ansible-file[3837947]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:43 kjcf05n00 ansible-file[2366878]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:43 kjcf05n01 ansible-file[3837988]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/LUS-10934 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:44 kjcf05n01 ansible-file[3838029]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/ZFS-513 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:44 kjcf05n00 ansible-file[2366919]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:45 kjcf05n01 ansible-file[3838070]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:45 kjcf05n00 ansible-file[2366964]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/LUS-11101 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:46 kjcf05n00 ansible-file[2367006]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/LUS-9595 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:48 kjcf05n00 ansible-file[2367064]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:49 kjcf05n00 ansible-file[2367112]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/LUS-10934 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:50 kjcf05n00 ansible-file[2367153]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/ZFS-513 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:51 kjcf05n00 ansible-file[2367194]: Invoked with group=root state=directory mode=0755 owner=root path=/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991 recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:56 kjcf05n01 ansible-stat[3838160]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/panic_mdt0.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:18:57 kjcf05n00 ansible-stat[2367372]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/panic_mdt0.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:18:57 kjcf05n01 ansible-file[3838210]: Invoked with dest=/home/users/filesystem-test/bin/debug/panic_mdt0.sh.latest _original_basename=panic_mdt0.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/panic_mdt0.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:18:58 kjcf05n00 ansible-file[2367416]: Invoked with dest=/home/users/filesystem-test/bin/debug/panic_mdt0.sh.latest _original_basename=panic_mdt0.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/panic_mdt0.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:19:01 kjcf05n01 ansible-ansible.builtin.command[3838299]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/panic_mdt0.sh.latest" "/home/users/filesystem-test/bin/debug/panic_mdt0.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:00 kjcf05n00 ansible-ansible.builtin.command[2367505]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/panic_mdt0.sh.latest" "/home/users/filesystem-test/bin/debug/panic_mdt0.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:02 kjcf05n00 mcfcli[3673891]: %3|1730769542.340|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:19:02 kjcf05n01 ansible-ansible.builtin.command[3838344]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/panic_mdt0.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:02 kjcf05n00 ansible-ansible.builtin.command[2367552]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/panic_mdt0.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:06 kjcf05n01 ansible-stat[3838437]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/ftrace_capture.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:19:07 kjcf05n01 ansible-file[3838485]: Invoked with dest=/home/users/filesystem-test/bin/debug/ftrace_capture.sh.latest _original_basename=ftrace_capture.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/ftrace_capture.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:19:06 kjcf05n00 ansible-stat[2367651]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/ftrace_capture.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:19:07 kjcf05n00 ansible-file[2367701]: Invoked with dest=/home/users/filesystem-test/bin/debug/ftrace_capture.sh.latest _original_basename=ftrace_capture.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/ftrace_capture.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:19:09 kjcf05n00 mcfcli[3673891]: %3|1730769549.465|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:19:10 kjcf05n01 ansible-ansible.builtin.command[3838575]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/ftrace_capture.sh.latest" "/home/users/filesystem-test/bin/debug/ftrace_capture.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:10 kjcf05n00 ansible-ansible.builtin.command[2367784]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/ftrace_capture.sh.latest" "/home/users/filesystem-test/bin/debug/ftrace_capture.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:12 kjcf05n01 ansible-ansible.builtin.command[3838619]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/ftrace_capture.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:12 kjcf05n00 ansible-ansible.builtin.command[2367833]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/ftrace_capture.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:16 kjcf05n01 ansible-stat[3838707]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:19:16 kjcf05n00 ansible-stat[2367931]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:19:17 kjcf05n01 ansible-file[3838750]: Invoked with dest=/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh.latest _original_basename=dklogs-capture-oneshot.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:19:18 kjcf05n00 ansible-file[2367978]: Invoked with dest=/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh.latest _original_basename=dklogs-capture-oneshot.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:19:20 kjcf05n01 ansible-ansible.builtin.command[3838910]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh.latest" "/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:20 kjcf05n00 ansible-ansible.builtin.command[2368069]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh.latest" "/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:22 kjcf05n01 ansible-ansible.builtin.command[3838954]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:22 kjcf05n00 ansible-ansible.builtin.command[2368113]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/dklogs-capture-oneshot.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:25 kjcf05n01 ansible-stat[3839043]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:19:26 kjcf05n01 ansible-file[3839086]: Invoked with dest=/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh.latest _original_basename=panic-mdt0-oneshot.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:19:26 kjcf05n00 ansible-stat[2368299]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:19:27 kjcf05n00 ansible-file[2368343]: Invoked with dest=/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh.latest _original_basename=panic-mdt0-oneshot.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:19:30 kjcf05n01 ansible-ansible.builtin.command[3839166]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh.latest" "/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:30 kjcf05n00 ansible-ansible.builtin.command[2368423]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh.latest" "/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:31 kjcf05n01 ansible-ansible.builtin.command[3839259]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:31 kjcf05n00 ansible-ansible.builtin.command[2368469]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/panic-mdt0-oneshot.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:35 kjcf05n01 ansible-stat[3839345]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/dklogs_capture.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:19:35 kjcf05n00 ansible-stat[2368633]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/dklogs_capture.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:19:36 kjcf05n01 ansible-file[3839388]: Invoked with dest=/home/users/filesystem-test/bin/debug/dklogs_capture.sh.latest _original_basename=dklogs_capture.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/dklogs_capture.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:19:36 kjcf05n00 ansible-file[2368720]: Invoked with dest=/home/users/filesystem-test/bin/debug/dklogs_capture.sh.latest _original_basename=dklogs_capture.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/dklogs_capture.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:19:39 kjcf05n01 ansible-ansible.builtin.command[3839468]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/dklogs_capture.sh.latest" "/home/users/filesystem-test/bin/debug/dklogs_capture.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:39 kjcf05n00 ansible-ansible.builtin.command[2368802]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/dklogs_capture.sh.latest" "/home/users/filesystem-test/bin/debug/dklogs_capture.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:39 kjcf05n00 mcfcli[3673891]: %3|1730769579.465|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:19:40 kjcf05n01 ansible-ansible.builtin.command[3839519]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/dklogs_capture.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:40 kjcf05n00 ansible-ansible.builtin.command[2368848]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/dklogs_capture.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:40 kjcf05n00 mcfcli[3673891]: %3|1730769580.942|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:19:44 kjcf05n01 ansible-stat[3839606]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:19:45 kjcf05n00 ansible-stat[2368942]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:19:45 kjcf05n01 ansible-file[3839649]: Invoked with dest=/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh.latest _original_basename=panic_server_on_kern_log.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:19:46 kjcf05n00 ansible-file[2368985]: Invoked with dest=/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh.latest _original_basename=panic_server_on_kern_log.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:19:48 kjcf05n01 ansible-ansible.builtin.command[3839734]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh.latest" "/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:48 kjcf05n00 ansible-ansible.builtin.command[2369101]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh.latest" "/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:50 kjcf05n01 ansible-ansible.builtin.command[3839831]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:50 kjcf05n00 ansible-ansible.builtin.command[2369219]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/panic_server_on_kern_log.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:54 kjcf05n01 ansible-stat[3839965]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/panic_all_mds.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:19:54 kjcf05n01 ansible-file[3840008]: Invoked with dest=/home/users/filesystem-test/bin/debug/panic_all_mds.sh.latest _original_basename=panic_all_mds.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/panic_all_mds.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:19:54 kjcf05n00 ansible-stat[2369334]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/panic_all_mds.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:19:55 kjcf05n00 ansible-file[2369381]: Invoked with dest=/home/users/filesystem-test/bin/debug/panic_all_mds.sh.latest _original_basename=panic_all_mds.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/panic_all_mds.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:19:58 kjcf05n01 ansible-ansible.builtin.command[3840097]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/panic_all_mds.sh.latest" "/home/users/filesystem-test/bin/debug/panic_all_mds.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:58 kjcf05n00 ansible-ansible.builtin.command[2369484]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/panic_all_mds.sh.latest" "/home/users/filesystem-test/bin/debug/panic_all_mds.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:59 kjcf05n01 ansible-ansible.builtin.command[3840141]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/panic_all_mds.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:19:59 kjcf05n00 ansible-ansible.builtin.command[2369528]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/panic_all_mds.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 19:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 19:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 19:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 19:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 19:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 19:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 19:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 19:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 19:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 19:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 19:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 19:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 19:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 19:20:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 19:20:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:20:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 19:20:03 kjcf05n01 ansible-stat[3840238]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/trigger-service-start.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:20:03 kjcf05n01 ansible-file[3840283]: Invoked with dest=/home/users/filesystem-test/bin/debug/trigger-service-start.sh.latest _original_basename=trigger-service-start.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/trigger-service-start.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:20:03 kjcf05n00 ansible-stat[2369633]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/trigger-service-start.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:20:04 kjcf05n00 ansible-file[2369678]: Invoked with dest=/home/users/filesystem-test/bin/debug/trigger-service-start.sh.latest _original_basename=trigger-service-start.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/trigger-service-start.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:20:07 kjcf05n01 ansible-ansible.builtin.command[3840372]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/trigger-service-start.sh.latest" "/home/users/filesystem-test/bin/debug/trigger-service-start.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:07 kjcf05n00 ansible-ansible.builtin.command[2369773]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/trigger-service-start.sh.latest" "/home/users/filesystem-test/bin/debug/trigger-service-start.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:08 kjcf05n01 ansible-ansible.builtin.command[3840419]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/trigger-service-start.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:08 kjcf05n00 ansible-ansible.builtin.command[2369819]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/trigger-service-start.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:09 kjcf05n00 mcfcli[3673891]: %3|1730769609.465|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 19:20:12 kjcf05n01 ansible-stat[3840555]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:20:13 kjcf05n00 ansible-stat[2369908]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:20:13 kjcf05n01 ansible-file[3840598]: Invoked with dest=/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh.latest _original_basename=ftrace-capture-oneshot.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:20:14 kjcf05n00 ansible-file[2369953]: Invoked with dest=/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh.latest _original_basename=ftrace-capture-oneshot.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:20:16 kjcf05n01 ansible-ansible.builtin.command[3840752]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh.latest" "/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:16 kjcf05n00 ansible-ansible.builtin.command[2370039]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh.latest" "/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:16 kjcf05n00 mcfcli[3673891]: %3|1730769616.930|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:20:18 kjcf05n01 ansible-ansible.builtin.command[3840796]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:18 kjcf05n00 ansible-ansible.builtin.command[2370086]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/ftrace-capture-oneshot.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:22 kjcf05n01 ansible-stat[3840891]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:20:22 kjcf05n00 ansible-stat[2370274]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:20:23 kjcf05n01 ansible-file[3840934]: Invoked with dest=/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch.latest _original_basename=XYMNTR_filesystem-test.patch.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:20:23 kjcf05n00 ansible-file[2370325]: Invoked with dest=/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch.latest _original_basename=XYMNTR_filesystem-test.patch.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:20:26 kjcf05n01 ansible-ansible.builtin.command[3841059]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch.latest" "/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:26 kjcf05n00 ansible-ansible.builtin.command[2370419]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch.latest" "/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:27 kjcf05n01 ansible-ansible.builtin.command[3841103]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:27 kjcf05n00 ansible-ansible.builtin.command[2370500]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/XYMNTR_filesystem-test.patch.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:31 kjcf05n01 ansible-stat[3841194]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:20:32 kjcf05n00 ansible-stat[2370622]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:20:32 kjcf05n01 ansible-file[3841237]: Invoked with dest=/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh.latest _original_basename=panic-all-mds-oneshot.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:20:33 kjcf05n00 ansible-file[2370700]: Invoked with dest=/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh.latest _original_basename=panic-all-mds-oneshot.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:20:35 kjcf05n01 ansible-ansible.builtin.command[3841317]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh.latest" "/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:35 kjcf05n00 ansible-ansible.builtin.command[2370796]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh.latest" "/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:36 kjcf05n00 python3.9[2370504]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 19:20:37 kjcf05n01 ansible-ansible.builtin.command[3841361]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:37 kjcf05n00 ansible-ansible.builtin.command[2370926]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/panic-all-mds-oneshot.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:39 kjcf05n00 mcfcli[3673891]: %3|1730769639.465|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 19:20:41 kjcf05n01 ansible-stat[3841499]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:20:41 kjcf05n00 ansible-stat[2371213]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:20:42 kjcf05n01 ansible-file[3841548]: Invoked with dest=/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh.latest _original_basename=dklogs_extended_capture.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:20:42 kjcf05n00 ansible-file[2371258]: Invoked with dest=/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh.latest _original_basename=dklogs_extended_capture.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:20:45 kjcf05n01 ansible-ansible.builtin.command[3841628]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh.latest" "/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:45 kjcf05n00 ansible-ansible.builtin.command[2371348]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh.latest" "/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:46 kjcf05n01 ansible-ansible.builtin.command[3841672]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:46 kjcf05n00 ansible-ansible.builtin.command[2371392]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/dklogs_extended_capture.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:50 kjcf05n01 ansible-stat[3841762]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:20:51 kjcf05n00 ansible-stat[2371480]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:20:51 kjcf05n01 ansible-file[3841805]: Invoked with dest=/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh.latest _original_basename=panic_server_on_LUS-11101.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:20:52 kjcf05n00 ansible-file[2371524]: Invoked with dest=/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh.latest _original_basename=panic_server_on_LUS-11101.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:20:55 kjcf05n01 ansible-ansible.builtin.command[3841885]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh.latest" "/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:55 kjcf05n00 ansible-ansible.builtin.command[2371607]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh.latest" "/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:56 kjcf05n01 ansible-ansible.builtin.command[3841929]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:56 kjcf05n00 ansible-ansible.builtin.command[2371745]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/LUS-11101/panic_server_on_LUS-11101.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:20:56 kjcf05n00 mcfcli[3673891]: %3|1730769656.927|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:21:00 kjcf05n01 ansible-stat[3842098]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:21:00 kjcf05n00 ansible-stat[2371964]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:21:01 kjcf05n01 ansible-file[3842170]: Invoked with dest=/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template.latest _original_basename=libcfs_LUS-9595.conf.template.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:21:01 kjcf05n00 ansible-file[2372024]: Invoked with dest=/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template.latest _original_basename=libcfs_LUS-9595.conf.template.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:21:04 kjcf05n01 ansible-ansible.builtin.command[3842257]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template.latest" "/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:04 kjcf05n00 ansible-ansible.builtin.command[2372113]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template.latest" "/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:05 kjcf05n01 ansible-ansible.builtin.command[3842305]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:05 kjcf05n00 ansible-ansible.builtin.command[2372168]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/LUS-9595/libcfs_LUS-9595.conf.template.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:09 kjcf05n01 ansible-stat[3842414]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:21:09 kjcf05n00 mcfcli[3673891]: %3|1730769669.465|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 19:21:10 kjcf05n00 ansible-stat[2372290]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:21:10 kjcf05n01 ansible-file[3842457]: Invoked with dest=/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.latest _original_basename=trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:21:11 kjcf05n00 ansible-file[2372336]: Invoked with dest=/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.latest _original_basename=trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:21:13 kjcf05n01 ansible-ansible.builtin.command[3842541]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.latest" "/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:13 kjcf05n00 ansible-ansible.builtin.command[2372425]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.latest" "/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:15 kjcf05n01 ansible-ansible.builtin.command[3842587]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:15 kjcf05n00 ansible-ansible.builtin.command[2372473]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/LUS-11101_LUS-10969/trace_jbd2_run_stats_LUS-11101_LUS-10969.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:19 kjcf05n01 ansible-stat[3842745]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:21:19 kjcf05n01 ansible-file[3842792]: Invoked with dest=/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh.latest _original_basename=XYMNTR_filesystem-test_LUS-10934.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:21:19 kjcf05n00 ansible-stat[2372580]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:21:20 kjcf05n00 ansible-file[2372624]: Invoked with dest=/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh.latest _original_basename=XYMNTR_filesystem-test_LUS-10934.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:21:23 kjcf05n01 ansible-ansible.builtin.command[3842876]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh.latest" "/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:23 kjcf05n00 ansible-ansible.builtin.command[2372800]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh.latest" "/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:24 kjcf05n01 ansible-ansible.builtin.command[3842923]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:24 kjcf05n00 ansible-ansible.builtin.command[2372854]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/LUS-10934/XYMNTR_filesystem-test_LUS-10934.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:28 kjcf05n01 ansible-stat[3843009]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:21:28 kjcf05n00 ansible-stat[2372948]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:21:29 kjcf05n01 ansible-file[3843052]: Invoked with dest=/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh.latest _original_basename=panic_server_on_ZFS-513.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:21:30 kjcf05n00 ansible-file[2372991]: Invoked with dest=/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh.latest _original_basename=panic_server_on_ZFS-513.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:21:32 kjcf05n01 ansible-ansible.builtin.command[3843180]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh.latest" "/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:32 kjcf05n00 ansible-ansible.builtin.command[2373075]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh.latest" "/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:34 kjcf05n01 ansible-ansible.builtin.command[3843224]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:34 kjcf05n00 ansible-ansible.builtin.command[2373164]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/ZFS-513/panic_server_on_ZFS-513.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:35 kjcf05n00 mcfcli[3673891]: %3|1730769695.924|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:21:38 kjcf05n01 ansible-stat[3843310]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:21:38 kjcf05n00 ansible-stat[2373335]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:21:38 kjcf05n01 ansible-file[3843353]: Invoked with dest=/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.latest _original_basename=XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:21:39 kjcf05n00 mcfcli[3673891]: %3|1730769699.465|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 19:21:39 kjcf05n00 ansible-file[2373380]: Invoked with dest=/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.latest _original_basename=XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:21:42 kjcf05n01 ansible-ansible.builtin.command[3843440]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.latest" "/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:42 kjcf05n00 ansible-ansible.builtin.command[2373465]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.latest" "/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:43 kjcf05n01 ansible-ansible.builtin.command[3843484]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:43 kjcf05n00 ansible-ansible.builtin.command[2373517]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/debug/LUS-8820_LUS-8991/XYMNTR_filesystem-test_LUS-8820_LUS-8991.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:51 kjcf05n01 ansible-stat[3843575]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:21:52 kjcf05n01 ansible-file[3843618]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours.latest _original_basename=lus-ho.sh_kill_and_panic_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:21:51 kjcf05n00 ansible-stat[2373666]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:21:53 kjcf05n00 ansible-file[2373712]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours.latest _original_basename=lus-ho.sh_kill_and_panic_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:21:55 kjcf05n01 ansible-ansible.builtin.command[3843698]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:55 kjcf05n00 ansible-ansible.builtin.command[2373796]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:57 kjcf05n01 ansible-ansible.builtin.command[3843742]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:21:57 kjcf05n00 ansible-ansible.builtin.command[2373841]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:00 kjcf05n01 ansible-stat[3843838]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:22:01 kjcf05n00 ansible-stat[2373938]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:22:01 kjcf05n01 ansible-file[3843885]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours.latest _original_basename=lus-ho.sh_cscli_only_oss_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:22:02 kjcf05n00 ansible-file[2373984]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours.latest _original_basename=lus-ho.sh_cscli_only_oss_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:22:04 kjcf05n01 ansible-ansible.builtin.command[3843969]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:04 kjcf05n00 ansible-ansible.builtin.command[2374072]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:06 kjcf05n01 ansible-ansible.builtin.command[3844017]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:06 kjcf05n00 ansible-ansible.builtin.command[2374128]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:09 kjcf05n01 ansible-stat[3844259]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/check_bitmaps_loop.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:22:09 kjcf05n00 mcfcli[3673891]: %3|1730769729.465|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 19:22:10 kjcf05n00 ansible-stat[2374346]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/check_bitmaps_loop.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:22:10 kjcf05n01 ansible-file[3844323]: Invoked with dest=/home/users/filesystem-test/bin/check_bitmaps_loop.sh.latest _original_basename=check_bitmaps_loop.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/check_bitmaps_loop.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:22:11 kjcf05n00 ansible-file[2374405]: Invoked with dest=/home/users/filesystem-test/bin/check_bitmaps_loop.sh.latest _original_basename=check_bitmaps_loop.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/check_bitmaps_loop.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:22:14 kjcf05n01 ansible-ansible.builtin.command[3844458]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/check_bitmaps_loop.sh.latest" "/home/users/filesystem-test/bin/check_bitmaps_loop.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:13 kjcf05n00 ansible-ansible.builtin.command[2374489]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/check_bitmaps_loop.sh.latest" "/home/users/filesystem-test/bin/check_bitmaps_loop.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:15 kjcf05n01 ansible-ansible.builtin.command[3844504]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/check_bitmaps_loop.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:15 kjcf05n00 ansible-ansible.builtin.command[2374533]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/check_bitmaps_loop.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:15 kjcf05n00 mcfcli[3673891]: %3|1730769735.921|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:22:19 kjcf05n01 ansible-stat[3844590]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/backup.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:22:19 kjcf05n00 ansible-stat[2374660]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/backup.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:22:20 kjcf05n01 ansible-file[3844637]: Invoked with dest=/home/users/filesystem-test/bin/backup.sh.latest _original_basename=backup.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/backup.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:22:20 kjcf05n00 ansible-file[2374703]: Invoked with dest=/home/users/filesystem-test/bin/backup.sh.latest _original_basename=backup.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/backup.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:22:23 kjcf05n01 ansible-ansible.builtin.command[3844722]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/backup.sh.latest" "/home/users/filesystem-test/bin/backup.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:23 kjcf05n00 ansible-ansible.builtin.command[2374880]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/backup.sh.latest" "/home/users/filesystem-test/bin/backup.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:24 kjcf05n01 ansible-ansible.builtin.command[3844811]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/backup.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:24 kjcf05n00 ansible-ansible.builtin.command[2374928]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/backup.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:28 kjcf05n01 ansible-stat[3845172]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:22:29 kjcf05n00 ansible-stat[2375094]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:22:29 kjcf05n01 ansible-file[3845231]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours.latest _original_basename=lus-ho.sh_panic_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:22:30 kjcf05n00 ansible-file[2375137]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours.latest _original_basename=lus-ho.sh_panic_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:22:32 kjcf05n01 ansible-ansible.builtin.command[3845317]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:32 kjcf05n00 ansible-ansible.builtin.command[2375224]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:34 kjcf05n01 ansible-ansible.builtin.command[3845362]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:34 kjcf05n00 ansible-ansible.builtin.command[2375268]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:38 kjcf05n01 ansible-stat[3845449]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:22:39 kjcf05n01 ansible-file[3845492]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours.latest _original_basename=lus-ho.sh_cscli_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:22:38 kjcf05n00 ansible-stat[2375360]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:22:39 kjcf05n00 mcfcli[3673891]: %3|1730769759.466|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 19:22:39 kjcf05n00 ansible-file[2375403]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours.latest _original_basename=lus-ho.sh_cscli_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:22:42 kjcf05n01 ansible-ansible.builtin.command[3845579]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:42 kjcf05n00 ansible-ansible.builtin.command[2375484]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:43 kjcf05n01 ansible-ansible.builtin.command[3845623]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:43 kjcf05n00 ansible-ansible.builtin.command[2375533]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:47 kjcf05n01 ansible-stat[3845709]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:22:48 kjcf05n00 ansible-stat[2375623]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:22:48 kjcf05n01 ansible-file[3845752]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours.latest _original_basename=lus-ho.sh_panic_only_oss_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:22:49 kjcf05n00 ansible-file[2375666]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours.latest _original_basename=lus-ho.sh_panic_only_oss_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:22:52 kjcf05n01 ansible-ansible.builtin.command[3845867]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:52 kjcf05n00 ansible-ansible.builtin.command[2375749]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:53 kjcf05n01 ansible-ansible.builtin.command[3845916]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:53 kjcf05n00 ansible-ansible.builtin.command[2375795]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:22:54 kjcf05n00 mcfcli[3673891]: %3|1730769774.434|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:22:57 kjcf05n01 ansible-stat[3846008]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:22:57 kjcf05n00 ansible-stat[2375971]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:22:58 kjcf05n01 ansible-file[3846057]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours.latest _original_basename=lus-ho.sh_handoff_and_kill_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:22:59 kjcf05n00 ansible-file[2376015]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours.latest _original_basename=lus-ho.sh_handoff_and_kill_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:23:01 kjcf05n01 ansible-ansible.builtin.command[3846142]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:01 kjcf05n00 ansible-ansible.builtin.command[2376106]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:03 kjcf05n01 ansible-ansible.builtin.command[3846187]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:03 kjcf05n00 ansible-ansible.builtin.command[2376154]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:06 kjcf05n01 ansible-stat[3846281]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:23:07 kjcf05n01 ansible-file[3846330]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours.latest _original_basename=lus-ho.sh_passive_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:23:07 kjcf05n00 ansible-stat[2376259]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:23:08 kjcf05n00 ansible-file[2376304]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours.latest _original_basename=lus-ho.sh_passive_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:23:09 kjcf05n00 mcfcli[3673891]: %3|1730769789.466|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 19:23:11 kjcf05n01 ansible-ansible.builtin.command[3846414]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:11 kjcf05n00 ansible-ansible.builtin.command[2376413]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:12 kjcf05n01 ansible-ansible.builtin.command[3846462]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:12 kjcf05n00 ansible-ansible.builtin.command[2376462]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:16 kjcf05n01 ansible-stat[3846550]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/e2fsck-helper.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T01:23:15.867517Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 19:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T01:23:15.867585Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.089ms Nov 4 19:23:16 kjcf05n00 ansible-stat[2376554]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/e2fsck-helper.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:23:17 kjcf05n01 ansible-file[3846593]: Invoked with dest=/home/users/filesystem-test/bin/e2fsck-helper.sh.latest _original_basename=e2fsck-helper.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/e2fsck-helper.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:23:17 kjcf05n00 ansible-file[2376601]: Invoked with dest=/home/users/filesystem-test/bin/e2fsck-helper.sh.latest _original_basename=e2fsck-helper.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/e2fsck-helper.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:23:20 kjcf05n01 ansible-ansible.builtin.command[3846728]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/e2fsck-helper.sh.latest" "/home/users/filesystem-test/bin/e2fsck-helper.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:20 kjcf05n00 ansible-ansible.builtin.command[2376803]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/e2fsck-helper.sh.latest" "/home/users/filesystem-test/bin/e2fsck-helper.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:21 kjcf05n01 ansible-ansible.builtin.command[3846825]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/e2fsck-helper.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:21 kjcf05n00 ansible-ansible.builtin.command[2376946]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/e2fsck-helper.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:25 kjcf05n01 ansible-stat[3846986]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:23:26 kjcf05n01 ansible-file[3847029]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull.latest _original_basename=lus-ho.sh_passive_cable_pull.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:23:25 kjcf05n00 ansible-stat[2377140]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:23:27 kjcf05n00 ansible-file[2377184]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull.latest _original_basename=lus-ho.sh_passive_cable_pull.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T19:23:27.253340701-06:00 level=info msg="Completed cleanup jobs" duration=26.482653ms Nov 4 19:23:29 kjcf05n01 ansible-ansible.builtin.command[3847109]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull.latest" "/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:29 kjcf05n00 ansible-ansible.builtin.command[2377287]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull.latest" "/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:31 kjcf05n01 ansible-ansible.builtin.command[3847157]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:31 kjcf05n00 ansible-ansible.builtin.command[2377331]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_cable_pull.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:33 kjcf05n02 nslcd[6957]: [e87ccd] ldap_result() failed: Can't contact LDAP server Nov 4 19:23:34 kjcf05n00 mcfcli[3673891]: %3|1730769814.262|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:23:34 kjcf05n01 ansible-stat[3847287]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:23:35 kjcf05n01 ansible-file[3847330]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours.latest _original_basename=lus-ho.sh_cscli_and_kill_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:23:35 kjcf05n00 ansible-stat[2377419]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:23:36 kjcf05n00 ansible-file[2377513]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours.latest _original_basename=lus-ho.sh_cscli_and_kill_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:23:38 kjcf05n01 ansible-ansible.builtin.command[3847410]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:38 kjcf05n00 ansible-ansible.builtin.command[2377593]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:39 kjcf05n00 mcfcli[3673891]: %3|1730769819.466|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 19:23:40 kjcf05n01 ansible-ansible.builtin.command[3847457]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:40 kjcf05n00 ansible-ansible.builtin.command[2377640]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:43 kjcf05n01 ansible-stat[3847547]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:23:44 kjcf05n00 ansible-stat[2377728]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:23:44 kjcf05n01 ansible-file[3847590]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours.latest _original_basename=lus-ho.sh_kill_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:23:45 kjcf05n00 ansible-file[2377773]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours.latest _original_basename=lus-ho.sh_kill_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:23:48 kjcf05n01 ansible-ansible.builtin.command[3847670]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:47 kjcf05n00 ansible-ansible.builtin.command[2377857]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:49 kjcf05n01 ansible-ansible.builtin.command[3847714]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:49 kjcf05n00 ansible-ansible.builtin.command[2377901]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:53 kjcf05n01 ansible-stat[3847805]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:23:53 kjcf05n00 ansible-stat[2377989]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:23:53 kjcf05n01 ansible-file[3847848]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours.latest _original_basename=lus-ho.sh_kill_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:23:54 kjcf05n00 ansible-file[2378034]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours.latest _original_basename=lus-ho.sh_kill_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:23:57 kjcf05n01 ansible-ansible.builtin.command[3847928]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:57 kjcf05n00 ansible-ansible.builtin.command[2378119]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:58 kjcf05n01 ansible-ansible.builtin.command[3847981]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:23:58 kjcf05n00 ansible-ansible.builtin.command[2378164]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:02 kjcf05n01 ansible-stat[3848072]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:24:03 kjcf05n01 ansible-file[3848116]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours.latest _original_basename=lus-ho.sh_cscli_and_kill_and_panic_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:24:02 kjcf05n00 ansible-stat[2378261]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:24:03 kjcf05n00 ansible-file[2378307]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours.latest _original_basename=lus-ho.sh_cscli_and_kill_and_panic_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:24:06 kjcf05n01 ansible-ansible.builtin.command[3848203]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:06 kjcf05n00 ansible-ansible.builtin.command[2378397]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:07 kjcf05n01 ansible-ansible.builtin.command[3848253]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:07 kjcf05n00 ansible-ansible.builtin.command[2378451]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:09 kjcf05n00 mcfcli[3673891]: %3|1730769849.599|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:24:09 kjcf05n00 mcfcli[3673891]: %3|1730769849.599|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:24:11 kjcf05n01 ansible-stat[3848347]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:24:11 kjcf05n00 ansible-stat[2378540]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:24:12 kjcf05n01 ansible-file[3848390]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours.latest _original_basename=lus-ho.sh_cscli_only_oss_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:24:12 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 19:24:12 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 7 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007787 sec, idle for 1 hour(s)] Nov 4 19:24:12 kjcf05n00 ansible-file[2378660]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours.latest _original_basename=lus-ho.sh_cscli_only_oss_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:24:15 kjcf05n01 ansible-ansible.builtin.command[3848567]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:15 kjcf05n00 ansible-ansible.builtin.command[2378741]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:16 kjcf05n01 ansible-ansible.builtin.command[3848611]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:16 kjcf05n00 ansible-ansible.builtin.command[2378789]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_oss_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:20 kjcf05n01 ansible-stat[3848731]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:24:21 kjcf05n01 ansible-file[3848806]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours.latest _original_basename=lus-ho.sh_panic_only_mds_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:24:20 kjcf05n00 ansible-stat[2378887]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:24:22 kjcf05n00 ansible-file[2378932]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours.latest _original_basename=lus-ho.sh_panic_only_mds_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:24:24 kjcf05n01 ansible-ansible.builtin.command[3848945]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:24 kjcf05n00 ansible-ansible.builtin.command[2379107]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:26 kjcf05n01 ansible-ansible.builtin.command[3848989]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:26 kjcf05n00 ansible-ansible.builtin.command[2379153]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:29 kjcf05n01 ansible-stat[3849116]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:24:30 kjcf05n01 ansible-file[3849195]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours.latest _original_basename=lus-ho.sh_cscli_and_panic_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:24:30 kjcf05n00 ansible-stat[2379363]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:24:31 kjcf05n00 ansible-file[2379427]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours.latest _original_basename=lus-ho.sh_cscli_and_panic_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:24:33 kjcf05n01 ansible-ansible.builtin.command[3849306]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:33 kjcf05n00 ansible-ansible.builtin.command[2379516]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:35 kjcf05n01 ansible-ansible.builtin.command[3849350]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:35 kjcf05n00 ansible-ansible.builtin.command[2379560]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:38 kjcf05n01 ansible-stat[3849436]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:24:39 kjcf05n00 ansible-stat[2379713]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:24:39 kjcf05n01 ansible-file[3849524]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours.latest _original_basename=lus-ho.sh_panic_only_oss_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:24:39 kjcf05n00 mcfcli[3673891]: %3|1730769879.966|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:24:40 kjcf05n00 ansible-file[2379756]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours.latest _original_basename=lus-ho.sh_panic_only_oss_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:24:43 kjcf05n01 ansible-ansible.builtin.command[3849609]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:43 kjcf05n00 ansible-ansible.builtin.command[2379854]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:44 kjcf05n01 ansible-ansible.builtin.command[3849653]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:44 kjcf05n00 ansible-ansible.builtin.command[2379898]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_oss_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:45 kjcf05n00 mcfcli[3673891]: %3|1730769885.464|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:24:47 kjcf05n01 ansible-stat[3849739]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lfsck-helper.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:24:48 kjcf05n00 ansible-stat[2379991]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lfsck-helper.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:24:48 kjcf05n01 ansible-file[3849782]: Invoked with dest=/home/users/filesystem-test/bin/lfsck-helper.sh.latest _original_basename=lfsck-helper.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lfsck-helper.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:24:49 kjcf05n00 ansible-file[2380053]: Invoked with dest=/home/users/filesystem-test/bin/lfsck-helper.sh.latest _original_basename=lfsck-helper.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lfsck-helper.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:24:52 kjcf05n01 ansible-ansible.builtin.command[3849866]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lfsck-helper.sh.latest" "/home/users/filesystem-test/bin/lfsck-helper.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:52 kjcf05n00 ansible-ansible.builtin.command[2380145]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lfsck-helper.sh.latest" "/home/users/filesystem-test/bin/lfsck-helper.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:53 kjcf05n01 ansible-ansible.builtin.command[3849910]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lfsck-helper.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:53 kjcf05n00 ansible-ansible.builtin.command[2380192]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lfsck-helper.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:24:57 kjcf05n01 ansible-stat[3849996]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:24:57 kjcf05n01 ansible-file[3850045]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours.latest _original_basename=lus-ho.sh_cscli_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:24:57 kjcf05n00 ansible-stat[2380370]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:24:58 kjcf05n00 ansible-file[2380414]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours.latest _original_basename=lus-ho.sh_cscli_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:25:01 kjcf05n01 ansible-ansible.builtin.command[3850129]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:01 kjcf05n00 ansible-ansible.builtin.command[2380503]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:02 kjcf05n01 ansible-ansible.builtin.command[3850179]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:02 kjcf05n00 ansible-ansible.builtin.command[2380549]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:06 kjcf05n01 ansible-stat[3850272]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:25:06 kjcf05n01 ansible-file[3850316]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours.latest _original_basename=lus-ho.sh_panic_only_mdt1_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:25:06 kjcf05n00 ansible-stat[2380721]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:25:07 kjcf05n00 ansible-file[2380771]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours.latest _original_basename=lus-ho.sh_panic_only_mdt1_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:25:10 kjcf05n00 mcfcli[3673891]: %3|1730769910.045|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:25:10 kjcf05n01 ansible-ansible.builtin.command[3850405]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:10 kjcf05n00 ansible-ansible.builtin.command[2380854]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:11 kjcf05n01 ansible-ansible.builtin.command[3850454]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:11 kjcf05n00 ansible-ansible.builtin.command[2380898]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:15 kjcf05n01 ansible-stat[3850598]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:25:15 kjcf05n00 ansible-stat[2380989]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:25:16 kjcf05n01 ansible-file[3850657]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours.latest _original_basename=lus-ho.sh_panic_only_mdt1_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:25:17 kjcf05n00 ansible-file[2381036]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours.latest _original_basename=lus-ho.sh_panic_only_mdt1_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:25:19 kjcf05n01 ansible-ansible.builtin.command[3850737]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:19 kjcf05n00 ansible-ansible.builtin.command[2381128]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:20 kjcf05n01 ansible-ansible.builtin.command[3850785]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:20 kjcf05n00 ansible-ansible.builtin.command[2381172]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mdt1_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:22 kjcf05n00 zabbix_server[15755]: Zabbix agent item "vfs.fs.size[/var/lib/reboot_cnt,total]" on host "kjcf05n03" failed: first network error, wait for 15 seconds Nov 4 19:25:22 kjcf05n00 mcfcli[3673891]: %3|1730769922.604|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:25:24 kjcf05n01 ansible-stat[3850878]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:25:24 kjcf05n00 ansible-stat[2381412]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:25:25 kjcf05n01 ansible-file[3850921]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours.latest _original_basename=lus-ho.sh_cscli_and_kill_and_panic_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:25:26 kjcf05n00 ansible-file[2381459]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours.latest _original_basename=lus-ho.sh_cscli_and_kill_and_panic_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:25:28 kjcf05n02 fstonithd.py[15145]: My partner 172.16.2.6 is kdumping. Forcing HA into GATHER state. Nov 4 19:25:28 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 19:25:28 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 19:25:28 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 19:25:28 kjcf05n01 ansible-ansible.builtin.command[3851001]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:28 kjcf05n00 ansible-ansible.builtin.command[2381588]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:30 kjcf05n01 ansible-ansible.builtin.command[3851052]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:30 kjcf05n00 ansible-ansible.builtin.command[2381641]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_and_panic_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:30 kjcf05n02 root[126564]: is_viking_off starts Nov 4 19:25:30 kjcf05n02 root[126563]: is_enc_ipmi_off starts Nov 4 19:25:30 kjcf05n02 root[126583]: I am master Nov 4 19:25:30 kjcf05n02 root[126594]: I am in slot 0; partner is in slot 1 Nov 4 19:25:30 kjcf05n02 root[126689]: is_lan_ipmi_sec_off leaves Nov 4 19:25:30 kjcf05n02 root[126691]: is_lan_ipmi_off leaves Nov 4 19:25:33 kjcf05n01 ansible-stat[3851186]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:25:34 kjcf05n01 ansible-file[3851229]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours.latest _original_basename=lus-ho.sh_panic_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:25:33 kjcf05n00 ansible-stat[2381731]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:25:35 kjcf05n00 ansible-file[2381774]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours.latest _original_basename=lus-ho.sh_panic_only_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:25:36 kjcf05n00 python3.9[2381593]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 19:25:37 kjcf05n01 ansible-ansible.builtin.command[3851309]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:37 kjcf05n00 zabbix_server[15722]: Zabbix agent item "system.cpu.util[,iowait]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 19:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 19:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 19:25:37 kjcf05n00 ansible-ansible.builtin.command[2382098]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 19:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 19:25:38 kjcf05n00 zabbix_server[15765]: Zabbix agent item "system.cpu.util[,nice]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 19:25:39 kjcf05n01 ansible-ansible.builtin.command[3851390]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:39 kjcf05n00 ansible-ansible.builtin.command[2382279]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:39 kjcf05n00 zabbix_server[15738]: Zabbix agent item "system.cpu.util[,softirq]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 19:25:39 kjcf05n02 root[127200]: is_viking_off leaves Nov 4 19:25:39 kjcf05n02 root[127205]: kjcf05n03 not already off look at kdump Nov 4 19:25:39 kjcf05n02 root[127206]: is_kdump_off starts Nov 4 19:25:39 kjcf05n02 fence_kdump[127207]: waiting for message from '172.16.2.6' Nov 4 19:25:40 kjcf05n02 fence_kdump[127207]: received valid message from '172.16.2.6' Nov 4 19:25:40 kjcf05n02 root[127223]: is_kdump_off detected kdump on kjcf05n03 Nov 4 19:25:40 kjcf05n02 root[127224]: kjcf05n03 is kdumping Nov 4 19:25:40 kjcf05n00 mcfcli[3673891]: %3|1730769940.045|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:25:40 kjcf05n00 zabbix_server[15777]: Zabbix agent item "system.cpu.util[,steal]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 19:25:40 kjcf05n02 root[127328]: is_viking_off starts Nov 4 19:25:40 kjcf05n02 root[127327]: is_enc_ipmi_off starts Nov 4 19:25:40 kjcf05n02 root[127344]: is_lan_ipmi_off leaves Nov 4 19:25:40 kjcf05n02 root[127346]: is_lan_ipmi_sec_off leaves Nov 4 19:25:40 kjcf05n02 root[127349]: I am master Nov 4 19:25:40 kjcf05n02 root[127352]: I am in slot 0; partner is in slot 1 Nov 4 19:25:41 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='15', error='Connection reset by peer (104)' Nov 4 19:25:41 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='15', client='AF_INET(172.16.2.6:36285)', local='AF_INET(0.0.0.0:601)' Nov 4 19:25:41 kjcf05n00 zabbix_server[15766]: Zabbix agent item "system.cpu.util[,system]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 19:25:42 kjcf05n01 ansible-stat[3851545]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:25:43 kjcf05n01 ansible-file[3851588]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours.latest _original_basename=lus-ho.sh_passive_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:25:43 kjcf05n00 ansible-stat[2382469]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:25:44 kjcf05n00 ansible-file[2382512]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours.latest _original_basename=lus-ho.sh_passive_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:25:46 kjcf05n01 ansible-ansible.builtin.command[3851668]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:46 kjcf05n00 ansible-ansible.builtin.command[2382598]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:47 kjcf05n02 root[127486]: is_viking_off leaves Nov 4 19:25:47 kjcf05n02 root[127489]: kjcf05n03 not already off look at kdump Nov 4 19:25:47 kjcf05n02 root[127490]: is_kdump_off starts Nov 4 19:25:47 kjcf05n02 fence_kdump[127491]: waiting for message from '172.16.2.6' Nov 4 19:25:47 kjcf05n02 fence_kdump[127491]: received valid message from '172.16.2.6' Nov 4 19:25:47 kjcf05n02 root[127506]: is_kdump_off detected kdump on kjcf05n03 Nov 4 19:25:47 kjcf05n02 root[127507]: kjcf05n03 is kdumping Nov 4 19:25:47 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 19:25:47 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 19:25:48 kjcf05n01 ansible-ansible.builtin.command[3851712]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:47 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 4 19:25:47 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 4 19:25:48 kjcf05n00 ansible-ansible.builtin.command[2382642]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_passive_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:51 kjcf05n01 ansible-stat[3851798]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:25:52 kjcf05n02 dwd[5196]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 4 19:25:52 kjcf05n02 dwd[5196]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 4 19:25:52 kjcf05n02 dwd[5196]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 4 19:25:52 kjcf05n02 dwd[5196]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 4 19:25:52 kjcf05n02 dwd[5196]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 4 19:25:52 kjcf05n02 dwd[5196]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 4 19:25:52 kjcf05n02 dwd[5196]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 4 19:25:52 kjcf05n02 dwd[5196]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 4 19:25:52 kjcf05n02 dwd[5196]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 4 19:25:52 kjcf05n02 dwd[5196]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 4 19:25:52 kjcf05n02 dwd[5196]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129828]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129832]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129833]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129828]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129832]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129833]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129828]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129832]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129833]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129828]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129832]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129833]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129828]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129832]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129833]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129828]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129832]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129833]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129828]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129832]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129833]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129828]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129832]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129833]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129828]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129881]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129832]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129828]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129881]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129832]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129833]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129881]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129833]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129833]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129833]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129833]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129833]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129833]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129833]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129833]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129829]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129833]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 systemd-udevd[129833]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:25:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 19:25:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 19:25:52 kjcf05n02 dwd[5196]: Starting NVME thread for nvme6n1 Nov 4 19:25:52 kjcf05n00 ansible-stat[2382752]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:25:52 kjcf05n02 dwd[5196]: Starting NVME thread for nvme15n1 Nov 4 19:25:52 kjcf05n02 dwd[5196]: Starting NVME thread for nvme16n1 Nov 4 19:25:52 kjcf05n02 dwd[5196]: Starting NVME thread for nvme5n1 Nov 4 19:25:52 kjcf05n01 ansible-file[3851845]: Invoked with dest=/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.latest _original_basename=restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:25:52 kjcf05n02 dwd[5196]: Starting NVME thread for nvme20n1 Nov 4 19:25:53 kjcf05n02 dwd[5196]: Starting NVME thread for nvme11n1 Nov 4 19:25:53 kjcf05n02 dwd[5196]: Starting NVME thread for nvme22n1 Nov 4 19:25:53 kjcf05n00 ansible-file[2382797]: Invoked with dest=/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.latest _original_basename=restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:25:53 kjcf05n02 dwd[5196]: Starting NVME thread for nvme21n1 Nov 4 19:25:53 kjcf05n02 dwd[5196]: Starting NVME thread for nvme12n1 Nov 4 19:25:53 kjcf05n02 dwd[5196]: Starting NVME thread for nvme10n1 Nov 4 19:25:53 kjcf05n02 dwd[5196]: Starting NVME thread for nvme7n1 Nov 4 19:25:55 kjcf05n01 ansible-ansible.builtin.command[3851925]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.latest" "/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 19:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 19:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 19:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 19:25:55 kjcf05n00 ansible-ansible.builtin.command[2382884]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.latest" "/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:56 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vfs.fs.inode[/var/lib/mdraidscripts,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 19:25:57 kjcf05n01 ansible-ansible.builtin.command[3851975]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:57 kjcf05n00 ansible-ansible.builtin.command[2382933]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/restart_lustre_and_wait_for_bitmap_loads_with_iostat.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:25:58 kjcf05n02 diskmonitor[17558]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 4 19:26:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 19:26:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 19:26:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 19:26:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 19:26:01 kjcf05n01 ansible-stat[3852065]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:26:01 kjcf05n01 ansible-file[3852108]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours.latest _original_basename=lus-ho.sh_cscli_and_panic_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:26:01 kjcf05n00 ansible-stat[2383030]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:26:02 kjcf05n00 mcfcli[3673891]: %3|1730769962.455|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:26:02 kjcf05n00 ansible-file[2383076]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours.latest _original_basename=lus-ho.sh_cscli_and_panic_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:26:05 kjcf05n01 ansible-ansible.builtin.command[3852197]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:05 kjcf05n00 ansible-ansible.builtin.command[2383162]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:06 kjcf05n02 diskmonitor[17558]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 4 19:26:06 kjcf05n02 diskmonitor[17558]: Scan for ReadErrorMax change for md66 Nov 4 19:26:06 kjcf05n02 diskmonitor[17558]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 4 19:26:06 kjcf05n02 diskmonitor[17558]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 4 19:26:06 kjcf05n02 diskmonitor[17558]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.min.76c05c063fa0949b68ee86c1978c2ca8 file Nov 4 19:26:06 kjcf05n02 diskmonitor[17558]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.max.76c05c063fa0949b68ee86c1978c2ca8 file Nov 4 19:26:06 kjcf05n02 diskmonitor[17558]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 4 19:26:06 kjcf05n02 diskmonitor[17558]: Set sync_speed_min (10000) for md66 Nov 4 19:26:06 kjcf05n02 diskmonitor[17558]: Set sync_speed_max (200000) for md66 Nov 4 19:26:06 kjcf05n02 diskmonitor[17558]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 19:26:06 kjcf05n01 ansible-ansible.builtin.command[3852246]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:06 kjcf05n00 ansible-ansible.builtin.command[2383209]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_panic_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:10 kjcf05n01 ansible-stat[3852344]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:26:10 kjcf05n00 mcfcli[3673891]: %3|1730769970.046|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 19:26:10 kjcf05n01 ansible-file[3852389]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours.latest _original_basename=lus-ho.sh_panic_only_mds_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:26:10 kjcf05n00 ansible-stat[2383314]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:26:11 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n03": interface unavailable Nov 4 19:26:11 kjcf05n00 ansible-file[2383359]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours.latest _original_basename=lus-ho.sh_panic_only_mds_only_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:26:14 kjcf05n01 ansible-ansible.builtin.command[3852587]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:14 kjcf05n00 ansible-ansible.builtin.command[2383441]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:15 kjcf05n01 ansible-ansible.builtin.command[3852633]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:15 kjcf05n00 ansible-ansible.builtin.command[2383485]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_panic_only_mds_only_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:19 kjcf05n01 ansible-stat[3852719]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:26:19 kjcf05n00 ansible-stat[2383587]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:26:20 kjcf05n01 ansible-file[3852766]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours.latest _original_basename=lus-ho.sh_cscli_and_kill_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:26:20 kjcf05n00 ansible-file[2383630]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours.latest _original_basename=lus-ho.sh_cscli_and_kill_24hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:26:23 kjcf05n01 ansible-ansible.builtin.command[3852850]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:23 kjcf05n00 ansible-ansible.builtin.command[2383714]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:24 kjcf05n01 ansible-ansible.builtin.command[3852939]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:24 kjcf05n00 ansible-ansible.builtin.command[2383851]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_cscli_and_kill_24hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:28 kjcf05n01 ansible-stat[3853025]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/zpool-scrub-helper.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:26:28 kjcf05n00 ansible-stat[2383949]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/zpool-scrub-helper.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:26:29 kjcf05n01 ansible-file[3853068]: Invoked with dest=/home/users/filesystem-test/bin/zpool-scrub-helper.sh.latest _original_basename=zpool-scrub-helper.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/zpool-scrub-helper.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:26:29 kjcf05n00 ansible-file[2383996]: Invoked with dest=/home/users/filesystem-test/bin/zpool-scrub-helper.sh.latest _original_basename=zpool-scrub-helper.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/zpool-scrub-helper.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:26:32 kjcf05n01 ansible-ansible.builtin.command[3853153]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/zpool-scrub-helper.sh.latest" "/home/users/filesystem-test/bin/zpool-scrub-helper.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:32 kjcf05n00 ansible-ansible.builtin.command[2384082]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/zpool-scrub-helper.sh.latest" "/home/users/filesystem-test/bin/zpool-scrub-helper.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:33 kjcf05n01 ansible-ansible.builtin.command[3853197]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/zpool-scrub-helper.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:33 kjcf05n00 ansible-ansible.builtin.command[2384130]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/zpool-scrub-helper.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:37 kjcf05n01 ansible-stat[3853283]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 19:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 19:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 19:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 19:26:37 kjcf05n00 ansible-stat[2384294]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:26:38 kjcf05n01 ansible-file[3853326]: Invoked with dest=/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh.latest _original_basename=cs_control_lustre_nxd.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:26:39 kjcf05n00 ansible-file[2384337]: Invoked with dest=/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh.latest _original_basename=cs_control_lustre_nxd.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:26:40 kjcf05n00 mcfcli[3673891]: %3|1730770000.046|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 19:26:41 kjcf05n01 ansible-ansible.builtin.command[3853410]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh.latest" "/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:41 kjcf05n00 ansible-ansible.builtin.command[2384417]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh.latest" "/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:41 kjcf05n00 mcfcli[3673891]: %3|1730770001.760|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:26:43 kjcf05n01 ansible-ansible.builtin.command[3853458]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:42 kjcf05n00 ansible-ansible.builtin.command[2384468]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/cs_control_lustre_nxd.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:46 kjcf05n01 ansible-stat[3853544]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:26:47 kjcf05n01 ansible-file[3853587]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours.latest _original_basename=lus-ho.sh_handoff_and_kill_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:26:46 kjcf05n00 ansible-stat[2384564]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:26:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 19:26:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 19:26:48 kjcf05n00 ansible-file[2384607]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours.latest _original_basename=lus-ho.sh_handoff_and_kill_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:26:50 kjcf05n01 ansible-ansible.builtin.command[3853718]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:50 kjcf05n00 ansible-ansible.builtin.command[2384775]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:52 kjcf05n01 ansible-ansible.builtin.command[3853810]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 19:26:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 19:26:52 kjcf05n00 ansible-ansible.builtin.command[2384870]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_handoff_and_kill_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:26:55 kjcf05n01 ansible-stat[3853901]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 19:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 19:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 19:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 19:26:56 kjcf05n00 ansible-stat[2384961]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:26:56 kjcf05n01 ansible-file[3853944]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours.latest _original_basename=lus-ho.sh_kill_and_panic_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:26:57 kjcf05n00 ansible-file[2385094]: Invoked with dest=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours.latest _original_basename=lus-ho.sh_kill_and_panic_48hours.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:26:59 kjcf05n02 nslcd[6957]: [b141f2] ldap_result() failed: Can't contact LDAP server Nov 4 19:26:59 kjcf05n01 ansible-ansible.builtin.command[3854033]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 19:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 19:27:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 19:27:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 19:26:59 kjcf05n00 ansible-ansible.builtin.command[2385201]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours.latest" "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:27:01 kjcf05n01 ansible-ansible.builtin.command[3854078]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:27:01 kjcf05n00 ansible-ansible.builtin.command[2385254]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lus-ho.sh_kill_and_panic_48hours.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:27:10 kjcf05n00 mcfcli[3673891]: %3|1730770030.467|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 19:27:19 kjcf05n00 mcfcli[3673891]: %3|1730770039.720|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:27:32 kjcf05n01 ansible-stat[3854690]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lfsck_errors.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:27:32 kjcf05n00 ansible-stat[2385599]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lfsck_errors.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:27:33 kjcf05n01 ansible-file[3854737]: Invoked with dest=/home/users/filesystem-test/bin/lfsck_errors.sh.latest recurse=False _original_basename=lfsck_errors.sh state=file path=/home/users/filesystem-test/bin/lfsck_errors.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:27:33 kjcf05n00 ansible-file[2385648]: Invoked with dest=/home/users/filesystem-test/bin/lfsck_errors.sh.latest recurse=False _original_basename=lfsck_errors.sh state=file path=/home/users/filesystem-test/bin/lfsck_errors.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:27:36 kjcf05n01 ansible-ansible.builtin.command[3854820]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lfsck_errors.sh.latest" "/home/users/filesystem-test/bin/lfsck_errors.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:27:36 kjcf05n00 ansible-ansible.builtin.command[2385779]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lfsck_errors.sh.latest" "/home/users/filesystem-test/bin/lfsck_errors.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 19:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 19:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 19:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 19:27:37 kjcf05n01 ansible-ansible.builtin.command[3854864]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lfsck_errors.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:27:37 kjcf05n00 ansible-ansible.builtin.command[2385832]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lfsck_errors.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:27:40 kjcf05n00 mcfcli[3673891]: %3|1730770060.467|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:27:41 kjcf05n01 ansible-stat[3854953]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:27:41 kjcf05n01 ansible-file[3854996]: Invoked with dest=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh.latest recurse=False _original_basename=lustre_benchmark_params_setup_snx11281.sh state=file path=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:27:41 kjcf05n00 ansible-stat[2385978]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:27:42 kjcf05n00 ansible-file[2386025]: Invoked with dest=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh.latest recurse=False _original_basename=lustre_benchmark_params_setup_snx11281.sh state=file path=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:27:45 kjcf05n01 ansible-ansible.builtin.command[3855081]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh.latest" "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:27:45 kjcf05n00 ansible-ansible.builtin.command[2386116]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh.latest" "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:27:46 kjcf05n01 ansible-ansible.builtin.command[3855133]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:27:46 kjcf05n00 ansible-ansible.builtin.command[2386164]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_snx11281.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:27:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 19:27:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 19:27:50 kjcf05n01 ansible-stat[3855262]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_failover.pl.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:27:50 kjcf05n00 ansible-stat[2386254]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_failover.pl.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:27:51 kjcf05n01 ansible-file[3855305]: Invoked with dest=/home/users/filesystem-test/bin/lustre_failover.pl.latest recurse=False _original_basename=lustre_failover.pl state=file path=/home/users/filesystem-test/bin/lustre_failover.pl.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:27:51 kjcf05n00 ansible-file[2386299]: Invoked with dest=/home/users/filesystem-test/bin/lustre_failover.pl.latest recurse=False _original_basename=lustre_failover.pl state=file path=/home/users/filesystem-test/bin/lustre_failover.pl.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:27:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 19:27:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 19:27:54 kjcf05n01 ansible-ansible.builtin.command[3855391]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_failover.pl.latest" "/home/users/filesystem-test/bin/lustre_failover.pl" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:27:54 kjcf05n00 ansible-ansible.builtin.command[2386387]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_failover.pl.latest" "/home/users/filesystem-test/bin/lustre_failover.pl" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 19:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 19:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 19:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 19:27:56 kjcf05n01 ansible-ansible.builtin.command[3855435]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_failover.pl.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:27:56 kjcf05n00 ansible-ansible.builtin.command[2386433]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_failover.pl.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:27:59 kjcf05n01 ansible-stat[3855547]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:28:00 kjcf05n01 ansible-file[3855614]: Invoked with dest=/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh.latest recurse=False _original_basename=obdfilter-survey_kjcf09.sh state=file path=/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:28:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 19:28:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 19:28:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 19:28:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 19:27:59 kjcf05n00 mcfcli[3673891]: %3|1730770079.717|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:27:59 kjcf05n00 ansible-stat[2386592]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:28:00 kjcf05n00 ansible-file[2386700]: Invoked with dest=/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh.latest recurse=False _original_basename=obdfilter-survey_kjcf09.sh state=file path=/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:28:03 kjcf05n01 ansible-ansible.builtin.command[3855763]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh.latest" "/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:03 kjcf05n00 ansible-ansible.builtin.command[2386818]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh.latest" "/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:05 kjcf05n01 ansible-ansible.builtin.command[3855808]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:05 kjcf05n00 ansible-ansible.builtin.command[2386867]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/obdfilter-survey_kjcf09.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:08 kjcf05n01 ansible-stat[3855906]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:28:08 kjcf05n00 ansible-stat[2386972]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:28:09 kjcf05n01 ansible-file[3855949]: Invoked with dest=/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh.latest recurse=False _original_basename=lustre_benchmark_params_check.sh state=file path=/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:28:10 kjcf05n00 ansible-file[2387030]: Invoked with dest=/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh.latest recurse=False _original_basename=lustre_benchmark_params_check.sh state=file path=/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:28:10 kjcf05n00 mcfcli[3673891]: %3|1730770090.467|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:28:12 kjcf05n01 ansible-ansible.builtin.command[3856080]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh.latest" "/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:12 kjcf05n00 ansible-ansible.builtin.command[2387116]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh.latest" "/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:14 kjcf05n01 ansible-ansible.builtin.command[3856124]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:14 kjcf05n00 ansible-ansible.builtin.command[2387162]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_check.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:17 kjcf05n01 ansible-stat[3856212]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/error_check_server_evictions.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:28:18 kjcf05n01 ansible-file[3856255]: Invoked with dest=/home/users/filesystem-test/bin/error_check_server_evictions.sh.latest recurse=False _original_basename=error_check_server_evictions.sh state=file path=/home/users/filesystem-test/bin/error_check_server_evictions.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:28:17 kjcf05n00 ansible-stat[2387256]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/error_check_server_evictions.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:28:19 kjcf05n00 ansible-file[2387299]: Invoked with dest=/home/users/filesystem-test/bin/error_check_server_evictions.sh.latest recurse=False _original_basename=error_check_server_evictions.sh state=file path=/home/users/filesystem-test/bin/error_check_server_evictions.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:28:21 kjcf05n01 ansible-ansible.builtin.command[3856339]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/error_check_server_evictions.sh.latest" "/home/users/filesystem-test/bin/error_check_server_evictions.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:21 kjcf05n00 ansible-ansible.builtin.command[2387393]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/error_check_server_evictions.sh.latest" "/home/users/filesystem-test/bin/error_check_server_evictions.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:23 kjcf05n01 ansible-ansible.builtin.command[3856387]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/error_check_server_evictions.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:23 kjcf05n00 ansible-ansible.builtin.command[2387439]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/error_check_server_evictions.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:26 kjcf05n01 ansible-stat[3856518]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:28:27 kjcf05n01 ansible-file[3856561]: Invoked with dest=/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh.latest recurse=False _original_basename=obdfilter-survey_kjcf04.sh state=file path=/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:28:26 kjcf05n00 ansible-stat[2387692]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:28:28 kjcf05n00 ansible-file[2387740]: Invoked with dest=/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh.latest recurse=False _original_basename=obdfilter-survey_kjcf04.sh state=file path=/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:28:31 kjcf05n01 ansible-ansible.builtin.command[3856714]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh.latest" "/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:30 kjcf05n00 ansible-ansible.builtin.command[2387820]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh.latest" "/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:32 kjcf05n01 ansible-ansible.builtin.command[3856758]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:32 kjcf05n00 ansible-ansible.builtin.command[2387885]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/obdfilter-survey_kjcf04.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:33 kjcf05n00 zabbix-server[2387901]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 19:28:33 kjcf05n00 zabbix-server[2387901]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n03:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 4 19:28:33 kjcf05n00 log_interesting_event.py[2387901]: Event '46593' acknowledged Nov 4 19:28:35 kjcf05n01 ansible-stat[3856848]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/cs_system_check.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:28:35 kjcf05n00 ansible-stat[2387990]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/cs_system_check.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:28:36 kjcf05n01 ansible-file[3856891]: Invoked with dest=/home/users/filesystem-test/bin/cs_system_check.sh.latest recurse=False _original_basename=cs_system_check.sh state=file path=/home/users/filesystem-test/bin/cs_system_check.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:28:37 kjcf05n00 ansible-file[2388035]: Invoked with dest=/home/users/filesystem-test/bin/cs_system_check.sh.latest recurse=False _original_basename=cs_system_check.sh state=file path=/home/users/filesystem-test/bin/cs_system_check.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 19:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 19:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 19:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 19:28:39 kjcf05n00 mcfcli[3673891]: %3|1730770119.714|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:28:39 kjcf05n01 ansible-ansible.builtin.command[3856974]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/cs_system_check.sh.latest" "/home/users/filesystem-test/bin/cs_system_check.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:39 kjcf05n00 ansible-ansible.builtin.command[2388120]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/cs_system_check.sh.latest" "/home/users/filesystem-test/bin/cs_system_check.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:40 kjcf05n00 mcfcli[3673891]: %3|1730770120.468|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:28:41 kjcf05n01 ansible-ansible.builtin.command[3857018]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/cs_system_check.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:41 kjcf05n00 ansible-ansible.builtin.command[2388164]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/cs_system_check.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:45 kjcf05n01 ansible-stat[3857109]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:28:45 kjcf05n00 ansible-stat[2388253]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:28:45 kjcf05n01 ansible-file[3857152]: Invoked with dest=/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py.latest recurse=False _original_basename=calculate_avg_recovery_duration.py state=file path=/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:28:46 kjcf05n00 ansible-file[2388296]: Invoked with dest=/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py.latest recurse=False _original_basename=calculate_avg_recovery_duration.py state=file path=/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:28:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 19:28:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 19:28:49 kjcf05n01 ansible-ansible.builtin.command[3857234]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py.latest" "/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:49 kjcf05n00 ansible-ansible.builtin.command[2388383]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py.latest" "/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:50 kjcf05n01 ansible-ansible.builtin.command[3857278]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:50 kjcf05n00 ansible-ansible.builtin.command[2388427]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/calculate_avg_recovery_duration.py.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 19:28:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 19:28:54 kjcf05n01 ansible-stat[3857369]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/find-unknown-stack-traces.py.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:28:54 kjcf05n00 ansible-stat[2388515]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/find-unknown-stack-traces.py.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:28:54 kjcf05n01 ansible-file[3857412]: Invoked with dest=/home/users/filesystem-test/bin/find-unknown-stack-traces.py.latest recurse=False _original_basename=find-unknown-stack-traces.py state=file path=/home/users/filesystem-test/bin/find-unknown-stack-traces.py.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:28:55 kjcf05n00 ansible-file[2388587]: Invoked with dest=/home/users/filesystem-test/bin/find-unknown-stack-traces.py.latest recurse=False _original_basename=find-unknown-stack-traces.py state=file path=/home/users/filesystem-test/bin/find-unknown-stack-traces.py.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 19:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 19:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 19:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 19:28:58 kjcf05n01 ansible-ansible.builtin.command[3857501]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/find-unknown-stack-traces.py.latest" "/home/users/filesystem-test/bin/find-unknown-stack-traces.py" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:58 kjcf05n00 ansible-ansible.builtin.command[2388786]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/find-unknown-stack-traces.py.latest" "/home/users/filesystem-test/bin/find-unknown-stack-traces.py" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:28:59 kjcf05n01 ansible-ansible.builtin.command[3857545]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/find-unknown-stack-traces.py.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 19:29:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 19:29:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 19:29:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 19:28:59 kjcf05n00 ansible-ansible.builtin.command[2388832]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/find-unknown-stack-traces.py.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:03 kjcf05n01 ansible-stat[3857637]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:29:03 kjcf05n00 ansible-stat[2388931]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:29:04 kjcf05n01 ansible-file[3857682]: Invoked with dest=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh.latest recurse=False _original_basename=lustre_benchmark_params_setup_E1000_kjcf05.sh state=file path=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:29:04 kjcf05n00 ansible-file[2388976]: Invoked with dest=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh.latest recurse=False _original_basename=lustre_benchmark_params_setup_E1000_kjcf05.sh state=file path=/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:29:07 kjcf05n01 ansible-ansible.builtin.command[3857774]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh.latest" "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:07 kjcf05n00 ansible-ansible.builtin.command[2389078]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh.latest" "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:08 kjcf05n01 ansible-ansible.builtin.command[3857833]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:09 kjcf05n00 ansible-ansible.builtin.command[2389181]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_benchmark_params_setup_E1000_kjcf05.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:10 kjcf05n00 mcfcli[3673891]: %3|1730770150.468|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:29:12 kjcf05n01 ansible-stat[3858007]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:29:13 kjcf05n01 ansible-file[3858054]: Invoked with dest=/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh.latest recurse=False _original_basename=lustre_pool_check_kjcf05.sh state=file path=/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:29:12 kjcf05n00 ansible-stat[2389350]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:29:13 kjcf05n00 ansible-file[2389405]: Invoked with dest=/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh.latest recurse=False _original_basename=lustre_pool_check_kjcf05.sh state=file path=/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:29:15 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:9a:1a Nov 4 19:29:15 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 4 19:29:16 kjcf05n01 ansible-ansible.builtin.command[3858136]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh.latest" "/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:16 kjcf05n00 ansible-ansible.builtin.command[2389527]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh.latest" "/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:18 kjcf05n01 ansible-ansible.builtin.command[3858183]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:17 kjcf05n00 mcfcli[3673891]: %3|1730770157.683|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:29:18 kjcf05n00 ansible-ansible.builtin.command[2389609]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_pool_check_kjcf05.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:19 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 4 19:29:19 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a kjcf05n03 Nov 4 19:29:19 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.6 Nov 4 19:29:19 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 4 19:29:19 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 4 19:29:19 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.6 Nov 4 19:29:19 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/pxelinux.cfg to 172.16.2.6 Nov 4 19:29:21 kjcf05n01 ansible-stat[3858278]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:29:21 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/vmlinuz_diskless to 172.16.2.6 Nov 4 19:29:22 kjcf05n00 ansible-stat[2389718]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:29:22 kjcf05n01 ansible-file[3858322]: Invoked with dest=/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh.latest recurse=False _original_basename=lustre_pool_setup_kjcf05.sh state=file path=/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:29:23 kjcf05n00 ansible-file[2389763]: Invoked with dest=/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh.latest recurse=False _original_basename=lustre_pool_setup_kjcf05.sh state=file path=/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:29:24 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/initramfs-diskless.img to 172.16.2.6 Nov 4 19:29:26 kjcf05n01 ansible-ansible.builtin.command[3858411]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh.latest" "/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:26 kjcf05n00 ansible-ansible.builtin.command[2389937]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh.latest" "/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:27 kjcf05n01 ansible-ansible.builtin.command[3858455]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:27 kjcf05n00 ansible-ansible.builtin.command[2389985]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_pool_setup_kjcf05.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:31 kjcf05n01 ansible-stat[3858614]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:29:31 kjcf05n00 ansible-stat[2390092]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:29:32 kjcf05n01 ansible-file[3858657]: Invoked with dest=/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh.latest recurse=False _original_basename=lustre_pool_unset_kjcf05.sh state=file path=/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:29:32 kjcf05n00 ansible-file[2390135]: Invoked with dest=/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh.latest recurse=False _original_basename=lustre_pool_unset_kjcf05.sh state=file path=/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:29:35 kjcf05n01 ansible-ansible.builtin.command[3858784]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh.latest" "/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:35 kjcf05n00 ansible-ansible.builtin.command[2390220]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh.latest" "/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:37 kjcf05n01 ansible-ansible.builtin.command[3858828]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:37 kjcf05n00 ansible-ansible.builtin.command[2390312]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/lustre_pool_unset_kjcf05.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 19:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 19:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 19:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 19:29:39 kjcf05n01 ansible-command[3858873]: Invoked with _uses_shell=True _raw_params=rm -f /home/users/filesystem-test/bin/fstrim_*.sh* warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:39 kjcf05n01 ansible-command[3858873]: [WARNING] Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. Nov 4 19:29:39 kjcf05n00 ansible-command[2390360]: Invoked with _uses_shell=True _raw_params=rm -f /home/users/filesystem-test/bin/fstrim_*.sh* warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:39 kjcf05n00 ansible-command[2390360]: [WARNING] Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. Nov 4 19:29:40 kjcf05n00 mcfcli[3673891]: %3|1730770180.468|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:29:43 kjcf05n01 ansible-stat[3858963]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/fstrim.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:29:43 kjcf05n00 ansible-stat[2390453]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/fstrim.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:29:44 kjcf05n01 ansible-file[3859006]: Invoked with dest=/home/users/filesystem-test/bin/fstrim.sh.latest _original_basename=fstrim.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/fstrim.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:29:45 kjcf05n00 ansible-file[2390497]: Invoked with dest=/home/users/filesystem-test/bin/fstrim.sh.latest _original_basename=fstrim.sh.j2 follow=False recurse=False state=file mode=None path=/home/users/filesystem-test/bin/fstrim.sh.latest force=False modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:29:47 kjcf05n01 ansible-ansible.builtin.command[3859087]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/fstrim.sh.latest" "/home/users/filesystem-test/bin/fstrim.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:47 kjcf05n00 ansible-ansible.builtin.command[2390578]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/fstrim.sh.latest" "/home/users/filesystem-test/bin/fstrim.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 19:29:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 19:29:49 kjcf05n01 ansible-ansible.builtin.command[3859131]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/fstrim.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:48 kjcf05n00 ansible-ansible.builtin.command[2390645]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/fstrim.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 19:29:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 19:29:52 kjcf05n01 ansible-stat[3859217]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:29:52 kjcf05n00 mcfcli[3673891]: %3|1730770192.874|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:29:53 kjcf05n00 ansible-stat[2390737]: Invoked with checksum_algorithm=sha1 get_checksum=True follow=False path=/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh.latest get_md5=False get_mime=True get_attributes=True Nov 4 19:29:53 kjcf05n01 ansible-file[3859265]: Invoked with dest=/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh.latest recurse=False _original_basename=process_obdfilter_survey_results.sh state=file path=/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:29:54 kjcf05n00 ansible-file[2390794]: Invoked with dest=/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh.latest recurse=False _original_basename=process_obdfilter_survey_results.sh state=file path=/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh.latest force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 19:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 19:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 19:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 19:29:57 kjcf05n01 ansible-ansible.builtin.command[3859345]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh.latest" "/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:57 kjcf05n00 ansible-ansible.builtin.command[2390881]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/link-if-identical.sh "/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh.latest" "/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:58 kjcf05n01 ansible-ansible.builtin.command[3859398]: Invoked with _raw_params=/tmp/ansible.2w0qgx0n.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:29:58 kjcf05n00 ansible-ansible.builtin.command[2390930]: Invoked with _raw_params=/tmp/ansible.l6gbbhf7.library_script_cache/set-execute.sh "/home/users/filesystem-test/bin/process_obdfilter_survey_results.sh.latest" warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:30:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 19:30:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 19:30:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 19:30:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 19:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 19:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 19:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 19:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 19:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 19:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 19:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 19:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 19:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 19:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 19:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 19:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 19:30:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 19:30:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:30:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 19:30:02 kjcf05n00 ansible-command[2390986]: Invoked with _raw_params=cscli set_timezone --show warn=True _uses_shell=False stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:30:10 kjcf05n00 mcfcli[3673891]: %3|1730770210.468|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:30:12 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:45918). Nov 4 19:30:12 kjcf05n01 rsyncd[3859426]: connect from kjcf05n03 (172.16.2.6) Nov 4 19:30:12 kjcf05n01 rsyncd[3859426]: rsync on puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 4 19:30:12 kjcf05n01 rsyncd[3859426]: building file list Nov 4 19:30:12 kjcf05n01 rsyncd[3859426]: sent 11446 bytes received 136 bytes total size 10901 Nov 4 19:30:12 kjcf05n01 systemd[1]: rsyncd@657-172.16.2.2:873-172.16.2.6:45918.service: Succeeded. Nov 4 19:30:28 kjcf05n02 fstonithd.py[15145]: Listening for kdump packets from partner Nov 4 19:30:32 kjcf05n00 mcfcli[3673891]: %3|1730770232.029|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:30:37 kjcf05n01 ansible-ansible.builtin.file[3859749]: Invoked with state=absent path=/tmp/ansible.2w0qgx0n.library_script_cache recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:30:37 kjcf05n00 ansible-ansible.builtin.file[2391446]: Invoked with state=absent path=/tmp/ansible.l6gbbhf7.library_script_cache recurse=False force=False follow=True modification_time_format=%Y%m%d%H%M.%S access_time_format=%Y%m%d%H%M.%S unsafe_writes=False _original_basename=None _diff_peek=None src=None modification_time=None access_time=None mode=None owner=None group=None seuser=None serole=None selevel=None setype=None attributes=None content=NOT_LOGGING_PARAMETER backup=None remote_src=None regexp=None delimiter=None directory_mode=None Nov 4 19:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 19:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 19:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 19:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 19:30:37 kjcf05n00 python3.9[2391398]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 19:30:38 kjcf05n01 ansible-command[3859791]: Invoked with _uses_shell=True _raw_params=rm -rf /tmp/ansible*library_script_cache warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:30:38 kjcf05n01 ansible-command[3859791]: [WARNING] Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. Nov 4 19:30:38 kjcf05n00 ansible-command[2391579]: Invoked with _uses_shell=True _raw_params=rm -rf /tmp/ansible*library_script_cache warn=True stdin_add_newline=True strip_empty_ends=True argv=None chdir=None executable=None creates=None removes=None stdin=None Nov 4 19:30:38 kjcf05n00 ansible-command[2391579]: [WARNING] Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. Nov 4 19:30:40 kjcf05n00 mcfcli[3673891]: %3|1730770240.468|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:30:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 19:30:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 19:30:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730770250', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 19:30:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730770250'} Nov 4 19:30:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:30:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730770250', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 19:30:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730770250'} Nov 4 19:30:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:30:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 19:30:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 19:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 19:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 19:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 19:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 19:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 19:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 19:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 19:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 19:31:07 kjcf05n02 dwd[5196]: nvme11n1 passed periodic SMART status check Nov 4 19:31:07 kjcf05n02 dwd[5196]: nvme5n1 passed periodic SMART status check Nov 4 19:31:07 kjcf05n02 dwd[5196]: nvme6n1 passed periodic SMART status check Nov 4 19:31:07 kjcf05n02 dwd[5196]: nvme16n1 passed periodic SMART status check Nov 4 19:31:07 kjcf05n02 dwd[5196]: nvme15n1 passed periodic SMART status check Nov 4 19:31:07 kjcf05n02 dwd[5196]: nvme20n1 passed periodic SMART status check Nov 4 19:31:08 kjcf05n02 dwd[5196]: nvme7n1 passed periodic SMART status check Nov 4 19:31:08 kjcf05n02 dwd[5196]: nvme22n1 passed periodic SMART status check Nov 4 19:31:08 kjcf05n02 dwd[5196]: nvme21n1 passed periodic SMART status check Nov 4 19:31:08 kjcf05n02 dwd[5196]: nvme10n1 passed periodic SMART status check Nov 4 19:31:08 kjcf05n02 dwd[5196]: nvme12n1 passed periodic SMART status check Nov 4 19:31:10 kjcf05n00 mcfcli[3673891]: %3|1730770270.392|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:31:10 kjcf05n00 mcfcli[3673891]: %3|1730770270.968|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 19:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 19:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 19:31:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 19:31:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 19:31:39 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='34', client='AF_INET(172.16.2.6:36527)', local='AF_INET(0.0.0.0:601)' Nov 4 19:31:39 kjcf05n03 syslog-ng[3194]: Configuration reload request received, reloading configuration; Nov 4 19:31:39 kjcf05n03 syslog-ng[3194]: Configuration reload finished; Nov 4 19:31:39 kjcf05n03 syslog-ng[3194]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 4 19:31:39 kjcf05n03 dracut: dracut-049-135.git20210121.el8 Nov 4 19:31:39 kjcf05n03 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 19:31:39 kjcf05n03 dracut: Loading and integrity checking all crypto modules Nov 4 19:31:39 kjcf05n03 dracut: Self testing crypto algorithms Nov 4 19:31:39 kjcf05n03 dracut: rd.md=0: removing MD RAID activation Nov 4 19:31:39 kjcf05n03 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 19:31:39 kjcf05n03 Copying live image to RAM... Nov 4 19:31:39 kjcf05n03 (this may take a minute) Nov 4 19:31:39 kjcf05n03 Done copying live image to RAM. Nov 4 19:31:39 kjcf05n03 dracut: Mounted root filesystem LiveOS_rootfs Nov 4 19:31:39 kjcf05n03 dracut: Checking integrity of kernel Nov 4 19:31:39 kjcf05n03 dracut: All initrd crypto checks done Nov 4 19:31:39 kjcf05n03 dracut: Switching root Nov 4 19:31:39 kjcf05n03 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 4 19:31:39 kjcf05n03 systemd: Detected architecture x86-64. Nov 4 19:31:39 kjcf05n03 systemd: Set hostname to . Nov 4 19:31:39 kjcf05n03 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 4 19:31:39 kjcf05n03 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 4 19:31:39 kjcf05n03 systemd: Reached target Swap. Nov 4 19:31:39 kjcf05n03 systemd: Started Forward Password Requests to Wall Directory Watch. Nov 4 19:31:39 kjcf05n03 systemd: Created slice system-getty.slice. Nov 4 19:31:39 kjcf05n03 systemd: Listening on Device-mapper event daemon FIFOs. Nov 4 19:31:39 kjcf05n03 systemd: Listening on udev Kernel Socket. Nov 4 19:31:39 kjcf05n03 systemd-journald[1533]: Journal started Nov 4 19:31:39 kjcf05n03 systemd-journald[1533]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 19:31:39 kjcf05n03 systemd-modules-load[1534]: Inserted module 'fuse' Nov 4 19:31:39 kjcf05n03 systemd[1]: Mounted Temporary Directory (/tmp). Nov 4 19:31:39 kjcf05n03 systemd[1]: Mounting FUSE Control File System... Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Apply Kernel Variables... Nov 4 19:31:39 kjcf05n03 systemd[1]: Mounting Kernel Configuration File System... Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Rebuild Hardware Database... Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Load/Save Random Seed... Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Create System Users... Nov 4 19:31:39 kjcf05n03 systemd[1]: Mounted FUSE Control File System. Nov 4 19:31:39 kjcf05n03 systemd[1]: Mounted Kernel Configuration File System. Nov 4 19:31:39 kjcf05n03 systemd-sysctl[1547]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 19:31:39 kjcf05n03 systemd-sysctl[1547]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Apply Kernel Variables. Nov 4 19:31:39 kjcf05n03 systemd-journald[1533]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Flush Journal to Persistent Storage. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Load/Save Random Seed. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Create System Users. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 4 19:31:39 kjcf05n03 systemd-tmpfiles[1558]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 19:31:39 kjcf05n03 systemd-tmpfiles[1558]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Create Static Device Nodes in /dev. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started udev Coldplug all Devices. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Rebuild Hardware Database. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting udev Kernel Device Manager... Nov 4 19:31:39 kjcf05n03 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started udev Kernel Device Manager. Nov 4 19:31:39 kjcf05n03 systemd[1]: Found device /dev/ttyS0. Nov 4 19:31:39 kjcf05n03 systemd-udevd[1578]: Using default interface naming scheme 'rhel-8.0'. Nov 4 19:31:39 kjcf05n03 systemd-udevd[1578]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:31:39 kjcf05n03 systemd-udevd[1622]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:31:39 kjcf05n03 systemd-udevd[1591]: Using default interface naming scheme 'rhel-8.0'. Nov 4 19:31:39 kjcf05n03 systemd-udevd[1591]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:31:39 kjcf05n03 systemd-udevd[1615]: Using default interface naming scheme 'rhel-8.0'. Nov 4 19:31:39 kjcf05n03 systemd-udevd[1615]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 4 19:31:39 kjcf05n03 systemd[1]: Reached target Local File Systems (Pre). Nov 4 19:31:39 kjcf05n03 systemd[1]: Reached target Local File Systems. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting openibd - configure Mellanox devices... Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Rebuild Journal Catalog... Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Create Volatile Files and Directories... Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Mark the need to relabel after reboot... Nov 4 19:31:39 kjcf05n03 root[1795]: openibd: running in auto mode Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 4 19:31:39 kjcf05n03 systemd-tmpfiles[1794]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 19:31:39 kjcf05n03 systemd-tmpfiles[1794]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 19:31:39 kjcf05n03 systemd-tmpfiles[1794]: "/var/tmp" already exists and is not a directory. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Rebuild Journal Catalog. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Create Volatile Files and Directories. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Mark the need to relabel after reboot. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting RDMA Node Description Daemon... Nov 4 19:31:39 kjcf05n03 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting RPC Bind... Nov 4 19:31:39 kjcf05n03 systemd[1]: Started RDMA Node Description Daemon. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 4 19:31:39 kjcf05n03 systemd-modules-load[1850]: Inserted module 'ib_iser' Nov 4 19:31:39 kjcf05n03 systemd-modules-load[1850]: Inserted module 'ib_isert' Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 4 19:31:39 kjcf05n03 systemd-modules-load[1850]: Inserted module 'ib_srpt' Nov 4 19:31:39 kjcf05n03 systemd-udevd[1622]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:31:39 kjcf05n03 systemd-modules-load[1851]: Inserted module 'ib_ipoib' Nov 4 19:31:39 kjcf05n03 systemd-udevd[1617]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started RPC Bind. Nov 4 19:31:39 kjcf05n03 systemd-modules-load[1850]: Inserted module 'rdma_ucm' Nov 4 19:31:39 kjcf05n03 systemd-modules-load[1850]: Module 'svcrdma' is blacklisted Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 4 19:31:39 kjcf05n03 systemd-udevd[1617]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 19:31:39 kjcf05n03 systemd-udevd[1622]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 19:31:39 kjcf05n03 systemd-modules-load[1851]: Inserted module 'ib_umad' Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 4 19:31:39 kjcf05n03 systemd[1]: Reached target Network (Pre). Nov 4 19:31:39 kjcf05n03 systemd[1]: Reached target RDMA Hardware. Nov 4 19:31:39 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 19:31:39 kjcf05n03 systemd[3194]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:31:39 kjcf05n03 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 4 19:31:39 kjcf05n03 openibd[1779]: Loading HCA driver and Access Layer:[ OK ] Nov 4 19:31:39 kjcf05n03 systemd[1]: Started openibd - configure Mellanox devices. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Update is Completed... Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Update is Completed. Nov 4 19:31:39 kjcf05n03 setup-icl[1767]: Setting LAN IP Address to 203.0.113.4 Nov 4 19:31:39 kjcf05n03 setup-icl[1767]: Setting LAN Subnet Mask to 255.255.255.0 Nov 4 19:31:39 kjcf05n03 setup-icl[1767]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 4 19:31:39 kjcf05n03 setup-icl[1767]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 4 19:31:39 kjcf05n03 systemd-udevd[1622]: Using default interface naming scheme 'rhel-8.0'. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 4 19:31:39 kjcf05n03 systemd[1]: Reached target System Initialization. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 4 19:31:39 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 4 19:31:39 kjcf05n03 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 4 19:31:39 kjcf05n03 systemd[1]: Listening on lldpad.socket. Nov 4 19:31:39 kjcf05n03 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 4 19:31:39 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 4 19:31:39 kjcf05n03 systemd[1]: Reached target Sockets. Nov 4 19:31:39 kjcf05n03 systemd[1]: Reached target Basic System. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting LSB: Bring up/down networking... Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 4 19:31:39 kjcf05n03 systemd[1]: Started D-Bus System Message Bus. Nov 4 19:31:39 kjcf05n03 network[2125]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 4 19:31:39 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 4 19:31:39 kjcf05n03 network[2142]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 19:31:39 kjcf05n03 network[2125]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started irqbalance daemon. Nov 4 19:31:39 kjcf05n03 beSetMlxConfig[2152]: ConnectX-3 multiport not detected Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Name Service Cache Daemon... Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[2156]: Setting up Mellanox network interface: ib1 Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 19:31:39 kjcf05n03 nscd[2196]: 2196 monitoring file `/etc/hosts` (1) Nov 4 19:31:39 kjcf05n03 nscd[2196]: 2196 monitoring directory `/etc` (2) Nov 4 19:31:39 kjcf05n03 nscd[2196]: 2196 monitoring file `/etc/resolv.conf` (3) Nov 4 19:31:39 kjcf05n03 nscd[2196]: 2196 monitoring directory `/etc` (2) Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[2175]: Setting up Mellanox network interface: ib0 Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 4 19:31:39 kjcf05n03 network[2180]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:31:39 kjcf05n03 network[2125]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Resets System Activity Logs... Nov 4 19:31:39 kjcf05n03 dbus-daemon[2141]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 4 19:31:39 kjcf05n03 dwd[2195]: dwd: vMay 29 2024 : 15:38:26 Nov 4 19:31:39 kjcf05n03 dwd[2195]: /usr/sbin/dwd -d --standalone=0 Nov 4 19:31:39 kjcf05n03 dwd[2195]: dwd: option Lethal: 0 Nov 4 19:31:39 kjcf05n03 dwd[2195]: dwd: option Interval: 60 Nov 4 19:31:39 kjcf05n03 dwd[2195]: dwd: option abrtlimit: 10 Nov 4 19:31:39 kjcf05n03 dwd[2195]: dwd: option DZPeriod: 604800 Nov 4 19:31:39 kjcf05n03 dwd[2195]: dwd: option SmartPeriod: 43200 Nov 4 19:31:39 kjcf05n03 dwd[2195]: dwd: option SDDEnabled: 1 Nov 4 19:31:39 kjcf05n03 dwd[2195]: dwd: option SDDAwaitScale: 3 Nov 4 19:31:39 kjcf05n03 dwd[2195]: dwd: option SDDAwaitMin: 100 Nov 4 19:31:39 kjcf05n03 dwd[2195]: dwd: option Verbosity: 1 Nov 4 19:31:39 kjcf05n03 dwd[2195]: dwd: option StandAlone: 0 Nov 4 19:31:39 kjcf05n03 dwd[2195]: option Lethal: 0 Nov 4 19:31:39 kjcf05n03 dwd[2195]: option Interval: 60 Nov 4 19:31:39 kjcf05n03 dwd[2195]: option abrtlimit: 10 Nov 4 19:31:39 kjcf05n03 dwd[2195]: option DZPeriod: 604800 Nov 4 19:31:39 kjcf05n03 dwd[2195]: option SmartPeriod: 43200 Nov 4 19:31:39 kjcf05n03 dwd[2195]: option SDDEnabled: 1 Nov 4 19:31:39 kjcf05n03 dwd[2195]: option SDDAwaitScale: 3 Nov 4 19:31:39 kjcf05n03 dwd[2195]: option SDDAwaitMin: 100 Nov 4 19:31:39 kjcf05n03 dwd[2195]: option Verbosity: 1 Nov 4 19:31:39 kjcf05n03 dwd[2195]: option StandAlone: 0 Nov 4 19:31:39 kjcf05n03 network[2225]: It is advised to switch to 'NetworkManager' instead for network management. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 0 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 1 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 2 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 3 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 4 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 5 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 6 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 7 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 8 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 9 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 10 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 11 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 12 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 13 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 14 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 15 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 16 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 17 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 18 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 19 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 20 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 21 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 22 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 23 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 24 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 25 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 26 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 27 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 28 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 29 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 30 Nov 4 19:31:39 kjcf05n03 cpupower[2239]: Setting cpu: 31 Nov 4 19:31:39 kjcf05n03 chronyd[2286]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 19:31:39 kjcf05n03 beSetMlxConfig[2152]: Starting MST (Mellanox Software Tools) driver set Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[2283]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[2292]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 19:31:39 kjcf05n03 mcelog[2302]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 4 19:31:39 kjcf05n03 mcelog[2302]: CPU is unsupported Nov 4 19:31:39 kjcf05n03 beSetMlxConfig[2152]: Loading MST PCI module - Success Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Manage Cutlass PHYs... Nov 4 19:31:39 kjcf05n03 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[2313]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[2325]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 19:31:39 kjcf05n03 chronyd[2286]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 19:31:39 kjcf05n03 chronyd[2286]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Name Service Cache Daemon. Nov 4 19:31:39 kjcf05n03 beSetMlxConfig[2152]: Loading MST PCI configuration module - Success Nov 4 19:31:39 kjcf05n03 beSetMlxConfig[2152]: Create devices Nov 4 19:31:39 kjcf05n03 mdraid-phy[2326]: no Cutlass to worry about Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Resets System Activity Logs. Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[2331]: No configuration found for ib0 Nov 4 19:31:39 kjcf05n03 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 0 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 1 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 2 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 3 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 4 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 5 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 6 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 7 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 8 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 9 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 10 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 11 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 12 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 13 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 14 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 15 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 16 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 17 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 18 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 19 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 20 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 21 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 22 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 23 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 24 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 25 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 26 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 27 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 28 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 29 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 30 Nov 4 19:31:39 kjcf05n03 cpupower[2357]: Idlestate 2 disabled on CPU 31 Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[2333]: No configuration found for ib1 Nov 4 19:31:39 kjcf05n03 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 4 19:31:39 kjcf05n03 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Manage Cutlass PHYs. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[2356]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[2369]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 19:31:39 kjcf05n03 mlnx_conf_mgr[2406]: INFO: No configurations found for mlx5_0, skipping. Nov 4 19:31:39 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 19:31:39 kjcf05n03 mlnx_conf_mgr[2428]: INFO: No configurations found for mlx5_1, skipping. Nov 4 19:31:39 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 19:31:39 kjcf05n03 sssd[sssd][2300]: Starting up Nov 4 19:31:39 kjcf05n03 sssd[be[implicit_files]][2503]: Starting up Nov 4 19:31:39 kjcf05n03 sssd[nss][2599]: Starting up Nov 4 19:31:39 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 4 19:31:39 kjcf05n03 systemd[1]: Reached target User and Group Name Lookups. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Login Service... Nov 4 19:31:39 kjcf05n03 systemd-logind[2721]: New seat seat0. Nov 4 19:31:39 kjcf05n03 systemd-logind[2721]: Watching system buttons on /dev/input/event0 (Power Button) Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Login Service. Nov 4 19:31:39 kjcf05n03 systemd-sysctl[2801]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 19:31:39 kjcf05n03 systemd-sysctl[2801]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 19:31:39 kjcf05n03 python3.9[2311]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 19:31:39 kjcf05n03 python3.9[3194]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 4 19:31:39 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 19:31:39 kjcf05n03 python3.9[3005]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 19:31:39 kjcf05n03 python3.9[3194]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 19:31:39 kjcf05n03 network[2125]: Bringing up loopback interface: [ OK ] Nov 4 19:31:39 kjcf05n03 systemd-sysctl[3136]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 19:31:39 kjcf05n03 systemd-sysctl[3136]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 19:31:39 kjcf05n03 systemd[1]: Started LSB: Bring up/down networking. Nov 4 19:31:39 kjcf05n03 systemd[1]: Reached target Network. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 4 19:31:39 kjcf05n03 systemd[1]: Reached target Network is Online. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Notify NFS peers of a restart... Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting System Logger Daemon... Nov 4 19:31:39 kjcf05n03 sm-notify[3190]: Version 2.3.3 starting Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started GSSAPI Proxy Daemon. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Notify NFS peers of a restart. Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 4 19:31:39 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 19:31:39 kjcf05n03 systemd[1]: Reached target NFS client services. Nov 4 19:31:39 kjcf05n03 systemd[1]: Reached target Remote File Systems (Pre). Nov 4 19:31:39 kjcf05n03 systemd[1]: Reached target Remote File Systems. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Permit User Sessions... Nov 4 19:31:39 kjcf05n03 lldpad[3181]: setsockopt nearest_bridge: Invalid argument Nov 4 19:31:39 kjcf05n03 lldpad[3194]: Last message 'setsockopt nearest_b' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Permit User Sessions. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Serial Getty on ttyS0. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Getty on tty1. Nov 4 19:31:39 kjcf05n03 python3.9[3206]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 19:31:39 kjcf05n03 python3.9[3194]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:31:39 kjcf05n03 systemd[1]: Reached target Login Prompts. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 4 19:31:39 kjcf05n03 beSetMlxConfig[2152]: Unloading MST PCI module (unused) - Success Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 19:31:39 kjcf05n03 syslog-ng[3194]: [2024-11-05T01:30:25.591618] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 4 19:31:39 kjcf05n03 syslog-ng[3194]: [2024-11-05T01:30:25.591920] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 4 19:31:39 kjcf05n03 syslog-ng[3194]: [2024-11-05T01:30:25.591954] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 4 19:31:39 kjcf05n03 syslog-ng[3194]: [2024-11-05T01:30:25.592543] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 4 19:31:39 kjcf05n03 syslog-ng[3194]: [2024-11-05T01:30:25.592883] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 4 19:31:39 kjcf05n03 systemd[1]: Started System Logger Daemon. Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 4 19:31:39 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 19:31:39 kjcf05n03 python3.9[3441]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 19:31:39 kjcf05n03 python3.9[3194]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 4 19:31:39 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 19:31:39 kjcf05n03 python3.9[3444]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 19:31:39 kjcf05n03 python3.9[3194]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 19:31:39 kjcf05n03 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 4 19:31:39 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 4 19:31:39 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 4 19:31:39 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 19:31:39 kjcf05n03 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 4 19:31:39 kjcf05n03 sshd[3453]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 4 19:31:39 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 4 19:31:39 kjcf05n03 chronyd[2286]: System's initial offset : 0.003169 seconds slow of true (slew) Nov 4 19:31:39 kjcf05n03 systemd[1]: Started NTP client/server. Nov 4 19:31:39 kjcf05n03 beSetMlxConfig[2152]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 19:31:39 kjcf05n03 beSetMlxConfig[2152]: ib mode Nov 4 19:31:39 kjcf05n03 root[3471]: openibd: Set node_desc for mlx5_0: kjcf05n03 HCA-1 Nov 4 19:31:39 kjcf05n03 root[3473]: openibd: Set node_desc for mlx5_1: kjcf05n03 HCA-2 Nov 4 19:31:39 kjcf05n03 beSetMlxConfig[2152]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 19:31:39 kjcf05n03 beSetMlxConfig[2152]: ib mode Nov 4 19:31:39 kjcf05n03 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 19:31:39 kjcf05n03 systemd-udevd[3489]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:31:39 kjcf05n03 systemd-udevd[3490]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:31:39 kjcf05n03 systemd-udevd[3493]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:31:39 kjcf05n03 systemd-udevd[3496]: Using default interface naming scheme 'rhel-8.0'. Nov 4 19:31:39 kjcf05n03 systemd-udevd[3496]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:31:39 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 19:31:39 kjcf05n03 systemd[3194]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:31:39 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[3531]: Setting up Mellanox network interface: ib1 Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[3532]: Setting up Mellanox network interface: ib0 Nov 4 19:31:39 kjcf05n03 systemd-udevd[3491]: Using default interface naming scheme 'rhel-8.0'. Nov 4 19:31:39 kjcf05n03 systemd-udevd[3492]: Using default interface naming scheme 'rhel-8.0'. Nov 4 19:31:39 kjcf05n03 systemd-udevd[3491]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:31:39 kjcf05n03 systemd-udevd[3492]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Puppet agent... Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[3587]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[3586]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[3612]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[3613]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[3615]: No configuration found for ib1 Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[3614]: No configuration found for ib0 Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[3622]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[3623]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 19:31:39 kjcf05n03 mlnx_conf_mgr[3662]: INFO: No configurations found for mlx5_1, skipping. Nov 4 19:31:39 kjcf05n03 mlnx_conf_mgr[3663]: INFO: No configurations found for mlx5_0, skipping. Nov 4 19:31:39 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 19:31:39 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 19:31:39 kjcf05n03 systemd[1]: Stopping Command Scheduler... Nov 4 19:31:39 kjcf05n03 systemd[1]: crond.service: Succeeded. Nov 4 19:31:39 kjcf05n03 systemd[1]: Stopped Command Scheduler. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 4 19:31:39 kjcf05n03 systemd[1]: Stopping Job spooling tools... Nov 4 19:31:39 kjcf05n03 systemd[1]: atd.service: Succeeded. Nov 4 19:31:39 kjcf05n03 systemd[1]: Stopped Job spooling tools. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 19:31:39 kjcf05n03 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 4 19:31:39 kjcf05n03 lldpad[3181]: init_ports: Error adding device ib0 Nov 4 19:31:39 kjcf05n03 lldpad[3181]: init_ports: Error adding device ib1 Nov 4 19:31:39 kjcf05n03 lldpad[3181]: Signal 15 received - terminating Nov 4 19:31:39 kjcf05n03 systemd[1]: lldpad.service: Succeeded. Nov 4 19:31:39 kjcf05n03 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 4 19:31:39 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 4 19:31:39 kjcf05n03 systemd[1]: lldpad.socket: Succeeded. Nov 4 19:31:39 kjcf05n03 systemd[1]: Closed lldpad.socket. Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 4 19:31:39 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting IPMI Driver... Nov 4 19:31:39 kjcf05n03 systemd[1]: Started IPMI Driver. Nov 4 19:31:39 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:39 kjcf05n03 systemd[3194]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:31:39 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Ipmievd Daemon... Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 1 | Nov-05-2024 | 01:00:49 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 2 | Nov-05-2024 | 01:01:40 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 3 | Nov-05-2024 | 01:01:41 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 4 | Nov-05-2024 | 01:02:46 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 5 | Nov-05-2024 | 01:02:47 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 6 | Nov-05-2024 | 01:26:09 | Sensor #0 (Generator ID 21h) | Memory | Assertion Event | Correctable memory error ; OEM Event Data2 code = 30h ; OEM Event Data3 code = 00h Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 7 | Nov-05-2024 | 01:27:45 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 8 | Nov-05-2024 | 01:27:45 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 9 | Nov-05-2024 | 01:27:45 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 10 | Nov-05-2024 | 01:27:45 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 11 | Nov-05-2024 | 01:27:45 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 12 | Nov-05-2024 | 01:27:45 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 13 | Nov-05-2024 | 01:27:45 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 14 | Nov-05-2024 | 01:27:45 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 15 | Nov-05-2024 | 01:27:45 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 16 | Nov-05-2024 | 01:27:45 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 17 | Nov-05-2024 | 01:27:45 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 18 | Nov-05-2024 | 01:27:45 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 19 | Nov-05-2024 | 01:27:45 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 20 | Nov-05-2024 | 01:27:45 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 21 | Nov-05-2024 | 01:27:45 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 22 | Nov-05-2024 | 01:27:45 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 23 | Nov-05-2024 | 01:27:45 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 24 | Nov-05-2024 | 01:27:45 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 25 | Nov-05-2024 | 01:27:45 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 26 | Nov-05-2024 | 01:27:45 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 27 | Nov-05-2024 | 01:27:45 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 28 | Nov-05-2024 | 01:27:45 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 29 | Nov-05-2024 | 01:27:46 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 30 | Nov-05-2024 | 01:27:46 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 31 | Nov-05-2024 | 01:27:46 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 32 | Nov-05-2024 | 01:27:46 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 33 | Nov-05-2024 | 01:27:46 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 34 | Nov-05-2024 | 01:27:46 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 35 | Nov-05-2024 | 01:27:46 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 36 | Nov-05-2024 | 01:27:46 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 37 | Nov-05-2024 | 01:27:46 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 38 | Nov-05-2024 | 01:27:46 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 39 | Nov-05-2024 | 01:28:16 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 40 | Nov-05-2024 | 01:28:16 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 41 | Nov-05-2024 | 01:28:16 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 42 | Nov-05-2024 | 01:28:16 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 43 | Nov-05-2024 | 01:28:16 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 44 | Nov-05-2024 | 01:28:16 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 45 | Nov-05-2024 | 01:28:16 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 46 | Nov-05-2024 | 01:28:16 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 47 | Nov-05-2024 | 01:28:16 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 48 | Nov-05-2024 | 01:28:16 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 49 | Nov-05-2024 | 01:28:16 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 50 | Nov-05-2024 | 01:28:16 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 51 | Nov-05-2024 | 01:28:16 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 52 | Nov-05-2024 | 01:28:16 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 53 | Nov-05-2024 | 01:28:16 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 54 | Nov-05-2024 | 01:28:16 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 55 | Nov-05-2024 | 01:28:16 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 56 | Nov-05-2024 | 01:28:16 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 57 | Nov-05-2024 | 01:28:16 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 58 | Nov-05-2024 | 01:28:16 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 59 | Nov-05-2024 | 01:28:16 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 60 | Nov-05-2024 | 01:28:16 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 61 | Nov-05-2024 | 01:28:17 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 62 | Nov-05-2024 | 01:28:17 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 63 | Nov-05-2024 | 01:28:17 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 64 | Nov-05-2024 | 01:28:17 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 65 | Nov-05-2024 | 01:28:17 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 66 | Nov-05-2024 | 01:28:17 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 67 | Nov-05-2024 | 01:28:17 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 68 | Nov-05-2024 | 01:28:17 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 69 | Nov-05-2024 | 01:28:17 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4006]: 70 | Nov-05-2024 | 01:28:17 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 19:31:39 kjcf05n03 ipmievd[4009]: Reading sensors... Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Ipmievd Daemon. Nov 4 19:31:39 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:39 kjcf05n03 systemd[3194]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 4 19:31:39 kjcf05n03 nscd[2196]: 2196 monitored file `/etc/hosts` was moved into place, adding watch Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 19:31:39 kjcf05n03 systemd[1]: set-mlx-config.service: Succeeded. Nov 4 19:31:39 kjcf05n03 systemd[1]: Stopped Set Mellanox configuration. Nov 4 19:31:39 kjcf05n03 systemd[1]: Stopping Set Mellanox configuration... Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 4 19:31:39 kjcf05n03 beSetMlxConfig[4067]: ConnectX-3 multiport not detected Nov 4 19:31:39 kjcf05n03 beSetMlxConfig[4067]: Starting MST (Mellanox Software Tools) driver set Nov 4 19:31:39 kjcf05n03 beSetMlxConfig[4067]: Loading MST PCI module - Success Nov 4 19:31:39 kjcf05n03 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 19:31:39 kjcf05n03 beSetMlxConfig[4067]: [warn] mst_pciconf is already loaded, skipping Nov 4 19:31:39 kjcf05n03 beSetMlxConfig[4067]: Create devices Nov 4 19:31:39 kjcf05n03 beSetMlxConfig[4067]: Unloading MST PCI module (unused) - Success Nov 4 19:31:39 kjcf05n03 ipmievd[4009]: Waiting for events... Nov 4 19:31:39 kjcf05n03 beSetMlxConfig[4067]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 19:31:39 kjcf05n03 beSetMlxConfig[4067]: ib mode Nov 4 19:31:39 kjcf05n03 beSetMlxConfig[4067]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 19:31:39 kjcf05n03 beSetMlxConfig[4067]: ib mode Nov 4 19:31:39 kjcf05n03 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 19:31:39 kjcf05n03 systemd-udevd[4968]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:31:39 kjcf05n03 systemd-udevd[4969]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:31:39 kjcf05n03 systemd-udevd[4972]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:31:39 kjcf05n03 systemd-udevd[4974]: Using default interface naming scheme 'rhel-8.0'. Nov 4 19:31:39 kjcf05n03 systemd-udevd[4974]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:31:39 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 19:31:39 kjcf05n03 systemd[3194]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:31:39 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[5010]: Setting up Mellanox network interface: ib0 Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[5011]: Setting up Mellanox network interface: ib1 Nov 4 19:31:39 kjcf05n03 systemd-udevd[4970]: Using default interface naming scheme 'rhel-8.0'. Nov 4 19:31:39 kjcf05n03 systemd-udevd[4971]: Using default interface naming scheme 'rhel-8.0'. Nov 4 19:31:39 kjcf05n03 systemd-udevd[4970]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:31:39 kjcf05n03 systemd-udevd[4971]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[5067]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[5065]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[5091]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[5092]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[5093]: No configuration found for ib0 Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[5094]: No configuration found for ib1 Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[5101]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 19:31:39 kjcf05n03 mlnx_interface_mgr[5102]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 19:31:39 kjcf05n03 mlnx_conf_mgr[5141]: INFO: No configurations found for mlx5_0, skipping. Nov 4 19:31:39 kjcf05n03 mlnx_conf_mgr[5142]: INFO: No configurations found for mlx5_1, skipping. Nov 4 19:31:39 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 19:31:39 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}f0f9ed56604d6b67614db58c7b7c979ee43ce1061c4a5a972cd19ed1f5ec26c5' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}f0f9ed56604d6b67614db58c7b7c979ee43ce1061c4a5a972cd19ed1f5ec26c5' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}0e35b3042cc26278cc5c79844941001af5502424c1daf1638a5a75c8e0b72522' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}0e35b3042cc26278cc5c79844941001af5502424c1daf1638a5a75c8e0b72522' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}04edc7416c1e94cb891c95611dfea61fea55693e73c126d57e8852681b872fcc' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}04edc7416c1e94cb891c95611dfea61fea55693e73c126d57e8852681b872fcc' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}f42f01c8b662a86ac8e263c9f10bdd38e013fb9d300c1e05748875cb92d74c11' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}f42f01c8b662a86ac8e263c9f10bdd38e013fb9d300c1e05748875cb92d74c11' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 19:31:39 kjcf05n03 systemd[1]: Stopping NTP client/server... Nov 4 19:31:39 kjcf05n03 chronyd[2286]: chronyd exiting Nov 4 19:31:39 kjcf05n03 systemd[1]: chronyd.service: Succeeded. Nov 4 19:31:39 kjcf05n03 systemd[1]: Stopped NTP client/server. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 4 19:31:39 kjcf05n03 chronyd[5176]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 19:31:39 kjcf05n03 chronyd[5176]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 19:31:39 kjcf05n03 chronyd[5176]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 19:31:39 kjcf05n03 chronyd[5176]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 4 19:31:39 kjcf05n03 systemd[1]: Started NTP client/server. Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 19:31:39 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:39 kjcf05n03 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 4 19:31:39 kjcf05n03 systemd[1]: dwd.service: Succeeded. Nov 4 19:31:39 kjcf05n03 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 19:31:39 kjcf05n03 dwd[5209]: dwd: vMay 29 2024 : 15:38:26 Nov 4 19:31:39 kjcf05n03 dwd[5209]: /usr/sbin/dwd -i 15 -d Nov 4 19:31:39 kjcf05n03 dwd[5209]: dwd: option Lethal: 0 Nov 4 19:31:39 kjcf05n03 dwd[5209]: dwd: option Interval: 15 Nov 4 19:31:39 kjcf05n03 dwd[5209]: dwd: option abrtlimit: 10 Nov 4 19:31:39 kjcf05n03 dwd[5209]: dwd: option DZPeriod: 604800 Nov 4 19:31:39 kjcf05n03 dwd[5209]: dwd: option SmartPeriod: 43200 Nov 4 19:31:39 kjcf05n03 dwd[5209]: dwd: option SDDEnabled: 1 Nov 4 19:31:39 kjcf05n03 dwd[5209]: dwd: option SDDAwaitScale: 3 Nov 4 19:31:39 kjcf05n03 dwd[5209]: dwd: option SDDAwaitMin: 100 Nov 4 19:31:39 kjcf05n03 dwd[5209]: dwd: option Verbosity: 1 Nov 4 19:31:39 kjcf05n03 dwd[5209]: dwd: option StandAlone: 0 Nov 4 19:31:39 kjcf05n03 dwd[5209]: option Lethal: 0 Nov 4 19:31:39 kjcf05n03 dwd[5209]: option Interval: 15 Nov 4 19:31:39 kjcf05n03 dwd[5209]: option abrtlimit: 10 Nov 4 19:31:39 kjcf05n03 dwd[5209]: option DZPeriod: 604800 Nov 4 19:31:39 kjcf05n03 dwd[5209]: option SmartPeriod: 43200 Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 19:31:39 kjcf05n03 dwd[5209]: option SDDEnabled: 1 Nov 4 19:31:39 kjcf05n03 dwd[5209]: option SDDAwaitScale: 3 Nov 4 19:31:39 kjcf05n03 dwd[5209]: option SDDAwaitMin: 100 Nov 4 19:31:39 kjcf05n03 dwd[5209]: option Verbosity: 1 Nov 4 19:31:39 kjcf05n03 dwd[5209]: option StandAlone: 0 Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 4 19:31:39 kjcf05n03 dwd[5211]: option Lethal now set to 1 Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 19:31:39 kjcf05n03 dwd[5211]: option abrtlimit now set to 1 Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 19:31:39 kjcf05n03 dwd[5211]: option SmartPeriod now set to 86400 Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 19:31:39 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 19:31:39 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Discard unused blocks. Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:31:39 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:39 kjcf05n03 python3.9[5240]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 4 19:31:39 kjcf05n03 python3.9[3194]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 19:31:39 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Periodic ZFS scrub. Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:31:39 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 19:31:39 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting Sed Control Plane worker process... Nov 4 19:31:39 kjcf05n03 sedcpwrkr[5378]: Using config script: /etc/sedcpwrkr.conf Nov 4 19:31:39 kjcf05n03 sedcpwrkr[5378]: - Creating default directory: '/var/log/sedcpwrkr' Nov 4 19:31:39 kjcf05n03 sedcpwrkr[5378]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 4 19:31:39 kjcf05n03 sedcpwrkr[5378]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 4 19:31:39 kjcf05n03 sedcpwrkr[5378]: - Creating default directory: '/var/run/sedcpwrkr' Nov 4 19:31:39 kjcf05n03 sedcpwrkr[5378]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 4 19:31:39 kjcf05n03 sedcpwrkr[5378]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 4 19:31:39 kjcf05n03 sedcpwrkr-server[5409]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 19:31:39 kjcf05n03 sedcpwrkr[5378]: celery multi v5.2.7 (dawn-chorus) Nov 4 19:31:39 kjcf05n03 sedcpwrkr[5378]: > Starting nodes... Nov 4 19:31:39 kjcf05n03 sedcpwrkr[5378]: > sedcpwrkr@kjcf05n03: OK Nov 4 19:31:39 kjcf05n03 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 4 19:31:39 kjcf05n03 sedcpwrkr-server[5411]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 19:31:39 kjcf05n03 sedcpwrkr-server[5411]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 19:31:39 kjcf05n03 sedcpwrkr-server[5411]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 19:31:39 kjcf05n03 systemd[1]: Started Sed Control Plane worker process. Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 19:31:39 kjcf05n03 systemd[1]: Reloading System Logger Daemon. Nov 4 19:31:39 kjcf05n03 systemd[1]: Reloaded System Logger Daemon. Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 19:31:39 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 4 19:31:39 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 4 19:31:39 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:39 kjcf05n03 systemd[1]: Starting IPv4 firewall with iptables... Nov 4 19:31:39 kjcf05n03 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 19:31:39 kjcf05n03 iptables.init[5478]: iptables: Applying firewall rules: [ OK ] Nov 4 19:31:39 kjcf05n03 systemd[1]: Started IPv4 firewall with iptables. Nov 4 19:31:39 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:40 kjcf05n03 systemd[3194]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 19:31:40 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 19:31:40 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 19:31:40 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:41 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 19:31:41 kjcf05n03 systemd[1]: openhpid.service: Supervising process 5576 which is not our child. We'll most likely not notice when it exits. Nov 4 19:31:41 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 19:31:41 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:40 kjcf05n00 mcfcli[3673891]: %3|1730770300.968|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:31:41 kjcf05n03 openhpid[5576]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 19:31:41 kjcf05n03 openhpid[5576]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 19:31:41 kjcf05n03 openhpid[5576]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 19:31:41 kjcf05n03 openhpid[5576]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 19:31:41 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:41 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:31:41 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:31:41 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 4 19:31:41 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 4 19:31:41 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 19:31:41 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 19:31:41 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:42 kjcf05n03 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 4 19:31:42 kjcf05n03 dcs-collectord[5667]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 4 19:31:42 kjcf05n03 hpi.inv.log[5667]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 4 19:31:42 kjcf05n03 dcs-collectord[5667]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 4 19:31:42 kjcf05n03 dcs-collectord[5667]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 4 19:31:42 kjcf05n03 dcs-collector[5658]: Starting dcs-collector:[ OK ] Nov 4 19:31:42 kjcf05n03 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 4 19:31:42 kjcf05n03 dcs-collectord[5670]: INFO Starting collection for memory_info (collection_process.py:52) Nov 4 19:31:42 kjcf05n03 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 4 19:31:42 kjcf05n03 dcs-collectord[5670]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 19:31:42 kjcf05n03 dcs-collectord[5670]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 19:31:42 kjcf05n03 dcs-collectord[5670]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 19:31:42 kjcf05n03 dcs-collectord[5670]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 4 19:31:42 kjcf05n03 dcs-collectord[5670]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 4 19:31:42 kjcf05n03 dcs-collectord[5670]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 4 19:31:42 kjcf05n03 dcs-collectord[5670]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259346780", "units": "kB"}, {"name": "MemAvailable", "value": "258626604", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821312", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686992", "units": "kB"}, {"name": "Inactive", "value": "960480", "units": "kB"}, {"name": "Active(anon)", "value": "1520940", "units": "kB"}, {"name": "Inactive(anon)", "value": "824204", "units": "kB"}, {"name": "Active(file)", "value": "166052", "units": "kB"}, {"name": "Inactive(file)", "value": "136276", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "751900", "units": "kB"}, {"name": "Mapped", "value": "86332", "units": "kB"}, {"name": "Shmem", "value": "1593436", "units": "kB"}, {"name": "KReclaimable", "value": "109484", "units": "kB"}, {"name": "Slab", "value": "277308", "units": "kB"}, {"name": "SReclaimable", "value": "109484", "units": "kB"}, {"name": "SUnreclaim", "value": "167824", "units": "kB"}, {"name": "KernelStack", "value": "9808", "units": "kB"}, {"name": "PageTables", "value": "19664", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3243428", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11136", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "4096", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "266568", "units": "kB"}, {"name": "DirectMap2M", "value": "18472960", "units": "kB"}, {"name": "DirectMap1G", "value": "249561088", "units": "kB"}]}' Nov 4 19:31:42 kjcf05n03 dcs-collectord[5670]: INFO Completed collection for memory_info (collection_process.py:59) Nov 4 19:31:42 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:43 kjcf05n03 dcs-collectord[5670]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 4 19:31:43 kjcf05n03 dcs-collectord[5670]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730770302.3930697], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730770302.6356275], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730770302.3262668, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 4 19:31:43 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:43 kjcf05n03 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 4 19:31:43 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:31:43 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:31:43 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 4 19:31:43 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 4 19:31:43 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 19:31:43 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 19:31:43 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:43 kjcf05n03 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 4 19:31:43 kjcf05n03 firmware-update-orc[5776]: Using config script: /etc/firmware_update_orc.conf Nov 4 19:31:43 kjcf05n03 firmware-update-orc[5776]: - Creating default directory: '/var/log/firmware-update-orc' Nov 4 19:31:43 kjcf05n03 firmware-update-orc[5776]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 4 19:31:43 kjcf05n03 firmware-update-orc[5776]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 4 19:31:43 kjcf05n03 firmware-update-orc[5776]: - Creating default directory: '/var/run/firmware-update-orc' Nov 4 19:31:43 kjcf05n03 firmware-update-orc[5776]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 4 19:31:43 kjcf05n03 firmware-update-orc[5776]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 4 19:31:44 kjcf05n03 firmware-update-orc-server[5814]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 19:31:44 kjcf05n03 firmware-update-orc[5776]: celery multi v5.2.7 (dawn-chorus) Nov 4 19:31:44 kjcf05n03 firmware-update-orc[5776]: > Starting nodes... Nov 4 19:31:44 kjcf05n03 firmware-update-orc[5776]: > worker1@kjcf05n03: OK Nov 4 19:31:44 kjcf05n03 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 4 19:31:44 kjcf05n03 firmware-update-orc-server[5816]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 19:31:44 kjcf05n03 firmware-update-orc-server[5816]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 19:31:44 kjcf05n03 firmware-update-orc-server[5816]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 19:31:44 kjcf05n03 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 4 19:31:44 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:44 kjcf05n03 systemd[3194]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:31:44 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:31:44 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:31:44 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 19:31:44 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 19:31:44 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 19:31:44 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 19:31:44 kjcf05n03 dbus-daemon[2141]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 19:31:44 kjcf05n03 dbus-daemon[2141]: [system] Reloaded configuration Nov 4 19:31:44 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 4 19:31:44 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 4 19:31:44 kjcf05n03 dbus-daemon[2141]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 19:31:44 kjcf05n03 dbus-daemon[2141]: [system] Reloaded configuration Nov 4 19:31:44 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 19:31:44 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 19:31:44 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 19:31:44 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 19:31:44 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:45 kjcf05n03 systemd[1]: Starting Manages hardware resources... Nov 4 19:31:45 kjcf05n03 ras-resource-manager-agent[5932]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 4 19:31:45 kjcf05n03 ras-resource-manager-agent[5918]: Starting ras-resource-manager-agent:[ OK ] Nov 4 19:31:45 kjcf05n03 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 4 19:31:45 kjcf05n03 ras-resource-manager-agent[5934]: INFO Starting the service handler (service_main_handler.py:98) Nov 4 19:31:45 kjcf05n03 ras-resource-manager-client[5934]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 4 19:31:45 kjcf05n03 systemd[1]: Started Manages hardware resources. Nov 4 19:31:45 kjcf05n03 ras-resource-manager-client[5934]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 19:31:45 kjcf05n03 ras-resource-manager-client[5944]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 19:31:45 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:45 kjcf05n03 systemd[3194]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:31:45 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:31:45 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:31:45 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 19:31:45 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 19:31:45 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:46 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 4 19:31:46 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:46 kjcf05n03 systemd[3194]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: Press Ctrl+C to exit. Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: Plugin support version 1.0 Nov 4 19:31:46 kjcf05n03 zabbix_agent2[6018]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 19:31:46 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:31:46 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:31:46 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:46 kjcf05n03 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 4 19:31:47 kjcf05n03 dcs-notification-sender[6094]: dcs-notification-senderd is stopped Nov 4 19:31:47 kjcf05n03 zabbix-agent2[6108]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 4 19:31:47 kjcf05n03 dcs-notification-sender[6094]: Starting notification-sender:[ OK ] Nov 4 19:31:47 kjcf05n03 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 4 19:31:47 kjcf05n03 zabbix-agent2[6110]: INFO DCS notification agent started. (agent.py:61) Nov 4 19:31:47 kjcf05n03 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 4 19:31:47 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:47 kjcf05n03 systemd[3194]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:31:47 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:31:47 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:31:47 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 19:31:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 19:31:48 kjcf05n03 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 4 19:31:48 kjcf05n03 dcs-collectord[6218]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 4 19:31:48 kjcf05n03 dcs-collectord[6218]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 4 19:31:48 kjcf05n03 dcs-bulk-data-sender[6218]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 4 19:31:48 kjcf05n03 dcs-bulk-data-sender[6189]: Starting bulk-data-sender:[ OK ] Nov 4 19:31:48 kjcf05n03 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 4 19:31:48 kjcf05n03 dcs-collectord[6220]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 4 19:31:48 kjcf05n03 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 4 19:31:48 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:49 kjcf05n03 systemd[3194]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:31:49 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:31:49 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:31:49 kjcf05n03 nscd[2196]: 2196 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 4 19:31:49 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 19:31:49 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 19:31:49 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 19:31:49 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 19:31:49 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 19:31:49 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 19:31:49 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 4 19:31:49 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 4 19:31:49 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 4 19:31:49 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 4 19:31:49 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 19:31:49 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 19:31:49 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 19:31:49 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 19:31:49 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 19:31:49 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 19:31:49 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 19:31:49 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 19:31:49 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 4 19:31:49 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 4 19:31:49 kjcf05n03 systemd[1]: Stopping System Security Services Daemon... Nov 4 19:31:49 kjcf05n03 sssd[nss][2599]: Shutting down (status = 0) Nov 4 19:31:49 kjcf05n03 sssd[be[implicit_files]][2503]: Shutting down (status = 0) Nov 4 19:31:49 kjcf05n03 python3.9[5240]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 4 19:31:49 kjcf05n03 python3.9[3194]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:31:49 kjcf05n03 systemd[1]: sssd.service: Succeeded. Nov 4 19:31:49 kjcf05n03 systemd[1]: Stopped System Security Services Daemon. Nov 4 19:31:49 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 4 19:31:49 kjcf05n03 sssd[sssd][6287]: Starting up Nov 4 19:31:50 kjcf05n03 sssd[be[implicit_files]][6288]: Starting up Nov 4 19:31:50 kjcf05n03 sssd[nss][6289]: Starting up Nov 4 19:31:50 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 4 19:31:50 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 19:31:50 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 19:31:50 kjcf05n00 mcfcli[3673891]: %3|1730770310.389|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:31:51 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 19:31:51 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 19:31:51 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 4 19:31:51 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 4 19:31:51 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 19:31:51 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 19:31:51 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure) defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 4 19:31:51 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure: defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 4 19:31:51 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure) defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 4 19:31:51 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure: defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 4 19:31:51 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 19:31:51 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 19:31:51 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 19:31:51 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 19:31:51 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 4 19:31:51 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 4 19:31:51 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:51 kjcf05n03 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 4 19:31:52 kjcf05n03 icinga2[6349]: [2024-11-04 19:31:51 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 4 19:31:52 kjcf05n03 icinga2[6349]: [2024-11-04 19:31:51 -0600] information/cli: Loading configuration file(s). Nov 4 19:31:52 kjcf05n03 icinga2[6349]: [2024-11-04 19:31:51 -0600] information/ConfigItem: Committing config item(s). Nov 4 19:31:52 kjcf05n03 icinga2[6349]: [2024-11-04 19:31:51 -0600] information/ApiListener: My API identity: kjcf05n03 Nov 4 19:31:52 kjcf05n03 icinga2[6349]: [2024-11-04 19:31:51 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 4 19:31:52 kjcf05n03 icinga2[6349]: [2024-11-04 19:31:51 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 4 19:31:52 kjcf05n03 icinga2[6349]: [2024-11-04 19:31:51 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 4 19:31:52 kjcf05n03 icinga2[6349]: [2024-11-04 19:31:51 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 4 19:31:52 kjcf05n03 icinga2[6349]: [2024-11-04 19:31:51 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 4 19:31:52 kjcf05n03 icinga2[6349]: [2024-11-04 19:31:51 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 4 19:31:52 kjcf05n03 icinga2[6349]: [2024-11-04 19:31:51 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 4 19:31:52 kjcf05n03 icinga2[6349]: [2024-11-04 19:31:51 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 4 19:31:52 kjcf05n03 icinga2[6349]: [2024-11-04 19:31:51 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 4 19:31:52 kjcf05n03 icinga2[6349]: [2024-11-04 19:31:51 -0600] information/cli: Closing console log. Nov 4 19:31:52 kjcf05n03 systemd[1]: Started Icinga host/service/network monitoring system. Nov 4 19:31:52 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 19:31:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 19:31:52 kjcf05n03 systemd[3194]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:31:52 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:31:52 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:31:53 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 19:31:53 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 19:31:53 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:53 kjcf05n03 systemd[1]: Started Icinga2 network monitor. Nov 4 19:31:53 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:53 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 19:31:53 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:31:53 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:31:53 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 19:31:53 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 19:31:53 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 19:31:53 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 19:31:54 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 4 19:31:54 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 4 19:31:54 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 4 19:31:54 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 4 19:31:54 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 19:31:54 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 19:31:54 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 19:31:54 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 19:31:54 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 4 19:31:54 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 4 19:31:54 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:54 kjcf05n03 systemd[1]: Starting Naming services LDAP client daemon.... Nov 4 19:31:54 kjcf05n03 nslcd[6961]: version 0.9.9 starting Nov 4 19:31:54 kjcf05n03 nslcd[6961]: accepting connections Nov 4 19:31:54 kjcf05n03 systemd[1]: Started Naming services LDAP client daemon.. Nov 4 19:31:54 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:55 kjcf05n03 systemd[3194]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:31:55 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:31:55 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:31:55 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 19:31:55 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 19:31:55 kjcf05n03 dcs-bulk-data-sender[6220]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 4 19:31:55 kjcf05n03 dcs-collectord[6220]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 4 19:31:55 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 19:31:55 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 19:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 19:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 19:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 19:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 19:31:56 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 19:31:56 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 19:31:56 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 19:31:56 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 19:31:56 kjcf05n03 systemd[1]: Reloading. Nov 4 19:31:56 kjcf05n03 systemd[1]: Starting DEAR Control Plane worker process... Nov 4 19:31:56 kjcf05n03 dearcpw[7206]: Using config script: /etc/dearcpw.conf Nov 4 19:31:56 kjcf05n03 dearcpw[7206]: - Creating default directory: '/var/log/dearcpw' Nov 4 19:31:56 kjcf05n03 dearcpw[7206]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 4 19:31:56 kjcf05n03 dearcpw[7206]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 4 19:31:56 kjcf05n03 dearcpw[7206]: - Creating default directory: '/var/run/dearcpw' Nov 4 19:31:56 kjcf05n03 dearcpw[7206]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 4 19:31:56 kjcf05n03 dearcpw[7206]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 4 19:31:57 kjcf05n03 dearcpw-server[7246]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 19:31:57 kjcf05n03 dearcpw[7206]: celery multi v5.2.7 (dawn-chorus) Nov 4 19:31:57 kjcf05n03 dearcpw[7206]: > Starting nodes... Nov 4 19:31:57 kjcf05n03 dearcpw[7206]: > dearcpw@kjcf05n03: OK Nov 4 19:31:57 kjcf05n03 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 4 19:31:57 kjcf05n03 dearcpw-server[7248]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 19:31:57 kjcf05n03 dearcpw-server[7248]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 19:31:57 kjcf05n03 dearcpw-server[7248]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 19:31:57 kjcf05n03 systemd[1]: Started DEAR Control Plane worker process. Nov 4 19:31:57 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:31:57 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:31:57 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 4 19:31:57 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 4 19:31:57 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 4 19:31:57 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 4 19:31:57 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 4 19:31:57 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 4 19:31:57 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 4 19:31:57 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 4 19:31:57 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:45952). Nov 4 19:31:57 kjcf05n01 rsyncd[3860178]: connect from kjcf05n03 (172.16.2.6) Nov 4 19:31:57 kjcf05n01 rsyncd[3860178]: rsync to puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 4 19:31:57 kjcf05n01 rsyncd[3860178]: receiving file list Nov 4 19:31:57 kjcf05n01 rsyncd[3860178]: sent 29 bytes received 333 bytes total size 10901 Nov 4 19:31:57 kjcf05n01 systemd[1]: rsyncd@658-172.16.2.2:873-172.16.2.6:45952.service: Succeeded. Nov 4 19:31:57 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 4 19:31:57 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 4 19:31:57 kjcf05n03 dcs-collectord[5670]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 19:31:57 kjcf05n03 dcs-collectord[5670]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 19:31:57 kjcf05n03 puppet[7448]: IEC: 017000000: Node is up and running: { "node": "kjcf05n03" } Nov 4 19:31:57 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 4 19:31:57 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 4 19:31:57 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 4 19:31:57 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 4 19:31:57 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 4 19:31:57 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 4 19:31:57 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 19:31:57 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 19:31:57 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 19:31:57 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 19:31:58 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 19:31:58 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 19:31:58 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 19:31:58 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 19:31:59 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 19:31:59 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 19:31:59 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 19:31:59 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 19:32:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 19:32:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 19:32:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 19:32:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 19:32:00 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 19:32:00 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 19:32:00 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 19:32:00 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 19:32:00 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 19:32:00 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 19:32:00 kjcf05n03 ipmievd[4009]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 4 19:32:00 kjcf05n03 ipmievd[4009]: System Event sensor - Timestamp Clock Sync Nov 4 19:32:00 kjcf05n03 systemd[1]: Reloading. Nov 4 19:32:00 kjcf05n03 ipmievd[4009]: System Event sensor - Timestamp Clock Sync Nov 4 19:32:00 kjcf05n03 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 4 19:32:01 kjcf05n03 diskless-swap[7639]: HA_PS_000: recovering journal Nov 4 19:32:01 kjcf05n03 systemd-udevd[1565]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 19:32:01 kjcf05n03 diskless-swap[7639]: HA_PS_000: clean, 2285/6400 files, 7056/25600 blocks Nov 4 19:32:01 kjcf05n03 diskless-swap[7639]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 4 19:32:01 kjcf05n03 diskless-swap[7639]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 4 19:32:01 kjcf05n03 diskless-swap[7639]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 4 19:32:01 kjcf05n03 diskless-swap[7639]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 4 19:32:01 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 4 19:32:01 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:32:01 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:32:01 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 4 19:32:01 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 4 19:32:01 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 19:32:01 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 19:32:01 kjcf05n03 systemd[1]: Stopping OpenSSH server daemon... Nov 4 19:32:01 kjcf05n03 systemd[1]: sshd.service: Succeeded. Nov 4 19:32:01 kjcf05n03 systemd[1]: Stopped OpenSSH server daemon. Nov 4 19:32:01 kjcf05n03 systemd[1]: Stopped target sshd-keygen.target. Nov 4 19:32:01 kjcf05n03 systemd[1]: Stopping sshd-keygen.target. Nov 4 19:32:01 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 4 19:32:01 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 4 19:32:01 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 4 19:32:01 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 4 19:32:01 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 4 19:32:02 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 19:32:02 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 19:32:02 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 19:32:02 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 19:32:02 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 19:32:02 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 19:32:03 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 19:32:03 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 19:32:03 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 19:32:03 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 19:32:04 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 19:32:04 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 19:32:04 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 19:32:04 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 19:32:04 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 19:32:04 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 19:32:04 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 19:32:04 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 19:32:04 kjcf05n03 systemd[1]: Reloading. Nov 4 19:32:04 kjcf05n03 systemd[1]: Set up automount opt-firmware.automount. Nov 4 19:32:05 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:32:05 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:32:05 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 4 19:32:05 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 4 19:32:05 kjcf05n03 systemd[1]: Reloading. Nov 4 19:32:05 kjcf05n03 systemd[1]: Set up automount mnt-llog.automount. Nov 4 19:32:05 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:32:05 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:32:05 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 19:32:05 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 19:32:05 kjcf05n03 systemd[1]: Reloading. Nov 4 19:32:05 kjcf05n03 systemd[1]: Set up automount usr-share-man.automount. Nov 4 19:32:05 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:32:06 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:32:06 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 4 19:32:06 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 4 19:32:06 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 4 19:32:06 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 4 19:32:06 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 4 19:32:06 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 4 19:32:06 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 19:32:06 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 19:32:06 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 19:32:06 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 19:32:06 kjcf05n03 systemd[1]: Reloading. Nov 4 19:32:06 kjcf05n03 systemd[1]: Starting Crash recovery kernel arming... Nov 4 19:32:06 kjcf05n03 kdumpctl[7883]: kdump: No kdump initial ramdisk found. Nov 4 19:32:06 kjcf05n03 kdumpctl[7883]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 4 19:32:06 kjcf05n03 dracut[7995]: dracut-049-135.git20210121.el8 Nov 4 19:32:07 kjcf05n03 dracut[7997]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 4 19:32:07 kjcf05n03 dracut[7997]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 19:32:07 kjcf05n03 dracut[7997]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 19:32:07 kjcf05n03 dracut[7997]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 4 19:32:07 kjcf05n03 dracut[7997]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 4 19:32:07 kjcf05n03 dracut[7997]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 19:32:07 kjcf05n03 dracut[7997]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 19:32:07 kjcf05n03 dracut[7997]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local dev holder Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + require_binaries mdadm expr Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _module_name=90hperaid Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ mdadm = \-\m ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for cmd in "$@" Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + find_binary mdadm Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for cmd in "$@" Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + find_binary expr Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n -h ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for dev in "${!host_fs_types[@]}" Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ nfs != *_raid_member ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + continue Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _ret=255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + ret=255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ 255 = 0 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ 255 = 255 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ module_depends hperaid Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: +++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: +++ set -x Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ depends Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo rootfs-block Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ return 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ _ret=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ return 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for _moddep in $(module_depends $_mod) Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all == *\ hperaid\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + add_dracutmodules+=' rootfs-block ' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ == *\ hperaid\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check_module rootfs-block Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _mod=rootfs-block Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ == *\ rootfs-block\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n '' ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + mods_checked_as_dep+=' rootfs-block ' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all == *\ rootfs-block\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + module_check rootfs-block 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 2 -eq 2 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _forced=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _ret=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + ret=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ 0 = 0 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ module_depends rootfs-block Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: +++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 19:32:07 kjcf05n03 kdumpctl[3194]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ depends Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo fs-lib Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ _ret=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ return 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for _moddep in $(module_depends $_mod) Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all == *\ rootfs-block\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + add_dracutmodules+=' fs-lib ' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ == *\ rootfs-block\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check_module fs-lib Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _mod=fs-lib Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n '' ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + mods_checked_as_dep+=' fs-lib ' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all == *\ fs-lib\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + module_check fs-lib 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 2 -eq 2 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _forced=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _ret=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + ret=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ 0 = 0 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ module_depends fs-lib Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: +++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ depends Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ return 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ _ret=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ return 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + mods_to_load+=' fs-lib ' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + mods_to_load+=' rootfs-block ' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + mods_to_load+=' hperaid ' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _mod=90kernel-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _mod=kernel-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check_module kernel-modules 1 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _mod=kernel-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all = all ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + module_check kernel-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 1 -eq 2 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + true Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _ret=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + ret=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ 0 != 0 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ module_depends kernel-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: +++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ depends Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ true Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ _ret=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ return 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + mods_to_load+=' kernel-modules ' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _mod=90kernel-modules-extra Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _mod=kernel-modules-extra Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check_module kernel-modules-extra 1 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _mod=kernel-modules-extra Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all = all ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + module_check kernel-modules-extra Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 1 -eq 2 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + true Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _ret=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + ret=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ 0 != 0 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ module_depends kernel-modules-extra Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: +++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ depends Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ true Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ _ret=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ return 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + mods_to_load+=' kernel-modules-extra ' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _mod=90kernel-network-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _mod=kernel-network-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check_module kernel-network-modules 1 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _mod=kernel-network-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all = all ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + module_check kernel-network-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 1 -eq 2 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _ret=255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + ret=255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ 255 != 0 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 1 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _mod=90livenet Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _mod=livenet Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check_module livenet 1 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _mod=livenet Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all = all ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + module_check livenet Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 1 -eq 2 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _ret=255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + ret=255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ 255 != 0 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 1 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _mod=90lvm Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _mod=lvm Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check_module lvm 1 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _mod=lvm Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all = all ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + module_check lvm Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 1 -eq 2 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + require_binaries lvm Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _module_name=90lvm Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ lvm = \-\m ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for cmd in "$@" Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + find_binary lvm Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n -h ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for fs in "${host_fs_types[@]}" Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ nfs = LVM*_member ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _ret=255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + ret=255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ 255 != 0 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 1 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _mod=90mdraid Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _mod=mdraid Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check_module mdraid 1 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _mod=mdraid Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all = all ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + module_check mdraid Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 1 -eq 2 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _rootdev Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + require_binaries mdadm expr Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _module_name=90mdraid Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ mdadm = \-\m ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for cmd in "$@" Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + find_binary mdadm Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for cmd in "$@" Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + find_binary expr Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n -h ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for dev in "${!host_fs_types[@]}" Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ nfs != *_raid_member ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + continue Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _ret=255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + ret=255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ 255 != 0 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 1 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _mod=90multipath Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _mod=multipath Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check_module multipath 1 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _mod=multipath Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all = all ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + module_check multipath Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 1 -eq 2 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _rootdev Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n -h ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for_each_host_dev_and_slaves is_mpath Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _func=is_mpath Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _dev Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for _dev in "${host_devs[@]}" Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + continue Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 1 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _ret=255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + ret=255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ 255 != 0 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 1 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _mod=90qemu Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _mod=qemu Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check_module qemu 1 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _mod=qemu Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all = all ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + module_check qemu Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 1 -eq 2 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n -h ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + type -P systemd-detect-virt Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ systemd-detect-virt --vm Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + vm=none Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + (( 1 != 0 )) Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _ret=255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + ret=255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ 255 != 0 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 1 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _mod=90qemu-net Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _mod=qemu-net Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check_module qemu-net 1 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _mod=qemu-net Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all = all ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + module_check qemu-net Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 1 -eq 2 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n -h ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + type -P systemd-detect-virt Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ systemd-detect-virt --vm Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + vm= Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + (( 1 != 0 )) Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _ret=255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + ret=255 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ 255 != 0 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + return 1 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _mod=90stratis Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + _mod=stratis Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check_module stratis 1 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _mod=stratis Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ all = all ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + module_check stratis Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 1 -eq 2 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _module_name=90stratis Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + local _ret=0 Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + [[ stratisd-init = \-\m ]] Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + for cmd in "$@" Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + find_binary stratisd-init Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 4 19:32:07 kjcf05n03 kdumpctl[7883]: + set +x Nov 4 19:32:07 kjcf05n03 dracut[7997]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 19:32:07 kjcf05n03 dracut[7997]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 4 19:32:07 kjcf05n03 dracut[7997]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 4 19:32:07 kjcf05n03 dracut[7997]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 4 19:32:07 kjcf05n03 dracut[7997]: memstrack is available Nov 4 19:32:07 kjcf05n03 dracut[7997]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 19:32:07 kjcf05n03 dracut[7997]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 19:32:07 kjcf05n03 dracut[7997]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 19:32:07 kjcf05n03 dracut[7997]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 19:32:07 kjcf05n03 dracut[7997]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 19:32:07 kjcf05n03 dracut[7997]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 19:32:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730770327', 'host':'kjcf05n03', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 4 19:32:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730770327', 'host':'kjcf05n03', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 4 19:32:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730770327'} Nov 4 19:32:08 kjcf05n03 dracut[7997]: *** Including module: bash *** Nov 4 19:32:08 kjcf05n03 dracut[7997]: *** Including module: systemd *** Nov 4 19:32:07 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730770327'} Nov 4 19:32:07 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:32:08 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 19:32:08 kjcf05n03 dracut[7997]: *** Including module: fips *** Nov 4 19:32:09 kjcf05n03 dracut[7997]: *** Including module: systemd-initrd *** Nov 4 19:32:09 kjcf05n03 dracut[7997]: *** Including module: watchdog-modules *** Nov 4 19:32:09 kjcf05n03 dracut[7997]: *** Including module: nss-softokn *** Nov 4 19:32:09 kjcf05n03 dracut[7997]: *** Including module: i18n *** Nov 4 19:32:09 kjcf05n03 dracut[7997]: No KEYMAP configured. Nov 4 19:32:09 kjcf05n03 dracut[7997]: *** Including module: network-legacy *** Nov 4 19:32:10 kjcf05n03 dracut[7997]: *** Including module: network *** Nov 4 19:32:10 kjcf05n03 dracut[7997]: *** Including module: ib_bonding *** Nov 4 19:32:10 kjcf05n03 dracut[7997]: *** Including module: drm *** Nov 4 19:32:10 kjcf05n00 mcfcli[3673891]: %3|1730770330.968|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 19:32:12 kjcf05n03 dcs-collectord[5670]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 19:32:12 kjcf05n03 dcs-collectord[5670]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 19:32:13 kjcf05n03 dracut[7997]: *** Including module: hperaid *** Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + install Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + local rule rule_path Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + inst_multiple cat expr Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.9WVpD8/initramfs -a -f cat expr Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + _ret=0 Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + (( 0 != 0 )) Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + : Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + inst_multiple -o mdmon Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.9WVpD8/initramfs -a -f -o mdmon Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + _ret=0 Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + (( 0 != 0 )) Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + : Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: ++ command -v partx Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + inst /usr/sbin/partx /sbin/partx Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + local _hostonly_install Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + [[ /usr/sbin/partx == \-\H ]] Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + [[ -e /tmp/dracut.9WVpD8/initramfs//sbin/partx ]] Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.9WVpD8/initramfs -f /usr/sbin/partx /sbin/partx Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + (( 0 != 0 )) Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + : Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: ++ command -v mdadm Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + local _hostonly_install Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + [[ -e /tmp/dracut.9WVpD8/initramfs//sbin/mdadm ]] Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.9WVpD8/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + (( 0 != 0 )) Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + : Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + [[ yes == \y\e\s ]] Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + local _raidconf Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: ++ cmdline Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: ++ local _activated dev line UUID Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: ++ declare -A _activated Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: ++ for dev in "${!host_fs_types[@]}" Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: ++ [[ nfs != *_raid_member ]] Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: ++ continue Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + _raidconf= Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + [[ -n '' ]] Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + inst_rules 64-md-raid.rules Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + local _target=/etc/udev/rules.d _rule _found Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + inst_dir /usr/lib/udev/rules.d Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + [[ -e /tmp/dracut.9WVpD8/initramfs//usr/lib/udev/rules.d ]] Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + inst_dir /etc/udev/rules.d Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + [[ -e /tmp/dracut.9WVpD8/initramfs//etc/udev/rules.d ]] Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + for _rule in "$@" Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + continue Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + continue Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + for r in '' $dracutbasedir/rules.d/ Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + [[ 64-md-raid.rules != /* ]] Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + continue Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + for r in '' $dracutbasedir/rules.d/ Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + continue Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + [[ -n '' ]] Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 4 19:32:13 kjcf05n03 kdumpctl[7883]: + set +x Nov 4 19:32:13 kjcf05n03 dracut[7997]: Skipping udev rule: 64-md-raid.rules Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + installkernel Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + instmods =drivers/md Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + local _optional=-o Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + local _silent Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + [[ '' = yes ]] Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + [[ =drivers/md = \-\c ]] Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + [[ =drivers/md = \-\s ]] Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + (( 1 == 0 )) Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.9WVpD8/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + _ret=0 Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + (( 0 != 0 )) Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + [[ -n '' ]] Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + _ret=0 Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + modules_loaded+='hperaid ' Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + '[' -n '' ']' Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + _d_mod=90kernel-modules Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + _d_mod=kernel-modules Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + [[ '' = yes ]] Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + dinfo '*** Including module: kernel-modules ***' Nov 4 19:32:14 kjcf05n03 kdumpctl[7883]: + set +x Nov 4 19:32:14 kjcf05n03 dracut[7997]: *** Including module: kernel-modules *** Nov 4 19:32:14 kjcf05n03 dracut[7997]: *** Including module: kernel-modules-extra *** Nov 4 19:32:15 kjcf05n03 dracut[7997]: *** Including module: kernel-network-modules *** Nov 4 19:32:15 kjcf05n03 dracut[7997]: *** Including module: diskless-mod *** Nov 4 19:32:15 kjcf05n03 dracut[7997]: *** Including module: fstab-sys *** Nov 4 19:32:15 kjcf05n03 dracut[7997]: *** Including module: nfs *** Nov 4 19:32:15 kjcf05n03 dracut[7997]: *** Including module: rootfs-block *** Nov 4 19:32:15 kjcf05n03 dracut[7997]: *** Including module: terminfo *** Nov 4 19:32:15 kjcf05n03 dracut[7997]: *** Including module: udev-rules *** Nov 4 19:32:15 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n03": interface became available Nov 4 19:32:16 kjcf05n03 dracut[7997]: Skipping udev rule: 91-permissions.rules Nov 4 19:32:16 kjcf05n03 dracut[7997]: Skipping udev rule: 80-drivers-modprobe.rules Nov 4 19:32:16 kjcf05n03 dracut[7997]: *** Including module: dracut-systemd *** Nov 4 19:32:16 kjcf05n03 dracut[7997]: *** Including module: usrmount *** Nov 4 19:32:16 kjcf05n03 dracut[7997]: *** Including module: base *** Nov 4 19:32:17 kjcf05n03 dracut[7997]: *** Including module: fs-lib *** Nov 4 19:32:17 kjcf05n03 dracut[7997]: *** Including module: kdumpbase *** Nov 4 19:32:17 kjcf05n03 dracut[7997]: *** Including module: memstrack *** Nov 4 19:32:17 kjcf05n03 dracut[7997]: *** Including module: shutdown *** Nov 4 19:32:17 kjcf05n03 dracut[7997]: *** Including module: squash *** Nov 4 19:32:18 kjcf05n03 dracut[7997]: *** Including modules done *** Nov 4 19:32:18 kjcf05n03 dracut[7997]: *** Installing kernel module dependencies *** Nov 4 19:32:18 kjcf05n03 dracut[7997]: *** Installing kernel module dependencies done *** Nov 4 19:32:18 kjcf05n03 dracut[7997]: *** Resolving executable dependencies *** Nov 4 19:32:18 kjcf05n00 zabbix-server[2392537]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 19:32:18 kjcf05n00 zabbix-server[2392537]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n03 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n03:system.uptime): 00:02:51\\"}}"' Nov 4 19:32:18 kjcf05n00 log_interesting_event.py[2392537]: Event '46595' acknowledged Nov 4 19:32:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730770339', 'host':'kjcf05n03', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128568 MiB (99.94% inode=100%);'}"] Nov 4 19:32:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128568 MiB (99.94% inode=100%);', 'message': 'DISK OK - free space: /tmp 128568 MiB (99.94% inode=100%);', 'value': 'ok', 'timestamp': '1730770339'} Nov 4 19:32:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:32:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730770339', 'host':'kjcf05n03', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.91, 1.87, 0.83'}"] Nov 4 19:32:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Load', 'description': 'OK - load average: 1.91, 1.87, 0.83', 'message': 'OK - load average: 1.91, 1.87, 0.83', 'value': 'ok', 'timestamp': '1730770339'} Nov 4 19:32:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:32:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730770339', 'host':'kjcf05n03', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 333 processes with STATE = RSZDT '}"] Nov 4 19:32:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Total Processes', 'description': 'PROCS OK: 333 processes with STATE = RSZDT ', 'message': 'PROCS OK: 333 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730770339'} Nov 4 19:32:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:32:19 kjcf05n03 dracut[7997]: *** Resolving executable dependencies done*** Nov 4 19:32:19 kjcf05n03 dracut[7997]: *** Hardlinking files *** Nov 4 19:32:19 kjcf05n03 dracut[7997]: *** Hardlinking files done *** Nov 4 19:32:19 kjcf05n03 dracut[7997]: *** Generating early-microcode cpio image *** Nov 4 19:32:19 kjcf05n03 dracut[7997]: *** Constructing AuthenticAMD.bin **** Nov 4 19:32:19 kjcf05n03 dracut[7997]: *** Store current command line parameters *** Nov 4 19:32:19 kjcf05n03 dracut[7997]: Stored kernel commandline: Nov 4 19:32:19 kjcf05n03 dracut[7997]: rd.driver.pre=sd_mod Nov 4 19:32:19 kjcf05n03 dracut[7997]: rd.driver.pre=nvme Nov 4 19:32:19 kjcf05n03 dracut[7997]: rd.driver.pre=ipmi_si Nov 4 19:32:19 kjcf05n03 dracut[7997]: rd.driver.pre=ipmi_devintf Nov 4 19:32:19 kjcf05n03 dracut[7997]: rd.driver.pre=ipmi_msghandler Nov 4 19:32:19 kjcf05n03 dracut[7997]: nameserver=172.16.2.2 Nov 4 19:32:19 kjcf05n03 dracut[7997]: nameserver=127.0.0.1 Nov 4 19:32:19 kjcf05n03 dracut[7997]: nameserver=172.16.2.2 Nov 4 19:32:19 kjcf05n03 dracut[7997]: nameserver=127.0.0.1 Nov 4 19:32:19 kjcf05n03 dracut[7997]: ifname=kdump-meth0:00:09:3d:06:9a:1a team=mgmt0:kdump-meth0 Nov 4 19:32:19 kjcf05n03 dracut[7997]: rd.neednet Nov 4 19:32:19 kjcf05n03 dracut[7997]: kdumpnic=mgmt0 Nov 4 19:32:19 kjcf05n03 dracut[7997]: bootdev=mgmt0 Nov 4 19:32:19 kjcf05n03 dracut[7997]: *** Install squash loader *** Nov 4 19:32:20 kjcf05n03 dracut[7997]: *** Squashing the files inside the initramfs *** Nov 4 19:32:20 kjcf05n03 dracut[7997]: *** Squashing the files inside the initramfs done *** Nov 4 19:32:20 kjcf05n03 dracut[7997]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 4 19:32:20 kjcf05n03 dracut[7997]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 4 19:32:21 kjcf05n03 kdumpctl[7883]: kdump: kexec: loaded kdump kernel Nov 4 19:32:21 kjcf05n03 kdumpctl[7883]: kdump: Starting kdump: [OK] Nov 4 19:32:21 kjcf05n03 systemd[1]: Started Crash recovery kernel arming. Nov 4 19:32:21 kjcf05n03 systemd[1]: Reloading. Nov 4 19:32:21 kjcf05n03 systemd[3194]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:32:21 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:32:21 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:32:21 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 4 19:32:21 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 4 19:32:21 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 4 19:32:21 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 4 19:32:21 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 4 19:32:21 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 4 19:32:21 kjcf05n03 ifdown[14610]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 19:32:21 kjcf05n03 ifdown[14611]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:32:21 kjcf05n03 ifdown[14612]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:32:21 kjcf05n00 zabbix-server[2392565]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 19:32:21 kjcf05n00 zabbix-server[2392565]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 158.85\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 203.71\\"}}"' Nov 4 19:32:21 kjcf05n00 log_interesting_event.py[2392565]: Event '46597' acknowledged Nov 4 19:32:22 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 19:32:22 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 19:32:22 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 19:32:22 kjcf05n03 ifup[14686]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 19:32:22 kjcf05n03 ifup[14687]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:32:22 kjcf05n03 ifup[14688]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:32:25 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 4 19:32:26 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 19:32:27 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 19:32:27 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 19:32:27 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:32:27 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:32:27 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:32:27 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:32:27 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 19:32:27 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 19:32:27 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 19:32:27 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 19:32:27 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:32:27 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:32:27 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:32:27 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:32:27 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 4 19:32:27 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 4 19:32:27 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 4 19:32:27 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 4 19:32:27 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 4 19:32:27 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 4 19:32:27 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 4 19:32:27 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 4 19:32:27 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 4 19:32:27 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 4 19:32:27 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 4 19:32:27 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 4 19:32:27 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 4 19:32:27 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 4 19:32:27 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 4 19:32:27 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 4 19:32:27 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 4 19:32:27 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 4 19:32:27 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 4 19:32:27 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 4 19:32:27 kjcf05n03 ifdown[14855]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 19:32:27 kjcf05n03 ifdown[14856]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:32:27 kjcf05n03 ifdown[14857]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:32:27 kjcf05n00 mcfcli[3673891]: %3|1730770347.022|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:32:27 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 19:32:27 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 19:32:27 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 19:32:27 kjcf05n03 ifup[14930]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 19:32:27 kjcf05n03 ifup[14931]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:32:27 kjcf05n03 ifup[14932]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:32:27 kjcf05n03 dcs-collectord[5670]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 19:32:27 kjcf05n03 dcs-collectord[5670]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 19:32:29 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 4 19:32:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730770349', 'host':'kjcf05n03', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(112.0B/360.0B), ib1=(56.0B/120.0B), icl0=(5.0kB/6.6kB), lo=(600.0B/600.0B), meth0=(1541.0MB/7.8MB), mgmt0=(1477.7MB/7.8MB)'}"] Nov 4 19:32:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(112.0B/360.0B), ib1=(56.0B/120.0B), icl0=(5.0kB/6.6kB), lo=(600.0B/600.0B), meth0=(1541.0MB/7.8MB), mgmt0=(1477.7MB/7.8MB)', 'message': 'NET OK - (Rx/Tx) ib0=(112.0B/360.0B), ib1=(56.0B/120.0B), icl0=(5.0kB/6.6kB), lo=(600.0B/600.0B), meth0=(1541.0MB/7.8MB), mgmt0=(1477.7MB/7.8MB)', 'value': 'ok', 'timestamp': '1730770349'} Nov 4 19:32:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:32:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730770349', 'host':'kjcf05n03', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 4 19:32:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730770349'} Nov 4 19:32:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:32:31 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 19:32:32 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 19:32:32 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 19:32:32 kjcf05n03 systemd[1]: Reloading. Nov 4 19:32:32 kjcf05n03 systemd[1]: Starting Corosync Cluster Engine... Nov 4 19:32:32 kjcf05n03 await_ha_peer[15145]: Waiting for HA peer kjcf05n02 Nov 4 19:32:33 kjcf05n03 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 4 19:32:33 kjcf05n03 await_ha_peer[15145]: Peer kjcf05n02 has started, starting HA Nov 4 19:32:34 kjcf05n03 systemd[1]: Started Corosync Cluster Engine. Nov 4 19:32:34 kjcf05n03 systemd[1]: Started Fast STONITH daemon. Nov 4 19:32:34 kjcf05n03 fstonithd.py[15182]: Listening for kdump packets from partner Nov 4 19:32:34 kjcf05n03 systemd[1]: Reloading. Nov 4 19:32:34 kjcf05n03 systemd[3194]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:32:34 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:32:34 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:32:34 kjcf05n03 systemd[1]: Reloading. Nov 4 19:32:34 kjcf05n03 systemd[1]: Reached target resource-agents dependencies. Nov 4 19:32:34 kjcf05n03 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 4 19:32:34 kjcf05n03 systemd[1]: Reloading. Nov 4 19:32:35 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 19:32:35 kjcf05n03 puppet-agent[3597]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 4 19:32:35 kjcf05n03 puppet[3597]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 4 19:32:35 kjcf05n03 puppet-agent[3597]: Applied catalog in 93.97 seconds Nov 4 19:32:35 kjcf05n03 puppet[3597]: Notice: Applied catalog in 93.97 seconds Nov 4 19:32:35 kjcf05n03 systemd[1]: Started Puppet agent. Nov 4 19:32:35 kjcf05n03 systemd[1]: Started Collect SAS Health Report every hour. Nov 4 19:32:35 kjcf05n03 systemd[1]: Reached target Timers. Nov 4 19:32:35 kjcf05n03 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 4 19:32:35 kjcf05n03 systemd[1]: Started Startup script for gateway-ec-node. Nov 4 19:32:35 kjcf05n03 systemd[1]: Started Startup script for monitoring-ec-node. Nov 4 19:32:35 kjcf05n03 systemd[1]: Started Service to do FW and inventory check on boot. Nov 4 19:32:35 kjcf05n03 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 4 19:32:35 kjcf05n03 systemd[1]: Starting Set absolute GEM time... Nov 4 19:32:35 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 19:32:35 kjcf05n03 wce-disable.sh[15337]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 4 19:32:35 kjcf05n03 systemd[1]: disable-write-cache.service: Succeeded. Nov 4 19:32:35 kjcf05n03 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 4 19:32:35 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 19:32:35 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 19:32:35 kjcf05n03 systemd[1]: set_gem_time.service: Succeeded. Nov 4 19:32:35 kjcf05n03 systemd[1]: Started Set absolute GEM time. Nov 4 19:32:35 kjcf05n03 python3.9[15335]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 4 19:32:35 kjcf05n03 python3.9[15335]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 4 19:32:35 kjcf05n03 gateway-ec-node.py[15334]: Starting gateway-ec-node service Nov 4 19:32:35 kjcf05n03 RFSF-API[15333]: INFO[2024-11-04T19:32:35-06:00] Datapath API RESTful Service starting Nov 4 19:32:35 kjcf05n03 dp-api-server-node[15333]: INFO[2024-11-04T19:32:35-06:00] Datapath API RESTful Service starting Nov 4 19:32:35 kjcf05n03 RFSF-API[15333]: INFO[2024-11-04T19:32:35-06:00] Running in production mode, starting dbus event listener Nov 4 19:32:35 kjcf05n03 dp-api-server-node[15333]: INFO[2024-11-04T19:32:35-06:00] Running in production mode, starting dbus event listener Nov 4 19:32:35 kjcf05n03 RFSF-API[15333]: INFO[2024-11-04T19:32:35-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 19:32:35 kjcf05n03 dp-api-server-node[15333]: INFO[2024-11-04T19:32:35-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 19:32:35 kjcf05n03 RFSF-API[15333]: INFO[2024-11-04T19:32:35-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 19:32:35 kjcf05n03 dp-api-server-node[15333]: INFO[2024-11-04T19:32:35-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 19:32:35 kjcf05n03 RFSF-API[15333]: INFO[2024-11-04T19:32:35-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 19:32:35 kjcf05n03 dp-api-server-node[15333]: INFO[2024-11-04T19:32:35-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 19:32:35 kjcf05n03 RFSF-API[15333]: INFO[2024-11-04T19:32:35-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 19:32:35 kjcf05n03 dp-api-server-node[15333]: INFO[2024-11-04T19:32:35-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 19:32:35 kjcf05n03 RFSF-API[15333]: INFO[2024-11-04T19:32:35-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 19:32:35 kjcf05n03 dp-api-server-node[15333]: INFO[2024-11-04T19:32:35-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 19:32:35 kjcf05n03 RFSF-API[15333]: INFO[2024-11-04T19:32:35-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 19:32:35 kjcf05n03 dp-api-server-node[15333]: INFO[2024-11-04T19:32:35-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 19:32:35 kjcf05n03 RFSF-API[15333]: INFO[2024-11-04T19:32:35-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 19:32:35 kjcf05n03 dp-api-server-node[15333]: INFO[2024-11-04T19:32:35-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 19:32:35 kjcf05n03 RFSF-API[15333]: INFO[2024-11-04T19:32:35-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 19:32:35 kjcf05n03 dp-api-server-node[15333]: INFO[2024-11-04T19:32:35-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 19:32:35 kjcf05n03 RFSF-API[15333]: INFO[2024-11-04T19:32:35-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 19:32:35 kjcf05n03 dp-api-server-node[15333]: INFO[2024-11-04T19:32:35-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 19:32:35 kjcf05n03 RFSF-API[15333]: INFO[2024-11-04T19:32:35-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 19:32:35 kjcf05n03 dp-api-server-node[15333]: INFO[2024-11-04T19:32:35-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 19:32:40 kjcf05n00 mcfcli[3673891]: %3|1730770360.969|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 19:32:42 kjcf05n03 dcs-collectord[5670]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 19:32:42 kjcf05n03 systemd[1]: Reloading. Nov 4 19:32:42 kjcf05n03 dcs-collectord[5670]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 19:32:42 kjcf05n03 dcs-collectord[5670]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 19:32:42 kjcf05n03 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 4 19:32:42 kjcf05n03 systemd[1]: Reloading. Nov 4 19:32:43 kjcf05n03 systemd[1]: Starting Cluster Controlled lcnmon... Nov 4 19:32:43 kjcf05n03 diskmonitor_pre[15791]: Key management is currently disabled.DEAR disabled Nov 4 19:32:43 kjcf05n03 systemd[1]: Started Cluster Controlled diskmonitor. Nov 4 19:32:44 kjcf05n00 httpd[1812020]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-B): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n03', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 4 19:32:45 kjcf05n03 sh[15843]: LNET configured: New Created Nov 4 19:32:45 kjcf05n03 systemd[1]: Started Cluster Controlled lcnmon. Nov 4 19:32:45 kjcf05n03 LCNmon[17877]: Interface ib0 is up Nov 4 19:32:45 kjcf05n03 LCNmon[17877]: Interface ib1 is up Nov 4 19:32:45 kjcf05n03 systemd[1]: nodebootchecks.service: Succeeded. Nov 4 19:32:46 kjcf05n00 zabbix-server[2392916]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 19:32:46 kjcf05n00 zabbix-server[2392916]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 373.62\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 267.9\\"}}"' Nov 4 19:32:46 kjcf05n00 log_interesting_event.py[2392916]: Event '46599' acknowledged Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: /var/run/diskmonitor does not exist, creating Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: Creating /var/run/diskmonitor/disk Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: Creating /var/run/diskmonitor/encl Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: Creating /var/run/diskmonitor/cli Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: RAS_Interlocks_enabled: 1 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: Using default ssd ids: HUSSL4010ASS600 , Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: add handler for sig: 14 sa_flags: 10000004 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: add handler for sig: 1 sa_flags: 10000004 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: add handler for sig: 2 sa_flags: 00000004 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: add handler for sig: 15 sa_flags: 00000004 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: add handler for sig: 6 sa_flags: 00000004 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: add handler for sig: 3 sa_flags: 00000004 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: add handler for sig: 30 sa_flags: 00000004 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: add handler for sig: 20 sa_flags: 00000004 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: add handler for sig: 10 sa_flags: 10000004 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: add handler for sig: 11 sa_flags: 00000004 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: add handler for sig: 7 sa_flags: 00000004 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: add handler for sig: 4 sa_flags: 00000004 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: add handler for sig: 8 sa_flags: 00000004 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: init_watch: /var/run/diskmonitor/encl initialized Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: init_watch: /var/run/diskmonitor/disk initialized Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: Using HA Baton locks - key: diskmonitor Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: Baton will be held for at most 570 seconds Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: DMMP Enabled: 0 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: random seed: 30fa686d Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: NVMe Enclosure: 1 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: ZFS Enclosure: 0 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: Dbus, Initialized Connection Successfully Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: int_catcher_thread: thread start Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: Received dbus message 4 org.freedesktop.DBus -> :1.92 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b07bec_S4EUNF0MA05386M encl_slot: 0 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b07bed_S4EUNF0MA05387D encl_slot: 0 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 4 19:32:47 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 19:32:47 kjcf05n03 openhpid[5576]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 4 19:32:47 kjcf05n03 openhpid[5576]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 4 19:32:47 kjcf05n03 systemd[1]: openhpid.service: Succeeded. Nov 4 19:32:47 kjcf05n03 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 4 19:32:47 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 19:32:47 kjcf05n03 systemd[1]: openhpid.service: Supervising process 18146 which is not our child. We'll most likely not notice when it exits. Nov 4 19:32:47 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 19:32:47 kjcf05n03 systemd[1]: Reached target Multi-User System. Nov 4 19:32:47 kjcf05n03 systemd[1]: Reached target Graphical Interface. Nov 4 19:32:47 kjcf05n03 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 4 19:32:47 kjcf05n03 dcs-collectord[5670]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 4 19:32:47 kjcf05n03 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 4 19:32:47 kjcf05n03 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 4 19:32:47 kjcf05n03 systemd[1]: Startup finished in 50.502s (kernel) + 2min 30.292s (userspace) = 3min 20.794s. Nov 4 19:32:47 kjcf05n03 openhpid[18146]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 19:32:47 kjcf05n03 openhpid[18146]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 19:32:47 kjcf05n03 openhpid[18146]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 19:32:47 kjcf05n03 openhpid[18146]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 19:32:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 19:32:49 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18397 (bash) Nov 4 19:32:49 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 4 19:32:49 kjcf05n03 systemd[1]: Reached target Host and Network Name Lookups. Nov 4 19:32:49 kjcf05n03 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 4 19:32:49 kjcf05n03 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 4 19:32:49 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 4 19:32:49 kjcf05n03 LCNmon[17877]: 10.16.100.58 is unreachable via ib0 Nov 4 19:32:49 kjcf05n03 LCNmon[17877]: Can ping through interface ib0 Nov 4 19:32:49 kjcf05n03 LCNmon[17877]: Can ping through interface ib1 Nov 4 19:32:49 kjcf05n03 LCNmon[17877]: NIC ib0, initial state UP Nov 4 19:32:49 kjcf05n03 LCNmon[17877]: NIC ib1, initial state UP Nov 4 19:32:49 kjcf05n03 LCNmon[17877]: LCNstat initial state UP Nov 4 19:32:49 kjcf05n03 LCNmon[17877]: LCNmon monitoring hosts kjcf05n03 and kjcf05n02 Nov 4 19:32:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730770371', 'host':'kjcf05n03', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.7% (4406512 kB) used.'}"] Nov 4 19:32:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'RAM usage', 'description': 'OK - 1.7% (4406512 kB) used.', 'message': 'OK - 1.7% (4406512 kB) used.', 'value': 'ok', 'timestamp': '1730770371'} Nov 4 19:32:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 4 19:32:53 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 4 19:32:57 kjcf05n03 dcs-collectord[5670]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 19:32:57 kjcf05n03 dcs-collectord[5670]: WARNING No data collected (hpi_parser.py:353) Nov 4 19:33:02 kjcf05n00 mcfcli[3673891]: %3|1730770382.854|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:33:11 kjcf05n03 ipmievd[4009]: System Event sensor - Timestamp Clock Sync Nov 4 19:33:10 kjcf05n00 mcfcli[3673891]: %3|1730770390.969|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 19:33:12 kjcf05n03 ipmievd[3194]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:33:12 kjcf05n03 dcs-collectord[5670]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 19:33:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730770396', 'host':'kjcf05n03', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 4 19:33:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730770396'} Nov 4 19:33:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b07bed_S4EUNF0MA05387D encl_sn: USE26000024VS001, slot: 2 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 4 19:33:26 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 4 19:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T19:33:27.253368806-06:00 level=info msg="Completed cleanup jobs" duration=26.385245ms Nov 4 19:33:27 kjcf05n03 dcs-collectord[5670]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 19:33:34 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE2600002IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 19:33:34 kjcf05n03 ras-resource-manager-agent[5934]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "f8b13506-9b15-11ef-acd7-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 4 19:33:34 kjcf05n03 ras-resource-manager-agent[5934]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'f8b13506-9b15-11ef-acd7-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 4 19:33:34 kjcf05n03 ras-resource-manager-agent[5934]: INFO Submitting new device inserted signal, starting to qualify drive: f8b13506-9b15-11ef-acd7-00093d069a1b (admin_action.py:110) Nov 4 19:33:34 kjcf05n02 firmware-update-orc-server[5878]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "07801ae4-2218-4afa-aa9e-1c501d5b1309"} (logger.py:65) Nov 4 19:33:34 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 145519 (get_disk_device) Nov 4 19:33:34 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 4 19:33:34 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 4 19:33:34 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'f8b13506-9b15-11ef-acd7-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 19:33:34 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'f8b13506-9b15-11ef-acd7-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 19:33:34 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': 'f8b13506-9b15-11ef-acd7-00093d069a1b', 'response ID': 'f8bc1b60-9b15-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 19:33:34 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: f8bc1b60-9b15-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 19:33:34 kjcf05n02 ccp-client[145542]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 19:33:34 kjcf05n02 ccp-client[145542]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 19:33:34 kjcf05n02 ccp-client[145551]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 19:33:34 kjcf05n02 ccp-client[145542]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 19:33:34 kjcf05n02 ccp-client[145542]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 19:33:34 kjcf05n02 ccp-client[145551]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 19:33:34 kjcf05n02 ccp-client[145551]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 19:33:34 kjcf05n03 diskmonitor[17298]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 19:33:34 kjcf05n03 ras-resource-manager-agent[5934]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "f904e304-9b15-11ef-acd7-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 4 19:33:34 kjcf05n03 ras-resource-manager-agent[5934]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'f904e304-9b15-11ef-acd7-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 4 19:33:34 kjcf05n03 ras-resource-manager-agent[5934]: INFO Submitting new device inserted signal, starting to qualify drive: f904e304-9b15-11ef-acd7-00093d069a1b (admin_action.py:110) Nov 4 19:33:34 kjcf05n03 firmware-update-orc-server[5890]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "fda6d672-4a49-44ce-9e0b-22b7c0cfd7b7"} (logger.py:65) Nov 4 19:33:34 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'f904e304-9b15-11ef-acd7-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 19:33:34 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'f904e304-9b15-11ef-acd7-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 19:33:34 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': 'f904e304-9b15-11ef-acd7-00093d069a1b', 'response ID': 'f90c652a-9b15-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 19:33:34 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: f90c652a-9b15-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 19:33:37 kjcf05n02 DRVFW[145704]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 19:33:37 kjcf05n02 ccp-client[145707]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 19:33:38 kjcf05n02 ccp-client[145707]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 19:33:38 kjcf05n02 ccp-client[145739]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 19:33:38 kjcf05n02 ccp-client[145739]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 19:33:38 kjcf05n02 ccp-client[145739]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 19:33:38 kjcf05n02 ccp-client[145707]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 19:33:38 kjcf05n02 ccp-client[145707]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 19:33:38 kjcf05n02 firmware-update-orc-server[5878]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 4 19:33:39 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: f8bc1b60-9b15-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 19:33:39 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': 'f8b13506-9b15-11ef-acd7-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'f8b13506-9b15-11ef-acd7-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}}} (logger.py:65) Nov 4 19:33:39 kjcf05n03 ras-resource-manager-agent[5934]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'f8b13506-9b15-11ef-acd7-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}} (resource_admin.py:98) Nov 4 19:33:39 kjcf05n03 ras-resource-manager-agent[5934]: INFO Drive qualification complete responding: f8b13506-9b15-11ef-acd7-00093d069a1b (admin_action.py:205) Nov 4 19:33:39 kjcf05n03 ras-resource-manager-agent[5934]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "f8b13506-9b15-11ef-acd7-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} (interesting_event.py:59) Nov 4 19:33:40 kjcf05n00 mcfcli[3673891]: %3|1730770420.970|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:33:41 kjcf05n03 diskmonitor[17298]: 4VS001, slot: 12 Nov 4 19:33:41 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 4 19:33:41 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 4 19:33:41 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 4 19:33:41 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 4 19:33:41 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 4 19:33:41 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b07bec_S4EUNF0MA05386M encl_sn: USE26000024VS001, slot: 1 Nov 4 19:33:41 kjcf05n03 diskmonitor[17298]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 4 19:33:41 kjcf05n03 diskmonitor[17298]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 4 19:33:41 kjcf05n03 diskmonitor[17298]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 4 19:33:41 kjcf05n03 diskmonitor[17298]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 19:33:41 kjcf05n03 diskmonitor[17298]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 4 19:33:41 kjcf05n03 diskmonitor[17298]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "f8b13506-9b15-11ef-acd7-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 4 19:33:41 kjcf05n03 diskmonitor[17298]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 19:33:41 kjcf05n03 diskmonitor[17298]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 4 19:33:41 kjcf05n03 diskmonitor[17298]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "f904e304-9b15-11ef-acd7-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 4 19:33:41 kjcf05n03 diskmonitor[17298]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 19:33:41 kjcf05n03 diskmonitor[17298]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 19:33:42 kjcf05n00 mcfcli[3673891]: %3|1730770422.851|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:33:44 kjcf05n03 chronyd[5176]: Selected source 172.16.2.1 Nov 4 19:33:44 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22273 (get_disk_device) Nov 4 19:33:45 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 4 19:33:45 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 4 19:33:45 kjcf05n03 ccp-client[22296]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 19:33:45 kjcf05n03 ccp-client[22296]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 19:33:45 kjcf05n03 ccp-client[22322]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 19:33:45 kjcf05n03 ccp-client[22296]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 19:33:45 kjcf05n03 ccp-client[22322]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 19:33:45 kjcf05n03 ccp-client[22296]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 19:33:45 kjcf05n03 ccp-client[22322]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 19:33:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730770427}"] Nov 4 19:33:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730770427, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:33:47 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:33:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730770427}"] Nov 4 19:33:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730770427, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:33:47 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:33:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730770427}"] Nov 4 19:33:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730770427, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:33:47 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:33:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730770427}"] Nov 4 19:33:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730770427, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:33:47 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:33:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730770427}"] Nov 4 19:33:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730770427, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:33:47 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:33:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730770427}"] Nov 4 19:33:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730770427, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:33:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:33:48 kjcf05n03 DRVFW[22612]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 19:33:48 kjcf05n03 ccp-client[22613]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 19:33:48 kjcf05n03 ccp-client[22613]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 19:33:48 kjcf05n03 ccp-client[22622]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 19:33:48 kjcf05n03 ccp-client[22613]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 19:33:48 kjcf05n03 ccp-client[22613]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 19:33:48 kjcf05n03 ccp-client[22622]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 19:33:48 kjcf05n03 ccp-client[22622]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 19:33:48 kjcf05n03 firmware-update-orc-server[5890]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 4 19:33:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730770427}"] Nov 4 19:33:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730770427, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:33:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:33:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730770427}"] Nov 4 19:33:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730770427, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:33:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:33:49 kjcf05n03 systemd[1]: Unmounting /mnt/llog... Nov 4 19:33:49 kjcf05n03 systemd[1]: mnt-llog.mount: Succeeded. Nov 4 19:33:49 kjcf05n03 systemd[1]: Unmounted /mnt/llog. Nov 4 19:33:50 kjcf05n03 ras-resource-manager-agent[5934]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'f904e304-9b15-11ef-acd7-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 4 19:33:50 kjcf05n03 ras-resource-manager-agent[5934]: INFO Drive qualification complete responding: f904e304-9b15-11ef-acd7-00093d069a1b (admin_action.py:205) Nov 4 19:33:50 kjcf05n03 ras-resource-manager-agent[5934]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "f904e304-9b15-11ef-acd7-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (interesting_event.py:59) Nov 4 19:33:49 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: f90c652a-9b15-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 19:33:49 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': 'f904e304-9b15-11ef-acd7-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'f904e304-9b15-11ef-acd7-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}}} (logger.py:65) Nov 4 19:33:53 kjcf05n03 ras-resource-manager-agent[5934]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "f8b13506-9b15-11ef-acd7-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} (service_main_handler.py:66) Nov 4 19:33:53 kjcf05n03 ras-resource-manager-agent[5934]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'f8b13506-9b15-11ef-acd7-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}} (resource_admin.py:98) Nov 4 19:33:53 kjcf05n03 ras-resource-manager-agent[5934]: INFO Device qualification response has been acknowledged: f8b13506-9b15-11ef-acd7-00093d069a1b (admin_action.py:151) Nov 4 19:33:53 kjcf05n03 ras-resource-manager-agent[5934]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "f904e304-9b15-11ef-acd7-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (service_main_handler.py:66) Nov 4 19:33:53 kjcf05n03 ras-resource-manager-agent[5934]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'f904e304-9b15-11ef-acd7-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 4 19:33:53 kjcf05n03 ras-resource-manager-agent[5934]: INFO Device qualification response has been acknowledged: f904e304-9b15-11ef-acd7-00093d069a1b (admin_action.py:151) Nov 4 19:33:55 kjcf05n03 python3.9[5240]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 4 19:33:56 kjcf05n03 python3.9[3194]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "f8b13506-9b15-11ef-acd7-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: Dbus, handle_ingress_ras_signals, uuid: f8b13506-9b15-11ef-acd7-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "f8b13506-9b15-11ef-acd7-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "f904e304-9b15-11ef-acd7-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: Dbus, handle_ingress_ras_signals, uuid: f904e304-9b15-11ef-acd7-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "f904e304-9b15-11ef-acd7-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 19:33:56 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 19:33:57 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 19:33:58 kjcf05n03 diskmonitor[17298]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 19:34:04 kjcf05n03 diskmonitor[17298]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 19:34:04 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 19:34:04 kjcf05n03 diskmonitor[17298]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 19:34:04 kjcf05n03 diskmonitor[17298]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 19:34:04 kjcf05n03 diskmonitor[17298]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 19:34:04 kjcf05n03 diskmonitor[17298]: leaving test state: 1 next state: 2 Nov 4 19:34:04 kjcf05n03 diskmonitor[17298]: lock req: no timeout Nov 4 19:34:04 kjcf05n03 diskmonitor[17298]: leaving test state: 2 next state: 4 Nov 4 19:34:04 kjcf05n03 diskmonitor[17298]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 19:34:11 kjcf05n00 mcfcli[3673891]: %3|1730770451.048|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:34:21 kjcf05n00 mcfcli[3673891]: %3|1730770461.336|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:34:33 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31464 deleted. Nov 4 19:34:41 kjcf05n00 mcfcli[3673891]: %3|1730770481.049|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 19:34:55 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 4 19:34:55 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 19:34:55 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 4 19:34:58 kjcf05n00 mcfcli[3673891]: %3|1730770498.431|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:35:05 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 4 19:35:05 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 19:35:05 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 4 19:35:08 kjcf05n03 dcs-collectord[5670]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 4 19:35:11 kjcf05n00 mcfcli[3673891]: %3|1730770511.049|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 19:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730770517}"] Nov 4 19:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730770517, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:35:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:35:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:35:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:35:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:35:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:35:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:35:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:35:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:35:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:35:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:35:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:35:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:35:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:35:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.969909ms Nov 4 19:35:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:35:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.969909ms Nov 4 19:35:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:35:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:35:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730770517}"] Nov 4 19:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730770517, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:35:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:35:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:35:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:35:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:35:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:35:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:35:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:35:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:35:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:35:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:35:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:35:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:35:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:35:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.665559ms Nov 4 19:35:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:35:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.665559ms Nov 4 19:35:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:35:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:35:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:35:20 kjcf05n03 diskmonitor[17298]: lock acquired Nov 4 19:35:20 kjcf05n03 diskmonitor[17298]: leaving test state: 4 next state: 8 Nov 4 19:35:36 kjcf05n00 mcfcli[3673891]: %3|1730770536.058|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:35:36 kjcf05n00 python3.9[2394734]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 19:35:39 kjcf05n03 diskmonitor[17298]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 4 19:35:39 kjcf05n03 diskmonitor[17298]: leaving test state: 8 next state: 20 Nov 4 19:35:39 kjcf05n03 diskmonitor[17298]: leaving test state: 20 next state: 40 Nov 4 19:35:39 kjcf05n03 diskmonitor[17298]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset f91b90000 Nov 4 19:35:39 kjcf05n03 diskmonitor[17298]: leaving test state: 40 next state: 80 Nov 4 19:35:41 kjcf05n00 mcfcli[3673891]: %3|1730770541.049|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:35:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730770250', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 19:35:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730770250'} Nov 4 19:35:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:35:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730770250', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 19:35:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730770250'} Nov 4 19:35:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:36:11 kjcf05n00 mcfcli[3673891]: %3|1730770571.049|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 19:36:14 kjcf05n00 mcfcli[3673891]: %3|1730770574.475|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:36:37 kjcf05n03 diskmonitor[17298]: leaving test state: 80 next state: 100 Nov 4 19:36:37 kjcf05n03 diskmonitor[17298]: lock release: time: Mon Nov 4 19:36:29 2024 Nov 4 19:36:37 kjcf05n03 diskmonitor[17298]: leaving test state: 100 next state: 1 Nov 4 19:36:41 kjcf05n00 mcfcli[3673891]: %3|1730770601.049|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 19:36:54 kjcf05n00 mcfcli[3673891]: %3|1730770614.027|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:37:11 kjcf05n00 mcfcli[3673891]: %3|1730770631.050|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 19:37:34 kjcf05n00 mcfcli[3673891]: %3|1730770654.024|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:37:41 kjcf05n00 mcfcli[3673891]: %3|1730770661.472|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 19:38:11 kjcf05n00 mcfcli[3673891]: %3|1730770691.971|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 19:38:14 kjcf05n00 mcfcli[3673891]: %3|1730770694.021|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:38:41 kjcf05n00 mcfcli[3673891]: %3|1730770721.972|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 19:38:54 kjcf05n00 mcfcli[3673891]: %3|1730770734.018|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:39:11 kjcf05n00 mcfcli[3673891]: %3|1730770751.972|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 19:39:31 kjcf05n00 mcfcli[3673891]: %3|1730770771.887|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:39:41 kjcf05n00 mcfcli[3673891]: %3|1730770781.972|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 19:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 19:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 19:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 19:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 19:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 19:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 19:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 19:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 19:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 19:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 19:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 19:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 19:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 19:40:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 19:40:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:40:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 19:40:11 kjcf05n00 mcfcli[3673891]: %3|1730770811.107|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:40:11 kjcf05n00 mcfcli[3673891]: %3|1730770811.972|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:40:39 kjcf05n00 python3.9[2397603]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 19:40:41 kjcf05n00 mcfcli[3673891]: %3|1730770841.973|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 19:40:51 kjcf05n00 mcfcli[3673891]: %3|1730770851.104|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:40:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730770250', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 19:40:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730770250'} Nov 4 19:40:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:40:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730770250', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 19:40:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730770250'} Nov 4 19:40:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:41:11 kjcf05n00 mcfcli[3673891]: %3|1730770871.973|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:41:29 kjcf05n00 mcfcli[3673891]: %3|1730770889.000|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:41:41 kjcf05n00 mcfcli[3673891]: %3|1730770901.973|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 19:42:05 kjcf05n00 mcfcli[3673891]: %3|1730770925.887|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:42:11 kjcf05n00 mcfcli[3673891]: %3|1730770931.974|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 19:42:41 kjcf05n00 mcfcli[3673891]: %3|1730770961.974|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:42:42 kjcf05n00 mcfcli[3673891]: %3|1730770962.221|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:43:11 kjcf05n00 mcfcli[3673891]: %3|1730770991.975|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 19:43:19 kjcf05n00 mcfcli[3673891]: %3|1730770999.637|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:43:23 kjcf05n03 root[40970]: failback_xyraid Nov 4 19:43:25 kjcf05n03 root[41084]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 4 19:43:26 kjcf05n03 root[41160]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 4 19:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T19:43:27.268499251-06:00 level=info msg="Completed cleanup jobs" duration=41.89415ms Nov 4 19:43:29 kjcf05n02 systemd[1]: data-kjcf05n03:md66.mount: Succeeded. Nov 4 19:43:31 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme7n1 Nov 4 19:43:31 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme21n1 Nov 4 19:43:31 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme12n1 Nov 4 19:43:31 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme10n1 Nov 4 19:43:31 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme22n1 Nov 4 19:43:33 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme20n1 Nov 4 19:43:33 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme11n1 Nov 4 19:43:33 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme6n1 Nov 4 19:43:33 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme15n1 Nov 4 19:43:33 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme5n1 Nov 4 19:43:33 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme16n1 Nov 4 19:43:34 kjcf05n02 nslcd[6957]: [45e146] ldap_result() failed: Can't contact LDAP server Nov 4 19:43:35 kjcf05n03 dwd[5211]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 4 19:43:35 kjcf05n03 dwd[5211]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 4 19:43:35 kjcf05n03 dwd[5211]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 4 19:43:35 kjcf05n03 dwd[5211]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 4 19:43:35 kjcf05n03 dwd[5211]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 4 19:43:35 kjcf05n03 dwd[5211]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 4 19:43:35 kjcf05n03 dwd[5211]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 4 19:43:35 kjcf05n03 dwd[5211]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 4 19:43:35 kjcf05n03 dwd[5211]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 4 19:43:35 kjcf05n03 dwd[5211]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 4 19:43:35 kjcf05n03 dwd[5211]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 4 19:43:35 kjcf05n03 dwd[5211]: Starting NVME thread for nvme10n1 Nov 4 19:43:35 kjcf05n03 dwd[5211]: Starting NVME thread for nvme15n1 Nov 4 19:43:36 kjcf05n03 dwd[5211]: Starting NVME thread for nvme21n1 Nov 4 19:43:36 kjcf05n03 dwd[5211]: Starting NVME thread for nvme11n1 Nov 4 19:43:36 kjcf05n03 dwd[5211]: Starting NVME thread for nvme20n1 Nov 4 19:43:36 kjcf05n03 systemd-udevd[43917]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43919]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43921]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43920]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43917]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43919]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43920]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43921]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43917]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43919]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43920]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43921]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43917]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43919]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43920]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43921]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43917]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43919]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43920]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43921]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43917]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43920]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43919]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43921]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43917]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43919]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43920]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43917]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43921]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43919]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43920]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43921]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43955]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43957]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43959]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43960]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43955]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43957]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43960]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43959]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43955]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43954]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43960]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43957]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43954]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43957]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43960]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43954]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43960]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43954]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43960]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43954]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43954]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43960]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43960]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43960]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43954]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43960]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43954]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43960]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43954]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43960]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43960]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:43:36 kjcf05n03 systemd-udevd[43960]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:43:37 kjcf05n03 dwd[5211]: Starting NVME thread for nvme12n1 Nov 4 19:43:37 kjcf05n03 dwd[5211]: Starting NVME thread for nvme7n1 Nov 4 19:43:37 kjcf05n03 dwd[5211]: Starting NVME thread for nvme6n1 Nov 4 19:43:37 kjcf05n03 dwd[5211]: Starting NVME thread for nvme5n1 Nov 4 19:43:37 kjcf05n03 dwd[5211]: Starting NVME thread for nvme16n1 Nov 4 19:43:37 kjcf05n03 nslcd[6961]: [8b4567] (re)loading /etc/nsswitch.conf Nov 4 19:43:37 kjcf05n03 dwd[5211]: Starting NVME thread for nvme22n1 Nov 4 19:43:40 kjcf05n03 dcs-bulk-data-sender[6220]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 141}' Nov 4 19:43:42 kjcf05n00 mcfcli[3673891]: %3|1730771022.052|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 19:43:45 kjcf05n03 diskmonitor[17298]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 4 19:43:52 kjcf05n03 diskmonitor[17298]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 4 19:43:52 kjcf05n03 diskmonitor[17298]: Scan for ReadErrorMax change for md66 Nov 4 19:43:52 kjcf05n03 diskmonitor[17298]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 4 19:43:52 kjcf05n03 diskmonitor[17298]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 4 19:43:52 kjcf05n03 diskmonitor[17298]: read_saved_file: md66 no saved speed Nov 4 19:43:52 kjcf05n03 diskmonitor[17298]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 4 19:43:52 kjcf05n03 diskmonitor[17298]: Set sync_speed_min (10000) for md66 Nov 4 19:43:52 kjcf05n03 diskmonitor[17298]: Set sync_speed_max (200000) for md66 Nov 4 19:43:52 kjcf05n03 diskmonitor[17298]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 19:43:59 kjcf05n00 mcfcli[3673891]: %3|1730771039.634|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:44:01 kjcf05n02 diskmonitor[17558]: Removed MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 4 19:44:01 kjcf05n02 diskmonitor[17558]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 19:44:12 kjcf05n00 mcfcli[3673891]: %3|1730771052.052|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:44:19 kjcf05n00 zabbix-server[2399884]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 19:44:19 kjcf05n00 zabbix-server[2399884]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n03' from event '46611' Nov 4 19:44:19 kjcf05n00 zabbix-server[2399884]: Filesystem 'kjcf05' has been mounted Nov 4 19:44:20 kjcf05n00 zabbix-server[2399884]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 4 19:44:20 kjcf05n00 zabbix-server[2399884]: Running puppet on 'None' Nov 4 19:44:22 kjcf05n05 puppet-agent[2379082]: Using configured environment 'production' Nov 4 19:44:22 kjcf05n05 puppet-agent[2379082]: Retrieving pluginfacts Nov 4 19:44:22 kjcf05n05 puppet-agent[2379082]: Retrieving plugin Nov 4 19:44:22 kjcf05n02 puppet-agent[166268]: Using configured environment 'production' Nov 4 19:44:22 kjcf05n02 puppet-agent[166268]: Retrieving pluginfacts Nov 4 19:44:22 kjcf05n02 puppet-agent[166268]: Retrieving plugin Nov 4 19:44:22 kjcf05n06 puppet-agent[2193112]: Using configured environment 'production' Nov 4 19:44:22 kjcf05n06 puppet-agent[2193112]: Retrieving pluginfacts Nov 4 19:44:22 kjcf05n06 puppet-agent[2193112]: Retrieving plugin Nov 4 19:44:22 kjcf05n06 puppet-agent[2193112]: Loading facts Nov 4 19:44:22 kjcf05n04 puppet-agent[2177771]: Using configured environment 'production' Nov 4 19:44:22 kjcf05n04 puppet-agent[2177771]: Retrieving pluginfacts Nov 4 19:44:22 kjcf05n04 puppet-agent[2177771]: Retrieving plugin Nov 4 19:44:22 kjcf05n07 puppet-agent[2195756]: Using configured environment 'production' Nov 4 19:44:22 kjcf05n07 puppet-agent[2195756]: Retrieving pluginfacts Nov 4 19:44:22 kjcf05n07 puppet-agent[2195756]: Retrieving plugin Nov 4 19:44:22 kjcf05n07 puppet-agent[2195756]: Loading facts Nov 4 19:44:22 kjcf05n03 puppet-agent[46749]: Using configured environment 'production' Nov 4 19:44:22 kjcf05n03 puppet-agent[46749]: Retrieving pluginfacts Nov 4 19:44:22 kjcf05n03 puppet-agent[46749]: Retrieving plugin Nov 4 19:44:22 kjcf05n05 puppet-agent[2379082]: Loading facts Nov 4 19:44:22 kjcf05n02 puppet-agent[166268]: Loading facts Nov 4 19:44:22 kjcf05n01 puppet-agent[3865122]: Using configured environment 'production' Nov 4 19:44:22 kjcf05n01 puppet-agent[3865122]: Retrieving pluginfacts Nov 4 19:44:22 kjcf05n01 puppet-agent[3865122]: Retrieving plugin Nov 4 19:44:22 kjcf05n01 puppet-agent[3865122]: Loading facts Nov 4 19:44:23 kjcf05n04 puppet-agent[2177771]: Loading facts Nov 4 19:44:23 kjcf05n03 puppet-agent[46749]: Loading facts Nov 4 19:44:22 kjcf05n00 puppet-agent[2400034]: Using configured environment 'production' Nov 4 19:44:22 kjcf05n00 puppet-agent[2400034]: Retrieving pluginfacts Nov 4 19:44:22 kjcf05n00 puppet-agent[2400034]: Retrieving plugin Nov 4 19:44:23 kjcf05n00 puppet-agent[2400034]: Loading facts Nov 4 19:44:25 kjcf05n02 puppet-agent[166268]: Caching catalog for kjcf05n02 Nov 4 19:44:25 kjcf05n02 puppet-agent[166268]: Applying configuration version '1730771063' Nov 4 19:44:25 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 4 19:44:25 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 4 19:44:25 kjcf05n06 puppet-agent[2193112]: Caching catalog for kjcf05n06 Nov 4 19:44:25 kjcf05n06 puppet-agent[2193112]: Applying configuration version '1730771064' Nov 4 19:44:25 kjcf05n03 puppet-agent[46749]: Caching catalog for kjcf05n03 Nov 4 19:44:25 kjcf05n03 puppet-agent[46749]: Applying configuration version '1730771064' Nov 4 19:44:26 kjcf05n07 puppet-agent[2195756]: Caching catalog for kjcf05n07 Nov 4 19:44:26 kjcf05n07 puppet-agent[2195756]: Applying configuration version '1730771064' Nov 4 19:44:26 kjcf05n01 puppet-agent[3865122]: Caching catalog for kjcf05n01 Nov 4 19:44:26 kjcf05n03 systemd[1]: Starting Cleanup of Temporary Directories... Nov 4 19:44:26 kjcf05n03 systemd-tmpfiles[47157]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 19:44:26 kjcf05n03 systemd-tmpfiles[47157]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 19:44:26 kjcf05n03 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 4 19:44:26 kjcf05n03 systemd[1]: Started Cleanup of Temporary Directories. Nov 4 19:44:27 kjcf05n01 puppet-agent[3865122]: Applying configuration version '1730771064' Nov 4 19:44:26 kjcf05n00 puppet-agent[2400034]: Caching catalog for kjcf05n00 Nov 4 19:44:26 kjcf05n00 puppet-agent[2400034]: Applying configuration version '1730771065' Nov 4 19:44:27 kjcf05n02 puppet-agent[166268]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 19:44:27 kjcf05n02 puppet-agent[166268]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 19:44:27 kjcf05n02 puppet-agent[166268]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 19:44:27 kjcf05n06 puppet-agent[2193112]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 19:44:27 kjcf05n06 puppet-agent[2193112]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 19:44:27 kjcf05n06 puppet-agent[2193112]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 19:44:27 kjcf05n03 puppet-agent[46749]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 19:44:27 kjcf05n03 puppet-agent[46749]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 19:44:27 kjcf05n03 puppet-agent[46749]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 19:44:28 kjcf05n07 puppet-agent[2195756]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 19:44:28 kjcf05n07 puppet-agent[2195756]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 19:44:28 kjcf05n07 puppet-agent[2195756]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 19:44:28 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 4 19:44:28 kjcf05n02 zabbix_agent2[107646]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 19:44:28 kjcf05n02 zabbix_agent2[3190]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 19:44:28 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 19:44:28 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 4 19:44:28 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 19:44:28 kjcf05n02 puppet-agent[166268]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: Press Ctrl+C to exit. Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: Plugin support version 1.0 Nov 4 19:44:28 kjcf05n02 zabbix_agent2[166683]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 19:44:28 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 4 19:44:28 kjcf05n03 zabbix_agent2[6018]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 19:44:28 kjcf05n03 zabbix_agent2[3194]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 19:44:28 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 19:44:28 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 4 19:44:28 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 4 19:44:28 kjcf05n03 puppet-agent[46749]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: Press Ctrl+C to exit. Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: Plugin support version 1.0 Nov 4 19:44:28 kjcf05n03 zabbix_agent2[47259]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 19:44:28 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2140769]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 19:44:28 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 4 19:44:28 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 19:44:28 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 4 19:44:28 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 4 19:44:28 kjcf05n06 puppet-agent[2193112]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: Press Ctrl+C to exit. Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: Plugin support version 1.0 Nov 4 19:44:28 kjcf05n06 zabbix_agent2[2194068]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 19:44:28 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2143487]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 19:44:28 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 4 19:44:28 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 19:44:28 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 4 19:44:28 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 4 19:44:28 kjcf05n07 puppet-agent[2195756]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: Press Ctrl+C to exit. Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: Plugin support version 1.0 Nov 4 19:44:28 kjcf05n07 zabbix_agent2[2196699]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 19:44:29 kjcf05n06 puppet-agent[2193112]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 19:44:29 kjcf05n06 puppet-agent[2193112]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 19:44:29 kjcf05n06 puppet-agent[2193112]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 19:44:30 kjcf05n01 puppet-agent[3865122]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 19:44:30 kjcf05n01 puppet-agent[3865122]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-19:25:27]/mode) mode changed '0755' to '0750' Nov 4 19:44:30 kjcf05n01 puppet-agent[3865122]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-19:25:27/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 4 19:44:30 kjcf05n01 puppet-agent[3865122]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-19:25:27/vmcore]/mode) mode changed '0600' to '0640' Nov 4 19:44:30 kjcf05n01 puppet-agent[3865122]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-19:25:27/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 4 19:44:30 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 19:44:30 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 19:44:30 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 19:44:29 kjcf05n00 puppet-agent[2400034]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 19:44:30 kjcf05n07 puppet-agent[2195756]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 19:44:30 kjcf05n07 puppet-agent[2195756]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 19:44:30 kjcf05n07 puppet-agent[2195756]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 19:44:30 kjcf05n02 puppet-agent[166268]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 19:44:30 kjcf05n02 puppet-agent[166268]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 19:44:30 kjcf05n02 puppet-agent[166268]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 19:44:30 kjcf05n02 puppet-agent[166268]: Applied catalog in 5.20 seconds Nov 4 19:44:30 kjcf05n06 puppet-agent[2193112]: Applied catalog in 4.69 seconds Nov 4 19:44:30 kjcf05n01 puppet-agent[3865122]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 19:44:30 kjcf05n01 puppet-agent[3865122]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 19:44:30 kjcf05n01 puppet-agent[3865122]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 19:44:30 kjcf05n03 puppet-agent[46749]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 19:44:30 kjcf05n03 puppet-agent[46749]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 19:44:30 kjcf05n03 puppet-agent[46749]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 19:44:30 kjcf05n03 puppet-agent[46749]: Applied catalog in 5.30 seconds Nov 4 19:44:30 kjcf05n07 puppet-agent[2195756]: Applied catalog in 4.84 seconds Nov 4 19:44:30 kjcf05n00 puppet-agent[2400034]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 19:44:30 kjcf05n00 puppet-agent[2400034]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 19:44:30 kjcf05n00 puppet-agent[2400034]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 19:44:31 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3835497]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 19:44:31 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 4 19:44:31 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 19:44:31 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 4 19:44:31 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 4 19:44:31 kjcf05n01 puppet-agent[3865122]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: Press Ctrl+C to exit. Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: Plugin support version 1.0 Nov 4 19:44:31 kjcf05n01 zabbix_agent2[3865546]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 19:44:31 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2363544]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 19:44:31 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 19:44:31 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 19:44:31 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 4 19:44:31 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 4 19:44:31 kjcf05n00 puppet-agent[2400034]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: Press Ctrl+C to exit. Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: Plugin support version 1.0 Nov 4 19:44:31 kjcf05n00 zabbix_agent2[2400649]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 19:44:31 kjcf05n00 zabbix-server[2400674]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 19:44:32 kjcf05n00 zabbix-server[2400684]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 19:44:32 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47561 (bash) Nov 4 19:44:32 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 4 19:44:32 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 4 19:44:32 kjcf05n00 zabbix-server[2400699]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 19:44:32 kjcf05n00 zabbix-server[2400701]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 19:44:33 kjcf05n01 puppet-agent[3865122]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_193247.log]/mode) mode changed '0644' to '0640' Nov 4 19:44:33 kjcf05n00 puppet-agent[2400034]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 4 19:44:34 kjcf05n01 puppet-agent[3865122]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_193249.log]/mode) mode changed '0644' to '0640' Nov 4 19:44:34 kjcf05n01 puppet-agent[3865122]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_194432.log]/mode) mode changed '0644' to '0640' Nov 4 19:44:34 kjcf05n01 puppet-agent[3865122]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241104_194433]/mode) mode changed '0755' to '0750' Nov 4 19:44:34 kjcf05n01 puppet-agent[3865122]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241104_194433/screenlog.0]/mode) mode changed '0644' to '0640' Nov 4 19:44:34 kjcf05n01 puppet-agent[3865122]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 19:44:34 kjcf05n01 puppet-agent[3865122]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 19:44:34 kjcf05n01 puppet-agent[3865122]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 19:44:34 kjcf05n00 puppet-agent[2400034]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 19:44:34 kjcf05n00 puppet-agent[2400034]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 19:44:34 kjcf05n00 puppet-agent[2400034]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 19:44:34 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 4 19:44:35 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 4 19:44:35 kjcf05n00 puppet-agent[2400034]: Applied catalog in 8.31 seconds Nov 4 19:44:35 kjcf05n01 puppet-agent[3865122]: Applied catalog in 8.65 seconds Nov 4 19:44:36 kjcf05n05 puppet-agent[2379082]: Caching catalog for kjcf05n05 Nov 4 19:44:36 kjcf05n05 puppet-agent[2379082]: Applying configuration version '1730771074' Nov 4 19:44:36 kjcf05n00 mcfcli[3673891]: %3|1730771076.827|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:44:38 kjcf05n05 puppet-agent[2379082]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 19:44:38 kjcf05n05 puppet-agent[2379082]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 19:44:38 kjcf05n05 puppet-agent[2379082]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 19:44:38 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2331966]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 19:44:38 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 4 19:44:38 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 19:44:38 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 4 19:44:38 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 4 19:44:38 kjcf05n05 puppet-agent[2379082]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: Press Ctrl+C to exit. Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: Plugin support version 1.0 Nov 4 19:44:38 kjcf05n05 zabbix_agent2[2379942]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 19:44:40 kjcf05n05 puppet-agent[2379082]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 19:44:40 kjcf05n05 puppet-agent[2379082]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 19:44:40 kjcf05n05 puppet-agent[2379082]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 19:44:41 kjcf05n05 puppet-agent[2379082]: Applied catalog in 4.76 seconds Nov 4 19:44:42 kjcf05n00 mcfcli[3673891]: %3|1730771082.052|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:45:12 kjcf05n00 mcfcli[3673891]: %3|1730771112.053|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:45:14 kjcf05n00 mcfcli[3673891]: %3|1730771114.987|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:45:15 kjcf05n04 puppet-agent[2177771]: Caching catalog for kjcf05n04 Nov 4 19:45:15 kjcf05n04 puppet-agent[2177771]: Applying configuration version '1730771113' Nov 4 19:45:17 kjcf05n04 puppet-agent[2177771]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 19:45:17 kjcf05n04 puppet-agent[2177771]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 19:45:17 kjcf05n04 puppet-agent[2177771]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 19:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730771117}"] Nov 4 19:45:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730771117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.051652ms Nov 4 19:45:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.051652ms Nov 4 19:45:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:45:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:45:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730771117}"] Nov 4 19:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730771117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.092319ms Nov 4 19:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.092319ms Nov 4 19:45:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:45:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:45:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:45:18 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2133006]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 19:45:18 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 4 19:45:18 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 19:45:18 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 4 19:45:18 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 4 19:45:18 kjcf05n04 puppet-agent[2177771]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: Starting Zabbix Agent 2 (6.2.1) Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: Press Ctrl+C to exit. Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: Plugin support version 1.0 Nov 4 19:45:18 kjcf05n04 zabbix_agent2[2179525]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 19:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730771117}"] Nov 4 19:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730771117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.165025ms Nov 4 19:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.165025ms Nov 4 19:45:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:45:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:45:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730771117}"] Nov 4 19:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730771117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.660359ms Nov 4 19:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.660359ms Nov 4 19:45:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:45:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:45:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730771117}"] Nov 4 19:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730771117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.488421ms Nov 4 19:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.488421ms Nov 4 19:45:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:45:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:45:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730771117}"] Nov 4 19:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730771117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.122325ms Nov 4 19:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.122325ms Nov 4 19:45:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:45:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:45:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730771117}"] Nov 4 19:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730771117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.682051ms Nov 4 19:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.682051ms Nov 4 19:45:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:45:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:45:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730771117}"] Nov 4 19:45:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730771117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.744277ms Nov 4 19:45:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.744277ms Nov 4 19:45:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:45:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:45:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:45:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730771117}"] Nov 4 19:45:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730771117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:45:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.670819ms Nov 4 19:45:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.670819ms Nov 4 19:45:19 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:45:19 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:45:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:45:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730771117}"] Nov 4 19:45:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730771117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:45:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.752732ms Nov 4 19:45:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.752732ms Nov 4 19:45:19 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:45:19 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:45:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:45:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730771117}"] Nov 4 19:45:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730771117, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 19:45:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 19:45:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T19:45:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 19:45:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T19:45:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 19:45:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T19:45:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.54812ms Nov 4 19:45:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T19:45:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.54812ms Nov 4 19:45:19 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:19:45:19 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 19:45:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:45:19 kjcf05n04 puppet-agent[2177771]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 19:45:19 kjcf05n04 puppet-agent[2177771]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 19:45:19 kjcf05n04 puppet-agent[2177771]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 19:45:19 kjcf05n04 puppet-agent[2177771]: Applied catalog in 4.75 seconds Nov 4 19:45:19 kjcf05n00 zabbix-server[2399884]: puppet completed status:(0): '' Nov 4 19:45:20 kjcf05n00 zabbix-server[2399884]: Event '46611' acknowledged Nov 4 19:45:20 kjcf05n00 zabbix-server[2399884]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n03"}' Nov 4 19:45:36 kjcf05n00 python3.9[2401338]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 19:45:42 kjcf05n00 mcfcli[3673891]: %3|1730771142.053|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:45:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730771149', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 4 19:45:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730771149'} Nov 4 19:45:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:45:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730771149', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 4 19:45:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730771149'} Nov 4 19:45:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 19:45:50 kjcf05n00 mcfcli[3673891]: %3|1730771150.290|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:46:12 kjcf05n00 mcfcli[3673891]: %3|1730771172.476|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 19:46:30 kjcf05n00 mcfcli[3673891]: %3|1730771190.287|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:46:42 kjcf05n00 mcfcli[3673891]: %3|1730771202.476|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:47:06 kjcf05n00 mcfcli[3673891]: %3|1730771226.293|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:47:12 kjcf05n00 mcfcli[3673891]: %3|1730771232.477|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:47:42 kjcf05n00 mcfcli[3673891]: %3|1730771262.477|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:47:46 kjcf05n00 mcfcli[3673891]: %3|1730771266.290|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:48:12 kjcf05n00 mcfcli[3673891]: %3|1730771292.477|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:48:23 kjcf05n00 mcfcli[3673891]: %3|1730771303.247|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:48:42 kjcf05n00 mcfcli[3673891]: %3|1730771322.477|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:48:50 kjcf05n03 dwd[5211]: nvme15n1 passed periodic SMART status check Nov 4 19:48:50 kjcf05n03 dwd[5211]: nvme10n1 passed periodic SMART status check Nov 4 19:48:51 kjcf05n03 dwd[5211]: nvme20n1 passed periodic SMART status check Nov 4 19:48:51 kjcf05n03 dwd[5211]: nvme21n1 passed periodic SMART status check Nov 4 19:48:51 kjcf05n03 dwd[5211]: nvme11n1 passed periodic SMART status check Nov 4 19:48:51 kjcf05n03 dwd[5211]: nvme12n1 passed periodic SMART status check Nov 4 19:48:52 kjcf05n03 dwd[5211]: nvme5n1 passed periodic SMART status check Nov 4 19:48:52 kjcf05n03 dwd[5211]: nvme6n1 passed periodic SMART status check Nov 4 19:48:52 kjcf05n03 dwd[5211]: nvme7n1 passed periodic SMART status check Nov 4 19:48:52 kjcf05n03 dwd[5211]: nvme16n1 passed periodic SMART status check Nov 4 19:48:52 kjcf05n03 dwd[5211]: nvme22n1 passed periodic SMART status check Nov 4 19:49:03 kjcf05n00 mcfcli[3673891]: %3|1730771343.245|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:49:12 kjcf05n00 mcfcli[3673891]: %3|1730771352.477|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:49:41 kjcf05n00 mcfcli[3673891]: %3|1730771381.054|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:49:42 kjcf05n00 mcfcli[3673891]: %3|1730771382.477|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 19:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 19:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 19:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 19:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 19:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 19:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 19:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 19:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 19:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 19:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 19:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 19:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 19:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 19:50:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 19:50:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 19:50:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 19:50:12 kjcf05n00 mcfcli[3673891]: %3|1730771412.479|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 19:50:19 kjcf05n00 mcfcli[3673891]: %3|1730771419.766|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:50:36 kjcf05n00 python3.9[2404352]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 19:50:42 kjcf05n00 mcfcli[3673891]: %3|1730771442.479|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 19:50:59 kjcf05n00 mcfcli[3673891]: %3|1730771459.763|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:51:12 kjcf05n00 mcfcli[3673891]: %3|1730771472.479|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:51:38 kjcf05n00 mcfcli[3673891]: %3|1730771498.493|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:51:42 kjcf05n00 mcfcli[3673891]: %3|1730771502.480|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:52:12 kjcf05n00 mcfcli[3673891]: %3|1730771532.480|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 19:52:17 kjcf05n00 mcfcli[3673891]: %3|1730771537.159|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:52:42 kjcf05n00 mcfcli[3673891]: %3|1730771562.481|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:52:55 kjcf05n00 mcfcli[3673891]: %3|1730771575.746|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:53:12 kjcf05n00 mcfcli[3673891]: %3|1730771592.481|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T01:53:15.868117Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 19:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T01:53:15.868183Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.086ms Nov 4 19:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T19:53:27.261784819-06:00 level=info msg="Completed cleanup jobs" duration=35.38397ms Nov 4 19:53:34 kjcf05n00 mcfcli[3673891]: %3|1730771614.224|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:53:42 kjcf05n00 mcfcli[3673891]: %3|1730771622.481|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:54:12 kjcf05n00 mcfcli[3673891]: %3|1730771652.481|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:54:12 kjcf05n00 mcfcli[3673891]: %3|1730771652.641|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:54:42 kjcf05n00 mcfcli[3673891]: %3|1730771682.482|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 19:54:48 kjcf05n00 mcfcli[3673891]: %3|1730771688.616|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:55:12 kjcf05n00 mcfcli[3673891]: %3|1730771712.482|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:55:26 kjcf05n00 mcfcli[3673891]: %3|1730771726.270|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 19:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 19:55:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 19:55:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 19:55:38 kjcf05n00 zabbix_server[15735]: Zabbix agent item "system.cpu.util[,nice]" on host "kjcf05n03" failed: first network error, wait for 15 seconds Nov 4 19:55:42 kjcf05n00 mcfcli[3673891]: %3|1730771742.483|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 19:55:44 kjcf05n02 fstonithd.py[15145]: My partner 172.16.2.6 is kdumping. Forcing HA into GATHER state. Nov 4 19:55:44 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 19:55:44 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 19:55:44 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 19:55:45 kjcf05n02 root[186073]: is_enc_ipmi_off starts Nov 4 19:55:45 kjcf05n02 root[186074]: is_viking_off starts Nov 4 19:55:45 kjcf05n02 root[186107]: is_lan_ipmi_off leaves Nov 4 19:55:45 kjcf05n02 root[186109]: is_lan_ipmi_sec_off leaves Nov 4 19:55:45 kjcf05n02 root[186112]: I am master Nov 4 19:55:45 kjcf05n02 root[186115]: I am in slot 0; partner is in slot 1 Nov 4 19:55:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 19:55:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 19:55:49 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='34', error='Connection reset by peer (104)' Nov 4 19:55:49 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='34', client='AF_INET(172.16.2.6:36527)', local='AF_INET(0.0.0.0:601)' Nov 4 19:55:51 kjcf05n02 root[186327]: is_viking_off leaves Nov 4 19:55:51 kjcf05n02 root[186330]: kjcf05n03 not already off look at kdump Nov 4 19:55:51 kjcf05n02 root[186331]: is_kdump_off starts Nov 4 19:55:51 kjcf05n02 fence_kdump[186335]: waiting for message from '172.16.2.6' Nov 4 19:55:52 kjcf05n02 fence_kdump[186335]: received valid message from '172.16.2.6' Nov 4 19:55:52 kjcf05n02 root[186337]: is_kdump_off detected kdump on kjcf05n03 Nov 4 19:55:52 kjcf05n02 root[186338]: kjcf05n03 is kdumping Nov 4 19:55:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 19:55:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 19:55:52 kjcf05n02 root[186457]: is_viking_off starts Nov 4 19:55:52 kjcf05n02 root[186456]: is_enc_ipmi_off starts Nov 4 19:55:52 kjcf05n02 root[186476]: I am master Nov 4 19:55:52 kjcf05n02 root[186479]: I am in slot 0; partner is in slot 1 Nov 4 19:55:52 kjcf05n02 root[186487]: is_lan_ipmi_off leaves Nov 4 19:55:52 kjcf05n02 root[186489]: is_lan_ipmi_sec_off leaves Nov 4 19:55:53 kjcf05n00 zabbix_server[15745]: Zabbix agent item "system.users.num" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 19:55:55 kjcf05n00 zabbix_server[15730]: Zabbix agent item "vm.memory.size[available]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 19:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 19:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 19:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 19:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 19:55:56 kjcf05n00 zabbix_server[15782]: Zabbix agent item "vm.memory.size[buffers]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 19:55:57 kjcf05n00 zabbix_server[15770]: Zabbix agent item "vm.memory.size[cached]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 19:55:59 kjcf05n02 root[186701]: is_viking_off leaves Nov 4 19:55:59 kjcf05n02 root[186704]: kjcf05n03 not already off look at kdump Nov 4 19:55:59 kjcf05n02 root[186705]: is_kdump_off starts Nov 4 19:55:59 kjcf05n02 fence_kdump[186706]: waiting for message from '172.16.2.6' Nov 4 19:56:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 19:56:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 19:56:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 19:56:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 19:55:59 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 4 19:55:59 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 4 19:56:00 kjcf05n02 fence_kdump[186706]: received valid message from '172.16.2.6' Nov 4 19:56:00 kjcf05n02 root[186707]: is_kdump_off detected kdump on kjcf05n03 Nov 4 19:56:00 kjcf05n02 root[186708]: kjcf05n03 is kdumping Nov 4 19:56:00 kjcf05n00 python3.9[2407306]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 19:56:04 kjcf05n02 systemd-udevd[188971]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188972]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188974]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188976]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188971]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188974]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188972]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188976]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188971]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188974]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188972]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188976]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188974]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188971]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188972]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188976]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188974]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188971]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188976]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188972]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188974]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188971]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188972]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188976]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188971]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188974]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188972]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188976]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188974]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188972]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188971]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[188976]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189011]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189012]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189008]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189016]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189012]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189016]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189012]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189016]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189016]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189012]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189012]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189012]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189012]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189012]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189012]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189012]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n02 systemd-udevd[189009]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 19:56:04 kjcf05n00 mcfcli[3673891]: %3|1730771764.199|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:56:04 kjcf05n02 dwd[5196]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 4 19:56:04 kjcf05n02 dwd[5196]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 4 19:56:04 kjcf05n02 dwd[5196]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 4 19:56:04 kjcf05n02 dwd[5196]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 4 19:56:04 kjcf05n02 dwd[5196]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 4 19:56:04 kjcf05n02 dwd[5196]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 4 19:56:04 kjcf05n02 dwd[5196]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 4 19:56:04 kjcf05n02 dwd[5196]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 4 19:56:04 kjcf05n02 dwd[5196]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 4 19:56:04 kjcf05n02 dwd[5196]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 4 19:56:04 kjcf05n02 dwd[5196]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 4 19:56:04 kjcf05n02 dwd[5196]: Starting NVME thread for nvme10n1 Nov 4 19:56:05 kjcf05n02 dwd[5196]: Starting NVME thread for nvme22n1 Nov 4 19:56:05 kjcf05n02 dwd[5196]: Starting NVME thread for nvme12n1 Nov 4 19:56:05 kjcf05n02 dwd[5196]: Starting NVME thread for nvme5n1 Nov 4 19:56:05 kjcf05n02 dwd[5196]: Starting NVME thread for nvme20n1 Nov 4 19:56:05 kjcf05n02 dwd[5196]: Starting NVME thread for nvme16n1 Nov 4 19:56:05 kjcf05n02 dwd[5196]: Starting NVME thread for nvme21n1 Nov 4 19:56:06 kjcf05n02 dwd[5196]: Starting NVME thread for nvme7n1 Nov 4 19:56:06 kjcf05n02 dwd[5196]: Starting NVME thread for nvme15n1 Nov 4 19:56:06 kjcf05n02 dwd[5196]: Starting NVME thread for nvme6n1 Nov 4 19:56:06 kjcf05n02 dwd[5196]: Starting NVME thread for nvme11n1 Nov 4 19:56:12 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vfs.fs.size[/var/lib/reboot_cnt,used]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 19:56:12 kjcf05n00 mcfcli[3673891]: %3|1730771772.483|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:56:14 kjcf05n02 diskmonitor[17558]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 4 19:56:23 kjcf05n02 diskmonitor[17558]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 4 19:56:23 kjcf05n02 diskmonitor[17558]: Scan for ReadErrorMax change for md66 Nov 4 19:56:23 kjcf05n02 diskmonitor[17558]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 4 19:56:23 kjcf05n02 diskmonitor[17558]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 4 19:56:23 kjcf05n02 diskmonitor[17558]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.min.76c05c063fa0949b68ee86c1978c2ca8 file Nov 4 19:56:23 kjcf05n02 diskmonitor[17558]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.max.76c05c063fa0949b68ee86c1978c2ca8 file Nov 4 19:56:23 kjcf05n02 diskmonitor[17558]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 4 19:56:23 kjcf05n02 diskmonitor[17558]: Set sync_speed_min (10000) for md66 Nov 4 19:56:23 kjcf05n02 diskmonitor[17558]: Set sync_speed_max (200000) for md66 Nov 4 19:56:23 kjcf05n02 diskmonitor[17558]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 19:56:27 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n03": interface unavailable Nov 4 19:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 19:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 19:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 19:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 19:56:42 kjcf05n00 mcfcli[3673891]: %3|1730771802.483|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:56:44 kjcf05n00 mcfcli[3673891]: %3|1730771804.197|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:56:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 19:56:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 19:56:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 19:56:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 19:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 19:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 19:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 19:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 19:57:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 19:57:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 19:57:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 19:57:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 19:57:12 kjcf05n00 mcfcli[3673891]: %3|1730771832.483|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 19:57:14 kjcf05n02 nslcd[6957]: [b127f8] ldap_result() failed: Can't contact LDAP server Nov 4 19:57:23 kjcf05n00 mcfcli[3673891]: %3|1730771843.499|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 19:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 19:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 19:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 19:57:42 kjcf05n00 mcfcli[3673891]: %3|1730771862.484|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 19:57:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 19:57:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 19:57:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 19:57:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 19:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 19:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 19:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 19:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 19:57:58 kjcf05n00 mcfcli[3673891]: %3|1730771878.740|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:58:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 19:58:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 19:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 19:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 19:58:12 kjcf05n00 mcfcli[3673891]: %3|1730771892.484|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:58:32 kjcf05n00 zabbix-server[2409105]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 19:58:32 kjcf05n00 zabbix-server[2409105]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n03:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 4 19:58:32 kjcf05n00 log_interesting_event.py[2409105]: Event '46612' acknowledged Nov 4 19:58:36 kjcf05n00 mcfcli[3673891]: %3|1730771916.665|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 19:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 19:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 19:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 19:58:42 kjcf05n00 mcfcli[3673891]: %3|1730771922.484|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:58:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 19:58:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 19:58:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 19:58:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 19:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 19:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 19:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 19:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 19:59:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 19:59:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 19:59:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 19:59:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 19:59:12 kjcf05n00 mcfcli[3673891]: %3|1730771952.485|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:59:14 kjcf05n00 mcfcli[3673891]: %3|1730771954.192|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:59:20 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:9a:1a Nov 4 19:59:20 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 4 19:59:24 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 4 19:59:24 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a kjcf05n03 Nov 4 19:59:24 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.6 Nov 4 19:59:24 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 4 19:59:24 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 4 19:59:24 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.6 Nov 4 19:59:24 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/pxelinux.cfg to 172.16.2.6 Nov 4 19:59:27 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/vmlinuz_diskless to 172.16.2.6 Nov 4 19:59:30 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/initramfs-diskless.img to 172.16.2.6 Nov 4 19:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 19:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 19:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 19:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 19:59:42 kjcf05n00 mcfcli[3673891]: %3|1730771982.485|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 19:59:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 19:59:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 19:59:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 19:59:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 19:59:53 kjcf05n00 mcfcli[3673891]: %3|1730771993.039|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 19:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 19:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 19:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 19:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 19:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 19:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 20:00:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 20:00:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 20:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 20:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 20:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 20:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 20:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 20:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 20:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 20:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 20:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 20:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 20:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 20:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 20:00:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 20:00:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:00:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 20:00:12 kjcf05n00 mcfcli[3673891]: %3|1730772012.485|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 20:00:17 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:54464). Nov 4 20:00:17 kjcf05n01 rsyncd[3871657]: connect from kjcf05n03 (172.16.2.6) Nov 4 20:00:17 kjcf05n01 rsyncd[3871657]: rsync on puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 4 20:00:17 kjcf05n01 rsyncd[3871657]: building file list Nov 4 20:00:17 kjcf05n01 rsyncd[3871657]: sent 11446 bytes received 136 bytes total size 10901 Nov 4 20:00:17 kjcf05n01 systemd[1]: rsyncd@659-172.16.2.2:873-172.16.2.6:54464.service: Succeeded. Nov 4 20:00:30 kjcf05n00 mcfcli[3673891]: %3|1730772030.804|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:00:36 kjcf05n00 python3.9[2410272]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 20:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 20:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 20:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 20:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 20:00:42 kjcf05n00 mcfcli[3673891]: %3|1730772042.485|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 20:00:44 kjcf05n02 fstonithd.py[15145]: Listening for kdump packets from partner Nov 4 20:00:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 20:00:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 20:00:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730772050', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 20:00:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730772050'} Nov 4 20:00:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:00:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730772050', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 20:00:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730772050'} Nov 4 20:00:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:00:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 20:00:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 20:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 20:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 20:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 20:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 20:01:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 20:01:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 20:01:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 20:01:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 20:01:09 kjcf05n00 mcfcli[3673891]: %3|1730772069.741|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:01:12 kjcf05n00 mcfcli[3673891]: %3|1730772072.485|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:01:30 kjcf05n02 dwd[5196]: nvme10n1 passed periodic SMART status check Nov 4 20:01:31 kjcf05n02 dwd[5196]: nvme22n1 passed periodic SMART status check Nov 4 20:01:31 kjcf05n02 dwd[5196]: nvme12n1 passed periodic SMART status check Nov 4 20:01:31 kjcf05n02 dwd[5196]: nvme21n1 passed periodic SMART status check Nov 4 20:01:31 kjcf05n02 dwd[5196]: nvme20n1 passed periodic SMART status check Nov 4 20:01:31 kjcf05n02 dwd[5196]: nvme16n1 passed periodic SMART status check Nov 4 20:01:31 kjcf05n02 dwd[5196]: nvme5n1 passed periodic SMART status check Nov 4 20:01:32 kjcf05n02 dwd[5196]: nvme6n1 passed periodic SMART status check Nov 4 20:01:32 kjcf05n02 dwd[5196]: nvme7n1 passed periodic SMART status check Nov 4 20:01:32 kjcf05n02 dwd[5196]: nvme11n1 passed periodic SMART status check Nov 4 20:01:32 kjcf05n02 dwd[5196]: nvme15n1 passed periodic SMART status check Nov 4 20:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 20:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 20:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 20:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 20:01:42 kjcf05n00 mcfcli[3673891]: %3|1730772102.485|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:01:43 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='15', client='AF_INET(172.16.2.6:41593)', local='AF_INET(0.0.0.0:601)' Nov 4 20:01:43 kjcf05n03 syslog-ng[3090]: Configuration reload request received, reloading configuration; Nov 4 20:01:43 kjcf05n03 syslog-ng[3090]: Configuration reload finished; Nov 4 20:01:43 kjcf05n03 syslog-ng[3090]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 4 20:01:43 kjcf05n03 dracut: dracut-049-135.git20210121.el8 Nov 4 20:01:43 kjcf05n03 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 20:01:43 kjcf05n03 dracut: Loading and integrity checking all crypto modules Nov 4 20:01:43 kjcf05n03 dracut: Self testing crypto algorithms Nov 4 20:01:43 kjcf05n03 dracut: rd.md=0: removing MD RAID activation Nov 4 20:01:43 kjcf05n03 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 20:01:43 kjcf05n03 Copying live image to RAM... Nov 4 20:01:43 kjcf05n03 (this may take a minute) Nov 4 20:01:43 kjcf05n03 Done copying live image to RAM. Nov 4 20:01:43 kjcf05n03 dracut: Mounted root filesystem LiveOS_rootfs Nov 4 20:01:43 kjcf05n03 dracut: Checking integrity of kernel Nov 4 20:01:43 kjcf05n03 dracut: All initrd crypto checks done Nov 4 20:01:43 kjcf05n03 dracut: Switching root Nov 4 20:01:43 kjcf05n03 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 4 20:01:43 kjcf05n03 systemd: Detected architecture x86-64. Nov 4 20:01:43 kjcf05n03 systemd: Set hostname to . Nov 4 20:01:43 kjcf05n03 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 4 20:01:43 kjcf05n03 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 4 20:01:43 kjcf05n03 systemd: Started Dispatch Password Requests to Console Directory Watch. Nov 4 20:01:43 kjcf05n03 systemd: Set up automount Arbitrary Executable File Formats File System Automount Point. Nov 4 20:01:43 kjcf05n03 systemd: Created slice User and Session Slice. Nov 4 20:01:43 kjcf05n03 systemd: Reached target Swap. Nov 4 20:01:43 kjcf05n03 systemd: Listening on udev Kernel Socket. Nov 4 20:01:43 kjcf05n03 systemd-journald[1540]: Journal started Nov 4 20:01:43 kjcf05n03 systemd-journald[1540]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 20:01:43 kjcf05n03 systemd-modules-load[1532]: Inserted module 'fuse' Nov 4 20:01:43 kjcf05n03 systemd[1]: Mounted /WIBS. Nov 4 20:01:43 kjcf05n03 systemd[1]: Mounting Kernel Configuration File System... Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Apply Kernel Variables... Nov 4 20:01:43 kjcf05n03 systemd[1]: Mounting FUSE Control File System... Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Rebuild Hardware Database... Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Load/Save Random Seed... Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Create System Users... Nov 4 20:01:43 kjcf05n03 systemd[1]: Mounted Kernel Configuration File System. Nov 4 20:01:43 kjcf05n03 systemd[1]: Mounted FUSE Control File System. Nov 4 20:01:43 kjcf05n03 systemd-sysctl[1552]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 20:01:43 kjcf05n03 systemd-sysctl[1552]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Apply Kernel Variables. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Load/Save Random Seed. Nov 4 20:01:43 kjcf05n03 systemd-journald[1540]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Flush Journal to Persistent Storage. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Create System Users. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 4 20:01:43 kjcf05n03 systemd-tmpfiles[1564]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 20:01:43 kjcf05n03 systemd-tmpfiles[1564]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Create Static Device Nodes in /dev. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started udev Coldplug all Devices. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Rebuild Hardware Database. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting udev Kernel Device Manager... Nov 4 20:01:43 kjcf05n03 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started udev Kernel Device Manager. Nov 4 20:01:43 kjcf05n03 systemd[1]: Found device /dev/ttyS0. Nov 4 20:01:43 kjcf05n03 systemd-udevd[1590]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:01:43 kjcf05n03 systemd-udevd[1606]: Using default interface naming scheme 'rhel-8.0'. Nov 4 20:01:43 kjcf05n03 systemd-udevd[1606]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:01:43 kjcf05n03 systemd-udevd[1596]: Using default interface naming scheme 'rhel-8.0'. Nov 4 20:01:43 kjcf05n03 systemd-udevd[1596]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:01:43 kjcf05n03 systemd-udevd[1642]: Using default interface naming scheme 'rhel-8.0'. Nov 4 20:01:43 kjcf05n03 systemd-udevd[1642]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 4 20:01:43 kjcf05n03 systemd[1]: Reached target Local File Systems (Pre). Nov 4 20:01:43 kjcf05n03 systemd[1]: Reached target Local File Systems. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting openibd - configure Mellanox devices... Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Rebuild Journal Catalog... Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Mark the need to relabel after reboot... Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Create Volatile Files and Directories... Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Mark the need to relabel after reboot. Nov 4 20:01:43 kjcf05n03 root[1807]: openibd: running in auto mode Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Rebuild Journal Catalog. Nov 4 20:01:43 kjcf05n03 systemd-tmpfiles[1805]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 20:01:43 kjcf05n03 systemd-tmpfiles[1805]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 4 20:01:43 kjcf05n03 systemd-tmpfiles[1805]: "/var/tmp" already exists and is not a directory. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Create Volatile Files and Directories. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting RPC Bind... Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 4 20:01:43 kjcf05n03 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting RDMA Node Description Daemon... Nov 4 20:01:43 kjcf05n03 systemd[1]: Started RPC Bind. Nov 4 20:01:43 kjcf05n03 systemd-modules-load[1862]: Inserted module 'ib_iser' Nov 4 20:01:43 kjcf05n03 systemd-modules-load[1862]: Inserted module 'ib_isert' Nov 4 20:01:43 kjcf05n03 systemd-modules-load[1862]: Inserted module 'ib_srpt' Nov 4 20:01:43 kjcf05n03 systemd[1]: Started RDMA Node Description Daemon. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 4 20:01:43 kjcf05n03 systemd-udevd[1616]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:01:43 kjcf05n03 systemd-modules-load[1874]: Inserted module 'ib_ipoib' Nov 4 20:01:43 kjcf05n03 systemd-udevd[1590]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:01:43 kjcf05n03 systemd-modules-load[1862]: Inserted module 'rdma_ucm' Nov 4 20:01:43 kjcf05n03 systemd-modules-load[1862]: Module 'svcrdma' is blacklisted Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 4 20:01:43 kjcf05n03 systemd-udevd[1616]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 20:01:43 kjcf05n03 systemd-udevd[1590]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 20:01:43 kjcf05n03 systemd-modules-load[1874]: Inserted module 'ib_umad' Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 4 20:01:43 kjcf05n03 systemd[1]: Reached target Network (Pre). Nov 4 20:01:43 kjcf05n03 systemd[1]: Reached target RDMA Hardware. Nov 4 20:01:43 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 20:01:43 kjcf05n03 systemd[3090]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:01:43 kjcf05n03 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 4 20:01:43 kjcf05n03 openibd[1788]: Loading HCA driver and Access Layer:[ OK ] Nov 4 20:01:43 kjcf05n03 systemd[1]: Started openibd - configure Mellanox devices. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Update is Completed... Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Update is Completed. Nov 4 20:01:43 kjcf05n03 setup-icl[1780]: Setting LAN IP Address to 203.0.113.4 Nov 4 20:01:43 kjcf05n03 setup-icl[1780]: Setting LAN Subnet Mask to 255.255.255.0 Nov 4 20:01:43 kjcf05n03 setup-icl[1780]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 4 20:01:43 kjcf05n03 setup-icl[1780]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 4 20:01:43 kjcf05n03 systemd-udevd[1616]: Using default interface naming scheme 'rhel-8.0'. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 4 20:01:43 kjcf05n03 systemd[1]: Reached target System Initialization. Nov 4 20:01:43 kjcf05n03 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 4 20:01:43 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 4 20:01:43 kjcf05n03 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 4 20:01:43 kjcf05n03 systemd[1]: Listening on lldpad.socket. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 4 20:01:43 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 4 20:01:43 kjcf05n03 systemd[1]: Reached target Sockets. Nov 4 20:01:43 kjcf05n03 systemd[1]: Reached target Basic System. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting LSB: Bring up/down networking... Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 4 20:01:43 kjcf05n03 network[2112]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Resets System Activity Logs... Nov 4 20:01:43 kjcf05n03 systemd[1]: Started D-Bus System Message Bus. Nov 4 20:01:43 kjcf05n03 mcelog[2128]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 4 20:01:43 kjcf05n03 mcelog[2128]: CPU is unsupported Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 4 20:01:43 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 20:01:43 kjcf05n03 network[2130]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 20:01:43 kjcf05n03 network[2112]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started irqbalance daemon. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 4 20:01:43 kjcf05n03 network[2140]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:01:43 kjcf05n03 network[2112]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[2147]: Setting up Mellanox network interface: ib1 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 0 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 1 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 2 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 3 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 4 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 5 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 6 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 7 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 8 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 9 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 10 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 11 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 12 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 13 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 14 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 15 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 16 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 17 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 18 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 19 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 20 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 21 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 22 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 23 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 24 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 25 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 26 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 27 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 28 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 29 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 30 Nov 4 20:01:43 kjcf05n03 cpupower[2153]: Setting cpu: 31 Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 4 20:01:43 kjcf05n03 dbus-daemon[2131]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 4 20:01:43 kjcf05n03 network[2154]: It is advised to switch to 'NetworkManager' instead for network management. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 4 20:01:43 kjcf05n03 chronyd[2183]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 20:01:43 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 4 20:01:43 kjcf05n03 dwd[2163]: dwd: vMay 29 2024 : 15:38:26 Nov 4 20:01:43 kjcf05n03 dwd[2163]: /usr/sbin/dwd -d --standalone=0 Nov 4 20:01:43 kjcf05n03 dwd[2163]: dwd: option Lethal: 0 Nov 4 20:01:43 kjcf05n03 dwd[2163]: dwd: option Interval: 60 Nov 4 20:01:43 kjcf05n03 dwd[2163]: dwd: option abrtlimit: 10 Nov 4 20:01:43 kjcf05n03 dwd[2163]: dwd: option DZPeriod: 604800 Nov 4 20:01:43 kjcf05n03 dwd[2163]: dwd: option SmartPeriod: 43200 Nov 4 20:01:43 kjcf05n03 dwd[2163]: dwd: option SDDEnabled: 1 Nov 4 20:01:43 kjcf05n03 dwd[2163]: dwd: option SDDAwaitScale: 3 Nov 4 20:01:43 kjcf05n03 dwd[2163]: dwd: option SDDAwaitMin: 100 Nov 4 20:01:43 kjcf05n03 dwd[2163]: dwd: option Verbosity: 1 Nov 4 20:01:43 kjcf05n03 dwd[2163]: dwd: option StandAlone: 0 Nov 4 20:01:43 kjcf05n03 dwd[2163]: option Lethal: 0 Nov 4 20:01:43 kjcf05n03 dwd[2163]: option Interval: 60 Nov 4 20:01:43 kjcf05n03 dwd[2163]: option abrtlimit: 10 Nov 4 20:01:43 kjcf05n03 dwd[2163]: option DZPeriod: 604800 Nov 4 20:01:43 kjcf05n03 dwd[2163]: option SmartPeriod: 43200 Nov 4 20:01:43 kjcf05n03 dwd[2163]: option SDDEnabled: 1 Nov 4 20:01:43 kjcf05n03 dwd[2163]: option SDDAwaitScale: 3 Nov 4 20:01:43 kjcf05n03 dwd[2163]: option SDDAwaitMin: 100 Nov 4 20:01:43 kjcf05n03 dwd[2163]: option Verbosity: 1 Nov 4 20:01:43 kjcf05n03 dwd[2163]: option StandAlone: 0 Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Name Service Cache Daemon... Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[2206]: Setting up Mellanox network interface: ib0 Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 4 20:01:43 kjcf05n03 nscd[2240]: 2240 monitoring file `/etc/hosts` (1) Nov 4 20:01:43 kjcf05n03 nscd[2240]: 2240 monitoring directory `/etc` (2) Nov 4 20:01:43 kjcf05n03 nscd[2240]: 2240 monitoring file `/etc/resolv.conf` (3) Nov 4 20:01:43 kjcf05n03 nscd[2240]: 2240 monitoring directory `/etc` (2) Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Manage Cutlass PHYs... Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[2228]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 20:01:43 kjcf05n03 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 4 20:01:43 kjcf05n03 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Resets System Activity Logs. Nov 4 20:01:43 kjcf05n03 chronyd[2183]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 20:01:43 kjcf05n03 chronyd[2183]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 20:01:43 kjcf05n03 sssd[sssd][2111]: Starting up Nov 4 20:01:43 kjcf05n03 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 4 20:01:43 kjcf05n03 beSetMlxConfig[2231]: ConnectX-3 multiport not detected Nov 4 20:01:43 kjcf05n03 mdraid-phy[2264]: no Cutlass to worry about Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 0 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 1 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 2 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 3 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 4 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 5 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 6 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 7 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 8 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 9 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 10 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 11 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 12 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 13 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 14 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 15 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 16 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 17 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 18 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 19 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 20 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 21 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 22 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 23 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 24 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 25 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 26 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 27 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 28 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 29 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 30 Nov 4 20:01:43 kjcf05n03 cpupower[2287]: Idlestate 2 disabled on CPU 31 Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[2273]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 20:01:43 kjcf05n03 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[2280]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Name Service Cache Daemon. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Manage Cutlass PHYs. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[2300]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 20:01:43 kjcf05n03 dbus-daemon[2131]: [system] Successfully activated service 'org.freedesktop.systemd1' Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[2301]: No configuration found for ib1 Nov 4 20:01:43 kjcf05n03 beSetMlxConfig[2231]: Starting MST (Mellanox Software Tools) driver set Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[2312]: No configuration found for ib0 Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[2316]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[2327]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 20:01:43 kjcf05n03 beSetMlxConfig[2231]: Loading MST PCI module - Success Nov 4 20:01:43 kjcf05n03 mlnx_conf_mgr[2351]: INFO: No configurations found for mlx5_1, skipping. Nov 4 20:01:43 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 20:01:43 kjcf05n03 mlnx_conf_mgr[2376]: INFO: No configurations found for mlx5_0, skipping. Nov 4 20:01:43 kjcf05n03 beSetMlxConfig[2231]: Loading MST PCI configuration module - Success Nov 4 20:01:43 kjcf05n03 beSetMlxConfig[2231]: Create devices Nov 4 20:01:43 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 20:01:43 kjcf05n03 sssd[be[implicit_files]][2317]: Starting up Nov 4 20:01:43 kjcf05n03 sssd[nss][2443]: Starting up Nov 4 20:01:43 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 4 20:01:43 kjcf05n03 systemd[1]: Reached target User and Group Name Lookups. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Login Service... Nov 4 20:01:43 kjcf05n03 systemd-logind[2542]: New seat seat0. Nov 4 20:01:43 kjcf05n03 systemd-logind[2542]: Watching system buttons on /dev/input/event0 (Power Button) Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Login Service. Nov 4 20:01:43 kjcf05n03 python3.9[2149]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 20:01:43 kjcf05n03 python3.9[3090]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:01:43 kjcf05n03 systemd-sysctl[2691]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 20:01:43 kjcf05n03 systemd-sysctl[2691]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 20:01:43 kjcf05n03 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 4 20:01:43 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 20:01:43 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 4 20:01:43 kjcf05n03 network[2112]: Bringing up loopback interface: [ OK ] Nov 4 20:01:43 kjcf05n03 python3.9[2885]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 20:01:43 kjcf05n03 python3.9[3090]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 20:01:43 kjcf05n03 systemd-sysctl[3020]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 20:01:43 kjcf05n03 systemd-sysctl[3020]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 20:01:43 kjcf05n03 systemd[1]: Started LSB: Bring up/down networking. Nov 4 20:01:43 kjcf05n03 systemd[1]: Reached target Network. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 4 20:01:43 kjcf05n03 systemd[1]: Reached target Network is Online. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting System Logger Daemon... Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Notify NFS peers of a restart... Nov 4 20:01:43 kjcf05n03 sm-notify[3098]: Version 2.3.3 starting Nov 4 20:01:43 kjcf05n03 systemd[1]: Started GSSAPI Proxy Daemon. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Notify NFS peers of a restart. Nov 4 20:01:43 kjcf05n03 sshd[3077]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 4 20:01:43 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 4 20:01:43 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 20:01:43 kjcf05n03 systemd[1]: Reached target NFS client services. Nov 4 20:01:43 kjcf05n03 systemd[1]: Reached target Remote File Systems (Pre). Nov 4 20:01:43 kjcf05n03 lldpad[3061]: setsockopt nearest_bridge: Invalid argument Nov 4 20:01:43 kjcf05n03 systemd[1]: Reached target Remote File Systems. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Permit User Sessions... Nov 4 20:01:43 kjcf05n03 lldpad[3061]: setsockopt nearest_bridge: Invalid argument Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Permit User Sessions. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Serial Getty on ttyS0. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Getty on tty1. Nov 4 20:01:43 kjcf05n03 systemd[1]: Reached target Login Prompts. Nov 4 20:01:43 kjcf05n03 syslog-ng[3090]: [2024-11-05T02:00:29.921623] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 4 20:01:43 kjcf05n03 syslog-ng[3090]: [2024-11-05T02:00:29.921944] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 4 20:01:43 kjcf05n03 syslog-ng[3090]: [2024-11-05T02:00:29.921979] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 4 20:01:43 kjcf05n03 syslog-ng[3090]: [2024-11-05T02:00:29.922561] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 4 20:01:43 kjcf05n03 syslog-ng[3090]: [2024-11-05T02:00:29.922876] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 4 20:01:43 kjcf05n03 systemd[1]: Started System Logger Daemon. Nov 4 20:01:43 kjcf05n03 python3.9[3132]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 20:01:43 kjcf05n03 python3.9[3090]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 20:01:43 kjcf05n03 beSetMlxConfig[2231]: Unloading MST PCI module (unused) - Success Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 4 20:01:43 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 20:01:43 kjcf05n03 python3.9[3438]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 20:01:43 kjcf05n03 python3.9[3090]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 4 20:01:43 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 20:01:43 kjcf05n03 python3.9[3441]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 20:01:43 kjcf05n03 python3.9[3090]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 4 20:01:43 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 4 20:01:43 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 20:01:43 kjcf05n03 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 4 20:01:43 kjcf05n03 chronyd[2183]: System's initial offset : 0.003544 seconds slow of true (slew) Nov 4 20:01:43 kjcf05n03 systemd[1]: Started NTP client/server. Nov 4 20:01:43 kjcf05n03 beSetMlxConfig[2231]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 20:01:43 kjcf05n03 beSetMlxConfig[2231]: ib mode Nov 4 20:01:43 kjcf05n03 root[3461]: openibd: Set node_desc for mlx5_0: kjcf05n03 HCA-1 Nov 4 20:01:43 kjcf05n03 root[3463]: openibd: Set node_desc for mlx5_1: kjcf05n03 HCA-2 Nov 4 20:01:43 kjcf05n03 beSetMlxConfig[2231]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 20:01:43 kjcf05n03 beSetMlxConfig[2231]: ib mode Nov 4 20:01:43 kjcf05n03 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 20:01:43 kjcf05n03 systemd-udevd[3480]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:01:43 kjcf05n03 systemd-udevd[3479]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:01:43 kjcf05n03 systemd-udevd[3483]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:01:43 kjcf05n03 systemd-udevd[3484]: Using default interface naming scheme 'rhel-8.0'. Nov 4 20:01:43 kjcf05n03 systemd-udevd[3484]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:01:43 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 20:01:43 kjcf05n03 systemd[3090]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:01:43 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[3522]: Setting up Mellanox network interface: ib0 Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[3521]: Setting up Mellanox network interface: ib1 Nov 4 20:01:43 kjcf05n03 systemd-udevd[3482]: Using default interface naming scheme 'rhel-8.0'. Nov 4 20:01:43 kjcf05n03 systemd-udevd[3481]: Using default interface naming scheme 'rhel-8.0'. Nov 4 20:01:43 kjcf05n03 systemd-udevd[3482]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:01:43 kjcf05n03 systemd-udevd[3481]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Puppet agent... Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[3572]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[3571]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[3602]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[3603]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[3604]: No configuration found for ib0 Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[3605]: No configuration found for ib1 Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[3612]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[3613]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 20:01:43 kjcf05n03 mlnx_conf_mgr[3649]: INFO: No configurations found for mlx5_0, skipping. Nov 4 20:01:43 kjcf05n03 mlnx_conf_mgr[3653]: INFO: No configurations found for mlx5_1, skipping. Nov 4 20:01:43 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 20:01:43 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 20:01:43 kjcf05n03 systemd[1]: Stopping Command Scheduler... Nov 4 20:01:43 kjcf05n03 systemd[1]: crond.service: Succeeded. Nov 4 20:01:43 kjcf05n03 systemd[1]: Stopped Command Scheduler. Nov 4 20:01:43 kjcf05n03 systemd[1]: crond.service: Found left-over process 3692 (anacron) in control group while starting unit. Ignoring. Nov 4 20:01:43 kjcf05n03 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 4 20:01:43 kjcf05n03 systemd[1]: Stopping Job spooling tools... Nov 4 20:01:43 kjcf05n03 systemd[1]: atd.service: Succeeded. Nov 4 20:01:43 kjcf05n03 systemd[1]: Stopped Job spooling tools. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 20:01:43 kjcf05n03 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 4 20:01:43 kjcf05n03 lldpad[3061]: init_ports: Error adding device ib0 Nov 4 20:01:43 kjcf05n03 lldpad[3061]: init_ports: Error adding device ib1 Nov 4 20:01:43 kjcf05n03 lldpad[3061]: Signal 15 received - terminating Nov 4 20:01:43 kjcf05n03 systemd[1]: lldpad.service: Succeeded. Nov 4 20:01:43 kjcf05n03 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 4 20:01:43 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 4 20:01:43 kjcf05n03 systemd[1]: lldpad.socket: Succeeded. Nov 4 20:01:43 kjcf05n03 systemd[1]: Closed lldpad.socket. Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 4 20:01:43 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting IPMI Driver... Nov 4 20:01:43 kjcf05n03 systemd[1]: Started IPMI Driver. Nov 4 20:01:43 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:43 kjcf05n03 systemd[3090]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:01:43 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Ipmievd Daemon... Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 1 | Nov-05-2024 | 01:31:05 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 2 | Nov-05-2024 | 01:31:56 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 3 | Nov-05-2024 | 01:31:57 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 4 | Nov-05-2024 | 01:33:03 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 5 | Nov-05-2024 | 01:33:03 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 6 | Nov-05-2024 | 01:57:50 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 7 | Nov-05-2024 | 01:57:50 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 8 | Nov-05-2024 | 01:57:50 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 9 | Nov-05-2024 | 01:57:50 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 10 | Nov-05-2024 | 01:57:50 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 11 | Nov-05-2024 | 01:57:50 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 12 | Nov-05-2024 | 01:57:50 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 13 | Nov-05-2024 | 01:57:50 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 14 | Nov-05-2024 | 01:57:50 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 15 | Nov-05-2024 | 01:57:50 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 16 | Nov-05-2024 | 01:57:50 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 17 | Nov-05-2024 | 01:57:50 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 18 | Nov-05-2024 | 01:58:20 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 19 | Nov-05-2024 | 01:58:20 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 20 | Nov-05-2024 | 01:58:20 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 21 | Nov-05-2024 | 01:58:20 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 22 | Nov-05-2024 | 01:58:20 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 23 | Nov-05-2024 | 01:58:20 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 24 | Nov-05-2024 | 01:58:20 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 25 | Nov-05-2024 | 01:58:20 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 26 | Nov-05-2024 | 01:58:20 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 27 | Nov-05-2024 | 01:58:20 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 28 | Nov-05-2024 | 01:58:20 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 20:01:43 kjcf05n03 ipmievd[4007]: 29 | Nov-05-2024 | 01:58:20 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 20:01:43 kjcf05n03 ipmievd[4010]: Reading sensors... Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Ipmievd Daemon. Nov 4 20:01:43 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:43 kjcf05n03 systemd[3090]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 4 20:01:43 kjcf05n03 nscd[2240]: 2240 monitored file `/etc/hosts` was moved into place, adding watch Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 20:01:43 kjcf05n03 systemd[1]: set-mlx-config.service: Succeeded. Nov 4 20:01:43 kjcf05n03 systemd[1]: Stopped Set Mellanox configuration. Nov 4 20:01:43 kjcf05n03 systemd[1]: Stopping Set Mellanox configuration... Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 4 20:01:43 kjcf05n03 beSetMlxConfig[4067]: ConnectX-3 multiport not detected Nov 4 20:01:43 kjcf05n03 beSetMlxConfig[4067]: Starting MST (Mellanox Software Tools) driver set Nov 4 20:01:43 kjcf05n03 beSetMlxConfig[4067]: Loading MST PCI module - Success Nov 4 20:01:43 kjcf05n03 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 20:01:43 kjcf05n03 beSetMlxConfig[4067]: [warn] mst_pciconf is already loaded, skipping Nov 4 20:01:43 kjcf05n03 beSetMlxConfig[4067]: Create devices Nov 4 20:01:43 kjcf05n03 beSetMlxConfig[4067]: Unloading MST PCI module (unused) - Success Nov 4 20:01:43 kjcf05n03 ipmievd[4010]: Waiting for events... Nov 4 20:01:43 kjcf05n03 beSetMlxConfig[4067]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 20:01:43 kjcf05n03 beSetMlxConfig[4067]: ib mode Nov 4 20:01:43 kjcf05n03 beSetMlxConfig[4067]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 20:01:43 kjcf05n03 beSetMlxConfig[4067]: ib mode Nov 4 20:01:43 kjcf05n03 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 20:01:43 kjcf05n03 systemd-udevd[4968]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:01:43 kjcf05n03 systemd-udevd[4969]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:01:43 kjcf05n03 systemd-udevd[4972]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:01:43 kjcf05n03 systemd-udevd[4974]: Using default interface naming scheme 'rhel-8.0'. Nov 4 20:01:43 kjcf05n03 systemd-udevd[4974]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:01:43 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 20:01:43 kjcf05n03 systemd[3090]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:01:43 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[5010]: Setting up Mellanox network interface: ib0 Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[5011]: Setting up Mellanox network interface: ib1 Nov 4 20:01:43 kjcf05n03 systemd-udevd[4970]: Using default interface naming scheme 'rhel-8.0'. Nov 4 20:01:43 kjcf05n03 systemd-udevd[4970]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:01:43 kjcf05n03 systemd-udevd[4971]: Using default interface naming scheme 'rhel-8.0'. Nov 4 20:01:43 kjcf05n03 systemd-udevd[4971]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[5060]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[5061]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[5091]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[5092]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[5093]: No configuration found for ib0 Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[5094]: No configuration found for ib1 Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[5101]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 20:01:43 kjcf05n03 mlnx_interface_mgr[5102]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 20:01:43 kjcf05n03 mlnx_conf_mgr[5141]: INFO: No configurations found for mlx5_0, skipping. Nov 4 20:01:43 kjcf05n03 mlnx_conf_mgr[5142]: INFO: No configurations found for mlx5_1, skipping. Nov 4 20:01:43 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 20:01:43 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}afa44fc83e68fcfc7d09642ccf6aadd81a7164390fa3826663129e25b922cf9c' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}afa44fc83e68fcfc7d09642ccf6aadd81a7164390fa3826663129e25b922cf9c' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}327ed8bebda98f66b9c0baf50bc56ea08494ce4a28398d8687df67ade621d6fa' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}327ed8bebda98f66b9c0baf50bc56ea08494ce4a28398d8687df67ade621d6fa' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}fd71161697a2eeb0f8f541c026a5121f16346727938597cbbc66fbdfc114f9b9' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}fd71161697a2eeb0f8f541c026a5121f16346727938597cbbc66fbdfc114f9b9' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}112f69b1e505ffbb5439debf4f115b5040484b14b9c4a5c4ebb2465da4c6db0c' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}112f69b1e505ffbb5439debf4f115b5040484b14b9c4a5c4ebb2465da4c6db0c' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 20:01:43 kjcf05n03 systemd[1]: Stopping NTP client/server... Nov 4 20:01:43 kjcf05n03 chronyd[2183]: chronyd exiting Nov 4 20:01:43 kjcf05n03 systemd[1]: chronyd.service: Succeeded. Nov 4 20:01:43 kjcf05n03 systemd[1]: Stopped NTP client/server. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 4 20:01:43 kjcf05n03 chronyd[5177]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 20:01:43 kjcf05n03 chronyd[5177]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 20:01:43 kjcf05n03 chronyd[5177]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 20:01:43 kjcf05n03 chronyd[5177]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 4 20:01:43 kjcf05n03 systemd[1]: Started NTP client/server. Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 20:01:43 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:43 kjcf05n03 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 4 20:01:43 kjcf05n03 systemd[1]: dwd.service: Succeeded. Nov 4 20:01:43 kjcf05n03 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 20:01:43 kjcf05n03 dwd[5210]: dwd: vMay 29 2024 : 15:38:26 Nov 4 20:01:43 kjcf05n03 dwd[5210]: /usr/sbin/dwd -i 15 -d Nov 4 20:01:43 kjcf05n03 dwd[5210]: dwd: option Lethal: 0 Nov 4 20:01:43 kjcf05n03 dwd[5210]: dwd: option Interval: 15 Nov 4 20:01:43 kjcf05n03 dwd[5210]: dwd: option abrtlimit: 10 Nov 4 20:01:43 kjcf05n03 dwd[5210]: dwd: option DZPeriod: 604800 Nov 4 20:01:43 kjcf05n03 dwd[5210]: dwd: option SmartPeriod: 43200 Nov 4 20:01:43 kjcf05n03 dwd[5210]: dwd: option SDDEnabled: 1 Nov 4 20:01:43 kjcf05n03 dwd[5210]: dwd: option SDDAwaitScale: 3 Nov 4 20:01:43 kjcf05n03 dwd[5210]: dwd: option SDDAwaitMin: 100 Nov 4 20:01:43 kjcf05n03 dwd[5210]: dwd: option Verbosity: 1 Nov 4 20:01:43 kjcf05n03 dwd[5210]: dwd: option StandAlone: 0 Nov 4 20:01:43 kjcf05n03 dwd[5210]: option Lethal: 0 Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 20:01:43 kjcf05n03 dwd[5210]: option Interval: 15 Nov 4 20:01:43 kjcf05n03 dwd[5210]: option abrtlimit: 10 Nov 4 20:01:43 kjcf05n03 dwd[5210]: option DZPeriod: 604800 Nov 4 20:01:43 kjcf05n03 dwd[5210]: option SmartPeriod: 43200 Nov 4 20:01:43 kjcf05n03 dwd[5210]: option SDDEnabled: 1 Nov 4 20:01:43 kjcf05n03 dwd[5210]: option SDDAwaitScale: 3 Nov 4 20:01:43 kjcf05n03 dwd[5210]: option SDDAwaitMin: 100 Nov 4 20:01:43 kjcf05n03 dwd[5210]: option Verbosity: 1 Nov 4 20:01:43 kjcf05n03 dwd[5210]: option StandAlone: 0 Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 4 20:01:43 kjcf05n03 dwd[5211]: option Lethal now set to 1 Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 20:01:43 kjcf05n03 dwd[5211]: option abrtlimit now set to 1 Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 20:01:43 kjcf05n03 dwd[5211]: option SmartPeriod now set to 86400 Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 20:01:43 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 20:01:43 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Discard unused blocks. Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:01:43 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:43 kjcf05n03 python3.9[5240]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 4 20:01:43 kjcf05n03 python3.9[3090]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 20:01:43 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Periodic ZFS scrub. Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:01:43 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 20:01:43 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting Sed Control Plane worker process... Nov 4 20:01:43 kjcf05n03 sedcpwrkr[5379]: Using config script: /etc/sedcpwrkr.conf Nov 4 20:01:43 kjcf05n03 sedcpwrkr[5379]: - Creating default directory: '/var/log/sedcpwrkr' Nov 4 20:01:43 kjcf05n03 sedcpwrkr[5379]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 4 20:01:43 kjcf05n03 sedcpwrkr[5379]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 4 20:01:43 kjcf05n03 sedcpwrkr[5379]: - Creating default directory: '/var/run/sedcpwrkr' Nov 4 20:01:43 kjcf05n03 sedcpwrkr[5379]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 4 20:01:43 kjcf05n03 sedcpwrkr[5379]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 4 20:01:43 kjcf05n03 sedcpwrkr-server[5410]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 20:01:43 kjcf05n03 sedcpwrkr[5379]: celery multi v5.2.7 (dawn-chorus) Nov 4 20:01:43 kjcf05n03 sedcpwrkr[5379]: > Starting nodes... Nov 4 20:01:43 kjcf05n03 sedcpwrkr[5379]: > sedcpwrkr@kjcf05n03: OK Nov 4 20:01:43 kjcf05n03 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 4 20:01:43 kjcf05n03 sedcpwrkr-server[5412]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 20:01:43 kjcf05n03 sedcpwrkr-server[5412]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 20:01:43 kjcf05n03 sedcpwrkr-server[5412]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 20:01:43 kjcf05n03 systemd[1]: Started Sed Control Plane worker process. Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 20:01:43 kjcf05n03 systemd[1]: Reloading System Logger Daemon. Nov 4 20:01:43 kjcf05n03 systemd[1]: Reloaded System Logger Daemon. Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 20:01:43 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 4 20:01:43 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 4 20:01:43 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:43 kjcf05n03 systemd[1]: Starting IPv4 firewall with iptables... Nov 4 20:01:43 kjcf05n03 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 20:01:43 kjcf05n03 iptables.init[5479]: iptables: Applying firewall rules: [ OK ] Nov 4 20:01:43 kjcf05n03 systemd[1]: Started IPv4 firewall with iptables. Nov 4 20:01:43 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:44 kjcf05n03 systemd[3090]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 20:01:44 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 20:01:44 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 20:01:44 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:45 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 20:01:45 kjcf05n03 systemd[1]: openhpid.service: Supervising process 5576 which is not our child. We'll most likely not notice when it exits. Nov 4 20:01:45 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 20:01:45 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:45 kjcf05n03 openhpid[5576]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 20:01:45 kjcf05n03 openhpid[5576]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 20:01:45 kjcf05n03 openhpid[5576]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 20:01:45 kjcf05n03 openhpid[5576]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 20:01:45 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:45 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:01:45 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:01:45 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 4 20:01:45 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 4 20:01:45 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 20:01:45 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 20:01:45 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:46 kjcf05n03 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 4 20:01:46 kjcf05n03 dcs-collectord[5667]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 4 20:01:46 kjcf05n03 hpi.inv.log[5667]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 4 20:01:46 kjcf05n03 dcs-collectord[5667]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 4 20:01:46 kjcf05n03 dcs-collectord[5667]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 4 20:01:46 kjcf05n03 dcs-collector[5658]: Starting dcs-collector:[ OK ] Nov 4 20:01:46 kjcf05n03 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 4 20:01:46 kjcf05n03 dcs-collectord[5670]: INFO Starting collection for memory_info (collection_process.py:52) Nov 4 20:01:46 kjcf05n03 dcs-collectord[5670]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 20:01:46 kjcf05n03 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 4 20:01:46 kjcf05n03 dcs-collectord[5670]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 20:01:46 kjcf05n03 dcs-collectord[5670]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 20:01:46 kjcf05n03 dcs-collectord[5670]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 4 20:01:46 kjcf05n03 dcs-collectord[5670]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 4 20:01:46 kjcf05n03 dcs-collectord[5670]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 4 20:01:46 kjcf05n03 dcs-collectord[5670]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259349644", "units": "kB"}, {"name": "MemAvailable", "value": "258629112", "units": "kB"}, {"name": "Buffers", "value": "84336", "units": "kB"}, {"name": "Cached", "value": "1821340", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1687704", "units": "kB"}, {"name": "Inactive", "value": "959848", "units": "kB"}, {"name": "Active(anon)", "value": "1520712", "units": "kB"}, {"name": "Inactive(anon)", "value": "824772", "units": "kB"}, {"name": "Active(file)", "value": "166992", "units": "kB"}, {"name": "Inactive(file)", "value": "135076", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "751704", "units": "kB"}, {"name": "Mapped", "value": "86388", "units": "kB"}, {"name": "Shmem", "value": "1593312", "units": "kB"}, {"name": "KReclaimable", "value": "108684", "units": "kB"}, {"name": "Slab", "value": "274048", "units": "kB"}, {"name": "SReclaimable", "value": "108684", "units": "kB"}, {"name": "SUnreclaim", "value": "165364", "units": "kB"}, {"name": "KernelStack", "value": "9744", "units": "kB"}, {"name": "PageTables", "value": "21052", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3185184", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11264", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "2048", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "252232", "units": "kB"}, {"name": "DirectMap2M", "value": "22681600", "units": "kB"}, {"name": "DirectMap1G", "value": "245366784", "units": "kB"}]}' Nov 4 20:01:46 kjcf05n03 dcs-collectord[5670]: INFO Completed collection for memory_info (collection_process.py:59) Nov 4 20:01:46 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:47 kjcf05n03 dcs-collectord[5670]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 4 20:01:47 kjcf05n03 dcs-collectord[5670]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730772106.3630416], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730772106.6079557], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730772106.2929895, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 4 20:01:47 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:47 kjcf05n03 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 4 20:01:47 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:01:47 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:01:47 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 4 20:01:47 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 4 20:01:47 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 20:01:47 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 20:01:47 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:47 kjcf05n03 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 4 20:01:47 kjcf05n03 firmware-update-orc[5776]: Using config script: /etc/firmware_update_orc.conf Nov 4 20:01:47 kjcf05n03 firmware-update-orc[5776]: - Creating default directory: '/var/log/firmware-update-orc' Nov 4 20:01:47 kjcf05n03 firmware-update-orc[5776]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 4 20:01:47 kjcf05n03 firmware-update-orc[5776]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 4 20:01:47 kjcf05n03 firmware-update-orc[5776]: - Creating default directory: '/var/run/firmware-update-orc' Nov 4 20:01:47 kjcf05n03 firmware-update-orc[5776]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 4 20:01:47 kjcf05n03 firmware-update-orc[5776]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 4 20:01:47 kjcf05n00 mcfcli[3673891]: %3|1730772107.400|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:01:47 kjcf05n03 firmware-update-orc-server[5814]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 20:01:47 kjcf05n03 firmware-update-orc[5776]: celery multi v5.2.7 (dawn-chorus) Nov 4 20:01:47 kjcf05n03 firmware-update-orc[5776]: > Starting nodes... Nov 4 20:01:47 kjcf05n03 firmware-update-orc[5776]: > worker1@kjcf05n03: OK Nov 4 20:01:47 kjcf05n03 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 4 20:01:47 kjcf05n03 firmware-update-orc-server[5816]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 20:01:47 kjcf05n03 firmware-update-orc-server[5816]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 20:01:47 kjcf05n03 firmware-update-orc-server[5816]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 20:01:47 kjcf05n03 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 4 20:01:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 20:01:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 20:01:48 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:48 kjcf05n03 systemd[3090]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:01:48 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:01:48 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:01:48 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 20:01:48 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 20:01:48 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 20:01:48 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 20:01:48 kjcf05n03 dbus-daemon[2131]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 20:01:48 kjcf05n03 dbus-daemon[2131]: [system] Reloaded configuration Nov 4 20:01:48 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 4 20:01:48 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 4 20:01:48 kjcf05n03 dbus-daemon[2131]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 20:01:48 kjcf05n03 dbus-daemon[2131]: [system] Reloaded configuration Nov 4 20:01:48 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 20:01:48 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 20:01:48 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 20:01:48 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 20:01:48 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:48 kjcf05n03 systemd[1]: Starting Manages hardware resources... Nov 4 20:01:49 kjcf05n03 ras-resource-manager-agent[5932]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 4 20:01:49 kjcf05n03 ras-resource-manager-agent[5918]: Starting ras-resource-manager-agent:[ OK ] Nov 4 20:01:49 kjcf05n03 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 4 20:01:49 kjcf05n03 ras-resource-manager-agent[5934]: INFO Starting the service handler (service_main_handler.py:98) Nov 4 20:01:49 kjcf05n03 ras-resource-manager-client[5934]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 4 20:01:49 kjcf05n03 systemd[1]: Started Manages hardware resources. Nov 4 20:01:49 kjcf05n03 ras-resource-manager-client[5934]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 20:01:49 kjcf05n03 ras-resource-manager-client[5944]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 20:01:49 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:49 kjcf05n03 systemd[3090]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:01:49 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:01:49 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:01:49 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 20:01:49 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 20:01:49 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:50 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 4 20:01:50 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:50 kjcf05n03 systemd[3090]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: Press Ctrl+C to exit. Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: Plugin support version 1.0 Nov 4 20:01:50 kjcf05n03 zabbix_agent2[6018]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 20:01:50 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:01:50 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:01:50 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:51 kjcf05n03 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 4 20:01:51 kjcf05n03 dcs-notification-sender[6098]: dcs-notification-senderd is stopped Nov 4 20:01:51 kjcf05n03 zabbix-agent2[6112]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 4 20:01:51 kjcf05n03 dcs-notification-sender[6098]: Starting notification-sender:[ OK ] Nov 4 20:01:51 kjcf05n03 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 4 20:01:51 kjcf05n03 zabbix-agent2[6114]: INFO DCS notification agent started. (agent.py:61) Nov 4 20:01:51 kjcf05n03 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 4 20:01:51 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:52 kjcf05n03 systemd[3090]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:01:52 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:01:52 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:01:52 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 20:01:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 20:01:52 kjcf05n03 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 4 20:01:52 kjcf05n03 dcs-collectord[6217]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 4 20:01:52 kjcf05n03 dcs-collectord[6217]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 4 20:01:52 kjcf05n03 dcs-bulk-data-sender[6217]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 4 20:01:52 kjcf05n03 dcs-bulk-data-sender[6208]: Starting bulk-data-sender:[ OK ] Nov 4 20:01:52 kjcf05n03 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 4 20:01:52 kjcf05n03 dcs-collectord[6219]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 4 20:01:52 kjcf05n03 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 4 20:01:52 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:53 kjcf05n03 systemd[3090]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:01:53 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:01:53 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:01:53 kjcf05n03 nscd[2240]: 2240 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 4 20:01:53 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 20:01:53 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 20:01:53 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 20:01:53 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 20:01:53 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 20:01:53 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 20:01:53 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 4 20:01:53 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 4 20:01:53 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 4 20:01:53 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 4 20:01:53 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 20:01:53 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 20:01:53 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 20:01:53 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 20:01:53 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 20:01:53 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 20:01:53 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 20:01:53 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 20:01:53 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 4 20:01:53 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 4 20:01:53 kjcf05n03 python3.9[5240]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 4 20:01:53 kjcf05n03 python3.9[3090]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:01:53 kjcf05n03 systemd[1]: Stopping System Security Services Daemon... Nov 4 20:01:53 kjcf05n03 sssd[nss][2443]: Shutting down (status = 0) Nov 4 20:01:53 kjcf05n03 sssd[be[implicit_files]][2317]: Shutting down (status = 0) Nov 4 20:01:53 kjcf05n03 systemd[1]: sssd.service: Succeeded. Nov 4 20:01:53 kjcf05n03 systemd[1]: Stopped System Security Services Daemon. Nov 4 20:01:53 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 4 20:01:54 kjcf05n03 sssd[sssd][6291]: Starting up Nov 4 20:01:54 kjcf05n03 sssd[be[implicit_files]][6292]: Starting up Nov 4 20:01:54 kjcf05n03 sssd[nss][6303]: Starting up Nov 4 20:01:54 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 4 20:01:54 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 20:01:54 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 20:01:55 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 20:01:55 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 20:01:55 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 4 20:01:55 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 4 20:01:55 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 20:01:55 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 20:01:55 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure) defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 4 20:01:55 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure: defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 4 20:01:55 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure) defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 4 20:01:55 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure: defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 4 20:01:55 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 20:01:55 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 20:01:55 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 20:01:55 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 20:01:55 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:01:55 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:01:55 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 20:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 20:01:55 kjcf05n03 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 4 20:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 20:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 20:01:56 kjcf05n03 icinga2[6350]: [2024-11-04 20:01:55 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 4 20:01:56 kjcf05n03 icinga2[6350]: [2024-11-04 20:01:55 -0600] information/cli: Loading configuration file(s). Nov 4 20:01:56 kjcf05n03 icinga2[6350]: [2024-11-04 20:01:55 -0600] information/ConfigItem: Committing config item(s). Nov 4 20:01:56 kjcf05n03 icinga2[6350]: [2024-11-04 20:01:55 -0600] information/ApiListener: My API identity: kjcf05n03 Nov 4 20:01:56 kjcf05n03 icinga2[6350]: [2024-11-04 20:01:55 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 4 20:01:56 kjcf05n03 icinga2[6350]: [2024-11-04 20:01:55 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 4 20:01:56 kjcf05n03 icinga2[6350]: [2024-11-04 20:01:55 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 4 20:01:56 kjcf05n03 icinga2[6350]: [2024-11-04 20:01:55 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 4 20:01:56 kjcf05n03 icinga2[6350]: [2024-11-04 20:01:55 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 4 20:01:56 kjcf05n03 icinga2[6350]: [2024-11-04 20:01:55 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 4 20:01:56 kjcf05n03 icinga2[6350]: [2024-11-04 20:01:55 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 4 20:01:56 kjcf05n03 icinga2[6350]: [2024-11-04 20:01:55 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 4 20:01:56 kjcf05n03 icinga2[6350]: [2024-11-04 20:01:55 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 4 20:01:56 kjcf05n03 icinga2[6350]: [2024-11-04 20:01:55 -0600] information/cli: Closing console log. Nov 4 20:01:56 kjcf05n03 systemd[1]: Started Icinga host/service/network monitoring system. Nov 4 20:01:56 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:56 kjcf05n03 systemd[3090]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:01:56 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:01:56 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:01:57 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 20:01:57 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 20:01:57 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:57 kjcf05n03 systemd[1]: Started Icinga2 network monitor. Nov 4 20:01:57 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:57 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 20:01:57 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:01:57 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:01:58 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 20:01:58 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 20:01:58 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 20:01:58 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 20:01:58 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 4 20:01:58 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 4 20:01:58 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 4 20:01:58 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 4 20:01:58 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 20:01:58 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 20:01:58 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 20:01:58 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 20:01:58 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 4 20:01:58 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 4 20:01:58 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:58 kjcf05n03 systemd[1]: Starting Naming services LDAP client daemon.... Nov 4 20:01:58 kjcf05n03 nslcd[6967]: version 0.9.9 starting Nov 4 20:01:58 kjcf05n03 nslcd[6967]: accepting connections Nov 4 20:01:58 kjcf05n03 systemd[1]: Started Naming services LDAP client daemon.. Nov 4 20:01:58 kjcf05n03 systemd[1]: Reloading. Nov 4 20:01:59 kjcf05n03 systemd[3090]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:01:59 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:01:59 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:01:59 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 20:01:59 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 20:01:59 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 20:01:59 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 20:02:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 20:02:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 20:02:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 20:02:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 20:02:00 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 20:02:00 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 20:02:00 kjcf05n03 dcs-bulk-data-sender[6219]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 4 20:02:00 kjcf05n03 dcs-collectord[6219]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 4 20:02:00 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 20:02:00 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 20:02:00 kjcf05n03 systemd[1]: Reloading. Nov 4 20:02:00 kjcf05n03 systemd[1]: Starting DEAR Control Plane worker process... Nov 4 20:02:00 kjcf05n03 dearcpw[7074]: Using config script: /etc/dearcpw.conf Nov 4 20:02:00 kjcf05n03 dearcpw[7074]: - Creating default directory: '/var/log/dearcpw' Nov 4 20:02:00 kjcf05n03 dearcpw[7074]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 4 20:02:00 kjcf05n03 dearcpw[7074]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 4 20:02:00 kjcf05n03 dearcpw[7074]: - Creating default directory: '/var/run/dearcpw' Nov 4 20:02:00 kjcf05n03 dearcpw[7074]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 4 20:02:00 kjcf05n03 dearcpw[7074]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 4 20:02:01 kjcf05n03 dearcpw-server[7114]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 20:02:01 kjcf05n03 dearcpw[7074]: celery multi v5.2.7 (dawn-chorus) Nov 4 20:02:01 kjcf05n03 dearcpw[7074]: > Starting nodes... Nov 4 20:02:01 kjcf05n03 dearcpw[7074]: > dearcpw@kjcf05n03: OK Nov 4 20:02:01 kjcf05n03 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 4 20:02:01 kjcf05n03 dearcpw-server[7116]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 20:02:01 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:54500). Nov 4 20:02:01 kjcf05n01 rsyncd[3872160]: connect from kjcf05n03 (172.16.2.6) Nov 4 20:02:01 kjcf05n01 rsyncd[3872160]: rsync to puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 4 20:02:01 kjcf05n01 rsyncd[3872160]: receiving file list Nov 4 20:02:01 kjcf05n03 dearcpw-server[7116]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 20:02:01 kjcf05n03 dearcpw-server[7116]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 20:02:01 kjcf05n03 systemd[1]: Started DEAR Control Plane worker process. Nov 4 20:02:01 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:02:01 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:02:01 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 4 20:02:01 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 4 20:02:01 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 4 20:02:01 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 4 20:02:01 kjcf05n03 dcs-collectord[5670]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 20:02:01 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 4 20:02:01 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 4 20:02:01 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 4 20:02:01 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 4 20:02:01 kjcf05n03 dcs-collectord[5670]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 20:02:01 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 4 20:02:01 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 4 20:02:01 kjcf05n01 rsyncd[3872160]: sent 29 bytes received 325 bytes total size 10901 Nov 4 20:02:01 kjcf05n01 systemd[1]: rsyncd@660-172.16.2.2:873-172.16.2.6:54500.service: Succeeded. Nov 4 20:02:02 kjcf05n03 puppet[7158]: IEC: 017000000: Node is up and running: { "node": "kjcf05n03" } Nov 4 20:02:02 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 4 20:02:02 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 4 20:02:02 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 4 20:02:02 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 4 20:02:02 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 4 20:02:02 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 4 20:02:02 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 20:02:02 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 20:02:02 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 20:02:02 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 20:02:02 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 20:02:02 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 20:02:02 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 20:02:02 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 20:02:03 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 20:02:03 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 20:02:03 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 20:02:03 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 20:02:04 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 20:02:04 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 20:02:04 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 20:02:04 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 20:02:05 kjcf05n03 ipmievd[4010]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 4 20:02:05 kjcf05n03 ipmievd[4010]: System Event sensor - Timestamp Clock Sync Nov 4 20:02:05 kjcf05n03 ipmievd[3090]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:02:05 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 20:02:05 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 20:02:05 kjcf05n03 systemd[1]: Reloading. Nov 4 20:02:05 kjcf05n03 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 4 20:02:05 kjcf05n03 diskless-swap[7244]: HA_PS_000: recovering journal Nov 4 20:02:05 kjcf05n03 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 20:02:05 kjcf05n03 diskless-swap[7244]: HA_PS_000: clean, 2285/6400 files, 7056/25600 blocks Nov 4 20:02:05 kjcf05n03 diskless-swap[7244]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 4 20:02:05 kjcf05n03 diskless-swap[7244]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 4 20:02:05 kjcf05n03 diskless-swap[7244]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 4 20:02:05 kjcf05n03 diskless-swap[7244]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 4 20:02:05 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 4 20:02:05 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:02:05 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:02:05 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 4 20:02:05 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 4 20:02:05 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 20:02:05 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 20:02:05 kjcf05n03 systemd[1]: Stopping OpenSSH server daemon... Nov 4 20:02:05 kjcf05n03 systemd[1]: sshd.service: Succeeded. Nov 4 20:02:05 kjcf05n03 systemd[1]: Stopped OpenSSH server daemon. Nov 4 20:02:05 kjcf05n03 systemd[1]: Stopped target sshd-keygen.target. Nov 4 20:02:05 kjcf05n03 systemd[1]: Stopping sshd-keygen.target. Nov 4 20:02:05 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 4 20:02:05 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 4 20:02:05 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 4 20:02:05 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 4 20:02:05 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 4 20:02:05 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 20:02:05 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 20:02:06 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 20:02:06 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 20:02:06 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 20:02:06 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 20:02:07 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 20:02:07 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 20:02:07 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 20:02:07 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 20:02:08 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 20:02:08 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 20:02:08 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 20:02:08 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 20:02:08 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 20:02:08 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 20:02:08 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 20:02:08 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 20:02:08 kjcf05n03 systemd[1]: Reloading. Nov 4 20:02:08 kjcf05n03 systemd[1]: Set up automount opt-firmware.automount. Nov 4 20:02:09 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:02:09 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:02:09 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 4 20:02:09 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 4 20:02:09 kjcf05n03 systemd[1]: Reloading. Nov 4 20:02:09 kjcf05n03 systemd[1]: Set up automount mnt-llog.automount. Nov 4 20:02:09 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:02:09 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:02:09 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 20:02:09 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 20:02:09 kjcf05n03 systemd[1]: Reloading. Nov 4 20:02:10 kjcf05n03 systemd[1]: Set up automount usr-share-man.automount. Nov 4 20:02:10 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:02:10 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:02:10 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 4 20:02:10 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 4 20:02:10 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 4 20:02:10 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 4 20:02:10 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 4 20:02:10 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 4 20:02:10 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 20:02:10 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 20:02:10 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 20:02:10 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 20:02:10 kjcf05n03 systemd[1]: Reloading. Nov 4 20:02:10 kjcf05n03 systemd[1]: Starting Crash recovery kernel arming... Nov 4 20:02:10 kjcf05n03 kdumpctl[7883]: kdump: No kdump initial ramdisk found. Nov 4 20:02:10 kjcf05n03 kdumpctl[7883]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 4 20:02:10 kjcf05n03 dracut[7995]: dracut-049-135.git20210121.el8 Nov 4 20:02:11 kjcf05n03 dracut[7997]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 4 20:02:11 kjcf05n03 dracut[7997]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 20:02:11 kjcf05n03 dracut[7997]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 20:02:11 kjcf05n03 dracut[7997]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 4 20:02:11 kjcf05n03 dracut[7997]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 4 20:02:11 kjcf05n03 dracut[7997]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 20:02:11 kjcf05n03 dracut[7997]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 20:02:11 kjcf05n03 dracut[7997]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local dev holder Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + require_binaries mdadm expr Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _module_name=90hperaid Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ mdadm = \-\m ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for cmd in "$@" Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + find_binary mdadm Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for cmd in "$@" Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + find_binary expr Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n -h ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for dev in "${!host_fs_types[@]}" Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ nfs != *_raid_member ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + continue Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _ret=255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + ret=255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ 255 = 0 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ 255 = 255 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ module_depends hperaid Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: +++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: +++ set -x Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ depends Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo rootfs-block Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ return 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ _ret=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ return 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for _moddep in $(module_depends $_mod) Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all == *\ hperaid\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + add_dracutmodules+=' rootfs-block ' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ == *\ hperaid\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check_module rootfs-block Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _mod=rootfs-block Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ == *\ rootfs-block\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n '' ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + mods_checked_as_dep+=' rootfs-block ' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all == *\ rootfs-block\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + module_check rootfs-block 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 2 -eq 2 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _forced=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _ret=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + ret=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ 0 = 0 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ module_depends rootfs-block Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: +++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 20:02:11 kjcf05n03 kdumpctl[3090]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ depends Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo fs-lib Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ _ret=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ return 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for _moddep in $(module_depends $_mod) Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all == *\ rootfs-block\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + add_dracutmodules+=' fs-lib ' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ == *\ rootfs-block\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check_module fs-lib Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _mod=fs-lib Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n '' ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + mods_checked_as_dep+=' fs-lib ' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all == *\ fs-lib\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + module_check fs-lib 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 2 -eq 2 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _forced=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _ret=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + ret=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ 0 = 0 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ module_depends fs-lib Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: +++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ depends Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ return 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ _ret=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ return 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + mods_to_load+=' fs-lib ' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + mods_to_load+=' rootfs-block ' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + mods_to_load+=' hperaid ' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _mod=90kernel-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _mod=kernel-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check_module kernel-modules 1 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _mod=kernel-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all = all ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + module_check kernel-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 1 -eq 2 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + true Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _ret=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + ret=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ 0 != 0 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ module_depends kernel-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: +++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ depends Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ true Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ _ret=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ return 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + mods_to_load+=' kernel-modules ' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _mod=90kernel-modules-extra Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _mod=kernel-modules-extra Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check_module kernel-modules-extra 1 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _mod=kernel-modules-extra Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all = all ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + module_check kernel-modules-extra Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 1 -eq 2 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + true Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _ret=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + ret=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ 0 != 0 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ module_depends kernel-modules-extra Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: +++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ depends Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ true Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ _ret=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ return 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + mods_to_load+=' kernel-modules-extra ' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _mod=90kernel-network-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _mod=kernel-network-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check_module kernel-network-modules 1 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _mod=kernel-network-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all = all ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + module_check kernel-network-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 1 -eq 2 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _ret=255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + ret=255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ 255 != 0 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 1 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _mod=90livenet Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _mod=livenet Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check_module livenet 1 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _mod=livenet Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all = all ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + module_check livenet Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 1 -eq 2 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _ret=255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + ret=255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ 255 != 0 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 1 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _mod=90lvm Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _mod=lvm Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check_module lvm 1 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _mod=lvm Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all = all ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + module_check lvm Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 1 -eq 2 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + require_binaries lvm Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _module_name=90lvm Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ lvm = \-\m ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for cmd in "$@" Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + find_binary lvm Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n -h ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for fs in "${host_fs_types[@]}" Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ nfs = LVM*_member ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _ret=255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + ret=255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ 255 != 0 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 1 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _mod=90mdraid Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _mod=mdraid Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check_module mdraid 1 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _mod=mdraid Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all = all ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + module_check mdraid Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 1 -eq 2 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _rootdev Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + require_binaries mdadm expr Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _module_name=90mdraid Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ mdadm = \-\m ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for cmd in "$@" Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + find_binary mdadm Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for cmd in "$@" Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + find_binary expr Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n -h ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for dev in "${!host_fs_types[@]}" Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ nfs != *_raid_member ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + continue Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _ret=255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + ret=255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ 255 != 0 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 1 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _mod=90multipath Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _mod=multipath Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check_module multipath 1 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _mod=multipath Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all = all ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + module_check multipath Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 1 -eq 2 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _rootdev Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n -h ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for_each_host_dev_and_slaves is_mpath Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _func=is_mpath Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _dev Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for _dev in "${host_devs[@]}" Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + continue Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 1 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _ret=255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + ret=255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ 255 != 0 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 1 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _mod=90qemu Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _mod=qemu Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check_module qemu 1 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _mod=qemu Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all = all ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + module_check qemu Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 1 -eq 2 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n -h ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + type -P systemd-detect-virt Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ systemd-detect-virt --vm Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + vm=none Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + (( 1 != 0 )) Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _ret=255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + ret=255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ 255 != 0 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 1 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _mod=90qemu-net Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _mod=qemu-net Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check_module qemu-net 1 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _mod=qemu-net Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all = all ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + module_check qemu-net Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 1 -eq 2 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n -h ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + type -P systemd-detect-virt Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ systemd-detect-virt --vm Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + vm= Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + (( 1 != 0 )) Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _ret=255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + ret=255 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ 255 != 0 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + return 1 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _mod=90stratis Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + _mod=stratis Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check_module stratis 1 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _mod=stratis Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddep Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -n 1 ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ all = all ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + module_check stratis Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ read a b Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _forced=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _hostonly=-h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 1 -eq 2 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + is_func check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: ++ type -t check Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + '[' 0 -ne 0 ']' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + check -h Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _module_name=90stratis Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + local _ret=0 Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + [[ stratisd-init = \-\m ]] Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + for cmd in "$@" Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + find_binary stratisd-init Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 4 20:02:11 kjcf05n03 kdumpctl[7883]: + set +x Nov 4 20:02:11 kjcf05n03 dracut[7997]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 20:02:11 kjcf05n03 dracut[7997]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 4 20:02:11 kjcf05n03 dracut[7997]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 4 20:02:11 kjcf05n03 dracut[7997]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 4 20:02:11 kjcf05n03 dracut[7997]: memstrack is available Nov 4 20:02:11 kjcf05n03 dracut[7997]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 20:02:11 kjcf05n03 dracut[7997]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 20:02:12 kjcf05n03 dracut[7997]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 20:02:12 kjcf05n03 dracut[7997]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 20:02:12 kjcf05n03 dracut[7997]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 20:02:12 kjcf05n03 dracut[7997]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 20:02:12 kjcf05n03 dracut[7997]: *** Including module: bash *** Nov 4 20:02:12 kjcf05n03 dracut[7997]: *** Including module: systemd *** Nov 4 20:02:12 kjcf05n00 mcfcli[3673891]: %3|1730772132.485|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 20:02:13 kjcf05n03 dracut[7997]: *** Including module: fips *** Nov 4 20:02:13 kjcf05n03 dracut[7997]: *** Including module: systemd-initrd *** Nov 4 20:02:13 kjcf05n03 dracut[7997]: *** Including module: watchdog-modules *** Nov 4 20:02:13 kjcf05n03 dracut[7997]: *** Including module: nss-softokn *** Nov 4 20:02:13 kjcf05n03 dracut[7997]: *** Including module: i18n *** Nov 4 20:02:13 kjcf05n03 dracut[7997]: No KEYMAP configured. Nov 4 20:02:13 kjcf05n03 dracut[7997]: *** Including module: network-legacy *** Nov 4 20:02:13 kjcf05n03 dracut[7997]: *** Including module: network *** Nov 4 20:02:14 kjcf05n03 dracut[7997]: *** Including module: ib_bonding *** Nov 4 20:02:14 kjcf05n03 dracut[7997]: *** Including module: drm *** Nov 4 20:02:16 kjcf05n03 dcs-collectord[5670]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 20:02:16 kjcf05n03 dcs-collectord[5670]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 20:02:18 kjcf05n03 dracut[7997]: *** Including module: hperaid *** Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + install Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + local rule rule_path Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + inst_multiple cat expr Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.HCxE4u/initramfs -a -f cat expr Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + _ret=0 Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + (( 0 != 0 )) Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + : Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + inst_multiple -o mdmon Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.HCxE4u/initramfs -a -f -o mdmon Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + _ret=0 Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + (( 0 != 0 )) Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + : Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: ++ command -v partx Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + inst /usr/sbin/partx /sbin/partx Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + local _hostonly_install Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + [[ /usr/sbin/partx == \-\H ]] Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + [[ -e /tmp/dracut.HCxE4u/initramfs//sbin/partx ]] Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.HCxE4u/initramfs -f /usr/sbin/partx /sbin/partx Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + (( 0 != 0 )) Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + : Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: ++ command -v mdadm Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + local _hostonly_install Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + [[ -e /tmp/dracut.HCxE4u/initramfs//sbin/mdadm ]] Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.HCxE4u/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + (( 0 != 0 )) Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + : Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + [[ yes == \y\e\s ]] Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + local _raidconf Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: ++ cmdline Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: ++ local _activated dev line UUID Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: ++ declare -A _activated Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: ++ for dev in "${!host_fs_types[@]}" Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: ++ [[ nfs != *_raid_member ]] Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: ++ continue Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + _raidconf= Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + [[ -n '' ]] Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + inst_rules 64-md-raid.rules Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + local _target=/etc/udev/rules.d _rule _found Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + inst_dir /usr/lib/udev/rules.d Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + [[ -e /tmp/dracut.HCxE4u/initramfs//usr/lib/udev/rules.d ]] Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + inst_dir /etc/udev/rules.d Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + [[ -e /tmp/dracut.HCxE4u/initramfs//etc/udev/rules.d ]] Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + for _rule in "$@" Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + continue Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + continue Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + for r in '' $dracutbasedir/rules.d/ Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + [[ 64-md-raid.rules != /* ]] Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + continue Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + for r in '' $dracutbasedir/rules.d/ Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + continue Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + [[ -n '' ]] Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + set +x Nov 4 20:02:18 kjcf05n03 dracut[7997]: Skipping udev rule: 64-md-raid.rules Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + installkernel Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + instmods =drivers/md Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + local _optional=-o Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + local _silent Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + local _ret Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + [[ '' = yes ]] Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + [[ =drivers/md = \-\c ]] Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + [[ =drivers/md = \-\s ]] Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + (( 1 == 0 )) Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.HCxE4u/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + _ret=0 Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + (( 0 != 0 )) Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + [[ -n '' ]] Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + _ret=0 Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + unset check depends cmdline install installkernel Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + return 0 Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + modules_loaded+='hperaid ' Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + '[' -n '' ']' Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + _d_mod=90kernel-modules Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + _d_mod=kernel-modules Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + [[ '' = yes ]] Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + dinfo '*** Including module: kernel-modules ***' Nov 4 20:02:18 kjcf05n03 kdumpctl[7883]: + set +x Nov 4 20:02:18 kjcf05n03 dracut[7997]: *** Including module: kernel-modules *** Nov 4 20:02:18 kjcf05n03 dracut[7997]: *** Including module: kernel-modules-extra *** Nov 4 20:02:19 kjcf05n03 dracut[7997]: *** Including module: kernel-network-modules *** Nov 4 20:02:19 kjcf05n03 dracut[7997]: *** Including module: diskless-mod *** Nov 4 20:02:19 kjcf05n03 dracut[7997]: *** Including module: fstab-sys *** Nov 4 20:02:19 kjcf05n03 dracut[7997]: *** Including module: nfs *** Nov 4 20:02:19 kjcf05n03 dracut[7997]: *** Including module: rootfs-block *** Nov 4 20:02:19 kjcf05n03 dracut[7997]: *** Including module: terminfo *** Nov 4 20:02:19 kjcf05n03 dracut[7997]: *** Including module: udev-rules *** Nov 4 20:02:20 kjcf05n03 dracut[7997]: Skipping udev rule: 91-permissions.rules Nov 4 20:02:20 kjcf05n03 dracut[7997]: Skipping udev rule: 80-drivers-modprobe.rules Nov 4 20:02:20 kjcf05n03 dracut[7997]: *** Including module: dracut-systemd *** Nov 4 20:02:20 kjcf05n03 dracut[7997]: *** Including module: usrmount *** Nov 4 20:02:20 kjcf05n03 dracut[7997]: *** Including module: base *** Nov 4 20:02:21 kjcf05n03 dracut[7997]: *** Including module: fs-lib *** Nov 4 20:02:21 kjcf05n03 dracut[7997]: *** Including module: kdumpbase *** Nov 4 20:02:21 kjcf05n03 dracut[7997]: *** Including module: memstrack *** Nov 4 20:02:21 kjcf05n03 dracut[7997]: *** Including module: shutdown *** Nov 4 20:02:21 kjcf05n03 dracut[7997]: *** Including module: squash *** Nov 4 20:02:22 kjcf05n03 dracut[7997]: *** Including modules done *** Nov 4 20:02:22 kjcf05n03 dracut[7997]: *** Installing kernel module dependencies *** Nov 4 20:02:22 kjcf05n03 dracut[7997]: *** Installing kernel module dependencies done *** Nov 4 20:02:22 kjcf05n03 dracut[7997]: *** Resolving executable dependencies *** Nov 4 20:02:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730772142', 'host':'kjcf05n03', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 334 processes with STATE = RSZDT '}"] Nov 4 20:02:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730772142', 'host':'kjcf05n03', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128603 MiB (99.97% inode=100%);'}"] Nov 4 20:02:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Total Processes', 'description': 'PROCS OK: 334 processes with STATE = RSZDT ', 'message': 'PROCS OK: 334 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730772142'} Nov 4 20:02:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730772142', 'host':'kjcf05n03', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.95, 1.89, 0.84'}"] Nov 4 20:02:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128603 MiB (99.97% inode=100%);', 'message': 'DISK OK - free space: /tmp 128603 MiB (99.97% inode=100%);', 'value': 'ok', 'timestamp': '1730772142'} Nov 4 20:02:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Load', 'description': 'OK - load average: 1.95, 1.89, 0.84', 'message': 'OK - load average: 1.95, 1.89, 0.84', 'value': 'ok', 'timestamp': '1730772142'} Nov 4 20:02:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:02:24 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 4 20:02:24 kjcf05n03 dracut[7997]: *** Resolving executable dependencies done*** Nov 4 20:02:24 kjcf05n03 dracut[7997]: *** Hardlinking files *** Nov 4 20:02:24 kjcf05n03 dracut[7997]: *** Hardlinking files done *** Nov 4 20:02:24 kjcf05n03 dracut[7997]: *** Generating early-microcode cpio image *** Nov 4 20:02:24 kjcf05n03 dracut[7997]: *** Constructing AuthenticAMD.bin **** Nov 4 20:02:24 kjcf05n03 dracut[7997]: *** Store current command line parameters *** Nov 4 20:02:24 kjcf05n03 dracut[7997]: Stored kernel commandline: Nov 4 20:02:24 kjcf05n03 dracut[7997]: rd.driver.pre=sd_mod Nov 4 20:02:24 kjcf05n03 dracut[7997]: rd.driver.pre=nvme Nov 4 20:02:24 kjcf05n03 dracut[7997]: rd.driver.pre=ipmi_si Nov 4 20:02:24 kjcf05n03 dracut[7997]: rd.driver.pre=ipmi_devintf Nov 4 20:02:24 kjcf05n03 dracut[7997]: rd.driver.pre=ipmi_msghandler Nov 4 20:02:24 kjcf05n03 dracut[7997]: nameserver=172.16.2.2 Nov 4 20:02:24 kjcf05n03 dracut[7997]: nameserver=127.0.0.1 Nov 4 20:02:24 kjcf05n03 dracut[7997]: nameserver=172.16.2.2 Nov 4 20:02:24 kjcf05n03 dracut[7997]: nameserver=127.0.0.1 Nov 4 20:02:24 kjcf05n03 dracut[7997]: ifname=kdump-meth0:00:09:3d:06:9a:1a team=mgmt0:kdump-meth0 Nov 4 20:02:24 kjcf05n03 dracut[7997]: rd.neednet Nov 4 20:02:24 kjcf05n03 dracut[7997]: kdumpnic=mgmt0 Nov 4 20:02:24 kjcf05n03 dracut[7997]: bootdev=mgmt0 Nov 4 20:02:24 kjcf05n03 dracut[7997]: *** Install squash loader *** Nov 4 20:02:24 kjcf05n03 dracut[7997]: *** Squashing the files inside the initramfs *** Nov 4 20:02:24 kjcf05n00 mcfcli[3673891]: %3|1730772144.185|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:02:24 kjcf05n03 dracut[7997]: *** Squashing the files inside the initramfs done *** Nov 4 20:02:24 kjcf05n03 dracut[7997]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 4 20:02:24 kjcf05n03 dracut[7997]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 4 20:02:25 kjcf05n03 kdumpctl[7883]: kdump: kexec: loaded kdump kernel Nov 4 20:02:25 kjcf05n03 kdumpctl[7883]: kdump: Starting kdump: [OK] Nov 4 20:02:25 kjcf05n03 systemd[1]: Started Crash recovery kernel arming. Nov 4 20:02:25 kjcf05n03 systemd[1]: Reloading. Nov 4 20:02:26 kjcf05n03 systemd[3090]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:02:26 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:02:26 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:02:26 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 4 20:02:26 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 4 20:02:26 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 4 20:02:26 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 4 20:02:26 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 4 20:02:26 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 4 20:02:26 kjcf05n03 ifdown[14593]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 20:02:26 kjcf05n03 ifdown[14594]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:02:26 kjcf05n03 ifdown[14607]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:02:26 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 20:02:26 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 20:02:26 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 20:02:26 kjcf05n03 ifup[14667]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 20:02:26 kjcf05n03 ifup[14668]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:02:26 kjcf05n03 ifup[14669]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:02:28 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 4 20:02:30 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 20:02:31 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 20:02:31 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 20:02:31 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:02:31 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:02:31 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:02:31 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:02:31 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 20:02:31 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 20:02:31 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 20:02:31 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 20:02:31 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:02:31 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:02:31 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:02:31 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:02:31 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 4 20:02:31 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 4 20:02:31 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 4 20:02:31 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 4 20:02:31 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 4 20:02:31 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 4 20:02:31 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 4 20:02:31 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 4 20:02:31 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 4 20:02:31 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 4 20:02:31 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 4 20:02:31 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 4 20:02:31 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 4 20:02:31 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 4 20:02:31 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 4 20:02:31 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 4 20:02:31 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 4 20:02:31 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 4 20:02:31 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 4 20:02:31 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 4 20:02:31 kjcf05n03 ifdown[14836]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 20:02:31 kjcf05n03 ifdown[14837]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:02:31 kjcf05n03 ifdown[14838]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:02:31 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 20:02:31 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 20:02:31 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 20:02:31 kjcf05n03 ifup[14911]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 20:02:31 kjcf05n03 ifup[14912]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:02:31 kjcf05n03 ifup[14913]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:02:31 kjcf05n03 dcs-collectord[5670]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 20:02:31 kjcf05n03 dcs-collectord[5670]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 20:02:34 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 4 20:02:35 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 20:02:36 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 20:02:36 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 20:02:36 kjcf05n03 systemd[1]: Reloading. Nov 4 20:02:36 kjcf05n03 systemd[1]: Starting Corosync Cluster Engine... Nov 4 20:02:36 kjcf05n03 await_ha_peer[15111]: Waiting for HA peer kjcf05n02 Nov 4 20:02:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730772156', 'host':'kjcf05n03', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(1036.0B/656.0B), ib1=(1232.0B/448.0B), icl0=(5.0kB/6.8kB), lo=(600.0B/600.0B), meth0=(1541.0MB/7.7MB), mgmt0=(1477.7MB/7.7MB)'}"] Nov 4 20:02:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(1036.0B/656.0B), ib1=(1232.0B/448.0B), icl0=(5.0kB/6.8kB), lo=(600.0B/600.0B), meth0=(1541.0MB/7.7MB), mgmt0=(1477.7MB/7.7MB)', 'message': 'NET OK - (Rx/Tx) ib0=(1036.0B/656.0B), ib1=(1232.0B/448.0B), icl0=(5.0kB/6.8kB), lo=(600.0B/600.0B), meth0=(1541.0MB/7.7MB), mgmt0=(1477.7MB/7.7MB)', 'value': 'ok', 'timestamp': '1730772156'} Nov 4 20:02:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:02:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730772156', 'host':'kjcf05n03', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 4 20:02:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730772156'} Nov 4 20:02:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 20:02:37 kjcf05n03 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 4 20:02:37 kjcf05n03 await_ha_peer[15111]: Peer kjcf05n02 has started, starting HA Nov 4 20:02:38 kjcf05n03 systemd[1]: Started Corosync Cluster Engine. Nov 4 20:02:38 kjcf05n03 systemd[1]: Started Fast STONITH daemon. Nov 4 20:02:38 kjcf05n03 fstonithd.py[15161]: Listening for kdump packets from partner Nov 4 20:02:38 kjcf05n03 systemd[1]: Reloading. Nov 4 20:02:38 kjcf05n03 systemd[3090]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:02:38 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:02:38 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:02:38 kjcf05n03 systemd[1]: Reloading. Nov 4 20:02:38 kjcf05n03 systemd[1]: Reached target resource-agents dependencies. Nov 4 20:02:38 kjcf05n03 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 4 20:02:38 kjcf05n03 systemd[1]: Reloading. Nov 4 20:02:38 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n03": interface became available Nov 4 20:02:39 kjcf05n03 systemd[1]: Reloading. Nov 4 20:02:39 kjcf05n03 puppet-agent[3587]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:02:39 kjcf05n03 puppet[3587]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:02:39 kjcf05n03 puppet-agent[3587]: Applied catalog in 93.41 seconds Nov 4 20:02:39 kjcf05n03 puppet[3587]: Notice: Applied catalog in 93.41 seconds Nov 4 20:02:39 kjcf05n03 systemd[1]: Started Puppet agent. Nov 4 20:02:39 kjcf05n03 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 4 20:02:39 kjcf05n03 systemd[1]: Started Service to do FW and inventory check on boot. Nov 4 20:02:39 kjcf05n03 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 4 20:02:39 kjcf05n03 systemd[1]: Started Startup script for gateway-ec-node. Nov 4 20:02:39 kjcf05n03 systemd[1]: Started Startup script for monitoring-ec-node. Nov 4 20:02:39 kjcf05n03 systemd[1]: Starting Set absolute GEM time... Nov 4 20:02:39 kjcf05n03 systemd[1]: Started Collect SAS Health Report every hour. Nov 4 20:02:39 kjcf05n03 systemd[1]: Reached target Timers. Nov 4 20:02:39 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 20:02:39 kjcf05n03 wce-disable.sh[15309]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 4 20:02:39 kjcf05n03 systemd[1]: disable-write-cache.service: Succeeded. Nov 4 20:02:39 kjcf05n03 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 4 20:02:39 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 20:02:39 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 20:02:39 kjcf05n03 systemd[1]: set_gem_time.service: Succeeded. Nov 4 20:02:39 kjcf05n03 systemd[1]: Started Set absolute GEM time. Nov 4 20:02:40 kjcf05n03 python3.9[15313]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 4 20:02:40 kjcf05n03 python3.9[15313]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 4 20:02:40 kjcf05n03 gateway-ec-node.py[15312]: Starting gateway-ec-node service Nov 4 20:02:40 kjcf05n03 RFSF-API[15311]: INFO[2024-11-04T20:02:39-06:00] Datapath API RESTful Service starting Nov 4 20:02:40 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-04T20:02:39-06:00] Datapath API RESTful Service starting Nov 4 20:02:40 kjcf05n03 RFSF-API[15311]: INFO[2024-11-04T20:02:39-06:00] Running in production mode, starting dbus event listener Nov 4 20:02:40 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-04T20:02:39-06:00] Running in production mode, starting dbus event listener Nov 4 20:02:40 kjcf05n03 RFSF-API[15311]: INFO[2024-11-04T20:02:39-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 20:02:40 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-04T20:02:39-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 20:02:40 kjcf05n03 RFSF-API[15311]: INFO[2024-11-04T20:02:39-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 20:02:40 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-04T20:02:39-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 20:02:40 kjcf05n03 RFSF-API[15311]: INFO[2024-11-04T20:02:39-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 20:02:40 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-04T20:02:39-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 20:02:40 kjcf05n03 RFSF-API[15311]: INFO[2024-11-04T20:02:39-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 20:02:40 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-04T20:02:39-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 20:02:40 kjcf05n03 RFSF-API[15311]: INFO[2024-11-04T20:02:39-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 20:02:40 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-04T20:02:39-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 20:02:40 kjcf05n03 RFSF-API[15311]: INFO[2024-11-04T20:02:39-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 20:02:40 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-04T20:02:39-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 20:02:40 kjcf05n03 RFSF-API[15311]: INFO[2024-11-04T20:02:39-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 20:02:40 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-04T20:02:39-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 20:02:40 kjcf05n03 RFSF-API[15311]: INFO[2024-11-04T20:02:39-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 20:02:40 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-04T20:02:39-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 20:02:40 kjcf05n03 RFSF-API[15311]: INFO[2024-11-04T20:02:39-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 20:02:40 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-04T20:02:39-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 20:02:40 kjcf05n03 RFSF-API[15311]: INFO[2024-11-04T20:02:39-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 20:02:40 kjcf05n03 dp-api-server-node[15311]: INFO[2024-11-04T20:02:39-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 20:02:41 kjcf05n00 zabbix-server[2411661]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 20:02:41 kjcf05n00 zabbix-server[2411661]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n03 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n03:system.uptime): 00:03:08\\"}}"' Nov 4 20:02:42 kjcf05n00 log_interesting_event.py[2411661]: Event '46613' acknowledged Nov 4 20:02:42 kjcf05n00 mcfcli[3673891]: %3|1730772162.486|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:02:45 kjcf05n03 systemd[1]: Reloading. Nov 4 20:02:46 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 20:02:46 kjcf05n03 systemd[1]: Starting Cluster Controlled lcnmon... Nov 4 20:02:46 kjcf05n03 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 4 20:02:46 kjcf05n03 dcs-collectord[5670]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 20:02:46 kjcf05n03 dcs-collectord[5670]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 20:02:46 kjcf05n03 dcs-collectord[5670]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 20:02:46 kjcf05n03 diskmonitor_pre[15826]: Key management is currently disabled.DEAR disabled Nov 4 20:02:46 kjcf05n03 systemd[1]: Started Cluster Controlled diskmonitor. Nov 4 20:02:48 kjcf05n03 sh[15822]: LNET configured: New Created Nov 4 20:02:48 kjcf05n03 systemd[1]: Started Cluster Controlled lcnmon. Nov 4 20:02:48 kjcf05n03 LCNmon[17856]: Interface ib0 is up Nov 4 20:02:48 kjcf05n03 LCNmon[17856]: Interface ib1 is up Nov 4 20:02:49 kjcf05n00 httpd[1812020]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-B): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n03', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 4 20:02:49 kjcf05n03 systemd[1]: nodebootchecks.service: Succeeded. Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: /var/run/diskmonitor does not exist, creating Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: Creating /var/run/diskmonitor/disk Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: Creating /var/run/diskmonitor/encl Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: Creating /var/run/diskmonitor/cli Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: RAS_Interlocks_enabled: 1 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: Using default ssd ids: HUSSL4010ASS600 , Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: add handler for sig: 14 sa_flags: 10000004 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: add handler for sig: 1 sa_flags: 10000004 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: add handler for sig: 2 sa_flags: 00000004 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: add handler for sig: 15 sa_flags: 00000004 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: add handler for sig: 6 sa_flags: 00000004 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: add handler for sig: 3 sa_flags: 00000004 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: add handler for sig: 30 sa_flags: 00000004 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: add handler for sig: 20 sa_flags: 00000004 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: add handler for sig: 10 sa_flags: 10000004 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: add handler for sig: 11 sa_flags: 00000004 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: add handler for sig: 7 sa_flags: 00000004 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: add handler for sig: 4 sa_flags: 00000004 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: add handler for sig: 8 sa_flags: 00000004 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: init_watch: /var/run/diskmonitor/encl initialized Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: init_watch: /var/run/diskmonitor/disk initialized Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: Using HA Baton locks - key: diskmonitor Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: Baton will be held for at most 570 seconds Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: DMMP Enabled: 0 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: random seed: 45ec0b03 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: NVMe Enclosure: 1 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: ZFS Enclosure: 0 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: Dbus, Initialized Connection Successfully Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: int_catcher_thread: thread start Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: Received dbus message 4 org.freedesktop.DBus -> :1.93 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b07bec_S4EUNF0MA05386M encl_slot: 0 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b07bed_S4EUNF0MA05387D encl_slot: 0 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 4 20:02:50 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 20:02:51 kjcf05n03 openhpid[5576]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 4 20:02:51 kjcf05n03 openhpid[5576]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 4 20:02:51 kjcf05n03 systemd[1]: openhpid.service: Succeeded. Nov 4 20:02:51 kjcf05n03 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 4 20:02:51 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 20:02:51 kjcf05n03 systemd[1]: openhpid.service: Supervising process 18189 which is not our child. We'll most likely not notice when it exits. Nov 4 20:02:51 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 20:02:51 kjcf05n03 systemd[1]: Reached target Multi-User System. Nov 4 20:02:51 kjcf05n03 systemd[1]: Reached target Graphical Interface. Nov 4 20:02:51 kjcf05n03 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 4 20:02:51 kjcf05n03 dcs-collectord[5670]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 4 20:02:51 kjcf05n03 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 4 20:02:51 kjcf05n03 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 4 20:02:51 kjcf05n03 systemd[1]: Startup finished in 50.128s (kernel) + 2min 29.031s (userspace) = 3min 19.159s. Nov 4 20:02:51 kjcf05n03 openhpid[18189]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 20:02:51 kjcf05n03 openhpid[18189]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 20:02:51 kjcf05n03 openhpid[18189]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 20:02:51 kjcf05n03 openhpid[18189]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 20:02:52 kjcf05n03 LCNmon[17856]: 10.16.100.56 is unreachable via ib0 Nov 4 20:02:52 kjcf05n03 LCNmon[17856]: Can ping through interface ib0 Nov 4 20:02:52 kjcf05n03 LCNmon[17856]: Can ping through interface ib1 Nov 4 20:02:52 kjcf05n03 LCNmon[17856]: NIC ib0, initial state UP Nov 4 20:02:52 kjcf05n03 LCNmon[17856]: NIC ib1, initial state UP Nov 4 20:02:52 kjcf05n03 LCNmon[17856]: LCNstat initial state UP Nov 4 20:02:52 kjcf05n03 LCNmon[17856]: LCNmon monitoring hosts kjcf05n03 and kjcf05n02 Nov 4 20:02:54 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18483 (bash) Nov 4 20:02:54 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 4 20:02:54 kjcf05n03 systemd[1]: Reached target Host and Network Name Lookups. Nov 4 20:02:54 kjcf05n03 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 4 20:02:54 kjcf05n03 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 4 20:02:54 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 4 20:02:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730772175', 'host':'kjcf05n03', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.7% (4378096 kB) used.'}"] Nov 4 20:02:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'RAM usage', 'description': 'OK - 1.7% (4378096 kB) used.', 'message': 'OK - 1.7% (4378096 kB) used.', 'value': 'ok', 'timestamp': '1730772175'} Nov 4 20:02:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 4 20:02:57 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 4 20:03:01 kjcf05n03 dcs-collectord[5670]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 20:03:01 kjcf05n03 dcs-collectord[5670]: WARNING No data collected (hpi_parser.py:353) Nov 4 20:03:02 kjcf05n00 mcfcli[3673891]: %3|1730772182.088|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730772185', 'host':'kjcf05n03', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 4 20:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730772185', 'host':'kjcf05n03', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 4 20:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730772185'} Nov 4 20:03:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730772185'} Nov 4 20:03:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:03:12 kjcf05n00 mcfcli[3673891]: %3|1730772192.486|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 20:03:15 kjcf05n03 ipmievd[4010]: System Event sensor - Timestamp Clock Sync Nov 4 20:03:16 kjcf05n03 ipmievd[3090]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:03:16 kjcf05n03 dcs-collectord[5670]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 20:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730772199', 'host':'kjcf05n03', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 4 20:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730772199'} Nov 4 20:03:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:03:20 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31463 deleted. Nov 4 20:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T20:03:27.252932316-06:00 level=info msg="Completed cleanup jobs" duration=26.145917ms Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b07bed_S4EUNF0MA05387D encl_sn: USE26000024VS001, slot: 2 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b07bec_S4EUNF0MA05386M encl_sn: USE26000024VS001, slot: 1 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 4 20:03:30 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 4 20:03:31 kjcf05n03 dcs-collectord[5670]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 20:03:34 kjcf05n02 nslcd[6957]: [16e9e8] ldap_result() failed: Can't contact LDAP server Nov 4 20:03:38 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 20:03:38 kjcf05n03 ras-resource-manager-agent[5934]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "2bf6abae-9b1a-11ef-8755-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 4 20:03:38 kjcf05n03 ras-resource-manager-agent[5934]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '2bf6abae-9b1a-11ef-8755-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 4 20:03:38 kjcf05n03 ras-resource-manager-agent[5934]: INFO Submitting new device inserted signal, starting to qualify drive: 2bf6abae-9b1a-11ef-8755-00093d069a1b (admin_action.py:110) Nov 4 20:03:38 kjcf05n02 firmware-update-orc-server[5878]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "45691b13-67e4-4dba-b7d1-58580eabf63a"} (logger.py:65) Nov 4 20:03:38 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 204645 (get_disk_device) Nov 4 20:03:38 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 4 20:03:38 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 4 20:03:38 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '2bf6abae-9b1a-11ef-8755-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 20:03:38 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '2bf6abae-9b1a-11ef-8755-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 20:03:38 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '2bf6abae-9b1a-11ef-8755-00093d069a1b', 'response ID': '2c01fdba-9b1a-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 20:03:38 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 2c01fdba-9b1a-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 20:03:38 kjcf05n03 diskmonitor[17464]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 20:03:38 kjcf05n03 ras-resource-manager-agent[5934]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "2c479b86-9b1a-11ef-8755-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 4 20:03:38 kjcf05n03 ras-resource-manager-agent[5934]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '2c479b86-9b1a-11ef-8755-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 4 20:03:38 kjcf05n03 ras-resource-manager-agent[5934]: INFO Submitting new device inserted signal, starting to qualify drive: 2c479b86-9b1a-11ef-8755-00093d069a1b (admin_action.py:110) Nov 4 20:03:38 kjcf05n02 ccp-client[204666]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 20:03:38 kjcf05n02 ccp-client[204666]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 20:03:38 kjcf05n02 ccp-client[204675]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 20:03:38 kjcf05n02 ccp-client[204666]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 20:03:38 kjcf05n02 ccp-client[204666]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 20:03:38 kjcf05n02 ccp-client[204675]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 20:03:38 kjcf05n02 ccp-client[204675]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 20:03:38 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '2c479b86-9b1a-11ef-8755-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 20:03:38 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '2c479b86-9b1a-11ef-8755-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 20:03:38 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '2c479b86-9b1a-11ef-8755-00093d069a1b', 'response ID': '2c4f8936-9b1a-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 20:03:38 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 2c4f8936-9b1a-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 20:03:39 kjcf05n03 firmware-update-orc-server[5890]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "597d1662-9611-48e6-8f34-1697d985d5ee"} (logger.py:65) Nov 4 20:03:41 kjcf05n02 DRVFW[204802]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 20:03:41 kjcf05n02 ccp-client[204803]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 20:03:41 kjcf05n02 ccp-client[204803]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 20:03:41 kjcf05n02 ccp-client[204812]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 20:03:41 kjcf05n02 ccp-client[204803]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 20:03:41 kjcf05n02 ccp-client[204803]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 20:03:41 kjcf05n02 ccp-client[204812]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 20:03:41 kjcf05n02 ccp-client[204812]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 20:03:41 kjcf05n02 firmware-update-orc-server[5878]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 4 20:03:42 kjcf05n00 mcfcli[3673891]: %3|1730772222.085|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:03:42 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 2c01fdba-9b1a-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 20:03:42 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '2bf6abae-9b1a-11ef-8755-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': '2bf6abae-9b1a-11ef-8755-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}}} (logger.py:65) Nov 4 20:03:42 kjcf05n03 ras-resource-manager-agent[5934]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '2bf6abae-9b1a-11ef-8755-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}} (resource_admin.py:98) Nov 4 20:03:42 kjcf05n03 ras-resource-manager-agent[5934]: INFO Drive qualification complete responding: 2bf6abae-9b1a-11ef-8755-00093d069a1b (admin_action.py:205) Nov 4 20:03:42 kjcf05n03 ras-resource-manager-agent[5934]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "2bf6abae-9b1a-11ef-8755-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} (interesting_event.py:59) Nov 4 20:03:42 kjcf05n00 mcfcli[3673891]: %3|1730772222.487|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 20:03:45 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 4 20:03:45 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 4 20:03:45 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 4 20:03:45 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 4 20:03:45 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 4 20:03:45 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 4 20:03:45 kjcf05n03 diskmonitor[17464]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 4 20:03:45 kjcf05n03 diskmonitor[17464]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 4 20:03:45 kjcf05n03 diskmonitor[17464]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 4 20:03:45 kjcf05n03 diskmonitor[17464]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 20:03:45 kjcf05n03 diskmonitor[17464]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 4 20:03:45 kjcf05n03 diskmonitor[17464]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "2bf6abae-9b1a-11ef-8755-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 4 20:03:45 kjcf05n03 diskmonitor[17464]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 20:03:45 kjcf05n03 diskmonitor[17464]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 4 20:03:45 kjcf05n03 diskmonitor[17464]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "2c479b86-9b1a-11ef-8755-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 4 20:03:45 kjcf05n03 diskmonitor[17464]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 20:03:45 kjcf05n03 diskmonitor[17464]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 20:03:47 kjcf05n03 chronyd[5177]: Selected source 172.16.2.1 Nov 4 20:03:49 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22277 (get_disk_device) Nov 4 20:03:49 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 4 20:03:49 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 4 20:03:49 kjcf05n03 ccp-client[22300]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 20:03:49 kjcf05n03 ccp-client[22300]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 20:03:49 kjcf05n03 ccp-client[22321]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 20:03:49 kjcf05n03 ccp-client[22300]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 20:03:49 kjcf05n03 ccp-client[22300]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 20:03:49 kjcf05n03 ccp-client[22321]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 20:03:49 kjcf05n03 ccp-client[22321]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 20:03:52 kjcf05n03 ras-resource-manager-agent[5934]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2bf6abae-9b1a-11ef-8755-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} (service_main_handler.py:66) Nov 4 20:03:52 kjcf05n03 ras-resource-manager-agent[5934]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '2bf6abae-9b1a-11ef-8755-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}} (resource_admin.py:98) Nov 4 20:03:52 kjcf05n03 ras-resource-manager-agent[5934]: INFO Device qualification response has been acknowledged: 2bf6abae-9b1a-11ef-8755-00093d069a1b (admin_action.py:151) Nov 4 20:03:52 kjcf05n03 DRVFW[22478]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 20:03:52 kjcf05n03 ccp-client[22479]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 20:03:52 kjcf05n03 ccp-client[22479]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 20:03:52 kjcf05n03 ccp-client[22519]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 20:03:52 kjcf05n03 ccp-client[22479]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 20:03:52 kjcf05n03 ccp-client[22479]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 20:03:52 kjcf05n03 ccp-client[22519]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 20:03:52 kjcf05n03 ccp-client[22519]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 20:03:52 kjcf05n03 firmware-update-orc-server[5890]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 4 20:03:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730772232}"] Nov 4 20:03:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730772232, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:03:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:03:53 kjcf05n03 ras-resource-manager-agent[5934]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '2c479b86-9b1a-11ef-8755-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 4 20:03:53 kjcf05n03 ras-resource-manager-agent[5934]: INFO Drive qualification complete responding: 2c479b86-9b1a-11ef-8755-00093d069a1b (admin_action.py:205) Nov 4 20:03:53 kjcf05n03 ras-resource-manager-agent[5934]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "2c479b86-9b1a-11ef-8755-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (interesting_event.py:59) Nov 4 20:03:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730772233}"] Nov 4 20:03:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730772233, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:03:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:03:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730772233}"] Nov 4 20:03:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730772233, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:03:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:03:53 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 2c4f8936-9b1a-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 20:03:53 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '2c479b86-9b1a-11ef-8755-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': '2c479b86-9b1a-11ef-8755-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}}} (logger.py:65) Nov 4 20:03:55 kjcf05n03 systemd[1]: Unmounting /mnt/llog... Nov 4 20:03:55 kjcf05n03 systemd[1]: mnt-llog.mount: Succeeded. Nov 4 20:03:55 kjcf05n03 systemd[1]: Unmounted /mnt/llog. Nov 4 20:03:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730772234}"] Nov 4 20:03:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730772234, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:03:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:03:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730772235}"] Nov 4 20:03:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730772235, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:03:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:03:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730772235}"] Nov 4 20:03:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730772235, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:03:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:03:56 kjcf05n03 diskmonitor[17464]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 20:03:57 kjcf05n03 diskmonitor[17464]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 20:03:57 kjcf05n03 ras-resource-manager-agent[5934]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "371c4a98-9b1a-11ef-8755-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 4 20:03:57 kjcf05n03 ras-resource-manager-agent[5934]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '371c4a98-9b1a-11ef-8755-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 4 20:03:57 kjcf05n03 ras-resource-manager-agent[5934]: INFO Requests ['2c479b86-9b1a-11ef-8755-00093d069a1b', '371c4a98-9b1a-11ef-8755-00093d069a1b'] already in progress (admin_action.py:99) Nov 4 20:03:57 kjcf05n03 ras-resource-manager-agent[5934]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '371c4a98-9b1a-11ef-8755-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 4 20:03:57 kjcf05n03 ras-resource-manager-agent[5934]: INFO Drive qualification complete responding: 371c4a98-9b1a-11ef-8755-00093d069a1b (admin_action.py:205) Nov 4 20:03:57 kjcf05n03 ras-resource-manager-agent[5934]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "2c479b86-9b1a-11ef-8755-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (interesting_event.py:59) Nov 4 20:03:57 kjcf05n03 ras-resource-manager-agent[5934]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "371c4a98-9b1a-11ef-8755-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (interesting_event.py:59) Nov 4 20:03:57 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 4 20:03:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730772239}"] Nov 4 20:03:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730772239, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:03:59 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:03:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730772239}"] Nov 4 20:03:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730772239, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:03:59 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:04:00 kjcf05n03 python3.9[5240]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 4 20:04:03 kjcf05n03 python3.9[3090]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "2bf6abae-9b1a-11ef-8755-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: Dbus, handle_ingress_ras_signals, uuid: 2bf6abae-9b1a-11ef-8755-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2bf6abae-9b1a-11ef-8755-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: main: Pending firmware leveling requests exist, rescanning disks Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "371c4a98-9b1a-11ef-8755-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: leaving test state: 1 next state: 2 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: lock req: no timeout Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: leaving test state: 2 next state: 4 Nov 4 20:04:03 kjcf05n03 diskmonitor[17464]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 20:04:06 kjcf05n03 ras-resource-manager-agent[5934]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2c479b86-9b1a-11ef-8755-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (service_main_handler.py:66) Nov 4 20:04:06 kjcf05n03 ras-resource-manager-agent[5934]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '2c479b86-9b1a-11ef-8755-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 4 20:04:06 kjcf05n03 ras-resource-manager-agent[5934]: INFO Device qualification response has been acknowledged: 2c479b86-9b1a-11ef-8755-00093d069a1b (admin_action.py:151) Nov 4 20:04:06 kjcf05n03 ras-resource-manager-agent[5934]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2c479b86-9b1a-11ef-8755-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (service_main_handler.py:66) Nov 4 20:04:06 kjcf05n03 ras-resource-manager-agent[5934]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '2c479b86-9b1a-11ef-8755-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 4 20:04:06 kjcf05n03 ras-resource-manager-agent[5934]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "371c4a98-9b1a-11ef-8755-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (service_main_handler.py:66) Nov 4 20:04:06 kjcf05n03 ras-resource-manager-agent[5934]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '371c4a98-9b1a-11ef-8755-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 4 20:04:06 kjcf05n03 ras-resource-manager-agent[5934]: INFO Device qualification response has been acknowledged: 371c4a98-9b1a-11ef-8755-00093d069a1b (admin_action.py:151) Nov 4 20:04:07 kjcf05n03 diskmonitor[17464]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 20:04:12 kjcf05n00 mcfcli[3673891]: %3|1730772252.986|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 20:04:17 kjcf05n02 nslcd[6957]: [ef438d] ldap_result() failed: Can't contact LDAP server Nov 4 20:04:20 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31465 deleted. Nov 4 20:04:22 kjcf05n00 mcfcli[3673891]: %3|1730772262.082|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:04:25 kjcf05n03 diskmonitor[17464]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "2c479b86-9b1a-11ef-8755-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 4 20:04:25 kjcf05n03 diskmonitor[17464]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 4 20:04:25 kjcf05n03 diskmonitor[17464]: Dbus, handle_ingress_ras_signals, uuid: 2c479b86-9b1a-11ef-8755-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 4 20:04:25 kjcf05n03 diskmonitor[17464]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 20:04:25 kjcf05n03 diskmonitor[17464]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2c479b86-9b1a-11ef-8755-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 4 20:04:25 kjcf05n03 diskmonitor[17464]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "2c479b86-9b1a-11ef-8755-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 4 20:04:25 kjcf05n03 diskmonitor[17464]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 4 20:04:25 kjcf05n03 diskmonitor[17464]: Dbus, handle_ingress_ras_signals, uuid: 2c479b86-9b1a-11ef-8755-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 4 20:04:25 kjcf05n03 diskmonitor[17464]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2c479b86-9b1a-11ef-8755-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 4 20:04:25 kjcf05n03 diskmonitor[17464]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "371c4a98-9b1a-11ef-8755-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 4 20:04:25 kjcf05n03 diskmonitor[17464]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 4 20:04:25 kjcf05n03 diskmonitor[17464]: Dbus, handle_ingress_ras_signals, uuid: 371c4a98-9b1a-11ef-8755-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 4 20:04:25 kjcf05n03 diskmonitor[17464]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "371c4a98-9b1a-11ef-8755-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 4 20:04:25 kjcf05n03 diskmonitor[17464]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 20:04:25 kjcf05n03 diskmonitor[17464]: lock acquired Nov 4 20:04:25 kjcf05n03 diskmonitor[17464]: leaving test state: 4 next state: 8 Nov 4 20:04:25 kjcf05n03 diskmonitor[17464]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 20:04:34 kjcf05n03 diskmonitor[17464]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 4 20:04:34 kjcf05n03 diskmonitor[17464]: leaving test state: 8 next state: 20 Nov 4 20:04:34 kjcf05n03 diskmonitor[17464]: leaving test state: 20 next state: 40 Nov 4 20:04:34 kjcf05n03 diskmonitor[17464]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 351460f8000 Nov 4 20:04:34 kjcf05n03 diskmonitor[17464]: leaving test state: 40 next state: 80 Nov 4 20:04:42 kjcf05n00 mcfcli[3673891]: %3|1730772282.987|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 20:04:59 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 4 20:04:59 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 20:04:59 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 4 20:05:01 kjcf05n00 mcfcli[3673891]: %3|1730772301.863|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:05:10 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 4 20:05:10 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 20:05:10 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 4 20:05:12 kjcf05n03 dcs-collectord[5670]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 4 20:05:12 kjcf05n00 mcfcli[3673891]: %3|1730772312.987|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:05:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730772321}"] Nov 4 20:05:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730772321, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:05:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:05:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:05:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:05:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:05:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:05:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:05:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:05:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:05:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:05:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:05:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:05:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:05:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:05:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.046102ms Nov 4 20:05:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:05:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.046102ms Nov 4 20:05:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:05:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:05:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:05:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730772321}"] Nov 4 20:05:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730772321, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:05:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:05:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:05:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:05:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:05:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:05:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:05:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:05:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:05:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:05:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:05:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:05:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:05:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:05:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.220528ms Nov 4 20:05:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:05:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.220528ms Nov 4 20:05:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:05:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:05:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:05:30 kjcf05n03 diskmonitor[17464]: leaving test state: 80 next state: 100 Nov 4 20:05:30 kjcf05n03 diskmonitor[17464]: lock release: time: Mon Nov 4 20:05:25 2024 Nov 4 20:05:30 kjcf05n03 diskmonitor[17464]: leaving test state: 100 next state: 1 Nov 4 20:05:39 kjcf05n00 mcfcli[3673891]: %3|1730772339.794|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:05:40 kjcf05n00 python3.9[2413381]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 20:05:42 kjcf05n00 mcfcli[3673891]: %3|1730772342.987|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 20:06:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730772050', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 20:06:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730772050'} Nov 4 20:06:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:06:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730772050', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 20:06:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730772050'} Nov 4 20:06:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:06:12 kjcf05n00 mcfcli[3673891]: %3|1730772372.988|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:06:18 kjcf05n00 mcfcli[3673891]: %3|1730772378.639|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:06:20 kjcf05n00 zabbix-server[2414032]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 20:06:20 kjcf05n00 zabbix-server[2414032]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n03' from event '46627' Nov 4 20:06:20 kjcf05n00 zabbix-server[2414032]: Host created 'enclosure_USE26000024VS001' Nov 4 20:06:20 kjcf05n00 zabbix-server[2414032]: Running puppet on 'kjcf05n03' Nov 4 20:06:22 kjcf05n03 puppet-agent[30735]: Using configured environment 'production' Nov 4 20:06:22 kjcf05n03 puppet-agent[30735]: Retrieving pluginfacts Nov 4 20:06:22 kjcf05n03 puppet-agent[30735]: Retrieving plugin Nov 4 20:06:22 kjcf05n03 puppet-agent[30735]: Loading facts Nov 4 20:06:25 kjcf05n03 puppet-agent[30735]: Caching catalog for kjcf05n03 Nov 4 20:06:25 kjcf05n03 puppet-agent[30735]: Applying configuration version '1730772383' Nov 4 20:06:27 kjcf05n03 puppet-agent[30735]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 20:06:27 kjcf05n03 puppet-agent[30735]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 20:06:27 kjcf05n03 puppet-agent[30735]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 20:06:28 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 4 20:06:28 kjcf05n03 zabbix_agent2[6018]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 20:06:28 kjcf05n03 zabbix_agent2[3090]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:06:28 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 20:06:28 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 4 20:06:28 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 4 20:06:28 kjcf05n03 puppet-agent[30735]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: Press Ctrl+C to exit. Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: Plugin support version 1.0 Nov 4 20:06:28 kjcf05n03 zabbix_agent2[31050]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 20:06:30 kjcf05n03 puppet-agent[30735]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 20:06:30 kjcf05n03 puppet-agent[30735]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 20:06:30 kjcf05n03 puppet-agent[30735]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 20:06:30 kjcf05n03 puppet-agent[30735]: Applied catalog in 5.05 seconds Nov 4 20:06:30 kjcf05n00 zabbix-server[2414032]: puppet completed status:(0): '' Nov 4 20:06:30 kjcf05n00 zabbix-server[2414032]: Event '46627' acknowledged Nov 4 20:06:30 kjcf05n00 zabbix-server[2414032]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n03"}' Nov 4 20:06:42 kjcf05n00 mcfcli[3673891]: %3|1730772402.988|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 20:06:58 kjcf05n00 mcfcli[3673891]: %3|1730772418.487|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:07:12 kjcf05n00 mcfcli[3673891]: %3|1730772432.988|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 20:07:14 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 20:07:35 kjcf05n00 mcfcli[3673891]: %3|1730772455.541|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:07:42 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 20:07:42 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 20:07:42 kjcf05n00 mcfcli[3673891]: %3|1730772462.989|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:08:12 kjcf05n00 mcfcli[3673891]: %3|1730772492.989|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:08:13 kjcf05n00 mcfcli[3673891]: %3|1730772493.839|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:08:22 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 20:08:22 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 20:08:22 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 20:08:42 kjcf05n00 mcfcli[3673891]: %3|1730772522.989|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:08:52 kjcf05n00 mcfcli[3673891]: %3|1730772532.389|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:08:58 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 4 20:08:59 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 20:08:59 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 20:08:59 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 20:09:12 kjcf05n00 mcfcli[3673891]: %3|1730772552.990|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:09:31 kjcf05n00 mcfcli[3673891]: %3|1730772571.979|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:09:42 kjcf05n00 mcfcli[3673891]: %3|1730772582.991|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 20:09:45 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 20:09:45 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 20:09:45 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 20:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 20:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 20:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 20:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 20:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 20:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 20:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 20:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 20:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 20:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 20:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 20:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 20:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 20:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 20:10:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 20:10:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:10:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 20:10:10 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 20:10:11 kjcf05n00 mcfcli[3673891]: %3|1730772611.976|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:10:13 kjcf05n00 mcfcli[3673891]: %3|1730772613.061|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 20:10:36 kjcf05n00 python3.9[2416357]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 20:10:38 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 20:10:38 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 20:10:43 kjcf05n00 mcfcli[3673891]: %3|1730772643.061|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 20:10:49 kjcf05n00 mcfcli[3673891]: %3|1730772649.970|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:10:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730772050', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 20:10:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730772050'} Nov 4 20:10:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:10:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730772050', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 20:10:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730772050'} Nov 4 20:10:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:11:05 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 20:11:05 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 20:11:05 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 20:11:13 kjcf05n00 mcfcli[3673891]: %3|1730772673.062|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 20:11:29 kjcf05n00 mcfcli[3673891]: %3|1730772689.025|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:11:43 kjcf05n00 mcfcli[3673891]: %3|1730772703.062|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 20:12:07 kjcf05n00 mcfcli[3673891]: %3|1730772727.026|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:12:13 kjcf05n00 mcfcli[3673891]: %3|1730772733.062|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 20:12:43 kjcf05n00 mcfcli[3673891]: %3|1730772763.062|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 20:12:44 kjcf05n00 mcfcli[3673891]: %3|1730772764.996|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:13:13 kjcf05n00 mcfcli[3673891]: %3|1730772793.063|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:13:22 kjcf05n00 mcfcli[3673891]: %3|1730772802.891|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T20:13:27.253370065-06:00 level=info msg="Completed cleanup jobs" duration=26.529836ms Nov 4 20:13:28 kjcf05n03 root[41667]: failback_xyraid Nov 4 20:13:30 kjcf05n03 root[41775]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 4 20:13:30 kjcf05n03 root[41852]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 4 20:13:35 kjcf05n02 systemd[1]: data-kjcf05n03:md66.mount: Succeeded. Nov 4 20:13:38 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme10n1 Nov 4 20:13:40 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme20n1 Nov 4 20:13:40 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme22n1 Nov 4 20:13:40 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme16n1 Nov 4 20:13:40 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme12n1 Nov 4 20:13:40 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme21n1 Nov 4 20:13:40 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme5n1 Nov 4 20:13:41 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme6n1 Nov 4 20:13:41 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme15n1 Nov 4 20:13:41 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme7n1 Nov 4 20:13:41 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme11n1 Nov 4 20:13:43 kjcf05n00 mcfcli[3673891]: %3|1730772823.493|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 20:13:43 kjcf05n03 dwd[5211]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 4 20:13:43 kjcf05n03 dwd[5211]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 4 20:13:43 kjcf05n03 dwd[5211]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 4 20:13:43 kjcf05n03 dwd[5211]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 4 20:13:43 kjcf05n03 dwd[5211]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 4 20:13:43 kjcf05n03 dwd[5211]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 4 20:13:43 kjcf05n03 dwd[5211]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 4 20:13:43 kjcf05n03 dwd[5211]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 4 20:13:43 kjcf05n03 dwd[5211]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 4 20:13:43 kjcf05n03 dwd[5211]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 4 20:13:43 kjcf05n03 dwd[5211]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 4 20:13:43 kjcf05n03 dwd[5211]: Starting NVME thread for nvme10n1 Nov 4 20:13:43 kjcf05n03 dwd[5211]: Starting NVME thread for nvme15n1 Nov 4 20:13:44 kjcf05n03 dwd[5211]: Starting NVME thread for nvme21n1 Nov 4 20:13:44 kjcf05n03 dwd[5211]: Starting NVME thread for nvme11n1 Nov 4 20:13:44 kjcf05n03 dwd[5211]: Starting NVME thread for nvme20n1 Nov 4 20:13:44 kjcf05n03 systemd-udevd[44799]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44802]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44804]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44799]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44802]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44804]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44799]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44802]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44804]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44802]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44799]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44804]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44802]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44799]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44804]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44799]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44804]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44802]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44799]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44804]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44802]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44799]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44804]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44802]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44837]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44839]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44841]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44836]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44839]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44841]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44836]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44841]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44836]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44836]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44841]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44841]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44841]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44841]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44841]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44841]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44841]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44843]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44841]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:13:44 kjcf05n03 systemd-udevd[44841]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:13:45 kjcf05n03 dwd[5211]: Starting NVME thread for nvme12n1 Nov 4 20:13:45 kjcf05n03 dcs-bulk-data-sender[6219]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 141}' Nov 4 20:13:45 kjcf05n03 dwd[5211]: Starting NVME thread for nvme7n1 Nov 4 20:13:45 kjcf05n03 dwd[5211]: Starting NVME thread for nvme6n1 Nov 4 20:13:45 kjcf05n03 dwd[5211]: Starting NVME thread for nvme5n1 Nov 4 20:13:45 kjcf05n03 dwd[5211]: Starting NVME thread for nvme16n1 Nov 4 20:13:46 kjcf05n03 dwd[5211]: Starting NVME thread for nvme22n1 Nov 4 20:13:46 kjcf05n03 nslcd[6967]: [8b4567] (re)loading /etc/nsswitch.conf Nov 4 20:13:47 kjcf05n02 diskmonitor[17558]: Removed MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 4 20:13:47 kjcf05n02 diskmonitor[17558]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 20:13:49 kjcf05n03 diskmonitor[17464]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 4 20:13:57 kjcf05n03 diskmonitor[17464]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 4 20:13:57 kjcf05n03 diskmonitor[17464]: Scan for ReadErrorMax change for md66 Nov 4 20:13:57 kjcf05n03 diskmonitor[17464]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 4 20:13:57 kjcf05n03 diskmonitor[17464]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 4 20:13:57 kjcf05n03 diskmonitor[17464]: read_saved_file: md66 no saved speed Nov 4 20:13:57 kjcf05n03 diskmonitor[17464]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 4 20:13:57 kjcf05n03 diskmonitor[17464]: Set sync_speed_min (10000) for md66 Nov 4 20:13:57 kjcf05n03 diskmonitor[17464]: Set sync_speed_max (200000) for md66 Nov 4 20:13:57 kjcf05n03 diskmonitor[17464]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 20:14:01 kjcf05n00 mcfcli[3673891]: %3|1730772841.773|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:14:13 kjcf05n00 mcfcli[3673891]: %3|1730772853.493|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 20:14:32 kjcf05n03 systemd[1]: Starting Cleanup of Temporary Directories... Nov 4 20:14:32 kjcf05n03 systemd-tmpfiles[48179]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 20:14:32 kjcf05n03 systemd-tmpfiles[48179]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 20:14:32 kjcf05n03 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 4 20:14:32 kjcf05n03 systemd[1]: Started Cleanup of Temporary Directories. Nov 4 20:14:37 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 48421 (bash) Nov 4 20:14:37 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 4 20:14:37 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 4 20:14:41 kjcf05n00 mcfcli[3673891]: %3|1730772881.498|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:14:43 kjcf05n00 mcfcli[3673891]: %3|1730772883.493|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 20:15:13 kjcf05n00 mcfcli[3673891]: %3|1730772913.494|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 20:15:19 kjcf05n00 mcfcli[3673891]: %3|1730772919.320|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:15:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730772921}"] Nov 4 20:15:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730772921, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:15:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:21-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:21 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:21-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:21 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:21-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:21 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.858411ms Nov 4 20:15:21 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:21-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.858411ms Nov 4 20:15:21 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:15:21 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:15:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:15:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730772921}"] Nov 4 20:15:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730772921, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:15:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.894548ms Nov 4 20:15:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.894548ms Nov 4 20:15:22 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:15:22 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:15:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:15:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730772921}"] Nov 4 20:15:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730772921, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:15:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.895951ms Nov 4 20:15:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.895951ms Nov 4 20:15:22 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:15:22 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:15:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:15:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730772921}"] Nov 4 20:15:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730772921, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:15:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.618694ms Nov 4 20:15:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.618694ms Nov 4 20:15:22 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:15:22 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:15:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:15:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730772921}"] Nov 4 20:15:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730772921, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:15:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:22-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:22 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:22-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:22 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:22-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:22 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.091588ms Nov 4 20:15:22 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:22-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.091588ms Nov 4 20:15:22 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:15:22 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:15:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:15:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730772922}"] Nov 4 20:15:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730772922, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:15:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.190622ms Nov 4 20:15:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.190622ms Nov 4 20:15:23 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:15:23 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:15:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:15:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730772922}"] Nov 4 20:15:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730772922, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:15:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.010295ms Nov 4 20:15:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.010295ms Nov 4 20:15:23 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:15:23 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:15:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:15:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730772922}"] Nov 4 20:15:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730772922, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:15:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.359489ms Nov 4 20:15:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.359489ms Nov 4 20:15:23 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:15:23 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:15:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:15:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730772922}"] Nov 4 20:15:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730772922, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:15:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.926337ms Nov 4 20:15:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.926337ms Nov 4 20:15:23 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:15:23 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:15:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:15:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730772922}"] Nov 4 20:15:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730772922, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:15:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.915488ms Nov 4 20:15:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.915488ms Nov 4 20:15:23 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:15:23 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:15:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:15:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730772922}"] Nov 4 20:15:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730772922, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:15:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:23-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:15:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:23 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:15:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:23-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:15:23 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:15:23-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:15:23 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:15:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.242219ms Nov 4 20:15:23 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:15:23-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.242219ms Nov 4 20:15:23 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:15:23 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:15:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:15:36 kjcf05n00 python3.9[2419372]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 20:15:43 kjcf05n00 mcfcli[3673891]: %3|1730772943.494|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 20:15:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730772950', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 4 20:15:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730772950'} Nov 4 20:15:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:15:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730772950', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 4 20:15:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730772950'} Nov 4 20:15:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:15:56 kjcf05n00 mcfcli[3673891]: %3|1730772956.962|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:16:13 kjcf05n00 mcfcli[3673891]: %3|1730772973.495|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 20:16:34 kjcf05n00 mcfcli[3673891]: %3|1730772994.754|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:16:43 kjcf05n00 mcfcli[3673891]: %3|1730773003.495|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:17:11 kjcf05n00 mcfcli[3673891]: %3|1730773031.620|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:17:13 kjcf05n00 mcfcli[3673891]: %3|1730773033.495|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:17:43 kjcf05n00 mcfcli[3673891]: %3|1730773063.496|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:17:49 kjcf05n00 mcfcli[3673891]: %3|1730773069.838|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:18:13 kjcf05n00 mcfcli[3673891]: %3|1730773093.496|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:18:26 kjcf05n00 mcfcli[3673891]: %3|1730773106.232|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:18:43 kjcf05n00 mcfcli[3673891]: %3|1730773123.497|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 20:18:58 kjcf05n03 dwd[5211]: nvme10n1 passed periodic SMART status check Nov 4 20:18:59 kjcf05n03 dwd[5211]: nvme21n1 passed periodic SMART status check Nov 4 20:18:59 kjcf05n03 dwd[5211]: nvme12n1 passed periodic SMART status check Nov 4 20:18:59 kjcf05n03 dwd[5211]: nvme20n1 passed periodic SMART status check Nov 4 20:18:59 kjcf05n03 dwd[5211]: nvme11n1 passed periodic SMART status check Nov 4 20:18:59 kjcf05n03 dwd[5211]: nvme15n1 passed periodic SMART status check Nov 4 20:19:00 kjcf05n03 dwd[5211]: nvme5n1 passed periodic SMART status check Nov 4 20:19:00 kjcf05n03 dwd[5211]: nvme7n1 passed periodic SMART status check Nov 4 20:19:00 kjcf05n03 dwd[5211]: nvme16n1 passed periodic SMART status check Nov 4 20:19:00 kjcf05n03 dwd[5211]: nvme6n1 passed periodic SMART status check Nov 4 20:19:00 kjcf05n03 dwd[5211]: nvme22n1 passed periodic SMART status check Nov 4 20:19:03 kjcf05n00 mcfcli[3673891]: %3|1730773143.983|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:19:13 kjcf05n00 mcfcli[3673891]: %3|1730773153.996|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:19:20 kjcf05n00 zabbix-server[2421655]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 20:19:20 kjcf05n00 zabbix-server[2421655]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n03' from event '46629' Nov 4 20:19:20 kjcf05n00 zabbix-server[2421655]: Filesystem 'kjcf05' has been mounted Nov 4 20:19:21 kjcf05n00 zabbix-server[2421655]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 4 20:19:21 kjcf05n00 zabbix-server[2421655]: Running puppet on 'None' Nov 4 20:19:23 kjcf05n04 puppet-agent[2243671]: Using configured environment 'production' Nov 4 20:19:23 kjcf05n04 puppet-agent[2243671]: Retrieving pluginfacts Nov 4 20:19:23 kjcf05n04 puppet-agent[2243671]: Retrieving plugin Nov 4 20:19:23 kjcf05n04 puppet-agent[2243671]: Loading facts Nov 4 20:19:23 kjcf05n05 puppet-agent[2446686]: Using configured environment 'production' Nov 4 20:19:23 kjcf05n05 puppet-agent[2446686]: Retrieving pluginfacts Nov 4 20:19:23 kjcf05n05 puppet-agent[2446686]: Retrieving plugin Nov 4 20:19:23 kjcf05n05 puppet-agent[2446686]: Loading facts Nov 4 20:19:23 kjcf05n06 puppet-agent[2254319]: Using configured environment 'production' Nov 4 20:19:23 kjcf05n06 puppet-agent[2254319]: Retrieving pluginfacts Nov 4 20:19:23 kjcf05n06 puppet-agent[2254319]: Retrieving plugin Nov 4 20:19:23 kjcf05n06 puppet-agent[2254319]: Loading facts Nov 4 20:19:23 kjcf05n02 puppet-agent[233650]: Using configured environment 'production' Nov 4 20:19:23 kjcf05n02 puppet-agent[233650]: Retrieving pluginfacts Nov 4 20:19:23 kjcf05n02 puppet-agent[233650]: Retrieving plugin Nov 4 20:19:23 kjcf05n07 puppet-agent[2257761]: Using configured environment 'production' Nov 4 20:19:23 kjcf05n07 puppet-agent[2257761]: Retrieving pluginfacts Nov 4 20:19:23 kjcf05n07 puppet-agent[2257761]: Retrieving plugin Nov 4 20:19:23 kjcf05n07 puppet-agent[2257761]: Loading facts Nov 4 20:19:23 kjcf05n03 puppet-agent[56597]: Using configured environment 'production' Nov 4 20:19:23 kjcf05n03 puppet-agent[56597]: Retrieving pluginfacts Nov 4 20:19:23 kjcf05n03 puppet-agent[56597]: Retrieving plugin Nov 4 20:19:24 kjcf05n01 puppet-agent[3879081]: Using configured environment 'production' Nov 4 20:19:24 kjcf05n01 puppet-agent[3879081]: Retrieving pluginfacts Nov 4 20:19:24 kjcf05n01 puppet-agent[3879081]: Retrieving plugin Nov 4 20:19:24 kjcf05n01 puppet-agent[3879081]: Loading facts Nov 4 20:19:24 kjcf05n02 puppet-agent[233650]: Loading facts Nov 4 20:19:24 kjcf05n03 puppet-agent[56597]: Loading facts Nov 4 20:19:23 kjcf05n00 puppet-agent[2421727]: Using configured environment 'production' Nov 4 20:19:23 kjcf05n00 puppet-agent[2421727]: Retrieving pluginfacts Nov 4 20:19:24 kjcf05n00 puppet-agent[2421727]: Retrieving plugin Nov 4 20:19:24 kjcf05n00 puppet-agent[2421727]: Loading facts Nov 4 20:19:26 kjcf05n02 puppet-agent[233650]: Caching catalog for kjcf05n02 Nov 4 20:19:26 kjcf05n02 puppet-agent[233650]: Applying configuration version '1730773165' Nov 4 20:19:26 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 4 20:19:26 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 4 20:19:26 kjcf05n06 puppet-agent[2254319]: Caching catalog for kjcf05n06 Nov 4 20:19:26 kjcf05n06 puppet-agent[2254319]: Applying configuration version '1730773165' Nov 4 20:19:27 kjcf05n03 puppet-agent[56597]: Caching catalog for kjcf05n03 Nov 4 20:19:27 kjcf05n03 puppet-agent[56597]: Applying configuration version '1730773165' Nov 4 20:19:27 kjcf05n07 puppet-agent[2257761]: Caching catalog for kjcf05n07 Nov 4 20:19:27 kjcf05n07 puppet-agent[2257761]: Applying configuration version '1730773165' Nov 4 20:19:27 kjcf05n01 puppet-agent[3879081]: Caching catalog for kjcf05n01 Nov 4 20:19:28 kjcf05n01 puppet-agent[3879081]: Applying configuration version '1730773165' Nov 4 20:19:27 kjcf05n00 puppet-agent[2421727]: Caching catalog for kjcf05n00 Nov 4 20:19:28 kjcf05n00 puppet-agent[2421727]: Applying configuration version '1730773166' Nov 4 20:19:28 kjcf05n02 puppet-agent[233650]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 20:19:28 kjcf05n02 puppet-agent[233650]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 20:19:28 kjcf05n02 puppet-agent[233650]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 20:19:28 kjcf05n06 puppet-agent[2254319]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 20:19:28 kjcf05n06 puppet-agent[2254319]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 20:19:28 kjcf05n06 puppet-agent[2254319]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 20:19:29 kjcf05n03 puppet-agent[56597]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 20:19:29 kjcf05n03 puppet-agent[56597]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 20:19:29 kjcf05n03 puppet-agent[56597]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 20:19:29 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 4 20:19:29 kjcf05n02 zabbix_agent2[166683]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 20:19:29 kjcf05n02 zabbix_agent2[3190]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 20:19:29 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 20:19:29 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 4 20:19:29 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 20:19:29 kjcf05n02 puppet-agent[233650]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: Press Ctrl+C to exit. Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: Plugin support version 1.0 Nov 4 20:19:29 kjcf05n02 zabbix_agent2[234001]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 20:19:29 kjcf05n07 puppet-agent[2257761]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 20:19:29 kjcf05n07 puppet-agent[2257761]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 20:19:29 kjcf05n07 puppet-agent[2257761]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 20:19:29 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 4 20:19:29 kjcf05n03 zabbix_agent2[31050]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 20:19:29 kjcf05n03 zabbix_agent2[3090]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:19:29 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 20:19:29 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 4 20:19:29 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 4 20:19:29 kjcf05n03 puppet-agent[56597]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: Press Ctrl+C to exit. Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: Plugin support version 1.0 Nov 4 20:19:29 kjcf05n03 zabbix_agent2[56949]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 20:19:29 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2194068]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 20:19:29 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 4 20:19:29 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 20:19:29 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 4 20:19:29 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 4 20:19:29 kjcf05n06 puppet-agent[2254319]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: Press Ctrl+C to exit. Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: Plugin support version 1.0 Nov 4 20:19:29 kjcf05n06 zabbix_agent2[2254747]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 20:19:29 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2196699]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 20:19:29 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 4 20:19:29 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 20:19:29 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 4 20:19:29 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 4 20:19:29 kjcf05n07 puppet-agent[2257761]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: Press Ctrl+C to exit. Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: Plugin support version 1.0 Nov 4 20:19:29 kjcf05n07 zabbix_agent2[2258708]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 20:19:31 kjcf05n01 puppet-agent[3879081]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 20:19:31 kjcf05n01 puppet-agent[3879081]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-19:55:44]/mode) mode changed '0755' to '0750' Nov 4 20:19:31 kjcf05n01 puppet-agent[3879081]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-19:55:44/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 4 20:19:31 kjcf05n01 puppet-agent[3879081]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-19:55:44/vmcore]/mode) mode changed '0600' to '0640' Nov 4 20:19:31 kjcf05n01 puppet-agent[3879081]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-19:55:44/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 4 20:19:31 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 20:19:31 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 20:19:31 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 20:19:30 kjcf05n00 puppet-agent[2421727]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 20:19:31 kjcf05n02 puppet-agent[233650]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 20:19:31 kjcf05n02 puppet-agent[233650]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 20:19:31 kjcf05n02 puppet-agent[233650]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 20:19:31 kjcf05n06 puppet-agent[2254319]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 20:19:31 kjcf05n06 puppet-agent[2254319]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 20:19:31 kjcf05n06 puppet-agent[2254319]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 20:19:31 kjcf05n06 puppet-agent[2254319]: Applied catalog in 4.86 seconds Nov 4 20:19:31 kjcf05n07 puppet-agent[2257761]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 20:19:31 kjcf05n07 puppet-agent[2257761]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 20:19:31 kjcf05n07 puppet-agent[2257761]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 20:19:31 kjcf05n02 puppet-agent[233650]: Applied catalog in 5.21 seconds Nov 4 20:19:31 kjcf05n03 puppet-agent[56597]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 20:19:31 kjcf05n03 puppet-agent[56597]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 20:19:31 kjcf05n03 puppet-agent[56597]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 20:19:31 kjcf05n01 puppet-agent[3879081]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 20:19:31 kjcf05n01 puppet-agent[3879081]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 20:19:31 kjcf05n01 puppet-agent[3879081]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 20:19:32 kjcf05n03 puppet-agent[56597]: Applied catalog in 5.18 seconds Nov 4 20:19:32 kjcf05n07 puppet-agent[2257761]: Applied catalog in 4.94 seconds Nov 4 20:19:32 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3865546]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 20:19:32 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 4 20:19:32 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 20:19:32 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 4 20:19:32 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 4 20:19:32 kjcf05n01 puppet-agent[3879081]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: Press Ctrl+C to exit. Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: Plugin support version 1.0 Nov 4 20:19:32 kjcf05n01 zabbix_agent2[3879464]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 20:19:31 kjcf05n00 puppet-agent[2421727]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 20:19:31 kjcf05n00 puppet-agent[2421727]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 20:19:31 kjcf05n00 puppet-agent[2421727]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 20:19:32 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2400649]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 20:19:32 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 20:19:32 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 20:19:32 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 4 20:19:32 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 4 20:19:32 kjcf05n00 puppet-agent[2421727]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: Press Ctrl+C to exit. Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: Plugin support version 1.0 Nov 4 20:19:32 kjcf05n00 zabbix_agent2[2422341]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 20:19:32 kjcf05n00 zabbix-server[2422377]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 20:19:33 kjcf05n00 zabbix-server[2422401]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 20:19:33 kjcf05n00 zabbix-server[2422411]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 20:19:34 kjcf05n00 zabbix-server[2422424]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 20:19:34 kjcf05n01 puppet-agent[3879081]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_194432.log]/mode) mode changed '0644' to '0640' Nov 4 20:19:34 kjcf05n01 puppet-agent[3879081]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_200252.log]/mode) mode changed '0644' to '0640' Nov 4 20:19:34 kjcf05n01 puppet-agent[3879081]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_201437.log]/mode) mode changed '0644' to '0640' Nov 4 20:19:34 kjcf05n00 puppet-agent[2421727]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 4 20:19:35 kjcf05n01 puppet-agent[3879081]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_200253.log]/mode) mode changed '0644' to '0640' Nov 4 20:19:35 kjcf05n01 puppet-agent[3879081]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_201437.log]/mode) mode changed '0644' to '0640' Nov 4 20:19:35 kjcf05n01 puppet-agent[3879081]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241104_201437]/mode) mode changed '0755' to '0750' Nov 4 20:19:35 kjcf05n01 puppet-agent[3879081]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241104_201437/screenlog.0]/mode) mode changed '0644' to '0640' Nov 4 20:19:35 kjcf05n01 puppet-agent[3879081]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 20:19:35 kjcf05n01 puppet-agent[3879081]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 20:19:35 kjcf05n01 puppet-agent[3879081]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 20:19:35 kjcf05n00 puppet-agent[2421727]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 20:19:35 kjcf05n00 puppet-agent[2421727]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 20:19:35 kjcf05n00 puppet-agent[2421727]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 20:19:36 kjcf05n01 puppet-agent[3879081]: Applied catalog in 8.64 seconds Nov 4 20:19:36 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 4 20:19:36 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 4 20:19:36 kjcf05n00 puppet-agent[2421727]: Applied catalog in 8.33 seconds Nov 4 20:19:36 kjcf05n05 puppet-agent[2446686]: Caching catalog for kjcf05n05 Nov 4 20:19:36 kjcf05n05 puppet-agent[2446686]: Applying configuration version '1730773175' Nov 4 20:19:38 kjcf05n05 puppet-agent[2446686]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 20:19:38 kjcf05n05 puppet-agent[2446686]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 20:19:38 kjcf05n05 puppet-agent[2446686]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 20:19:39 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2379942]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 20:19:39 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 4 20:19:39 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 20:19:39 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 4 20:19:39 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 4 20:19:39 kjcf05n05 puppet-agent[2446686]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: Press Ctrl+C to exit. Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: Plugin support version 1.0 Nov 4 20:19:39 kjcf05n05 zabbix_agent2[2447646]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 20:19:41 kjcf05n05 puppet-agent[2446686]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 20:19:41 kjcf05n05 puppet-agent[2446686]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 20:19:41 kjcf05n05 puppet-agent[2446686]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 20:19:41 kjcf05n05 puppet-agent[2446686]: Applied catalog in 4.79 seconds Nov 4 20:19:42 kjcf05n00 mcfcli[3673891]: %3|1730773182.774|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:19:43 kjcf05n00 mcfcli[3673891]: %3|1730773183.997|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 20:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 20:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 20:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 20:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 20:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 20:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 20:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 20:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 20:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 20:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 20:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 20:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 20:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 20:20:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 20:20:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:20:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 20:20:02 kjcf05n04 puppet-agent[2243671]: Caching catalog for kjcf05n04 Nov 4 20:20:02 kjcf05n04 puppet-agent[2243671]: Applying configuration version '1730773201' Nov 4 20:20:05 kjcf05n04 puppet-agent[2243671]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 20:20:05 kjcf05n04 puppet-agent[2243671]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 20:20:05 kjcf05n04 puppet-agent[2243671]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 20:20:05 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2179525]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 20:20:05 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 4 20:20:05 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 20:20:05 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 4 20:20:05 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 4 20:20:05 kjcf05n04 puppet-agent[2243671]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: Press Ctrl+C to exit. Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: Plugin support version 1.0 Nov 4 20:20:05 kjcf05n04 zabbix_agent2[2245186]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 20:20:07 kjcf05n04 puppet-agent[2243671]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 20:20:07 kjcf05n04 puppet-agent[2243671]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 20:20:07 kjcf05n04 puppet-agent[2243671]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 20:20:07 kjcf05n04 puppet-agent[2243671]: Applied catalog in 4.81 seconds Nov 4 20:20:07 kjcf05n00 zabbix-server[2421655]: puppet completed status:(0): '' Nov 4 20:20:07 kjcf05n00 zabbix-server[2421655]: Event '46629' acknowledged Nov 4 20:20:07 kjcf05n00 zabbix-server[2421655]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n03"}' Nov 4 20:20:14 kjcf05n00 mcfcli[3673891]: %3|1730773214.065|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 20:20:20 kjcf05n00 mcfcli[3673891]: %3|1730773220.332|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:20:37 kjcf05n00 python3.9[2422764]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 20:20:44 kjcf05n00 mcfcli[3673891]: %3|1730773244.065|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 20:20:59 kjcf05n00 mcfcli[3673891]: %3|1730773259.654|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:21:14 kjcf05n00 mcfcli[3673891]: %3|1730773274.065|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 20:21:37 kjcf05n00 mcfcli[3673891]: %3|1730773297.803|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:21:44 kjcf05n00 mcfcli[3673891]: %3|1730773304.066|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:22:14 kjcf05n00 mcfcli[3673891]: %3|1730773334.066|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:22:15 kjcf05n00 mcfcli[3673891]: %3|1730773335.302|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:22:44 kjcf05n00 mcfcli[3673891]: %3|1730773364.498|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 20:22:52 kjcf05n00 mcfcli[3673891]: %3|1730773372.162|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:23:14 kjcf05n00 mcfcli[3673891]: %3|1730773394.498|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T02:23:15.867780Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 20:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T02:23:15.867843Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.081ms Nov 4 20:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T20:23:27.25284259-06:00 level=info msg="Completed cleanup jobs" duration=26.109369ms Nov 4 20:23:31 kjcf05n00 mcfcli[3673891]: %3|1730773411.328|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:23:34 kjcf05n02 nslcd[6957]: [0e0f76] ldap_result() failed: Can't contact LDAP server Nov 4 20:23:34 kjcf05n02 nslcd[6957]: [52255a] ldap_result() failed: Can't contact LDAP server Nov 4 20:23:44 kjcf05n00 mcfcli[3673891]: %3|1730773424.498|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:24:11 kjcf05n00 mcfcli[3673891]: %3|1730773451.325|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:24:12 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 20:24:12 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 0 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007457 sec, idle for 1 hour(s)] Nov 4 20:24:14 kjcf05n00 mcfcli[3673891]: %3|1730773454.499|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:24:44 kjcf05n00 mcfcli[3673891]: %3|1730773484.500|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:24:51 kjcf05n00 mcfcli[3673891]: %3|1730773491.322|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:25:14 kjcf05n00 mcfcli[3673891]: %3|1730773514.500|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:25:30 kjcf05n00 mcfcli[3673891]: %3|1730773530.109|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 20:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 20:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 20:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 20:25:44 kjcf05n00 zabbix_server[15753]: Zabbix agent item "system.localtime" on host "kjcf05n03" failed: first network error, wait for 15 seconds Nov 4 20:25:44 kjcf05n00 mcfcli[3673891]: %3|1730773544.500|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 20:25:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 20:25:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 20:25:48 kjcf05n02 fstonithd.py[15145]: My partner 172.16.2.6 is kdumping. Forcing HA into GATHER state. Nov 4 20:25:49 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 20:25:49 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 20:25:49 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 20:25:50 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='15', error='Connection reset by peer (104)' Nov 4 20:25:50 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='15', client='AF_INET(172.16.2.6:41593)', local='AF_INET(0.0.0.0:601)' Nov 4 20:25:50 kjcf05n02 root[245350]: is_viking_off starts Nov 4 20:25:50 kjcf05n02 root[245349]: is_enc_ipmi_off starts Nov 4 20:25:50 kjcf05n02 root[245367]: I am master Nov 4 20:25:50 kjcf05n02 root[245370]: I am in slot 0; partner is in slot 1 Nov 4 20:25:50 kjcf05n02 root[245378]: is_lan_ipmi_off leaves Nov 4 20:25:51 kjcf05n02 root[245380]: is_lan_ipmi_sec_off leaves Nov 4 20:25:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 20:25:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 20:25:55 kjcf05n00 python3.9[2426071]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 20:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 20:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 20:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 20:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 20:25:57 kjcf05n02 root[245486]: is_viking_off leaves Nov 4 20:25:57 kjcf05n02 root[245489]: kjcf05n03 not already off look at kdump Nov 4 20:25:57 kjcf05n02 root[245504]: is_kdump_off starts Nov 4 20:25:57 kjcf05n02 fence_kdump[245505]: waiting for message from '172.16.2.6' Nov 4 20:25:57 kjcf05n02 fence_kdump[245505]: received valid message from '172.16.2.6' Nov 4 20:25:57 kjcf05n02 root[245508]: is_kdump_off detected kdump on kjcf05n03 Nov 4 20:25:57 kjcf05n02 root[245512]: kjcf05n03 is kdumping Nov 4 20:25:57 kjcf05n02 root[245611]: is_viking_off starts Nov 4 20:25:57 kjcf05n02 root[245609]: is_enc_ipmi_off starts Nov 4 20:25:58 kjcf05n02 root[245628]: is_lan_ipmi_off leaves Nov 4 20:25:58 kjcf05n02 root[245630]: is_lan_ipmi_sec_off leaves Nov 4 20:25:58 kjcf05n02 root[245644]: I am master Nov 4 20:25:58 kjcf05n02 root[245647]: I am in slot 0; partner is in slot 1 Nov 4 20:25:59 kjcf05n00 zabbix_server[15728]: Zabbix agent item "vfs.file.contents["/sys/class/net/icl0/operstate"]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 20:26:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 20:26:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 20:26:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 20:26:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 20:26:00 kjcf05n00 zabbix_server[15727]: Zabbix agent item "vfs.file.contents["/sys/class/net/mgmt0/operstate"]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 20:26:01 kjcf05n00 zabbix_server[15773]: Zabbix agent item "vfs.file.contents["/sys/class/net/ib0/operstate"]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 20:26:01 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 4 20:26:01 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 4 20:26:02 kjcf05n00 zabbix_server[15730]: Zabbix agent item "vfs.file.contents["/sys/class/net/meth0/operstate"]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 20:26:04 kjcf05n02 root[245856]: is_viking_off leaves Nov 4 20:26:04 kjcf05n02 root[245859]: kjcf05n03 not already off look at kdump Nov 4 20:26:04 kjcf05n02 root[245860]: is_kdump_off starts Nov 4 20:26:04 kjcf05n02 fence_kdump[245861]: waiting for message from '172.16.2.6' Nov 4 20:26:05 kjcf05n02 fence_kdump[245861]: received valid message from '172.16.2.6' Nov 4 20:26:05 kjcf05n02 root[245880]: is_kdump_off detected kdump on kjcf05n03 Nov 4 20:26:05 kjcf05n02 root[245881]: kjcf05n03 is kdumping Nov 4 20:26:10 kjcf05n02 systemd-udevd[248092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248095]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248097]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248095]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248097]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248095]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248097]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248095]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248097]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248097]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248095]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248097]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248095]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248097]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248095]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248092]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248093]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248097]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248095]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248132]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248130]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248135]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248137]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248132]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248129]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248135]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248137]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248132]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248135]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248137]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248132]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248137]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248132]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248135]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248132]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248137]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248132]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248137]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248132]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248137]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248132]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248132]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248137]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248132]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248137]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248132]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248137]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248132]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248132]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248132]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:26:10 kjcf05n02 systemd-udevd[248132]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:26:09 kjcf05n00 mcfcli[3673891]: %3|1730773569.784|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:26:10 kjcf05n02 dwd[5196]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 4 20:26:10 kjcf05n02 dwd[5196]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 4 20:26:10 kjcf05n02 dwd[5196]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 4 20:26:10 kjcf05n02 dwd[5196]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 4 20:26:10 kjcf05n02 dwd[5196]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 4 20:26:10 kjcf05n02 dwd[5196]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 4 20:26:10 kjcf05n02 dwd[5196]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 4 20:26:10 kjcf05n02 dwd[5196]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 4 20:26:10 kjcf05n02 dwd[5196]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 4 20:26:10 kjcf05n02 dwd[5196]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 4 20:26:10 kjcf05n02 dwd[5196]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 4 20:26:10 kjcf05n02 dwd[5196]: Starting NVME thread for nvme7n1 Nov 4 20:26:10 kjcf05n02 dwd[5196]: Starting NVME thread for nvme15n1 Nov 4 20:26:11 kjcf05n02 dwd[5196]: Starting NVME thread for nvme6n1 Nov 4 20:26:11 kjcf05n02 dwd[5196]: Starting NVME thread for nvme10n1 Nov 4 20:26:11 kjcf05n02 dwd[5196]: Starting NVME thread for nvme21n1 Nov 4 20:26:11 kjcf05n02 dwd[5196]: Starting NVME thread for nvme16n1 Nov 4 20:26:11 kjcf05n02 dwd[5196]: Starting NVME thread for nvme20n1 Nov 4 20:26:12 kjcf05n02 dwd[5196]: Starting NVME thread for nvme22n1 Nov 4 20:26:12 kjcf05n02 dwd[5196]: Starting NVME thread for nvme11n1 Nov 4 20:26:12 kjcf05n02 dwd[5196]: Starting NVME thread for nvme12n1 Nov 4 20:26:12 kjcf05n02 dwd[5196]: Starting NVME thread for nvme5n1 Nov 4 20:26:14 kjcf05n00 mcfcli[3673891]: %3|1730773574.500|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 20:26:17 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.cpu.num" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 20:26:21 kjcf05n02 diskmonitor[17558]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 4 20:26:29 kjcf05n02 diskmonitor[17558]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 4 20:26:29 kjcf05n02 diskmonitor[17558]: Scan for ReadErrorMax change for md66 Nov 4 20:26:29 kjcf05n02 diskmonitor[17558]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 4 20:26:29 kjcf05n02 diskmonitor[17558]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 4 20:26:29 kjcf05n02 diskmonitor[17558]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.min.76c05c063fa0949b68ee86c1978c2ca8 file Nov 4 20:26:29 kjcf05n02 diskmonitor[17558]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.max.76c05c063fa0949b68ee86c1978c2ca8 file Nov 4 20:26:29 kjcf05n02 diskmonitor[17558]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 4 20:26:29 kjcf05n02 diskmonitor[17558]: Set sync_speed_min (10000) for md66 Nov 4 20:26:29 kjcf05n02 diskmonitor[17558]: Set sync_speed_max (200000) for md66 Nov 4 20:26:29 kjcf05n02 diskmonitor[17558]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 20:26:32 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n03": interface unavailable Nov 4 20:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 20:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 20:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 20:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 20:26:44 kjcf05n00 mcfcli[3673891]: %3|1730773604.500|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 20:26:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 20:26:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 20:26:48 kjcf05n00 mcfcli[3673891]: %3|1730773608.027|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:26:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 20:26:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 20:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 20:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 20:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 20:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 20:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 20:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 20:27:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 20:27:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 20:27:14 kjcf05n00 mcfcli[3673891]: %3|1730773634.501|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 20:27:20 kjcf05n02 nslcd[6957]: [ed7263] ldap_result() failed: Can't contact LDAP server Nov 4 20:27:25 kjcf05n00 mcfcli[3673891]: %3|1730773645.115|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 20:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 20:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 20:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 20:27:44 kjcf05n00 mcfcli[3673891]: %3|1730773664.501|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 20:27:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 20:27:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 20:27:51 kjcf05n02 nslcd[6957]: [efd79f] ldap_result() failed: Can't contact LDAP server Nov 4 20:27:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 20:27:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 20:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 20:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 20:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 20:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 20:28:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 20:28:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 20:28:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 20:28:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 20:28:02 kjcf05n00 mcfcli[3673891]: %3|1730773682.914|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:28:14 kjcf05n00 mcfcli[3673891]: %3|1730773694.501|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 20:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 20:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 20:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 20:28:40 kjcf05n00 mcfcli[3673891]: %3|1730773720.565|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:28:44 kjcf05n00 mcfcli[3673891]: %3|1730773724.501|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:28:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 20:28:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 20:28:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 20:28:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 20:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 20:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 20:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 20:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 20:29:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 20:29:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 20:29:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 20:29:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 20:29:14 kjcf05n00 mcfcli[3673891]: %3|1730773754.501|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 20:29:19 kjcf05n00 mcfcli[3673891]: %3|1730773759.073|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:29:33 kjcf05n00 zabbix-server[2428248]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 20:29:33 kjcf05n00 zabbix-server[2428248]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n03:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 4 20:29:33 kjcf05n00 log_interesting_event.py[2428248]: Event '46632' acknowledged Nov 4 20:29:37 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:9a:1a Nov 4 20:29:37 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 4 20:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 20:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 20:29:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 20:29:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 20:29:40 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 4 20:29:40 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a kjcf05n03 Nov 4 20:29:40 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.6 Nov 4 20:29:40 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 4 20:29:40 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 4 20:29:40 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.6 Nov 4 20:29:40 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/pxelinux.cfg to 172.16.2.6 Nov 4 20:29:43 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/vmlinuz_diskless to 172.16.2.6 Nov 4 20:29:44 kjcf05n00 mcfcli[3673891]: %3|1730773784.501|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 20:29:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 20:29:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 20:29:51 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/initramfs-diskless.img to 172.16.2.6 Nov 4 20:29:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 20:29:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 20:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 20:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 20:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 20:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 20:29:56 kjcf05n00 mcfcli[3673891]: %3|1730773796.133|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:30:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 20:30:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 20:30:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 20:30:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 20:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 20:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 20:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 20:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 20:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 20:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 20:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 20:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 20:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 20:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 20:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 20:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 20:30:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 20:30:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:30:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 20:30:14 kjcf05n00 mcfcli[3673891]: %3|1730773814.502|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 20:30:34 kjcf05n00 mcfcli[3673891]: %3|1730773834.209|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:30:36 kjcf05n00 python3.9[2428676]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 20:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 20:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 20:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 20:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 20:30:39 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:40224). Nov 4 20:30:39 kjcf05n01 rsyncd[3883853]: connect from kjcf05n03 (172.16.2.6) Nov 4 20:30:39 kjcf05n01 rsyncd[3883853]: rsync on puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 4 20:30:39 kjcf05n01 rsyncd[3883853]: building file list Nov 4 20:30:39 kjcf05n01 rsyncd[3883853]: sent 11446 bytes received 136 bytes total size 10901 Nov 4 20:30:39 kjcf05n01 systemd[1]: rsyncd@661-172.16.2.2:873-172.16.2.6:40224.service: Succeeded. Nov 4 20:30:44 kjcf05n00 mcfcli[3673891]: %3|1730773844.502|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 20:30:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 20:30:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 20:30:48 kjcf05n02 fstonithd.py[15145]: Listening for kdump packets from partner Nov 4 20:30:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730773850', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 20:30:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730773850'} Nov 4 20:30:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:30:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730773850', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 20:30:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730773850'} Nov 4 20:30:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:30:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 20:30:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 20:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 20:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 20:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 20:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 20:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 20:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 20:31:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 20:31:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 20:31:14 kjcf05n00 mcfcli[3673891]: %3|1730773874.207|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:31:14 kjcf05n00 mcfcli[3673891]: %3|1730773874.503|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:31:36 kjcf05n02 dwd[5196]: nvme21n1 passed periodic SMART status check Nov 4 20:31:36 kjcf05n02 dwd[5196]: nvme15n1 passed periodic SMART status check Nov 4 20:31:36 kjcf05n02 dwd[5196]: nvme6n1 passed periodic SMART status check Nov 4 20:31:36 kjcf05n02 dwd[5196]: nvme7n1 passed periodic SMART status check Nov 4 20:31:36 kjcf05n02 dwd[5196]: nvme10n1 passed periodic SMART status check Nov 4 20:31:36 kjcf05n02 dwd[5196]: nvme16n1 passed periodic SMART status check Nov 4 20:31:37 kjcf05n02 dwd[5196]: nvme5n1 passed periodic SMART status check Nov 4 20:31:37 kjcf05n02 dwd[5196]: nvme22n1 passed periodic SMART status check Nov 4 20:31:37 kjcf05n02 dwd[5196]: nvme12n1 passed periodic SMART status check Nov 4 20:31:37 kjcf05n02 dwd[5196]: nvme20n1 passed periodic SMART status check Nov 4 20:31:37 kjcf05n02 dwd[5196]: nvme11n1 passed periodic SMART status check Nov 4 20:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 20:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 20:31:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 20:31:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 20:31:44 kjcf05n00 mcfcli[3673891]: %3|1730773904.503|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:31:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 20:31:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 20:31:51 kjcf05n00 mcfcli[3673891]: %3|1730773911.134|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:31:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 20:31:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 20:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 20:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 20:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 20:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 20:32:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 20:32:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 20:32:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 20:32:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 20:32:04 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='30', client='AF_INET(172.16.2.6:39799)', local='AF_INET(0.0.0.0:601)' Nov 4 20:32:04 kjcf05n03 syslog-ng[3195]: Configuration reload request received, reloading configuration; Nov 4 20:32:04 kjcf05n03 syslog-ng[3195]: Configuration reload finished; Nov 4 20:32:04 kjcf05n03 syslog-ng[3195]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 4 20:32:04 kjcf05n03 dracut: dracut-049-135.git20210121.el8 Nov 4 20:32:04 kjcf05n03 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 20:32:04 kjcf05n03 dracut: Loading and integrity checking all crypto modules Nov 4 20:32:04 kjcf05n03 dracut: Self testing crypto algorithms Nov 4 20:32:04 kjcf05n03 dracut: rd.md=0: removing MD RAID activation Nov 4 20:32:04 kjcf05n03 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 20:32:04 kjcf05n03 Copying live image to RAM... Nov 4 20:32:04 kjcf05n03 (this may take a minute) Nov 4 20:32:04 kjcf05n03 Done copying live image to RAM. Nov 4 20:32:04 kjcf05n03 dracut: Mounted root filesystem LiveOS_rootfs Nov 4 20:32:04 kjcf05n03 dracut: Checking integrity of kernel Nov 4 20:32:04 kjcf05n03 dracut: All initrd crypto checks done Nov 4 20:32:04 kjcf05n03 dracut: Switching root Nov 4 20:32:04 kjcf05n03 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 4 20:32:04 kjcf05n03 systemd: Detected architecture x86-64. Nov 4 20:32:04 kjcf05n03 systemd: Set hostname to . Nov 4 20:32:04 kjcf05n03 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 4 20:32:04 kjcf05n03 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 4 20:32:04 kjcf05n03 systemd: Listening on LVM2 poll daemon socket. Nov 4 20:32:04 kjcf05n03 systemd: Listening on RPCbind Server Activation Socket. Nov 4 20:32:04 kjcf05n03 systemd: Listening on initctl Compatibility Named Pipe. Nov 4 20:32:04 kjcf05n03 systemd: Reached target rpc_pipefs.target. Nov 4 20:32:04 kjcf05n03 systemd: Reached target ZFS pool import target. Nov 4 20:32:04 kjcf05n03 systemd-journald[1523]: Journal started Nov 4 20:32:04 kjcf05n03 systemd-journald[1523]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 20:32:04 kjcf05n03 systemd-modules-load[1514]: Inserted module 'fuse' Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Load/Save Random Seed. Nov 4 20:32:04 kjcf05n03 systemd[1]: Mounted FUSE Control File System. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Create System Users. Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 4 20:32:04 kjcf05n03 systemd-sysctl[1538]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 20:32:04 kjcf05n03 systemd-sysctl[1538]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Apply Kernel Variables. Nov 4 20:32:04 kjcf05n03 systemd-tmpfiles[1541]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 20:32:04 kjcf05n03 systemd-tmpfiles[1541]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Create Static Device Nodes in /dev. Nov 4 20:32:04 kjcf05n03 systemd-journald[1523]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Flush Journal to Persistent Storage. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started udev Coldplug all Devices. Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Rebuild Hardware Database. Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting udev Kernel Device Manager... Nov 4 20:32:04 kjcf05n03 systemd-udevd[1551]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started udev Kernel Device Manager. Nov 4 20:32:04 kjcf05n03 systemd[1]: Found device /dev/ttyS0. Nov 4 20:32:04 kjcf05n03 systemd-udevd[1569]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:32:04 kjcf05n03 systemd-udevd[1571]: Using default interface naming scheme 'rhel-8.0'. Nov 4 20:32:04 kjcf05n03 systemd-udevd[1571]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 4 20:32:04 kjcf05n03 systemd-udevd[1570]: Using default interface naming scheme 'rhel-8.0'. Nov 4 20:32:04 kjcf05n03 systemd-udevd[1570]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:32:04 kjcf05n03 systemd-udevd[1567]: Using default interface naming scheme 'rhel-8.0'. Nov 4 20:32:04 kjcf05n03 systemd[1]: Reached target Local File Systems (Pre). Nov 4 20:32:04 kjcf05n03 systemd-udevd[1567]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:32:04 kjcf05n03 systemd[1]: Reached target Local File Systems. Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Mark the need to relabel after reboot... Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Create Volatile Files and Directories... Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Rebuild Journal Catalog... Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting openibd - configure Mellanox devices... Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Mark the need to relabel after reboot. Nov 4 20:32:04 kjcf05n03 systemd-tmpfiles[1784]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 20:32:04 kjcf05n03 systemd-tmpfiles[1784]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 20:32:04 kjcf05n03 systemd-tmpfiles[1784]: "/var/tmp" already exists and is not a directory. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Create Volatile Files and Directories. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Rebuild Journal Catalog. Nov 4 20:32:04 kjcf05n03 root[1804]: openibd: running in auto mode Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting RPC Bind... Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting RDMA Node Description Daemon... Nov 4 20:32:04 kjcf05n03 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 4 20:32:04 kjcf05n03 systemd[1]: Started RPC Bind. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started RDMA Node Description Daemon. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 4 20:32:04 kjcf05n03 systemd-modules-load[1847]: Inserted module 'ib_iser' Nov 4 20:32:04 kjcf05n03 systemd-modules-load[1847]: Inserted module 'ib_isert' Nov 4 20:32:04 kjcf05n03 systemd-modules-load[1847]: Inserted module 'ib_srpt' Nov 4 20:32:04 kjcf05n03 systemd-udevd[1601]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:32:04 kjcf05n03 systemd-udevd[1559]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:32:04 kjcf05n03 systemd-udevd[1601]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 20:32:04 kjcf05n03 systemd-udevd[1559]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 20:32:04 kjcf05n03 systemd-modules-load[1855]: Inserted module 'ib_ipoib' Nov 4 20:32:04 kjcf05n03 systemd-modules-load[1847]: Inserted module 'rdma_ucm' Nov 4 20:32:04 kjcf05n03 systemd-modules-load[1847]: Module 'svcrdma' is blacklisted Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 4 20:32:04 kjcf05n03 systemd-modules-load[1855]: Inserted module 'ib_umad' Nov 4 20:32:04 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 4 20:32:04 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 20:32:04 kjcf05n03 systemd[1]: Reached target Network (Pre). Nov 4 20:32:04 kjcf05n03 systemd[1]: Reached target RDMA Hardware. Nov 4 20:32:04 kjcf05n03 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 4 20:32:04 kjcf05n03 openibd[1789]: Loading HCA driver and Access Layer:[ OK ] Nov 4 20:32:04 kjcf05n03 systemd[1]: Started openibd - configure Mellanox devices. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Update is Completed... Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Update is Completed. Nov 4 20:32:04 kjcf05n03 setup-icl[1764]: Setting LAN IP Address to 203.0.113.4 Nov 4 20:32:04 kjcf05n03 setup-icl[1764]: Setting LAN Subnet Mask to 255.255.255.0 Nov 4 20:32:04 kjcf05n03 setup-icl[1764]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 4 20:32:04 kjcf05n03 setup-icl[1764]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 4 20:32:04 kjcf05n03 systemd-udevd[1601]: Using default interface naming scheme 'rhel-8.0'. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 4 20:32:04 kjcf05n03 systemd[1]: Reached target System Initialization. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 4 20:32:04 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 4 20:32:04 kjcf05n03 systemd[1]: Listening on lldpad.socket. Nov 4 20:32:04 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 4 20:32:04 kjcf05n03 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 4 20:32:04 kjcf05n03 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 4 20:32:04 kjcf05n03 systemd[1]: Reached target Sockets. Nov 4 20:32:04 kjcf05n03 systemd[1]: Reached target Basic System. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting LSB: Bring up/down networking... Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 4 20:32:04 kjcf05n03 mcelog[2115]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 4 20:32:04 kjcf05n03 mcelog[2115]: CPU is unsupported Nov 4 20:32:04 kjcf05n03 systemd[1]: Started irqbalance daemon. Nov 4 20:32:04 kjcf05n03 network[2116]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 4 20:32:04 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 20:32:04 kjcf05n03 beSetMlxConfig[2127]: ConnectX-3 multiport not detected Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Resets System Activity Logs... Nov 4 20:32:04 kjcf05n03 chronyd[2159]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 20:32:04 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 20:32:04 kjcf05n03 network[2141]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 20:32:04 kjcf05n03 network[2116]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[2160]: Setting up Mellanox network interface: ib0 Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 4 20:32:04 kjcf05n03 network[2167]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:32:04 kjcf05n03 network[2116]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[2175]: Setting up Mellanox network interface: ib1 Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Name Service Cache Daemon... Nov 4 20:32:04 kjcf05n03 dwd[2176]: dwd: vMay 29 2024 : 15:38:26 Nov 4 20:32:04 kjcf05n03 dwd[2176]: /usr/sbin/dwd -d --standalone=0 Nov 4 20:32:04 kjcf05n03 dwd[2176]: dwd: option Lethal: 0 Nov 4 20:32:04 kjcf05n03 dwd[2176]: dwd: option Interval: 60 Nov 4 20:32:04 kjcf05n03 dwd[2176]: dwd: option abrtlimit: 10 Nov 4 20:32:04 kjcf05n03 dwd[2176]: dwd: option DZPeriod: 604800 Nov 4 20:32:04 kjcf05n03 dwd[2176]: dwd: option SmartPeriod: 43200 Nov 4 20:32:04 kjcf05n03 dwd[2176]: dwd: option SDDEnabled: 1 Nov 4 20:32:04 kjcf05n03 dwd[2176]: dwd: option SDDAwaitScale: 3 Nov 4 20:32:04 kjcf05n03 dwd[2176]: dwd: option SDDAwaitMin: 100 Nov 4 20:32:04 kjcf05n03 dwd[2176]: dwd: option Verbosity: 1 Nov 4 20:32:04 kjcf05n03 dwd[2176]: dwd: option StandAlone: 0 Nov 4 20:32:04 kjcf05n03 dwd[2176]: option Lethal: 0 Nov 4 20:32:04 kjcf05n03 dwd[2176]: option Interval: 60 Nov 4 20:32:04 kjcf05n03 dwd[2176]: option abrtlimit: 10 Nov 4 20:32:04 kjcf05n03 dwd[2176]: option DZPeriod: 604800 Nov 4 20:32:04 kjcf05n03 dwd[2176]: option SmartPeriod: 43200 Nov 4 20:32:04 kjcf05n03 dwd[2176]: option SDDEnabled: 1 Nov 4 20:32:04 kjcf05n03 dwd[2176]: option SDDAwaitScale: 3 Nov 4 20:32:04 kjcf05n03 dwd[2176]: option SDDAwaitMin: 100 Nov 4 20:32:04 kjcf05n03 dwd[2176]: option Verbosity: 1 Nov 4 20:32:04 kjcf05n03 dwd[2176]: option StandAlone: 0 Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 4 20:32:04 kjcf05n03 nscd[2232]: 2232 monitoring file `/etc/hosts` (1) Nov 4 20:32:04 kjcf05n03 nscd[2232]: 2232 monitoring directory `/etc` (2) Nov 4 20:32:04 kjcf05n03 nscd[2232]: 2232 monitoring file `/etc/resolv.conf` (3) Nov 4 20:32:04 kjcf05n03 nscd[2232]: 2232 monitoring directory `/etc` (2) Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 4 20:32:04 kjcf05n03 network[2201]: It is advised to switch to 'NetworkManager' instead for network management. Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 0 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 1 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 2 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 3 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 4 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 5 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 6 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 7 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 8 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 9 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 10 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 11 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 12 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 13 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 14 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 15 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 16 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 17 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 18 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 19 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 20 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 21 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 22 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 23 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 24 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 25 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 26 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 27 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 28 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 29 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 30 Nov 4 20:32:04 kjcf05n03 cpupower[2242]: Setting cpu: 31 Nov 4 20:32:04 kjcf05n03 systemd[1]: Started D-Bus System Message Bus. Nov 4 20:32:04 kjcf05n03 beSetMlxConfig[2127]: Starting MST (Mellanox Software Tools) driver set Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 4 20:32:04 kjcf05n03 chronyd[2159]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 20:32:04 kjcf05n03 chronyd[2159]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 20:32:04 kjcf05n03 beSetMlxConfig[2127]: Loading MST PCI module - Success Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[2289]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Manage Cutlass PHYs... Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[2290]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 4 20:32:04 kjcf05n03 dbus-daemon[2271]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 20:32:04 kjcf05n03 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 4 20:32:04 kjcf05n03 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 4 20:32:04 kjcf05n03 beSetMlxConfig[2127]: Loading MST PCI configuration module - Success Nov 4 20:32:04 kjcf05n03 beSetMlxConfig[2127]: Create devices Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[2306]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Resets System Activity Logs. Nov 4 20:32:04 kjcf05n03 mdraid-phy[2304]: no Cutlass to worry about Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[2319]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 20:32:04 kjcf05n03 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Name Service Cache Daemon. Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[2328]: No configuration found for ib1 Nov 4 20:32:04 kjcf05n03 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[2333]: No configuration found for ib0 Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Manage Cutlass PHYs. Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 0 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 1 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 2 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 3 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 4 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 5 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 6 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 7 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 8 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 9 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 10 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 11 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 12 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 13 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 14 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 15 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 16 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 17 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 18 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 19 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 20 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 21 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 22 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 23 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 24 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 25 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 26 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 27 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 28 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 29 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 30 Nov 4 20:32:04 kjcf05n03 cpupower[2367]: Idlestate 2 disabled on CPU 31 Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[2355]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[2366]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 20:32:04 kjcf05n03 mlnx_conf_mgr[2410]: INFO: No configurations found for mlx5_1, skipping. Nov 4 20:32:04 kjcf05n03 mlnx_conf_mgr[2426]: INFO: No configurations found for mlx5_0, skipping. Nov 4 20:32:04 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 20:32:04 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 20:32:04 kjcf05n03 sssd[sssd][2296]: Starting up Nov 4 20:32:04 kjcf05n03 sssd[be[implicit_files]][2511]: Starting up Nov 4 20:32:04 kjcf05n03 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 4 20:32:04 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 4 20:32:04 kjcf05n03 sssd[nss][2594]: Starting up Nov 4 20:32:04 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 4 20:32:04 kjcf05n03 systemd[1]: Reached target User and Group Name Lookups. Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Login Service... Nov 4 20:32:04 kjcf05n03 systemd-logind[2723]: New seat seat0. Nov 4 20:32:04 kjcf05n03 systemd-logind[2723]: Watching system buttons on /dev/input/event0 (Power Button) Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Login Service. Nov 4 20:32:04 kjcf05n03 python3.9[2184]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 20:32:04 kjcf05n03 python3.9[3195]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 20:32:04 kjcf05n03 systemd-sysctl[2790]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 20:32:04 kjcf05n03 systemd-sysctl[2790]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 4 20:32:04 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 20:32:04 kjcf05n03 python3.9[2911]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 20:32:04 kjcf05n03 python3.9[3195]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 4 20:32:04 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 20:32:04 kjcf05n03 network[2116]: Bringing up loopback interface: [ OK ] Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 20:32:04 kjcf05n03 systemd-sysctl[3122]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 20:32:04 kjcf05n03 systemd-sysctl[3122]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 20:32:04 kjcf05n03 systemd[1]: Started LSB: Bring up/down networking. Nov 4 20:32:04 kjcf05n03 systemd[1]: Reached target Network. Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 4 20:32:04 kjcf05n03 systemd[1]: Reached target Network is Online. Nov 4 20:32:04 kjcf05n03 python3.9[3100]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 20:32:04 kjcf05n03 python3.9[3195]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting System Logger Daemon... Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Notify NFS peers of a restart... Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started GSSAPI Proxy Daemon. Nov 4 20:32:04 kjcf05n03 sm-notify[3199]: Version 2.3.3 starting Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Notify NFS peers of a restart. Nov 4 20:32:04 kjcf05n03 sshd[3166]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 4 20:32:04 kjcf05n03 systemd[1]: Reached target NFS client services. Nov 4 20:32:04 kjcf05n03 systemd[1]: Reached target Remote File Systems (Pre). Nov 4 20:32:04 kjcf05n03 systemd[1]: Reached target Remote File Systems. Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Permit User Sessions... Nov 4 20:32:04 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 4 20:32:04 kjcf05n03 lldpad[3167]: setsockopt nearest_bridge: Invalid argument Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Permit User Sessions. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Serial Getty on ttyS0. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Getty on tty1. Nov 4 20:32:04 kjcf05n03 lldpad[3167]: setsockopt nearest_bridge: Invalid argument Nov 4 20:32:04 kjcf05n03 systemd[1]: Reached target Login Prompts. Nov 4 20:32:04 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 20:32:04 kjcf05n03 syslog-ng[3195]: [2024-11-05T02:30:51.225529] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 4 20:32:04 kjcf05n03 syslog-ng[3195]: [2024-11-05T02:30:51.225846] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 4 20:32:04 kjcf05n03 syslog-ng[3195]: [2024-11-05T02:30:51.225882] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 4 20:32:04 kjcf05n03 syslog-ng[3195]: [2024-11-05T02:30:51.226459] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 4 20:32:04 kjcf05n03 syslog-ng[3195]: [2024-11-05T02:30:51.226644] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 4 20:32:04 kjcf05n03 systemd[1]: Started System Logger Daemon. Nov 4 20:32:04 kjcf05n03 beSetMlxConfig[2127]: Unloading MST PCI module (unused) - Success Nov 4 20:32:04 kjcf05n03 python3.9[3219]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 20:32:04 kjcf05n03 python3.9[3195]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 4 20:32:04 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 20:32:04 kjcf05n03 python3.9[3445]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 20:32:04 kjcf05n03 python3.9[3195]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 4 20:32:04 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 4 20:32:04 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 20:32:04 kjcf05n03 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 4 20:32:04 kjcf05n03 chronyd[2159]: System's initial offset : 0.002344 seconds slow of true (slew) Nov 4 20:32:04 kjcf05n03 systemd[1]: Started NTP client/server. Nov 4 20:32:04 kjcf05n03 beSetMlxConfig[2127]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 20:32:04 kjcf05n03 beSetMlxConfig[2127]: ib mode Nov 4 20:32:04 kjcf05n03 beSetMlxConfig[2127]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 20:32:04 kjcf05n03 root[3469]: openibd: Set node_desc for mlx5_0: kjcf05n03 HCA-1 Nov 4 20:32:04 kjcf05n03 root[3471]: openibd: Set node_desc for mlx5_1: kjcf05n03 HCA-2 Nov 4 20:32:04 kjcf05n03 beSetMlxConfig[2127]: ib mode Nov 4 20:32:04 kjcf05n03 systemd-udevd[1551]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 20:32:04 kjcf05n03 systemd-udevd[3481]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:32:04 kjcf05n03 systemd-udevd[3482]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:32:04 kjcf05n03 systemd-udevd[3485]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:32:04 kjcf05n03 systemd-udevd[3488]: Using default interface naming scheme 'rhel-8.0'. Nov 4 20:32:04 kjcf05n03 systemd-udevd[3488]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:32:04 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 20:32:04 kjcf05n03 systemd[3195]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:04 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[3523]: Setting up Mellanox network interface: ib0 Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[3524]: Setting up Mellanox network interface: ib1 Nov 4 20:32:04 kjcf05n03 systemd-udevd[3483]: Using default interface naming scheme 'rhel-8.0'. Nov 4 20:32:04 kjcf05n03 systemd-udevd[3483]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[3573]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[3574]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[3589]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[3590]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[3591]: No configuration found for ib0 Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[3592]: No configuration found for ib1 Nov 4 20:32:04 kjcf05n03 systemd-udevd[3484]: Using default interface naming scheme 'rhel-8.0'. Nov 4 20:32:04 kjcf05n03 systemd-udevd[3484]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Puppet agent... Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[3600]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[3599]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 20:32:04 kjcf05n03 mlnx_conf_mgr[3654]: INFO: No configurations found for mlx5_1, skipping. Nov 4 20:32:04 kjcf05n03 mlnx_conf_mgr[3655]: INFO: No configurations found for mlx5_0, skipping. Nov 4 20:32:04 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 20:32:04 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 20:32:04 kjcf05n03 systemd[1]: Stopping Command Scheduler... Nov 4 20:32:04 kjcf05n03 systemd[1]: crond.service: Succeeded. Nov 4 20:32:04 kjcf05n03 systemd[1]: Stopped Command Scheduler. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 4 20:32:04 kjcf05n03 systemd[1]: Stopping Job spooling tools... Nov 4 20:32:04 kjcf05n03 systemd[1]: atd.service: Succeeded. Nov 4 20:32:04 kjcf05n03 systemd[1]: Stopped Job spooling tools. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 20:32:04 kjcf05n03 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 4 20:32:04 kjcf05n03 lldpad[3167]: init_ports: Error adding device ib0 Nov 4 20:32:04 kjcf05n03 lldpad[3167]: init_ports: Error adding device ib1 Nov 4 20:32:04 kjcf05n03 lldpad[3167]: Signal 15 received - terminating Nov 4 20:32:04 kjcf05n03 systemd[1]: lldpad.service: Succeeded. Nov 4 20:32:04 kjcf05n03 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 4 20:32:04 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 4 20:32:04 kjcf05n03 systemd[1]: lldpad.socket: Succeeded. Nov 4 20:32:04 kjcf05n03 systemd[1]: Closed lldpad.socket. Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 4 20:32:04 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting IPMI Driver... Nov 4 20:32:04 kjcf05n03 systemd[1]: Started IPMI Driver. Nov 4 20:32:04 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:04 kjcf05n03 systemd[3195]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:04 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Ipmievd Daemon... Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 1 | Nov-05-2024 | 02:01:09 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 2 | Nov-05-2024 | 02:02:00 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 3 | Nov-05-2024 | 02:02:00 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 4 | Nov-05-2024 | 02:03:06 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 5 | Nov-05-2024 | 02:03:06 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 6 | Nov-05-2024 | 02:28:05 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 7 | Nov-05-2024 | 02:28:05 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 8 | Nov-05-2024 | 02:28:05 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 9 | Nov-05-2024 | 02:28:05 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 10 | Nov-05-2024 | 02:28:05 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 11 | Nov-05-2024 | 02:28:05 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 12 | Nov-05-2024 | 02:28:05 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 13 | Nov-05-2024 | 02:28:05 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 14 | Nov-05-2024 | 02:28:05 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 15 | Nov-05-2024 | 02:28:05 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 16 | Nov-05-2024 | 02:28:05 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 17 | Nov-05-2024 | 02:28:05 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 18 | Nov-05-2024 | 02:28:05 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 19 | Nov-05-2024 | 02:28:05 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 20 | Nov-05-2024 | 02:28:05 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 21 | Nov-05-2024 | 02:28:05 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 22 | Nov-05-2024 | 02:28:05 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 23 | Nov-05-2024 | 02:28:05 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 24 | Nov-05-2024 | 02:28:05 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 25 | Nov-05-2024 | 02:28:05 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 26 | Nov-05-2024 | 02:28:05 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 27 | Nov-05-2024 | 02:28:05 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 28 | Nov-05-2024 | 02:28:06 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 29 | Nov-05-2024 | 02:28:06 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 30 | Nov-05-2024 | 02:28:06 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 31 | Nov-05-2024 | 02:28:06 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 32 | Nov-05-2024 | 02:28:06 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 33 | Nov-05-2024 | 02:28:06 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 34 | Nov-05-2024 | 02:28:06 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 35 | Nov-05-2024 | 02:28:06 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 36 | Nov-05-2024 | 02:28:06 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 37 | Nov-05-2024 | 02:28:06 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 38 | Nov-05-2024 | 02:28:35 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 39 | Nov-05-2024 | 02:28:35 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 40 | Nov-05-2024 | 02:28:35 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 41 | Nov-05-2024 | 02:28:35 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 42 | Nov-05-2024 | 02:28:35 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 43 | Nov-05-2024 | 02:28:35 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 44 | Nov-05-2024 | 02:28:35 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 45 | Nov-05-2024 | 02:28:35 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 46 | Nov-05-2024 | 02:28:35 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 47 | Nov-05-2024 | 02:28:35 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 48 | Nov-05-2024 | 02:28:35 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 20:32:04 kjcf05n03 ipmievd[3999]: 49 | Nov-05-2024 | 02:28:35 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 20:32:04 kjcf05n03 ipmievd[4002]: Reading sensors... Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Ipmievd Daemon. Nov 4 20:32:04 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:04 kjcf05n03 systemd[3195]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 4 20:32:04 kjcf05n03 nscd[2232]: 2232 monitored file `/etc/hosts` was moved into place, adding watch Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 20:32:04 kjcf05n03 systemd[1]: set-mlx-config.service: Succeeded. Nov 4 20:32:04 kjcf05n03 systemd[1]: Stopped Set Mellanox configuration. Nov 4 20:32:04 kjcf05n03 systemd[1]: Stopping Set Mellanox configuration... Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 4 20:32:04 kjcf05n03 beSetMlxConfig[4059]: ConnectX-3 multiport not detected Nov 4 20:32:04 kjcf05n03 beSetMlxConfig[4059]: Starting MST (Mellanox Software Tools) driver set Nov 4 20:32:04 kjcf05n03 beSetMlxConfig[4059]: Loading MST PCI module - Success Nov 4 20:32:04 kjcf05n03 systemd-udevd[1551]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 20:32:04 kjcf05n03 beSetMlxConfig[4059]: [warn] mst_pciconf is already loaded, skipping Nov 4 20:32:04 kjcf05n03 beSetMlxConfig[4059]: Create devices Nov 4 20:32:04 kjcf05n03 beSetMlxConfig[4059]: Unloading MST PCI module (unused) - Success Nov 4 20:32:04 kjcf05n03 ipmievd[4002]: Waiting for events... Nov 4 20:32:04 kjcf05n03 beSetMlxConfig[4059]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 20:32:04 kjcf05n03 beSetMlxConfig[4059]: ib mode Nov 4 20:32:04 kjcf05n03 beSetMlxConfig[4059]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 20:32:04 kjcf05n03 beSetMlxConfig[4059]: ib mode Nov 4 20:32:04 kjcf05n03 systemd-udevd[1551]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 20:32:04 kjcf05n03 systemd-udevd[4960]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:32:04 kjcf05n03 systemd-udevd[4961]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:32:04 kjcf05n03 systemd-udevd[4964]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:32:04 kjcf05n03 systemd-udevd[4966]: Using default interface naming scheme 'rhel-8.0'. Nov 4 20:32:04 kjcf05n03 systemd-udevd[4966]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:32:04 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 20:32:04 kjcf05n03 systemd[3195]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:04 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[5002]: Setting up Mellanox network interface: ib0 Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[5003]: Setting up Mellanox network interface: ib1 Nov 4 20:32:04 kjcf05n03 systemd-udevd[4962]: Using default interface naming scheme 'rhel-8.0'. Nov 4 20:32:04 kjcf05n03 systemd-udevd[4963]: Using default interface naming scheme 'rhel-8.0'. Nov 4 20:32:04 kjcf05n03 systemd-udevd[4962]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:32:04 kjcf05n03 systemd-udevd[4963]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[5053]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[5052]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[5083]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[5084]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[5085]: No configuration found for ib1 Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[5086]: No configuration found for ib0 Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[5093]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 20:32:04 kjcf05n03 mlnx_interface_mgr[5094]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 20:32:04 kjcf05n03 mlnx_conf_mgr[5133]: INFO: No configurations found for mlx5_1, skipping. Nov 4 20:32:04 kjcf05n03 mlnx_conf_mgr[5134]: INFO: No configurations found for mlx5_0, skipping. Nov 4 20:32:04 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 20:32:04 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}a79960857b3de4b9d58eeb0f9bb3fe86fdfe0f174efa3d1d822f3c6c2c19f29f' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}a79960857b3de4b9d58eeb0f9bb3fe86fdfe0f174efa3d1d822f3c6c2c19f29f' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}65fd780dcd8c63a18de1456bb7d3eada324b03724a8925cb584c74d6c2bc6ad6' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}65fd780dcd8c63a18de1456bb7d3eada324b03724a8925cb584c74d6c2bc6ad6' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}52aa8d361fdeb9e5aff3119f483257bc2eedbc844baf42f9f905028ad8a5dd90' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}52aa8d361fdeb9e5aff3119f483257bc2eedbc844baf42f9f905028ad8a5dd90' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}31379c64365aec02bd6e73f0d2a419b1ed1e9ec89f852c1d9764b119fc618d25' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}31379c64365aec02bd6e73f0d2a419b1ed1e9ec89f852c1d9764b119fc618d25' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 20:32:04 kjcf05n03 systemd[1]: Stopping NTP client/server... Nov 4 20:32:04 kjcf05n03 chronyd[2159]: chronyd exiting Nov 4 20:32:04 kjcf05n03 systemd[1]: chronyd.service: Succeeded. Nov 4 20:32:04 kjcf05n03 systemd[1]: Stopped NTP client/server. Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 4 20:32:04 kjcf05n03 chronyd[5170]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 20:32:04 kjcf05n03 chronyd[5170]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 20:32:04 kjcf05n03 chronyd[5170]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 20:32:04 kjcf05n03 chronyd[5170]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 4 20:32:04 kjcf05n03 systemd[1]: Started NTP client/server. Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 20:32:04 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:04 kjcf05n03 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 4 20:32:04 kjcf05n03 systemd[1]: dwd.service: Succeeded. Nov 4 20:32:04 kjcf05n03 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 20:32:04 kjcf05n03 dwd[5202]: dwd: vMay 29 2024 : 15:38:26 Nov 4 20:32:04 kjcf05n03 dwd[5202]: /usr/sbin/dwd -i 15 -d Nov 4 20:32:04 kjcf05n03 dwd[5202]: dwd: option Lethal: 0 Nov 4 20:32:04 kjcf05n03 dwd[5202]: dwd: option Interval: 15 Nov 4 20:32:04 kjcf05n03 dwd[5202]: dwd: option abrtlimit: 10 Nov 4 20:32:04 kjcf05n03 dwd[5202]: dwd: option DZPeriod: 604800 Nov 4 20:32:04 kjcf05n03 dwd[5202]: dwd: option SmartPeriod: 43200 Nov 4 20:32:04 kjcf05n03 dwd[5202]: dwd: option SDDEnabled: 1 Nov 4 20:32:04 kjcf05n03 dwd[5202]: dwd: option SDDAwaitScale: 3 Nov 4 20:32:04 kjcf05n03 dwd[5202]: dwd: option SDDAwaitMin: 100 Nov 4 20:32:04 kjcf05n03 dwd[5202]: dwd: option Verbosity: 1 Nov 4 20:32:04 kjcf05n03 dwd[5202]: dwd: option StandAlone: 0 Nov 4 20:32:04 kjcf05n03 dwd[5202]: option Lethal: 0 Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 20:32:04 kjcf05n03 dwd[5202]: option Interval: 15 Nov 4 20:32:04 kjcf05n03 dwd[5202]: option abrtlimit: 10 Nov 4 20:32:04 kjcf05n03 dwd[5202]: option DZPeriod: 604800 Nov 4 20:32:04 kjcf05n03 dwd[5202]: option SmartPeriod: 43200 Nov 4 20:32:04 kjcf05n03 dwd[5202]: option SDDEnabled: 1 Nov 4 20:32:04 kjcf05n03 dwd[5202]: option SDDAwaitScale: 3 Nov 4 20:32:04 kjcf05n03 dwd[5202]: option SDDAwaitMin: 100 Nov 4 20:32:04 kjcf05n03 dwd[5202]: option Verbosity: 1 Nov 4 20:32:04 kjcf05n03 dwd[5202]: option StandAlone: 0 Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 20:32:04 kjcf05n03 dwd[5203]: option abrtlimit now set to 1 Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 20:32:04 kjcf05n03 dwd[5203]: option SmartPeriod now set to 86400 Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 20:32:04 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 20:32:04 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Discard unused blocks. Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:04 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:04 kjcf05n03 python3.9[5232]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 4 20:32:04 kjcf05n03 python3.9[3195]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 20:32:04 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Periodic ZFS scrub. Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:04 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 20:32:04 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:04 kjcf05n03 systemd[1]: Starting Sed Control Plane worker process... Nov 4 20:32:04 kjcf05n03 sedcpwrkr[5371]: Using config script: /etc/sedcpwrkr.conf Nov 4 20:32:04 kjcf05n03 sedcpwrkr[5371]: - Creating default directory: '/var/log/sedcpwrkr' Nov 4 20:32:04 kjcf05n03 sedcpwrkr[5371]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 4 20:32:04 kjcf05n03 sedcpwrkr[5371]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 4 20:32:04 kjcf05n03 sedcpwrkr[5371]: - Creating default directory: '/var/run/sedcpwrkr' Nov 4 20:32:04 kjcf05n03 sedcpwrkr[5371]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 4 20:32:04 kjcf05n03 sedcpwrkr[5371]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 4 20:32:04 kjcf05n03 sedcpwrkr-server[5402]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 20:32:04 kjcf05n03 sedcpwrkr[5371]: celery multi v5.2.7 (dawn-chorus) Nov 4 20:32:04 kjcf05n03 sedcpwrkr[5371]: > Starting nodes... Nov 4 20:32:04 kjcf05n03 sedcpwrkr[5371]: > sedcpwrkr@kjcf05n03: OK Nov 4 20:32:04 kjcf05n03 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 4 20:32:04 kjcf05n03 sedcpwrkr-server[5404]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 20:32:04 kjcf05n03 sedcpwrkr-server[5404]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 20:32:04 kjcf05n03 sedcpwrkr-server[5404]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 20:32:04 kjcf05n03 systemd[1]: Started Sed Control Plane worker process. Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 20:32:04 kjcf05n03 systemd[1]: Reloading System Logger Daemon. Nov 4 20:32:04 kjcf05n03 systemd[1]: Reloaded System Logger Daemon. Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 20:32:04 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 4 20:32:04 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 4 20:32:04 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:05 kjcf05n03 systemd[1]: Starting IPv4 firewall with iptables... Nov 4 20:32:05 kjcf05n03 systemd-udevd[1551]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 20:32:05 kjcf05n03 iptables.init[5471]: iptables: Applying firewall rules: [ OK ] Nov 4 20:32:05 kjcf05n03 systemd[1]: Started IPv4 firewall with iptables. Nov 4 20:32:05 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:05 kjcf05n03 systemd[3195]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:05 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:05 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:05 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 4 20:32:05 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 4 20:32:05 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 20:32:05 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 20:32:05 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 4 20:32:05 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 4 20:32:05 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 4 20:32:05 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 4 20:32:05 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 4 20:32:05 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 4 20:32:05 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 20:32:05 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 20:32:06 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 20:32:06 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 4 20:32:06 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 4 20:32:06 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 4 20:32:06 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 4 20:32:06 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 4 20:32:06 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 4 20:32:06 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 4 20:32:06 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 4 20:32:06 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 4 20:32:06 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 4 20:32:06 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 4 20:32:06 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 4 20:32:06 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 4 20:32:06 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 4 20:32:06 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 4 20:32:06 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 4 20:32:06 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 4 20:32:06 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 4 20:32:06 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 4 20:32:06 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 4 20:32:06 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 4 20:32:06 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 4 20:32:06 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 4 20:32:06 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 4 20:32:06 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 4 20:32:06 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 20:32:06 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 20:32:06 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 4 20:32:06 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 4 20:32:06 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 20:32:06 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 20:32:06 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 4 20:32:06 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 4 20:32:06 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 20:32:06 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 20:32:06 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 20:32:06 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 20:32:06 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:06 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 20:32:06 kjcf05n03 systemd[1]: openhpid.service: Supervising process 5568 which is not our child. We'll most likely not notice when it exits. Nov 4 20:32:06 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 20:32:06 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:06 kjcf05n03 openhpid[5568]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 20:32:06 kjcf05n03 openhpid[5568]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 20:32:06 kjcf05n03 openhpid[5568]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 20:32:06 kjcf05n03 openhpid[5568]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 20:32:06 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:06 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:07 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:07 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 4 20:32:07 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 4 20:32:07 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 20:32:07 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 20:32:07 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:07 kjcf05n03 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 4 20:32:07 kjcf05n03 dcs-collectord[5659]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 4 20:32:07 kjcf05n03 hpi.inv.log[5659]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 4 20:32:07 kjcf05n03 dcs-collectord[5659]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 4 20:32:07 kjcf05n03 dcs-collectord[5659]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 4 20:32:07 kjcf05n03 dcs-collector[5650]: Starting dcs-collector:[ OK ] Nov 4 20:32:07 kjcf05n03 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 4 20:32:07 kjcf05n03 dcs-collectord[5662]: INFO Starting collection for memory_info (collection_process.py:52) Nov 4 20:32:07 kjcf05n03 dcs-collectord[5662]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 20:32:07 kjcf05n03 dcs-collectord[5662]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 20:32:07 kjcf05n03 dcs-collectord[5662]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 20:32:07 kjcf05n03 dcs-collectord[5662]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 4 20:32:07 kjcf05n03 dcs-collectord[5662]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 4 20:32:07 kjcf05n03 dcs-collectord[5662]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 4 20:32:07 kjcf05n03 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 4 20:32:07 kjcf05n03 dcs-collectord[5662]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259352404", "units": "kB"}, {"name": "MemAvailable", "value": "258631820", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821324", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1687012", "units": "kB"}, {"name": "Inactive", "value": "958256", "units": "kB"}, {"name": "Active(anon)", "value": "1520608", "units": "kB"}, {"name": "Inactive(anon)", "value": "822332", "units": "kB"}, {"name": "Active(file)", "value": "166404", "units": "kB"}, {"name": "Inactive(file)", "value": "135924", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "749780", "units": "kB"}, {"name": "Mapped", "value": "86132", "units": "kB"}, {"name": "Shmem", "value": "1593448", "units": "kB"}, {"name": "KReclaimable", "value": "108668", "units": "kB"}, {"name": "Slab", "value": "273852", "units": "kB"}, {"name": "SReclaimable", "value": "108668", "units": "kB"}, {"name": "SUnreclaim", "value": "165184", "units": "kB"}, {"name": "KernelStack", "value": "9680", "units": "kB"}, {"name": "PageTables", "value": "20248", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3133168", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11136", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "2048", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "285000", "units": "kB"}, {"name": "DirectMap2M", "value": "21600256", "units": "kB"}, {"name": "DirectMap1G", "value": "246415360", "units": "kB"}]}' Nov 4 20:32:07 kjcf05n03 dcs-collectord[5662]: INFO Completed collection for memory_info (collection_process.py:59) Nov 4 20:32:07 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:08 kjcf05n03 systemd[3195]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:08 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:08 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:08 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 4 20:32:08 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 4 20:32:08 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 20:32:08 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 20:32:08 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:08 kjcf05n03 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 4 20:32:08 kjcf05n03 firmware-update-orc[5743]: Using config script: /etc/firmware_update_orc.conf Nov 4 20:32:08 kjcf05n03 firmware-update-orc[5743]: - Creating default directory: '/var/log/firmware-update-orc' Nov 4 20:32:08 kjcf05n03 firmware-update-orc[5743]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 4 20:32:08 kjcf05n03 firmware-update-orc[5743]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 4 20:32:08 kjcf05n03 firmware-update-orc[5743]: - Creating default directory: '/var/run/firmware-update-orc' Nov 4 20:32:08 kjcf05n03 firmware-update-orc[5743]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 4 20:32:08 kjcf05n03 firmware-update-orc[5743]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 4 20:32:09 kjcf05n03 dcs-collectord[5662]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 4 20:32:09 kjcf05n03 dcs-collectord[5662]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730773927.6859407], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730773928.8627136], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730773927.618892, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 4 20:32:09 kjcf05n03 firmware-update-orc-server[5779]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 20:32:09 kjcf05n03 firmware-update-orc[5743]: celery multi v5.2.7 (dawn-chorus) Nov 4 20:32:09 kjcf05n03 firmware-update-orc[5743]: > Starting nodes... Nov 4 20:32:09 kjcf05n03 firmware-update-orc[5743]: > worker1@kjcf05n03: OK Nov 4 20:32:09 kjcf05n03 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 4 20:32:09 kjcf05n03 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 4 20:32:09 kjcf05n03 firmware-update-orc-server[5808]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 20:32:09 kjcf05n03 firmware-update-orc-server[5808]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 20:32:09 kjcf05n03 firmware-update-orc-server[5808]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 20:32:09 kjcf05n03 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 4 20:32:09 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:09 kjcf05n03 systemd[3195]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:09 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:09 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:09 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 20:32:09 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 20:32:09 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 20:32:09 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 20:32:09 kjcf05n03 dbus-daemon[2271]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 20:32:09 kjcf05n03 dbus-daemon[2271]: [system] Reloaded configuration Nov 4 20:32:09 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 4 20:32:09 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 4 20:32:09 kjcf05n03 dbus-daemon[2271]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 20:32:09 kjcf05n03 dbus-daemon[2271]: [system] Reloaded configuration Nov 4 20:32:09 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 20:32:09 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 20:32:09 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 20:32:09 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 20:32:09 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:10 kjcf05n03 systemd[1]: Starting Manages hardware resources... Nov 4 20:32:10 kjcf05n03 ras-resource-manager-agent[5924]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 4 20:32:10 kjcf05n03 ras-resource-manager-agent[5910]: Starting ras-resource-manager-agent:[ OK ] Nov 4 20:32:10 kjcf05n03 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 4 20:32:10 kjcf05n03 ras-resource-manager-agent[5926]: INFO Starting the service handler (service_main_handler.py:98) Nov 4 20:32:10 kjcf05n03 ras-resource-manager-client[5926]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 4 20:32:10 kjcf05n03 systemd[1]: Started Manages hardware resources. Nov 4 20:32:10 kjcf05n03 ras-resource-manager-client[5926]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 20:32:10 kjcf05n03 ras-resource-manager-client[5936]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 20:32:10 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:11 kjcf05n03 systemd[3195]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:11 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:11 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:11 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 20:32:11 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 20:32:11 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:11 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 4 20:32:11 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:11 kjcf05n03 systemd[3195]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: Press Ctrl+C to exit. Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: Plugin support version 1.0 Nov 4 20:32:11 kjcf05n03 zabbix_agent2[6010]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 20:32:11 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:11 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:11 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:12 kjcf05n03 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 4 20:32:12 kjcf05n03 dcs-notification-sender[6086]: dcs-notification-senderd is stopped Nov 4 20:32:12 kjcf05n03 zabbix-agent2[6104]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 4 20:32:12 kjcf05n03 dcs-notification-sender[6086]: Starting notification-sender:[ OK ] Nov 4 20:32:12 kjcf05n03 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 4 20:32:12 kjcf05n03 zabbix-agent2[6106]: INFO DCS notification agent started. (agent.py:61) Nov 4 20:32:12 kjcf05n03 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 4 20:32:12 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:12 kjcf05n03 systemd[3195]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:12 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:12 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:13 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:13 kjcf05n03 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 4 20:32:13 kjcf05n03 dcs-collectord[6214]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 4 20:32:13 kjcf05n03 dcs-collectord[6214]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 4 20:32:13 kjcf05n03 dcs-bulk-data-sender[6214]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 4 20:32:13 kjcf05n03 dcs-bulk-data-sender[6205]: Starting bulk-data-sender:[ OK ] Nov 4 20:32:13 kjcf05n03 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 4 20:32:13 kjcf05n03 dcs-collectord[6216]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 4 20:32:13 kjcf05n03 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 4 20:32:13 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:14 kjcf05n03 systemd[3195]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:14 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:14 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:14 kjcf05n03 nscd[2232]: 2232 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 4 20:32:14 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 20:32:14 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 20:32:14 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 20:32:14 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 20:32:14 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 20:32:14 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 20:32:14 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 4 20:32:14 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 4 20:32:14 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 4 20:32:14 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 4 20:32:14 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 20:32:14 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 20:32:14 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 20:32:14 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 20:32:14 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 20:32:14 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 20:32:14 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 20:32:14 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 20:32:14 kjcf05n00 mcfcli[3673891]: %3|1730773934.503|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 20:32:14 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 4 20:32:14 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 4 20:32:14 kjcf05n03 systemd[1]: Stopping System Security Services Daemon... Nov 4 20:32:14 kjcf05n03 sssd[nss][2594]: Shutting down (status = 0) Nov 4 20:32:14 kjcf05n03 sssd[be[implicit_files]][2511]: Shutting down (status = 0) Nov 4 20:32:14 kjcf05n03 systemd[1]: sssd.service: Succeeded. Nov 4 20:32:14 kjcf05n03 systemd[1]: Stopped System Security Services Daemon. Nov 4 20:32:14 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 4 20:32:15 kjcf05n03 sssd[sssd][6280]: Starting up Nov 4 20:32:15 kjcf05n03 python3.9[5232]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 4 20:32:15 kjcf05n03 python3.9[3195]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:15 kjcf05n03 sssd[be[implicit_files]][6282]: Starting up Nov 4 20:32:15 kjcf05n03 sssd[nss][6295]: Starting up Nov 4 20:32:15 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 4 20:32:15 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 20:32:15 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 20:32:16 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 20:32:16 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 20:32:16 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 4 20:32:16 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 4 20:32:16 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 20:32:16 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 20:32:16 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure) defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 4 20:32:16 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure: defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 4 20:32:16 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure) defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 4 20:32:16 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure: defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 4 20:32:16 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 20:32:16 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 20:32:16 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 20:32:16 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 20:32:16 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 4 20:32:16 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 4 20:32:16 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:16 kjcf05n03 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 4 20:32:17 kjcf05n03 icinga2[6343]: [2024-11-04 20:32:16 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 4 20:32:17 kjcf05n03 icinga2[6343]: [2024-11-04 20:32:16 -0600] information/cli: Loading configuration file(s). Nov 4 20:32:17 kjcf05n03 icinga2[6343]: [2024-11-04 20:32:16 -0600] information/ConfigItem: Committing config item(s). Nov 4 20:32:17 kjcf05n03 icinga2[6343]: [2024-11-04 20:32:17 -0600] information/ApiListener: My API identity: kjcf05n03 Nov 4 20:32:17 kjcf05n03 icinga2[6343]: [2024-11-04 20:32:17 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 4 20:32:17 kjcf05n03 icinga2[6343]: [2024-11-04 20:32:17 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 4 20:32:17 kjcf05n03 icinga2[6343]: [2024-11-04 20:32:17 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 4 20:32:17 kjcf05n03 icinga2[6343]: [2024-11-04 20:32:17 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 4 20:32:17 kjcf05n03 icinga2[6343]: [2024-11-04 20:32:17 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 4 20:32:17 kjcf05n03 icinga2[6343]: [2024-11-04 20:32:17 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 4 20:32:17 kjcf05n03 icinga2[6343]: [2024-11-04 20:32:17 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 4 20:32:17 kjcf05n03 icinga2[6343]: [2024-11-04 20:32:17 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 4 20:32:17 kjcf05n03 icinga2[6343]: [2024-11-04 20:32:17 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 4 20:32:17 kjcf05n03 icinga2[6343]: [2024-11-04 20:32:17 -0600] information/cli: Closing console log. Nov 4 20:32:17 kjcf05n03 systemd[1]: Started Icinga host/service/network monitoring system. Nov 4 20:32:17 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:17 kjcf05n03 systemd[3195]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:17 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:17 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:18 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 20:32:18 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 20:32:18 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:18 kjcf05n03 systemd[1]: Started Icinga2 network monitor. Nov 4 20:32:18 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:18 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 20:32:18 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:18 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:19 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 20:32:19 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 20:32:19 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 20:32:19 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 20:32:19 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 4 20:32:19 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 4 20:32:19 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 4 20:32:19 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 4 20:32:19 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 20:32:19 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 20:32:19 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 20:32:19 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 20:32:19 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 4 20:32:19 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 4 20:32:19 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:19 kjcf05n03 systemd[1]: Starting Naming services LDAP client daemon.... Nov 4 20:32:19 kjcf05n03 nslcd[6958]: version 0.9.9 starting Nov 4 20:32:19 kjcf05n03 nslcd[6958]: accepting connections Nov 4 20:32:19 kjcf05n03 systemd[1]: Started Naming services LDAP client daemon.. Nov 4 20:32:19 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:20 kjcf05n03 systemd[3195]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:20 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:20 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:20 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 20:32:20 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 20:32:20 kjcf05n03 dcs-bulk-data-sender[6216]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 4 20:32:20 kjcf05n03 dcs-collectord[6216]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 4 20:32:20 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 20:32:20 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 20:32:20 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 20:32:20 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 20:32:21 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 20:32:21 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 20:32:21 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:21 kjcf05n03 systemd[1]: Starting DEAR Control Plane worker process... Nov 4 20:32:21 kjcf05n03 dearcpw[7064]: Using config script: /etc/dearcpw.conf Nov 4 20:32:21 kjcf05n03 dearcpw[7064]: - Creating default directory: '/var/log/dearcpw' Nov 4 20:32:21 kjcf05n03 dearcpw[7064]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 4 20:32:21 kjcf05n03 dearcpw[7064]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 4 20:32:21 kjcf05n03 dearcpw[7064]: - Creating default directory: '/var/run/dearcpw' Nov 4 20:32:21 kjcf05n03 dearcpw[7064]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 4 20:32:21 kjcf05n03 dearcpw[7064]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 4 20:32:22 kjcf05n03 dearcpw-server[7104]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 20:32:22 kjcf05n03 dearcpw[7064]: celery multi v5.2.7 (dawn-chorus) Nov 4 20:32:22 kjcf05n03 dearcpw[7064]: > Starting nodes... Nov 4 20:32:22 kjcf05n03 dearcpw[7064]: > dearcpw@kjcf05n03: OK Nov 4 20:32:22 kjcf05n03 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 4 20:32:22 kjcf05n03 dearcpw-server[7106]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 20:32:22 kjcf05n03 dearcpw-server[7106]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 20:32:22 kjcf05n03 dearcpw-server[7106]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 20:32:22 kjcf05n03 systemd[1]: Started DEAR Control Plane worker process. Nov 4 20:32:22 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:22 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:22 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 4 20:32:22 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 4 20:32:22 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 4 20:32:22 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 4 20:32:22 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 4 20:32:22 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 4 20:32:22 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 4 20:32:22 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 4 20:32:22 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 4 20:32:22 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 4 20:32:22 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:40258). Nov 4 20:32:22 kjcf05n01 rsyncd[3884469]: connect from kjcf05n03 (172.16.2.6) Nov 4 20:32:22 kjcf05n01 rsyncd[3884469]: rsync to puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 4 20:32:22 kjcf05n01 rsyncd[3884469]: receiving file list Nov 4 20:32:22 kjcf05n01 rsyncd[3884469]: sent 29 bytes received 325 bytes total size 10901 Nov 4 20:32:22 kjcf05n01 systemd[1]: rsyncd@662-172.16.2.2:873-172.16.2.6:40258.service: Succeeded. Nov 4 20:32:22 kjcf05n03 puppet[7142]: IEC: 017000000: Node is up and running: { "node": "kjcf05n03" } Nov 4 20:32:22 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 4 20:32:22 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 4 20:32:22 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 4 20:32:22 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 4 20:32:22 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 4 20:32:22 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 4 20:32:22 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 20:32:22 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 20:32:22 kjcf05n03 dcs-collectord[5662]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 20:32:22 kjcf05n03 dcs-collectord[5662]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 20:32:23 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 20:32:23 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 20:32:23 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 20:32:23 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 20:32:23 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 20:32:23 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 20:32:24 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 20:32:24 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 20:32:24 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 20:32:24 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 20:32:25 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 20:32:25 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 20:32:25 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 20:32:25 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 20:32:25 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 20:32:25 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 20:32:25 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:26 kjcf05n03 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 4 20:32:26 kjcf05n03 diskless-swap[7369]: HA_PS_000: recovering journal Nov 4 20:32:26 kjcf05n03 systemd-udevd[1551]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 20:32:26 kjcf05n03 diskless-swap[7369]: HA_PS_000: clean, 2285/6400 files, 7056/25600 blocks Nov 4 20:32:26 kjcf05n03 ipmievd[4002]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 4 20:32:26 kjcf05n03 ipmievd[4002]: System Event sensor - Timestamp Clock Sync Nov 4 20:32:26 kjcf05n03 diskless-swap[7369]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 4 20:32:26 kjcf05n03 diskless-swap[7369]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 4 20:32:26 kjcf05n03 diskless-swap[7369]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 4 20:32:26 kjcf05n03 diskless-swap[7369]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 4 20:32:26 kjcf05n03 ipmievd[4002]: System Event sensor - Timestamp Clock Sync Nov 4 20:32:26 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 4 20:32:26 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:26 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:26 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 4 20:32:26 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 4 20:32:26 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 20:32:26 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 20:32:26 kjcf05n03 systemd[1]: Stopping OpenSSH server daemon... Nov 4 20:32:26 kjcf05n03 systemd[1]: sshd.service: Succeeded. Nov 4 20:32:26 kjcf05n03 systemd[1]: Stopped OpenSSH server daemon. Nov 4 20:32:26 kjcf05n03 systemd[1]: Stopped target sshd-keygen.target. Nov 4 20:32:26 kjcf05n03 systemd[1]: Stopping sshd-keygen.target. Nov 4 20:32:26 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 4 20:32:26 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 4 20:32:26 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 4 20:32:26 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 4 20:32:26 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 4 20:32:26 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 20:32:26 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 20:32:27 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 20:32:27 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 20:32:27 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 20:32:27 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 20:32:28 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 20:32:28 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 20:32:28 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 20:32:28 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 20:32:28 kjcf05n00 mcfcli[3673891]: %3|1730773948.710|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:32:29 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 20:32:29 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 20:32:29 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 20:32:29 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 20:32:29 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 20:32:29 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 20:32:29 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 20:32:29 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 20:32:29 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:29 kjcf05n03 systemd[1]: Set up automount opt-firmware.automount. Nov 4 20:32:30 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:30 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:30 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 4 20:32:30 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 4 20:32:30 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:30 kjcf05n03 systemd[1]: Set up automount mnt-llog.automount. Nov 4 20:32:30 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:30 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:30 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 20:32:30 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 20:32:30 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:30 kjcf05n03 systemd[1]: Set up automount usr-share-man.automount. Nov 4 20:32:30 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:30 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:30 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 4 20:32:30 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 4 20:32:30 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 4 20:32:30 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 4 20:32:30 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 4 20:32:30 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 4 20:32:30 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 20:32:30 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 20:32:30 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 20:32:30 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 20:32:30 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:31 kjcf05n03 systemd[1]: Starting Crash recovery kernel arming... Nov 4 20:32:31 kjcf05n03 kdumpctl[7868]: kdump: No kdump initial ramdisk found. Nov 4 20:32:31 kjcf05n03 kdumpctl[7868]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 4 20:32:31 kjcf05n03 dracut[7980]: dracut-049-135.git20210121.el8 Nov 4 20:32:32 kjcf05n03 dracut[7982]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 4 20:32:32 kjcf05n03 dracut[7982]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 20:32:32 kjcf05n03 dracut[7982]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 20:32:32 kjcf05n03 dracut[7982]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 4 20:32:32 kjcf05n03 dracut[7982]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 4 20:32:32 kjcf05n03 dracut[7982]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 20:32:32 kjcf05n03 dracut[7982]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 20:32:32 kjcf05n03 dracut[7982]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + is_func check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ type -t check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 0 -ne 0 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check -h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local dev holder Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + require_binaries mdadm expr Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _module_name=90hperaid Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ mdadm = \-\m ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for cmd in "$@" Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + find_binary mdadm Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for cmd in "$@" Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + find_binary expr Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n -h ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for dev in "${!host_fs_types[@]}" Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ nfs != *_raid_member ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + continue Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _ret=255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + ret=255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ 255 = 0 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ 255 = 255 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ module_depends hperaid Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: +++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: +++ set -x Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ depends Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo rootfs-block Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ return 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ _ret=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ return 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for _moddep in $(module_depends $_mod) Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all == *\ hperaid\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + add_dracutmodules+=' rootfs-block ' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ == *\ hperaid\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check_module rootfs-block Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _mod=rootfs-block Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddep Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ == *\ rootfs-block\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n '' ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + mods_checked_as_dep+=' rootfs-block ' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all == *\ rootfs-block\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + module_check rootfs-block 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _forced=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 2 -eq 2 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _forced=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + is_func check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ type -t check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 0 -ne 0 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check -h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _ret=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + ret=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ 0 = 0 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ module_depends rootfs-block Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: +++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 20:32:32 kjcf05n03 kdumpctl[3195]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ depends Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo fs-lib Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ _ret=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ return 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for _moddep in $(module_depends $_mod) Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all == *\ rootfs-block\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + add_dracutmodules+=' fs-lib ' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ == *\ rootfs-block\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check_module fs-lib Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _mod=fs-lib Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddep Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n '' ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + mods_checked_as_dep+=' fs-lib ' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all == *\ fs-lib\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + module_check fs-lib 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _forced=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 2 -eq 2 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _forced=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + is_func check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ type -t check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 0 -ne 0 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check -h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _ret=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + ret=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ 0 = 0 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ module_depends fs-lib Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: +++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ depends Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ return 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ _ret=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ return 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + mods_to_load+=' fs-lib ' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + mods_to_load+=' rootfs-block ' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + mods_to_load+=' hperaid ' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _mod=90kernel-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _mod=kernel-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check_module kernel-modules 1 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _mod=kernel-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddep Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n 1 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all = all ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + module_check kernel-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _forced=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 1 -eq 2 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + is_func check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ type -t check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 0 -ne 0 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check -h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + true Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _ret=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + ret=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ 0 != 0 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ module_depends kernel-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: +++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ depends Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ true Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ _ret=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ return 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + mods_to_load+=' kernel-modules ' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _mod=90kernel-modules-extra Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _mod=kernel-modules-extra Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check_module kernel-modules-extra 1 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _mod=kernel-modules-extra Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddep Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n 1 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all = all ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + module_check kernel-modules-extra Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _forced=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 1 -eq 2 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + is_func check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ type -t check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 0 -ne 0 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check -h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + true Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _ret=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + ret=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ 0 != 0 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ module_depends kernel-modules-extra Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: +++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ depends Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ true Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ _ret=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ return 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + mods_to_load+=' kernel-modules-extra ' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _mod=90kernel-network-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _mod=kernel-network-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check_module kernel-network-modules 1 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _mod=kernel-network-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddep Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n 1 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all = all ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + module_check kernel-network-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _forced=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 1 -eq 2 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + is_func check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ type -t check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 0 -ne 0 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check -h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _ret=255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + ret=255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ 255 != 0 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n 1 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 1 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _mod=90livenet Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _mod=livenet Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check_module livenet 1 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _mod=livenet Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddep Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n 1 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all = all ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + module_check livenet Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _forced=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 1 -eq 2 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + is_func check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ type -t check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 0 -ne 0 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check -h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _ret=255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + ret=255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ 255 != 0 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n 1 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 1 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _mod=90lvm Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _mod=lvm Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check_module lvm 1 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _mod=lvm Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddep Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n 1 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all = all ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + module_check lvm Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _forced=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 1 -eq 2 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + is_func check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ type -t check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 0 -ne 0 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check -h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + require_binaries lvm Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _module_name=90lvm Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ lvm = \-\m ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for cmd in "$@" Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + find_binary lvm Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n -h ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for fs in "${host_fs_types[@]}" Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ nfs = LVM*_member ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _ret=255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + ret=255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ 255 != 0 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n 1 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 1 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _mod=90mdraid Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _mod=mdraid Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check_module mdraid 1 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _mod=mdraid Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddep Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n 1 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all = all ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + module_check mdraid Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _forced=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 1 -eq 2 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + is_func check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ type -t check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 0 -ne 0 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check -h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _rootdev Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + require_binaries mdadm expr Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _module_name=90mdraid Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ mdadm = \-\m ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for cmd in "$@" Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + find_binary mdadm Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for cmd in "$@" Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + find_binary expr Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n -h ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for dev in "${!host_fs_types[@]}" Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ nfs != *_raid_member ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + continue Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _ret=255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + ret=255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ 255 != 0 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n 1 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 1 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _mod=90multipath Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _mod=multipath Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check_module multipath 1 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _mod=multipath Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddep Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n 1 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all = all ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + module_check multipath Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _forced=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 1 -eq 2 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + is_func check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ type -t check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 0 -ne 0 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check -h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _rootdev Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n -h ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for_each_host_dev_and_slaves is_mpath Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _func=is_mpath Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _dev Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for _dev in "${host_devs[@]}" Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + continue Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 1 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _ret=255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + ret=255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ 255 != 0 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n 1 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 1 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _mod=90qemu Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _mod=qemu Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check_module qemu 1 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _mod=qemu Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddep Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n 1 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all = all ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + module_check qemu Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _forced=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 1 -eq 2 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + is_func check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ type -t check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 0 -ne 0 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check -h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n -h ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + type -P systemd-detect-virt Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ systemd-detect-virt --vm Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + vm=none Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + (( 1 != 0 )) Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _ret=255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + ret=255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ 255 != 0 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n 1 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 1 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _mod=90qemu-net Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _mod=qemu-net Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check_module qemu-net 1 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _mod=qemu-net Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddep Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n 1 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all = all ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + module_check qemu-net Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _forced=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 1 -eq 2 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + is_func check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ type -t check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 0 -ne 0 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check -h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n -h ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + type -P systemd-detect-virt Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ systemd-detect-virt --vm Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + vm= Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + (( 1 != 0 )) Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _ret=255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + ret=255 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ 255 != 0 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n 1 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + return 1 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _mod=90stratis Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + _mod=stratis Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check_module stratis 1 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _mod=stratis Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddep Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -n 1 ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ all = all ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + module_check stratis Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ read a b Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _forced=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _hostonly=-h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 1 -eq 2 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + is_func check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: ++ type -t check Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + '[' 0 -ne 0 ']' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + check -h Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _module_name=90stratis Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + local _ret=0 Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + [[ stratisd-init = \-\m ]] Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + for cmd in "$@" Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + find_binary stratisd-init Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 4 20:32:32 kjcf05n03 kdumpctl[7868]: + set +x Nov 4 20:32:32 kjcf05n03 dracut[7982]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 20:32:32 kjcf05n03 dracut[7982]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 4 20:32:32 kjcf05n03 dracut[7982]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 4 20:32:32 kjcf05n03 dracut[7982]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 4 20:32:32 kjcf05n03 dracut[7982]: memstrack is available Nov 4 20:32:32 kjcf05n03 dracut[7982]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 20:32:32 kjcf05n03 dracut[7982]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 20:32:32 kjcf05n03 dracut[7982]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 20:32:32 kjcf05n03 dracut[7982]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 20:32:32 kjcf05n03 dracut[7982]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 20:32:32 kjcf05n03 dracut[7982]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 20:32:33 kjcf05n03 dracut[7982]: *** Including module: bash *** Nov 4 20:32:33 kjcf05n03 dracut[7982]: *** Including module: systemd *** Nov 4 20:32:33 kjcf05n03 dracut[7982]: *** Including module: fips *** Nov 4 20:32:34 kjcf05n03 dracut[7982]: *** Including module: systemd-initrd *** Nov 4 20:32:34 kjcf05n03 dracut[7982]: *** Including module: watchdog-modules *** Nov 4 20:32:34 kjcf05n03 dracut[7982]: *** Including module: nss-softokn *** Nov 4 20:32:34 kjcf05n03 dracut[7982]: *** Including module: i18n *** Nov 4 20:32:34 kjcf05n03 dracut[7982]: No KEYMAP configured. Nov 4 20:32:34 kjcf05n03 dracut[7982]: *** Including module: network-legacy *** Nov 4 20:32:35 kjcf05n03 dracut[7982]: *** Including module: network *** Nov 4 20:32:35 kjcf05n03 dracut[7982]: *** Including module: ib_bonding *** Nov 4 20:32:35 kjcf05n03 dracut[7982]: *** Including module: drm *** Nov 4 20:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 20:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 20:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 20:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 20:32:37 kjcf05n03 dcs-collectord[5662]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 20:32:37 kjcf05n03 dcs-collectord[5662]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 20:32:38 kjcf05n03 dracut[7982]: *** Including module: hperaid *** Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + install Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + local rule rule_path Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + inst_multiple cat expr Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.tlpARe/initramfs -a -f cat expr Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + _ret=0 Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + (( 0 != 0 )) Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + : Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + return 0 Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + inst_multiple -o mdmon Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.tlpARe/initramfs -a -f -o mdmon Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + _ret=0 Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + (( 0 != 0 )) Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + : Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + return 0 Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: ++ command -v partx Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + inst /usr/sbin/partx /sbin/partx Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + local _hostonly_install Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + [[ /usr/sbin/partx == \-\H ]] Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + [[ -e /tmp/dracut.tlpARe/initramfs//sbin/partx ]] Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.tlpARe/initramfs -f /usr/sbin/partx /sbin/partx Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + (( 0 != 0 )) Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + : Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: ++ command -v mdadm Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + local _hostonly_install Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + [[ -e /tmp/dracut.tlpARe/initramfs//sbin/mdadm ]] Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.tlpARe/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + (( 0 != 0 )) Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + : Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + [[ yes == \y\e\s ]] Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + local _raidconf Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: ++ cmdline Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: ++ local _activated dev line UUID Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: ++ declare -A _activated Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: ++ for dev in "${!host_fs_types[@]}" Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: ++ [[ nfs != *_raid_member ]] Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: ++ continue Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + _raidconf= Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + [[ -n '' ]] Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + inst_rules 64-md-raid.rules Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + local _target=/etc/udev/rules.d _rule _found Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + inst_dir /usr/lib/udev/rules.d Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + [[ -e /tmp/dracut.tlpARe/initramfs//usr/lib/udev/rules.d ]] Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + return 0 Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + inst_dir /etc/udev/rules.d Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + [[ -e /tmp/dracut.tlpARe/initramfs//etc/udev/rules.d ]] Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + return 0 Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + for _rule in "$@" Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + continue Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + continue Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + for r in '' $dracutbasedir/rules.d/ Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + [[ 64-md-raid.rules != /* ]] Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + continue Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + for r in '' $dracutbasedir/rules.d/ Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + continue Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + [[ -n '' ]] Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 4 20:32:38 kjcf05n03 kdumpctl[7868]: + set +x Nov 4 20:32:38 kjcf05n03 dracut[7982]: Skipping udev rule: 64-md-raid.rules Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + installkernel Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + instmods =drivers/md Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + local _optional=-o Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + local _silent Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + local _ret Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + [[ '' = yes ]] Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + [[ =drivers/md = \-\c ]] Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + [[ =drivers/md = \-\s ]] Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + (( 1 == 0 )) Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.tlpARe/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + _ret=0 Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + (( 0 != 0 )) Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + [[ -n '' ]] Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + return 0 Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + _ret=0 Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + unset check depends cmdline install installkernel Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + return 0 Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + modules_loaded+='hperaid ' Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + '[' -n '' ']' Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + _d_mod=90kernel-modules Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + _d_mod=kernel-modules Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + [[ '' = yes ]] Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + dinfo '*** Including module: kernel-modules ***' Nov 4 20:32:39 kjcf05n03 kdumpctl[7868]: + set +x Nov 4 20:32:39 kjcf05n03 dracut[7982]: *** Including module: kernel-modules *** Nov 4 20:32:39 kjcf05n03 dracut[7982]: *** Including module: kernel-modules-extra *** Nov 4 20:32:38 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n03": interface became available Nov 4 20:32:39 kjcf05n03 dracut[7982]: *** Including module: kernel-network-modules *** Nov 4 20:32:39 kjcf05n03 dracut[7982]: *** Including module: diskless-mod *** Nov 4 20:32:39 kjcf05n03 dracut[7982]: *** Including module: fstab-sys *** Nov 4 20:32:39 kjcf05n03 dracut[7982]: *** Including module: nfs *** Nov 4 20:32:40 kjcf05n03 dracut[7982]: *** Including module: rootfs-block *** Nov 4 20:32:40 kjcf05n03 dracut[7982]: *** Including module: terminfo *** Nov 4 20:32:40 kjcf05n03 dracut[7982]: *** Including module: udev-rules *** Nov 4 20:32:40 kjcf05n03 dracut[7982]: Skipping udev rule: 91-permissions.rules Nov 4 20:32:40 kjcf05n03 dracut[7982]: Skipping udev rule: 80-drivers-modprobe.rules Nov 4 20:32:40 kjcf05n03 dracut[7982]: *** Including module: dracut-systemd *** Nov 4 20:32:41 kjcf05n03 dracut[7982]: *** Including module: usrmount *** Nov 4 20:32:41 kjcf05n03 dracut[7982]: *** Including module: base *** Nov 4 20:32:42 kjcf05n03 dracut[7982]: *** Including module: fs-lib *** Nov 4 20:32:42 kjcf05n03 dracut[7982]: *** Including module: kdumpbase *** Nov 4 20:32:42 kjcf05n00 zabbix-server[2430243]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 20:32:42 kjcf05n00 zabbix-server[2430243]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n03 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n03:system.uptime): 00:02:46\\"}}"' Nov 4 20:32:42 kjcf05n00 log_interesting_event.py[2430243]: Event '46635' acknowledged Nov 4 20:32:42 kjcf05n00 zabbix-server[2430244]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 20:32:42 kjcf05n03 dracut[7982]: *** Including module: memstrack *** Nov 4 20:32:42 kjcf05n03 dracut[7982]: *** Including module: shutdown *** Nov 4 20:32:42 kjcf05n03 dracut[7982]: *** Including module: squash *** Nov 4 20:32:42 kjcf05n00 zabbix-server[2430244]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 4 20:32:42 kjcf05n00 log_interesting_event.py[2430244]: Event '46637' acknowledged Nov 4 20:32:43 kjcf05n03 dracut[7982]: *** Including modules done *** Nov 4 20:32:43 kjcf05n03 dracut[7982]: *** Installing kernel module dependencies *** Nov 4 20:32:42 kjcf05n00 zabbix-server[2430245]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 20:32:42 kjcf05n00 zabbix-server[2430245]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 4 20:32:42 kjcf05n00 log_interesting_event.py[2430245]: Event '46638' acknowledged Nov 4 20:32:43 kjcf05n03 dracut[7982]: *** Installing kernel module dependencies done *** Nov 4 20:32:43 kjcf05n03 dracut[7982]: *** Resolving executable dependencies *** Nov 4 20:32:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730773963', 'host':'kjcf05n03', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(0.0B/0.0B), ib1=(0.0B/0.0B), icl0=(4.4kB/6.0kB), lo=(500.0B/500.0B), meth0=(1540.9MB/7.8MB), mgmt0=(1477.6MB/7.7MB)'}"] Nov 4 20:32:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(0.0B/0.0B), ib1=(0.0B/0.0B), icl0=(4.4kB/6.0kB), lo=(500.0B/500.0B), meth0=(1540.9MB/7.8MB), mgmt0=(1477.6MB/7.7MB)', 'message': 'NET OK - (Rx/Tx) ib0=(0.0B/0.0B), ib1=(0.0B/0.0B), icl0=(4.4kB/6.0kB), lo=(500.0B/500.0B), meth0=(1540.9MB/7.8MB), mgmt0=(1477.6MB/7.7MB)', 'value': 'ok', 'timestamp': '1730773963'} Nov 4 20:32:44 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:32:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730773964', 'host':'kjcf05n03', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 4 20:32:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730773964'} Nov 4 20:32:44 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:32:44 kjcf05n00 mcfcli[3673891]: %3|1730773964.504|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 20:32:44 kjcf05n03 dracut[7982]: *** Resolving executable dependencies done*** Nov 4 20:32:44 kjcf05n03 dracut[7982]: *** Hardlinking files *** Nov 4 20:32:44 kjcf05n03 dracut[7982]: *** Hardlinking files done *** Nov 4 20:32:44 kjcf05n03 dracut[7982]: *** Generating early-microcode cpio image *** Nov 4 20:32:44 kjcf05n03 dracut[7982]: *** Constructing AuthenticAMD.bin **** Nov 4 20:32:44 kjcf05n03 dracut[7982]: *** Store current command line parameters *** Nov 4 20:32:44 kjcf05n03 dracut[7982]: Stored kernel commandline: Nov 4 20:32:44 kjcf05n03 dracut[7982]: rd.driver.pre=sd_mod Nov 4 20:32:44 kjcf05n03 dracut[7982]: rd.driver.pre=nvme Nov 4 20:32:44 kjcf05n03 dracut[7982]: rd.driver.pre=ipmi_si Nov 4 20:32:44 kjcf05n03 dracut[7982]: rd.driver.pre=ipmi_devintf Nov 4 20:32:44 kjcf05n03 dracut[7982]: rd.driver.pre=ipmi_msghandler Nov 4 20:32:44 kjcf05n03 dracut[7982]: nameserver=172.16.2.2 Nov 4 20:32:44 kjcf05n03 dracut[7982]: nameserver=127.0.0.1 Nov 4 20:32:44 kjcf05n03 dracut[7982]: nameserver=172.16.2.2 Nov 4 20:32:44 kjcf05n03 dracut[7982]: nameserver=127.0.0.1 Nov 4 20:32:44 kjcf05n03 dracut[7982]: ifname=kdump-meth0:00:09:3d:06:9a:1a team=mgmt0:kdump-meth0 Nov 4 20:32:44 kjcf05n03 dracut[7982]: rd.neednet Nov 4 20:32:44 kjcf05n03 dracut[7982]: kdumpnic=mgmt0 Nov 4 20:32:44 kjcf05n03 dracut[7982]: bootdev=mgmt0 Nov 4 20:32:44 kjcf05n03 dracut[7982]: *** Install squash loader *** Nov 4 20:32:45 kjcf05n03 dracut[7982]: *** Squashing the files inside the initramfs *** Nov 4 20:32:45 kjcf05n03 dracut[7982]: *** Squashing the files inside the initramfs done *** Nov 4 20:32:45 kjcf05n03 dracut[7982]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 4 20:32:45 kjcf05n00 zabbix-server[2430263]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 20:32:45 kjcf05n00 zabbix-server[2430263]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 316.25\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 193.86\\"}}"' Nov 4 20:32:45 kjcf05n00 log_interesting_event.py[2430263]: Event '46642' acknowledged Nov 4 20:32:45 kjcf05n03 dracut[7982]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 4 20:32:46 kjcf05n03 kdumpctl[7868]: kdump: kexec: loaded kdump kernel Nov 4 20:32:46 kjcf05n03 kdumpctl[7868]: kdump: Starting kdump: [OK] Nov 4 20:32:46 kjcf05n03 systemd[1]: Started Crash recovery kernel arming. Nov 4 20:32:46 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:46 kjcf05n03 systemd[3195]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:46 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:46 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:46 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 4 20:32:46 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 4 20:32:46 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 4 20:32:46 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 4 20:32:46 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 4 20:32:46 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 4 20:32:46 kjcf05n03 ifdown[14572]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 20:32:46 kjcf05n03 ifdown[14573]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:32:46 kjcf05n03 ifdown[14574]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:32:47 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 20:32:47 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 20:32:47 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 20:32:47 kjcf05n03 ifup[14634]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 20:32:47 kjcf05n03 ifup[14635]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:32:47 kjcf05n03 ifup[14636]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:32:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 20:32:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 20:32:49 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 4 20:32:51 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 20:32:51 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 20:32:51 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 20:32:51 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:32:51 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:32:51 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:32:51 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:32:51 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 20:32:51 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 20:32:51 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 20:32:51 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 20:32:51 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:32:51 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:32:51 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:32:51 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:32:51 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 4 20:32:51 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 4 20:32:51 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 4 20:32:51 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 4 20:32:51 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 4 20:32:51 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 4 20:32:51 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 4 20:32:51 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 4 20:32:51 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 4 20:32:51 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 4 20:32:51 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 4 20:32:51 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 4 20:32:51 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 4 20:32:51 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 4 20:32:51 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 4 20:32:51 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 4 20:32:51 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 4 20:32:51 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 4 20:32:51 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 4 20:32:51 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 4 20:32:51 kjcf05n03 ifdown[14822]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 20:32:51 kjcf05n03 ifdown[14823]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:32:51 kjcf05n03 ifdown[14824]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:32:52 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 20:32:52 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 20:32:52 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 20:32:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 20:32:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 20:32:52 kjcf05n03 ifup[14884]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 20:32:52 kjcf05n03 ifup[14886]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:32:52 kjcf05n03 ifup[14887]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:32:53 kjcf05n03 dcs-collectord[5662]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 20:32:53 kjcf05n03 dcs-collectord[5662]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 20:32:54 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 4 20:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 20:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 20:32:56 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 20:32:56 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 20:32:56 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 20:32:57 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:57 kjcf05n03 systemd[1]: Starting Corosync Cluster Engine... Nov 4 20:32:57 kjcf05n03 await_ha_peer[15089]: Waiting for HA peer kjcf05n02 Nov 4 20:32:58 kjcf05n03 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 4 20:32:58 kjcf05n03 await_ha_peer[15089]: Peer kjcf05n02 has started, starting HA Nov 4 20:32:58 kjcf05n03 systemd[1]: Started Corosync Cluster Engine. Nov 4 20:32:58 kjcf05n03 systemd[1]: Started Fast STONITH daemon. Nov 4 20:32:58 kjcf05n03 fstonithd.py[15144]: Listening for kdump packets from partner Nov 4 20:32:58 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:59 kjcf05n03 systemd[3195]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:32:59 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:32:59 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:32:59 kjcf05n03 systemd[1]: Reloading. Nov 4 20:32:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730773978', 'host':'kjcf05n03', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.5% (3847980 kB) used.'}"] Nov 4 20:32:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'RAM usage', 'description': 'OK - 1.5% (3847980 kB) used.', 'message': 'OK - 1.5% (3847980 kB) used.', 'value': 'ok', 'timestamp': '1730773978'} Nov 4 20:32:58 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:32:59 kjcf05n03 systemd[1]: Reached target resource-agents dependencies. Nov 4 20:32:59 kjcf05n03 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 4 20:32:59 kjcf05n03 systemd[1]: Reloading. Nov 4 20:33:00 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 20:33:00 kjcf05n03 puppet-agent[3615]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 4 20:33:00 kjcf05n03 puppet[3615]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 4 20:33:00 kjcf05n03 puppet-agent[3615]: Applied catalog in 92.64 seconds Nov 4 20:33:00 kjcf05n03 puppet[3615]: Notice: Applied catalog in 92.64 seconds Nov 4 20:33:00 kjcf05n03 systemd[1]: Started Puppet agent. Nov 4 20:33:00 kjcf05n03 systemd[1]: Starting Set absolute GEM time... Nov 4 20:33:00 kjcf05n03 systemd[1]: Started Service to do FW and inventory check on boot. Nov 4 20:33:00 kjcf05n03 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 4 20:33:00 kjcf05n03 systemd[1]: Started Startup script for monitoring-ec-node. Nov 4 20:33:00 kjcf05n03 systemd[1]: Started Startup script for gateway-ec-node. Nov 4 20:33:00 kjcf05n03 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 4 20:33:00 kjcf05n03 systemd[1]: Started Collect SAS Health Report every hour. Nov 4 20:33:00 kjcf05n03 systemd[1]: Reached target Timers. Nov 4 20:33:00 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 20:33:00 kjcf05n03 wce-disable.sh[15292]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 4 20:33:00 kjcf05n03 systemd[1]: disable-write-cache.service: Succeeded. Nov 4 20:33:00 kjcf05n03 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 4 20:33:00 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 20:33:00 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 20:33:00 kjcf05n03 systemd[1]: set_gem_time.service: Succeeded. Nov 4 20:33:00 kjcf05n03 systemd[1]: Started Set absolute GEM time. Nov 4 20:33:00 kjcf05n03 python3.9[15290]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 4 20:33:00 kjcf05n03 python3.9[15290]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 4 20:33:00 kjcf05n03 gateway-ec-node.py[15291]: Starting gateway-ec-node service Nov 4 20:33:00 kjcf05n03 RFSF-API[15289]: INFO[2024-11-04T20:33:00-06:00] Datapath API RESTful Service starting Nov 4 20:33:00 kjcf05n03 dp-api-server-node[15289]: INFO[2024-11-04T20:33:00-06:00] Datapath API RESTful Service starting Nov 4 20:33:00 kjcf05n03 RFSF-API[15289]: INFO[2024-11-04T20:33:00-06:00] Running in production mode, starting dbus event listener Nov 4 20:33:00 kjcf05n03 dp-api-server-node[15289]: INFO[2024-11-04T20:33:00-06:00] Running in production mode, starting dbus event listener Nov 4 20:33:00 kjcf05n03 RFSF-API[15289]: INFO[2024-11-04T20:33:00-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 20:33:00 kjcf05n03 dp-api-server-node[15289]: INFO[2024-11-04T20:33:00-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 20:33:00 kjcf05n03 RFSF-API[15289]: INFO[2024-11-04T20:33:00-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 20:33:00 kjcf05n03 dp-api-server-node[15289]: INFO[2024-11-04T20:33:00-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 20:33:00 kjcf05n03 RFSF-API[15289]: INFO[2024-11-04T20:33:00-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 20:33:00 kjcf05n03 dp-api-server-node[15289]: INFO[2024-11-04T20:33:00-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 20:33:00 kjcf05n03 RFSF-API[15289]: INFO[2024-11-04T20:33:00-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 20:33:00 kjcf05n03 dp-api-server-node[15289]: INFO[2024-11-04T20:33:00-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 20:33:00 kjcf05n03 RFSF-API[15289]: INFO[2024-11-04T20:33:00-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 20:33:00 kjcf05n03 dp-api-server-node[15289]: INFO[2024-11-04T20:33:00-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 20:33:00 kjcf05n03 RFSF-API[15289]: INFO[2024-11-04T20:33:00-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 20:33:00 kjcf05n03 dp-api-server-node[15289]: INFO[2024-11-04T20:33:00-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 20:33:00 kjcf05n03 RFSF-API[15289]: INFO[2024-11-04T20:33:00-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 20:33:00 kjcf05n03 dp-api-server-node[15289]: INFO[2024-11-04T20:33:00-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 20:33:00 kjcf05n03 RFSF-API[15289]: INFO[2024-11-04T20:33:00-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 20:33:00 kjcf05n03 dp-api-server-node[15289]: INFO[2024-11-04T20:33:00-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 20:33:00 kjcf05n03 RFSF-API[15289]: INFO[2024-11-04T20:33:00-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 20:33:00 kjcf05n03 dp-api-server-node[15289]: INFO[2024-11-04T20:33:00-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 20:33:00 kjcf05n03 RFSF-API[15289]: INFO[2024-11-04T20:33:00-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 20:33:00 kjcf05n03 dp-api-server-node[15289]: INFO[2024-11-04T20:33:00-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 20:33:05 kjcf05n03 systemd[1]: Reloading. Nov 4 20:33:05 kjcf05n03 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 4 20:33:05 kjcf05n03 systemd[1]: Reloading. Nov 4 20:33:05 kjcf05n03 systemd[1]: Starting Cluster Controlled lcnmon... Nov 4 20:33:05 kjcf05n03 diskmonitor_pre[15836]: Key management is currently disabled.DEAR disabled Nov 4 20:33:05 kjcf05n03 systemd[1]: Started Cluster Controlled diskmonitor. Nov 4 20:33:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730773985', 'host':'kjcf05n03', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 4 20:33:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730773985'} Nov 4 20:33:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:33:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730773985', 'host':'kjcf05n03', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 4 20:33:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730773985'} Nov 4 20:33:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:33:07 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31466 deleted. Nov 4 20:33:07 kjcf05n03 sh[15869]: LNET configured: New Created Nov 4 20:33:07 kjcf05n03 systemd[1]: Started Cluster Controlled lcnmon. Nov 4 20:33:07 kjcf05n03 LCNmon[17920]: Interface ib0 is up Nov 4 20:33:07 kjcf05n03 LCNmon[17920]: Interface ib1 is up Nov 4 20:33:07 kjcf05n03 LCNmon[17920]: Can ping through interface ib0 Nov 4 20:33:08 kjcf05n03 dcs-collectord[5662]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 20:33:08 kjcf05n03 dcs-collectord[5662]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 20:33:08 kjcf05n03 dcs-collectord[5662]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 20:33:08 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 17970 (bash) Nov 4 20:33:08 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 4 20:33:08 kjcf05n03 systemd[1]: Reached target Host and Network Name Lookups. Nov 4 20:33:08 kjcf05n03 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 4 20:33:08 kjcf05n03 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 4 20:33:08 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 4 20:33:08 kjcf05n03 LCNmon[17920]: Can ping through interface ib1 Nov 4 20:33:08 kjcf05n03 LCNmon[17920]: NIC ib0, initial state UP Nov 4 20:33:08 kjcf05n03 LCNmon[17920]: NIC ib1, initial state UP Nov 4 20:33:08 kjcf05n03 LCNmon[17920]: LCNstat initial state UP Nov 4 20:33:08 kjcf05n03 LCNmon[17920]: LCNmon monitoring hosts kjcf05n03 and kjcf05n02 Nov 4 20:33:08 kjcf05n00 mcfcli[3673891]: %3|1730773988.707|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: /var/run/diskmonitor does not exist, creating Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: Creating /var/run/diskmonitor/disk Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: Creating /var/run/diskmonitor/encl Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: Creating /var/run/diskmonitor/cli Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: RAS_Interlocks_enabled: 1 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: Using default ssd ids: HUSSL4010ASS600 , Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: add handler for sig: 14 sa_flags: 10000004 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: add handler for sig: 1 sa_flags: 10000004 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: add handler for sig: 2 sa_flags: 00000004 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: add handler for sig: 15 sa_flags: 00000004 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: add handler for sig: 6 sa_flags: 00000004 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: add handler for sig: 3 sa_flags: 00000004 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: add handler for sig: 30 sa_flags: 00000004 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: add handler for sig: 20 sa_flags: 00000004 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: add handler for sig: 10 sa_flags: 10000004 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: add handler for sig: 11 sa_flags: 00000004 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: add handler for sig: 7 sa_flags: 00000004 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: add handler for sig: 4 sa_flags: 00000004 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: add handler for sig: 8 sa_flags: 00000004 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: init_watch: /var/run/diskmonitor/encl initialized Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: init_watch: /var/run/diskmonitor/disk initialized Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: Using HA Baton locks - key: diskmonitor Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: Baton will be held for at most 570 seconds Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: DMMP Enabled: 0 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: random seed: 1daf1121 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: NVMe Enclosure: 1 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: ZFS Enclosure: 0 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: Dbus, Initialized Connection Successfully Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: int_catcher_thread: thread start Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: Received dbus message 4 org.freedesktop.DBus -> :1.98 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b07bec_S4EUNF0MA05386M encl_slot: 0 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b07bed_S4EUNF0MA05387D encl_slot: 0 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 4 20:33:10 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 20:33:10 kjcf05n00 httpd[1812018]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-B): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n03', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 4 20:33:11 kjcf05n03 systemd[1]: nodebootchecks.service: Succeeded. Nov 4 20:33:12 kjcf05n03 openhpid[5568]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 4 20:33:12 kjcf05n03 openhpid[5568]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 4 20:33:12 kjcf05n03 systemd[1]: openhpid.service: Succeeded. Nov 4 20:33:12 kjcf05n03 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 4 20:33:12 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 20:33:12 kjcf05n03 systemd[1]: openhpid.service: Supervising process 18497 which is not our child. We'll most likely not notice when it exits. Nov 4 20:33:12 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 20:33:12 kjcf05n03 systemd[1]: Reached target Multi-User System. Nov 4 20:33:12 kjcf05n03 systemd[1]: Reached target Graphical Interface. Nov 4 20:33:12 kjcf05n03 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 4 20:33:12 kjcf05n03 dcs-collectord[5662]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 4 20:33:12 kjcf05n03 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 4 20:33:12 kjcf05n03 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 4 20:33:12 kjcf05n03 systemd[1]: Startup finished in 50.541s (kernel) + 2min 28.273s (userspace) = 3min 18.814s. Nov 4 20:33:12 kjcf05n03 openhpid[18497]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 20:33:12 kjcf05n03 openhpid[18497]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 20:33:12 kjcf05n03 openhpid[18497]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 20:33:12 kjcf05n03 openhpid[18497]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 20:33:14 kjcf05n00 mcfcli[3673891]: %3|1730773994.504|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b07bed_S4EUNF0MA05387D encl_sn: USE26000024VS001, slot: 2 Nov 4 20:33:16 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 4 20:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730773999', 'host':'kjcf05n03', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 4 20:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730773999', 'host':'kjcf05n03', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 4 20:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730773999'} Nov 4 20:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730773999'} Nov 4 20:33:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:33:19 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 20:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730773999', 'host':'kjcf05n03', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.98, 1.94, 0.89'}"] Nov 4 20:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Load', 'description': 'OK - load average: 1.98, 1.94, 0.89', 'message': 'OK - load average: 1.98, 1.94, 0.89', 'value': 'ok', 'timestamp': '1730773999'} Nov 4 20:33:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730773999', 'host':'kjcf05n03', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 358 processes with STATE = RSZDT '}"] Nov 4 20:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Total Processes', 'description': 'PROCS OK: 358 processes with STATE = RSZDT ', 'message': 'PROCS OK: 358 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730773999'} Nov 4 20:33:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:33:23 kjcf05n03 dcs-collectord[5662]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 20:33:23 kjcf05n03 dcs-collectord[5662]: WARNING No data collected (hpi_parser.py:353) Nov 4 20:33:23 kjcf05n00 zabbix-server[2430676]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 20:33:23 kjcf05n00 zabbix-server[2430676]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 168.7\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 127.74\\"}}"' Nov 4 20:33:23 kjcf05n00 log_interesting_event.py[2430676]: Event '46651' acknowledged Nov 4 20:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T20:33:27.267616545-06:00 level=info msg="Completed cleanup jobs" duration=41.19322ms Nov 4 20:33:36 kjcf05n03 ipmievd[4002]: System Event sensor - Timestamp Clock Sync Nov 4 20:33:38 kjcf05n03 ipmievd[3195]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:33:38 kjcf05n03 dcs-collectord[5662]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 20:33:42 kjcf05n00 mcfcli[3673891]: %3|1730774022.535|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:33:44 kjcf05n00 mcfcli[3673891]: %3|1730774024.504|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b07bec_S4EUNF0MA05386M encl_sn: USE26000024VS001, slot: 1 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 4 20:33:48 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 4 20:33:53 kjcf05n03 dcs-collectord[5662]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 20:33:56 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '67c7379e-9b1e-11ef-b6e0-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 20:33:56 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '67c7379e-9b1e-11ef-b6e0-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 20:33:56 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '67c7379e-9b1e-11ef-b6e0-00093d069a1b', 'response ID': '67d22d98-9b1e-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 20:33:56 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 67d22d98-9b1e-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 20:33:56 kjcf05n02 firmware-update-orc-server[5878]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "a2f38802-d9e9-4ea4-ac69-507e3af6d345"} (logger.py:65) Nov 4 20:33:56 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 264339 (get_disk_device) Nov 4 20:33:56 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 4 20:33:56 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 4 20:33:56 kjcf05n02 ccp-client[264360]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 20:33:56 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db01026002538450000000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 20:33:56 kjcf05n03 ras-resource-manager-agent[5926]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "67c7379e-9b1e-11ef-b6e0-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 4 20:33:56 kjcf05n03 ras-resource-manager-agent[5926]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '67c7379e-9b1e-11ef-b6e0-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 4 20:33:56 kjcf05n03 ras-resource-manager-agent[5926]: INFO Submitting new device inserted signal, starting to qualify drive: 67c7379e-9b1e-11ef-b6e0-00093d069a1b (admin_action.py:110) Nov 4 20:33:57 kjcf05n02 ccp-client[264360]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 20:33:57 kjcf05n02 ccp-client[264374]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 20:33:57 kjcf05n02 ccp-client[264360]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 20:33:57 kjcf05n02 ccp-client[264374]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 20:33:57 kjcf05n02 ccp-client[264374]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 20:33:57 kjcf05n02 ccp-client[264360]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 20:33:57 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '68192e1e-9b1e-11ef-b6e0-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 20:33:57 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '68192e1e-9b1e-11ef-b6e0-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 20:33:57 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '68192e1e-9b1e-11ef-b6e0-00093d069a1b', 'response ID': '6820b8aa-9b1e-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 20:33:57 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 6820b8aa-9b1e-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 20:33:57 kjcf05n03 diskmonitor[17487]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 20:33:57 kjcf05n03 ras-resource-manager-agent[5926]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "68192e1e-9b1e-11ef-b6e0-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 4 20:33:57 kjcf05n03 ras-resource-manager-agent[5926]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '68192e1e-9b1e-11ef-b6e0-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 4 20:33:57 kjcf05n03 ras-resource-manager-agent[5926]: INFO Submitting new device inserted signal, starting to qualify drive: 68192e1e-9b1e-11ef-b6e0-00093d069a1b (admin_action.py:110) Nov 4 20:33:57 kjcf05n03 firmware-update-orc-server[5882]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "c9ca65e9-c796-4866-a2e8-4386a0903134"} (logger.py:65) Nov 4 20:34:00 kjcf05n02 DRVFW[264489]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 20:34:00 kjcf05n02 ccp-client[264490]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 20:34:00 kjcf05n02 ccp-client[264490]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 20:34:00 kjcf05n02 ccp-client[264517]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 20:34:00 kjcf05n02 ccp-client[264490]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 20:34:00 kjcf05n02 ccp-client[264490]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 20:34:00 kjcf05n02 ccp-client[264517]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 20:34:00 kjcf05n02 ccp-client[264517]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 20:34:00 kjcf05n02 firmware-update-orc-server[5878]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 4 20:34:01 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 67d22d98-9b1e-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 20:34:01 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '67c7379e-9b1e-11ef-b6e0-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': '67c7379e-9b1e-11ef-b6e0-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}}} (logger.py:65) Nov 4 20:34:01 kjcf05n03 ras-resource-manager-agent[5926]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '67c7379e-9b1e-11ef-b6e0-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 4 20:34:01 kjcf05n03 ras-resource-manager-agent[5926]: INFO Drive qualification complete responding: 67c7379e-9b1e-11ef-b6e0-00093d069a1b (admin_action.py:205) Nov 4 20:34:01 kjcf05n03 ras-resource-manager-agent[5926]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "67c7379e-9b1e-11ef-b6e0-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (interesting_event.py:59) Nov 4 20:34:03 kjcf05n03 diskmonitor[17487]: 4 Nov 4 20:34:03 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 4 20:34:03 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 4 20:34:03 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 4 20:34:03 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 4 20:34:03 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 4 20:34:03 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 4 20:34:03 kjcf05n03 diskmonitor[17487]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 4 20:34:03 kjcf05n03 diskmonitor[17487]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 4 20:34:03 kjcf05n03 diskmonitor[17487]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 4 20:34:03 kjcf05n03 diskmonitor[17487]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 20:34:03 kjcf05n03 diskmonitor[17487]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 4 20:34:03 kjcf05n03 diskmonitor[17487]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "67c7379e-9b1e-11ef-b6e0-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 4 20:34:03 kjcf05n03 diskmonitor[17487]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 20:34:03 kjcf05n03 diskmonitor[17487]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 4 20:34:03 kjcf05n03 diskmonitor[17487]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "68192e1e-9b1e-11ef-b6e0-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 4 20:34:03 kjcf05n03 diskmonitor[17487]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 20:34:03 kjcf05n03 diskmonitor[17487]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 20:34:03 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 4 20:34:07 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31467 deleted. Nov 4 20:34:08 kjcf05n03 systemd[1]: Unmounting /mnt/llog... Nov 4 20:34:08 kjcf05n03 systemd[1]: mnt-llog.mount: Succeeded. Nov 4 20:34:08 kjcf05n03 systemd[1]: Unmounted /mnt/llog. Nov 4 20:34:09 kjcf05n03 chronyd[5170]: Selected source 172.16.2.1 Nov 4 20:34:10 kjcf05n03 ras-resource-manager-agent[5926]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "67c7379e-9b1e-11ef-b6e0-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (service_main_handler.py:66) Nov 4 20:34:10 kjcf05n03 ras-resource-manager-agent[5926]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '67c7379e-9b1e-11ef-b6e0-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 4 20:34:10 kjcf05n03 ras-resource-manager-agent[5926]: INFO Device qualification response has been acknowledged: 67c7379e-9b1e-11ef-b6e0-00093d069a1b (admin_action.py:151) Nov 4 20:34:12 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22541 (get_disk_device) Nov 4 20:34:12 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 4 20:34:12 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 4 20:34:12 kjcf05n03 ccp-client[22581]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 20:34:12 kjcf05n03 ccp-client[22581]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 20:34:12 kjcf05n03 ccp-client[22632]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 20:34:12 kjcf05n03 ccp-client[22581]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 20:34:12 kjcf05n03 ccp-client[22632]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 20:34:12 kjcf05n03 ccp-client[22632]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 20:34:12 kjcf05n03 ccp-client[22581]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 20:34:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730774052}"] Nov 4 20:34:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730774052, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:34:12 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:34:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730774052}"] Nov 4 20:34:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730774052, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:34:12 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:34:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730774052}"] Nov 4 20:34:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730774052, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:34:12 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:34:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730774052}"] Nov 4 20:34:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730774052, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:34:12 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:34:13 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730774052}"] Nov 4 20:34:13 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730774052, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:34:13 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:34:13 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730774052}"] Nov 4 20:34:13 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730774052, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:34:13 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:34:13 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730774052}"] Nov 4 20:34:13 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730774052, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:34:13 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:34:13 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730774052}"] Nov 4 20:34:13 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730774052, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:34:13 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:34:14 kjcf05n03 diskmonitor[17487]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 20:34:14 kjcf05n00 mcfcli[3673891]: %3|1730774054.504|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 20:34:15 kjcf05n03 diskmonitor[17487]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 20:34:15 kjcf05n03 ras-resource-manager-agent[5926]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "72e6b0b4-9b1e-11ef-b6e0-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 4 20:34:15 kjcf05n03 ras-resource-manager-agent[5926]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '72e6b0b4-9b1e-11ef-b6e0-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 4 20:34:15 kjcf05n03 ras-resource-manager-agent[5926]: INFO Requests ['68192e1e-9b1e-11ef-b6e0-00093d069a1b', '72e6b0b4-9b1e-11ef-b6e0-00093d069a1b'] already in progress (admin_action.py:99) Nov 4 20:34:15 kjcf05n03 DRVFW[23756]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 20:34:15 kjcf05n03 ccp-client[23759]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 20:34:15 kjcf05n03 ccp-client[23759]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 20:34:15 kjcf05n03 ccp-client[23788]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 20:34:15 kjcf05n03 ccp-client[23759]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 20:34:15 kjcf05n03 ccp-client[23759]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 20:34:15 kjcf05n03 ccp-client[23788]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 20:34:15 kjcf05n03 ccp-client[23788]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 20:34:15 kjcf05n03 firmware-update-orc-server[5882]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 4 20:34:16 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 6820b8aa-9b1e-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 20:34:16 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '68192e1e-9b1e-11ef-b6e0-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': '68192e1e-9b1e-11ef-b6e0-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}}} (logger.py:65) Nov 4 20:34:16 kjcf05n03 python3.9[5232]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 4 20:34:16 kjcf05n03 python3.9[3195]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:34:16 kjcf05n03 ras-resource-manager-agent[5926]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '68192e1e-9b1e-11ef-b6e0-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}} (resource_admin.py:98) Nov 4 20:34:16 kjcf05n03 ras-resource-manager-agent[5926]: INFO Drive qualification complete responding: 68192e1e-9b1e-11ef-b6e0-00093d069a1b (admin_action.py:205) Nov 4 20:34:16 kjcf05n03 ras-resource-manager-agent[5926]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "68192e1e-9b1e-11ef-b6e0-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (interesting_event.py:59) Nov 4 20:34:16 kjcf05n03 ras-resource-manager-agent[5926]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "72e6b0b4-9b1e-11ef-b6e0-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (interesting_event.py:59) Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "67c7379e-9b1e-11ef-b6e0-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: Dbus, handle_ingress_ras_signals, uuid: 67c7379e-9b1e-11ef-b6e0-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "67c7379e-9b1e-11ef-b6e0-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: main: Pending firmware leveling requests exist, rescanning disks Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "72e6b0b4-9b1e-11ef-b6e0-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: leaving test state: 1 next state: 2 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: lock req: no timeout Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: leaving test state: 2 next state: 4 Nov 4 20:34:19 kjcf05n03 diskmonitor[17487]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 20:34:20 kjcf05n00 mcfcli[3673891]: %3|1730774060.258|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:34:44 kjcf05n00 mcfcli[3673891]: %3|1730774084.504|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:34:59 kjcf05n00 mcfcli[3673891]: %3|1730774099.334|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:35:14 kjcf05n00 mcfcli[3673891]: %3|1730774114.504|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:35:15 kjcf05n03 ras-resource-manager-agent[5926]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "68192e1e-9b1e-11ef-b6e0-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (service_main_handler.py:66) Nov 4 20:35:15 kjcf05n03 ras-resource-manager-agent[5926]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '68192e1e-9b1e-11ef-b6e0-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}} (resource_admin.py:98) Nov 4 20:35:15 kjcf05n03 ras-resource-manager-agent[5926]: INFO Device qualification response has been acknowledged: 68192e1e-9b1e-11ef-b6e0-00093d069a1b (admin_action.py:151) Nov 4 20:35:15 kjcf05n03 ras-resource-manager-agent[5926]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "72e6b0b4-9b1e-11ef-b6e0-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} (service_main_handler.py:66) Nov 4 20:35:15 kjcf05n03 ras-resource-manager-agent[5926]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '72e6b0b4-9b1e-11ef-b6e0-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 18}}} (resource_admin.py:98) Nov 4 20:35:15 kjcf05n03 ras-resource-manager-agent[5926]: INFO Device qualification response has been acknowledged: 72e6b0b4-9b1e-11ef-b6e0-00093d069a1b (admin_action.py:151) Nov 4 20:35:16 kjcf05n03 diskmonitor[17487]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 20:35:17 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 4 20:35:17 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 20:35:17 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 4 20:35:33 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 4 20:35:33 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 20:35:33 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 4 20:35:33 kjcf05n03 dcs-collectord[5662]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 4 20:35:33 kjcf05n03 diskmonitor[17487]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "68192e1e-9b1e-11ef-b6e0-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 4 20:35:33 kjcf05n03 diskmonitor[17487]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 4 20:35:33 kjcf05n03 diskmonitor[17487]: Dbus, handle_ingress_ras_signals, uuid: 68192e1e-9b1e-11ef-b6e0-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 4 20:35:33 kjcf05n03 diskmonitor[17487]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 20:35:33 kjcf05n03 diskmonitor[17487]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "68192e1e-9b1e-11ef-b6e0-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 4 20:35:33 kjcf05n03 diskmonitor[17487]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "72e6b0b4-9b1e-11ef-b6e0-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 4 20:35:33 kjcf05n03 diskmonitor[17487]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 4 20:35:33 kjcf05n03 diskmonitor[17487]: Dbus, handle_ingress_ras_signals, uuid: 72e6b0b4-9b1e-11ef-b6e0-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 4 20:35:33 kjcf05n03 diskmonitor[17487]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "72e6b0b4-9b1e-11ef-b6e0-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 18}}} Nov 4 20:35:33 kjcf05n03 diskmonitor[17487]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 20:35:33 kjcf05n03 diskmonitor[17487]: lock acquired Nov 4 20:35:33 kjcf05n03 diskmonitor[17487]: leaving test state: 4 next state: 8 Nov 4 20:35:33 kjcf05n03 diskmonitor[17487]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 20:35:36 kjcf05n00 python3.9[2432027]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 20:35:38 kjcf05n00 mcfcli[3673891]: %3|1730774138.888|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:35:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730774142}"] Nov 4 20:35:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730774142, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:35:42 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:35:42-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:35:42 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:35:42-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:35:42 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:35:42-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:35:42 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:35:42-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:35:42 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:35:42-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:35:42 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:35:42-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:35:42 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:35:42-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.169754ms Nov 4 20:35:42 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:35:42-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.169754ms Nov 4 20:35:42 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:35:42 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:35:42 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:35:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Inactive', 'timestamp': 1730774142}"] Nov 4 20:35:42 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730774142, 'value': 'Inactive', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:35:42 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:35:42-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:35:42 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:35:42-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:35:42 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:35:42-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:35:42 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:35:42-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:35:42 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:35:42-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:35:42 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:35:42-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:35:42 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:35:42-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.134568ms Nov 4 20:35:42 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:35:42-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.134568ms Nov 4 20:35:42 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:35:42 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:35:44 kjcf05n00 mcfcli[3673891]: %3|1730774144.505|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 20:35:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730773850', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 20:35:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730773850'} Nov 4 20:35:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:35:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730773850', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 20:35:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730773850'} Nov 4 20:35:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:35:53 kjcf05n03 diskmonitor[17487]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 4 20:35:53 kjcf05n03 diskmonitor[17487]: leaving test state: 8 next state: 20 Nov 4 20:35:53 kjcf05n03 diskmonitor[17487]: leaving test state: 20 next state: 40 Nov 4 20:35:53 kjcf05n03 diskmonitor[17487]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 11fe3eb0000 Nov 4 20:35:53 kjcf05n03 diskmonitor[17487]: leaving test state: 40 next state: 80 Nov 4 20:36:14 kjcf05n00 mcfcli[3673891]: %3|1730774174.505|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:36:18 kjcf05n00 mcfcli[3673891]: %3|1730774178.885|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:36:20 kjcf05n00 zabbix-server[2432625]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 20:36:20 kjcf05n00 zabbix-server[2432625]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n03' from event '46656' Nov 4 20:36:21 kjcf05n00 zabbix-server[2432625]: Host created 'enclosure_USE26000024VS001' Nov 4 20:36:21 kjcf05n00 zabbix-server[2432625]: Running puppet on 'kjcf05n03' Nov 4 20:36:23 kjcf05n03 puppet-agent[28772]: Using configured environment 'production' Nov 4 20:36:23 kjcf05n03 puppet-agent[28772]: Retrieving pluginfacts Nov 4 20:36:23 kjcf05n03 puppet-agent[28772]: Retrieving plugin Nov 4 20:36:23 kjcf05n03 puppet-agent[28772]: Loading facts Nov 4 20:36:26 kjcf05n03 puppet-agent[28772]: Caching catalog for kjcf05n03 Nov 4 20:36:26 kjcf05n03 puppet-agent[28772]: Applying configuration version '1730774184' Nov 4 20:36:28 kjcf05n03 puppet-agent[28772]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 20:36:28 kjcf05n03 puppet-agent[28772]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 20:36:28 kjcf05n03 puppet-agent[28772]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 20:36:28 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 4 20:36:28 kjcf05n03 zabbix_agent2[6010]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 20:36:28 kjcf05n03 zabbix_agent2[3195]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:36:28 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 20:36:28 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 4 20:36:28 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 4 20:36:28 kjcf05n03 puppet-agent[28772]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: Press Ctrl+C to exit. Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: Plugin support version 1.0 Nov 4 20:36:28 kjcf05n03 zabbix_agent2[29119]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 20:36:30 kjcf05n03 puppet-agent[28772]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 20:36:30 kjcf05n03 puppet-agent[28772]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 20:36:30 kjcf05n03 puppet-agent[28772]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 20:36:31 kjcf05n00 zabbix-server[2432625]: puppet completed status:(0): '' Nov 4 20:36:31 kjcf05n00 zabbix-server[2432625]: Event '46656' acknowledged Nov 4 20:36:31 kjcf05n00 zabbix-server[2432625]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n03"}' Nov 4 20:36:31 kjcf05n03 puppet-agent[28772]: Applied catalog in 5.16 seconds Nov 4 20:36:38 kjcf05n03 diskmonitor[17487]: leaving test state: 80 next state: 100 Nov 4 20:36:38 kjcf05n03 diskmonitor[17487]: lock release: time: Mon Nov 4 20:36:32 2024 Nov 4 20:36:38 kjcf05n03 diskmonitor[17487]: leaving test state: 100 next state: 1 Nov 4 20:36:44 kjcf05n00 mcfcli[3673891]: %3|1730774204.506|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:36:58 kjcf05n00 mcfcli[3673891]: %3|1730774218.161|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:37:14 kjcf05n00 mcfcli[3673891]: %3|1730774234.506|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:37:37 kjcf05n00 mcfcli[3673891]: %3|1730774257.251|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:37:44 kjcf05n00 mcfcli[3673891]: %3|1730774264.506|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:38:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730774292}"] Nov 4 20:38:12 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730774292, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:38:12 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:38:12-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:38:12 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:38:12-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:38:12 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:38:12-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:38:12 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:38:12-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:38:12 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:38:12-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:38:12 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:38:12-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:38:12 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:38:12-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.241708ms Nov 4 20:38:12 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:38:12-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.241708ms Nov 4 20:38:12 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:38:12 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:38:12 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:38:14 kjcf05n00 mcfcli[3673891]: %3|1730774294.506|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:38:17 kjcf05n00 mcfcli[3673891]: %3|1730774297.248|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:38:44 kjcf05n00 mcfcli[3673891]: %3|1730774324.507|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:38:56 kjcf05n00 mcfcli[3673891]: %3|1730774336.442|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:39:04 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 4 20:39:14 kjcf05n00 mcfcli[3673891]: %3|1730774354.507|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:39:36 kjcf05n00 mcfcli[3673891]: %3|1730774376.439|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:39:44 kjcf05n00 mcfcli[3673891]: %3|1730774384.507|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 20:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 20:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 20:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 20:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 20:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 20:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 20:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 20:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 20:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 20:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 20:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 20:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 20:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 20:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 20:40:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 20:40:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:40:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 20:40:12 kjcf05n00 mcfcli[3673891]: %3|1730774412.263|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:40:15 kjcf05n00 mcfcli[3673891]: %3|1730774415.007|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 20:40:37 kjcf05n00 python3.9[2434939]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 20:40:45 kjcf05n00 mcfcli[3673891]: %3|1730774445.007|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 20:40:52 kjcf05n00 mcfcli[3673891]: %3|1730774452.260|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:40:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730773850', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 20:40:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730773850'} Nov 4 20:40:59 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:40:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730773850', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 20:40:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730773850'} Nov 4 20:40:59 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:41:15 kjcf05n00 mcfcli[3673891]: %3|1730774475.008|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:41:32 kjcf05n00 mcfcli[3673891]: %3|1730774492.257|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:41:45 kjcf05n00 mcfcli[3673891]: %3|1730774505.073|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 20:42:10 kjcf05n00 mcfcli[3673891]: %3|1730774530.014|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:42:15 kjcf05n00 mcfcli[3673891]: %3|1730774535.073|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 20:42:45 kjcf05n00 mcfcli[3673891]: %3|1730774565.073|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 20:42:45 kjcf05n00 mcfcli[3673891]: %3|1730774565.521|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:43:15 kjcf05n00 mcfcli[3673891]: %3|1730774595.510|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 20:43:24 kjcf05n00 mcfcli[3673891]: %3|1730774604.307|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T20:43:27.268432315-06:00 level=info msg="Completed cleanup jobs" duration=41.532053ms Nov 4 20:43:34 kjcf05n02 nslcd[6957]: [a7c4c9] ldap_result() failed: Can't contact LDAP server Nov 4 20:43:34 kjcf05n02 nslcd[6957]: [68079a] ldap_result() failed: Can't contact LDAP server Nov 4 20:43:42 kjcf05n03 root[41333]: failback_xyraid Nov 4 20:43:43 kjcf05n03 root[41466]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 4 20:43:44 kjcf05n03 root[41537]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 4 20:43:45 kjcf05n00 mcfcli[3673891]: %3|1730774625.510|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:43:49 kjcf05n02 systemd[1]: data-kjcf05n03:md66.mount: Succeeded. Nov 4 20:43:52 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme10n1 Nov 4 20:43:52 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme7n1 Nov 4 20:43:52 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme20n1 Nov 4 20:43:52 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme16n1 Nov 4 20:43:52 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme22n1 Nov 4 20:43:52 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme5n1 Nov 4 20:43:52 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme11n1 Nov 4 20:43:52 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme12n1 Nov 4 20:43:52 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme15n1 Nov 4 20:43:52 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme21n1 Nov 4 20:43:52 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme6n1 Nov 4 20:43:54 kjcf05n03 dwd[5203]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 4 20:43:54 kjcf05n03 dwd[5203]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 4 20:43:54 kjcf05n03 dwd[5203]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 4 20:43:54 kjcf05n03 dwd[5203]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 4 20:43:54 kjcf05n03 dwd[5203]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 4 20:43:54 kjcf05n03 dwd[5203]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 4 20:43:54 kjcf05n03 dwd[5203]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 4 20:43:54 kjcf05n03 dwd[5203]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 4 20:43:54 kjcf05n03 dwd[5203]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 4 20:43:54 kjcf05n03 dwd[5203]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 4 20:43:54 kjcf05n03 dwd[5203]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 4 20:43:54 kjcf05n03 dwd[5203]: Starting NVME thread for nvme10n1 Nov 4 20:43:54 kjcf05n03 dwd[5203]: Starting NVME thread for nvme15n1 Nov 4 20:43:54 kjcf05n03 dwd[5203]: Starting NVME thread for nvme21n1 Nov 4 20:43:55 kjcf05n03 dwd[5203]: Starting NVME thread for nvme11n1 Nov 4 20:43:55 kjcf05n03 dcs-bulk-data-sender[6216]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 139}' Nov 4 20:43:55 kjcf05n03 dwd[5203]: Starting NVME thread for nvme20n1 Nov 4 20:43:55 kjcf05n03 systemd-udevd[44313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44318]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44318]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44318]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44318]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44318]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44318]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44313]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44318]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44318]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44351]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44353]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44355]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44357]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44351]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44353]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44355]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44357]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44351]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44353]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44357]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44351]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44357]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44351]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44353]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44357]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44351]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44357]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44351]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44357]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44351]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44357]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44357]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44351]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44357]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44351]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 dwd[5203]: Starting NVME thread for nvme12n1 Nov 4 20:43:55 kjcf05n03 systemd-udevd[44357]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44351]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44357]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44357]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44357]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:43:55 kjcf05n03 systemd-udevd[44357]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:43:56 kjcf05n03 dwd[5203]: Starting NVME thread for nvme7n1 Nov 4 20:43:56 kjcf05n03 dwd[5203]: Starting NVME thread for nvme6n1 Nov 4 20:43:56 kjcf05n03 dwd[5203]: Starting NVME thread for nvme5n1 Nov 4 20:43:56 kjcf05n03 dwd[5203]: Starting NVME thread for nvme16n1 Nov 4 20:43:56 kjcf05n03 dwd[5203]: Starting NVME thread for nvme22n1 Nov 4 20:43:57 kjcf05n03 nslcd[6958]: [8b4567] (re)loading /etc/nsswitch.conf Nov 4 20:44:01 kjcf05n03 diskmonitor[17487]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 4 20:44:02 kjcf05n00 mcfcli[3673891]: %3|1730774642.957|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:44:11 kjcf05n03 diskmonitor[17487]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 4 20:44:11 kjcf05n03 diskmonitor[17487]: Scan for ReadErrorMax change for md66 Nov 4 20:44:11 kjcf05n03 diskmonitor[17487]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 4 20:44:11 kjcf05n03 diskmonitor[17487]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 4 20:44:11 kjcf05n03 diskmonitor[17487]: read_saved_file: md66 no saved speed Nov 4 20:44:11 kjcf05n03 diskmonitor[17487]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 4 20:44:11 kjcf05n03 diskmonitor[17487]: Set sync_speed_min (10000) for md66 Nov 4 20:44:11 kjcf05n03 diskmonitor[17487]: Set sync_speed_max (200000) for md66 Nov 4 20:44:11 kjcf05n03 diskmonitor[17487]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 20:44:15 kjcf05n00 mcfcli[3673891]: %3|1730774655.510|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:44:37 kjcf05n02 diskmonitor[17558]: Removed MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 4 20:44:37 kjcf05n02 diskmonitor[17558]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 20:44:39 kjcf05n00 mcfcli[3673891]: %3|1730774679.032|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:44:45 kjcf05n00 mcfcli[3673891]: %3|1730774685.510|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 20:44:51 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47281 (bash) Nov 4 20:44:51 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 4 20:44:51 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 4 20:44:54 kjcf05n03 systemd[1]: Starting Cleanup of Temporary Directories... Nov 4 20:44:54 kjcf05n03 systemd-tmpfiles[47493]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 20:44:54 kjcf05n03 systemd-tmpfiles[47493]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 20:44:54 kjcf05n03 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 4 20:44:54 kjcf05n03 systemd[1]: Started Cleanup of Temporary Directories. Nov 4 20:45:15 kjcf05n00 mcfcli[3673891]: %3|1730774715.510|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 20:45:18 kjcf05n00 mcfcli[3673891]: %3|1730774718.064|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:45:37 kjcf05n00 python3.9[2437908]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 20:45:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730774742}"] Nov 4 20:45:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730774742, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:45:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.297593ms Nov 4 20:45:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.297593ms Nov 4 20:45:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:45:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:45:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:45:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730774742}"] Nov 4 20:45:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730774742, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:45:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.470447ms Nov 4 20:45:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.470447ms Nov 4 20:45:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:45:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:45:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:45:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730774742}"] Nov 4 20:45:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730774742, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:45:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.236249ms Nov 4 20:45:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.236249ms Nov 4 20:45:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:45:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:45:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:45:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730774743}"] Nov 4 20:45:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730774743, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:45:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.326657ms Nov 4 20:45:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.326657ms Nov 4 20:45:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:45:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:45:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:45:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730774743}"] Nov 4 20:45:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730774743, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:45:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.06095ms Nov 4 20:45:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.06095ms Nov 4 20:45:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:45:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:45:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:45:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730774743}"] Nov 4 20:45:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730774743, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:45:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.611979ms Nov 4 20:45:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.611979ms Nov 4 20:45:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:45:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:45:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:45:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730774743}"] Nov 4 20:45:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730774743, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:45:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:43-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:43 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:43-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:43 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:43-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:43 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.585923ms Nov 4 20:45:43 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:43-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.585923ms Nov 4 20:45:43 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:45:43 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:45:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:45:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730774743}"] Nov 4 20:45:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730774743, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:45:44 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:44-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:44 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:44-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:44 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:44-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:44 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:44-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:44 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:44-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:44 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:44-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:44 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:44-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.091097ms Nov 4 20:45:44 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:44-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.091097ms Nov 4 20:45:44 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:45:44 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:45:44 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:45:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730774743}"] Nov 4 20:45:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730774743, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:45:44 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:44-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:44 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:44-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:44 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:44-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:44 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:44-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:44 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:44-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:44 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:44-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:44 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:44-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.01319ms Nov 4 20:45:44 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:44-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.01319ms Nov 4 20:45:44 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:45:44 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:45:44 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:45:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730774743}"] Nov 4 20:45:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730774743, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:45:44 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:44-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:44 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:44-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:44 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:44-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:44 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:44-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:44 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:44-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:44 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:44-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:44 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:44-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.183679ms Nov 4 20:45:44 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:44-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.183679ms Nov 4 20:45:44 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:45:44 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:45:44 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:45:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730774743}"] Nov 4 20:45:44 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730774743, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 20:45:44 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:44-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:44 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:44-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 20:45:44 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:44-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:44 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T20:45:44-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:44 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:44-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 20:45:44 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T20:45:44-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 20:45:44 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T20:45:44-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.909957ms Nov 4 20:45:44 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T20:45:44-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.909957ms Nov 4 20:45:44 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:20:45:44 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 20:45:44 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:45:45 kjcf05n00 mcfcli[3673891]: %3|1730774745.511|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 20:45:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730774750', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 4 20:45:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730774750'} Nov 4 20:45:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:45:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730774750', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 4 20:45:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730774750'} Nov 4 20:45:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 20:45:58 kjcf05n00 mcfcli[3673891]: %3|1730774758.061|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:46:15 kjcf05n00 mcfcli[3673891]: %3|1730774775.511|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 20:46:35 kjcf05n00 mcfcli[3673891]: %3|1730774795.120|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:46:45 kjcf05n00 mcfcli[3673891]: %3|1730774805.511|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 20:47:10 kjcf05n00 mcfcli[3673891]: %3|1730774830.295|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:47:15 kjcf05n00 mcfcli[3673891]: %3|1730774835.511|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:47:45 kjcf05n00 mcfcli[3673891]: %3|1730774865.512|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:47:47 kjcf05n00 mcfcli[3673891]: %3|1730774867.565|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:48:15 kjcf05n00 mcfcli[3673891]: %3|1730774895.512|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:48:26 kjcf05n00 mcfcli[3673891]: %3|1730774906.131|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:48:45 kjcf05n00 mcfcli[3673891]: %3|1730774925.512|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:49:04 kjcf05n00 mcfcli[3673891]: %3|1730774944.540|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:49:09 kjcf05n03 dwd[5203]: nvme10n1 passed periodic SMART status check Nov 4 20:49:09 kjcf05n03 dwd[5203]: nvme15n1 passed periodic SMART status check Nov 4 20:49:09 kjcf05n03 dwd[5203]: nvme21n1 passed periodic SMART status check Nov 4 20:49:09 kjcf05n03 dwd[5203]: nvme11n1 passed periodic SMART status check Nov 4 20:49:10 kjcf05n03 dwd[5203]: nvme20n1 passed periodic SMART status check Nov 4 20:49:10 kjcf05n03 dwd[5203]: nvme7n1 passed periodic SMART status check Nov 4 20:49:10 kjcf05n03 dwd[5203]: nvme12n1 passed periodic SMART status check Nov 4 20:49:11 kjcf05n03 dwd[5203]: nvme16n1 passed periodic SMART status check Nov 4 20:49:11 kjcf05n03 dwd[5203]: nvme22n1 passed periodic SMART status check Nov 4 20:49:11 kjcf05n03 dwd[5203]: nvme6n1 passed periodic SMART status check Nov 4 20:49:11 kjcf05n03 dwd[5203]: nvme5n1 passed periodic SMART status check Nov 4 20:49:15 kjcf05n00 mcfcli[3673891]: %3|1730774955.512|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:49:23 kjcf05n00 zabbix-server[2440163]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 20:49:23 kjcf05n00 zabbix-server[2440163]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 317.7\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 122.33\\"}}"' Nov 4 20:49:23 kjcf05n00 log_interesting_event.py[2440163]: Event '46660' acknowledged Nov 4 20:49:23 kjcf05n00 zabbix-server[2440191]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 20:49:23 kjcf05n00 zabbix-server[2440191]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n03' from event '46659' Nov 4 20:49:23 kjcf05n00 zabbix-server[2440191]: Filesystem 'kjcf05' has been mounted Nov 4 20:49:24 kjcf05n00 zabbix-server[2440191]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 4 20:49:24 kjcf05n00 zabbix-server[2440191]: Running puppet on 'None' Nov 4 20:49:26 kjcf05n03 puppet-agent[55220]: Using configured environment 'production' Nov 4 20:49:26 kjcf05n03 puppet-agent[55220]: Retrieving pluginfacts Nov 4 20:49:26 kjcf05n03 puppet-agent[55220]: Retrieving plugin Nov 4 20:49:26 kjcf05n02 puppet-agent[292601]: Using configured environment 'production' Nov 4 20:49:26 kjcf05n02 puppet-agent[292601]: Retrieving pluginfacts Nov 4 20:49:26 kjcf05n02 puppet-agent[292601]: Retrieving plugin Nov 4 20:49:26 kjcf05n05 puppet-agent[2495264]: Using configured environment 'production' Nov 4 20:49:26 kjcf05n05 puppet-agent[2495264]: Retrieving pluginfacts Nov 4 20:49:26 kjcf05n05 puppet-agent[2495264]: Retrieving plugin Nov 4 20:49:26 kjcf05n06 puppet-agent[2307595]: Using configured environment 'production' Nov 4 20:49:26 kjcf05n06 puppet-agent[2307595]: Retrieving pluginfacts Nov 4 20:49:26 kjcf05n06 puppet-agent[2307595]: Retrieving plugin Nov 4 20:49:26 kjcf05n06 puppet-agent[2307595]: Loading facts Nov 4 20:49:26 kjcf05n04 puppet-agent[2290746]: Using configured environment 'production' Nov 4 20:49:26 kjcf05n04 puppet-agent[2290746]: Retrieving pluginfacts Nov 4 20:49:26 kjcf05n04 puppet-agent[2290746]: Retrieving plugin Nov 4 20:49:26 kjcf05n07 puppet-agent[2310830]: Using configured environment 'production' Nov 4 20:49:26 kjcf05n07 puppet-agent[2310830]: Retrieving pluginfacts Nov 4 20:49:26 kjcf05n07 puppet-agent[2310830]: Retrieving plugin Nov 4 20:49:26 kjcf05n07 puppet-agent[2310830]: Loading facts Nov 4 20:49:27 kjcf05n03 puppet-agent[55220]: Loading facts Nov 4 20:49:27 kjcf05n02 puppet-agent[292601]: Loading facts Nov 4 20:49:27 kjcf05n05 puppet-agent[2495264]: Loading facts Nov 4 20:49:27 kjcf05n01 puppet-agent[3891175]: Using configured environment 'production' Nov 4 20:49:27 kjcf05n01 puppet-agent[3891175]: Retrieving pluginfacts Nov 4 20:49:27 kjcf05n01 puppet-agent[3891175]: Retrieving plugin Nov 4 20:49:27 kjcf05n01 puppet-agent[3891175]: Loading facts Nov 4 20:49:27 kjcf05n04 puppet-agent[2290746]: Loading facts Nov 4 20:49:27 kjcf05n00 puppet-agent[2440359]: Using configured environment 'production' Nov 4 20:49:27 kjcf05n00 puppet-agent[2440359]: Retrieving pluginfacts Nov 4 20:49:27 kjcf05n00 puppet-agent[2440359]: Retrieving plugin Nov 4 20:49:27 kjcf05n00 puppet-agent[2440359]: Loading facts Nov 4 20:49:29 kjcf05n03 puppet-agent[55220]: Caching catalog for kjcf05n03 Nov 4 20:49:29 kjcf05n03 puppet-agent[55220]: Applying configuration version '1730774968' Nov 4 20:49:29 kjcf05n02 puppet-agent[292601]: Caching catalog for kjcf05n02 Nov 4 20:49:29 kjcf05n02 puppet-agent[292601]: Applying configuration version '1730774968' Nov 4 20:49:29 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 4 20:49:29 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 4 20:49:30 kjcf05n06 puppet-agent[2307595]: Caching catalog for kjcf05n06 Nov 4 20:49:30 kjcf05n06 puppet-agent[2307595]: Applying configuration version '1730774968' Nov 4 20:49:30 kjcf05n07 puppet-agent[2310830]: Caching catalog for kjcf05n07 Nov 4 20:49:30 kjcf05n07 puppet-agent[2310830]: Applying configuration version '1730774968' Nov 4 20:49:31 kjcf05n01 puppet-agent[3891175]: Caching catalog for kjcf05n01 Nov 4 20:49:31 kjcf05n00 puppet-agent[2440359]: Caching catalog for kjcf05n00 Nov 4 20:49:31 kjcf05n00 puppet-agent[2440359]: Applying configuration version '1730774969' Nov 4 20:49:31 kjcf05n03 puppet-agent[55220]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 20:49:31 kjcf05n03 puppet-agent[55220]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 20:49:31 kjcf05n03 puppet-agent[55220]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 20:49:31 kjcf05n01 puppet-agent[3891175]: Applying configuration version '1730774968' Nov 4 20:49:31 kjcf05n02 puppet-agent[292601]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 20:49:31 kjcf05n02 puppet-agent[292601]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 20:49:31 kjcf05n02 puppet-agent[292601]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 20:49:32 kjcf05n06 puppet-agent[2307595]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 20:49:32 kjcf05n06 puppet-agent[2307595]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 20:49:32 kjcf05n06 puppet-agent[2307595]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 20:49:32 kjcf05n07 puppet-agent[2310830]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 20:49:32 kjcf05n07 puppet-agent[2310830]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 20:49:32 kjcf05n07 puppet-agent[2310830]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 20:49:32 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 4 20:49:32 kjcf05n03 zabbix_agent2[29119]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 20:49:32 kjcf05n03 zabbix_agent2[3195]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 20:49:32 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 20:49:32 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 4 20:49:32 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 4 20:49:32 kjcf05n03 puppet-agent[55220]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: Press Ctrl+C to exit. Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: Plugin support version 1.0 Nov 4 20:49:32 kjcf05n03 zabbix_agent2[55572]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 20:49:32 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 4 20:49:32 kjcf05n02 zabbix_agent2[234001]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 20:49:32 kjcf05n02 zabbix_agent2[3190]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 20:49:32 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 20:49:32 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 4 20:49:32 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 20:49:32 kjcf05n02 puppet-agent[292601]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: Press Ctrl+C to exit. Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: Plugin support version 1.0 Nov 4 20:49:32 kjcf05n02 zabbix_agent2[293112]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 20:49:32 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2254747]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 20:49:32 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 4 20:49:32 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 20:49:32 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 4 20:49:32 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 4 20:49:32 kjcf05n06 puppet-agent[2307595]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: Press Ctrl+C to exit. Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: Plugin support version 1.0 Nov 4 20:49:32 kjcf05n06 zabbix_agent2[2308149]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 20:49:32 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2258708]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 20:49:32 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 4 20:49:32 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 20:49:32 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 4 20:49:32 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 4 20:49:32 kjcf05n07 puppet-agent[2310830]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: Press Ctrl+C to exit. Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: Plugin support version 1.0 Nov 4 20:49:32 kjcf05n07 zabbix_agent2[2311704]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 20:49:32 kjcf05n00 zabbix_server[15748]: Zabbix agent item "system.cpu.util[,guest_nice]" on host "kjcf05n07" failed: first network error, wait for 15 seconds Nov 4 20:49:33 kjcf05n00 puppet-agent[2440359]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 20:49:34 kjcf05n03 puppet-agent[55220]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 20:49:34 kjcf05n03 puppet-agent[55220]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 20:49:34 kjcf05n03 puppet-agent[55220]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 20:49:34 kjcf05n03 puppet-agent[55220]: Applied catalog in 5.06 seconds Nov 4 20:49:34 kjcf05n02 puppet-agent[292601]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 20:49:34 kjcf05n02 puppet-agent[292601]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 20:49:34 kjcf05n02 puppet-agent[292601]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 20:49:34 kjcf05n06 puppet-agent[2307595]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 20:49:34 kjcf05n06 puppet-agent[2307595]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 20:49:34 kjcf05n06 puppet-agent[2307595]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 20:49:34 kjcf05n01 puppet-agent[3891175]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 20:49:34 kjcf05n01 puppet-agent[3891175]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-20:25:49]/mode) mode changed '0755' to '0750' Nov 4 20:49:34 kjcf05n01 puppet-agent[3891175]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-20:25:49/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 4 20:49:34 kjcf05n01 puppet-agent[3891175]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-20:25:49/vmcore]/mode) mode changed '0600' to '0640' Nov 4 20:49:34 kjcf05n01 puppet-agent[3891175]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-20:25:49/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 4 20:49:34 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 20:49:34 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 20:49:34 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 20:49:34 kjcf05n07 puppet-agent[2310830]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 20:49:34 kjcf05n07 puppet-agent[2310830]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 20:49:34 kjcf05n07 puppet-agent[2310830]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 20:49:34 kjcf05n02 puppet-agent[292601]: Applied catalog in 5.12 seconds Nov 4 20:49:34 kjcf05n06 puppet-agent[2307595]: Applied catalog in 4.64 seconds Nov 4 20:49:35 kjcf05n07 puppet-agent[2310830]: Applied catalog in 4.80 seconds Nov 4 20:49:35 kjcf05n01 puppet-agent[3891175]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 20:49:35 kjcf05n01 puppet-agent[3891175]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 20:49:35 kjcf05n01 puppet-agent[3891175]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 20:49:34 kjcf05n00 puppet-agent[2440359]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 20:49:34 kjcf05n00 puppet-agent[2440359]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 20:49:34 kjcf05n00 puppet-agent[2440359]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 20:49:35 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3879464]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 20:49:35 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 4 20:49:35 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 20:49:35 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 4 20:49:35 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 4 20:49:35 kjcf05n01 puppet-agent[3891175]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: Press Ctrl+C to exit. Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: Plugin support version 1.0 Nov 4 20:49:35 kjcf05n01 zabbix_agent2[3891541]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 20:49:35 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2422341]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 20:49:35 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 20:49:35 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 20:49:35 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 4 20:49:35 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 4 20:49:35 kjcf05n00 puppet-agent[2440359]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: Press Ctrl+C to exit. Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: Plugin support version 1.0 Nov 4 20:49:35 kjcf05n00 zabbix_agent2[2440939]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 20:49:35 kjcf05n04 puppet-agent[2290746]: Caching catalog for kjcf05n04 Nov 4 20:49:35 kjcf05n04 puppet-agent[2290746]: Applying configuration version '1730774974' Nov 4 20:49:35 kjcf05n00 zabbix-server[2440965]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 20:49:36 kjcf05n00 zabbix-server[2440966]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 20:49:36 kjcf05n00 zabbix-server[2440975]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 20:49:37 kjcf05n00 zabbix-server[2440977]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 20:49:37 kjcf05n00 puppet-agent[2440359]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 4 20:49:38 kjcf05n01 puppet-agent[3891175]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_203307.log]/mode) mode changed '0644' to '0640' Nov 4 20:49:38 kjcf05n01 puppet-agent[3891175]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_204451.log]/mode) mode changed '0644' to '0640' Nov 4 20:49:38 kjcf05n04 puppet-agent[2290746]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 20:49:38 kjcf05n04 puppet-agent[2290746]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 20:49:38 kjcf05n04 puppet-agent[2290746]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 20:49:38 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2245186]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 20:49:38 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 4 20:49:38 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 20:49:38 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 4 20:49:38 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 4 20:49:38 kjcf05n04 puppet-agent[2290746]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: Press Ctrl+C to exit. Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: Plugin support version 1.0 Nov 4 20:49:38 kjcf05n04 zabbix_agent2[2291570]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 20:49:38 kjcf05n01 puppet-agent[3891175]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_203307.log]/mode) mode changed '0644' to '0640' Nov 4 20:49:38 kjcf05n01 puppet-agent[3891175]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_204451.log]/mode) mode changed '0644' to '0640' Nov 4 20:49:38 kjcf05n01 puppet-agent[3891175]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241104_204451]/mode) mode changed '0755' to '0750' Nov 4 20:49:38 kjcf05n01 puppet-agent[3891175]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241104_204451/screenlog.0]/mode) mode changed '0644' to '0640' Nov 4 20:49:38 kjcf05n01 puppet-agent[3891175]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 20:49:38 kjcf05n01 puppet-agent[3891175]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 20:49:38 kjcf05n01 puppet-agent[3891175]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 20:49:38 kjcf05n00 puppet-agent[2440359]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 20:49:38 kjcf05n00 puppet-agent[2440359]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 20:49:38 kjcf05n00 puppet-agent[2440359]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 20:49:39 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 4 20:49:39 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 4 20:49:39 kjcf05n00 puppet-agent[2440359]: Applied catalog in 8.36 seconds Nov 4 20:49:40 kjcf05n01 puppet-agent[3891175]: Applied catalog in 8.80 seconds Nov 4 20:49:40 kjcf05n04 puppet-agent[2290746]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 20:49:40 kjcf05n04 puppet-agent[2290746]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 20:49:40 kjcf05n04 puppet-agent[2290746]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 20:49:41 kjcf05n04 puppet-agent[2290746]: Applied catalog in 4.80 seconds Nov 4 20:49:41 kjcf05n00 mcfcli[3673891]: %3|1730774981.077|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:49:45 kjcf05n00 mcfcli[3673891]: %3|1730774985.513|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 20:49:47 kjcf05n00 zabbix_server[15783]: resuming Zabbix agent checks on host "kjcf05n07": connection restored Nov 4 20:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 20:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 20:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 20:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 20:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 20:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 20:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 20:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 20:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 20:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 20:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 20:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 20:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 20:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 20:50:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 20:50:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 20:50:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 20:50:06 kjcf05n05 puppet-agent[2495264]: Caching catalog for kjcf05n05 Nov 4 20:50:06 kjcf05n05 puppet-agent[2495264]: Applying configuration version '1730775005' Nov 4 20:50:09 kjcf05n05 puppet-agent[2495264]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 20:50:09 kjcf05n05 puppet-agent[2495264]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 20:50:09 kjcf05n05 puppet-agent[2495264]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 20:50:09 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2447646]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 20:50:09 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 4 20:50:09 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 20:50:09 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 4 20:50:09 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 4 20:50:09 kjcf05n05 puppet-agent[2495264]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: Starting Zabbix Agent 2 (6.2.1) Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: Press Ctrl+C to exit. Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: Plugin support version 1.0 Nov 4 20:50:09 kjcf05n05 zabbix_agent2[2497559]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 20:50:11 kjcf05n05 puppet-agent[2495264]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 20:50:11 kjcf05n05 puppet-agent[2495264]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 20:50:11 kjcf05n05 puppet-agent[2495264]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 20:50:11 kjcf05n05 puppet-agent[2495264]: Applied catalog in 4.81 seconds Nov 4 20:50:11 kjcf05n00 zabbix-server[2440191]: puppet completed status:(0): '' Nov 4 20:50:11 kjcf05n00 zabbix-server[2440191]: Event '46659' acknowledged Nov 4 20:50:11 kjcf05n00 zabbix-server[2440191]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n03"}' Nov 4 20:50:15 kjcf05n00 mcfcli[3673891]: %3|1730775015.513|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:50:16 kjcf05n00 mcfcli[3673891]: %3|1730775016.357|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:50:42 kjcf05n00 python3.9[2441296]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 20:50:45 kjcf05n00 mcfcli[3673891]: %3|1730775045.514|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 20:50:53 kjcf05n00 mcfcli[3673891]: %3|1730775053.061|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:51:15 kjcf05n00 mcfcli[3673891]: %3|1730775075.514|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 20:51:32 kjcf05n00 mcfcli[3673891]: %3|1730775092.149|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:51:45 kjcf05n00 mcfcli[3673891]: %3|1730775105.514|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 20:52:10 kjcf05n00 mcfcli[3673891]: %3|1730775130.219|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:52:15 kjcf05n00 mcfcli[3673891]: %3|1730775135.515|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:52:45 kjcf05n00 mcfcli[3673891]: %3|1730775165.515|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:52:47 kjcf05n00 mcfcli[3673891]: %3|1730775167.858|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:53:15 kjcf05n00 mcfcli[3673891]: %3|1730775195.516|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T02:53:15.868511Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 20:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T02:53:15.868571Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.080ms Nov 4 20:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T20:53:27.270248668-06:00 level=info msg="Completed cleanup jobs" duration=43.443743ms Nov 4 20:53:27 kjcf05n00 mcfcli[3673891]: %3|1730775207.855|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:53:45 kjcf05n00 mcfcli[3673891]: %3|1730775225.516|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:54:05 kjcf05n00 mcfcli[3673891]: %3|1730775245.982|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:54:15 kjcf05n00 mcfcli[3673891]: %3|1730775255.516|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 20:54:45 kjcf05n00 mcfcli[3673891]: %3|1730775285.516|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 20:54:45 kjcf05n00 mcfcli[3673891]: %3|1730775285.979|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:55:15 kjcf05n00 mcfcli[3673891]: %3|1730775315.516|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 20:55:25 kjcf05n00 mcfcli[3673891]: %3|1730775325.976|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 20:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 20:55:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 20:55:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 20:55:45 kjcf05n00 mcfcli[3673891]: %3|1730775345.517|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 20:55:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 20:55:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 20:55:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 20:55:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 20:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 20:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 20:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 20:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 20:55:56 kjcf05n00 python3.9[2444481]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 20:55:56 kjcf05n00 zabbix_server[15745]: Zabbix agent item "vm.memory.size[buffers]" on host "kjcf05n03" failed: first network error, wait for 15 seconds Nov 4 20:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 20:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 20:56:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 20:56:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 20:56:00 kjcf05n00 mcfcli[3673891]: %3|1730775360.922|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:56:02 kjcf05n02 fstonithd.py[15145]: My partner 172.16.2.6 is kdumping. Forcing HA into GATHER state. Nov 4 20:56:02 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 20:56:02 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 20:56:02 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 20:56:04 kjcf05n02 root[304309]: is_viking_off starts Nov 4 20:56:04 kjcf05n02 root[304308]: is_enc_ipmi_off starts Nov 4 20:56:04 kjcf05n02 root[304326]: I am master Nov 4 20:56:04 kjcf05n02 root[304329]: I am in slot 0; partner is in slot 1 Nov 4 20:56:04 kjcf05n02 root[304331]: is_lan_ipmi_off leaves Nov 4 20:56:04 kjcf05n02 root[304333]: is_lan_ipmi_sec_off leaves Nov 4 20:56:10 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='30', error='Connection reset by peer (104)' Nov 4 20:56:10 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='30', client='AF_INET(172.16.2.6:39799)', local='AF_INET(0.0.0.0:601)' Nov 4 20:56:10 kjcf05n02 root[304439]: is_viking_off leaves Nov 4 20:56:10 kjcf05n02 root[304442]: kjcf05n03 not already off look at kdump Nov 4 20:56:10 kjcf05n02 root[304443]: is_kdump_off starts Nov 4 20:56:10 kjcf05n02 fence_kdump[304444]: waiting for message from '172.16.2.6' Nov 4 20:56:11 kjcf05n00 zabbix_server[15737]: Zabbix agent item "vfs.fs.inode[/var/lib/mdraidscripts,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 20:56:11 kjcf05n02 fence_kdump[304444]: received valid message from '172.16.2.6' Nov 4 20:56:11 kjcf05n02 root[304478]: is_kdump_off detected kdump on kjcf05n03 Nov 4 20:56:11 kjcf05n02 root[304479]: kjcf05n03 is kdumping Nov 4 20:56:12 kjcf05n02 root[304575]: is_enc_ipmi_off starts Nov 4 20:56:12 kjcf05n02 root[304576]: is_viking_off starts Nov 4 20:56:12 kjcf05n02 root[304594]: is_lan_ipmi_off leaves Nov 4 20:56:12 kjcf05n02 root[304596]: is_lan_ipmi_sec_off leaves Nov 4 20:56:12 kjcf05n02 root[304599]: I am master Nov 4 20:56:12 kjcf05n02 root[304602]: I am in slot 0; partner is in slot 1 Nov 4 20:56:12 kjcf05n00 zabbix_server[15768]: Zabbix agent item "vfs.fs.inode[/var/lib/reboot_cnt,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 20:56:13 kjcf05n00 zabbix_server[15725]: Zabbix agent item "vfs.fs.inode[/etc/ganesha,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 20:56:13 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 4 20:56:13 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 4 20:56:14 kjcf05n00 zabbix_server[15776]: Zabbix agent item "vfs.fs.size[/mnt/persistent_ha_data,pused]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 20:56:15 kjcf05n00 zabbix_server[15754]: Zabbix agent item "vfs.fs.size[/var/lib/pacemaker,pused]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 20:56:16 kjcf05n00 mcfcli[3673891]: %3|1730775376.016|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 20:56:18 kjcf05n02 root[304795]: is_viking_off leaves Nov 4 20:56:18 kjcf05n02 root[304798]: kjcf05n03 not already off look at kdump Nov 4 20:56:18 kjcf05n02 root[304799]: is_kdump_off starts Nov 4 20:56:18 kjcf05n02 fence_kdump[304800]: waiting for message from '172.16.2.6' Nov 4 20:56:18 kjcf05n02 fence_kdump[304800]: received valid message from '172.16.2.6' Nov 4 20:56:18 kjcf05n02 root[304803]: is_kdump_off detected kdump on kjcf05n03 Nov 4 20:56:18 kjcf05n02 root[304804]: kjcf05n03 is kdumping Nov 4 20:56:20 kjcf05n02 diskmonitor[17558]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 4 20:56:23 kjcf05n02 systemd-udevd[307315]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307318]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307315]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307318]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307315]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307318]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307315]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307318]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307315]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307318]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307315]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307318]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307315]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307318]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307315]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307314]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307318]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307316]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307352]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307356]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307354]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307359]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307356]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307352]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307354]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307359]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307356]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307351]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307359]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307356]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307359]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307356]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307351]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307356]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307351]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307356]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307356]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307351]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307356]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307351]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307356]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307356]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307351]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307356]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307351]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307356]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307351]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307356]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307351]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 systemd-udevd[307351]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 20:56:23 kjcf05n02 dwd[5196]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 4 20:56:23 kjcf05n02 dwd[5196]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 4 20:56:23 kjcf05n02 dwd[5196]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 4 20:56:23 kjcf05n02 dwd[5196]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 4 20:56:23 kjcf05n02 dwd[5196]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 4 20:56:23 kjcf05n02 dwd[5196]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 4 20:56:23 kjcf05n02 dwd[5196]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 4 20:56:23 kjcf05n02 dwd[5196]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 4 20:56:23 kjcf05n02 dwd[5196]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 4 20:56:23 kjcf05n02 dwd[5196]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 4 20:56:23 kjcf05n02 dwd[5196]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 4 20:56:23 kjcf05n02 dwd[5196]: Starting NVME thread for nvme22n1 Nov 4 20:56:23 kjcf05n02 dwd[5196]: Starting NVME thread for nvme7n1 Nov 4 20:56:23 kjcf05n02 dwd[5196]: Starting NVME thread for nvme11n1 Nov 4 20:56:24 kjcf05n02 dwd[5196]: Starting NVME thread for nvme6n1 Nov 4 20:56:24 kjcf05n02 dwd[5196]: Starting NVME thread for nvme12n1 Nov 4 20:56:24 kjcf05n02 dwd[5196]: Starting NVME thread for nvme15n1 Nov 4 20:56:24 kjcf05n02 dwd[5196]: Starting NVME thread for nvme21n1 Nov 4 20:56:24 kjcf05n02 dwd[5196]: Starting NVME thread for nvme16n1 Nov 4 20:56:24 kjcf05n02 dwd[5196]: Starting NVME thread for nvme5n1 Nov 4 20:56:24 kjcf05n02 dwd[5196]: Starting NVME thread for nvme10n1 Nov 4 20:56:25 kjcf05n02 dwd[5196]: Starting NVME thread for nvme20n1 Nov 4 20:56:27 kjcf05n02 diskmonitor[17558]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 4 20:56:27 kjcf05n02 diskmonitor[17558]: Scan for ReadErrorMax change for md66 Nov 4 20:56:27 kjcf05n02 diskmonitor[17558]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 4 20:56:27 kjcf05n02 diskmonitor[17558]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 4 20:56:27 kjcf05n02 diskmonitor[17558]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.min.76c05c063fa0949b68ee86c1978c2ca8 file Nov 4 20:56:27 kjcf05n02 diskmonitor[17558]: read_saved_file: found system in /var/run/diskmonitor/sync_speed_min/saved.max.76c05c063fa0949b68ee86c1978c2ca8 file Nov 4 20:56:27 kjcf05n02 diskmonitor[17558]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 4 20:56:27 kjcf05n02 diskmonitor[17558]: Set sync_speed_min (10000) for md66 Nov 4 20:56:27 kjcf05n02 diskmonitor[17558]: Set sync_speed_max (200000) for md66 Nov 4 20:56:27 kjcf05n02 diskmonitor[17558]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 20:56:30 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.cpu.util[,guest]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 20:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 20:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 20:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 20:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 20:56:40 kjcf05n00 mcfcli[3673891]: %3|1730775400.412|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:56:45 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n03": interface unavailable Nov 4 20:56:46 kjcf05n00 mcfcli[3673891]: %3|1730775406.017|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:56:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 20:56:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 20:56:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 20:56:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 20:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 20:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 20:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 20:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 20:57:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 20:57:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 20:57:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 20:57:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 20:57:16 kjcf05n00 mcfcli[3673891]: %3|1730775436.017|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 20:57:18 kjcf05n00 mcfcli[3673891]: %3|1730775438.973|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:57:33 kjcf05n02 nslcd[6957]: [e45d32] ldap_result() failed: Can't contact LDAP server Nov 4 20:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 20:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 20:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 20:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 20:57:46 kjcf05n00 mcfcli[3673891]: %3|1730775466.017|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 20:57:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 20:57:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 20:57:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 20:57:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 20:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 20:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 20:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 20:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 20:57:57 kjcf05n00 mcfcli[3673891]: %3|1730775477.716|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 20:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 20:58:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 20:58:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 20:58:16 kjcf05n00 mcfcli[3673891]: %3|1730775496.017|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:58:36 kjcf05n00 mcfcli[3673891]: %3|1730775516.150|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 20:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 20:58:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 20:58:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 20:58:46 kjcf05n00 mcfcli[3673891]: %3|1730775526.017|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:58:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 20:58:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 20:58:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 20:58:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 20:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 20:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 20:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 20:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 20:59:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 20:59:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 20:59:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 20:59:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 20:59:14 kjcf05n00 mcfcli[3673891]: %3|1730775554.208|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:59:16 kjcf05n00 mcfcli[3673891]: %3|1730775556.017|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 20:59:35 kjcf05n00 zabbix-server[2446646]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 20:59:35 kjcf05n00 zabbix-server[2446646]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n03:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 4 20:59:35 kjcf05n00 log_interesting_event.py[2446646]: Event '46661' acknowledged Nov 4 20:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 20:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 20:59:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 20:59:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 20:59:46 kjcf05n00 mcfcli[3673891]: %3|1730775586.018|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 20:59:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 20:59:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 20:59:51 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:9a:1a Nov 4 20:59:51 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 4 20:59:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 20:59:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 20:59:54 kjcf05n00 mcfcli[3673891]: %3|1730775594.205|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 20:59:55 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 4 20:59:55 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a kjcf05n03 Nov 4 20:59:55 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.6 Nov 4 20:59:55 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 4 20:59:55 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 4 20:59:55 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.6 Nov 4 20:59:55 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/pxelinux.cfg to 172.16.2.6 Nov 4 20:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 20:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 20:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 20:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 20:59:58 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/vmlinuz_diskless to 172.16.2.6 Nov 4 21:00:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 21:00:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 21:00:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 21:00:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 21:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 21:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 21:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 21:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 21:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 21:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 21:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 21:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 21:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 21:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 21:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 21:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 21:00:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 21:00:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:00:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 21:00:06 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/initramfs-diskless.img to 172.16.2.6 Nov 4 21:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T03:00:10.410559Z lvl=info msg="TSI log compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=5 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=start Nov 4 21:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T03:00:10.410559Z lvl=info msg="TSI log compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=7 op_name=tsi1_compact_log_file tsi1_log_file_id=2 op_event=start Nov 4 21:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T03:00:10.411149Z lvl=info msg="Log file compacted" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=7 op_name=tsi1_compact_log_file tsi1_log_file_id=2 elapsed=0ms bytes=883 kb_per_sec=1408 Nov 4 21:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T03:00:10.411180Z lvl=info msg="TSI log compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=7 op_name=tsi1_compact_log_file tsi1_log_file_id=2 op_event=end op_elapsed=0.641ms Nov 4 21:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T03:00:10.411202Z lvl=info msg="TSI level compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=7 op_name=tsi1_compact_to_level tsi1_level=2 op_event=start Nov 4 21:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T03:00:10.411222Z lvl=info msg="Performing full compaction" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=7 op_name=tsi1_compact_to_level tsi1_level=2 src=2,1 dst=/mnt/mgmt/var/lib/influxdb/engine/data/f75a8c5868320c8d/autogen/675/index/6/L2-00000004.tsi Nov 4 21:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T03:00:10.411997Z lvl=info msg="Log file compacted" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=5 op_name=tsi1_compact_log_file tsi1_log_file_id=1 elapsed=1ms bytes=16916 kb_per_sec=11310 Nov 4 21:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T03:00:10.412027Z lvl=info msg="TSI log compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=5 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=end op_elapsed=1.488ms Nov 4 21:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T03:00:10.412401Z lvl=info msg="Full compaction complete" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=7 op_name=tsi1_compact_to_level tsi1_level=2 path=/mnt/mgmt/var/lib/influxdb/engine/data/f75a8c5868320c8d/autogen/675/index/6/L2-00000004.tsi elapsed=1ms bytes=14087 kb_per_sec=11550 Nov 4 21:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T03:00:10.412410Z lvl=info msg="Removing index file" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=7 op_name=tsi1_compact_to_level tsi1_level=2 path=/mnt/mgmt/var/lib/influxdb/engine/data/f75a8c5868320c8d/autogen/675/index/6/L1-00000002.tsi Nov 4 21:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T03:00:10.412436Z lvl=info msg="Removing index file" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=7 op_name=tsi1_compact_to_level tsi1_level=2 path=/mnt/mgmt/var/lib/influxdb/engine/data/f75a8c5868320c8d/autogen/675/index/6/L1-00000001.tsi Nov 4 21:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T03:00:10.412459Z lvl=info msg="TSI level compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=7 op_name=tsi1_compact_to_level tsi1_level=2 op_event=end op_elapsed=1.258ms Nov 4 21:00:16 kjcf05n00 mcfcli[3673891]: %3|1730775616.081|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 21:00:33 kjcf05n00 mcfcli[3673891]: %3|1730775633.756|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 21:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 21:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 21:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 21:00:46 kjcf05n00 python3.9[2447508]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 21:00:46 kjcf05n00 mcfcli[3673891]: %3|1730775646.519|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 21:00:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 21:00:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 21:00:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 21:00:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 21:00:53 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:44040). Nov 4 21:00:53 kjcf05n01 rsyncd[3895890]: connect from kjcf05n03 (172.16.2.6) Nov 4 21:00:53 kjcf05n01 rsyncd[3895890]: rsync on puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 4 21:00:53 kjcf05n01 rsyncd[3895890]: building file list Nov 4 21:00:53 kjcf05n01 rsyncd[3895890]: sent 11446 bytes received 136 bytes total size 10901 Nov 4 21:00:53 kjcf05n01 systemd[1]: rsyncd@663-172.16.2.2:873-172.16.2.6:44040.service: Succeeded. Nov 4 21:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 21:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 21:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 21:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 21:00:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730775659', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 21:00:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730775659'} Nov 4 21:00:59 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:00:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730775659', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 21:00:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730775659'} Nov 4 21:00:59 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:01:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 21:01:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 21:01:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 21:01:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 21:01:02 kjcf05n02 fstonithd.py[15145]: Listening for kdump packets from partner Nov 4 21:01:11 kjcf05n00 mcfcli[3673891]: %3|1730775671.002|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:01:17 kjcf05n00 mcfcli[3673891]: %3|1730775677.019|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 21:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 21:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 21:01:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 21:01:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 21:01:47 kjcf05n00 mcfcli[3673891]: %3|1730775707.019|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 21:01:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 21:01:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 21:01:49 kjcf05n02 dwd[5196]: nvme11n1 passed periodic SMART status check Nov 4 21:01:49 kjcf05n02 dwd[5196]: nvme22n1 passed periodic SMART status check Nov 4 21:01:49 kjcf05n02 dwd[5196]: nvme7n1 passed periodic SMART status check Nov 4 21:01:50 kjcf05n02 dwd[5196]: nvme20n1 passed periodic SMART status check Nov 4 21:01:50 kjcf05n02 dwd[5196]: nvme15n1 passed periodic SMART status check Nov 4 21:01:50 kjcf05n02 dwd[5196]: nvme6n1 passed periodic SMART status check Nov 4 21:01:50 kjcf05n02 dwd[5196]: nvme16n1 passed periodic SMART status check Nov 4 21:01:50 kjcf05n02 dwd[5196]: nvme21n1 passed periodic SMART status check Nov 4 21:01:50 kjcf05n02 dwd[5196]: nvme10n1 passed periodic SMART status check Nov 4 21:01:50 kjcf05n02 dwd[5196]: nvme12n1 passed periodic SMART status check Nov 4 21:01:50 kjcf05n02 dwd[5196]: nvme5n1 passed periodic SMART status check Nov 4 21:01:50 kjcf05n00 mcfcli[3673891]: %3|1730775710.595|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:01:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 21:01:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 21:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 21:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 21:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 21:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 21:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 21:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 21:02:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 21:02:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 21:02:17 kjcf05n00 mcfcli[3673891]: %3|1730775737.019|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:02:19 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='30', client='AF_INET(172.16.2.6:37375)', local='AF_INET(0.0.0.0:601)' Nov 4 21:02:19 kjcf05n03 syslog-ng[3163]: Configuration reload request received, reloading configuration; Nov 4 21:02:19 kjcf05n03 syslog-ng[3163]: Configuration reload finished; Nov 4 21:02:19 kjcf05n03 syslog-ng[3163]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 4 21:02:19 kjcf05n03 dracut: dracut-049-135.git20210121.el8 Nov 4 21:02:19 kjcf05n03 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 21:02:19 kjcf05n03 dracut: Loading and integrity checking all crypto modules Nov 4 21:02:19 kjcf05n03 dracut: Self testing crypto algorithms Nov 4 21:02:19 kjcf05n03 dracut: rd.md=0: removing MD RAID activation Nov 4 21:02:19 kjcf05n03 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 21:02:19 kjcf05n03 Copying live image to RAM... Nov 4 21:02:19 kjcf05n03 (this may take a minute) Nov 4 21:02:19 kjcf05n03 Done copying live image to RAM. Nov 4 21:02:19 kjcf05n03 dracut: Mounted root filesystem LiveOS_rootfs Nov 4 21:02:19 kjcf05n03 dracut: Checking integrity of kernel Nov 4 21:02:19 kjcf05n03 dracut: All initrd crypto checks done Nov 4 21:02:19 kjcf05n03 dracut: Switching root Nov 4 21:02:19 kjcf05n03 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 4 21:02:19 kjcf05n03 systemd: Detected architecture x86-64. Nov 4 21:02:19 kjcf05n03 systemd: Set hostname to . Nov 4 21:02:19 kjcf05n03 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 4 21:02:19 kjcf05n03 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 4 21:02:19 kjcf05n03 systemd: Started Dispatch Password Requests to Console Directory Watch. Nov 4 21:02:19 kjcf05n03 systemd: Listening on udev Kernel Socket. Nov 4 21:02:19 kjcf05n03 systemd: Listening on Device-mapper event daemon FIFOs. Nov 4 21:02:19 kjcf05n03 systemd: Reached target Swap. Nov 4 21:02:19 kjcf05n03 systemd: Listening on LVM2 poll daemon socket. Nov 4 21:02:19 kjcf05n03 systemd-journald[1526]: Journal started Nov 4 21:02:19 kjcf05n03 systemd-journald[1526]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 21:02:19 kjcf05n03 systemd-modules-load[1521]: Inserted module 'fuse' Nov 4 21:02:19 kjcf05n03 systemd[1]: Mounted POSIX Message Queue File System. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Load/Save Random Seed... Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Rebuild Hardware Database... Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Create System Users... Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Apply Kernel Variables... Nov 4 21:02:19 kjcf05n03 systemd[1]: Mounting Kernel Configuration File System... Nov 4 21:02:19 kjcf05n03 systemd[1]: Mounting FUSE Control File System... Nov 4 21:02:19 kjcf05n03 systemd[1]: Mounted Kernel Configuration File System. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Load/Save Random Seed. Nov 4 21:02:19 kjcf05n03 systemd[1]: Mounted FUSE Control File System. Nov 4 21:02:19 kjcf05n03 systemd-journald[1526]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Flush Journal to Persistent Storage. Nov 4 21:02:19 kjcf05n03 systemd-sysctl[1542]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 21:02:19 kjcf05n03 systemd-sysctl[1542]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Create System Users. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Apply Kernel Variables. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 4 21:02:19 kjcf05n03 systemd-tmpfiles[1553]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 21:02:19 kjcf05n03 systemd-tmpfiles[1553]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Create Static Device Nodes in /dev. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started udev Coldplug all Devices. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Rebuild Hardware Database. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting udev Kernel Device Manager... Nov 4 21:02:19 kjcf05n03 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started udev Kernel Device Manager. Nov 4 21:02:19 kjcf05n03 systemd[1]: Found device /dev/ttyS0. Nov 4 21:02:19 kjcf05n03 systemd-udevd[1572]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:02:19 kjcf05n03 systemd-udevd[1636]: Using default interface naming scheme 'rhel-8.0'. Nov 4 21:02:19 kjcf05n03 systemd-udevd[1636]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:02:19 kjcf05n03 systemd-udevd[1587]: Using default interface naming scheme 'rhel-8.0'. Nov 4 21:02:19 kjcf05n03 systemd-udevd[1587]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:02:19 kjcf05n03 systemd-udevd[1606]: Using default interface naming scheme 'rhel-8.0'. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 4 21:02:19 kjcf05n03 systemd-udevd[1606]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:02:19 kjcf05n03 systemd[1]: Reached target Local File Systems (Pre). Nov 4 21:02:19 kjcf05n03 systemd[1]: Reached target Local File Systems. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Rebuild Journal Catalog... Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting openibd - configure Mellanox devices... Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Mark the need to relabel after reboot... Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Create Volatile Files and Directories... Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Mark the need to relabel after reboot. Nov 4 21:02:19 kjcf05n03 root[1789]: openibd: running in auto mode Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Rebuild Journal Catalog. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 4 21:02:19 kjcf05n03 systemd-tmpfiles[1790]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 21:02:19 kjcf05n03 systemd-tmpfiles[1790]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 21:02:19 kjcf05n03 systemd-tmpfiles[1790]: "/var/tmp" already exists and is not a directory. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Create Volatile Files and Directories. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting RPC Bind... Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started RPC Bind. Nov 4 21:02:19 kjcf05n03 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting RDMA Node Description Daemon... Nov 4 21:02:19 kjcf05n03 systemd-modules-load[1902]: Inserted module 'ib_iser' Nov 4 21:02:19 kjcf05n03 systemd-modules-load[1902]: Inserted module 'ib_isert' Nov 4 21:02:19 kjcf05n03 systemd[1]: Started RDMA Node Description Daemon. Nov 4 21:02:19 kjcf05n03 systemd-modules-load[1902]: Inserted module 'ib_srpt' Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 4 21:02:19 kjcf05n03 systemd-udevd[1636]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:02:19 kjcf05n03 systemd-udevd[1619]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:02:19 kjcf05n03 systemd-modules-load[1895]: Inserted module 'ib_ipoib' Nov 4 21:02:19 kjcf05n03 systemd-modules-load[1902]: Inserted module 'rdma_ucm' Nov 4 21:02:19 kjcf05n03 systemd-modules-load[1902]: Module 'svcrdma' is blacklisted Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 4 21:02:19 kjcf05n03 systemd-udevd[1636]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 21:02:19 kjcf05n03 systemd-udevd[1619]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 21:02:19 kjcf05n03 systemd-modules-load[1895]: Inserted module 'ib_umad' Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 4 21:02:19 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 21:02:19 kjcf05n03 systemd[3163]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:19 kjcf05n03 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 4 21:02:19 kjcf05n03 systemd[1]: Reached target RDMA Hardware. Nov 4 21:02:19 kjcf05n03 systemd[1]: Reached target Network (Pre). Nov 4 21:02:19 kjcf05n03 openibd[1770]: Loading HCA driver and Access Layer:[ OK ] Nov 4 21:02:19 kjcf05n03 systemd[1]: Started openibd - configure Mellanox devices. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Update is Completed... Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Update is Completed. Nov 4 21:02:19 kjcf05n03 setup-icl[1757]: Setting LAN IP Address to 203.0.113.4 Nov 4 21:02:19 kjcf05n03 setup-icl[1757]: Setting LAN Subnet Mask to 255.255.255.0 Nov 4 21:02:19 kjcf05n03 setup-icl[1757]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 4 21:02:19 kjcf05n03 setup-icl[1757]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 4 21:02:19 kjcf05n03 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 4 21:02:19 kjcf05n03 systemd[1]: Reached target System Initialization. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 4 21:02:19 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 4 21:02:19 kjcf05n03 systemd[1]: Listening on lldpad.socket. Nov 4 21:02:19 kjcf05n03 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 4 21:02:19 kjcf05n03 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 4 21:02:19 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 4 21:02:19 kjcf05n03 systemd[1]: Reached target Sockets. Nov 4 21:02:19 kjcf05n03 systemd[1]: Reached target Basic System. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Resets System Activity Logs... Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 4 21:02:19 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started irqbalance daemon. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[2094]: Setting up Mellanox network interface: ib1 Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 4 21:02:19 kjcf05n03 beSetMlxConfig[2096]: ConnectX-3 multiport not detected Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting LSB: Bring up/down networking... Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 4 21:02:19 kjcf05n03 chronyd[2137]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 21:02:19 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 21:02:19 kjcf05n03 network[2117]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 4 21:02:19 kjcf05n03 mcelog[2129]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 4 21:02:19 kjcf05n03 mcelog[2129]: CPU is unsupported Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[2159]: Setting up Mellanox network interface: ib0 Nov 4 21:02:19 kjcf05n03 systemd[1]: Started D-Bus System Message Bus. Nov 4 21:02:19 kjcf05n03 network[2161]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 21:02:19 kjcf05n03 network[2117]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 4 21:02:19 kjcf05n03 dwd[2176]: dwd: vMay 29 2024 : 15:38:26 Nov 4 21:02:19 kjcf05n03 dwd[2176]: /usr/sbin/dwd -d --standalone=0 Nov 4 21:02:19 kjcf05n03 dwd[2176]: dwd: option Lethal: 0 Nov 4 21:02:19 kjcf05n03 dwd[2176]: dwd: option Interval: 60 Nov 4 21:02:19 kjcf05n03 dwd[2176]: dwd: option abrtlimit: 10 Nov 4 21:02:19 kjcf05n03 dwd[2176]: dwd: option DZPeriod: 604800 Nov 4 21:02:19 kjcf05n03 dwd[2176]: dwd: option SmartPeriod: 43200 Nov 4 21:02:19 kjcf05n03 dwd[2176]: dwd: option SDDEnabled: 1 Nov 4 21:02:19 kjcf05n03 dwd[2176]: dwd: option SDDAwaitScale: 3 Nov 4 21:02:19 kjcf05n03 dwd[2176]: dwd: option SDDAwaitMin: 100 Nov 4 21:02:19 kjcf05n03 dwd[2176]: dwd: option Verbosity: 1 Nov 4 21:02:19 kjcf05n03 dwd[2176]: dwd: option StandAlone: 0 Nov 4 21:02:19 kjcf05n03 dwd[2176]: option Lethal: 0 Nov 4 21:02:19 kjcf05n03 dwd[2176]: option Interval: 60 Nov 4 21:02:19 kjcf05n03 dwd[2176]: option abrtlimit: 10 Nov 4 21:02:19 kjcf05n03 dwd[2176]: option DZPeriod: 604800 Nov 4 21:02:19 kjcf05n03 dwd[2176]: option SmartPeriod: 43200 Nov 4 21:02:19 kjcf05n03 dwd[2176]: option SDDEnabled: 1 Nov 4 21:02:19 kjcf05n03 dwd[2176]: option SDDAwaitScale: 3 Nov 4 21:02:19 kjcf05n03 dwd[2176]: option SDDAwaitMin: 100 Nov 4 21:02:19 kjcf05n03 dwd[2176]: option Verbosity: 1 Nov 4 21:02:19 kjcf05n03 dwd[2176]: option StandAlone: 0 Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 4 21:02:19 kjcf05n03 beSetMlxConfig[2096]: Starting MST (Mellanox Software Tools) driver set Nov 4 21:02:19 kjcf05n03 chronyd[2137]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 21:02:19 kjcf05n03 chronyd[2137]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[2185]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 21:02:19 kjcf05n03 network[2190]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:02:19 kjcf05n03 network[2117]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Name Service Cache Daemon... Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 4 21:02:19 kjcf05n03 nscd[2240]: 2240 monitoring file `/etc/hosts` (1) Nov 4 21:02:19 kjcf05n03 nscd[2240]: 2240 monitoring directory `/etc` (2) Nov 4 21:02:19 kjcf05n03 nscd[2240]: 2240 monitoring file `/etc/resolv.conf` (3) Nov 4 21:02:19 kjcf05n03 nscd[2240]: 2240 monitoring directory `/etc` (2) Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 0 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 1 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 2 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 3 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 4 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 5 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 6 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 7 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 8 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 9 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 10 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 11 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 12 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 13 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 14 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 15 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 16 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 17 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 18 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 19 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 20 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 21 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 22 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 23 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 24 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 25 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 26 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 27 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 28 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 29 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 30 Nov 4 21:02:19 kjcf05n03 cpupower[2238]: Setting cpu: 31 Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Manage Cutlass PHYs... Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Resets System Activity Logs. Nov 4 21:02:19 kjcf05n03 network[2227]: It is advised to switch to 'NetworkManager' instead for network management. Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[2224]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 21:02:19 kjcf05n03 dbus-daemon[2187]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[2237]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 21:02:19 kjcf05n03 beSetMlxConfig[2096]: Loading MST PCI module - Success Nov 4 21:02:19 kjcf05n03 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 4 21:02:19 kjcf05n03 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 4 21:02:19 kjcf05n03 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 4 21:02:19 kjcf05n03 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 4 21:02:19 kjcf05n03 mdraid-phy[2248]: no Cutlass to worry about Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Name Service Cache Daemon. Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[2269]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[2270]: No configuration found for ib1 Nov 4 21:02:19 kjcf05n03 beSetMlxConfig[2096]: Loading MST PCI configuration module - Success Nov 4 21:02:19 kjcf05n03 beSetMlxConfig[2096]: Create devices Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Manage Cutlass PHYs. Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 0 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 1 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 2 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 3 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 4 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 5 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 6 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 7 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 8 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 9 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 10 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 11 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 12 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 13 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 14 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 15 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 16 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 17 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 18 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 19 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 20 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 21 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 22 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 23 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 24 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 25 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 26 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 27 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 28 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 29 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 30 Nov 4 21:02:19 kjcf05n03 cpupower[2293]: Idlestate 2 disabled on CPU 31 Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[2284]: No configuration found for ib0 Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[2288]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[2313]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 21:02:19 kjcf05n03 mlnx_conf_mgr[2341]: INFO: No configurations found for mlx5_1, skipping. Nov 4 21:02:19 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 21:02:19 kjcf05n03 mlnx_conf_mgr[2368]: INFO: No configurations found for mlx5_0, skipping. Nov 4 21:02:19 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 21:02:19 kjcf05n03 sssd[sssd][2205]: Starting up Nov 4 21:02:19 kjcf05n03 sssd[be[implicit_files]][2422]: Starting up Nov 4 21:02:19 kjcf05n03 sssd[nss][2512]: Starting up Nov 4 21:02:19 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 4 21:02:19 kjcf05n03 systemd[1]: Reached target User and Group Name Lookups. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Login Service... Nov 4 21:02:19 kjcf05n03 systemd-logind[2635]: New seat seat0. Nov 4 21:02:19 kjcf05n03 systemd-logind[2635]: Watching system buttons on /dev/input/event0 (Power Button) Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Login Service. Nov 4 21:02:19 kjcf05n03 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 4 21:02:19 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 4 21:02:19 kjcf05n03 python3.9[2102]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 21:02:19 kjcf05n03 python3.9[3163]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 21:02:19 kjcf05n03 systemd-sysctl[2763]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 21:02:19 kjcf05n03 systemd-sysctl[2763]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 4 21:02:19 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 21:02:19 kjcf05n03 python3.9[2902]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 21:02:19 kjcf05n03 python3.9[3163]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 21:02:19 kjcf05n03 network[2117]: Bringing up loopback interface: [ OK ] Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 4 21:02:19 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 21:02:19 kjcf05n03 systemd-sysctl[3096]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 21:02:19 kjcf05n03 systemd-sysctl[3096]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 21:02:19 kjcf05n03 systemd[1]: Started LSB: Bring up/down networking. Nov 4 21:02:19 kjcf05n03 systemd[1]: Reached target Network. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 4 21:02:19 kjcf05n03 systemd[1]: Reached target Network is Online. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Notify NFS peers of a restart... Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting System Logger Daemon... Nov 4 21:02:19 kjcf05n03 python3.9[3097]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 21:02:19 kjcf05n03 python3.9[3163]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:19 kjcf05n03 systemd[1]: Started GSSAPI Proxy Daemon. Nov 4 21:02:19 kjcf05n03 sm-notify[3158]: Version 2.3.3 starting Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Notify NFS peers of a restart. Nov 4 21:02:19 kjcf05n03 sshd[3144]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 4 21:02:19 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 4 21:02:19 kjcf05n03 systemd[1]: Reached target NFS client services. Nov 4 21:02:19 kjcf05n03 systemd[1]: Reached target Remote File Systems (Pre). Nov 4 21:02:19 kjcf05n03 systemd[1]: Reached target Remote File Systems. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Permit User Sessions... Nov 4 21:02:19 kjcf05n03 lldpad[3140]: setsockopt nearest_bridge: Invalid argument Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Permit User Sessions. Nov 4 21:02:19 kjcf05n03 lldpad[3140]: setsockopt nearest_bridge: Invalid argument Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 4 21:02:19 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Getty on tty1. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Serial Getty on ttyS0. Nov 4 21:02:19 kjcf05n03 systemd[1]: Reached target Login Prompts. Nov 4 21:02:19 kjcf05n03 beSetMlxConfig[2096]: Unloading MST PCI module (unused) - Success Nov 4 21:02:19 kjcf05n03 syslog-ng[3163]: [2024-11-05T03:01:06.726395] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 4 21:02:19 kjcf05n03 syslog-ng[3163]: [2024-11-05T03:01:06.726686] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 4 21:02:19 kjcf05n03 syslog-ng[3163]: [2024-11-05T03:01:06.726720] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 4 21:02:19 kjcf05n03 syslog-ng[3163]: [2024-11-05T03:01:06.727290] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 4 21:02:19 kjcf05n03 syslog-ng[3163]: [2024-11-05T03:01:06.727469] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 4 21:02:19 kjcf05n03 systemd[1]: Started System Logger Daemon. Nov 4 21:02:19 kjcf05n03 python3.9[3174]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 21:02:19 kjcf05n03 python3.9[3163]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 4 21:02:19 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 21:02:19 kjcf05n03 python3.9[3404]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 21:02:19 kjcf05n03 python3.9[3163]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 4 21:02:19 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 4 21:02:19 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 21:02:19 kjcf05n03 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 4 21:02:19 kjcf05n03 chronyd[2137]: System's initial offset : 0.002608 seconds fast of true (slew) Nov 4 21:02:19 kjcf05n03 systemd[1]: Started NTP client/server. Nov 4 21:02:19 kjcf05n03 beSetMlxConfig[2096]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 21:02:19 kjcf05n03 beSetMlxConfig[2096]: ib mode Nov 4 21:02:19 kjcf05n03 root[3424]: openibd: Set node_desc for mlx5_0: kjcf05n03 HCA-1 Nov 4 21:02:19 kjcf05n03 root[3426]: openibd: Set node_desc for mlx5_1: kjcf05n03 HCA-2 Nov 4 21:02:19 kjcf05n03 beSetMlxConfig[2096]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 21:02:19 kjcf05n03 beSetMlxConfig[2096]: ib mode Nov 4 21:02:19 kjcf05n03 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 21:02:19 kjcf05n03 systemd-udevd[3442]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:02:19 kjcf05n03 systemd-udevd[3443]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:02:19 kjcf05n03 systemd-udevd[3446]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:02:19 kjcf05n03 systemd-udevd[3448]: Using default interface naming scheme 'rhel-8.0'. Nov 4 21:02:19 kjcf05n03 systemd-udevd[3448]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:02:19 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 21:02:19 kjcf05n03 systemd[3163]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:19 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[3485]: Setting up Mellanox network interface: ib0 Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[3484]: Setting up Mellanox network interface: ib1 Nov 4 21:02:19 kjcf05n03 systemd-udevd[3445]: Using default interface naming scheme 'rhel-8.0'. Nov 4 21:02:19 kjcf05n03 systemd-udevd[3444]: Using default interface naming scheme 'rhel-8.0'. Nov 4 21:02:19 kjcf05n03 systemd-udevd[3445]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:02:19 kjcf05n03 systemd-udevd[3444]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Puppet agent... Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[3536]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[3538]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[3565]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[3566]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[3567]: No configuration found for ib0 Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[3568]: No configuration found for ib1 Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[3575]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[3576]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 21:02:19 kjcf05n03 mlnx_conf_mgr[3615]: INFO: No configurations found for mlx5_0, skipping. Nov 4 21:02:19 kjcf05n03 mlnx_conf_mgr[3616]: INFO: No configurations found for mlx5_1, skipping. Nov 4 21:02:19 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 21:02:19 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 21:02:19 kjcf05n03 systemd[1]: Stopping Command Scheduler... Nov 4 21:02:19 kjcf05n03 systemd[1]: crond.service: Succeeded. Nov 4 21:02:19 kjcf05n03 systemd[1]: Stopped Command Scheduler. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 4 21:02:19 kjcf05n03 systemd[1]: Stopping Job spooling tools... Nov 4 21:02:19 kjcf05n03 systemd[1]: atd.service: Succeeded. Nov 4 21:02:19 kjcf05n03 systemd[1]: Stopped Job spooling tools. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 21:02:19 kjcf05n03 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 4 21:02:19 kjcf05n03 lldpad[3140]: init_ports: Error adding device ib0 Nov 4 21:02:19 kjcf05n03 lldpad[3140]: init_ports: Error adding device ib1 Nov 4 21:02:19 kjcf05n03 lldpad[3140]: Signal 15 received - terminating Nov 4 21:02:19 kjcf05n03 systemd[1]: lldpad.service: Succeeded. Nov 4 21:02:19 kjcf05n03 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 4 21:02:19 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 4 21:02:19 kjcf05n03 systemd[1]: lldpad.socket: Succeeded. Nov 4 21:02:19 kjcf05n03 systemd[1]: Closed lldpad.socket. Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 4 21:02:19 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting IPMI Driver... Nov 4 21:02:19 kjcf05n03 systemd[1]: Started IPMI Driver. Nov 4 21:02:19 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:19 kjcf05n03 systemd[3163]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:19 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Ipmievd Daemon... Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 1 | Nov-05-2024 | 02:31:30 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 2 | Nov-05-2024 | 02:32:21 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 3 | Nov-05-2024 | 02:32:21 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 4 | Nov-05-2024 | 02:33:27 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 5 | Nov-05-2024 | 02:33:28 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 6 | Nov-05-2024 | 02:57:04 | Sensor #0 (Generator ID 21h) | Memory | Assertion Event | Correctable memory error ; OEM Event Data2 code = 30h ; OEM Event Data3 code = 00h Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 7 | Nov-05-2024 | 02:58:09 | Sensor #11 (Generator ID 20h) | Voltage | Assertion Event | Lower Non-critical - going low ; Sensor Reading = 49h ; Threshold = 9Bh Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 8 | Nov-05-2024 | 02:58:09 | Sensor #11 (Generator ID 20h) | Voltage | Assertion Event | Lower Critical - going low ; Sensor Reading = 49h ; Threshold = 94h Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 9 | Nov-05-2024 | 02:58:09 | Sensor #11 (Generator ID 20h) | Voltage | Assertion Event | Lower Non-recoverable - going low ; Sensor Reading = 49h ; Threshold = 8Ch Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 10 | Nov-05-2024 | 02:58:19 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 11 | Nov-05-2024 | 02:58:19 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 12 | Nov-05-2024 | 02:58:19 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 13 | Nov-05-2024 | 02:58:19 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 14 | Nov-05-2024 | 02:58:19 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 15 | Nov-05-2024 | 02:58:19 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 16 | Nov-05-2024 | 02:58:19 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 17 | Nov-05-2024 | 02:58:19 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 18 | Nov-05-2024 | 02:58:19 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 19 | Nov-05-2024 | 02:58:19 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 20 | Nov-05-2024 | 02:58:19 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 21 | Nov-05-2024 | 02:58:19 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 22 | Nov-05-2024 | 02:58:50 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 23 | Nov-05-2024 | 02:58:50 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 24 | Nov-05-2024 | 02:58:50 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 25 | Nov-05-2024 | 02:58:50 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 26 | Nov-05-2024 | 02:58:50 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 27 | Nov-05-2024 | 02:58:50 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 28 | Nov-05-2024 | 02:58:50 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 29 | Nov-05-2024 | 02:58:50 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 30 | Nov-05-2024 | 02:58:50 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 31 | Nov-05-2024 | 02:58:50 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 32 | Nov-05-2024 | 02:58:50 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 21:02:19 kjcf05n03 ipmievd[3962]: 33 | Nov-05-2024 | 02:58:50 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 21:02:19 kjcf05n03 ipmievd[3965]: Reading sensors... Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Ipmievd Daemon. Nov 4 21:02:19 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:19 kjcf05n03 systemd[3163]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 4 21:02:19 kjcf05n03 nscd[2240]: 2240 monitored file `/etc/hosts` was moved into place, adding watch Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 21:02:19 kjcf05n03 systemd[1]: set-mlx-config.service: Succeeded. Nov 4 21:02:19 kjcf05n03 systemd[1]: Stopped Set Mellanox configuration. Nov 4 21:02:19 kjcf05n03 systemd[1]: Stopping Set Mellanox configuration... Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 4 21:02:19 kjcf05n03 beSetMlxConfig[4023]: ConnectX-3 multiport not detected Nov 4 21:02:19 kjcf05n03 beSetMlxConfig[4023]: Starting MST (Mellanox Software Tools) driver set Nov 4 21:02:19 kjcf05n03 beSetMlxConfig[4023]: Loading MST PCI module - Success Nov 4 21:02:19 kjcf05n03 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 21:02:19 kjcf05n03 beSetMlxConfig[4023]: [warn] mst_pciconf is already loaded, skipping Nov 4 21:02:19 kjcf05n03 beSetMlxConfig[4023]: Create devices Nov 4 21:02:19 kjcf05n03 beSetMlxConfig[4023]: Unloading MST PCI module (unused) - Success Nov 4 21:02:19 kjcf05n03 ipmievd[3965]: Waiting for events... Nov 4 21:02:19 kjcf05n03 beSetMlxConfig[4023]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 21:02:19 kjcf05n03 beSetMlxConfig[4023]: ib mode Nov 4 21:02:19 kjcf05n03 beSetMlxConfig[4023]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 21:02:19 kjcf05n03 beSetMlxConfig[4023]: ib mode Nov 4 21:02:19 kjcf05n03 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 21:02:19 kjcf05n03 systemd-udevd[4922]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:02:19 kjcf05n03 systemd-udevd[4923]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:02:19 kjcf05n03 systemd-udevd[4926]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:02:19 kjcf05n03 systemd-udevd[4929]: Using default interface naming scheme 'rhel-8.0'. Nov 4 21:02:19 kjcf05n03 systemd-udevd[4929]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:02:19 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 21:02:19 kjcf05n03 systemd[3163]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:19 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[4964]: Setting up Mellanox network interface: ib0 Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[4965]: Setting up Mellanox network interface: ib1 Nov 4 21:02:19 kjcf05n03 systemd-udevd[4924]: Using default interface naming scheme 'rhel-8.0'. Nov 4 21:02:19 kjcf05n03 systemd-udevd[4925]: Using default interface naming scheme 'rhel-8.0'. Nov 4 21:02:19 kjcf05n03 systemd-udevd[4924]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:02:19 kjcf05n03 systemd-udevd[4925]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[5021]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[5022]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[5045]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[5046]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[5047]: No configuration found for ib0 Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[5048]: No configuration found for ib1 Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[5055]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 21:02:19 kjcf05n03 mlnx_interface_mgr[5056]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 21:02:19 kjcf05n03 mlnx_conf_mgr[5095]: INFO: No configurations found for mlx5_0, skipping. Nov 4 21:02:19 kjcf05n03 mlnx_conf_mgr[5096]: INFO: No configurations found for mlx5_1, skipping. Nov 4 21:02:19 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 21:02:19 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}e42ec93cd3bd0ea30becb277eebe0ee78248658c30e0a8657f56c592df112316' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}e42ec93cd3bd0ea30becb277eebe0ee78248658c30e0a8657f56c592df112316' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}399cb6a83fb6df721de7da9c517f8f739e3f27c1f2e08018e83d340f71ec317a' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}399cb6a83fb6df721de7da9c517f8f739e3f27c1f2e08018e83d340f71ec317a' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}4e17ac77337727da202bb8949c0b3cc63708b188f9de35b424bb94c878adde2c' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}4e17ac77337727da202bb8949c0b3cc63708b188f9de35b424bb94c878adde2c' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}624b75b742600e0963d5525f200421e41f7159be6a4c58d97d18ad27801b53cb' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}624b75b742600e0963d5525f200421e41f7159be6a4c58d97d18ad27801b53cb' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 21:02:19 kjcf05n03 systemd[1]: Stopping NTP client/server... Nov 4 21:02:19 kjcf05n03 chronyd[2137]: chronyd exiting Nov 4 21:02:19 kjcf05n03 systemd[1]: chronyd.service: Succeeded. Nov 4 21:02:19 kjcf05n03 systemd[1]: Stopped NTP client/server. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 4 21:02:19 kjcf05n03 chronyd[5130]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 21:02:19 kjcf05n03 chronyd[5130]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 21:02:19 kjcf05n03 chronyd[5130]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 21:02:19 kjcf05n03 chronyd[5130]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 4 21:02:19 kjcf05n03 systemd[1]: Started NTP client/server. Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 21:02:19 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:19 kjcf05n03 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 4 21:02:19 kjcf05n03 systemd[1]: dwd.service: Succeeded. Nov 4 21:02:19 kjcf05n03 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 21:02:19 kjcf05n03 dwd[5161]: dwd: vMay 29 2024 : 15:38:26 Nov 4 21:02:19 kjcf05n03 dwd[5161]: /usr/sbin/dwd -i 15 -d Nov 4 21:02:19 kjcf05n03 dwd[5161]: dwd: option Lethal: 0 Nov 4 21:02:19 kjcf05n03 dwd[5161]: dwd: option Interval: 15 Nov 4 21:02:19 kjcf05n03 dwd[5161]: dwd: option abrtlimit: 10 Nov 4 21:02:19 kjcf05n03 dwd[5161]: dwd: option DZPeriod: 604800 Nov 4 21:02:19 kjcf05n03 dwd[5161]: dwd: option SmartPeriod: 43200 Nov 4 21:02:19 kjcf05n03 dwd[5161]: dwd: option SDDEnabled: 1 Nov 4 21:02:19 kjcf05n03 dwd[5161]: dwd: option SDDAwaitScale: 3 Nov 4 21:02:19 kjcf05n03 dwd[5161]: dwd: option SDDAwaitMin: 100 Nov 4 21:02:19 kjcf05n03 dwd[5161]: dwd: option Verbosity: 1 Nov 4 21:02:19 kjcf05n03 dwd[5161]: dwd: option StandAlone: 0 Nov 4 21:02:19 kjcf05n03 dwd[5161]: option Lethal: 0 Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 21:02:19 kjcf05n03 dwd[5161]: option Interval: 15 Nov 4 21:02:19 kjcf05n03 dwd[5161]: option abrtlimit: 10 Nov 4 21:02:19 kjcf05n03 dwd[5161]: option DZPeriod: 604800 Nov 4 21:02:19 kjcf05n03 dwd[5161]: option SmartPeriod: 43200 Nov 4 21:02:19 kjcf05n03 dwd[5161]: option SDDEnabled: 1 Nov 4 21:02:19 kjcf05n03 dwd[5161]: option SDDAwaitScale: 3 Nov 4 21:02:19 kjcf05n03 dwd[5161]: option SDDAwaitMin: 100 Nov 4 21:02:19 kjcf05n03 dwd[5161]: option Verbosity: 1 Nov 4 21:02:19 kjcf05n03 dwd[5161]: option StandAlone: 0 Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 4 21:02:19 kjcf05n03 dwd[5162]: option Lethal now set to 1 Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 21:02:19 kjcf05n03 dwd[5162]: option abrtlimit now set to 1 Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 21:02:19 kjcf05n03 dwd[5162]: option SmartPeriod now set to 86400 Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 21:02:19 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 21:02:19 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Discard unused blocks. Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:19 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:19 kjcf05n03 python3.9[5191]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 4 21:02:19 kjcf05n03 python3.9[3163]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 21:02:19 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Periodic ZFS scrub. Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:19 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 21:02:19 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting Sed Control Plane worker process... Nov 4 21:02:19 kjcf05n03 sedcpwrkr[5330]: Using config script: /etc/sedcpwrkr.conf Nov 4 21:02:19 kjcf05n03 sedcpwrkr[5330]: - Creating default directory: '/var/log/sedcpwrkr' Nov 4 21:02:19 kjcf05n03 sedcpwrkr[5330]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 4 21:02:19 kjcf05n03 sedcpwrkr[5330]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 4 21:02:19 kjcf05n03 sedcpwrkr[5330]: - Creating default directory: '/var/run/sedcpwrkr' Nov 4 21:02:19 kjcf05n03 sedcpwrkr[5330]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 4 21:02:19 kjcf05n03 sedcpwrkr[5330]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 4 21:02:19 kjcf05n03 sedcpwrkr-server[5361]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 21:02:19 kjcf05n03 sedcpwrkr[5330]: celery multi v5.2.7 (dawn-chorus) Nov 4 21:02:19 kjcf05n03 sedcpwrkr[5330]: > Starting nodes... Nov 4 21:02:19 kjcf05n03 sedcpwrkr[5330]: > sedcpwrkr@kjcf05n03: OK Nov 4 21:02:19 kjcf05n03 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 4 21:02:19 kjcf05n03 sedcpwrkr-server[5363]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 21:02:19 kjcf05n03 sedcpwrkr-server[5363]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 21:02:19 kjcf05n03 sedcpwrkr-server[5363]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 21:02:19 kjcf05n03 systemd[1]: Started Sed Control Plane worker process. Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 21:02:19 kjcf05n03 systemd[1]: Reloading System Logger Daemon. Nov 4 21:02:19 kjcf05n03 systemd[1]: Reloaded System Logger Daemon. Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 21:02:19 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 4 21:02:19 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 4 21:02:19 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:19 kjcf05n03 systemd[1]: Starting IPv4 firewall with iptables... Nov 4 21:02:19 kjcf05n03 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 21:02:19 kjcf05n03 iptables.init[5430]: iptables: Applying firewall rules: [ OK ] Nov 4 21:02:19 kjcf05n03 systemd[1]: Started IPv4 firewall with iptables. Nov 4 21:02:20 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:20 kjcf05n03 systemd[3163]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:20 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:20 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:20 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 4 21:02:20 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 4 21:02:20 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 21:02:20 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 21:02:20 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 4 21:02:20 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 4 21:02:20 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 4 21:02:20 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 4 21:02:20 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 4 21:02:20 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 4 21:02:21 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 21:02:21 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 21:02:21 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 21:02:21 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 4 21:02:21 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 4 21:02:21 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 4 21:02:21 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 4 21:02:21 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 4 21:02:21 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 4 21:02:21 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 4 21:02:21 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 4 21:02:21 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 4 21:02:21 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 4 21:02:21 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 4 21:02:21 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 4 21:02:21 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 4 21:02:21 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 4 21:02:21 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 4 21:02:21 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 4 21:02:21 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 4 21:02:21 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 4 21:02:21 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 4 21:02:21 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 4 21:02:21 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 4 21:02:21 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 4 21:02:21 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 4 21:02:21 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 4 21:02:21 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 4 21:02:21 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 21:02:21 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 21:02:21 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 4 21:02:21 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 4 21:02:21 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 21:02:21 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 21:02:21 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 4 21:02:21 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 4 21:02:21 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 21:02:21 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 21:02:21 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 21:02:21 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 21:02:21 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:21 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 21:02:21 kjcf05n03 systemd[1]: openhpid.service: Supervising process 5527 which is not our child. We'll most likely not notice when it exits. Nov 4 21:02:21 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 21:02:21 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:21 kjcf05n03 openhpid[5527]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 21:02:21 kjcf05n03 openhpid[5527]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 21:02:21 kjcf05n03 openhpid[5527]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 21:02:21 kjcf05n03 openhpid[5527]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 21:02:21 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:22 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:22 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:22 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 4 21:02:22 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 4 21:02:22 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 21:02:22 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 21:02:22 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:22 kjcf05n03 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 4 21:02:22 kjcf05n03 dcs-collectord[5618]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 4 21:02:22 kjcf05n03 hpi.inv.log[5618]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 4 21:02:22 kjcf05n03 dcs-collectord[5618]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 4 21:02:22 kjcf05n03 dcs-collectord[5618]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 4 21:02:22 kjcf05n03 dcs-collector[5609]: Starting dcs-collector:[ OK ] Nov 4 21:02:22 kjcf05n03 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 4 21:02:22 kjcf05n03 dcs-collectord[5621]: INFO Starting collection for memory_info (collection_process.py:52) Nov 4 21:02:22 kjcf05n03 dcs-collectord[5621]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 21:02:22 kjcf05n03 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 4 21:02:22 kjcf05n03 dcs-collectord[5621]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 21:02:22 kjcf05n03 dcs-collectord[5621]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 21:02:22 kjcf05n03 dcs-collectord[5621]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 4 21:02:22 kjcf05n03 dcs-collectord[5621]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 4 21:02:22 kjcf05n03 dcs-collectord[5621]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 4 21:02:22 kjcf05n03 dcs-collectord[5621]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259347156", "units": "kB"}, {"name": "MemAvailable", "value": "258626712", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821324", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686952", "units": "kB"}, {"name": "Inactive", "value": "962772", "units": "kB"}, {"name": "Active(anon)", "value": "1520660", "units": "kB"}, {"name": "Inactive(anon)", "value": "826736", "units": "kB"}, {"name": "Active(file)", "value": "166292", "units": "kB"}, {"name": "Inactive(file)", "value": "136036", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "753592", "units": "kB"}, {"name": "Mapped", "value": "86096", "units": "kB"}, {"name": "Shmem", "value": "1593448", "units": "kB"}, {"name": "KReclaimable", "value": "108948", "units": "kB"}, {"name": "Slab", "value": "274996", "units": "kB"}, {"name": "SReclaimable", "value": "108948", "units": "kB"}, {"name": "SUnreclaim", "value": "166048", "units": "kB"}, {"name": "KernelStack", "value": "9712", "units": "kB"}, {"name": "PageTables", "value": "19964", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3152676", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11264", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "0", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "280904", "units": "kB"}, {"name": "DirectMap2M", "value": "21604352", "units": "kB"}, {"name": "DirectMap1G", "value": "246415360", "units": "kB"}]}' Nov 4 21:02:22 kjcf05n03 dcs-collectord[5621]: INFO Completed collection for memory_info (collection_process.py:59) Nov 4 21:02:22 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:23 kjcf05n03 systemd[3163]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:23 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:23 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:23 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 4 21:02:23 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 4 21:02:23 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 21:02:23 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 21:02:23 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:23 kjcf05n03 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 4 21:02:23 kjcf05n03 firmware-update-orc[5702]: Using config script: /etc/firmware_update_orc.conf Nov 4 21:02:23 kjcf05n03 firmware-update-orc[5702]: - Creating default directory: '/var/log/firmware-update-orc' Nov 4 21:02:23 kjcf05n03 firmware-update-orc[5702]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 4 21:02:23 kjcf05n03 firmware-update-orc[5702]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 4 21:02:23 kjcf05n03 firmware-update-orc[5702]: - Creating default directory: '/var/run/firmware-update-orc' Nov 4 21:02:23 kjcf05n03 firmware-update-orc[5702]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 4 21:02:23 kjcf05n03 firmware-update-orc[5702]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 4 21:02:24 kjcf05n03 dcs-collectord[5621]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 4 21:02:24 kjcf05n03 dcs-collectord[5621]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730775742.5695229], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730775743.7450147], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730775742.5032496, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 4 21:02:24 kjcf05n03 firmware-update-orc-server[5739]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 21:02:24 kjcf05n03 firmware-update-orc[5702]: celery multi v5.2.7 (dawn-chorus) Nov 4 21:02:24 kjcf05n03 firmware-update-orc[5702]: > Starting nodes... Nov 4 21:02:24 kjcf05n03 firmware-update-orc[5702]: > worker1@kjcf05n03: OK Nov 4 21:02:24 kjcf05n03 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 4 21:02:24 kjcf05n03 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 4 21:02:24 kjcf05n03 firmware-update-orc-server[5767]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 21:02:24 kjcf05n03 firmware-update-orc-server[5767]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 21:02:24 kjcf05n03 firmware-update-orc-server[5767]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 21:02:24 kjcf05n03 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 4 21:02:24 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:24 kjcf05n03 systemd[3163]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:24 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:24 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:24 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 21:02:24 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 21:02:24 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 21:02:24 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 21:02:24 kjcf05n03 dbus-daemon[2187]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 21:02:24 kjcf05n03 dbus-daemon[2187]: [system] Reloaded configuration Nov 4 21:02:24 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 4 21:02:24 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 4 21:02:24 kjcf05n03 dbus-daemon[2187]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 21:02:24 kjcf05n03 dbus-daemon[2187]: [system] Reloaded configuration Nov 4 21:02:24 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 21:02:24 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 21:02:24 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 21:02:24 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 21:02:24 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:24 kjcf05n03 systemd[1]: Starting Manages hardware resources... Nov 4 21:02:25 kjcf05n03 ras-resource-manager-agent[5883]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 4 21:02:25 kjcf05n03 ras-resource-manager-agent[5869]: Starting ras-resource-manager-agent:[ OK ] Nov 4 21:02:25 kjcf05n03 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 4 21:02:25 kjcf05n03 ras-resource-manager-agent[5885]: INFO Starting the service handler (service_main_handler.py:98) Nov 4 21:02:25 kjcf05n03 ras-resource-manager-client[5885]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 4 21:02:25 kjcf05n03 systemd[1]: Started Manages hardware resources. Nov 4 21:02:25 kjcf05n03 ras-resource-manager-client[5885]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 21:02:25 kjcf05n03 ras-resource-manager-client[5895]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 21:02:25 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:25 kjcf05n03 systemd[3163]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:25 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:25 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:25 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 21:02:25 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 21:02:26 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:26 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 4 21:02:26 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:26 kjcf05n03 systemd[3163]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: Press Ctrl+C to exit. Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: Plugin support version 1.0 Nov 4 21:02:26 kjcf05n03 zabbix_agent2[5969]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 21:02:26 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:26 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:26 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:27 kjcf05n03 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 4 21:02:27 kjcf05n03 dcs-notification-sender[6046]: dcs-notification-senderd is stopped Nov 4 21:02:27 kjcf05n03 zabbix-agent2[6064]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 4 21:02:27 kjcf05n03 dcs-notification-sender[6046]: Starting notification-sender:[ OK ] Nov 4 21:02:27 kjcf05n03 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 4 21:02:27 kjcf05n03 zabbix-agent2[6066]: INFO DCS notification agent started. (agent.py:61) Nov 4 21:02:27 kjcf05n03 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 4 21:02:27 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:27 kjcf05n03 systemd[3163]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:27 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:27 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:27 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:28 kjcf05n03 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 4 21:02:28 kjcf05n03 dcs-collectord[6171]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 4 21:02:28 kjcf05n03 dcs-collectord[6171]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 4 21:02:28 kjcf05n03 dcs-bulk-data-sender[6171]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 4 21:02:28 kjcf05n03 dcs-bulk-data-sender[6162]: Starting bulk-data-sender:[ OK ] Nov 4 21:02:28 kjcf05n03 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 4 21:02:28 kjcf05n03 dcs-collectord[6173]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 4 21:02:28 kjcf05n03 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 4 21:02:28 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:28 kjcf05n03 systemd[3163]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:28 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:28 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:28 kjcf05n03 nscd[2240]: 2240 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 4 21:02:28 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 21:02:28 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 21:02:28 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 21:02:28 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 21:02:28 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 21:02:28 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 21:02:28 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 4 21:02:28 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 4 21:02:28 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 4 21:02:28 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 4 21:02:28 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 21:02:28 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 21:02:28 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 21:02:28 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 21:02:28 kjcf05n00 mcfcli[3673891]: %3|1730775748.763|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:02:29 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 21:02:29 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 21:02:29 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 21:02:29 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 21:02:29 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 4 21:02:29 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 4 21:02:29 kjcf05n03 systemd[1]: Stopping System Security Services Daemon... Nov 4 21:02:29 kjcf05n03 sssd[nss][2512]: Shutting down (status = 0) Nov 4 21:02:29 kjcf05n03 sssd[be[implicit_files]][2422]: Shutting down (status = 0) Nov 4 21:02:29 kjcf05n03 systemd[1]: sssd.service: Succeeded. Nov 4 21:02:29 kjcf05n03 systemd[1]: Stopped System Security Services Daemon. Nov 4 21:02:29 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 4 21:02:29 kjcf05n03 sssd[sssd][6237]: Starting up Nov 4 21:02:30 kjcf05n03 python3.9[5191]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 4 21:02:30 kjcf05n03 python3.9[3163]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:30 kjcf05n03 sssd[be[implicit_files]][6238]: Starting up Nov 4 21:02:30 kjcf05n03 sssd[nss][6251]: Starting up Nov 4 21:02:30 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 4 21:02:30 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 21:02:30 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 21:02:31 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 21:02:31 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 21:02:31 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 4 21:02:31 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 4 21:02:31 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 21:02:31 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 21:02:31 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure) defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 4 21:02:31 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure: defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 4 21:02:31 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure) defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 4 21:02:31 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure: defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 4 21:02:31 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 21:02:31 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 21:02:31 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 21:02:31 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 21:02:31 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:02:31 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:02:31 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:31 kjcf05n03 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 4 21:02:32 kjcf05n03 icinga2[6299]: [2024-11-04 21:02:31 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 4 21:02:32 kjcf05n03 icinga2[6299]: [2024-11-04 21:02:31 -0600] information/cli: Loading configuration file(s). Nov 4 21:02:32 kjcf05n03 icinga2[6299]: [2024-11-04 21:02:31 -0600] information/ConfigItem: Committing config item(s). Nov 4 21:02:32 kjcf05n03 icinga2[6299]: [2024-11-04 21:02:31 -0600] information/ApiListener: My API identity: kjcf05n03 Nov 4 21:02:32 kjcf05n03 icinga2[6299]: [2024-11-04 21:02:31 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 4 21:02:32 kjcf05n03 icinga2[6299]: [2024-11-04 21:02:31 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 4 21:02:32 kjcf05n03 icinga2[6299]: [2024-11-04 21:02:31 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 4 21:02:32 kjcf05n03 icinga2[6299]: [2024-11-04 21:02:31 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 4 21:02:32 kjcf05n03 icinga2[6299]: [2024-11-04 21:02:31 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 4 21:02:32 kjcf05n03 icinga2[6299]: [2024-11-04 21:02:31 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 4 21:02:32 kjcf05n03 icinga2[6299]: [2024-11-04 21:02:31 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 4 21:02:32 kjcf05n03 icinga2[6299]: [2024-11-04 21:02:31 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 4 21:02:32 kjcf05n03 icinga2[6299]: [2024-11-04 21:02:31 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 4 21:02:32 kjcf05n03 icinga2[6299]: [2024-11-04 21:02:31 -0600] information/cli: Closing console log. Nov 4 21:02:32 kjcf05n03 systemd[1]: Started Icinga host/service/network monitoring system. Nov 4 21:02:32 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:32 kjcf05n03 systemd[3163]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:32 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:32 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:33 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 21:02:33 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 21:02:33 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:33 kjcf05n03 systemd[1]: Started Icinga2 network monitor. Nov 4 21:02:33 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:33 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 21:02:33 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:33 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:34 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 21:02:34 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 21:02:34 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 21:02:34 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 21:02:34 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 4 21:02:34 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 4 21:02:34 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 4 21:02:34 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 4 21:02:34 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 21:02:34 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 21:02:34 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 21:02:34 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 21:02:34 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 4 21:02:34 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 4 21:02:34 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:34 kjcf05n03 systemd[1]: Starting Naming services LDAP client daemon.... Nov 4 21:02:34 kjcf05n03 nslcd[6913]: version 0.9.9 starting Nov 4 21:02:34 kjcf05n03 nslcd[6913]: accepting connections Nov 4 21:02:34 kjcf05n03 systemd[1]: Started Naming services LDAP client daemon.. Nov 4 21:02:34 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:35 kjcf05n03 systemd[3163]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:35 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:35 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:35 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 21:02:35 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 21:02:35 kjcf05n03 dcs-bulk-data-sender[6173]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 4 21:02:35 kjcf05n03 dcs-collectord[6173]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 4 21:02:35 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 21:02:35 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 21:02:35 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 21:02:35 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 21:02:36 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 21:02:36 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 21:02:36 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:36 kjcf05n03 systemd[1]: Starting DEAR Control Plane worker process... Nov 4 21:02:36 kjcf05n03 dearcpw[7155]: Using config script: /etc/dearcpw.conf Nov 4 21:02:36 kjcf05n03 dearcpw[7155]: - Creating default directory: '/var/log/dearcpw' Nov 4 21:02:36 kjcf05n03 dearcpw[7155]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 4 21:02:36 kjcf05n03 dearcpw[7155]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 4 21:02:36 kjcf05n03 dearcpw[7155]: - Creating default directory: '/var/run/dearcpw' Nov 4 21:02:36 kjcf05n03 dearcpw[7155]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 4 21:02:36 kjcf05n03 dearcpw[7155]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 4 21:02:37 kjcf05n03 dearcpw-server[7195]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 21:02:37 kjcf05n03 dearcpw[7155]: celery multi v5.2.7 (dawn-chorus) Nov 4 21:02:37 kjcf05n03 dearcpw[7155]: > Starting nodes... Nov 4 21:02:37 kjcf05n03 dearcpw[7155]: > dearcpw@kjcf05n03: OK Nov 4 21:02:37 kjcf05n03 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 4 21:02:37 kjcf05n03 dearcpw-server[7197]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 21:02:37 kjcf05n03 dearcpw-server[7197]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 21:02:37 kjcf05n03 dearcpw-server[7197]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 21:02:37 kjcf05n03 systemd[1]: Started DEAR Control Plane worker process. Nov 4 21:02:37 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:37 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:37 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 4 21:02:37 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 4 21:02:37 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 4 21:02:37 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 4 21:02:37 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 4 21:02:37 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 4 21:02:37 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 4 21:02:37 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 4 21:02:37 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 4 21:02:37 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 4 21:02:37 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:44074). Nov 4 21:02:37 kjcf05n01 rsyncd[3896855]: connect from kjcf05n03 (172.16.2.6) Nov 4 21:02:37 kjcf05n01 rsyncd[3896855]: rsync to puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 4 21:02:37 kjcf05n01 rsyncd[3896855]: receiving file list Nov 4 21:02:37 kjcf05n01 rsyncd[3896855]: sent 29 bytes received 325 bytes total size 10901 Nov 4 21:02:37 kjcf05n01 systemd[1]: rsyncd@664-172.16.2.2:873-172.16.2.6:44074.service: Succeeded. Nov 4 21:02:37 kjcf05n03 puppet[7398]: IEC: 017000000: Node is up and running: { "node": "kjcf05n03" } Nov 4 21:02:37 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 4 21:02:37 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 4 21:02:37 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 4 21:02:37 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 4 21:02:37 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 4 21:02:37 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 4 21:02:37 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 21:02:37 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 21:02:37 kjcf05n03 dcs-collectord[5621]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 21:02:37 kjcf05n03 dcs-collectord[5621]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 21:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 21:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 21:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 21:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 21:02:38 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 21:02:38 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 21:02:38 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 21:02:38 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 21:02:38 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 21:02:38 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 21:02:39 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 21:02:39 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 21:02:39 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 21:02:39 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 21:02:40 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 21:02:40 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 21:02:40 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 21:02:40 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 21:02:40 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 21:02:40 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 21:02:40 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:40 kjcf05n03 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 4 21:02:40 kjcf05n03 diskless-swap[7579]: HA_PS_000: recovering journal Nov 4 21:02:40 kjcf05n03 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 21:02:40 kjcf05n03 diskless-swap[7579]: HA_PS_000: clean, 2285/6400 files, 7056/25600 blocks Nov 4 21:02:40 kjcf05n03 diskless-swap[7579]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 4 21:02:41 kjcf05n03 diskless-swap[7579]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 4 21:02:41 kjcf05n03 diskless-swap[7579]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 4 21:02:41 kjcf05n03 diskless-swap[7579]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 4 21:02:41 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 4 21:02:41 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:41 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:41 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 4 21:02:41 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 4 21:02:41 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 21:02:41 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 21:02:41 kjcf05n03 systemd[1]: Stopping OpenSSH server daemon... Nov 4 21:02:41 kjcf05n03 systemd[1]: sshd.service: Succeeded. Nov 4 21:02:41 kjcf05n03 systemd[1]: Stopped OpenSSH server daemon. Nov 4 21:02:41 kjcf05n03 systemd[1]: Stopped target sshd-keygen.target. Nov 4 21:02:41 kjcf05n03 systemd[1]: Stopping sshd-keygen.target. Nov 4 21:02:41 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 4 21:02:41 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 4 21:02:41 kjcf05n03 ipmievd[3965]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 4 21:02:41 kjcf05n03 ipmievd[3965]: System Event sensor - Timestamp Clock Sync Nov 4 21:02:41 kjcf05n03 ipmievd[3163]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:41 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 4 21:02:41 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 4 21:02:41 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 4 21:02:42 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 21:02:42 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 21:02:42 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 21:02:42 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 21:02:42 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 21:02:42 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 21:02:43 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 21:02:43 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 21:02:43 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 21:02:43 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 21:02:43 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 21:02:43 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 21:02:43 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 21:02:43 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 21:02:44 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 21:02:44 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 21:02:44 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 21:02:44 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 21:02:44 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:45 kjcf05n03 systemd[1]: Set up automount opt-firmware.automount. Nov 4 21:02:45 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:45 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:45 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 4 21:02:45 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 4 21:02:45 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:45 kjcf05n03 systemd[1]: Set up automount mnt-llog.automount. Nov 4 21:02:45 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:45 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:45 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 21:02:45 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 21:02:45 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:45 kjcf05n03 systemd[1]: Set up automount usr-share-man.automount. Nov 4 21:02:45 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:02:45 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:02:45 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 4 21:02:45 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 4 21:02:45 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 4 21:02:45 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 4 21:02:45 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 4 21:02:45 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 4 21:02:45 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 21:02:45 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 21:02:45 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 21:02:45 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 21:02:45 kjcf05n03 systemd[1]: Reloading. Nov 4 21:02:46 kjcf05n03 systemd[1]: Starting Crash recovery kernel arming... Nov 4 21:02:46 kjcf05n03 kdumpctl[7811]: kdump: No kdump initial ramdisk found. Nov 4 21:02:46 kjcf05n03 kdumpctl[7811]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 4 21:02:46 kjcf05n03 dracut[7937]: dracut-049-135.git20210121.el8 Nov 4 21:02:46 kjcf05n03 dracut[7939]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 4 21:02:46 kjcf05n03 dracut[7939]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 21:02:46 kjcf05n03 dracut[7939]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 21:02:46 kjcf05n03 dracut[7939]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 4 21:02:46 kjcf05n03 dracut[7939]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 4 21:02:46 kjcf05n03 dracut[7939]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 21:02:46 kjcf05n03 dracut[7939]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 21:02:46 kjcf05n03 dracut[7939]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 21:02:46 kjcf05n03 kdumpctl[7811]: + is_func check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check -h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local dev holder Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + require_binaries mdadm expr Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _module_name=90hperaid Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ mdadm = \-\m ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for cmd in "$@" Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + find_binary mdadm Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for cmd in "$@" Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + find_binary expr Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n -h ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for dev in "${!host_fs_types[@]}" Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ nfs != *_raid_member ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + continue Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _ret=255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + ret=255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ 255 = 0 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ 255 = 255 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ module_depends hperaid Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: +++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: +++ set -x Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ depends Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo rootfs-block Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ return 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ _ret=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ return 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for _moddep in $(module_depends $_mod) Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all == *\ hperaid\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + add_dracutmodules+=' rootfs-block ' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ == *\ hperaid\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check_module rootfs-block Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _mod=rootfs-block Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ == *\ rootfs-block\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n '' ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + mods_checked_as_dep+=' rootfs-block ' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all == *\ rootfs-block\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + module_check rootfs-block 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 2 -eq 2 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _forced=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + is_func check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check -h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _ret=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + ret=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ 0 = 0 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ module_depends rootfs-block Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: +++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 21:02:47 kjcf05n03 kdumpctl[3163]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ depends Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo fs-lib Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ _ret=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ return 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for _moddep in $(module_depends $_mod) Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all == *\ rootfs-block\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + add_dracutmodules+=' fs-lib ' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ == *\ rootfs-block\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check_module fs-lib Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _mod=fs-lib Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n '' ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + mods_checked_as_dep+=' fs-lib ' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all == *\ fs-lib\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + module_check fs-lib 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 2 -eq 2 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _forced=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + is_func check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check -h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _ret=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + ret=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ 0 = 0 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ module_depends fs-lib Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: +++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ depends Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ return 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ _ret=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ return 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + mods_to_load+=' fs-lib ' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + mods_to_load+=' rootfs-block ' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + mods_to_load+=' hperaid ' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _mod=90kernel-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _mod=kernel-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check_module kernel-modules 1 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _mod=kernel-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all = all ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + module_check kernel-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 1 -eq 2 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + is_func check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check -h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + true Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _ret=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + ret=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ 0 != 0 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ module_depends kernel-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: +++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ depends Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ true Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ _ret=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ return 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + mods_to_load+=' kernel-modules ' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _mod=90kernel-modules-extra Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _mod=kernel-modules-extra Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check_module kernel-modules-extra 1 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _mod=kernel-modules-extra Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all = all ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + module_check kernel-modules-extra Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 1 -eq 2 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + is_func check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check -h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + true Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _ret=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + ret=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ 0 != 0 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ module_depends kernel-modules-extra Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: +++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ depends Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ true Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ _ret=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ return 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + mods_to_load+=' kernel-modules-extra ' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _mod=90kernel-network-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _mod=kernel-network-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check_module kernel-network-modules 1 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _mod=kernel-network-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all = all ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + module_check kernel-network-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 1 -eq 2 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + is_func check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check -h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _ret=255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + ret=255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ 255 != 0 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 1 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _mod=90livenet Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _mod=livenet Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check_module livenet 1 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _mod=livenet Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all = all ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + module_check livenet Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 1 -eq 2 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + is_func check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check -h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _ret=255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + ret=255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ 255 != 0 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 1 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _mod=90lvm Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _mod=lvm Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check_module lvm 1 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _mod=lvm Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all = all ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + module_check lvm Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 1 -eq 2 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + is_func check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check -h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + require_binaries lvm Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _module_name=90lvm Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ lvm = \-\m ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for cmd in "$@" Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + find_binary lvm Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n -h ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for fs in "${host_fs_types[@]}" Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ nfs = LVM*_member ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _ret=255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + ret=255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ 255 != 0 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 1 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _mod=90mdraid Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _mod=mdraid Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check_module mdraid 1 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _mod=mdraid Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all = all ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + module_check mdraid Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 1 -eq 2 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + is_func check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check -h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _rootdev Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + require_binaries mdadm expr Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _module_name=90mdraid Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ mdadm = \-\m ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for cmd in "$@" Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + find_binary mdadm Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for cmd in "$@" Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + find_binary expr Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n -h ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for dev in "${!host_fs_types[@]}" Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ nfs != *_raid_member ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + continue Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _ret=255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + ret=255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ 255 != 0 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 1 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _mod=90multipath Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _mod=multipath Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check_module multipath 1 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _mod=multipath Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all = all ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + module_check multipath Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 1 -eq 2 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + is_func check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check -h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _rootdev Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n -h ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for_each_host_dev_and_slaves is_mpath Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _func=is_mpath Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _dev Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for _dev in "${host_devs[@]}" Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + continue Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 1 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _ret=255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + ret=255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ 255 != 0 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 1 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _mod=90qemu Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _mod=qemu Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check_module qemu 1 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _mod=qemu Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all = all ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + module_check qemu Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 1 -eq 2 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + is_func check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check -h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n -h ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + type -P systemd-detect-virt Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ systemd-detect-virt --vm Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + vm=none Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + (( 1 != 0 )) Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _ret=255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + ret=255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ 255 != 0 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 1 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _mod=90qemu-net Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _mod=qemu-net Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check_module qemu-net 1 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _mod=qemu-net Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all = all ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + module_check qemu-net Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 1 -eq 2 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + is_func check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check -h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n -h ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + type -P systemd-detect-virt Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ systemd-detect-virt --vm Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + vm= Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + (( 1 != 0 )) Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _ret=255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + ret=255 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ 255 != 0 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + return 1 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _mod=90stratis Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + _mod=stratis Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check_module stratis 1 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _mod=stratis Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddep Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -n 1 ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ all = all ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + module_check stratis Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ read a b Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _forced=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _hostonly=-h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 1 -eq 2 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + is_func check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: ++ type -t check Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + '[' 0 -ne 0 ']' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + check -h Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _module_name=90stratis Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + local _ret=0 Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + [[ stratisd-init = \-\m ]] Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + for cmd in "$@" Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + find_binary stratisd-init Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 4 21:02:47 kjcf05n03 kdumpctl[7811]: + set +x Nov 4 21:02:47 kjcf05n03 dracut[7939]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 21:02:47 kjcf05n03 dracut[7939]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 4 21:02:47 kjcf05n03 dracut[7939]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 4 21:02:47 kjcf05n00 mcfcli[3673891]: %3|1730775767.019|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:02:47 kjcf05n03 dracut[7939]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 4 21:02:47 kjcf05n03 dracut[7939]: memstrack is available Nov 4 21:02:47 kjcf05n03 dracut[7939]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 21:02:47 kjcf05n03 dracut[7939]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 21:02:47 kjcf05n03 dracut[7939]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 21:02:47 kjcf05n03 dracut[7939]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 21:02:47 kjcf05n03 dracut[7939]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 21:02:47 kjcf05n03 dracut[7939]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 21:02:48 kjcf05n03 dracut[7939]: *** Including module: bash *** Nov 4 21:02:48 kjcf05n03 dracut[7939]: *** Including module: systemd *** Nov 4 21:02:48 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib0 Nov 4 21:02:48 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib0 Nov 4 21:02:48 kjcf05n03 dracut[7939]: *** Including module: fips *** Nov 4 21:02:48 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n03": interface became available Nov 4 21:02:49 kjcf05n03 dracut[7939]: *** Including module: systemd-initrd *** Nov 4 21:02:49 kjcf05n03 dracut[7939]: *** Including module: watchdog-modules *** Nov 4 21:02:49 kjcf05n03 dracut[7939]: *** Including module: nss-softokn *** Nov 4 21:02:49 kjcf05n03 dracut[7939]: *** Including module: i18n *** Nov 4 21:02:49 kjcf05n03 dracut[7939]: No KEYMAP configured. Nov 4 21:02:49 kjcf05n03 dracut[7939]: *** Including module: network-legacy *** Nov 4 21:02:49 kjcf05n03 dracut[7939]: *** Including module: network *** Nov 4 21:02:49 kjcf05n03 dracut[7939]: *** Including module: ib_bonding *** Nov 4 21:02:49 kjcf05n03 dracut[7939]: *** Including module: drm *** Nov 4 21:02:50 kjcf05n00 zabbix-server[2448868]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:02:50 kjcf05n00 zabbix-server[2448868]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n03 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n03:system.uptime): 00:02:42\\"}}"' Nov 4 21:02:50 kjcf05n00 log_interesting_event.py[2448868]: Event '46663' acknowledged Nov 4 21:02:50 kjcf05n00 zabbix-server[2448870]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:02:50 kjcf05n00 zabbix-server[2448870]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 4 21:02:50 kjcf05n00 log_interesting_event.py[2448870]: Event '46665' acknowledged Nov 4 21:02:50 kjcf05n00 zabbix-server[2448873]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:02:50 kjcf05n00 zabbix-server[2448873]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 4 21:02:51 kjcf05n00 log_interesting_event.py[2448873]: Event '46666' acknowledged Nov 4 21:02:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730775771', 'host':'kjcf05n03', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 4 21:02:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730775771'} Nov 4 21:02:52 kjcf05n02 LCNmon[17967]: 10.16.100.53 is unreachable via ib1 Nov 4 21:02:52 kjcf05n02 LCNmon[17967]: 10.16.100.59 is unreachable via ib1 Nov 4 21:02:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:02:52 kjcf05n03 dcs-collectord[5621]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 21:02:52 kjcf05n03 dcs-collectord[5621]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 21:02:53 kjcf05n03 dracut[7939]: *** Including module: hperaid *** Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + install Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + local rule rule_path Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + inst_multiple cat expr Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.2Rvc7i/initramfs -a -f cat expr Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + _ret=0 Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + (( 0 != 0 )) Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + : Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + return 0 Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + inst_multiple -o mdmon Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.2Rvc7i/initramfs -a -f -o mdmon Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + _ret=0 Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + (( 0 != 0 )) Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + : Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + return 0 Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: ++ command -v partx Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + inst /usr/sbin/partx /sbin/partx Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + local _hostonly_install Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + [[ /usr/sbin/partx == \-\H ]] Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + [[ -e /tmp/dracut.2Rvc7i/initramfs//sbin/partx ]] Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.2Rvc7i/initramfs -f /usr/sbin/partx /sbin/partx Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + (( 0 != 0 )) Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + : Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: ++ command -v mdadm Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + local _hostonly_install Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + [[ -e /tmp/dracut.2Rvc7i/initramfs//sbin/mdadm ]] Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.2Rvc7i/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + (( 0 != 0 )) Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + : Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + [[ yes == \y\e\s ]] Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + local _raidconf Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: ++ cmdline Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: ++ local _activated dev line UUID Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: ++ declare -A _activated Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: ++ for dev in "${!host_fs_types[@]}" Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: ++ [[ nfs != *_raid_member ]] Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: ++ continue Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + _raidconf= Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + [[ -n '' ]] Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + inst_rules 64-md-raid.rules Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + local _target=/etc/udev/rules.d _rule _found Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + inst_dir /usr/lib/udev/rules.d Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + [[ -e /tmp/dracut.2Rvc7i/initramfs//usr/lib/udev/rules.d ]] Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + return 0 Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + inst_dir /etc/udev/rules.d Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + [[ -e /tmp/dracut.2Rvc7i/initramfs//etc/udev/rules.d ]] Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + return 0 Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + for _rule in "$@" Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + continue Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + continue Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + for r in '' $dracutbasedir/rules.d/ Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + [[ 64-md-raid.rules != /* ]] Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + continue Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + for r in '' $dracutbasedir/rules.d/ Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + continue Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + [[ -n '' ]] Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + set +x Nov 4 21:02:53 kjcf05n03 dracut[7939]: Skipping udev rule: 64-md-raid.rules Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + installkernel Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + instmods =drivers/md Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + local _optional=-o Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + local _silent Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + local _ret Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + [[ '' = yes ]] Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + [[ =drivers/md = \-\c ]] Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + [[ =drivers/md = \-\s ]] Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + (( 1 == 0 )) Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.2Rvc7i/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + _ret=0 Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + (( 0 != 0 )) Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + [[ -n '' ]] Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + return 0 Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + _ret=0 Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + unset check depends cmdline install installkernel Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + return 0 Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + modules_loaded+='hperaid ' Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + '[' -n '' ']' Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + _d_mod=90kernel-modules Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + _d_mod=kernel-modules Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + [[ '' = yes ]] Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + dinfo '*** Including module: kernel-modules ***' Nov 4 21:02:53 kjcf05n03 kdumpctl[7811]: + set +x Nov 4 21:02:53 kjcf05n03 dracut[7939]: *** Including module: kernel-modules *** Nov 4 21:02:53 kjcf05n03 dracut[7939]: *** Including module: kernel-modules-extra *** Nov 4 21:02:54 kjcf05n03 dracut[7939]: *** Including module: kernel-network-modules *** Nov 4 21:02:54 kjcf05n03 dracut[7939]: *** Including module: diskless-mod *** Nov 4 21:02:54 kjcf05n03 dracut[7939]: *** Including module: fstab-sys *** Nov 4 21:02:54 kjcf05n03 dracut[7939]: *** Including module: nfs *** Nov 4 21:02:55 kjcf05n03 dracut[7939]: *** Including module: rootfs-block *** Nov 4 21:02:55 kjcf05n03 dracut[7939]: *** Including module: terminfo *** Nov 4 21:02:55 kjcf05n03 dracut[7939]: *** Including module: udev-rules *** Nov 4 21:02:55 kjcf05n03 dracut[7939]: Skipping udev rule: 91-permissions.rules Nov 4 21:02:55 kjcf05n03 dracut[7939]: Skipping udev rule: 80-drivers-modprobe.rules Nov 4 21:02:55 kjcf05n03 dracut[7939]: *** Including module: dracut-systemd *** Nov 4 21:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 21:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 21:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 21:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 21:02:56 kjcf05n03 dracut[7939]: *** Including module: usrmount *** Nov 4 21:02:56 kjcf05n03 dracut[7939]: *** Including module: base *** Nov 4 21:02:56 kjcf05n03 dracut[7939]: *** Including module: fs-lib *** Nov 4 21:02:56 kjcf05n03 dracut[7939]: *** Including module: kdumpbase *** Nov 4 21:02:57 kjcf05n03 dracut[7939]: *** Including module: memstrack *** Nov 4 21:02:57 kjcf05n03 dracut[7939]: *** Including module: shutdown *** Nov 4 21:02:57 kjcf05n03 dracut[7939]: *** Including module: squash *** Nov 4 21:02:57 kjcf05n03 dracut[7939]: *** Including modules done *** Nov 4 21:02:57 kjcf05n03 dracut[7939]: *** Installing kernel module dependencies *** Nov 4 21:02:57 kjcf05n03 dracut[7939]: *** Installing kernel module dependencies done *** Nov 4 21:02:58 kjcf05n03 dracut[7939]: *** Resolving executable dependencies *** Nov 4 21:02:59 kjcf05n03 dracut[7939]: *** Resolving executable dependencies done*** Nov 4 21:02:59 kjcf05n03 dracut[7939]: *** Hardlinking files *** Nov 4 21:02:59 kjcf05n03 dracut[7939]: *** Hardlinking files done *** Nov 4 21:02:59 kjcf05n03 dracut[7939]: *** Generating early-microcode cpio image *** Nov 4 21:02:59 kjcf05n03 dracut[7939]: *** Constructing AuthenticAMD.bin **** Nov 4 21:02:59 kjcf05n03 dracut[7939]: *** Store current command line parameters *** Nov 4 21:02:59 kjcf05n03 dracut[7939]: Stored kernel commandline: Nov 4 21:02:59 kjcf05n03 dracut[7939]: rd.driver.pre=sd_mod Nov 4 21:02:59 kjcf05n03 dracut[7939]: rd.driver.pre=nvme Nov 4 21:02:59 kjcf05n03 dracut[7939]: rd.driver.pre=ipmi_si Nov 4 21:02:59 kjcf05n03 dracut[7939]: rd.driver.pre=ipmi_devintf Nov 4 21:02:59 kjcf05n03 dracut[7939]: rd.driver.pre=ipmi_msghandler Nov 4 21:02:59 kjcf05n03 dracut[7939]: nameserver=172.16.2.2 Nov 4 21:02:59 kjcf05n03 dracut[7939]: nameserver=127.0.0.1 Nov 4 21:02:59 kjcf05n03 dracut[7939]: nameserver=172.16.2.2 Nov 4 21:02:59 kjcf05n03 dracut[7939]: nameserver=127.0.0.1 Nov 4 21:02:59 kjcf05n03 dracut[7939]: ifname=kdump-meth0:00:09:3d:06:9a:1a team=mgmt0:kdump-meth0 Nov 4 21:02:59 kjcf05n03 dracut[7939]: rd.neednet Nov 4 21:02:59 kjcf05n03 dracut[7939]: kdumpnic=mgmt0 Nov 4 21:02:59 kjcf05n03 dracut[7939]: bootdev=mgmt0 Nov 4 21:02:59 kjcf05n03 dracut[7939]: *** Install squash loader *** Nov 4 21:02:59 kjcf05n03 dracut[7939]: *** Squashing the files inside the initramfs *** Nov 4 21:03:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 21:03:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 21:03:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 21:03:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 21:03:00 kjcf05n03 dracut[7939]: *** Squashing the files inside the initramfs done *** Nov 4 21:03:00 kjcf05n03 dracut[7939]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 4 21:03:00 kjcf05n03 dracut[7939]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 4 21:03:01 kjcf05n03 kdumpctl[7811]: kdump: kexec: loaded kdump kernel Nov 4 21:03:01 kjcf05n03 kdumpctl[7811]: kdump: Starting kdump: [OK] Nov 4 21:03:01 kjcf05n03 systemd[1]: Started Crash recovery kernel arming. Nov 4 21:03:01 kjcf05n03 systemd[1]: Reloading. Nov 4 21:03:01 kjcf05n03 systemd[3163]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:03:01 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:03:01 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:03:01 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 4 21:03:01 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 4 21:03:01 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 4 21:03:01 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 4 21:03:01 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 4 21:03:01 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 4 21:03:01 kjcf05n03 ifdown[14526]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 21:03:01 kjcf05n03 ifdown[14527]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:03:01 kjcf05n03 ifdown[14528]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:03:01 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 21:03:01 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 21:03:01 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 21:03:02 kjcf05n03 ifup[14588]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 21:03:02 kjcf05n03 ifup[14589]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:03:02 kjcf05n03 ifup[14590]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:03:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730775782', 'host':'kjcf05n03', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.4% (3690812 kB) used.'}"] Nov 4 21:03:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'RAM usage', 'description': 'OK - 1.4% (3690812 kB) used.', 'message': 'OK - 1.4% (3690812 kB) used.', 'value': 'ok', 'timestamp': '1730775782'} Nov 4 21:03:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:03:03 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 4 21:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730775785', 'host':'kjcf05n03', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 4 21:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730775785', 'host':'kjcf05n03', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 4 21:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730775785'} Nov 4 21:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730775785'} Nov 4 21:03:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:03:06 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 21:03:06 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 21:03:06 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 21:03:06 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 21:03:06 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:03:06 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:03:06 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:03:06 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:03:06 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 21:03:06 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 21:03:06 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 21:03:06 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 21:03:06 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:03:06 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:03:06 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:03:06 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:03:06 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 4 21:03:06 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 4 21:03:06 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 4 21:03:06 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 4 21:03:06 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 4 21:03:06 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 4 21:03:06 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 4 21:03:06 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 4 21:03:06 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 4 21:03:06 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 4 21:03:06 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 4 21:03:06 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 4 21:03:06 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 4 21:03:06 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 4 21:03:06 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 4 21:03:06 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 4 21:03:06 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 4 21:03:06 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 4 21:03:06 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 4 21:03:06 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 4 21:03:06 kjcf05n03 ifdown[14796]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 21:03:06 kjcf05n03 ifdown[14797]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:03:06 kjcf05n03 ifdown[14798]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:03:06 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 21:03:06 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 21:03:06 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 21:03:07 kjcf05n03 ifup[14858]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 21:03:07 kjcf05n03 ifup[14859]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:03:07 kjcf05n03 ifup[14860]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:03:06 kjcf05n00 mcfcli[3673891]: %3|1730775786.889|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:03:07 kjcf05n03 dcs-collectord[5621]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 21:03:07 kjcf05n03 dcs-collectord[5621]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 21:03:09 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 4 21:03:11 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 21:03:11 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 21:03:11 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 21:03:11 kjcf05n03 systemd[1]: Reloading. Nov 4 21:03:11 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31468 deleted. Nov 4 21:03:11 kjcf05n03 systemd[1]: Starting Corosync Cluster Engine... Nov 4 21:03:11 kjcf05n03 await_ha_peer[15059]: Waiting for HA peer kjcf05n02 Nov 4 21:03:13 kjcf05n03 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 4 21:03:13 kjcf05n03 await_ha_peer[15059]: Peer kjcf05n02 has started, starting HA Nov 4 21:03:13 kjcf05n03 systemd[1]: Started Corosync Cluster Engine. Nov 4 21:03:13 kjcf05n03 systemd[1]: Started Fast STONITH daemon. Nov 4 21:03:13 kjcf05n03 fstonithd.py[15114]: Listening for kdump packets from partner Nov 4 21:03:13 kjcf05n03 systemd[1]: Reloading. Nov 4 21:03:13 kjcf05n03 systemd[3163]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:03:13 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:03:13 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:03:14 kjcf05n03 systemd[1]: Reloading. Nov 4 21:03:14 kjcf05n03 systemd[1]: Reached target resource-agents dependencies. Nov 4 21:03:14 kjcf05n03 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 4 21:03:14 kjcf05n03 systemd[1]: Reloading. Nov 4 21:03:14 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 21:03:14 kjcf05n03 puppet-agent[3550]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:03:14 kjcf05n03 puppet[3550]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:03:14 kjcf05n03 puppet-agent[3550]: Applied catalog in 92.49 seconds Nov 4 21:03:14 kjcf05n03 puppet[3550]: Notice: Applied catalog in 92.49 seconds Nov 4 21:03:14 kjcf05n03 systemd[1]: Started Puppet agent. Nov 4 21:03:14 kjcf05n03 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 4 21:03:14 kjcf05n03 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 4 21:03:14 kjcf05n03 systemd[1]: Started Startup script for gateway-ec-node. Nov 4 21:03:14 kjcf05n03 systemd[1]: Started Startup script for monitoring-ec-node. Nov 4 21:03:14 kjcf05n03 systemd[1]: Started Collect SAS Health Report every hour. Nov 4 21:03:14 kjcf05n03 systemd[1]: Reached target Timers. Nov 4 21:03:14 kjcf05n03 systemd[1]: Starting Set absolute GEM time... Nov 4 21:03:14 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 21:03:14 kjcf05n03 systemd[1]: Started Service to do FW and inventory check on boot. Nov 4 21:03:14 kjcf05n03 wce-disable.sh[15247]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 4 21:03:14 kjcf05n03 systemd[1]: disable-write-cache.service: Succeeded. Nov 4 21:03:14 kjcf05n03 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 4 21:03:14 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 21:03:14 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 21:03:14 kjcf05n03 systemd[1]: set_gem_time.service: Succeeded. Nov 4 21:03:14 kjcf05n03 systemd[1]: Started Set absolute GEM time. Nov 4 21:03:15 kjcf05n03 python3.9[15250]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 4 21:03:15 kjcf05n03 python3.9[15250]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 4 21:03:15 kjcf05n03 gateway-ec-node.py[15249]: Starting gateway-ec-node service Nov 4 21:03:15 kjcf05n03 RFSF-API[15248]: INFO[2024-11-04T21:03:15-06:00] Datapath API RESTful Service starting Nov 4 21:03:15 kjcf05n03 dp-api-server-node[15248]: INFO[2024-11-04T21:03:15-06:00] Datapath API RESTful Service starting Nov 4 21:03:15 kjcf05n03 RFSF-API[15248]: INFO[2024-11-04T21:03:15-06:00] Running in production mode, starting dbus event listener Nov 4 21:03:15 kjcf05n03 dp-api-server-node[15248]: INFO[2024-11-04T21:03:15-06:00] Running in production mode, starting dbus event listener Nov 4 21:03:15 kjcf05n03 RFSF-API[15248]: INFO[2024-11-04T21:03:15-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 21:03:15 kjcf05n03 dp-api-server-node[15248]: INFO[2024-11-04T21:03:15-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 21:03:15 kjcf05n03 RFSF-API[15248]: INFO[2024-11-04T21:03:15-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 21:03:15 kjcf05n03 RFSF-API[15248]: INFO[2024-11-04T21:03:15-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 21:03:15 kjcf05n03 dp-api-server-node[15248]: INFO[2024-11-04T21:03:15-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 21:03:15 kjcf05n03 dp-api-server-node[15248]: INFO[2024-11-04T21:03:15-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 21:03:15 kjcf05n03 dp-api-server-node[15248]: INFO[2024-11-04T21:03:15-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 21:03:15 kjcf05n03 RFSF-API[15248]: INFO[2024-11-04T21:03:15-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 21:03:15 kjcf05n03 RFSF-API[15248]: INFO[2024-11-04T21:03:15-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 21:03:15 kjcf05n03 dp-api-server-node[15248]: INFO[2024-11-04T21:03:15-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 21:03:15 kjcf05n03 RFSF-API[15248]: INFO[2024-11-04T21:03:15-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 21:03:15 kjcf05n03 dp-api-server-node[15248]: INFO[2024-11-04T21:03:15-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 21:03:15 kjcf05n03 RFSF-API[15248]: INFO[2024-11-04T21:03:15-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 21:03:15 kjcf05n03 dp-api-server-node[15248]: INFO[2024-11-04T21:03:15-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 21:03:15 kjcf05n03 RFSF-API[15248]: INFO[2024-11-04T21:03:15-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 21:03:15 kjcf05n03 dp-api-server-node[15248]: INFO[2024-11-04T21:03:15-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 21:03:15 kjcf05n03 RFSF-API[15248]: INFO[2024-11-04T21:03:15-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 21:03:15 kjcf05n03 dp-api-server-node[15248]: INFO[2024-11-04T21:03:15-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 21:03:15 kjcf05n03 RFSF-API[15248]: INFO[2024-11-04T21:03:15-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 21:03:15 kjcf05n03 dp-api-server-node[15248]: INFO[2024-11-04T21:03:15-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 21:03:17 kjcf05n00 mcfcli[3673891]: %3|1730775797.021|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 21:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730775799', 'host':'kjcf05n03', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(336.0B/360.0B), ib1=(56.0B/360.0B), icl0=(7.1kB/8.8kB), lo=(600.0B/600.0B), meth0=(1541.1MB/7.7MB), mgmt0=(1477.9MB/7.7MB)'}"] Nov 4 21:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(336.0B/360.0B), ib1=(56.0B/360.0B), icl0=(7.1kB/8.8kB), lo=(600.0B/600.0B), meth0=(1541.1MB/7.7MB), mgmt0=(1477.9MB/7.7MB)', 'message': 'NET OK - (Rx/Tx) ib0=(336.0B/360.0B), ib1=(56.0B/360.0B), icl0=(7.1kB/8.8kB), lo=(600.0B/600.0B), meth0=(1541.1MB/7.7MB), mgmt0=(1477.9MB/7.7MB)', 'value': 'ok', 'timestamp': '1730775799'} Nov 4 21:03:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730775799', 'host':'kjcf05n03', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 4 21:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730775799'} Nov 4 21:03:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730775799', 'host':'kjcf05n03', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 4 21:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730775799'} Nov 4 21:03:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730775799', 'host':'kjcf05n03', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.34, 1.72, 0.80'}"] Nov 4 21:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Load', 'description': 'OK - load average: 1.34, 1.72, 0.80', 'message': 'OK - load average: 1.34, 1.72, 0.80', 'value': 'ok', 'timestamp': '1730775799'} Nov 4 21:03:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730775799', 'host':'kjcf05n03', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 342 processes with STATE = RSZDT '}"] Nov 4 21:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Total Processes', 'description': 'PROCS OK: 342 processes with STATE = RSZDT ', 'message': 'PROCS OK: 342 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730775799'} Nov 4 21:03:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:03:22 kjcf05n03 systemd[1]: Reloading. Nov 4 21:03:22 kjcf05n03 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 4 21:03:22 kjcf05n03 systemd[1]: Reloading. Nov 4 21:03:22 kjcf05n03 systemd[1]: Starting Cluster Controlled lcnmon... Nov 4 21:03:22 kjcf05n03 diskmonitor_pre[15764]: Key management is currently disabled.DEAR disabled Nov 4 21:03:22 kjcf05n03 systemd[1]: Started Cluster Controlled diskmonitor. Nov 4 21:03:22 kjcf05n03 dcs-collectord[5621]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 21:03:22 kjcf05n03 dcs-collectord[5621]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 21:03:22 kjcf05n03 dcs-collectord[5621]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 21:03:23 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 17850 (bash) Nov 4 21:03:23 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 4 21:03:23 kjcf05n03 systemd[1]: Reached target Host and Network Name Lookups. Nov 4 21:03:23 kjcf05n03 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 4 21:03:23 kjcf05n03 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 4 21:03:23 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 4 21:03:24 kjcf05n03 sh[15824]: LNET configured: New Created Nov 4 21:03:24 kjcf05n03 systemd[1]: Started Cluster Controlled lcnmon. Nov 4 21:03:24 kjcf05n03 LCNmon[17896]: Interface ib0 is up Nov 4 21:03:24 kjcf05n03 LCNmon[17896]: Interface ib1 is up Nov 4 21:03:24 kjcf05n03 LCNmon[17896]: Can ping through interface ib0 Nov 4 21:03:24 kjcf05n00 httpd[1812019]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-B): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n03', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 4 21:03:25 kjcf05n03 systemd[1]: nodebootchecks.service: Succeeded. Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: /var/run/diskmonitor does not exist, creating Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: Creating /var/run/diskmonitor/disk Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: Creating /var/run/diskmonitor/encl Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: Creating /var/run/diskmonitor/cli Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: RAS_Interlocks_enabled: 1 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: Using default ssd ids: HUSSL4010ASS600 , Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: add handler for sig: 14 sa_flags: 10000004 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: add handler for sig: 1 sa_flags: 10000004 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: add handler for sig: 2 sa_flags: 00000004 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: add handler for sig: 15 sa_flags: 00000004 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: add handler for sig: 6 sa_flags: 00000004 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: add handler for sig: 3 sa_flags: 00000004 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: add handler for sig: 30 sa_flags: 00000004 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: add handler for sig: 20 sa_flags: 00000004 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: add handler for sig: 10 sa_flags: 10000004 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: add handler for sig: 11 sa_flags: 00000004 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: add handler for sig: 7 sa_flags: 00000004 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: add handler for sig: 4 sa_flags: 00000004 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: add handler for sig: 8 sa_flags: 00000004 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: init_watch: /var/run/diskmonitor/encl initialized Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: init_watch: /var/run/diskmonitor/disk initialized Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: Using HA Baton locks - key: diskmonitor Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: Baton will be held for at most 570 seconds Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: DMMP Enabled: 0 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: random seed: 2618f40a Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: NVMe Enclosure: 1 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: ZFS Enclosure: 0 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: Dbus, Initialized Connection Successfully Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: int_catcher_thread: thread start Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: Received dbus message 4 org.freedesktop.DBus -> :1.95 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b07bec_S4EUNF0MA05386M encl_slot: 0 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b07bed_S4EUNF0MA05387D encl_slot: 0 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 4 21:03:26 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 21:03:27 kjcf05n03 openhpid[5527]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 4 21:03:27 kjcf05n03 openhpid[5527]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 4 21:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T21:03:27.25332871-06:00 level=info msg="Completed cleanup jobs" duration=26.761079ms Nov 4 21:03:27 kjcf05n03 systemd[1]: openhpid.service: Succeeded. Nov 4 21:03:27 kjcf05n03 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 4 21:03:27 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 21:03:27 kjcf05n03 systemd[1]: openhpid.service: Supervising process 18270 which is not our child. We'll most likely not notice when it exits. Nov 4 21:03:27 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 21:03:27 kjcf05n03 systemd[1]: Reached target Multi-User System. Nov 4 21:03:27 kjcf05n03 systemd[1]: Reached target Graphical Interface. Nov 4 21:03:27 kjcf05n03 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 4 21:03:27 kjcf05n03 dcs-collectord[5621]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 4 21:03:27 kjcf05n03 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 4 21:03:27 kjcf05n03 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 4 21:03:27 kjcf05n03 systemd[1]: Startup finished in 51.073s (kernel) + 2min 28.092s (userspace) = 3min 19.165s. Nov 4 21:03:27 kjcf05n03 openhpid[18270]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 21:03:27 kjcf05n03 openhpid[18270]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 21:03:27 kjcf05n03 openhpid[18270]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 21:03:27 kjcf05n03 openhpid[18270]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 21:03:28 kjcf05n03 LCNmon[17896]: 10.16.100.57 is unreachable via ib1 Nov 4 21:03:28 kjcf05n03 LCNmon[17896]: Can ping through interface ib1 Nov 4 21:03:28 kjcf05n03 LCNmon[17896]: NIC ib0, initial state UP Nov 4 21:03:28 kjcf05n03 LCNmon[17896]: NIC ib1, initial state UP Nov 4 21:03:28 kjcf05n03 LCNmon[17896]: LCNstat initial state UP Nov 4 21:03:28 kjcf05n03 LCNmon[17896]: LCNmon monitoring hosts kjcf05n03 and kjcf05n02 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 4 21:03:32 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 4 21:03:33 kjcf05n02 nslcd[6957]: [2dba31] ldap_result() failed: Can't contact LDAP server Nov 4 21:03:38 kjcf05n03 dcs-collectord[5621]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 21:03:38 kjcf05n03 dcs-collectord[5621]: WARNING No data collected (hpi_parser.py:353) Nov 4 21:03:45 kjcf05n00 mcfcli[3673891]: %3|1730775825.211|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:03:47 kjcf05n00 mcfcli[3673891]: %3|1730775827.082|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 21:03:51 kjcf05n03 ipmievd[3965]: System Event sensor - Timestamp Clock Sync Nov 4 21:03:53 kjcf05n03 ipmievd[3163]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:03:53 kjcf05n03 dcs-collectord[5621]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b07bed_S4EUNF0MA05387D encl_sn: USE26000024VS001, slot: 2 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b07bec_S4EUNF0MA05386M encl_sn: USE26000024VS001, slot: 1 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 4 21:04:05 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 4 21:04:08 kjcf05n03 dcs-collectord[5621]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 21:04:10 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 4 21:04:11 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31469 deleted. Nov 4 21:04:13 kjcf05n02 firmware-update-orc-server[5878]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "47e1c45b-1fb7-476f-b1e0-8dd3265b57fd"} (logger.py:65) Nov 4 21:04:13 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 323453 (get_disk_device) Nov 4 21:04:13 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 4 21:04:13 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 4 21:04:13 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db0099600253845000000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 21:04:13 kjcf05n03 ras-resource-manager-agent[5885]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "a262fb82-9b22-11ef-b97f-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 4 21:04:13 kjcf05n03 ras-resource-manager-agent[5885]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'a262fb82-9b22-11ef-b97f-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 4 21:04:13 kjcf05n03 ras-resource-manager-agent[5885]: INFO Submitting new device inserted signal, starting to qualify drive: a262fb82-9b22-11ef-b97f-00093d069a1b (admin_action.py:110) Nov 4 21:04:12 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'a262fb82-9b22-11ef-b97f-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 21:04:12 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'a262fb82-9b22-11ef-b97f-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 21:04:12 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': 'a262fb82-9b22-11ef-b97f-00093d069a1b', 'response ID': 'a26e7426-9b22-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 21:04:12 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: a26e7426-9b22-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 21:04:13 kjcf05n02 ccp-client[323474]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 21:04:13 kjcf05n02 ccp-client[323474]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 21:04:13 kjcf05n02 ccp-client[323497]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 21:04:13 kjcf05n02 ccp-client[323474]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 21:04:13 kjcf05n02 ccp-client[323474]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 21:04:13 kjcf05n02 ccp-client[323497]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 21:04:13 kjcf05n02 ccp-client[323497]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 21:04:13 kjcf05n03 diskmonitor[17340]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 21:04:13 kjcf05n03 ras-resource-manager-agent[5885]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "a2b49528-9b22-11ef-b97f-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 4 21:04:13 kjcf05n03 ras-resource-manager-agent[5885]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'a2b49528-9b22-11ef-b97f-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 4 21:04:13 kjcf05n03 ras-resource-manager-agent[5885]: INFO Submitting new device inserted signal, starting to qualify drive: a2b49528-9b22-11ef-b97f-00093d069a1b (admin_action.py:110) Nov 4 21:04:13 kjcf05n03 firmware-update-orc-server[5841]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "5001eeeb-4742-4517-a9b9-0ad5bec69b9d"} (logger.py:65) Nov 4 21:04:13 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'a2b49528-9b22-11ef-b97f-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 21:04:13 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'a2b49528-9b22-11ef-b97f-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 21:04:13 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': 'a2b49528-9b22-11ef-b97f-00093d069a1b', 'response ID': 'a2bd3796-9b22-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 21:04:13 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: a2bd3796-9b22-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 21:04:16 kjcf05n02 DRVFW[323613]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 21:04:16 kjcf05n02 ccp-client[323614]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 21:04:16 kjcf05n02 ccp-client[323614]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 21:04:16 kjcf05n02 ccp-client[323623]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 21:04:16 kjcf05n02 ccp-client[323614]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 21:04:16 kjcf05n02 ccp-client[323614]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 21:04:16 kjcf05n02 ccp-client[323623]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 21:04:16 kjcf05n02 ccp-client[323623]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 21:04:16 kjcf05n02 firmware-update-orc-server[5878]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 4 21:04:16 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: a26e7426-9b22-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 21:04:16 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': 'a262fb82-9b22-11ef-b97f-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'a262fb82-9b22-11ef-b97f-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}}} (logger.py:65) Nov 4 21:04:17 kjcf05n03 ras-resource-manager-agent[5885]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'a262fb82-9b22-11ef-b97f-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 4 21:04:17 kjcf05n03 ras-resource-manager-agent[5885]: INFO Drive qualification complete responding: a262fb82-9b22-11ef-b97f-00093d069a1b (admin_action.py:205) Nov 4 21:04:17 kjcf05n03 ras-resource-manager-agent[5885]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "a262fb82-9b22-11ef-b97f-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (interesting_event.py:59) Nov 4 21:04:17 kjcf05n00 mcfcli[3673891]: %3|1730775857.082|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:04:20 kjcf05n03 diskmonitor[17340]: 04 Nov 4 21:04:20 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 4 21:04:20 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 4 21:04:20 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 4 21:04:20 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 4 21:04:20 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 4 21:04:20 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 4 21:04:20 kjcf05n03 diskmonitor[17340]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 4 21:04:20 kjcf05n03 diskmonitor[17340]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 4 21:04:20 kjcf05n03 diskmonitor[17340]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 4 21:04:20 kjcf05n03 diskmonitor[17340]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 21:04:20 kjcf05n03 diskmonitor[17340]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 4 21:04:20 kjcf05n03 diskmonitor[17340]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "a262fb82-9b22-11ef-b97f-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 4 21:04:20 kjcf05n03 diskmonitor[17340]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 21:04:20 kjcf05n03 diskmonitor[17340]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 4 21:04:20 kjcf05n03 diskmonitor[17340]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "a2b49528-9b22-11ef-b97f-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 4 21:04:20 kjcf05n03 diskmonitor[17340]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 21:04:20 kjcf05n03 diskmonitor[17340]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 21:04:23 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22220 (get_disk_device) Nov 4 21:04:23 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 4 21:04:23 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 4 21:04:24 kjcf05n03 ccp-client[22242]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 21:04:24 kjcf05n03 ccp-client[22242]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 21:04:24 kjcf05n03 ccp-client[22253]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 21:04:24 kjcf05n03 ccp-client[22242]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 21:04:24 kjcf05n03 ccp-client[22242]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 21:04:24 kjcf05n03 ccp-client[22253]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 21:04:24 kjcf05n03 ccp-client[22253]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 21:04:24 kjcf05n03 systemd[1]: Unmounting /mnt/llog... Nov 4 21:04:24 kjcf05n03 systemd[1]: mnt-llog.mount: Succeeded. Nov 4 21:04:24 kjcf05n03 systemd[1]: Unmounted /mnt/llog. Nov 4 21:04:25 kjcf05n03 chronyd[5130]: Selected source 172.16.2.1 Nov 4 21:04:25 kjcf05n00 mcfcli[3673891]: %3|1730775865.208|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:04:27 kjcf05n03 DRVFW[22363]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 21:04:27 kjcf05n03 ccp-client[22364]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 21:04:27 kjcf05n03 ccp-client[22364]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 21:04:27 kjcf05n03 ccp-client[22373]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 21:04:27 kjcf05n03 ccp-client[22364]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 21:04:27 kjcf05n03 ccp-client[22364]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 21:04:27 kjcf05n03 ccp-client[22373]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 21:04:27 kjcf05n03 ccp-client[22373]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 21:04:27 kjcf05n03 firmware-update-orc-server[5841]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 4 21:04:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730775867}"] Nov 4 21:04:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730775867, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:04:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:04:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730775867}"] Nov 4 21:04:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730775867, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:04:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:04:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730775867}"] Nov 4 21:04:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730775867, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:04:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:04:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730775867}"] Nov 4 21:04:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730775867, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:04:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:04:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730775867}"] Nov 4 21:04:27 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730775867, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:04:27 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730775867}"] Nov 4 21:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730775867, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:04:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:04:28 kjcf05n03 ras-resource-manager-agent[5885]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'a2b49528-9b22-11ef-b97f-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 13}}} (resource_admin.py:98) Nov 4 21:04:28 kjcf05n03 ras-resource-manager-agent[5885]: INFO Drive qualification complete responding: a2b49528-9b22-11ef-b97f-00093d069a1b (admin_action.py:205) Nov 4 21:04:28 kjcf05n03 ras-resource-manager-agent[5885]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "a2b49528-9b22-11ef-b97f-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 13}}} (interesting_event.py:59) Nov 4 21:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730775867}"] Nov 4 21:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730775867, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:04:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:04:28 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: a2bd3796-9b22-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 21:04:28 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': 'a2b49528-9b22-11ef-b97f-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'a2b49528-9b22-11ef-b97f-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 13}}}} (logger.py:65) Nov 4 21:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730775867}"] Nov 4 21:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730775867, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:04:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:04:30 kjcf05n03 ras-resource-manager-agent[5885]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "a262fb82-9b22-11ef-b97f-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (service_main_handler.py:66) Nov 4 21:04:30 kjcf05n03 ras-resource-manager-agent[5885]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'a262fb82-9b22-11ef-b97f-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 4 21:04:30 kjcf05n03 ras-resource-manager-agent[5885]: INFO Device qualification response has been acknowledged: a262fb82-9b22-11ef-b97f-00093d069a1b (admin_action.py:151) Nov 4 21:04:30 kjcf05n03 ras-resource-manager-agent[5885]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "a2b49528-9b22-11ef-b97f-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 13}}} (service_main_handler.py:66) Nov 4 21:04:30 kjcf05n03 ras-resource-manager-agent[5885]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'a2b49528-9b22-11ef-b97f-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 13}}} (resource_admin.py:98) Nov 4 21:04:30 kjcf05n03 ras-resource-manager-agent[5885]: INFO Device qualification response has been acknowledged: a2b49528-9b22-11ef-b97f-00093d069a1b (admin_action.py:151) Nov 4 21:04:31 kjcf05n03 python3.9[5191]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 4 21:04:32 kjcf05n03 python3.9[3163]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "a262fb82-9b22-11ef-b97f-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: Dbus, handle_ingress_ras_signals, uuid: a262fb82-9b22-11ef-b97f-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "a262fb82-9b22-11ef-b97f-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "a2b49528-9b22-11ef-b97f-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 13}}} Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: Dbus, handle_ingress_ras_signals, uuid: a2b49528-9b22-11ef-b97f-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "a2b49528-9b22-11ef-b97f-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 13}}} Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 21:04:32 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 21:04:34 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 21:04:34 kjcf05n03 diskmonitor[17340]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 21:04:38 kjcf05n03 diskmonitor[17340]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 21:04:38 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 21:04:38 kjcf05n03 diskmonitor[17340]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 21:04:38 kjcf05n03 diskmonitor[17340]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 21:04:38 kjcf05n03 diskmonitor[17340]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 21:04:38 kjcf05n03 diskmonitor[17340]: leaving test state: 1 next state: 2 Nov 4 21:04:38 kjcf05n03 diskmonitor[17340]: lock req: no timeout Nov 4 21:04:38 kjcf05n03 diskmonitor[17340]: leaving test state: 2 next state: 4 Nov 4 21:04:38 kjcf05n03 diskmonitor[17340]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 21:04:47 kjcf05n00 mcfcli[3673891]: %3|1730775887.082|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:05:03 kjcf05n00 mcfcli[3673891]: %3|1730775903.466|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:05:17 kjcf05n00 mcfcli[3673891]: %3|1730775917.522|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 21:05:34 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 4 21:05:34 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 21:05:34 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 4 21:05:37 kjcf05n00 python3.9[2450478]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 21:05:38 kjcf05n03 diskmonitor[17340]: lock acquired Nov 4 21:05:38 kjcf05n03 diskmonitor[17340]: leaving test state: 4 next state: 8 Nov 4 21:05:40 kjcf05n00 diskmonitor[2758297]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 21:05:41 kjcf05n00 mcfcli[3673891]: %3|1730775941.556|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:05:44 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 4 21:05:44 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 21:05:44 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 4 21:05:45 kjcf05n03 diskmonitor[17340]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 4 21:05:45 kjcf05n03 diskmonitor[17340]: leaving test state: 8 next state: 20 Nov 4 21:05:45 kjcf05n03 diskmonitor[17340]: leaving test state: 20 next state: 40 Nov 4 21:05:45 kjcf05n03 diskmonitor[17340]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset e74a3c8000 Nov 4 21:05:45 kjcf05n03 diskmonitor[17340]: leaving test state: 40 next state: 80 Nov 4 21:05:47 kjcf05n00 mcfcli[3673891]: %3|1730775947.522|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:05:48 kjcf05n03 dcs-collectord[5621]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 4 21:05:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730775659', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 21:05:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730775659'} Nov 4 21:05:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:05:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730775659', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 21:05:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730775659'} Nov 4 21:05:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:05:57 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730775957}"] Nov 4 21:05:57 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730775957, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:05:57 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:05:57-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:05:57 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:05:57-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:05:57 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:05:57-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:05:57 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:05:57-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:05:57 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:05:57-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:05:57 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:05:57-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:05:57 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:05:57-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.035783ms Nov 4 21:05:57 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:05:57-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.035783ms Nov 4 21:05:57 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:05:57 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:05:57 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:06:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730775960}"] Nov 4 21:06:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730775960, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:06:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:06:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:06:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:06:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:06:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:06:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:06:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:06:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:06:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:06:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:06:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:06:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:06:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:06:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.392381ms Nov 4 21:06:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:06:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.392381ms Nov 4 21:06:00 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:06:00 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:06:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:06:17 kjcf05n00 mcfcli[3673891]: %3|1730775977.522|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 21:06:19 kjcf05n00 mcfcli[3673891]: %3|1730775979.564|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:06:24 kjcf05n00 zabbix-server[2451270]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:06:24 kjcf05n00 zabbix-server[2451270]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n03' from event '46683' Nov 4 21:06:24 kjcf05n00 zabbix-server[2451270]: Host created 'enclosure_USE26000024VS001' Nov 4 21:06:24 kjcf05n00 zabbix-server[2451270]: Running puppet on 'kjcf05n03' Nov 4 21:06:26 kjcf05n03 puppet-agent[28567]: Using configured environment 'production' Nov 4 21:06:26 kjcf05n03 puppet-agent[28567]: Retrieving pluginfacts Nov 4 21:06:26 kjcf05n03 puppet-agent[28567]: Retrieving plugin Nov 4 21:06:27 kjcf05n03 puppet-agent[28567]: Loading facts Nov 4 21:06:29 kjcf05n03 puppet-agent[28567]: Caching catalog for kjcf05n03 Nov 4 21:06:29 kjcf05n03 puppet-agent[28567]: Applying configuration version '1730775988' Nov 4 21:06:31 kjcf05n03 puppet-agent[28567]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 21:06:31 kjcf05n03 puppet-agent[28567]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 21:06:31 kjcf05n03 puppet-agent[28567]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 21:06:32 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 4 21:06:32 kjcf05n03 zabbix_agent2[5969]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 21:06:32 kjcf05n03 zabbix_agent2[3163]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:06:32 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 21:06:32 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 4 21:06:32 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 4 21:06:32 kjcf05n03 puppet-agent[28567]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: Press Ctrl+C to exit. Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: Plugin support version 1.0 Nov 4 21:06:32 kjcf05n03 zabbix_agent2[28898]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 21:06:34 kjcf05n03 puppet-agent[28567]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 21:06:34 kjcf05n03 puppet-agent[28567]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 21:06:34 kjcf05n03 puppet-agent[28567]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 21:06:34 kjcf05n00 zabbix-server[2451270]: puppet completed status:(0): '' Nov 4 21:06:34 kjcf05n00 zabbix-server[2451270]: Event '46683' acknowledged Nov 4 21:06:34 kjcf05n00 zabbix-server[2451270]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n03"}' Nov 4 21:06:34 kjcf05n03 puppet-agent[28567]: Applied catalog in 5.27 seconds Nov 4 21:06:42 kjcf05n03 diskmonitor[17340]: leaving test state: 80 next state: 100 Nov 4 21:06:42 kjcf05n03 diskmonitor[17340]: lock release: time: Mon Nov 4 21:06:36 2024 Nov 4 21:06:42 kjcf05n03 diskmonitor[17340]: leaving test state: 100 next state: 1 Nov 4 21:06:47 kjcf05n00 mcfcli[3673891]: %3|1730776007.522|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 21:06:58 kjcf05n00 mcfcli[3673891]: %3|1730776018.332|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:07:17 kjcf05n00 mcfcli[3673891]: %3|1730776037.522|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:07:21 kjcf05n00 zabbix-server[2451867]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:07:21 kjcf05n00 zabbix-server[2451867]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 79.05\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 84.46\\"}}"' Nov 4 21:07:21 kjcf05n00 log_interesting_event.py[2451867]: Event '46684' acknowledged Nov 4 21:07:28 kjcf05n01 diskmonitor[1331407]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 21:07:34 kjcf05n00 mcfcli[3673891]: %3|1730776054.921|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:07:47 kjcf05n00 mcfcli[3673891]: %3|1730776067.523|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:07:54 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 21:07:54 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 21:07:54 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 21:07:55 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 4 21:08:04 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 21:08:04 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 21:08:04 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 21:08:14 kjcf05n00 mcfcli[3673891]: %3|1730776094.809|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:08:17 kjcf05n00 mcfcli[3673891]: %3|1730776097.523|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:08:47 kjcf05n00 mcfcli[3673891]: %3|1730776127.523|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:08:54 kjcf05n00 mcfcli[3673891]: %3|1730776134.806|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:09:11 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 4 21:09:15 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/21', errno='Permission denied (13)' Nov 4 21:09:17 kjcf05n00 mcfcli[3673891]: %3|1730776157.523|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:09:25 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 4 21:09:33 kjcf05n00 mcfcli[3673891]: %3|1730776173.136|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:09:47 kjcf05n00 mcfcli[3673891]: %3|1730776187.523|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 21:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 21:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 21:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 21:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 21:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 21:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 21:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 21:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 21:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 21:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 21:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 21:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 21:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 21:10:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 21:10:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:10:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 21:10:13 kjcf05n00 mcfcli[3673891]: %3|1730776213.133|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:10:17 kjcf05n00 mcfcli[3673891]: %3|1730776217.524|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 21:10:37 kjcf05n00 python3.9[2453436]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 21:10:47 kjcf05n00 mcfcli[3673891]: %3|1730776247.525|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 21:10:52 kjcf05n00 mcfcli[3673891]: %3|1730776252.002|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:10:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730775659', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 21:10:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730775659'} Nov 4 21:10:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:10:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730775659', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 21:10:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730775659'} Nov 4 21:10:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:11:06 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 21:11:06 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 21:11:06 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 21:11:17 kjcf05n00 mcfcli[3673891]: %3|1730776277.525|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 21:11:29 kjcf05n00 mcfcli[3673891]: %3|1730776289.133|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:11:34 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 21:11:40 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 21:11:47 kjcf05n00 mcfcli[3673891]: %3|1730776307.525|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 21:11:55 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 21:11:55 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 21:11:55 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 21:12:02 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 21:12:02 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 21:12:08 kjcf05n00 mcfcli[3673891]: %3|1730776328.227|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:12:09 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 21:12:09 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 21:12:17 kjcf05n00 mcfcli[3673891]: %3|1730776337.525|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 21:12:44 kjcf05n00 mcfcli[3673891]: %3|1730776364.142|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:12:47 kjcf05n00 mcfcli[3673891]: %3|1730776367.526|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 21:13:17 kjcf05n00 mcfcli[3673891]: %3|1730776397.526|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:13:22 kjcf05n00 mcfcli[3673891]: %3|1730776402.740|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T21:13:27.253050498-06:00 level=info msg="Completed cleanup jobs" duration=26.268716ms Nov 4 21:13:47 kjcf05n00 mcfcli[3673891]: %3|1730776427.526|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:13:58 kjcf05n03 root[41151]: failback_xyraid Nov 4 21:13:59 kjcf05n03 root[41273]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 4 21:14:00 kjcf05n03 root[41372]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 4 21:14:02 kjcf05n00 mcfcli[3673891]: %3|1730776442.737|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:14:04 kjcf05n02 systemd[1]: data-kjcf05n03:md66.mount: Succeeded. Nov 4 21:14:07 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme10n1 Nov 4 21:14:07 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme6n1 Nov 4 21:14:07 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme12n1 Nov 4 21:14:07 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme16n1 Nov 4 21:14:07 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme7n1 Nov 4 21:14:07 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme20n1 Nov 4 21:14:07 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme11n1 Nov 4 21:14:07 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme22n1 Nov 4 21:14:07 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme21n1 Nov 4 21:14:07 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme15n1 Nov 4 21:14:07 kjcf05n02 dwd[5196]: Drive path is missing, purging: nvme5n1 Nov 4 21:14:09 kjcf05n03 dwd[5162]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 4 21:14:09 kjcf05n03 dwd[5162]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 4 21:14:09 kjcf05n03 dwd[5162]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 4 21:14:09 kjcf05n03 dwd[5162]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 4 21:14:09 kjcf05n03 dwd[5162]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 4 21:14:09 kjcf05n03 dwd[5162]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 4 21:14:09 kjcf05n03 dwd[5162]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 4 21:14:09 kjcf05n03 dwd[5162]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 4 21:14:09 kjcf05n03 dwd[5162]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 4 21:14:09 kjcf05n03 dwd[5162]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 4 21:14:09 kjcf05n03 dwd[5162]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 4 21:14:09 kjcf05n03 dwd[5162]: Starting NVME thread for nvme10n1 Nov 4 21:14:09 kjcf05n03 dwd[5162]: Starting NVME thread for nvme15n1 Nov 4 21:14:10 kjcf05n03 dwd[5162]: Starting NVME thread for nvme21n1 Nov 4 21:14:10 kjcf05n03 dcs-bulk-data-sender[6173]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 139}' Nov 4 21:14:10 kjcf05n03 dwd[5162]: Starting NVME thread for nvme11n1 Nov 4 21:14:10 kjcf05n03 dwd[5162]: Starting NVME thread for nvme20n1 Nov 4 21:14:10 kjcf05n03 systemd-udevd[44138]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44135]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44132]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44133]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44138]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44135]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44132]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44133]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44138]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44132]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44133]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44135]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44133]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44138]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44132]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44135]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44138]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44132]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44133]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44135]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44138]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44132]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44133]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44135]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44138]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44132]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44135]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44133]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44138]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44132]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44135]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44133]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44171]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44174]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44175]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44177]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44170]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44175]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44174]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44170]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44177]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44175]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44170]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44177]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44170]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44177]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44174]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44170]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44177]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44170]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44177]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44170]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44177]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44170]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44170]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44177]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44170]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44170]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44177]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44170]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44177]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44170]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44170]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 systemd-udevd[44170]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:14:10 kjcf05n03 dwd[5162]: Starting NVME thread for nvme12n1 Nov 4 21:14:11 kjcf05n03 dwd[5162]: Starting NVME thread for nvme7n1 Nov 4 21:14:11 kjcf05n03 dwd[5162]: Starting NVME thread for nvme6n1 Nov 4 21:14:11 kjcf05n03 dwd[5162]: Starting NVME thread for nvme5n1 Nov 4 21:14:11 kjcf05n03 dwd[5162]: Starting NVME thread for nvme16n1 Nov 4 21:14:11 kjcf05n03 dwd[5162]: Starting NVME thread for nvme22n1 Nov 4 21:14:12 kjcf05n03 nslcd[6913]: [8b4567] (re)loading /etc/nsswitch.conf Nov 4 21:14:17 kjcf05n03 diskmonitor[17340]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 4 21:14:17 kjcf05n00 mcfcli[3673891]: %3|1730776457.526|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:14:24 kjcf05n03 diskmonitor[17340]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 4 21:14:24 kjcf05n03 diskmonitor[17340]: Scan for ReadErrorMax change for md66 Nov 4 21:14:24 kjcf05n03 diskmonitor[17340]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 4 21:14:24 kjcf05n03 diskmonitor[17340]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 4 21:14:24 kjcf05n03 diskmonitor[17340]: read_saved_file: md66 no saved speed Nov 4 21:14:24 kjcf05n03 diskmonitor[17340]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 4 21:14:24 kjcf05n03 diskmonitor[17340]: Set sync_speed_min (10000) for md66 Nov 4 21:14:24 kjcf05n03 diskmonitor[17340]: Set sync_speed_max (200000) for md66 Nov 4 21:14:24 kjcf05n03 diskmonitor[17340]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 21:14:39 kjcf05n00 mcfcli[3673891]: %3|1730776479.807|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:14:47 kjcf05n00 mcfcli[3673891]: %3|1730776487.526|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:14:51 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 46810 (bash) Nov 4 21:14:51 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 4 21:14:51 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 4 21:14:54 kjcf05n02 diskmonitor[17558]: Removed MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 4 21:14:54 kjcf05n02 diskmonitor[17558]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 21:15:09 kjcf05n03 systemd[1]: Starting Cleanup of Temporary Directories... Nov 4 21:15:09 kjcf05n03 systemd-tmpfiles[47469]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 21:15:09 kjcf05n03 systemd-tmpfiles[47469]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 21:15:09 kjcf05n03 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 4 21:15:09 kjcf05n03 systemd[1]: Started Cleanup of Temporary Directories. Nov 4 21:15:17 kjcf05n00 mcfcli[3673891]: %3|1730776517.526|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 21:15:17 kjcf05n00 mcfcli[3673891]: %3|1730776517.558|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:15:37 kjcf05n00 python3.9[2456583]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 21:15:47 kjcf05n00 mcfcli[3673891]: %3|1730776547.526|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:15:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730776550', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 4 21:15:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730776550'} Nov 4 21:15:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:15:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730776550', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 4 21:15:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730776550'} Nov 4 21:15:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:15:56 kjcf05n00 mcfcli[3673891]: %3|1730776556.156|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:15:57 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730776557}"] Nov 4 21:15:57 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730776557, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:15:57 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:57-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:57 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:57-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:57 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:57-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:57 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:57-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:57 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:57-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:57 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:57-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:57 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:57-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.048066ms Nov 4 21:15:57 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:57-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.048066ms Nov 4 21:15:57 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:15:57 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:15:57 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730776557}"] Nov 4 21:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730776557, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.019833ms Nov 4 21:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.019833ms Nov 4 21:15:58 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:15:58 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:15:58 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730776557}"] Nov 4 21:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730776557, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.90582ms Nov 4 21:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.90582ms Nov 4 21:15:58 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:15:58 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:15:58 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730776557}"] Nov 4 21:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730776557, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.528403ms Nov 4 21:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.528403ms Nov 4 21:15:58 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:15:58 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:15:58 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730776557}"] Nov 4 21:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730776557, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.526499ms Nov 4 21:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.526499ms Nov 4 21:15:58 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:15:58 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:15:58 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730776557}"] Nov 4 21:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730776557, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.821572ms Nov 4 21:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.821572ms Nov 4 21:15:58 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:15:58 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:15:58 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730776557}"] Nov 4 21:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730776557, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.518457ms Nov 4 21:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.518457ms Nov 4 21:15:58 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:15:58 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:15:58 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730776557}"] Nov 4 21:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730776557, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.953178ms Nov 4 21:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.953178ms Nov 4 21:15:58 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:15:58 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:15:58 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:15:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730776557}"] Nov 4 21:15:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730776557, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:15:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.904226ms Nov 4 21:15:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.904226ms Nov 4 21:15:59 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:15:59 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:15:59 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:15:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730776557}"] Nov 4 21:15:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730776557, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:15:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.790413ms Nov 4 21:15:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.790413ms Nov 4 21:15:59 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:15:59 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:15:59 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:15:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730776558}"] Nov 4 21:15:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730776558, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:15:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:15:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:15:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:15:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:15:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:15:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:15:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.758233ms Nov 4 21:15:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:15:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.758233ms Nov 4 21:15:59 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:15:59 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:15:59 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:16:17 kjcf05n00 mcfcli[3673891]: %3|1730776577.527|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:16:32 kjcf05n00 mcfcli[3673891]: %3|1730776592.089|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:16:47 kjcf05n00 mcfcli[3673891]: %3|1730776607.527|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 21:17:12 kjcf05n00 mcfcli[3673891]: %3|1730776632.086|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:17:17 kjcf05n00 mcfcli[3673891]: %3|1730776637.527|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 21:17:46 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 4 21:17:47 kjcf05n00 mcfcli[3673891]: %3|1730776667.527|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 21:17:47 kjcf05n00 mcfcli[3673891]: %3|1730776667.770|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:18:17 kjcf05n00 mcfcli[3673891]: %3|1730776697.527|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:18:26 kjcf05n00 mcfcli[3673891]: %3|1730776706.832|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:18:47 kjcf05n00 mcfcli[3673891]: %3|1730776727.529|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:19:04 kjcf05n00 mcfcli[3673891]: %3|1730776744.435|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:19:17 kjcf05n00 mcfcli[3673891]: %3|1730776757.529|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 21:19:24 kjcf05n03 dwd[5162]: nvme15n1 passed periodic SMART status check Nov 4 21:19:24 kjcf05n03 dwd[5162]: nvme10n1 passed periodic SMART status check Nov 4 21:19:24 kjcf05n00 zabbix-server[2459012]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:19:24 kjcf05n00 zabbix-server[2459012]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n03' from event '46687' Nov 4 21:19:24 kjcf05n00 zabbix-server[2459012]: Filesystem 'kjcf05' has been mounted Nov 4 21:19:25 kjcf05n03 dwd[5162]: nvme12n1 passed periodic SMART status check Nov 4 21:19:25 kjcf05n03 dwd[5162]: nvme20n1 passed periodic SMART status check Nov 4 21:19:25 kjcf05n03 dwd[5162]: nvme21n1 passed periodic SMART status check Nov 4 21:19:25 kjcf05n03 dwd[5162]: nvme11n1 passed periodic SMART status check Nov 4 21:19:25 kjcf05n00 zabbix-server[2459012]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 4 21:19:25 kjcf05n00 zabbix-server[2459012]: Running puppet on 'None' Nov 4 21:19:26 kjcf05n03 dwd[5162]: nvme22n1 passed periodic SMART status check Nov 4 21:19:26 kjcf05n03 dwd[5162]: nvme16n1 passed periodic SMART status check Nov 4 21:19:26 kjcf05n03 dwd[5162]: nvme5n1 passed periodic SMART status check Nov 4 21:19:26 kjcf05n03 dwd[5162]: nvme6n1 passed periodic SMART status check Nov 4 21:19:26 kjcf05n03 dwd[5162]: nvme7n1 passed periodic SMART status check Nov 4 21:19:27 kjcf05n03 puppet-agent[54775]: Using configured environment 'production' Nov 4 21:19:27 kjcf05n03 puppet-agent[54775]: Retrieving pluginfacts Nov 4 21:19:27 kjcf05n03 puppet-agent[54775]: Retrieving plugin Nov 4 21:19:27 kjcf05n02 puppet-agent[351638]: Using configured environment 'production' Nov 4 21:19:27 kjcf05n02 puppet-agent[351638]: Retrieving pluginfacts Nov 4 21:19:27 kjcf05n02 puppet-agent[351638]: Retrieving plugin Nov 4 21:19:27 kjcf05n05 puppet-agent[2555416]: Using configured environment 'production' Nov 4 21:19:27 kjcf05n05 puppet-agent[2555416]: Retrieving pluginfacts Nov 4 21:19:27 kjcf05n05 puppet-agent[2555416]: Retrieving plugin Nov 4 21:19:27 kjcf05n06 puppet-agent[2360837]: Using configured environment 'production' Nov 4 21:19:27 kjcf05n06 puppet-agent[2360837]: Retrieving pluginfacts Nov 4 21:19:27 kjcf05n06 puppet-agent[2360837]: Retrieving plugin Nov 4 21:19:27 kjcf05n04 puppet-agent[2349034]: Using configured environment 'production' Nov 4 21:19:27 kjcf05n04 puppet-agent[2349034]: Retrieving pluginfacts Nov 4 21:19:27 kjcf05n04 puppet-agent[2349034]: Retrieving plugin Nov 4 21:19:27 kjcf05n07 puppet-agent[2363410]: Using configured environment 'production' Nov 4 21:19:27 kjcf05n07 puppet-agent[2363410]: Retrieving pluginfacts Nov 4 21:19:27 kjcf05n07 puppet-agent[2363410]: Retrieving plugin Nov 4 21:19:27 kjcf05n03 puppet-agent[54775]: Loading facts Nov 4 21:19:27 kjcf05n06 puppet-agent[2360837]: Loading facts Nov 4 21:19:27 kjcf05n02 puppet-agent[351638]: Loading facts Nov 4 21:19:27 kjcf05n01 puppet-agent[3903223]: Using configured environment 'production' Nov 4 21:19:27 kjcf05n01 puppet-agent[3903223]: Retrieving pluginfacts Nov 4 21:19:27 kjcf05n01 puppet-agent[3903223]: Retrieving plugin Nov 4 21:19:27 kjcf05n01 puppet-agent[3903223]: Loading facts Nov 4 21:19:27 kjcf05n05 puppet-agent[2555416]: Loading facts Nov 4 21:19:27 kjcf05n04 puppet-agent[2349034]: Loading facts Nov 4 21:19:27 kjcf05n07 puppet-agent[2363410]: Loading facts Nov 4 21:19:27 kjcf05n00 puppet-agent[2459102]: Using configured environment 'production' Nov 4 21:19:27 kjcf05n00 puppet-agent[2459102]: Retrieving pluginfacts Nov 4 21:19:27 kjcf05n00 puppet-agent[2459102]: Retrieving plugin Nov 4 21:19:28 kjcf05n00 puppet-agent[2459102]: Loading facts Nov 4 21:19:30 kjcf05n03 puppet-agent[54775]: Caching catalog for kjcf05n03 Nov 4 21:19:30 kjcf05n03 puppet-agent[54775]: Applying configuration version '1730776768' Nov 4 21:19:30 kjcf05n02 puppet-agent[351638]: Caching catalog for kjcf05n02 Nov 4 21:19:30 kjcf05n02 puppet-agent[351638]: Applying configuration version '1730776768' Nov 4 21:19:30 kjcf05n06 puppet-agent[2360837]: Caching catalog for kjcf05n06 Nov 4 21:19:30 kjcf05n06 puppet-agent[2360837]: Applying configuration version '1730776769' Nov 4 21:19:30 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 4 21:19:30 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 4 21:19:30 kjcf05n07 puppet-agent[2363410]: Caching catalog for kjcf05n07 Nov 4 21:19:30 kjcf05n07 puppet-agent[2363410]: Applying configuration version '1730776769' Nov 4 21:19:31 kjcf05n01 puppet-agent[3903223]: Caching catalog for kjcf05n01 Nov 4 21:19:32 kjcf05n01 puppet-agent[3903223]: Applying configuration version '1730776769' Nov 4 21:19:31 kjcf05n00 puppet-agent[2459102]: Caching catalog for kjcf05n00 Nov 4 21:19:31 kjcf05n00 puppet-agent[2459102]: Applying configuration version '1730776769' Nov 4 21:19:32 kjcf05n03 puppet-agent[54775]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 21:19:32 kjcf05n03 puppet-agent[54775]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 21:19:32 kjcf05n03 puppet-agent[54775]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 21:19:32 kjcf05n02 puppet-agent[351638]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 21:19:32 kjcf05n02 puppet-agent[351638]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 21:19:32 kjcf05n02 puppet-agent[351638]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 21:19:32 kjcf05n06 puppet-agent[2360837]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 21:19:32 kjcf05n06 puppet-agent[2360837]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 21:19:32 kjcf05n06 puppet-agent[2360837]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 21:19:32 kjcf05n07 puppet-agent[2363410]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 21:19:32 kjcf05n07 puppet-agent[2363410]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 21:19:32 kjcf05n07 puppet-agent[2363410]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 21:19:32 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2308149]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 21:19:32 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 4 21:19:32 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 21:19:32 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 4 21:19:32 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 4 21:19:32 kjcf05n06 puppet-agent[2360837]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: Press Ctrl+C to exit. Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: Plugin support version 1.0 Nov 4 21:19:32 kjcf05n06 zabbix_agent2[2361236]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 21:19:33 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 4 21:19:33 kjcf05n03 zabbix_agent2[28898]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 21:19:33 kjcf05n03 zabbix_agent2[3163]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:19:33 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 21:19:33 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 4 21:19:33 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 4 21:19:33 kjcf05n03 puppet-agent[54775]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: Press Ctrl+C to exit. Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: Plugin support version 1.0 Nov 4 21:19:33 kjcf05n03 zabbix_agent2[55245]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 21:19:33 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 4 21:19:33 kjcf05n02 zabbix_agent2[293112]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 21:19:33 kjcf05n02 zabbix_agent2[3190]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:19:33 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 21:19:33 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 4 21:19:33 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 21:19:33 kjcf05n02 puppet-agent[351638]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: Press Ctrl+C to exit. Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: Plugin support version 1.0 Nov 4 21:19:33 kjcf05n02 zabbix_agent2[352071]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 21:19:33 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2311704]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 21:19:33 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 4 21:19:33 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 21:19:33 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 4 21:19:33 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 4 21:19:33 kjcf05n07 puppet-agent[2363410]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: Press Ctrl+C to exit. Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: Plugin support version 1.0 Nov 4 21:19:33 kjcf05n07 zabbix_agent2[2364462]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 21:19:34 kjcf05n06 puppet-agent[2360837]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 21:19:34 kjcf05n06 puppet-agent[2360837]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 21:19:34 kjcf05n06 puppet-agent[2360837]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 21:19:35 kjcf05n01 puppet-agent[3903223]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 21:19:35 kjcf05n01 puppet-agent[3903223]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-20:56:02]/mode) mode changed '0755' to '0750' Nov 4 21:19:35 kjcf05n01 puppet-agent[3903223]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-20:56:02/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 4 21:19:35 kjcf05n01 puppet-agent[3903223]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-20:56:02/vmcore]/mode) mode changed '0600' to '0640' Nov 4 21:19:35 kjcf05n01 puppet-agent[3903223]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-20:56:02/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 4 21:19:35 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 21:19:35 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 21:19:35 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 21:19:35 kjcf05n03 puppet-agent[54775]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 21:19:35 kjcf05n03 puppet-agent[54775]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 21:19:35 kjcf05n03 puppet-agent[54775]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 21:19:34 kjcf05n00 puppet-agent[2459102]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 21:19:35 kjcf05n07 puppet-agent[2363410]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 21:19:35 kjcf05n07 puppet-agent[2363410]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 21:19:35 kjcf05n07 puppet-agent[2363410]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 21:19:35 kjcf05n02 puppet-agent[351638]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 21:19:35 kjcf05n02 puppet-agent[351638]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 21:19:35 kjcf05n02 puppet-agent[351638]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 21:19:35 kjcf05n02 puppet-agent[351638]: Applied catalog in 5.15 seconds Nov 4 21:19:35 kjcf05n03 puppet-agent[54775]: Applied catalog in 5.13 seconds Nov 4 21:19:35 kjcf05n06 puppet-agent[2360837]: Applied catalog in 4.80 seconds Nov 4 21:19:35 kjcf05n07 puppet-agent[2363410]: Applied catalog in 4.90 seconds Nov 4 21:19:35 kjcf05n01 puppet-agent[3903223]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 21:19:35 kjcf05n01 puppet-agent[3903223]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 21:19:35 kjcf05n01 puppet-agent[3903223]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 21:19:35 kjcf05n00 puppet-agent[2459102]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 21:19:35 kjcf05n00 puppet-agent[2459102]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 21:19:35 kjcf05n00 puppet-agent[2459102]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 21:19:36 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3891541]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 21:19:36 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 4 21:19:36 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 21:19:36 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 4 21:19:36 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 4 21:19:36 kjcf05n01 puppet-agent[3903223]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: Press Ctrl+C to exit. Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: Plugin support version 1.0 Nov 4 21:19:36 kjcf05n01 zabbix_agent2[3903566]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 21:19:36 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2440939]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 21:19:36 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 21:19:36 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 21:19:36 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 4 21:19:36 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 4 21:19:36 kjcf05n00 puppet-agent[2459102]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: Press Ctrl+C to exit. Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: Plugin support version 1.0 Nov 4 21:19:36 kjcf05n00 zabbix_agent2[2459530]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 21:19:36 kjcf05n00 zabbix-server[2459553]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:19:37 kjcf05n00 zabbix-server[2459564]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:19:37 kjcf05n00 zabbix-server[2459574]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:19:37 kjcf05n00 zabbix-server[2459620]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:19:38 kjcf05n04 puppet-agent[2349034]: Caching catalog for kjcf05n04 Nov 4 21:19:38 kjcf05n04 puppet-agent[2349034]: Applying configuration version '1730776776' Nov 4 21:19:38 kjcf05n01 puppet-agent[3903223]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_210321.log]/mode) mode changed '0644' to '0640' Nov 4 21:19:38 kjcf05n01 puppet-agent[3903223]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_211450.log]/mode) mode changed '0644' to '0640' Nov 4 21:19:38 kjcf05n00 puppet-agent[2459102]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 4 21:19:39 kjcf05n01 puppet-agent[3903223]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_210323.log]/mode) mode changed '0644' to '0640' Nov 4 21:19:39 kjcf05n01 puppet-agent[3903223]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_211450.log]/mode) mode changed '0644' to '0640' Nov 4 21:19:39 kjcf05n01 puppet-agent[3903223]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241104_211451]/mode) mode changed '0755' to '0750' Nov 4 21:19:39 kjcf05n01 puppet-agent[3903223]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241104_211451/screenlog.0]/mode) mode changed '0644' to '0640' Nov 4 21:19:39 kjcf05n01 puppet-agent[3903223]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 21:19:39 kjcf05n01 puppet-agent[3903223]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 21:19:39 kjcf05n01 puppet-agent[3903223]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 21:19:39 kjcf05n00 puppet-agent[2459102]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 21:19:39 kjcf05n00 puppet-agent[2459102]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 21:19:39 kjcf05n00 puppet-agent[2459102]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 21:19:40 kjcf05n04 puppet-agent[2349034]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 21:19:40 kjcf05n04 puppet-agent[2349034]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 21:19:40 kjcf05n04 puppet-agent[2349034]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 21:19:39 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 4 21:19:40 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 4 21:19:40 kjcf05n00 puppet-agent[2459102]: Applied catalog in 8.23 seconds Nov 4 21:19:40 kjcf05n01 puppet-agent[3903223]: Applied catalog in 8.71 seconds Nov 4 21:19:41 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2291570]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 21:19:41 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 4 21:19:41 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 21:19:41 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 4 21:19:41 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 4 21:19:41 kjcf05n04 puppet-agent[2349034]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: Press Ctrl+C to exit. Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: Plugin support version 1.0 Nov 4 21:19:41 kjcf05n04 zabbix_agent2[2349907]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 21:19:42 kjcf05n04 puppet-agent[2349034]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 21:19:42 kjcf05n04 puppet-agent[2349034]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 21:19:42 kjcf05n04 puppet-agent[2349034]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 21:19:42 kjcf05n04 puppet-agent[2349034]: Applied catalog in 4.75 seconds Nov 4 21:19:44 kjcf05n00 mcfcli[3673891]: %3|1730776784.433|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:19:46 kjcf05n05 puppet-agent[2555416]: Caching catalog for kjcf05n05 Nov 4 21:19:46 kjcf05n05 puppet-agent[2555416]: Applying configuration version '1730776783' Nov 4 21:19:47 kjcf05n00 mcfcli[3673891]: %3|1730776787.529|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:19:49 kjcf05n05 puppet-agent[2555416]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 21:19:49 kjcf05n05 puppet-agent[2555416]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 21:19:49 kjcf05n05 puppet-agent[2555416]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 21:19:49 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2497559]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 21:19:49 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 4 21:19:49 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 21:19:49 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 4 21:19:49 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 4 21:19:49 kjcf05n05 puppet-agent[2555416]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: Press Ctrl+C to exit. Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: Plugin support version 1.0 Nov 4 21:19:49 kjcf05n05 zabbix_agent2[2556340]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 21:19:51 kjcf05n05 puppet-agent[2555416]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 21:19:51 kjcf05n05 puppet-agent[2555416]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 21:19:51 kjcf05n05 puppet-agent[2555416]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 21:19:52 kjcf05n05 puppet-agent[2555416]: Applied catalog in 5.99 seconds Nov 4 21:19:51 kjcf05n00 zabbix-server[2459012]: puppet completed status:(0): '' Nov 4 21:19:52 kjcf05n00 zabbix-server[2459012]: Event '46687' acknowledged Nov 4 21:19:52 kjcf05n00 zabbix-server[2459012]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n03"}' Nov 4 21:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 21:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 21:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 21:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 21:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 21:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 21:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 21:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 21:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 21:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 21:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 21:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 21:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 21:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 21:20:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 21:20:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:20:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 21:20:10 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/21', errno='Permission denied (13)' Nov 4 21:20:17 kjcf05n00 mcfcli[3673891]: %3|1730776817.529|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:20:19 kjcf05n00 mcfcli[3673891]: %3|1730776819.322|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:20:21 kjcf05n01 diskmonitor[1331407]: leaving test state: 1 next state: 2 Nov 4 21:20:21 kjcf05n01 diskmonitor[1331407]: lock req: no timeout Nov 4 21:20:21 kjcf05n01 diskmonitor[1331407]: leaving test state: 2 next state: 4 Nov 4 21:20:37 kjcf05n00 python3.9[2460129]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 21:20:47 kjcf05n00 mcfcli[3673891]: %3|1730776847.529|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 21:20:56 kjcf05n00 mcfcli[3673891]: %3|1730776856.925|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:21:17 kjcf05n00 mcfcli[3673891]: %3|1730776877.529|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 21:21:24 kjcf05n01 diskmonitor[1331407]: lock acquired Nov 4 21:21:24 kjcf05n01 diskmonitor[1331407]: leaving test state: 4 next state: 8 Nov 4 21:21:32 kjcf05n01 diskmonitor[1331407]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 4 21:21:32 kjcf05n01 diskmonitor[1331407]: leaving test state: 8 next state: 20 Nov 4 21:21:32 kjcf05n01 diskmonitor[1331407]: leaving test state: 20 next state: 40 Nov 4 21:21:32 kjcf05n01 diskmonitor[1331407]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset ee0aec0000 Nov 4 21:21:32 kjcf05n01 diskmonitor[1331407]: leaving test state: 40 next state: 80 Nov 4 21:21:34 kjcf05n00 mcfcli[3673891]: %3|1730776894.934|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:21:47 kjcf05n00 mcfcli[3673891]: %3|1730776907.530|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:22:13 kjcf05n00 mcfcli[3673891]: %3|1730776933.312|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:22:17 kjcf05n00 mcfcli[3673891]: %3|1730776937.530|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:22:28 kjcf05n01 diskmonitor[1331407]: leaving test state: 80 next state: 100 Nov 4 21:22:28 kjcf05n01 diskmonitor[1331407]: lock release: time: Mon Nov 4 21:22:27 2024 Nov 4 21:22:28 kjcf05n01 diskmonitor[1331407]: leaving test state: 100 next state: 1 Nov 4 21:22:47 kjcf05n00 mcfcli[3673891]: %3|1730776967.530|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:22:53 kjcf05n00 mcfcli[3673891]: %3|1730776973.183|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T03:23:15.867808Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 21:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T03:23:15.867876Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.095ms Nov 4 21:23:17 kjcf05n00 mcfcli[3673891]: %3|1730776997.531|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 21:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T21:23:27.252923569-06:00 level=info msg="Completed cleanup jobs" duration=26.524124ms Nov 4 21:23:31 kjcf05n00 mcfcli[3673891]: %3|1730777011.878|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:23:34 kjcf05n02 nslcd[6957]: [bbd95a] ldap_result() failed: Can't contact LDAP server Nov 4 21:23:47 kjcf05n00 mcfcli[3673891]: %3|1730777027.531|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:24:11 kjcf05n00 mcfcli[3673891]: %3|1730777051.875|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:24:12 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 21:24:12 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 0 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007836 sec, idle for 1 hour(s)] Nov 4 21:24:17 kjcf05n00 mcfcli[3673891]: %3|1730777057.532|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:24:47 kjcf05n00 mcfcli[3673891]: %3|1730777087.532|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 21:24:50 kjcf05n00 mcfcli[3673891]: %3|1730777090.539|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:25:17 kjcf05n00 mcfcli[3673891]: %3|1730777117.532|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 21:25:29 kjcf05n00 mcfcli[3673891]: %3|1730777129.156|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:25:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 21:25:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 21:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 21:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 21:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 21:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 21:25:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 21:25:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 21:25:47 kjcf05n00 mcfcli[3673891]: %3|1730777147.532|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 21:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 21:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 21:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 21:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 21:25:56 kjcf05n00 zabbix_server[15764]: Zabbix agent item "dcs.lustre.device.ost.name[OST0001,ost_name]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 4 21:25:56 kjcf05n00 python3.9[2463219]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 21:25:58 kjcf05n00 zabbix_server[15752]: Zabbix agent item "agent.ping" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 4 21:25:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 21:25:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 21:25:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 21:25:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 21:26:01 kjcf05n03 fstonithd.py[15114]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 4 21:26:02 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 21:26:02 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 21:26:02 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 21:26:02 kjcf05n03 root[66598]: is_viking_off starts Nov 4 21:26:02 kjcf05n03 root[66597]: is_enc_ipmi_off starts Nov 4 21:26:02 kjcf05n03 root[66616]: I am not master; I will get master Nov 4 21:26:03 kjcf05n03 root[66622]: I am in slot 1; partner is in slot 0 Nov 4 21:26:03 kjcf05n03 root[66630]: is_lan_ipmi_off leaves Nov 4 21:26:03 kjcf05n03 root[66632]: is_lan_ipmi_sec_off leaves Nov 4 21:26:08 kjcf05n03 root[66733]: I am now master Nov 4 21:26:08 kjcf05n00 mcfcli[3673891]: %3|1730777168.775|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:26:11 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0001,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 4 21:26:13 kjcf05n00 zabbix_server[15734]: Zabbix agent item "vfs.file.contents["/sys/class/net/ib1/operstate"]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 4 21:26:14 kjcf05n00 zabbix_server[15778]: Zabbix agent item "vfs.fs.size[/mnt/persistent_ha_data,pused]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 4 21:26:16 kjcf05n03 root[66965]: is_viking_off leaves Nov 4 21:26:17 kjcf05n03 root[66968]: kjcf05n02 not already off look at kdump Nov 4 21:26:17 kjcf05n03 root[66969]: is_kdump_off starts Nov 4 21:26:17 kjcf05n03 fence_kdump[66970]: waiting for message from '172.16.2.5' Nov 4 21:26:17 kjcf05n03 fence_kdump[66970]: received valid message from '172.16.2.5' Nov 4 21:26:17 kjcf05n03 root[66985]: is_kdump_off detected kdump on kjcf05n02 Nov 4 21:26:17 kjcf05n03 root[66986]: kjcf05n02 is kdumping Nov 4 21:26:17 kjcf05n03 root[67075]: is_viking_off starts Nov 4 21:26:17 kjcf05n03 root[67074]: is_enc_ipmi_off starts Nov 4 21:26:17 kjcf05n00 mcfcli[3673891]: %3|1730777177.532|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:26:18 kjcf05n03 root[67092]: is_lan_ipmi_off leaves Nov 4 21:26:18 kjcf05n03 root[67094]: is_lan_ipmi_sec_off leaves Nov 4 21:26:18 kjcf05n03 root[67098]: I am master Nov 4 21:26:18 kjcf05n03 root[67100]: I am in slot 1; partner is in slot 0 Nov 4 21:26:23 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='70', error='Connection reset by peer (104)' Nov 4 21:26:23 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='70', client='AF_INET(172.16.2.5:37913)', local='AF_INET(0.0.0.0:601)' Nov 4 21:26:25 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 4 21:26:25 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 4 21:26:26 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.mdt.name[MDT0000,mdt_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 4 21:26:29 kjcf05n03 root[67472]: is_viking_off leaves Nov 4 21:26:29 kjcf05n03 root[67475]: kjcf05n02 not already off look at kdump Nov 4 21:26:29 kjcf05n03 root[67476]: is_kdump_off starts Nov 4 21:26:29 kjcf05n03 fence_kdump[67477]: waiting for message from '172.16.2.5' Nov 4 21:26:29 kjcf05n03 fence_kdump[67477]: received valid message from '172.16.2.5' Nov 4 21:26:29 kjcf05n03 root[67478]: is_kdump_off detected kdump on kjcf05n02 Nov 4 21:26:29 kjcf05n03 root[67479]: kjcf05n02 is kdumping Nov 4 21:26:29 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.array.discovery" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 4 21:26:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 21:26:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 21:26:34 kjcf05n03 dwd[5162]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 4 21:26:34 kjcf05n03 dwd[5162]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 4 21:26:34 kjcf05n03 dwd[5162]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 4 21:26:34 kjcf05n03 dwd[5162]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 4 21:26:34 kjcf05n03 dwd[5162]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 4 21:26:34 kjcf05n03 dwd[5162]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 4 21:26:34 kjcf05n03 dwd[5162]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 4 21:26:34 kjcf05n03 dwd[5162]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 4 21:26:34 kjcf05n03 dwd[5162]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 4 21:26:34 kjcf05n03 dwd[5162]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 4 21:26:34 kjcf05n03 dwd[5162]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 4 21:26:34 kjcf05n03 dwd[5162]: Starting NVME thread for nvme25n1 Nov 4 21:26:34 kjcf05n03 dwd[5162]: Starting NVME thread for nvme8n1 Nov 4 21:26:34 kjcf05n03 dwd[5162]: Starting NVME thread for nvme18n1 Nov 4 21:26:34 kjcf05n03 dwd[5162]: Starting NVME thread for nvme23n1 Nov 4 21:26:35 kjcf05n03 dwd[5162]: Starting NVME thread for nvme9n1 Nov 4 21:26:35 kjcf05n03 dwd[5162]: Starting NVME thread for nvme4n1 Nov 4 21:26:35 kjcf05n03 dwd[5162]: Starting NVME thread for nvme2n1 Nov 4 21:26:35 kjcf05n03 systemd-udevd[69961]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69962]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69964]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69967]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69962]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69967]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69961]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69964]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69962]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69967]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69961]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69964]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69967]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69962]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69961]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69979]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69964]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69967]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69982]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69986]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69985]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69962]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69961]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69979]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69967]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69964]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69986]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69985]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69962]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69961]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69979]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69967]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69964]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69962]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69985]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69986]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69967]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69979]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69964]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69962]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69986]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69967]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69964]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69962]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69985]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69967]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69962]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69979]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69985]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69985]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69962]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69967]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69985]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69962]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69985]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69985]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69962]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69985]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69962]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69985]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69962]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69985]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69962]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 systemd-udevd[69962]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:26:35 kjcf05n03 dwd[5162]: Starting NVME thread for nvme3n1 Nov 4 21:26:35 kjcf05n03 dwd[5162]: Starting NVME thread for nvme19n1 Nov 4 21:26:35 kjcf05n03 dwd[5162]: Starting NVME thread for nvme17n1 Nov 4 21:26:35 kjcf05n03 dwd[5162]: Starting NVME thread for nvme24n1 Nov 4 21:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 21:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 21:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 21:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 21:26:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 21:26:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 21:26:41 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 4 21:26:44 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 4 21:26:46 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 4 21:26:47 kjcf05n00 mcfcli[3673891]: %3|1730777207.532|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 21:26:48 kjcf05n03 diskmonitor[17340]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 4 21:26:48 kjcf05n00 mcfcli[3673891]: %3|1730777208.134|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:26:55 kjcf05n03 diskmonitor[17340]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 4 21:26:55 kjcf05n03 diskmonitor[17340]: Scan for ReadErrorMax change for md65 Nov 4 21:26:55 kjcf05n03 diskmonitor[17340]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 4 21:26:55 kjcf05n03 diskmonitor[17340]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 4 21:26:55 kjcf05n03 diskmonitor[17340]: read_saved_file: md65 no saved speed Nov 4 21:26:55 kjcf05n03 diskmonitor[17340]: reconstruction_policy: sync_action prev = current = idle - md65 Nov 4 21:26:55 kjcf05n03 diskmonitor[17340]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 21:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 21:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 21:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 21:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 21:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 21:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 21:26:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 21:26:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 21:27:17 kjcf05n00 mcfcli[3673891]: %3|1730777237.532|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:27:25 kjcf05n00 mcfcli[3673891]: %3|1730777245.753|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:27:33 kjcf05n03 nslcd[6913]: (re)loading /etc/nsswitch.conf Nov 4 21:27:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 21:27:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 21:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 21:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 21:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 21:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 21:27:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 21:27:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 21:27:47 kjcf05n00 mcfcli[3673891]: %3|1730777267.533|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:27:55 kjcf05n03 nslcd[6913]: [495cff] ldap_result() failed: Can't contact LDAP server Nov 4 21:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 21:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 21:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 21:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 21:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 21:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 21:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 21:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 21:28:04 kjcf05n00 mcfcli[3673891]: %3|1730777284.745|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:28:17 kjcf05n00 mcfcli[3673891]: %3|1730777297.533|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:28:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730777308}"] Nov 4 21:28:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730777308, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:28:28 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:28-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:28 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:28-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:28 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:28-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:28 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:28-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:28 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:28-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:28 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:28-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:28 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:28-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.2106ms Nov 4 21:28:28 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:28-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.2106ms Nov 4 21:28:28 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:28:28 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:28:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:28:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730777308}"] Nov 4 21:28:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730777308, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:28:28 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:28-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:28 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:28-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:28 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:28-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:28 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:28-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:28 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:28-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:28 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:28-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:28 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:28-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.827312ms Nov 4 21:28:28 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:28-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.827312ms Nov 4 21:28:28 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:28:28 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:28:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:28:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730777308}"] Nov 4 21:28:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730777308, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:28:29 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:29-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:29 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:29-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:29 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:29-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:29 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:29-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:29 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:29-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:29 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:29-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:29 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:29-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.197315ms Nov 4 21:28:29 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:29-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.197315ms Nov 4 21:28:29 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:28:29 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:28:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:28:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730777309}"] Nov 4 21:28:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730777309, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:28:29 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:29-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:29 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:29-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:29 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:29-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:29 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:29-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:29 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:29-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:29 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:29-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:29 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:29-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.36015ms Nov 4 21:28:29 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:29-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.36015ms Nov 4 21:28:29 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:28:29 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:28:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:28:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730777309}"] Nov 4 21:28:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730777309, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:28:29 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:29-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:29 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:29-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:29 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:29-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:29 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:29-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:29 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:29-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:29 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:29-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:29 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:29-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.188759ms Nov 4 21:28:29 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:29-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.188759ms Nov 4 21:28:29 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:28:29 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:28:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:28:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730777309}"] Nov 4 21:28:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730777309, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:28:29 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:29-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:29 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:29-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:29 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:29-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:29 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:29-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:29 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:29-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:29 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:29-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:29 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:29-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.856507ms Nov 4 21:28:29 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:29-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.856507ms Nov 4 21:28:29 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:28:29 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:28:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:28:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730777309}"] Nov 4 21:28:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730777309, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:28:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.262277ms Nov 4 21:28:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.262277ms Nov 4 21:28:30 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:28:30 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:28:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:28:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730777309}"] Nov 4 21:28:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730777309, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:28:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.931467ms Nov 4 21:28:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.931467ms Nov 4 21:28:30 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:28:30 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:28:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:28:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730777309}"] Nov 4 21:28:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730777309, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:28:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.881955ms Nov 4 21:28:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.881955ms Nov 4 21:28:30 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:28:30 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:28:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:28:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730777309}"] Nov 4 21:28:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730777309, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:28:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.22685ms Nov 4 21:28:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.22685ms Nov 4 21:28:30 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:28:30 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:28:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:28:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730777309}"] Nov 4 21:28:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730777309, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:28:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:30-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:28:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:30 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:28:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:30-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:28:30 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:28:30-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:28:30 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:28:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.890931ms Nov 4 21:28:30 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:28:30-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.890931ms Nov 4 21:28:30 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:28:30 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:28:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:28:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 21:28:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 21:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 21:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 21:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 21:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 21:28:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 21:28:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 21:28:43 kjcf05n00 mcfcli[3673891]: %3|1730777323.043|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:28:47 kjcf05n00 mcfcli[3673891]: %3|1730777327.533|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 21:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 21:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 21:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 21:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 21:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 21:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 21:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 21:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 21:29:17 kjcf05n00 mcfcli[3673891]: %3|1730777357.534|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 21:29:20 kjcf05n00 mcfcli[3673891]: %3|1730777360.305|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:29:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 21:29:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 21:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 21:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 21:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 21:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 21:29:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 21:29:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 21:29:39 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 4 21:29:39 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 4 21:29:43 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 4 21:29:43 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 4 21:29:43 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 4 21:29:43 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 4 21:29:43 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 4 21:29:43 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 4 21:29:43 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 4 21:29:46 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 4 21:29:47 kjcf05n00 mcfcli[3673891]: %3|1730777387.534|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:29:55 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 4 21:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 21:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 21:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 21:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 21:29:58 kjcf05n00 mcfcli[3673891]: %3|1730777398.443|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 21:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 21:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 21:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 21:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 21:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 21:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 21:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 21:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 21:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 21:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 21:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 21:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 21:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 21:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 21:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 21:30:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 21:30:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:30:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 21:30:10 kjcf05n00 zabbix-server[2465983]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:30:10 kjcf05n00 zabbix-server[2465983]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 4 21:30:10 kjcf05n00 log_interesting_event.py[2465983]: Event '46689' acknowledged Nov 4 21:30:17 kjcf05n00 mcfcli[3673891]: %3|1730777417.535|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 21:30:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 21:30:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 21:30:36 kjcf05n00 mcfcli[3673891]: %3|1730777436.163|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 1ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 21:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 21:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 21:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 21:30:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 21:30:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 21:30:38 kjcf05n00 python3.9[2466116]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 21:30:42 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:55010). Nov 4 21:30:42 kjcf05n01 rsyncd[3908676]: connect from kjcf05n02 (172.16.2.5) Nov 4 21:30:42 kjcf05n01 rsyncd[3908676]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 4 21:30:42 kjcf05n01 rsyncd[3908676]: building file list Nov 4 21:30:42 kjcf05n01 rsyncd[3908676]: sent 11450 bytes received 136 bytes total size 10905 Nov 4 21:30:42 kjcf05n01 systemd[1]: rsyncd@665-172.16.2.2:873-172.16.2.5:55010.service: Succeeded. Nov 4 21:30:47 kjcf05n00 mcfcli[3673891]: %3|1730777447.535|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 21:30:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730777452', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 21:30:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730777452'} Nov 4 21:30:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:30:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730777452', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 21:30:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730777452'} Nov 4 21:30:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 21:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 21:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 21:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 21:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 21:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 21:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 21:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 21:31:01 kjcf05n03 fstonithd.py[15114]: Listening for kdump packets from partner Nov 4 21:31:06 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/21', errno='Permission denied (13)' Nov 4 21:31:12 kjcf05n00 mcfcli[3673891]: %3|1730777472.966|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:31:17 kjcf05n00 mcfcli[3673891]: %3|1730777477.535|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:31:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 21:31:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 21:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 21:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 21:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 21:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 21:31:37 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 4 21:31:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 21:31:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 21:31:47 kjcf05n00 mcfcli[3673891]: %3|1730777507.535|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 21:31:51 kjcf05n00 mcfcli[3673891]: %3|1730777511.556|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 21:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 21:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 21:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 21:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 21:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 21:31:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 21:31:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 21:32:00 kjcf05n03 dwd[5162]: nvme23n1 passed periodic SMART status check Nov 4 21:32:00 kjcf05n03 dwd[5162]: nvme8n1 passed periodic SMART status check Nov 4 21:32:00 kjcf05n03 dwd[5162]: nvme25n1 passed periodic SMART status check Nov 4 21:32:00 kjcf05n03 dwd[5162]: nvme18n1 passed periodic SMART status check Nov 4 21:32:01 kjcf05n03 dwd[5162]: nvme24n1 passed periodic SMART status check Nov 4 21:32:01 kjcf05n03 dwd[5162]: nvme4n1 passed periodic SMART status check Nov 4 21:32:01 kjcf05n03 dwd[5162]: nvme19n1 passed periodic SMART status check Nov 4 21:32:01 kjcf05n03 dwd[5162]: nvme17n1 passed periodic SMART status check Nov 4 21:32:01 kjcf05n03 dwd[5162]: nvme9n1 passed periodic SMART status check Nov 4 21:32:01 kjcf05n03 dwd[5162]: nvme3n1 passed periodic SMART status check Nov 4 21:32:01 kjcf05n03 dwd[5162]: nvme2n1 passed periodic SMART status check Nov 4 21:32:05 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 4 21:32:09 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='70', client='AF_INET(172.16.2.5:36189)', local='AF_INET(0.0.0.0:601)' Nov 4 21:32:09 kjcf05n02 syslog-ng[3162]: Configuration reload request received, reloading configuration; Nov 4 21:32:09 kjcf05n02 syslog-ng[3162]: Configuration reload finished; Nov 4 21:32:09 kjcf05n02 syslog-ng[3162]: Syslog connection established; fd='20', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 4 21:32:09 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 4 21:32:09 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 21:32:09 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 4 21:32:09 kjcf05n02 dracut: Self testing crypto algorithms Nov 4 21:32:09 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 4 21:32:09 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 21:32:09 kjcf05n02 Copying live image to RAM... Nov 4 21:32:09 kjcf05n02 (this may take a minute) Nov 4 21:32:09 kjcf05n02 Done copying live image to RAM. Nov 4 21:32:09 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 4 21:32:09 kjcf05n02 dracut: Checking integrity of kernel Nov 4 21:32:09 kjcf05n02 dracut: All initrd crypto checks done Nov 4 21:32:09 kjcf05n02 dracut: Switching root Nov 4 21:32:09 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 4 21:32:09 kjcf05n02 systemd: Detected architecture x86-64. Nov 4 21:32:09 kjcf05n02 systemd: Set hostname to . Nov 4 21:32:09 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 4 21:32:09 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 4 21:32:09 kjcf05n02 systemd: Listening on LVM2 poll daemon socket. Nov 4 21:32:09 kjcf05n02 systemd: Listening on Process Core Dump Socket. Nov 4 21:32:09 kjcf05n02 systemd: Reached target CXI Retry Handlers Started. Nov 4 21:32:09 kjcf05n02 systemd: Reached target rpc_pipefs.target. Nov 4 21:32:09 kjcf05n02 systemd: Listening on initctl Compatibility Named Pipe. Nov 4 21:32:09 kjcf05n02 systemd-journald[1542]: Journal started Nov 4 21:32:09 kjcf05n02 systemd-journald[1542]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 21:32:09 kjcf05n02 systemd-modules-load[1526]: Inserted module 'fuse' Nov 4 21:32:09 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Create System Users. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 4 21:32:09 kjcf05n02 systemd-sysctl[1553]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 21:32:09 kjcf05n02 systemd-sysctl[1553]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 4 21:32:09 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 4 21:32:09 kjcf05n02 systemd-tmpfiles[1562]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 21:32:09 kjcf05n02 systemd-tmpfiles[1562]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 4 21:32:09 kjcf05n02 systemd-journald[1542]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 4 21:32:09 kjcf05n02 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 4 21:32:09 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 4 21:32:09 kjcf05n02 systemd-udevd[1587]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:32:09 kjcf05n02 systemd-udevd[1599]: Using default interface naming scheme 'rhel-8.0'. Nov 4 21:32:09 kjcf05n02 systemd-udevd[1599]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:32:09 kjcf05n02 systemd-udevd[1572]: Using default interface naming scheme 'rhel-8.0'. Nov 4 21:32:09 kjcf05n02 systemd-udevd[1572]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:32:09 kjcf05n02 systemd-udevd[1618]: Using default interface naming scheme 'rhel-8.0'. Nov 4 21:32:09 kjcf05n02 systemd-udevd[1618]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 4 21:32:09 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 4 21:32:09 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 4 21:32:09 kjcf05n02 root[1792]: openibd: running in auto mode Nov 4 21:32:09 kjcf05n02 systemd-tmpfiles[1786]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 21:32:09 kjcf05n02 systemd-tmpfiles[1786]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 4 21:32:09 kjcf05n02 systemd-tmpfiles[1786]: "/var/tmp" already exists and is not a directory. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started RPC Bind. Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 4 21:32:09 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 4 21:32:09 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 4 21:32:09 kjcf05n02 systemd-modules-load[1908]: Inserted module 'ib_iser' Nov 4 21:32:09 kjcf05n02 systemd-modules-load[1908]: Inserted module 'ib_isert' Nov 4 21:32:09 kjcf05n02 systemd-modules-load[1908]: Inserted module 'ib_srpt' Nov 4 21:32:09 kjcf05n02 systemd-udevd[1612]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:32:09 kjcf05n02 systemd-udevd[1587]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:32:09 kjcf05n02 systemd-modules-load[1901]: Inserted module 'ib_ipoib' Nov 4 21:32:09 kjcf05n02 systemd-modules-load[1908]: Inserted module 'rdma_ucm' Nov 4 21:32:09 kjcf05n02 systemd-modules-load[1908]: Module 'svcrdma' is blacklisted Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 4 21:32:09 kjcf05n02 systemd-udevd[1587]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 21:32:09 kjcf05n02 systemd-udevd[1612]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 21:32:09 kjcf05n02 systemd-modules-load[1901]: Inserted module 'ib_umad' Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 4 21:32:09 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 21:32:09 kjcf05n02 systemd[3162]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:09 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 4 21:32:09 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 4 21:32:09 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 4 21:32:09 kjcf05n02 openibd[1777]: Loading HCA driver and Access Layer:[ OK ] Nov 4 21:32:09 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Update is Completed. Nov 4 21:32:09 kjcf05n02 setup-icl[1760]: Setting LAN IP Address to 203.0.113.3 Nov 4 21:32:09 kjcf05n02 setup-icl[1760]: Setting LAN Subnet Mask to 255.255.255.0 Nov 4 21:32:09 kjcf05n02 setup-icl[1760]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 4 21:32:09 kjcf05n02 setup-icl[1760]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 4 21:32:09 kjcf05n02 systemd-udevd[1612]: Using default interface naming scheme 'rhel-8.0'. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 4 21:32:09 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 4 21:32:09 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 4 21:32:09 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 4 21:32:09 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 4 21:32:09 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 4 21:32:09 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 4 21:32:09 kjcf05n02 systemd[1]: Reached target Sockets. Nov 4 21:32:09 kjcf05n02 systemd[1]: Reached target Basic System. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 21:32:09 kjcf05n02 mcelog[2080]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 4 21:32:09 kjcf05n02 mcelog[2080]: CPU is unsupported Nov 4 21:32:09 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[2093]: Setting up Mellanox network interface: ib0 Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 4 21:32:09 kjcf05n02 nscd[2122]: 2122 monitoring file `/etc/hosts` (1) Nov 4 21:32:09 kjcf05n02 nscd[2122]: 2122 monitoring directory `/etc` (2) Nov 4 21:32:09 kjcf05n02 nscd[2122]: 2122 monitoring file `/etc/resolv.conf` (3) Nov 4 21:32:09 kjcf05n02 nscd[2122]: 2122 monitoring directory `/etc` (2) Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 4 21:32:09 kjcf05n02 beSetMlxConfig[2099]: ConnectX-3 multiport not detected Nov 4 21:32:09 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 0 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 1 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 2 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 3 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 4 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 5 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 6 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 7 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 8 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 9 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 10 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 11 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 12 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 13 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 14 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 15 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 16 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 17 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 18 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 19 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 20 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 21 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 22 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 23 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 24 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 25 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 26 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 27 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 28 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 29 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 30 Nov 4 21:32:09 kjcf05n02 cpupower[2162]: Setting cpu: 31 Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[2159]: Setting up Mellanox network interface: ib1 Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[2166]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 21:32:09 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 4 21:32:09 kjcf05n02 chronyd[2213]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[2209]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 21:32:09 kjcf05n02 beSetMlxConfig[2099]: Starting MST (Mellanox Software Tools) driver set Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[2227]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 4 21:32:09 kjcf05n02 network[2233]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 21:32:09 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 4 21:32:09 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 4 21:32:09 kjcf05n02 dwd[2231]: dwd: vMay 29 2024 : 15:38:26 Nov 4 21:32:09 kjcf05n02 dwd[2231]: /usr/sbin/dwd -d --standalone=0 Nov 4 21:32:09 kjcf05n02 dwd[2231]: dwd: option Lethal: 0 Nov 4 21:32:09 kjcf05n02 dwd[2231]: dwd: option Interval: 60 Nov 4 21:32:09 kjcf05n02 dwd[2231]: dwd: option abrtlimit: 10 Nov 4 21:32:09 kjcf05n02 dwd[2231]: dwd: option DZPeriod: 604800 Nov 4 21:32:09 kjcf05n02 dwd[2231]: dwd: option SmartPeriod: 43200 Nov 4 21:32:09 kjcf05n02 dwd[2231]: dwd: option SDDEnabled: 1 Nov 4 21:32:09 kjcf05n02 dwd[2231]: dwd: option SDDAwaitScale: 3 Nov 4 21:32:09 kjcf05n02 dwd[2231]: dwd: option SDDAwaitMin: 100 Nov 4 21:32:09 kjcf05n02 dwd[2231]: dwd: option Verbosity: 1 Nov 4 21:32:09 kjcf05n02 dwd[2231]: dwd: option StandAlone: 0 Nov 4 21:32:09 kjcf05n02 dwd[2231]: option Lethal: 0 Nov 4 21:32:09 kjcf05n02 dwd[2231]: option Interval: 60 Nov 4 21:32:09 kjcf05n02 dwd[2231]: option abrtlimit: 10 Nov 4 21:32:09 kjcf05n02 dwd[2231]: option DZPeriod: 604800 Nov 4 21:32:09 kjcf05n02 dwd[2231]: option SmartPeriod: 43200 Nov 4 21:32:09 kjcf05n02 dwd[2231]: option SDDEnabled: 1 Nov 4 21:32:09 kjcf05n02 dwd[2231]: option SDDAwaitScale: 3 Nov 4 21:32:09 kjcf05n02 dwd[2231]: option SDDAwaitMin: 100 Nov 4 21:32:09 kjcf05n02 dwd[2231]: option Verbosity: 1 Nov 4 21:32:09 kjcf05n02 dwd[2231]: option StandAlone: 0 Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[2252]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 21:32:09 kjcf05n02 mdraid-phy[2262]: no Cutlass to worry about Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[2261]: No configuration found for ib0 Nov 4 21:32:09 kjcf05n02 dbus-daemon[2211]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 21:32:09 kjcf05n02 beSetMlxConfig[2099]: Loading MST PCI module - Success Nov 4 21:32:09 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 4 21:32:09 kjcf05n02 network[2233]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:32:09 kjcf05n02 network[2265]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 21:32:09 kjcf05n02 chronyd[2213]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 21:32:09 kjcf05n02 chronyd[2213]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 21:32:09 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 0 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 1 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 2 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 3 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 4 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 5 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 6 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 7 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 8 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 9 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 10 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 11 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 12 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 13 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 14 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 15 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 16 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 17 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 18 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 19 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 20 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 21 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 22 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 23 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 24 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 25 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 26 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 27 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 28 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 29 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 30 Nov 4 21:32:09 kjcf05n02 cpupower[2282]: Idlestate 2 disabled on CPU 31 Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[2268]: No configuration found for ib1 Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 4 21:32:09 kjcf05n02 network[2277]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[2278]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 21:32:09 kjcf05n02 network[2233]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 4 21:32:09 kjcf05n02 beSetMlxConfig[2099]: Loading MST PCI configuration module - Success Nov 4 21:32:09 kjcf05n02 beSetMlxConfig[2099]: Create devices Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[2288]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 21:32:09 kjcf05n02 network[2290]: It is advised to switch to 'NetworkManager' instead for network management. Nov 4 21:32:09 kjcf05n02 mlnx_conf_mgr[2316]: INFO: No configurations found for mlx5_0, skipping. Nov 4 21:32:09 kjcf05n02 mlnx_conf_mgr[2345]: INFO: No configurations found for mlx5_1, skipping. Nov 4 21:32:09 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 21:32:09 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 21:32:09 kjcf05n02 sssd[sssd][2169]: Starting up Nov 4 21:32:09 kjcf05n02 sssd[be[implicit_files]][2409]: Starting up Nov 4 21:32:09 kjcf05n02 sssd[nss][2509]: Starting up Nov 4 21:32:09 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 4 21:32:09 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Login Service... Nov 4 21:32:09 kjcf05n02 systemd-logind[2629]: New seat seat0. Nov 4 21:32:09 kjcf05n02 systemd-logind[2629]: Watching system buttons on /dev/input/event0 (Power Button) Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Login Service. Nov 4 21:32:09 kjcf05n02 python3.9[2240]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 21:32:09 kjcf05n02 python3.9[3162]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 21:32:09 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 4 21:32:09 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 4 21:32:09 kjcf05n02 systemd-sysctl[2826]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 21:32:09 kjcf05n02 systemd-sysctl[2826]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 4 21:32:09 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 21:32:09 kjcf05n02 python3.9[2906]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 21:32:09 kjcf05n02 python3.9[3162]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 4 21:32:09 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 21:32:09 kjcf05n02 network[2233]: Bringing up loopback interface: [ OK ] Nov 4 21:32:09 kjcf05n02 systemd-sysctl[3150]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 21:32:09 kjcf05n02 systemd-sysctl[3150]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 21:32:09 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 4 21:32:09 kjcf05n02 python3.9[3106]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 21:32:09 kjcf05n02 python3.9[3162]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:09 kjcf05n02 systemd[1]: Reached target Network. Nov 4 21:32:09 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 4 21:32:09 kjcf05n02 sm-notify[3155]: Version 2.3.3 starting Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 4 21:32:09 kjcf05n02 sshd[3156]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 4 21:32:09 kjcf05n02 beSetMlxConfig[2099]: Unloading MST PCI module (unused) - Success Nov 4 21:32:09 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 4 21:32:09 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 4 21:32:09 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 4 21:32:09 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 4 21:32:09 kjcf05n02 lldpad[3161]: setsockopt nearest_bridge: Invalid argument Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 4 21:32:09 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 21:32:09 kjcf05n02 lldpad[3161]: setsockopt nearest_bridge: Invalid argument Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 4 21:32:09 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 4 21:32:09 kjcf05n02 syslog-ng[3162]: [2024-11-05T03:30:54.284794] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 4 21:32:09 kjcf05n02 syslog-ng[3162]: [2024-11-05T03:30:54.285084] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 4 21:32:09 kjcf05n02 syslog-ng[3162]: [2024-11-05T03:30:54.285121] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 4 21:32:09 kjcf05n02 syslog-ng[3162]: [2024-11-05T03:30:54.285678] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 4 21:32:09 kjcf05n02 syslog-ng[3162]: [2024-11-05T03:30:54.285856] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 4 21:32:09 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 4 21:32:09 kjcf05n02 python3.9[3355]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 21:32:09 kjcf05n02 python3.9[3162]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 4 21:32:09 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 21:32:09 kjcf05n02 python3.9[3414]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 21:32:09 kjcf05n02 python3.9[3162]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 4 21:32:09 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 4 21:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 21:32:09 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 4 21:32:09 kjcf05n02 chronyd[2213]: System's initial offset : 0.004080 seconds slow of true (slew) Nov 4 21:32:09 kjcf05n02 systemd[1]: Started NTP client/server. Nov 4 21:32:09 kjcf05n02 beSetMlxConfig[2099]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 21:32:09 kjcf05n02 beSetMlxConfig[2099]: ib mode Nov 4 21:32:09 kjcf05n02 beSetMlxConfig[2099]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 21:32:09 kjcf05n02 root[3437]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 4 21:32:09 kjcf05n02 root[3439]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 4 21:32:09 kjcf05n02 beSetMlxConfig[2099]: ib mode Nov 4 21:32:09 kjcf05n02 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 21:32:09 kjcf05n02 systemd-udevd[3452]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:32:09 kjcf05n02 systemd-udevd[3453]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:32:09 kjcf05n02 systemd-udevd[3456]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:32:09 kjcf05n02 systemd-udevd[3459]: Using default interface naming scheme 'rhel-8.0'. Nov 4 21:32:09 kjcf05n02 systemd-udevd[3459]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:32:09 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 21:32:09 kjcf05n02 systemd[3162]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:09 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[3494]: Setting up Mellanox network interface: ib0 Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[3495]: Setting up Mellanox network interface: ib1 Nov 4 21:32:09 kjcf05n02 systemd-udevd[3454]: Using default interface naming scheme 'rhel-8.0'. Nov 4 21:32:09 kjcf05n02 systemd-udevd[3454]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[3544]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[3545]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[3560]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[3561]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[3562]: No configuration found for ib1 Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[3563]: No configuration found for ib0 Nov 4 21:32:09 kjcf05n02 systemd-udevd[3455]: Using default interface naming scheme 'rhel-8.0'. Nov 4 21:32:09 kjcf05n02 systemd-udevd[3455]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[3571]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[3570]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 21:32:09 kjcf05n02 mlnx_conf_mgr[3625]: INFO: No configurations found for mlx5_1, skipping. Nov 4 21:32:09 kjcf05n02 mlnx_conf_mgr[3626]: INFO: No configurations found for mlx5_0, skipping. Nov 4 21:32:09 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 21:32:09 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 21:32:09 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 4 21:32:09 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 4 21:32:09 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 4 21:32:09 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 4 21:32:09 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 4 21:32:09 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 21:32:09 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 4 21:32:09 kjcf05n02 lldpad[3161]: init_ports: Error adding device ib0 Nov 4 21:32:09 kjcf05n02 lldpad[3161]: init_ports: Error adding device ib1 Nov 4 21:32:09 kjcf05n02 lldpad[3161]: Signal 15 received - terminating Nov 4 21:32:09 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 4 21:32:09 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 4 21:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 4 21:32:09 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 4 21:32:09 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 4 21:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 4 21:32:09 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 4 21:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:09 kjcf05n02 systemd[3162]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 1 | Nov-05-2024 | 00:31:03 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 2 | Nov-05-2024 | 00:31:58 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 3 | Nov-05-2024 | 00:31:59 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 4 | Nov-05-2024 | 00:33:01 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 5 | Nov-05-2024 | 00:33:01 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 6 | Nov-05-2024 | 03:28:07 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 7 | Nov-05-2024 | 03:28:07 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 8 | Nov-05-2024 | 03:28:07 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 9 | Nov-05-2024 | 03:28:07 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 10 | Nov-05-2024 | 03:28:07 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 11 | Nov-05-2024 | 03:28:07 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 12 | Nov-05-2024 | 03:28:07 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 13 | Nov-05-2024 | 03:28:07 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 14 | Nov-05-2024 | 03:28:07 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 15 | Nov-05-2024 | 03:28:07 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 16 | Nov-05-2024 | 03:28:07 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 17 | Nov-05-2024 | 03:28:07 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 18 | Nov-05-2024 | 03:28:07 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 19 | Nov-05-2024 | 03:28:07 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 20 | Nov-05-2024 | 03:28:07 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 21 | Nov-05-2024 | 03:28:07 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 22 | Nov-05-2024 | 03:28:07 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 23 | Nov-05-2024 | 03:28:07 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 24 | Nov-05-2024 | 03:28:07 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 25 | Nov-05-2024 | 03:28:07 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 26 | Nov-05-2024 | 03:28:07 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 27 | Nov-05-2024 | 03:28:07 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 28 | Nov-05-2024 | 03:28:08 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 29 | Nov-05-2024 | 03:28:08 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 30 | Nov-05-2024 | 03:28:08 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 31 | Nov-05-2024 | 03:28:08 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 32 | Nov-05-2024 | 03:28:08 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 33 | Nov-05-2024 | 03:28:08 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 34 | Nov-05-2024 | 03:28:08 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 35 | Nov-05-2024 | 03:28:08 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 36 | Nov-05-2024 | 03:28:08 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 37 | Nov-05-2024 | 03:28:08 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 38 | Nov-05-2024 | 03:28:38 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 39 | Nov-05-2024 | 03:28:38 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 40 | Nov-05-2024 | 03:28:38 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 41 | Nov-05-2024 | 03:28:38 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 42 | Nov-05-2024 | 03:28:38 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 43 | Nov-05-2024 | 03:28:38 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 44 | Nov-05-2024 | 03:28:38 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 45 | Nov-05-2024 | 03:28:38 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 46 | Nov-05-2024 | 03:28:38 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 47 | Nov-05-2024 | 03:28:38 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 48 | Nov-05-2024 | 03:28:38 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 21:32:09 kjcf05n02 ipmievd[3970]: 49 | Nov-05-2024 | 03:28:38 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 21:32:09 kjcf05n02 ipmievd[3973]: Reading sensors... Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 4 21:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:09 kjcf05n02 systemd[3162]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 4 21:32:09 kjcf05n02 nscd[2122]: 2122 monitored file `/etc/hosts` was moved into place, adding watch Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 21:32:09 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 4 21:32:09 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 4 21:32:09 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 4 21:32:09 kjcf05n02 beSetMlxConfig[4029]: ConnectX-3 multiport not detected Nov 4 21:32:09 kjcf05n02 beSetMlxConfig[4029]: Starting MST (Mellanox Software Tools) driver set Nov 4 21:32:09 kjcf05n02 beSetMlxConfig[4029]: Loading MST PCI module - Success Nov 4 21:32:09 kjcf05n02 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 21:32:09 kjcf05n02 beSetMlxConfig[4029]: [warn] mst_pciconf is already loaded, skipping Nov 4 21:32:09 kjcf05n02 beSetMlxConfig[4029]: Create devices Nov 4 21:32:09 kjcf05n02 beSetMlxConfig[4029]: Unloading MST PCI module (unused) - Success Nov 4 21:32:09 kjcf05n02 ipmievd[3973]: Waiting for events... Nov 4 21:32:09 kjcf05n02 beSetMlxConfig[4029]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 21:32:09 kjcf05n02 beSetMlxConfig[4029]: ib mode Nov 4 21:32:09 kjcf05n02 beSetMlxConfig[4029]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 21:32:09 kjcf05n02 beSetMlxConfig[4029]: ib mode Nov 4 21:32:09 kjcf05n02 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 21:32:09 kjcf05n02 systemd-udevd[4928]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:32:09 kjcf05n02 systemd-udevd[4929]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:32:09 kjcf05n02 systemd-udevd[4932]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:32:09 kjcf05n02 systemd-udevd[4934]: Using default interface naming scheme 'rhel-8.0'. Nov 4 21:32:09 kjcf05n02 systemd-udevd[4934]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:32:09 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 21:32:09 kjcf05n02 systemd[3162]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:09 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[4970]: Setting up Mellanox network interface: ib1 Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[4971]: Setting up Mellanox network interface: ib0 Nov 4 21:32:09 kjcf05n02 systemd-udevd[4930]: Using default interface naming scheme 'rhel-8.0'. Nov 4 21:32:09 kjcf05n02 systemd-udevd[4931]: Using default interface naming scheme 'rhel-8.0'. Nov 4 21:32:09 kjcf05n02 systemd-udevd[4930]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:32:09 kjcf05n02 systemd-udevd[4931]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[5020]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[5021]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[5051]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[5052]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[5053]: No configuration found for ib0 Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[5054]: No configuration found for ib1 Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[5061]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 21:32:09 kjcf05n02 mlnx_interface_mgr[5062]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 21:32:09 kjcf05n02 mlnx_conf_mgr[5098]: INFO: No configurations found for mlx5_0, skipping. Nov 4 21:32:09 kjcf05n02 mlnx_conf_mgr[5102]: INFO: No configurations found for mlx5_1, skipping. Nov 4 21:32:09 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 21:32:09 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}80aed9b19da726f7a11c460f9b64e97a1ac46ec7cd38b20ee43cc3a28a71c9f7' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}80aed9b19da726f7a11c460f9b64e97a1ac46ec7cd38b20ee43cc3a28a71c9f7' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}7e4ea3532fa0f81a49115ea7117e6998ef1a7cbcab437f000701d03cdb690873' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}7e4ea3532fa0f81a49115ea7117e6998ef1a7cbcab437f000701d03cdb690873' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}cfdb6f72c575f48ccaa2ded4fe9fa826f96fea769e20bdd53e3496c77c593869' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}cfdb6f72c575f48ccaa2ded4fe9fa826f96fea769e20bdd53e3496c77c593869' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}cf630f70c10250315d6ab247b9d0fc0ffdf72b8456dd9fb35d227bc1f5af3443' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}cf630f70c10250315d6ab247b9d0fc0ffdf72b8456dd9fb35d227bc1f5af3443' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 21:32:09 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 4 21:32:09 kjcf05n02 chronyd[2213]: chronyd exiting Nov 4 21:32:09 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 4 21:32:09 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 4 21:32:09 kjcf05n02 chronyd[5138]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 21:32:09 kjcf05n02 chronyd[5138]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 21:32:09 kjcf05n02 chronyd[5138]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 21:32:09 kjcf05n02 chronyd[5138]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 4 21:32:09 kjcf05n02 systemd[1]: Started NTP client/server. Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 21:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:09 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 4 21:32:09 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 4 21:32:09 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 21:32:09 kjcf05n02 dwd[5169]: dwd: vMay 29 2024 : 15:38:26 Nov 4 21:32:09 kjcf05n02 dwd[5169]: /usr/sbin/dwd -i 15 -d Nov 4 21:32:09 kjcf05n02 dwd[5169]: dwd: option Lethal: 0 Nov 4 21:32:09 kjcf05n02 dwd[5169]: dwd: option Interval: 15 Nov 4 21:32:09 kjcf05n02 dwd[5169]: dwd: option abrtlimit: 10 Nov 4 21:32:09 kjcf05n02 dwd[5169]: dwd: option DZPeriod: 604800 Nov 4 21:32:09 kjcf05n02 dwd[5169]: dwd: option SmartPeriod: 43200 Nov 4 21:32:09 kjcf05n02 dwd[5169]: dwd: option SDDEnabled: 1 Nov 4 21:32:09 kjcf05n02 dwd[5169]: dwd: option SDDAwaitScale: 3 Nov 4 21:32:09 kjcf05n02 dwd[5169]: dwd: option SDDAwaitMin: 100 Nov 4 21:32:09 kjcf05n02 dwd[5169]: dwd: option Verbosity: 1 Nov 4 21:32:09 kjcf05n02 dwd[5169]: dwd: option StandAlone: 0 Nov 4 21:32:09 kjcf05n02 dwd[5169]: option Lethal: 0 Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 21:32:09 kjcf05n02 dwd[5169]: option Interval: 15 Nov 4 21:32:09 kjcf05n02 dwd[5169]: option abrtlimit: 10 Nov 4 21:32:09 kjcf05n02 dwd[5169]: option DZPeriod: 604800 Nov 4 21:32:09 kjcf05n02 dwd[5169]: option SmartPeriod: 43200 Nov 4 21:32:09 kjcf05n02 dwd[5169]: option SDDEnabled: 1 Nov 4 21:32:09 kjcf05n02 dwd[5169]: option SDDAwaitScale: 3 Nov 4 21:32:09 kjcf05n02 dwd[5169]: option SDDAwaitMin: 100 Nov 4 21:32:09 kjcf05n02 dwd[5169]: option Verbosity: 1 Nov 4 21:32:09 kjcf05n02 dwd[5169]: option StandAlone: 0 Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 4 21:32:09 kjcf05n02 dwd[5170]: option Lethal now set to 1 Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 21:32:09 kjcf05n02 dwd[5170]: option abrtlimit now set to 1 Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 21:32:09 kjcf05n02 dwd[5170]: option SmartPeriod now set to 86400 Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 21:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 21:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:09 kjcf05n02 python3.9[5200]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 4 21:32:09 kjcf05n02 python3.9[3162]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 21:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 21:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 4 21:32:09 kjcf05n02 sedcpwrkr[5337]: Using config script: /etc/sedcpwrkr.conf Nov 4 21:32:09 kjcf05n02 sedcpwrkr[5337]: - Creating default directory: '/var/log/sedcpwrkr' Nov 4 21:32:09 kjcf05n02 sedcpwrkr[5337]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 4 21:32:09 kjcf05n02 sedcpwrkr[5337]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 4 21:32:09 kjcf05n02 sedcpwrkr[5337]: - Creating default directory: '/var/run/sedcpwrkr' Nov 4 21:32:09 kjcf05n02 sedcpwrkr[5337]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 4 21:32:09 kjcf05n02 sedcpwrkr[5337]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 4 21:32:09 kjcf05n02 sedcpwrkr-server[5368]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 21:32:09 kjcf05n02 sedcpwrkr[5337]: celery multi v5.2.7 (dawn-chorus) Nov 4 21:32:09 kjcf05n02 sedcpwrkr[5337]: > Starting nodes... Nov 4 21:32:09 kjcf05n02 sedcpwrkr[5337]: > sedcpwrkr@kjcf05n02: OK Nov 4 21:32:09 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 4 21:32:09 kjcf05n02 sedcpwrkr-server[5370]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 21:32:09 kjcf05n02 sedcpwrkr-server[5370]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 21:32:09 kjcf05n02 sedcpwrkr-server[5370]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 21:32:09 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 21:32:09 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 4 21:32:09 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 21:32:09 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 4 21:32:09 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 4 21:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:09 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 4 21:32:10 kjcf05n02 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 21:32:10 kjcf05n02 iptables.init[5437]: iptables: Applying firewall rules: [ OK ] Nov 4 21:32:10 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 4 21:32:10 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:10 kjcf05n02 systemd[3162]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:10 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:10 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:10 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 4 21:32:10 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 4 21:32:10 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 21:32:10 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 21:32:10 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 4 21:32:10 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 4 21:32:10 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 4 21:32:10 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 4 21:32:10 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 4 21:32:10 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 4 21:32:11 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 21:32:11 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 21:32:11 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 21:32:11 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 4 21:32:11 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 4 21:32:11 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 4 21:32:11 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 4 21:32:11 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 4 21:32:11 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 4 21:32:11 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 4 21:32:11 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 4 21:32:11 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 4 21:32:11 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 4 21:32:11 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 4 21:32:11 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 4 21:32:11 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 4 21:32:11 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 4 21:32:11 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 4 21:32:11 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 4 21:32:11 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 4 21:32:11 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 4 21:32:11 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 4 21:32:11 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 4 21:32:11 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 4 21:32:11 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 4 21:32:11 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 4 21:32:11 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 4 21:32:11 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 4 21:32:11 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 21:32:11 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 21:32:11 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 4 21:32:11 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 4 21:32:11 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 21:32:11 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 21:32:11 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 4 21:32:11 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 4 21:32:11 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 21:32:11 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 21:32:11 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 21:32:11 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 21:32:11 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:11 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 21:32:11 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5536 which is not our child. We'll most likely not notice when it exits. Nov 4 21:32:11 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 21:32:11 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:11 kjcf05n02 openhpid[5536]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 21:32:11 kjcf05n02 openhpid[5536]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 21:32:11 kjcf05n02 openhpid[5536]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 21:32:11 kjcf05n02 openhpid[5536]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 21:32:12 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:12 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:12 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:12 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 4 21:32:12 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 4 21:32:12 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 21:32:12 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 21:32:12 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:12 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 4 21:32:12 kjcf05n02 dcs-collectord[5627]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 4 21:32:12 kjcf05n02 hpi.inv.log[5627]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 4 21:32:12 kjcf05n02 dcs-collectord[5627]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 4 21:32:12 kjcf05n02 dcs-collectord[5627]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 4 21:32:12 kjcf05n02 dcs-collector[5618]: Starting dcs-collector:[ OK ] Nov 4 21:32:12 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 4 21:32:12 kjcf05n02 dcs-collectord[5630]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 21:32:12 kjcf05n02 dcs-collectord[5630]: INFO Starting collection for memory_info (collection_process.py:52) Nov 4 21:32:12 kjcf05n02 dcs-collectord[5630]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 21:32:12 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 4 21:32:12 kjcf05n02 dcs-collectord[5630]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 21:32:12 kjcf05n02 dcs-collectord[5630]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 4 21:32:12 kjcf05n02 dcs-collectord[5630]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 4 21:32:12 kjcf05n02 dcs-collectord[5630]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 4 21:32:12 kjcf05n02 dcs-collectord[5630]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259348572", "units": "kB"}, {"name": "MemAvailable", "value": "258627712", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821264", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686756", "units": "kB"}, {"name": "Inactive", "value": "959056", "units": "kB"}, {"name": "Active(anon)", "value": "1520724", "units": "kB"}, {"name": "Inactive(anon)", "value": "822768", "units": "kB"}, {"name": "Active(file)", "value": "166032", "units": "kB"}, {"name": "Inactive(file)", "value": "136288", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "749864", "units": "kB"}, {"name": "Mapped", "value": "86404", "units": "kB"}, {"name": "Shmem", "value": "1593388", "units": "kB"}, {"name": "KReclaimable", "value": "108128", "units": "kB"}, {"name": "Slab", "value": "274468", "units": "kB"}, {"name": "SReclaimable", "value": "108128", "units": "kB"}, {"name": "SUnreclaim", "value": "166340", "units": "kB"}, {"name": "KernelStack", "value": "9776", "units": "kB"}, {"name": "PageTables", "value": "20464", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3192860", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11264", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "2048", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "285000", "units": "kB"}, {"name": "DirectMap2M", "value": "20551680", "units": "kB"}, {"name": "DirectMap1G", "value": "247463936", "units": "kB"}]}' Nov 4 21:32:12 kjcf05n02 dcs-collectord[5630]: INFO Completed collection for memory_info (collection_process.py:59) Nov 4 21:32:12 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:13 kjcf05n02 dcs-collectord[5630]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 4 21:32:13 kjcf05n02 dcs-collectord[5630]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730777532.691329], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730777532.9267874], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730777532.62525, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 4 21:32:13 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:13 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 4 21:32:13 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:13 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:13 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 4 21:32:13 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 4 21:32:13 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 21:32:13 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 21:32:13 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:13 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 4 21:32:13 kjcf05n02 firmware-update-orc[5736]: Using config script: /etc/firmware_update_orc.conf Nov 4 21:32:13 kjcf05n02 firmware-update-orc[5736]: - Creating default directory: '/var/log/firmware-update-orc' Nov 4 21:32:13 kjcf05n02 firmware-update-orc[5736]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 4 21:32:13 kjcf05n02 firmware-update-orc[5736]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 4 21:32:13 kjcf05n02 firmware-update-orc[5736]: - Creating default directory: '/var/run/firmware-update-orc' Nov 4 21:32:13 kjcf05n02 firmware-update-orc[5736]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 4 21:32:13 kjcf05n02 firmware-update-orc[5736]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 4 21:32:14 kjcf05n02 firmware-update-orc-server[5772]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 21:32:14 kjcf05n02 firmware-update-orc[5736]: celery multi v5.2.7 (dawn-chorus) Nov 4 21:32:14 kjcf05n02 firmware-update-orc[5736]: > Starting nodes... Nov 4 21:32:14 kjcf05n02 firmware-update-orc[5736]: > worker1@kjcf05n02: OK Nov 4 21:32:14 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 4 21:32:14 kjcf05n02 firmware-update-orc-server[5776]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 21:32:14 kjcf05n02 firmware-update-orc-server[5776]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 21:32:14 kjcf05n02 firmware-update-orc-server[5776]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 21:32:14 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 4 21:32:14 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:14 kjcf05n02 systemd[3162]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:14 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:14 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:14 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 21:32:14 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 21:32:14 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 21:32:14 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 21:32:14 kjcf05n02 dbus-daemon[2211]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 21:32:14 kjcf05n02 dbus-daemon[2211]: [system] Reloaded configuration Nov 4 21:32:14 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 4 21:32:14 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 4 21:32:14 kjcf05n02 dbus-daemon[2211]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 21:32:14 kjcf05n02 dbus-daemon[2211]: [system] Reloaded configuration Nov 4 21:32:14 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 21:32:14 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 21:32:14 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 21:32:14 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 21:32:14 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:15 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 4 21:32:15 kjcf05n02 ras-resource-manager-agent[5892]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 4 21:32:15 kjcf05n02 ras-resource-manager-agent[5878]: Starting ras-resource-manager-agent:[ OK ] Nov 4 21:32:15 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 4 21:32:15 kjcf05n02 ras-resource-manager-agent[5894]: INFO Starting the service handler (service_main_handler.py:98) Nov 4 21:32:15 kjcf05n02 ras-resource-manager-client[5894]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 4 21:32:15 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 4 21:32:15 kjcf05n02 ras-resource-manager-client[5894]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 21:32:15 kjcf05n02 ras-resource-manager-client[5904]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 21:32:15 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:15 kjcf05n02 systemd[3162]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:15 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:15 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:15 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 21:32:15 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 21:32:15 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:16 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 21:32:16 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:16 kjcf05n02 systemd[3162]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: Press Ctrl+C to exit. Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: Plugin support version 1.0 Nov 4 21:32:16 kjcf05n02 zabbix_agent2[5978]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 21:32:16 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:16 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:16 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:17 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 4 21:32:17 kjcf05n02 dcs-notification-sender[6056]: dcs-notification-senderd is stopped Nov 4 21:32:17 kjcf05n02 zabbix-agent2[6070]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 4 21:32:17 kjcf05n02 dcs-notification-sender[6056]: Starting notification-sender:[ OK ] Nov 4 21:32:17 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 4 21:32:17 kjcf05n02 zabbix-agent2[6072]: INFO DCS notification agent started. (agent.py:61) Nov 4 21:32:17 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 4 21:32:17 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:17 kjcf05n00 mcfcli[3673891]: %3|1730777537.536|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 21:32:17 kjcf05n02 systemd[3162]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:17 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:17 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:17 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:18 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 4 21:32:18 kjcf05n02 dcs-collectord[6178]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 4 21:32:18 kjcf05n02 dcs-collectord[6178]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 4 21:32:18 kjcf05n02 dcs-bulk-data-sender[6178]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 4 21:32:18 kjcf05n02 dcs-bulk-data-sender[6149]: Starting bulk-data-sender:[ OK ] Nov 4 21:32:18 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 4 21:32:18 kjcf05n02 dcs-collectord[6180]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 4 21:32:18 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 4 21:32:18 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:18 kjcf05n02 systemd[3162]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:18 kjcf05n02 nscd[2122]: 2122 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 4 21:32:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 21:32:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 21:32:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 21:32:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 21:32:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 21:32:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 21:32:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 4 21:32:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 4 21:32:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 4 21:32:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 4 21:32:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 21:32:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 21:32:18 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 21:32:18 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 21:32:19 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 21:32:19 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 21:32:19 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 21:32:19 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 21:32:19 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 4 21:32:19 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 4 21:32:19 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 4 21:32:19 kjcf05n02 sssd[nss][2509]: Shutting down (status = 0) Nov 4 21:32:19 kjcf05n02 sssd[be[implicit_files]][2409]: Shutting down (status = 0) Nov 4 21:32:19 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 4 21:32:19 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 4 21:32:19 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 4 21:32:20 kjcf05n02 sssd[sssd][6247]: Starting up Nov 4 21:32:20 kjcf05n02 sssd[be[implicit_files]][6249]: Starting up Nov 4 21:32:20 kjcf05n02 python3.9[5200]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 4 21:32:20 kjcf05n02 python3.9[3162]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:20 kjcf05n02 sssd[nss][6250]: Starting up Nov 4 21:32:20 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 21:32:20 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 4 21:32:20 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 4 21:32:20 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 4 21:32:21 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 21:32:21 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 21:32:21 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 4 21:32:21 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 4 21:32:21 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 4 21:32:21 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 4 21:32:21 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 21:32:21 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 21:32:21 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 21:32:21 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 21:32:21 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 4 21:32:21 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 4 21:32:21 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:21 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 4 21:32:21 kjcf05n00 zabbix_server[15697]: item "kjcf05n02:vfs.fs.size[/mnt/persistent_ha_data,total]" became not supported: no such file or directory Nov 4 21:32:21 kjcf05n00 zabbix-server[2467397]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:32:21 kjcf05n00 zabbix-server[2467397]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 305.35\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 135.43\\"}}"' Nov 4 21:32:21 kjcf05n00 log_interesting_event.py[2467397]: Event '46691' acknowledged Nov 4 21:32:22 kjcf05n00 zabbix-server[2467398]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:32:22 kjcf05n02 icinga2[6315]: [2024-11-04 21:32:21 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 4 21:32:22 kjcf05n02 icinga2[6315]: [2024-11-04 21:32:21 -0600] information/cli: Loading configuration file(s). Nov 4 21:32:22 kjcf05n02 icinga2[6315]: [2024-11-04 21:32:21 -0600] information/ConfigItem: Committing config item(s). Nov 4 21:32:22 kjcf05n02 icinga2[6315]: [2024-11-04 21:32:21 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 4 21:32:22 kjcf05n02 icinga2[6315]: [2024-11-04 21:32:21 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 4 21:32:22 kjcf05n02 icinga2[6315]: [2024-11-04 21:32:21 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 4 21:32:22 kjcf05n02 icinga2[6315]: [2024-11-04 21:32:21 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 4 21:32:22 kjcf05n02 icinga2[6315]: [2024-11-04 21:32:21 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 4 21:32:22 kjcf05n02 icinga2[6315]: [2024-11-04 21:32:21 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 4 21:32:22 kjcf05n02 icinga2[6315]: [2024-11-04 21:32:21 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 4 21:32:22 kjcf05n02 icinga2[6315]: [2024-11-04 21:32:21 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 4 21:32:22 kjcf05n02 icinga2[6315]: [2024-11-04 21:32:21 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 4 21:32:22 kjcf05n02 icinga2[6315]: [2024-11-04 21:32:21 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 4 21:32:22 kjcf05n02 icinga2[6315]: [2024-11-04 21:32:21 -0600] information/cli: Closing console log. Nov 4 21:32:22 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 4 21:32:22 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:22 kjcf05n00 zabbix-server[2467398]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 4 21:32:22 kjcf05n00 log_interesting_event.py[2467398]: Event '46692' acknowledged Nov 4 21:32:22 kjcf05n02 systemd[3162]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:22 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:22 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:22 kjcf05n00 zabbix-server[2467399]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:32:22 kjcf05n00 zabbix-server[2467399]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 4 21:32:22 kjcf05n00 log_interesting_event.py[2467399]: Event '46693' acknowledged Nov 4 21:32:22 kjcf05n00 zabbix_server[15660]: item "kjcf05n02:vfs.fs.inode[/mnt/persistent_ha_data,pfree]" became not supported: no such file or directory Nov 4 21:32:22 kjcf05n00 zabbix_server[15660]: item "kjcf05n02:vfs.fs.size[/mnt/persistent_ha_data,used]" became not supported: no such file or directory Nov 4 21:32:22 kjcf05n00 zabbix_server[15660]: item "kjcf05n02:vfs.fs.size[/mnt/persistent_ha_data,pused]" became not supported: no such file or directory Nov 4 21:32:22 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 21:32:22 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 21:32:22 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:23 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 4 21:32:23 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:23 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 21:32:23 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:23 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:24 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 21:32:24 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 21:32:24 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 21:32:24 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 21:32:24 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 4 21:32:24 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 4 21:32:24 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 4 21:32:24 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 4 21:32:24 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 21:32:24 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 21:32:24 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 21:32:24 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 21:32:24 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 4 21:32:24 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 4 21:32:24 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:24 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 4 21:32:24 kjcf05n02 nslcd[6931]: version 0.9.9 starting Nov 4 21:32:24 kjcf05n02 nslcd[6931]: accepting connections Nov 4 21:32:24 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 4 21:32:24 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:24 kjcf05n00 zabbix-server[2467404]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:32:24 kjcf05n00 zabbix-server[2467404]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:25\\"}}"' Nov 4 21:32:24 kjcf05n00 log_interesting_event.py[2467404]: Event '46696' acknowledged Nov 4 21:32:25 kjcf05n02 systemd[3162]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:25 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:25 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:25 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 21:32:25 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 21:32:25 kjcf05n02 dcs-bulk-data-sender[6180]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 4 21:32:25 kjcf05n02 dcs-collectord[6180]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 4 21:32:25 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 21:32:25 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 21:32:25 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 21:32:25 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 21:32:26 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 21:32:26 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 21:32:26 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:26 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 4 21:32:26 kjcf05n02 dearcpw[7173]: Using config script: /etc/dearcpw.conf Nov 4 21:32:26 kjcf05n02 dearcpw[7173]: - Creating default directory: '/var/log/dearcpw' Nov 4 21:32:26 kjcf05n02 dearcpw[7173]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 4 21:32:26 kjcf05n02 dearcpw[7173]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 4 21:32:26 kjcf05n02 dearcpw[7173]: - Creating default directory: '/var/run/dearcpw' Nov 4 21:32:26 kjcf05n02 dearcpw[7173]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 4 21:32:26 kjcf05n02 dearcpw[7173]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 4 21:32:26 kjcf05n02 dearcpw-server[7213]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 21:32:26 kjcf05n02 dearcpw[7173]: celery multi v5.2.7 (dawn-chorus) Nov 4 21:32:26 kjcf05n02 dearcpw[7173]: > Starting nodes... Nov 4 21:32:26 kjcf05n02 dearcpw[7173]: > dearcpw@kjcf05n02: OK Nov 4 21:32:26 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 4 21:32:26 kjcf05n02 dearcpw-server[7215]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 21:32:26 kjcf05n02 dearcpw-server[7215]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 21:32:26 kjcf05n02 dearcpw-server[7215]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 21:32:27 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 4 21:32:27 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:27 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:27 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 4 21:32:27 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 4 21:32:27 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 4 21:32:27 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 4 21:32:27 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 4 21:32:27 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 4 21:32:27 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 4 21:32:27 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 4 21:32:27 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 4 21:32:27 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 4 21:32:27 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:55044). Nov 4 21:32:27 kjcf05n01 rsyncd[3909290]: connect from kjcf05n02 (172.16.2.5) Nov 4 21:32:27 kjcf05n01 rsyncd[3909290]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 4 21:32:27 kjcf05n01 rsyncd[3909290]: receiving file list Nov 4 21:32:27 kjcf05n01 rsyncd[3909290]: sent 29 bytes received 325 bytes total size 10905 Nov 4 21:32:27 kjcf05n01 systemd[1]: rsyncd@666-172.16.2.2:873-172.16.2.5:55044.service: Succeeded. Nov 4 21:32:27 kjcf05n02 puppet[7418]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 4 21:32:27 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 4 21:32:27 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 4 21:32:27 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 4 21:32:27 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 4 21:32:27 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 4 21:32:27 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 4 21:32:27 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 21:32:27 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 21:32:27 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 21:32:27 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 21:32:27 kjcf05n02 dcs-collectord[5630]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 21:32:27 kjcf05n02 dcs-collectord[5630]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 21:32:27 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 21:32:27 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 21:32:28 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 21:32:28 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 21:32:28 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 21:32:28 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 21:32:28 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 21:32:28 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 21:32:29 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 21:32:29 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 21:32:29 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 21:32:29 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 21:32:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 21:32:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 21:32:30 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:30 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 4 21:32:30 kjcf05n02 diskless-swap[7602]: HA_PS_000: recovering journal Nov 4 21:32:30 kjcf05n02 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 21:32:30 kjcf05n02 diskless-swap[7602]: HA_PS_000: clean, 2292/6400 files, 7090/25600 blocks Nov 4 21:32:30 kjcf05n02 diskless-swap[7602]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 4 21:32:30 kjcf05n02 diskless-swap[7602]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 4 21:32:30 kjcf05n02 diskless-swap[7602]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 4 21:32:30 kjcf05n02 diskless-swap[7602]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 4 21:32:30 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 4 21:32:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 4 21:32:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 4 21:32:30 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 21:32:30 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 21:32:30 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 4 21:32:31 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 4 21:32:31 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 4 21:32:31 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 4 21:32:31 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 4 21:32:31 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 4 21:32:31 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 4 21:32:31 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 4 21:32:31 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 4 21:32:31 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 4 21:32:31 kjcf05n02 ipmievd[3973]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 4 21:32:31 kjcf05n02 ipmievd[3973]: System Event sensor - Timestamp Clock Sync Nov 4 21:32:31 kjcf05n02 ipmievd[3162]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:31 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 21:32:31 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 21:32:31 kjcf05n00 mcfcli[3673891]: %3|1730777551.553|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:32:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 21:32:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 21:32:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 21:32:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 21:32:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 21:32:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 21:32:32 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 21:32:32 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 21:32:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 21:32:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 21:32:33 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 21:32:33 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 21:32:33 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 21:32:33 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 21:32:34 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 21:32:34 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 21:32:34 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 21:32:34 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 21:32:34 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:34 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 4 21:32:34 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:34 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:34 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 4 21:32:34 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 4 21:32:34 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:35 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 4 21:32:35 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:35 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:35 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 21:32:35 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 21:32:35 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:35 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 4 21:32:35 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:35 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:35 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 4 21:32:35 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 4 21:32:35 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 4 21:32:35 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 4 21:32:35 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 4 21:32:35 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 4 21:32:35 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 21:32:35 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 21:32:35 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 21:32:35 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 21:32:35 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:35 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 4 21:32:35 kjcf05n02 kdumpctl[7836]: kdump: No kdump initial ramdisk found. Nov 4 21:32:35 kjcf05n02 kdumpctl[7836]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 4 21:32:36 kjcf05n02 dracut[7948]: dracut-049-135.git20210121.el8 Nov 4 21:32:36 kjcf05n02 dracut[7950]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 4 21:32:36 kjcf05n02 dracut[7950]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 21:32:36 kjcf05n02 dracut[7950]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 21:32:36 kjcf05n02 dracut[7950]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 4 21:32:36 kjcf05n02 dracut[7950]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 4 21:32:36 kjcf05n02 dracut[7950]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 21:32:36 kjcf05n02 dracut[7950]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 21:32:36 kjcf05n02 dracut[7950]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + is_func check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check -h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local dev holder Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + require_binaries mdadm expr Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _module_name=90hperaid Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ mdadm = \-\m ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for cmd in "$@" Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + find_binary mdadm Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for cmd in "$@" Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + find_binary expr Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n -h ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for dev in "${!host_fs_types[@]}" Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ nfs != *_raid_member ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + continue Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _ret=255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + ret=255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ 255 = 0 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ 255 = 255 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ module_depends hperaid Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: +++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: +++ set -x Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ depends Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo rootfs-block Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ return 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ _ret=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ return 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for _moddep in $(module_depends $_mod) Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all == *\ hperaid\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + add_dracutmodules+=' rootfs-block ' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ == *\ hperaid\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check_module rootfs-block Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _mod=rootfs-block Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ == *\ rootfs-block\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n '' ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + mods_checked_as_dep+=' rootfs-block ' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all == *\ rootfs-block\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + module_check rootfs-block 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 2 -eq 2 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _forced=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + is_func check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check -h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _ret=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + ret=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ 0 = 0 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ module_depends rootfs-block Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: +++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 21:32:36 kjcf05n02 kdumpctl[3162]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ depends Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo fs-lib Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ _ret=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ return 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for _moddep in $(module_depends $_mod) Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all == *\ rootfs-block\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + add_dracutmodules+=' fs-lib ' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ == *\ rootfs-block\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check_module fs-lib Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _mod=fs-lib Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n '' ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + mods_checked_as_dep+=' fs-lib ' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all == *\ fs-lib\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + module_check fs-lib 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 2 -eq 2 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _forced=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + is_func check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check -h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _ret=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + ret=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ 0 = 0 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ module_depends fs-lib Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: +++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ depends Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ return 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ _ret=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ return 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + mods_to_load+=' fs-lib ' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + mods_to_load+=' rootfs-block ' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + mods_to_load+=' hperaid ' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _mod=90kernel-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _mod=kernel-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check_module kernel-modules 1 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _mod=kernel-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all = all ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + module_check kernel-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 1 -eq 2 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + is_func check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check -h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + true Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _ret=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + ret=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ 0 != 0 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ module_depends kernel-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: +++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ depends Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ true Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ _ret=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ return 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + mods_to_load+=' kernel-modules ' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _mod=90kernel-modules-extra Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _mod=kernel-modules-extra Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check_module kernel-modules-extra 1 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _mod=kernel-modules-extra Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all = all ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + module_check kernel-modules-extra Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 1 -eq 2 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + is_func check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check -h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + true Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _ret=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + ret=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ 0 != 0 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ module_depends kernel-modules-extra Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: +++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ depends Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ true Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ _ret=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ return 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + mods_to_load+=' kernel-modules-extra ' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _mod=90kernel-network-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _mod=kernel-network-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check_module kernel-network-modules 1 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _mod=kernel-network-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all = all ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + module_check kernel-network-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 1 -eq 2 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + is_func check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check -h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _ret=255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + ret=255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ 255 != 0 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 1 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _mod=90livenet Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _mod=livenet Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check_module livenet 1 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _mod=livenet Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all = all ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + module_check livenet Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 1 -eq 2 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + is_func check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check -h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _ret=255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + ret=255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ 255 != 0 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 1 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _mod=90lvm Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _mod=lvm Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check_module lvm 1 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _mod=lvm Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all = all ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + module_check lvm Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 1 -eq 2 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + is_func check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check -h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + require_binaries lvm Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _module_name=90lvm Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ lvm = \-\m ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for cmd in "$@" Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + find_binary lvm Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n -h ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for fs in "${host_fs_types[@]}" Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ nfs = LVM*_member ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _ret=255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + ret=255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ 255 != 0 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 1 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _mod=90mdraid Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _mod=mdraid Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check_module mdraid 1 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _mod=mdraid Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all = all ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + module_check mdraid Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 1 -eq 2 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + is_func check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check -h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _rootdev Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + require_binaries mdadm expr Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _module_name=90mdraid Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ mdadm = \-\m ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for cmd in "$@" Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + find_binary mdadm Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for cmd in "$@" Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + find_binary expr Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n -h ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for dev in "${!host_fs_types[@]}" Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ nfs != *_raid_member ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + continue Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _ret=255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + ret=255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ 255 != 0 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 1 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _mod=90multipath Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _mod=multipath Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check_module multipath 1 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _mod=multipath Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all = all ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + module_check multipath Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 1 -eq 2 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + is_func check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check -h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _rootdev Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n -h ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for_each_host_dev_and_slaves is_mpath Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _func=is_mpath Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _dev Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for _dev in "${host_devs[@]}" Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + continue Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 1 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _ret=255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + ret=255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ 255 != 0 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 1 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _mod=90qemu Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _mod=qemu Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check_module qemu 1 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _mod=qemu Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all = all ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + module_check qemu Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 1 -eq 2 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + is_func check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check -h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n -h ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + type -P systemd-detect-virt Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ systemd-detect-virt --vm Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + vm=none Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + (( 1 != 0 )) Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _ret=255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + ret=255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ 255 != 0 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 1 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _mod=90qemu-net Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _mod=qemu-net Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check_module qemu-net 1 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _mod=qemu-net Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all = all ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + module_check qemu-net Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 1 -eq 2 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + is_func check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check -h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n -h ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + type -P systemd-detect-virt Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ systemd-detect-virt --vm Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + vm= Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + (( 1 != 0 )) Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _ret=255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + ret=255 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ 255 != 0 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + return 1 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _mod=90stratis Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + _mod=stratis Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check_module stratis 1 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _mod=stratis Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ all = all ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + module_check stratis Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 1 -eq 2 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + is_func check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + check -h Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _module_name=90stratis Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + local _ret=0 Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + [[ stratisd-init = \-\m ]] Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + for cmd in "$@" Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + find_binary stratisd-init Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 4 21:32:36 kjcf05n02 kdumpctl[7836]: + set +x Nov 4 21:32:36 kjcf05n02 dracut[7950]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 21:32:36 kjcf05n02 dracut[7950]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 4 21:32:36 kjcf05n02 dracut[7950]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 4 21:32:36 kjcf05n02 dracut[7950]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 4 21:32:36 kjcf05n02 dracut[7950]: memstrack is available Nov 4 21:32:36 kjcf05n02 dracut[7950]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 21:32:36 kjcf05n02 dracut[7950]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 21:32:36 kjcf05n02 dracut[7950]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 21:32:37 kjcf05n02 dracut[7950]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 21:32:37 kjcf05n02 dracut[7950]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 21:32:37 kjcf05n02 dracut[7950]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 21:32:37 kjcf05n02 dracut[7950]: *** Including module: bash *** Nov 4 21:32:37 kjcf05n02 dracut[7950]: *** Including module: systemd *** Nov 4 21:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 21:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 21:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 21:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 21:32:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 21:32:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 21:32:38 kjcf05n02 dracut[7950]: *** Including module: fips *** Nov 4 21:32:38 kjcf05n02 dracut[7950]: *** Including module: systemd-initrd *** Nov 4 21:32:38 kjcf05n02 dracut[7950]: *** Including module: watchdog-modules *** Nov 4 21:32:38 kjcf05n02 dracut[7950]: *** Including module: nss-softokn *** Nov 4 21:32:38 kjcf05n02 dracut[7950]: *** Including module: i18n *** Nov 4 21:32:38 kjcf05n02 dracut[7950]: No KEYMAP configured. Nov 4 21:32:38 kjcf05n02 dracut[7950]: *** Including module: network-legacy *** Nov 4 21:32:38 kjcf05n02 dracut[7950]: *** Including module: network *** Nov 4 21:32:39 kjcf05n02 dracut[7950]: *** Including module: ib_bonding *** Nov 4 21:32:39 kjcf05n02 dracut[7950]: *** Including module: drm *** Nov 4 21:32:39 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 4 21:32:39 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[02-03]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 4 21:32:39 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 4 21:32:39 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[02-03]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running Nov 4 21:32:39 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 4 21:32:39 kjcf05n00 zabbix_server[15685]: item "kjcf05n02:vfs.fs.inode[/mnt/persistent_ha_data,pfree]" became supported Nov 4 21:32:42 kjcf05n02 dracut[7950]: *** Including module: hperaid *** Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + install Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + local rule rule_path Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + inst_multiple cat expr Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.QMUUf0/initramfs -a -f cat expr Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + _ret=0 Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + (( 0 != 0 )) Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + : Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + return 0 Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + inst_multiple -o mdmon Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.QMUUf0/initramfs -a -f -o mdmon Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + _ret=0 Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + (( 0 != 0 )) Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + : Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + return 0 Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: ++ command -v partx Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + inst /usr/sbin/partx /sbin/partx Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + local _hostonly_install Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + [[ /usr/sbin/partx == \-\H ]] Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + [[ -e /tmp/dracut.QMUUf0/initramfs//sbin/partx ]] Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.QMUUf0/initramfs -f /usr/sbin/partx /sbin/partx Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + (( 0 != 0 )) Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + : Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: ++ command -v mdadm Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + local _hostonly_install Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + [[ -e /tmp/dracut.QMUUf0/initramfs//sbin/mdadm ]] Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.QMUUf0/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + (( 0 != 0 )) Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + : Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + [[ yes == \y\e\s ]] Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + local _raidconf Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: ++ cmdline Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: ++ local _activated dev line UUID Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: ++ declare -A _activated Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: ++ for dev in "${!host_fs_types[@]}" Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: ++ [[ nfs != *_raid_member ]] Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: ++ continue Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + _raidconf= Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + [[ -n '' ]] Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + inst_rules 64-md-raid.rules Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + local _target=/etc/udev/rules.d _rule _found Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + inst_dir /usr/lib/udev/rules.d Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + [[ -e /tmp/dracut.QMUUf0/initramfs//usr/lib/udev/rules.d ]] Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + return 0 Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + inst_dir /etc/udev/rules.d Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + [[ -e /tmp/dracut.QMUUf0/initramfs//etc/udev/rules.d ]] Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + return 0 Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + for _rule in "$@" Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + continue Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + continue Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + for r in '' $dracutbasedir/rules.d/ Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + [[ 64-md-raid.rules != /* ]] Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + continue Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + for r in '' $dracutbasedir/rules.d/ Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + continue Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + [[ -n '' ]] Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 4 21:32:42 kjcf05n02 kdumpctl[7836]: + set +x Nov 4 21:32:42 kjcf05n02 dracut[7950]: Skipping udev rule: 64-md-raid.rules Nov 4 21:32:43 kjcf05n02 dcs-collectord[5630]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 21:32:43 kjcf05n02 dcs-collectord[5630]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + installkernel Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + instmods =drivers/md Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + local _optional=-o Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + local _silent Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + local _ret Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + [[ '' = yes ]] Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + [[ =drivers/md = \-\c ]] Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + [[ =drivers/md = \-\s ]] Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + (( 1 == 0 )) Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.QMUUf0/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + _ret=0 Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + (( 0 != 0 )) Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + [[ -n '' ]] Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + return 0 Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + _ret=0 Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + return 0 Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + modules_loaded+='hperaid ' Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + '[' -n '' ']' Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + _d_mod=90kernel-modules Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + _d_mod=kernel-modules Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + [[ '' = yes ]] Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + dinfo '*** Including module: kernel-modules ***' Nov 4 21:32:43 kjcf05n02 kdumpctl[7836]: + set +x Nov 4 21:32:43 kjcf05n02 dracut[7950]: *** Including module: kernel-modules *** Nov 4 21:32:43 kjcf05n02 dracut[7950]: *** Including module: kernel-modules-extra *** Nov 4 21:32:43 kjcf05n02 dracut[7950]: *** Including module: kernel-network-modules *** Nov 4 21:32:43 kjcf05n02 dracut[7950]: *** Including module: diskless-mod *** Nov 4 21:32:43 kjcf05n02 dracut[7950]: *** Including module: fstab-sys *** Nov 4 21:32:43 kjcf05n02 dracut[7950]: *** Including module: nfs *** Nov 4 21:32:44 kjcf05n02 dracut[7950]: *** Including module: rootfs-block *** Nov 4 21:32:44 kjcf05n02 dracut[7950]: *** Including module: terminfo *** Nov 4 21:32:44 kjcf05n02 dracut[7950]: *** Including module: udev-rules *** Nov 4 21:32:44 kjcf05n00 zabbix_server[15675]: item "kjcf05n02:vfs.fs.size[/mnt/persistent_ha_data,pused]" became supported Nov 4 21:32:44 kjcf05n02 dracut[7950]: Skipping udev rule: 91-permissions.rules Nov 4 21:32:44 kjcf05n02 dracut[7950]: Skipping udev rule: 80-drivers-modprobe.rules Nov 4 21:32:44 kjcf05n02 dracut[7950]: *** Including module: dracut-systemd *** Nov 4 21:32:45 kjcf05n02 dracut[7950]: *** Including module: usrmount *** Nov 4 21:32:45 kjcf05n02 dracut[7950]: *** Including module: base *** Nov 4 21:32:45 kjcf05n02 dracut[7950]: *** Including module: fs-lib *** Nov 4 21:32:45 kjcf05n02 dracut[7950]: *** Including module: kdumpbase *** Nov 4 21:32:45 kjcf05n00 zabbix-server[2467620]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:32:45 kjcf05n00 zabbix-server[2467620]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 232.97\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 170.87\\"}}"' Nov 4 21:32:45 kjcf05n00 log_interesting_event.py[2467620]: Event '46707' acknowledged Nov 4 21:32:46 kjcf05n02 dracut[7950]: *** Including module: memstrack *** Nov 4 21:32:46 kjcf05n02 dracut[7950]: *** Including module: shutdown *** Nov 4 21:32:46 kjcf05n02 dracut[7950]: *** Including module: squash *** Nov 4 21:32:46 kjcf05n02 dracut[7950]: *** Including modules done *** Nov 4 21:32:46 kjcf05n02 dracut[7950]: *** Installing kernel module dependencies *** Nov 4 21:32:46 kjcf05n02 dracut[7950]: *** Installing kernel module dependencies done *** Nov 4 21:32:46 kjcf05n02 dracut[7950]: *** Resolving executable dependencies *** Nov 4 21:32:47 kjcf05n00 mcfcli[3673891]: %3|1730777567.536|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 21:32:48 kjcf05n02 dracut[7950]: *** Resolving executable dependencies done*** Nov 4 21:32:48 kjcf05n02 dracut[7950]: *** Hardlinking files *** Nov 4 21:32:48 kjcf05n02 dracut[7950]: *** Hardlinking files done *** Nov 4 21:32:48 kjcf05n02 dracut[7950]: *** Generating early-microcode cpio image *** Nov 4 21:32:48 kjcf05n02 dracut[7950]: *** Constructing AuthenticAMD.bin **** Nov 4 21:32:48 kjcf05n02 dracut[7950]: *** Store current command line parameters *** Nov 4 21:32:48 kjcf05n02 dracut[7950]: Stored kernel commandline: Nov 4 21:32:48 kjcf05n02 dracut[7950]: rd.driver.pre=sd_mod Nov 4 21:32:48 kjcf05n02 dracut[7950]: rd.driver.pre=nvme Nov 4 21:32:48 kjcf05n02 dracut[7950]: rd.driver.pre=ipmi_si Nov 4 21:32:48 kjcf05n02 dracut[7950]: rd.driver.pre=ipmi_devintf Nov 4 21:32:48 kjcf05n02 dracut[7950]: rd.driver.pre=ipmi_msghandler Nov 4 21:32:48 kjcf05n02 dracut[7950]: nameserver=172.16.2.2 Nov 4 21:32:48 kjcf05n02 dracut[7950]: nameserver=127.0.0.1 Nov 4 21:32:48 kjcf05n02 dracut[7950]: nameserver=172.16.2.2 Nov 4 21:32:48 kjcf05n02 dracut[7950]: nameserver=127.0.0.1 Nov 4 21:32:48 kjcf05n02 dracut[7950]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 4 21:32:48 kjcf05n02 dracut[7950]: rd.neednet Nov 4 21:32:48 kjcf05n02 dracut[7950]: kdumpnic=mgmt0 Nov 4 21:32:48 kjcf05n02 dracut[7950]: bootdev=mgmt0 Nov 4 21:32:48 kjcf05n02 dracut[7950]: *** Install squash loader *** Nov 4 21:32:47 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 4 21:32:47 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[02-03]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 4 21:32:47 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 4 21:32:47 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[02-03]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running Nov 4 21:32:47 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 4 21:32:48 kjcf05n02 dracut[7950]: *** Squashing the files inside the initramfs *** Nov 4 21:32:49 kjcf05n02 dracut[7950]: *** Squashing the files inside the initramfs done *** Nov 4 21:32:49 kjcf05n02 dracut[7950]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 4 21:32:49 kjcf05n02 dracut[7950]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 4 21:32:49 kjcf05n00 zabbix_server[15682]: item "kjcf05n02:vfs.fs.size[/mnt/persistent_ha_data,total]" became supported Nov 4 21:32:49 kjcf05n02 kdumpctl[7836]: kdump: kexec: loaded kdump kernel Nov 4 21:32:49 kjcf05n02 kdumpctl[7836]: kdump: Starting kdump: [OK] Nov 4 21:32:49 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 4 21:32:49 kjcf05n02 systemd[1]: Reloading. Nov 4 21:32:50 kjcf05n02 systemd[3162]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:32:50 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:32:50 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:32:50 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 4 21:32:50 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 4 21:32:50 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 4 21:32:50 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 4 21:32:50 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 4 21:32:50 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 4 21:32:50 kjcf05n02 ifdown[14655]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 21:32:50 kjcf05n02 ifdown[14657]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:32:50 kjcf05n02 ifdown[14659]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:32:50 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 21:32:50 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 21:32:50 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 21:32:50 kjcf05n02 ifup[14719]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 21:32:50 kjcf05n02 ifup[14720]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:32:50 kjcf05n02 ifup[14721]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:32:52 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 4 21:32:54 kjcf05n00 zabbix_server[15704]: item "kjcf05n02:vfs.fs.size[/mnt/persistent_ha_data,used]" became supported Nov 4 21:32:54 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 21:32:55 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 21:32:55 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:32:55 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 21:32:55 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:32:55 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:32:55 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:32:55 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 21:32:55 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 21:32:55 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 21:32:55 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 21:32:55 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:32:55 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:32:55 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:32:55 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:32:55 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 4 21:32:55 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 4 21:32:55 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 4 21:32:55 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 4 21:32:55 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 4 21:32:55 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 4 21:32:55 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 4 21:32:55 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 4 21:32:55 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 4 21:32:55 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 4 21:32:55 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 4 21:32:55 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 4 21:32:55 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 4 21:32:55 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 4 21:32:55 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 4 21:32:55 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 4 21:32:55 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 4 21:32:55 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 4 21:32:55 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 4 21:32:55 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 4 21:32:55 kjcf05n02 ifdown[14885]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 21:32:55 kjcf05n02 ifdown[14886]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:32:55 kjcf05n02 ifdown[14900]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:32:55 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 21:32:55 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 21:32:55 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 21:32:55 kjcf05n02 ifup[14963]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 21:32:55 kjcf05n02 ifup[14964]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:32:55 kjcf05n02 ifup[14965]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 21:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 21:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 21:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 21:32:58 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 4 21:32:58 kjcf05n02 dcs-collectord[5630]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 21:32:58 kjcf05n02 dcs-collectord[5630]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 21:32:59 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 4 21:32:59 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 4 21:32:59 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 4 21:32:59 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running Nov 4 21:32:59 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 4 21:32:59 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 21:32:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 21:32:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 21:33:00 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 21:33:00 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 21:33:00 kjcf05n02 systemd[1]: Reloading. Nov 4 21:33:00 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 4 21:33:00 kjcf05n02 await_ha_peer[15249]: Waiting for HA peer kjcf05n03 Nov 4 21:33:01 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 4 21:33:01 kjcf05n02 await_ha_peer[15249]: Peer kjcf05n03 has started, starting HA Nov 4 21:33:02 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 4 21:33:02 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 4 21:33:02 kjcf05n02 fstonithd.py[15289]: Listening for kdump packets from partner Nov 4 21:33:02 kjcf05n02 systemd[1]: Reloading. Nov 4 21:33:02 kjcf05n02 systemd[3162]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:33:02 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:33:02 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:33:02 kjcf05n02 systemd[1]: Reloading. Nov 4 21:33:02 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 4 21:33:02 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 4 21:33:02 kjcf05n02 systemd[1]: Reloading. Nov 4 21:33:03 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 21:33:03 kjcf05n02 puppet-agent[3586]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 4 21:33:03 kjcf05n02 puppet[3586]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 4 21:33:03 kjcf05n02 puppet-agent[3586]: Applied catalog in 90.75 seconds Nov 4 21:33:03 kjcf05n02 puppet[3586]: Notice: Applied catalog in 90.75 seconds Nov 4 21:33:03 kjcf05n02 systemd[1]: Started Puppet agent. Nov 4 21:33:03 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 4 21:33:03 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 4 21:33:03 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 4 21:33:03 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 4 21:33:03 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 4 21:33:03 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 4 21:33:03 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 4 21:33:03 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 21:33:03 kjcf05n02 systemd[1]: Reached target Timers. Nov 4 21:33:03 kjcf05n02 wce-disable.sh[15448]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 4 21:33:03 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 4 21:33:03 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 4 21:33:03 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 21:33:03 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 21:33:03 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 4 21:33:03 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 4 21:33:03 kjcf05n02 RFSF-API[15443]: INFO[2024-11-04T21:33:03-06:00] Datapath API RESTful Service starting Nov 4 21:33:03 kjcf05n02 dp-api-server-node[15443]: INFO[2024-11-04T21:33:03-06:00] Datapath API RESTful Service starting Nov 4 21:33:03 kjcf05n02 RFSF-API[15443]: INFO[2024-11-04T21:33:03-06:00] Running in production mode, starting dbus event listener Nov 4 21:33:03 kjcf05n02 dp-api-server-node[15443]: INFO[2024-11-04T21:33:03-06:00] Running in production mode, starting dbus event listener Nov 4 21:33:03 kjcf05n02 RFSF-API[15443]: INFO[2024-11-04T21:33:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 21:33:03 kjcf05n02 dp-api-server-node[15443]: INFO[2024-11-04T21:33:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 21:33:03 kjcf05n02 RFSF-API[15443]: INFO[2024-11-04T21:33:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 21:33:03 kjcf05n02 dp-api-server-node[15443]: INFO[2024-11-04T21:33:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 21:33:03 kjcf05n02 RFSF-API[15443]: INFO[2024-11-04T21:33:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 21:33:03 kjcf05n02 dp-api-server-node[15443]: INFO[2024-11-04T21:33:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 21:33:03 kjcf05n02 RFSF-API[15443]: INFO[2024-11-04T21:33:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 21:33:03 kjcf05n02 dp-api-server-node[15443]: INFO[2024-11-04T21:33:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 21:33:03 kjcf05n02 RFSF-API[15443]: INFO[2024-11-04T21:33:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 21:33:03 kjcf05n02 dp-api-server-node[15443]: INFO[2024-11-04T21:33:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 21:33:03 kjcf05n02 RFSF-API[15443]: INFO[2024-11-04T21:33:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 21:33:03 kjcf05n02 dp-api-server-node[15443]: INFO[2024-11-04T21:33:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 21:33:03 kjcf05n02 RFSF-API[15443]: INFO[2024-11-04T21:33:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 21:33:03 kjcf05n02 dp-api-server-node[15443]: INFO[2024-11-04T21:33:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 21:33:03 kjcf05n02 RFSF-API[15443]: INFO[2024-11-04T21:33:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 21:33:03 kjcf05n02 dp-api-server-node[15443]: INFO[2024-11-04T21:33:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 21:33:03 kjcf05n02 RFSF-API[15443]: INFO[2024-11-04T21:33:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 21:33:03 kjcf05n02 dp-api-server-node[15443]: INFO[2024-11-04T21:33:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 21:33:03 kjcf05n02 RFSF-API[15443]: INFO[2024-11-04T21:33:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 21:33:03 kjcf05n02 dp-api-server-node[15443]: INFO[2024-11-04T21:33:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 21:33:03 kjcf05n02 python3.9[15444]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 4 21:33:03 kjcf05n02 python3.9[15444]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 4 21:33:03 kjcf05n02 gateway-ec-node.py[15445]: Starting gateway-ec-node service Nov 4 21:33:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730777585', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 2.81, 2.08, 0.92'}"] Nov 4 21:33:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 2.81, 2.08, 0.92', 'message': 'OK - load average: 2.81, 2.08, 0.92', 'value': 'ok', 'timestamp': '1730777585'} Nov 4 21:33:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:33:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730777589', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 343 processes with STATE = RSZDT '}"] Nov 4 21:33:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 343 processes with STATE = RSZDT ', 'message': 'PROCS OK: 343 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730777589'} Nov 4 21:33:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:33:10 kjcf05n02 systemd[1]: Reloading. Nov 4 21:33:10 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 15899 (bash) Nov 4 21:33:10 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 4 21:33:10 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 4 21:33:10 kjcf05n02 systemd[1]: Reloading. Nov 4 21:33:10 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 4 21:33:10 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 4 21:33:10 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 4 21:33:10 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 4 21:33:10 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 4 21:33:11 kjcf05n02 diskmonitor_pre[15964]: Key management is currently disabled.DEAR disabled Nov 4 21:33:11 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 4 21:33:11 kjcf05n00 mcfcli[3673891]: %3|1730777591.274|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:33:12 kjcf05n02 sh[16046]: LNET configured: New Created Nov 4 21:33:12 kjcf05n02 dcs-collectord[5630]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 21:33:12 kjcf05n02 dcs-collectord[5630]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 21:33:12 kjcf05n02 dcs-collectord[5630]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 21:33:12 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 4 21:33:12 kjcf05n02 LCNmon[18133]: Interface ib0 is up Nov 4 21:33:12 kjcf05n02 LCNmon[18133]: Interface ib1 is up Nov 4 21:33:12 kjcf05n02 LCNmon[18133]: Can ping through interface ib0 Nov 4 21:33:12 kjcf05n02 LCNmon[18133]: Can ping through interface ib1 Nov 4 21:33:12 kjcf05n02 LCNmon[18133]: NIC ib0, initial state UP Nov 4 21:33:12 kjcf05n02 LCNmon[18133]: NIC ib1, initial state UP Nov 4 21:33:12 kjcf05n02 LCNmon[18133]: LCNstat initial state UP Nov 4 21:33:13 kjcf05n02 LCNmon[18133]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 4 21:33:13 kjcf05n00 httpd[1812023]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 4 21:33:14 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 4 21:33:14 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: /var/run/diskmonitor does not exist, creating Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: Creating /var/run/diskmonitor/disk Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: Creating /var/run/diskmonitor/encl Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: Creating /var/run/diskmonitor/cli Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: RAS_Interlocks_enabled: 1 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: Using default ssd ids: HUSSL4010ASS600 , Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: add handler for sig: 14 sa_flags: 10000004 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: add handler for sig: 1 sa_flags: 10000004 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: add handler for sig: 2 sa_flags: 00000004 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: add handler for sig: 15 sa_flags: 00000004 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: add handler for sig: 6 sa_flags: 00000004 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: add handler for sig: 3 sa_flags: 00000004 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: add handler for sig: 30 sa_flags: 00000004 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: add handler for sig: 20 sa_flags: 00000004 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: add handler for sig: 10 sa_flags: 10000004 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: add handler for sig: 11 sa_flags: 00000004 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: add handler for sig: 7 sa_flags: 00000004 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: add handler for sig: 4 sa_flags: 00000004 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: add handler for sig: 8 sa_flags: 00000004 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: init_watch: /var/run/diskmonitor/encl initialized Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: init_watch: /var/run/diskmonitor/disk initialized Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: Using HA Baton locks - key: diskmonitor Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: Baton will be held for at most 570 seconds Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: DMMP Enabled: 0 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: random seed: f96c8c0a Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: NVMe Enclosure: 1 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: ZFS Enclosure: 0 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: Dbus, Initialized Connection Successfully Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: int_catcher_thread: thread start Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: Received dbus message 4 org.freedesktop.DBus -> :1.119 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 4 21:33:15 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 21:33:17 kjcf05n02 openhpid[5536]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 4 21:33:17 kjcf05n02 openhpid[5536]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 4 21:33:17 kjcf05n00 mcfcli[3673891]: %3|1730777597.536|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:33:17 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 4 21:33:17 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 4 21:33:17 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 21:33:17 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18707 which is not our child. We'll most likely not notice when it exits. Nov 4 21:33:17 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 21:33:17 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 4 21:33:17 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 4 21:33:17 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 4 21:33:17 kjcf05n02 dcs-collectord[5630]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 4 21:33:17 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 4 21:33:17 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 4 21:33:17 kjcf05n02 systemd[1]: Startup finished in 50.140s (kernel) + 2min 30.495s (userspace) = 3min 20.635s. Nov 4 21:33:17 kjcf05n02 openhpid[18707]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 21:33:17 kjcf05n02 openhpid[18707]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 21:33:17 kjcf05n02 openhpid[18707]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 21:33:17 kjcf05n02 openhpid[18707]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 21:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730777599', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 4 21:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730777599', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 4 21:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730777599'} Nov 4 21:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730777599'} Nov 4 21:33:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:33:19 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 21:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730777599', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.7% (4389984 kB) used.'}"] Nov 4 21:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.7% (4389984 kB) used.', 'message': 'OK - 1.7% (4389984 kB) used.', 'value': 'ok', 'timestamp': '1730777599'} Nov 4 21:33:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: check_run_sedcmd, No Device name provided Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 4 21:33:19 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 4 21:33:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730777601', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 4 21:33:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730777601'} Nov 4 21:33:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:33:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730777603', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(3976.0B/2680.0B), ib1=(2632.0B/2024.0B), icl0=(8.0kB/9.8kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.1MB), mgmt0=(1478.4MB/8.1MB)'}"] Nov 4 21:33:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730777603', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 4 21:33:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(3976.0B/2680.0B), ib1=(2632.0B/2024.0B), icl0=(8.0kB/9.8kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.1MB), mgmt0=(1478.4MB/8.1MB)', 'message': 'NET OK - (Rx/Tx) ib0=(3976.0B/2680.0B), ib1=(2632.0B/2024.0B), icl0=(8.0kB/9.8kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.1MB), mgmt0=(1478.4MB/8.1MB)', 'value': 'ok', 'timestamp': '1730777603'} Nov 4 21:33:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730777603'} Nov 4 21:33:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:33:27 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 21:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T21:33:27.268125916-06:00 level=info msg="Completed cleanup jobs" duration=41.597049ms Nov 4 21:33:28 kjcf05n02 dcs-collectord[5630]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 21:33:28 kjcf05n02 dcs-collectord[5630]: WARNING No data collected (hpi_parser.py:353) Nov 4 21:33:41 kjcf05n02 ipmievd[3973]: System Event sensor - Timestamp Clock Sync Nov 4 21:33:43 kjcf05n02 ipmievd[3162]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:33:43 kjcf05n02 dcs-collectord[5630]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 21:33:47 kjcf05n00 mcfcli[3673891]: %3|1730777627.536|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 21:33:47 kjcf05n00 mcfcli[3673891]: %3|1730777627.758|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 4 21:33:53 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 4 21:33:58 kjcf05n02 dcs-collectord[5630]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 21:34:02 kjcf05n03 firmware-update-orc-server[5841]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "c617a054-43cc-49a7-92f9-a89a1baf0b49"} (logger.py:65) Nov 4 21:34:02 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 84439 (get_disk_device) Nov 4 21:34:02 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 4 21:34:02 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 4 21:34:02 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db0101200253IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 21:34:02 kjcf05n02 ras-resource-manager-agent[5894]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "ccb84172-9b26-11ef-b1b0-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 4 21:34:02 kjcf05n02 ras-resource-manager-agent[5894]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'ccb84172-9b26-11ef-b1b0-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 4 21:34:02 kjcf05n02 ras-resource-manager-agent[5894]: INFO Submitting new device inserted signal, starting to qualify drive: ccb84172-9b26-11ef-b1b0-00093d0695e3 (admin_action.py:110) Nov 4 21:34:01 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'ccb84172-9b26-11ef-b1b0-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 21:34:01 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'ccb84172-9b26-11ef-b1b0-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 21:34:01 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': 'ccb84172-9b26-11ef-b1b0-00093d0695e3', 'response ID': 'ccc23b50-9b26-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 21:34:01 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: ccc23b50-9b26-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 21:34:02 kjcf05n03 ccp-client[84460]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 21:34:02 kjcf05n03 ccp-client[84460]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 21:34:02 kjcf05n03 ccp-client[84484]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 21:34:02 kjcf05n03 ccp-client[84460]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 21:34:02 kjcf05n03 ccp-client[84460]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 21:34:02 kjcf05n03 ccp-client[84484]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 21:34:02 kjcf05n03 ccp-client[84484]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 21:34:02 kjcf05n02 diskmonitor[17751]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 21:34:02 kjcf05n02 ras-resource-manager-agent[5894]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "cd0b525e-9b26-11ef-b1b0-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 4 21:34:02 kjcf05n02 ras-resource-manager-agent[5894]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'cd0b525e-9b26-11ef-b1b0-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 4 21:34:02 kjcf05n02 ras-resource-manager-agent[5894]: INFO Submitting new device inserted signal, starting to qualify drive: cd0b525e-9b26-11ef-b1b0-00093d0695e3 (admin_action.py:110) Nov 4 21:34:02 kjcf05n02 firmware-update-orc-server[5850]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "8b6fdbf3-0aaf-4aef-a85a-a82a8bb1baa8"} (logger.py:65) Nov 4 21:34:02 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'cd0b525e-9b26-11ef-b1b0-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 21:34:02 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'cd0b525e-9b26-11ef-b1b0-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 21:34:02 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': 'cd0b525e-9b26-11ef-b1b0-00093d0695e3', 'response ID': 'cd1249b0-9b26-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 21:34:02 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: cd1249b0-9b26-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 21:34:05 kjcf05n03 DRVFW[84593]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 21:34:05 kjcf05n03 ccp-client[84594]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 21:34:05 kjcf05n03 ccp-client[84594]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 21:34:05 kjcf05n03 ccp-client[84603]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 21:34:05 kjcf05n03 ccp-client[84594]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 21:34:05 kjcf05n03 ccp-client[84594]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 21:34:05 kjcf05n03 ccp-client[84603]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 21:34:05 kjcf05n03 ccp-client[84603]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 21:34:05 kjcf05n03 firmware-update-orc-server[5841]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 4 21:34:07 kjcf05n02 ras-resource-manager-agent[5894]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'ccb84172-9b26-11ef-b1b0-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 4 21:34:07 kjcf05n02 ras-resource-manager-agent[5894]: INFO Drive qualification complete responding: ccb84172-9b26-11ef-b1b0-00093d0695e3 (admin_action.py:205) Nov 4 21:34:07 kjcf05n02 ras-resource-manager-agent[5894]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "ccb84172-9b26-11ef-b1b0-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (interesting_event.py:59) Nov 4 21:34:06 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: ccc23b50-9b26-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 21:34:06 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': 'ccb84172-9b26-11ef-b1b0-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': 'ccb84172-9b26-11ef-b1b0-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}}} (logger.py:65) Nov 4 21:34:10 kjcf05n02 diskmonitor[17751]: 84500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 4 21:34:10 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 4 21:34:10 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 4 21:34:10 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 4 21:34:10 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 4 21:34:10 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 4 21:34:10 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 4 21:34:10 kjcf05n02 diskmonitor[17751]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 4 21:34:10 kjcf05n02 diskmonitor[17751]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 4 21:34:10 kjcf05n02 diskmonitor[17751]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 4 21:34:10 kjcf05n02 diskmonitor[17751]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 21:34:10 kjcf05n02 diskmonitor[17751]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 4 21:34:10 kjcf05n02 diskmonitor[17751]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "ccb84172-9b26-11ef-b1b0-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 4 21:34:10 kjcf05n02 diskmonitor[17751]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 21:34:10 kjcf05n02 diskmonitor[17751]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 4 21:34:10 kjcf05n02 diskmonitor[17751]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "cd0b525e-9b26-11ef-b1b0-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 4 21:34:10 kjcf05n02 diskmonitor[17751]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 21:34:10 kjcf05n02 diskmonitor[17751]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 21:34:11 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31462 deleted. Nov 4 21:34:11 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 4 21:34:11 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 4 21:34:11 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 4 21:34:12 kjcf05n03 nslcd[6913]: [e8944a] ldap_result() failed: Can't contact LDAP server Nov 4 21:34:12 kjcf05n03 nslcd[6913]: [5558ec] ldap_result() failed: Can't contact LDAP server Nov 4 21:34:14 kjcf05n02 chronyd[5138]: Selected source 172.16.2.1 Nov 4 21:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730777657}"] Nov 4 21:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730777657, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:34:17 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22702 (get_disk_device) Nov 4 21:34:17 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 4 21:34:17 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 4 21:34:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:34:17 kjcf05n00 mcfcli[3673891]: %3|1730777657.536|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 21:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730777657}"] Nov 4 21:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730777657, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:34:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730777657}"] Nov 4 21:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730777657, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:34:17 kjcf05n02 ccp-client[22764]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 21:34:17 kjcf05n02 ccp-client[22764]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 21:34:17 kjcf05n02 ccp-client[22799]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 21:34:17 kjcf05n02 ccp-client[22764]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 21:34:17 kjcf05n02 ccp-client[22764]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 21:34:17 kjcf05n02 ccp-client[22799]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 21:34:17 kjcf05n02 ccp-client[22799]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 21:34:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730777657}"] Nov 4 21:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730777657, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:34:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730777657}"] Nov 4 21:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730777657, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:34:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:34:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730777657}"] Nov 4 21:34:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730777657, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:34:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:34:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730777657}"] Nov 4 21:34:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730777657, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:34:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:34:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730777657}"] Nov 4 21:34:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730777657, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:34:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:34:21 kjcf05n02 DRVFW[23009]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 21:34:21 kjcf05n02 ccp-client[23010]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 21:34:21 kjcf05n02 ccp-client[23010]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 21:34:21 kjcf05n02 ccp-client[23019]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 21:34:21 kjcf05n02 ccp-client[23010]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 21:34:21 kjcf05n02 ccp-client[23010]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 21:34:21 kjcf05n02 ccp-client[23019]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 21:34:21 kjcf05n02 ccp-client[23019]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 21:34:21 kjcf05n02 firmware-update-orc-server[5850]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 4 21:34:21 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31454 deleted. Nov 4 21:34:21 kjcf05n02 python3.9[5200]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 4 21:34:22 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: cd1249b0-9b26-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 21:34:22 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': 'cd0b525e-9b26-11ef-b1b0-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': 'cd0b525e-9b26-11ef-b1b0-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 18}}}} (logger.py:65) Nov 4 21:34:22 kjcf05n02 python3.9[3162]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:34:22 kjcf05n02 ras-resource-manager-agent[5894]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'cd0b525e-9b26-11ef-b1b0-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 18}}} (resource_admin.py:98) Nov 4 21:34:22 kjcf05n02 ras-resource-manager-agent[5894]: INFO Drive qualification complete responding: cd0b525e-9b26-11ef-b1b0-00093d0695e3 (admin_action.py:205) Nov 4 21:34:22 kjcf05n02 ras-resource-manager-agent[5894]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "cd0b525e-9b26-11ef-b1b0-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} (interesting_event.py:59) Nov 4 21:34:23 kjcf05n02 ras-resource-manager-agent[5894]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "ccb84172-9b26-11ef-b1b0-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (service_main_handler.py:66) Nov 4 21:34:23 kjcf05n02 ras-resource-manager-agent[5894]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'ccb84172-9b26-11ef-b1b0-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 4 21:34:23 kjcf05n02 ras-resource-manager-agent[5894]: INFO Device qualification response has been acknowledged: ccb84172-9b26-11ef-b1b0-00093d0695e3 (admin_action.py:151) Nov 4 21:34:23 kjcf05n02 ras-resource-manager-agent[5894]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "cd0b525e-9b26-11ef-b1b0-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} (service_main_handler.py:66) Nov 4 21:34:23 kjcf05n02 ras-resource-manager-agent[5894]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'cd0b525e-9b26-11ef-b1b0-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 18}}} (resource_admin.py:98) Nov 4 21:34:23 kjcf05n02 ras-resource-manager-agent[5894]: INFO Device qualification response has been acknowledged: cd0b525e-9b26-11ef-b1b0-00093d0695e3 (admin_action.py:151) Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "ccb84172-9b26-11ef-b1b0-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: Dbus, handle_ingress_ras_signals, uuid: ccb84172-9b26-11ef-b1b0-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "ccb84172-9b26-11ef-b1b0-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "cd0b525e-9b26-11ef-b1b0-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: Dbus, handle_ingress_ras_signals, uuid: cd0b525e-9b26-11ef-b1b0-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "cd0b525e-9b26-11ef-b1b0-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 21:34:25 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 21:34:25 kjcf05n00 mcfcli[3673891]: %3|1730777665.555|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:34:27 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 21:34:28 kjcf05n02 diskmonitor[17751]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 21:34:33 kjcf05n02 diskmonitor[17751]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 21:34:33 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 21:34:33 kjcf05n02 diskmonitor[17751]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 21:34:33 kjcf05n02 diskmonitor[17751]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 21:34:33 kjcf05n02 diskmonitor[17751]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 21:34:33 kjcf05n02 diskmonitor[17751]: leaving test state: 1 next state: 2 Nov 4 21:34:33 kjcf05n02 diskmonitor[17751]: lock req: no timeout Nov 4 21:34:33 kjcf05n02 diskmonitor[17751]: leaving test state: 2 next state: 4 Nov 4 21:34:33 kjcf05n02 diskmonitor[17751]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 21:34:47 kjcf05n00 mcfcli[3673891]: %3|1730777687.536|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 21:35:01 kjcf05n00 mcfcli[3673891]: %3|1730777701.423|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:35:17 kjcf05n00 mcfcli[3673891]: %3|1730777717.536|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 21:35:23 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 4 21:35:23 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 21:35:23 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 4 21:35:38 kjcf05n00 python3.9[2469536]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 21:35:38 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 4 21:35:38 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 21:35:38 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 4 21:35:38 kjcf05n02 dcs-collectord[5630]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 4 21:35:40 kjcf05n00 mcfcli[3673891]: %3|1730777740.523|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:35:41 kjcf05n02 diskmonitor[17751]: lock acquired Nov 4 21:35:41 kjcf05n02 diskmonitor[17751]: leaving test state: 4 next state: 8 Nov 4 21:35:47 kjcf05n00 mcfcli[3673891]: %3|1730777747.537|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:35:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730777748}"] Nov 4 21:35:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730777748, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:35:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:35:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:35:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:35:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:35:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:35:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:35:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:35:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:35:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:35:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:35:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:35:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:35:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:35:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.366182ms Nov 4 21:35:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:35:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.366182ms Nov 4 21:35:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:35:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:35:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:35:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730777452', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 21:35:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730777452'} Nov 4 21:35:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:35:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730777452', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 21:35:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730777452'} Nov 4 21:35:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:35:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730777753}"] Nov 4 21:35:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730777753, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:35:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:35:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:35:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:35:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:35:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:35:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:35:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:35:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:35:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:35:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:35:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:35:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:35:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:35:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.31147ms Nov 4 21:35:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:35:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.31147ms Nov 4 21:35:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:35:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:35:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:35:58 kjcf05n02 diskmonitor[17751]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 4 21:35:58 kjcf05n02 diskmonitor[17751]: leaving test state: 8 next state: 20 Nov 4 21:35:58 kjcf05n02 diskmonitor[17751]: leaving test state: 20 next state: 40 Nov 4 21:35:58 kjcf05n02 diskmonitor[17751]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 2cd503a0000 Nov 4 21:35:58 kjcf05n02 diskmonitor[17751]: leaving test state: 40 next state: 80 Nov 4 21:36:17 kjcf05n00 mcfcli[3673891]: %3|1730777777.537|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 21:36:18 kjcf05n00 mcfcli[3673891]: %3|1730777778.093|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:36:48 kjcf05n00 mcfcli[3673891]: %3|1730777808.036|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 21:36:48 kjcf05n00 ipmievd[5530]: Memory sensor - Correctable ECC Nov 4 21:36:58 kjcf05n00 mcfcli[3673891]: %3|1730777818.090|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:37:05 kjcf05n02 diskmonitor[17751]: leaving test state: 80 next state: 100 Nov 4 21:37:05 kjcf05n02 diskmonitor[17751]: lock release: time: Mon Nov 4 21:36:57 2024 Nov 4 21:37:05 kjcf05n02 diskmonitor[17751]: leaving test state: 100 next state: 1 Nov 4 21:37:06 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 4 21:37:18 kjcf05n00 mcfcli[3673891]: %3|1730777838.037|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 21:37:36 kjcf05n00 mcfcli[3673891]: %3|1730777856.592|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:37:48 kjcf05n00 mcfcli[3673891]: %3|1730777868.037|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:38:15 kjcf05n00 mcfcli[3673891]: %3|1730777895.616|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:38:18 kjcf05n00 mcfcli[3673891]: %3|1730777898.037|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:38:48 kjcf05n00 mcfcli[3673891]: %3|1730777928.038|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:38:55 kjcf05n00 mcfcli[3673891]: %3|1730777935.613|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:39:18 kjcf05n00 mcfcli[3673891]: %3|1730777958.038|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:39:24 kjcf05n00 zabbix-server[2471784]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:39:24 kjcf05n00 zabbix-server[2471784]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n02' from event '46722' Nov 4 21:39:24 kjcf05n00 zabbix-server[2471784]: Host created 'enclosure_USE26000024VS001' Nov 4 21:39:24 kjcf05n00 zabbix-server[2471784]: Running puppet on 'kjcf05n02' Nov 4 21:39:26 kjcf05n02 puppet-agent[35122]: Using configured environment 'production' Nov 4 21:39:26 kjcf05n02 puppet-agent[35122]: Retrieving pluginfacts Nov 4 21:39:26 kjcf05n02 puppet-agent[35122]: Retrieving plugin Nov 4 21:39:27 kjcf05n02 puppet-agent[35122]: Loading facts Nov 4 21:39:30 kjcf05n02 puppet-agent[35122]: Caching catalog for kjcf05n02 Nov 4 21:39:30 kjcf05n02 puppet-agent[35122]: Applying configuration version '1730777968' Nov 4 21:39:32 kjcf05n02 puppet-agent[35122]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 21:39:32 kjcf05n02 puppet-agent[35122]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 21:39:32 kjcf05n02 puppet-agent[35122]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 21:39:32 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 4 21:39:32 kjcf05n02 zabbix_agent2[5978]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 21:39:32 kjcf05n02 zabbix_agent2[3162]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:39:32 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 21:39:32 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 4 21:39:32 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 21:39:32 kjcf05n02 puppet-agent[35122]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: Press Ctrl+C to exit. Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: Plugin support version 1.0 Nov 4 21:39:32 kjcf05n02 zabbix_agent2[35481]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 21:39:33 kjcf05n00 mcfcli[3673891]: %3|1730777973.443|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:39:34 kjcf05n02 puppet-agent[35122]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 21:39:34 kjcf05n02 puppet-agent[35122]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 21:39:34 kjcf05n02 puppet-agent[35122]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 21:39:34 kjcf05n00 zabbix-server[2471784]: puppet completed status:(0): '' Nov 4 21:39:35 kjcf05n00 zabbix-server[2471784]: Event '46722' acknowledged Nov 4 21:39:35 kjcf05n00 zabbix-server[2471784]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n02"}' Nov 4 21:39:35 kjcf05n02 puppet-agent[35122]: Applied catalog in 5.00 seconds Nov 4 21:39:48 kjcf05n00 mcfcli[3673891]: %3|1730777988.038|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 21:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 21:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 21:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 21:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 21:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 21:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 21:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 21:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 21:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 21:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 21:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 21:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 21:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 21:40:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 21:40:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:40:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 21:40:10 kjcf05n00 mcfcli[3673891]: %3|1730778010.289|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:40:18 kjcf05n00 mcfcli[3673891]: %3|1730778018.039|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 21:40:38 kjcf05n00 python3.9[2472470]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 21:40:45 kjcf05n00 mcfcli[3673891]: %3|1730778045.175|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:40:48 kjcf05n00 mcfcli[3673891]: %3|1730778048.138|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 21:40:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730777452', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 21:40:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730777452'} Nov 4 21:40:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:40:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730777452', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 21:40:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730777452'} Nov 4 21:40:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:41:18 kjcf05n00 mcfcli[3673891]: %3|1730778078.138|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 21:41:24 kjcf05n00 mcfcli[3673891]: %3|1730778084.607|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:41:40 kjcf05n00 diskmonitor[2758297]: leaving test state: 1 next state: 2 Nov 4 21:41:40 kjcf05n00 diskmonitor[2758297]: lock req: no timeout Nov 4 21:41:40 kjcf05n00 diskmonitor[2758297]: leaving test state: 2 next state: 4 Nov 4 21:41:48 kjcf05n00 mcfcli[3673891]: %3|1730778108.138|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:42:01 kjcf05n00 syslog-ng[15617]: Opening tty device failed, disabling usertty() for 10 minutes; user='admin', line='/dev/pts/21', errno='Permission denied (13)' Nov 4 21:42:02 kjcf05n00 mcfcli[3673891]: %3|1730778122.607|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:42:18 kjcf05n00 mcfcli[3673891]: %3|1730778138.138|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:42:42 kjcf05n00 mcfcli[3673891]: %3|1730778162.604|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:42:45 kjcf05n00 diskmonitor[2758297]: lock acquired Nov 4 21:42:45 kjcf05n00 diskmonitor[2758297]: leaving test state: 4 next state: 8 Nov 4 21:42:48 kjcf05n00 mcfcli[3673891]: %3|1730778168.139|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:42:59 kjcf05n00 diskmonitor[2758297]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 4 21:42:59 kjcf05n00 diskmonitor[2758297]: leaving test state: 8 next state: 20 Nov 4 21:42:59 kjcf05n00 diskmonitor[2758297]: leaving test state: 20 next state: 40 Nov 4 21:42:59 kjcf05n00 diskmonitor[2758297]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset 642fa08000 Nov 4 21:42:59 kjcf05n00 diskmonitor[2758297]: leaving test state: 40 next state: 80 Nov 4 21:43:18 kjcf05n00 mcfcli[3673891]: %3|1730778198.139|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:43:20 kjcf05n00 mcfcli[3673891]: %3|1730778200.131|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T21:43:27.254168949-06:00 level=info msg="Completed cleanup jobs" duration=27.250379ms Nov 4 21:43:45 kjcf05n02 root[42436]: failback_xyraid Nov 4 21:43:46 kjcf05n02 root[42602]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 4 21:43:47 kjcf05n02 root[42745]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 4 21:43:48 kjcf05n00 mcfcli[3673891]: %3|1730778228.139|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 21:43:50 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 4 21:43:53 kjcf05n00 diskmonitor[2758297]: leaving test state: 80 next state: 100 Nov 4 21:43:53 kjcf05n00 diskmonitor[2758297]: lock release: time: Mon Nov 4 21:43:52 2024 Nov 4 21:43:53 kjcf05n00 diskmonitor[2758297]: leaving test state: 100 next state: 1 Nov 4 21:43:54 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme24n1 Nov 4 21:43:54 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme23n1 Nov 4 21:43:54 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme4n1 Nov 4 21:43:54 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme3n1 Nov 4 21:43:54 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme19n1 Nov 4 21:43:54 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme18n1 Nov 4 21:43:54 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme17n1 Nov 4 21:43:54 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme8n1 Nov 4 21:43:54 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme9n1 Nov 4 21:43:54 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme25n1 Nov 4 21:43:54 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme2n1 Nov 4 21:43:56 kjcf05n02 dwd[5170]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 4 21:43:56 kjcf05n02 dwd[5170]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 4 21:43:56 kjcf05n02 dwd[5170]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 4 21:43:56 kjcf05n02 dwd[5170]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 4 21:43:56 kjcf05n02 dwd[5170]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 4 21:43:56 kjcf05n02 dwd[5170]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 4 21:43:56 kjcf05n02 dwd[5170]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 4 21:43:56 kjcf05n02 dwd[5170]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 4 21:43:56 kjcf05n02 dwd[5170]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 4 21:43:56 kjcf05n02 dwd[5170]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 4 21:43:56 kjcf05n02 dwd[5170]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 4 21:43:56 kjcf05n02 dwd[5170]: Starting NVME thread for nvme2n1 Nov 4 21:43:56 kjcf05n02 dwd[5170]: Starting NVME thread for nvme18n1 Nov 4 21:43:56 kjcf05n02 dwd[5170]: Starting NVME thread for nvme19n1 Nov 4 21:43:56 kjcf05n02 dwd[5170]: Starting NVME thread for nvme9n1 Nov 4 21:43:57 kjcf05n02 systemd-udevd[45450]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45452]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45454]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45450]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45452]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45454]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45450]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45452]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45454]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45450]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45452]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45454]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45450]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45452]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45454]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45450]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45452]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45454]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45450]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45478]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45452]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45479]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45483]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45454]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45450]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45484]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45478]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45452]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45483]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45479]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45484]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45478]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45479]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45484]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45484]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45452]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45483]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45479]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45452]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45484]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45484]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45484]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45484]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45484]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 dwd[5170]: Starting NVME thread for nvme3n1 Nov 4 21:43:57 kjcf05n02 systemd-udevd[45451]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:43:57 kjcf05n02 nslcd[6931]: [8b4567] (re)loading /etc/nsswitch.conf Nov 4 21:43:57 kjcf05n02 dwd[5170]: Starting NVME thread for nvme24n1 Nov 4 21:43:57 kjcf05n00 mcfcli[3673891]: %3|1730778237.549|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:43:58 kjcf05n02 dwd[5170]: Starting NVME thread for nvme4n1 Nov 4 21:43:58 kjcf05n02 dwd[5170]: Starting NVME thread for nvme23n1 Nov 4 21:43:58 kjcf05n02 dwd[5170]: Starting NVME thread for nvme17n1 Nov 4 21:43:58 kjcf05n02 dwd[5170]: Starting NVME thread for nvme25n1 Nov 4 21:43:58 kjcf05n02 dwd[5170]: Starting NVME thread for nvme8n1 Nov 4 21:44:00 kjcf05n02 dcs-bulk-data-sender[6180]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 139}' Nov 4 21:44:02 kjcf05n02 diskmonitor[17751]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 4 21:44:09 kjcf05n02 diskmonitor[17751]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 4 21:44:09 kjcf05n02 diskmonitor[17751]: Scan for ReadErrorMax change for md65 Nov 4 21:44:09 kjcf05n02 diskmonitor[17751]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 4 21:44:09 kjcf05n02 diskmonitor[17751]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 4 21:44:09 kjcf05n02 diskmonitor[17751]: read_saved_file: md65 no saved speed Nov 4 21:44:09 kjcf05n02 diskmonitor[17751]: reconstruction_policy: sync_action prev = current = idle - md65 Nov 4 21:44:09 kjcf05n02 diskmonitor[17751]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 21:44:18 kjcf05n00 mcfcli[3673891]: %3|1730778258.140|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 21:44:35 kjcf05n00 mcfcli[3673891]: %3|1730778275.410|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:44:48 kjcf05n00 mcfcli[3673891]: %3|1730778288.542|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 21:44:49 kjcf05n03 diskmonitor[17340]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 4 21:44:49 kjcf05n03 diskmonitor[17340]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 21:44:54 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 48516 (bash) Nov 4 21:44:54 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 4 21:44:54 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 4 21:44:58 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 4 21:44:58 kjcf05n02 systemd-tmpfiles[48761]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 21:44:58 kjcf05n02 systemd-tmpfiles[48761]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 21:44:58 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 4 21:44:58 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 4 21:45:12 kjcf05n00 mcfcli[3673891]: %3|1730778312.979|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:45:18 kjcf05n00 mcfcli[3673891]: %3|1730778318.542|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:45:41 kjcf05n00 python3.9[2476273]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 21:45:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730778347}"] Nov 4 21:45:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730778347, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:45:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.025183ms Nov 4 21:45:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.025183ms Nov 4 21:45:47 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:45:47 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:45:47 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730778347}"] Nov 4 21:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730778347, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.323843ms Nov 4 21:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.323843ms Nov 4 21:45:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:45:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:45:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730778347}"] Nov 4 21:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730778347, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.288617ms Nov 4 21:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.288617ms Nov 4 21:45:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:45:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:45:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730778347}"] Nov 4 21:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730778347, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.109912ms Nov 4 21:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.109912ms Nov 4 21:45:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:45:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:45:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730778347}"] Nov 4 21:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730778347, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:45:48 kjcf05n00 mcfcli[3673891]: %3|1730778348.542|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 21:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.011979ms Nov 4 21:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.011979ms Nov 4 21:45:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:45:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:45:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730778347}"] Nov 4 21:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730778347, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.663486ms Nov 4 21:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.663486ms Nov 4 21:45:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:45:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:45:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730778347}"] Nov 4 21:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730778347, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.326798ms Nov 4 21:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.326798ms Nov 4 21:45:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:45:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:45:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730778347}"] Nov 4 21:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730778347, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.714772ms Nov 4 21:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.714772ms Nov 4 21:45:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:45:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:45:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:45:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730778347}"] Nov 4 21:45:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730778347, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:45:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.743296ms Nov 4 21:45:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.743296ms Nov 4 21:45:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:45:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:45:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:45:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730778347}"] Nov 4 21:45:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730778347, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:45:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.620365ms Nov 4 21:45:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.620365ms Nov 4 21:45:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:45:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:45:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:45:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730778347}"] Nov 4 21:45:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730778347, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 21:45:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 21:45:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T21:45:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 21:45:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T21:45:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 21:45:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T21:45:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.858491ms Nov 4 21:45:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T21:45:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.858491ms Nov 4 21:45:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:21:45:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 21:45:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:45:52 kjcf05n00 mcfcli[3673891]: %3|1730778352.976|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:45:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730778355', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 4 21:45:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730778355'} Nov 4 21:45:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:45:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730778355', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 4 21:45:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730778355'} Nov 4 21:45:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 21:46:18 kjcf05n00 mcfcli[3673891]: %3|1730778378.543|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:46:31 kjcf05n00 mcfcli[3673891]: %3|1730778391.702|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:46:44 kjcf05n00 zabbix-server[2477206]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:46:44 kjcf05n00 zabbix-server[2477206]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 199.67\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 138.03\\"}}"' Nov 4 21:46:44 kjcf05n00 log_interesting_event.py[2477206]: Event '46726' acknowledged Nov 4 21:46:48 kjcf05n00 mcfcli[3673891]: %3|1730778408.543|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:47:11 kjcf05n00 mcfcli[3673891]: %3|1730778431.621|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:47:18 kjcf05n00 mcfcli[3673891]: %3|1730778438.543|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:47:47 kjcf05n00 mcfcli[3673891]: %3|1730778467.145|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:47:48 kjcf05n00 mcfcli[3673891]: %3|1730778468.543|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 21:48:07 kjcf05n04 diskmonitor[39342]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 21:48:18 kjcf05n00 mcfcli[3673891]: %3|1730778498.543|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:48:24 kjcf05n00 mcfcli[3673891]: %3|1730778504.979|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:48:48 kjcf05n00 mcfcli[3673891]: %3|1730778528.543|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 21:49:03 kjcf05n00 mcfcli[3673891]: %3|1730778543.098|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:49:18 kjcf05n00 mcfcli[3673891]: %3|1730778558.543|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 21:49:22 kjcf05n02 dwd[5170]: nvme2n1 passed periodic SMART status check Nov 4 21:49:22 kjcf05n02 dwd[5170]: nvme19n1 passed periodic SMART status check Nov 4 21:49:22 kjcf05n02 dwd[5170]: nvme18n1 passed periodic SMART status check Nov 4 21:49:22 kjcf05n02 dwd[5170]: nvme9n1 passed periodic SMART status check Nov 4 21:49:23 kjcf05n02 dwd[5170]: nvme3n1 passed periodic SMART status check Nov 4 21:49:23 kjcf05n02 dwd[5170]: nvme4n1 passed periodic SMART status check Nov 4 21:49:23 kjcf05n02 dwd[5170]: nvme17n1 passed periodic SMART status check Nov 4 21:49:23 kjcf05n02 dwd[5170]: nvme25n1 passed periodic SMART status check Nov 4 21:49:23 kjcf05n02 dwd[5170]: nvme24n1 passed periodic SMART status check Nov 4 21:49:23 kjcf05n02 dwd[5170]: nvme23n1 passed periodic SMART status check Nov 4 21:49:24 kjcf05n02 dwd[5170]: nvme8n1 passed periodic SMART status check Nov 4 21:49:24 kjcf05n00 zabbix-server[2478641]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:49:24 kjcf05n00 zabbix-server[2478641]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46727' Nov 4 21:49:24 kjcf05n00 zabbix-server[2478641]: Filesystem 'kjcf05' has been mounted Nov 4 21:49:25 kjcf05n00 zabbix-server[2478641]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 4 21:49:25 kjcf05n00 zabbix-server[2478641]: Running puppet on 'None' Nov 4 21:49:27 kjcf05n04 puppet-agent[2396276]: Using configured environment 'production' Nov 4 21:49:27 kjcf05n04 puppet-agent[2396276]: Retrieving pluginfacts Nov 4 21:49:27 kjcf05n04 puppet-agent[2396276]: Retrieving plugin Nov 4 21:49:27 kjcf05n07 puppet-agent[2416629]: Using configured environment 'production' Nov 4 21:49:27 kjcf05n07 puppet-agent[2416629]: Retrieving pluginfacts Nov 4 21:49:27 kjcf05n07 puppet-agent[2416629]: Retrieving plugin Nov 4 21:49:27 kjcf05n03 puppet-agent[111427]: Using configured environment 'production' Nov 4 21:49:27 kjcf05n03 puppet-agent[111427]: Retrieving pluginfacts Nov 4 21:49:27 kjcf05n03 puppet-agent[111427]: Retrieving plugin Nov 4 21:49:27 kjcf05n05 puppet-agent[2603709]: Using configured environment 'production' Nov 4 21:49:27 kjcf05n05 puppet-agent[2603709]: Retrieving pluginfacts Nov 4 21:49:27 kjcf05n05 puppet-agent[2603709]: Retrieving plugin Nov 4 21:49:27 kjcf05n02 puppet-agent[56659]: Using configured environment 'production' Nov 4 21:49:27 kjcf05n02 puppet-agent[56659]: Retrieving pluginfacts Nov 4 21:49:27 kjcf05n02 puppet-agent[56659]: Retrieving plugin Nov 4 21:49:27 kjcf05n06 puppet-agent[2414041]: Using configured environment 'production' Nov 4 21:49:27 kjcf05n06 puppet-agent[2414041]: Retrieving pluginfacts Nov 4 21:49:27 kjcf05n06 puppet-agent[2414041]: Retrieving plugin Nov 4 21:49:27 kjcf05n03 puppet-agent[111427]: Loading facts Nov 4 21:49:27 kjcf05n02 puppet-agent[56659]: Loading facts Nov 4 21:49:27 kjcf05n05 puppet-agent[2603709]: Loading facts Nov 4 21:49:27 kjcf05n06 puppet-agent[2414041]: Loading facts Nov 4 21:49:28 kjcf05n04 puppet-agent[2396276]: Loading facts Nov 4 21:49:28 kjcf05n07 puppet-agent[2416629]: Loading facts Nov 4 21:49:28 kjcf05n01 puppet-agent[3915969]: Using configured environment 'production' Nov 4 21:49:28 kjcf05n01 puppet-agent[3915969]: Retrieving pluginfacts Nov 4 21:49:28 kjcf05n01 puppet-agent[3915969]: Retrieving plugin Nov 4 21:49:28 kjcf05n01 puppet-agent[3915969]: Loading facts Nov 4 21:49:27 kjcf05n00 puppet-agent[2478706]: Using configured environment 'production' Nov 4 21:49:27 kjcf05n00 puppet-agent[2478706]: Retrieving pluginfacts Nov 4 21:49:28 kjcf05n00 puppet-agent[2478706]: Retrieving plugin Nov 4 21:49:28 kjcf05n00 puppet-agent[2478706]: Loading facts Nov 4 21:49:31 kjcf05n07 puppet-agent[2416629]: Caching catalog for kjcf05n07 Nov 4 21:49:31 kjcf05n07 puppet-agent[2416629]: Applying configuration version '1730778569' Nov 4 21:49:31 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 4 21:49:31 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 4 21:49:33 kjcf05n01 puppet-agent[3915969]: Caching catalog for kjcf05n01 Nov 4 21:49:33 kjcf05n03 puppet-agent[111427]: Caching catalog for kjcf05n03 Nov 4 21:49:33 kjcf05n03 puppet-agent[111427]: Applying configuration version '1730778569' Nov 4 21:49:33 kjcf05n06 puppet-agent[2414041]: Caching catalog for kjcf05n06 Nov 4 21:49:33 kjcf05n06 puppet-agent[2414041]: Applying configuration version '1730778569' Nov 4 21:49:33 kjcf05n01 puppet-agent[3915969]: Applying configuration version '1730778570' Nov 4 21:49:33 kjcf05n02 puppet-agent[56659]: Caching catalog for kjcf05n02 Nov 4 21:49:33 kjcf05n02 puppet-agent[56659]: Applying configuration version '1730778569' Nov 4 21:49:33 kjcf05n06 diskmonitor[19372]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 21:49:34 kjcf05n07 puppet-agent[2416629]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 21:49:34 kjcf05n07 puppet-agent[2416629]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 21:49:34 kjcf05n07 puppet-agent[2416629]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 21:49:34 kjcf05n00 puppet-agent[2478706]: Caching catalog for kjcf05n00 Nov 4 21:49:34 kjcf05n00 puppet-agent[2478706]: Applying configuration version '1730778572' Nov 4 21:49:35 kjcf05n05 puppet-agent[2603709]: Caching catalog for kjcf05n05 Nov 4 21:49:35 kjcf05n05 puppet-agent[2603709]: Applying configuration version '1730778572' Nov 4 21:49:35 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2364462]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 21:49:35 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 4 21:49:35 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 21:49:35 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 4 21:49:35 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 4 21:49:35 kjcf05n07 puppet-agent[2416629]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: Press Ctrl+C to exit. Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: Plugin support version 1.0 Nov 4 21:49:35 kjcf05n07 zabbix_agent2[2417837]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 21:49:35 kjcf05n03 puppet-agent[111427]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 21:49:35 kjcf05n03 puppet-agent[111427]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 21:49:35 kjcf05n03 puppet-agent[111427]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 21:49:35 kjcf05n02 puppet-agent[56659]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 21:49:35 kjcf05n02 puppet-agent[56659]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 21:49:35 kjcf05n02 puppet-agent[56659]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 21:49:35 kjcf05n06 puppet-agent[2414041]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 21:49:35 kjcf05n06 puppet-agent[2414041]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 21:49:35 kjcf05n06 puppet-agent[2414041]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 21:49:36 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 4 21:49:36 kjcf05n03 zabbix_agent2[55245]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 21:49:36 kjcf05n03 zabbix_agent2[3163]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 21:49:36 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 21:49:36 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 4 21:49:36 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 4 21:49:36 kjcf05n03 puppet-agent[111427]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: Press Ctrl+C to exit. Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: Plugin support version 1.0 Nov 4 21:49:36 kjcf05n03 zabbix_agent2[111918]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 21:49:36 kjcf05n04 puppet-agent[2396276]: Caching catalog for kjcf05n04 Nov 4 21:49:36 kjcf05n04 puppet-agent[2396276]: Applying configuration version '1730778573' Nov 4 21:49:36 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 4 21:49:36 kjcf05n02 zabbix_agent2[35481]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 21:49:36 kjcf05n02 zabbix_agent2[3162]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 21:49:36 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 21:49:36 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 4 21:49:36 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 21:49:36 kjcf05n02 puppet-agent[56659]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: Press Ctrl+C to exit. Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: Plugin support version 1.0 Nov 4 21:49:36 kjcf05n02 zabbix_agent2[57152]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 21:49:36 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2361236]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 21:49:36 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 4 21:49:36 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 21:49:36 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 4 21:49:36 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 4 21:49:36 kjcf05n06 puppet-agent[2414041]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: Press Ctrl+C to exit. Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: Plugin support version 1.0 Nov 4 21:49:36 kjcf05n06 zabbix_agent2[2415216]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 21:49:36 kjcf05n01 puppet-agent[3915969]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 21:49:36 kjcf05n01 puppet-agent[3915969]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-21:26:01]/mode) mode changed '0755' to '0750' Nov 4 21:49:36 kjcf05n01 puppet-agent[3915969]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-21:26:01/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 4 21:49:36 kjcf05n01 puppet-agent[3915969]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-21:26:01/vmcore]/mode) mode changed '0600' to '0640' Nov 4 21:49:36 kjcf05n01 puppet-agent[3915969]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-21:26:01/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 4 21:49:36 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 21:49:36 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 21:49:36 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 21:49:37 kjcf05n01 puppet-agent[3915969]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 21:49:37 kjcf05n01 puppet-agent[3915969]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 21:49:37 kjcf05n01 puppet-agent[3915969]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 21:49:37 kjcf05n07 puppet-agent[2416629]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 21:49:37 kjcf05n07 puppet-agent[2416629]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 21:49:37 kjcf05n07 puppet-agent[2416629]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 21:49:37 kjcf05n05 puppet-agent[2603709]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 21:49:37 kjcf05n05 puppet-agent[2603709]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 21:49:37 kjcf05n05 puppet-agent[2603709]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 21:49:37 kjcf05n00 puppet-agent[2478706]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 21:49:37 kjcf05n07 puppet-agent[2416629]: Applied catalog in 6.12 seconds Nov 4 21:49:38 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3903566]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 21:49:38 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 4 21:49:38 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 21:49:38 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 4 21:49:38 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 4 21:49:38 kjcf05n01 puppet-agent[3915969]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: Press Ctrl+C to exit. Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: Plugin support version 1.0 Nov 4 21:49:38 kjcf05n01 zabbix_agent2[3916413]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 21:49:38 kjcf05n03 puppet-agent[111427]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 21:49:38 kjcf05n03 puppet-agent[111427]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 21:49:38 kjcf05n03 puppet-agent[111427]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 21:49:38 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2556340]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 21:49:38 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 4 21:49:38 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 21:49:38 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 4 21:49:38 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 4 21:49:38 kjcf05n05 puppet-agent[2603709]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: Press Ctrl+C to exit. Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: Plugin support version 1.0 Nov 4 21:49:38 kjcf05n05 zabbix_agent2[2604481]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 21:49:38 kjcf05n06 puppet-agent[2414041]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 21:49:38 kjcf05n06 puppet-agent[2414041]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 21:49:38 kjcf05n06 puppet-agent[2414041]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 21:49:38 kjcf05n07 diskmonitor[19063]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 21:49:38 kjcf05n04 puppet-agent[2396276]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 21:49:38 kjcf05n04 puppet-agent[2396276]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 21:49:38 kjcf05n04 puppet-agent[2396276]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 21:49:38 kjcf05n02 puppet-agent[56659]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 21:49:38 kjcf05n02 puppet-agent[56659]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 21:49:38 kjcf05n02 puppet-agent[56659]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 21:49:38 kjcf05n02 puppet-agent[56659]: Applied catalog in 5.16 seconds Nov 4 21:49:38 kjcf05n03 puppet-agent[111427]: Applied catalog in 5.25 seconds Nov 4 21:49:38 kjcf05n06 puppet-agent[2414041]: Applied catalog in 4.88 seconds Nov 4 21:49:39 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2349907]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 21:49:39 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 4 21:49:39 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 21:49:39 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 4 21:49:39 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 4 21:49:39 kjcf05n04 puppet-agent[2396276]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: Press Ctrl+C to exit. Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: Plugin support version 1.0 Nov 4 21:49:39 kjcf05n04 zabbix_agent2[2397182]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 21:49:38 kjcf05n00 puppet-agent[2478706]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 21:49:38 kjcf05n00 puppet-agent[2478706]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 21:49:38 kjcf05n00 puppet-agent[2478706]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 21:49:39 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2459530]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 21:49:39 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 21:49:39 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 21:49:39 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 4 21:49:39 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 4 21:49:39 kjcf05n00 puppet-agent[2478706]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: Starting Zabbix Agent 2 (6.2.1) Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: Press Ctrl+C to exit. Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: Plugin support version 1.0 Nov 4 21:49:39 kjcf05n00 zabbix_agent2[2479346]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 21:49:39 kjcf05n00 mcfcli[3673891]: %3|1730778579.503|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:49:39 kjcf05n00 zabbix-server[2479370]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:49:40 kjcf05n05 puppet-agent[2603709]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 21:49:40 kjcf05n05 puppet-agent[2603709]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 21:49:40 kjcf05n05 puppet-agent[2603709]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 21:49:40 kjcf05n05 puppet-agent[2603709]: Applied catalog in 4.92 seconds Nov 4 21:49:40 kjcf05n01 puppet-agent[3915969]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_213310.log]/mode) mode changed '0644' to '0640' Nov 4 21:49:40 kjcf05n01 puppet-agent[3915969]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_214453.log]/mode) mode changed '0644' to '0640' Nov 4 21:49:40 kjcf05n01 puppet-agent[3915969]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241104_214454]/mode) mode changed '0755' to '0750' Nov 4 21:49:40 kjcf05n01 puppet-agent[3915969]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241104_214454/screenlog.0]/mode) mode changed '0644' to '0640' Nov 4 21:49:40 kjcf05n00 zabbix-server[2479371]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:49:40 kjcf05n00 zabbix-server[2479401]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:49:40 kjcf05n04 puppet-agent[2396276]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 21:49:40 kjcf05n04 puppet-agent[2396276]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 21:49:40 kjcf05n04 puppet-agent[2396276]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 21:49:40 kjcf05n04 puppet-agent[2396276]: Applied catalog in 5.02 seconds Nov 4 21:49:41 kjcf05n01 puppet-agent[3915969]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_213310.log]/mode) mode changed '0644' to '0640' Nov 4 21:49:41 kjcf05n01 puppet-agent[3915969]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_214453.log]/mode) mode changed '0644' to '0640' Nov 4 21:49:41 kjcf05n01 puppet-agent[3915969]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 21:49:41 kjcf05n01 puppet-agent[3915969]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 21:49:41 kjcf05n01 puppet-agent[3915969]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 21:49:40 kjcf05n00 zabbix-server[2479403]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:49:41 kjcf05n00 puppet-agent[2478706]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 4 21:49:42 kjcf05n01 puppet-agent[3915969]: Applied catalog in 8.95 seconds Nov 4 21:49:42 kjcf05n00 puppet-agent[2478706]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 21:49:42 kjcf05n00 puppet-agent[2478706]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 21:49:42 kjcf05n00 puppet-agent[2478706]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 21:49:42 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 4 21:49:43 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 4 21:49:43 kjcf05n00 puppet-agent[2478706]: Applied catalog in 8.57 seconds Nov 4 21:49:43 kjcf05n00 zabbix-server[2478641]: puppet completed status:(0): '' Nov 4 21:49:43 kjcf05n00 zabbix-server[2478641]: Event '46727' acknowledged Nov 4 21:49:43 kjcf05n00 zabbix-server[2478641]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 4 21:49:48 kjcf05n00 mcfcli[3673891]: %3|1730778588.543|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 21:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 21:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 21:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 21:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 21:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 21:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 21:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 21:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 21:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 21:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 21:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 21:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 21:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 21:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 21:50:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 21:50:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 21:50:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 21:50:11 kjcf05n05 diskmonitor[40540]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 21:50:17 kjcf05n00 mcfcli[3673891]: %3|1730778617.106|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:50:18 kjcf05n00 mcfcli[3673891]: %3|1730778618.544|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 21:50:38 kjcf05n00 python3.9[2479744]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 21:50:48 kjcf05n00 mcfcli[3673891]: %3|1730778648.544|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:50:54 kjcf05n00 mcfcli[3673891]: %3|1730778654.942|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:51:18 kjcf05n00 mcfcli[3673891]: %3|1730778678.544|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 21:51:24 kjcf05n00 zabbix-server[2480454]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:51:24 kjcf05n00 zabbix-server[2480454]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 102.47\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 107.74\\"}}"' Nov 4 21:51:24 kjcf05n00 log_interesting_event.py[2480454]: Event '46728' acknowledged Nov 4 21:51:34 kjcf05n00 mcfcli[3673891]: %3|1730778694.131|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:51:48 kjcf05n00 mcfcli[3673891]: %3|1730778708.544|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 21:52:09 kjcf05n00 mcfcli[3673891]: %3|1730778729.088|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:52:18 kjcf05n00 mcfcli[3673891]: %3|1730778738.544|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 21:52:48 kjcf05n00 mcfcli[3673891]: %3|1730778768.545|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 21:52:49 kjcf05n00 mcfcli[3673891]: %3|1730778769.085|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T03:53:15.868398Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 21:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T03:53:15.868462Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.087ms Nov 4 21:53:18 kjcf05n00 mcfcli[3673891]: %3|1730778798.546|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 21:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T21:53:27.287112077-06:00 level=info msg="Completed cleanup jobs" duration=60.490705ms Nov 4 21:53:27 kjcf05n00 mcfcli[3673891]: %3|1730778807.980|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:53:48 kjcf05n00 mcfcli[3673891]: %3|1730778828.546|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:54:07 kjcf05n00 mcfcli[3673891]: %3|1730778847.395|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:54:13 kjcf05n03 nslcd[6913]: [e87ccd] ldap_result() failed: Can't contact LDAP server Nov 4 21:54:13 kjcf05n03 nslcd[6913]: [1b58ba] ldap_result() failed: Can't contact LDAP server Nov 4 21:54:18 kjcf05n00 mcfcli[3673891]: %3|1730778858.546|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:54:47 kjcf05n00 mcfcli[3673891]: %3|1730778887.392|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:54:48 kjcf05n00 mcfcli[3673891]: %3|1730778888.546|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:55:18 kjcf05n00 mcfcli[3673891]: %3|1730778918.546|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:55:26 kjcf05n00 mcfcli[3673891]: %3|1730778926.877|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:55:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 21:55:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 21:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 21:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 21:55:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 21:55:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 21:55:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 21:55:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 21:55:48 kjcf05n00 mcfcli[3673891]: %3|1730778948.546|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 21:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 21:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 21:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 21:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 21:55:56 kjcf05n00 python3.9[2482954]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 21:55:59 kjcf05n00 zabbix_server[15733]: Zabbix agent item "dcs.lustre.device.discovery[{$LUSTRE_FS_NAME},ost]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 4 21:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 21:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 21:55:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 21:55:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 21:56:00 kjcf05n00 zabbix_server[15736]: Zabbix agent item "system.uptime" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 4 21:56:04 kjcf05n03 fstonithd.py[15114]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 4 21:56:05 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 21:56:05 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 21:56:05 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 21:56:05 kjcf05n03 root[123143]: is_enc_ipmi_off starts Nov 4 21:56:05 kjcf05n03 root[123142]: is_viking_off starts Nov 4 21:56:05 kjcf05n03 root[123159]: is_lan_ipmi_off leaves Nov 4 21:56:05 kjcf05n03 root[123161]: is_lan_ipmi_sec_off leaves Nov 4 21:56:06 kjcf05n03 root[123166]: I am master Nov 4 21:56:06 kjcf05n03 root[123167]: I am in slot 1; partner is in slot 0 Nov 4 21:56:06 kjcf05n00 mcfcli[3673891]: %3|1730778966.874|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:56:09 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='70', error='Connection reset by peer (104)' Nov 4 21:56:09 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='70', client='AF_INET(172.16.2.5:36189)', local='AF_INET(0.0.0.0:601)' Nov 4 21:56:12 kjcf05n03 root[123272]: is_viking_off leaves Nov 4 21:56:12 kjcf05n03 root[123275]: kjcf05n02 not already off look at kdump Nov 4 21:56:12 kjcf05n03 root[123276]: is_kdump_off starts Nov 4 21:56:12 kjcf05n03 fence_kdump[123277]: waiting for message from '172.16.2.5' Nov 4 21:56:12 kjcf05n03 fence_kdump[123277]: received valid message from '172.16.2.5' Nov 4 21:56:12 kjcf05n03 root[123292]: is_kdump_off detected kdump on kjcf05n02 Nov 4 21:56:12 kjcf05n03 root[123293]: kjcf05n02 is kdumping Nov 4 21:56:12 kjcf05n03 root[123410]: is_viking_off starts Nov 4 21:56:12 kjcf05n03 root[123409]: is_enc_ipmi_off starts Nov 4 21:56:13 kjcf05n03 root[123426]: is_lan_ipmi_off leaves Nov 4 21:56:13 kjcf05n03 root[123428]: is_lan_ipmi_sec_off leaves Nov 4 21:56:13 kjcf05n03 root[123447]: I am in slot 1; partner is in slot 0 Nov 4 21:56:13 kjcf05n03 root[123448]: I am master Nov 4 21:56:14 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.discovery[{$LUSTRE_FS_NAME},ost]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 4 21:56:15 kjcf05n00 zabbix_server[15731]: Zabbix agent item "system.cpu.util[,iowait]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 4 21:56:16 kjcf05n00 zabbix_server[15763]: Zabbix agent item "vfs.file.contents["/sys/class/net/ib0/operstate"]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 4 21:56:17 kjcf05n00 zabbix_server[15768]: Zabbix agent item "vfs.file.contents["/sys/class/net/meth0/operstate"]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 4 21:56:17 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 4 21:56:17 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 4 21:56:18 kjcf05n00 zabbix_server[15721]: Zabbix agent item "vfs.fs.size[/etc/ganesha,pused]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 4 21:56:18 kjcf05n00 mcfcli[3673891]: %3|1730778978.547|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:56:21 kjcf05n03 root[123663]: is_viking_off leaves Nov 4 21:56:21 kjcf05n03 root[123667]: kjcf05n02 not already off look at kdump Nov 4 21:56:21 kjcf05n03 root[123669]: is_kdump_off starts Nov 4 21:56:21 kjcf05n03 fence_kdump[123670]: waiting for message from '172.16.2.5' Nov 4 21:56:21 kjcf05n03 fence_kdump[123670]: received valid message from '172.16.2.5' Nov 4 21:56:21 kjcf05n03 root[123673]: is_kdump_off detected kdump on kjcf05n02 Nov 4 21:56:21 kjcf05n03 root[123674]: kjcf05n02 is kdumping Nov 4 21:56:26 kjcf05n03 systemd-udevd[125931]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125929]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125928]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125933]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125931]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125929]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125928]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125933]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125931]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125929]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125928]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125933]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125931]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125929]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125928]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125933]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125931]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125929]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125928]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125933]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125951]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125954]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125929]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125931]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125928]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125957]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125951]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125956]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125933]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125929]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125954]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125951]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125957]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125928]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125933]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125956]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125954]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125929]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125951]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125928]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125957]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125956]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125928]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125951]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125928]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125951]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125956]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125928]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125929]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125951]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125928]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125957]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125951]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125928]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125951]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125951]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125928]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125951]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125951]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125928]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125951]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125928]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125951]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 systemd-udevd[125951]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 21:56:26 kjcf05n03 dwd[5162]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 4 21:56:26 kjcf05n03 dwd[5162]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 4 21:56:26 kjcf05n03 dwd[5162]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 4 21:56:26 kjcf05n03 dwd[5162]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 4 21:56:26 kjcf05n03 dwd[5162]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 4 21:56:26 kjcf05n03 dwd[5162]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 4 21:56:26 kjcf05n03 dwd[5162]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 4 21:56:26 kjcf05n03 dwd[5162]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 4 21:56:26 kjcf05n03 dwd[5162]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 4 21:56:26 kjcf05n03 dwd[5162]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 4 21:56:26 kjcf05n03 dwd[5162]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 4 21:56:26 kjcf05n03 dwd[5162]: Starting NVME thread for nvme23n1 Nov 4 21:56:26 kjcf05n03 dwd[5162]: Starting NVME thread for nvme18n1 Nov 4 21:56:26 kjcf05n03 dwd[5162]: Starting NVME thread for nvme25n1 Nov 4 21:56:26 kjcf05n03 dwd[5162]: Starting NVME thread for nvme17n1 Nov 4 21:56:27 kjcf05n03 dwd[5162]: Starting NVME thread for nvme3n1 Nov 4 21:56:27 kjcf05n03 dwd[5162]: Starting NVME thread for nvme9n1 Nov 4 21:56:27 kjcf05n03 dwd[5162]: Starting NVME thread for nvme8n1 Nov 4 21:56:27 kjcf05n03 dwd[5162]: Starting NVME thread for nvme19n1 Nov 4 21:56:27 kjcf05n03 dwd[5162]: Starting NVME thread for nvme24n1 Nov 4 21:56:27 kjcf05n03 dwd[5162]: Starting NVME thread for nvme2n1 Nov 4 21:56:28 kjcf05n03 dwd[5162]: Starting NVME thread for nvme4n1 Nov 4 21:56:29 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.mdt.name[MDT0000,mdt_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 4 21:56:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 21:56:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 21:56:33 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vm.memory.size[pavailable]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 4 21:56:34 kjcf05n03 diskmonitor[17340]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 4 21:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 21:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 21:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 21:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 21:56:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 21:56:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 21:56:39 kjcf05n03 diskmonitor[17340]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 4 21:56:39 kjcf05n03 diskmonitor[17340]: Scan for ReadErrorMax change for md65 Nov 4 21:56:39 kjcf05n03 diskmonitor[17340]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 4 21:56:39 kjcf05n03 diskmonitor[17340]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 4 21:56:39 kjcf05n03 diskmonitor[17340]: read_saved_file: md65 no saved speed Nov 4 21:56:39 kjcf05n03 diskmonitor[17340]: reconstruction_policy: sync_action prev = current = idle - md65 Nov 4 21:56:39 kjcf05n03 diskmonitor[17340]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 21:56:44 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 4 21:56:46 kjcf05n00 mcfcli[3673891]: %3|1730779006.846|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:56:48 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 4 21:56:48 kjcf05n00 mcfcli[3673891]: %3|1730779008.547|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 21:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 21:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 21:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 21:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 21:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 21:56:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 21:56:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 21:57:18 kjcf05n00 mcfcli[3673891]: %3|1730779038.547|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:57:24 kjcf05n00 mcfcli[3673891]: %3|1730779044.311|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:57:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 21:57:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 21:57:36 kjcf05n03 nslcd[6913]: [b141f2] ldap_result() failed: Can't contact LDAP server Nov 4 21:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 21:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 21:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 21:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 21:57:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 21:57:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 21:57:48 kjcf05n00 mcfcli[3673891]: %3|1730779068.547|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 21:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 21:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 21:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 21:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 21:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 21:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 21:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 21:58:00 kjcf05n00 mcfcli[3673891]: %3|1730779080.313|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:58:19 kjcf05n00 mcfcli[3673891]: %3|1730779099.047|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:58:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 21:58:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 21:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 21:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 21:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 21:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 21:58:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 21:58:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 21:58:38 kjcf05n00 mcfcli[3673891]: %3|1730779118.510|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:58:49 kjcf05n00 mcfcli[3673891]: %3|1730779129.048|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 21:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 21:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 21:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 21:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 21:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 21:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 21:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 21:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 21:59:11 kjcf05n00 zabbix-server[2484935]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 21:59:11 kjcf05n00 zabbix-server[2484935]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 4 21:59:11 kjcf05n00 log_interesting_event.py[2484935]: Event '46730' acknowledged Nov 4 21:59:17 kjcf05n00 mcfcli[3673891]: %3|1730779157.804|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:59:19 kjcf05n00 mcfcli[3673891]: %3|1730779159.048|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 21:59:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 21:59:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 21:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 21:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 21:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 21:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 21:59:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 21:59:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 21:59:49 kjcf05n00 mcfcli[3673891]: %3|1730779189.048|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 21:59:52 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 4 21:59:52 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 4 21:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 21:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 21:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 21:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 21:59:56 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 4 21:59:56 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 4 21:59:56 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 4 21:59:56 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 4 21:59:56 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 4 21:59:56 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 4 21:59:56 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 4 21:59:57 kjcf05n00 mcfcli[3673891]: %3|1730779197.802|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 21:59:59 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 4 21:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 21:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 21:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 21:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 22:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 22:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 22:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 22:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 22:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 22:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 22:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 22:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 22:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 22:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 22:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 22:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 22:00:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 22:00:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:00:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 22:00:07 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.410669Z lvl=info msg="TSI log compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=8 op_name=tsi1_compact_log_file tsi1_log_file_id=2 op_event=start Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.410683Z lvl=info msg="TSI log compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=2 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=start Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.410669Z lvl=info msg="TSI log compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=4 op_name=tsi1_compact_log_file tsi1_log_file_id=2 op_event=start Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.410669Z lvl=info msg="TSI log compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=6 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=start Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.411719Z lvl=info msg="Log file compacted" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=8 op_name=tsi1_compact_log_file tsi1_log_file_id=2 elapsed=1ms bytes=1332 kb_per_sec=1215 Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.411720Z lvl=info msg="Log file compacted" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=4 op_name=tsi1_compact_log_file tsi1_log_file_id=2 elapsed=1ms bytes=3611 kb_per_sec=3308 Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.411765Z lvl=info msg="TSI log compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=8 op_name=tsi1_compact_log_file tsi1_log_file_id=2 op_event=end op_elapsed=1.116ms Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.411771Z lvl=info msg="TSI log compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=4 op_name=tsi1_compact_log_file tsi1_log_file_id=2 op_event=end op_elapsed=1.122ms Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.411800Z lvl=info msg="TSI level compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=8 op_name=tsi1_compact_to_level tsi1_level=2 op_event=start Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.411800Z lvl=info msg="TSI level compaction (start)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=4 op_name=tsi1_compact_to_level tsi1_level=2 op_event=start Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.411822Z lvl=info msg="Performing full compaction" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=4 op_name=tsi1_compact_to_level tsi1_level=2 src=2,1 dst=/mnt/mgmt/var/lib/influxdb/engine/data/f75a8c5868320c8d/autogen/675/index/3/L2-00000004.tsi Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.411824Z lvl=info msg="Performing full compaction" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=8 op_name=tsi1_compact_to_level tsi1_level=2 src=2,1 dst=/mnt/mgmt/var/lib/influxdb/engine/data/f75a8c5868320c8d/autogen/675/index/7/L2-00000004.tsi Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.412484Z lvl=info msg="Log file compacted" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=2 op_name=tsi1_compact_log_file tsi1_log_file_id=1 elapsed=1ms bytes=19023 kb_per_sec=10110 Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.412522Z lvl=info msg="TSI log compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=2 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=end op_elapsed=1.874ms Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.412523Z lvl=info msg="Log file compacted" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=6 op_name=tsi1_compact_log_file tsi1_log_file_id=1 elapsed=1ms bytes=19448 kb_per_sec=10126 Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.412556Z lvl=info msg="TSI log compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=6 op_name=tsi1_compact_log_file tsi1_log_file_id=1 op_event=end op_elapsed=1.908ms Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.413085Z lvl=info msg="Full compaction complete" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=4 op_name=tsi1_compact_to_level tsi1_level=2 path=/mnt/mgmt/var/lib/influxdb/engine/data/f75a8c5868320c8d/autogen/675/index/3/L2-00000004.tsi elapsed=1ms bytes=15162 kb_per_sec=11610 Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.413095Z lvl=info msg="Removing index file" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=4 op_name=tsi1_compact_to_level tsi1_level=2 path=/mnt/mgmt/var/lib/influxdb/engine/data/f75a8c5868320c8d/autogen/675/index/3/L1-00000002.tsi Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.413122Z lvl=info msg="Removing index file" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=4 op_name=tsi1_compact_to_level tsi1_level=2 path=/mnt/mgmt/var/lib/influxdb/engine/data/f75a8c5868320c8d/autogen/675/index/3/L1-00000001.tsi Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.413150Z lvl=info msg="TSI level compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=4 op_name=tsi1_compact_to_level tsi1_level=2 op_event=end op_elapsed=1.354ms Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.413375Z lvl=info msg="Full compaction complete" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=8 op_name=tsi1_compact_to_level tsi1_level=2 path=/mnt/mgmt/var/lib/influxdb/engine/data/f75a8c5868320c8d/autogen/675/index/7/L2-00000004.tsi elapsed=1ms bytes=15381 kb_per_sec=9608 Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.413394Z lvl=info msg="Removing index file" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=8 op_name=tsi1_compact_to_level tsi1_level=2 path=/mnt/mgmt/var/lib/influxdb/engine/data/f75a8c5868320c8d/autogen/675/index/7/L1-00000002.tsi Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.413434Z lvl=info msg="Removing index file" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=8 op_name=tsi1_compact_to_level tsi1_level=2 path=/mnt/mgmt/var/lib/influxdb/engine/data/f75a8c5868320c8d/autogen/675/index/7/L1-00000001.tsi Nov 4 22:00:10 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:00:10.413464Z lvl=info msg="TSI level compaction (end)" log_id=0s8llxRG000 service=storage-engine index=tsi tsi1_partition=8 op_name=tsi1_compact_to_level tsi1_level=2 op_event=end op_elapsed=1.665ms Nov 4 22:00:19 kjcf05n00 mcfcli[3673891]: %3|1730779219.048|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:00:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 22:00:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 22:00:35 kjcf05n00 mcfcli[3673891]: %3|1730779235.629|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 22:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 22:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 22:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 22:00:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 22:00:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 22:00:49 kjcf05n00 mcfcli[3673891]: %3|1730779249.049|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 22:00:49 kjcf05n00 python3.9[2485705]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 22:00:55 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:56632). Nov 4 22:00:55 kjcf05n01 rsyncd[3920745]: connect from kjcf05n02 (172.16.2.5) Nov 4 22:00:55 kjcf05n01 rsyncd[3920745]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 4 22:00:55 kjcf05n01 rsyncd[3920745]: building file list Nov 4 22:00:55 kjcf05n01 rsyncd[3920745]: sent 11450 bytes received 136 bytes total size 10905 Nov 4 22:00:55 kjcf05n01 systemd[1]: rsyncd@667-172.16.2.2:873-172.16.2.5:56632.service: Succeeded. Nov 4 22:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 22:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 22:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 22:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 22:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 22:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 22:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 22:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 22:01:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730779263', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 22:01:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730779263'} Nov 4 22:01:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:01:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730779263', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 22:01:03 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730779263'} Nov 4 22:01:03 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:01:05 kjcf05n03 fstonithd.py[15114]: Listening for kdump packets from partner Nov 4 22:01:15 kjcf05n00 mcfcli[3673891]: %3|1730779275.626|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:01:19 kjcf05n00 mcfcli[3673891]: %3|1730779279.145|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 22:01:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 22:01:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 22:01:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 22:01:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 22:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 22:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 22:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 22:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 22:01:49 kjcf05n00 mcfcli[3673891]: %3|1730779309.145|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 22:01:52 kjcf05n03 dwd[5162]: nvme25n1 passed periodic SMART status check Nov 4 22:01:52 kjcf05n03 dwd[5162]: nvme17n1 passed periodic SMART status check Nov 4 22:01:52 kjcf05n03 dwd[5162]: nvme23n1 passed periodic SMART status check Nov 4 22:01:52 kjcf05n03 dwd[5162]: nvme18n1 passed periodic SMART status check Nov 4 22:01:52 kjcf05n00 mcfcli[3673891]: %3|1730779312.292|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:01:53 kjcf05n03 dwd[5162]: nvme19n1 passed periodic SMART status check Nov 4 22:01:53 kjcf05n03 dwd[5162]: nvme8n1 passed periodic SMART status check Nov 4 22:01:53 kjcf05n03 dwd[5162]: nvme3n1 passed periodic SMART status check Nov 4 22:01:53 kjcf05n03 dwd[5162]: nvme2n1 passed periodic SMART status check Nov 4 22:01:53 kjcf05n03 dwd[5162]: nvme9n1 passed periodic SMART status check Nov 4 22:01:53 kjcf05n03 dwd[5162]: nvme24n1 passed periodic SMART status check Nov 4 22:01:54 kjcf05n03 dwd[5162]: nvme4n1 passed periodic SMART status check Nov 4 22:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 22:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 22:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 22:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 22:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 22:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 22:01:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 22:01:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 22:02:10 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 4 22:02:19 kjcf05n00 mcfcli[3673891]: %3|1730779339.145|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 22:02:21 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='70', client='AF_INET(172.16.2.5:43015)', local='AF_INET(0.0.0.0:601)' Nov 4 22:02:21 kjcf05n02 syslog-ng[3142]: Configuration reload request received, reloading configuration; Nov 4 22:02:21 kjcf05n02 syslog-ng[3142]: Configuration reload finished; Nov 4 22:02:21 kjcf05n02 syslog-ng[3142]: Syslog connection established; fd='18', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 4 22:02:21 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 4 22:02:21 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 22:02:21 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 4 22:02:21 kjcf05n02 dracut: Self testing crypto algorithms Nov 4 22:02:21 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 4 22:02:21 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 22:02:21 kjcf05n02 Copying live image to RAM... Nov 4 22:02:21 kjcf05n02 (this may take a minute) Nov 4 22:02:21 kjcf05n02 Done copying live image to RAM. Nov 4 22:02:21 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 4 22:02:21 kjcf05n02 dracut: Checking integrity of kernel Nov 4 22:02:21 kjcf05n02 dracut: All initrd crypto checks done Nov 4 22:02:21 kjcf05n02 dracut: Switching root Nov 4 22:02:21 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 4 22:02:21 kjcf05n02 systemd: Detected architecture x86-64. Nov 4 22:02:21 kjcf05n02 systemd: Set hostname to . Nov 4 22:02:21 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 4 22:02:21 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 4 22:02:21 kjcf05n02 systemd: Created slice system-serial\x2dgetty.slice. Nov 4 22:02:21 kjcf05n02 systemd: Created slice User and Session Slice. Nov 4 22:02:21 kjcf05n02 systemd: Listening on udev Kernel Socket. Nov 4 22:02:21 kjcf05n02 systemd: Reached target Swap. Nov 4 22:02:21 kjcf05n02 systemd: Listening on Device-mapper event daemon FIFOs. Nov 4 22:02:21 kjcf05n02 systemd-journald[1547]: Journal started Nov 4 22:02:21 kjcf05n02 systemd-journald[1547]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 22:02:21 kjcf05n02 systemd-modules-load[1533]: Inserted module 'fuse' Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Create list of required static device nodes for the current kernel. Nov 4 22:02:21 kjcf05n02 systemd[1]: Mounted Kernel Debug File System. Nov 4 22:02:21 kjcf05n02 systemd[1]: Mounted Huge Pages File System. Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Create System Users... Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Rebuild Hardware Database... Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Load/Save Random Seed... Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Apply Kernel Variables... Nov 4 22:02:21 kjcf05n02 systemd[1]: Mounting Kernel Configuration File System... Nov 4 22:02:21 kjcf05n02 systemd[1]: Mounting FUSE Control File System... Nov 4 22:02:21 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Create System Users. Nov 4 22:02:21 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 4 22:02:21 kjcf05n02 systemd-sysctl[1563]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 22:02:21 kjcf05n02 systemd-sysctl[1563]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 4 22:02:21 kjcf05n02 systemd-journald[1547]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 4 22:02:21 kjcf05n02 systemd-tmpfiles[1570]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 22:02:21 kjcf05n02 systemd-tmpfiles[1570]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 4 22:02:21 kjcf05n02 systemd-udevd[1581]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 4 22:02:21 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 4 22:02:21 kjcf05n02 systemd-udevd[1615]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:02:21 kjcf05n02 systemd-udevd[1643]: Using default interface naming scheme 'rhel-8.0'. Nov 4 22:02:21 kjcf05n02 systemd-udevd[1643]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:02:21 kjcf05n02 systemd-udevd[1597]: Using default interface naming scheme 'rhel-8.0'. Nov 4 22:02:21 kjcf05n02 systemd-udevd[1597]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:02:21 kjcf05n02 systemd-udevd[1642]: Using default interface naming scheme 'rhel-8.0'. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 4 22:02:21 kjcf05n02 systemd-udevd[1642]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:02:21 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 4 22:02:21 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 4 22:02:21 kjcf05n02 systemd-tmpfiles[1789]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 22:02:21 kjcf05n02 systemd-tmpfiles[1789]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 4 22:02:21 kjcf05n02 systemd-tmpfiles[1789]: "/var/tmp" already exists and is not a directory. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 4 22:02:21 kjcf05n02 root[1806]: openibd: running in auto mode Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started RPC Bind. Nov 4 22:02:21 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 4 22:02:21 kjcf05n02 systemd-modules-load[1908]: Inserted module 'ib_iser' Nov 4 22:02:21 kjcf05n02 systemd-modules-load[1908]: Inserted module 'ib_isert' Nov 4 22:02:21 kjcf05n02 systemd-modules-load[1908]: Inserted module 'ib_srpt' Nov 4 22:02:21 kjcf05n02 systemd-udevd[1584]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:02:21 kjcf05n02 systemd-udevd[1627]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:02:21 kjcf05n02 systemd-modules-load[1915]: Inserted module 'ib_ipoib' Nov 4 22:02:21 kjcf05n02 systemd-modules-load[1908]: Inserted module 'rdma_ucm' Nov 4 22:02:21 kjcf05n02 systemd-modules-load[1908]: Module 'svcrdma' is blacklisted Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 4 22:02:21 kjcf05n02 systemd-udevd[1584]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 22:02:21 kjcf05n02 systemd-udevd[1627]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 22:02:21 kjcf05n02 systemd-modules-load[1915]: Inserted module 'ib_umad' Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 4 22:02:21 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 4 22:02:21 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 4 22:02:21 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 22:02:21 kjcf05n02 systemd[3142]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:21 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 4 22:02:21 kjcf05n02 openibd[1793]: Loading HCA driver and Access Layer:[ OK ] Nov 4 22:02:21 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Update is Completed. Nov 4 22:02:21 kjcf05n02 setup-icl[1779]: Setting LAN IP Address to 203.0.113.3 Nov 4 22:02:21 kjcf05n02 setup-icl[1779]: Setting LAN Subnet Mask to 255.255.255.0 Nov 4 22:02:21 kjcf05n02 setup-icl[1779]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 4 22:02:21 kjcf05n02 setup-icl[1779]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 4 22:02:21 kjcf05n02 systemd-udevd[1584]: Using default interface naming scheme 'rhel-8.0'. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 4 22:02:21 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 4 22:02:21 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 4 22:02:21 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 4 22:02:21 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 4 22:02:21 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 4 22:02:21 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 4 22:02:21 kjcf05n02 systemd[1]: Reached target Sockets. Nov 4 22:02:21 kjcf05n02 systemd[1]: Reached target Basic System. Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 22:02:21 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 0 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 1 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 2 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 3 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 4 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 5 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 6 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 7 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 8 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 9 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 10 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 11 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 12 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 13 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 14 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 15 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 16 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 17 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 18 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 19 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 20 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 21 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 22 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 23 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 24 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 25 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 26 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 27 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 28 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 29 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 30 Nov 4 22:02:21 kjcf05n02 cpupower[2093]: Setting cpu: 31 Nov 4 22:02:21 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 4 22:02:21 kjcf05n02 dwd[2094]: dwd: vMay 29 2024 : 15:38:26 Nov 4 22:02:21 kjcf05n02 dwd[2094]: /usr/sbin/dwd -d --standalone=0 Nov 4 22:02:21 kjcf05n02 dwd[2094]: dwd: option Lethal: 0 Nov 4 22:02:21 kjcf05n02 dwd[2094]: dwd: option Interval: 60 Nov 4 22:02:21 kjcf05n02 dwd[2094]: dwd: option abrtlimit: 10 Nov 4 22:02:21 kjcf05n02 dwd[2094]: dwd: option DZPeriod: 604800 Nov 4 22:02:21 kjcf05n02 dwd[2094]: dwd: option SmartPeriod: 43200 Nov 4 22:02:21 kjcf05n02 dwd[2094]: dwd: option SDDEnabled: 1 Nov 4 22:02:21 kjcf05n02 dwd[2094]: dwd: option SDDAwaitScale: 3 Nov 4 22:02:21 kjcf05n02 dwd[2094]: dwd: option SDDAwaitMin: 100 Nov 4 22:02:21 kjcf05n02 dwd[2094]: dwd: option Verbosity: 1 Nov 4 22:02:21 kjcf05n02 dwd[2094]: dwd: option StandAlone: 0 Nov 4 22:02:21 kjcf05n02 dwd[2094]: option Lethal: 0 Nov 4 22:02:21 kjcf05n02 dwd[2094]: option Interval: 60 Nov 4 22:02:21 kjcf05n02 dwd[2094]: option abrtlimit: 10 Nov 4 22:02:21 kjcf05n02 dwd[2094]: option DZPeriod: 604800 Nov 4 22:02:21 kjcf05n02 dwd[2094]: option SmartPeriod: 43200 Nov 4 22:02:21 kjcf05n02 dwd[2094]: option SDDEnabled: 1 Nov 4 22:02:21 kjcf05n02 dwd[2094]: option SDDAwaitScale: 3 Nov 4 22:02:21 kjcf05n02 dwd[2094]: option SDDAwaitMin: 100 Nov 4 22:02:21 kjcf05n02 dwd[2094]: option Verbosity: 1 Nov 4 22:02:21 kjcf05n02 dwd[2094]: option StandAlone: 0 Nov 4 22:02:21 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 4 22:02:21 kjcf05n02 chronyd[2128]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 4 22:02:21 kjcf05n02 mcelog[2126]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 4 22:02:21 kjcf05n02 mcelog[2126]: CPU is unsupported Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[2110]: Setting up Mellanox network interface: ib0 Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[2125]: Setting up Mellanox network interface: ib1 Nov 4 22:02:21 kjcf05n02 dbus-daemon[2095]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 4 22:02:21 kjcf05n02 network[2159]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 22:02:21 kjcf05n02 nscd[2211]: 2211 monitoring file `/etc/hosts` (1) Nov 4 22:02:21 kjcf05n02 nscd[2211]: 2211 monitoring directory `/etc` (2) Nov 4 22:02:21 kjcf05n02 nscd[2211]: 2211 monitoring file `/etc/resolv.conf` (3) Nov 4 22:02:21 kjcf05n02 nscd[2211]: 2211 monitoring directory `/etc` (2) Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 4 22:02:21 kjcf05n02 network[2208]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 22:02:21 kjcf05n02 network[2159]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:02:21 kjcf05n02 chronyd[2128]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 4 22:02:21 kjcf05n02 chronyd[2128]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[2224]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 4 22:02:21 kjcf05n02 network[2229]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:02:21 kjcf05n02 network[2159]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[2230]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 0 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 1 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 2 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 3 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 4 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 5 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 6 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 7 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 8 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 9 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 10 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 11 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 12 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 13 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 14 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 15 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 16 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 17 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 18 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 19 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 20 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 21 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 22 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 23 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 24 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 25 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 26 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 27 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 28 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 29 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 30 Nov 4 22:02:21 kjcf05n02 cpupower[2251]: Idlestate 2 disabled on CPU 31 Nov 4 22:02:21 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 4 22:02:21 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 4 22:02:21 kjcf05n02 beSetMlxConfig[2231]: ConnectX-3 multiport not detected Nov 4 22:02:21 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 4 22:02:21 kjcf05n02 mdraid-phy[2246]: no Cutlass to worry about Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[2245]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 22:02:21 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 4 22:02:21 kjcf05n02 sssd[sssd][2092]: Starting up Nov 4 22:02:21 kjcf05n02 network[2247]: It is advised to switch to 'NetworkManager' instead for network management. Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[2258]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[2264]: No configuration found for ib0 Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[2277]: No configuration found for ib1 Nov 4 22:02:21 kjcf05n02 dbus-daemon[2095]: [system] Successfully activated service 'org.freedesktop.systemd1' Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[2287]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 22:02:21 kjcf05n02 beSetMlxConfig[2231]: Starting MST (Mellanox Software Tools) driver set Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[2297]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 22:02:21 kjcf05n02 beSetMlxConfig[2231]: Loading MST PCI module - Success Nov 4 22:02:21 kjcf05n02 mlnx_conf_mgr[2326]: INFO: No configurations found for mlx5_0, skipping. Nov 4 22:02:21 kjcf05n02 mlnx_conf_mgr[2347]: INFO: No configurations found for mlx5_1, skipping. Nov 4 22:02:21 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 22:02:21 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 22:02:21 kjcf05n02 beSetMlxConfig[2231]: Loading MST PCI configuration module - Success Nov 4 22:02:21 kjcf05n02 beSetMlxConfig[2231]: Create devices Nov 4 22:02:21 kjcf05n02 sssd[be[implicit_files]][2299]: Starting up Nov 4 22:02:21 kjcf05n02 sssd[nss][2419]: Starting up Nov 4 22:02:21 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 4 22:02:21 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Login Service... Nov 4 22:02:21 kjcf05n02 systemd-logind[2524]: New seat seat0. Nov 4 22:02:21 kjcf05n02 systemd-logind[2524]: Watching system buttons on /dev/input/event0 (Power Button) Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Login Service. Nov 4 22:02:21 kjcf05n02 python3.9[2234]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 22:02:21 kjcf05n02 python3.9[3142]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 22:02:21 kjcf05n02 systemd-sysctl[2735]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 22:02:21 kjcf05n02 systemd-sysctl[2735]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 4 22:02:21 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 22:02:21 kjcf05n02 python3.9[2808]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 22:02:21 kjcf05n02 python3.9[3142]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 4 22:02:21 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 22:02:21 kjcf05n02 network[2159]: Bringing up loopback interface: [ OK ] Nov 4 22:02:21 kjcf05n02 python3.9[2987]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 22:02:21 kjcf05n02 python3.9[3142]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:21 kjcf05n02 systemd-sysctl[3064]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 22:02:21 kjcf05n02 systemd-sysctl[3064]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 22:02:21 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 4 22:02:21 kjcf05n02 systemd[1]: Reached target Network. Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 4 22:02:21 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 4 22:02:21 kjcf05n02 sm-notify[3128]: Version 2.3.3 starting Nov 4 22:02:21 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 4 22:02:21 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 4 22:02:21 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 4 22:02:21 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 4 22:02:21 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 4 22:02:21 kjcf05n02 lldpad[3117]: setsockopt nearest_bridge: Invalid argument Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 4 22:02:21 kjcf05n02 lldpad[3117]: setsockopt nearest_bridge: Invalid argument Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 4 22:02:21 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 4 22:02:21 kjcf05n02 sshd[3182]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 4 22:02:21 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 4 22:02:21 kjcf05n02 syslog-ng[3142]: [2024-11-05T04:01:08.589316] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 4 22:02:21 kjcf05n02 syslog-ng[3142]: [2024-11-05T04:01:08.589591] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 4 22:02:21 kjcf05n02 syslog-ng[3142]: [2024-11-05T04:01:08.589620] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 4 22:02:21 kjcf05n02 syslog-ng[3142]: [2024-11-05T04:01:08.590182] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 4 22:02:21 kjcf05n02 syslog-ng[3142]: [2024-11-05T04:01:08.590482] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 4 22:02:21 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 4 22:02:21 kjcf05n02 beSetMlxConfig[2231]: Unloading MST PCI module (unused) - Success Nov 4 22:02:21 kjcf05n02 python3.9[3190]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 22:02:21 kjcf05n02 python3.9[3142]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 4 22:02:21 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 22:02:21 kjcf05n02 python3.9[3418]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 22:02:21 kjcf05n02 python3.9[3142]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 4 22:02:21 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 4 22:02:21 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 22:02:21 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 4 22:02:21 kjcf05n02 chronyd[2128]: System's initial offset : 0.003464 seconds slow of true (slew) Nov 4 22:02:21 kjcf05n02 systemd[1]: Started NTP client/server. Nov 4 22:02:21 kjcf05n02 beSetMlxConfig[2231]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 22:02:21 kjcf05n02 beSetMlxConfig[2231]: ib mode Nov 4 22:02:21 kjcf05n02 root[3439]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 4 22:02:21 kjcf05n02 root[3441]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 4 22:02:21 kjcf05n02 beSetMlxConfig[2231]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 22:02:21 kjcf05n02 beSetMlxConfig[2231]: ib mode Nov 4 22:02:21 kjcf05n02 systemd-udevd[1581]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 22:02:21 kjcf05n02 systemd-udevd[3457]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:02:21 kjcf05n02 systemd-udevd[3458]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:02:21 kjcf05n02 systemd-udevd[3461]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:02:21 kjcf05n02 systemd-udevd[3462]: Using default interface naming scheme 'rhel-8.0'. Nov 4 22:02:21 kjcf05n02 systemd-udevd[3462]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:02:21 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 22:02:21 kjcf05n02 systemd[3142]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:21 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[3499]: Setting up Mellanox network interface: ib1 Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[3500]: Setting up Mellanox network interface: ib0 Nov 4 22:02:21 kjcf05n02 systemd-udevd[3460]: Using default interface naming scheme 'rhel-8.0'. Nov 4 22:02:21 kjcf05n02 systemd-udevd[3459]: Using default interface naming scheme 'rhel-8.0'. Nov 4 22:02:21 kjcf05n02 systemd-udevd[3460]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:02:21 kjcf05n02 systemd-udevd[3459]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[3549]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[3550]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[3580]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[3581]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[3582]: No configuration found for ib1 Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[3583]: No configuration found for ib0 Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[3590]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[3591]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 22:02:21 kjcf05n02 mlnx_conf_mgr[3630]: INFO: No configurations found for mlx5_1, skipping. Nov 4 22:02:21 kjcf05n02 mlnx_conf_mgr[3631]: INFO: No configurations found for mlx5_0, skipping. Nov 4 22:02:21 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 22:02:21 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 22:02:21 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 4 22:02:21 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 4 22:02:21 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 4 22:02:21 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 4 22:02:21 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 4 22:02:21 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 22:02:21 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 4 22:02:21 kjcf05n02 lldpad[3117]: init_ports: Error adding device ib0 Nov 4 22:02:21 kjcf05n02 lldpad[3117]: init_ports: Error adding device ib1 Nov 4 22:02:21 kjcf05n02 lldpad[3117]: Signal 15 received - terminating Nov 4 22:02:21 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 4 22:02:21 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 4 22:02:21 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 4 22:02:21 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 4 22:02:21 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 4 22:02:21 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 4 22:02:21 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 4 22:02:21 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:21 kjcf05n02 systemd[3142]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:21 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 1 | Nov-05-2024 | 03:31:35 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 2 | Nov-05-2024 | 03:32:26 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 3 | Nov-05-2024 | 03:32:27 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 4 | Nov-05-2024 | 03:33:32 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 5 | Nov-05-2024 | 03:33:32 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 6 | Nov-05-2024 | 03:58:13 | Sensor #40 (Generator ID 20h) | Voltage | Assertion Event | Lower Critical - going low ; Sensor Reading = 00h ; Threshold = 02h Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 7 | Nov-05-2024 | 03:58:13 | Sensor #40 (Generator ID 20h) | Voltage | Assertion Event | Lower Non-recoverable - going low ; Sensor Reading = 00h ; Threshold = 01h Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 8 | Nov-05-2024 | 03:58:21 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 9 | Nov-05-2024 | 03:58:21 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 10 | Nov-05-2024 | 03:58:21 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 11 | Nov-05-2024 | 03:58:21 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 12 | Nov-05-2024 | 03:58:21 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 13 | Nov-05-2024 | 03:58:21 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 14 | Nov-05-2024 | 03:58:21 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 15 | Nov-05-2024 | 03:58:21 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 16 | Nov-05-2024 | 03:58:21 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 17 | Nov-05-2024 | 03:58:21 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 18 | Nov-05-2024 | 03:58:21 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 19 | Nov-05-2024 | 03:58:21 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 20 | Nov-05-2024 | 03:58:52 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 21 | Nov-05-2024 | 03:58:52 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 22 | Nov-05-2024 | 03:58:52 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 23 | Nov-05-2024 | 03:58:52 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 24 | Nov-05-2024 | 03:58:52 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 25 | Nov-05-2024 | 03:58:52 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 26 | Nov-05-2024 | 03:58:52 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 27 | Nov-05-2024 | 03:58:52 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 28 | Nov-05-2024 | 03:58:52 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 29 | Nov-05-2024 | 03:58:52 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 30 | Nov-05-2024 | 03:58:52 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 22:02:21 kjcf05n02 ipmievd[3978]: 31 | Nov-05-2024 | 03:58:52 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 22:02:21 kjcf05n02 ipmievd[3981]: Reading sensors... Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 4 22:02:21 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:21 kjcf05n02 systemd[3142]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 4 22:02:21 kjcf05n02 nscd[2211]: 2211 monitored file `/etc/hosts` was moved into place, adding watch Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 22:02:21 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 4 22:02:21 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 4 22:02:21 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 4 22:02:21 kjcf05n02 beSetMlxConfig[4038]: ConnectX-3 multiport not detected Nov 4 22:02:21 kjcf05n02 beSetMlxConfig[4038]: Starting MST (Mellanox Software Tools) driver set Nov 4 22:02:21 kjcf05n02 beSetMlxConfig[4038]: Loading MST PCI module - Success Nov 4 22:02:21 kjcf05n02 systemd-udevd[1581]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 22:02:21 kjcf05n02 beSetMlxConfig[4038]: [warn] mst_pciconf is already loaded, skipping Nov 4 22:02:21 kjcf05n02 beSetMlxConfig[4038]: Create devices Nov 4 22:02:21 kjcf05n02 beSetMlxConfig[4038]: Unloading MST PCI module (unused) - Success Nov 4 22:02:21 kjcf05n02 ipmievd[3981]: Waiting for events... Nov 4 22:02:21 kjcf05n02 beSetMlxConfig[4038]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 22:02:21 kjcf05n02 beSetMlxConfig[4038]: ib mode Nov 4 22:02:21 kjcf05n02 beSetMlxConfig[4038]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 22:02:21 kjcf05n02 beSetMlxConfig[4038]: ib mode Nov 4 22:02:21 kjcf05n02 systemd-udevd[1581]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 22:02:21 kjcf05n02 systemd-udevd[4940]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:02:21 kjcf05n02 systemd-udevd[4939]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:02:21 kjcf05n02 systemd-udevd[4943]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:02:21 kjcf05n02 systemd-udevd[4945]: Using default interface naming scheme 'rhel-8.0'. Nov 4 22:02:21 kjcf05n02 systemd-udevd[4945]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:02:21 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 22:02:21 kjcf05n02 systemd[3142]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:21 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[4981]: Setting up Mellanox network interface: ib0 Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[4982]: Setting up Mellanox network interface: ib1 Nov 4 22:02:21 kjcf05n02 systemd-udevd[4942]: Using default interface naming scheme 'rhel-8.0'. Nov 4 22:02:21 kjcf05n02 systemd-udevd[4941]: Using default interface naming scheme 'rhel-8.0'. Nov 4 22:02:21 kjcf05n02 systemd-udevd[4942]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:02:21 kjcf05n02 systemd-udevd[4941]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[5031]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[5032]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[5062]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[5063]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[5064]: No configuration found for ib0 Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[5065]: No configuration found for ib1 Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[5072]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 22:02:21 kjcf05n02 mlnx_interface_mgr[5073]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 22:02:21 kjcf05n02 mlnx_conf_mgr[5112]: INFO: No configurations found for mlx5_1, skipping. Nov 4 22:02:21 kjcf05n02 mlnx_conf_mgr[5113]: INFO: No configurations found for mlx5_0, skipping. Nov 4 22:02:21 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 22:02:21 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}54fe5ef7a2905031c8def2642f74fbae6459254a9a83e4a1a0a311fe67d75149' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}54fe5ef7a2905031c8def2642f74fbae6459254a9a83e4a1a0a311fe67d75149' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}e81b1f96fb420fbd79229620d97ac628a5e005858831a3f9580d278a6d466fe8' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}e81b1f96fb420fbd79229620d97ac628a5e005858831a3f9580d278a6d466fe8' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}2a1794f2cd95794067aea9a1064872488366aef25e3c23299bdc50879c8969da' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}2a1794f2cd95794067aea9a1064872488366aef25e3c23299bdc50879c8969da' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}79baf79a92c5d8f65d0f7b6c78083219ace45caf09b626e2346747543639a91e' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}79baf79a92c5d8f65d0f7b6c78083219ace45caf09b626e2346747543639a91e' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 22:02:21 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 4 22:02:21 kjcf05n02 chronyd[2128]: chronyd exiting Nov 4 22:02:21 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 4 22:02:21 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 4 22:02:21 kjcf05n02 chronyd[5147]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 22:02:21 kjcf05n02 chronyd[5147]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 22:02:21 kjcf05n02 chronyd[5147]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 22:02:21 kjcf05n02 chronyd[5147]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 4 22:02:21 kjcf05n02 systemd[1]: Started NTP client/server. Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 22:02:21 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:21 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 4 22:02:21 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 4 22:02:21 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 22:02:21 kjcf05n02 dwd[5178]: dwd: vMay 29 2024 : 15:38:26 Nov 4 22:02:21 kjcf05n02 dwd[5178]: /usr/sbin/dwd -i 15 -d Nov 4 22:02:21 kjcf05n02 dwd[5178]: dwd: option Lethal: 0 Nov 4 22:02:21 kjcf05n02 dwd[5178]: dwd: option Interval: 15 Nov 4 22:02:21 kjcf05n02 dwd[5178]: dwd: option abrtlimit: 10 Nov 4 22:02:21 kjcf05n02 dwd[5178]: dwd: option DZPeriod: 604800 Nov 4 22:02:21 kjcf05n02 dwd[5178]: dwd: option SmartPeriod: 43200 Nov 4 22:02:21 kjcf05n02 dwd[5178]: dwd: option SDDEnabled: 1 Nov 4 22:02:21 kjcf05n02 dwd[5178]: dwd: option SDDAwaitScale: 3 Nov 4 22:02:21 kjcf05n02 dwd[5178]: dwd: option SDDAwaitMin: 100 Nov 4 22:02:21 kjcf05n02 dwd[5178]: dwd: option Verbosity: 1 Nov 4 22:02:21 kjcf05n02 dwd[5178]: dwd: option StandAlone: 0 Nov 4 22:02:21 kjcf05n02 dwd[5178]: option Lethal: 0 Nov 4 22:02:21 kjcf05n02 dwd[5178]: option Interval: 15 Nov 4 22:02:21 kjcf05n02 dwd[5178]: option abrtlimit: 10 Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 22:02:21 kjcf05n02 dwd[5178]: option DZPeriod: 604800 Nov 4 22:02:21 kjcf05n02 dwd[5178]: option SmartPeriod: 43200 Nov 4 22:02:21 kjcf05n02 dwd[5178]: option SDDEnabled: 1 Nov 4 22:02:21 kjcf05n02 dwd[5178]: option SDDAwaitScale: 3 Nov 4 22:02:21 kjcf05n02 dwd[5178]: option SDDAwaitMin: 100 Nov 4 22:02:21 kjcf05n02 dwd[5178]: option Verbosity: 1 Nov 4 22:02:21 kjcf05n02 dwd[5178]: option StandAlone: 0 Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 4 22:02:21 kjcf05n02 dwd[5180]: option Lethal now set to 1 Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 22:02:21 kjcf05n02 dwd[5180]: option abrtlimit now set to 1 Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 22:02:21 kjcf05n02 dwd[5180]: option SmartPeriod now set to 86400 Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 22:02:21 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 22:02:21 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:21 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:21 kjcf05n02 python3.9[5209]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 4 22:02:21 kjcf05n02 python3.9[3142]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 22:02:21 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:21 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 22:02:21 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:21 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 4 22:02:21 kjcf05n02 sedcpwrkr[5346]: Using config script: /etc/sedcpwrkr.conf Nov 4 22:02:21 kjcf05n02 sedcpwrkr[5346]: - Creating default directory: '/var/log/sedcpwrkr' Nov 4 22:02:21 kjcf05n02 sedcpwrkr[5346]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 4 22:02:21 kjcf05n02 sedcpwrkr[5346]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 4 22:02:21 kjcf05n02 sedcpwrkr[5346]: - Creating default directory: '/var/run/sedcpwrkr' Nov 4 22:02:21 kjcf05n02 sedcpwrkr[5346]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 4 22:02:21 kjcf05n02 sedcpwrkr[5346]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 4 22:02:21 kjcf05n02 sedcpwrkr-server[5377]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 22:02:21 kjcf05n02 sedcpwrkr[5346]: celery multi v5.2.7 (dawn-chorus) Nov 4 22:02:21 kjcf05n02 sedcpwrkr[5346]: > Starting nodes... Nov 4 22:02:21 kjcf05n02 sedcpwrkr[5346]: > sedcpwrkr@kjcf05n02: OK Nov 4 22:02:21 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 4 22:02:21 kjcf05n02 sedcpwrkr-server[5379]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 22:02:21 kjcf05n02 sedcpwrkr-server[5379]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 22:02:21 kjcf05n02 sedcpwrkr-server[5379]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 22:02:21 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 22:02:21 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 4 22:02:21 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 22:02:21 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 4 22:02:21 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 4 22:02:22 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:22 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 4 22:02:22 kjcf05n02 systemd-udevd[1581]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 22:02:22 kjcf05n02 iptables.init[5447]: iptables: Applying firewall rules: [ OK ] Nov 4 22:02:22 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 4 22:02:22 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:23 kjcf05n02 systemd[3142]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 22:02:23 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 22:02:23 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 22:02:23 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:24 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 22:02:24 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5545 which is not our child. We'll most likely not notice when it exits. Nov 4 22:02:24 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 22:02:24 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:24 kjcf05n02 openhpid[5545]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 22:02:24 kjcf05n02 openhpid[5545]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 22:02:24 kjcf05n02 openhpid[5545]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 22:02:24 kjcf05n02 openhpid[5545]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 22:02:24 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:24 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:24 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:24 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 4 22:02:24 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 4 22:02:24 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 22:02:24 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 22:02:24 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:25 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 4 22:02:25 kjcf05n02 dcs-collectord[5636]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 4 22:02:25 kjcf05n02 hpi.inv.log[5636]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 4 22:02:25 kjcf05n02 dcs-collectord[5636]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 4 22:02:25 kjcf05n02 dcs-collectord[5636]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 4 22:02:25 kjcf05n02 dcs-collector[5627]: Starting dcs-collector:[ OK ] Nov 4 22:02:25 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 4 22:02:25 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 4 22:02:25 kjcf05n02 dcs-collectord[5639]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 22:02:25 kjcf05n02 dcs-collectord[5639]: INFO Starting collection for memory_info (collection_process.py:52) Nov 4 22:02:25 kjcf05n02 dcs-collectord[5639]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 22:02:25 kjcf05n02 dcs-collectord[5639]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 22:02:25 kjcf05n02 dcs-collectord[5639]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 4 22:02:25 kjcf05n02 dcs-collectord[5639]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 4 22:02:25 kjcf05n02 dcs-collectord[5639]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 4 22:02:25 kjcf05n02 dcs-collectord[5639]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259346708", "units": "kB"}, {"name": "MemAvailable", "value": "258626160", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821276", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686760", "units": "kB"}, {"name": "Inactive", "value": "958996", "units": "kB"}, {"name": "Active(anon)", "value": "1520684", "units": "kB"}, {"name": "Inactive(anon)", "value": "822744", "units": "kB"}, {"name": "Active(file)", "value": "166076", "units": "kB"}, {"name": "Inactive(file)", "value": "136252", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "747988", "units": "kB"}, {"name": "Mapped", "value": "85632", "units": "kB"}, {"name": "Shmem", "value": "1593400", "units": "kB"}, {"name": "KReclaimable", "value": "108740", "units": "kB"}, {"name": "Slab", "value": "276068", "units": "kB"}, {"name": "SReclaimable", "value": "108740", "units": "kB"}, {"name": "SUnreclaim", "value": "167328", "units": "kB"}, {"name": "KernelStack", "value": "9808", "units": "kB"}, {"name": "PageTables", "value": "20612", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3358156", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11136", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "0", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "276808", "units": "kB"}, {"name": "DirectMap2M", "value": "20559872", "units": "kB"}, {"name": "DirectMap1G", "value": "247463936", "units": "kB"}]}' Nov 4 22:02:25 kjcf05n02 dcs-collectord[5639]: INFO Completed collection for memory_info (collection_process.py:59) Nov 4 22:02:25 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:25 kjcf05n02 systemd[3142]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:25 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:25 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:25 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 4 22:02:25 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 4 22:02:25 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 22:02:25 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 22:02:25 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:26 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 4 22:02:26 kjcf05n02 firmware-update-orc[5720]: Using config script: /etc/firmware_update_orc.conf Nov 4 22:02:26 kjcf05n02 firmware-update-orc[5720]: - Creating default directory: '/var/log/firmware-update-orc' Nov 4 22:02:26 kjcf05n02 firmware-update-orc[5720]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 4 22:02:26 kjcf05n02 firmware-update-orc[5720]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 4 22:02:26 kjcf05n02 firmware-update-orc[5720]: - Creating default directory: '/var/run/firmware-update-orc' Nov 4 22:02:26 kjcf05n02 firmware-update-orc[5720]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 4 22:02:26 kjcf05n02 firmware-update-orc[5720]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 4 22:02:26 kjcf05n02 dcs-collectord[5639]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 4 22:02:26 kjcf05n02 dcs-collectord[5639]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730779345.2014413], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730779346.3782313], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730779345.1321275, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 4 22:02:26 kjcf05n02 firmware-update-orc-server[5756]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 22:02:26 kjcf05n02 firmware-update-orc[5720]: celery multi v5.2.7 (dawn-chorus) Nov 4 22:02:26 kjcf05n02 firmware-update-orc[5720]: > Starting nodes... Nov 4 22:02:26 kjcf05n02 firmware-update-orc[5720]: > worker1@kjcf05n02: OK Nov 4 22:02:26 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 4 22:02:26 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 4 22:02:26 kjcf05n02 firmware-update-orc-server[5785]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 22:02:26 kjcf05n02 firmware-update-orc-server[5785]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 22:02:26 kjcf05n02 firmware-update-orc-server[5785]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 22:02:26 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 4 22:02:26 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:27 kjcf05n02 systemd[3142]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:27 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:27 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:27 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 22:02:27 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 22:02:27 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 22:02:27 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 22:02:27 kjcf05n02 dbus-daemon[2095]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 22:02:27 kjcf05n02 dbus-daemon[2095]: [system] Reloaded configuration Nov 4 22:02:27 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 4 22:02:27 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 4 22:02:27 kjcf05n02 dbus-daemon[2095]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 22:02:27 kjcf05n02 dbus-daemon[2095]: [system] Reloaded configuration Nov 4 22:02:27 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 22:02:27 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 22:02:27 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 22:02:27 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 22:02:27 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:27 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 4 22:02:28 kjcf05n02 ras-resource-manager-agent[5901]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 4 22:02:28 kjcf05n02 ras-resource-manager-agent[5887]: Starting ras-resource-manager-agent:[ OK ] Nov 4 22:02:28 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 4 22:02:28 kjcf05n02 ras-resource-manager-agent[5903]: INFO Starting the service handler (service_main_handler.py:98) Nov 4 22:02:28 kjcf05n02 ras-resource-manager-client[5903]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 4 22:02:28 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 4 22:02:28 kjcf05n02 ras-resource-manager-client[5903]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 22:02:28 kjcf05n02 ras-resource-manager-client[5913]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 22:02:28 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:28 kjcf05n02 systemd[3142]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:28 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:28 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:28 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 22:02:28 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 22:02:28 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:28 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 22:02:28 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:29 kjcf05n02 systemd[3142]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: Press Ctrl+C to exit. Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: Plugin support version 1.0 Nov 4 22:02:29 kjcf05n02 zabbix_agent2[5987]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 22:02:29 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:29 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:29 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:29 kjcf05n00 mcfcli[3673891]: %3|1730779349.388|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:02:29 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 4 22:02:29 kjcf05n02 dcs-notification-sender[6062]: dcs-notification-senderd is stopped Nov 4 22:02:29 kjcf05n02 zabbix-agent2[6077]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 4 22:02:29 kjcf05n02 dcs-notification-sender[6062]: Starting notification-sender:[ OK ] Nov 4 22:02:29 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 4 22:02:30 kjcf05n02 zabbix-agent2[6082]: INFO DCS notification agent started. (agent.py:61) Nov 4 22:02:30 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 4 22:02:30 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:30 kjcf05n02 systemd[3142]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:30 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:30 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:30 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:30 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 4 22:02:31 kjcf05n02 dcs-collectord[6172]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 4 22:02:31 kjcf05n02 dcs-collectord[6172]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 4 22:02:31 kjcf05n02 dcs-bulk-data-sender[6172]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 4 22:02:31 kjcf05n02 dcs-bulk-data-sender[6163]: Starting bulk-data-sender:[ OK ] Nov 4 22:02:31 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 4 22:02:31 kjcf05n02 dcs-collectord[6174]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 4 22:02:31 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 4 22:02:31 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:31 kjcf05n02 systemd[3142]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:31 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:31 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:31 kjcf05n02 nscd[2211]: 2211 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 4 22:02:31 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 22:02:31 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 22:02:31 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 22:02:31 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 22:02:31 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 22:02:31 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 22:02:31 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 4 22:02:31 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 4 22:02:31 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 4 22:02:31 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 4 22:02:31 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 22:02:31 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 22:02:31 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 22:02:31 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 22:02:32 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 22:02:32 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 22:02:32 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 22:02:32 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 22:02:32 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 4 22:02:32 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 4 22:02:32 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 4 22:02:32 kjcf05n02 sssd[nss][2419]: Shutting down (status = 0) Nov 4 22:02:32 kjcf05n02 sssd[be[implicit_files]][2299]: Shutting down (status = 0) Nov 4 22:02:32 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 4 22:02:32 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 4 22:02:32 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 4 22:02:32 kjcf05n02 sssd[sssd][6260]: Starting up Nov 4 22:02:32 kjcf05n02 python3.9[5209]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 4 22:02:32 kjcf05n02 python3.9[3142]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:32 kjcf05n02 sssd[be[implicit_files]][6262]: Starting up Nov 4 22:02:33 kjcf05n02 sssd[nss][6263]: Starting up Nov 4 22:02:33 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 22:02:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 22:02:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 22:02:33 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:02:33 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:34 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 4 22:02:34 kjcf05n02 icinga2[6322]: [2024-11-04 22:02:34 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 4 22:02:34 kjcf05n02 icinga2[6322]: [2024-11-04 22:02:34 -0600] information/cli: Loading configuration file(s). Nov 4 22:02:34 kjcf05n02 icinga2[6322]: [2024-11-04 22:02:34 -0600] information/ConfigItem: Committing config item(s). Nov 4 22:02:34 kjcf05n02 icinga2[6322]: [2024-11-04 22:02:34 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 4 22:02:34 kjcf05n02 icinga2[6322]: [2024-11-04 22:02:34 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 4 22:02:34 kjcf05n02 icinga2[6322]: [2024-11-04 22:02:34 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 4 22:02:34 kjcf05n02 icinga2[6322]: [2024-11-04 22:02:34 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 4 22:02:34 kjcf05n02 icinga2[6322]: [2024-11-04 22:02:34 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 4 22:02:34 kjcf05n02 icinga2[6322]: [2024-11-04 22:02:34 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 4 22:02:34 kjcf05n02 icinga2[6322]: [2024-11-04 22:02:34 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 4 22:02:34 kjcf05n02 icinga2[6322]: [2024-11-04 22:02:34 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 4 22:02:34 kjcf05n02 icinga2[6322]: [2024-11-04 22:02:34 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 4 22:02:34 kjcf05n02 icinga2[6322]: [2024-11-04 22:02:34 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 4 22:02:34 kjcf05n02 icinga2[6322]: [2024-11-04 22:02:34 -0600] information/cli: Closing console log. Nov 4 22:02:34 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 4 22:02:34 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:35 kjcf05n02 systemd[3142]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:35 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:35 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:35 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 22:02:35 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 22:02:35 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:35 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 4 22:02:35 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:36 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 22:02:36 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:36 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:36 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 22:02:36 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 22:02:36 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 22:02:36 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 22:02:36 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 4 22:02:36 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 4 22:02:36 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 4 22:02:36 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 4 22:02:36 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 22:02:36 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 22:02:36 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 22:02:36 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 22:02:36 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 4 22:02:36 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 4 22:02:36 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:37 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 4 22:02:37 kjcf05n02 nslcd[7233]: version 0.9.9 starting Nov 4 22:02:37 kjcf05n02 nslcd[7233]: accepting connections Nov 4 22:02:37 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 4 22:02:37 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 22:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 22:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 22:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 22:02:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 22:02:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 22:02:37 kjcf05n02 systemd[3142]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:37 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:37 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:37 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 22:02:37 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 22:02:37 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 22:02:37 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 22:02:38 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 22:02:38 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 22:02:38 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 22:02:38 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 22:02:38 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:38 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 4 22:02:39 kjcf05n02 dearcpw[7417]: Using config script: /etc/dearcpw.conf Nov 4 22:02:39 kjcf05n02 dearcpw[7417]: - Creating default directory: '/var/log/dearcpw' Nov 4 22:02:39 kjcf05n02 dearcpw[7417]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 4 22:02:39 kjcf05n02 dearcpw[7417]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 4 22:02:39 kjcf05n02 dearcpw[7417]: - Creating default directory: '/var/run/dearcpw' Nov 4 22:02:39 kjcf05n02 dearcpw[7417]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 4 22:02:39 kjcf05n02 dearcpw[7417]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 4 22:02:39 kjcf05n02 dearcpw-server[7466]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 22:02:39 kjcf05n02 dearcpw[7417]: celery multi v5.2.7 (dawn-chorus) Nov 4 22:02:39 kjcf05n02 dearcpw[7417]: > Starting nodes... Nov 4 22:02:39 kjcf05n02 dearcpw[7417]: > dearcpw@kjcf05n02: OK Nov 4 22:02:39 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 4 22:02:39 kjcf05n02 dearcpw-server[7468]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 22:02:39 kjcf05n02 dearcpw-server[7468]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 22:02:39 kjcf05n02 dearcpw-server[7468]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 22:02:39 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 4 22:02:39 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:39 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:39 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 4 22:02:39 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 4 22:02:39 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 4 22:02:39 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 4 22:02:39 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 4 22:02:39 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 4 22:02:39 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 4 22:02:39 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 4 22:02:39 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 4 22:02:39 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 4 22:02:40 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:56666). Nov 4 22:02:40 kjcf05n01 rsyncd[3921649]: connect from kjcf05n02 (172.16.2.5) Nov 4 22:02:40 kjcf05n01 rsyncd[3921649]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 4 22:02:40 kjcf05n01 rsyncd[3921649]: receiving file list Nov 4 22:02:40 kjcf05n01 rsyncd[3921649]: sent 29 bytes received 325 bytes total size 10905 Nov 4 22:02:40 kjcf05n01 systemd[1]: rsyncd@668-172.16.2.2:873-172.16.2.5:56666.service: Succeeded. Nov 4 22:02:40 kjcf05n02 puppet[7495]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 4 22:02:40 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 4 22:02:40 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 4 22:02:40 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 4 22:02:40 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 4 22:02:40 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 4 22:02:40 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 4 22:02:40 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 22:02:40 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 22:02:40 kjcf05n02 dcs-bulk-data-sender[6174]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 4 22:02:40 kjcf05n02 dcs-collectord[6174]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 4 22:02:40 kjcf05n02 dcs-collectord[5639]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 22:02:40 kjcf05n02 dcs-collectord[5639]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 22:02:40 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 22:02:40 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 22:02:41 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 22:02:41 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 22:02:41 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 22:02:41 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 22:02:41 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 22:02:41 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 22:02:41 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 22:02:41 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 22:02:42 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 22:02:42 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 22:02:42 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 22:02:42 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 22:02:43 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 22:02:43 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 22:02:43 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:43 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 4 22:02:43 kjcf05n02 diskless-swap[7599]: HA_PS_000: recovering journal Nov 4 22:02:43 kjcf05n02 systemd-udevd[1581]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 22:02:43 kjcf05n02 diskless-swap[7599]: HA_PS_000: clean, 2292/6400 files, 7090/25600 blocks Nov 4 22:02:43 kjcf05n02 diskless-swap[7599]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 4 22:02:43 kjcf05n02 diskless-swap[7599]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 4 22:02:43 kjcf05n02 diskless-swap[7599]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 4 22:02:43 kjcf05n02 diskless-swap[7599]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 4 22:02:43 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 4 22:02:43 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:43 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:43 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 4 22:02:43 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 4 22:02:43 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 22:02:43 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 22:02:43 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 4 22:02:44 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 4 22:02:44 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 4 22:02:44 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 4 22:02:44 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 4 22:02:44 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 4 22:02:44 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 4 22:02:44 kjcf05n02 ipmievd[3981]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 4 22:02:44 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 4 22:02:44 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 4 22:02:44 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 4 22:02:44 kjcf05n02 ipmievd[3981]: System Event sensor - Timestamp Clock Sync Nov 4 22:02:44 kjcf05n02 ipmievd[3142]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:44 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 22:02:44 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 22:02:44 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 22:02:44 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 22:02:44 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 22:02:44 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 22:02:45 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 22:02:45 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 22:02:45 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 22:02:45 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 22:02:46 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 22:02:46 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 22:02:46 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 22:02:46 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 22:02:46 kjcf05n00 zabbix-server[2487194]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:02:46 kjcf05n00 zabbix-server[2487194]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 237.42\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 174.64\\"}}"' Nov 4 22:02:46 kjcf05n00 log_interesting_event.py[2487194]: Event '46731' acknowledged Nov 4 22:02:47 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 22:02:47 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 22:02:47 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 22:02:47 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 22:02:47 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:47 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 4 22:02:47 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:47 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:47 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 4 22:02:47 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 4 22:02:47 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:47 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 4 22:02:47 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:47 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:47 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 22:02:47 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 22:02:47 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:48 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 4 22:02:48 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:02:48 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:02:48 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 4 22:02:48 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 4 22:02:48 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 4 22:02:48 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 4 22:02:48 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 4 22:02:48 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 4 22:02:48 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 22:02:48 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 22:02:48 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 22:02:48 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 22:02:48 kjcf05n02 systemd[1]: Reloading. Nov 4 22:02:48 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 4 22:02:48 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 4 22:02:48 kjcf05n02 kdumpctl[7831]: kdump: No kdump initial ramdisk found. Nov 4 22:02:48 kjcf05n02 kdumpctl[7831]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 4 22:02:48 kjcf05n02 dracut[7955]: dracut-049-135.git20210121.el8 Nov 4 22:02:49 kjcf05n00 mcfcli[3673891]: %3|1730779369.145|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:02:49 kjcf05n02 dracut[7957]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 4 22:02:49 kjcf05n02 dracut[7957]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 22:02:49 kjcf05n02 dracut[7957]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 22:02:49 kjcf05n02 dracut[7957]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 4 22:02:49 kjcf05n02 dracut[7957]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 4 22:02:49 kjcf05n02 dracut[7957]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 22:02:49 kjcf05n02 dracut[7957]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 22:02:49 kjcf05n02 dracut[7957]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + is_func check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check -h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local dev holder Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + require_binaries mdadm expr Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _module_name=90hperaid Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ mdadm = \-\m ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for cmd in "$@" Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + find_binary mdadm Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for cmd in "$@" Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + find_binary expr Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n -h ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for dev in "${!host_fs_types[@]}" Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ nfs != *_raid_member ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + continue Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _ret=255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + ret=255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ 255 = 0 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ 255 = 255 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ module_depends hperaid Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: +++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: +++ set -x Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ depends Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo rootfs-block Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ return 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ _ret=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ return 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for _moddep in $(module_depends $_mod) Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all == *\ hperaid\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + add_dracutmodules+=' rootfs-block ' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ == *\ hperaid\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check_module rootfs-block Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _mod=rootfs-block Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ == *\ rootfs-block\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n '' ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + mods_checked_as_dep+=' rootfs-block ' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all == *\ rootfs-block\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + module_check rootfs-block 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 2 -eq 2 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _forced=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + is_func check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check -h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _ret=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + ret=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ 0 = 0 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ module_depends rootfs-block Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: +++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ depends Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo fs-lib Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ _ret=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ return 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for _moddep in $(module_depends $_mod) Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all == *\ rootfs-block\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + add_dracutmodules+=' fs-lib ' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ == *\ rootfs-block\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check_module fs-lib Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _mod=fs-lib Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n '' ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + mods_checked_as_dep+=' fs-lib ' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all == *\ fs-lib\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + module_check fs-lib 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 2 -eq 2 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _forced=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + is_func check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check -h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _ret=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + ret=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ 0 = 0 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ module_depends fs-lib Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: +++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ depends Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ return 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ _ret=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ return 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + mods_to_load+=' fs-lib ' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + mods_to_load+=' rootfs-block ' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + mods_to_load+=' hperaid ' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _mod=90kernel-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _mod=kernel-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check_module kernel-modules 1 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _mod=kernel-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[3142]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all = all ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + module_check kernel-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 1 -eq 2 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + is_func check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check -h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + true Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _ret=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + ret=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ 0 != 0 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ module_depends kernel-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: +++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ depends Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ true Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ _ret=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ return 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + mods_to_load+=' kernel-modules ' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _mod=90kernel-modules-extra Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _mod=kernel-modules-extra Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check_module kernel-modules-extra 1 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _mod=kernel-modules-extra Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all = all ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + module_check kernel-modules-extra Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 1 -eq 2 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + is_func check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check -h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + true Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _ret=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + ret=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ 0 != 0 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ module_depends kernel-modules-extra Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: +++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ depends Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ true Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ _ret=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ return 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + mods_to_load+=' kernel-modules-extra ' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _mod=90kernel-network-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _mod=kernel-network-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check_module kernel-network-modules 1 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _mod=kernel-network-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all = all ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + module_check kernel-network-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 1 -eq 2 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + is_func check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check -h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _ret=255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + ret=255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ 255 != 0 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 1 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _mod=90livenet Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _mod=livenet Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check_module livenet 1 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _mod=livenet Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all = all ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + module_check livenet Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 1 -eq 2 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + is_func check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check -h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _ret=255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + ret=255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ 255 != 0 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 1 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _mod=90lvm Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _mod=lvm Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check_module lvm 1 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _mod=lvm Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all = all ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + module_check lvm Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 1 -eq 2 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + is_func check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check -h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + require_binaries lvm Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _module_name=90lvm Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ lvm = \-\m ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for cmd in "$@" Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + find_binary lvm Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n -h ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for fs in "${host_fs_types[@]}" Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ nfs = LVM*_member ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _ret=255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + ret=255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ 255 != 0 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 1 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _mod=90mdraid Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _mod=mdraid Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check_module mdraid 1 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _mod=mdraid Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all = all ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + module_check mdraid Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 1 -eq 2 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + is_func check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check -h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _rootdev Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + require_binaries mdadm expr Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _module_name=90mdraid Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ mdadm = \-\m ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for cmd in "$@" Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + find_binary mdadm Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for cmd in "$@" Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + find_binary expr Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n -h ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for dev in "${!host_fs_types[@]}" Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ nfs != *_raid_member ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + continue Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _ret=255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + ret=255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ 255 != 0 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 1 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _mod=90multipath Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _mod=multipath Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check_module multipath 1 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _mod=multipath Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all = all ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + module_check multipath Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 1 -eq 2 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + is_func check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check -h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _rootdev Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n -h ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for_each_host_dev_and_slaves is_mpath Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _func=is_mpath Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _dev Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for _dev in "${host_devs[@]}" Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + continue Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 1 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _ret=255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + ret=255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ 255 != 0 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 1 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _mod=90qemu Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _mod=qemu Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check_module qemu 1 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _mod=qemu Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all = all ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + module_check qemu Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 1 -eq 2 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + is_func check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check -h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n -h ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + type -P systemd-detect-virt Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ systemd-detect-virt --vm Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + vm=none Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + (( 1 != 0 )) Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _ret=255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + ret=255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ 255 != 0 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 1 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _mod=90qemu-net Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _mod=qemu-net Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check_module qemu-net 1 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _mod=qemu-net Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all = all ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + module_check qemu-net Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 1 -eq 2 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + is_func check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check -h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n -h ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + type -P systemd-detect-virt Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ systemd-detect-virt --vm Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + vm= Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + (( 1 != 0 )) Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _ret=255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + ret=255 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ 255 != 0 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + return 1 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _mod=90stratis Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + _mod=stratis Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check_module stratis 1 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _mod=stratis Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddep Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -n 1 ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ all = all ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + module_check stratis Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ read a b Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _forced=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _hostonly=-h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 1 -eq 2 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + is_func check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: ++ type -t check Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + '[' 0 -ne 0 ']' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + check -h Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _module_name=90stratis Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + local _ret=0 Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + [[ stratisd-init = \-\m ]] Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + for cmd in "$@" Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + find_binary stratisd-init Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 4 22:02:49 kjcf05n02 kdumpctl[7831]: + set +x Nov 4 22:02:49 kjcf05n02 dracut[7957]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 22:02:49 kjcf05n02 dracut[7957]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 4 22:02:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730779369', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(0.0B/0.0B), ib1=(0.0B/0.0B), icl0=(4.1kB/5.5kB), lo=(400.0B/400.0B), meth0=(1540.8MB/7.4MB), mgmt0=(1477.7MB/7.4MB)'}"] Nov 4 22:02:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730779368', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 4 22:02:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(0.0B/0.0B), ib1=(0.0B/0.0B), icl0=(4.1kB/5.5kB), lo=(400.0B/400.0B), meth0=(1540.8MB/7.4MB), mgmt0=(1477.7MB/7.4MB)', 'message': 'NET OK - (Rx/Tx) ib0=(0.0B/0.0B), ib1=(0.0B/0.0B), icl0=(4.1kB/5.5kB), lo=(400.0B/400.0B), meth0=(1540.8MB/7.4MB), mgmt0=(1477.7MB/7.4MB)', 'value': 'ok', 'timestamp': '1730779369'} Nov 4 22:02:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730779368'} Nov 4 22:02:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:02:49 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 22:02:49 kjcf05n02 dracut[7957]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 4 22:02:49 kjcf05n02 dracut[7957]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 4 22:02:49 kjcf05n02 dracut[7957]: memstrack is available Nov 4 22:02:49 kjcf05n02 dracut[7957]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 22:02:50 kjcf05n02 dracut[7957]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 22:02:50 kjcf05n02 dracut[7957]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 22:02:50 kjcf05n02 dracut[7957]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 22:02:50 kjcf05n02 dracut[7957]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 22:02:50 kjcf05n02 dracut[7957]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 22:02:50 kjcf05n02 dracut[7957]: *** Including module: bash *** Nov 4 22:02:50 kjcf05n02 dracut[7957]: *** Including module: systemd *** Nov 4 22:02:50 kjcf05n02 dracut[7957]: *** Including module: fips *** Nov 4 22:02:51 kjcf05n02 dracut[7957]: *** Including module: systemd-initrd *** Nov 4 22:02:51 kjcf05n02 dracut[7957]: *** Including module: watchdog-modules *** Nov 4 22:02:51 kjcf05n02 dracut[7957]: *** Including module: nss-softokn *** Nov 4 22:02:51 kjcf05n02 dracut[7957]: *** Including module: i18n *** Nov 4 22:02:51 kjcf05n02 dracut[7957]: No KEYMAP configured. Nov 4 22:02:51 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 4 22:02:52 kjcf05n02 dracut[7957]: *** Including module: network-legacy *** Nov 4 22:02:52 kjcf05n02 dracut[7957]: *** Including module: network *** Nov 4 22:02:52 kjcf05n02 dracut[7957]: *** Including module: ib_bonding *** Nov 4 22:02:52 kjcf05n02 dracut[7957]: *** Including module: drm *** Nov 4 22:02:52 kjcf05n00 zabbix-server[2487287]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:02:52 kjcf05n00 zabbix-server[2487287]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:42\\"}}"' Nov 4 22:02:52 kjcf05n00 log_interesting_event.py[2487287]: Event '46732' acknowledged Nov 4 22:02:55 kjcf05n02 dcs-collectord[5639]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 22:02:55 kjcf05n02 dcs-collectord[5639]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 22:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 22:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 22:02:55 kjcf05n02 dracut[7957]: *** Including module: hperaid *** Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + install Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + local rule rule_path Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + inst_multiple cat expr Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.IEyxtR/initramfs -a -f cat expr Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + _ret=0 Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + (( 0 != 0 )) Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + : Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + return 0 Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + inst_multiple -o mdmon Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.IEyxtR/initramfs -a -f -o mdmon Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + _ret=0 Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + (( 0 != 0 )) Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + : Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + return 0 Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: ++ command -v partx Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + inst /usr/sbin/partx /sbin/partx Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + local _hostonly_install Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + [[ /usr/sbin/partx == \-\H ]] Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + [[ -e /tmp/dracut.IEyxtR/initramfs//sbin/partx ]] Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.IEyxtR/initramfs -f /usr/sbin/partx /sbin/partx Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + (( 0 != 0 )) Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + : Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: ++ command -v mdadm Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + local _hostonly_install Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + [[ -e /tmp/dracut.IEyxtR/initramfs//sbin/mdadm ]] Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.IEyxtR/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + (( 0 != 0 )) Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + : Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + [[ yes == \y\e\s ]] Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + local _raidconf Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: ++ cmdline Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: ++ local _activated dev line UUID Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: ++ declare -A _activated Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: ++ for dev in "${!host_fs_types[@]}" Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: ++ [[ nfs != *_raid_member ]] Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: ++ continue Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + _raidconf= Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + [[ -n '' ]] Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + inst_rules 64-md-raid.rules Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + local _target=/etc/udev/rules.d _rule _found Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + inst_dir /usr/lib/udev/rules.d Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + [[ -e /tmp/dracut.IEyxtR/initramfs//usr/lib/udev/rules.d ]] Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + return 0 Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + inst_dir /etc/udev/rules.d Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + [[ -e /tmp/dracut.IEyxtR/initramfs//etc/udev/rules.d ]] Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + return 0 Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + for _rule in "$@" Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + continue Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + continue Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + for r in '' $dracutbasedir/rules.d/ Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + [[ 64-md-raid.rules != /* ]] Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + continue Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + for r in '' $dracutbasedir/rules.d/ Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + continue Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + [[ -n '' ]] Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 4 22:02:55 kjcf05n02 kdumpctl[7831]: + set +x Nov 4 22:02:55 kjcf05n02 dracut[7957]: Skipping udev rule: 64-md-raid.rules Nov 4 22:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 22:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 22:02:55 kjcf05n00 zabbix-server[2487288]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:02:55 kjcf05n00 zabbix-server[2487288]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 4 22:02:56 kjcf05n00 log_interesting_event.py[2487288]: Event '46734' acknowledged Nov 4 22:02:56 kjcf05n00 zabbix-server[2487290]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + installkernel Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + instmods =drivers/md Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + local _optional=-o Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + local _silent Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + local _ret Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + [[ '' = yes ]] Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + [[ =drivers/md = \-\c ]] Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + [[ =drivers/md = \-\s ]] Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + (( 1 == 0 )) Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.IEyxtR/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + _ret=0 Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + (( 0 != 0 )) Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + [[ -n '' ]] Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + return 0 Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + _ret=0 Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + unset check depends cmdline install installkernel Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + return 0 Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + modules_loaded+='hperaid ' Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + '[' -n '' ']' Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + _d_mod=90kernel-modules Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + _d_mod=kernel-modules Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + [[ '' = yes ]] Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + dinfo '*** Including module: kernel-modules ***' Nov 4 22:02:56 kjcf05n02 kdumpctl[7831]: + set +x Nov 4 22:02:56 kjcf05n02 dracut[7957]: *** Including module: kernel-modules *** Nov 4 22:02:56 kjcf05n02 dracut[7957]: *** Including module: kernel-modules-extra *** Nov 4 22:02:56 kjcf05n00 zabbix-server[2487290]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 4 22:02:56 kjcf05n00 log_interesting_event.py[2487290]: Event '46735' acknowledged Nov 4 22:02:57 kjcf05n02 dracut[7957]: *** Including module: kernel-network-modules *** Nov 4 22:02:57 kjcf05n02 dracut[7957]: *** Including module: diskless-mod *** Nov 4 22:02:57 kjcf05n02 dracut[7957]: *** Including module: fstab-sys *** Nov 4 22:02:57 kjcf05n02 dracut[7957]: *** Including module: nfs *** Nov 4 22:02:57 kjcf05n02 dracut[7957]: *** Including module: rootfs-block *** Nov 4 22:02:57 kjcf05n02 dracut[7957]: *** Including module: terminfo *** Nov 4 22:02:57 kjcf05n02 dracut[7957]: *** Including module: udev-rules *** Nov 4 22:02:58 kjcf05n02 dracut[7957]: Skipping udev rule: 91-permissions.rules Nov 4 22:02:58 kjcf05n02 dracut[7957]: Skipping udev rule: 80-drivers-modprobe.rules Nov 4 22:02:58 kjcf05n02 dracut[7957]: *** Including module: dracut-systemd *** Nov 4 22:02:58 kjcf05n02 dracut[7957]: *** Including module: usrmount *** Nov 4 22:02:58 kjcf05n02 dracut[7957]: *** Including module: base *** Nov 4 22:02:59 kjcf05n02 dracut[7957]: *** Including module: fs-lib *** Nov 4 22:02:59 kjcf05n02 dracut[7957]: *** Including module: kdumpbase *** Nov 4 22:02:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 22:02:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 22:02:59 kjcf05n02 dracut[7957]: *** Including module: memstrack *** Nov 4 22:02:59 kjcf05n02 dracut[7957]: *** Including module: shutdown *** Nov 4 22:02:59 kjcf05n02 dracut[7957]: *** Including module: squash *** Nov 4 22:03:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 22:03:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 22:03:00 kjcf05n02 dracut[7957]: *** Including modules done *** Nov 4 22:03:00 kjcf05n02 dracut[7957]: *** Installing kernel module dependencies *** Nov 4 22:03:00 kjcf05n02 dracut[7957]: *** Installing kernel module dependencies done *** Nov 4 22:03:00 kjcf05n02 dracut[7957]: *** Resolving executable dependencies *** Nov 4 22:03:01 kjcf05n02 dracut[7957]: *** Resolving executable dependencies done*** Nov 4 22:03:01 kjcf05n02 dracut[7957]: *** Hardlinking files *** Nov 4 22:03:01 kjcf05n02 dracut[7957]: *** Hardlinking files done *** Nov 4 22:03:01 kjcf05n02 dracut[7957]: *** Generating early-microcode cpio image *** Nov 4 22:03:01 kjcf05n02 dracut[7957]: *** Constructing AuthenticAMD.bin **** Nov 4 22:03:01 kjcf05n02 dracut[7957]: *** Store current command line parameters *** Nov 4 22:03:01 kjcf05n02 dracut[7957]: Stored kernel commandline: Nov 4 22:03:01 kjcf05n02 dracut[7957]: rd.driver.pre=sd_mod Nov 4 22:03:01 kjcf05n02 dracut[7957]: rd.driver.pre=nvme Nov 4 22:03:01 kjcf05n02 dracut[7957]: rd.driver.pre=ipmi_si Nov 4 22:03:01 kjcf05n02 dracut[7957]: rd.driver.pre=ipmi_devintf Nov 4 22:03:01 kjcf05n02 dracut[7957]: rd.driver.pre=ipmi_msghandler Nov 4 22:03:01 kjcf05n02 dracut[7957]: nameserver=172.16.2.2 Nov 4 22:03:01 kjcf05n02 dracut[7957]: nameserver=127.0.0.1 Nov 4 22:03:01 kjcf05n02 dracut[7957]: nameserver=172.16.2.2 Nov 4 22:03:01 kjcf05n02 dracut[7957]: nameserver=127.0.0.1 Nov 4 22:03:01 kjcf05n02 dracut[7957]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 4 22:03:01 kjcf05n02 dracut[7957]: rd.neednet Nov 4 22:03:01 kjcf05n02 dracut[7957]: kdumpnic=mgmt0 Nov 4 22:03:01 kjcf05n02 dracut[7957]: bootdev=mgmt0 Nov 4 22:03:01 kjcf05n02 dracut[7957]: *** Install squash loader *** Nov 4 22:03:02 kjcf05n02 dracut[7957]: *** Squashing the files inside the initramfs *** Nov 4 22:03:02 kjcf05n02 dracut[7957]: *** Squashing the files inside the initramfs done *** Nov 4 22:03:02 kjcf05n02 dracut[7957]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 4 22:03:02 kjcf05n02 dracut[7957]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 4 22:03:03 kjcf05n02 kdumpctl[7831]: kdump: kexec: loaded kdump kernel Nov 4 22:03:03 kjcf05n02 kdumpctl[7831]: kdump: Starting kdump: [OK] Nov 4 22:03:03 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 4 22:03:03 kjcf05n02 systemd[1]: Reloading. Nov 4 22:03:03 kjcf05n02 systemd[3142]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:03:03 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:03:03 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:03:03 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 4 22:03:03 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 4 22:03:03 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 4 22:03:03 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 4 22:03:03 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 4 22:03:03 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 4 22:03:03 kjcf05n02 ifdown[14555]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 22:03:03 kjcf05n02 ifdown[14556]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:03:03 kjcf05n02 ifdown[14557]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:03:04 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 22:03:04 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 22:03:04 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 22:03:04 kjcf05n02 ifup[14630]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 22:03:04 kjcf05n02 ifup[14631]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:03:04 kjcf05n02 ifup[14632]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730779385', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.92, 1.87, 0.83'}"] Nov 4 22:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 1.92, 1.87, 0.83', 'message': 'OK - load average: 1.92, 1.87, 0.83', 'value': 'ok', 'timestamp': '1730779385'} Nov 4 22:03:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:03:07 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 4 22:03:08 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 22:03:08 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 22:03:08 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 22:03:08 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:03:08 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:03:08 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:03:08 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:03:08 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 22:03:08 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 22:03:08 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 22:03:08 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 22:03:08 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:03:08 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:03:08 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:03:08 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:03:08 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 4 22:03:08 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 4 22:03:08 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 4 22:03:08 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 4 22:03:08 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 4 22:03:08 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 4 22:03:08 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 4 22:03:08 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 4 22:03:08 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 4 22:03:08 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 4 22:03:08 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 4 22:03:08 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 4 22:03:08 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 4 22:03:08 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 4 22:03:08 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 4 22:03:08 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 4 22:03:08 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 4 22:03:08 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 4 22:03:08 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 4 22:03:08 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 4 22:03:08 kjcf05n02 ifdown[14814]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 22:03:08 kjcf05n02 ifdown[14815]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:03:08 kjcf05n02 ifdown[14816]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:03:09 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 22:03:09 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 22:03:09 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 22:03:09 kjcf05n02 ifup[14886]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 22:03:09 kjcf05n02 ifup[14889]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:03:09 kjcf05n02 ifup[14890]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:03:09 kjcf05n00 mcfcli[3673891]: %3|1730779389.385|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:03:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730779389', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 329 processes with STATE = RSZDT '}"] Nov 4 22:03:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 329 processes with STATE = RSZDT ', 'message': 'PROCS OK: 329 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730779389'} Nov 4 22:03:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:03:10 kjcf05n02 dcs-collectord[5639]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 22:03:10 kjcf05n02 dcs-collectord[5639]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 22:03:11 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 4 22:03:13 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 22:03:13 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 22:03:13 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 22:03:13 kjcf05n02 systemd[1]: Reloading. Nov 4 22:03:14 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 4 22:03:14 kjcf05n02 await_ha_peer[15091]: Waiting for HA peer kjcf05n03 Nov 4 22:03:15 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 4 22:03:15 kjcf05n02 await_ha_peer[15091]: Peer kjcf05n03 has started, starting HA Nov 4 22:03:15 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 4 22:03:15 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 4 22:03:15 kjcf05n02 fstonithd.py[15145]: Listening for kdump packets from partner Nov 4 22:03:15 kjcf05n02 systemd[1]: Reloading. Nov 4 22:03:16 kjcf05n02 systemd[3142]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:03:16 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:03:16 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:03:16 kjcf05n02 systemd[1]: Reloading. Nov 4 22:03:16 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 4 22:03:16 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 4 22:03:16 kjcf05n02 systemd[1]: Reloading. Nov 4 22:03:17 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 22:03:17 kjcf05n02 puppet-agent[3565]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:03:17 kjcf05n02 puppet[3565]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:03:17 kjcf05n02 puppet-agent[3565]: Applied catalog in 91.97 seconds Nov 4 22:03:17 kjcf05n02 puppet[3565]: Notice: Applied catalog in 91.97 seconds Nov 4 22:03:17 kjcf05n02 systemd[1]: Started Puppet agent. Nov 4 22:03:17 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 4 22:03:17 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 4 22:03:17 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 4 22:03:17 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 4 22:03:17 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 4 22:03:17 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 4 22:03:17 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 4 22:03:17 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 22:03:17 kjcf05n02 systemd[1]: Reached target Timers. Nov 4 22:03:17 kjcf05n02 wce-disable.sh[15284]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 4 22:03:17 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 4 22:03:17 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 4 22:03:17 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 22:03:17 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 22:03:17 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 4 22:03:17 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 4 22:03:17 kjcf05n02 gateway-ec-node.py[15288]: Starting gateway-ec-node service Nov 4 22:03:17 kjcf05n02 python3.9[15287]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 4 22:03:17 kjcf05n02 python3.9[15287]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 4 22:03:17 kjcf05n02 RFSF-API[15286]: INFO[2024-11-04T22:03:17-06:00] Datapath API RESTful Service starting Nov 4 22:03:17 kjcf05n02 dp-api-server-node[15286]: INFO[2024-11-04T22:03:17-06:00] Datapath API RESTful Service starting Nov 4 22:03:17 kjcf05n02 RFSF-API[15286]: INFO[2024-11-04T22:03:17-06:00] Running in production mode, starting dbus event listener Nov 4 22:03:17 kjcf05n02 dp-api-server-node[15286]: INFO[2024-11-04T22:03:17-06:00] Running in production mode, starting dbus event listener Nov 4 22:03:17 kjcf05n02 RFSF-API[15286]: INFO[2024-11-04T22:03:17-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 22:03:17 kjcf05n02 dp-api-server-node[15286]: INFO[2024-11-04T22:03:17-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 22:03:17 kjcf05n02 RFSF-API[15286]: INFO[2024-11-04T22:03:17-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 22:03:17 kjcf05n02 dp-api-server-node[15286]: INFO[2024-11-04T22:03:17-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 22:03:17 kjcf05n02 RFSF-API[15286]: INFO[2024-11-04T22:03:17-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 22:03:17 kjcf05n02 dp-api-server-node[15286]: INFO[2024-11-04T22:03:17-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 22:03:17 kjcf05n02 RFSF-API[15286]: INFO[2024-11-04T22:03:17-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 22:03:17 kjcf05n02 dp-api-server-node[15286]: INFO[2024-11-04T22:03:17-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 22:03:17 kjcf05n02 RFSF-API[15286]: INFO[2024-11-04T22:03:17-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 22:03:17 kjcf05n02 dp-api-server-node[15286]: INFO[2024-11-04T22:03:17-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 22:03:17 kjcf05n02 RFSF-API[15286]: INFO[2024-11-04T22:03:17-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 22:03:17 kjcf05n02 dp-api-server-node[15286]: INFO[2024-11-04T22:03:17-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 22:03:17 kjcf05n02 RFSF-API[15286]: INFO[2024-11-04T22:03:17-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 22:03:17 kjcf05n02 dp-api-server-node[15286]: INFO[2024-11-04T22:03:17-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 22:03:17 kjcf05n02 RFSF-API[15286]: INFO[2024-11-04T22:03:17-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 22:03:17 kjcf05n02 dp-api-server-node[15286]: INFO[2024-11-04T22:03:17-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 22:03:17 kjcf05n02 RFSF-API[15286]: INFO[2024-11-04T22:03:17-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 22:03:17 kjcf05n02 dp-api-server-node[15286]: INFO[2024-11-04T22:03:17-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 22:03:17 kjcf05n02 RFSF-API[15286]: INFO[2024-11-04T22:03:17-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 22:03:17 kjcf05n02 dp-api-server-node[15286]: INFO[2024-11-04T22:03:17-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 22:03:19 kjcf05n00 mcfcli[3673891]: %3|1730779399.145|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730779399', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.5% (3881296 kB) used.'}"] Nov 4 22:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.5% (3881296 kB) used.', 'message': 'OK - 1.5% (3881296 kB) used.', 'value': 'ok', 'timestamp': '1730779399'} Nov 4 22:03:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:03:23 kjcf05n02 systemd[1]: Reloading. Nov 4 22:03:24 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 22:03:24 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 4 22:03:24 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 4 22:03:24 kjcf05n02 diskmonitor_pre[15817]: Key management is currently disabled.DEAR disabled Nov 4 22:03:24 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 4 22:03:25 kjcf05n02 dcs-collectord[5639]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 22:03:25 kjcf05n02 dcs-collectord[5639]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 22:03:25 kjcf05n02 dcs-collectord[5639]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 22:03:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730779405', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 4 22:03:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730779405'} Nov 4 22:03:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:03:26 kjcf05n02 sh[15814]: LNET configured: New Created Nov 4 22:03:26 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 17876 (bash) Nov 4 22:03:26 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 4 22:03:26 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 4 22:03:26 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 4 22:03:26 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 4 22:03:26 kjcf05n02 LCNmon[17900]: Interface ib0 is up Nov 4 22:03:26 kjcf05n02 LCNmon[17900]: Interface ib1 is up Nov 4 22:03:26 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 4 22:03:26 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 4 22:03:26 kjcf05n02 LCNmon[17900]: Can ping through interface ib0 Nov 4 22:03:26 kjcf05n02 LCNmon[17900]: Can ping through interface ib1 Nov 4 22:03:26 kjcf05n02 LCNmon[17900]: NIC ib0, initial state UP Nov 4 22:03:26 kjcf05n02 LCNmon[17900]: NIC ib1, initial state UP Nov 4 22:03:26 kjcf05n02 LCNmon[17900]: LCNstat initial state UP Nov 4 22:03:26 kjcf05n02 LCNmon[17900]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 4 22:03:26 kjcf05n00 httpd[1812025]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 4 22:03:27 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 4 22:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T22:03:27.267696026-06:00 level=info msg="Completed cleanup jobs" duration=41.133923ms Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: /var/run/diskmonitor does not exist, creating Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: Creating /var/run/diskmonitor/disk Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: Creating /var/run/diskmonitor/encl Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: Creating /var/run/diskmonitor/cli Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: RAS_Interlocks_enabled: 1 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: Using default ssd ids: HUSSL4010ASS600 , Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: add handler for sig: 14 sa_flags: 10000004 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: add handler for sig: 1 sa_flags: 10000004 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: add handler for sig: 2 sa_flags: 00000004 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: add handler for sig: 15 sa_flags: 00000004 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: add handler for sig: 6 sa_flags: 00000004 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: add handler for sig: 3 sa_flags: 00000004 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: add handler for sig: 30 sa_flags: 00000004 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: add handler for sig: 20 sa_flags: 00000004 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: add handler for sig: 10 sa_flags: 10000004 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: add handler for sig: 11 sa_flags: 00000004 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: add handler for sig: 7 sa_flags: 00000004 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: add handler for sig: 4 sa_flags: 00000004 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: add handler for sig: 8 sa_flags: 00000004 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: init_watch: /var/run/diskmonitor/encl initialized Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: init_watch: /var/run/diskmonitor/disk initialized Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: Using HA Baton locks - key: diskmonitor Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: Baton will be held for at most 570 seconds Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: DMMP Enabled: 0 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: random seed: 62a6d233 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: NVMe Enclosure: 1 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: ZFS Enclosure: 0 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: Dbus, Initialized Connection Successfully Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: int_catcher_thread: thread start Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: Received dbus message 4 org.freedesktop.DBus -> :1.93 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 4 22:03:28 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 22:03:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730779409', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 4 22:03:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730779409'} Nov 4 22:03:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:03:29 kjcf05n02 openhpid[5545]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 4 22:03:29 kjcf05n02 openhpid[5545]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 4 22:03:30 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 4 22:03:30 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 4 22:03:30 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 22:03:30 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18405 which is not our child. We'll most likely not notice when it exits. Nov 4 22:03:30 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 22:03:30 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 4 22:03:30 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 4 22:03:30 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 4 22:03:30 kjcf05n02 dcs-collectord[5639]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 4 22:03:30 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 4 22:03:30 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 4 22:03:30 kjcf05n02 systemd[1]: Startup finished in 50.506s (kernel) + 2min 29.871s (userspace) = 3min 20.378s. Nov 4 22:03:30 kjcf05n02 openhpid[18405]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 22:03:30 kjcf05n02 openhpid[18405]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 22:03:30 kjcf05n02 openhpid[18405]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 22:03:30 kjcf05n02 openhpid[18405]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 4 22:03:34 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 4 22:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730779416', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 4 22:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730779416', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 4 22:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730779416'} Nov 4 22:03:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730779416'} Nov 4 22:03:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:03:40 kjcf05n02 dcs-collectord[5639]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 22:03:40 kjcf05n02 dcs-collectord[5639]: WARNING No data collected (hpi_parser.py:353) Nov 4 22:03:49 kjcf05n00 mcfcli[3673891]: %3|1730779429.145|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:03:49 kjcf05n00 mcfcli[3673891]: %3|1730779429.382|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:03:54 kjcf05n02 ipmievd[3981]: System Event sensor - Timestamp Clock Sync Nov 4 22:03:55 kjcf05n02 ipmievd[3142]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:03:55 kjcf05n02 dcs-collectord[5639]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 4 22:04:07 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 4 22:04:10 kjcf05n02 dcs-collectord[5639]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 22:04:15 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db01026002538450000000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 22:04:15 kjcf05n02 ras-resource-manager-agent[5903]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "056a73a6-9b2b-11ef-8155-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 4 22:04:15 kjcf05n02 ras-resource-manager-agent[5903]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '056a73a6-9b2b-11ef-8155-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 4 22:04:15 kjcf05n02 ras-resource-manager-agent[5903]: INFO Submitting new device inserted signal, starting to qualify drive: 056a73a6-9b2b-11ef-8155-00093d0695e3 (admin_action.py:110) Nov 4 22:04:15 kjcf05n03 firmware-update-orc-server[5841]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "6124986b-35cb-49de-b4a1-f4954a959aeb"} (logger.py:65) Nov 4 22:04:15 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 140612 (get_disk_device) Nov 4 22:04:15 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 4 22:04:15 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 4 22:04:15 kjcf05n03 ccp-client[140649]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 22:04:14 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '056a73a6-9b2b-11ef-8155-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 22:04:14 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '056a73a6-9b2b-11ef-8155-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 22:04:14 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '056a73a6-9b2b-11ef-8155-00093d0695e3', 'response ID': '05749e6c-9b2b-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 22:04:14 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 05749e6c-9b2b-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 22:04:15 kjcf05n03 ccp-client[140649]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 22:04:15 kjcf05n03 ccp-client[140658]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 22:04:15 kjcf05n03 ccp-client[140649]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 22:04:15 kjcf05n03 ccp-client[140649]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 22:04:15 kjcf05n03 ccp-client[140658]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 22:04:15 kjcf05n03 ccp-client[140658]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 22:04:15 kjcf05n02 diskmonitor[17465]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 22:04:15 kjcf05n02 ras-resource-manager-agent[5903]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "05bba67c-9b2b-11ef-8155-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 4 22:04:15 kjcf05n02 ras-resource-manager-agent[5903]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '05bba67c-9b2b-11ef-8155-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 4 22:04:15 kjcf05n02 ras-resource-manager-agent[5903]: INFO Submitting new device inserted signal, starting to qualify drive: 05bba67c-9b2b-11ef-8155-00093d0695e3 (admin_action.py:110) Nov 4 22:04:15 kjcf05n02 firmware-update-orc-server[5861]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "70de27ba-84e8-4b24-87ee-4129289c9141"} (logger.py:65) Nov 4 22:04:15 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '05bba67c-9b2b-11ef-8155-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 22:04:15 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '05bba67c-9b2b-11ef-8155-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 22:04:15 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '05bba67c-9b2b-11ef-8155-00093d0695e3', 'response ID': '05c29590-9b2b-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 22:04:15 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 05c29590-9b2b-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 22:04:18 kjcf05n03 DRVFW[140770]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 22:04:18 kjcf05n03 ccp-client[140771]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 22:04:18 kjcf05n03 ccp-client[140771]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 22:04:18 kjcf05n03 ccp-client[140780]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 22:04:18 kjcf05n03 ccp-client[140771]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 22:04:18 kjcf05n03 ccp-client[140771]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 22:04:18 kjcf05n03 ccp-client[140780]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 22:04:18 kjcf05n03 ccp-client[140780]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 22:04:18 kjcf05n03 firmware-update-orc-server[5841]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 4 22:04:19 kjcf05n02 ras-resource-manager-agent[5903]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '056a73a6-9b2b-11ef-8155-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 4 22:04:19 kjcf05n02 ras-resource-manager-agent[5903]: INFO Drive qualification complete responding: 056a73a6-9b2b-11ef-8155-00093d0695e3 (admin_action.py:205) Nov 4 22:04:19 kjcf05n02 ras-resource-manager-agent[5903]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "056a73a6-9b2b-11ef-8155-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (interesting_event.py:59) Nov 4 22:04:18 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 05749e6c-9b2b-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 22:04:18 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '056a73a6-9b2b-11ef-8155-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '056a73a6-9b2b-11ef-8155-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}}} (logger.py:65) Nov 4 22:04:19 kjcf05n00 mcfcli[3673891]: %3|1730779459.146|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 22:04:22 kjcf05n02 diskmonitor[17465]: 4 Nov 4 22:04:22 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 4 22:04:22 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 4 22:04:22 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 4 22:04:22 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 4 22:04:22 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 4 22:04:22 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 4 22:04:22 kjcf05n02 diskmonitor[17465]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 4 22:04:22 kjcf05n02 diskmonitor[17465]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 4 22:04:22 kjcf05n02 diskmonitor[17465]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 4 22:04:22 kjcf05n02 diskmonitor[17465]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 22:04:22 kjcf05n02 diskmonitor[17465]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 4 22:04:22 kjcf05n02 diskmonitor[17465]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "056a73a6-9b2b-11ef-8155-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 4 22:04:22 kjcf05n02 diskmonitor[17465]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 22:04:22 kjcf05n02 diskmonitor[17465]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 4 22:04:22 kjcf05n02 diskmonitor[17465]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "05bba67c-9b2b-11ef-8155-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 4 22:04:22 kjcf05n02 diskmonitor[17465]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 22:04:22 kjcf05n02 diskmonitor[17465]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 22:04:25 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22323 (get_disk_device) Nov 4 22:04:25 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 4 22:04:25 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 4 22:04:26 kjcf05n02 ccp-client[22344]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 22:04:26 kjcf05n02 ccp-client[22344]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 22:04:26 kjcf05n02 ccp-client[22353]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 22:04:26 kjcf05n02 ccp-client[22344]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 22:04:26 kjcf05n02 ccp-client[22344]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 22:04:26 kjcf05n02 ccp-client[22353]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 22:04:26 kjcf05n02 ccp-client[22353]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 22:04:27 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 4 22:04:27 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 4 22:04:27 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 4 22:04:27 kjcf05n02 chronyd[5147]: Selected source 172.16.2.1 Nov 4 22:04:28 kjcf05n00 mcfcli[3673891]: %3|1730779468.331|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:04:29 kjcf05n02 DRVFW[22502]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 22:04:29 kjcf05n02 ccp-client[22503]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 22:04:29 kjcf05n02 ccp-client[22503]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 22:04:29 kjcf05n02 ccp-client[22524]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 22:04:29 kjcf05n02 ccp-client[22503]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 22:04:29 kjcf05n02 ccp-client[22503]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 22:04:29 kjcf05n02 ccp-client[22524]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 22:04:29 kjcf05n02 ccp-client[22524]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 22:04:29 kjcf05n02 firmware-update-orc-server[5861]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 4 22:04:29 kjcf05n02 ras-resource-manager-agent[5903]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "056a73a6-9b2b-11ef-8155-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (service_main_handler.py:66) Nov 4 22:04:29 kjcf05n02 ras-resource-manager-agent[5903]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '056a73a6-9b2b-11ef-8155-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 4 22:04:29 kjcf05n02 ras-resource-manager-agent[5903]: INFO Device qualification response has been acknowledged: 056a73a6-9b2b-11ef-8155-00093d0695e3 (admin_action.py:151) Nov 4 22:04:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730779469}"] Nov 4 22:04:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730779469, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:04:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:04:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730779469}"] Nov 4 22:04:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730779469, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:04:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:04:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730779470}"] Nov 4 22:04:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730779470, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:04:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:04:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730779470}"] Nov 4 22:04:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730779470, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:04:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:04:30 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 05c29590-9b2b-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 22:04:30 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '05bba67c-9b2b-11ef-8155-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '05bba67c-9b2b-11ef-8155-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}}} (logger.py:65) Nov 4 22:04:30 kjcf05n02 ras-resource-manager-agent[5903]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '05bba67c-9b2b-11ef-8155-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}} (resource_admin.py:98) Nov 4 22:04:30 kjcf05n02 ras-resource-manager-agent[5903]: INFO Drive qualification complete responding: 05bba67c-9b2b-11ef-8155-00093d0695e3 (admin_action.py:205) Nov 4 22:04:30 kjcf05n02 ras-resource-manager-agent[5903]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "05bba67c-9b2b-11ef-8155-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (interesting_event.py:59) Nov 4 22:04:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730779470}"] Nov 4 22:04:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730779470, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:04:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:04:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730779470}"] Nov 4 22:04:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730779470, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:04:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:04:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730779470}"] Nov 4 22:04:30 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730779470, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:04:30 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:04:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730779470}"] Nov 4 22:04:31 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730779470, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:04:31 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:04:33 kjcf05n02 diskmonitor[17465]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 22:04:34 kjcf05n02 python3.9[5209]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 4 22:04:34 kjcf05n02 python3.9[3142]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:04:34 kjcf05n02 diskmonitor[17465]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 22:04:34 kjcf05n02 ras-resource-manager-agent[5903]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "10c1d262-9b2b-11ef-8155-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 4 22:04:34 kjcf05n02 ras-resource-manager-agent[5903]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '10c1d262-9b2b-11ef-8155-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 4 22:04:34 kjcf05n02 ras-resource-manager-agent[5903]: INFO Requests ['05bba67c-9b2b-11ef-8155-00093d0695e3', '10c1d262-9b2b-11ef-8155-00093d0695e3'] already in progress (admin_action.py:99) Nov 4 22:04:34 kjcf05n02 ras-resource-manager-agent[5903]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '10c1d262-9b2b-11ef-8155-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}} (resource_admin.py:98) Nov 4 22:04:34 kjcf05n02 ras-resource-manager-agent[5903]: INFO Drive qualification complete responding: 10c1d262-9b2b-11ef-8155-00093d0695e3 (admin_action.py:205) Nov 4 22:04:34 kjcf05n02 ras-resource-manager-agent[5903]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "05bba67c-9b2b-11ef-8155-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (interesting_event.py:59) Nov 4 22:04:34 kjcf05n02 ras-resource-manager-agent[5903]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "10c1d262-9b2b-11ef-8155-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (interesting_event.py:59) Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "056a73a6-9b2b-11ef-8155-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: Dbus, handle_ingress_ras_signals, uuid: 056a73a6-9b2b-11ef-8155-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "056a73a6-9b2b-11ef-8155-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: main: Pending firmware leveling requests exist, rescanning disks Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "10c1d262-9b2b-11ef-8155-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: leaving test state: 1 next state: 2 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: lock req: no timeout Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: leaving test state: 2 next state: 4 Nov 4 22:04:38 kjcf05n02 diskmonitor[17465]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 22:04:43 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31472 deleted. Nov 4 22:04:43 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31473 deleted. Nov 4 22:04:49 kjcf05n00 mcfcli[3673891]: %3|1730779489.146|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:05:08 kjcf05n00 mcfcli[3673891]: %3|1730779508.328|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:05:19 kjcf05n00 mcfcli[3673891]: %3|1730779519.146|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:05:30 kjcf05n02 ras-resource-manager-agent[5903]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "05bba67c-9b2b-11ef-8155-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (service_main_handler.py:66) Nov 4 22:05:30 kjcf05n02 ras-resource-manager-agent[5903]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '05bba67c-9b2b-11ef-8155-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}} (resource_admin.py:98) Nov 4 22:05:30 kjcf05n02 ras-resource-manager-agent[5903]: INFO Device qualification response has been acknowledged: 05bba67c-9b2b-11ef-8155-00093d0695e3 (admin_action.py:151) Nov 4 22:05:30 kjcf05n02 ras-resource-manager-agent[5903]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "05bba67c-9b2b-11ef-8155-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (service_main_handler.py:66) Nov 4 22:05:30 kjcf05n02 ras-resource-manager-agent[5903]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '05bba67c-9b2b-11ef-8155-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}} (resource_admin.py:98) Nov 4 22:05:30 kjcf05n02 ras-resource-manager-agent[5903]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "10c1d262-9b2b-11ef-8155-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (service_main_handler.py:66) Nov 4 22:05:30 kjcf05n02 ras-resource-manager-agent[5903]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '10c1d262-9b2b-11ef-8155-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}} (resource_admin.py:98) Nov 4 22:05:30 kjcf05n02 ras-resource-manager-agent[5903]: INFO Device qualification response has been acknowledged: 10c1d262-9b2b-11ef-8155-00093d0695e3 (admin_action.py:151) Nov 4 22:05:31 kjcf05n02 diskmonitor[17465]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 22:05:35 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 4 22:05:35 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 22:05:35 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 4 22:05:39 kjcf05n00 python3.9[2488813]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 22:05:45 kjcf05n00 mcfcli[3673891]: %3|1730779545.339|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:05:46 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 4 22:05:46 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 22:05:46 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 4 22:05:48 kjcf05n02 diskmonitor[17465]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "05bba67c-9b2b-11ef-8155-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 4 22:05:48 kjcf05n02 diskmonitor[17465]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 4 22:05:48 kjcf05n02 diskmonitor[17465]: Dbus, handle_ingress_ras_signals, uuid: 05bba67c-9b2b-11ef-8155-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 4 22:05:48 kjcf05n02 diskmonitor[17465]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 22:05:48 kjcf05n02 diskmonitor[17465]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "05bba67c-9b2b-11ef-8155-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 4 22:05:48 kjcf05n02 diskmonitor[17465]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "05bba67c-9b2b-11ef-8155-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 4 22:05:48 kjcf05n02 diskmonitor[17465]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 4 22:05:48 kjcf05n02 diskmonitor[17465]: Dbus, handle_ingress_ras_signals, uuid: 05bba67c-9b2b-11ef-8155-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 4 22:05:48 kjcf05n02 diskmonitor[17465]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "05bba67c-9b2b-11ef-8155-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 4 22:05:48 kjcf05n02 diskmonitor[17465]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "10c1d262-9b2b-11ef-8155-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 4 22:05:48 kjcf05n02 diskmonitor[17465]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 4 22:05:48 kjcf05n02 diskmonitor[17465]: Dbus, handle_ingress_ras_signals, uuid: 10c1d262-9b2b-11ef-8155-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 4 22:05:48 kjcf05n02 diskmonitor[17465]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "10c1d262-9b2b-11ef-8155-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 4 22:05:48 kjcf05n02 diskmonitor[17465]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 22:05:48 kjcf05n02 diskmonitor[17465]: lock acquired Nov 4 22:05:48 kjcf05n02 diskmonitor[17465]: leaving test state: 4 next state: 8 Nov 4 22:05:48 kjcf05n02 diskmonitor[17465]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 22:05:49 kjcf05n00 mcfcli[3673891]: %3|1730779549.147|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 22:05:51 kjcf05n02 dcs-collectord[5639]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 4 22:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730779263', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 22:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730779263'} Nov 4 22:05:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730779263', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 22:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730779263'} Nov 4 22:05:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:06:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730779560}"] Nov 4 22:06:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730779560, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:06:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:06:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:06:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:06:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:06:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:06:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:06:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:06:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:06:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:06:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:06:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:06:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:06:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:06:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.319184ms Nov 4 22:06:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:06:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.319184ms Nov 4 22:06:00 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:06:00 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:06:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:06:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730779560}"] Nov 4 22:06:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730779560, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:06:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:06:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:06:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:06:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:06:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:06:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:06:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:06:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:06:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:06:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:06:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:06:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:06:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:06:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.016848ms Nov 4 22:06:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:06:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.016848ms Nov 4 22:06:00 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:06:00 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:06:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:06:01 kjcf05n02 diskmonitor[17465]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 4 22:06:01 kjcf05n02 diskmonitor[17465]: leaving test state: 8 next state: 20 Nov 4 22:06:01 kjcf05n02 diskmonitor[17465]: leaving test state: 20 next state: 40 Nov 4 22:06:01 kjcf05n02 diskmonitor[17465]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 6921ae0000 Nov 4 22:06:01 kjcf05n02 diskmonitor[17465]: leaving test state: 40 next state: 80 Nov 4 22:06:19 kjcf05n00 mcfcli[3673891]: %3|1730779579.147|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:06:24 kjcf05n00 mcfcli[3673891]: %3|1730779584.184|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:06:49 kjcf05n00 mcfcli[3673891]: %3|1730779609.147|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 22:06:59 kjcf05n02 diskmonitor[17465]: leaving test state: 80 next state: 100 Nov 4 22:06:59 kjcf05n02 diskmonitor[17465]: lock release: time: Mon Nov 4 22:06:54 2024 Nov 4 22:06:59 kjcf05n02 diskmonitor[17465]: leaving test state: 100 next state: 1 Nov 4 22:07:03 kjcf05n00 mcfcli[3673891]: %3|1730779623.516|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:07:11 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 4 22:07:19 kjcf05n00 mcfcli[3673891]: %3|1730779639.148|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 22:07:37 kjcf05n00 mcfcli[3673891]: %3|1730779657.783|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:07:49 kjcf05n00 mcfcli[3673891]: %3|1730779669.148|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:08:08 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 22:08:15 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 22:08:15 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 22:08:15 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 22:08:16 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 22:08:16 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 22:08:16 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 22:08:17 kjcf05n00 mcfcli[3673891]: %3|1730779697.172|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:08:19 kjcf05n00 mcfcli[3673891]: %3|1730779699.553|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 22:08:36 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 22:08:36 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 22:08:49 kjcf05n00 mcfcli[3673891]: %3|1730779729.554|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 22:08:57 kjcf05n00 mcfcli[3673891]: %3|1730779737.169|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:09:19 kjcf05n00 mcfcli[3673891]: %3|1730779759.554|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 22:09:27 kjcf05n00 zabbix-server[2491158]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:09:27 kjcf05n00 zabbix-server[2491158]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n02' from event '46751' Nov 4 22:09:27 kjcf05n00 zabbix-server[2491158]: Host created 'enclosure_USE26000024VS001' Nov 4 22:09:27 kjcf05n00 zabbix-server[2491158]: Running puppet on 'kjcf05n02' Nov 4 22:09:29 kjcf05n02 puppet-agent[34782]: Using configured environment 'production' Nov 4 22:09:29 kjcf05n02 puppet-agent[34782]: Retrieving pluginfacts Nov 4 22:09:29 kjcf05n02 puppet-agent[34782]: Retrieving plugin Nov 4 22:09:30 kjcf05n02 puppet-agent[34782]: Loading facts Nov 4 22:09:33 kjcf05n02 puppet-agent[34782]: Caching catalog for kjcf05n02 Nov 4 22:09:33 kjcf05n02 puppet-agent[34782]: Applying configuration version '1730779771' Nov 4 22:09:34 kjcf05n00 mcfcli[3673891]: %3|1730779774.951|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:09:35 kjcf05n02 puppet-agent[34782]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 22:09:35 kjcf05n02 puppet-agent[34782]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 22:09:35 kjcf05n02 puppet-agent[34782]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 22:09:36 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 4 22:09:36 kjcf05n02 zabbix_agent2[5987]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 22:09:36 kjcf05n02 zabbix_agent2[3142]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:09:36 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 22:09:36 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 4 22:09:36 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 22:09:36 kjcf05n02 puppet-agent[34782]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: Press Ctrl+C to exit. Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: Plugin support version 1.0 Nov 4 22:09:36 kjcf05n02 zabbix_agent2[35127]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 22:09:37 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 22:09:40 kjcf05n02 puppet-agent[34782]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 22:09:40 kjcf05n02 puppet-agent[34782]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 22:09:40 kjcf05n02 puppet-agent[34782]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 22:09:40 kjcf05n00 zabbix-server[2491158]: puppet completed status:(0): '' Nov 4 22:09:40 kjcf05n00 zabbix-server[2491158]: Event '46751' acknowledged Nov 4 22:09:40 kjcf05n00 zabbix-server[2491158]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n02"}' Nov 4 22:09:40 kjcf05n02 puppet-agent[34782]: Applied catalog in 7.72 seconds Nov 4 22:09:49 kjcf05n00 mcfcli[3673891]: %3|1730779789.554|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 22:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 22:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 22:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 22:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 22:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 22:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 22:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 22:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 22:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 22:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 22:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 22:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 22:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 22:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 22:10:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 22:10:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:10:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 22:10:05 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 22:10:05 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 22:10:11 kjcf05n00 mcfcli[3673891]: %3|1730779811.596|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:10:19 kjcf05n00 mcfcli[3673891]: %3|1730779819.554|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 22:10:38 kjcf05n00 python3.9[2491702]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 22:10:42 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 22:10:42 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 22:10:42 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 22:10:49 kjcf05n00 mcfcli[3673891]: %3|1730779849.554|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 22:10:51 kjcf05n00 mcfcli[3673891]: %3|1730779851.439|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:10:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730779263', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 22:10:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730779263'} Nov 4 22:10:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:10:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730779263', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 22:10:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730779263'} Nov 4 22:10:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:11:19 kjcf05n00 mcfcli[3673891]: %3|1730779879.554|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:11:30 kjcf05n00 mcfcli[3673891]: %3|1730779890.578|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:11:49 kjcf05n00 mcfcli[3673891]: %3|1730779909.556|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 22:11:57 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 22:11:57 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 22:11:57 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 22:12:08 kjcf05n00 mcfcli[3673891]: %3|1730779928.409|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:12:19 kjcf05n00 mcfcli[3673891]: %3|1730779939.556|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:12:47 kjcf05n00 mcfcli[3673891]: %3|1730779967.265|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:12:49 kjcf05n00 mcfcli[3673891]: %3|1730779969.556|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:13:19 kjcf05n00 mcfcli[3673891]: %3|1730779999.556|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:13:25 kjcf05n00 mcfcli[3673891]: %3|1730780005.374|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T22:13:27.252964265-06:00 level=info msg="Completed cleanup jobs" duration=26.448537ms Nov 4 22:13:49 kjcf05n00 mcfcli[3673891]: %3|1730780029.556|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 22:14:00 kjcf05n02 root[41777]: failback_xyraid Nov 4 22:14:02 kjcf05n02 root[41915]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 4 22:14:02 kjcf05n00 mcfcli[3673891]: %3|1730780042.118|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:14:03 kjcf05n02 root[42057]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 4 22:14:05 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 4 22:14:09 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme2n1 Nov 4 22:14:09 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme25n1 Nov 4 22:14:09 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme4n1 Nov 4 22:14:09 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme18n1 Nov 4 22:14:09 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme17n1 Nov 4 22:14:09 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme19n1 Nov 4 22:14:09 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme24n1 Nov 4 22:14:09 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme23n1 Nov 4 22:14:09 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme9n1 Nov 4 22:14:09 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme8n1 Nov 4 22:14:09 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme3n1 Nov 4 22:14:11 kjcf05n02 dwd[5180]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 4 22:14:11 kjcf05n02 dwd[5180]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 4 22:14:11 kjcf05n02 dwd[5180]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 4 22:14:11 kjcf05n02 dwd[5180]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 4 22:14:11 kjcf05n02 dwd[5180]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 4 22:14:11 kjcf05n02 dwd[5180]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 4 22:14:11 kjcf05n02 dwd[5180]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 4 22:14:11 kjcf05n02 dwd[5180]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 4 22:14:11 kjcf05n02 dwd[5180]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 4 22:14:11 kjcf05n02 dwd[5180]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 4 22:14:11 kjcf05n02 dwd[5180]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 4 22:14:11 kjcf05n02 dwd[5180]: Starting NVME thread for nvme2n1 Nov 4 22:14:11 kjcf05n02 dwd[5180]: Starting NVME thread for nvme18n1 Nov 4 22:14:11 kjcf05n02 dwd[5180]: Starting NVME thread for nvme19n1 Nov 4 22:14:11 kjcf05n02 dwd[5180]: Starting NVME thread for nvme9n1 Nov 4 22:14:12 kjcf05n02 systemd-udevd[45034]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45035]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45036]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45038]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45034]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45035]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45036]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45038]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45034]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45036]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45035]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45038]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45034]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45036]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45038]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45035]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 dwd[5180]: Starting NVME thread for nvme3n1 Nov 4 22:14:12 kjcf05n02 systemd-udevd[45034]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45036]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45038]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45035]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45034]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45036]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45038]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45035]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45059]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45063]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45066]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45067]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45034]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45036]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45035]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45038]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45059]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45066]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45036]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45063]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45034]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45035]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45038]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45059]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45066]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45034]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45034]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45036]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45034]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45066]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45034]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45063]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45059]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45036]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45034]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45066]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45036]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45034]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45036]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45036]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45034]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45036]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45034]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45036]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45034]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45036]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45036]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 systemd-udevd[45036]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:14:12 kjcf05n02 dwd[5180]: Starting NVME thread for nvme24n1 Nov 4 22:14:13 kjcf05n02 dwd[5180]: Starting NVME thread for nvme4n1 Nov 4 22:14:13 kjcf05n02 diskmonitor[17465]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 4 22:14:13 kjcf05n02 dwd[5180]: Starting NVME thread for nvme23n1 Nov 4 22:14:13 kjcf05n02 dwd[5180]: Starting NVME thread for nvme17n1 Nov 4 22:14:13 kjcf05n02 dwd[5180]: Starting NVME thread for nvme25n1 Nov 4 22:14:13 kjcf05n02 dwd[5180]: Starting NVME thread for nvme8n1 Nov 4 22:14:14 kjcf05n03 nslcd[6913]: [45e146] ldap_result() failed: Can't contact LDAP server Nov 4 22:14:14 kjcf05n02 nslcd[7233]: [8b4567] (re)loading /etc/nsswitch.conf Nov 4 22:14:15 kjcf05n02 dcs-bulk-data-sender[6174]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 139}' Nov 4 22:14:19 kjcf05n02 diskmonitor[17465]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 4 22:14:19 kjcf05n02 diskmonitor[17465]: Scan for ReadErrorMax change for md65 Nov 4 22:14:19 kjcf05n02 diskmonitor[17465]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 4 22:14:19 kjcf05n02 diskmonitor[17465]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 4 22:14:19 kjcf05n02 diskmonitor[17465]: read_saved_file: md65 no saved speed Nov 4 22:14:19 kjcf05n02 diskmonitor[17465]: reconstruction_policy: sync_action prev = current = idle - md65 Nov 4 22:14:19 kjcf05n02 diskmonitor[17465]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 22:14:19 kjcf05n00 mcfcli[3673891]: %3|1730780059.556|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 22:14:40 kjcf05n00 mcfcli[3673891]: %3|1730780080.313|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:14:46 kjcf05n03 diskmonitor[17340]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 4 22:14:46 kjcf05n03 diskmonitor[17340]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 22:14:49 kjcf05n00 mcfcli[3673891]: %3|1730780089.557|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:14:53 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47971 (bash) Nov 4 22:14:53 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 4 22:14:53 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 4 22:15:10 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 4 22:15:10 kjcf05n02 systemd-tmpfiles[48825]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 22:15:10 kjcf05n02 systemd-tmpfiles[48825]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 22:15:10 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 4 22:15:10 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 4 22:15:15 kjcf05n00 mcfcli[3673891]: %3|1730780115.369|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:15:19 kjcf05n00 mcfcli[3673891]: %3|1730780119.557|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:15:38 kjcf05n00 python3.9[2494970]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 22:15:49 kjcf05n00 mcfcli[3673891]: %3|1730780149.557|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 22:15:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730780152', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 4 22:15:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730780152'} Nov 4 22:15:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:15:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730780152', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 4 22:15:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730780152'} Nov 4 22:15:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:15:55 kjcf05n00 mcfcli[3673891]: %3|1730780155.188|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:16:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730780160}"] Nov 4 22:16:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730780160, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:16:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.526081ms Nov 4 22:16:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.526081ms Nov 4 22:16:00 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:16:00 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:16:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:16:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730780160}"] Nov 4 22:16:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730780160, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:16:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.845687ms Nov 4 22:16:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.845687ms Nov 4 22:16:00 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:16:00 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:16:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:16:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730780160}"] Nov 4 22:16:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730780160, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:16:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.421155ms Nov 4 22:16:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.421155ms Nov 4 22:16:00 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:16:00 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:16:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:16:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730780160}"] Nov 4 22:16:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730780160, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:16:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.834126ms Nov 4 22:16:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.834126ms Nov 4 22:16:00 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:16:00 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:16:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:16:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730780160}"] Nov 4 22:16:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730780160, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:16:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.123237ms Nov 4 22:16:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.123237ms Nov 4 22:16:01 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:16:01 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:16:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:16:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730780160}"] Nov 4 22:16:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730780160, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:16:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.172499ms Nov 4 22:16:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.172499ms Nov 4 22:16:01 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:16:01 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:16:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:16:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730780160}"] Nov 4 22:16:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730780160, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:16:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.164574ms Nov 4 22:16:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.164574ms Nov 4 22:16:01 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:16:01 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:16:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:16:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730780160}"] Nov 4 22:16:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730780160, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:16:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.989587ms Nov 4 22:16:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.989587ms Nov 4 22:16:01 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:16:01 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:16:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:16:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730780160}"] Nov 4 22:16:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730780160, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:16:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.834055ms Nov 4 22:16:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.834055ms Nov 4 22:16:01 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:16:01 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:16:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:16:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730780160}"] Nov 4 22:16:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730780160, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:16:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.06085ms Nov 4 22:16:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.06085ms Nov 4 22:16:01 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:16:01 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:16:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:16:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730780160}"] Nov 4 22:16:01 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730780160, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:16:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:01-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:16:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:01 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:16:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:01-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:16:01 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:16:01-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:16:01 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:16:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.779924ms Nov 4 22:16:01 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:16:01-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.779924ms Nov 4 22:16:01 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:16:01 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:16:01 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:16:19 kjcf05n00 mcfcli[3673891]: %3|1730780179.557|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 22:16:29 kjcf05n00 mcfcli[3673891]: %3|1730780189.770|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:16:49 kjcf05n00 mcfcli[3673891]: %3|1730780209.557|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 22:17:09 kjcf05n00 mcfcli[3673891]: %3|1730780229.454|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:17:19 kjcf05n00 mcfcli[3673891]: %3|1730780239.558|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:17:49 kjcf05n00 mcfcli[3673891]: %3|1730780269.451|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:17:50 kjcf05n00 mcfcli[3673891]: %3|1730780270.058|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 22:18:20 kjcf05n00 mcfcli[3673891]: %3|1730780300.058|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:18:21 kjcf05n00 zabbix-server[2496779]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:18:21 kjcf05n00 zabbix-server[2496779]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 272.82\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 116.99\\"}}"' Nov 4 22:18:22 kjcf05n00 log_interesting_event.py[2496779]: Event '46753' acknowledged Nov 4 22:18:29 kjcf05n00 mcfcli[3673891]: %3|1730780309.448|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:18:50 kjcf05n00 mcfcli[3673891]: %3|1730780330.058|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:19:07 kjcf05n00 mcfcli[3673891]: %3|1730780347.307|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:19:20 kjcf05n00 mcfcli[3673891]: %3|1730780360.059|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:19:28 kjcf05n00 zabbix-server[2497337]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:19:28 kjcf05n00 zabbix-server[2497337]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46754' Nov 4 22:19:28 kjcf05n00 zabbix-server[2497337]: Filesystem 'kjcf05' has been mounted Nov 4 22:19:29 kjcf05n00 zabbix-server[2497337]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 4 22:19:29 kjcf05n00 zabbix-server[2497337]: Running puppet on 'None' Nov 4 22:19:31 kjcf05n07 puppet-agent[2469461]: Using configured environment 'production' Nov 4 22:19:31 kjcf05n07 puppet-agent[2469461]: Retrieving pluginfacts Nov 4 22:19:31 kjcf05n07 puppet-agent[2469461]: Retrieving plugin Nov 4 22:19:31 kjcf05n03 puppet-agent[167622]: Using configured environment 'production' Nov 4 22:19:31 kjcf05n03 puppet-agent[167622]: Retrieving pluginfacts Nov 4 22:19:31 kjcf05n03 puppet-agent[167622]: Retrieving plugin Nov 4 22:19:31 kjcf05n02 puppet-agent[56572]: Using configured environment 'production' Nov 4 22:19:31 kjcf05n02 puppet-agent[56572]: Retrieving pluginfacts Nov 4 22:19:31 kjcf05n02 puppet-agent[56572]: Retrieving plugin Nov 4 22:19:31 kjcf05n05 puppet-agent[2663590]: Using configured environment 'production' Nov 4 22:19:31 kjcf05n05 puppet-agent[2663590]: Retrieving pluginfacts Nov 4 22:19:31 kjcf05n05 puppet-agent[2663590]: Retrieving plugin Nov 4 22:19:31 kjcf05n06 puppet-agent[2467426]: Using configured environment 'production' Nov 4 22:19:31 kjcf05n06 puppet-agent[2467426]: Retrieving pluginfacts Nov 4 22:19:31 kjcf05n06 puppet-agent[2467426]: Retrieving plugin Nov 4 22:19:31 kjcf05n04 puppet-agent[2454945]: Using configured environment 'production' Nov 4 22:19:31 kjcf05n04 puppet-agent[2454945]: Retrieving pluginfacts Nov 4 22:19:31 kjcf05n04 puppet-agent[2454945]: Retrieving plugin Nov 4 22:19:31 kjcf05n06 puppet-agent[2467426]: Loading facts Nov 4 22:19:31 kjcf05n02 puppet-agent[56572]: Loading facts Nov 4 22:19:31 kjcf05n01 puppet-agent[3928074]: Using configured environment 'production' Nov 4 22:19:31 kjcf05n01 puppet-agent[3928074]: Retrieving pluginfacts Nov 4 22:19:31 kjcf05n01 puppet-agent[3928074]: Retrieving plugin Nov 4 22:19:31 kjcf05n00 puppet-agent[2497398]: Using configured environment 'production' Nov 4 22:19:31 kjcf05n00 puppet-agent[2497398]: Retrieving pluginfacts Nov 4 22:19:31 kjcf05n00 puppet-agent[2497398]: Retrieving plugin Nov 4 22:19:31 kjcf05n03 puppet-agent[167622]: Loading facts Nov 4 22:19:31 kjcf05n05 puppet-agent[2663590]: Loading facts Nov 4 22:19:32 kjcf05n04 puppet-agent[2454945]: Loading facts Nov 4 22:19:32 kjcf05n07 puppet-agent[2469461]: Loading facts Nov 4 22:19:32 kjcf05n01 puppet-agent[3928074]: Loading facts Nov 4 22:19:32 kjcf05n00 puppet-agent[2497398]: Loading facts Nov 4 22:19:37 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 4 22:19:37 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 4 22:19:38 kjcf05n02 dwd[5180]: nvme24n1 passed periodic SMART status check Nov 4 22:19:38 kjcf05n02 dwd[5180]: nvme4n1 passed periodic SMART status check Nov 4 22:19:38 kjcf05n02 dwd[5180]: nvme2n1 passed periodic SMART status check Nov 4 22:19:38 kjcf05n02 dwd[5180]: nvme19n1 passed periodic SMART status check Nov 4 22:19:38 kjcf05n02 dwd[5180]: nvme9n1 passed periodic SMART status check Nov 4 22:19:38 kjcf05n02 dwd[5180]: nvme17n1 passed periodic SMART status check Nov 4 22:19:38 kjcf05n02 dwd[5180]: nvme25n1 passed periodic SMART status check Nov 4 22:19:38 kjcf05n02 dwd[5180]: nvme18n1 passed periodic SMART status check Nov 4 22:19:38 kjcf05n02 dwd[5180]: nvme3n1 passed periodic SMART status check Nov 4 22:19:38 kjcf05n02 dwd[5180]: nvme23n1 passed periodic SMART status check Nov 4 22:19:38 kjcf05n03 puppet-agent[167622]: Caching catalog for kjcf05n03 Nov 4 22:19:38 kjcf05n03 puppet-agent[167622]: Applying configuration version '1730780372' Nov 4 22:19:39 kjcf05n02 dwd[5180]: nvme8n1 passed periodic SMART status check Nov 4 22:19:39 kjcf05n02 puppet-agent[56572]: Caching catalog for kjcf05n02 Nov 4 22:19:39 kjcf05n02 puppet-agent[56572]: Applying configuration version '1730780372' Nov 4 22:19:40 kjcf05n06 puppet-agent[2467426]: Caching catalog for kjcf05n06 Nov 4 22:19:40 kjcf05n06 puppet-agent[2467426]: Applying configuration version '1730780373' Nov 4 22:19:41 kjcf05n01 puppet-agent[3928074]: Caching catalog for kjcf05n01 Nov 4 22:19:41 kjcf05n01 puppet-agent[3928074]: Applying configuration version '1730780373' Nov 4 22:19:41 kjcf05n07 puppet-agent[2469461]: Caching catalog for kjcf05n07 Nov 4 22:19:41 kjcf05n07 puppet-agent[2469461]: Applying configuration version '1730780378' Nov 4 22:19:41 kjcf05n03 puppet-agent[167622]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 22:19:41 kjcf05n03 puppet-agent[167622]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 22:19:41 kjcf05n03 puppet-agent[167622]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 22:19:42 kjcf05n02 puppet-agent[56572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 22:19:42 kjcf05n02 puppet-agent[56572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 22:19:42 kjcf05n02 puppet-agent[56572]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 22:19:42 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 4 22:19:42 kjcf05n03 zabbix_agent2[111918]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 22:19:42 kjcf05n03 zabbix_agent2[3163]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 22:19:42 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 22:19:42 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 4 22:19:42 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 4 22:19:42 kjcf05n03 puppet-agent[167622]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: Press Ctrl+C to exit. Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: Plugin support version 1.0 Nov 4 22:19:42 kjcf05n03 zabbix_agent2[168541]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 22:19:42 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 4 22:19:42 kjcf05n02 zabbix_agent2[35127]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 22:19:42 kjcf05n02 zabbix_agent2[3142]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:19:42 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 22:19:42 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 4 22:19:42 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 22:19:42 kjcf05n02 puppet-agent[56572]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: Press Ctrl+C to exit. Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: Plugin support version 1.0 Nov 4 22:19:42 kjcf05n02 zabbix_agent2[57146]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 22:19:42 kjcf05n06 puppet-agent[2467426]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 22:19:42 kjcf05n06 puppet-agent[2467426]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 22:19:42 kjcf05n06 puppet-agent[2467426]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 22:19:43 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2415216]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 22:19:43 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 4 22:19:43 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 22:19:43 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 4 22:19:43 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 4 22:19:43 kjcf05n06 puppet-agent[2467426]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: Press Ctrl+C to exit. Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: Plugin support version 1.0 Nov 4 22:19:43 kjcf05n06 zabbix_agent2[2468468]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 22:19:43 kjcf05n00 puppet-agent[2497398]: Caching catalog for kjcf05n00 Nov 4 22:19:43 kjcf05n00 puppet-agent[2497398]: Applying configuration version '1730780378' Nov 4 22:19:44 kjcf05n07 puppet-agent[2469461]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 22:19:44 kjcf05n07 puppet-agent[2469461]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 22:19:44 kjcf05n07 puppet-agent[2469461]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 22:19:44 kjcf05n01 puppet-agent[3928074]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 22:19:44 kjcf05n01 puppet-agent[3928074]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-21:56:04]/mode) mode changed '0755' to '0750' Nov 4 22:19:44 kjcf05n01 puppet-agent[3928074]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-21:56:04/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 4 22:19:44 kjcf05n01 puppet-agent[3928074]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-21:56:04/vmcore]/mode) mode changed '0600' to '0640' Nov 4 22:19:44 kjcf05n01 puppet-agent[3928074]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-21:56:04/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 4 22:19:44 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 22:19:44 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 22:19:44 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 22:19:44 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2417837]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 22:19:44 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 4 22:19:44 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 22:19:44 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 4 22:19:44 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 4 22:19:44 kjcf05n07 puppet-agent[2469461]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: Press Ctrl+C to exit. Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: Plugin support version 1.0 Nov 4 22:19:44 kjcf05n07 zabbix_agent2[2471239]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 22:19:44 kjcf05n03 puppet-agent[167622]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 22:19:44 kjcf05n03 puppet-agent[167622]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 22:19:44 kjcf05n03 puppet-agent[167622]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 22:19:45 kjcf05n02 puppet-agent[56572]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 22:19:45 kjcf05n02 puppet-agent[56572]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 22:19:45 kjcf05n02 puppet-agent[56572]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 22:19:45 kjcf05n01 puppet-agent[3928074]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 22:19:45 kjcf05n01 puppet-agent[3928074]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 22:19:45 kjcf05n01 puppet-agent[3928074]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 22:19:45 kjcf05n03 puppet-agent[167622]: Applied catalog in 6.44 seconds Nov 4 22:19:45 kjcf05n06 puppet-agent[2467426]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 22:19:45 kjcf05n06 puppet-agent[2467426]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 22:19:45 kjcf05n06 puppet-agent[2467426]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 22:19:45 kjcf05n06 puppet-agent[2467426]: Applied catalog in 5.40 seconds Nov 4 22:19:45 kjcf05n02 puppet-agent[56572]: Applied catalog in 5.87 seconds Nov 4 22:19:46 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3916413]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 22:19:46 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 4 22:19:46 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 22:19:46 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 4 22:19:46 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 4 22:19:46 kjcf05n01 puppet-agent[3928074]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: Press Ctrl+C to exit. Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: Plugin support version 1.0 Nov 4 22:19:46 kjcf05n01 zabbix_agent2[3928419]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 22:19:45 kjcf05n00 mcfcli[3673891]: %3|1730780385.700|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:19:46 kjcf05n07 puppet-agent[2469461]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 22:19:46 kjcf05n07 puppet-agent[2469461]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 22:19:46 kjcf05n07 puppet-agent[2469461]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 22:19:46 kjcf05n00 puppet-agent[2497398]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 22:19:47 kjcf05n07 puppet-agent[2469461]: Applied catalog in 5.44 seconds Nov 4 22:19:47 kjcf05n00 puppet-agent[2497398]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 22:19:47 kjcf05n00 puppet-agent[2497398]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 22:19:47 kjcf05n00 puppet-agent[2497398]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 22:19:48 kjcf05n01 puppet-agent[3928074]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_220325.log]/mode) mode changed '0644' to '0640' Nov 4 22:19:48 kjcf05n01 puppet-agent[3928074]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_221453.log]/mode) mode changed '0644' to '0640' Nov 4 22:19:48 kjcf05n01 puppet-agent[3928074]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241104_221453]/mode) mode changed '0755' to '0750' Nov 4 22:19:48 kjcf05n01 puppet-agent[3928074]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241104_221453/screenlog.0]/mode) mode changed '0644' to '0640' Nov 4 22:19:48 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2479346]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 22:19:48 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 22:19:48 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 22:19:48 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 4 22:19:48 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 4 22:19:48 kjcf05n00 puppet-agent[2497398]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: Press Ctrl+C to exit. Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: Plugin support version 1.0 Nov 4 22:19:48 kjcf05n00 zabbix_agent2[2498038]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 22:19:49 kjcf05n01 puppet-agent[3928074]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_220324.log]/mode) mode changed '0644' to '0640' Nov 4 22:19:49 kjcf05n01 puppet-agent[3928074]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_221453.log]/mode) mode changed '0644' to '0640' Nov 4 22:19:49 kjcf05n01 puppet-agent[3928074]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 22:19:49 kjcf05n01 puppet-agent[3928074]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 22:19:49 kjcf05n01 puppet-agent[3928074]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 22:19:48 kjcf05n00 zabbix-server[2498059]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:19:49 kjcf05n00 zabbix-server[2498068]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:19:49 kjcf05n00 zabbix-server[2498071]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:19:50 kjcf05n00 zabbix-server[2498073]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:19:50 kjcf05n00 mcfcli[3673891]: %3|1730780390.059|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:19:50 kjcf05n01 puppet-agent[3928074]: Applied catalog in 9.37 seconds Nov 4 22:19:50 kjcf05n00 puppet-agent[2497398]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 4 22:19:51 kjcf05n00 puppet-agent[2497398]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 22:19:51 kjcf05n00 puppet-agent[2497398]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 22:19:51 kjcf05n00 puppet-agent[2497398]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 22:19:52 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 4 22:19:52 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 4 22:19:52 kjcf05n00 puppet-agent[2497398]: Applied catalog in 8.62 seconds Nov 4 22:19:57 kjcf05n04 puppet-agent[2454945]: Caching catalog for kjcf05n04 Nov 4 22:19:57 kjcf05n04 puppet-agent[2454945]: Applying configuration version '1730780394' Nov 4 22:19:59 kjcf05n04 puppet-agent[2454945]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 22:19:59 kjcf05n04 puppet-agent[2454945]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 22:19:59 kjcf05n04 puppet-agent[2454945]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 22:19:59 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2397182]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 22:19:59 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 4 22:19:59 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 22:19:59 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 4 22:19:59 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 4 22:19:59 kjcf05n04 puppet-agent[2454945]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: Press Ctrl+C to exit. Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: Plugin support version 1.0 Nov 4 22:19:59 kjcf05n04 zabbix_agent2[2456019]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 22:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 22:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 22:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 22:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 22:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 22:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 22:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 22:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 22:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 22:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 22:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 22:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 22:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 22:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 22:20:01 kjcf05n04 puppet-agent[2454945]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 22:20:01 kjcf05n04 puppet-agent[2454945]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 22:20:01 kjcf05n04 puppet-agent[2454945]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 22:20:01 kjcf05n04 puppet-agent[2454945]: Applied catalog in 4.80 seconds Nov 4 22:20:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 22:20:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:20:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 22:20:07 kjcf05n05 puppet-agent[2663590]: Caching catalog for kjcf05n05 Nov 4 22:20:07 kjcf05n05 puppet-agent[2663590]: Applying configuration version '1730780405' Nov 4 22:20:09 kjcf05n05 puppet-agent[2663590]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 22:20:09 kjcf05n05 puppet-agent[2663590]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 22:20:09 kjcf05n05 puppet-agent[2663590]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 22:20:10 kjcf05n00 zabbix_server[15758]: Zabbix agent item "vm.memory.size[buffers]" on host "kjcf05n05" failed: first network error, wait for 15 seconds Nov 4 22:20:10 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2604481]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 22:20:10 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 4 22:20:10 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 22:20:10 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 4 22:20:10 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 4 22:20:10 kjcf05n05 puppet-agent[2663590]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: Press Ctrl+C to exit. Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: Plugin support version 1.0 Nov 4 22:20:10 kjcf05n05 zabbix_agent2[2665237]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 22:20:11 kjcf05n05 puppet-agent[2663590]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 22:20:11 kjcf05n05 puppet-agent[2663590]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 22:20:11 kjcf05n05 puppet-agent[2663590]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 22:20:12 kjcf05n05 puppet-agent[2663590]: Applied catalog in 4.81 seconds Nov 4 22:20:12 kjcf05n00 zabbix-server[2497337]: puppet completed status:(0): '' Nov 4 22:20:12 kjcf05n00 zabbix-server[2497337]: Event '46754' acknowledged Nov 4 22:20:12 kjcf05n00 zabbix-server[2497337]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 4 22:20:20 kjcf05n00 mcfcli[3673891]: %3|1730780420.060|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:20:23 kjcf05n00 mcfcli[3673891]: %3|1730780423.978|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:20:25 kjcf05n00 zabbix_server[15783]: resuming Zabbix agent checks on host "kjcf05n05": connection restored Nov 4 22:20:38 kjcf05n00 python3.9[2498539]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 22:20:50 kjcf05n00 mcfcli[3673891]: %3|1730780450.060|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 22:21:00 kjcf05n00 mcfcli[3673891]: %3|1730780460.786|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:21:20 kjcf05n00 mcfcli[3673891]: %3|1730780480.152|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:21:39 kjcf05n00 mcfcli[3673891]: %3|1730780499.302|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:21:50 kjcf05n00 mcfcli[3673891]: %3|1730780510.152|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 22:22:19 kjcf05n00 mcfcli[3673891]: %3|1730780539.299|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:22:20 kjcf05n00 mcfcli[3673891]: %3|1730780540.153|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:22:50 kjcf05n00 mcfcli[3673891]: %3|1730780570.153|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 22:22:59 kjcf05n00 mcfcli[3673891]: %3|1730780579.153|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:23:15.868202Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 22:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:23:15.868263Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.082ms Nov 4 22:23:20 kjcf05n00 mcfcli[3673891]: %3|1730780600.153|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 22:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T22:23:27.252899884-06:00 level=info msg="Completed cleanup jobs" duration=26.469183ms Nov 4 22:23:36 kjcf05n00 mcfcli[3673891]: %3|1730780616.789|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:23:50 kjcf05n00 mcfcli[3673891]: %3|1730780630.153|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 22:24:12 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 22:24:12 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 0 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007512 sec, idle for 1 hour(s)] Nov 4 22:24:13 kjcf05n00 mcfcli[3673891]: %3|1730780653.751|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:24:20 kjcf05n00 mcfcli[3673891]: %3|1730780660.154|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 22:24:50 kjcf05n00 mcfcli[3673891]: %3|1730780690.154|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:24:51 kjcf05n00 mcfcli[3673891]: %3|1730780691.316|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:25:20 kjcf05n00 mcfcli[3673891]: %3|1730780720.154|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 22:25:29 kjcf05n00 mcfcli[3673891]: %3|1730780729.477|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:25:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 22:25:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 22:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 22:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 22:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 22:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 22:25:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 22:25:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 22:25:50 kjcf05n00 mcfcli[3673891]: %3|1730780750.155|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 22:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 22:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 22:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 22:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 22:25:59 kjcf05n00 zabbix_server[15773]: Zabbix agent item "dcs.lustre.device.discovery[{$LUSTRE_FS_NAME},ost]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 4 22:25:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 22:25:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 22:25:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 22:25:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 22:26:00 kjcf05n00 zabbix_server[15734]: Zabbix agent item "system.uptime" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 4 22:26:04 kjcf05n03 fstonithd.py[15114]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 4 22:26:04 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 22:26:04 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 22:26:04 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 22:26:06 kjcf05n03 root[179550]: is_viking_off starts Nov 4 22:26:06 kjcf05n03 root[179549]: is_enc_ipmi_off starts Nov 4 22:26:06 kjcf05n03 root[179566]: is_lan_ipmi_off leaves Nov 4 22:26:06 kjcf05n03 root[179568]: is_lan_ipmi_sec_off leaves Nov 4 22:26:06 kjcf05n03 root[179571]: I am master Nov 4 22:26:06 kjcf05n03 root[179574]: I am in slot 1; partner is in slot 0 Nov 4 22:26:07 kjcf05n00 python3.9[2501541]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 22:26:09 kjcf05n00 mcfcli[3673891]: %3|1730780769.474|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:26:12 kjcf05n03 root[179678]: is_viking_off leaves Nov 4 22:26:12 kjcf05n03 root[179681]: kjcf05n02 not already off look at kdump Nov 4 22:26:12 kjcf05n03 root[179682]: is_kdump_off starts Nov 4 22:26:12 kjcf05n03 fence_kdump[179683]: waiting for message from '172.16.2.5' Nov 4 22:26:13 kjcf05n03 fence_kdump[179683]: received valid message from '172.16.2.5' Nov 4 22:26:13 kjcf05n03 root[179698]: is_kdump_off detected kdump on kjcf05n02 Nov 4 22:26:13 kjcf05n03 root[179699]: kjcf05n02 is kdumping Nov 4 22:26:13 kjcf05n03 root[179795]: is_enc_ipmi_off starts Nov 4 22:26:13 kjcf05n03 root[179796]: is_viking_off starts Nov 4 22:26:13 kjcf05n03 root[179812]: is_lan_ipmi_off leaves Nov 4 22:26:13 kjcf05n03 root[179814]: is_lan_ipmi_sec_off leaves Nov 4 22:26:14 kjcf05n03 root[179817]: I am in slot 1; partner is in slot 0 Nov 4 22:26:14 kjcf05n03 root[179820]: I am master Nov 4 22:26:14 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.discovery[{$LUSTRE_FS_NAME},ost]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 4 22:26:15 kjcf05n00 zabbix_server[15772]: Zabbix agent item "system.cpu.util[,iowait]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 4 22:26:19 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='70', error='Connection reset by peer (104)' Nov 4 22:26:19 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='70', client='AF_INET(172.16.2.5:43015)', local='AF_INET(0.0.0.0:601)' Nov 4 22:26:19 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 4 22:26:19 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 4 22:26:20 kjcf05n03 root[180028]: is_viking_off leaves Nov 4 22:26:20 kjcf05n03 root[180031]: kjcf05n02 not already off look at kdump Nov 4 22:26:20 kjcf05n03 root[180032]: is_kdump_off starts Nov 4 22:26:20 kjcf05n03 fence_kdump[180033]: waiting for message from '172.16.2.5' Nov 4 22:26:20 kjcf05n00 mcfcli[3673891]: %3|1730780780.155|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:26:21 kjcf05n03 fence_kdump[180033]: received valid message from '172.16.2.5' Nov 4 22:26:21 kjcf05n03 root[180048]: is_kdump_off detected kdump on kjcf05n02 Nov 4 22:26:21 kjcf05n03 root[180049]: kjcf05n02 is kdumping Nov 4 22:26:25 kjcf05n03 systemd-udevd[182253]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182255]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182253]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182256]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182258]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182255]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182253]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182256]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182258]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182255]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182267]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182268]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182253]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182256]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182271]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182255]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182258]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182273]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182267]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182253]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182268]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182255]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182271]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182273]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182256]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182258]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182253]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182268]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182255]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182271]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182273]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182258]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182253]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182268]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182255]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182273]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182258]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182253]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182268]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182255]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182273]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182271]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182253]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182258]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182273]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182255]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182268]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182271]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182253]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182273]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182268]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182258]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182273]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182268]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182273]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182273]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182273]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182253]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182273]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182253]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182273]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182253]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182273]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 systemd-udevd[182273]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:26:25 kjcf05n03 dwd[5162]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 4 22:26:25 kjcf05n03 dwd[5162]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 4 22:26:25 kjcf05n03 dwd[5162]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 4 22:26:25 kjcf05n03 dwd[5162]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 4 22:26:25 kjcf05n03 dwd[5162]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 4 22:26:25 kjcf05n03 dwd[5162]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 4 22:26:25 kjcf05n03 dwd[5162]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 4 22:26:25 kjcf05n03 dwd[5162]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 4 22:26:25 kjcf05n03 dwd[5162]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 4 22:26:25 kjcf05n03 dwd[5162]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 4 22:26:25 kjcf05n03 dwd[5162]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 4 22:26:25 kjcf05n03 dwd[5162]: Starting NVME thread for nvme2n1 Nov 4 22:26:26 kjcf05n03 dwd[5162]: Starting NVME thread for nvme8n1 Nov 4 22:26:26 kjcf05n03 dwd[5162]: Starting NVME thread for nvme24n1 Nov 4 22:26:27 kjcf05n03 dwd[5162]: Starting NVME thread for nvme17n1 Nov 4 22:26:27 kjcf05n03 dwd[5162]: Starting NVME thread for nvme3n1 Nov 4 22:26:27 kjcf05n03 dwd[5162]: Starting NVME thread for nvme25n1 Nov 4 22:26:27 kjcf05n03 dwd[5162]: Starting NVME thread for nvme19n1 Nov 4 22:26:27 kjcf05n03 dwd[5162]: Starting NVME thread for nvme4n1 Nov 4 22:26:27 kjcf05n03 dwd[5162]: Starting NVME thread for nvme18n1 Nov 4 22:26:27 kjcf05n03 dwd[5162]: Starting NVME thread for nvme23n1 Nov 4 22:26:27 kjcf05n03 dwd[5162]: Starting NVME thread for nvme9n1 Nov 4 22:26:29 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.mdt.name[MDT0000,mdt_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 4 22:26:30 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.array.discovery" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 4 22:26:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 22:26:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 22:26:37 kjcf05n03 diskmonitor[17340]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 4 22:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 22:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 22:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 22:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 22:26:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 22:26:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 22:26:44 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 4 22:26:45 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 4 22:26:46 kjcf05n03 diskmonitor[17340]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 4 22:26:46 kjcf05n03 diskmonitor[17340]: Scan for ReadErrorMax change for md65 Nov 4 22:26:46 kjcf05n03 diskmonitor[17340]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 4 22:26:46 kjcf05n03 diskmonitor[17340]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 4 22:26:46 kjcf05n03 diskmonitor[17340]: read_saved_file: md65 no saved speed Nov 4 22:26:46 kjcf05n03 diskmonitor[17340]: reconstruction_policy: sync_action prev = current = idle - md65 Nov 4 22:26:46 kjcf05n03 diskmonitor[17340]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 22:26:49 kjcf05n00 mcfcli[3673891]: %3|1730780809.471|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:26:50 kjcf05n00 mcfcli[3673891]: %3|1730780810.564|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 22:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 22:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 22:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 22:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 22:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 22:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 22:26:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 22:26:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 22:27:20 kjcf05n00 mcfcli[3673891]: %3|1730780840.564|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:27:27 kjcf05n00 mcfcli[3673891]: %3|1730780847.616|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:27:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 22:27:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 22:27:35 kjcf05n03 nslcd[6913]: ldap_result() failed: Can't contact LDAP server Nov 4 22:27:35 kjcf05n03 nslcd[6913]: [b127f8] ldap_result() failed: Can't contact LDAP server Nov 4 22:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 22:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 22:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 22:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 22:27:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 22:27:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 22:27:50 kjcf05n00 mcfcli[3673891]: %3|1730780870.565|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 22:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 22:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 22:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 22:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 22:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 22:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 22:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 22:28:07 kjcf05n00 mcfcli[3673891]: %3|1730780887.613|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:28:20 kjcf05n00 mcfcli[3673891]: %3|1730780900.565|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 22:28:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 22:28:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 22:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 22:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 22:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 22:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 22:28:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 22:28:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 22:28:46 kjcf05n00 mcfcli[3673891]: %3|1730780926.888|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:28:50 kjcf05n00 mcfcli[3673891]: %3|1730780930.566|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 22:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 22:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 22:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 22:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 22:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 22:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 22:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 22:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 22:29:12 kjcf05n00 zabbix-server[2503816]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:29:12 kjcf05n00 zabbix-server[2503816]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 4 22:29:12 kjcf05n00 log_interesting_event.py[2503816]: Event '46756' acknowledged Nov 4 22:29:20 kjcf05n00 mcfcli[3673891]: %3|1730780960.566|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:29:25 kjcf05n00 mcfcli[3673891]: %3|1730780965.897|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:29:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 22:29:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 22:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 22:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 22:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 22:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 22:29:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 22:29:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 22:29:50 kjcf05n00 mcfcli[3673891]: %3|1730780990.567|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:29:51 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 4 22:29:51 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 4 22:29:55 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 4 22:29:55 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 4 22:29:55 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 4 22:29:55 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 4 22:29:55 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 4 22:29:55 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 4 22:29:55 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 4 22:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 22:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 22:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 22:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 22:29:57 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 4 22:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 22:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 22:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 22:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 22:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 22:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 22:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 22:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 22:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 22:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 22:30:00 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 4 22:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 22:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 22:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 22:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 22:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 22:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 22:30:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 22:30:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:30:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 22:30:04 kjcf05n00 mcfcli[3673891]: %3|1730781004.339|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:30:20 kjcf05n00 mcfcli[3673891]: %3|1730781020.567|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 22:30:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 22:30:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 22:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 22:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 22:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 22:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 22:30:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 22:30:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 22:30:39 kjcf05n00 mcfcli[3673891]: %3|1730781039.391|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:30:42 kjcf05n00 python3.9[2504467]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 22:30:47 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:55314). Nov 4 22:30:47 kjcf05n01 rsyncd[3932742]: connect from kjcf05n02 (172.16.2.5) Nov 4 22:30:47 kjcf05n01 rsyncd[3932742]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 4 22:30:47 kjcf05n01 rsyncd[3932742]: building file list Nov 4 22:30:47 kjcf05n01 rsyncd[3932742]: sent 11450 bytes received 136 bytes total size 10905 Nov 4 22:30:47 kjcf05n01 systemd[1]: rsyncd@669-172.16.2.2:873-172.16.2.5:55314.service: Succeeded. Nov 4 22:30:50 kjcf05n00 mcfcli[3673891]: %3|1730781050.567|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 22:30:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730781055', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 22:30:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730781055'} Nov 4 22:30:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:30:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730781055', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 22:30:55 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730781055'} Nov 4 22:30:55 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 22:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 22:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 22:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 22:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 22:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 22:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 22:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 22:31:04 kjcf05n03 fstonithd.py[15114]: Listening for kdump packets from partner Nov 4 22:31:17 kjcf05n00 mcfcli[3673891]: %3|1730781077.207|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:31:21 kjcf05n00 mcfcli[3673891]: %3|1730781081.066|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 22:31:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 22:31:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 22:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 22:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 22:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 22:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 22:31:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 22:31:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 22:31:51 kjcf05n03 dwd[5162]: nvme2n1 passed periodic SMART status check Nov 4 22:31:51 kjcf05n00 mcfcli[3673891]: %3|1730781111.067|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 22:31:52 kjcf05n03 dwd[5162]: nvme25n1 passed periodic SMART status check Nov 4 22:31:52 kjcf05n03 dwd[5162]: nvme8n1 passed periodic SMART status check Nov 4 22:31:52 kjcf05n03 dwd[5162]: nvme3n1 passed periodic SMART status check Nov 4 22:31:52 kjcf05n03 dwd[5162]: nvme17n1 passed periodic SMART status check Nov 4 22:31:52 kjcf05n03 dwd[5162]: nvme24n1 passed periodic SMART status check Nov 4 22:31:53 kjcf05n03 dwd[5162]: nvme23n1 passed periodic SMART status check Nov 4 22:31:53 kjcf05n03 dwd[5162]: nvme4n1 passed periodic SMART status check Nov 4 22:31:53 kjcf05n03 dwd[5162]: nvme18n1 passed periodic SMART status check Nov 4 22:31:53 kjcf05n03 dwd[5162]: nvme9n1 passed periodic SMART status check Nov 4 22:31:53 kjcf05n03 dwd[5162]: nvme19n1 passed periodic SMART status check Nov 4 22:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 22:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 22:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 22:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 22:31:57 kjcf05n00 mcfcli[3673891]: %3|1730781117.204|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 22:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 22:31:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 22:31:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 22:32:13 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='15', client='AF_INET(172.16.2.5:45055)', local='AF_INET(0.0.0.0:601)' Nov 4 22:32:13 kjcf05n02 syslog-ng[3196]: Configuration reload request received, reloading configuration; Nov 4 22:32:13 kjcf05n02 syslog-ng[3196]: Configuration reload finished; Nov 4 22:32:13 kjcf05n02 syslog-ng[3196]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 4 22:32:13 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 4 22:32:13 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 22:32:13 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 4 22:32:13 kjcf05n02 dracut: Self testing crypto algorithms Nov 4 22:32:13 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 4 22:32:13 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 22:32:13 kjcf05n02 Copying live image to RAM... Nov 4 22:32:13 kjcf05n02 (this may take a minute) Nov 4 22:32:13 kjcf05n02 Done copying live image to RAM. Nov 4 22:32:13 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 4 22:32:13 kjcf05n02 dracut: Checking integrity of kernel Nov 4 22:32:13 kjcf05n02 dracut: All initrd crypto checks done Nov 4 22:32:13 kjcf05n02 dracut: Switching root Nov 4 22:32:13 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 4 22:32:13 kjcf05n02 systemd: Detected architecture x86-64. Nov 4 22:32:13 kjcf05n02 systemd: Set hostname to . Nov 4 22:32:13 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 4 22:32:13 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 4 22:32:13 kjcf05n02 systemd: Created slice system-getty.slice. Nov 4 22:32:13 kjcf05n02 systemd: Started Dispatch Password Requests to Console Directory Watch. Nov 4 22:32:13 kjcf05n02 systemd: Set up automount Arbitrary Executable File Formats File System Automount Point. Nov 4 22:32:13 kjcf05n02 systemd: Created slice User and Session Slice. Nov 4 22:32:13 kjcf05n02 systemd: Listening on Journal Socket. Nov 4 22:32:13 kjcf05n02 systemd-journald[1525]: Journal started Nov 4 22:32:13 kjcf05n02 systemd-journald[1525]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 22:32:13 kjcf05n02 systemd-modules-load[1505]: Inserted module 'fuse' Nov 4 22:32:13 kjcf05n02 systemd[1]: Mounted Temporary Directory (/tmp). Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Create System Users... Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Load/Save Random Seed... Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Rebuild Hardware Database... Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 4 22:32:13 kjcf05n02 systemd[1]: Mounting FUSE Control File System... Nov 4 22:32:13 kjcf05n02 systemd[1]: Mounting Kernel Configuration File System... Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Apply Kernel Variables... Nov 4 22:32:13 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Create System Users. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 4 22:32:13 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 4 22:32:13 kjcf05n02 systemd-journald[1525]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 4 22:32:13 kjcf05n02 systemd-sysctl[1542]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 22:32:13 kjcf05n02 systemd-sysctl[1542]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 4 22:32:13 kjcf05n02 systemd-tmpfiles[1547]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 22:32:13 kjcf05n02 systemd-tmpfiles[1547]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 4 22:32:13 kjcf05n02 systemd-udevd[1557]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 4 22:32:13 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 4 22:32:13 kjcf05n02 systemd-udevd[1598]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:32:13 kjcf05n02 systemd-udevd[1608]: Using default interface naming scheme 'rhel-8.0'. Nov 4 22:32:13 kjcf05n02 systemd-udevd[1608]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:32:13 kjcf05n02 systemd-udevd[1575]: Using default interface naming scheme 'rhel-8.0'. Nov 4 22:32:13 kjcf05n02 systemd-udevd[1575]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:32:13 kjcf05n02 systemd-udevd[1615]: Using default interface naming scheme 'rhel-8.0'. Nov 4 22:32:13 kjcf05n02 systemd-udevd[1615]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 4 22:32:13 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 4 22:32:13 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 4 22:32:13 kjcf05n02 root[1799]: openibd: running in auto mode Nov 4 22:32:13 kjcf05n02 systemd-tmpfiles[1796]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 4 22:32:13 kjcf05n02 systemd-tmpfiles[1796]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 22:32:13 kjcf05n02 systemd-tmpfiles[1796]: "/var/tmp" already exists and is not a directory. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 4 22:32:13 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 4 22:32:13 kjcf05n02 systemd-modules-load[1833]: Inserted module 'ib_iser' Nov 4 22:32:13 kjcf05n02 systemd-modules-load[1833]: Inserted module 'ib_isert' Nov 4 22:32:13 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 4 22:32:13 kjcf05n02 systemd-modules-load[1833]: Inserted module 'ib_srpt' Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 4 22:32:13 kjcf05n02 systemd-udevd[1606]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:32:13 kjcf05n02 systemd-modules-load[1826]: Inserted module 'ib_ipoib' Nov 4 22:32:13 kjcf05n02 systemd-udevd[1607]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:32:13 kjcf05n02 systemd-modules-load[1833]: Inserted module 'rdma_ucm' Nov 4 22:32:13 kjcf05n02 systemd-modules-load[1833]: Module 'svcrdma' is blacklisted Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started RPC Bind. Nov 4 22:32:13 kjcf05n02 systemd-udevd[1606]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 22:32:13 kjcf05n02 systemd-udevd[1607]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 22:32:13 kjcf05n02 systemd-modules-load[1826]: Inserted module 'ib_umad' Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 4 22:32:13 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 4 22:32:13 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 4 22:32:13 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 22:32:13 kjcf05n02 systemd[3196]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:13 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 4 22:32:13 kjcf05n02 openibd[1779]: Loading HCA driver and Access Layer:[ OK ] Nov 4 22:32:13 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Update is Completed. Nov 4 22:32:13 kjcf05n02 setup-icl[1756]: Setting LAN IP Address to 203.0.113.3 Nov 4 22:32:13 kjcf05n02 setup-icl[1756]: Setting LAN Subnet Mask to 255.255.255.0 Nov 4 22:32:13 kjcf05n02 setup-icl[1756]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 4 22:32:13 kjcf05n02 setup-icl[1756]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 4 22:32:13 kjcf05n02 systemd-udevd[1606]: Using default interface naming scheme 'rhel-8.0'. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 4 22:32:13 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 4 22:32:13 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 4 22:32:13 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 4 22:32:13 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 4 22:32:13 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 4 22:32:13 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 4 22:32:13 kjcf05n02 systemd[1]: Reached target Sockets. Nov 4 22:32:13 kjcf05n02 systemd[1]: Reached target Basic System. Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 4 22:32:13 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 22:32:13 kjcf05n02 nscd[2141]: 2141 monitoring file `/etc/hosts` (1) Nov 4 22:32:13 kjcf05n02 nscd[2141]: 2141 monitoring directory `/etc` (2) Nov 4 22:32:13 kjcf05n02 nscd[2141]: 2141 monitoring file `/etc/resolv.conf` (3) Nov 4 22:32:13 kjcf05n02 nscd[2141]: 2141 monitoring directory `/etc` (2) Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 4 22:32:13 kjcf05n02 network[2119]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 0 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 1 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 2 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 3 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 4 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 5 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 6 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 7 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 8 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 9 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 10 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 11 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 12 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 13 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 14 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 15 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 16 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 17 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 18 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 19 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 20 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 21 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 22 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 23 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 24 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 25 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 26 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 27 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 28 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 29 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 30 Nov 4 22:32:13 kjcf05n02 cpupower[2155]: Setting cpu: 31 Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[2154]: Setting up Mellanox network interface: ib0 Nov 4 22:32:13 kjcf05n02 chronyd[2169]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 4 22:32:13 kjcf05n02 network[2156]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 22:32:13 kjcf05n02 network[2119]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 22:32:13 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 4 22:32:13 kjcf05n02 mcelog[2190]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 4 22:32:13 kjcf05n02 mcelog[2190]: CPU is unsupported Nov 4 22:32:13 kjcf05n02 network[2179]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:32:13 kjcf05n02 network[2119]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 4 22:32:13 kjcf05n02 dwd[2186]: dwd: vMay 29 2024 : 15:38:26 Nov 4 22:32:13 kjcf05n02 dwd[2186]: /usr/sbin/dwd -d --standalone=0 Nov 4 22:32:13 kjcf05n02 dwd[2186]: dwd: option Lethal: 0 Nov 4 22:32:13 kjcf05n02 dwd[2186]: dwd: option Interval: 60 Nov 4 22:32:13 kjcf05n02 dwd[2186]: dwd: option abrtlimit: 10 Nov 4 22:32:13 kjcf05n02 dwd[2186]: dwd: option DZPeriod: 604800 Nov 4 22:32:13 kjcf05n02 dwd[2186]: dwd: option SmartPeriod: 43200 Nov 4 22:32:13 kjcf05n02 dwd[2186]: dwd: option SDDEnabled: 1 Nov 4 22:32:13 kjcf05n02 dwd[2186]: dwd: option SDDAwaitScale: 3 Nov 4 22:32:13 kjcf05n02 dwd[2186]: dwd: option SDDAwaitMin: 100 Nov 4 22:32:13 kjcf05n02 dwd[2186]: dwd: option Verbosity: 1 Nov 4 22:32:13 kjcf05n02 dwd[2186]: dwd: option StandAlone: 0 Nov 4 22:32:13 kjcf05n02 dwd[2186]: option Lethal: 0 Nov 4 22:32:13 kjcf05n02 dwd[2186]: option Interval: 60 Nov 4 22:32:13 kjcf05n02 dwd[2186]: option abrtlimit: 10 Nov 4 22:32:13 kjcf05n02 dwd[2186]: option DZPeriod: 604800 Nov 4 22:32:13 kjcf05n02 dwd[2186]: option SmartPeriod: 43200 Nov 4 22:32:13 kjcf05n02 dwd[2186]: option SDDEnabled: 1 Nov 4 22:32:13 kjcf05n02 dwd[2186]: option SDDAwaitScale: 3 Nov 4 22:32:13 kjcf05n02 dwd[2186]: option SDDAwaitMin: 100 Nov 4 22:32:13 kjcf05n02 dwd[2186]: option Verbosity: 1 Nov 4 22:32:13 kjcf05n02 dwd[2186]: option StandAlone: 0 Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 4 22:32:13 kjcf05n02 network[2204]: It is advised to switch to 'NetworkManager' instead for network management. Nov 4 22:32:13 kjcf05n02 chronyd[2169]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 22:32:13 kjcf05n02 chronyd[2169]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 22:32:13 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 4 22:32:13 kjcf05n02 dbus-daemon[2187]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[2210]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 22:32:13 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 22:32:13 kjcf05n02 beSetMlxConfig[2211]: ConnectX-3 multiport not detected Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 4 22:32:13 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[2254]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[2256]: Setting up Mellanox network interface: ib1 Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 0 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 1 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 2 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 3 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 4 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 5 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 6 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 7 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 8 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 9 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 10 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 11 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 12 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 13 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 14 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 15 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 16 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 17 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 18 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 19 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 20 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 21 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 22 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 23 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 24 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 25 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 26 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 27 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 28 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 29 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 30 Nov 4 22:32:13 kjcf05n02 cpupower[2279]: Idlestate 2 disabled on CPU 31 Nov 4 22:32:13 kjcf05n02 mdraid-phy[2258]: no Cutlass to worry about Nov 4 22:32:13 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[2267]: No configuration found for ib0 Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 22:32:13 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 4 22:32:13 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 4 22:32:13 kjcf05n02 beSetMlxConfig[2211]: Starting MST (Mellanox Software Tools) driver set Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[2312]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[2313]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 22:32:13 kjcf05n02 beSetMlxConfig[2211]: Loading MST PCI module - Success Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[2332]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 22:32:13 kjcf05n02 mlnx_conf_mgr[2352]: INFO: No configurations found for mlx5_0, skipping. Nov 4 22:32:13 kjcf05n02 sssd[sssd][2198]: Starting up Nov 4 22:32:13 kjcf05n02 beSetMlxConfig[2211]: Loading MST PCI configuration module - Success Nov 4 22:32:13 kjcf05n02 beSetMlxConfig[2211]: Create devices Nov 4 22:32:13 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[2357]: No configuration found for ib1 Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[2377]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 22:32:13 kjcf05n02 mlnx_conf_mgr[2426]: INFO: No configurations found for mlx5_1, skipping. Nov 4 22:32:13 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 22:32:13 kjcf05n02 sssd[be[implicit_files]][2378]: Starting up Nov 4 22:32:13 kjcf05n02 sssd[nss][2515]: Starting up Nov 4 22:32:13 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 4 22:32:13 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Login Service... Nov 4 22:32:13 kjcf05n02 systemd-logind[2626]: New seat seat0. Nov 4 22:32:13 kjcf05n02 systemd-logind[2626]: Watching system buttons on /dev/input/event0 (Power Button) Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Login Service. Nov 4 22:32:13 kjcf05n02 python3.9[2257]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 22:32:13 kjcf05n02 python3.9[3196]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:13 kjcf05n02 systemd-sysctl[2747]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 22:32:13 kjcf05n02 systemd-sysctl[2747]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 4 22:32:13 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 22:32:13 kjcf05n02 python3.9[2970]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 22:32:13 kjcf05n02 python3.9[3196]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:13 kjcf05n02 network[2119]: Bringing up loopback interface: [ OK ] Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 22:32:13 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 4 22:32:13 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 4 22:32:13 kjcf05n02 systemd-sysctl[3100]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 22:32:13 kjcf05n02 systemd-sysctl[3100]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 22:32:13 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 4 22:32:13 kjcf05n02 systemd[1]: Reached target Network. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 4 22:32:13 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 4 22:32:13 kjcf05n02 sm-notify[3179]: Version 2.3.3 starting Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 4 22:32:13 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 4 22:32:13 kjcf05n02 sshd[3163]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 4 22:32:13 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 4 22:32:13 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 22:32:13 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 4 22:32:13 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 4 22:32:13 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 4 22:32:13 kjcf05n02 lldpad[3142]: setsockopt nearest_bridge: Invalid argument Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 4 22:32:13 kjcf05n02 lldpad[3142]: setsockopt nearest_bridge: Invalid argument Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 4 22:32:13 kjcf05n02 python3.9[3209]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 22:32:13 kjcf05n02 python3.9[3196]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:13 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 22:32:13 kjcf05n02 syslog-ng[3196]: [2024-11-05T04:31:01.366411] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 4 22:32:13 kjcf05n02 syslog-ng[3196]: [2024-11-05T04:31:01.366676] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 4 22:32:13 kjcf05n02 syslog-ng[3196]: [2024-11-05T04:31:01.366712] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 4 22:32:13 kjcf05n02 syslog-ng[3196]: [2024-11-05T04:31:01.367274] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 4 22:32:13 kjcf05n02 syslog-ng[3196]: [2024-11-05T04:31:01.367447] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 4 22:32:13 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 4 22:32:13 kjcf05n02 beSetMlxConfig[2211]: Unloading MST PCI module (unused) - Success Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 4 22:32:13 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 22:32:13 kjcf05n02 python3.9[3446]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 22:32:13 kjcf05n02 python3.9[3196]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 4 22:32:13 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 22:32:13 kjcf05n02 python3.9[3449]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 22:32:13 kjcf05n02 python3.9[3196]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 4 22:32:13 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 4 22:32:13 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 22:32:13 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 4 22:32:13 kjcf05n02 chronyd[2169]: System's initial offset : 0.002610 seconds slow of true (slew) Nov 4 22:32:13 kjcf05n02 systemd[1]: Started NTP client/server. Nov 4 22:32:13 kjcf05n02 beSetMlxConfig[2211]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 22:32:13 kjcf05n02 beSetMlxConfig[2211]: ib mode Nov 4 22:32:13 kjcf05n02 root[3469]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 4 22:32:13 kjcf05n02 root[3471]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 4 22:32:13 kjcf05n02 beSetMlxConfig[2211]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 22:32:13 kjcf05n02 beSetMlxConfig[2211]: ib mode Nov 4 22:32:13 kjcf05n02 systemd-udevd[1557]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 22:32:13 kjcf05n02 systemd-udevd[3487]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:32:13 kjcf05n02 systemd-udevd[3488]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:32:13 kjcf05n02 systemd-udevd[3491]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:32:13 kjcf05n02 systemd-udevd[3494]: Using default interface naming scheme 'rhel-8.0'. Nov 4 22:32:13 kjcf05n02 systemd-udevd[3494]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:32:13 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 22:32:13 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 22:32:13 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 22:32:13 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[3529]: Setting up Mellanox network interface: ib1 Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[3530]: Setting up Mellanox network interface: ib0 Nov 4 22:32:13 kjcf05n02 systemd-udevd[3490]: Using default interface naming scheme 'rhel-8.0'. Nov 4 22:32:13 kjcf05n02 systemd-udevd[3490]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[3579]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[3580]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[3595]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[3596]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[3597]: No configuration found for ib1 Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[3598]: No configuration found for ib0 Nov 4 22:32:13 kjcf05n02 systemd-udevd[3489]: Using default interface naming scheme 'rhel-8.0'. Nov 4 22:32:13 kjcf05n02 systemd-udevd[3489]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[3605]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[3606]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 22:32:13 kjcf05n02 mlnx_conf_mgr[3660]: INFO: No configurations found for mlx5_1, skipping. Nov 4 22:32:13 kjcf05n02 mlnx_conf_mgr[3661]: INFO: No configurations found for mlx5_0, skipping. Nov 4 22:32:13 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 22:32:13 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 22:32:13 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 4 22:32:13 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 4 22:32:13 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 4 22:32:13 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 4 22:32:13 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 4 22:32:13 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 22:32:13 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 4 22:32:13 kjcf05n02 lldpad[3142]: init_ports: Error adding device ib0 Nov 4 22:32:13 kjcf05n02 lldpad[3142]: init_ports: Error adding device ib1 Nov 4 22:32:13 kjcf05n02 lldpad[3142]: Signal 15 received - terminating Nov 4 22:32:13 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 4 22:32:13 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 4 22:32:13 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 4 22:32:13 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 4 22:32:13 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 4 22:32:13 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 4 22:32:13 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 4 22:32:13 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:13 kjcf05n02 systemd[3196]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:13 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 1 | Nov-05-2024 | 04:01:47 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 2 | Nov-05-2024 | 04:02:38 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 3 | Nov-05-2024 | 04:02:39 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 4 | Nov-05-2024 | 04:03:45 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 5 | Nov-05-2024 | 04:03:45 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 6 | Nov-05-2024 | 04:28:21 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 7 | Nov-05-2024 | 04:28:21 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 8 | Nov-05-2024 | 04:28:21 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 9 | Nov-05-2024 | 04:28:21 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 10 | Nov-05-2024 | 04:28:21 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 11 | Nov-05-2024 | 04:28:21 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 12 | Nov-05-2024 | 04:28:21 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 13 | Nov-05-2024 | 04:28:21 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 14 | Nov-05-2024 | 04:28:21 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 15 | Nov-05-2024 | 04:28:21 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 16 | Nov-05-2024 | 04:28:21 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 17 | Nov-05-2024 | 04:28:21 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 18 | Nov-05-2024 | 04:28:52 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 19 | Nov-05-2024 | 04:28:52 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 20 | Nov-05-2024 | 04:28:52 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 21 | Nov-05-2024 | 04:28:52 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 22 | Nov-05-2024 | 04:28:52 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 23 | Nov-05-2024 | 04:28:52 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 24 | Nov-05-2024 | 04:28:52 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 25 | Nov-05-2024 | 04:28:52 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 26 | Nov-05-2024 | 04:28:52 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 27 | Nov-05-2024 | 04:28:52 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 28 | Nov-05-2024 | 04:28:52 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 22:32:13 kjcf05n02 ipmievd[4005]: 29 | Nov-05-2024 | 04:28:52 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 22:32:13 kjcf05n02 ipmievd[4008]: Reading sensors... Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 4 22:32:13 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:13 kjcf05n02 systemd[3196]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 4 22:32:13 kjcf05n02 nscd[2141]: 2141 monitored file `/etc/hosts` was moved into place, adding watch Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 22:32:13 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 4 22:32:13 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 4 22:32:13 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 4 22:32:13 kjcf05n02 beSetMlxConfig[4066]: ConnectX-3 multiport not detected Nov 4 22:32:13 kjcf05n02 beSetMlxConfig[4066]: Starting MST (Mellanox Software Tools) driver set Nov 4 22:32:13 kjcf05n02 beSetMlxConfig[4066]: Loading MST PCI module - Success Nov 4 22:32:13 kjcf05n02 systemd-udevd[1557]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 22:32:13 kjcf05n02 beSetMlxConfig[4066]: [warn] mst_pciconf is already loaded, skipping Nov 4 22:32:13 kjcf05n02 beSetMlxConfig[4066]: Create devices Nov 4 22:32:13 kjcf05n02 beSetMlxConfig[4066]: Unloading MST PCI module (unused) - Success Nov 4 22:32:13 kjcf05n02 ipmievd[4008]: Waiting for events... Nov 4 22:32:13 kjcf05n02 beSetMlxConfig[4066]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 22:32:13 kjcf05n02 beSetMlxConfig[4066]: ib mode Nov 4 22:32:13 kjcf05n02 beSetMlxConfig[4066]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 22:32:13 kjcf05n02 beSetMlxConfig[4066]: ib mode Nov 4 22:32:13 kjcf05n02 systemd-udevd[1557]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 22:32:13 kjcf05n02 systemd-udevd[4967]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:32:13 kjcf05n02 systemd-udevd[4968]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:32:13 kjcf05n02 systemd-udevd[4971]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:32:13 kjcf05n02 systemd-udevd[4974]: Using default interface naming scheme 'rhel-8.0'. Nov 4 22:32:13 kjcf05n02 systemd-udevd[4974]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:32:13 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 22:32:13 kjcf05n02 systemd[3196]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:13 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[5009]: Setting up Mellanox network interface: ib1 Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[5010]: Setting up Mellanox network interface: ib0 Nov 4 22:32:13 kjcf05n02 systemd-udevd[4970]: Using default interface naming scheme 'rhel-8.0'. Nov 4 22:32:13 kjcf05n02 systemd-udevd[4970]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[5058]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[5060]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[5074]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[5076]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[5077]: No configuration found for ib1 Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[5078]: No configuration found for ib0 Nov 4 22:32:13 kjcf05n02 systemd-udevd[4969]: Using default interface naming scheme 'rhel-8.0'. Nov 4 22:32:13 kjcf05n02 systemd-udevd[4969]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[5082]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 22:32:13 kjcf05n02 mlnx_interface_mgr[5086]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 22:32:13 kjcf05n02 mlnx_conf_mgr[5137]: INFO: No configurations found for mlx5_1, skipping. Nov 4 22:32:13 kjcf05n02 mlnx_conf_mgr[5141]: INFO: No configurations found for mlx5_0, skipping. Nov 4 22:32:13 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 22:32:13 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}8bebdcbd0e888617272161cc3eabde189ad7ed6b3fc811dcdffda93888aa1067' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}8bebdcbd0e888617272161cc3eabde189ad7ed6b3fc811dcdffda93888aa1067' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}3fc395e93f6d8431972104111537fef12e4b85a24a0477a3219c900ee2a7b83c' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}3fc395e93f6d8431972104111537fef12e4b85a24a0477a3219c900ee2a7b83c' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}355e0daa01bb6edee66335e1eea6ab9c35e2ec95be691d8f51944ba8dadb74db' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}355e0daa01bb6edee66335e1eea6ab9c35e2ec95be691d8f51944ba8dadb74db' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}0d6e5ead8a342c7e23971b09cf4cabc8a152cb21beda9659fc7d9fd5f1c16b6f' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}0d6e5ead8a342c7e23971b09cf4cabc8a152cb21beda9659fc7d9fd5f1c16b6f' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 22:32:13 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 4 22:32:13 kjcf05n02 chronyd[2169]: chronyd exiting Nov 4 22:32:13 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 4 22:32:13 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 4 22:32:13 kjcf05n02 chronyd[5175]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 22:32:13 kjcf05n02 chronyd[5175]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 22:32:13 kjcf05n02 chronyd[5175]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 22:32:13 kjcf05n02 chronyd[5175]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 4 22:32:13 kjcf05n02 systemd[1]: Started NTP client/server. Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 22:32:13 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:13 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 4 22:32:13 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 4 22:32:13 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 22:32:13 kjcf05n02 dwd[5206]: dwd: vMay 29 2024 : 15:38:26 Nov 4 22:32:13 kjcf05n02 dwd[5206]: /usr/sbin/dwd -i 15 -d Nov 4 22:32:13 kjcf05n02 dwd[5206]: dwd: option Lethal: 0 Nov 4 22:32:13 kjcf05n02 dwd[5206]: dwd: option Interval: 15 Nov 4 22:32:13 kjcf05n02 dwd[5206]: dwd: option abrtlimit: 10 Nov 4 22:32:13 kjcf05n02 dwd[5206]: dwd: option DZPeriod: 604800 Nov 4 22:32:13 kjcf05n02 dwd[5206]: dwd: option SmartPeriod: 43200 Nov 4 22:32:13 kjcf05n02 dwd[5206]: dwd: option SDDEnabled: 1 Nov 4 22:32:13 kjcf05n02 dwd[5206]: dwd: option SDDAwaitScale: 3 Nov 4 22:32:13 kjcf05n02 dwd[5206]: dwd: option SDDAwaitMin: 100 Nov 4 22:32:13 kjcf05n02 dwd[5206]: dwd: option Verbosity: 1 Nov 4 22:32:13 kjcf05n02 dwd[5206]: dwd: option StandAlone: 0 Nov 4 22:32:13 kjcf05n02 dwd[5206]: option Lethal: 0 Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 22:32:13 kjcf05n02 dwd[5206]: option Interval: 15 Nov 4 22:32:13 kjcf05n02 dwd[5206]: option abrtlimit: 10 Nov 4 22:32:13 kjcf05n02 dwd[5206]: option DZPeriod: 604800 Nov 4 22:32:13 kjcf05n02 dwd[5206]: option SmartPeriod: 43200 Nov 4 22:32:13 kjcf05n02 dwd[5206]: option SDDEnabled: 1 Nov 4 22:32:13 kjcf05n02 dwd[5206]: option SDDAwaitScale: 3 Nov 4 22:32:13 kjcf05n02 dwd[5206]: option SDDAwaitMin: 100 Nov 4 22:32:13 kjcf05n02 dwd[5206]: option Verbosity: 1 Nov 4 22:32:13 kjcf05n02 dwd[5206]: option StandAlone: 0 Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 4 22:32:13 kjcf05n02 dwd[5207]: option Lethal now set to 1 Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 22:32:13 kjcf05n02 dwd[5207]: option abrtlimit now set to 1 Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 22:32:13 kjcf05n02 dwd[5207]: option SmartPeriod now set to 86400 Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 22:32:13 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 22:32:13 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:13 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:13 kjcf05n02 python3.9[5236]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 4 22:32:13 kjcf05n02 python3.9[3196]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 22:32:13 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:13 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 22:32:13 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:13 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 4 22:32:13 kjcf05n02 sedcpwrkr[5375]: Using config script: /etc/sedcpwrkr.conf Nov 4 22:32:13 kjcf05n02 sedcpwrkr[5375]: - Creating default directory: '/var/log/sedcpwrkr' Nov 4 22:32:13 kjcf05n02 sedcpwrkr[5375]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 4 22:32:13 kjcf05n02 sedcpwrkr[5375]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 4 22:32:13 kjcf05n02 sedcpwrkr[5375]: - Creating default directory: '/var/run/sedcpwrkr' Nov 4 22:32:13 kjcf05n02 sedcpwrkr[5375]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 4 22:32:13 kjcf05n02 sedcpwrkr[5375]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 4 22:32:13 kjcf05n02 sedcpwrkr-server[5406]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 22:32:13 kjcf05n02 sedcpwrkr[5375]: celery multi v5.2.7 (dawn-chorus) Nov 4 22:32:13 kjcf05n02 sedcpwrkr[5375]: > Starting nodes... Nov 4 22:32:13 kjcf05n02 sedcpwrkr[5375]: > sedcpwrkr@kjcf05n02: OK Nov 4 22:32:13 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 4 22:32:13 kjcf05n02 sedcpwrkr-server[5408]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 22:32:13 kjcf05n02 sedcpwrkr-server[5408]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 22:32:13 kjcf05n02 sedcpwrkr-server[5408]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 22:32:13 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 22:32:13 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 4 22:32:13 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 22:32:13 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 4 22:32:13 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 4 22:32:14 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:14 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 4 22:32:14 kjcf05n02 systemd-udevd[1557]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 22:32:14 kjcf05n02 iptables.init[5475]: iptables: Applying firewall rules: [ OK ] Nov 4 22:32:14 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 4 22:32:14 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:15 kjcf05n02 systemd[3196]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 22:32:15 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 22:32:15 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 22:32:15 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:15 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 22:32:15 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5572 which is not our child. We'll most likely not notice when it exits. Nov 4 22:32:15 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 22:32:15 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:15 kjcf05n02 openhpid[5572]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 22:32:15 kjcf05n02 openhpid[5572]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 22:32:15 kjcf05n02 openhpid[5572]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 22:32:15 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 4 22:32:16 kjcf05n02 openhpid[5572]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 22:32:16 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:16 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:16 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:16 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 4 22:32:16 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 4 22:32:16 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 22:32:16 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 22:32:16 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:16 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 4 22:32:17 kjcf05n02 dcs-collectord[5663]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 4 22:32:17 kjcf05n02 hpi.inv.log[5663]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 4 22:32:17 kjcf05n02 dcs-collectord[5663]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 4 22:32:17 kjcf05n02 dcs-collectord[5663]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 4 22:32:17 kjcf05n02 dcs-collector[5654]: Starting dcs-collector:[ OK ] Nov 4 22:32:17 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 4 22:32:17 kjcf05n02 dcs-collectord[5666]: INFO Starting collection for memory_info (collection_process.py:52) Nov 4 22:32:17 kjcf05n02 dcs-collectord[5666]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 22:32:17 kjcf05n02 dcs-collectord[5666]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 22:32:17 kjcf05n02 dcs-collectord[5666]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 22:32:17 kjcf05n02 dcs-collectord[5666]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 4 22:32:17 kjcf05n02 dcs-collectord[5666]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 4 22:32:17 kjcf05n02 dcs-collectord[5666]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 4 22:32:17 kjcf05n02 dcs-collectord[5666]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259351300", "units": "kB"}, {"name": "MemAvailable", "value": "258631060", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821280", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686960", "units": "kB"}, {"name": "Inactive", "value": "960008", "units": "kB"}, {"name": "Active(anon)", "value": "1520608", "units": "kB"}, {"name": "Inactive(anon)", "value": "824032", "units": "kB"}, {"name": "Active(file)", "value": "166352", "units": "kB"}, {"name": "Inactive(file)", "value": "135976", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "751848", "units": "kB"}, {"name": "Mapped", "value": "86288", "units": "kB"}, {"name": "Shmem", "value": "1593404", "units": "kB"}, {"name": "KReclaimable", "value": "109348", "units": "kB"}, {"name": "Slab", "value": "273468", "units": "kB"}, {"name": "SReclaimable", "value": "109348", "units": "kB"}, {"name": "SUnreclaim", "value": "164120", "units": "kB"}, {"name": "KernelStack", "value": "9680", "units": "kB"}, {"name": "PageTables", "value": "20604", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3071152", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11392", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "4096", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "264520", "units": "kB"}, {"name": "DirectMap2M", "value": "22669312", "units": "kB"}, {"name": "DirectMap1G", "value": "245366784", "units": "kB"}]}' Nov 4 22:32:17 kjcf05n02 dcs-collectord[5666]: INFO Completed collection for memory_info (collection_process.py:59) Nov 4 22:32:17 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 4 22:32:17 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:17 kjcf05n02 dcs-collectord[5666]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 4 22:32:17 kjcf05n02 dcs-collectord[5666]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730781136.9106593], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730781137.150584], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730781136.8432066, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 4 22:32:17 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:17 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 4 22:32:17 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:17 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:17 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 4 22:32:17 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 4 22:32:17 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 22:32:17 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 22:32:17 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:17 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 4 22:32:17 kjcf05n02 firmware-update-orc[5772]: Using config script: /etc/firmware_update_orc.conf Nov 4 22:32:17 kjcf05n02 firmware-update-orc[5772]: - Creating default directory: '/var/log/firmware-update-orc' Nov 4 22:32:17 kjcf05n02 firmware-update-orc[5772]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 4 22:32:17 kjcf05n02 firmware-update-orc[5772]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 4 22:32:17 kjcf05n02 firmware-update-orc[5772]: - Creating default directory: '/var/run/firmware-update-orc' Nov 4 22:32:17 kjcf05n02 firmware-update-orc[5772]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 4 22:32:17 kjcf05n02 firmware-update-orc[5772]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 4 22:32:18 kjcf05n02 firmware-update-orc-server[5808]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 22:32:18 kjcf05n02 firmware-update-orc[5772]: celery multi v5.2.7 (dawn-chorus) Nov 4 22:32:18 kjcf05n02 firmware-update-orc[5772]: > Starting nodes... Nov 4 22:32:18 kjcf05n02 firmware-update-orc[5772]: > worker1@kjcf05n02: OK Nov 4 22:32:18 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 4 22:32:18 kjcf05n02 firmware-update-orc-server[5812]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 22:32:18 kjcf05n02 firmware-update-orc-server[5812]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 22:32:18 kjcf05n02 firmware-update-orc-server[5812]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 22:32:18 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 4 22:32:18 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:18 kjcf05n02 systemd[3196]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:18 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:18 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:18 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 22:32:18 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 22:32:18 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 22:32:18 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 22:32:18 kjcf05n02 dbus-daemon[2187]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 22:32:18 kjcf05n02 dbus-daemon[2187]: [system] Reloaded configuration Nov 4 22:32:18 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 4 22:32:18 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 4 22:32:18 kjcf05n02 dbus-daemon[2187]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 22:32:18 kjcf05n02 dbus-daemon[2187]: [system] Reloaded configuration Nov 4 22:32:18 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 22:32:18 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 22:32:18 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 22:32:18 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 22:32:19 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:19 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 4 22:32:19 kjcf05n02 ras-resource-manager-agent[5928]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 4 22:32:19 kjcf05n02 ras-resource-manager-agent[5914]: Starting ras-resource-manager-agent:[ OK ] Nov 4 22:32:19 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 4 22:32:19 kjcf05n02 ras-resource-manager-agent[5930]: INFO Starting the service handler (service_main_handler.py:98) Nov 4 22:32:19 kjcf05n02 ras-resource-manager-client[5930]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 4 22:32:19 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 4 22:32:19 kjcf05n02 ras-resource-manager-client[5930]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 22:32:19 kjcf05n02 ras-resource-manager-client[5940]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 22:32:19 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:20 kjcf05n02 systemd[3196]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:20 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:20 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:20 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 22:32:20 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 22:32:20 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:20 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 22:32:20 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:21 kjcf05n02 systemd[3196]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: Press Ctrl+C to exit. Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: Plugin support version 1.0 Nov 4 22:32:21 kjcf05n02 zabbix_agent2[6014]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 22:32:21 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:21 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:21 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:21 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 4 22:32:21 kjcf05n02 dcs-notification-sender[6091]: dcs-notification-senderd is stopped Nov 4 22:32:21 kjcf05n02 zabbix-agent2[6105]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 4 22:32:21 kjcf05n02 dcs-notification-sender[6091]: Starting notification-sender:[ OK ] Nov 4 22:32:21 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 4 22:32:21 kjcf05n00 mcfcli[3673891]: %3|1730781141.067|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 22:32:21 kjcf05n02 zabbix-agent2[6107]: INFO DCS notification agent started. (agent.py:61) Nov 4 22:32:21 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 4 22:32:21 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:22 kjcf05n02 systemd[3196]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:22 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:22 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:22 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:22 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 4 22:32:22 kjcf05n02 dcs-collectord[6213]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 4 22:32:22 kjcf05n02 dcs-collectord[6213]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 4 22:32:22 kjcf05n02 dcs-bulk-data-sender[6213]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 4 22:32:22 kjcf05n02 dcs-bulk-data-sender[6204]: Starting bulk-data-sender:[ OK ] Nov 4 22:32:22 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 4 22:32:22 kjcf05n02 dcs-collectord[6215]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 4 22:32:22 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 4 22:32:22 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:23 kjcf05n02 systemd[3196]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:23 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:23 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:23 kjcf05n02 nscd[2141]: 2141 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 4 22:32:23 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 22:32:23 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 22:32:23 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 22:32:23 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 22:32:23 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 22:32:23 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 22:32:23 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 4 22:32:23 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 4 22:32:23 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 4 22:32:23 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 4 22:32:23 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 22:32:23 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 22:32:23 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 22:32:23 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 22:32:23 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 22:32:23 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 22:32:23 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 22:32:23 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 22:32:23 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 4 22:32:23 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 4 22:32:23 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 4 22:32:23 kjcf05n02 sssd[nss][2515]: Shutting down (status = 0) Nov 4 22:32:23 kjcf05n02 sssd[be[implicit_files]][2378]: Shutting down (status = 0) Nov 4 22:32:23 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 4 22:32:23 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 4 22:32:23 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 4 22:32:24 kjcf05n02 sssd[sssd][6288]: Starting up Nov 4 22:32:24 kjcf05n02 sssd[be[implicit_files]][6289]: Starting up Nov 4 22:32:24 kjcf05n02 python3.9[5236]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 4 22:32:24 kjcf05n02 python3.9[3196]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:24 kjcf05n02 sssd[nss][6300]: Starting up Nov 4 22:32:24 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 4 22:32:24 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 22:32:24 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 22:32:25 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 22:32:25 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 22:32:25 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 4 22:32:25 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 4 22:32:25 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 22:32:25 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 22:32:25 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 4 22:32:25 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 4 22:32:25 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 4 22:32:25 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 4 22:32:25 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 22:32:25 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 22:32:25 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 22:32:25 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 22:32:25 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 4 22:32:25 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 4 22:32:25 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:25 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 4 22:32:26 kjcf05n02 icinga2[6346]: [2024-11-04 22:32:25 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 4 22:32:26 kjcf05n02 icinga2[6346]: [2024-11-04 22:32:25 -0600] information/cli: Loading configuration file(s). Nov 4 22:32:26 kjcf05n02 icinga2[6346]: [2024-11-04 22:32:25 -0600] information/ConfigItem: Committing config item(s). Nov 4 22:32:26 kjcf05n02 icinga2[6346]: [2024-11-04 22:32:25 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 4 22:32:26 kjcf05n02 icinga2[6346]: [2024-11-04 22:32:25 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 4 22:32:26 kjcf05n02 icinga2[6346]: [2024-11-04 22:32:25 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 4 22:32:26 kjcf05n02 icinga2[6346]: [2024-11-04 22:32:25 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 4 22:32:26 kjcf05n02 icinga2[6346]: [2024-11-04 22:32:25 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 4 22:32:26 kjcf05n02 icinga2[6346]: [2024-11-04 22:32:25 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 4 22:32:26 kjcf05n02 icinga2[6346]: [2024-11-04 22:32:25 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 4 22:32:26 kjcf05n02 icinga2[6346]: [2024-11-04 22:32:25 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 4 22:32:26 kjcf05n02 icinga2[6346]: [2024-11-04 22:32:25 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 4 22:32:26 kjcf05n02 icinga2[6346]: [2024-11-04 22:32:25 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 4 22:32:26 kjcf05n02 icinga2[6346]: [2024-11-04 22:32:25 -0600] information/cli: Closing console log. Nov 4 22:32:26 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 4 22:32:26 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:26 kjcf05n02 systemd[3196]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:26 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:26 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:27 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 22:32:27 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 22:32:27 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:27 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 4 22:32:27 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:27 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 22:32:27 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:27 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:28 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 22:32:28 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 22:32:28 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 22:32:28 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 22:32:28 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 4 22:32:28 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 4 22:32:28 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 4 22:32:28 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 4 22:32:28 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 22:32:28 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 22:32:28 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 22:32:28 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 22:32:28 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 4 22:32:28 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 4 22:32:28 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:28 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 4 22:32:28 kjcf05n02 nslcd[6958]: version 0.9.9 starting Nov 4 22:32:28 kjcf05n02 nslcd[6958]: accepting connections Nov 4 22:32:28 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 4 22:32:28 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:29 kjcf05n02 systemd[3196]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:29 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:29 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:29 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 22:32:29 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 22:32:29 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 22:32:29 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 22:32:30 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 22:32:30 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 22:32:30 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 22:32:30 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 22:32:30 kjcf05n02 dcs-bulk-data-sender[6215]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 4 22:32:30 kjcf05n02 dcs-collectord[6215]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 4 22:32:30 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:30 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 4 22:32:30 kjcf05n02 dearcpw[7061]: Using config script: /etc/dearcpw.conf Nov 4 22:32:30 kjcf05n02 dearcpw[7061]: - Creating default directory: '/var/log/dearcpw' Nov 4 22:32:30 kjcf05n02 dearcpw[7061]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 4 22:32:30 kjcf05n02 dearcpw[7061]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 4 22:32:30 kjcf05n02 dearcpw[7061]: - Creating default directory: '/var/run/dearcpw' Nov 4 22:32:30 kjcf05n02 dearcpw[7061]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 4 22:32:30 kjcf05n02 dearcpw[7061]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 4 22:32:31 kjcf05n02 dearcpw-server[7101]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 22:32:31 kjcf05n02 dearcpw[7061]: celery multi v5.2.7 (dawn-chorus) Nov 4 22:32:31 kjcf05n02 dearcpw[7061]: > Starting nodes... Nov 4 22:32:31 kjcf05n02 dearcpw[7061]: > dearcpw@kjcf05n02: OK Nov 4 22:32:31 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 4 22:32:31 kjcf05n02 dearcpw-server[7103]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 22:32:31 kjcf05n02 dearcpw-server[7103]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 22:32:31 kjcf05n02 dearcpw-server[7103]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 22:32:31 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 4 22:32:31 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:31 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:31 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 4 22:32:31 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 4 22:32:31 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 4 22:32:31 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 4 22:32:31 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 4 22:32:31 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 4 22:32:31 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 4 22:32:31 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 4 22:32:31 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 4 22:32:31 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 4 22:32:31 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:55348). Nov 4 22:32:31 kjcf05n01 rsyncd[3933665]: connect from kjcf05n02 (172.16.2.5) Nov 4 22:32:31 kjcf05n01 rsyncd[3933665]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 4 22:32:31 kjcf05n01 rsyncd[3933665]: receiving file list Nov 4 22:32:31 kjcf05n01 rsyncd[3933665]: sent 29 bytes received 325 bytes total size 10905 Nov 4 22:32:31 kjcf05n01 systemd[1]: rsyncd@670-172.16.2.2:873-172.16.2.5:55348.service: Succeeded. Nov 4 22:32:31 kjcf05n02 puppet[7143]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 4 22:32:31 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 4 22:32:31 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 4 22:32:31 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 4 22:32:31 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 4 22:32:31 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 4 22:32:31 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 4 22:32:31 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 22:32:31 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 22:32:32 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 22:32:32 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 22:32:32 kjcf05n02 dcs-collectord[5666]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 22:32:32 kjcf05n02 dcs-collectord[5666]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 22:32:32 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 22:32:32 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 22:32:32 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 22:32:32 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 22:32:33 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 22:32:33 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 22:32:33 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 22:32:33 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 22:32:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 22:32:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 22:32:33 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 22:32:33 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 22:32:33 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 22:32:33 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 22:32:34 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 22:32:34 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 22:32:34 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:34 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 4 22:32:34 kjcf05n02 diskless-swap[7226]: HA_PS_000: recovering journal Nov 4 22:32:34 kjcf05n02 systemd-udevd[1557]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 22:32:34 kjcf05n02 diskless-swap[7226]: HA_PS_000: clean, 2292/6400 files, 7091/25600 blocks Nov 4 22:32:34 kjcf05n02 diskless-swap[7226]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 4 22:32:35 kjcf05n02 diskless-swap[7226]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 4 22:32:35 kjcf05n02 diskless-swap[7226]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 4 22:32:35 kjcf05n02 diskless-swap[7226]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 4 22:32:35 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 4 22:32:35 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:35 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:35 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 4 22:32:35 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 4 22:32:35 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 22:32:35 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 22:32:35 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 4 22:32:35 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 4 22:32:35 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 4 22:32:35 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 4 22:32:35 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 4 22:32:35 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 4 22:32:35 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 4 22:32:35 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 4 22:32:35 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 4 22:32:35 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 4 22:32:35 kjcf05n02 ipmievd[4008]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 4 22:32:35 kjcf05n02 ipmievd[4008]: System Event sensor - Timestamp Clock Sync Nov 4 22:32:35 kjcf05n02 ipmievd[3196]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:35 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 22:32:35 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 22:32:36 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 22:32:36 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 22:32:36 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 22:32:36 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 22:32:37 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 22:32:37 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 22:32:37 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 22:32:37 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 22:32:37 kjcf05n00 mcfcli[3673891]: %3|1730781157.201|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 22:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 22:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 22:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 22:32:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 22:32:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 22:32:37 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 22:32:37 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 22:32:37 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 22:32:37 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 22:32:38 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 22:32:38 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 22:32:38 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 22:32:38 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 22:32:38 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:38 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 4 22:32:38 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:38 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:38 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 4 22:32:38 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 4 22:32:38 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:39 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 4 22:32:39 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:39 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:39 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 22:32:39 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 22:32:39 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:39 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 4 22:32:39 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:39 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:39 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 4 22:32:39 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 4 22:32:39 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 4 22:32:39 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 4 22:32:39 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 4 22:32:39 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 4 22:32:39 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 22:32:39 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 22:32:39 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 22:32:39 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 22:32:39 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:39 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 4 22:32:39 kjcf05n02 kdumpctl[7848]: kdump: No kdump initial ramdisk found. Nov 4 22:32:39 kjcf05n02 kdumpctl[7848]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 4 22:32:40 kjcf05n02 dracut[7974]: dracut-049-135.git20210121.el8 Nov 4 22:32:40 kjcf05n02 dracut[7977]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 4 22:32:40 kjcf05n02 dracut[7977]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 22:32:40 kjcf05n02 dracut[7977]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 22:32:40 kjcf05n02 dracut[7977]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 4 22:32:40 kjcf05n02 dracut[7977]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 4 22:32:40 kjcf05n02 dracut[7977]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 22:32:40 kjcf05n02 dracut[7977]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 22:32:40 kjcf05n02 dracut[7977]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + is_func check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ type -t check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 0 -ne 0 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check -h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local dev holder Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + require_binaries mdadm expr Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _module_name=90hperaid Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ mdadm = \-\m ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for cmd in "$@" Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + find_binary mdadm Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for cmd in "$@" Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + find_binary expr Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n -h ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for dev in "${!host_fs_types[@]}" Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ nfs != *_raid_member ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + continue Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _ret=255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + ret=255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ 255 = 0 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ 255 = 255 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ module_depends hperaid Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: +++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: +++ set -x Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ depends Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo rootfs-block Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ return 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ _ret=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ return 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for _moddep in $(module_depends $_mod) Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all == *\ hperaid\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + add_dracutmodules+=' rootfs-block ' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ == *\ hperaid\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check_module rootfs-block Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _mod=rootfs-block Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddep Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ == *\ rootfs-block\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n '' ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + mods_checked_as_dep+=' rootfs-block ' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all == *\ rootfs-block\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + module_check rootfs-block 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 22:32:40 kjcf05n02 kdumpctl[3196]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _forced=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 2 -eq 2 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _forced=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + is_func check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ type -t check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 0 -ne 0 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check -h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _ret=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + ret=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ 0 = 0 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ module_depends rootfs-block Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: +++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 22:32:40 kjcf05n02 kdumpctl[3196]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ depends Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo fs-lib Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ _ret=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ return 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for _moddep in $(module_depends $_mod) Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all == *\ rootfs-block\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + add_dracutmodules+=' fs-lib ' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ == *\ rootfs-block\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check_module fs-lib Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _mod=fs-lib Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddep Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n '' ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + mods_checked_as_dep+=' fs-lib ' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all == *\ fs-lib\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + module_check fs-lib 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _forced=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 2 -eq 2 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _forced=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + is_func check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ type -t check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 0 -ne 0 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check -h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _ret=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + ret=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ 0 = 0 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ module_depends fs-lib Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: +++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ depends Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ return 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ _ret=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ return 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + mods_to_load+=' fs-lib ' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + mods_to_load+=' rootfs-block ' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + mods_to_load+=' hperaid ' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _mod=90kernel-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _mod=kernel-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check_module kernel-modules 1 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _mod=kernel-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddep Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n 1 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all = all ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + module_check kernel-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _forced=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 1 -eq 2 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + is_func check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ type -t check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 0 -ne 0 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check -h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + true Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _ret=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + ret=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ 0 != 0 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ module_depends kernel-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: +++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ depends Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ true Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ _ret=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ return 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + mods_to_load+=' kernel-modules ' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _mod=90kernel-modules-extra Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _mod=kernel-modules-extra Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check_module kernel-modules-extra 1 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _mod=kernel-modules-extra Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddep Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n 1 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all = all ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + module_check kernel-modules-extra Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _forced=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 1 -eq 2 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + is_func check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ type -t check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 0 -ne 0 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check -h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + true Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _ret=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + ret=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ 0 != 0 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ module_depends kernel-modules-extra Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: +++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ depends Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ true Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ _ret=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ return 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + mods_to_load+=' kernel-modules-extra ' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _mod=90kernel-network-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _mod=kernel-network-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check_module kernel-network-modules 1 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _mod=kernel-network-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddep Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n 1 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all = all ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + module_check kernel-network-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _forced=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 1 -eq 2 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + is_func check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ type -t check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 0 -ne 0 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check -h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _ret=255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + ret=255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ 255 != 0 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n 1 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 1 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _mod=90livenet Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _mod=livenet Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check_module livenet 1 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _mod=livenet Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddep Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n 1 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all = all ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + module_check livenet Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _forced=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 1 -eq 2 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + is_func check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ type -t check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 0 -ne 0 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check -h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _ret=255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + ret=255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ 255 != 0 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n 1 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 1 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _mod=90lvm Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _mod=lvm Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check_module lvm 1 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _mod=lvm Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddep Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n 1 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all = all ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + module_check lvm Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _forced=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 1 -eq 2 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + is_func check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ type -t check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 0 -ne 0 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check -h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + require_binaries lvm Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _module_name=90lvm Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ lvm = \-\m ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for cmd in "$@" Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + find_binary lvm Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n -h ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for fs in "${host_fs_types[@]}" Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ nfs = LVM*_member ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _ret=255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + ret=255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ 255 != 0 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n 1 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 1 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _mod=90mdraid Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _mod=mdraid Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check_module mdraid 1 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _mod=mdraid Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddep Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n 1 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all = all ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + module_check mdraid Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _forced=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 1 -eq 2 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + is_func check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ type -t check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 0 -ne 0 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check -h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _rootdev Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + require_binaries mdadm expr Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _module_name=90mdraid Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ mdadm = \-\m ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for cmd in "$@" Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + find_binary mdadm Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for cmd in "$@" Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + find_binary expr Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n -h ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for dev in "${!host_fs_types[@]}" Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ nfs != *_raid_member ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + continue Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _ret=255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + ret=255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ 255 != 0 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n 1 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 1 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _mod=90multipath Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _mod=multipath Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check_module multipath 1 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _mod=multipath Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddep Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n 1 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all = all ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + module_check multipath Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _forced=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 1 -eq 2 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + is_func check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ type -t check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 0 -ne 0 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check -h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _rootdev Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n -h ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for_each_host_dev_and_slaves is_mpath Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _func=is_mpath Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _dev Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for _dev in "${host_devs[@]}" Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + continue Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 1 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _ret=255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + ret=255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ 255 != 0 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n 1 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 1 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _mod=90qemu Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _mod=qemu Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check_module qemu 1 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _mod=qemu Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddep Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n 1 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all = all ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + module_check qemu Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _forced=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 1 -eq 2 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + is_func check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ type -t check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 0 -ne 0 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check -h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n -h ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + type -P systemd-detect-virt Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ systemd-detect-virt --vm Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + vm=none Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + (( 1 != 0 )) Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _ret=255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + ret=255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ 255 != 0 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n 1 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 1 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _mod=90qemu-net Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _mod=qemu-net Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check_module qemu-net 1 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _mod=qemu-net Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddep Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n 1 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all = all ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + module_check qemu-net Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _forced=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 1 -eq 2 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + is_func check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ type -t check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 0 -ne 0 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check -h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n -h ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + type -P systemd-detect-virt Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ systemd-detect-virt --vm Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + vm= Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + (( 1 != 0 )) Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _ret=255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + ret=255 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ 255 != 0 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n 1 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + return 1 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _mod=90stratis Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + _mod=stratis Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check_module stratis 1 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _mod=stratis Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddep Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -n 1 ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ all = all ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + module_check stratis Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ read a b Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _forced=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _hostonly=-h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 1 -eq 2 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + is_func check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: ++ type -t check Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + '[' 0 -ne 0 ']' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + check -h Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _module_name=90stratis Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + local _ret=0 Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + [[ stratisd-init = \-\m ]] Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + for cmd in "$@" Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + find_binary stratisd-init Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 4 22:32:40 kjcf05n02 kdumpctl[7848]: + set +x Nov 4 22:32:40 kjcf05n02 dracut[7977]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 22:32:40 kjcf05n02 dracut[7977]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 4 22:32:40 kjcf05n02 dracut[7977]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 4 22:32:41 kjcf05n02 dracut[7977]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 4 22:32:41 kjcf05n02 dracut[7977]: memstrack is available Nov 4 22:32:41 kjcf05n02 dracut[7977]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 22:32:41 kjcf05n02 dracut[7977]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 22:32:41 kjcf05n02 dracut[7977]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 22:32:41 kjcf05n02 dracut[7977]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 22:32:41 kjcf05n02 dracut[7977]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 22:32:41 kjcf05n02 dracut[7977]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 22:32:41 kjcf05n02 dracut[7977]: *** Including module: bash *** Nov 4 22:32:41 kjcf05n02 dracut[7977]: *** Including module: systemd *** Nov 4 22:32:42 kjcf05n02 dracut[7977]: *** Including module: fips *** Nov 4 22:32:42 kjcf05n02 dracut[7977]: *** Including module: systemd-initrd *** Nov 4 22:32:42 kjcf05n02 dracut[7977]: *** Including module: watchdog-modules *** Nov 4 22:32:42 kjcf05n02 dracut[7977]: *** Including module: nss-softokn *** Nov 4 22:32:42 kjcf05n02 dracut[7977]: *** Including module: i18n *** Nov 4 22:32:42 kjcf05n02 dracut[7977]: No KEYMAP configured. Nov 4 22:32:43 kjcf05n02 dracut[7977]: *** Including module: network-legacy *** Nov 4 22:32:43 kjcf05n02 dracut[7977]: *** Including module: network *** Nov 4 22:32:43 kjcf05n02 dracut[7977]: *** Including module: ib_bonding *** Nov 4 22:32:43 kjcf05n02 dracut[7977]: *** Including module: drm *** Nov 4 22:32:46 kjcf05n02 dracut[7977]: *** Including module: hperaid *** Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + install Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + local rule rule_path Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + inst_multiple cat expr Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.cFyy9a/initramfs -a -f cat expr Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + _ret=0 Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + (( 0 != 0 )) Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + : Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + return 0 Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + inst_multiple -o mdmon Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.cFyy9a/initramfs -a -f -o mdmon Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + _ret=0 Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + (( 0 != 0 )) Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + : Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + return 0 Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: ++ command -v partx Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + inst /usr/sbin/partx /sbin/partx Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + local _hostonly_install Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + [[ /usr/sbin/partx == \-\H ]] Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + [[ -e /tmp/dracut.cFyy9a/initramfs//sbin/partx ]] Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.cFyy9a/initramfs -f /usr/sbin/partx /sbin/partx Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + (( 0 != 0 )) Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + : Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: ++ command -v mdadm Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + local _hostonly_install Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + [[ -e /tmp/dracut.cFyy9a/initramfs//sbin/mdadm ]] Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.cFyy9a/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + (( 0 != 0 )) Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + : Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + [[ yes == \y\e\s ]] Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + local _raidconf Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: ++ cmdline Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: ++ local _activated dev line UUID Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: ++ declare -A _activated Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: ++ for dev in "${!host_fs_types[@]}" Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: ++ [[ nfs != *_raid_member ]] Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: ++ continue Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + _raidconf= Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + [[ -n '' ]] Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + inst_rules 64-md-raid.rules Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + local _target=/etc/udev/rules.d _rule _found Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + inst_dir /usr/lib/udev/rules.d Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + [[ -e /tmp/dracut.cFyy9a/initramfs//usr/lib/udev/rules.d ]] Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + return 0 Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + inst_dir /etc/udev/rules.d Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + [[ -e /tmp/dracut.cFyy9a/initramfs//etc/udev/rules.d ]] Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + return 0 Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + for _rule in "$@" Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + continue Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + continue Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + for r in '' $dracutbasedir/rules.d/ Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + [[ 64-md-raid.rules != /* ]] Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + continue Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + for r in '' $dracutbasedir/rules.d/ Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + continue Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + [[ -n '' ]] Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 4 22:32:46 kjcf05n02 kdumpctl[7848]: + set +x Nov 4 22:32:46 kjcf05n02 dracut[7977]: Skipping udev rule: 64-md-raid.rules Nov 4 22:32:47 kjcf05n02 dcs-collectord[5666]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 22:32:47 kjcf05n02 dcs-collectord[5666]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + installkernel Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + instmods =drivers/md Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + local _optional=-o Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + local _silent Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + local _ret Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + [[ '' = yes ]] Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + [[ =drivers/md = \-\c ]] Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + [[ =drivers/md = \-\s ]] Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + (( 1 == 0 )) Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.cFyy9a/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + _ret=0 Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + (( 0 != 0 )) Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + [[ -n '' ]] Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + return 0 Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + _ret=0 Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + unset check depends cmdline install installkernel Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + return 0 Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + modules_loaded+='hperaid ' Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + '[' -n '' ']' Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + _d_mod=90kernel-modules Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + _d_mod=kernel-modules Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + [[ '' = yes ]] Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + dinfo '*** Including module: kernel-modules ***' Nov 4 22:32:47 kjcf05n02 kdumpctl[7848]: + set +x Nov 4 22:32:47 kjcf05n02 dracut[7977]: *** Including module: kernel-modules *** Nov 4 22:32:47 kjcf05n02 dracut[7977]: *** Including module: kernel-modules-extra *** Nov 4 22:32:47 kjcf05n02 dracut[7977]: *** Including module: kernel-network-modules *** Nov 4 22:32:47 kjcf05n02 dracut[7977]: *** Including module: diskless-mod *** Nov 4 22:32:47 kjcf05n02 dracut[7977]: *** Including module: fstab-sys *** Nov 4 22:32:47 kjcf05n02 dracut[7977]: *** Including module: nfs *** Nov 4 22:32:48 kjcf05n02 dracut[7977]: *** Including module: rootfs-block *** Nov 4 22:32:48 kjcf05n02 dracut[7977]: *** Including module: terminfo *** Nov 4 22:32:48 kjcf05n02 dracut[7977]: *** Including module: udev-rules *** Nov 4 22:32:48 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 4 22:32:48 kjcf05n02 dracut[7977]: Skipping udev rule: 91-permissions.rules Nov 4 22:32:48 kjcf05n02 dracut[7977]: Skipping udev rule: 80-drivers-modprobe.rules Nov 4 22:32:48 kjcf05n02 dracut[7977]: *** Including module: dracut-systemd *** Nov 4 22:32:49 kjcf05n02 dracut[7977]: *** Including module: usrmount *** Nov 4 22:32:49 kjcf05n02 dracut[7977]: *** Including module: base *** Nov 4 22:32:49 kjcf05n02 dracut[7977]: *** Including module: fs-lib *** Nov 4 22:32:49 kjcf05n02 dracut[7977]: *** Including module: kdumpbase *** Nov 4 22:32:50 kjcf05n02 dracut[7977]: *** Including module: memstrack *** Nov 4 22:32:50 kjcf05n02 dracut[7977]: *** Including module: shutdown *** Nov 4 22:32:50 kjcf05n02 dracut[7977]: *** Including module: squash *** Nov 4 22:32:50 kjcf05n02 dracut[7977]: *** Including modules done *** Nov 4 22:32:50 kjcf05n02 dracut[7977]: *** Installing kernel module dependencies *** Nov 4 22:32:50 kjcf05n02 dracut[7977]: *** Installing kernel module dependencies done *** Nov 4 22:32:50 kjcf05n02 dracut[7977]: *** Resolving executable dependencies *** Nov 4 22:32:51 kjcf05n00 mcfcli[3673891]: %3|1730781171.068|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 22:32:51 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 4 22:32:52 kjcf05n02 dracut[7977]: *** Resolving executable dependencies done*** Nov 4 22:32:52 kjcf05n02 dracut[7977]: *** Hardlinking files *** Nov 4 22:32:52 kjcf05n02 dracut[7977]: *** Hardlinking files done *** Nov 4 22:32:52 kjcf05n02 dracut[7977]: *** Generating early-microcode cpio image *** Nov 4 22:32:52 kjcf05n02 dracut[7977]: *** Constructing AuthenticAMD.bin **** Nov 4 22:32:52 kjcf05n02 dracut[7977]: *** Store current command line parameters *** Nov 4 22:32:52 kjcf05n02 dracut[7977]: Stored kernel commandline: Nov 4 22:32:52 kjcf05n02 dracut[7977]: rd.driver.pre=sd_mod Nov 4 22:32:52 kjcf05n02 dracut[7977]: rd.driver.pre=nvme Nov 4 22:32:52 kjcf05n02 dracut[7977]: rd.driver.pre=ipmi_si Nov 4 22:32:52 kjcf05n02 dracut[7977]: rd.driver.pre=ipmi_devintf Nov 4 22:32:52 kjcf05n02 dracut[7977]: rd.driver.pre=ipmi_msghandler Nov 4 22:32:52 kjcf05n02 dracut[7977]: nameserver=172.16.2.2 Nov 4 22:32:52 kjcf05n02 dracut[7977]: nameserver=127.0.0.1 Nov 4 22:32:52 kjcf05n02 dracut[7977]: nameserver=172.16.2.2 Nov 4 22:32:52 kjcf05n02 dracut[7977]: nameserver=127.0.0.1 Nov 4 22:32:52 kjcf05n02 dracut[7977]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 4 22:32:52 kjcf05n02 dracut[7977]: rd.neednet Nov 4 22:32:52 kjcf05n02 dracut[7977]: kdumpnic=mgmt0 Nov 4 22:32:52 kjcf05n02 dracut[7977]: bootdev=mgmt0 Nov 4 22:32:52 kjcf05n02 dracut[7977]: *** Install squash loader *** Nov 4 22:32:52 kjcf05n02 dracut[7977]: *** Squashing the files inside the initramfs *** Nov 4 22:32:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730781172', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(0.0B/0.0B), ib1=(0.0B/0.0B), icl0=(4.4kB/5.9kB), lo=(500.0B/500.0B), meth0=(1540.9MB/7.5MB), mgmt0=(1477.8MB/7.5MB)'}"] Nov 4 22:32:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(0.0B/0.0B), ib1=(0.0B/0.0B), icl0=(4.4kB/5.9kB), lo=(500.0B/500.0B), meth0=(1540.9MB/7.5MB), mgmt0=(1477.8MB/7.5MB)', 'message': 'NET OK - (Rx/Tx) ib0=(0.0B/0.0B), ib1=(0.0B/0.0B), icl0=(4.4kB/5.9kB), lo=(500.0B/500.0B), meth0=(1540.9MB/7.5MB), mgmt0=(1477.8MB/7.5MB)', 'value': 'ok', 'timestamp': '1730781172'} Nov 4 22:32:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:32:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730781172', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128555 MiB (99.93% inode=100%);'}"] Nov 4 22:32:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128555 MiB (99.93% inode=100%);', 'message': 'DISK OK - free space: /tmp 128555 MiB (99.93% inode=100%);', 'value': 'ok', 'timestamp': '1730781172'} Nov 4 22:32:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:32:53 kjcf05n02 dracut[7977]: *** Squashing the files inside the initramfs done *** Nov 4 22:32:53 kjcf05n02 dracut[7977]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 4 22:32:53 kjcf05n02 dracut[7977]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 4 22:32:54 kjcf05n02 kdumpctl[7848]: kdump: kexec: loaded kdump kernel Nov 4 22:32:54 kjcf05n02 kdumpctl[7848]: kdump: Starting kdump: [OK] Nov 4 22:32:54 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 4 22:32:54 kjcf05n02 systemd[1]: Reloading. Nov 4 22:32:54 kjcf05n02 systemd[3196]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:32:54 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:32:54 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:32:54 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 4 22:32:54 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 4 22:32:54 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 4 22:32:54 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 4 22:32:54 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 4 22:32:54 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 4 22:32:54 kjcf05n02 ifdown[14564]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 22:32:54 kjcf05n02 ifdown[14565]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:32:54 kjcf05n02 ifdown[14566]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:32:54 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 22:32:54 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 22:32:54 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 22:32:55 kjcf05n02 ifup[14626]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 22:32:55 kjcf05n02 ifup[14627]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:32:55 kjcf05n02 ifup[14628]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:32:54 kjcf05n00 zabbix-server[2505936]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:32:55 kjcf05n00 zabbix-server[2505936]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:51\\"}}"' Nov 4 22:32:55 kjcf05n00 log_interesting_event.py[2505936]: Event '46759' acknowledged Nov 4 22:32:55 kjcf05n00 zabbix-server[2505937]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:32:55 kjcf05n00 zabbix-server[2505937]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 4 22:32:55 kjcf05n00 log_interesting_event.py[2505937]: Event '46761' acknowledged Nov 4 22:32:55 kjcf05n00 zabbix-server[2505943]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:32:55 kjcf05n00 zabbix-server[2505943]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 4 22:32:55 kjcf05n00 log_interesting_event.py[2505943]: Event '46762' acknowledged Nov 4 22:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 22:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 22:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 22:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 22:32:57 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 4 22:32:59 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 22:32:59 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 22:32:59 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 22:32:59 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:32:59 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:32:59 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:32:59 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:32:59 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 22:32:59 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 22:32:59 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 22:32:59 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 22:32:59 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:32:59 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:32:59 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:32:59 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:32:59 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 4 22:32:59 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 4 22:32:59 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 4 22:32:59 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 4 22:32:59 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 4 22:32:59 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 4 22:32:59 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 4 22:32:59 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 4 22:32:59 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 4 22:32:59 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 4 22:32:59 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 4 22:32:59 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 4 22:32:59 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 4 22:32:59 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 4 22:32:59 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 4 22:32:59 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 4 22:32:59 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 4 22:32:59 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 4 22:32:59 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 4 22:32:59 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 4 22:32:59 kjcf05n02 ifdown[14816]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 22:32:59 kjcf05n02 ifdown[14817]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:32:59 kjcf05n02 ifdown[14818]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:32:59 kjcf05n02 ifup[14878]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 22:32:59 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 22:32:59 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 22:32:59 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 22:32:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 22:32:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 22:32:59 kjcf05n02 ifup[14879]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:32:59 kjcf05n02 ifup[14880]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:32:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 22:32:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 22:33:02 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 4 22:33:02 kjcf05n02 dcs-collectord[5666]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 22:33:02 kjcf05n02 dcs-collectord[5666]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 22:33:04 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 22:33:04 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 22:33:04 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 22:33:04 kjcf05n02 systemd[1]: Reloading. Nov 4 22:33:04 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 4 22:33:04 kjcf05n02 await_ha_peer[15095]: Waiting for HA peer kjcf05n03 Nov 4 22:33:06 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 4 22:33:06 kjcf05n02 await_ha_peer[15095]: Peer kjcf05n03 has started, starting HA Nov 4 22:33:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730781185', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 3.50, 2.27, 0.97'}"] Nov 4 22:33:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 3.50, 2.27, 0.97', 'message': 'OK - load average: 3.50, 2.27, 0.97', 'value': 'ok', 'timestamp': '1730781185'} Nov 4 22:33:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:33:06 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 4 22:33:06 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 4 22:33:06 kjcf05n02 fstonithd.py[15153]: Listening for kdump packets from partner Nov 4 22:33:06 kjcf05n02 systemd[1]: Reloading. Nov 4 22:33:06 kjcf05n02 systemd[3196]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:33:06 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:33:06 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:33:06 kjcf05n02 systemd[1]: Reloading. Nov 4 22:33:07 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 4 22:33:07 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 4 22:33:07 kjcf05n02 systemd[1]: Reloading. Nov 4 22:33:07 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 22:33:07 kjcf05n02 puppet-agent[3621]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 4 22:33:07 kjcf05n02 puppet[3621]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 4 22:33:07 kjcf05n02 puppet-agent[3621]: Applied catalog in 90.56 seconds Nov 4 22:33:07 kjcf05n02 puppet[3621]: Notice: Applied catalog in 90.56 seconds Nov 4 22:33:07 kjcf05n02 systemd[1]: Started Puppet agent. Nov 4 22:33:07 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 4 22:33:07 kjcf05n02 systemd[1]: Reached target Timers. Nov 4 22:33:07 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 4 22:33:07 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 4 22:33:07 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 4 22:33:07 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 4 22:33:07 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 4 22:33:07 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 22:33:07 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 4 22:33:07 kjcf05n02 wce-disable.sh[15292]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 4 22:33:07 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 4 22:33:07 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 4 22:33:07 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 22:33:07 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 22:33:07 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 4 22:33:07 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 4 22:33:08 kjcf05n02 python3.9[15294]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 4 22:33:08 kjcf05n02 python3.9[15294]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 4 22:33:08 kjcf05n02 gateway-ec-node.py[15295]: Starting gateway-ec-node service Nov 4 22:33:08 kjcf05n02 RFSF-API[15293]: INFO[2024-11-04T22:33:07-06:00] Datapath API RESTful Service starting Nov 4 22:33:08 kjcf05n02 dp-api-server-node[15293]: INFO[2024-11-04T22:33:07-06:00] Datapath API RESTful Service starting Nov 4 22:33:08 kjcf05n02 RFSF-API[15293]: INFO[2024-11-04T22:33:07-06:00] Running in production mode, starting dbus event listener Nov 4 22:33:08 kjcf05n02 dp-api-server-node[15293]: INFO[2024-11-04T22:33:07-06:00] Running in production mode, starting dbus event listener Nov 4 22:33:08 kjcf05n02 RFSF-API[15293]: INFO[2024-11-04T22:33:07-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 22:33:08 kjcf05n02 dp-api-server-node[15293]: INFO[2024-11-04T22:33:07-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 22:33:08 kjcf05n02 RFSF-API[15293]: INFO[2024-11-04T22:33:07-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 22:33:08 kjcf05n02 dp-api-server-node[15293]: INFO[2024-11-04T22:33:07-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 22:33:08 kjcf05n02 RFSF-API[15293]: INFO[2024-11-04T22:33:07-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 22:33:08 kjcf05n02 dp-api-server-node[15293]: INFO[2024-11-04T22:33:07-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 22:33:08 kjcf05n02 RFSF-API[15293]: INFO[2024-11-04T22:33:07-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 22:33:08 kjcf05n02 dp-api-server-node[15293]: INFO[2024-11-04T22:33:07-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 22:33:08 kjcf05n02 RFSF-API[15293]: INFO[2024-11-04T22:33:07-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 22:33:08 kjcf05n02 dp-api-server-node[15293]: INFO[2024-11-04T22:33:07-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 22:33:08 kjcf05n02 RFSF-API[15293]: INFO[2024-11-04T22:33:07-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 22:33:08 kjcf05n02 dp-api-server-node[15293]: INFO[2024-11-04T22:33:07-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 22:33:08 kjcf05n02 RFSF-API[15293]: INFO[2024-11-04T22:33:07-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 22:33:08 kjcf05n02 dp-api-server-node[15293]: INFO[2024-11-04T22:33:07-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 22:33:08 kjcf05n02 RFSF-API[15293]: INFO[2024-11-04T22:33:07-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 22:33:08 kjcf05n02 dp-api-server-node[15293]: INFO[2024-11-04T22:33:07-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 22:33:08 kjcf05n02 RFSF-API[15293]: INFO[2024-11-04T22:33:07-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 22:33:08 kjcf05n02 dp-api-server-node[15293]: INFO[2024-11-04T22:33:07-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 22:33:08 kjcf05n02 RFSF-API[15293]: INFO[2024-11-04T22:33:07-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 22:33:08 kjcf05n02 dp-api-server-node[15293]: INFO[2024-11-04T22:33:07-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 22:33:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730781189', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 339 processes with STATE = RSZDT '}"] Nov 4 22:33:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 339 processes with STATE = RSZDT ', 'message': 'PROCS OK: 339 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730781189'} Nov 4 22:33:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:33:12 kjcf05n02 systemd[1]: Reloading. Nov 4 22:33:12 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 22:33:12 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 4 22:33:12 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 4 22:33:13 kjcf05n02 diskmonitor_pre[15872]: Key management is currently disabled.DEAR disabled Nov 4 22:33:13 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 4 22:33:15 kjcf05n02 sh[15868]: LNET configured: New Created Nov 4 22:33:15 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 4 22:33:15 kjcf05n02 LCNmon[17919]: Interface ib0 is up Nov 4 22:33:15 kjcf05n02 LCNmon[17919]: Interface ib1 is up Nov 4 22:33:17 kjcf05n02 dcs-collectord[5666]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 22:33:17 kjcf05n02 dcs-collectord[5666]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 22:33:17 kjcf05n02 dcs-collectord[5666]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 22:33:17 kjcf05n00 mcfcli[3673891]: %3|1730781197.198|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: /var/run/diskmonitor does not exist, creating Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: Creating /var/run/diskmonitor/disk Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: Creating /var/run/diskmonitor/encl Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: Creating /var/run/diskmonitor/cli Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: RAS_Interlocks_enabled: 1 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: Using default ssd ids: HUSSL4010ASS600 , Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: add handler for sig: 14 sa_flags: 10000004 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: add handler for sig: 1 sa_flags: 10000004 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: add handler for sig: 2 sa_flags: 00000004 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: add handler for sig: 15 sa_flags: 00000004 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: add handler for sig: 6 sa_flags: 00000004 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: add handler for sig: 3 sa_flags: 00000004 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: add handler for sig: 30 sa_flags: 00000004 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: add handler for sig: 20 sa_flags: 00000004 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: add handler for sig: 10 sa_flags: 10000004 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: add handler for sig: 11 sa_flags: 00000004 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: add handler for sig: 7 sa_flags: 00000004 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: add handler for sig: 4 sa_flags: 00000004 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: add handler for sig: 8 sa_flags: 00000004 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: init_watch: /var/run/diskmonitor/encl initialized Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: init_watch: /var/run/diskmonitor/disk initialized Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: Using HA Baton locks - key: diskmonitor Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: Baton will be held for at most 570 seconds Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: DMMP Enabled: 0 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: random seed: 4c81b3d0 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: NVMe Enclosure: 1 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: ZFS Enclosure: 0 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: Dbus, Initialized Connection Successfully Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: int_catcher_thread: thread start Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: Received dbus message 4 org.freedesktop.DBus -> :1.96 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 4 22:33:17 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 22:33:17 kjcf05n00 httpd[1812018]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 4 22:33:18 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 4 22:33:19 kjcf05n02 LCNmon[17919]: 10.16.100.54 is unreachable via ib0 Nov 4 22:33:19 kjcf05n02 LCNmon[17919]: 10.16.100.55 is unreachable via ib0 Nov 4 22:33:19 kjcf05n02 LCNmon[17919]: 10.16.100.56 is unreachable via ib0 Nov 4 22:33:19 kjcf05n02 LCNmon[17919]: 10.16.100.57 is unreachable via ib0 Nov 4 22:33:19 kjcf05n02 LCNmon[17919]: 10.16.100.61 is unreachable via ib0 Nov 4 22:33:19 kjcf05n02 LCNmon[17919]: Can ping through interface ib0 Nov 4 22:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730781199', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.7% (4376968 kB) used.'}"] Nov 4 22:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.7% (4376968 kB) used.', 'message': 'OK - 1.7% (4376968 kB) used.', 'value': 'ok', 'timestamp': '1730781199'} Nov 4 22:33:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:33:21 kjcf05n00 mcfcli[3673891]: %3|1730781201.157|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 22:33:21 kjcf05n02 openhpid[5572]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 4 22:33:21 kjcf05n02 openhpid[5572]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 4 22:33:21 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 4 22:33:21 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 4 22:33:21 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 22:33:22 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18572 which is not our child. We'll most likely not notice when it exits. Nov 4 22:33:22 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 22:33:22 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 4 22:33:22 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 4 22:33:22 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 4 22:33:22 kjcf05n02 dcs-collectord[5666]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 4 22:33:22 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 4 22:33:22 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 4 22:33:22 kjcf05n02 systemd[1]: Startup finished in 50.734s (kernel) + 2min 28.515s (userspace) = 3min 19.250s. Nov 4 22:33:22 kjcf05n02 openhpid[18572]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 22:33:22 kjcf05n02 openhpid[18572]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 22:33:22 kjcf05n02 openhpid[18572]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 22:33:22 kjcf05n02 openhpid[18572]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: check_run_sedcmd, No Device name provided Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 4 22:33:22 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 4 22:33:23 kjcf05n02 LCNmon[17919]: 10.16.100.54 is unreachable via ib1 Nov 4 22:33:23 kjcf05n02 LCNmon[17919]: 10.16.100.56 is unreachable via ib1 Nov 4 22:33:23 kjcf05n02 LCNmon[17919]: Can ping through interface ib1 Nov 4 22:33:23 kjcf05n02 LCNmon[17919]: NIC ib0, initial state UP Nov 4 22:33:23 kjcf05n02 LCNmon[17919]: NIC ib1, initial state UP Nov 4 22:33:23 kjcf05n02 LCNmon[17919]: LCNstat initial state UP Nov 4 22:33:23 kjcf05n02 LCNmon[17919]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 4 22:33:24 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18749 (bash) Nov 4 22:33:24 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 4 22:33:24 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 4 22:33:24 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 4 22:33:24 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 4 22:33:24 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 4 22:33:24 kjcf05n00 zabbix-server[2506367]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:33:24 kjcf05n00 zabbix-server[2506367]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 155.95\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 141.82\\"}}"' Nov 4 22:33:24 kjcf05n00 log_interesting_event.py[2506367]: Event '46772' acknowledged Nov 4 22:33:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730781205', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 4 22:33:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730781205'} Nov 4 22:33:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T22:33:27.267939364-06:00 level=info msg="Completed cleanup jobs" duration=41.228546ms Nov 4 22:33:32 kjcf05n02 dcs-collectord[5666]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 22:33:32 kjcf05n02 dcs-collectord[5666]: WARNING No data collected (hpi_parser.py:353) Nov 4 22:33:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730781216', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 4 22:33:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730781216'} Nov 4 22:33:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:33:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730781216', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 4 22:33:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730781216'} Nov 4 22:33:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730781216', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 4 22:33:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730781216'} Nov 4 22:33:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:33:46 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 22:33:46 kjcf05n02 ipmievd[4008]: System Event sensor - Timestamp Clock Sync Nov 4 22:33:47 kjcf05n02 ipmievd[3196]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:33:47 kjcf05n02 dcs-collectord[5666]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 22:33:51 kjcf05n00 mcfcli[3673891]: %3|1730781231.157|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 22:33:52 kjcf05n00 mcfcli[3673891]: %3|1730781232.397|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 4 22:33:56 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 4 22:34:02 kjcf05n02 dcs-collectord[5666]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 22:34:04 kjcf05n03 firmware-update-orc-server[5841]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "6cf29a05-4b5a-4927-9c51-ed972d61c719"} (logger.py:65) Nov 4 22:34:04 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 196638 (get_disk_device) Nov 4 22:34:04 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 4 22:34:04 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 4 22:34:04 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the dIEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 22:34:04 kjcf05n02 ras-resource-manager-agent[5930]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "2fb92b1c-9b2f-11ef-a98c-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 4 22:34:04 kjcf05n02 ras-resource-manager-agent[5930]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '2fb92b1c-9b2f-11ef-a98c-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 4 22:34:04 kjcf05n02 ras-resource-manager-agent[5930]: INFO Submitting new device inserted signal, starting to qualify drive: 2fb92b1c-9b2f-11ef-a98c-00093d0695e3 (admin_action.py:110) Nov 4 22:34:03 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '2fb92b1c-9b2f-11ef-a98c-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 22:34:03 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '2fb92b1c-9b2f-11ef-a98c-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 22:34:03 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '2fb92b1c-9b2f-11ef-a98c-00093d0695e3', 'response ID': '2fc38350-9b2f-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 22:34:03 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 2fc38350-9b2f-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 22:34:04 kjcf05n03 ccp-client[196672]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 22:34:04 kjcf05n03 ccp-client[196672]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 22:34:04 kjcf05n03 ccp-client[196686]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 22:34:04 kjcf05n03 ccp-client[196672]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 22:34:04 kjcf05n03 ccp-client[196672]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 22:34:04 kjcf05n03 ccp-client[196686]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 22:34:04 kjcf05n03 ccp-client[196686]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 22:34:04 kjcf05n02 diskmonitor[17528]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 22:34:04 kjcf05n02 ras-resource-manager-agent[5930]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "30090baa-9b2f-11ef-a98c-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 4 22:34:04 kjcf05n02 ras-resource-manager-agent[5930]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '30090baa-9b2f-11ef-a98c-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 4 22:34:04 kjcf05n02 ras-resource-manager-agent[5930]: INFO Submitting new device inserted signal, starting to qualify drive: 30090baa-9b2f-11ef-a98c-00093d0695e3 (admin_action.py:110) Nov 4 22:34:04 kjcf05n02 firmware-update-orc-server[5887]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "b8d7c8eb-0ede-41b4-94ed-643b70ebf2f3"} (logger.py:65) Nov 4 22:34:04 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '30090baa-9b2f-11ef-a98c-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 22:34:04 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '30090baa-9b2f-11ef-a98c-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 22:34:04 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '30090baa-9b2f-11ef-a98c-00093d0695e3', 'response ID': '3010310a-9b2f-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 22:34:04 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 3010310a-9b2f-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 22:34:07 kjcf05n03 DRVFW[196815]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 22:34:07 kjcf05n03 ccp-client[196816]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 22:34:07 kjcf05n03 ccp-client[196816]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 22:34:07 kjcf05n03 ccp-client[196827]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 22:34:07 kjcf05n03 ccp-client[196816]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 22:34:07 kjcf05n03 ccp-client[196816]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 22:34:07 kjcf05n03 ccp-client[196827]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 22:34:07 kjcf05n03 ccp-client[196827]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 22:34:07 kjcf05n03 firmware-update-orc-server[5841]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 4 22:34:09 kjcf05n02 ras-resource-manager-agent[5930]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '2fb92b1c-9b2f-11ef-a98c-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 4 22:34:09 kjcf05n02 ras-resource-manager-agent[5930]: INFO Drive qualification complete responding: 2fb92b1c-9b2f-11ef-a98c-00093d0695e3 (admin_action.py:205) Nov 4 22:34:09 kjcf05n02 ras-resource-manager-agent[5930]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "2fb92b1c-9b2f-11ef-a98c-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (interesting_event.py:59) Nov 4 22:34:08 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 2fc38350-9b2f-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 22:34:08 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '2fb92b1c-9b2f-11ef-a98c-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '2fb92b1c-9b2f-11ef-a98c-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}}} (logger.py:65) Nov 4 22:34:12 kjcf05n02 diskmonitor[17528]: rive: eui.345950304db010010025384500000004 Nov 4 22:34:12 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 4 22:34:12 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 4 22:34:12 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 4 22:34:12 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 4 22:34:12 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 4 22:34:12 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 4 22:34:12 kjcf05n02 diskmonitor[17528]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 4 22:34:12 kjcf05n02 diskmonitor[17528]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 4 22:34:12 kjcf05n02 diskmonitor[17528]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 4 22:34:12 kjcf05n02 diskmonitor[17528]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 22:34:12 kjcf05n02 diskmonitor[17528]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 4 22:34:12 kjcf05n02 diskmonitor[17528]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "2fb92b1c-9b2f-11ef-a98c-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 4 22:34:12 kjcf05n02 diskmonitor[17528]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 22:34:12 kjcf05n02 diskmonitor[17528]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 4 22:34:12 kjcf05n02 diskmonitor[17528]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "30090baa-9b2f-11ef-a98c-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 4 22:34:12 kjcf05n02 diskmonitor[17528]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 22:34:12 kjcf05n02 diskmonitor[17528]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 22:34:12 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31475 deleted. Nov 4 22:34:14 kjcf05n03 nslcd[6913]: [16e9e8] ldap_result() failed: Can't contact LDAP server Nov 4 22:34:19 kjcf05n02 chronyd[5175]: Selected source 172.16.2.1 Nov 4 22:34:19 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22414 (get_disk_device) Nov 4 22:34:19 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 4 22:34:19 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 4 22:34:20 kjcf05n02 ccp-client[22438]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 22:34:20 kjcf05n02 ccp-client[22438]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 22:34:20 kjcf05n02 ccp-client[22450]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 22:34:20 kjcf05n02 ccp-client[22438]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 22:34:20 kjcf05n02 ccp-client[22438]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 22:34:20 kjcf05n02 ccp-client[22450]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 22:34:20 kjcf05n02 ccp-client[22450]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 22:34:21 kjcf05n00 mcfcli[3673891]: %3|1730781261.158|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 22:34:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730781261}"] Nov 4 22:34:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730781261, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:34:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:34:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730781261}"] Nov 4 22:34:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730781261, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:34:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:34:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730781261}"] Nov 4 22:34:21 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730781261, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:34:21 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:34:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730781261}"] Nov 4 22:34:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730781261, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:34:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:34:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730781261}"] Nov 4 22:34:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730781261, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:34:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:34:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730781261}"] Nov 4 22:34:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730781261, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:34:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:34:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730781261}"] Nov 4 22:34:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730781261, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:34:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:34:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730781261}"] Nov 4 22:34:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730781261, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:34:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:34:23 kjcf05n02 DRVFW[22749]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 22:34:23 kjcf05n02 ccp-client[22750]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 22:34:23 kjcf05n02 ccp-client[22750]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 22:34:23 kjcf05n02 ccp-client[22775]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 22:34:23 kjcf05n02 ccp-client[22750]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 22:34:23 kjcf05n02 ccp-client[22750]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 22:34:23 kjcf05n02 ccp-client[22775]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 22:34:23 kjcf05n02 ccp-client[22775]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 22:34:23 kjcf05n02 firmware-update-orc-server[5887]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 4 22:34:23 kjcf05n02 ras-resource-manager-agent[5930]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '30090baa-9b2f-11ef-a98c-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 4 22:34:23 kjcf05n02 ras-resource-manager-agent[5930]: INFO Drive qualification complete responding: 30090baa-9b2f-11ef-a98c-00093d0695e3 (admin_action.py:205) Nov 4 22:34:23 kjcf05n02 ras-resource-manager-agent[5930]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "30090baa-9b2f-11ef-a98c-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 4 22:34:23 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 3010310a-9b2f-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 22:34:23 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '30090baa-9b2f-11ef-a98c-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '30090baa-9b2f-11ef-a98c-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}}} (logger.py:65) Nov 4 22:34:24 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 4 22:34:24 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 4 22:34:24 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 4 22:34:26 kjcf05n02 python3.9[5236]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 4 22:34:27 kjcf05n02 python3.9[3196]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:34:27 kjcf05n02 ras-resource-manager-agent[5930]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2fb92b1c-9b2f-11ef-a98c-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (service_main_handler.py:66) Nov 4 22:34:27 kjcf05n02 ras-resource-manager-agent[5930]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '2fb92b1c-9b2f-11ef-a98c-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 4 22:34:27 kjcf05n02 ras-resource-manager-agent[5930]: INFO Device qualification response has been acknowledged: 2fb92b1c-9b2f-11ef-a98c-00093d0695e3 (admin_action.py:151) Nov 4 22:34:27 kjcf05n02 ras-resource-manager-agent[5930]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "30090baa-9b2f-11ef-a98c-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 4 22:34:27 kjcf05n02 ras-resource-manager-agent[5930]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '30090baa-9b2f-11ef-a98c-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 4 22:34:27 kjcf05n02 ras-resource-manager-agent[5930]: INFO Device qualification response has been acknowledged: 30090baa-9b2f-11ef-a98c-00093d0695e3 (admin_action.py:151) Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "2fb92b1c-9b2f-11ef-a98c-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: Dbus, handle_ingress_ras_signals, uuid: 2fb92b1c-9b2f-11ef-a98c-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2fb92b1c-9b2f-11ef-a98c-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "30090baa-9b2f-11ef-a98c-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: Dbus, handle_ingress_ras_signals, uuid: 30090baa-9b2f-11ef-a98c-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "30090baa-9b2f-11ef-a98c-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 22:34:29 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 22:34:30 kjcf05n00 mcfcli[3673891]: %3|1730781270.649|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:34:31 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 22:34:31 kjcf05n02 diskmonitor[17528]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 22:34:36 kjcf05n02 diskmonitor[17528]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 22:34:36 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 22:34:36 kjcf05n02 diskmonitor[17528]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 22:34:36 kjcf05n02 diskmonitor[17528]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 22:34:36 kjcf05n02 diskmonitor[17528]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 22:34:36 kjcf05n02 diskmonitor[17528]: leaving test state: 1 next state: 2 Nov 4 22:34:36 kjcf05n02 diskmonitor[17528]: lock req: no timeout Nov 4 22:34:36 kjcf05n02 diskmonitor[17528]: leaving test state: 2 next state: 4 Nov 4 22:34:36 kjcf05n02 diskmonitor[17528]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 22:34:51 kjcf05n00 mcfcli[3673891]: %3|1730781291.569|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 22:35:09 kjcf05n00 mcfcli[3673891]: %3|1730781309.313|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:35:12 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31474 deleted. Nov 4 22:35:21 kjcf05n00 mcfcli[3673891]: %3|1730781321.569|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:35:25 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 4 22:35:25 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 22:35:25 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 4 22:35:40 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 4 22:35:40 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 22:35:40 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 4 22:35:42 kjcf05n02 dcs-collectord[5666]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 4 22:35:45 kjcf05n00 python3.9[2507646]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 22:35:46 kjcf05n00 mcfcli[3673891]: %3|1730781346.449|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:35:46 kjcf05n02 diskmonitor[17528]: lock acquired Nov 4 22:35:46 kjcf05n02 diskmonitor[17528]: leaving test state: 4 next state: 8 Nov 4 22:35:51 kjcf05n00 mcfcli[3673891]: %3|1730781351.570|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 22:35:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730781351}"] Nov 4 22:35:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730781351, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:35:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:35:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:35:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:35:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:35:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:35:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:35:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:35:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:35:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:35:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:35:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:35:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:35:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:35:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.272286ms Nov 4 22:35:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:35:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.272286ms Nov 4 22:35:51 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:35:51 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:35:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:35:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730781351}"] Nov 4 22:35:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730781351, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:35:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:35:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:35:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:35:51-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:35:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:35:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:35:51 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:35:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:35:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:35:51-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:35:51 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:35:51-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:35:51 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:35:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.914475ms Nov 4 22:35:51 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:35:51-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.914475ms Nov 4 22:35:51 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:35:51 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:35:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:36:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730781055', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 22:36:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730781055'} Nov 4 22:36:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:36:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730781055', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 22:36:02 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730781055'} Nov 4 22:36:02 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:36:08 kjcf05n02 diskmonitor[17528]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 4 22:36:08 kjcf05n02 diskmonitor[17528]: leaving test state: 8 next state: 20 Nov 4 22:36:08 kjcf05n02 diskmonitor[17528]: leaving test state: 20 next state: 40 Nov 4 22:36:08 kjcf05n02 diskmonitor[17528]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 185f1c90000 Nov 4 22:36:08 kjcf05n02 diskmonitor[17528]: leaving test state: 40 next state: 80 Nov 4 22:36:21 kjcf05n00 mcfcli[3673891]: %3|1730781381.570|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:36:23 kjcf05n00 mcfcli[3673891]: %3|1730781383.693|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:36:45 kjcf05n02 diskmonitor[17528]: leaving test state: 80 next state: 100 Nov 4 22:36:45 kjcf05n02 diskmonitor[17528]: lock release: time: Mon Nov 4 22:36:39 2024 Nov 4 22:36:45 kjcf05n02 diskmonitor[17528]: leaving test state: 100 next state: 1 Nov 4 22:36:51 kjcf05n00 mcfcli[3673891]: %3|1730781411.570|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:37:01 kjcf05n00 mcfcli[3673891]: %3|1730781421.355|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:37:16 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 4 22:37:22 kjcf05n00 mcfcli[3673891]: %3|1730781442.070|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 22:37:41 kjcf05n00 mcfcli[3673891]: %3|1730781461.352|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:37:52 kjcf05n00 mcfcli[3673891]: %3|1730781472.070|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:38:19 kjcf05n00 mcfcli[3673891]: %3|1730781499.478|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:38:22 kjcf05n00 mcfcli[3673891]: %3|1730781502.070|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:38:52 kjcf05n00 mcfcli[3673891]: %3|1730781532.070|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:38:56 kjcf05n00 mcfcli[3673891]: %3|1730781536.257|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:39:22 kjcf05n00 mcfcli[3673891]: %3|1730781562.071|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:39:27 kjcf05n00 zabbix-server[2510044]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:39:27 kjcf05n00 zabbix-server[2510044]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n02' from event '46779' Nov 4 22:39:27 kjcf05n00 zabbix-server[2510044]: Host created 'enclosure_USE26000024VS001' Nov 4 22:39:27 kjcf05n00 zabbix-server[2510044]: Running puppet on 'kjcf05n02' Nov 4 22:39:29 kjcf05n02 puppet-agent[34727]: Using configured environment 'production' Nov 4 22:39:29 kjcf05n02 puppet-agent[34727]: Retrieving pluginfacts Nov 4 22:39:29 kjcf05n02 puppet-agent[34727]: Retrieving plugin Nov 4 22:39:29 kjcf05n02 puppet-agent[34727]: Loading facts Nov 4 22:39:32 kjcf05n02 puppet-agent[34727]: Caching catalog for kjcf05n02 Nov 4 22:39:32 kjcf05n02 puppet-agent[34727]: Applying configuration version '1730781570' Nov 4 22:39:34 kjcf05n02 puppet-agent[34727]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 22:39:34 kjcf05n02 puppet-agent[34727]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 22:39:34 kjcf05n02 puppet-agent[34727]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 22:39:35 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 4 22:39:35 kjcf05n02 zabbix_agent2[6014]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 22:39:35 kjcf05n02 zabbix_agent2[3196]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:39:35 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 22:39:35 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 4 22:39:35 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 22:39:35 kjcf05n02 puppet-agent[34727]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: Press Ctrl+C to exit. Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: Plugin support version 1.0 Nov 4 22:39:35 kjcf05n02 zabbix_agent2[35048]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 22:39:35 kjcf05n00 mcfcli[3673891]: %3|1730781575.708|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:39:37 kjcf05n02 puppet-agent[34727]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 22:39:37 kjcf05n02 puppet-agent[34727]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 22:39:37 kjcf05n02 puppet-agent[34727]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 22:39:37 kjcf05n02 puppet-agent[34727]: Applied catalog in 4.97 seconds Nov 4 22:39:37 kjcf05n00 zabbix-server[2510044]: puppet completed status:(0): '' Nov 4 22:39:37 kjcf05n00 zabbix-server[2510044]: Event '46779' acknowledged Nov 4 22:39:37 kjcf05n00 zabbix-server[2510044]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n02"}' Nov 4 22:39:52 kjcf05n00 mcfcli[3673891]: %3|1730781592.071|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 22:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 22:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 22:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 22:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 22:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 22:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 22:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 22:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 22:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 22:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 22:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 22:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 22:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 22:40:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 22:40:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:40:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 22:40:14 kjcf05n00 mcfcli[3673891]: %3|1730781614.957|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:40:22 kjcf05n00 mcfcli[3673891]: %3|1730781622.071|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:40:24 kjcf05n00 zabbix-server[2510560]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:40:24 kjcf05n00 zabbix-server[2510560]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 270.14\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 220.02\\"}}"' Nov 4 22:40:24 kjcf05n00 log_interesting_event.py[2510560]: Event '46780' acknowledged Nov 4 22:40:39 kjcf05n00 python3.9[2510617]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 22:40:50 kjcf05n00 mcfcli[3673891]: %3|1730781650.321|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:40:52 kjcf05n00 mcfcli[3673891]: %3|1730781652.072|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 22:40:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730781055', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 22:40:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730781055'} Nov 4 22:40:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:40:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730781055', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 22:40:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730781055'} Nov 4 22:40:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:41:22 kjcf05n00 mcfcli[3673891]: %3|1730781682.072|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:41:28 kjcf05n00 mcfcli[3673891]: %3|1730781688.670|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:41:52 kjcf05n00 mcfcli[3673891]: %3|1730781712.073|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:42:06 kjcf05n00 mcfcli[3673891]: %3|1730781726.860|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:42:22 kjcf05n00 mcfcli[3673891]: %3|1730781742.073|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:42:45 kjcf05n00 mcfcli[3673891]: %3|1730781765.124|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:42:52 kjcf05n00 mcfcli[3673891]: %3|1730781772.073|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 22:43:22 kjcf05n00 mcfcli[3673891]: %3|1730781802.074|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:43:22 kjcf05n00 mcfcli[3673891]: %3|1730781802.996|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T22:43:27.268972985-06:00 level=info msg="Completed cleanup jobs" duration=42.386005ms Nov 4 22:43:52 kjcf05n00 mcfcli[3673891]: %3|1730781832.074|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:43:58 kjcf05n02 root[42281]: failback_xyraid Nov 4 22:43:59 kjcf05n02 root[42398]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 4 22:44:01 kjcf05n02 root[42541]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 4 22:44:02 kjcf05n00 mcfcli[3673891]: %3|1730781842.993|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:44:03 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 4 22:44:07 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme25n1 Nov 4 22:44:07 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme3n1 Nov 4 22:44:07 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme17n1 Nov 4 22:44:07 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme18n1 Nov 4 22:44:07 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme23n1 Nov 4 22:44:07 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme9n1 Nov 4 22:44:07 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme2n1 Nov 4 22:44:07 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme19n1 Nov 4 22:44:07 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme24n1 Nov 4 22:44:07 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme8n1 Nov 4 22:44:07 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme4n1 Nov 4 22:44:09 kjcf05n02 dwd[5207]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 4 22:44:09 kjcf05n02 dwd[5207]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 4 22:44:09 kjcf05n02 dwd[5207]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 4 22:44:09 kjcf05n02 dwd[5207]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 4 22:44:09 kjcf05n02 dwd[5207]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 4 22:44:09 kjcf05n02 dwd[5207]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 4 22:44:09 kjcf05n02 dwd[5207]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 4 22:44:09 kjcf05n02 dwd[5207]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 4 22:44:09 kjcf05n02 dwd[5207]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 4 22:44:09 kjcf05n02 dwd[5207]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 4 22:44:09 kjcf05n02 dwd[5207]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 4 22:44:09 kjcf05n02 dwd[5207]: Starting NVME thread for nvme2n1 Nov 4 22:44:09 kjcf05n02 dwd[5207]: Starting NVME thread for nvme18n1 Nov 4 22:44:09 kjcf05n02 dwd[5207]: Starting NVME thread for nvme19n1 Nov 4 22:44:09 kjcf05n02 dwd[5207]: Starting NVME thread for nvme9n1 Nov 4 22:44:10 kjcf05n02 systemd-udevd[45244]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45247]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45245]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45249]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45244]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45247]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45245]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45249]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45244]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45247]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45245]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45249]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45244]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45245]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45247]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45249]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45244]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45245]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45247]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45249]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45244]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45245]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45247]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45249]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45244]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45247]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45272]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45275]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45277]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45245]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45244]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45281]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45249]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45247]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45272]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45275]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45245]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45244]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45249]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45277]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45275]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45249]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45245]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45275]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45245]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45245]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45249]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45277]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45244]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45245]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45275]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45245]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45249]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45245]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45275]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45245]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45245]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45275]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45245]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 dwd[5207]: Starting NVME thread for nvme3n1 Nov 4 22:44:10 kjcf05n02 systemd-udevd[45275]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45245]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45275]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45245]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 systemd-udevd[45245]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:44:10 kjcf05n02 dcs-bulk-data-sender[6215]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 4 22:44:10 kjcf05n02 dwd[5207]: Starting NVME thread for nvme24n1 Nov 4 22:44:10 kjcf05n02 dwd[5207]: Starting NVME thread for nvme4n1 Nov 4 22:44:10 kjcf05n02 dwd[5207]: Starting NVME thread for nvme23n1 Nov 4 22:44:10 kjcf05n02 dwd[5207]: Starting NVME thread for nvme17n1 Nov 4 22:44:10 kjcf05n02 dwd[5207]: Starting NVME thread for nvme25n1 Nov 4 22:44:10 kjcf05n02 dwd[5207]: Starting NVME thread for nvme8n1 Nov 4 22:44:12 kjcf05n02 nslcd[6958]: [8b4567] (re)loading /etc/nsswitch.conf Nov 4 22:44:15 kjcf05n02 diskmonitor[17528]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 4 22:44:21 kjcf05n02 diskmonitor[17528]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 4 22:44:21 kjcf05n02 diskmonitor[17528]: Scan for ReadErrorMax change for md65 Nov 4 22:44:21 kjcf05n02 diskmonitor[17528]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 4 22:44:21 kjcf05n02 diskmonitor[17528]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 4 22:44:21 kjcf05n02 diskmonitor[17528]: read_saved_file: md65 no saved speed Nov 4 22:44:21 kjcf05n02 diskmonitor[17528]: reconstruction_policy: sync_action prev = current = idle - md65 Nov 4 22:44:21 kjcf05n02 diskmonitor[17528]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 22:44:22 kjcf05n00 mcfcli[3673891]: %3|1730781862.074|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:44:41 kjcf05n00 mcfcli[3673891]: %3|1730781881.077|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:44:48 kjcf05n03 diskmonitor[17340]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 4 22:44:48 kjcf05n03 diskmonitor[17340]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 22:44:51 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47705 (bash) Nov 4 22:44:51 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 4 22:44:51 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 4 22:44:52 kjcf05n00 mcfcli[3673891]: %3|1730781892.074|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 22:45:03 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 4 22:45:03 kjcf05n02 systemd-tmpfiles[48291]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 22:45:03 kjcf05n02 systemd-tmpfiles[48291]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 22:45:03 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 4 22:45:03 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 4 22:45:19 kjcf05n00 mcfcli[3673891]: %3|1730781919.277|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:45:22 kjcf05n00 mcfcli[3673891]: %3|1730781922.075|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 22:45:39 kjcf05n00 python3.9[2513579]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 22:45:52 kjcf05n00 mcfcli[3673891]: %3|1730781952.075|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 22:45:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730781952}"] Nov 4 22:45:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730781952, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:45:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.099863ms Nov 4 22:45:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.099863ms Nov 4 22:45:52 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:45:52 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:45:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:45:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730781952}"] Nov 4 22:45:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730781952, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:45:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.220268ms Nov 4 22:45:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.220268ms Nov 4 22:45:52 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:45:52 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:45:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:45:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730781952}"] Nov 4 22:45:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730781952, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:45:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.380959ms Nov 4 22:45:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.380959ms Nov 4 22:45:52 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:45:52 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:45:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:45:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730781952}"] Nov 4 22:45:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730781952, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:45:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.260504ms Nov 4 22:45:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.260504ms Nov 4 22:45:52 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:45:52 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:45:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:45:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730781952}"] Nov 4 22:45:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730781952, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:45:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.025664ms Nov 4 22:45:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.025664ms Nov 4 22:45:52 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:45:52 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:45:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:45:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730781952', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 4 22:45:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730781952'} Nov 4 22:45:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:45:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730781952', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 4 22:45:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730781952'} Nov 4 22:45:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:45:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730781952}"] Nov 4 22:45:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730781952, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:45:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:52-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:52 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:52-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:52 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:52-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:52 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.251146ms Nov 4 22:45:52 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:52-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.251146ms Nov 4 22:45:52 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:45:52 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:45:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:45:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730781952}"] Nov 4 22:45:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730781952, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:45:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.803921ms Nov 4 22:45:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.803921ms Nov 4 22:45:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:45:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:45:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:45:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730781952}"] Nov 4 22:45:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730781952, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:45:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.09298ms Nov 4 22:45:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.09298ms Nov 4 22:45:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:45:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:45:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:45:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730781952}"] Nov 4 22:45:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730781952, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:45:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.829556ms Nov 4 22:45:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.829556ms Nov 4 22:45:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:45:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:45:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:45:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730781952}"] Nov 4 22:45:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730781952, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:45:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.833093ms Nov 4 22:45:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.833093ms Nov 4 22:45:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:45:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:45:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:45:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730781952}"] Nov 4 22:45:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730781952, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 22:45:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:53-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 22:45:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:53 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T22:45:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:53-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 22:45:53 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T22:45:53-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 22:45:53 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:45:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.309686ms Nov 4 22:45:53 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:45:53-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.309686ms Nov 4 22:45:53 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:22:45:53 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 22:45:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 22:45:59 kjcf05n00 mcfcli[3673891]: %3|1730781959.274|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:46:22 kjcf05n00 mcfcli[3673891]: %3|1730781982.075|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 22:46:37 kjcf05n00 mcfcli[3673891]: %3|1730781997.698|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:46:52 kjcf05n00 mcfcli[3673891]: %3|1730782012.076|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:47:15 kjcf05n00 mcfcli[3673891]: %3|1730782035.236|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:47:22 kjcf05n00 mcfcli[3673891]: %3|1730782042.076|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:47:52 kjcf05n00 mcfcli[3673891]: %3|1730782072.076|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 22:47:54 kjcf05n00 mcfcli[3673891]: %3|1730782074.383|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:48:22 kjcf05n00 mcfcli[3673891]: %3|1730782102.076|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:48:33 kjcf05n00 mcfcli[3673891]: %3|1730782113.430|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:48:52 kjcf05n00 mcfcli[3673891]: %3|1730782132.076|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:49:12 kjcf05n00 mcfcli[3673891]: %3|1730782152.484|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:49:22 kjcf05n00 mcfcli[3673891]: %3|1730782162.077|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:49:30 kjcf05n00 zabbix-server[2515894]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:49:30 kjcf05n00 zabbix-server[2515894]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46783' Nov 4 22:49:31 kjcf05n00 zabbix-server[2515894]: Filesystem 'kjcf05' has been mounted Nov 4 22:49:31 kjcf05n00 zabbix-server[2515894]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 4 22:49:31 kjcf05n00 zabbix-server[2515894]: Running puppet on 'None' Nov 4 22:49:33 kjcf05n05 puppet-agent[2711722]: Using configured environment 'production' Nov 4 22:49:33 kjcf05n05 puppet-agent[2711722]: Retrieving pluginfacts Nov 4 22:49:33 kjcf05n05 puppet-agent[2711722]: Retrieving plugin Nov 4 22:49:33 kjcf05n06 puppet-agent[2521101]: Using configured environment 'production' Nov 4 22:49:33 kjcf05n06 puppet-agent[2521101]: Retrieving pluginfacts Nov 4 22:49:33 kjcf05n04 puppet-agent[2501833]: Using configured environment 'production' Nov 4 22:49:33 kjcf05n04 puppet-agent[2501833]: Retrieving pluginfacts Nov 4 22:49:33 kjcf05n03 puppet-agent[223681]: Using configured environment 'production' Nov 4 22:49:33 kjcf05n03 puppet-agent[223681]: Retrieving pluginfacts Nov 4 22:49:33 kjcf05n03 puppet-agent[223681]: Retrieving plugin Nov 4 22:49:33 kjcf05n02 puppet-agent[56392]: Using configured environment 'production' Nov 4 22:49:33 kjcf05n02 puppet-agent[56392]: Retrieving pluginfacts Nov 4 22:49:33 kjcf05n02 puppet-agent[56392]: Retrieving plugin Nov 4 22:49:33 kjcf05n06 puppet-agent[2521101]: Retrieving plugin Nov 4 22:49:33 kjcf05n06 puppet-agent[2521101]: Loading facts Nov 4 22:49:33 kjcf05n07 puppet-agent[2522523]: Using configured environment 'production' Nov 4 22:49:33 kjcf05n07 puppet-agent[2522523]: Retrieving pluginfacts Nov 4 22:49:33 kjcf05n07 puppet-agent[2522523]: Retrieving plugin Nov 4 22:49:33 kjcf05n04 puppet-agent[2501833]: Retrieving plugin Nov 4 22:49:33 kjcf05n04 puppet-agent[2501833]: Loading facts Nov 4 22:49:34 kjcf05n03 puppet-agent[223681]: Loading facts Nov 4 22:49:34 kjcf05n02 puppet-agent[56392]: Loading facts Nov 4 22:49:34 kjcf05n05 puppet-agent[2711722]: Loading facts Nov 4 22:49:34 kjcf05n01 puppet-agent[3940043]: Using configured environment 'production' Nov 4 22:49:34 kjcf05n01 puppet-agent[3940043]: Retrieving pluginfacts Nov 4 22:49:34 kjcf05n01 puppet-agent[3940043]: Retrieving plugin Nov 4 22:49:34 kjcf05n07 puppet-agent[2522523]: Loading facts Nov 4 22:49:34 kjcf05n00 puppet-agent[2516077]: Using configured environment 'production' Nov 4 22:49:34 kjcf05n00 puppet-agent[2516077]: Retrieving pluginfacts Nov 4 22:49:34 kjcf05n00 puppet-agent[2516077]: Retrieving plugin Nov 4 22:49:34 kjcf05n00 puppet-agent[2516077]: Loading facts Nov 4 22:49:34 kjcf05n01 puppet-agent[3940043]: Loading facts Nov 4 22:49:35 kjcf05n02 dwd[5207]: nvme9n1 passed periodic SMART status check Nov 4 22:49:35 kjcf05n02 dwd[5207]: nvme2n1 passed periodic SMART status check Nov 4 22:49:35 kjcf05n02 dwd[5207]: nvme19n1 passed periodic SMART status check Nov 4 22:49:35 kjcf05n02 dwd[5207]: nvme3n1 passed periodic SMART status check Nov 4 22:49:35 kjcf05n02 dwd[5207]: nvme18n1 passed periodic SMART status check Nov 4 22:49:36 kjcf05n02 dwd[5207]: nvme23n1 passed periodic SMART status check Nov 4 22:49:36 kjcf05n02 dwd[5207]: nvme8n1 passed periodic SMART status check Nov 4 22:49:36 kjcf05n02 dwd[5207]: nvme17n1 passed periodic SMART status check Nov 4 22:49:36 kjcf05n02 dwd[5207]: nvme24n1 passed periodic SMART status check Nov 4 22:49:36 kjcf05n02 dwd[5207]: nvme25n1 passed periodic SMART status check Nov 4 22:49:36 kjcf05n02 dwd[5207]: nvme4n1 passed periodic SMART status check Nov 4 22:49:36 kjcf05n06 puppet-agent[2521101]: Caching catalog for kjcf05n06 Nov 4 22:49:36 kjcf05n06 puppet-agent[2521101]: Applying configuration version '1730782175' Nov 4 22:49:36 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 4 22:49:36 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 4 22:49:37 kjcf05n02 puppet-agent[56392]: Caching catalog for kjcf05n02 Nov 4 22:49:37 kjcf05n02 puppet-agent[56392]: Applying configuration version '1730782175' Nov 4 22:49:37 kjcf05n03 puppet-agent[223681]: Caching catalog for kjcf05n03 Nov 4 22:49:37 kjcf05n03 puppet-agent[223681]: Applying configuration version '1730782175' Nov 4 22:49:38 kjcf05n01 puppet-agent[3940043]: Caching catalog for kjcf05n01 Nov 4 22:49:38 kjcf05n07 puppet-agent[2522523]: Caching catalog for kjcf05n07 Nov 4 22:49:38 kjcf05n07 puppet-agent[2522523]: Applying configuration version '1730782175' Nov 4 22:49:39 kjcf05n01 puppet-agent[3940043]: Applying configuration version '1730782176' Nov 4 22:49:39 kjcf05n06 puppet-agent[2521101]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 22:49:39 kjcf05n06 puppet-agent[2521101]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 22:49:39 kjcf05n06 puppet-agent[2521101]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 22:49:39 kjcf05n00 puppet-agent[2516077]: Caching catalog for kjcf05n00 Nov 4 22:49:39 kjcf05n00 puppet-agent[2516077]: Applying configuration version '1730782177' Nov 4 22:49:39 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2468468]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 22:49:39 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 4 22:49:39 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 22:49:39 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 4 22:49:39 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 4 22:49:39 kjcf05n06 puppet-agent[2521101]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: Press Ctrl+C to exit. Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: Plugin support version 1.0 Nov 4 22:49:39 kjcf05n06 zabbix_agent2[2521734]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 22:49:39 kjcf05n02 puppet-agent[56392]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 22:49:39 kjcf05n02 puppet-agent[56392]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 22:49:39 kjcf05n02 puppet-agent[56392]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 22:49:40 kjcf05n03 puppet-agent[223681]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 22:49:40 kjcf05n03 puppet-agent[223681]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 22:49:40 kjcf05n03 puppet-agent[223681]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 22:49:40 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 4 22:49:40 kjcf05n02 zabbix_agent2[35048]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 22:49:40 kjcf05n02 zabbix_agent2[3196]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 22:49:40 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 22:49:40 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 4 22:49:40 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 22:49:40 kjcf05n02 puppet-agent[56392]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: Press Ctrl+C to exit. Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: Plugin support version 1.0 Nov 4 22:49:40 kjcf05n02 zabbix_agent2[56841]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 22:49:40 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 4 22:49:40 kjcf05n03 zabbix_agent2[168541]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 22:49:40 kjcf05n03 zabbix_agent2[3163]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 22:49:40 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 22:49:40 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 4 22:49:40 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 4 22:49:40 kjcf05n03 puppet-agent[223681]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: Press Ctrl+C to exit. Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: Plugin support version 1.0 Nov 4 22:49:40 kjcf05n03 zabbix_agent2[224083]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 22:49:40 kjcf05n07 puppet-agent[2522523]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 22:49:40 kjcf05n07 puppet-agent[2522523]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 22:49:40 kjcf05n07 puppet-agent[2522523]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 22:49:41 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2471239]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 22:49:41 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 4 22:49:41 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 22:49:41 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 4 22:49:41 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 4 22:49:41 kjcf05n07 puppet-agent[2522523]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: Press Ctrl+C to exit. Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: Plugin support version 1.0 Nov 4 22:49:41 kjcf05n07 zabbix_agent2[2523877]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 22:49:41 kjcf05n06 puppet-agent[2521101]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 22:49:41 kjcf05n06 puppet-agent[2521101]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 22:49:41 kjcf05n06 puppet-agent[2521101]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 22:49:41 kjcf05n01 puppet-agent[3940043]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 22:49:41 kjcf05n01 puppet-agent[3940043]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-22:26:04]/mode) mode changed '0755' to '0750' Nov 4 22:49:41 kjcf05n01 puppet-agent[3940043]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-22:26:04/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 4 22:49:41 kjcf05n01 puppet-agent[3940043]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-22:26:04/vmcore]/mode) mode changed '0600' to '0640' Nov 4 22:49:41 kjcf05n01 puppet-agent[3940043]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-22:26:04/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 4 22:49:41 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 22:49:41 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 22:49:41 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 22:49:41 kjcf05n06 puppet-agent[2521101]: Applied catalog in 4.85 seconds Nov 4 22:49:42 kjcf05n02 puppet-agent[56392]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 22:49:42 kjcf05n02 puppet-agent[56392]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 22:49:42 kjcf05n02 puppet-agent[56392]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 22:49:42 kjcf05n00 puppet-agent[2516077]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 22:49:42 kjcf05n01 puppet-agent[3940043]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 22:49:42 kjcf05n01 puppet-agent[3940043]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 22:49:42 kjcf05n01 puppet-agent[3940043]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 22:49:42 kjcf05n02 puppet-agent[56392]: Applied catalog in 5.02 seconds Nov 4 22:49:43 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3928419]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 22:49:43 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 4 22:49:43 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 22:49:43 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 4 22:49:43 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 4 22:49:43 kjcf05n01 puppet-agent[3940043]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: Press Ctrl+C to exit. Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: Plugin support version 1.0 Nov 4 22:49:43 kjcf05n01 zabbix_agent2[3940436]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 22:49:43 kjcf05n03 puppet-agent[223681]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 22:49:43 kjcf05n03 puppet-agent[223681]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 22:49:43 kjcf05n03 puppet-agent[223681]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 22:49:43 kjcf05n03 puppet-agent[223681]: Applied catalog in 5.90 seconds Nov 4 22:49:44 kjcf05n07 puppet-agent[2522523]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 22:49:44 kjcf05n07 puppet-agent[2522523]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 22:49:44 kjcf05n07 puppet-agent[2522523]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 22:49:44 kjcf05n07 puppet-agent[2522523]: Applied catalog in 6.09 seconds Nov 4 22:49:44 kjcf05n00 puppet-agent[2516077]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 22:49:44 kjcf05n00 puppet-agent[2516077]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 22:49:44 kjcf05n00 puppet-agent[2516077]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 22:49:44 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2498038]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 22:49:45 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 22:49:44 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 22:49:44 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 4 22:49:44 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 4 22:49:44 kjcf05n00 puppet-agent[2516077]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: Press Ctrl+C to exit. Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: Plugin support version 1.0 Nov 4 22:49:44 kjcf05n00 zabbix_agent2[2516615]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 22:49:45 kjcf05n00 zabbix-server[2516640]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:49:45 kjcf05n00 zabbix-server[2516641]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:49:46 kjcf05n00 zabbix-server[2516646]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:49:46 kjcf05n01 puppet-agent[3940043]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_223323.log]/mode) mode changed '0644' to '0640' Nov 4 22:49:46 kjcf05n01 puppet-agent[3940043]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_224450.log]/mode) mode changed '0644' to '0640' Nov 4 22:49:46 kjcf05n01 puppet-agent[3940043]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241104_224451]/mode) mode changed '0755' to '0750' Nov 4 22:49:46 kjcf05n01 puppet-agent[3940043]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241104_224451/screenlog.0]/mode) mode changed '0644' to '0640' Nov 4 22:49:46 kjcf05n00 zabbix-server[2516648]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:49:46 kjcf05n00 puppet-agent[2516077]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 4 22:49:47 kjcf05n01 puppet-agent[3940043]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_223323.log]/mode) mode changed '0644' to '0640' Nov 4 22:49:47 kjcf05n01 puppet-agent[3940043]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_224450.log]/mode) mode changed '0644' to '0640' Nov 4 22:49:47 kjcf05n01 puppet-agent[3940043]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 22:49:47 kjcf05n01 puppet-agent[3940043]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 22:49:47 kjcf05n01 puppet-agent[3940043]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 22:49:48 kjcf05n00 puppet-agent[2516077]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 22:49:48 kjcf05n00 puppet-agent[2516077]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 22:49:48 kjcf05n00 puppet-agent[2516077]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 22:49:49 kjcf05n01 puppet-agent[3940043]: Applied catalog in 10.77 seconds Nov 4 22:49:49 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 4 22:49:49 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 4 22:49:49 kjcf05n00 puppet-agent[2516077]: Applied catalog in 10.36 seconds Nov 4 22:49:51 kjcf05n05 puppet-agent[2711722]: Caching catalog for kjcf05n05 Nov 4 22:49:51 kjcf05n05 puppet-agent[2711722]: Applying configuration version '1730782185' Nov 4 22:49:51 kjcf05n04 puppet-agent[2501833]: Caching catalog for kjcf05n04 Nov 4 22:49:51 kjcf05n04 puppet-agent[2501833]: Applying configuration version '1730782186' Nov 4 22:49:52 kjcf05n00 mcfcli[3673891]: %3|1730782192.077|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:49:52 kjcf05n00 mcfcli[3673891]: %3|1730782192.482|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:49:53 kjcf05n05 puppet-agent[2711722]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 22:49:53 kjcf05n05 puppet-agent[2711722]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 22:49:53 kjcf05n05 puppet-agent[2711722]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 22:49:54 kjcf05n04 puppet-agent[2501833]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 22:49:54 kjcf05n04 puppet-agent[2501833]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 22:49:54 kjcf05n04 puppet-agent[2501833]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 22:49:54 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2665237]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 22:49:54 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 4 22:49:54 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 22:49:54 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 4 22:49:54 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 4 22:49:54 kjcf05n05 puppet-agent[2711722]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: Press Ctrl+C to exit. Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: Plugin support version 1.0 Nov 4 22:49:54 kjcf05n05 zabbix_agent2[2712725]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 22:49:54 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2456019]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 22:49:54 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 4 22:49:54 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 22:49:54 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 4 22:49:54 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 4 22:49:54 kjcf05n04 puppet-agent[2501833]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: Starting Zabbix Agent 2 (6.2.1) Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: Press Ctrl+C to exit. Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: Plugin support version 1.0 Nov 4 22:49:54 kjcf05n04 zabbix_agent2[2502852]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 22:49:56 kjcf05n05 puppet-agent[2711722]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 22:49:56 kjcf05n05 puppet-agent[2711722]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 22:49:56 kjcf05n05 puppet-agent[2711722]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 22:49:56 kjcf05n05 puppet-agent[2711722]: Applied catalog in 5.16 seconds Nov 4 22:49:56 kjcf05n04 puppet-agent[2501833]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 22:49:56 kjcf05n04 puppet-agent[2501833]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 22:49:56 kjcf05n04 puppet-agent[2501833]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 22:49:56 kjcf05n04 puppet-agent[2501833]: Applied catalog in 5.11 seconds Nov 4 22:49:56 kjcf05n00 zabbix-server[2515894]: puppet completed status:(0): '' Nov 4 22:49:56 kjcf05n00 zabbix-server[2515894]: Event '46783' acknowledged Nov 4 22:49:56 kjcf05n00 zabbix-server[2515894]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 4 22:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 22:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 22:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 22:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 22:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 22:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 22:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 22:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 22:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 22:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 22:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 22:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 22:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 22:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 22:50:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 22:50:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 22:50:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 22:50:22 kjcf05n00 mcfcli[3673891]: %3|1730782222.079|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:50:27 kjcf05n00 mcfcli[3673891]: %3|1730782227.651|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:50:39 kjcf05n00 python3.9[2517013]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 22:50:52 kjcf05n00 mcfcli[3673891]: %3|1730782252.164|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 95 identical error(s) suppressed) Nov 4 22:51:07 kjcf05n00 mcfcli[3673891]: %3|1730782267.648|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:51:22 kjcf05n00 mcfcli[3673891]: %3|1730782282.164|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:51:44 kjcf05n00 mcfcli[3673891]: %3|1730782304.826|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:51:52 kjcf05n00 mcfcli[3673891]: %3|1730782312.165|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:52:12 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T22:52:12-06:00] Checking for stale sessions... Nov 4 22:52:12 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T22:52:12-06:00] Checking for stale sessions... Nov 4 22:52:22 kjcf05n00 mcfcli[3673891]: %3|1730782342.165|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:52:24 kjcf05n00 mcfcli[3673891]: %3|1730782344.823|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:52:52 kjcf05n00 mcfcli[3673891]: %3|1730782372.165|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:53:04 kjcf05n00 mcfcli[3673891]: %3|1730782384.403|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:53:15.867479Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 22:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T04:53:15.867558Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.101ms Nov 4 22:53:22 kjcf05n00 mcfcli[3673891]: %3|1730782402.165|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:53:24 kjcf05n00 zabbix-server[2518868]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:53:24 kjcf05n00 zabbix-server[2518868]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 219.59\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 162.96\\"}}"' Nov 4 22:53:25 kjcf05n00 log_interesting_event.py[2518868]: Event '46785' acknowledged Nov 4 22:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T22:53:27.262196408-06:00 level=info msg="Completed cleanup jobs" duration=35.8001ms Nov 4 22:53:44 kjcf05n00 mcfcli[3673891]: %3|1730782424.400|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:53:52 kjcf05n00 mcfcli[3673891]: %3|1730782432.166|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:54:14 kjcf05n03 nslcd[6913]: [0e0f76] ldap_result() failed: Can't contact LDAP server Nov 4 22:54:22 kjcf05n00 mcfcli[3673891]: %3|1730782462.581|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 22:54:24 kjcf05n00 mcfcli[3673891]: %3|1730782464.397|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:54:46 kjcf05n00 zabbix-server[2519463]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:54:46 kjcf05n00 zabbix-server[2519463]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 142.2\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 105.88\\"}}"' Nov 4 22:54:46 kjcf05n00 log_interesting_event.py[2519463]: Event '46786' acknowledged Nov 4 22:54:52 kjcf05n00 mcfcli[3673891]: %3|1730782492.581|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:55:04 kjcf05n00 mcfcli[3673891]: %3|1730782504.395|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:55:22 kjcf05n00 mcfcli[3673891]: %3|1730782522.581|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:55:28 kjcf05n03 diskmonitor[17340]: reconstruction_policy: sync_action prev = resync current = idle - md66 Nov 4 22:55:28 kjcf05n03 diskmonitor[17340]: Restore sync_speed_min (system) for md66 Nov 4 22:55:28 kjcf05n03 diskmonitor[17340]: Restore sync_speed_max (system) for md66 Nov 4 22:55:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 22:55:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 22:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 22:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 22:55:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 22:55:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 22:55:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 22:55:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 22:55:44 kjcf05n00 mcfcli[3673891]: %3|1730782544.392|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:55:52 kjcf05n00 mcfcli[3673891]: %3|1730782552.581|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 22:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 22:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 22:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 22:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 22:55:56 kjcf05n00 zabbix_server[15731]: Zabbix agent item "dcs.lustre.device.ost.name[OST0001,ost_name]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 4 22:55:57 kjcf05n00 zabbix_server[15737]: Zabbix agent item "xrtx.enclosure.serial_number[USE26000024VS001]" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 4 22:55:58 kjcf05n00 python3.9[2520147]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 22:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 22:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 22:55:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 22:55:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 22:56:02 kjcf05n03 fstonithd.py[15114]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 4 22:56:02 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 22:56:02 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 22:56:02 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 22:56:04 kjcf05n03 root[235219]: is_enc_ipmi_off starts Nov 4 22:56:04 kjcf05n03 root[235220]: is_viking_off starts Nov 4 22:56:04 kjcf05n03 root[235248]: I am master Nov 4 22:56:04 kjcf05n03 root[235251]: I am in slot 1; partner is in slot 0 Nov 4 22:56:04 kjcf05n03 root[235262]: is_lan_ipmi_off leaves Nov 4 22:56:04 kjcf05n03 root[235264]: is_lan_ipmi_sec_off leaves Nov 4 22:56:09 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='15', error='Connection reset by peer (104)' Nov 4 22:56:09 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='15', client='AF_INET(172.16.2.5:45055)', local='AF_INET(0.0.0.0:601)' Nov 4 22:56:10 kjcf05n03 root[235378]: is_viking_off leaves Nov 4 22:56:10 kjcf05n03 root[235381]: kjcf05n02 not already off look at kdump Nov 4 22:56:10 kjcf05n03 root[235382]: is_kdump_off starts Nov 4 22:56:10 kjcf05n03 fence_kdump[235383]: waiting for message from '172.16.2.5' Nov 4 22:56:11 kjcf05n03 fence_kdump[235383]: received valid message from '172.16.2.5' Nov 4 22:56:11 kjcf05n03 root[235384]: is_kdump_off detected kdump on kjcf05n02 Nov 4 22:56:11 kjcf05n03 root[235385]: kjcf05n02 is kdumping Nov 4 22:56:11 kjcf05n03 root[235495]: is_viking_off starts Nov 4 22:56:11 kjcf05n03 root[235494]: is_enc_ipmi_off starts Nov 4 22:56:11 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 4 22:56:11 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 4 22:56:11 kjcf05n03 root[235511]: is_lan_ipmi_off leaves Nov 4 22:56:11 kjcf05n03 root[235513]: is_lan_ipmi_sec_off leaves Nov 4 22:56:11 kjcf05n03 root[235516]: I am master Nov 4 22:56:11 kjcf05n03 root[235519]: I am in slot 1; partner is in slot 0 Nov 4 22:56:11 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0001,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 4 22:56:12 kjcf05n00 zabbix_server[15727]: Zabbix agent item "system.cpu.util[,guest_nice]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 4 22:56:13 kjcf05n00 zabbix_server[15742]: Zabbix agent item "vfs.file.contents["/sys/class/net/ib1/operstate"]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 4 22:56:14 kjcf05n00 zabbix_server[15757]: Zabbix agent item "vfs.file.contents["/sys/class/net/icl0/operstate"]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 4 22:56:15 kjcf05n00 zabbix_server[15754]: Zabbix agent item "system.cpu.util[,iowait]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 4 22:56:19 kjcf05n03 root[235737]: is_viking_off leaves Nov 4 22:56:19 kjcf05n03 root[235740]: kjcf05n02 not already off look at kdump Nov 4 22:56:19 kjcf05n03 root[235741]: is_kdump_off starts Nov 4 22:56:19 kjcf05n03 fence_kdump[235742]: waiting for message from '172.16.2.5' Nov 4 22:56:20 kjcf05n03 fence_kdump[235742]: received valid message from '172.16.2.5' Nov 4 22:56:20 kjcf05n03 root[235745]: is_kdump_off detected kdump on kjcf05n02 Nov 4 22:56:20 kjcf05n03 root[235746]: kjcf05n02 is kdumping Nov 4 22:56:22 kjcf05n00 mcfcli[3673891]: %3|1730782582.582|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:56:24 kjcf05n03 systemd-udevd[237957]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237959]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237958]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237960]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237959]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237958]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237957]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237960]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237959]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237958]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237957]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237960]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237958]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237957]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237959]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237960]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237957]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237958]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237959]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237960]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237958]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237957]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237982]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237959]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237985]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237960]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237987]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237958]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237957]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237990]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237982]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237959]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237960]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237985]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237958]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237957]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237982]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237990]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237959]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237960]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237985]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237957]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237957]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237957]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237960]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237958]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237959]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237957]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237960]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237957]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237990]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237960]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237957]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237960]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237957]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237957]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237960]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237957]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237960]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237957]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237960]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237957]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237957]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 systemd-udevd[237957]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 22:56:24 kjcf05n03 dwd[5162]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 4 22:56:24 kjcf05n03 dwd[5162]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 4 22:56:24 kjcf05n03 dwd[5162]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 4 22:56:24 kjcf05n03 dwd[5162]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 4 22:56:24 kjcf05n03 dwd[5162]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 4 22:56:24 kjcf05n03 dwd[5162]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 4 22:56:24 kjcf05n03 dwd[5162]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 4 22:56:24 kjcf05n03 dwd[5162]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 4 22:56:24 kjcf05n03 dwd[5162]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 4 22:56:24 kjcf05n03 dwd[5162]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 4 22:56:24 kjcf05n03 dwd[5162]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 4 22:56:24 kjcf05n00 mcfcli[3673891]: %3|1730782584.389|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:56:24 kjcf05n03 dwd[5162]: Starting NVME thread for nvme4n1 Nov 4 22:56:24 kjcf05n03 dwd[5162]: Starting NVME thread for nvme18n1 Nov 4 22:56:24 kjcf05n03 dwd[5162]: Starting NVME thread for nvme23n1 Nov 4 22:56:25 kjcf05n03 dwd[5162]: Starting NVME thread for nvme2n1 Nov 4 22:56:25 kjcf05n03 dwd[5162]: Starting NVME thread for nvme19n1 Nov 4 22:56:25 kjcf05n03 dwd[5162]: Starting NVME thread for nvme25n1 Nov 4 22:56:25 kjcf05n03 dwd[5162]: Starting NVME thread for nvme3n1 Nov 4 22:56:26 kjcf05n03 dwd[5162]: Starting NVME thread for nvme8n1 Nov 4 22:56:26 kjcf05n03 dwd[5162]: Starting NVME thread for nvme9n1 Nov 4 22:56:26 kjcf05n03 dwd[5162]: Starting NVME thread for nvme24n1 Nov 4 22:56:26 kjcf05n03 dwd[5162]: Starting NVME thread for nvme17n1 Nov 4 22:56:26 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.mdt.name[MDT0000,mdt_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 4 22:56:28 kjcf05n03 diskmonitor[17340]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 4 22:56:30 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.swap.size[,pfree]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 4 22:56:32 kjcf05n03 diskmonitor[17340]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 4 22:56:32 kjcf05n03 diskmonitor[17340]: Scan for ReadErrorMax change for md65 Nov 4 22:56:32 kjcf05n03 diskmonitor[17340]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 4 22:56:32 kjcf05n03 diskmonitor[17340]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 4 22:56:32 kjcf05n03 diskmonitor[17340]: read_saved_file: md65 no saved speed Nov 4 22:56:32 kjcf05n03 diskmonitor[17340]: reconstruction_policy: sync_action prev = current = idle - md65 Nov 4 22:56:32 kjcf05n03 diskmonitor[17340]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 22:56:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 22:56:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 22:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 22:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 22:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 22:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 22:56:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 22:56:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 22:56:41 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 4 22:56:45 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 4 22:56:52 kjcf05n00 mcfcli[3673891]: %3|1730782612.582|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 22:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 22:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 22:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 22:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 22:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 22:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 22:56:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 22:56:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 22:57:01 kjcf05n00 mcfcli[3673891]: %3|1730782621.285|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:57:22 kjcf05n00 mcfcli[3673891]: %3|1730782642.582|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:57:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 22:57:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 22:57:35 kjcf05n03 nslcd[6913]: [ed7263] ldap_result() failed: Can't contact LDAP server Nov 4 22:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 22:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 22:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 22:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 22:57:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 22:57:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 22:57:39 kjcf05n00 mcfcli[3673891]: %3|1730782659.739|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:57:52 kjcf05n00 mcfcli[3673891]: %3|1730782672.582|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 22:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 22:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 22:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 22:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 22:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 22:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 22:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 22:58:19 kjcf05n00 mcfcli[3673891]: %3|1730782699.394|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:58:22 kjcf05n00 mcfcli[3673891]: %3|1730782702.582|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:58:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 22:58:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 22:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 22:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 22:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 22:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 22:58:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 22:58:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 22:58:52 kjcf05n00 mcfcli[3673891]: %3|1730782732.583|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 22:58:54 kjcf05n00 mcfcli[3673891]: %3|1730782734.362|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 22:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 22:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 22:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 22:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 22:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 22:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 22:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 22:59:11 kjcf05n00 zabbix-server[2522390]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 22:59:11 kjcf05n00 zabbix-server[2522390]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 4 22:59:11 kjcf05n00 log_interesting_event.py[2522390]: Event '46788' acknowledged Nov 4 22:59:22 kjcf05n00 mcfcli[3673891]: %3|1730782762.584|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:59:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 22:59:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 22:59:33 kjcf05n00 mcfcli[3673891]: %3|1730782773.848|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 22:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 22:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 22:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 22:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 22:59:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 22:59:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 22:59:50 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 4 22:59:50 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 4 22:59:52 kjcf05n00 mcfcli[3673891]: %3|1730782792.584|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 22:59:54 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 4 22:59:54 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 4 22:59:54 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 4 22:59:54 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 4 22:59:54 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 4 22:59:54 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 4 22:59:54 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 4 22:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 22:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 22:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 22:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 22:59:57 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 4 22:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 22:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 22:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 22:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 23:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 23:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 23:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 23:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 23:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 23:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 23:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 23:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 23:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 23:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 23:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 23:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 23:00:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 23:00:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:00:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 23:00:05 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 4 23:00:13 kjcf05n00 mcfcli[3673891]: %3|1730782813.845|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:00:22 kjcf05n00 mcfcli[3673891]: %3|1730782822.584|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:00:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 23:00:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 23:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 23:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 23:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 23:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 23:00:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 23:00:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 23:00:44 kjcf05n00 python3.9[2523330]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 23:00:52 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:50876). Nov 4 23:00:52 kjcf05n01 rsyncd[3944903]: connect from kjcf05n02 (172.16.2.5) Nov 4 23:00:52 kjcf05n01 rsyncd[3944903]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 4 23:00:52 kjcf05n01 rsyncd[3944903]: building file list Nov 4 23:00:52 kjcf05n01 rsyncd[3944903]: sent 11450 bytes received 136 bytes total size 10905 Nov 4 23:00:52 kjcf05n01 systemd[1]: rsyncd@671-172.16.2.2:873-172.16.2.5:50876.service: Succeeded. Nov 4 23:00:52 kjcf05n00 mcfcli[3673891]: %3|1730782852.584|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:00:53 kjcf05n00 mcfcli[3673891]: %3|1730782853.842|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 23:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 23:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 23:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 23:00:57 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730782856', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 23:00:57 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730782856'} Nov 4 23:00:57 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:00:57 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730782856', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 23:00:57 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730782856'} Nov 4 23:00:57 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 23:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 23:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 23:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 23:01:02 kjcf05n03 fstonithd.py[15114]: Listening for kdump packets from partner Nov 4 23:01:22 kjcf05n00 mcfcli[3673891]: %3|1730782882.585|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:01:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 23:01:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 23:01:33 kjcf05n00 mcfcli[3673891]: %3|1730782893.840|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 23:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 23:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 23:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 23:01:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 23:01:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 23:01:50 kjcf05n03 dwd[5162]: nvme4n1 passed periodic SMART status check Nov 4 23:01:50 kjcf05n03 dwd[5162]: nvme18n1 passed periodic SMART status check Nov 4 23:01:51 kjcf05n03 dwd[5162]: nvme3n1 passed periodic SMART status check Nov 4 23:01:51 kjcf05n03 dwd[5162]: nvme23n1 passed periodic SMART status check Nov 4 23:01:51 kjcf05n03 dwd[5162]: nvme25n1 passed periodic SMART status check Nov 4 23:01:51 kjcf05n03 dwd[5162]: nvme2n1 passed periodic SMART status check Nov 4 23:01:51 kjcf05n03 dwd[5162]: nvme19n1 passed periodic SMART status check Nov 4 23:01:52 kjcf05n03 dwd[5162]: nvme24n1 passed periodic SMART status check Nov 4 23:01:52 kjcf05n03 dwd[5162]: nvme9n1 passed periodic SMART status check Nov 4 23:01:52 kjcf05n03 dwd[5162]: nvme17n1 passed periodic SMART status check Nov 4 23:01:52 kjcf05n03 dwd[5162]: nvme8n1 passed periodic SMART status check Nov 4 23:01:52 kjcf05n00 mcfcli[3673891]: %3|1730782912.585|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 23:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 23:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 23:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 23:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 23:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 23:01:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 23:01:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 23:02:13 kjcf05n00 mcfcli[3673891]: %3|1730782933.195|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:02:19 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='34', client='AF_INET(172.16.2.5:38617)', local='AF_INET(0.0.0.0:601)' Nov 4 23:02:19 kjcf05n02 syslog-ng[3136]: Configuration reload request received, reloading configuration; Nov 4 23:02:19 kjcf05n02 syslog-ng[3136]: Configuration reload finished; Nov 4 23:02:19 kjcf05n02 syslog-ng[3136]: Syslog connection established; fd='18', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 4 23:02:20 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 4 23:02:20 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 23:02:20 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 4 23:02:20 kjcf05n02 dracut: Self testing crypto algorithms Nov 4 23:02:20 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 4 23:02:20 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 23:02:20 kjcf05n02 Copying live image to RAM... Nov 4 23:02:20 kjcf05n02 (this may take a minute) Nov 4 23:02:20 kjcf05n02 Done copying live image to RAM. Nov 4 23:02:20 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 4 23:02:20 kjcf05n02 dracut: Checking integrity of kernel Nov 4 23:02:20 kjcf05n02 dracut: All initrd crypto checks done Nov 4 23:02:20 kjcf05n02 dracut: Switching root Nov 4 23:02:20 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 4 23:02:20 kjcf05n02 systemd: Detected architecture x86-64. Nov 4 23:02:20 kjcf05n02 systemd: Set hostname to . Nov 4 23:02:20 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 4 23:02:20 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 4 23:02:20 kjcf05n02 systemd: Reached target rpc_pipefs.target. Nov 4 23:02:20 kjcf05n02 systemd: Reached target ZFS pool import target. Nov 4 23:02:20 kjcf05n02 systemd: Set up automount Arbitrary Executable File Formats File System Automount Point. Nov 4 23:02:20 kjcf05n02 systemd: Created slice system-getty.slice. Nov 4 23:02:20 kjcf05n02 systemd: Reached target ZFS startup target. Nov 4 23:02:20 kjcf05n02 systemd-journald[1539]: Journal started Nov 4 23:02:20 kjcf05n02 systemd-journald[1539]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 23:02:20 kjcf05n02 systemd-modules-load[1546]: Inserted module 'fuse' Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 4 23:02:20 kjcf05n02 systemd[1]: Mounted Temporary Directory (/tmp). Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Remount Root and Kernel File Systems. Nov 4 23:02:20 kjcf05n02 systemd[1]: Mounted POSIX Message Queue File System. Nov 4 23:02:20 kjcf05n02 systemd[1]: Mounted /WIBS. Nov 4 23:02:20 kjcf05n02 systemd[1]: Mounted /mnt. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Load Kernel Modules. Nov 4 23:02:20 kjcf05n02 systemd[1]: Mounted /data. Nov 4 23:02:20 kjcf05n02 systemd[1]: Mounting FUSE Control File System... Nov 4 23:02:20 kjcf05n02 systemd[1]: Mounting Kernel Configuration File System... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Apply Kernel Variables... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Load/Save Random Seed... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Rebuild Hardware Database... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Create System Users... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 4 23:02:20 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 4 23:02:20 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 4 23:02:20 kjcf05n02 systemd-sysctl[1563]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 23:02:20 kjcf05n02 systemd-sysctl[1563]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Create System Users. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 4 23:02:20 kjcf05n02 systemd-journald[1539]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 4 23:02:20 kjcf05n02 systemd-tmpfiles[1572]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 23:02:20 kjcf05n02 systemd-tmpfiles[1572]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 4 23:02:20 kjcf05n02 systemd-udevd[1582]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 4 23:02:20 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 4 23:02:20 kjcf05n02 systemd-udevd[1610]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:02:20 kjcf05n02 systemd-udevd[1591]: Using default interface naming scheme 'rhel-8.0'. Nov 4 23:02:20 kjcf05n02 systemd-udevd[1591]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 4 23:02:20 kjcf05n02 systemd-udevd[1603]: Using default interface naming scheme 'rhel-8.0'. Nov 4 23:02:20 kjcf05n02 systemd-udevd[1603]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:02:20 kjcf05n02 systemd-udevd[1652]: Using default interface naming scheme 'rhel-8.0'. Nov 4 23:02:20 kjcf05n02 systemd-udevd[1652]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:02:20 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 4 23:02:20 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 4 23:02:20 kjcf05n02 root[1815]: openibd: running in auto mode Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 4 23:02:20 kjcf05n02 systemd-tmpfiles[1818]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 23:02:20 kjcf05n02 systemd-tmpfiles[1818]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 23:02:20 kjcf05n02 systemd-tmpfiles[1818]: "/var/tmp" already exists and is not a directory. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started RPC Bind. Nov 4 23:02:20 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 4 23:02:20 kjcf05n02 systemd-modules-load[1929]: Inserted module 'ib_iser' Nov 4 23:02:20 kjcf05n02 systemd-modules-load[1929]: Inserted module 'ib_isert' Nov 4 23:02:20 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 4 23:02:20 kjcf05n02 systemd-modules-load[1929]: Inserted module 'ib_srpt' Nov 4 23:02:20 kjcf05n02 systemd-udevd[1655]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:02:20 kjcf05n02 systemd-modules-load[1934]: Inserted module 'ib_ipoib' Nov 4 23:02:20 kjcf05n02 systemd-udevd[1617]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:02:20 kjcf05n02 systemd-modules-load[1929]: Inserted module 'rdma_ucm' Nov 4 23:02:20 kjcf05n02 systemd-modules-load[1929]: Module 'svcrdma' is blacklisted Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 4 23:02:20 kjcf05n02 systemd-udevd[1617]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 23:02:20 kjcf05n02 systemd-udevd[1655]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 23:02:20 kjcf05n02 systemd-modules-load[1934]: Inserted module 'ib_umad' Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 4 23:02:20 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 4 23:02:20 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 4 23:02:20 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 23:02:20 kjcf05n02 systemd[3136]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:20 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 4 23:02:20 kjcf05n02 openibd[1799]: Loading HCA driver and Access Layer:[ OK ] Nov 4 23:02:20 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Update is Completed. Nov 4 23:02:20 kjcf05n02 setup-icl[1788]: Setting LAN IP Address to 203.0.113.3 Nov 4 23:02:20 kjcf05n02 setup-icl[1788]: Setting LAN Subnet Mask to 255.255.255.0 Nov 4 23:02:20 kjcf05n02 setup-icl[1788]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 4 23:02:20 kjcf05n02 setup-icl[1788]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 4 23:02:20 kjcf05n02 systemd-udevd[1655]: Using default interface naming scheme 'rhel-8.0'. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 4 23:02:20 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 4 23:02:20 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 4 23:02:20 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 4 23:02:20 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 4 23:02:20 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 4 23:02:20 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 4 23:02:20 kjcf05n02 systemd[1]: Reached target Sockets. Nov 4 23:02:20 kjcf05n02 systemd[1]: Reached target Basic System. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 4 23:02:20 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 4 23:02:20 kjcf05n02 network[2103]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[2130]: Setting up Mellanox network interface: ib1 Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 4 23:02:20 kjcf05n02 network[2132]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 23:02:20 kjcf05n02 network[2103]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 4 23:02:20 kjcf05n02 mcelog[2143]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 4 23:02:20 kjcf05n02 mcelog[2143]: CPU is unsupported Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 4 23:02:20 kjcf05n02 network[2152]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:02:20 kjcf05n02 network[2103]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 4 23:02:20 kjcf05n02 nscd[2178]: 2178 monitoring file `/etc/hosts` (1) Nov 4 23:02:20 kjcf05n02 nscd[2178]: 2178 monitoring directory `/etc` (2) Nov 4 23:02:20 kjcf05n02 nscd[2178]: 2178 monitoring file `/etc/resolv.conf` (3) Nov 4 23:02:20 kjcf05n02 nscd[2178]: 2178 monitoring directory `/etc` (2) Nov 4 23:02:20 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 23:02:20 kjcf05n02 network[2175]: It is advised to switch to 'NetworkManager' instead for network management. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 4 23:02:20 kjcf05n02 dbus-daemon[2148]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[2190]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 23:02:20 kjcf05n02 chronyd[2228]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 0 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 1 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 2 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 3 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 4 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 5 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 6 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 7 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 8 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 9 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 10 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 11 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 12 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 13 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 14 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 15 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 16 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 17 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 18 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 19 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 20 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 21 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 22 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 23 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 24 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 25 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 26 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 27 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 28 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 29 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 30 Nov 4 23:02:20 kjcf05n02 cpupower[2221]: Setting cpu: 31 Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[2208]: Setting up Mellanox network interface: ib0 Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 23:02:20 kjcf05n02 dwd[2195]: dwd: vMay 29 2024 : 15:38:26 Nov 4 23:02:20 kjcf05n02 dwd[2195]: /usr/sbin/dwd -d --standalone=0 Nov 4 23:02:20 kjcf05n02 dwd[2195]: dwd: option Lethal: 0 Nov 4 23:02:20 kjcf05n02 dwd[2195]: dwd: option Interval: 60 Nov 4 23:02:20 kjcf05n02 dwd[2195]: dwd: option abrtlimit: 10 Nov 4 23:02:20 kjcf05n02 dwd[2195]: dwd: option DZPeriod: 604800 Nov 4 23:02:20 kjcf05n02 dwd[2195]: dwd: option SmartPeriod: 43200 Nov 4 23:02:20 kjcf05n02 dwd[2195]: dwd: option SDDEnabled: 1 Nov 4 23:02:20 kjcf05n02 dwd[2195]: dwd: option SDDAwaitScale: 3 Nov 4 23:02:20 kjcf05n02 dwd[2195]: dwd: option SDDAwaitMin: 100 Nov 4 23:02:20 kjcf05n02 dwd[2195]: dwd: option Verbosity: 1 Nov 4 23:02:20 kjcf05n02 dwd[2195]: dwd: option StandAlone: 0 Nov 4 23:02:20 kjcf05n02 dwd[2195]: option Lethal: 0 Nov 4 23:02:20 kjcf05n02 dwd[2195]: option Interval: 60 Nov 4 23:02:20 kjcf05n02 dwd[2195]: option abrtlimit: 10 Nov 4 23:02:20 kjcf05n02 dwd[2195]: option DZPeriod: 604800 Nov 4 23:02:20 kjcf05n02 dwd[2195]: option SmartPeriod: 43200 Nov 4 23:02:20 kjcf05n02 dwd[2195]: option SDDEnabled: 1 Nov 4 23:02:20 kjcf05n02 dwd[2195]: option SDDAwaitScale: 3 Nov 4 23:02:20 kjcf05n02 dwd[2195]: option SDDAwaitMin: 100 Nov 4 23:02:20 kjcf05n02 dwd[2195]: option Verbosity: 1 Nov 4 23:02:20 kjcf05n02 dwd[2195]: option StandAlone: 0 Nov 4 23:02:20 kjcf05n02 beSetMlxConfig[2215]: ConnectX-3 multiport not detected Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[2240]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 4 23:02:20 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 4 23:02:20 kjcf05n02 mdraid-phy[2235]: no Cutlass to worry about Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 4 23:02:20 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 4 23:02:20 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 4 23:02:20 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[2275]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[2277]: No configuration found for ib1 Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 4 23:02:20 kjcf05n02 sssd[sssd][2131]: Starting up Nov 4 23:02:20 kjcf05n02 chronyd[2228]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 23:02:20 kjcf05n02 chronyd[2228]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 0 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 1 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 2 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 3 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 4 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 5 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 6 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 7 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 8 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 9 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 10 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 11 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 12 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 13 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 14 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 15 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 16 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 17 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 18 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 19 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 20 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 21 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 22 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 23 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 24 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 25 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 26 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 27 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 28 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 29 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 30 Nov 4 23:02:20 kjcf05n02 cpupower[2303]: Idlestate 2 disabled on CPU 31 Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[2294]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[2300]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 23:02:20 kjcf05n02 beSetMlxConfig[2215]: Starting MST (Mellanox Software Tools) driver set Nov 4 23:02:20 kjcf05n02 dbus-daemon[2148]: [system] Successfully activated service 'org.freedesktop.systemd1' Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[2310]: No configuration found for ib0 Nov 4 23:02:20 kjcf05n02 mlnx_conf_mgr[2334]: INFO: No configurations found for mlx5_1, skipping. Nov 4 23:02:20 kjcf05n02 beSetMlxConfig[2215]: Loading MST PCI module - Success Nov 4 23:02:20 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[2340]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 23:02:20 kjcf05n02 beSetMlxConfig[2215]: Loading MST PCI configuration module - Success Nov 4 23:02:20 kjcf05n02 beSetMlxConfig[2215]: Create devices Nov 4 23:02:20 kjcf05n02 mlnx_conf_mgr[2376]: INFO: No configurations found for mlx5_0, skipping. Nov 4 23:02:20 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 23:02:20 kjcf05n02 sssd[be[implicit_files]][2322]: Starting up Nov 4 23:02:20 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 4 23:02:20 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 4 23:02:20 kjcf05n02 sssd[nss][2444]: Starting up Nov 4 23:02:20 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 4 23:02:20 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Login Service... Nov 4 23:02:20 kjcf05n02 systemd-logind[2563]: New seat seat0. Nov 4 23:02:20 kjcf05n02 systemd-logind[2563]: Watching system buttons on /dev/input/event0 (Power Button) Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Login Service. Nov 4 23:02:20 kjcf05n02 python3.9[2256]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 23:02:20 kjcf05n02 python3.9[3136]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:20 kjcf05n02 systemd-sysctl[2734]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 23:02:20 kjcf05n02 systemd-sysctl[2734]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 4 23:02:20 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 23:02:20 kjcf05n02 python3.9[2869]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 23:02:20 kjcf05n02 python3.9[3136]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 23:02:20 kjcf05n02 network[2103]: Bringing up loopback interface: [ OK ] Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 4 23:02:20 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 23:02:20 kjcf05n02 systemd-sysctl[3080]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 23:02:20 kjcf05n02 systemd-sysctl[3080]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 23:02:20 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 4 23:02:20 kjcf05n02 systemd[1]: Reached target Network. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 4 23:02:20 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 4 23:02:20 kjcf05n02 sm-notify[3147]: Version 2.3.3 starting Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 4 23:02:20 kjcf05n02 python3.9[3071]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 23:02:20 kjcf05n02 python3.9[3136]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:20 kjcf05n02 sshd[3115]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 4 23:02:20 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 4 23:02:20 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 4 23:02:20 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 4 23:02:20 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 4 23:02:20 kjcf05n02 lldpad[3116]: setsockopt nearest_bridge: Invalid argument Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 4 23:02:20 kjcf05n02 lldpad[3116]: setsockopt nearest_bridge: Invalid argument Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 4 23:02:20 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 4 23:02:20 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 23:02:20 kjcf05n02 syslog-ng[3136]: [2024-11-05T05:01:05.727062] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 4 23:02:20 kjcf05n02 syslog-ng[3136]: [2024-11-05T05:01:05.727331] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 4 23:02:20 kjcf05n02 syslog-ng[3136]: [2024-11-05T05:01:05.727372] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 4 23:02:20 kjcf05n02 syslog-ng[3136]: [2024-11-05T05:01:05.727934] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 4 23:02:20 kjcf05n02 syslog-ng[3136]: [2024-11-05T05:01:05.728111] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 4 23:02:20 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 4 23:02:20 kjcf05n02 beSetMlxConfig[2215]: Unloading MST PCI module (unused) - Success Nov 4 23:02:20 kjcf05n02 python3.9[3202]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 23:02:20 kjcf05n02 python3.9[3136]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 4 23:02:20 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 23:02:20 kjcf05n02 python3.9[3428]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 23:02:20 kjcf05n02 python3.9[3136]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 4 23:02:20 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 4 23:02:20 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 23:02:20 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 4 23:02:20 kjcf05n02 chronyd[2228]: System's initial offset : 0.000107 seconds slow of true (slew) Nov 4 23:02:20 kjcf05n02 systemd[1]: Started NTP client/server. Nov 4 23:02:20 kjcf05n02 beSetMlxConfig[2215]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 23:02:20 kjcf05n02 beSetMlxConfig[2215]: ib mode Nov 4 23:02:20 kjcf05n02 root[3448]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 4 23:02:20 kjcf05n02 root[3450]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 4 23:02:20 kjcf05n02 beSetMlxConfig[2215]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 23:02:20 kjcf05n02 beSetMlxConfig[2215]: ib mode Nov 4 23:02:20 kjcf05n02 systemd-udevd[1582]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 23:02:20 kjcf05n02 systemd-udevd[3467]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:02:20 kjcf05n02 systemd-udevd[3468]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:02:20 kjcf05n02 systemd-udevd[3471]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:02:20 kjcf05n02 systemd-udevd[3474]: Using default interface naming scheme 'rhel-8.0'. Nov 4 23:02:20 kjcf05n02 systemd-udevd[3474]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:02:20 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 23:02:20 kjcf05n02 systemd[3136]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:20 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[3509]: Setting up Mellanox network interface: ib0 Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[3510]: Setting up Mellanox network interface: ib1 Nov 4 23:02:20 kjcf05n02 systemd-udevd[3469]: Using default interface naming scheme 'rhel-8.0'. Nov 4 23:02:20 kjcf05n02 systemd-udevd[3469]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:02:20 kjcf05n02 systemd-udevd[3470]: Using default interface naming scheme 'rhel-8.0'. Nov 4 23:02:20 kjcf05n02 systemd-udevd[3470]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[3559]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[3560]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[3589]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[3591]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[3592]: No configuration found for ib0 Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[3593]: No configuration found for ib1 Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[3600]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[3601]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 23:02:20 kjcf05n02 mlnx_conf_mgr[3640]: INFO: No configurations found for mlx5_0, skipping. Nov 4 23:02:20 kjcf05n02 mlnx_conf_mgr[3641]: INFO: No configurations found for mlx5_1, skipping. Nov 4 23:02:20 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 23:02:20 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 23:02:20 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 4 23:02:20 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 4 23:02:20 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 4 23:02:20 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 4 23:02:20 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 4 23:02:20 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 23:02:20 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 4 23:02:20 kjcf05n02 lldpad[3116]: init_ports: Error adding device ib0 Nov 4 23:02:20 kjcf05n02 lldpad[3116]: init_ports: Error adding device ib1 Nov 4 23:02:20 kjcf05n02 lldpad[3116]: Signal 15 received - terminating Nov 4 23:02:20 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 4 23:02:20 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 4 23:02:20 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 4 23:02:20 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 4 23:02:20 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 4 23:02:20 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 4 23:02:20 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 4 23:02:20 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:20 kjcf05n02 systemd[3136]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:20 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 1 | Nov-05-2024 | 04:31:39 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 2 | Nov-05-2024 | 04:32:30 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 3 | Nov-05-2024 | 04:32:31 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 4 | Nov-05-2024 | 04:33:36 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 5 | Nov-05-2024 | 04:33:37 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 6 | Nov-05-2024 | 04:58:19 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 7 | Nov-05-2024 | 04:58:19 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 8 | Nov-05-2024 | 04:58:19 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 9 | Nov-05-2024 | 04:58:19 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 10 | Nov-05-2024 | 04:58:19 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 11 | Nov-05-2024 | 04:58:19 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 12 | Nov-05-2024 | 04:58:19 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 13 | Nov-05-2024 | 04:58:19 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 14 | Nov-05-2024 | 04:58:19 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 15 | Nov-05-2024 | 04:58:19 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 16 | Nov-05-2024 | 04:58:19 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 17 | Nov-05-2024 | 04:58:19 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 18 | Nov-05-2024 | 04:58:19 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 19 | Nov-05-2024 | 04:58:19 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 20 | Nov-05-2024 | 04:58:19 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 21 | Nov-05-2024 | 04:58:19 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 22 | Nov-05-2024 | 04:58:19 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 23 | Nov-05-2024 | 04:58:19 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 24 | Nov-05-2024 | 04:58:19 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 25 | Nov-05-2024 | 04:58:19 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 26 | Nov-05-2024 | 04:58:19 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 27 | Nov-05-2024 | 04:58:19 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 28 | Nov-05-2024 | 04:58:21 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 29 | Nov-05-2024 | 04:58:21 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 30 | Nov-05-2024 | 04:58:21 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 31 | Nov-05-2024 | 04:58:21 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 32 | Nov-05-2024 | 04:58:21 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 33 | Nov-05-2024 | 04:58:21 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 34 | Nov-05-2024 | 04:58:21 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 35 | Nov-05-2024 | 04:58:21 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 36 | Nov-05-2024 | 04:58:21 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 37 | Nov-05-2024 | 04:58:21 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 38 | Nov-05-2024 | 04:58:50 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 39 | Nov-05-2024 | 04:58:50 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 40 | Nov-05-2024 | 04:58:50 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 41 | Nov-05-2024 | 04:58:50 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 42 | Nov-05-2024 | 04:58:50 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 43 | Nov-05-2024 | 04:58:50 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 44 | Nov-05-2024 | 04:58:50 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 45 | Nov-05-2024 | 04:58:50 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 46 | Nov-05-2024 | 04:58:50 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 47 | Nov-05-2024 | 04:58:50 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 48 | Nov-05-2024 | 04:58:50 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 23:02:20 kjcf05n02 ipmievd[3981]: 49 | Nov-05-2024 | 04:58:50 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 23:02:20 kjcf05n02 ipmievd[3986]: Reading sensors... Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 4 23:02:20 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:20 kjcf05n02 systemd[3136]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 4 23:02:20 kjcf05n02 nscd[2178]: 2178 monitored file `/etc/hosts` was moved into place, adding watch Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 23:02:20 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 4 23:02:20 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 4 23:02:20 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 4 23:02:20 kjcf05n02 beSetMlxConfig[4042]: ConnectX-3 multiport not detected Nov 4 23:02:20 kjcf05n02 beSetMlxConfig[4042]: Starting MST (Mellanox Software Tools) driver set Nov 4 23:02:20 kjcf05n02 beSetMlxConfig[4042]: Loading MST PCI module - Success Nov 4 23:02:20 kjcf05n02 systemd-udevd[1582]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 23:02:20 kjcf05n02 beSetMlxConfig[4042]: [warn] mst_pciconf is already loaded, skipping Nov 4 23:02:20 kjcf05n02 beSetMlxConfig[4042]: Create devices Nov 4 23:02:20 kjcf05n02 beSetMlxConfig[4042]: Unloading MST PCI module (unused) - Success Nov 4 23:02:20 kjcf05n02 ipmievd[3986]: Waiting for events... Nov 4 23:02:20 kjcf05n02 beSetMlxConfig[4042]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 23:02:20 kjcf05n02 beSetMlxConfig[4042]: ib mode Nov 4 23:02:20 kjcf05n02 beSetMlxConfig[4042]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 23:02:20 kjcf05n02 beSetMlxConfig[4042]: ib mode Nov 4 23:02:20 kjcf05n02 systemd-udevd[1582]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 23:02:20 kjcf05n02 systemd-udevd[4943]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:02:20 kjcf05n02 systemd-udevd[4944]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:02:20 kjcf05n02 systemd-udevd[4947]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:02:20 kjcf05n02 systemd-udevd[4949]: Using default interface naming scheme 'rhel-8.0'. Nov 4 23:02:20 kjcf05n02 systemd-udevd[4949]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:02:20 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 23:02:20 kjcf05n02 systemd[3136]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:20 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[4985]: Setting up Mellanox network interface: ib1 Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[4986]: Setting up Mellanox network interface: ib0 Nov 4 23:02:20 kjcf05n02 systemd-udevd[4945]: Using default interface naming scheme 'rhel-8.0'. Nov 4 23:02:20 kjcf05n02 systemd-udevd[4946]: Using default interface naming scheme 'rhel-8.0'. Nov 4 23:02:20 kjcf05n02 systemd-udevd[4945]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:02:20 kjcf05n02 systemd-udevd[4946]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[5035]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[5036]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[5066]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[5067]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[5068]: No configuration found for ib1 Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[5069]: No configuration found for ib0 Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[5073]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 23:02:20 kjcf05n02 mlnx_interface_mgr[5077]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 23:02:20 kjcf05n02 mlnx_conf_mgr[5111]: INFO: No configurations found for mlx5_1, skipping. Nov 4 23:02:20 kjcf05n02 mlnx_conf_mgr[5117]: INFO: No configurations found for mlx5_0, skipping. Nov 4 23:02:20 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 23:02:20 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}917c1aaaa339aaac8fa1894237e08eb264dae90c2ab936c174fb971b7f1187ea' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}917c1aaaa339aaac8fa1894237e08eb264dae90c2ab936c174fb971b7f1187ea' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}2a1495fb8cf910923c09fe177cb9b4d1532f5495693361e9e2cf25515ca1fa38' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}2a1495fb8cf910923c09fe177cb9b4d1532f5495693361e9e2cf25515ca1fa38' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}9377a69a3ee12e17bca1027ac71b56b8233fff78e4b9a9c8fc52da5f6238759f' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}9377a69a3ee12e17bca1027ac71b56b8233fff78e4b9a9c8fc52da5f6238759f' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}e5298d7afce6fce96afb6194ac0753d832a0177c9d880e4e95271f763e6a5801' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}e5298d7afce6fce96afb6194ac0753d832a0177c9d880e4e95271f763e6a5801' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 23:02:20 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 4 23:02:20 kjcf05n02 chronyd[2228]: chronyd exiting Nov 4 23:02:20 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 4 23:02:20 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 4 23:02:20 kjcf05n02 chronyd[5151]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 23:02:20 kjcf05n02 chronyd[5151]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 23:02:20 kjcf05n02 chronyd[5151]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 23:02:20 kjcf05n02 chronyd[5151]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 4 23:02:20 kjcf05n02 systemd[1]: Started NTP client/server. Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 23:02:20 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:20 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 4 23:02:20 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 4 23:02:20 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 23:02:20 kjcf05n02 dwd[5182]: dwd: vMay 29 2024 : 15:38:26 Nov 4 23:02:20 kjcf05n02 dwd[5182]: /usr/sbin/dwd -i 15 -d Nov 4 23:02:20 kjcf05n02 dwd[5182]: dwd: option Lethal: 0 Nov 4 23:02:20 kjcf05n02 dwd[5182]: dwd: option Interval: 15 Nov 4 23:02:20 kjcf05n02 dwd[5182]: dwd: option abrtlimit: 10 Nov 4 23:02:20 kjcf05n02 dwd[5182]: dwd: option DZPeriod: 604800 Nov 4 23:02:20 kjcf05n02 dwd[5182]: dwd: option SmartPeriod: 43200 Nov 4 23:02:20 kjcf05n02 dwd[5182]: dwd: option SDDEnabled: 1 Nov 4 23:02:20 kjcf05n02 dwd[5182]: dwd: option SDDAwaitScale: 3 Nov 4 23:02:20 kjcf05n02 dwd[5182]: dwd: option SDDAwaitMin: 100 Nov 4 23:02:20 kjcf05n02 dwd[5182]: dwd: option Verbosity: 1 Nov 4 23:02:20 kjcf05n02 dwd[5182]: dwd: option StandAlone: 0 Nov 4 23:02:20 kjcf05n02 dwd[5182]: option Lethal: 0 Nov 4 23:02:20 kjcf05n02 dwd[5182]: option Interval: 15 Nov 4 23:02:20 kjcf05n02 dwd[5182]: option abrtlimit: 10 Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 23:02:20 kjcf05n02 dwd[5182]: option DZPeriod: 604800 Nov 4 23:02:20 kjcf05n02 dwd[5182]: option SmartPeriod: 43200 Nov 4 23:02:20 kjcf05n02 dwd[5182]: option SDDEnabled: 1 Nov 4 23:02:20 kjcf05n02 dwd[5182]: option SDDAwaitScale: 3 Nov 4 23:02:20 kjcf05n02 dwd[5182]: option SDDAwaitMin: 100 Nov 4 23:02:20 kjcf05n02 dwd[5182]: option Verbosity: 1 Nov 4 23:02:20 kjcf05n02 dwd[5182]: option StandAlone: 0 Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 4 23:02:20 kjcf05n02 dwd[5183]: option Lethal now set to 1 Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 23:02:20 kjcf05n02 dwd[5183]: option abrtlimit now set to 1 Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 23:02:20 kjcf05n02 dwd[5183]: option SmartPeriod now set to 86400 Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 23:02:20 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 23:02:20 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:20 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:20 kjcf05n02 python3.9[5212]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 4 23:02:20 kjcf05n02 python3.9[3136]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 23:02:20 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:20 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 23:02:20 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 4 23:02:20 kjcf05n02 sedcpwrkr[5349]: Using config script: /etc/sedcpwrkr.conf Nov 4 23:02:20 kjcf05n02 sedcpwrkr[5349]: - Creating default directory: '/var/log/sedcpwrkr' Nov 4 23:02:20 kjcf05n02 sedcpwrkr[5349]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 4 23:02:20 kjcf05n02 sedcpwrkr[5349]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 4 23:02:20 kjcf05n02 sedcpwrkr[5349]: - Creating default directory: '/var/run/sedcpwrkr' Nov 4 23:02:20 kjcf05n02 sedcpwrkr[5349]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 4 23:02:20 kjcf05n02 sedcpwrkr[5349]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 4 23:02:20 kjcf05n02 sedcpwrkr-server[5380]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 23:02:20 kjcf05n02 sedcpwrkr[5349]: celery multi v5.2.7 (dawn-chorus) Nov 4 23:02:20 kjcf05n02 sedcpwrkr[5349]: > Starting nodes... Nov 4 23:02:20 kjcf05n02 sedcpwrkr[5349]: > sedcpwrkr@kjcf05n02: OK Nov 4 23:02:20 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 4 23:02:20 kjcf05n02 sedcpwrkr-server[5382]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 23:02:20 kjcf05n02 sedcpwrkr-server[5382]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 23:02:20 kjcf05n02 sedcpwrkr-server[5382]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 23:02:20 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 23:02:20 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 4 23:02:20 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 23:02:20 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 4 23:02:20 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 4 23:02:20 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:20 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 4 23:02:20 kjcf05n02 systemd-udevd[1582]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 23:02:20 kjcf05n02 iptables.init[5450]: iptables: Applying firewall rules: [ OK ] Nov 4 23:02:20 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 4 23:02:20 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:20 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 4 23:02:21 kjcf05n02 systemd[3136]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 23:02:21 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 23:02:21 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 23:02:21 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:21 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 23:02:22 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5547 which is not our child. We'll most likely not notice when it exits. Nov 4 23:02:22 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 23:02:22 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:22 kjcf05n02 openhpid[5547]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 23:02:22 kjcf05n02 openhpid[5547]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 23:02:22 kjcf05n02 openhpid[5547]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 23:02:22 kjcf05n02 openhpid[5547]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 23:02:22 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:22 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:22 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:22 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 4 23:02:22 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 4 23:02:22 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 23:02:22 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 23:02:22 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:22 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 4 23:02:22 kjcf05n00 mcfcli[3673891]: %3|1730782942.585|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 23:02:23 kjcf05n02 dcs-collectord[5638]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 4 23:02:23 kjcf05n02 hpi.inv.log[5638]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 4 23:02:23 kjcf05n02 dcs-collectord[5638]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 4 23:02:23 kjcf05n02 dcs-collectord[5638]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 4 23:02:23 kjcf05n02 dcs-collector[5629]: Starting dcs-collector:[ OK ] Nov 4 23:02:23 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 4 23:02:23 kjcf05n02 dcs-collectord[5641]: INFO Starting collection for memory_info (collection_process.py:52) Nov 4 23:02:23 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 4 23:02:23 kjcf05n02 dcs-collectord[5641]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 23:02:23 kjcf05n02 dcs-collectord[5641]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 23:02:23 kjcf05n02 dcs-collectord[5641]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259346524", "units": "kB"}, {"name": "MemAvailable", "value": "258626252", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821280", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686916", "units": "kB"}, {"name": "Inactive", "value": "962616", "units": "kB"}, {"name": "Active(anon)", "value": "1520884", "units": "kB"}, {"name": "Inactive(anon)", "value": "826324", "units": "kB"}, {"name": "Active(file)", "value": "166032", "units": "kB"}, {"name": "Inactive(file)", "value": "136292", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "753436", "units": "kB"}, {"name": "Mapped", "value": "86412", "units": "kB"}, {"name": "Shmem", "value": "1593404", "units": "kB"}, {"name": "KReclaimable", "value": "109292", "units": "kB"}, {"name": "Slab", "value": "274384", "units": "kB"}, {"name": "SReclaimable", "value": "109292", "units": "kB"}, {"name": "SUnreclaim", "value": "165092", "units": "kB"}, {"name": "KernelStack", "value": "9616", "units": "kB"}, {"name": "PageTables", "value": "20308", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3323772", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11392", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "6144", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "272712", "units": "kB"}, {"name": "DirectMap2M", "value": "22661120", "units": "kB"}, {"name": "DirectMap1G", "value": "245366784", "units": "kB"}]}' Nov 4 23:02:23 kjcf05n02 dcs-collectord[5641]: INFO Completed collection for memory_info (collection_process.py:59) Nov 4 23:02:23 kjcf05n02 dcs-collectord[5641]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 23:02:23 kjcf05n02 dcs-collectord[5641]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 4 23:02:23 kjcf05n02 dcs-collectord[5641]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 4 23:02:23 kjcf05n02 dcs-collectord[5641]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 4 23:02:23 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:23 kjcf05n02 dcs-collectord[5641]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 4 23:02:23 kjcf05n02 dcs-collectord[5641]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730782943.212967], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730782943.44788], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730782943.1463425, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 4 23:02:23 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:23 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 4 23:02:23 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:23 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:23 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 4 23:02:23 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 4 23:02:23 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 23:02:23 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 23:02:23 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:24 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 4 23:02:24 kjcf05n02 firmware-update-orc[5747]: Using config script: /etc/firmware_update_orc.conf Nov 4 23:02:24 kjcf05n02 firmware-update-orc[5747]: - Creating default directory: '/var/log/firmware-update-orc' Nov 4 23:02:24 kjcf05n02 firmware-update-orc[5747]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 4 23:02:24 kjcf05n02 firmware-update-orc[5747]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 4 23:02:24 kjcf05n02 firmware-update-orc[5747]: - Creating default directory: '/var/run/firmware-update-orc' Nov 4 23:02:24 kjcf05n02 firmware-update-orc[5747]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 4 23:02:24 kjcf05n02 firmware-update-orc[5747]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 4 23:02:24 kjcf05n02 firmware-update-orc-server[5783]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 23:02:24 kjcf05n02 firmware-update-orc[5747]: celery multi v5.2.7 (dawn-chorus) Nov 4 23:02:24 kjcf05n02 firmware-update-orc[5747]: > Starting nodes... Nov 4 23:02:24 kjcf05n02 firmware-update-orc[5747]: > worker1@kjcf05n02: OK Nov 4 23:02:24 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 4 23:02:24 kjcf05n02 firmware-update-orc-server[5787]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 23:02:24 kjcf05n02 firmware-update-orc-server[5787]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 23:02:24 kjcf05n02 firmware-update-orc-server[5787]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 23:02:24 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 4 23:02:24 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:25 kjcf05n02 systemd[3136]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:25 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:25 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:25 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 23:02:25 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 23:02:25 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 23:02:25 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 23:02:25 kjcf05n02 dbus-daemon[2148]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 23:02:25 kjcf05n02 dbus-daemon[2148]: [system] Reloaded configuration Nov 4 23:02:25 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 4 23:02:25 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 4 23:02:25 kjcf05n02 dbus-daemon[2148]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 23:02:25 kjcf05n02 dbus-daemon[2148]: [system] Reloaded configuration Nov 4 23:02:25 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 23:02:25 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 23:02:25 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 23:02:25 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 23:02:25 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:25 kjcf05n04 python3.9[10466]: [ses_monitor.py:863 - send_syslog_gem_msg() ] [INFO] CSM:Generic : GEM /dev/sg10 SGFGD20025060FF: 2024-11-05 00:02:51.112; HAL; hal; 02; Bad CRC on IPC frame on expected 00000001 got c2e49e42 on endpoint I2C Transport 5:1 Nov 4 23:02:25 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 4 23:02:26 kjcf05n02 ras-resource-manager-agent[5903]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 4 23:02:26 kjcf05n02 ras-resource-manager-agent[5889]: Starting ras-resource-manager-agent:[ OK ] Nov 4 23:02:26 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 4 23:02:26 kjcf05n02 ras-resource-manager-agent[5905]: INFO Starting the service handler (service_main_handler.py:98) Nov 4 23:02:26 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 4 23:02:26 kjcf05n02 ras-resource-manager-client[5905]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 4 23:02:26 kjcf05n02 ras-resource-manager-client[5905]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 23:02:26 kjcf05n02 ras-resource-manager-client[5915]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 23:02:26 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:26 kjcf05n02 systemd[3136]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:26 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:26 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:26 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 23:02:26 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 23:02:26 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:26 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 23:02:26 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:27 kjcf05n02 systemd[3136]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: Press Ctrl+C to exit. Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: Plugin support version 1.0 Nov 4 23:02:27 kjcf05n02 zabbix_agent2[5989]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 23:02:27 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:27 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:27 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:27 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 4 23:02:27 kjcf05n02 dcs-notification-sender[6065]: dcs-notification-senderd is stopped Nov 4 23:02:27 kjcf05n02 zabbix-agent2[6079]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 4 23:02:27 kjcf05n02 dcs-notification-sender[6065]: Starting notification-sender:[ OK ] Nov 4 23:02:27 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 4 23:02:28 kjcf05n02 zabbix-agent2[6081]: INFO DCS notification agent started. (agent.py:61) Nov 4 23:02:28 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 4 23:02:28 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:28 kjcf05n02 systemd[3136]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:28 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:28 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:28 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:28 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 4 23:02:29 kjcf05n02 dcs-collectord[6166]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 4 23:02:29 kjcf05n02 dcs-collectord[6166]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 4 23:02:29 kjcf05n02 dcs-bulk-data-sender[6166]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 4 23:02:29 kjcf05n02 dcs-bulk-data-sender[6157]: Starting bulk-data-sender:[ OK ] Nov 4 23:02:29 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 4 23:02:29 kjcf05n02 dcs-collectord[6168]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 4 23:02:29 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 4 23:02:29 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:29 kjcf05n02 systemd[3136]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:29 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:29 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:29 kjcf05n02 nscd[2178]: 2178 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 4 23:02:29 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 23:02:29 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 23:02:29 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 23:02:29 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 23:02:29 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 23:02:29 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 23:02:29 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 4 23:02:29 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 4 23:02:29 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 4 23:02:29 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 4 23:02:29 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 23:02:29 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 23:02:29 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 23:02:29 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 23:02:29 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 23:02:29 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 23:02:29 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 4 23:02:30 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 4 23:02:30 kjcf05n02 sssd[nss][2444]: Shutting down (status = 0) Nov 4 23:02:30 kjcf05n02 sssd[be[implicit_files]][2322]: Shutting down (status = 0) Nov 4 23:02:30 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 4 23:02:30 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 4 23:02:30 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 4 23:02:30 kjcf05n02 sssd[sssd][6269]: Starting up Nov 4 23:02:30 kjcf05n02 sssd[be[implicit_files]][6270]: Starting up Nov 4 23:02:30 kjcf05n02 python3.9[5212]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 4 23:02:30 kjcf05n02 python3.9[3136]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:30 kjcf05n02 sssd[nss][6271]: Starting up Nov 4 23:02:30 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 4 23:02:30 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 23:02:30 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 23:02:31 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 23:02:31 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 23:02:31 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 4 23:02:31 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 4 23:02:31 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 23:02:31 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 23:02:31 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 4 23:02:31 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 4 23:02:31 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 4 23:02:31 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 4 23:02:31 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 23:02:31 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 23:02:31 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 23:02:31 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 23:02:31 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:02:31 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:02:31 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:31 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 4 23:02:32 kjcf05n02 icinga2[6320]: [2024-11-04 23:02:32 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 4 23:02:32 kjcf05n02 icinga2[6320]: [2024-11-04 23:02:32 -0600] information/cli: Loading configuration file(s). Nov 4 23:02:32 kjcf05n02 icinga2[6320]: [2024-11-04 23:02:32 -0600] information/ConfigItem: Committing config item(s). Nov 4 23:02:32 kjcf05n02 icinga2[6320]: [2024-11-04 23:02:32 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 4 23:02:32 kjcf05n02 icinga2[6320]: [2024-11-04 23:02:32 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 4 23:02:32 kjcf05n02 icinga2[6320]: [2024-11-04 23:02:32 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 4 23:02:32 kjcf05n02 icinga2[6320]: [2024-11-04 23:02:32 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 4 23:02:32 kjcf05n02 icinga2[6320]: [2024-11-04 23:02:32 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 4 23:02:32 kjcf05n02 icinga2[6320]: [2024-11-04 23:02:32 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 4 23:02:32 kjcf05n02 icinga2[6320]: [2024-11-04 23:02:32 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 4 23:02:32 kjcf05n02 icinga2[6320]: [2024-11-04 23:02:32 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 4 23:02:32 kjcf05n02 icinga2[6320]: [2024-11-04 23:02:32 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 4 23:02:32 kjcf05n02 icinga2[6320]: [2024-11-04 23:02:32 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 4 23:02:32 kjcf05n02 icinga2[6320]: [2024-11-04 23:02:32 -0600] information/cli: Closing console log. Nov 4 23:02:32 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 4 23:02:32 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:32 kjcf05n02 systemd[3136]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:32 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:32 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:32 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 4 23:02:33 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 23:02:33 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 23:02:33 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 23:02:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 23:02:33 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 4 23:02:33 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:34 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 23:02:34 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:34 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:34 kjcf05n00 zabbix_server[15653]: item "kjcf05n02:vfs.fs.size[/mnt/persistent_ha_data,total]" became not supported: no such file or directory Nov 4 23:02:34 kjcf05n00 zabbix_server[15653]: item "kjcf05n02:vfs.fs.inode[/mnt/persistent_ha_data,pfree]" became not supported: no such file or directory Nov 4 23:02:34 kjcf05n00 zabbix_server[15653]: item "kjcf05n02:vfs.fs.size[/mnt/persistent_ha_data,used]" became not supported: no such file or directory Nov 4 23:02:34 kjcf05n00 zabbix_server[15653]: item "kjcf05n02:vfs.fs.size[/mnt/persistent_ha_data,pused]" became not supported: no such file or directory Nov 4 23:02:34 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 23:02:34 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 23:02:34 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 23:02:34 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 23:02:34 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 4 23:02:34 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 4 23:02:34 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 4 23:02:34 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 4 23:02:34 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 23:02:34 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 23:02:34 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 23:02:34 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 23:02:34 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 4 23:02:34 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 4 23:02:35 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:35 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 4 23:02:35 kjcf05n02 nslcd[6942]: version 0.9.9 starting Nov 4 23:02:35 kjcf05n02 nslcd[6942]: accepting connections Nov 4 23:02:35 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 4 23:02:35 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:34 kjcf05n00 zabbix-server[2524406]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:02:34 kjcf05n00 zabbix-server[2524406]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:27\\"}}"' Nov 4 23:02:34 kjcf05n00 log_interesting_event.py[2524406]: Event '46791' acknowledged Nov 4 23:02:35 kjcf05n00 zabbix-server[2524407]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:02:35 kjcf05n02 dcs-bulk-data-sender[6168]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 4 23:02:35 kjcf05n02 dcs-collectord[6168]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 4 23:02:35 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:35 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:35 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:35 kjcf05n00 zabbix-server[2524407]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 4 23:02:35 kjcf05n00 log_interesting_event.py[2524407]: Event '46793' acknowledged Nov 4 23:02:35 kjcf05n00 zabbix-server[2524408]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:02:35 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 23:02:35 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 23:02:35 kjcf05n00 zabbix-server[2524408]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 4 23:02:35 kjcf05n00 log_interesting_event.py[2524408]: Event '46794' acknowledged Nov 4 23:02:36 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 23:02:36 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 23:02:36 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 23:02:36 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 23:02:36 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 23:02:36 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 23:02:36 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:37 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 4 23:02:37 kjcf05n02 dearcpw[7184]: Using config script: /etc/dearcpw.conf Nov 4 23:02:37 kjcf05n02 dearcpw[7184]: - Creating default directory: '/var/log/dearcpw' Nov 4 23:02:37 kjcf05n02 dearcpw[7184]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 4 23:02:37 kjcf05n02 dearcpw[7184]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 4 23:02:37 kjcf05n02 dearcpw[7184]: - Creating default directory: '/var/run/dearcpw' Nov 4 23:02:37 kjcf05n02 dearcpw[7184]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 4 23:02:37 kjcf05n02 dearcpw[7184]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 4 23:02:37 kjcf05n02 dearcpw-server[7224]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 23:02:37 kjcf05n02 dearcpw[7184]: celery multi v5.2.7 (dawn-chorus) Nov 4 23:02:37 kjcf05n02 dearcpw[7184]: > Starting nodes... Nov 4 23:02:37 kjcf05n02 dearcpw[7184]: > dearcpw@kjcf05n02: OK Nov 4 23:02:37 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 4 23:02:37 kjcf05n02 dearcpw-server[7241]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 23:02:37 kjcf05n02 dearcpw-server[7241]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 23:02:37 kjcf05n02 dearcpw-server[7241]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 23:02:37 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 4 23:02:37 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:37 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:37 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 4 23:02:37 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 4 23:02:37 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 4 23:02:37 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 4 23:02:37 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 4 23:02:37 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 4 23:02:37 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 4 23:02:37 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 4 23:02:37 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 4 23:02:37 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 4 23:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 23:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 23:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 23:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 23:02:37 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:50910). Nov 4 23:02:37 kjcf05n01 rsyncd[3945767]: connect from kjcf05n02 (172.16.2.5) Nov 4 23:02:37 kjcf05n01 rsyncd[3945767]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 4 23:02:37 kjcf05n01 rsyncd[3945767]: receiving file list Nov 4 23:02:37 kjcf05n01 rsyncd[3945767]: sent 29 bytes received 324 bytes total size 10905 Nov 4 23:02:37 kjcf05n01 systemd[1]: rsyncd@672-172.16.2.2:873-172.16.2.5:50910.service: Succeeded. Nov 4 23:02:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 23:02:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 23:02:37 kjcf05n02 puppet[7431]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 4 23:02:37 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 4 23:02:37 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 4 23:02:37 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 4 23:02:37 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 4 23:02:37 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 4 23:02:37 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 4 23:02:37 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 23:02:37 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 23:02:38 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 23:02:38 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 23:02:38 kjcf05n02 dcs-collectord[5641]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 23:02:38 kjcf05n02 dcs-collectord[5641]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 23:02:38 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 23:02:38 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 23:02:38 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 23:02:38 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 23:02:39 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 23:02:39 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 23:02:39 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 23:02:39 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 23:02:40 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 23:02:40 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 23:02:40 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 23:02:40 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 23:02:40 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 23:02:40 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 23:02:40 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:41 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 4 23:02:41 kjcf05n02 diskless-swap[7614]: HA_PS_000: recovering journal Nov 4 23:02:41 kjcf05n02 systemd-udevd[1582]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 23:02:41 kjcf05n02 diskless-swap[7614]: HA_PS_000: clean, 2292/6400 files, 7091/25600 blocks Nov 4 23:02:41 kjcf05n02 diskless-swap[7614]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 4 23:02:41 kjcf05n02 diskless-swap[7614]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 4 23:02:41 kjcf05n02 diskless-swap[7614]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 4 23:02:41 kjcf05n02 diskless-swap[7614]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 4 23:02:41 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 4 23:02:41 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:41 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:41 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 4 23:02:41 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 4 23:02:41 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 23:02:41 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 23:02:41 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 4 23:02:41 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 4 23:02:41 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 4 23:02:41 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 4 23:02:41 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 4 23:02:41 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 4 23:02:41 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 4 23:02:41 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 4 23:02:41 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 4 23:02:41 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 4 23:02:41 kjcf05n02 ipmievd[3986]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 4 23:02:42 kjcf05n02 ipmievd[3986]: System Event sensor - Timestamp Clock Sync Nov 4 23:02:42 kjcf05n02 ipmievd[3136]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:42 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 23:02:42 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 23:02:42 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 23:02:42 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 23:02:42 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 23:02:42 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 23:02:43 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 23:02:43 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 23:02:43 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 23:02:43 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 23:02:44 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 23:02:44 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 23:02:44 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 23:02:44 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 23:02:44 kjcf05n00 zabbix_server[15678]: item "kjcf05n02:vfs.fs.size[/mnt/persistent_ha_data,pused]" became supported Nov 4 23:02:44 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 23:02:44 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 23:02:44 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 23:02:44 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 23:02:44 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:44 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 4 23:02:45 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:45 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:45 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 4 23:02:45 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 4 23:02:45 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:45 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 4 23:02:45 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:45 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:45 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 23:02:45 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 23:02:45 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:45 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 4 23:02:45 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:02:45 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:02:45 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 4 23:02:45 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 4 23:02:45 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 4 23:02:45 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 4 23:02:45 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 4 23:02:45 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 4 23:02:45 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 23:02:45 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 23:02:45 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 23:02:45 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 23:02:45 kjcf05n02 systemd[1]: Reloading. Nov 4 23:02:46 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: kdump: No kdump initial ramdisk found. Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 4 23:02:46 kjcf05n02 dracut[7976]: dracut-049-135.git20210121.el8 Nov 4 23:02:46 kjcf05n02 dracut[7978]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 4 23:02:46 kjcf05n02 dracut[7978]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 23:02:46 kjcf05n02 dracut[7978]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 23:02:46 kjcf05n02 dracut[7978]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 4 23:02:46 kjcf05n02 dracut[7978]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 4 23:02:46 kjcf05n02 dracut[7978]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 23:02:46 kjcf05n02 dracut[7978]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 23:02:46 kjcf05n02 dracut[7978]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + is_func check Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ type -t check Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + '[' 0 -ne 0 ']' Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + check -h Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + local dev holder Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + require_binaries mdadm expr Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + local _module_name=90hperaid Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + local _ret=0 Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + [[ mdadm = \-\m ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + for cmd in "$@" Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + find_binary mdadm Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + for cmd in "$@" Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + find_binary expr Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + return 0 Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + [[ -n -h ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + for dev in "${!host_fs_types[@]}" Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + [[ nfs != *_raid_member ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + continue Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + return 255 Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + _ret=255 Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + hostonly=-h Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + return 255 Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + ret=255 Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + [[ 255 = 0 ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + [[ 255 = 255 ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ module_depends hperaid Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: +++ read a b Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ local _ret Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ unset check depends cmdline install installkernel Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: +++ set -x Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ depends Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ echo rootfs-block Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ return 0 Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ _ret=0 Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ unset check depends cmdline install installkernel Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ return 0 Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + for _moddep in $(module_depends $_mod) Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + [[ all == *\ hperaid\ * ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + add_dracutmodules+=' rootfs-block ' Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + [[ == *\ hperaid\ * ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + check_module rootfs-block Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + local _mod=rootfs-block Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + local _moddep Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + [[ == *\ rootfs-block\ * ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + [[ -n '' ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + mods_checked_as_dep+=' rootfs-block ' Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + [[ all == *\ rootfs-block\ * ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + module_check rootfs-block 0 Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + local _forced=0 Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + local _hostonly=-h Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + '[' 2 -eq 2 ']' Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + _forced=0 Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + is_func check Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: ++ type -t check Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + '[' 0 -ne 0 ']' Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + check -h Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + return 0 Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + _ret=0 Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:46 kjcf05n02 kdumpctl[7864]: + hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + ret=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ 0 = 0 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ module_depends rootfs-block Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: +++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 23:02:47 kjcf05n02 kdumpctl[3136]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ depends Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo fs-lib Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ _ret=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ return 0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + for _moddep in $(module_depends $_mod) Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all == *\ rootfs-block\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + add_dracutmodules+=' fs-lib ' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ == *\ rootfs-block\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check_module fs-lib Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _mod=fs-lib Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddep Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n '' ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + mods_checked_as_dep+=' fs-lib ' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all == *\ fs-lib\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + module_check fs-lib 0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _forced=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 2 -eq 2 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _forced=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + is_func check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ type -t check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 0 -ne 0 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check -h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _ret=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + ret=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ 0 = 0 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ module_depends fs-lib Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: +++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ depends Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ return 0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ _ret=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ return 0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + mods_to_load+=' fs-lib ' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + mods_to_load+=' rootfs-block ' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + mods_to_load+=' hperaid ' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _mod=90kernel-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _mod=kernel-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check_module kernel-modules 1 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _mod=kernel-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddep Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n 1 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all = all ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + module_check kernel-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _forced=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 1 -eq 2 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + is_func check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ type -t check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 0 -ne 0 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check -h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + true Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _ret=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + ret=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ 0 != 0 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ module_depends kernel-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: +++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ depends Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ true Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ _ret=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ return 0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + mods_to_load+=' kernel-modules ' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _mod=90kernel-modules-extra Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _mod=kernel-modules-extra Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check_module kernel-modules-extra 1 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _mod=kernel-modules-extra Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddep Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n 1 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all = all ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + module_check kernel-modules-extra Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _forced=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 1 -eq 2 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + is_func check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ type -t check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 0 -ne 0 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check -h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + true Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _ret=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + ret=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ 0 != 0 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ module_depends kernel-modules-extra Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: +++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ depends Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ true Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ _ret=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ return 0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + mods_to_load+=' kernel-modules-extra ' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _mod=90kernel-network-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _mod=kernel-network-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check_module kernel-network-modules 1 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _mod=kernel-network-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddep Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n 1 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all = all ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + module_check kernel-network-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _forced=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 1 -eq 2 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + is_func check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ type -t check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 0 -ne 0 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check -h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _ret=255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + ret=255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ 255 != 0 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n 1 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 1 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _mod=90livenet Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _mod=livenet Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check_module livenet 1 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _mod=livenet Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 23:02:47 kjcf05n02 kdumpctl[3136]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddep Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n 1 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all = all ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + module_check livenet Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _forced=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 1 -eq 2 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + is_func check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ type -t check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 0 -ne 0 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check -h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _ret=255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + ret=255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ 255 != 0 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n 1 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 1 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _mod=90lvm Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _mod=lvm Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check_module lvm 1 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _mod=lvm Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddep Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n 1 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all = all ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + module_check lvm Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _forced=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 1 -eq 2 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + is_func check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ type -t check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 0 -ne 0 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check -h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + require_binaries lvm Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _module_name=90lvm Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ lvm = \-\m ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + for cmd in "$@" Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + find_binary lvm Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n -h ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + for fs in "${host_fs_types[@]}" Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ nfs = LVM*_member ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _ret=255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + ret=255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ 255 != 0 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n 1 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 1 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _mod=90mdraid Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _mod=mdraid Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check_module mdraid 1 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _mod=mdraid Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddep Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n 1 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all = all ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + module_check mdraid Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _forced=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 1 -eq 2 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + is_func check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ type -t check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 0 -ne 0 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check -h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _rootdev Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + require_binaries mdadm expr Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _module_name=90mdraid Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ mdadm = \-\m ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + for cmd in "$@" Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + find_binary mdadm Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + for cmd in "$@" Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + find_binary expr Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n -h ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + for dev in "${!host_fs_types[@]}" Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ nfs != *_raid_member ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + continue Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _ret=255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + ret=255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ 255 != 0 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n 1 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 1 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _mod=90multipath Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _mod=multipath Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check_module multipath 1 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _mod=multipath Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddep Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n 1 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all = all ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + module_check multipath Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _forced=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 1 -eq 2 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + is_func check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ type -t check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 0 -ne 0 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check -h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _rootdev Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n -h ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + for_each_host_dev_and_slaves is_mpath Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _func=is_mpath Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _dev Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + for _dev in "${host_devs[@]}" Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + continue Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 1 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _ret=255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + ret=255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ 255 != 0 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n 1 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 1 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _mod=90qemu Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _mod=qemu Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check_module qemu 1 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _mod=qemu Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 23:02:47 kjcf05n02 kdumpctl[3136]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddep Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n 1 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all = all ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + module_check qemu Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _forced=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 1 -eq 2 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + is_func check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ type -t check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 0 -ne 0 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check -h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n -h ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + type -P systemd-detect-virt Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ systemd-detect-virt --vm Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + vm=none Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + (( 1 != 0 )) Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _ret=255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + ret=255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ 255 != 0 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n 1 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 1 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _mod=90qemu-net Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _mod=qemu-net Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check_module qemu-net 1 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _mod=qemu-net Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddep Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n 1 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all = all ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + module_check qemu-net Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _forced=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 1 -eq 2 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + is_func check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ type -t check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 0 -ne 0 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check -h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n -h ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + type -P systemd-detect-virt Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ systemd-detect-virt --vm Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + vm= Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + (( 1 != 0 )) Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _ret=255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + ret=255 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ 255 != 0 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n 1 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + return 1 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _mod=90stratis Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + _mod=stratis Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check_module stratis 1 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _mod=stratis Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddep Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -n 1 ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ all = all ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + module_check stratis Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ read a b Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _forced=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _hostonly=-h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 1 -eq 2 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + is_func check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: ++ type -t check Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + '[' 0 -ne 0 ']' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + check -h Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _module_name=90stratis Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + local _ret=0 Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + [[ stratisd-init = \-\m ]] Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + for cmd in "$@" Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + find_binary stratisd-init Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 4 23:02:47 kjcf05n02 kdumpctl[7864]: + set +x Nov 4 23:02:47 kjcf05n02 dracut[7978]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 23:02:47 kjcf05n02 dracut[7978]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 4 23:02:47 kjcf05n02 dracut[7978]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 4 23:02:47 kjcf05n02 dracut[7978]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 4 23:02:47 kjcf05n02 dracut[7978]: memstrack is available Nov 4 23:02:47 kjcf05n02 dracut[7978]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 23:02:47 kjcf05n02 dracut[7978]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 23:02:47 kjcf05n02 dracut[7978]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 23:02:47 kjcf05n02 dracut[7978]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 23:02:47 kjcf05n02 dracut[7978]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 23:02:47 kjcf05n02 dracut[7978]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 23:02:47 kjcf05n02 dracut[7978]: *** Including module: bash *** Nov 4 23:02:47 kjcf05n02 dracut[7978]: *** Including module: systemd *** Nov 4 23:02:48 kjcf05n02 dracut[7978]: *** Including module: fips *** Nov 4 23:02:49 kjcf05n02 dracut[7978]: *** Including module: systemd-initrd *** Nov 4 23:02:49 kjcf05n02 dracut[7978]: *** Including module: watchdog-modules *** Nov 4 23:02:49 kjcf05n02 dracut[7978]: *** Including module: nss-softokn *** Nov 4 23:02:49 kjcf05n02 dracut[7978]: *** Including module: i18n *** Nov 4 23:02:49 kjcf05n02 dracut[7978]: No KEYMAP configured. Nov 4 23:02:49 kjcf05n02 dracut[7978]: *** Including module: network-legacy *** Nov 4 23:02:49 kjcf05n02 dracut[7978]: *** Including module: network *** Nov 4 23:02:49 kjcf05n00 zabbix_server[15650]: item "kjcf05n02:vfs.fs.size[/mnt/persistent_ha_data,total]" became supported Nov 4 23:02:49 kjcf05n02 dracut[7978]: *** Including module: ib_bonding *** Nov 4 23:02:49 kjcf05n02 dracut[7978]: *** Including module: drm *** Nov 4 23:02:50 kjcf05n00 mcfcli[3673891]: %3|1730782970.148|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:02:52 kjcf05n00 mcfcli[3673891]: %3|1730782972.585|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 23:02:53 kjcf05n02 dracut[7978]: *** Including module: hperaid *** Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + install Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + local rule rule_path Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + inst_multiple cat expr Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.TetTmg/initramfs -a -f cat expr Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + _ret=0 Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + (( 0 != 0 )) Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + : Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + return 0 Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + inst_multiple -o mdmon Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.TetTmg/initramfs -a -f -o mdmon Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + _ret=0 Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + (( 0 != 0 )) Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + : Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + return 0 Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: ++ command -v partx Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + inst /usr/sbin/partx /sbin/partx Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + local _hostonly_install Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + [[ /usr/sbin/partx == \-\H ]] Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + [[ -e /tmp/dracut.TetTmg/initramfs//sbin/partx ]] Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.TetTmg/initramfs -f /usr/sbin/partx /sbin/partx Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + (( 0 != 0 )) Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + : Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: ++ command -v mdadm Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + local _hostonly_install Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + [[ -e /tmp/dracut.TetTmg/initramfs//sbin/mdadm ]] Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.TetTmg/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + (( 0 != 0 )) Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + : Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + [[ yes == \y\e\s ]] Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + local _raidconf Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: ++ cmdline Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: ++ local _activated dev line UUID Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: ++ declare -A _activated Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: ++ for dev in "${!host_fs_types[@]}" Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: ++ [[ nfs != *_raid_member ]] Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: ++ continue Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + _raidconf= Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + [[ -n '' ]] Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + inst_rules 64-md-raid.rules Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + local _target=/etc/udev/rules.d _rule _found Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + inst_dir /usr/lib/udev/rules.d Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + [[ -e /tmp/dracut.TetTmg/initramfs//usr/lib/udev/rules.d ]] Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + return 0 Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + inst_dir /etc/udev/rules.d Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + [[ -e /tmp/dracut.TetTmg/initramfs//etc/udev/rules.d ]] Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + return 0 Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + for _rule in "$@" Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + continue Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + continue Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + for r in '' $dracutbasedir/rules.d/ Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + [[ 64-md-raid.rules != /* ]] Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + continue Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + for r in '' $dracutbasedir/rules.d/ Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + continue Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + [[ -n '' ]] Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + set +x Nov 4 23:02:53 kjcf05n02 dracut[7978]: Skipping udev rule: 64-md-raid.rules Nov 4 23:02:53 kjcf05n02 dcs-collectord[5641]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 23:02:53 kjcf05n02 dcs-collectord[5641]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + installkernel Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + instmods =drivers/md Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + local _optional=-o Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + local _silent Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + local _ret Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + [[ '' = yes ]] Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + [[ =drivers/md = \-\c ]] Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + [[ =drivers/md = \-\s ]] Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + (( 1 == 0 )) Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.TetTmg/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + _ret=0 Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + (( 0 != 0 )) Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + [[ -n '' ]] Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + return 0 Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + _ret=0 Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + unset check depends cmdline install installkernel Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + return 0 Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + modules_loaded+='hperaid ' Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + '[' -n '' ']' Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + _d_mod=90kernel-modules Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + _d_mod=kernel-modules Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + [[ '' = yes ]] Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + dinfo '*** Including module: kernel-modules ***' Nov 4 23:02:53 kjcf05n02 kdumpctl[7864]: + set +x Nov 4 23:02:53 kjcf05n02 dracut[7978]: *** Including module: kernel-modules *** Nov 4 23:02:53 kjcf05n02 dracut[7978]: *** Including module: kernel-modules-extra *** Nov 4 23:02:54 kjcf05n02 dracut[7978]: *** Including module: kernel-network-modules *** Nov 4 23:02:54 kjcf05n02 dracut[7978]: *** Including module: diskless-mod *** Nov 4 23:02:54 kjcf05n02 dracut[7978]: *** Including module: fstab-sys *** Nov 4 23:02:54 kjcf05n02 dracut[7978]: *** Including module: nfs *** Nov 4 23:02:54 kjcf05n00 zabbix_server[15704]: item "kjcf05n02:vfs.fs.size[/mnt/persistent_ha_data,used]" became supported Nov 4 23:02:54 kjcf05n02 dracut[7978]: *** Including module: rootfs-block *** Nov 4 23:02:54 kjcf05n02 dracut[7978]: *** Including module: terminfo *** Nov 4 23:02:54 kjcf05n02 dracut[7978]: *** Including module: udev-rules *** Nov 4 23:02:55 kjcf05n02 dracut[7978]: Skipping udev rule: 91-permissions.rules Nov 4 23:02:55 kjcf05n02 dracut[7978]: Skipping udev rule: 80-drivers-modprobe.rules Nov 4 23:02:55 kjcf05n02 dracut[7978]: *** Including module: dracut-systemd *** Nov 4 23:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 23:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 23:02:55 kjcf05n02 dracut[7978]: *** Including module: usrmount *** Nov 4 23:02:55 kjcf05n02 dracut[7978]: *** Including module: base *** Nov 4 23:02:55 kjcf05n02 dracut[7978]: *** Including module: fs-lib *** Nov 4 23:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 23:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 23:02:56 kjcf05n02 dracut[7978]: *** Including module: kdumpbase *** Nov 4 23:02:56 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 4 23:02:56 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 4 23:02:56 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 4 23:02:56 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running Nov 4 23:02:56 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 4 23:02:56 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730782975', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(0.0B/0.0B), ib1=(0.0B/0.0B), icl0=(4.3kB/5.9kB), lo=(500.0B/500.0B), meth0=(1540.9MB/7.6MB), mgmt0=(1477.8MB/7.5MB)'}"] Nov 4 23:02:56 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(0.0B/0.0B), ib1=(0.0B/0.0B), icl0=(4.3kB/5.9kB), lo=(500.0B/500.0B), meth0=(1540.9MB/7.6MB), mgmt0=(1477.8MB/7.5MB)', 'message': 'NET OK - (Rx/Tx) ib0=(0.0B/0.0B), ib1=(0.0B/0.0B), icl0=(4.3kB/5.9kB), lo=(500.0B/500.0B), meth0=(1540.9MB/7.6MB), mgmt0=(1477.8MB/7.5MB)', 'value': 'ok', 'timestamp': '1730782975'} Nov 4 23:02:56 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:02:56 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730782976', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128606 MiB (99.97% inode=100%);'}"] Nov 4 23:02:56 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128606 MiB (99.97% inode=100%);', 'message': 'DISK OK - free space: /tmp 128606 MiB (99.97% inode=100%);', 'value': 'ok', 'timestamp': '1730782976'} Nov 4 23:02:56 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:02:56 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31477 deleted. Nov 4 23:02:56 kjcf05n02 dracut[7978]: *** Including module: memstrack *** Nov 4 23:02:56 kjcf05n02 dracut[7978]: *** Including module: shutdown *** Nov 4 23:02:56 kjcf05n02 dracut[7978]: *** Including module: squash *** Nov 4 23:02:56 kjcf05n02 dracut[7978]: *** Including modules done *** Nov 4 23:02:57 kjcf05n02 dracut[7978]: *** Installing kernel module dependencies *** Nov 4 23:02:57 kjcf05n02 dracut[7978]: *** Installing kernel module dependencies done *** Nov 4 23:02:57 kjcf05n02 dracut[7978]: *** Resolving executable dependencies *** Nov 4 23:02:58 kjcf05n02 dracut[7978]: *** Resolving executable dependencies done*** Nov 4 23:02:58 kjcf05n02 dracut[7978]: *** Hardlinking files *** Nov 4 23:02:58 kjcf05n02 dracut[7978]: *** Hardlinking files done *** Nov 4 23:02:58 kjcf05n02 dracut[7978]: *** Generating early-microcode cpio image *** Nov 4 23:02:58 kjcf05n02 dracut[7978]: *** Constructing AuthenticAMD.bin **** Nov 4 23:02:58 kjcf05n02 dracut[7978]: *** Store current command line parameters *** Nov 4 23:02:58 kjcf05n02 dracut[7978]: Stored kernel commandline: Nov 4 23:02:58 kjcf05n02 dracut[7978]: rd.driver.pre=sd_mod Nov 4 23:02:58 kjcf05n02 dracut[7978]: rd.driver.pre=nvme Nov 4 23:02:58 kjcf05n02 dracut[7978]: rd.driver.pre=ipmi_si Nov 4 23:02:58 kjcf05n02 dracut[7978]: rd.driver.pre=ipmi_devintf Nov 4 23:02:58 kjcf05n02 dracut[7978]: rd.driver.pre=ipmi_msghandler Nov 4 23:02:58 kjcf05n02 dracut[7978]: nameserver=172.16.2.2 Nov 4 23:02:58 kjcf05n02 dracut[7978]: nameserver=127.0.0.1 Nov 4 23:02:58 kjcf05n02 dracut[7978]: nameserver=172.16.2.2 Nov 4 23:02:58 kjcf05n02 dracut[7978]: nameserver=127.0.0.1 Nov 4 23:02:58 kjcf05n02 dracut[7978]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 4 23:02:58 kjcf05n02 dracut[7978]: rd.neednet Nov 4 23:02:58 kjcf05n02 dracut[7978]: kdumpnic=mgmt0 Nov 4 23:02:58 kjcf05n02 dracut[7978]: bootdev=mgmt0 Nov 4 23:02:58 kjcf05n02 dracut[7978]: *** Install squash loader *** Nov 4 23:02:59 kjcf05n02 dracut[7978]: *** Squashing the files inside the initramfs *** Nov 4 23:02:59 kjcf05n02 dracut[7978]: *** Squashing the files inside the initramfs done *** Nov 4 23:02:59 kjcf05n02 dracut[7978]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 4 23:02:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 23:02:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 23:02:59 kjcf05n02 dracut[7978]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 4 23:02:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 23:02:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 23:03:00 kjcf05n02 kdumpctl[7864]: kdump: kexec: loaded kdump kernel Nov 4 23:03:00 kjcf05n02 kdumpctl[7864]: kdump: Starting kdump: [OK] Nov 4 23:03:00 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 4 23:03:00 kjcf05n02 systemd[1]: Reloading. Nov 4 23:03:00 kjcf05n02 systemd[3136]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:03:00 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:03:00 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:03:00 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 4 23:03:00 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 4 23:03:00 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 4 23:03:00 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 4 23:03:00 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 4 23:03:00 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 4 23:03:00 kjcf05n02 ifdown[14634]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 23:03:00 kjcf05n02 ifdown[14635]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:03:00 kjcf05n02 ifdown[14637]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:03:01 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 23:03:01 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 23:03:01 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 23:03:01 kjcf05n02 ifup[14697]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 23:03:01 kjcf05n02 ifup[14698]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:03:01 kjcf05n02 ifup[14699]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:03:04 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 4 23:03:04 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 4 23:03:04 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 4 23:03:04 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 4 23:03:04 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running Nov 4 23:03:04 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 4 23:03:05 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 23:03:05 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 23:03:05 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 23:03:05 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:03:05 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:03:05 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:03:05 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:03:05 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 23:03:05 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 23:03:05 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 23:03:05 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 23:03:05 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:03:05 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:03:05 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:03:05 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:03:05 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 4 23:03:05 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 4 23:03:05 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 4 23:03:05 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 4 23:03:05 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 4 23:03:05 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 4 23:03:05 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 4 23:03:05 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 4 23:03:05 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 4 23:03:05 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 4 23:03:05 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 4 23:03:05 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 4 23:03:05 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 4 23:03:05 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 4 23:03:05 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 4 23:03:05 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 4 23:03:05 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 4 23:03:05 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 4 23:03:05 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 4 23:03:05 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 4 23:03:05 kjcf05n02 ifdown[14979]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 23:03:05 kjcf05n02 ifdown[14980]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:03:05 kjcf05n02 ifdown[14981]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:03:06 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 23:03:06 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 23:03:06 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 23:03:06 kjcf05n02 ifup[15046]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 23:03:06 kjcf05n02 ifup[15047]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:03:06 kjcf05n02 ifup[15051]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730782985', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.89, 1.87, 0.83'}"] Nov 4 23:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 1.89, 1.87, 0.83', 'message': 'OK - load average: 1.89, 1.87, 0.83', 'value': 'ok', 'timestamp': '1730782985'} Nov 4 23:03:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:03:08 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 4 23:03:08 kjcf05n02 dcs-collectord[5641]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 23:03:08 kjcf05n02 dcs-collectord[5641]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 23:03:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730782989', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 328 processes with STATE = RSZDT '}"] Nov 4 23:03:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 328 processes with STATE = RSZDT ', 'message': 'PROCS OK: 328 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730782989'} Nov 4 23:03:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 23:03:10 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 23:03:10 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 23:03:10 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 23:03:10 kjcf05n02 systemd[1]: Reloading. Nov 4 23:03:10 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 4 23:03:10 kjcf05n02 await_ha_peer[15263]: Waiting for HA peer kjcf05n03 Nov 4 23:03:12 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 4 23:03:12 kjcf05n02 await_ha_peer[15263]: Peer kjcf05n03 has started, starting HA Nov 4 23:03:12 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 4 23:03:12 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 4 23:03:12 kjcf05n02 fstonithd.py[15352]: Listening for kdump packets from partner Nov 4 23:03:12 kjcf05n02 systemd[1]: Reloading. Nov 4 23:03:13 kjcf05n02 systemd[3136]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:03:13 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:03:13 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:03:13 kjcf05n02 systemd[1]: Reloading. Nov 4 23:03:13 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 4 23:03:13 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 4 23:03:13 kjcf05n02 systemd[1]: Reloading. Nov 4 23:03:13 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 23:03:13 kjcf05n02 puppet-agent[3575]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:03:13 kjcf05n02 puppet[3575]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:03:13 kjcf05n02 puppet-agent[3575]: Applied catalog in 90.87 seconds Nov 4 23:03:13 kjcf05n02 puppet[3575]: Notice: Applied catalog in 90.87 seconds Nov 4 23:03:13 kjcf05n02 systemd[1]: Started Puppet agent. Nov 4 23:03:13 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 4 23:03:13 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 23:03:13 kjcf05n02 systemd[1]: Reached target Timers. Nov 4 23:03:13 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 4 23:03:13 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 4 23:03:13 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 4 23:03:13 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 4 23:03:13 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 4 23:03:13 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 4 23:03:13 kjcf05n02 wce-disable.sh[15545]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 4 23:03:13 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 4 23:03:13 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 4 23:03:13 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 23:03:13 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 23:03:13 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 4 23:03:13 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 4 23:03:14 kjcf05n02 gateway-ec-node.py[15542]: Starting gateway-ec-node service Nov 4 23:03:14 kjcf05n02 python3.9[15543]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 4 23:03:14 kjcf05n02 python3.9[15543]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 4 23:03:14 kjcf05n02 RFSF-API[15541]: INFO[2024-11-04T23:03:14-06:00] Datapath API RESTful Service starting Nov 4 23:03:14 kjcf05n02 dp-api-server-node[15541]: INFO[2024-11-04T23:03:14-06:00] Datapath API RESTful Service starting Nov 4 23:03:14 kjcf05n02 RFSF-API[15541]: INFO[2024-11-04T23:03:14-06:00] Running in production mode, starting dbus event listener Nov 4 23:03:14 kjcf05n02 dp-api-server-node[15541]: INFO[2024-11-04T23:03:14-06:00] Running in production mode, starting dbus event listener Nov 4 23:03:14 kjcf05n02 RFSF-API[15541]: INFO[2024-11-04T23:03:14-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 23:03:14 kjcf05n02 dp-api-server-node[15541]: INFO[2024-11-04T23:03:14-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 23:03:14 kjcf05n02 RFSF-API[15541]: INFO[2024-11-04T23:03:14-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 23:03:14 kjcf05n02 dp-api-server-node[15541]: INFO[2024-11-04T23:03:14-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 23:03:14 kjcf05n02 RFSF-API[15541]: INFO[2024-11-04T23:03:14-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 23:03:14 kjcf05n02 dp-api-server-node[15541]: INFO[2024-11-04T23:03:14-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 23:03:14 kjcf05n02 RFSF-API[15541]: INFO[2024-11-04T23:03:14-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 23:03:14 kjcf05n02 dp-api-server-node[15541]: INFO[2024-11-04T23:03:14-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 23:03:14 kjcf05n02 RFSF-API[15541]: INFO[2024-11-04T23:03:14-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 23:03:14 kjcf05n02 dp-api-server-node[15541]: INFO[2024-11-04T23:03:14-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 23:03:14 kjcf05n02 RFSF-API[15541]: INFO[2024-11-04T23:03:14-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 23:03:14 kjcf05n02 dp-api-server-node[15541]: INFO[2024-11-04T23:03:14-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 23:03:14 kjcf05n02 RFSF-API[15541]: INFO[2024-11-04T23:03:14-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 23:03:14 kjcf05n02 dp-api-server-node[15541]: INFO[2024-11-04T23:03:14-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 23:03:14 kjcf05n02 RFSF-API[15541]: INFO[2024-11-04T23:03:14-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 23:03:14 kjcf05n02 dp-api-server-node[15541]: INFO[2024-11-04T23:03:14-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 23:03:14 kjcf05n02 RFSF-API[15541]: INFO[2024-11-04T23:03:14-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 23:03:14 kjcf05n02 dp-api-server-node[15541]: INFO[2024-11-04T23:03:14-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 23:03:14 kjcf05n02 RFSF-API[15541]: INFO[2024-11-04T23:03:14-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 23:03:14 kjcf05n02 dp-api-server-node[15541]: INFO[2024-11-04T23:03:14-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 23:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730782999', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.5% (3898348 kB) used.'}"] Nov 4 23:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.5% (3898348 kB) used.', 'message': 'OK - 1.5% (3898348 kB) used.', 'value': 'ok', 'timestamp': '1730782999'} Nov 4 23:03:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:03:19 kjcf05n02 systemd[1]: Reloading. Nov 4 23:03:19 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 4 23:03:19 kjcf05n02 systemd[1]: Reloading. Nov 4 23:03:20 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 4 23:03:20 kjcf05n02 diskmonitor_pre[16023]: Key management is currently disabled.DEAR disabled Nov 4 23:03:20 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 4 23:03:21 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18128 (bash) Nov 4 23:03:21 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 4 23:03:21 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 4 23:03:21 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 4 23:03:21 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 4 23:03:21 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 4 23:03:22 kjcf05n02 sh[16085]: LNET configured: New Created Nov 4 23:03:22 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 4 23:03:22 kjcf05n02 LCNmon[18168]: Interface ib0 is up Nov 4 23:03:22 kjcf05n02 LCNmon[18168]: Interface ib1 is up Nov 4 23:03:22 kjcf05n02 LCNmon[18168]: Can ping through interface ib0 Nov 4 23:03:22 kjcf05n02 LCNmon[18168]: Can ping through interface ib1 Nov 4 23:03:22 kjcf05n02 LCNmon[18168]: NIC ib0, initial state UP Nov 4 23:03:22 kjcf05n02 LCNmon[18168]: NIC ib1, initial state UP Nov 4 23:03:22 kjcf05n02 LCNmon[18168]: LCNstat initial state UP Nov 4 23:03:22 kjcf05n02 LCNmon[18168]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 4 23:03:22 kjcf05n00 mcfcli[3673891]: %3|1730783002.585|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 23:03:23 kjcf05n02 dcs-collectord[5641]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 23:03:23 kjcf05n02 dcs-collectord[5641]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 23:03:23 kjcf05n02 dcs-collectord[5641]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 23:03:23 kjcf05n00 httpd[1812024]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 4 23:03:24 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: /var/run/diskmonitor does not exist, creating Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: Creating /var/run/diskmonitor/disk Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: Creating /var/run/diskmonitor/encl Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: Creating /var/run/diskmonitor/cli Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: RAS_Interlocks_enabled: 1 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: Using default ssd ids: HUSSL4010ASS600 , Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: add handler for sig: 14 sa_flags: 10000004 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: add handler for sig: 1 sa_flags: 10000004 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: add handler for sig: 2 sa_flags: 00000004 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: add handler for sig: 15 sa_flags: 00000004 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: add handler for sig: 6 sa_flags: 00000004 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: add handler for sig: 3 sa_flags: 00000004 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: add handler for sig: 30 sa_flags: 00000004 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: add handler for sig: 20 sa_flags: 00000004 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: add handler for sig: 10 sa_flags: 10000004 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: add handler for sig: 11 sa_flags: 00000004 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: add handler for sig: 7 sa_flags: 00000004 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: add handler for sig: 4 sa_flags: 00000004 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: add handler for sig: 8 sa_flags: 00000004 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: init_watch: /var/run/diskmonitor/encl initialized Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: init_watch: /var/run/diskmonitor/disk initialized Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: Using HA Baton locks - key: diskmonitor Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: Baton will be held for at most 570 seconds Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: DMMP Enabled: 0 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: random seed: fa857bbf Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: NVMe Enclosure: 1 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: ZFS Enclosure: 0 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: Dbus, Initialized Connection Successfully Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: int_catcher_thread: thread start Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: Received dbus message 4 org.freedesktop.DBus -> :1.110 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 4 23:03:24 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 23:03:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730783005', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 4 23:03:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730783005'} Nov 4 23:03:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T23:03:27.253357051-06:00 level=info msg="Completed cleanup jobs" duration=26.633941ms Nov 4 23:03:28 kjcf05n02 openhpid[5547]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 4 23:03:28 kjcf05n02 openhpid[5547]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 4 23:03:28 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 4 23:03:28 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 4 23:03:28 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 23:03:28 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18775 which is not our child. We'll most likely not notice when it exits. Nov 4 23:03:28 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 23:03:28 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 4 23:03:28 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 4 23:03:28 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 4 23:03:28 kjcf05n02 dcs-collectord[5641]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 4 23:03:28 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 4 23:03:28 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 4 23:03:28 kjcf05n02 systemd[1]: Startup finished in 50.953s (kernel) + 2min 29.969s (userspace) = 3min 20.922s. Nov 4 23:03:28 kjcf05n02 openhpid[18775]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 23:03:28 kjcf05n02 openhpid[18775]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 23:03:28 kjcf05n02 openhpid[18775]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 23:03:28 kjcf05n02 openhpid[18775]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 23:03:30 kjcf05n00 mcfcli[3673891]: %3|1730783010.145|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 4 23:03:30 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 4 23:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730783016', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 4 23:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730783016', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 4 23:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730783016'} Nov 4 23:03:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730783016'} Nov 4 23:03:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:03:38 kjcf05n02 dcs-collectord[5641]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 23:03:38 kjcf05n02 dcs-collectord[5641]: WARNING No data collected (hpi_parser.py:353) Nov 4 23:03:39 kjcf05n00 zabbix_server[15687]: item "kjcf05n02:vfs.fs.inode[/mnt/persistent_ha_data,pfree]" became supported Nov 4 23:03:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730783023', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 4 23:03:43 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730783023'} Nov 4 23:03:43 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:03:52 kjcf05n02 ipmievd[3986]: System Event sensor - Timestamp Clock Sync Nov 4 23:03:52 kjcf05n00 mcfcli[3673891]: %3|1730783032.585|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 23:03:53 kjcf05n02 ipmievd[3136]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:03:53 kjcf05n02 dcs-collectord[5641]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 4 23:04:03 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 4 23:04:07 kjcf05n00 mcfcli[3673891]: %3|1730783047.464|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:04:08 kjcf05n02 dcs-collectord[5641]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 23:04:11 kjcf05n03 firmware-update-orc-server[5841]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "0408e824-38dd-4acd-af22-4d9aed7b9316"} (logger.py:65) Nov 4 23:04:11 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 252769 (get_disk_device) Nov 4 23:04:11 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 4 23:04:11 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 4 23:04:11 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e30061300253845000000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 23:04:11 kjcf05n02 ras-resource-manager-agent[5905]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "64c5ac3c-9b33-11ef-aa25-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 4 23:04:11 kjcf05n02 ras-resource-manager-agent[5905]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '64c5ac3c-9b33-11ef-aa25-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 4 23:04:11 kjcf05n02 ras-resource-manager-agent[5905]: INFO Submitting new device inserted signal, starting to qualify drive: 64c5ac3c-9b33-11ef-aa25-00093d0695e3 (admin_action.py:110) Nov 4 23:04:10 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '64c5ac3c-9b33-11ef-aa25-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 23:04:10 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '64c5ac3c-9b33-11ef-aa25-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 23:04:10 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '64c5ac3c-9b33-11ef-aa25-00093d0695e3', 'response ID': '64d03e0e-9b33-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 23:04:10 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 64d03e0e-9b33-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 23:04:11 kjcf05n03 ccp-client[252803]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 23:04:11 kjcf05n03 ccp-client[252803]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 23:04:11 kjcf05n03 ccp-client[252812]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 23:04:11 kjcf05n03 ccp-client[252803]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 23:04:11 kjcf05n03 ccp-client[252803]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 23:04:11 kjcf05n03 ccp-client[252812]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 23:04:11 kjcf05n03 ccp-client[252812]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 23:04:11 kjcf05n02 diskmonitor[17710]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 23:04:11 kjcf05n02 ras-resource-manager-agent[5905]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "65156baa-9b33-11ef-aa25-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 4 23:04:11 kjcf05n02 ras-resource-manager-agent[5905]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '65156baa-9b33-11ef-aa25-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 4 23:04:11 kjcf05n02 ras-resource-manager-agent[5905]: INFO Submitting new device inserted signal, starting to qualify drive: 65156baa-9b33-11ef-aa25-00093d0695e3 (admin_action.py:110) Nov 4 23:04:11 kjcf05n02 firmware-update-orc-server[5861]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "f0c8970f-4ce8-4c69-ac82-ef6089fbc37a"} (logger.py:65) Nov 4 23:04:11 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '65156baa-9b33-11ef-aa25-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 23:04:11 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '65156baa-9b33-11ef-aa25-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 23:04:11 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '65156baa-9b33-11ef-aa25-00093d0695e3', 'response ID': '651d103a-9b33-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 23:04:11 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 651d103a-9b33-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 23:04:14 kjcf05n03 DRVFW[252968]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 23:04:14 kjcf05n03 ccp-client[252969]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 23:04:14 kjcf05n03 ccp-client[252969]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 23:04:14 kjcf05n03 ccp-client[252978]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 23:04:14 kjcf05n03 ccp-client[252969]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 23:04:14 kjcf05n03 ccp-client[252969]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 23:04:14 kjcf05n03 ccp-client[252978]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 23:04:14 kjcf05n03 ccp-client[252978]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 23:04:14 kjcf05n03 firmware-update-orc-server[5841]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 4 23:04:16 kjcf05n02 ras-resource-manager-agent[5905]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '64c5ac3c-9b33-11ef-aa25-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 4 23:04:16 kjcf05n02 ras-resource-manager-agent[5905]: INFO Drive qualification complete responding: 64c5ac3c-9b33-11ef-aa25-00093d0695e3 (admin_action.py:205) Nov 4 23:04:16 kjcf05n02 ras-resource-manager-agent[5905]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "64c5ac3c-9b33-11ef-aa25-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (interesting_event.py:59) Nov 4 23:04:15 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 64d03e0e-9b33-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 23:04:15 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '64c5ac3c-9b33-11ef-aa25-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '64c5ac3c-9b33-11ef-aa25-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}}} (logger.py:65) Nov 4 23:04:18 kjcf05n02 diskmonitor[17710]: 03 Nov 4 23:04:18 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 4 23:04:18 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 4 23:04:18 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 4 23:04:18 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 4 23:04:18 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 4 23:04:18 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 4 23:04:18 kjcf05n02 diskmonitor[17710]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 4 23:04:18 kjcf05n02 diskmonitor[17710]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 4 23:04:18 kjcf05n02 diskmonitor[17710]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 4 23:04:18 kjcf05n02 diskmonitor[17710]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 23:04:18 kjcf05n02 diskmonitor[17710]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 4 23:04:18 kjcf05n02 diskmonitor[17710]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "64c5ac3c-9b33-11ef-aa25-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 4 23:04:18 kjcf05n02 diskmonitor[17710]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 23:04:18 kjcf05n02 diskmonitor[17710]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 4 23:04:18 kjcf05n02 diskmonitor[17710]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "65156baa-9b33-11ef-aa25-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 4 23:04:18 kjcf05n02 diskmonitor[17710]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 23:04:18 kjcf05n02 diskmonitor[17710]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 23:04:22 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 4 23:04:22 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 4 23:04:22 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 4 23:04:22 kjcf05n00 mcfcli[3673891]: %3|1730783062.586|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:04:25 kjcf05n02 chronyd[5151]: Selected source 172.16.2.1 Nov 4 23:04:26 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22709 (get_disk_device) Nov 4 23:04:26 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 4 23:04:26 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 4 23:04:27 kjcf05n02 ccp-client[22731]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 23:04:27 kjcf05n02 ccp-client[22731]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 23:04:27 kjcf05n02 ccp-client[22731]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 23:04:27 kjcf05n02 ccp-client[22740]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 23:04:27 kjcf05n02 ccp-client[22731]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 23:04:27 kjcf05n02 ccp-client[22740]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 23:04:27 kjcf05n02 ccp-client[22740]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 23:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730783067}"] Nov 4 23:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730783067, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:04:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730783067}"] Nov 4 23:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730783067, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:04:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730783067}"] Nov 4 23:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730783067, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:04:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730783067}"] Nov 4 23:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730783067, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:04:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730783067}"] Nov 4 23:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730783067, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:04:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730783067}"] Nov 4 23:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730783067, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:04:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730783068}"] Nov 4 23:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730783068, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:04:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730783068}"] Nov 4 23:04:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730783068, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:04:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:04:29 kjcf05n02 ras-resource-manager-agent[5905]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "64c5ac3c-9b33-11ef-aa25-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (service_main_handler.py:66) Nov 4 23:04:29 kjcf05n02 ras-resource-manager-agent[5905]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '64c5ac3c-9b33-11ef-aa25-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 4 23:04:29 kjcf05n02 ras-resource-manager-agent[5905]: INFO Device qualification response has been acknowledged: 64c5ac3c-9b33-11ef-aa25-00093d0695e3 (admin_action.py:151) Nov 4 23:04:29 kjcf05n02 DRVFW[22958]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 23:04:30 kjcf05n02 ccp-client[22963]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 23:04:30 kjcf05n02 ccp-client[22963]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 23:04:30 kjcf05n02 ccp-client[23007]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 23:04:30 kjcf05n02 ccp-client[22963]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 23:04:30 kjcf05n02 ccp-client[23007]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 23:04:30 kjcf05n02 ccp-client[22963]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 23:04:30 kjcf05n02 ccp-client[23007]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 23:04:30 kjcf05n02 firmware-update-orc-server[5861]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 4 23:04:32 kjcf05n02 python3.9[5212]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 4 23:04:32 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 651d103a-9b33-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 23:04:32 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '65156baa-9b33-11ef-aa25-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '65156baa-9b33-11ef-aa25-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}}} (logger.py:65) Nov 4 23:04:32 kjcf05n02 python3.9[3136]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:04:32 kjcf05n02 ras-resource-manager-agent[5905]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '65156baa-9b33-11ef-aa25-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 4 23:04:32 kjcf05n02 ras-resource-manager-agent[5905]: INFO Drive qualification complete responding: 65156baa-9b33-11ef-aa25-00093d0695e3 (admin_action.py:205) Nov 4 23:04:32 kjcf05n02 ras-resource-manager-agent[5905]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "65156baa-9b33-11ef-aa25-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 4 23:04:34 kjcf05n02 diskmonitor[17710]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 23:04:34 kjcf05n02 diskmonitor[17710]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 23:04:34 kjcf05n02 ras-resource-manager-agent[5905]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "72c55968-9b33-11ef-aa25-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 4 23:04:34 kjcf05n02 ras-resource-manager-agent[5905]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '72c55968-9b33-11ef-aa25-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 4 23:04:34 kjcf05n02 ras-resource-manager-agent[5905]: INFO Requests ['65156baa-9b33-11ef-aa25-00093d0695e3', '72c55968-9b33-11ef-aa25-00093d0695e3'] already in progress (admin_action.py:99) Nov 4 23:04:34 kjcf05n02 ras-resource-manager-agent[5905]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '72c55968-9b33-11ef-aa25-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 4 23:04:34 kjcf05n02 ras-resource-manager-agent[5905]: INFO Drive qualification complete responding: 72c55968-9b33-11ef-aa25-00093d0695e3 (admin_action.py:205) Nov 4 23:04:34 kjcf05n02 ras-resource-manager-agent[5905]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "65156baa-9b33-11ef-aa25-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 4 23:04:34 kjcf05n02 ras-resource-manager-agent[5905]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "72c55968-9b33-11ef-aa25-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "64c5ac3c-9b33-11ef-aa25-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: Dbus, handle_ingress_ras_signals, uuid: 64c5ac3c-9b33-11ef-aa25-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "64c5ac3c-9b33-11ef-aa25-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: main: Pending firmware leveling requests exist, rescanning disks Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "72c55968-9b33-11ef-aa25-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: leaving test state: 1 next state: 2 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: lock req: no timeout Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: leaving test state: 2 next state: 4 Nov 4 23:04:39 kjcf05n02 diskmonitor[17710]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 23:04:46 kjcf05n00 mcfcli[3673891]: %3|1730783086.819|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:04:52 kjcf05n00 mcfcli[3673891]: %3|1730783092.587|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:04:56 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31476 deleted. Nov 4 23:05:22 kjcf05n00 mcfcli[3673891]: %3|1730783122.587|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:05:24 kjcf05n00 mcfcli[3673891]: %3|1730783124.820|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:05:31 kjcf05n02 ras-resource-manager-agent[5905]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "65156baa-9b33-11ef-aa25-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 4 23:05:31 kjcf05n02 ras-resource-manager-agent[5905]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '65156baa-9b33-11ef-aa25-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 4 23:05:31 kjcf05n02 ras-resource-manager-agent[5905]: INFO Device qualification response has been acknowledged: 65156baa-9b33-11ef-aa25-00093d0695e3 (admin_action.py:151) Nov 4 23:05:31 kjcf05n02 ras-resource-manager-agent[5905]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "65156baa-9b33-11ef-aa25-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 4 23:05:31 kjcf05n02 ras-resource-manager-agent[5905]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '65156baa-9b33-11ef-aa25-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 4 23:05:31 kjcf05n02 ras-resource-manager-agent[5905]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "72c55968-9b33-11ef-aa25-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 4 23:05:31 kjcf05n02 ras-resource-manager-agent[5905]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '72c55968-9b33-11ef-aa25-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 4 23:05:31 kjcf05n02 ras-resource-manager-agent[5905]: INFO Device qualification response has been acknowledged: 72c55968-9b33-11ef-aa25-00093d0695e3 (admin_action.py:151) Nov 4 23:05:31 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 4 23:05:31 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 23:05:31 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 4 23:05:31 kjcf05n02 diskmonitor[17710]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 23:05:39 kjcf05n00 python3.9[2526546]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 23:05:47 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 4 23:05:47 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 23:05:47 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 4 23:05:48 kjcf05n02 diskmonitor[17710]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "65156baa-9b33-11ef-aa25-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 4 23:05:48 kjcf05n02 diskmonitor[17710]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 4 23:05:48 kjcf05n02 diskmonitor[17710]: Dbus, handle_ingress_ras_signals, uuid: 65156baa-9b33-11ef-aa25-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 4 23:05:48 kjcf05n02 diskmonitor[17710]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 23:05:48 kjcf05n02 diskmonitor[17710]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "65156baa-9b33-11ef-aa25-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 4 23:05:48 kjcf05n02 diskmonitor[17710]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "65156baa-9b33-11ef-aa25-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 4 23:05:48 kjcf05n02 diskmonitor[17710]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 4 23:05:48 kjcf05n02 diskmonitor[17710]: Dbus, handle_ingress_ras_signals, uuid: 65156baa-9b33-11ef-aa25-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 4 23:05:48 kjcf05n02 diskmonitor[17710]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "65156baa-9b33-11ef-aa25-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 4 23:05:48 kjcf05n02 diskmonitor[17710]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "72c55968-9b33-11ef-aa25-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 4 23:05:48 kjcf05n02 diskmonitor[17710]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 4 23:05:48 kjcf05n02 diskmonitor[17710]: Dbus, handle_ingress_ras_signals, uuid: 72c55968-9b33-11ef-aa25-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 4 23:05:48 kjcf05n02 diskmonitor[17710]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "72c55968-9b33-11ef-aa25-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 4 23:05:48 kjcf05n02 diskmonitor[17710]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 23:05:48 kjcf05n02 diskmonitor[17710]: lock acquired Nov 4 23:05:48 kjcf05n02 diskmonitor[17710]: leaving test state: 4 next state: 8 Nov 4 23:05:48 kjcf05n02 diskmonitor[17710]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 23:05:49 kjcf05n02 dcs-collectord[5641]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 4 23:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730782856', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 23:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730782856'} Nov 4 23:05:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730782856', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 23:05:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730782856'} Nov 4 23:05:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:05:52 kjcf05n00 mcfcli[3673891]: %3|1730783152.587|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:05:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730783158}"] Nov 4 23:05:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730783158, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:05:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:05:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:05:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:05:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:05:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:05:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:05:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:05:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:05:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:05:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:05:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:05:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:05:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:05:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.809149ms Nov 4 23:05:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:05:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.809149ms Nov 4 23:05:58 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:05:58 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:05:58 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:05:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730783158}"] Nov 4 23:05:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730783158, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:05:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:05:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:05:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:05:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:05:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:05:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:05:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:05:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:05:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:05:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:05:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:05:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:05:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:05:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.182107ms Nov 4 23:05:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:05:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.182107ms Nov 4 23:05:58 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:05:58 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:05:58 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:06:03 kjcf05n00 mcfcli[3673891]: %3|1730783163.930|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:06:09 kjcf05n02 diskmonitor[17710]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 4 23:06:09 kjcf05n02 diskmonitor[17710]: leaving test state: 8 next state: 20 Nov 4 23:06:09 kjcf05n02 diskmonitor[17710]: leaving test state: 20 next state: 40 Nov 4 23:06:09 kjcf05n02 diskmonitor[17710]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 17c34438000 Nov 4 23:06:09 kjcf05n02 diskmonitor[17710]: leaving test state: 40 next state: 80 Nov 4 23:06:22 kjcf05n00 mcfcli[3673891]: %3|1730783182.587|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:06:43 kjcf05n00 mcfcli[3673891]: %3|1730783203.928|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:06:44 kjcf05n00 zabbix-server[2527499]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:06:44 kjcf05n00 zabbix-server[2527499]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 172.57\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 135.92\\"}}"' Nov 4 23:06:44 kjcf05n00 log_interesting_event.py[2527499]: Event '46821' acknowledged Nov 4 23:06:52 kjcf05n00 mcfcli[3673891]: %3|1730783212.588|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:07:10 kjcf05n02 diskmonitor[17710]: leaving test state: 80 next state: 100 Nov 4 23:07:10 kjcf05n02 diskmonitor[17710]: lock release: time: Mon Nov 4 23:07:02 2024 Nov 4 23:07:10 kjcf05n02 diskmonitor[17710]: leaving test state: 100 next state: 1 Nov 4 23:07:21 kjcf05n00 mcfcli[3673891]: %3|1730783241.258|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:07:21 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 4 23:07:22 kjcf05n00 mcfcli[3673891]: %3|1730783242.588|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 23:07:24 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 4 23:07:50 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 4 23:07:52 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 4 23:07:52 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 4 23:07:52 kjcf05n00 mcfcli[3673891]: %3|1730783272.588|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:08:00 kjcf05n00 mcfcli[3673891]: %3|1730783280.960|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:08:22 kjcf05n00 mcfcli[3673891]: %3|1730783302.588|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:08:25 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 4 23:08:25 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 4 23:08:26 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 4 23:08:26 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 4 23:08:26 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 4 23:08:39 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 23:08:39 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 23:08:39 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 23:08:40 kjcf05n00 mcfcli[3673891]: %3|1730783320.013|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:08:52 kjcf05n00 mcfcli[3673891]: %3|1730783332.588|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:09:17 kjcf05n00 mcfcli[3673891]: %3|1730783357.606|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:09:22 kjcf05n00 mcfcli[3673891]: %3|1730783362.588|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 23:09:32 kjcf05n00 zabbix-server[2528968]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:09:32 kjcf05n00 zabbix-server[2528968]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n02' from event '46822' Nov 4 23:09:32 kjcf05n00 zabbix-server[2528968]: Host created 'enclosure_USE26000024VS001' Nov 4 23:09:32 kjcf05n00 zabbix-server[2528968]: Running puppet on 'kjcf05n02' Nov 4 23:09:34 kjcf05n02 puppet-agent[35204]: Using configured environment 'production' Nov 4 23:09:34 kjcf05n02 puppet-agent[35204]: Retrieving pluginfacts Nov 4 23:09:34 kjcf05n02 puppet-agent[35204]: Retrieving plugin Nov 4 23:09:34 kjcf05n02 puppet-agent[35204]: Loading facts Nov 4 23:09:37 kjcf05n02 puppet-agent[35204]: Caching catalog for kjcf05n02 Nov 4 23:09:37 kjcf05n02 puppet-agent[35204]: Applying configuration version '1730783375' Nov 4 23:09:39 kjcf05n02 puppet-agent[35204]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 23:09:39 kjcf05n02 puppet-agent[35204]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 23:09:39 kjcf05n02 puppet-agent[35204]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 23:09:40 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 4 23:09:40 kjcf05n02 zabbix_agent2[5989]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 23:09:40 kjcf05n02 zabbix_agent2[3136]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:09:40 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 23:09:40 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 4 23:09:40 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 23:09:40 kjcf05n02 puppet-agent[35204]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: Press Ctrl+C to exit. Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: Plugin support version 1.0 Nov 4 23:09:40 kjcf05n02 zabbix_agent2[35553]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 23:09:42 kjcf05n02 puppet-agent[35204]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 23:09:42 kjcf05n02 puppet-agent[35204]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 23:09:42 kjcf05n02 puppet-agent[35204]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 23:09:42 kjcf05n02 puppet-agent[35204]: Applied catalog in 4.98 seconds Nov 4 23:09:42 kjcf05n00 zabbix-server[2528968]: puppet completed status:(0): '' Nov 4 23:09:42 kjcf05n00 zabbix-server[2528968]: Event '46822' acknowledged Nov 4 23:09:42 kjcf05n00 zabbix-server[2528968]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n02"}' Nov 4 23:09:52 kjcf05n00 mcfcli[3673891]: %3|1730783392.589|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 23:09:57 kjcf05n00 mcfcli[3673891]: %3|1730783397.602|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 23:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 23:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 23:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 23:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 23:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 23:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 23:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 23:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 23:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 23:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 23:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 23:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 23:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 23:10:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 23:10:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:10:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 23:10:17 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 4 23:10:17 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 4 23:10:17 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 4 23:10:22 kjcf05n00 mcfcli[3673891]: %3|1730783422.589|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 23:10:36 kjcf05n00 mcfcli[3673891]: %3|1730783436.018|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:10:43 kjcf05n00 python3.9[2529512]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 23:10:52 kjcf05n00 mcfcli[3673891]: %3|1730783452.589|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:11:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730782856', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 23:11:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730782856'} Nov 4 23:11:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:11:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730782856', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 23:11:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730782856'} Nov 4 23:11:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:11:14 kjcf05n00 mcfcli[3673891]: %3|1730783474.975|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:11:22 kjcf05n00 mcfcli[3673891]: %3|1730783482.590|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:11:37 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 4 23:11:37 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 4 23:11:37 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 4 23:11:52 kjcf05n00 mcfcli[3673891]: %3|1730783512.591|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:11:54 kjcf05n00 mcfcli[3673891]: %3|1730783514.423|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:12:22 kjcf05n00 mcfcli[3673891]: %3|1730783542.591|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:12:34 kjcf05n00 mcfcli[3673891]: %3|1730783554.420|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:12:52 kjcf05n00 mcfcli[3673891]: %3|1730783572.591|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:13:10 kjcf05n00 mcfcli[3673891]: %3|1730783590.517|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:13:22 kjcf05n00 mcfcli[3673891]: %3|1730783602.591|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 23:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T23:13:27.252593665-06:00 level=info msg="Completed cleanup jobs" duration=26.099069ms Nov 4 23:13:50 kjcf05n00 mcfcli[3673891]: %3|1730783630.514|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:13:52 kjcf05n00 mcfcli[3673891]: %3|1730783632.591|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:13:56 kjcf05n02 root[42038]: failback_xyraid Nov 4 23:13:57 kjcf05n02 root[42155]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 4 23:13:58 kjcf05n02 root[42319]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 4 23:14:01 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 4 23:14:05 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme4n1 Nov 4 23:14:05 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme3n1 Nov 4 23:14:05 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme8n1 Nov 4 23:14:05 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme9n1 Nov 4 23:14:05 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme17n1 Nov 4 23:14:05 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme24n1 Nov 4 23:14:05 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme23n1 Nov 4 23:14:05 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme25n1 Nov 4 23:14:05 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme18n1 Nov 4 23:14:05 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme19n1 Nov 4 23:14:05 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme2n1 Nov 4 23:14:06 kjcf05n02 dwd[5183]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 4 23:14:06 kjcf05n02 dwd[5183]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 4 23:14:06 kjcf05n02 dwd[5183]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 4 23:14:06 kjcf05n02 dwd[5183]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 4 23:14:06 kjcf05n02 dwd[5183]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 4 23:14:06 kjcf05n02 dwd[5183]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 4 23:14:06 kjcf05n02 dwd[5183]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 4 23:14:06 kjcf05n02 dwd[5183]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 4 23:14:06 kjcf05n02 dwd[5183]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 4 23:14:06 kjcf05n02 dwd[5183]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 4 23:14:06 kjcf05n02 dwd[5183]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 4 23:14:06 kjcf05n02 dwd[5183]: Starting NVME thread for nvme2n1 Nov 4 23:14:06 kjcf05n02 dwd[5183]: Starting NVME thread for nvme18n1 Nov 4 23:14:07 kjcf05n02 dwd[5183]: Starting NVME thread for nvme19n1 Nov 4 23:14:07 kjcf05n02 dwd[5183]: Starting NVME thread for nvme9n1 Nov 4 23:14:07 kjcf05n02 systemd-udevd[45003]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45005]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45006]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45003]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45005]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45006]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45003]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45005]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45006]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45003]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45005]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45003]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45006]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45005]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45024]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45027]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45006]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45026]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45030]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45003]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45024]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45005]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45006]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45027]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45003]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45030]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45024]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45005]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45026]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45027]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45003]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45030]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45005]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45003]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45030]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45005]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45030]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45003]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45005]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45008]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45027]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45003]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45030]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45003]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45005]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45003]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45030]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45003]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45003]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45030]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45003]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45003]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45030]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45003]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45030]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 systemd-udevd[45003]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:14:07 kjcf05n02 dwd[5183]: Starting NVME thread for nvme3n1 Nov 4 23:14:07 kjcf05n02 dwd[5183]: Starting NVME thread for nvme24n1 Nov 4 23:14:08 kjcf05n02 nslcd[6942]: [8b4567] (re)loading /etc/nsswitch.conf Nov 4 23:14:08 kjcf05n02 dwd[5183]: Starting NVME thread for nvme4n1 Nov 4 23:14:08 kjcf05n02 dwd[5183]: Starting NVME thread for nvme23n1 Nov 4 23:14:08 kjcf05n02 dwd[5183]: Starting NVME thread for nvme17n1 Nov 4 23:14:08 kjcf05n02 dwd[5183]: Starting NVME thread for nvme25n1 Nov 4 23:14:08 kjcf05n02 dwd[5183]: Starting NVME thread for nvme8n1 Nov 4 23:14:10 kjcf05n02 dcs-bulk-data-sender[6168]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 139}' Nov 4 23:14:12 kjcf05n02 diskmonitor[17710]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 4 23:14:17 kjcf05n02 diskmonitor[17710]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 4 23:14:17 kjcf05n02 diskmonitor[17710]: Scan for ReadErrorMax change for md65 Nov 4 23:14:17 kjcf05n02 diskmonitor[17710]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 4 23:14:17 kjcf05n02 diskmonitor[17710]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 4 23:14:17 kjcf05n02 diskmonitor[17710]: read_saved_file: md65 no saved speed Nov 4 23:14:17 kjcf05n02 diskmonitor[17710]: reconstruction_policy: sync_action prev = current = idle - md65 Nov 4 23:14:17 kjcf05n02 diskmonitor[17710]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 23:14:17 kjcf05n03 nslcd[6913]: [a7c4c9] ldap_result() failed: Can't contact LDAP server Nov 4 23:14:21 kjcf05n03 diskmonitor[17340]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 4 23:14:21 kjcf05n03 diskmonitor[17340]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 23:14:22 kjcf05n00 mcfcli[3673891]: %3|1730783662.591|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 23:14:26 kjcf05n00 mcfcli[3673891]: %3|1730783666.602|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:14:49 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47984 (bash) Nov 4 23:14:49 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 4 23:14:49 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 4 23:14:52 kjcf05n00 mcfcli[3673891]: %3|1730783692.591|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 23:15:06 kjcf05n00 mcfcli[3673891]: %3|1730783706.599|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:15:08 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 4 23:15:08 kjcf05n02 systemd-tmpfiles[48772]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 23:15:08 kjcf05n02 systemd-tmpfiles[48772]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 23:15:08 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 4 23:15:08 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 4 23:15:22 kjcf05n00 mcfcli[3673891]: %3|1730783722.592|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 23:15:39 kjcf05n00 python3.9[2532470]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 23:15:40 kjcf05n00 mcfcli[3673891]: %3|1730783740.790|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:15:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730783751', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 4 23:15:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730783751'} Nov 4 23:15:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:15:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730783751', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 4 23:15:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730783751'} Nov 4 23:15:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:15:52 kjcf05n00 mcfcli[3673891]: %3|1730783752.592|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 23:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730783758}"] Nov 4 23:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730783758, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.163742ms Nov 4 23:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.163742ms Nov 4 23:15:58 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:15:58 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:15:58 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730783758}"] Nov 4 23:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730783758, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.82652ms Nov 4 23:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.82652ms Nov 4 23:15:58 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:15:58 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:15:58 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730783758}"] Nov 4 23:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730783758, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.816803ms Nov 4 23:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.816803ms Nov 4 23:15:58 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:15:58 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:15:58 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730783758}"] Nov 4 23:15:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730783758, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:15:58-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:15:58 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:15:58-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:15:58 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:15:58-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:15:58 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.940094ms Nov 4 23:15:58 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:15:58-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.940094ms Nov 4 23:15:58 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:15:58 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:15:58 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:15:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730783758}"] Nov 4 23:15:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730783758, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:15:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:15:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:15:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:15:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:15:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:15:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:15:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:15:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:15:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:15:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:15:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:15:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:15:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:15:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.971863ms Nov 4 23:15:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:15:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.971863ms Nov 4 23:15:59 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:15:59 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:15:59 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:15:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730783759}"] Nov 4 23:15:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730783759, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:15:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:15:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:15:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:15:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:15:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:15:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:15:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:15:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:15:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:15:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:15:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:15:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:15:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:15:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.893189ms Nov 4 23:15:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:15:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.893189ms Nov 4 23:15:59 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:15:59 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:15:59 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:15:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730783759}"] Nov 4 23:15:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730783759, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:15:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:15:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:15:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:15:59-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:15:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:15:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:15:59 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:15:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:15:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:15:59-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:15:59 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:15:59-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:15:59 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:15:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.924735ms Nov 4 23:15:59 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:15:59-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.924735ms Nov 4 23:15:59 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:15:59 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:15:59 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:15:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730783759}"] Nov 4 23:15:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730783759, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:16:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:16:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:16:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:16:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:16:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:16:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:16:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:16:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:16:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:16:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:16:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:16:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:16:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:16:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.164053ms Nov 4 23:16:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:16:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.164053ms Nov 4 23:16:00 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:16:00 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:16:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:16:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730783759}"] Nov 4 23:16:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730783759, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:16:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:16:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:16:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:16:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:16:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:16:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:16:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:16:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:16:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:16:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:16:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:16:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:16:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:16:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.709131ms Nov 4 23:16:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:16:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.709131ms Nov 4 23:16:00 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:16:00 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:16:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:16:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730783759}"] Nov 4 23:16:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730783759, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:16:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:16:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:16:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:16:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:16:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:16:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:16:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:16:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:16:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:16:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:16:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:16:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:16:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:16:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.043207ms Nov 4 23:16:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:16:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.043207ms Nov 4 23:16:00 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:16:00 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:16:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:16:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730783759}"] Nov 4 23:16:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730783759, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:16:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:16:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:16:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:16:00-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:16:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:16:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:16:00 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:16:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:16:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:16:00-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:16:00 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:16:00-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:16:00 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:16:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.351283ms Nov 4 23:16:00 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:16:00-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.351283ms Nov 4 23:16:00 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:16:00 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:16:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:16:20 kjcf05n00 mcfcli[3673891]: %3|1730783780.072|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:16:22 kjcf05n00 mcfcli[3673891]: %3|1730783782.592|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 23:16:52 kjcf05n00 mcfcli[3673891]: %3|1730783812.592|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 23:16:57 kjcf05n00 mcfcli[3673891]: %3|1730783817.124|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:17:22 kjcf05n00 mcfcli[3673891]: %3|1730783842.592|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 23:17:35 kjcf05n00 mcfcli[3673891]: %3|1730783855.772|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:17:52 kjcf05n00 mcfcli[3673891]: %3|1730783872.593|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:18:15 kjcf05n00 mcfcli[3673891]: %3|1730783895.769|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:18:22 kjcf05n00 mcfcli[3673891]: %3|1730783902.593|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:18:52 kjcf05n00 mcfcli[3673891]: %3|1730783932.594|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:18:54 kjcf05n00 mcfcli[3673891]: %3|1730783934.241|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:19:22 kjcf05n00 mcfcli[3673891]: %3|1730783962.594|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:19:31 kjcf05n00 zabbix-server[2534824]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:19:31 kjcf05n00 zabbix-server[2534824]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46825' Nov 4 23:19:32 kjcf05n00 zabbix-server[2534824]: Filesystem 'kjcf05' has been mounted Nov 4 23:19:32 kjcf05n02 dwd[5183]: nvme2n1 passed periodic SMART status check Nov 4 23:19:32 kjcf05n02 dwd[5183]: nvme18n1 passed periodic SMART status check Nov 4 23:19:32 kjcf05n00 zabbix-server[2534824]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 4 23:19:32 kjcf05n00 zabbix-server[2534824]: Running puppet on 'None' Nov 4 23:19:33 kjcf05n02 dwd[5183]: nvme24n1 passed periodic SMART status check Nov 4 23:19:33 kjcf05n02 dwd[5183]: nvme19n1 passed periodic SMART status check Nov 4 23:19:33 kjcf05n02 dwd[5183]: nvme3n1 passed periodic SMART status check Nov 4 23:19:33 kjcf05n02 dwd[5183]: nvme9n1 passed periodic SMART status check Nov 4 23:19:34 kjcf05n02 dwd[5183]: nvme8n1 passed periodic SMART status check Nov 4 23:19:34 kjcf05n02 dwd[5183]: nvme25n1 passed periodic SMART status check Nov 4 23:19:34 kjcf05n02 dwd[5183]: nvme4n1 passed periodic SMART status check Nov 4 23:19:34 kjcf05n02 dwd[5183]: nvme23n1 passed periodic SMART status check Nov 4 23:19:34 kjcf05n02 dwd[5183]: nvme17n1 passed periodic SMART status check Nov 4 23:19:34 kjcf05n02 puppet-agent[56863]: Using configured environment 'production' Nov 4 23:19:34 kjcf05n03 puppet-agent[279989]: Using configured environment 'production' Nov 4 23:19:34 kjcf05n03 puppet-agent[279989]: Retrieving pluginfacts Nov 4 23:19:34 kjcf05n03 puppet-agent[279989]: Retrieving plugin Nov 4 23:19:34 kjcf05n07 puppet-agent[2575367]: Using configured environment 'production' Nov 4 23:19:34 kjcf05n07 puppet-agent[2575367]: Retrieving pluginfacts Nov 4 23:19:34 kjcf05n07 puppet-agent[2575367]: Retrieving plugin Nov 4 23:19:34 kjcf05n00 mcfcli[3673891]: %3|1730783974.212|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:19:34 kjcf05n02 puppet-agent[56863]: Retrieving pluginfacts Nov 4 23:19:34 kjcf05n02 puppet-agent[56863]: Retrieving plugin Nov 4 23:19:34 kjcf05n05 puppet-agent[2771596]: Using configured environment 'production' Nov 4 23:19:34 kjcf05n05 puppet-agent[2771596]: Retrieving pluginfacts Nov 4 23:19:34 kjcf05n05 puppet-agent[2771596]: Retrieving plugin Nov 4 23:19:34 kjcf05n06 puppet-agent[2574644]: Using configured environment 'production' Nov 4 23:19:34 kjcf05n06 puppet-agent[2574644]: Retrieving pluginfacts Nov 4 23:19:34 kjcf05n06 puppet-agent[2574644]: Retrieving plugin Nov 4 23:19:34 kjcf05n04 puppet-agent[2560587]: Using configured environment 'production' Nov 4 23:19:34 kjcf05n04 puppet-agent[2560587]: Retrieving pluginfacts Nov 4 23:19:34 kjcf05n04 puppet-agent[2560587]: Retrieving plugin Nov 4 23:19:34 kjcf05n04 puppet-agent[2560587]: Loading facts Nov 4 23:19:35 kjcf05n02 puppet-agent[56863]: Loading facts Nov 4 23:19:35 kjcf05n05 puppet-agent[2771596]: Loading facts Nov 4 23:19:35 kjcf05n03 puppet-agent[279989]: Loading facts Nov 4 23:19:35 kjcf05n06 puppet-agent[2574644]: Loading facts Nov 4 23:19:35 kjcf05n01 puppet-agent[3952333]: Using configured environment 'production' Nov 4 23:19:35 kjcf05n01 puppet-agent[3952333]: Retrieving pluginfacts Nov 4 23:19:35 kjcf05n01 puppet-agent[3952333]: Retrieving plugin Nov 4 23:19:35 kjcf05n07 puppet-agent[2575367]: Loading facts Nov 4 23:19:35 kjcf05n00 puppet-agent[2534998]: Using configured environment 'production' Nov 4 23:19:35 kjcf05n00 puppet-agent[2534998]: Retrieving pluginfacts Nov 4 23:19:35 kjcf05n00 puppet-agent[2534998]: Retrieving plugin Nov 4 23:19:35 kjcf05n01 puppet-agent[3952333]: Loading facts Nov 4 23:19:35 kjcf05n00 puppet-agent[2534998]: Loading facts Nov 4 23:19:38 kjcf05n06 puppet-agent[2574644]: Caching catalog for kjcf05n06 Nov 4 23:19:38 kjcf05n06 puppet-agent[2574644]: Applying configuration version '1730783976' Nov 4 23:19:38 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 4 23:19:38 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 4 23:19:39 kjcf05n02 puppet-agent[56863]: Caching catalog for kjcf05n02 Nov 4 23:19:39 kjcf05n02 puppet-agent[56863]: Applying configuration version '1730783976' Nov 4 23:19:39 kjcf05n03 puppet-agent[279989]: Caching catalog for kjcf05n03 Nov 4 23:19:39 kjcf05n03 puppet-agent[279989]: Applying configuration version '1730783976' Nov 4 23:19:40 kjcf05n01 puppet-agent[3952333]: Caching catalog for kjcf05n01 Nov 4 23:19:40 kjcf05n01 puppet-agent[3952333]: Applying configuration version '1730783977' Nov 4 23:19:40 kjcf05n06 puppet-agent[2574644]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 23:19:40 kjcf05n06 puppet-agent[2574644]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 23:19:40 kjcf05n06 puppet-agent[2574644]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 23:19:40 kjcf05n00 puppet-agent[2534998]: Caching catalog for kjcf05n00 Nov 4 23:19:40 kjcf05n00 puppet-agent[2534998]: Applying configuration version '1730783978' Nov 4 23:19:40 kjcf05n07 puppet-agent[2575367]: Caching catalog for kjcf05n07 Nov 4 23:19:40 kjcf05n07 puppet-agent[2575367]: Applying configuration version '1730783976' Nov 4 23:19:41 kjcf05n02 puppet-agent[56863]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 23:19:41 kjcf05n02 puppet-agent[56863]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 23:19:41 kjcf05n02 puppet-agent[56863]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 23:19:41 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2521734]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 23:19:41 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 4 23:19:41 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 23:19:41 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 4 23:19:41 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 4 23:19:41 kjcf05n06 puppet-agent[2574644]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: Press Ctrl+C to exit. Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: Plugin support version 1.0 Nov 4 23:19:41 kjcf05n06 zabbix_agent2[2575124]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 23:19:41 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 4 23:19:41 kjcf05n02 zabbix_agent2[35553]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 23:19:41 kjcf05n02 zabbix_agent2[3136]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:19:41 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 23:19:41 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 4 23:19:41 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 23:19:41 kjcf05n02 puppet-agent[56863]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: Press Ctrl+C to exit. Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: Plugin support version 1.0 Nov 4 23:19:41 kjcf05n02 zabbix_agent2[57302]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 23:19:41 kjcf05n03 puppet-agent[279989]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 23:19:41 kjcf05n03 puppet-agent[279989]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 23:19:41 kjcf05n03 puppet-agent[279989]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 23:19:42 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 4 23:19:42 kjcf05n03 zabbix_agent2[224083]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 23:19:42 kjcf05n03 zabbix_agent2[3163]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 23:19:42 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 23:19:42 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 4 23:19:42 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 4 23:19:42 kjcf05n03 puppet-agent[279989]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: Press Ctrl+C to exit. Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: Plugin support version 1.0 Nov 4 23:19:42 kjcf05n03 zabbix_agent2[280457]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 23:19:42 kjcf05n07 puppet-agent[2575367]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 23:19:42 kjcf05n07 puppet-agent[2575367]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 23:19:42 kjcf05n07 puppet-agent[2575367]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 23:19:43 kjcf05n06 puppet-agent[2574644]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 23:19:43 kjcf05n06 puppet-agent[2574644]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 23:19:43 kjcf05n06 puppet-agent[2574644]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 23:19:43 kjcf05n06 puppet-agent[2574644]: Applied catalog in 4.92 seconds Nov 4 23:19:43 kjcf05n01 puppet-agent[3952333]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 23:19:43 kjcf05n01 puppet-agent[3952333]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-22:56:01]/mode) mode changed '0755' to '0750' Nov 4 23:19:43 kjcf05n01 puppet-agent[3952333]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-22:56:01/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 4 23:19:43 kjcf05n01 puppet-agent[3952333]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-22:56:01/vmcore]/mode) mode changed '0600' to '0640' Nov 4 23:19:43 kjcf05n01 puppet-agent[3952333]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-22:56:01/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 4 23:19:43 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 23:19:43 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 23:19:43 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 23:19:43 kjcf05n00 puppet-agent[2534998]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 23:19:43 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2523877]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 23:19:43 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 4 23:19:43 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 23:19:43 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 4 23:19:43 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 4 23:19:43 kjcf05n07 puppet-agent[2575367]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: Press Ctrl+C to exit. Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: Plugin support version 1.0 Nov 4 23:19:43 kjcf05n07 zabbix_agent2[2576797]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 23:19:43 kjcf05n02 puppet-agent[56863]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 23:19:43 kjcf05n02 puppet-agent[56863]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 23:19:43 kjcf05n02 puppet-agent[56863]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 23:19:43 kjcf05n02 puppet-agent[56863]: Applied catalog in 5.16 seconds Nov 4 23:19:44 kjcf05n01 puppet-agent[3952333]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 23:19:44 kjcf05n01 puppet-agent[3952333]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 23:19:44 kjcf05n01 puppet-agent[3952333]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 23:19:44 kjcf05n03 puppet-agent[279989]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 23:19:44 kjcf05n03 puppet-agent[279989]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 23:19:44 kjcf05n03 puppet-agent[279989]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 23:19:44 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3940436]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 23:19:44 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 4 23:19:44 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 23:19:44 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 4 23:19:44 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 4 23:19:44 kjcf05n01 puppet-agent[3952333]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: Press Ctrl+C to exit. Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: Plugin support version 1.0 Nov 4 23:19:44 kjcf05n01 zabbix_agent2[3952741]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 23:19:44 kjcf05n00 puppet-agent[2534998]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 23:19:44 kjcf05n00 puppet-agent[2534998]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 23:19:44 kjcf05n00 puppet-agent[2534998]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 23:19:45 kjcf05n03 puppet-agent[279989]: Applied catalog in 5.32 seconds Nov 4 23:19:45 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2516615]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 23:19:45 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 23:19:45 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 23:19:45 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 4 23:19:45 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 4 23:19:45 kjcf05n00 puppet-agent[2534998]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: Press Ctrl+C to exit. Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: Plugin support version 1.0 Nov 4 23:19:45 kjcf05n00 zabbix_agent2[2535613]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 23:19:45 kjcf05n07 puppet-agent[2575367]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 23:19:45 kjcf05n07 puppet-agent[2575367]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 23:19:45 kjcf05n07 puppet-agent[2575367]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 23:19:45 kjcf05n00 zabbix-server[2535638]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:19:45 kjcf05n07 puppet-agent[2575367]: Applied catalog in 4.96 seconds Nov 4 23:19:46 kjcf05n00 zabbix-server[2535639]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:19:46 kjcf05n00 zabbix-server[2535645]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:19:46 kjcf05n00 zabbix-server[2535647]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:19:47 kjcf05n01 puppet-agent[3952333]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_230321.log]/mode) mode changed '0644' to '0640' Nov 4 23:19:47 kjcf05n01 puppet-agent[3952333]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_231448.log]/mode) mode changed '0644' to '0640' Nov 4 23:19:47 kjcf05n01 puppet-agent[3952333]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241104_231449]/mode) mode changed '0755' to '0750' Nov 4 23:19:47 kjcf05n01 puppet-agent[3952333]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241104_231449/screenlog.0]/mode) mode changed '0644' to '0640' Nov 4 23:19:46 kjcf05n00 puppet-agent[2534998]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 4 23:19:47 kjcf05n01 puppet-agent[3952333]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_230321.log]/mode) mode changed '0644' to '0640' Nov 4 23:19:47 kjcf05n01 puppet-agent[3952333]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_231448.log]/mode) mode changed '0644' to '0640' Nov 4 23:19:47 kjcf05n01 puppet-agent[3952333]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 23:19:47 kjcf05n01 puppet-agent[3952333]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 23:19:47 kjcf05n01 puppet-agent[3952333]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 23:19:48 kjcf05n00 puppet-agent[2534998]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 23:19:48 kjcf05n00 puppet-agent[2534998]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 23:19:48 kjcf05n00 puppet-agent[2534998]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 23:19:49 kjcf05n01 puppet-agent[3952333]: Applied catalog in 8.96 seconds Nov 4 23:19:48 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 4 23:19:49 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 4 23:19:48 kjcf05n00 puppet-agent[2534998]: Applied catalog in 8.45 seconds Nov 4 23:19:52 kjcf05n00 mcfcli[3673891]: %3|1730783992.595|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 23:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 23:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 23:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 23:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 23:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 23:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 23:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 23:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 23:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 23:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 23:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 23:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 23:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 23:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 23:20:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 23:20:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:20:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 23:20:09 kjcf05n04 puppet-agent[2560587]: Caching catalog for kjcf05n04 Nov 4 23:20:09 kjcf05n04 puppet-agent[2560587]: Applying configuration version '1730784006' Nov 4 23:20:11 kjcf05n04 puppet-agent[2560587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 23:20:11 kjcf05n04 puppet-agent[2560587]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 23:20:11 kjcf05n04 puppet-agent[2560587]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 23:20:11 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2502852]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 23:20:11 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 4 23:20:11 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 23:20:11 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 4 23:20:11 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 4 23:20:11 kjcf05n04 puppet-agent[2560587]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: Press Ctrl+C to exit. Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: Plugin support version 1.0 Nov 4 23:20:11 kjcf05n04 zabbix_agent2[2562174]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 23:20:11 kjcf05n00 mcfcli[3673891]: %3|1730784011.680|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:20:13 kjcf05n04 puppet-agent[2560587]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 23:20:13 kjcf05n04 puppet-agent[2560587]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 23:20:13 kjcf05n04 puppet-agent[2560587]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 23:20:13 kjcf05n04 puppet-agent[2560587]: Applied catalog in 4.80 seconds Nov 4 23:20:22 kjcf05n00 mcfcli[3673891]: %3|1730784022.595|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:20:27 kjcf05n05 puppet-agent[2771596]: Caching catalog for kjcf05n05 Nov 4 23:20:27 kjcf05n05 puppet-agent[2771596]: Applying configuration version '1730784026' Nov 4 23:20:29 kjcf05n05 puppet-agent[2771596]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 23:20:29 kjcf05n05 puppet-agent[2771596]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 23:20:29 kjcf05n05 puppet-agent[2771596]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 23:20:30 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2712725]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 23:20:30 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 4 23:20:30 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 23:20:30 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 4 23:20:30 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 4 23:20:30 kjcf05n05 puppet-agent[2771596]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: Press Ctrl+C to exit. Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: Plugin support version 1.0 Nov 4 23:20:30 kjcf05n05 zabbix_agent2[2774552]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 23:20:32 kjcf05n05 puppet-agent[2771596]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 23:20:32 kjcf05n05 puppet-agent[2771596]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 23:20:32 kjcf05n05 puppet-agent[2771596]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 23:20:32 kjcf05n05 puppet-agent[2771596]: Applied catalog in 4.76 seconds Nov 4 23:20:32 kjcf05n00 zabbix-server[2534824]: puppet completed status:(0): '' Nov 4 23:20:32 kjcf05n00 zabbix-server[2534824]: Event '46825' acknowledged Nov 4 23:20:32 kjcf05n00 zabbix-server[2534824]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 4 23:20:43 kjcf05n00 python3.9[2536014]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 23:20:44 kjcf05n00 zabbix-server[2536308]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:20:44 kjcf05n00 zabbix-server[2536308]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 238.9\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 141.06\\"}}"' Nov 4 23:20:44 kjcf05n00 log_interesting_event.py[2536308]: Event '46826' acknowledged Nov 4 23:20:50 kjcf05n00 mcfcli[3673891]: %3|1730784050.295|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:20:52 kjcf05n00 mcfcli[3673891]: %3|1730784052.595|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:21:22 kjcf05n00 mcfcli[3673891]: %3|1730784082.595|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:21:29 kjcf05n00 mcfcli[3673891]: %3|1730784089.934|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:21:52 kjcf05n00 mcfcli[3673891]: %3|1730784112.595|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 23:22:09 kjcf05n00 mcfcli[3673891]: %3|1730784129.603|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:22:22 kjcf05n00 mcfcli[3673891]: %3|1730784142.595|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 23:22:48 kjcf05n00 mcfcli[3673891]: %3|1730784168.057|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:22:52 kjcf05n00 mcfcli[3673891]: %3|1730784172.596|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 23:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T05:23:15.867513Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 23:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T05:23:15.867610Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.121ms Nov 4 23:23:22 kjcf05n00 mcfcli[3673891]: %3|1730784202.596|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 23:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T23:23:27.268002598-06:00 level=info msg="Completed cleanup jobs" duration=41.140329ms Nov 4 23:23:27 kjcf05n00 mcfcli[3673891]: %3|1730784207.395|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:23:52 kjcf05n00 mcfcli[3673891]: %3|1730784232.596|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:24:06 kjcf05n00 mcfcli[3673891]: %3|1730784246.510|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:24:12 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 4 23:24:12 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 0 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007730 sec, idle for 1 hour(s)] Nov 4 23:24:22 kjcf05n00 mcfcli[3673891]: %3|1730784262.597|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:24:46 kjcf05n00 mcfcli[3673891]: %3|1730784286.508|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:24:52 kjcf05n00 mcfcli[3673891]: %3|1730784292.597|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:25:22 kjcf05n00 mcfcli[3673891]: %3|1730784322.597|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:25:26 kjcf05n00 mcfcli[3673891]: %3|1730784326.505|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:25:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 23:25:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 23:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 23:25:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 23:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 23:25:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 23:25:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 23:25:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 23:25:52 kjcf05n00 mcfcli[3673891]: %3|1730784352.598|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:25:54 kjcf05n00 zabbix_server[15718]: Zabbix agent item "dcs.lustre.device.discovery[{$LUSTRE_FS_NAME},ost]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 4 23:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 23:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 23:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 23:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 23:25:57 kjcf05n00 python3.9[2539123]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 23:25:58 kjcf05n00 zabbix_server[15754]: Zabbix agent item "agent.ping" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 4 23:25:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 23:25:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 23:26:00 kjcf05n03 fstonithd.py[15114]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 4 23:26:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 23:26:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 23:26:00 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 23:26:00 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 23:26:00 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 23:26:02 kjcf05n03 root[291402]: is_enc_ipmi_off starts Nov 4 23:26:02 kjcf05n03 root[291403]: is_viking_off starts Nov 4 23:26:02 kjcf05n03 root[291440]: I am master Nov 4 23:26:02 kjcf05n03 root[291444]: I am in slot 1; partner is in slot 0 Nov 4 23:26:02 kjcf05n03 root[291468]: is_lan_ipmi_off leaves Nov 4 23:26:02 kjcf05n03 root[291470]: is_lan_ipmi_sec_off leaves Nov 4 23:26:03 kjcf05n00 mcfcli[3673891]: %3|1730784363.091|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:26:06 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='34', error='Connection reset by peer (104)' Nov 4 23:26:06 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='34', client='AF_INET(172.16.2.5:38617)', local='AF_INET(0.0.0.0:601)' Nov 4 23:26:08 kjcf05n03 root[291658]: is_viking_off leaves Nov 4 23:26:08 kjcf05n03 root[291661]: kjcf05n02 not already off look at kdump Nov 4 23:26:08 kjcf05n03 root[291662]: is_kdump_off starts Nov 4 23:26:08 kjcf05n03 fence_kdump[291663]: waiting for message from '172.16.2.5' Nov 4 23:26:08 kjcf05n03 fence_kdump[291663]: received valid message from '172.16.2.5' Nov 4 23:26:08 kjcf05n03 root[291666]: is_kdump_off detected kdump on kjcf05n02 Nov 4 23:26:08 kjcf05n03 root[291667]: kjcf05n02 is kdumping Nov 4 23:26:09 kjcf05n03 root[291774]: is_viking_off starts Nov 4 23:26:09 kjcf05n03 root[291773]: is_enc_ipmi_off starts Nov 4 23:26:09 kjcf05n03 root[291791]: I am master Nov 4 23:26:09 kjcf05n03 root[291794]: I am in slot 1; partner is in slot 0 Nov 4 23:26:09 kjcf05n03 root[291802]: is_lan_ipmi_off leaves Nov 4 23:26:09 kjcf05n03 root[291804]: is_lan_ipmi_sec_off leaves Nov 4 23:26:09 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.discovery[{$LUSTRE_FS_NAME},ost]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 4 23:26:12 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 4 23:26:12 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 4 23:26:13 kjcf05n00 zabbix_server[15777]: Zabbix agent item "vfs.fs.inode[/etc/ganesha,pfree]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 4 23:26:15 kjcf05n03 root[291987]: is_viking_off leaves Nov 4 23:26:15 kjcf05n03 root[291990]: kjcf05n02 not already off look at kdump Nov 4 23:26:15 kjcf05n03 root[291991]: is_kdump_off starts Nov 4 23:26:15 kjcf05n03 fence_kdump[291992]: waiting for message from '172.16.2.5' Nov 4 23:26:15 kjcf05n03 fence_kdump[291992]: received valid message from '172.16.2.5' Nov 4 23:26:16 kjcf05n03 root[291993]: is_kdump_off detected kdump on kjcf05n02 Nov 4 23:26:16 kjcf05n03 root[291994]: kjcf05n02 is kdumping Nov 4 23:26:20 kjcf05n03 systemd-udevd[294186]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294189]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294187]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294192]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294186]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294187]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294189]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294192]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294186]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294187]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294189]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294192]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294186]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294187]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294192]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294189]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294205]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294186]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294207]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294187]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294210]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294214]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294192]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294205]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294189]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294186]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294187]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294210]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294214]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294192]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294205]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294186]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294189]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294187]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294210]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294214]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294187]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294192]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294186]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294205]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294214]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294187]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294186]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294214]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294187]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294214]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294210]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294187]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294192]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294214]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294187]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294210]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294186]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294214]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294186]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294186]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294214]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294186]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294214]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294186]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294214]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294186]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294214]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 systemd-udevd[294214]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:26:20 kjcf05n03 dwd[5162]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 4 23:26:20 kjcf05n03 dwd[5162]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 4 23:26:20 kjcf05n03 dwd[5162]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 4 23:26:20 kjcf05n03 dwd[5162]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 4 23:26:20 kjcf05n03 dwd[5162]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 4 23:26:20 kjcf05n03 dwd[5162]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 4 23:26:20 kjcf05n03 dwd[5162]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 4 23:26:20 kjcf05n03 dwd[5162]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 4 23:26:20 kjcf05n03 dwd[5162]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 4 23:26:20 kjcf05n03 dwd[5162]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 4 23:26:20 kjcf05n03 dwd[5162]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 4 23:26:21 kjcf05n03 dwd[5162]: Starting NVME thread for nvme8n1 Nov 4 23:26:21 kjcf05n03 dwd[5162]: Starting NVME thread for nvme4n1 Nov 4 23:26:21 kjcf05n03 dwd[5162]: Starting NVME thread for nvme9n1 Nov 4 23:26:21 kjcf05n03 dwd[5162]: Starting NVME thread for nvme23n1 Nov 4 23:26:21 kjcf05n03 dwd[5162]: Starting NVME thread for nvme24n1 Nov 4 23:26:21 kjcf05n03 dwd[5162]: Starting NVME thread for nvme18n1 Nov 4 23:26:21 kjcf05n03 dwd[5162]: Starting NVME thread for nvme19n1 Nov 4 23:26:21 kjcf05n03 dwd[5162]: Starting NVME thread for nvme25n1 Nov 4 23:26:21 kjcf05n03 dwd[5162]: Starting NVME thread for nvme17n1 Nov 4 23:26:22 kjcf05n03 dwd[5162]: Starting NVME thread for nvme2n1 Nov 4 23:26:22 kjcf05n03 dwd[5162]: Starting NVME thread for nvme3n1 Nov 4 23:26:22 kjcf05n00 mcfcli[3673891]: %3|1730784382.598|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 23:26:24 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.mdt.name[MDT0000,mdt_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 4 23:26:28 kjcf05n03 diskmonitor[17340]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 4 23:26:28 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.swap.size[,total]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 4 23:26:32 kjcf05n03 diskmonitor[17340]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 4 23:26:32 kjcf05n03 diskmonitor[17340]: Scan for ReadErrorMax change for md65 Nov 4 23:26:32 kjcf05n03 diskmonitor[17340]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 4 23:26:32 kjcf05n03 diskmonitor[17340]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 4 23:26:32 kjcf05n03 diskmonitor[17340]: read_saved_file: md65 no saved speed Nov 4 23:26:32 kjcf05n03 diskmonitor[17340]: reconstruction_policy: sync_action prev = current = idle - md65 Nov 4 23:26:32 kjcf05n03 diskmonitor[17340]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 23:26:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 23:26:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 23:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 23:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 23:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 23:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 23:26:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 23:26:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 23:26:39 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 4 23:26:41 kjcf05n00 mcfcli[3673891]: %3|1730784401.857|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:26:43 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 4 23:26:53 kjcf05n00 mcfcli[3673891]: %3|1730784413.097|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 23:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 23:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 23:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 23:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 23:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 23:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 23:26:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 23:26:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 23:27:20 kjcf05n00 mcfcli[3673891]: %3|1730784440.874|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:27:23 kjcf05n00 mcfcli[3673891]: %3|1730784443.099|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:27:31 kjcf05n03 nslcd[6913]: [e45d32] ldap_result() failed: Can't contact LDAP server Nov 4 23:27:31 kjcf05n03 nslcd[6913]: [9b500d] ldap_result() failed: Can't contact LDAP server Nov 4 23:27:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 23:27:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 23:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 23:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 23:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 23:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 23:27:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 23:27:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 23:27:53 kjcf05n00 mcfcli[3673891]: %3|1730784473.178|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 23:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 23:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 23:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 23:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 23:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 23:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 23:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 23:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 23:27:59 kjcf05n00 mcfcli[3673891]: %3|1730784479.992|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:28:23 kjcf05n00 mcfcli[3673891]: %3|1730784503.178|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:28:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 23:28:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 23:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 23:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 23:28:37 kjcf05n00 mcfcli[3673891]: %3|1730784517.482|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 23:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 23:28:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 23:28:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 23:28:53 kjcf05n00 mcfcli[3673891]: %3|1730784533.178|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 23:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 23:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 23:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 23:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 23:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 23:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 23:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 23:29:12 kjcf05n00 zabbix-server[2541456]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:29:12 kjcf05n00 zabbix-server[2541456]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 4 23:29:12 kjcf05n00 log_interesting_event.py[2541456]: Event '46828' acknowledged Nov 4 23:29:17 kjcf05n00 mcfcli[3673891]: %3|1730784557.480|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:29:23 kjcf05n00 mcfcli[3673891]: %3|1730784563.178|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:29:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 23:29:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 23:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 23:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 23:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 23:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 23:29:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 23:29:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 23:29:46 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 4 23:29:48 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 4 23:29:48 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 4 23:29:51 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 4 23:29:51 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 4 23:29:51 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 4 23:29:51 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 4 23:29:51 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 4 23:29:51 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 4 23:29:51 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 4 23:29:53 kjcf05n00 mcfcli[3673891]: %3|1730784593.179|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:29:54 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 4 23:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 23:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 23:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 23:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 23:29:57 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 4 23:29:56 kjcf05n00 mcfcli[3673891]: %3|1730784596.888|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 23:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 23:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 23:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 23:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 23:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 23:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 23:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 23:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 23:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 23:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 23:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 23:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 23:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 23:30:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 23:30:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:30:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 23:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 23:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 23:30:23 kjcf05n00 mcfcli[3673891]: %3|1730784623.179|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:30:33 kjcf05n00 mcfcli[3673891]: %3|1730784633.282|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:30:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 23:30:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 23:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 23:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 23:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 23:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 23:30:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 23:30:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 23:30:39 kjcf05n00 python3.9[2542265]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 23:30:44 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:53734). Nov 4 23:30:44 kjcf05n01 rsyncd[3957249]: connect from kjcf05n02 (172.16.2.5) Nov 4 23:30:44 kjcf05n01 rsyncd[3957249]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 4 23:30:44 kjcf05n01 rsyncd[3957249]: building file list Nov 4 23:30:44 kjcf05n01 rsyncd[3957249]: sent 11449 bytes received 136 bytes total size 10905 Nov 4 23:30:44 kjcf05n01 systemd[1]: rsyncd@673-172.16.2.2:873-172.16.2.5:53734.service: Succeeded. Nov 4 23:30:53 kjcf05n00 mcfcli[3673891]: %3|1730784653.280|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 23:30:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730784653', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 23:30:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730784653'} Nov 4 23:30:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:30:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730784653', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 23:30:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730784653'} Nov 4 23:30:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 23:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 23:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 23:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 23:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 23:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 23:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 23:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 23:31:00 kjcf05n03 fstonithd.py[15114]: Listening for kdump packets from partner Nov 4 23:31:13 kjcf05n00 mcfcli[3673891]: %3|1730784673.143|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:31:23 kjcf05n00 mcfcli[3673891]: %3|1730784683.600|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 23:31:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 23:31:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 23:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 23:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 23:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 23:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 23:31:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 23:31:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 23:31:47 kjcf05n03 dwd[5162]: nvme23n1 passed periodic SMART status check Nov 4 23:31:47 kjcf05n03 dwd[5162]: nvme9n1 passed periodic SMART status check Nov 4 23:31:47 kjcf05n03 dwd[5162]: nvme4n1 passed periodic SMART status check Nov 4 23:31:47 kjcf05n03 dwd[5162]: nvme17n1 passed periodic SMART status check Nov 4 23:31:47 kjcf05n03 dwd[5162]: nvme25n1 passed periodic SMART status check Nov 4 23:31:47 kjcf05n03 dwd[5162]: nvme24n1 passed periodic SMART status check Nov 4 23:31:47 kjcf05n03 dwd[5162]: nvme19n1 passed periodic SMART status check Nov 4 23:31:47 kjcf05n03 dwd[5162]: nvme8n1 passed periodic SMART status check Nov 4 23:31:47 kjcf05n03 dwd[5162]: nvme18n1 passed periodic SMART status check Nov 4 23:31:48 kjcf05n03 dwd[5162]: nvme2n1 passed periodic SMART status check Nov 4 23:31:48 kjcf05n03 dwd[5162]: nvme3n1 passed periodic SMART status check Nov 4 23:31:52 kjcf05n00 mcfcli[3673891]: %3|1730784712.971|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:31:53 kjcf05n00 mcfcli[3673891]: %3|1730784713.601|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 23:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 23:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 23:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 23:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 4 23:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 23:31:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 4 23:31:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 23:32:09 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='47', client='AF_INET(172.16.2.5:45925)', local='AF_INET(0.0.0.0:601)' Nov 4 23:32:09 kjcf05n02 syslog-ng[3231]: Configuration reload request received, reloading configuration; Nov 4 23:32:09 kjcf05n02 syslog-ng[3231]: Configuration reload finished; Nov 4 23:32:09 kjcf05n02 syslog-ng[3231]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 4 23:32:09 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 4 23:32:09 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 23:32:09 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 4 23:32:09 kjcf05n02 dracut: Self testing crypto algorithms Nov 4 23:32:09 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 4 23:32:09 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 4 23:32:09 kjcf05n02 Copying live image to RAM... Nov 4 23:32:09 kjcf05n02 (this may take a minute) Nov 4 23:32:09 kjcf05n02 Done copying live image to RAM. Nov 4 23:32:09 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 4 23:32:09 kjcf05n02 dracut: Checking integrity of kernel Nov 4 23:32:09 kjcf05n02 dracut: All initrd crypto checks done Nov 4 23:32:09 kjcf05n02 dracut: Switching root Nov 4 23:32:09 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 4 23:32:09 kjcf05n02 systemd: Detected architecture x86-64. Nov 4 23:32:09 kjcf05n02 systemd: Set hostname to . Nov 4 23:32:09 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 4 23:32:09 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 4 23:32:09 kjcf05n02 systemd: Started Dispatch Password Requests to Console Directory Watch. Nov 4 23:32:09 kjcf05n02 systemd: Created slice system-serial\x2dgetty.slice. Nov 4 23:32:09 kjcf05n02 systemd: Listening on udev Kernel Socket. Nov 4 23:32:09 kjcf05n02 systemd: Listening on initctl Compatibility Named Pipe. Nov 4 23:32:09 kjcf05n02 systemd: Listening on Device-mapper event daemon FIFOs. Nov 4 23:32:09 kjcf05n02 systemd-journald[1526]: Journal started Nov 4 23:32:09 kjcf05n02 systemd-journald[1526]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 23:32:09 kjcf05n02 systemd-modules-load[1535]: Inserted module 'fuse' Nov 4 23:32:09 kjcf05n02 systemd[1]: Mounted /data. Nov 4 23:32:09 kjcf05n02 systemd[1]: Mounted Kernel Debug File System. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Remount Root and Kernel File Systems. Nov 4 23:32:09 kjcf05n02 systemd[1]: Mounted /mnt. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Load Kernel Modules. Nov 4 23:32:09 kjcf05n02 systemd[1]: Mounted /WIBS. Nov 4 23:32:09 kjcf05n02 systemd[1]: Mounted Huge Pages File System. Nov 4 23:32:09 kjcf05n02 systemd[1]: Mounted POSIX Message Queue File System. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 4 23:32:09 kjcf05n02 systemd[1]: Mounted Temporary Directory (/tmp). Nov 4 23:32:09 kjcf05n02 systemd[1]: Mounting Kernel Configuration File System... Nov 4 23:32:09 kjcf05n02 systemd[1]: Mounting FUSE Control File System... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Apply Kernel Variables... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Rebuild Hardware Database... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Load/Save Random Seed... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Create System Users... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 4 23:32:09 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 4 23:32:09 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 4 23:32:09 kjcf05n02 systemd-sysctl[1562]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 23:32:09 kjcf05n02 systemd-sysctl[1562]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Create System Users. Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 4 23:32:09 kjcf05n02 systemd-journald[1526]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 4 23:32:09 kjcf05n02 systemd-tmpfiles[1570]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 23:32:09 kjcf05n02 systemd-tmpfiles[1570]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 4 23:32:09 kjcf05n02 systemd-udevd[1577]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 4 23:32:09 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 4 23:32:09 kjcf05n02 systemd-udevd[1592]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:32:09 kjcf05n02 systemd-udevd[1637]: Using default interface naming scheme 'rhel-8.0'. Nov 4 23:32:09 kjcf05n02 systemd-udevd[1637]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:32:09 kjcf05n02 systemd-udevd[1636]: Using default interface naming scheme 'rhel-8.0'. Nov 4 23:32:09 kjcf05n02 systemd-udevd[1636]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:32:09 kjcf05n02 systemd-udevd[1581]: Using default interface naming scheme 'rhel-8.0'. Nov 4 23:32:09 kjcf05n02 systemd-udevd[1581]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 4 23:32:09 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 4 23:32:09 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 4 23:32:09 kjcf05n02 root[1827]: openibd: running in auto mode Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 4 23:32:09 kjcf05n02 systemd-tmpfiles[1823]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 23:32:09 kjcf05n02 systemd-tmpfiles[1823]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 23:32:09 kjcf05n02 systemd-tmpfiles[1823]: "/var/tmp" already exists and is not a directory. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 4 23:32:09 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 4 23:32:09 kjcf05n02 systemd-modules-load[1855]: Inserted module 'ib_iser' Nov 4 23:32:09 kjcf05n02 systemd-modules-load[1855]: Inserted module 'ib_isert' Nov 4 23:32:09 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 4 23:32:09 kjcf05n02 systemd-modules-load[1855]: Inserted module 'ib_srpt' Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 4 23:32:09 kjcf05n02 systemd-udevd[1583]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:32:09 kjcf05n02 systemd-modules-load[1853]: Inserted module 'ib_ipoib' Nov 4 23:32:09 kjcf05n02 systemd-udevd[1602]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started RPC Bind. Nov 4 23:32:09 kjcf05n02 systemd-modules-load[1855]: Inserted module 'rdma_ucm' Nov 4 23:32:09 kjcf05n02 systemd-modules-load[1855]: Module 'svcrdma' is blacklisted Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 4 23:32:09 kjcf05n02 systemd-udevd[1602]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 23:32:09 kjcf05n02 systemd-udevd[1583]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 4 23:32:09 kjcf05n02 systemd-modules-load[1853]: Inserted module 'ib_umad' Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 4 23:32:09 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 4 23:32:09 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 4 23:32:09 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 23:32:09 kjcf05n02 systemd[3231]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:09 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 4 23:32:09 kjcf05n02 openibd[1809]: Loading HCA driver and Access Layer:[ OK ] Nov 4 23:32:09 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Update is Completed. Nov 4 23:32:09 kjcf05n02 setup-icl[1780]: Setting LAN IP Address to 203.0.113.3 Nov 4 23:32:09 kjcf05n02 setup-icl[1780]: Setting LAN Subnet Mask to 255.255.255.0 Nov 4 23:32:09 kjcf05n02 setup-icl[1780]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 4 23:32:09 kjcf05n02 setup-icl[1780]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 4 23:32:09 kjcf05n02 systemd-udevd[1583]: Using default interface naming scheme 'rhel-8.0'. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 4 23:32:09 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 4 23:32:09 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 4 23:32:09 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 4 23:32:09 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 4 23:32:09 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 4 23:32:09 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 4 23:32:09 kjcf05n02 systemd[1]: Reached target Sockets. Nov 4 23:32:09 kjcf05n02 systemd[1]: Reached target Basic System. Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 4 23:32:09 kjcf05n02 nscd[2153]: 2153 monitoring file `/etc/hosts` (1) Nov 4 23:32:09 kjcf05n02 nscd[2153]: 2153 monitoring directory `/etc` (2) Nov 4 23:32:09 kjcf05n02 nscd[2153]: 2153 monitoring file `/etc/resolv.conf` (3) Nov 4 23:32:09 kjcf05n02 nscd[2153]: 2153 monitoring directory `/etc` (2) Nov 4 23:32:09 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 4 23:32:09 kjcf05n02 beSetMlxConfig[2145]: ConnectX-3 multiport not detected Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 4 23:32:09 kjcf05n02 mcelog[2152]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 4 23:32:09 kjcf05n02 mcelog[2152]: CPU is unsupported Nov 4 23:32:09 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 0 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 1 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 2 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 3 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 4 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 5 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 6 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 7 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 8 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 9 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 10 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 11 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 12 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 13 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 14 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 15 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 16 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 17 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 18 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 19 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 20 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 21 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 22 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 23 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 24 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 25 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 26 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 27 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 28 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 29 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 30 Nov 4 23:32:09 kjcf05n02 cpupower[2177]: Setting cpu: 31 Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[2178]: Setting up Mellanox network interface: ib0 Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 4 23:32:09 kjcf05n02 network[2180]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 23:32:09 kjcf05n02 dwd[2195]: dwd: vMay 29 2024 : 15:38:26 Nov 4 23:32:09 kjcf05n02 dwd[2195]: /usr/sbin/dwd -d --standalone=0 Nov 4 23:32:09 kjcf05n02 dwd[2195]: dwd: option Lethal: 0 Nov 4 23:32:09 kjcf05n02 dwd[2195]: dwd: option Interval: 60 Nov 4 23:32:09 kjcf05n02 dwd[2195]: dwd: option abrtlimit: 10 Nov 4 23:32:09 kjcf05n02 dwd[2195]: dwd: option DZPeriod: 604800 Nov 4 23:32:09 kjcf05n02 dwd[2195]: dwd: option SmartPeriod: 43200 Nov 4 23:32:09 kjcf05n02 dwd[2195]: dwd: option SDDEnabled: 1 Nov 4 23:32:09 kjcf05n02 dwd[2195]: dwd: option SDDAwaitScale: 3 Nov 4 23:32:09 kjcf05n02 dwd[2195]: dwd: option SDDAwaitMin: 100 Nov 4 23:32:09 kjcf05n02 dwd[2195]: dwd: option Verbosity: 1 Nov 4 23:32:09 kjcf05n02 dwd[2195]: dwd: option StandAlone: 0 Nov 4 23:32:09 kjcf05n02 dwd[2195]: option Lethal: 0 Nov 4 23:32:09 kjcf05n02 dwd[2195]: option Interval: 60 Nov 4 23:32:09 kjcf05n02 dwd[2195]: option abrtlimit: 10 Nov 4 23:32:09 kjcf05n02 dwd[2195]: option DZPeriod: 604800 Nov 4 23:32:09 kjcf05n02 dwd[2195]: option SmartPeriod: 43200 Nov 4 23:32:09 kjcf05n02 dwd[2195]: option SDDEnabled: 1 Nov 4 23:32:09 kjcf05n02 dwd[2195]: option SDDAwaitScale: 3 Nov 4 23:32:09 kjcf05n02 dwd[2195]: option SDDAwaitMin: 100 Nov 4 23:32:09 kjcf05n02 dwd[2195]: option Verbosity: 1 Nov 4 23:32:09 kjcf05n02 dwd[2195]: option StandAlone: 0 Nov 4 23:32:09 kjcf05n02 network[2213]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 4 23:32:09 kjcf05n02 network[2180]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:32:09 kjcf05n02 beSetMlxConfig[2145]: Starting MST (Mellanox Software Tools) driver set Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 4 23:32:09 kjcf05n02 chronyd[2258]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 23:32:09 kjcf05n02 network[2236]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:32:09 kjcf05n02 network[2180]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 4 23:32:09 kjcf05n02 beSetMlxConfig[2145]: Loading MST PCI module - Success Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 4 23:32:09 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[2260]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 23:32:09 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 23:32:09 kjcf05n02 network[2262]: It is advised to switch to 'NetworkManager' instead for network management. Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 4 23:32:09 kjcf05n02 beSetMlxConfig[2145]: Loading MST PCI configuration module - Success Nov 4 23:32:09 kjcf05n02 beSetMlxConfig[2145]: Create devices Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 4 23:32:09 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 4 23:32:09 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 0 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 1 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 2 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 3 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 4 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 5 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 6 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 7 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 8 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 9 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 10 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 11 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 12 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 13 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 14 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 15 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 16 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 17 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 18 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 19 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 20 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 21 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 22 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 23 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 24 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 25 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 26 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 27 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 28 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 29 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 30 Nov 4 23:32:09 kjcf05n02 cpupower[2321]: Idlestate 2 disabled on CPU 31 Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[2299]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[2300]: Setting up Mellanox network interface: ib1 Nov 4 23:32:09 kjcf05n02 mdraid-phy[2306]: no Cutlass to worry about Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 4 23:32:09 kjcf05n02 chronyd[2258]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 23:32:09 kjcf05n02 chronyd[2258]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 23:32:09 kjcf05n02 dbus-daemon[2269]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 23:32:09 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[2331]: No configuration found for ib0 Nov 4 23:32:09 kjcf05n02 sssd[sssd][2163]: Starting up Nov 4 23:32:09 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[2378]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 23:32:09 kjcf05n02 dbus-daemon[2269]: [system] Successfully activated service 'org.freedesktop.systemd1' Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[2380]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[2429]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 23:32:09 kjcf05n02 mlnx_conf_mgr[2433]: INFO: No configurations found for mlx5_0, skipping. Nov 4 23:32:09 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[2449]: No configuration found for ib1 Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[2480]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 23:32:09 kjcf05n02 mlnx_conf_mgr[2523]: INFO: No configurations found for mlx5_1, skipping. Nov 4 23:32:09 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 23:32:09 kjcf05n02 sssd[be[implicit_files]][2401]: Starting up Nov 4 23:32:09 kjcf05n02 sssd[nss][2573]: Starting up Nov 4 23:32:09 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 4 23:32:09 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Login Service... Nov 4 23:32:09 kjcf05n02 systemd-logind[2702]: New seat seat0. Nov 4 23:32:09 kjcf05n02 systemd-logind[2702]: Watching system buttons on /dev/input/event0 (Power Button) Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Login Service. Nov 4 23:32:09 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 4 23:32:09 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 4 23:32:09 kjcf05n02 python3.9[2232]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 23:32:09 kjcf05n02 python3.9[3231]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 23:32:09 kjcf05n02 systemd-sysctl[2881]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 23:32:09 kjcf05n02 systemd-sysctl[2881]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 4 23:32:09 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 23:32:09 kjcf05n02 python3.9[3034]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 23:32:09 kjcf05n02 python3.9[3231]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 23:32:09 kjcf05n02 network[2180]: Bringing up loopback interface: [ OK ] Nov 4 23:32:09 kjcf05n02 systemd-sysctl[3212]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 4 23:32:09 kjcf05n02 systemd-sysctl[3212]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 4 23:32:09 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 4 23:32:09 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 23:32:09 kjcf05n02 systemd[1]: Reached target Network. Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 4 23:32:09 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 4 23:32:09 kjcf05n02 sm-notify[3226]: Version 2.3.3 starting Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 4 23:32:09 kjcf05n02 sshd[3217]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 4 23:32:09 kjcf05n02 beSetMlxConfig[2145]: Unloading MST PCI module (unused) - Success Nov 4 23:32:09 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 4 23:32:09 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 4 23:32:09 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 4 23:32:09 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 4 23:32:09 kjcf05n02 python3.9[3216]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 23:32:09 kjcf05n02 python3.9[3231]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:09 kjcf05n02 lldpad[3221]: setsockopt nearest_bridge: Invalid argument Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 23:32:09 kjcf05n02 lldpad[3221]: setsockopt nearest_bridge: Invalid argument Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 4 23:32:09 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 4 23:32:09 kjcf05n02 syslog-ng[3231]: [2024-11-05T05:30:56.340344] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 4 23:32:09 kjcf05n02 syslog-ng[3231]: [2024-11-05T05:30:56.340611] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 4 23:32:09 kjcf05n02 syslog-ng[3231]: [2024-11-05T05:30:56.340647] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 4 23:32:09 kjcf05n02 syslog-ng[3231]: [2024-11-05T05:30:56.341229] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 4 23:32:09 kjcf05n02 syslog-ng[3231]: [2024-11-05T05:30:56.341399] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 4 23:32:09 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 4 23:32:09 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 23:32:09 kjcf05n02 python3.9[3473]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 23:32:09 kjcf05n02 python3.9[3231]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 4 23:32:09 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 23:32:09 kjcf05n02 python3.9[3476]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 4 23:32:09 kjcf05n02 python3.9[3231]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 4 23:32:09 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 4 23:32:09 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 4 23:32:09 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 4 23:32:09 kjcf05n02 chronyd[2258]: System's initial offset : 0.000296 seconds fast of true (slew) Nov 4 23:32:09 kjcf05n02 systemd[1]: Started NTP client/server. Nov 4 23:32:09 kjcf05n02 beSetMlxConfig[2145]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 23:32:09 kjcf05n02 beSetMlxConfig[2145]: ib mode Nov 4 23:32:09 kjcf05n02 beSetMlxConfig[2145]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 23:32:09 kjcf05n02 root[3500]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 4 23:32:09 kjcf05n02 root[3502]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 4 23:32:09 kjcf05n02 beSetMlxConfig[2145]: ib mode Nov 4 23:32:09 kjcf05n02 systemd-udevd[1577]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 23:32:09 kjcf05n02 systemd-udevd[3514]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:32:09 kjcf05n02 systemd-udevd[3515]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:32:09 kjcf05n02 systemd-udevd[3518]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:32:09 kjcf05n02 systemd-udevd[3521]: Using default interface naming scheme 'rhel-8.0'. Nov 4 23:32:09 kjcf05n02 systemd-udevd[3521]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:32:09 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 23:32:09 kjcf05n02 systemd[3231]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:09 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[3556]: Setting up Mellanox network interface: ib1 Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[3557]: Setting up Mellanox network interface: ib0 Nov 4 23:32:09 kjcf05n02 systemd-udevd[3516]: Using default interface naming scheme 'rhel-8.0'. Nov 4 23:32:09 kjcf05n02 systemd-udevd[3517]: Using default interface naming scheme 'rhel-8.0'. Nov 4 23:32:09 kjcf05n02 systemd-udevd[3516]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:32:09 kjcf05n02 systemd-udevd[3517]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[3606]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[3607]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[3637]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[3638]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[3639]: No configuration found for ib1 Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[3640]: No configuration found for ib0 Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[3647]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[3648]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 23:32:09 kjcf05n02 mlnx_conf_mgr[3687]: INFO: No configurations found for mlx5_0, skipping. Nov 4 23:32:09 kjcf05n02 mlnx_conf_mgr[3688]: INFO: No configurations found for mlx5_1, skipping. Nov 4 23:32:09 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 23:32:09 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 4 23:32:09 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 4 23:32:09 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 4 23:32:09 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 4 23:32:09 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 4 23:32:09 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 4 23:32:09 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 4 23:32:09 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 4 23:32:09 kjcf05n02 lldpad[3221]: init_ports: Error adding device ib0 Nov 4 23:32:09 kjcf05n02 lldpad[3221]: init_ports: Error adding device ib1 Nov 4 23:32:09 kjcf05n02 lldpad[3221]: Signal 15 received - terminating Nov 4 23:32:09 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 4 23:32:09 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 4 23:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 4 23:32:09 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 4 23:32:09 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 4 23:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 4 23:32:09 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 4 23:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:09 kjcf05n02 systemd[3231]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 1 | Nov-05-2024 | 05:01:46 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 2 | Nov-05-2024 | 05:02:37 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 3 | Nov-05-2024 | 05:02:37 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 4 | Nov-05-2024 | 05:03:42 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 5 | Nov-05-2024 | 05:03:43 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 6 | Nov-05-2024 | 05:28:17 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 7 | Nov-05-2024 | 05:28:17 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 8 | Nov-05-2024 | 05:28:17 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 9 | Nov-05-2024 | 05:28:17 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 10 | Nov-05-2024 | 05:28:17 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 11 | Nov-05-2024 | 05:28:17 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 12 | Nov-05-2024 | 05:28:17 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 13 | Nov-05-2024 | 05:28:17 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 14 | Nov-05-2024 | 05:28:17 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 15 | Nov-05-2024 | 05:28:17 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 16 | Nov-05-2024 | 05:28:17 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 17 | Nov-05-2024 | 05:28:17 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 18 | Nov-05-2024 | 05:28:17 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 19 | Nov-05-2024 | 05:28:17 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 20 | Nov-05-2024 | 05:28:17 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 21 | Nov-05-2024 | 05:28:17 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 22 | Nov-05-2024 | 05:28:17 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 23 | Nov-05-2024 | 05:28:17 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 24 | Nov-05-2024 | 05:28:17 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 25 | Nov-05-2024 | 05:28:17 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 26 | Nov-05-2024 | 05:28:17 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 27 | Nov-05-2024 | 05:28:17 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 28 | Nov-05-2024 | 05:28:18 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 29 | Nov-05-2024 | 05:28:18 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 30 | Nov-05-2024 | 05:28:18 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 31 | Nov-05-2024 | 05:28:18 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 32 | Nov-05-2024 | 05:28:18 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 33 | Nov-05-2024 | 05:28:18 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 34 | Nov-05-2024 | 05:28:18 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 35 | Nov-05-2024 | 05:28:18 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 36 | Nov-05-2024 | 05:28:18 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 37 | Nov-05-2024 | 05:28:18 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 38 | Nov-05-2024 | 05:28:47 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 39 | Nov-05-2024 | 05:28:48 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 40 | Nov-05-2024 | 05:28:48 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 41 | Nov-05-2024 | 05:28:48 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 42 | Nov-05-2024 | 05:28:48 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 43 | Nov-05-2024 | 05:28:48 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 44 | Nov-05-2024 | 05:28:48 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 45 | Nov-05-2024 | 05:28:48 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 46 | Nov-05-2024 | 05:28:48 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 47 | Nov-05-2024 | 05:28:48 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 48 | Nov-05-2024 | 05:28:48 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 49 | Nov-05-2024 | 05:28:48 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 50 | Nov-05-2024 | 05:28:48 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 51 | Nov-05-2024 | 05:28:48 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 52 | Nov-05-2024 | 05:28:48 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 53 | Nov-05-2024 | 05:28:48 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 54 | Nov-05-2024 | 05:28:48 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 55 | Nov-05-2024 | 05:28:48 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 56 | Nov-05-2024 | 05:28:48 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 57 | Nov-05-2024 | 05:28:48 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 58 | Nov-05-2024 | 05:28:48 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 59 | Nov-05-2024 | 05:28:48 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 60 | Nov-05-2024 | 05:28:49 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 61 | Nov-05-2024 | 05:28:49 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 62 | Nov-05-2024 | 05:28:49 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 63 | Nov-05-2024 | 05:28:49 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 64 | Nov-05-2024 | 05:28:49 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 65 | Nov-05-2024 | 05:28:49 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 66 | Nov-05-2024 | 05:28:49 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 67 | Nov-05-2024 | 05:28:49 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 68 | Nov-05-2024 | 05:28:49 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4033]: 69 | Nov-05-2024 | 05:28:49 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 4 23:32:09 kjcf05n02 ipmievd[4036]: Reading sensors... Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 4 23:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:09 kjcf05n02 systemd[3231]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 4 23:32:09 kjcf05n02 nscd[2153]: 2153 monitored file `/etc/hosts` was moved into place, adding watch Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 4 23:32:09 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 4 23:32:09 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 4 23:32:09 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 4 23:32:09 kjcf05n02 beSetMlxConfig[4094]: ConnectX-3 multiport not detected Nov 4 23:32:09 kjcf05n02 beSetMlxConfig[4094]: Starting MST (Mellanox Software Tools) driver set Nov 4 23:32:09 kjcf05n02 beSetMlxConfig[4094]: Loading MST PCI module - Success Nov 4 23:32:09 kjcf05n02 systemd-udevd[1577]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 23:32:09 kjcf05n02 beSetMlxConfig[4094]: [warn] mst_pciconf is already loaded, skipping Nov 4 23:32:09 kjcf05n02 beSetMlxConfig[4094]: Create devices Nov 4 23:32:09 kjcf05n02 beSetMlxConfig[4094]: Unloading MST PCI module (unused) - Success Nov 4 23:32:09 kjcf05n02 ipmievd[4036]: Waiting for events... Nov 4 23:32:09 kjcf05n02 beSetMlxConfig[4094]: Configuring /dev/mst/mt4123_pciconf1 Nov 4 23:32:09 kjcf05n02 beSetMlxConfig[4094]: ib mode Nov 4 23:32:09 kjcf05n02 beSetMlxConfig[4094]: Configuring /dev/mst/mt4123_pciconf0 Nov 4 23:32:09 kjcf05n02 beSetMlxConfig[4094]: ib mode Nov 4 23:32:09 kjcf05n02 systemd-udevd[1577]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 23:32:09 kjcf05n02 systemd-udevd[4995]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:32:09 kjcf05n02 systemd-udevd[4996]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:32:09 kjcf05n02 systemd-udevd[4999]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:32:09 kjcf05n02 systemd-udevd[5002]: Using default interface naming scheme 'rhel-8.0'. Nov 4 23:32:09 kjcf05n02 systemd-udevd[5002]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:32:09 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 4 23:32:09 kjcf05n02 systemd[3231]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:09 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[5037]: Setting up Mellanox network interface: ib0 Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[5038]: Setting up Mellanox network interface: ib1 Nov 4 23:32:09 kjcf05n02 systemd-udevd[4997]: Using default interface naming scheme 'rhel-8.0'. Nov 4 23:32:09 kjcf05n02 systemd-udevd[4998]: Using default interface naming scheme 'rhel-8.0'. Nov 4 23:32:09 kjcf05n02 systemd-udevd[4997]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:32:09 kjcf05n02 systemd-udevd[4998]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[5087]: set_ipoib_cm: ib0 connection mode set to connected Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[5088]: set_ipoib_cm: ib1 connection mode set to connected Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[5118]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[5119]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[5120]: No configuration found for ib0 Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[5121]: No configuration found for ib1 Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[5128]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 4 23:32:09 kjcf05n02 mlnx_interface_mgr[5129]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 4 23:32:09 kjcf05n02 mlnx_conf_mgr[5166]: INFO: No configurations found for mlx5_0, skipping. Nov 4 23:32:09 kjcf05n02 mlnx_conf_mgr[5169]: INFO: No configurations found for mlx5_1, skipping. Nov 4 23:32:09 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 4 23:32:09 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}600ddbb9ee841f2ab7b80821d312a0f6885f7b1d152f275727a7fdccdc1d1aa4' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}600ddbb9ee841f2ab7b80821d312a0f6885f7b1d152f275727a7fdccdc1d1aa4' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}902accf4ceb76a4825e6f4631d7106398e2d21d388ed21292e60e1572a64c487' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}902accf4ceb76a4825e6f4631d7106398e2d21d388ed21292e60e1572a64c487' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}f5cc8f503459c09ba85f3315376705e0a19328647c05fac0f30983fa3ae44891' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}f5cc8f503459c09ba85f3315376705e0a19328647c05fac0f30983fa3ae44891' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}ed99b95f599fedd0af2d6895fd5a429a92a0b789f45a41ec275c378c7c95387f' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}ed99b95f599fedd0af2d6895fd5a429a92a0b789f45a41ec275c378c7c95387f' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 4 23:32:09 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 4 23:32:09 kjcf05n02 chronyd[2258]: chronyd exiting Nov 4 23:32:09 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 4 23:32:09 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 4 23:32:09 kjcf05n02 chronyd[5203]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 4 23:32:09 kjcf05n02 chronyd[5203]: Wrong owner of /var/run/chrony (UID != 991) Nov 4 23:32:09 kjcf05n02 chronyd[5203]: Disabled command socket /var/run/chrony/chronyd.sock Nov 4 23:32:09 kjcf05n02 chronyd[5203]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 4 23:32:09 kjcf05n02 systemd[1]: Started NTP client/server. Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 4 23:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:09 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 4 23:32:09 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 4 23:32:09 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 4 23:32:09 kjcf05n02 dwd[5234]: dwd: vMay 29 2024 : 15:38:26 Nov 4 23:32:09 kjcf05n02 dwd[5234]: /usr/sbin/dwd -i 15 -d Nov 4 23:32:09 kjcf05n02 dwd[5234]: dwd: option Lethal: 0 Nov 4 23:32:09 kjcf05n02 dwd[5234]: dwd: option Interval: 15 Nov 4 23:32:09 kjcf05n02 dwd[5234]: dwd: option abrtlimit: 10 Nov 4 23:32:09 kjcf05n02 dwd[5234]: dwd: option DZPeriod: 604800 Nov 4 23:32:09 kjcf05n02 dwd[5234]: dwd: option SmartPeriod: 43200 Nov 4 23:32:09 kjcf05n02 dwd[5234]: dwd: option SDDEnabled: 1 Nov 4 23:32:09 kjcf05n02 dwd[5234]: dwd: option SDDAwaitScale: 3 Nov 4 23:32:09 kjcf05n02 dwd[5234]: dwd: option SDDAwaitMin: 100 Nov 4 23:32:09 kjcf05n02 dwd[5234]: dwd: option Verbosity: 1 Nov 4 23:32:09 kjcf05n02 dwd[5234]: dwd: option StandAlone: 0 Nov 4 23:32:09 kjcf05n02 dwd[5234]: option Lethal: 0 Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 4 23:32:09 kjcf05n02 dwd[5234]: option Interval: 15 Nov 4 23:32:09 kjcf05n02 dwd[5234]: option abrtlimit: 10 Nov 4 23:32:09 kjcf05n02 dwd[5234]: option DZPeriod: 604800 Nov 4 23:32:09 kjcf05n02 dwd[5234]: option SmartPeriod: 43200 Nov 4 23:32:09 kjcf05n02 dwd[5234]: option SDDEnabled: 1 Nov 4 23:32:09 kjcf05n02 dwd[5234]: option SDDAwaitScale: 3 Nov 4 23:32:09 kjcf05n02 dwd[5234]: option SDDAwaitMin: 100 Nov 4 23:32:09 kjcf05n02 dwd[5234]: option Verbosity: 1 Nov 4 23:32:09 kjcf05n02 dwd[5234]: option StandAlone: 0 Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 4 23:32:09 kjcf05n02 dwd[5236]: option Lethal now set to 1 Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 23:32:09 kjcf05n02 dwd[5236]: option abrtlimit now set to 1 Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 4 23:32:09 kjcf05n02 dwd[5236]: option SmartPeriod now set to 86400 Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 4 23:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 4 23:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:09 kjcf05n02 python3.9[5265]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 4 23:32:09 kjcf05n02 python3.9[3231]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 4 23:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 4 23:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:09 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 4 23:32:09 kjcf05n02 sedcpwrkr[5404]: Using config script: /etc/sedcpwrkr.conf Nov 4 23:32:09 kjcf05n02 sedcpwrkr[5404]: - Creating default directory: '/var/log/sedcpwrkr' Nov 4 23:32:09 kjcf05n02 sedcpwrkr[5404]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 4 23:32:09 kjcf05n02 sedcpwrkr[5404]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 4 23:32:09 kjcf05n02 sedcpwrkr[5404]: - Creating default directory: '/var/run/sedcpwrkr' Nov 4 23:32:09 kjcf05n02 sedcpwrkr[5404]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 4 23:32:09 kjcf05n02 sedcpwrkr[5404]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 4 23:32:09 kjcf05n02 sedcpwrkr-server[5435]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 23:32:09 kjcf05n02 sedcpwrkr[5404]: celery multi v5.2.7 (dawn-chorus) Nov 4 23:32:09 kjcf05n02 sedcpwrkr[5404]: > Starting nodes... Nov 4 23:32:09 kjcf05n02 sedcpwrkr[5404]: > sedcpwrkr@kjcf05n02: OK Nov 4 23:32:09 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 4 23:32:09 kjcf05n02 sedcpwrkr-server[5437]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 4 23:32:09 kjcf05n02 sedcpwrkr-server[5437]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 23:32:09 kjcf05n02 sedcpwrkr-server[5437]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 4 23:32:09 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 4 23:32:09 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 4 23:32:09 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 4 23:32:09 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 4 23:32:09 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 4 23:32:09 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:10 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 4 23:32:10 kjcf05n02 systemd-udevd[1577]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 23:32:10 kjcf05n02 iptables.init[5504]: iptables: Applying firewall rules: [ OK ] Nov 4 23:32:10 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 4 23:32:10 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:10 kjcf05n02 systemd[3231]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:10 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:10 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:10 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 4 23:32:10 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 4 23:32:10 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 23:32:10 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 23:32:10 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 4 23:32:10 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 4 23:32:10 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 4 23:32:10 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 4 23:32:10 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 4 23:32:10 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 4 23:32:11 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 23:32:11 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 4 23:32:11 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 23:32:11 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 4 23:32:11 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 4 23:32:11 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 4 23:32:11 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 4 23:32:11 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 4 23:32:11 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 4 23:32:11 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 4 23:32:11 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 4 23:32:11 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 4 23:32:11 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 4 23:32:11 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 4 23:32:11 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 4 23:32:11 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 4 23:32:11 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 4 23:32:11 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 4 23:32:11 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 4 23:32:11 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 4 23:32:11 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 4 23:32:11 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 4 23:32:11 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 4 23:32:11 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 4 23:32:11 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 4 23:32:11 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 4 23:32:11 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 4 23:32:11 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 4 23:32:11 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 23:32:11 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 4 23:32:11 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 4 23:32:11 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 4 23:32:11 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 23:32:11 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 4 23:32:11 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 4 23:32:11 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 4 23:32:11 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 23:32:11 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 4 23:32:11 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 23:32:11 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 4 23:32:11 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:11 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 23:32:11 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5601 which is not our child. We'll most likely not notice when it exits. Nov 4 23:32:11 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 23:32:11 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:11 kjcf05n02 openhpid[5601]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 23:32:11 kjcf05n02 openhpid[5601]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 23:32:11 kjcf05n02 openhpid[5601]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 23:32:11 kjcf05n02 openhpid[5601]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 23:32:11 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:12 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:12 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:12 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 4 23:32:12 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 4 23:32:12 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 23:32:12 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 4 23:32:12 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:12 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 4 23:32:13 kjcf05n02 dcs-collectord[5692]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 4 23:32:13 kjcf05n02 hpi.inv.log[5692]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 4 23:32:13 kjcf05n02 dcs-collectord[5692]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 4 23:32:13 kjcf05n02 dcs-collectord[5692]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 4 23:32:13 kjcf05n02 dcs-collector[5683]: Starting dcs-collector:[ OK ] Nov 4 23:32:13 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 4 23:32:13 kjcf05n02 dcs-collectord[5695]: INFO Starting collection for memory_info (collection_process.py:52) Nov 4 23:32:13 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 4 23:32:13 kjcf05n02 dcs-collectord[5695]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 23:32:13 kjcf05n02 dcs-collectord[5695]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 23:32:13 kjcf05n02 dcs-collectord[5695]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 23:32:13 kjcf05n02 dcs-collectord[5695]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 4 23:32:13 kjcf05n02 dcs-collectord[5695]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 4 23:32:13 kjcf05n02 dcs-collectord[5695]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 4 23:32:13 kjcf05n02 dcs-collectord[5695]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259349412", "units": "kB"}, {"name": "MemAvailable", "value": "258628268", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821224", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686476", "units": "kB"}, {"name": "Inactive", "value": "960036", "units": "kB"}, {"name": "Active(anon)", "value": "1520576", "units": "kB"}, {"name": "Inactive(anon)", "value": "824000", "units": "kB"}, {"name": "Active(file)", "value": "165900", "units": "kB"}, {"name": "Inactive(file)", "value": "136036", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "751408", "units": "kB"}, {"name": "Mapped", "value": "86488", "units": "kB"}, {"name": "Shmem", "value": "1593256", "units": "kB"}, {"name": "KReclaimable", "value": "107940", "units": "kB"}, {"name": "Slab", "value": "273840", "units": "kB"}, {"name": "SReclaimable", "value": "107940", "units": "kB"}, {"name": "SUnreclaim", "value": "165900", "units": "kB"}, {"name": "KernelStack", "value": "9696", "units": "kB"}, {"name": "PageTables", "value": "20264", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3280256", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11136", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "2048", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "297288", "units": "kB"}, {"name": "DirectMap2M", "value": "19490816", "units": "kB"}, {"name": "DirectMap1G", "value": "248512512", "units": "kB"}]}' Nov 4 23:32:13 kjcf05n02 dcs-collectord[5695]: INFO Completed collection for memory_info (collection_process.py:59) Nov 4 23:32:13 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:13 kjcf05n02 systemd[3231]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:13 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:13 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:13 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 4 23:32:13 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 4 23:32:13 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 23:32:13 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 4 23:32:13 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:13 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 4 23:32:13 kjcf05n02 firmware-update-orc[5776]: Using config script: /etc/firmware_update_orc.conf Nov 4 23:32:13 kjcf05n02 firmware-update-orc[5776]: - Creating default directory: '/var/log/firmware-update-orc' Nov 4 23:32:13 kjcf05n02 firmware-update-orc[5776]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 4 23:32:13 kjcf05n02 firmware-update-orc[5776]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 4 23:32:13 kjcf05n02 firmware-update-orc[5776]: - Creating default directory: '/var/run/firmware-update-orc' Nov 4 23:32:13 kjcf05n02 firmware-update-orc[5776]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 4 23:32:13 kjcf05n02 firmware-update-orc[5776]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 4 23:32:14 kjcf05n02 dcs-collectord[5695]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 4 23:32:14 kjcf05n02 dcs-collectord[5695]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730784732.7304227], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730784733.901308], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730784732.6608632, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 4 23:32:14 kjcf05n02 firmware-update-orc-server[5812]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 23:32:14 kjcf05n02 firmware-update-orc[5776]: celery multi v5.2.7 (dawn-chorus) Nov 4 23:32:14 kjcf05n02 firmware-update-orc[5776]: > Starting nodes... Nov 4 23:32:14 kjcf05n02 firmware-update-orc[5776]: > worker1@kjcf05n02: OK Nov 4 23:32:14 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 4 23:32:14 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 4 23:32:14 kjcf05n02 firmware-update-orc-server[5841]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 4 23:32:14 kjcf05n02 firmware-update-orc-server[5841]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 23:32:14 kjcf05n02 firmware-update-orc-server[5841]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 4 23:32:14 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 4 23:32:14 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:14 kjcf05n02 systemd[3231]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:14 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:14 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:14 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 23:32:14 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 4 23:32:14 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 4 23:32:14 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 4 23:32:14 kjcf05n02 dbus-daemon[2269]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 23:32:14 kjcf05n02 dbus-daemon[2269]: [system] Reloaded configuration Nov 4 23:32:14 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 4 23:32:14 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 4 23:32:14 kjcf05n02 dbus-daemon[2269]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 4 23:32:14 kjcf05n02 dbus-daemon[2269]: [system] Reloaded configuration Nov 4 23:32:14 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 23:32:14 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 4 23:32:14 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 23:32:14 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 4 23:32:15 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:15 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 4 23:32:15 kjcf05n02 ras-resource-manager-agent[5957]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 4 23:32:15 kjcf05n02 ras-resource-manager-agent[5943]: Starting ras-resource-manager-agent:[ OK ] Nov 4 23:32:15 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 4 23:32:15 kjcf05n02 ras-resource-manager-agent[5959]: INFO Starting the service handler (service_main_handler.py:98) Nov 4 23:32:15 kjcf05n02 ras-resource-manager-client[5959]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 4 23:32:15 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 4 23:32:15 kjcf05n02 ras-resource-manager-client[5959]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 23:32:15 kjcf05n02 ras-resource-manager-client[5969]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 23:32:15 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:16 kjcf05n02 systemd[3231]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:16 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:16 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:16 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 23:32:16 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 4 23:32:16 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:16 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 23:32:16 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:16 kjcf05n02 systemd[3231]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: Press Ctrl+C to exit. Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: Plugin support version 1.0 Nov 4 23:32:16 kjcf05n02 zabbix_agent2[6043]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 23:32:16 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:16 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:16 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:16 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 4 23:32:17 kjcf05n02 dcs-notification-sender[6120]: dcs-notification-senderd is stopped Nov 4 23:32:17 kjcf05n02 zabbix-agent2[6134]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 4 23:32:17 kjcf05n02 dcs-notification-sender[6120]: Starting notification-sender:[ OK ] Nov 4 23:32:17 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 4 23:32:17 kjcf05n02 zabbix-agent2[6136]: INFO DCS notification agent started. (agent.py:61) Nov 4 23:32:17 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 4 23:32:17 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:17 kjcf05n02 systemd[3231]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:17 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:17 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:18 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:18 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 4 23:32:18 kjcf05n02 dcs-collectord[6248]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 4 23:32:18 kjcf05n02 dcs-collectord[6248]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 4 23:32:18 kjcf05n02 dcs-bulk-data-sender[6248]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 4 23:32:18 kjcf05n02 dcs-bulk-data-sender[6239]: Starting bulk-data-sender:[ OK ] Nov 4 23:32:18 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 4 23:32:18 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 4 23:32:18 kjcf05n02 dcs-collectord[6250]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 4 23:32:18 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:19 kjcf05n02 systemd[3231]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:19 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:19 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:19 kjcf05n02 nscd[2153]: 2153 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 4 23:32:19 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 23:32:19 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 23:32:19 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 23:32:19 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 4 23:32:19 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 23:32:19 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 4 23:32:19 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 4 23:32:19 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 4 23:32:19 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 4 23:32:19 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 4 23:32:19 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 23:32:19 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 4 23:32:19 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 23:32:19 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 4 23:32:19 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 23:32:19 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 23:32:19 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 23:32:19 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 23:32:19 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 4 23:32:19 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 4 23:32:19 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 4 23:32:19 kjcf05n02 sssd[nss][2573]: Shutting down (status = 0) Nov 4 23:32:19 kjcf05n02 sssd[be[implicit_files]][2401]: Shutting down (status = 0) Nov 4 23:32:19 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 4 23:32:19 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 4 23:32:19 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 4 23:32:20 kjcf05n02 sssd[sssd][6314]: Starting up Nov 4 23:32:20 kjcf05n02 sssd[be[implicit_files]][6315]: Starting up Nov 4 23:32:20 kjcf05n02 python3.9[5265]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 4 23:32:20 kjcf05n02 python3.9[3231]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:20 kjcf05n02 sssd[nss][6316]: Starting up Nov 4 23:32:20 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 4 23:32:20 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 23:32:20 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 4 23:32:21 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 23:32:21 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 4 23:32:21 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 4 23:32:21 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 4 23:32:21 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 23:32:21 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 4 23:32:21 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 4 23:32:21 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 4 23:32:21 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 4 23:32:21 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 4 23:32:21 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 23:32:21 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 4 23:32:21 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 23:32:21 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 4 23:32:21 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 4 23:32:21 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 4 23:32:21 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:21 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 4 23:32:22 kjcf05n02 icinga2[6376]: [2024-11-04 23:32:21 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 4 23:32:22 kjcf05n02 icinga2[6376]: [2024-11-04 23:32:21 -0600] information/cli: Loading configuration file(s). Nov 4 23:32:22 kjcf05n02 icinga2[6376]: [2024-11-04 23:32:21 -0600] information/ConfigItem: Committing config item(s). Nov 4 23:32:22 kjcf05n02 icinga2[6376]: [2024-11-04 23:32:21 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 4 23:32:22 kjcf05n02 icinga2[6376]: [2024-11-04 23:32:21 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 4 23:32:22 kjcf05n02 icinga2[6376]: [2024-11-04 23:32:21 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 4 23:32:22 kjcf05n02 icinga2[6376]: [2024-11-04 23:32:21 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 4 23:32:22 kjcf05n02 icinga2[6376]: [2024-11-04 23:32:21 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 4 23:32:22 kjcf05n02 icinga2[6376]: [2024-11-04 23:32:21 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 4 23:32:22 kjcf05n02 icinga2[6376]: [2024-11-04 23:32:21 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 4 23:32:22 kjcf05n02 icinga2[6376]: [2024-11-04 23:32:21 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 4 23:32:22 kjcf05n02 icinga2[6376]: [2024-11-04 23:32:21 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 4 23:32:22 kjcf05n02 icinga2[6376]: [2024-11-04 23:32:21 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 4 23:32:22 kjcf05n02 icinga2[6376]: [2024-11-04 23:32:21 -0600] information/cli: Closing console log. Nov 4 23:32:22 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 4 23:32:22 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:22 kjcf05n02 systemd[3231]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:22 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:22 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:22 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 23:32:22 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 4 23:32:22 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:23 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 4 23:32:23 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:23 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 23:32:23 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:23 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:23 kjcf05n00 mcfcli[3673891]: %3|1730784743.601|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 23:32:24 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 23:32:24 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 4 23:32:24 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 23:32:24 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 4 23:32:24 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 4 23:32:24 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 4 23:32:24 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 4 23:32:24 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 4 23:32:24 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 23:32:24 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 4 23:32:24 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 23:32:24 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 4 23:32:24 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 4 23:32:24 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 4 23:32:24 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:24 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 4 23:32:24 kjcf05n02 nslcd[6988]: version 0.9.9 starting Nov 4 23:32:24 kjcf05n02 nslcd[6988]: accepting connections Nov 4 23:32:24 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 4 23:32:24 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:25 kjcf05n02 systemd[3231]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:25 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:25 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:25 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 23:32:25 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 4 23:32:25 kjcf05n02 dcs-bulk-data-sender[6250]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 4 23:32:25 kjcf05n02 dcs-collectord[6250]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 4 23:32:25 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 23:32:25 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 4 23:32:25 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 23:32:25 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 4 23:32:25 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 4 23:32:26 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 23:32:26 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 4 23:32:26 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:26 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 4 23:32:26 kjcf05n02 dearcpw[7230]: Using config script: /etc/dearcpw.conf Nov 4 23:32:26 kjcf05n02 dearcpw[7230]: - Creating default directory: '/var/log/dearcpw' Nov 4 23:32:26 kjcf05n02 dearcpw[7230]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 4 23:32:26 kjcf05n02 dearcpw[7230]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 4 23:32:26 kjcf05n02 dearcpw[7230]: - Creating default directory: '/var/run/dearcpw' Nov 4 23:32:26 kjcf05n02 dearcpw[7230]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 4 23:32:26 kjcf05n02 dearcpw[7230]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 4 23:32:26 kjcf05n02 dearcpw-server[7270]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 23:32:26 kjcf05n02 dearcpw[7230]: celery multi v5.2.7 (dawn-chorus) Nov 4 23:32:26 kjcf05n02 dearcpw[7230]: > Starting nodes... Nov 4 23:32:26 kjcf05n02 dearcpw[7230]: > dearcpw@kjcf05n02: OK Nov 4 23:32:26 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 4 23:32:26 kjcf05n02 dearcpw-server[7272]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 4 23:32:26 kjcf05n02 dearcpw-server[7272]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 23:32:26 kjcf05n02 dearcpw-server[7272]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 4 23:32:27 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 4 23:32:27 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:27 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:27 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 4 23:32:27 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 4 23:32:27 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 4 23:32:27 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 4 23:32:27 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 4 23:32:27 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 4 23:32:27 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 4 23:32:27 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 4 23:32:27 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 4 23:32:27 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 4 23:32:27 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:53768). Nov 4 23:32:27 kjcf05n01 rsyncd[3957911]: connect from kjcf05n02 (172.16.2.5) Nov 4 23:32:27 kjcf05n01 rsyncd[3957911]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 4 23:32:27 kjcf05n01 rsyncd[3957911]: receiving file list Nov 4 23:32:27 kjcf05n01 rsyncd[3957911]: sent 29 bytes received 325 bytes total size 10905 Nov 4 23:32:27 kjcf05n01 systemd[1]: rsyncd@674-172.16.2.2:873-172.16.2.5:53768.service: Succeeded. Nov 4 23:32:27 kjcf05n02 puppet[7471]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 4 23:32:27 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 4 23:32:27 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 4 23:32:27 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 4 23:32:27 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 4 23:32:27 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 4 23:32:27 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 4 23:32:27 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 23:32:27 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 4 23:32:27 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 23:32:27 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 4 23:32:27 kjcf05n02 dcs-collectord[5695]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 23:32:27 kjcf05n02 dcs-collectord[5695]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 23:32:28 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 23:32:28 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 4 23:32:28 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 23:32:28 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 23:32:29 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 23:32:29 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 23:32:29 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 23:32:29 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 23:32:29 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 23:32:29 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 23:32:29 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 23:32:29 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 23:32:30 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 23:32:30 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 23:32:30 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:30 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 4 23:32:31 kjcf05n02 diskless-swap[7659]: HA_PS_000: recovering journal Nov 4 23:32:31 kjcf05n02 systemd-udevd[1577]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 4 23:32:31 kjcf05n02 diskless-swap[7659]: HA_PS_000: clean, 2292/6400 files, 7091/25600 blocks Nov 4 23:32:31 kjcf05n02 diskless-swap[7659]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 4 23:32:31 kjcf05n02 diskless-swap[7659]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 4 23:32:31 kjcf05n02 diskless-swap[7659]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 4 23:32:31 kjcf05n02 diskless-swap[7659]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 4 23:32:31 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 4 23:32:31 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:31 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:31 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 4 23:32:31 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 4 23:32:31 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 23:32:31 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 4 23:32:31 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 4 23:32:31 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 4 23:32:31 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 4 23:32:31 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 4 23:32:31 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 4 23:32:31 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 4 23:32:31 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 4 23:32:31 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 4 23:32:31 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 4 23:32:31 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 4 23:32:30 kjcf05n00 mcfcli[3673891]: %3|1730784750.878|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:32:31 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 23:32:31 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 4 23:32:31 kjcf05n02 ipmievd[4036]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 4 23:32:31 kjcf05n02 ipmievd[4036]: System Event sensor - Timestamp Clock Sync Nov 4 23:32:32 kjcf05n02 ipmievd[3231]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:32 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 23:32:32 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 4 23:32:32 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 23:32:32 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 4 23:32:33 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 23:32:33 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 4 23:32:33 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 4 23:32:33 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 4 23:32:33 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 23:32:33 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 4 23:32:33 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 4 23:32:33 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 4 23:32:33 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib0 Nov 4 23:32:33 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib0 Nov 4 23:32:34 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 4 23:32:34 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 4 23:32:34 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 23:32:34 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 4 23:32:34 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:34 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 4 23:32:34 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:34 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:34 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 4 23:32:34 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 4 23:32:34 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:35 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 4 23:32:35 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:35 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:35 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 23:32:35 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 4 23:32:35 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:35 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 4 23:32:35 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:35 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:35 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 4 23:32:35 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 4 23:32:35 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 4 23:32:35 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 4 23:32:35 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 4 23:32:35 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 4 23:32:35 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 23:32:35 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 4 23:32:35 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 23:32:35 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 4 23:32:35 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:35 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 4 23:32:35 kjcf05n02 kdumpctl[7887]: kdump: No kdump initial ramdisk found. Nov 4 23:32:35 kjcf05n02 kdumpctl[7887]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 4 23:32:36 kjcf05n02 dracut[7999]: dracut-049-135.git20210121.el8 Nov 4 23:32:36 kjcf05n02 dracut[8001]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 4 23:32:36 kjcf05n02 dracut[8001]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 23:32:36 kjcf05n02 dracut[8001]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 23:32:36 kjcf05n02 dracut[8001]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 4 23:32:36 kjcf05n02 dracut[8001]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 4 23:32:36 kjcf05n02 dracut[8001]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 23:32:36 kjcf05n02 dracut[8001]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 23:32:36 kjcf05n02 dracut[8001]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + is_func check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ type -t check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 0 -ne 0 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check -h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local dev holder Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + require_binaries mdadm expr Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _module_name=90hperaid Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ mdadm = \-\m ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for cmd in "$@" Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + find_binary mdadm Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for cmd in "$@" Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + find_binary expr Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n -h ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for dev in "${!host_fs_types[@]}" Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ nfs != *_raid_member ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + continue Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _ret=255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + ret=255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ 255 = 0 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ 255 = 255 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ module_depends hperaid Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: +++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: +++ set -x Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ depends Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo rootfs-block Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ return 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ _ret=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ return 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for _moddep in $(module_depends $_mod) Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all == *\ hperaid\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + add_dracutmodules+=' rootfs-block ' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ == *\ hperaid\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check_module rootfs-block Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _mod=rootfs-block Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddep Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ == *\ rootfs-block\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n '' ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + mods_checked_as_dep+=' rootfs-block ' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all == *\ rootfs-block\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + module_check rootfs-block 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _forced=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 2 -eq 2 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _forced=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + is_func check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ type -t check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 0 -ne 0 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check -h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _ret=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + ret=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ 0 = 0 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ module_depends rootfs-block Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: +++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 4 23:32:36 kjcf05n02 kdumpctl[3231]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ depends Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo fs-lib Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ _ret=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ return 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for _moddep in $(module_depends $_mod) Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all == *\ rootfs-block\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + add_dracutmodules+=' fs-lib ' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ == *\ rootfs-block\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check_module fs-lib Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _mod=fs-lib Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddep Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n '' ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + mods_checked_as_dep+=' fs-lib ' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all == *\ fs-lib\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + module_check fs-lib 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _forced=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 2 -eq 2 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _forced=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + is_func check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ type -t check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 0 -ne 0 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check -h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _ret=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + ret=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ 0 = 0 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ module_depends fs-lib Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: +++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ depends Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ return 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ _ret=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ return 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + mods_to_load+=' fs-lib ' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + mods_to_load+=' rootfs-block ' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + mods_to_load+=' hperaid ' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _mod=90kernel-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _mod=kernel-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check_module kernel-modules 1 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _mod=kernel-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddep Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n 1 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all = all ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + module_check kernel-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _forced=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 1 -eq 2 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + is_func check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ type -t check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 0 -ne 0 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check -h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + true Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _ret=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + ret=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ 0 != 0 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ module_depends kernel-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: +++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ depends Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ true Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ _ret=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ return 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + mods_to_load+=' kernel-modules ' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _mod=90kernel-modules-extra Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _mod=kernel-modules-extra Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check_module kernel-modules-extra 1 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _mod=kernel-modules-extra Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddep Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n 1 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all = all ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + module_check kernel-modules-extra Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _forced=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 1 -eq 2 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + is_func check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ type -t check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 0 -ne 0 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check -h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + true Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _ret=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + ret=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ 0 != 0 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ module_depends kernel-modules-extra Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: +++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ depends Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ true Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ _ret=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ return 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + mods_to_load+=' kernel-modules-extra ' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _mod=90kernel-network-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _mod=kernel-network-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check_module kernel-network-modules 1 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _mod=kernel-network-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddep Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n 1 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all = all ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + module_check kernel-network-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _forced=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 1 -eq 2 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + is_func check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ type -t check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 0 -ne 0 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check -h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _ret=255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + ret=255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ 255 != 0 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n 1 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 1 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _mod=90livenet Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _mod=livenet Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check_module livenet 1 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _mod=livenet Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddep Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n 1 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all = all ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + module_check livenet Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _forced=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 1 -eq 2 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + is_func check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ type -t check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 0 -ne 0 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check -h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _ret=255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + ret=255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ 255 != 0 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n 1 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 1 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _mod=90lvm Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _mod=lvm Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check_module lvm 1 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _mod=lvm Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddep Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n 1 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all = all ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + module_check lvm Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _forced=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 1 -eq 2 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + is_func check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ type -t check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 0 -ne 0 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check -h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + require_binaries lvm Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _module_name=90lvm Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ lvm = \-\m ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for cmd in "$@" Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + find_binary lvm Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n -h ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for fs in "${host_fs_types[@]}" Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ nfs = LVM*_member ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _ret=255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + ret=255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ 255 != 0 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n 1 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 1 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _mod=90mdraid Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _mod=mdraid Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check_module mdraid 1 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _mod=mdraid Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddep Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n 1 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all = all ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + module_check mdraid Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _forced=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 1 -eq 2 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + is_func check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ type -t check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 0 -ne 0 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check -h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _rootdev Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + require_binaries mdadm expr Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _module_name=90mdraid Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ mdadm = \-\m ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for cmd in "$@" Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + find_binary mdadm Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for cmd in "$@" Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + find_binary expr Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n -h ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for dev in "${!host_fs_types[@]}" Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ nfs != *_raid_member ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + continue Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _ret=255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + ret=255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ 255 != 0 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n 1 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 1 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _mod=90multipath Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _mod=multipath Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check_module multipath 1 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _mod=multipath Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddep Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n 1 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all = all ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + module_check multipath Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _forced=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 1 -eq 2 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + is_func check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ type -t check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 0 -ne 0 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check -h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _rootdev Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n -h ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for_each_host_dev_and_slaves is_mpath Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _func=is_mpath Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _dev Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for _dev in "${host_devs[@]}" Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + continue Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 1 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _ret=255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + ret=255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ 255 != 0 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n 1 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 1 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _mod=90qemu Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _mod=qemu Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check_module qemu 1 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _mod=qemu Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddep Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n 1 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all = all ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + module_check qemu Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _forced=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 1 -eq 2 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + is_func check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ type -t check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 0 -ne 0 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check -h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n -h ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + type -P systemd-detect-virt Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ systemd-detect-virt --vm Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + vm=none Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + (( 1 != 0 )) Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _ret=255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + ret=255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ 255 != 0 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n 1 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 1 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _mod=90qemu-net Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _mod=qemu-net Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check_module qemu-net 1 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _mod=qemu-net Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddep Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n 1 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all = all ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + module_check qemu-net Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _forced=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 1 -eq 2 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + is_func check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ type -t check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 0 -ne 0 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check -h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n -h ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + type -P systemd-detect-virt Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ systemd-detect-virt --vm Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + vm= Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + (( 1 != 0 )) Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _ret=255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + ret=255 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ 255 != 0 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n 1 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + return 1 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _mod=90stratis Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + _mod=stratis Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check_module stratis 1 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _mod=stratis Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddep Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -n 1 ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ all = all ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + module_check stratis Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ read a b Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _forced=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _hostonly=-h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 1 -eq 2 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + is_func check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: ++ type -t check Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + '[' 0 -ne 0 ']' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + check -h Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _module_name=90stratis Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + local _ret=0 Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + [[ stratisd-init = \-\m ]] Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + for cmd in "$@" Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + find_binary stratisd-init Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 4 23:32:36 kjcf05n02 kdumpctl[7887]: + set +x Nov 4 23:32:36 kjcf05n02 dracut[8001]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 23:32:36 kjcf05n02 dracut[8001]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 4 23:32:36 kjcf05n02 dracut[8001]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 4 23:32:36 kjcf05n02 dracut[8001]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 4 23:32:37 kjcf05n02 dracut[8001]: memstrack is available Nov 4 23:32:37 kjcf05n02 dracut[8001]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 4 23:32:37 kjcf05n02 dracut[8001]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 4 23:32:37 kjcf05n02 dracut[8001]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 4 23:32:37 kjcf05n02 dracut[8001]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 4 23:32:37 kjcf05n02 dracut[8001]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 4 23:32:37 kjcf05n02 dracut[8001]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 4 23:32:37 kjcf05n02 dracut[8001]: *** Including module: bash *** Nov 4 23:32:37 kjcf05n02 dracut[8001]: *** Including module: systemd *** Nov 4 23:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 4 23:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 4 23:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 4 23:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 4 23:32:37 kjcf05n03 LCNmon[17896]: 10.16.100.52 is unreachable via ib1 Nov 4 23:32:37 kjcf05n03 LCNmon[17896]: 10.16.100.58 is unreachable via ib1 Nov 4 23:32:38 kjcf05n02 dracut[8001]: *** Including module: fips *** Nov 4 23:32:38 kjcf05n02 dracut[8001]: *** Including module: systemd-initrd *** Nov 4 23:32:38 kjcf05n02 dracut[8001]: *** Including module: watchdog-modules *** Nov 4 23:32:38 kjcf05n02 dracut[8001]: *** Including module: nss-softokn *** Nov 4 23:32:38 kjcf05n02 dracut[8001]: *** Including module: i18n *** Nov 4 23:32:38 kjcf05n02 dracut[8001]: No KEYMAP configured. Nov 4 23:32:38 kjcf05n02 dracut[8001]: *** Including module: network-legacy *** Nov 4 23:32:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730784758', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 4 23:32:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730784758', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 4 23:32:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730784758'} Nov 4 23:32:38 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730784758'} Nov 4 23:32:38 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:32:39 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 23:32:39 kjcf05n02 dracut[8001]: *** Including module: network *** Nov 4 23:32:39 kjcf05n02 dracut[8001]: *** Including module: ib_bonding *** Nov 4 23:32:39 kjcf05n02 dracut[8001]: *** Including module: drm *** Nov 4 23:32:42 kjcf05n02 dracut[8001]: *** Including module: hperaid *** Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + install Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + local rule rule_path Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + inst_multiple cat expr Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.U3faZO/initramfs -a -f cat expr Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + _ret=0 Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + (( 0 != 0 )) Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + : Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + return 0 Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + inst_multiple -o mdmon Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.U3faZO/initramfs -a -f -o mdmon Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + _ret=0 Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + (( 0 != 0 )) Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + : Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + return 0 Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: ++ command -v partx Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + inst /usr/sbin/partx /sbin/partx Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + local _hostonly_install Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + [[ /usr/sbin/partx == \-\H ]] Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + [[ -e /tmp/dracut.U3faZO/initramfs//sbin/partx ]] Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.U3faZO/initramfs -f /usr/sbin/partx /sbin/partx Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + (( 0 != 0 )) Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + : Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: ++ command -v mdadm Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + local _hostonly_install Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + [[ -e /tmp/dracut.U3faZO/initramfs//sbin/mdadm ]] Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.U3faZO/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + (( 0 != 0 )) Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + : Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + [[ yes == \y\e\s ]] Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + local _raidconf Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: ++ cmdline Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: ++ local _activated dev line UUID Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: ++ declare -A _activated Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: ++ for dev in "${!host_fs_types[@]}" Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: ++ [[ nfs != *_raid_member ]] Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: ++ continue Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + _raidconf= Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + [[ -n '' ]] Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + inst_rules 64-md-raid.rules Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + local _target=/etc/udev/rules.d _rule _found Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + inst_dir /usr/lib/udev/rules.d Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + [[ -e /tmp/dracut.U3faZO/initramfs//usr/lib/udev/rules.d ]] Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + return 0 Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + inst_dir /etc/udev/rules.d Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + [[ -e /tmp/dracut.U3faZO/initramfs//etc/udev/rules.d ]] Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + return 0 Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + for _rule in "$@" Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + continue Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + continue Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + for r in '' $dracutbasedir/rules.d/ Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + [[ 64-md-raid.rules != /* ]] Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + continue Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + for r in '' $dracutbasedir/rules.d/ Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + continue Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + [[ -n '' ]] Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 4 23:32:42 kjcf05n02 kdumpctl[7887]: + set +x Nov 4 23:32:42 kjcf05n02 dracut[8001]: Skipping udev rule: 64-md-raid.rules Nov 4 23:32:42 kjcf05n02 dcs-collectord[5695]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 23:32:43 kjcf05n02 dcs-collectord[5695]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + installkernel Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + instmods =drivers/md Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + local _optional=-o Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + local _silent Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + local _ret Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + [[ '' = yes ]] Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + [[ =drivers/md = \-\c ]] Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + [[ =drivers/md = \-\s ]] Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + (( 1 == 0 )) Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.U3faZO/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + _ret=0 Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + (( 0 != 0 )) Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + [[ -n '' ]] Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + return 0 Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + _ret=0 Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + unset check depends cmdline install installkernel Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + return 0 Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + modules_loaded+='hperaid ' Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + '[' -n '' ']' Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + _d_mod=90kernel-modules Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + _d_mod=kernel-modules Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + [[ '' = yes ]] Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + dinfo '*** Including module: kernel-modules ***' Nov 4 23:32:43 kjcf05n02 kdumpctl[7887]: + set +x Nov 4 23:32:43 kjcf05n02 dracut[8001]: *** Including module: kernel-modules *** Nov 4 23:32:43 kjcf05n02 dracut[8001]: *** Including module: kernel-modules-extra *** Nov 4 23:32:43 kjcf05n02 dracut[8001]: *** Including module: kernel-network-modules *** Nov 4 23:32:43 kjcf05n02 dracut[8001]: *** Including module: diskless-mod *** Nov 4 23:32:44 kjcf05n02 dracut[8001]: *** Including module: fstab-sys *** Nov 4 23:32:44 kjcf05n02 dracut[8001]: *** Including module: nfs *** Nov 4 23:32:44 kjcf05n02 dracut[8001]: *** Including module: rootfs-block *** Nov 4 23:32:44 kjcf05n02 dracut[8001]: *** Including module: terminfo *** Nov 4 23:32:44 kjcf05n02 dracut[8001]: *** Including module: udev-rules *** Nov 4 23:32:44 kjcf05n02 dracut[8001]: Skipping udev rule: 91-permissions.rules Nov 4 23:32:44 kjcf05n02 dracut[8001]: Skipping udev rule: 80-drivers-modprobe.rules Nov 4 23:32:44 kjcf05n02 dracut[8001]: *** Including module: dracut-systemd *** Nov 4 23:32:45 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 4 23:32:45 kjcf05n02 dracut[8001]: *** Including module: usrmount *** Nov 4 23:32:45 kjcf05n02 dracut[8001]: *** Including module: base *** Nov 4 23:32:45 kjcf05n02 dracut[8001]: *** Including module: fs-lib *** Nov 4 23:32:45 kjcf05n02 dracut[8001]: *** Including module: kdumpbase *** Nov 4 23:32:45 kjcf05n00 zabbix-server[2543716]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:32:45 kjcf05n00 zabbix-server[2543716]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 220.73\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 185.65\\"}}"' Nov 4 23:32:45 kjcf05n00 log_interesting_event.py[2543716]: Event '46829' acknowledged Nov 4 23:32:46 kjcf05n02 dracut[8001]: *** Including module: memstrack *** Nov 4 23:32:46 kjcf05n02 dracut[8001]: *** Including module: shutdown *** Nov 4 23:32:46 kjcf05n02 dracut[8001]: *** Including module: squash *** Nov 4 23:32:46 kjcf05n02 dracut[8001]: *** Including modules done *** Nov 4 23:32:46 kjcf05n02 dracut[8001]: *** Installing kernel module dependencies *** Nov 4 23:32:46 kjcf05n02 dracut[8001]: *** Installing kernel module dependencies done *** Nov 4 23:32:47 kjcf05n02 dracut[8001]: *** Resolving executable dependencies *** Nov 4 23:32:48 kjcf05n02 dracut[8001]: *** Resolving executable dependencies done*** Nov 4 23:32:48 kjcf05n02 dracut[8001]: *** Hardlinking files *** Nov 4 23:32:48 kjcf05n02 dracut[8001]: *** Hardlinking files done *** Nov 4 23:32:48 kjcf05n02 dracut[8001]: *** Generating early-microcode cpio image *** Nov 4 23:32:48 kjcf05n02 dracut[8001]: *** Constructing AuthenticAMD.bin **** Nov 4 23:32:48 kjcf05n02 dracut[8001]: *** Store current command line parameters *** Nov 4 23:32:48 kjcf05n02 dracut[8001]: Stored kernel commandline: Nov 4 23:32:48 kjcf05n02 dracut[8001]: rd.driver.pre=sd_mod Nov 4 23:32:48 kjcf05n02 dracut[8001]: rd.driver.pre=nvme Nov 4 23:32:48 kjcf05n02 dracut[8001]: rd.driver.pre=ipmi_si Nov 4 23:32:48 kjcf05n02 dracut[8001]: rd.driver.pre=ipmi_devintf Nov 4 23:32:48 kjcf05n02 dracut[8001]: rd.driver.pre=ipmi_msghandler Nov 4 23:32:48 kjcf05n02 dracut[8001]: nameserver=172.16.2.2 Nov 4 23:32:48 kjcf05n02 dracut[8001]: nameserver=127.0.0.1 Nov 4 23:32:48 kjcf05n02 dracut[8001]: nameserver=172.16.2.2 Nov 4 23:32:48 kjcf05n02 dracut[8001]: nameserver=127.0.0.1 Nov 4 23:32:48 kjcf05n02 dracut[8001]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 4 23:32:48 kjcf05n02 dracut[8001]: rd.neednet Nov 4 23:32:48 kjcf05n02 dracut[8001]: kdumpnic=mgmt0 Nov 4 23:32:48 kjcf05n02 dracut[8001]: bootdev=mgmt0 Nov 4 23:32:48 kjcf05n02 dracut[8001]: *** Install squash loader *** Nov 4 23:32:48 kjcf05n02 dracut[8001]: *** Squashing the files inside the initramfs *** Nov 4 23:32:48 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 4 23:32:49 kjcf05n02 dracut[8001]: *** Squashing the files inside the initramfs done *** Nov 4 23:32:49 kjcf05n02 dracut[8001]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 4 23:32:49 kjcf05n02 dracut[8001]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 4 23:32:49 kjcf05n02 kdumpctl[7887]: kdump: kexec: loaded kdump kernel Nov 4 23:32:49 kjcf05n02 kdumpctl[7887]: kdump: Starting kdump: [OK] Nov 4 23:32:49 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 4 23:32:49 kjcf05n02 systemd[1]: Reloading. Nov 4 23:32:50 kjcf05n02 systemd[3231]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:32:50 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:32:50 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:32:50 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 4 23:32:50 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 4 23:32:50 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 4 23:32:50 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 4 23:32:50 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 4 23:32:50 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 4 23:32:50 kjcf05n02 ifdown[14590]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 23:32:50 kjcf05n02 ifdown[14592]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:32:50 kjcf05n02 ifdown[14593]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:32:50 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 23:32:50 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 23:32:50 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 23:32:50 kjcf05n02 ifup[14653]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 23:32:50 kjcf05n02 ifup[14654]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:32:50 kjcf05n02 ifup[14655]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:32:51 kjcf05n00 zabbix-server[2543724]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:32:51 kjcf05n00 zabbix-server[2543724]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:51\\"}}"' Nov 4 23:32:51 kjcf05n00 log_interesting_event.py[2543724]: Event '46830' acknowledged Nov 4 23:32:52 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 4 23:32:51 kjcf05n00 zabbix-server[2543725]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:32:51 kjcf05n00 zabbix-server[2543725]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 4 23:32:52 kjcf05n00 log_interesting_event.py[2543725]: Event '46831' acknowledged Nov 4 23:32:52 kjcf05n00 zabbix-server[2543726]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:32:52 kjcf05n00 zabbix-server[2543726]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 4 23:32:52 kjcf05n00 log_interesting_event.py[2543726]: Event '46832' acknowledged Nov 4 23:32:53 kjcf05n00 mcfcli[3673891]: %3|1730784773.601|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 23:32:54 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 4 23:32:55 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 23:32:55 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 23:32:55 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:32:55 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:32:55 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:32:55 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:32:55 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 23:32:55 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 23:32:55 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 23:32:55 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 23:32:55 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:32:55 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:32:55 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:32:55 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:32:55 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 4 23:32:55 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 4 23:32:55 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 4 23:32:55 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 4 23:32:55 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 4 23:32:55 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 4 23:32:55 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 4 23:32:55 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 4 23:32:55 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 4 23:32:55 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 4 23:32:55 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 4 23:32:55 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 4 23:32:55 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 4 23:32:55 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 4 23:32:55 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 4 23:32:55 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 4 23:32:55 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 4 23:32:55 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 4 23:32:55 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 4 23:32:55 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 4 23:32:55 kjcf05n02 ifdown[14841]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 23:32:55 kjcf05n02 ifdown[14843]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:32:55 kjcf05n02 ifdown[14844]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:32:55 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 4 23:32:55 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 4 23:32:55 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 23:32:55 kjcf05n02 ifup[14904]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 23:32:55 kjcf05n02 ifup[14905]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:32:55 kjcf05n02 ifup[14906]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 4 23:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 4 23:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 4 23:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 4 23:32:58 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 4 23:32:58 kjcf05n02 dcs-collectord[5695]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 23:32:58 kjcf05n02 dcs-collectord[5695]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 23:32:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730784779', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(1512.0B/656.0B), ib1=(392.0B/240.0B), icl0=(4.8kB/6.6kB), lo=(600.0B/600.0B), meth0=(1541.0MB/7.8MB), mgmt0=(1477.7MB/7.8MB)'}"] Nov 4 23:32:59 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(1512.0B/656.0B), ib1=(392.0B/240.0B), icl0=(4.8kB/6.6kB), lo=(600.0B/600.0B), meth0=(1541.0MB/7.8MB), mgmt0=(1477.7MB/7.8MB)', 'message': 'NET OK - (Rx/Tx) ib0=(1512.0B/656.0B), ib1=(392.0B/240.0B), icl0=(4.8kB/6.6kB), lo=(600.0B/600.0B), meth0=(1541.0MB/7.8MB), mgmt0=(1477.7MB/7.8MB)', 'value': 'ok', 'timestamp': '1730784779'} Nov 4 23:32:59 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:32:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 4 23:32:59 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 4 23:32:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 4 23:33:00 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 23:33:00 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 4 23:33:00 kjcf05n02 systemd[1]: Reloading. Nov 4 23:33:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730784780', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 4 23:33:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730784780'} Nov 4 23:33:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:33:00 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 4 23:33:00 kjcf05n02 await_ha_peer[15135]: Waiting for HA peer kjcf05n03 Nov 4 23:33:01 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 4 23:33:01 kjcf05n02 await_ha_peer[15135]: Peer kjcf05n03 has started, starting HA Nov 4 23:33:02 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 4 23:33:02 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 4 23:33:02 kjcf05n02 fstonithd.py[15175]: Listening for kdump packets from partner Nov 4 23:33:02 kjcf05n02 systemd[1]: Reloading. Nov 4 23:33:02 kjcf05n02 systemd[3231]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:33:02 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:33:02 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:33:02 kjcf05n02 systemd[1]: Reloading. Nov 4 23:33:02 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 4 23:33:02 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 4 23:33:02 kjcf05n02 systemd[1]: Reloading. Nov 4 23:33:03 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 23:33:03 kjcf05n02 puppet-agent[3622]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 4 23:33:03 kjcf05n02 puppet[3622]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 4 23:33:03 kjcf05n02 puppet-agent[3622]: Applied catalog in 91.07 seconds Nov 4 23:33:03 kjcf05n02 puppet[3622]: Notice: Applied catalog in 91.07 seconds Nov 4 23:33:03 kjcf05n02 systemd[1]: Started Puppet agent. Nov 4 23:33:03 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 4 23:33:03 kjcf05n02 systemd[1]: Reached target Timers. Nov 4 23:33:03 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 4 23:33:03 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 4 23:33:03 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 4 23:33:03 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 4 23:33:03 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 4 23:33:03 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 4 23:33:03 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 4 23:33:03 kjcf05n02 wce-disable.sh[15335]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 4 23:33:03 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 4 23:33:03 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 4 23:33:03 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 4 23:33:03 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 4 23:33:03 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 4 23:33:03 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 4 23:33:04 kjcf05n02 python3.9[15339]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 4 23:33:04 kjcf05n02 python3.9[15339]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 4 23:33:04 kjcf05n02 gateway-ec-node.py[15338]: Starting gateway-ec-node service Nov 4 23:33:04 kjcf05n02 RFSF-API[15337]: INFO[2024-11-04T23:33:03-06:00] Datapath API RESTful Service starting Nov 4 23:33:04 kjcf05n02 dp-api-server-node[15337]: INFO[2024-11-04T23:33:03-06:00] Datapath API RESTful Service starting Nov 4 23:33:04 kjcf05n02 RFSF-API[15337]: INFO[2024-11-04T23:33:03-06:00] Running in production mode, starting dbus event listener Nov 4 23:33:04 kjcf05n02 dp-api-server-node[15337]: INFO[2024-11-04T23:33:03-06:00] Running in production mode, starting dbus event listener Nov 4 23:33:04 kjcf05n02 RFSF-API[15337]: INFO[2024-11-04T23:33:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 23:33:04 kjcf05n02 dp-api-server-node[15337]: INFO[2024-11-04T23:33:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 4 23:33:04 kjcf05n02 RFSF-API[15337]: INFO[2024-11-04T23:33:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 23:33:04 kjcf05n02 dp-api-server-node[15337]: INFO[2024-11-04T23:33:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 4 23:33:04 kjcf05n02 RFSF-API[15337]: INFO[2024-11-04T23:33:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 23:33:04 kjcf05n02 dp-api-server-node[15337]: INFO[2024-11-04T23:33:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 4 23:33:04 kjcf05n02 RFSF-API[15337]: INFO[2024-11-04T23:33:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 23:33:04 kjcf05n02 dp-api-server-node[15337]: INFO[2024-11-04T23:33:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 4 23:33:04 kjcf05n02 RFSF-API[15337]: INFO[2024-11-04T23:33:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 23:33:04 kjcf05n02 dp-api-server-node[15337]: INFO[2024-11-04T23:33:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 4 23:33:04 kjcf05n02 RFSF-API[15337]: INFO[2024-11-04T23:33:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 23:33:04 kjcf05n02 dp-api-server-node[15337]: INFO[2024-11-04T23:33:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 4 23:33:04 kjcf05n02 RFSF-API[15337]: INFO[2024-11-04T23:33:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 23:33:04 kjcf05n02 dp-api-server-node[15337]: INFO[2024-11-04T23:33:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 4 23:33:04 kjcf05n02 RFSF-API[15337]: INFO[2024-11-04T23:33:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 23:33:04 kjcf05n02 dp-api-server-node[15337]: INFO[2024-11-04T23:33:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 4 23:33:04 kjcf05n02 RFSF-API[15337]: INFO[2024-11-04T23:33:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 23:33:04 kjcf05n02 dp-api-server-node[15337]: INFO[2024-11-04T23:33:03-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 4 23:33:04 kjcf05n02 RFSF-API[15337]: INFO[2024-11-04T23:33:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 23:33:04 kjcf05n02 dp-api-server-node[15337]: INFO[2024-11-04T23:33:03-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 4 23:33:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730784785', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.91, 1.93, 0.87'}"] Nov 4 23:33:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 1.91, 1.93, 0.87', 'message': 'OK - load average: 1.91, 1.93, 0.87', 'value': 'ok', 'timestamp': '1730784785'} Nov 4 23:33:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:33:07 kjcf05n00 mcfcli[3673891]: %3|1730784787.505|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:33:09 kjcf05n02 systemd[1]: Reloading. Nov 4 23:33:09 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 4 23:33:09 kjcf05n02 systemd[1]: Reloading. Nov 4 23:33:09 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 4 23:33:10 kjcf05n02 diskmonitor_pre[15772]: Key management is currently disabled.DEAR disabled Nov 4 23:33:10 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 4 23:33:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730784789', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 348 processes with STATE = RSZDT '}"] Nov 4 23:33:09 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 348 processes with STATE = RSZDT ', 'message': 'PROCS OK: 348 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730784789'} Nov 4 23:33:09 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:33:11 kjcf05n02 sh[15844]: LNET configured: New Created Nov 4 23:33:11 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 4 23:33:11 kjcf05n02 LCNmon[17867]: Interface ib0 is up Nov 4 23:33:11 kjcf05n02 LCNmon[17867]: Interface ib1 is up Nov 4 23:33:11 kjcf05n02 LCNmon[17867]: Can ping through interface ib0 Nov 4 23:33:13 kjcf05n02 dcs-collectord[5695]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 23:33:13 kjcf05n02 dcs-collectord[5695]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 4 23:33:13 kjcf05n02 dcs-collectord[5695]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 4 23:33:13 kjcf05n00 httpd[1812025]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: /var/run/diskmonitor does not exist, creating Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: Creating /var/run/diskmonitor/disk Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: Creating /var/run/diskmonitor/encl Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: Creating /var/run/diskmonitor/cli Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: RAS_Interlocks_enabled: 1 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: Using default ssd ids: HUSSL4010ASS600 , Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: add handler for sig: 14 sa_flags: 10000004 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: add handler for sig: 1 sa_flags: 10000004 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: add handler for sig: 2 sa_flags: 00000004 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: add handler for sig: 15 sa_flags: 00000004 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: add handler for sig: 6 sa_flags: 00000004 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: add handler for sig: 3 sa_flags: 00000004 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: add handler for sig: 30 sa_flags: 00000004 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: add handler for sig: 20 sa_flags: 00000004 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: add handler for sig: 10 sa_flags: 10000004 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: add handler for sig: 11 sa_flags: 00000004 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: add handler for sig: 7 sa_flags: 00000004 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: add handler for sig: 4 sa_flags: 00000004 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: add handler for sig: 8 sa_flags: 00000004 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: init_watch: /var/run/diskmonitor/encl initialized Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: init_watch: /var/run/diskmonitor/disk initialized Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: Using HA Baton locks - key: diskmonitor Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: Baton will be held for at most 570 seconds Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: DMMP Enabled: 0 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: random seed: 51149ca9 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: NVMe Enclosure: 1 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: ZFS Enclosure: 0 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: Dbus, Initialized Connection Successfully Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: int_catcher_thread: thread start Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: Received dbus message 4 org.freedesktop.DBus -> :1.92 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 4 23:33:14 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 23:33:14 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 4 23:33:16 kjcf05n02 LCNmon[17867]: 10.16.100.55 is unreachable via ib1 Nov 4 23:33:16 kjcf05n02 LCNmon[17867]: 10.16.100.57 is unreachable via ib1 Nov 4 23:33:16 kjcf05n02 LCNmon[17867]: 10.16.100.61 is unreachable via ib1 Nov 4 23:33:16 kjcf05n02 LCNmon[17867]: Can ping through interface ib1 Nov 4 23:33:16 kjcf05n02 LCNmon[17867]: NIC ib0, initial state UP Nov 4 23:33:16 kjcf05n02 LCNmon[17867]: NIC ib1, initial state UP Nov 4 23:33:16 kjcf05n02 LCNmon[17867]: LCNstat initial state UP Nov 4 23:33:16 kjcf05n02 LCNmon[17867]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 4 23:33:17 kjcf05n02 openhpid[5601]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 4 23:33:17 kjcf05n02 openhpid[5601]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 4 23:33:17 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 4 23:33:17 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 4 23:33:17 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 4 23:33:17 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18514 which is not our child. We'll most likely not notice when it exits. Nov 4 23:33:17 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 4 23:33:17 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 4 23:33:17 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 4 23:33:17 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 4 23:33:17 kjcf05n02 dcs-collectord[5695]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 4 23:33:17 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 4 23:33:17 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 4 23:33:17 kjcf05n02 systemd[1]: Startup finished in 50.101s (kernel) + 2min 28.378s (userspace) = 3min 18.480s. Nov 4 23:33:17 kjcf05n02 openhpid[18514]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 4 23:33:17 kjcf05n02 openhpid[18514]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 4 23:33:17 kjcf05n02 openhpid[18514]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 4 23:33:17 kjcf05n02 openhpid[18514]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: check_run_sedcmd, No Device name provided Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 4 23:33:18 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 4 23:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730784799', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.7% (4371164 kB) used.'}"] Nov 4 23:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.7% (4371164 kB) used.', 'message': 'OK - 1.7% (4371164 kB) used.', 'value': 'ok', 'timestamp': '1730784799'} Nov 4 23:33:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:33:21 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18812 (bash) Nov 4 23:33:21 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 4 23:33:21 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 4 23:33:21 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 4 23:33:21 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 4 23:33:21 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 4 23:33:23 kjcf05n00 mcfcli[3673891]: %3|1730784803.601|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 23:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T23:33:27.25358588-06:00 level=info msg="Completed cleanup jobs" duration=26.488041ms Nov 4 23:33:28 kjcf05n02 dcs-collectord[5695]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 23:33:28 kjcf05n02 dcs-collectord[5695]: WARNING No data collected (hpi_parser.py:353) Nov 4 23:33:42 kjcf05n02 ipmievd[4036]: System Event sensor - Timestamp Clock Sync Nov 4 23:33:43 kjcf05n02 ipmievd[3231]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:33:43 kjcf05n02 dcs-collectord[5695]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 23:33:47 kjcf05n00 mcfcli[3673891]: %3|1730784827.502|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:33:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730784830', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 4 23:33:50 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730784830'} Nov 4 23:33:50 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 4 23:33:52 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 4 23:33:53 kjcf05n00 mcfcli[3673891]: %3|1730784833.601|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:33:58 kjcf05n02 dcs-collectord[5695]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 4 23:34:00 kjcf05n03 firmware-update-orc-server[5841]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "a0d80361-00f7-4126-a6eb-ac8245343308"} (logger.py:65) Nov 4 23:34:00 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 308674 (get_disk_device) Nov 4 23:34:00 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 4 23:34:00 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 4 23:34:00 kjcf05n03 ccp-client[308697]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 23:34:00 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drIEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 23:34:00 kjcf05n02 ras-resource-manager-agent[5959]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "8f277394-9b37-11ef-af6d-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 4 23:34:00 kjcf05n02 ras-resource-manager-agent[5959]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '8f277394-9b37-11ef-af6d-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 4 23:34:00 kjcf05n02 ras-resource-manager-agent[5959]: INFO Submitting new device inserted signal, starting to qualify drive: 8f277394-9b37-11ef-af6d-00093d0695e3 (admin_action.py:110) Nov 4 23:33:59 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '8f277394-9b37-11ef-af6d-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 23:33:59 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '8f277394-9b37-11ef-af6d-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 4 23:33:59 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '8f277394-9b37-11ef-af6d-00093d0695e3', 'response ID': '8f322cb2-9b37-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 23:33:59 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 8f322cb2-9b37-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 23:34:00 kjcf05n03 ccp-client[308697]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 23:34:00 kjcf05n03 ccp-client[308707]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 23:34:00 kjcf05n03 ccp-client[308697]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 23:34:00 kjcf05n03 ccp-client[308707]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 23:34:00 kjcf05n03 ccp-client[308707]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 23:34:00 kjcf05n03 ccp-client[308697]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 23:34:00 kjcf05n02 diskmonitor[17460]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 23:34:00 kjcf05n02 ras-resource-manager-agent[5959]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "8f75b93c-9b37-11ef-af6d-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 4 23:34:00 kjcf05n02 ras-resource-manager-agent[5959]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '8f75b93c-9b37-11ef-af6d-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 4 23:34:00 kjcf05n02 ras-resource-manager-agent[5959]: INFO Submitting new device inserted signal, starting to qualify drive: 8f75b93c-9b37-11ef-af6d-00093d0695e3 (admin_action.py:110) Nov 4 23:34:00 kjcf05n02 firmware-update-orc-server[5915]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "0a9bcc5b-eb76-4e33-9e85-eaf90836f8aa"} (logger.py:65) Nov 4 23:34:00 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '8f75b93c-9b37-11ef-af6d-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 23:34:00 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '8f75b93c-9b37-11ef-af6d-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 4 23:34:00 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '8f75b93c-9b37-11ef-af6d-00093d0695e3', 'response ID': '8f7d82de-9b37-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 4 23:34:00 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 8f7d82de-9b37-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 23:34:03 kjcf05n03 DRVFW[308819]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 23:34:03 kjcf05n03 ccp-client[308820]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 23:34:03 kjcf05n03 ccp-client[308820]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 23:34:03 kjcf05n03 ccp-client[308820]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 23:34:03 kjcf05n03 ccp-client[308829]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 23:34:03 kjcf05n03 ccp-client[308820]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 23:34:03 kjcf05n03 ccp-client[308829]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 23:34:03 kjcf05n03 ccp-client[308829]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 23:34:03 kjcf05n03 firmware-update-orc-server[5841]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 4 23:34:04 kjcf05n02 ras-resource-manager-agent[5959]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '8f277394-9b37-11ef-af6d-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 4 23:34:04 kjcf05n02 ras-resource-manager-agent[5959]: INFO Drive qualification complete responding: 8f277394-9b37-11ef-af6d-00093d0695e3 (admin_action.py:205) Nov 4 23:34:04 kjcf05n02 ras-resource-manager-agent[5959]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "8f277394-9b37-11ef-af6d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (interesting_event.py:59) Nov 4 23:34:03 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 8f322cb2-9b37-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 23:34:03 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '8f277394-9b37-11ef-af6d-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '8f277394-9b37-11ef-af6d-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}}} (logger.py:65) Nov 4 23:34:09 kjcf05n02 diskmonitor[17460]: ive: eui.345950304db010120025384500000004 Nov 4 23:34:09 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 4 23:34:09 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 4 23:34:09 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 4 23:34:09 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 4 23:34:09 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 4 23:34:09 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 4 23:34:09 kjcf05n02 diskmonitor[17460]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 4 23:34:09 kjcf05n02 diskmonitor[17460]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 4 23:34:09 kjcf05n02 diskmonitor[17460]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 4 23:34:09 kjcf05n02 diskmonitor[17460]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 23:34:09 kjcf05n02 diskmonitor[17460]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 4 23:34:09 kjcf05n02 diskmonitor[17460]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "8f277394-9b37-11ef-af6d-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 4 23:34:09 kjcf05n02 diskmonitor[17460]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 23:34:09 kjcf05n02 diskmonitor[17460]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 4 23:34:09 kjcf05n02 diskmonitor[17460]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "8f75b93c-9b37-11ef-af6d-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 4 23:34:09 kjcf05n02 diskmonitor[17460]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 4 23:34:09 kjcf05n02 diskmonitor[17460]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 23:34:15 kjcf05n02 chronyd[5203]: Selected source 172.16.2.1 Nov 4 23:34:15 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22432 (get_disk_device) Nov 4 23:34:15 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 4 23:34:15 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 4 23:34:16 kjcf05n02 ccp-client[22453]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 23:34:16 kjcf05n02 ccp-client[22453]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 23:34:16 kjcf05n02 ccp-client[22462]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 23:34:16 kjcf05n02 ccp-client[22453]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 23:34:16 kjcf05n02 ccp-client[22453]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 23:34:16 kjcf05n02 ccp-client[22462]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 23:34:16 kjcf05n02 ccp-client[22462]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 23:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730784857}"] Nov 4 23:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730784857, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:34:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730784857}"] Nov 4 23:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730784857, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:34:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730784857}"] Nov 4 23:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730784857, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:34:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730784857}"] Nov 4 23:34:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730784857, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:34:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:34:18 kjcf05n03 nslcd[6913]: [2dba31] ldap_result() failed: Can't contact LDAP server Nov 4 23:34:18 kjcf05n03 nslcd[6913]: [83e458] ldap_result() failed: Can't contact LDAP server Nov 4 23:34:18 kjcf05n02 ras-resource-manager-agent[5959]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "8f277394-9b37-11ef-af6d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} (service_main_handler.py:66) Nov 4 23:34:18 kjcf05n02 ras-resource-manager-agent[5959]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '8f277394-9b37-11ef-af6d-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 3}}} (resource_admin.py:98) Nov 4 23:34:18 kjcf05n02 ras-resource-manager-agent[5959]: INFO Device qualification response has been acknowledged: 8f277394-9b37-11ef-af6d-00093d0695e3 (admin_action.py:151) Nov 4 23:34:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730784857}"] Nov 4 23:34:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730784857, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:34:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:34:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730784857}"] Nov 4 23:34:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730784857, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:34:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:34:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730784857}"] Nov 4 23:34:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730784857, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:34:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:34:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730784857}"] Nov 4 23:34:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730784857, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:34:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:34:18 kjcf05n02 DRVFW[22829]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 4 23:34:19 kjcf05n02 ccp-client[22830]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 4 23:34:19 kjcf05n02 ccp-client[22830]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 4 23:34:19 kjcf05n02 ccp-client[22875]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 4 23:34:19 kjcf05n02 ccp-client[22830]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 4 23:34:19 kjcf05n02 ccp-client[22830]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 4 23:34:19 kjcf05n02 ccp-client[22875]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 4 23:34:19 kjcf05n02 ccp-client[22875]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 4 23:34:19 kjcf05n02 firmware-update-orc-server[5915]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 4 23:34:20 kjcf05n02 ras-resource-manager-agent[5959]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '8f75b93c-9b37-11ef-af6d-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 4 23:34:20 kjcf05n02 ras-resource-manager-agent[5959]: INFO Drive qualification complete responding: 8f75b93c-9b37-11ef-af6d-00093d0695e3 (admin_action.py:205) Nov 4 23:34:20 kjcf05n02 ras-resource-manager-agent[5959]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "8f75b93c-9b37-11ef-af6d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 4 23:34:20 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 8f7d82de-9b37-11ef-acfe-00093d0696a6 (logger.py:65) Nov 4 23:34:20 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '8f75b93c-9b37-11ef-af6d-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '8f75b93c-9b37-11ef-af6d-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}}} (logger.py:65) Nov 4 23:34:22 kjcf05n02 python3.9[5265]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 4 23:34:22 kjcf05n02 python3.9[3231]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:34:22 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 4 23:34:22 kjcf05n02 diskmonitor[17460]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 23:34:22 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 4 23:34:22 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 4 23:34:23 kjcf05n02 diskmonitor[17460]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 23:34:23 kjcf05n02 ras-resource-manager-agent[5959]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "9cacc708-9b37-11ef-af6d-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 4 23:34:23 kjcf05n02 ras-resource-manager-agent[5959]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '9cacc708-9b37-11ef-af6d-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 4 23:34:23 kjcf05n02 ras-resource-manager-agent[5959]: INFO Requests ['8f75b93c-9b37-11ef-af6d-00093d0695e3', '9cacc708-9b37-11ef-af6d-00093d0695e3'] already in progress (admin_action.py:99) Nov 4 23:34:23 kjcf05n02 ras-resource-manager-agent[5959]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '9cacc708-9b37-11ef-af6d-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 4 23:34:23 kjcf05n02 ras-resource-manager-agent[5959]: INFO Drive qualification complete responding: 9cacc708-9b37-11ef-af6d-00093d0695e3 (admin_action.py:205) Nov 4 23:34:23 kjcf05n02 ras-resource-manager-agent[5959]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "8f75b93c-9b37-11ef-af6d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 4 23:34:23 kjcf05n02 ras-resource-manager-agent[5959]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "9cacc708-9b37-11ef-af6d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (interesting_event.py:59) Nov 4 23:34:23 kjcf05n00 mcfcli[3673891]: %3|1730784863.601|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:34:24 kjcf05n00 mcfcli[3673891]: %3|1730784864.787|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "8f277394-9b37-11ef-af6d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: Dbus, handle_ingress_ras_signals, uuid: 8f277394-9b37-11ef-af6d-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "8f277394-9b37-11ef-af6d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 3}}} Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: main: Pending firmware leveling requests exist, rescanning disks Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "9cacc708-9b37-11ef-af6d-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: leaving test state: 1 next state: 2 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: lock req: no timeout Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: leaving test state: 2 next state: 4 Nov 4 23:34:27 kjcf05n02 diskmonitor[17460]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 23:34:32 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31478 deleted. Nov 4 23:34:32 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31479 deleted. Nov 4 23:34:48 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 4 23:34:53 kjcf05n00 mcfcli[3673891]: %3|1730784893.602|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 23:35:02 kjcf05n00 mcfcli[3673891]: %3|1730784902.258|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:35:21 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 4 23:35:21 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 23:35:21 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 4 23:35:22 kjcf05n02 ras-resource-manager-agent[5959]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "8f75b93c-9b37-11ef-af6d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 4 23:35:22 kjcf05n02 ras-resource-manager-agent[5959]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '8f75b93c-9b37-11ef-af6d-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 4 23:35:22 kjcf05n02 ras-resource-manager-agent[5959]: INFO Device qualification response has been acknowledged: 8f75b93c-9b37-11ef-af6d-00093d0695e3 (admin_action.py:151) Nov 4 23:35:22 kjcf05n02 ras-resource-manager-agent[5959]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "8f75b93c-9b37-11ef-af6d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 4 23:35:22 kjcf05n02 ras-resource-manager-agent[5959]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '8f75b93c-9b37-11ef-af6d-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 4 23:35:22 kjcf05n02 ras-resource-manager-agent[5959]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "9cacc708-9b37-11ef-af6d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} (service_main_handler.py:66) Nov 4 23:35:22 kjcf05n02 ras-resource-manager-agent[5959]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '9cacc708-9b37-11ef-af6d-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 19}}} (resource_admin.py:98) Nov 4 23:35:22 kjcf05n02 ras-resource-manager-agent[5959]: INFO Device qualification response has been acknowledged: 9cacc708-9b37-11ef-af6d-00093d0695e3 (admin_action.py:151) Nov 4 23:35:23 kjcf05n02 diskmonitor[17460]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 4 23:35:23 kjcf05n00 mcfcli[3673891]: %3|1730784923.602|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:35:36 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 4 23:35:36 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 4 23:35:36 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 4 23:35:39 kjcf05n02 dcs-collectord[5695]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 4 23:35:39 kjcf05n00 python3.9[2545393]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 23:35:41 kjcf05n02 diskmonitor[17460]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "8f75b93c-9b37-11ef-af6d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 4 23:35:41 kjcf05n02 diskmonitor[17460]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 4 23:35:41 kjcf05n02 diskmonitor[17460]: Dbus, handle_ingress_ras_signals, uuid: 8f75b93c-9b37-11ef-af6d-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 4 23:35:41 kjcf05n02 diskmonitor[17460]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 4 23:35:41 kjcf05n02 diskmonitor[17460]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "8f75b93c-9b37-11ef-af6d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 4 23:35:41 kjcf05n02 diskmonitor[17460]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "8f75b93c-9b37-11ef-af6d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 4 23:35:41 kjcf05n02 diskmonitor[17460]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 4 23:35:41 kjcf05n02 diskmonitor[17460]: Dbus, handle_ingress_ras_signals, uuid: 8f75b93c-9b37-11ef-af6d-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 4 23:35:41 kjcf05n02 diskmonitor[17460]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "8f75b93c-9b37-11ef-af6d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 4 23:35:41 kjcf05n02 diskmonitor[17460]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "9cacc708-9b37-11ef-af6d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 4 23:35:41 kjcf05n02 diskmonitor[17460]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 4 23:35:41 kjcf05n02 diskmonitor[17460]: Dbus, handle_ingress_ras_signals, uuid: 9cacc708-9b37-11ef-af6d-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 4 23:35:41 kjcf05n02 diskmonitor[17460]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "9cacc708-9b37-11ef-af6d-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 19}}} Nov 4 23:35:41 kjcf05n02 diskmonitor[17460]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 4 23:35:41 kjcf05n02 diskmonitor[17460]: lock acquired Nov 4 23:35:41 kjcf05n02 diskmonitor[17460]: leaving test state: 4 next state: 8 Nov 4 23:35:41 kjcf05n02 diskmonitor[17460]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 23:35:41 kjcf05n00 mcfcli[3673891]: %3|1730784941.053|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:35:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730784947}"] Nov 4 23:35:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730784947, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:35:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:35:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:35:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:35:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:35:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:35:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:35:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:35:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:35:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:35:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:35:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:35:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:35:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:35:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.887265ms Nov 4 23:35:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:35:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.887265ms Nov 4 23:35:47 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:35:47 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:35:47 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:35:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Inactive', 'timestamp': 1730784947}"] Nov 4 23:35:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730784947, 'value': 'Inactive', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:35:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:35:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:35:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:35:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:35:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:35:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:35:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:35:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:35:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:35:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:35:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:35:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:35:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:35:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.77797ms Nov 4 23:35:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:35:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.77797ms Nov 4 23:35:47 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:35:47 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:35:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730784653', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 23:35:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730784653'} Nov 4 23:35:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:35:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730784653', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 23:35:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730784653'} Nov 4 23:35:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:35:53 kjcf05n00 mcfcli[3673891]: %3|1730784953.602|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 23:35:56 kjcf05n02 diskmonitor[17460]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 4 23:35:56 kjcf05n02 diskmonitor[17460]: leaving test state: 8 next state: 20 Nov 4 23:35:56 kjcf05n02 diskmonitor[17460]: leaving test state: 20 next state: 40 Nov 4 23:35:56 kjcf05n02 diskmonitor[17460]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 2edd3960000 Nov 4 23:35:56 kjcf05n02 diskmonitor[17460]: leaving test state: 40 next state: 80 Nov 4 23:36:21 kjcf05n00 mcfcli[3673891]: %3|1730784981.050|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:36:23 kjcf05n00 mcfcli[3673891]: %3|1730784983.603|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:36:53 kjcf05n00 mcfcli[3673891]: %3|1730785013.603|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:36:59 kjcf05n02 diskmonitor[17460]: leaving test state: 80 next state: 100 Nov 4 23:36:59 kjcf05n02 diskmonitor[17460]: lock release: time: Mon Nov 4 23:36:52 2024 Nov 4 23:36:59 kjcf05n02 diskmonitor[17460]: leaving test state: 100 next state: 1 Nov 4 23:36:58 kjcf05n00 mcfcli[3673891]: %3|1730785018.879|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:37:23 kjcf05n00 mcfcli[3673891]: %3|1730785043.603|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:37:26 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 4 23:37:38 kjcf05n00 mcfcli[3673891]: %3|1730785058.876|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:37:53 kjcf05n00 mcfcli[3673891]: %3|1730785073.603|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:38:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730785097}"] Nov 4 23:38:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730785097, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:38:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:38:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:38:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:38:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:38:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:38:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:38:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:38:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:38:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:38:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:38:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:38:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:38:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:38:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.156549ms Nov 4 23:38:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:38:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.156549ms Nov 4 23:38:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:38:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:38:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:38:18 kjcf05n00 mcfcli[3673891]: %3|1730785098.873|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:38:23 kjcf05n00 mcfcli[3673891]: %3|1730785103.604|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:38:53 kjcf05n00 mcfcli[3673891]: %3|1730785133.604|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 23:38:56 kjcf05n00 mcfcli[3673891]: %3|1730785136.567|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:39:23 kjcf05n00 mcfcli[3673891]: %3|1730785163.605|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 23:39:32 kjcf05n00 zabbix-server[2547865]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:39:32 kjcf05n00 zabbix-server[2547865]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n02' from event '46844' Nov 4 23:39:33 kjcf05n00 zabbix-server[2547865]: Host created 'enclosure_USE26000024VS001' Nov 4 23:39:33 kjcf05n00 zabbix-server[2547865]: Running puppet on 'kjcf05n02' Nov 4 23:39:35 kjcf05n02 puppet-agent[35225]: Using configured environment 'production' Nov 4 23:39:35 kjcf05n02 puppet-agent[35225]: Retrieving pluginfacts Nov 4 23:39:35 kjcf05n02 puppet-agent[35225]: Retrieving plugin Nov 4 23:39:35 kjcf05n02 puppet-agent[35225]: Loading facts Nov 4 23:39:36 kjcf05n00 mcfcli[3673891]: %3|1730785176.564|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:39:38 kjcf05n02 puppet-agent[35225]: Caching catalog for kjcf05n02 Nov 4 23:39:38 kjcf05n02 puppet-agent[35225]: Applying configuration version '1730785176' Nov 4 23:39:40 kjcf05n02 puppet-agent[35225]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 23:39:40 kjcf05n02 puppet-agent[35225]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 23:39:40 kjcf05n02 puppet-agent[35225]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 23:39:40 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 4 23:39:40 kjcf05n02 zabbix_agent2[6043]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 23:39:40 kjcf05n02 zabbix_agent2[3231]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:39:40 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 23:39:40 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 4 23:39:40 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 23:39:40 kjcf05n02 puppet-agent[35225]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: Press Ctrl+C to exit. Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: Plugin support version 1.0 Nov 4 23:39:40 kjcf05n02 zabbix_agent2[35573]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 23:39:42 kjcf05n02 puppet-agent[35225]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 23:39:42 kjcf05n02 puppet-agent[35225]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 23:39:42 kjcf05n02 puppet-agent[35225]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 23:39:42 kjcf05n02 puppet-agent[35225]: Applied catalog in 5.00 seconds Nov 4 23:39:42 kjcf05n00 zabbix-server[2547865]: puppet completed status:(0): '' Nov 4 23:39:43 kjcf05n00 zabbix-server[2547865]: Event '46844' acknowledged Nov 4 23:39:43 kjcf05n00 zabbix-server[2547865]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n02"}' Nov 4 23:39:53 kjcf05n00 mcfcli[3673891]: %3|1730785193.605|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 23:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 23:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 23:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 23:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 23:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 23:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 23:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 23:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 23:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 23:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 23:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 23:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 23:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 23:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 23:40:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 23:40:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:40:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 23:40:14 kjcf05n00 mcfcli[3673891]: %3|1730785214.942|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:40:23 kjcf05n00 mcfcli[3673891]: %3|1730785223.605|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 23:40:39 kjcf05n00 python3.9[2548295]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 23:40:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730784653', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 4 23:40:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730784653'} Nov 4 23:40:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:40:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730784653', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 4 23:40:52 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730784653'} Nov 4 23:40:52 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:40:53 kjcf05n00 mcfcli[3673891]: %3|1730785253.605|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:40:54 kjcf05n00 mcfcli[3673891]: %3|1730785254.482|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:41:23 kjcf05n00 mcfcli[3673891]: %3|1730785283.607|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:41:33 kjcf05n00 mcfcli[3673891]: %3|1730785293.922|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:41:53 kjcf05n00 mcfcli[3673891]: %3|1730785313.607|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 23:42:11 kjcf05n00 mcfcli[3673891]: %3|1730785331.439|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:42:23 kjcf05n00 mcfcli[3673891]: %3|1730785343.607|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:42:50 kjcf05n00 mcfcli[3673891]: %3|1730785370.094|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:42:53 kjcf05n00 mcfcli[3673891]: %3|1730785373.607|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 23:43:23 kjcf05n00 mcfcli[3673891]: %3|1730785403.607|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 23:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T23:43:27.268107427-06:00 level=info msg="Completed cleanup jobs" duration=41.232606ms Nov 4 23:43:28 kjcf05n00 mcfcli[3673891]: %3|1730785408.672|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:43:53 kjcf05n00 mcfcli[3673891]: %3|1730785433.608|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:43:56 kjcf05n02 root[42553]: failback_xyraid Nov 4 23:43:57 kjcf05n02 root[42669]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 4 23:43:58 kjcf05n02 root[42848]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 4 23:44:01 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 4 23:44:04 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme17n1 Nov 4 23:44:04 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme25n1 Nov 4 23:44:04 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme4n1 Nov 4 23:44:04 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme19n1 Nov 4 23:44:04 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme23n1 Nov 4 23:44:04 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme24n1 Nov 4 23:44:04 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme18n1 Nov 4 23:44:04 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme9n1 Nov 4 23:44:04 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme2n1 Nov 4 23:44:04 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme3n1 Nov 4 23:44:04 kjcf05n03 dwd[5162]: Drive path is missing, purging: nvme8n1 Nov 4 23:44:05 kjcf05n00 mcfcli[3673891]: %3|1730785445.783|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:44:06 kjcf05n02 dwd[5236]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 4 23:44:06 kjcf05n02 dwd[5236]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 4 23:44:06 kjcf05n02 dwd[5236]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 4 23:44:06 kjcf05n02 dwd[5236]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 4 23:44:06 kjcf05n02 dwd[5236]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 4 23:44:06 kjcf05n02 dwd[5236]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 4 23:44:06 kjcf05n02 dwd[5236]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 4 23:44:06 kjcf05n02 dwd[5236]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 4 23:44:06 kjcf05n02 dwd[5236]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 4 23:44:06 kjcf05n02 dwd[5236]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 4 23:44:06 kjcf05n02 dwd[5236]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 4 23:44:06 kjcf05n02 dwd[5236]: Starting NVME thread for nvme2n1 Nov 4 23:44:06 kjcf05n02 dwd[5236]: Starting NVME thread for nvme18n1 Nov 4 23:44:06 kjcf05n02 dwd[5236]: Starting NVME thread for nvme19n1 Nov 4 23:44:07 kjcf05n02 dwd[5236]: Starting NVME thread for nvme9n1 Nov 4 23:44:07 kjcf05n02 systemd-udevd[45618]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45619]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45621]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45623]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45618]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45619]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45621]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45623]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45618]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45619]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45621]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45623]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45618]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45619]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45621]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45623]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45618]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45619]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45623]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45621]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45618]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45619]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45643]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45621]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45623]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45645]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45647]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45618]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45652]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45619]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45643]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45621]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45623]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 dwd[5236]: Starting NVME thread for nvme3n1 Nov 4 23:44:07 kjcf05n02 systemd-udevd[45618]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45645]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45652]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45619]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45643]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45621]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45647]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45618]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45652]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45652]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45618]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45652]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45619]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45621]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45645]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45652]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45619]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45618]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45652]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45621]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45618]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45618]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45618]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45652]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45618]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45652]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45618]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45652]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45618]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45618]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 systemd-udevd[45618]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:44:07 kjcf05n02 dwd[5236]: Starting NVME thread for nvme24n1 Nov 4 23:44:08 kjcf05n02 dwd[5236]: Starting NVME thread for nvme4n1 Nov 4 23:44:08 kjcf05n02 nslcd[6988]: [7b23c6] (re)loading /etc/nsswitch.conf Nov 4 23:44:08 kjcf05n02 dwd[5236]: Starting NVME thread for nvme23n1 Nov 4 23:44:08 kjcf05n02 dwd[5236]: Starting NVME thread for nvme17n1 Nov 4 23:44:08 kjcf05n02 dwd[5236]: Starting NVME thread for nvme25n1 Nov 4 23:44:08 kjcf05n02 dwd[5236]: Starting NVME thread for nvme8n1 Nov 4 23:44:10 kjcf05n02 dcs-bulk-data-sender[6250]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 141}' Nov 4 23:44:16 kjcf05n02 diskmonitor[17460]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 4 23:44:20 kjcf05n02 diskmonitor[17460]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 4 23:44:20 kjcf05n02 diskmonitor[17460]: Scan for ReadErrorMax change for md65 Nov 4 23:44:20 kjcf05n02 diskmonitor[17460]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 4 23:44:20 kjcf05n02 diskmonitor[17460]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 4 23:44:20 kjcf05n02 diskmonitor[17460]: read_saved_file: md65 no saved speed Nov 4 23:44:20 kjcf05n02 diskmonitor[17460]: reconstruction_policy: sync_action prev = current = idle - md65 Nov 4 23:44:20 kjcf05n02 diskmonitor[17460]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 23:44:23 kjcf05n00 mcfcli[3673891]: %3|1730785463.608|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:44:33 kjcf05n03 diskmonitor[17340]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 4 23:44:33 kjcf05n03 diskmonitor[17340]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 23:44:44 kjcf05n00 mcfcli[3673891]: %3|1730785484.831|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:44:48 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 48088 (bash) Nov 4 23:44:48 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 4 23:44:48 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 4 23:44:53 kjcf05n00 mcfcli[3673891]: %3|1730785493.608|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:44:59 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 4 23:44:59 kjcf05n02 systemd-tmpfiles[48542]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 23:44:59 kjcf05n02 systemd-tmpfiles[48542]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 4 23:44:59 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 4 23:44:59 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 4 23:45:22 kjcf05n00 mcfcli[3673891]: %3|1730785522.633|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:45:23 kjcf05n00 mcfcli[3673891]: %3|1730785523.608|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 23:45:40 kjcf05n00 python3.9[2551415]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 23:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730785547}"] Nov 4 23:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730785547, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.056632ms Nov 4 23:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.056632ms Nov 4 23:45:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:45:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:45:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730785547}"] Nov 4 23:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730785547, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.074446ms Nov 4 23:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.074446ms Nov 4 23:45:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:45:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:45:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730785547}"] Nov 4 23:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730785547, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.852149ms Nov 4 23:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.852149ms Nov 4 23:45:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:45:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:45:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730785547}"] Nov 4 23:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730785547, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.981511ms Nov 4 23:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.981511ms Nov 4 23:45:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:45:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:45:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730785547}"] Nov 4 23:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730785547, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.64982ms Nov 4 23:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.64982ms Nov 4 23:45:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:45:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:45:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730785547}"] Nov 4 23:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730785547, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.549976ms Nov 4 23:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.549976ms Nov 4 23:45:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:45:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:45:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730785547}"] Nov 4 23:45:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730785547, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.638849ms Nov 4 23:45:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.638849ms Nov 4 23:45:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:45:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:45:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:45:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730785547}"] Nov 4 23:45:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730785547, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:45:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.747002ms Nov 4 23:45:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.747002ms Nov 4 23:45:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:45:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:45:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:45:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730785547}"] Nov 4 23:45:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730785547, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:45:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.136702ms Nov 4 23:45:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.136702ms Nov 4 23:45:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:45:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:45:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:45:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730785547}"] Nov 4 23:45:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730785547, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:45:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.812545ms Nov 4 23:45:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.812545ms Nov 4 23:45:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:45:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:45:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:45:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730785547}"] Nov 4 23:45:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730785547, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:45:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:45:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:45:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:45:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:45:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:45:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:45:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.592552ms Nov 4 23:45:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:45:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.592552ms Nov 4 23:45:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:45:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:45:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:45:53 kjcf05n00 mcfcli[3673891]: %3|1730785553.608|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 23:45:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730785553', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 4 23:45:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730785553'} Nov 4 23:45:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:46:02 kjcf05n00 mcfcli[3673891]: %3|1730785562.567|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:46:23 kjcf05n00 mcfcli[3673891]: %3|1730785583.608|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 23:46:39 kjcf05n00 mcfcli[3673891]: %3|1730785599.774|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:46:53 kjcf05n00 mcfcli[3673891]: %3|1730785613.608|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:47:19 kjcf05n00 mcfcli[3673891]: %3|1730785639.770|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:47:23 kjcf05n00 mcfcli[3673891]: %3|1730785643.608|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:47:53 kjcf05n00 mcfcli[3673891]: %3|1730785673.609|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:47:59 kjcf05n00 mcfcli[3673891]: %3|1730785679.767|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:48:23 kjcf05n00 mcfcli[3673891]: %3|1730785703.609|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:48:39 kjcf05n00 mcfcli[3673891]: %3|1730785719.764|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:48:53 kjcf05n00 mcfcli[3673891]: %3|1730785733.609|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:49:17 kjcf05n00 mcfcli[3673891]: %3|1730785757.320|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:49:23 kjcf05n00 mcfcli[3673891]: %3|1730785763.609|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:49:33 kjcf05n02 dwd[5236]: nvme19n1 passed periodic SMART status check Nov 4 23:49:33 kjcf05n02 dwd[5236]: nvme9n1 passed periodic SMART status check Nov 4 23:49:33 kjcf05n02 dwd[5236]: nvme2n1 passed periodic SMART status check Nov 4 23:49:33 kjcf05n02 dwd[5236]: nvme4n1 passed periodic SMART status check Nov 4 23:49:33 kjcf05n02 dwd[5236]: nvme24n1 passed periodic SMART status check Nov 4 23:49:33 kjcf05n02 dwd[5236]: nvme18n1 passed periodic SMART status check Nov 4 23:49:33 kjcf05n02 dwd[5236]: nvme3n1 passed periodic SMART status check Nov 4 23:49:33 kjcf05n02 dwd[5236]: nvme23n1 passed periodic SMART status check Nov 4 23:49:34 kjcf05n02 dwd[5236]: nvme8n1 passed periodic SMART status check Nov 4 23:49:34 kjcf05n02 dwd[5236]: nvme17n1 passed periodic SMART status check Nov 4 23:49:34 kjcf05n02 dwd[5236]: nvme25n1 passed periodic SMART status check Nov 4 23:49:35 kjcf05n00 zabbix-server[2553739]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:49:35 kjcf05n00 zabbix-server[2553739]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46846' Nov 4 23:49:35 kjcf05n00 zabbix-server[2553739]: Filesystem 'kjcf05' has been mounted Nov 4 23:49:36 kjcf05n00 zabbix-server[2553739]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 4 23:49:36 kjcf05n00 zabbix-server[2553739]: Running puppet on 'None' Nov 4 23:49:37 kjcf05n02 puppet-agent[56742]: Using configured environment 'production' Nov 4 23:49:37 kjcf05n02 puppet-agent[56742]: Retrieving pluginfacts Nov 4 23:49:37 kjcf05n02 puppet-agent[56742]: Retrieving plugin Nov 4 23:49:38 kjcf05n05 puppet-agent[2820043]: Using configured environment 'production' Nov 4 23:49:38 kjcf05n05 puppet-agent[2820043]: Retrieving pluginfacts Nov 4 23:49:38 kjcf05n05 puppet-agent[2820043]: Retrieving plugin Nov 4 23:49:38 kjcf05n06 puppet-agent[2628036]: Using configured environment 'production' Nov 4 23:49:38 kjcf05n06 puppet-agent[2628036]: Retrieving pluginfacts Nov 4 23:49:38 kjcf05n06 puppet-agent[2628036]: Retrieving plugin Nov 4 23:49:38 kjcf05n04 puppet-agent[2607727]: Using configured environment 'production' Nov 4 23:49:38 kjcf05n04 puppet-agent[2607727]: Retrieving pluginfacts Nov 4 23:49:38 kjcf05n04 puppet-agent[2607727]: Retrieving plugin Nov 4 23:49:38 kjcf05n03 puppet-agent[336184]: Using configured environment 'production' Nov 4 23:49:38 kjcf05n03 puppet-agent[336184]: Retrieving pluginfacts Nov 4 23:49:38 kjcf05n03 puppet-agent[336184]: Retrieving plugin Nov 4 23:49:38 kjcf05n03 puppet-agent[336184]: Loading facts Nov 4 23:49:38 kjcf05n07 puppet-agent[2628543]: Using configured environment 'production' Nov 4 23:49:38 kjcf05n07 puppet-agent[2628543]: Retrieving pluginfacts Nov 4 23:49:38 kjcf05n07 puppet-agent[2628543]: Retrieving plugin Nov 4 23:49:38 kjcf05n02 puppet-agent[56742]: Loading facts Nov 4 23:49:38 kjcf05n06 puppet-agent[2628036]: Loading facts Nov 4 23:49:38 kjcf05n05 puppet-agent[2820043]: Loading facts Nov 4 23:49:38 kjcf05n04 puppet-agent[2607727]: Loading facts Nov 4 23:49:38 kjcf05n01 puppet-agent[3964544]: Using configured environment 'production' Nov 4 23:49:38 kjcf05n01 puppet-agent[3964544]: Retrieving pluginfacts Nov 4 23:49:38 kjcf05n01 puppet-agent[3964544]: Retrieving plugin Nov 4 23:49:38 kjcf05n07 puppet-agent[2628543]: Loading facts Nov 4 23:49:38 kjcf05n00 puppet-agent[2553810]: Using configured environment 'production' Nov 4 23:49:38 kjcf05n00 puppet-agent[2553810]: Retrieving pluginfacts Nov 4 23:49:38 kjcf05n00 puppet-agent[2553810]: Retrieving plugin Nov 4 23:49:38 kjcf05n00 puppet-agent[2553810]: Loading facts Nov 4 23:49:39 kjcf05n01 puppet-agent[3964544]: Loading facts Nov 4 23:49:41 kjcf05n02 puppet-agent[56742]: Caching catalog for kjcf05n02 Nov 4 23:49:41 kjcf05n02 puppet-agent[56742]: Applying configuration version '1730785779' Nov 4 23:49:41 kjcf05n03 puppet-agent[336184]: Caching catalog for kjcf05n03 Nov 4 23:49:41 kjcf05n03 puppet-agent[336184]: Applying configuration version '1730785779' Nov 4 23:49:40 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 4 23:49:40 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 4 23:49:41 kjcf05n07 puppet-agent[2628543]: Caching catalog for kjcf05n07 Nov 4 23:49:41 kjcf05n07 puppet-agent[2628543]: Applying configuration version '1730785780' Nov 4 23:49:41 kjcf05n06 puppet-agent[2628036]: Caching catalog for kjcf05n06 Nov 4 23:49:41 kjcf05n06 puppet-agent[2628036]: Applying configuration version '1730785780' Nov 4 23:49:42 kjcf05n01 puppet-agent[3964544]: Caching catalog for kjcf05n01 Nov 4 23:49:42 kjcf05n01 puppet-agent[3964544]: Applying configuration version '1730785780' Nov 4 23:49:42 kjcf05n00 puppet-agent[2553810]: Caching catalog for kjcf05n00 Nov 4 23:49:42 kjcf05n00 puppet-agent[2553810]: Applying configuration version '1730785780' Nov 4 23:49:43 kjcf05n02 puppet-agent[56742]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 23:49:43 kjcf05n02 puppet-agent[56742]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 23:49:43 kjcf05n02 puppet-agent[56742]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 23:49:43 kjcf05n03 puppet-agent[336184]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 23:49:43 kjcf05n03 puppet-agent[336184]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 23:49:43 kjcf05n03 puppet-agent[336184]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 23:49:43 kjcf05n07 puppet-agent[2628543]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 23:49:43 kjcf05n07 puppet-agent[2628543]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 23:49:43 kjcf05n07 puppet-agent[2628543]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 23:49:43 kjcf05n06 puppet-agent[2628036]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 23:49:43 kjcf05n06 puppet-agent[2628036]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 23:49:43 kjcf05n06 puppet-agent[2628036]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 23:49:43 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 4 23:49:43 kjcf05n02 zabbix_agent2[35573]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 23:49:43 kjcf05n02 zabbix_agent2[3231]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 4 23:49:43 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 23:49:43 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 4 23:49:43 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 4 23:49:43 kjcf05n02 puppet-agent[56742]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: Press Ctrl+C to exit. Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: Plugin support version 1.0 Nov 4 23:49:43 kjcf05n02 zabbix_agent2[57347]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 23:49:43 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 4 23:49:43 kjcf05n03 zabbix_agent2[280457]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 23:49:43 kjcf05n03 zabbix_agent2[3163]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 4 23:49:43 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 23:49:43 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 4 23:49:43 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 4 23:49:43 kjcf05n03 puppet-agent[336184]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: Press Ctrl+C to exit. Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: Plugin support version 1.0 Nov 4 23:49:43 kjcf05n03 zabbix_agent2[336529]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 4 23:49:44 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2575124]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 23:49:44 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 4 23:49:44 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 23:49:44 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 4 23:49:44 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 4 23:49:44 kjcf05n06 puppet-agent[2628036]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: Press Ctrl+C to exit. Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: Plugin support version 1.0 Nov 4 23:49:44 kjcf05n06 zabbix_agent2[2628580]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 23:49:44 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2576797]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 23:49:44 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 4 23:49:44 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 23:49:44 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 4 23:49:44 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 4 23:49:44 kjcf05n07 puppet-agent[2628543]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: Press Ctrl+C to exit. Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: Plugin support version 1.0 Nov 4 23:49:44 kjcf05n07 zabbix_agent2[2629731]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 4 23:49:45 kjcf05n02 puppet-agent[56742]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 23:49:45 kjcf05n01 puppet-agent[3964544]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 23:49:45 kjcf05n01 puppet-agent[3964544]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-23:25:59]/mode) mode changed '0755' to '0750' Nov 4 23:49:45 kjcf05n01 puppet-agent[3964544]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-23:25:59/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 4 23:49:45 kjcf05n01 puppet-agent[3964544]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-23:25:59/vmcore]/mode) mode changed '0600' to '0640' Nov 4 23:49:45 kjcf05n01 puppet-agent[3964544]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-04-23:25:59/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 4 23:49:45 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 23:49:45 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 23:49:45 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 23:49:45 kjcf05n00 puppet-agent[2553810]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 4 23:49:45 kjcf05n02 puppet-agent[56742]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 23:49:45 kjcf05n02 puppet-agent[56742]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 23:49:45 kjcf05n02 puppet-agent[56742]: Applied catalog in 4.98 seconds Nov 4 23:49:45 kjcf05n03 puppet-agent[336184]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 23:49:45 kjcf05n03 puppet-agent[336184]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 23:49:45 kjcf05n03 puppet-agent[336184]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 23:49:46 kjcf05n07 puppet-agent[2628543]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 23:49:46 kjcf05n07 puppet-agent[2628543]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 23:49:46 kjcf05n07 puppet-agent[2628543]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 23:49:46 kjcf05n07 puppet-agent[2628543]: Applied catalog in 4.78 seconds Nov 4 23:49:46 kjcf05n06 puppet-agent[2628036]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 23:49:46 kjcf05n06 puppet-agent[2628036]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 23:49:46 kjcf05n06 puppet-agent[2628036]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 23:49:46 kjcf05n06 puppet-agent[2628036]: Applied catalog in 4.70 seconds Nov 4 23:49:46 kjcf05n01 puppet-agent[3964544]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 23:49:46 kjcf05n01 puppet-agent[3964544]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 23:49:46 kjcf05n01 puppet-agent[3964544]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 23:49:46 kjcf05n03 puppet-agent[336184]: Applied catalog in 5.13 seconds Nov 4 23:49:46 kjcf05n00 puppet-agent[2553810]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 23:49:46 kjcf05n00 puppet-agent[2553810]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 23:49:46 kjcf05n00 puppet-agent[2553810]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 23:49:47 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3952741]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 23:49:47 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 4 23:49:47 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 23:49:47 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 4 23:49:47 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 4 23:49:47 kjcf05n01 puppet-agent[3964544]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: Press Ctrl+C to exit. Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: Plugin support version 1.0 Nov 4 23:49:47 kjcf05n01 zabbix_agent2[3964889]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 4 23:49:46 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2535613]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 23:49:47 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 4 23:49:46 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 23:49:46 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 4 23:49:46 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 4 23:49:46 kjcf05n00 puppet-agent[2553810]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: Press Ctrl+C to exit. Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: Plugin support version 1.0 Nov 4 23:49:46 kjcf05n00 zabbix_agent2[2554293]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 4 23:49:47 kjcf05n00 zabbix-server[2554317]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:49:47 kjcf05n00 zabbix-server[2554319]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:49:47 kjcf05n00 zabbix-server[2554330]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:49:48 kjcf05n00 zabbix-server[2554334]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:49:49 kjcf05n01 puppet-agent[3964544]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_233321.log]/mode) mode changed '0644' to '0640' Nov 4 23:49:49 kjcf05n01 puppet-agent[3964544]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241104_234448.log]/mode) mode changed '0644' to '0640' Nov 4 23:49:49 kjcf05n01 puppet-agent[3964544]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241104_234448]/mode) mode changed '0755' to '0750' Nov 4 23:49:49 kjcf05n01 puppet-agent[3964544]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241104_234448/screenlog.0]/mode) mode changed '0644' to '0640' Nov 4 23:49:48 kjcf05n00 puppet-agent[2553810]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 4 23:49:49 kjcf05n01 puppet-agent[3964544]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_233319.log]/mode) mode changed '0644' to '0640' Nov 4 23:49:49 kjcf05n01 puppet-agent[3964544]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241104_234448.log]/mode) mode changed '0644' to '0640' Nov 4 23:49:49 kjcf05n01 puppet-agent[3964544]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 23:49:49 kjcf05n01 puppet-agent[3964544]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 23:49:49 kjcf05n01 puppet-agent[3964544]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 23:49:49 kjcf05n00 puppet-agent[2553810]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 23:49:49 kjcf05n00 puppet-agent[2553810]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 23:49:49 kjcf05n00 puppet-agent[2553810]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 23:49:50 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 4 23:49:50 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 4 23:49:50 kjcf05n00 puppet-agent[2553810]: Applied catalog in 8.27 seconds Nov 4 23:49:51 kjcf05n01 puppet-agent[3964544]: Applied catalog in 8.87 seconds Nov 4 23:49:53 kjcf05n00 mcfcli[3673891]: %3|1730785793.609|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:49:56 kjcf05n00 mcfcli[3673891]: %3|1730785796.354|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 4 23:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 4 23:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 4 23:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 4 23:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 4 23:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 4 23:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 4 23:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 4 23:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 4 23:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 4 23:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 4 23:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 4 23:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 4 23:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 4 23:50:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 4 23:50:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 4 23:50:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 4 23:50:17 kjcf05n04 puppet-agent[2607727]: Caching catalog for kjcf05n04 Nov 4 23:50:17 kjcf05n04 puppet-agent[2607727]: Applying configuration version '1730785815' Nov 4 23:50:19 kjcf05n04 puppet-agent[2607727]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 23:50:19 kjcf05n04 puppet-agent[2607727]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 23:50:19 kjcf05n04 puppet-agent[2607727]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 23:50:19 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2562174]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 23:50:19 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 4 23:50:19 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 23:50:19 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 4 23:50:19 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 4 23:50:19 kjcf05n04 puppet-agent[2607727]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: Press Ctrl+C to exit. Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: Plugin support version 1.0 Nov 4 23:50:19 kjcf05n04 zabbix_agent2[2609452]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 23:50:21 kjcf05n04 puppet-agent[2607727]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 23:50:21 kjcf05n04 puppet-agent[2607727]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 23:50:21 kjcf05n04 puppet-agent[2607727]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 23:50:22 kjcf05n04 puppet-agent[2607727]: Applied catalog in 4.76 seconds Nov 4 23:50:23 kjcf05n00 mcfcli[3673891]: %3|1730785823.609|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 23:50:29 kjcf05n05 puppet-agent[2820043]: Caching catalog for kjcf05n05 Nov 4 23:50:29 kjcf05n05 puppet-agent[2820043]: Applying configuration version '1730785827' Nov 4 23:50:31 kjcf05n05 puppet-agent[2820043]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 4 23:50:31 kjcf05n05 puppet-agent[2820043]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 4 23:50:31 kjcf05n05 puppet-agent[2820043]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 4 23:50:32 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2774552]: Zabbix Agent 2 stopped. (6.2.1) Nov 4 23:50:32 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 4 23:50:32 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 4 23:50:32 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 4 23:50:32 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 4 23:50:32 kjcf05n05 puppet-agent[2820043]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: Starting Zabbix Agent 2 (6.2.1) Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: Press Ctrl+C to exit. Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: Plugin support version 1.0 Nov 4 23:50:32 kjcf05n05 zabbix_agent2[2822806]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 4 23:50:33 kjcf05n05 puppet-agent[2820043]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 4 23:50:33 kjcf05n05 puppet-agent[2820043]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 4 23:50:33 kjcf05n05 puppet-agent[2820043]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 4 23:50:33 kjcf05n00 mcfcli[3673891]: %3|1730785833.901|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:50:34 kjcf05n00 zabbix-server[2553739]: puppet completed status:(0): '' Nov 4 23:50:34 kjcf05n00 zabbix-server[2553739]: Event '46846' acknowledged Nov 4 23:50:34 kjcf05n05 puppet-agent[2820043]: Applied catalog in 4.76 seconds Nov 4 23:50:34 kjcf05n00 zabbix-server[2553739]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 4 23:50:40 kjcf05n00 python3.9[2554875]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 23:50:53 kjcf05n00 mcfcli[3673891]: %3|1730785853.609|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 23:50:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730785853', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 4 23:50:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730785853'} Nov 4 23:50:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:51:13 kjcf05n00 mcfcli[3673891]: %3|1730785873.194|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:51:23 kjcf05n00 mcfcli[3673891]: %3|1730785883.611|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 23:51:51 kjcf05n00 mcfcli[3673891]: %3|1730785911.883|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:51:54 kjcf05n00 mcfcli[3673891]: %3|1730785914.111|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:52:24 kjcf05n00 mcfcli[3673891]: %3|1730785944.111|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 23:52:31 kjcf05n00 mcfcli[3673891]: %3|1730785951.603|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:52:54 kjcf05n00 mcfcli[3673891]: %3|1730785974.111|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 23:53:05 kjcf05n00 mcfcli[3673891]: %3|1730785985.600|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T05:53:15.868523Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 4 23:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T05:53:15.868587Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.086ms Nov 4 23:53:24 kjcf05n00 mcfcli[3673891]: %3|1730786004.113|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 4 23:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-04T23:53:27.268201485-06:00 level=info msg="Completed cleanup jobs" duration=41.438198ms Nov 4 23:53:45 kjcf05n00 mcfcli[3673891]: %3|1730786025.597|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:53:54 kjcf05n00 mcfcli[3673891]: %3|1730786034.186|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 23:54:17 kjcf05n03 nslcd[6913]: [6c6125] ldap_result() failed: Can't contact LDAP server Nov 4 23:54:24 kjcf05n00 mcfcli[3673891]: %3|1730786064.172|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:54:24 kjcf05n00 mcfcli[3673891]: %3|1730786064.613|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 4 23:54:54 kjcf05n00 mcfcli[3673891]: %3|1730786094.613|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:55:03 kjcf05n00 mcfcli[3673891]: %3|1730786103.979|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:55:14 kjcf05n03 nslcd[6913]: [8c895d] ldap_result() failed: Can't contact LDAP server Nov 4 23:55:24 kjcf05n00 mcfcli[3673891]: %3|1730786124.613|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 23:55:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 23:55:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 23:55:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 23:55:43 kjcf05n00 mcfcli[3673891]: %3|1730786143.220|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:55:54 kjcf05n00 mcfcli[3673891]: %3|1730786154.613|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 4 23:55:55 kjcf05n00 zabbix_server[15750]: Zabbix agent item "vm.memory.size[available]" on host "kjcf05n03" failed: first network error, wait for 15 seconds Nov 4 23:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 23:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 23:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 23:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 23:55:58 kjcf05n00 python3.9[2557770]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 4 23:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 23:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 23:56:00 kjcf05n02 fstonithd.py[15175]: My partner 172.16.2.6 is kdumping. Forcing HA into GATHER state. Nov 4 23:56:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 23:56:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 23:56:00 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 4 23:56:00 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 4 23:56:00 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 4 23:56:02 kjcf05n02 root[68218]: is_enc_ipmi_off starts Nov 4 23:56:02 kjcf05n02 root[68219]: is_viking_off starts Nov 4 23:56:02 kjcf05n02 root[68255]: I am not master; I will get master Nov 4 23:56:02 kjcf05n02 root[68258]: I am in slot 0; partner is in slot 1 Nov 4 23:56:02 kjcf05n02 root[68265]: is_lan_ipmi_sec_off leaves Nov 4 23:56:02 kjcf05n02 root[68267]: is_lan_ipmi_off leaves Nov 4 23:56:08 kjcf05n02 root[68395]: I am now master Nov 4 23:56:10 kjcf05n00 zabbix_server[15741]: Zabbix agent item "vfs.fs.inode[/var/lib/pacemaker,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 23:56:11 kjcf05n00 zabbix_server[15782]: Zabbix agent item "vfs.fs.inode[/var/lib/mdraidscripts,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 23:56:12 kjcf05n00 zabbix_server[15735]: Zabbix agent item "vfs.fs.inode[/var/lib/reboot_cnt,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 23:56:13 kjcf05n00 zabbix_server[15731]: Zabbix agent item "vfs.fs.inode[/etc/ganesha,pfree]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 23:56:14 kjcf05n02 root[68584]: is_viking_off leaves Nov 4 23:56:14 kjcf05n02 root[68587]: kjcf05n03 not already off look at kdump Nov 4 23:56:14 kjcf05n02 root[68588]: is_kdump_off starts Nov 4 23:56:14 kjcf05n02 fence_kdump[68589]: waiting for message from '172.16.2.6' Nov 4 23:56:14 kjcf05n02 fence_kdump[68589]: received valid message from '172.16.2.6' Nov 4 23:56:14 kjcf05n02 root[68590]: is_kdump_off detected kdump on kjcf05n03 Nov 4 23:56:15 kjcf05n02 root[68591]: kjcf05n03 is kdumping Nov 4 23:56:14 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 4 23:56:14 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 4 23:56:15 kjcf05n02 root[68697]: is_enc_ipmi_off starts Nov 4 23:56:15 kjcf05n02 root[68698]: is_viking_off starts Nov 4 23:56:15 kjcf05n02 root[68717]: I am master Nov 4 23:56:15 kjcf05n02 root[68720]: I am in slot 0; partner is in slot 1 Nov 4 23:56:15 kjcf05n02 root[68728]: is_lan_ipmi_off leaves Nov 4 23:56:15 kjcf05n02 root[68730]: is_lan_ipmi_sec_off leaves Nov 4 23:56:20 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 4 23:56:20 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 4 23:56:20 kjcf05n00 mcfcli[3673891]: %3|1730786180.476|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:56:23 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='30', error='Connection reset by peer (104)' Nov 4 23:56:23 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='30', client='AF_INET(172.16.2.6:37375)', local='AF_INET(0.0.0.0:601)' Nov 4 23:56:24 kjcf05n02 root[68932]: is_viking_off leaves Nov 4 23:56:24 kjcf05n02 root[68935]: kjcf05n03 not already off look at kdump Nov 4 23:56:24 kjcf05n02 root[68936]: is_kdump_off starts Nov 4 23:56:24 kjcf05n02 fence_kdump[68937]: waiting for message from '172.16.2.6' Nov 4 23:56:24 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 4 23:56:24 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 4 23:56:25 kjcf05n02 fence_kdump[68937]: received valid message from '172.16.2.6' Nov 4 23:56:25 kjcf05n02 root[68946]: is_kdump_off detected kdump on kjcf05n03 Nov 4 23:56:25 kjcf05n02 root[68947]: kjcf05n03 is kdumping Nov 4 23:56:24 kjcf05n00 mcfcli[3673891]: %3|1730786184.613|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:56:28 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.cpu.util[,softirq]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 4 23:56:29 kjcf05n02 dwd[5236]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 4 23:56:29 kjcf05n02 dwd[5236]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 4 23:56:29 kjcf05n02 dwd[5236]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 4 23:56:29 kjcf05n02 dwd[5236]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 4 23:56:29 kjcf05n02 dwd[5236]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 4 23:56:29 kjcf05n02 dwd[5236]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 4 23:56:29 kjcf05n02 dwd[5236]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 4 23:56:29 kjcf05n02 dwd[5236]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 4 23:56:29 kjcf05n02 dwd[5236]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 4 23:56:29 kjcf05n02 dwd[5236]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 4 23:56:29 kjcf05n02 dwd[5236]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 4 23:56:29 kjcf05n02 dwd[5236]: Starting NVME thread for nvme16n1 Nov 4 23:56:30 kjcf05n02 systemd-udevd[71260]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71262]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71264]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71265]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71262]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71260]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71264]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71265]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71262]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71260]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71264]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71265]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71262]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71264]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71260]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71262]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71265]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71264]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71260]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71262]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71265]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71264]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71260]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71265]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71262]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71264]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71260]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71265]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71262]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71264]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71260]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71265]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71298]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71300]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71302]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71304]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71298]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71300]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71304]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71302]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71298]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71304]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71302]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71298]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71304]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71298]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71304]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71302]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71304]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71302]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71304]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71302]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71304]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71302]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71304]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71304]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71302]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71304]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71302]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 dwd[5236]: Starting NVME thread for nvme22n1 Nov 4 23:56:30 kjcf05n02 systemd-udevd[71304]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71302]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71304]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71302]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 systemd-udevd[71302]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 4 23:56:30 kjcf05n02 dwd[5236]: Starting NVME thread for nvme15n1 Nov 4 23:56:30 kjcf05n02 dwd[5236]: Starting NVME thread for nvme6n1 Nov 4 23:56:30 kjcf05n02 dwd[5236]: Starting NVME thread for nvme11n1 Nov 4 23:56:30 kjcf05n02 dwd[5236]: Starting NVME thread for nvme7n1 Nov 4 23:56:30 kjcf05n02 dwd[5236]: Starting NVME thread for nvme10n1 Nov 4 23:56:30 kjcf05n02 dwd[5236]: Starting NVME thread for nvme20n1 Nov 4 23:56:30 kjcf05n02 dwd[5236]: Starting NVME thread for nvme21n1 Nov 4 23:56:31 kjcf05n02 dwd[5236]: Starting NVME thread for nvme5n1 Nov 4 23:56:31 kjcf05n02 dwd[5236]: Starting NVME thread for nvme12n1 Nov 4 23:56:36 kjcf05n02 diskmonitor[17460]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 4 23:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 23:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 23:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 23:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 23:56:40 kjcf05n02 diskmonitor[17460]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 4 23:56:40 kjcf05n02 diskmonitor[17460]: Scan for ReadErrorMax change for md66 Nov 4 23:56:40 kjcf05n02 diskmonitor[17460]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 4 23:56:40 kjcf05n02 diskmonitor[17460]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 4 23:56:40 kjcf05n02 diskmonitor[17460]: read_saved_file: md66 no saved speed Nov 4 23:56:40 kjcf05n02 diskmonitor[17460]: reconstruction_policy: sync_action prev = current = idle - md66 Nov 4 23:56:40 kjcf05n02 diskmonitor[17460]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 4 23:56:43 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n03": interface unavailable Nov 4 23:56:54 kjcf05n00 mcfcli[3673891]: %3|1730786214.614|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 23:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 23:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 23:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 23:56:58 kjcf05n00 mcfcli[3673891]: %3|1730786218.248|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:57:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 23:57:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 23:57:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 23:57:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 23:57:20 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 4 23:57:20 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 4 23:57:24 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 4 23:57:24 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 4 23:57:24 kjcf05n00 mcfcli[3673891]: %3|1730786244.614|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:57:31 kjcf05n02 nslcd[6988]: (re)loading /etc/nsswitch.conf Nov 4 23:57:31 kjcf05n02 nslcd[6988]: [b0dc51] ldap_result() failed: Can't contact LDAP server Nov 4 23:57:35 kjcf05n00 mcfcli[3673891]: %3|1730786255.915|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 23:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 23:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 23:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 23:57:54 kjcf05n00 mcfcli[3673891]: %3|1730786274.614|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 23:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 23:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 23:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 23:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 23:58:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 23:58:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 23:58:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 23:58:14 kjcf05n00 mcfcli[3673891]: %3|1730786294.558|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:58:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730786298}"] Nov 4 23:58:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730786298, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:58:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.049519ms Nov 4 23:58:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.049519ms Nov 4 23:58:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:58:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:58:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:58:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730786298}"] Nov 4 23:58:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730786298, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:58:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.113909ms Nov 4 23:58:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.113909ms Nov 4 23:58:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:58:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:58:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:58:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730786298}"] Nov 4 23:58:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730786298, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:58:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.89049ms Nov 4 23:58:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.89049ms Nov 4 23:58:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:58:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:58:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:58:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730786298}"] Nov 4 23:58:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730786298, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:58:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:18-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:18 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:18-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:18 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:18-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:18 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.028339ms Nov 4 23:58:18 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:18-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.028339ms Nov 4 23:58:18 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:58:18 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:58:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:58:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730786298}"] Nov 4 23:58:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730786298, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:58:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.731252ms Nov 4 23:58:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.731252ms Nov 4 23:58:19 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:58:19 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:58:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:58:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730786298}"] Nov 4 23:58:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730786298, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:58:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.12016ms Nov 4 23:58:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.12016ms Nov 4 23:58:19 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:58:19 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:58:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:58:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730786298}"] Nov 4 23:58:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730786298, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:58:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.823675ms Nov 4 23:58:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.823675ms Nov 4 23:58:19 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:58:19 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:58:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:58:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730786298}"] Nov 4 23:58:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730786298, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:58:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.639421ms Nov 4 23:58:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.639421ms Nov 4 23:58:19 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:58:19 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:58:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:58:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730786298}"] Nov 4 23:58:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730786298, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:58:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.143064ms Nov 4 23:58:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.143064ms Nov 4 23:58:19 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:58:19 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:58:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:58:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730786298}"] Nov 4 23:58:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730786298, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:58:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.110243ms Nov 4 23:58:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.110243ms Nov 4 23:58:19 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:58:19 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:58:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:58:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730786298}"] Nov 4 23:58:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730786298, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 4 23:58:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:19-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 4 23:58:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:19 kjcf05n00 RFSF-API[9864]: INFO[2024-11-04T23:58:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:19-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 4 23:58:19 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-04T23:58:19-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 4 23:58:19 kjcf05n00 RFSF-API[8976]: INFO[2024-11-04T23:58:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.57518ms Nov 4 23:58:19 kjcf05n00 dp-api-server[8976]: INFO[2024-11-04T23:58:19-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.57518ms Nov 4 23:58:19 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [04/Nov/2024:23:58:19 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 4 23:58:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 4 23:58:20 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 4 23:58:20 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 4 23:58:24 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 4 23:58:24 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 4 23:58:24 kjcf05n00 mcfcli[3673891]: %3|1730786304.615|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 23:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 23:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 23:58:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 23:58:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 23:58:52 kjcf05n00 mcfcli[3673891]: %3|1730786332.036|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:58:55 kjcf05n00 mcfcli[3673891]: %3|1730786335.115|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 23:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 23:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 23:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 23:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 23:59:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 23:59:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 4 23:59:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 4 23:59:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 4 23:59:20 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 4 23:59:20 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 4 23:59:24 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 4 23:59:24 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 4 23:59:25 kjcf05n00 mcfcli[3673891]: %3|1730786365.115|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 4 23:59:30 kjcf05n00 mcfcli[3673891]: %3|1730786370.755|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 4 23:59:34 kjcf05n00 zabbix-server[2560391]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 4 23:59:34 kjcf05n00 zabbix-server[2560391]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n03:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 4 23:59:34 kjcf05n00 log_interesting_event.py[2560391]: Event '46849' acknowledged Nov 4 23:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 4 23:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 4 23:59:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 4 23:59:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 4 23:59:41 kjcf05n02 diskmonitor[17460]: Unable to Get Channel Cipher Suites Nov 4 23:59:46 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:9a:1a Nov 4 23:59:46 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 4 23:59:50 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 4 23:59:50 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a kjcf05n03 Nov 4 23:59:50 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.6 Nov 4 23:59:50 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 4 23:59:50 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 4 23:59:50 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.6 Nov 4 23:59:50 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/pxelinux.cfg to 172.16.2.6 Nov 4 23:59:53 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/vmlinuz_diskless to 172.16.2.6 Nov 4 23:59:53 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 4 23:59:55 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/initramfs-diskless.img to 172.16.2.6 Nov 4 23:59:55 kjcf05n00 mcfcli[3673891]: %3|1730786395.188|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 4 23:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 4 23:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 4 23:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 4 23:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 4 23:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 4 23:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 5 00:00:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 5 00:00:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 5 00:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 5 00:00:00 kjcf05n06 systemd[1]: Starting update of the root trust anchor for DNSSEC validation in unbound... Nov 5 00:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 5 00:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 5 00:00:00 kjcf05n07 systemd[1]: Starting update of the root trust anchor for DNSSEC validation in unbound... Nov 5 00:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 5 00:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 5 00:00:00 kjcf05n05 systemd[1]: Starting update of the root trust anchor for DNSSEC validation in unbound... Nov 5 00:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 5 00:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 5 00:00:00 kjcf05n04 systemd[1]: Starting update of the root trust anchor for DNSSEC validation in unbound... Nov 5 00:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 5 00:00:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 5 00:00:00 kjcf05n02 systemd[1]: Starting update of the root trust anchor for DNSSEC validation in unbound... Nov 5 00:00:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:00:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 5 00:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 5 00:00:00 kjcf05n00 systemd[1]: Starting update of the root trust anchor for DNSSEC validation in unbound... Nov 5 00:00:00 kjcf05n00 systemd[1]: Starting "vmcore cleanup"... Nov 5 00:00:00 kjcf05n00 systemd[1]: clean_kdump.service: Succeeded. Nov 5 00:00:00 kjcf05n00 systemd[1]: Started "vmcore cleanup". Nov 5 00:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 5 00:00:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 5 00:00:02 kjcf05n01 systemd[1]: Starting update of the root trust anchor for DNSSEC validation in unbound... Nov 5 00:00:02 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 5 00:00:02 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 5 00:00:02 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 5 00:00:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:00:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 5 00:00:09 kjcf05n00 mcfcli[3673891]: %3|1730786409.145|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:00:20 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 5 00:00:20 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 5 00:00:24 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 5 00:00:24 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 5 00:00:25 kjcf05n00 mcfcli[3673891]: %3|1730786425.189|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 00:00:31 kjcf05n02 nslcd[6988]: [e8944a] ldap_result() failed: Can't contact LDAP server Nov 5 00:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 5 00:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 5 00:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 5 00:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 5 00:00:40 kjcf05n00 python3.9[2560821]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 5 00:00:43 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:47020). Nov 5 00:00:43 kjcf05n01 rsyncd[3969297]: connect from kjcf05n03 (172.16.2.6) Nov 5 00:00:43 kjcf05n01 rsyncd[3969297]: rsync on puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 5 00:00:43 kjcf05n01 rsyncd[3969297]: building file list Nov 5 00:00:43 kjcf05n01 rsyncd[3969297]: sent 11446 bytes received 136 bytes total size 10901 Nov 5 00:00:43 kjcf05n01 systemd[1]: rsyncd@675-172.16.2.2:873-172.16.2.6:47020.service: Succeeded. Nov 5 00:00:45 kjcf05n00 mcfcli[3673891]: %3|1730786445.927|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:00:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730786453', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 5 00:00:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730786453'} Nov 5 00:00:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:00:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730786453', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 5 00:00:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730786453'} Nov 5 00:00:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:00:55 kjcf05n00 mcfcli[3673891]: %3|1730786455.189|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 5 00:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 5 00:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 5 00:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 5 00:01:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 5 00:01:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 5 00:01:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 5 00:01:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 5 00:01:00 kjcf05n02 fstonithd.py[15175]: Listening for kdump packets from partner Nov 5 00:01:20 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 5 00:01:20 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 5 00:01:21 kjcf05n00 mcfcli[3673891]: %3|1730786481.917|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:01:24 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 5 00:01:24 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 5 00:01:25 kjcf05n00 mcfcli[3673891]: %3|1730786485.189|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 00:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 5 00:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 5 00:01:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 5 00:01:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 5 00:01:55 kjcf05n02 dwd[5236]: nvme22n1 passed periodic SMART status check Nov 5 00:01:55 kjcf05n02 dwd[5236]: nvme16n1 passed periodic SMART status check Nov 5 00:01:55 kjcf05n02 dwd[5236]: nvme6n1 passed periodic SMART status check Nov 5 00:01:55 kjcf05n02 dwd[5236]: nvme15n1 passed periodic SMART status check Nov 5 00:01:55 kjcf05n00 mcfcli[3673891]: %3|1730786515.189|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 5 00:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 5 00:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 5 00:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 5 00:01:56 kjcf05n02 dwd[5236]: nvme20n1 passed periodic SMART status check Nov 5 00:01:56 kjcf05n02 dwd[5236]: nvme11n1 passed periodic SMART status check Nov 5 00:01:56 kjcf05n02 dwd[5236]: nvme21n1 passed periodic SMART status check Nov 5 00:01:56 kjcf05n02 dwd[5236]: nvme12n1 passed periodic SMART status check Nov 5 00:01:56 kjcf05n02 dwd[5236]: nvme7n1 passed periodic SMART status check Nov 5 00:01:56 kjcf05n02 dwd[5236]: nvme5n1 passed periodic SMART status check Nov 5 00:01:56 kjcf05n02 dwd[5236]: nvme10n1 passed periodic SMART status check Nov 5 00:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 5 00:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 5 00:02:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 5 00:02:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 5 00:01:59 kjcf05n00 mcfcli[3673891]: %3|1730786519.727|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:02:09 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='70', client='AF_INET(172.16.2.6:46431)', local='AF_INET(0.0.0.0:601)' Nov 5 00:02:09 kjcf05n03 syslog-ng[3131]: Configuration reload request received, reloading configuration; Nov 5 00:02:09 kjcf05n03 syslog-ng[3131]: Configuration reload finished; Nov 5 00:02:09 kjcf05n03 syslog-ng[3131]: Syslog connection established; fd='16', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 5 00:02:09 kjcf05n03 dracut: dracut-049-135.git20210121.el8 Nov 5 00:02:09 kjcf05n03 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 5 00:02:09 kjcf05n03 dracut: Loading and integrity checking all crypto modules Nov 5 00:02:09 kjcf05n03 dracut: Self testing crypto algorithms Nov 5 00:02:09 kjcf05n03 dracut: rd.md=0: removing MD RAID activation Nov 5 00:02:09 kjcf05n03 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 5 00:02:09 kjcf05n03 Copying live image to RAM... Nov 5 00:02:09 kjcf05n03 (this may take a minute) Nov 5 00:02:09 kjcf05n03 Done copying live image to RAM. Nov 5 00:02:09 kjcf05n03 dracut: Mounted root filesystem LiveOS_rootfs Nov 5 00:02:09 kjcf05n03 dracut: Checking integrity of kernel Nov 5 00:02:09 kjcf05n03 dracut: All initrd crypto checks done Nov 5 00:02:09 kjcf05n03 dracut: Switching root Nov 5 00:02:09 kjcf05n03 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 5 00:02:09 kjcf05n03 systemd: Detected architecture x86-64. Nov 5 00:02:09 kjcf05n03 systemd: Set hostname to . Nov 5 00:02:09 kjcf05n03 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 5 00:02:09 kjcf05n03 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 5 00:02:09 kjcf05n03 systemd: Started Forward Password Requests to Wall Directory Watch. Nov 5 00:02:09 kjcf05n03 systemd: Created slice system-sshd\x2dkeygen.slice. Nov 5 00:02:09 kjcf05n03 systemd: Reached target CXI Retry Handlers Started. Nov 5 00:02:09 kjcf05n03 systemd: Reached target rpc_pipefs.target. Nov 5 00:02:09 kjcf05n03 systemd: Listening on initctl Compatibility Named Pipe. Nov 5 00:02:09 kjcf05n03 systemd-journald[1522]: Journal started Nov 5 00:02:09 kjcf05n03 systemd-journald[1522]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 5 00:02:09 kjcf05n03 systemd-modules-load[1543]: Inserted module 'fuse' Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Load Kernel Modules. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Remount Root and Kernel File Systems. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Load/Save Random Seed... Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Rebuild Hardware Database... Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Create System Users... Nov 5 00:02:09 kjcf05n03 systemd[1]: Mounting FUSE Control File System... Nov 5 00:02:09 kjcf05n03 systemd[1]: Mounting Kernel Configuration File System... Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Apply Kernel Variables... Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Load/Save Random Seed. Nov 5 00:02:09 kjcf05n03 systemd[1]: Mounted FUSE Control File System. Nov 5 00:02:09 kjcf05n03 systemd[1]: Mounted Kernel Configuration File System. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Create System Users. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 5 00:02:09 kjcf05n03 systemd-sysctl[1558]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 5 00:02:09 kjcf05n03 systemd-sysctl[1558]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Apply Kernel Variables. Nov 5 00:02:09 kjcf05n03 systemd-journald[1522]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Flush Journal to Persistent Storage. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started udev Coldplug all Devices. Nov 5 00:02:09 kjcf05n03 systemd-tmpfiles[1562]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 00:02:09 kjcf05n03 systemd-tmpfiles[1562]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Create Static Device Nodes in /dev. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Rebuild Hardware Database. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting udev Kernel Device Manager... Nov 5 00:02:09 kjcf05n03 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started udev Kernel Device Manager. Nov 5 00:02:09 kjcf05n03 systemd[1]: Found device /dev/ttyS0. Nov 5 00:02:09 kjcf05n03 systemd-udevd[1629]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:02:09 kjcf05n03 systemd-udevd[1605]: Using default interface naming scheme 'rhel-8.0'. Nov 5 00:02:09 kjcf05n03 systemd-udevd[1605]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:02:09 kjcf05n03 systemd-udevd[1634]: Using default interface naming scheme 'rhel-8.0'. Nov 5 00:02:09 kjcf05n03 systemd-udevd[1634]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:02:09 kjcf05n03 systemd-udevd[1619]: Using default interface naming scheme 'rhel-8.0'. Nov 5 00:02:09 kjcf05n03 systemd-udevd[1619]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 5 00:02:09 kjcf05n03 systemd[1]: Reached target Local File Systems (Pre). Nov 5 00:02:09 kjcf05n03 systemd[1]: Reached target Local File Systems. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Mark the need to relabel after reboot... Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Create Volatile Files and Directories... Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Rebuild Journal Catalog... Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting openibd - configure Mellanox devices... Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Mark the need to relabel after reboot. Nov 5 00:02:09 kjcf05n03 systemd-tmpfiles[1787]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 00:02:09 kjcf05n03 systemd-tmpfiles[1787]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 5 00:02:09 kjcf05n03 systemd-tmpfiles[1787]: "/var/tmp" already exists and is not a directory. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Create Volatile Files and Directories. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting RPC Bind... Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 5 00:02:09 kjcf05n03 root[1801]: openibd: running in auto mode Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Rebuild Journal Catalog. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started RPC Bind. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting RDMA Node Description Daemon... Nov 5 00:02:09 kjcf05n03 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 5 00:02:09 kjcf05n03 systemd[1]: Started RDMA Node Description Daemon. Nov 5 00:02:09 kjcf05n03 systemd-modules-load[1884]: Inserted module 'ib_iser' Nov 5 00:02:09 kjcf05n03 systemd-modules-load[1884]: Inserted module 'ib_isert' Nov 5 00:02:09 kjcf05n03 systemd-modules-load[1884]: Inserted module 'ib_srpt' Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 5 00:02:09 kjcf05n03 systemd-modules-load[1891]: Inserted module 'ib_ipoib' Nov 5 00:02:09 kjcf05n03 systemd-udevd[1635]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:02:09 kjcf05n03 systemd-udevd[1629]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:02:09 kjcf05n03 systemd-modules-load[1884]: Inserted module 'rdma_ucm' Nov 5 00:02:09 kjcf05n03 systemd-modules-load[1884]: Module 'svcrdma' is blacklisted Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 5 00:02:09 kjcf05n03 systemd-udevd[1629]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 5 00:02:09 kjcf05n03 systemd-udevd[1635]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 5 00:02:09 kjcf05n03 systemd-modules-load[1891]: Inserted module 'ib_umad' Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 5 00:02:09 kjcf05n03 systemd[1]: Reached target RDMA Hardware. Nov 5 00:02:09 kjcf05n03 systemd[1]: Reached target Network (Pre). Nov 5 00:02:09 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 5 00:02:09 kjcf05n03 systemd[3131]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:09 kjcf05n03 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 5 00:02:09 kjcf05n03 openibd[1791]: Loading HCA driver and Access Layer:[ OK ] Nov 5 00:02:09 kjcf05n03 systemd[1]: Started openibd - configure Mellanox devices. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Update is Completed... Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Update is Completed. Nov 5 00:02:09 kjcf05n03 setup-icl[1777]: Setting LAN IP Address to 203.0.113.4 Nov 5 00:02:09 kjcf05n03 setup-icl[1777]: Setting LAN Subnet Mask to 255.255.255.0 Nov 5 00:02:09 kjcf05n03 setup-icl[1777]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 5 00:02:09 kjcf05n03 setup-icl[1777]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 5 00:02:09 kjcf05n03 systemd-udevd[1635]: Using default interface naming scheme 'rhel-8.0'. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 5 00:02:09 kjcf05n03 systemd[1]: Reached target System Initialization. Nov 5 00:02:09 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 5 00:02:09 kjcf05n03 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 5 00:02:09 kjcf05n03 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 5 00:02:09 kjcf05n03 systemd[1]: Listening on lldpad.socket. Nov 5 00:02:09 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 5 00:02:09 kjcf05n03 systemd[1]: Reached target Sockets. Nov 5 00:02:09 kjcf05n03 systemd[1]: Reached target Basic System. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started irqbalance daemon. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Resets System Activity Logs... Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting LSB: Bring up/down networking... Nov 5 00:02:09 kjcf05n03 mcelog[2094]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 5 00:02:09 kjcf05n03 mcelog[2094]: CPU is unsupported Nov 5 00:02:09 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Name Service Cache Daemon... Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 5 00:02:09 kjcf05n03 nscd[2141]: 2141 monitoring file `/etc/hosts` (1) Nov 5 00:02:09 kjcf05n03 nscd[2141]: 2141 monitoring directory `/etc` (2) Nov 5 00:02:09 kjcf05n03 nscd[2141]: 2141 monitoring file `/etc/resolv.conf` (3) Nov 5 00:02:09 kjcf05n03 nscd[2141]: 2141 monitoring directory `/etc` (2) Nov 5 00:02:09 kjcf05n03 network[2107]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started D-Bus System Message Bus. Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[2108]: Setting up Mellanox network interface: ib0 Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[2136]: Setting up Mellanox network interface: ib1 Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 5 00:02:09 kjcf05n03 network[2151]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 5 00:02:09 kjcf05n03 network[2107]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 5 00:02:09 kjcf05n03 chronyd[2200]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 0 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 1 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 2 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 3 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 4 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 5 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 6 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 7 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 8 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 9 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 10 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 11 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 12 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 13 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 14 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 15 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 16 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 17 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 18 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 19 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 20 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 21 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 22 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 23 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 24 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 25 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 26 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 27 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 28 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 29 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 30 Nov 5 00:02:09 kjcf05n03 cpupower[2194]: Setting cpu: 31 Nov 5 00:02:09 kjcf05n03 beSetMlxConfig[2160]: ConnectX-3 multiport not detected Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 5 00:02:09 kjcf05n03 network[2193]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:02:09 kjcf05n03 network[2107]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 5 00:02:09 kjcf05n03 dbus-daemon[2152]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 5 00:02:09 kjcf05n03 network[2228]: It is advised to switch to 'NetworkManager' instead for network management. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[2229]: set_ipoib_cm: ib0 connection mode set to connected Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Manage Cutlass PHYs... Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Resets System Activity Logs. Nov 5 00:02:09 kjcf05n03 dwd[2230]: dwd: vMay 29 2024 : 15:38:26 Nov 5 00:02:09 kjcf05n03 dwd[2230]: /usr/sbin/dwd -d --standalone=0 Nov 5 00:02:09 kjcf05n03 dwd[2230]: dwd: option Lethal: 0 Nov 5 00:02:09 kjcf05n03 dwd[2230]: dwd: option Interval: 60 Nov 5 00:02:09 kjcf05n03 dwd[2230]: dwd: option abrtlimit: 10 Nov 5 00:02:09 kjcf05n03 dwd[2230]: dwd: option DZPeriod: 604800 Nov 5 00:02:09 kjcf05n03 dwd[2230]: dwd: option SmartPeriod: 43200 Nov 5 00:02:09 kjcf05n03 dwd[2230]: dwd: option SDDEnabled: 1 Nov 5 00:02:09 kjcf05n03 dwd[2230]: dwd: option SDDAwaitScale: 3 Nov 5 00:02:09 kjcf05n03 dwd[2230]: dwd: option SDDAwaitMin: 100 Nov 5 00:02:09 kjcf05n03 dwd[2230]: dwd: option Verbosity: 1 Nov 5 00:02:09 kjcf05n03 dwd[2230]: dwd: option StandAlone: 0 Nov 5 00:02:09 kjcf05n03 dwd[2230]: option Lethal: 0 Nov 5 00:02:09 kjcf05n03 dwd[2230]: option Interval: 60 Nov 5 00:02:09 kjcf05n03 dwd[2230]: option abrtlimit: 10 Nov 5 00:02:09 kjcf05n03 dwd[2230]: option DZPeriod: 604800 Nov 5 00:02:09 kjcf05n03 dwd[2230]: option SmartPeriod: 43200 Nov 5 00:02:09 kjcf05n03 dwd[2230]: option SDDEnabled: 1 Nov 5 00:02:09 kjcf05n03 dwd[2230]: option SDDAwaitScale: 3 Nov 5 00:02:09 kjcf05n03 dwd[2230]: option SDDAwaitMin: 100 Nov 5 00:02:09 kjcf05n03 dwd[2230]: option Verbosity: 1 Nov 5 00:02:09 kjcf05n03 dwd[2230]: option StandAlone: 0 Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[2232]: set_ipoib_cm: ib1 connection mode set to connected Nov 5 00:02:09 kjcf05n03 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 5 00:02:09 kjcf05n03 chronyd[2200]: Wrong owner of /var/run/chrony (UID != 991) Nov 5 00:02:09 kjcf05n03 chronyd[2200]: Disabled command socket /var/run/chrony/chronyd.sock Nov 5 00:02:09 kjcf05n03 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 5 00:02:09 kjcf05n03 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Name Service Cache Daemon. Nov 5 00:02:09 kjcf05n03 mdraid-phy[2262]: no Cutlass to worry about Nov 5 00:02:09 kjcf05n03 beSetMlxConfig[2160]: Starting MST (Mellanox Software Tools) driver set Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[2265]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 5 00:02:09 kjcf05n03 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 0 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 1 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 2 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 3 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 4 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 5 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 6 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 7 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 8 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 9 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 10 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 11 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 12 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 13 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 14 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 15 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 16 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 17 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 18 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 19 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 20 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 21 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 22 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 23 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 24 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 25 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 26 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 27 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 28 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 29 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 30 Nov 5 00:02:09 kjcf05n03 cpupower[2291]: Idlestate 2 disabled on CPU 31 Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[2280]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Manage Cutlass PHYs. Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[2289]: No configuration found for ib0 Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 5 00:02:09 kjcf05n03 beSetMlxConfig[2160]: Loading MST PCI module - Success Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[2294]: No configuration found for ib1 Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[2300]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[2306]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 5 00:02:09 kjcf05n03 beSetMlxConfig[2160]: Loading MST PCI configuration module - Success Nov 5 00:02:09 kjcf05n03 beSetMlxConfig[2160]: Create devices Nov 5 00:02:09 kjcf05n03 sssd[sssd][2227]: Starting up Nov 5 00:02:09 kjcf05n03 mlnx_conf_mgr[2350]: INFO: No configurations found for mlx5_0, skipping. Nov 5 00:02:09 kjcf05n03 mlnx_conf_mgr[2351]: INFO: No configurations found for mlx5_1, skipping. Nov 5 00:02:09 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 5 00:02:09 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 5 00:02:09 kjcf05n03 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 5 00:02:09 kjcf05n03 sssd[be[implicit_files]][2405]: Starting up Nov 5 00:02:09 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 5 00:02:09 kjcf05n03 sssd[nss][2501]: Starting up Nov 5 00:02:09 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 5 00:02:09 kjcf05n03 systemd[1]: Reached target User and Group Name Lookups. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Login Service... Nov 5 00:02:09 kjcf05n03 systemd-logind[2599]: New seat seat0. Nov 5 00:02:09 kjcf05n03 systemd-logind[2599]: Watching system buttons on /dev/input/event0 (Power Button) Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Login Service. Nov 5 00:02:09 kjcf05n03 python3.9[2240]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 5 00:02:09 kjcf05n03 python3.9[3131]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 00:02:09 kjcf05n03 systemd-sysctl[2735]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 5 00:02:09 kjcf05n03 systemd-sysctl[2735]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 5 00:02:09 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 00:02:09 kjcf05n03 network[2107]: Bringing up loopback interface: [ OK ] Nov 5 00:02:09 kjcf05n03 python3.9[2959]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 5 00:02:09 kjcf05n03 python3.9[3131]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 00:02:09 kjcf05n03 systemd-sysctl[3063]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 5 00:02:09 kjcf05n03 systemd-sysctl[3063]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 5 00:02:09 kjcf05n03 systemd[1]: Started LSB: Bring up/down networking. Nov 5 00:02:09 kjcf05n03 systemd[1]: Reached target Network. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 5 00:02:09 kjcf05n03 systemd[1]: Reached target Network is Online. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting System Logger Daemon... Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Notify NFS peers of a restart... Nov 5 00:02:09 kjcf05n03 sm-notify[3141]: Version 2.3.3 starting Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started GSSAPI Proxy Daemon. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Notify NFS peers of a restart. Nov 5 00:02:09 kjcf05n03 sshd[3120]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 5 00:02:09 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 5 00:02:09 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 00:02:09 kjcf05n03 systemd[1]: Reached target NFS client services. Nov 5 00:02:09 kjcf05n03 systemd[1]: Reached target Remote File Systems (Pre). Nov 5 00:02:09 kjcf05n03 systemd[1]: Reached target Remote File Systems. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Permit User Sessions... Nov 5 00:02:09 kjcf05n03 lldpad[3111]: setsockopt nearest_bridge: Invalid argument Nov 5 00:02:09 kjcf05n03 lldpad[3131]: Last message 'setsockopt nearest_b' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Permit User Sessions. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Serial Getty on ttyS0. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Getty on tty1. Nov 5 00:02:09 kjcf05n03 python3.9[3174]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 5 00:02:09 kjcf05n03 python3.9[3131]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:09 kjcf05n03 systemd[1]: Reached target Login Prompts. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 5 00:02:09 kjcf05n03 syslog-ng[3131]: [2024-11-05T06:00:56.453828] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 5 00:02:09 kjcf05n03 syslog-ng[3131]: [2024-11-05T06:00:56.454136] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 5 00:02:09 kjcf05n03 syslog-ng[3131]: [2024-11-05T06:00:56.454176] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 5 00:02:09 kjcf05n03 syslog-ng[3131]: [2024-11-05T06:00:56.454445] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 5 00:02:09 kjcf05n03 syslog-ng[3131]: [2024-11-05T06:00:56.454650] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started System Logger Daemon. Nov 5 00:02:09 kjcf05n03 beSetMlxConfig[2160]: Unloading MST PCI module (unused) - Success Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 5 00:02:09 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 00:02:09 kjcf05n03 python3.9[3410]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 5 00:02:09 kjcf05n03 python3.9[3131]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 5 00:02:09 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 00:02:09 kjcf05n03 python3.9[3413]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 5 00:02:09 kjcf05n03 python3.9[3131]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 5 00:02:09 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 5 00:02:09 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 00:02:09 kjcf05n03 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 5 00:02:09 kjcf05n03 chronyd[2200]: System's initial offset : 0.003263 seconds slow of true (slew) Nov 5 00:02:09 kjcf05n03 systemd[1]: Started NTP client/server. Nov 5 00:02:09 kjcf05n03 beSetMlxConfig[2160]: Configuring /dev/mst/mt4123_pciconf1 Nov 5 00:02:09 kjcf05n03 beSetMlxConfig[2160]: ib mode Nov 5 00:02:09 kjcf05n03 root[3446]: openibd: Set node_desc for mlx5_0: kjcf05n03 HCA-1 Nov 5 00:02:09 kjcf05n03 root[3448]: openibd: Set node_desc for mlx5_1: kjcf05n03 HCA-2 Nov 5 00:02:09 kjcf05n03 beSetMlxConfig[2160]: Configuring /dev/mst/mt4123_pciconf0 Nov 5 00:02:09 kjcf05n03 beSetMlxConfig[2160]: ib mode Nov 5 00:02:09 kjcf05n03 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 00:02:09 kjcf05n03 systemd-udevd[3465]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:02:09 kjcf05n03 systemd-udevd[3464]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:02:09 kjcf05n03 systemd-udevd[3468]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:02:09 kjcf05n03 systemd-udevd[3469]: Using default interface naming scheme 'rhel-8.0'. Nov 5 00:02:09 kjcf05n03 systemd-udevd[3469]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:02:09 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 5 00:02:09 kjcf05n03 systemd[3131]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:09 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[3506]: Setting up Mellanox network interface: ib1 Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[3507]: Setting up Mellanox network interface: ib0 Nov 5 00:02:09 kjcf05n03 systemd-udevd[3466]: Using default interface naming scheme 'rhel-8.0'. Nov 5 00:02:09 kjcf05n03 systemd-udevd[3467]: Using default interface naming scheme 'rhel-8.0'. Nov 5 00:02:09 kjcf05n03 systemd-udevd[3466]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:02:09 kjcf05n03 systemd-udevd[3467]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Puppet agent... Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[3559]: set_ipoib_cm: ib0 connection mode set to connected Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[3560]: set_ipoib_cm: ib1 connection mode set to connected Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[3587]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[3588]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[3591]: No configuration found for ib0 Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[3590]: No configuration found for ib1 Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[3598]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[3599]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 5 00:02:09 kjcf05n03 mlnx_conf_mgr[3638]: INFO: No configurations found for mlx5_1, skipping. Nov 5 00:02:09 kjcf05n03 mlnx_conf_mgr[3639]: INFO: No configurations found for mlx5_0, skipping. Nov 5 00:02:09 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 5 00:02:09 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 5 00:02:09 kjcf05n03 systemd[1]: Stopping Command Scheduler... Nov 5 00:02:09 kjcf05n03 systemd[1]: crond.service: Succeeded. Nov 5 00:02:09 kjcf05n03 systemd[1]: Stopped Command Scheduler. Nov 5 00:02:09 kjcf05n03 systemd[1]: crond.service: Found left-over process 3433 (anacron) in control group while starting unit. Ignoring. Nov 5 00:02:09 kjcf05n03 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 5 00:02:09 kjcf05n03 systemd[1]: Stopping Job spooling tools... Nov 5 00:02:09 kjcf05n03 systemd[1]: atd.service: Succeeded. Nov 5 00:02:09 kjcf05n03 systemd[1]: Stopped Job spooling tools. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 5 00:02:09 kjcf05n03 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 5 00:02:09 kjcf05n03 lldpad[3111]: init_ports: Error adding device ib0 Nov 5 00:02:09 kjcf05n03 lldpad[3111]: init_ports: Error adding device ib1 Nov 5 00:02:09 kjcf05n03 lldpad[3111]: Signal 15 received - terminating Nov 5 00:02:09 kjcf05n03 systemd[1]: lldpad.service: Succeeded. Nov 5 00:02:09 kjcf05n03 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 5 00:02:09 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 5 00:02:09 kjcf05n03 systemd[1]: lldpad.socket: Succeeded. Nov 5 00:02:09 kjcf05n03 systemd[1]: Closed lldpad.socket. Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 5 00:02:09 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting IPMI Driver... Nov 5 00:02:09 kjcf05n03 systemd[1]: Started IPMI Driver. Nov 5 00:02:09 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:09 kjcf05n03 systemd[3131]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:09 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Ipmievd Daemon... Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 1 | Nov-05-2024 | 03:01:45 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 2 | Nov-05-2024 | 03:02:36 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 3 | Nov-05-2024 | 03:02:36 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 4 | Nov-05-2024 | 03:03:42 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 5 | Nov-05-2024 | 03:03:43 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 6 | Nov-05-2024 | 05:58:17 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 7 | Nov-05-2024 | 05:58:17 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 8 | Nov-05-2024 | 05:58:17 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 9 | Nov-05-2024 | 05:58:17 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 10 | Nov-05-2024 | 05:58:17 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 11 | Nov-05-2024 | 05:58:17 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 12 | Nov-05-2024 | 05:58:17 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 13 | Nov-05-2024 | 05:58:17 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 14 | Nov-05-2024 | 05:58:17 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 15 | Nov-05-2024 | 05:58:17 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 16 | Nov-05-2024 | 05:58:17 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 17 | Nov-05-2024 | 05:58:17 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 18 | Nov-05-2024 | 05:58:47 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 19 | Nov-05-2024 | 05:58:47 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 20 | Nov-05-2024 | 05:58:47 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 21 | Nov-05-2024 | 05:58:47 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 22 | Nov-05-2024 | 05:58:47 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 23 | Nov-05-2024 | 05:58:47 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 24 | Nov-05-2024 | 05:58:47 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 25 | Nov-05-2024 | 05:58:47 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 26 | Nov-05-2024 | 05:58:47 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 27 | Nov-05-2024 | 05:58:47 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 28 | Nov-05-2024 | 05:58:47 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 29 | Nov-05-2024 | 05:58:47 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 30 | Nov-05-2024 | 05:58:47 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 31 | Nov-05-2024 | 05:58:47 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 32 | Nov-05-2024 | 05:58:47 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 33 | Nov-05-2024 | 05:58:47 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 34 | Nov-05-2024 | 05:58:47 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 35 | Nov-05-2024 | 05:58:47 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 36 | Nov-05-2024 | 05:58:47 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 37 | Nov-05-2024 | 05:58:47 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 38 | Nov-05-2024 | 05:58:47 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 39 | Nov-05-2024 | 05:58:47 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 40 | Nov-05-2024 | 05:58:48 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 41 | Nov-05-2024 | 05:58:48 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 42 | Nov-05-2024 | 05:58:48 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 43 | Nov-05-2024 | 05:58:48 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 44 | Nov-05-2024 | 05:58:48 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 45 | Nov-05-2024 | 05:58:48 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 46 | Nov-05-2024 | 05:58:48 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 47 | Nov-05-2024 | 05:58:48 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 48 | Nov-05-2024 | 05:58:48 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3982]: 49 | Nov-05-2024 | 05:58:48 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:02:09 kjcf05n03 ipmievd[3985]: Reading sensors... Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Ipmievd Daemon. Nov 5 00:02:09 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:09 kjcf05n03 systemd[3131]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 5 00:02:09 kjcf05n03 nscd[2141]: 2141 monitored file `/etc/hosts` was moved into place, adding watch Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 5 00:02:09 kjcf05n03 systemd[1]: set-mlx-config.service: Succeeded. Nov 5 00:02:09 kjcf05n03 systemd[1]: Stopped Set Mellanox configuration. Nov 5 00:02:09 kjcf05n03 systemd[1]: Stopping Set Mellanox configuration... Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 5 00:02:09 kjcf05n03 beSetMlxConfig[4043]: ConnectX-3 multiport not detected Nov 5 00:02:09 kjcf05n03 beSetMlxConfig[4043]: Starting MST (Mellanox Software Tools) driver set Nov 5 00:02:09 kjcf05n03 beSetMlxConfig[4043]: Loading MST PCI module - Success Nov 5 00:02:09 kjcf05n03 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 00:02:09 kjcf05n03 beSetMlxConfig[4043]: [warn] mst_pciconf is already loaded, skipping Nov 5 00:02:09 kjcf05n03 beSetMlxConfig[4043]: Create devices Nov 5 00:02:09 kjcf05n03 beSetMlxConfig[4043]: Unloading MST PCI module (unused) - Success Nov 5 00:02:09 kjcf05n03 ipmievd[3985]: Waiting for events... Nov 5 00:02:09 kjcf05n03 beSetMlxConfig[4043]: Configuring /dev/mst/mt4123_pciconf1 Nov 5 00:02:09 kjcf05n03 beSetMlxConfig[4043]: ib mode Nov 5 00:02:09 kjcf05n03 beSetMlxConfig[4043]: Configuring /dev/mst/mt4123_pciconf0 Nov 5 00:02:09 kjcf05n03 beSetMlxConfig[4043]: ib mode Nov 5 00:02:09 kjcf05n03 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 00:02:09 kjcf05n03 systemd-udevd[4944]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:02:09 kjcf05n03 systemd-udevd[4945]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:02:09 kjcf05n03 systemd-udevd[4948]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:02:09 kjcf05n03 systemd-udevd[4951]: Using default interface naming scheme 'rhel-8.0'. Nov 5 00:02:09 kjcf05n03 systemd-udevd[4951]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:02:09 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 5 00:02:09 kjcf05n03 systemd[3131]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:09 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[4986]: Setting up Mellanox network interface: ib0 Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[4987]: Setting up Mellanox network interface: ib1 Nov 5 00:02:09 kjcf05n03 systemd-udevd[4946]: Using default interface naming scheme 'rhel-8.0'. Nov 5 00:02:09 kjcf05n03 systemd-udevd[4946]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:02:09 kjcf05n03 systemd-udevd[4947]: Using default interface naming scheme 'rhel-8.0'. Nov 5 00:02:09 kjcf05n03 systemd-udevd[4947]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[5040]: set_ipoib_cm: ib1 connection mode set to connected Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[5039]: set_ipoib_cm: ib0 connection mode set to connected Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[5067]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[5068]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[5069]: No configuration found for ib1 Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[5070]: No configuration found for ib0 Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[5077]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 5 00:02:09 kjcf05n03 mlnx_interface_mgr[5078]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 5 00:02:09 kjcf05n03 mlnx_conf_mgr[5117]: INFO: No configurations found for mlx5_1, skipping. Nov 5 00:02:09 kjcf05n03 mlnx_conf_mgr[5118]: INFO: No configurations found for mlx5_0, skipping. Nov 5 00:02:09 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 5 00:02:09 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}77095e333c149d2760f06a3fe14503d0493646ea3245fec3d5abb78e8402ab5f' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}77095e333c149d2760f06a3fe14503d0493646ea3245fec3d5abb78e8402ab5f' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}f0f12a46352e38160b55b183926a1aa4a5c8d084cb2a81f38465c2f1140c3110' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}f0f12a46352e38160b55b183926a1aa4a5c8d084cb2a81f38465c2f1140c3110' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}b49703bc9b054ee55256e084ff53307364c52a4fbbddb8d3dbb6cac4c86582b3' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}b49703bc9b054ee55256e084ff53307364c52a4fbbddb8d3dbb6cac4c86582b3' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}f99735458a012ce5d67f684e7cd5f11d2213e350d6bc6923986c6a5f1adc824d' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}f99735458a012ce5d67f684e7cd5f11d2213e350d6bc6923986c6a5f1adc824d' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 5 00:02:09 kjcf05n03 systemd[1]: Stopping NTP client/server... Nov 5 00:02:09 kjcf05n03 chronyd[2200]: chronyd exiting Nov 5 00:02:09 kjcf05n03 systemd[1]: chronyd.service: Succeeded. Nov 5 00:02:09 kjcf05n03 systemd[1]: Stopped NTP client/server. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 5 00:02:09 kjcf05n03 chronyd[5153]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 5 00:02:09 kjcf05n03 chronyd[5153]: Wrong owner of /var/run/chrony (UID != 991) Nov 5 00:02:09 kjcf05n03 chronyd[5153]: Disabled command socket /var/run/chrony/chronyd.sock Nov 5 00:02:09 kjcf05n03 chronyd[5153]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 5 00:02:09 kjcf05n03 systemd[1]: Started NTP client/server. Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 5 00:02:09 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:09 kjcf05n03 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 5 00:02:09 kjcf05n03 systemd[1]: dwd.service: Succeeded. Nov 5 00:02:09 kjcf05n03 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 5 00:02:09 kjcf05n03 dwd[5185]: dwd: vMay 29 2024 : 15:38:26 Nov 5 00:02:09 kjcf05n03 dwd[5185]: /usr/sbin/dwd -i 15 -d Nov 5 00:02:09 kjcf05n03 dwd[5185]: dwd: option Lethal: 0 Nov 5 00:02:09 kjcf05n03 dwd[5185]: dwd: option Interval: 15 Nov 5 00:02:09 kjcf05n03 dwd[5185]: dwd: option abrtlimit: 10 Nov 5 00:02:09 kjcf05n03 dwd[5185]: dwd: option DZPeriod: 604800 Nov 5 00:02:09 kjcf05n03 dwd[5185]: dwd: option SmartPeriod: 43200 Nov 5 00:02:09 kjcf05n03 dwd[5185]: dwd: option SDDEnabled: 1 Nov 5 00:02:09 kjcf05n03 dwd[5185]: dwd: option SDDAwaitScale: 3 Nov 5 00:02:09 kjcf05n03 dwd[5185]: dwd: option SDDAwaitMin: 100 Nov 5 00:02:09 kjcf05n03 dwd[5185]: dwd: option Verbosity: 1 Nov 5 00:02:09 kjcf05n03 dwd[5185]: dwd: option StandAlone: 0 Nov 5 00:02:09 kjcf05n03 dwd[5185]: option Lethal: 0 Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 5 00:02:09 kjcf05n03 dwd[5185]: option Interval: 15 Nov 5 00:02:09 kjcf05n03 dwd[5185]: option abrtlimit: 10 Nov 5 00:02:09 kjcf05n03 dwd[5185]: option DZPeriod: 604800 Nov 5 00:02:09 kjcf05n03 dwd[5185]: option SmartPeriod: 43200 Nov 5 00:02:09 kjcf05n03 dwd[5185]: option SDDEnabled: 1 Nov 5 00:02:09 kjcf05n03 dwd[5185]: option SDDAwaitScale: 3 Nov 5 00:02:09 kjcf05n03 dwd[5185]: option SDDAwaitMin: 100 Nov 5 00:02:09 kjcf05n03 dwd[5185]: option Verbosity: 1 Nov 5 00:02:09 kjcf05n03 dwd[5185]: option StandAlone: 0 Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 5 00:02:09 kjcf05n03 dwd[5186]: option Lethal now set to 1 Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 5 00:02:09 kjcf05n03 dwd[5186]: option abrtlimit now set to 1 Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 5 00:02:09 kjcf05n03 dwd[5186]: option SmartPeriod now set to 86400 Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 5 00:02:09 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 5 00:02:09 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Discard unused blocks. Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:09 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:09 kjcf05n03 python3.9[5215]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 5 00:02:09 kjcf05n03 python3.9[3131]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 5 00:02:09 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Periodic ZFS scrub. Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:09 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 5 00:02:09 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:09 kjcf05n03 systemd[1]: Starting Sed Control Plane worker process... Nov 5 00:02:09 kjcf05n03 sedcpwrkr[5352]: Using config script: /etc/sedcpwrkr.conf Nov 5 00:02:09 kjcf05n03 sedcpwrkr[5352]: - Creating default directory: '/var/log/sedcpwrkr' Nov 5 00:02:09 kjcf05n03 sedcpwrkr[5352]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 5 00:02:09 kjcf05n03 sedcpwrkr[5352]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 5 00:02:09 kjcf05n03 sedcpwrkr[5352]: - Creating default directory: '/var/run/sedcpwrkr' Nov 5 00:02:09 kjcf05n03 sedcpwrkr[5352]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 5 00:02:09 kjcf05n03 sedcpwrkr[5352]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 5 00:02:09 kjcf05n03 sedcpwrkr-server[5383]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 5 00:02:09 kjcf05n03 sedcpwrkr[5352]: celery multi v5.2.7 (dawn-chorus) Nov 5 00:02:09 kjcf05n03 sedcpwrkr[5352]: > Starting nodes... Nov 5 00:02:09 kjcf05n03 sedcpwrkr[5352]: > sedcpwrkr@kjcf05n03: OK Nov 5 00:02:09 kjcf05n03 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 5 00:02:09 kjcf05n03 sedcpwrkr-server[5385]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 5 00:02:09 kjcf05n03 sedcpwrkr-server[5385]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 5 00:02:09 kjcf05n03 sedcpwrkr-server[5385]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 5 00:02:09 kjcf05n03 systemd[1]: Started Sed Control Plane worker process. Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 5 00:02:09 kjcf05n03 systemd[1]: Reloading System Logger Daemon. Nov 5 00:02:09 kjcf05n03 systemd[1]: Reloaded System Logger Daemon. Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 5 00:02:09 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 5 00:02:09 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 5 00:02:09 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:10 kjcf05n03 systemd[1]: Starting IPv4 firewall with iptables... Nov 5 00:02:10 kjcf05n03 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 00:02:10 kjcf05n03 iptables.init[5450]: iptables: Applying firewall rules: [ OK ] Nov 5 00:02:10 kjcf05n03 systemd[1]: Started IPv4 firewall with iptables. Nov 5 00:02:10 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:10 kjcf05n03 systemd[3131]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:10 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:10 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:10 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 5 00:02:10 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 5 00:02:10 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 5 00:02:10 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 5 00:02:10 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 5 00:02:10 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 5 00:02:10 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 5 00:02:10 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 5 00:02:10 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 5 00:02:10 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 5 00:02:11 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 5 00:02:11 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 5 00:02:11 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 00:02:11 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 5 00:02:11 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 5 00:02:11 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 5 00:02:11 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 5 00:02:11 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 5 00:02:11 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 5 00:02:11 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 5 00:02:11 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 5 00:02:11 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 5 00:02:11 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 5 00:02:11 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 5 00:02:11 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 5 00:02:11 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 5 00:02:11 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 5 00:02:11 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 5 00:02:11 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 5 00:02:11 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 5 00:02:11 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 5 00:02:11 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 5 00:02:11 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 5 00:02:11 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 5 00:02:11 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 5 00:02:11 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 5 00:02:11 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 5 00:02:11 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 5 00:02:11 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 5 00:02:11 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 5 00:02:11 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 5 00:02:11 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 5 00:02:11 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 5 00:02:11 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 5 00:02:11 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 5 00:02:11 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 5 00:02:11 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 5 00:02:11 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 5 00:02:11 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 5 00:02:11 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 5 00:02:11 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:11 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 5 00:02:11 kjcf05n03 systemd[1]: openhpid.service: Supervising process 5554 which is not our child. We'll most likely not notice when it exits. Nov 5 00:02:11 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 5 00:02:11 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:11 kjcf05n03 openhpid[5554]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 5 00:02:11 kjcf05n03 openhpid[5554]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 5 00:02:11 kjcf05n03 openhpid[5554]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 5 00:02:11 kjcf05n03 openhpid[5554]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 5 00:02:11 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:12 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:12 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:12 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 5 00:02:12 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 5 00:02:12 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 5 00:02:12 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 5 00:02:12 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:12 kjcf05n03 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 5 00:02:13 kjcf05n03 dcs-collectord[5645]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 5 00:02:13 kjcf05n03 hpi.inv.log[5645]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 5 00:02:13 kjcf05n03 dcs-collectord[5645]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 5 00:02:13 kjcf05n03 dcs-collectord[5645]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 5 00:02:13 kjcf05n03 dcs-collector[5636]: Starting dcs-collector:[ OK ] Nov 5 00:02:13 kjcf05n03 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 5 00:02:13 kjcf05n03 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 5 00:02:13 kjcf05n03 dcs-collectord[5648]: INFO Starting collection for memory_info (collection_process.py:52) Nov 5 00:02:13 kjcf05n03 dcs-collectord[5648]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 5 00:02:13 kjcf05n03 dcs-collectord[5648]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 00:02:13 kjcf05n03 dcs-collectord[5648]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 5 00:02:13 kjcf05n03 dcs-collectord[5648]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 5 00:02:13 kjcf05n03 dcs-collectord[5648]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 5 00:02:13 kjcf05n03 dcs-collectord[5648]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 5 00:02:13 kjcf05n03 dcs-collectord[5648]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259344220", "units": "kB"}, {"name": "MemAvailable", "value": "258623904", "units": "kB"}, {"name": "Buffers", "value": "84336", "units": "kB"}, {"name": "Cached", "value": "1821384", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1687572", "units": "kB"}, {"name": "Inactive", "value": "960336", "units": "kB"}, {"name": "Active(anon)", "value": "1520848", "units": "kB"}, {"name": "Inactive(anon)", "value": "824600", "units": "kB"}, {"name": "Active(file)", "value": "166724", "units": "kB"}, {"name": "Inactive(file)", "value": "135736", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "751700", "units": "kB"}, {"name": "Mapped", "value": "86076", "units": "kB"}, {"name": "Shmem", "value": "1593448", "units": "kB"}, {"name": "KReclaimable", "value": "109068", "units": "kB"}, {"name": "Slab", "value": "275700", "units": "kB"}, {"name": "SReclaimable", "value": "109068", "units": "kB"}, {"name": "SUnreclaim", "value": "166632", "units": "kB"}, {"name": "KernelStack", "value": "9728", "units": "kB"}, {"name": "PageTables", "value": "19716", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3042972", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11392", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "0", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "250184", "units": "kB"}, {"name": "DirectMap2M", "value": "18489344", "units": "kB"}, {"name": "DirectMap1G", "value": "249561088", "units": "kB"}]}' Nov 5 00:02:13 kjcf05n03 dcs-collectord[5648]: INFO Completed collection for memory_info (collection_process.py:59) Nov 5 00:02:13 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:13 kjcf05n03 systemd[3131]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 5 00:02:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 5 00:02:13 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 5 00:02:13 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 5 00:02:13 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:13 kjcf05n03 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 5 00:02:14 kjcf05n03 firmware-update-orc[5729]: Using config script: /etc/firmware_update_orc.conf Nov 5 00:02:14 kjcf05n03 firmware-update-orc[5729]: - Creating default directory: '/var/log/firmware-update-orc' Nov 5 00:02:14 kjcf05n03 firmware-update-orc[5729]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 5 00:02:14 kjcf05n03 firmware-update-orc[5729]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 5 00:02:14 kjcf05n03 firmware-update-orc[5729]: - Creating default directory: '/var/run/firmware-update-orc' Nov 5 00:02:14 kjcf05n03 firmware-update-orc[5729]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 5 00:02:14 kjcf05n03 firmware-update-orc[5729]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 5 00:02:14 kjcf05n03 dcs-collectord[5648]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 5 00:02:14 kjcf05n03 dcs-collectord[5648]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730786532.8315635], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730786534.011324], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730786532.7643716, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 5 00:02:14 kjcf05n03 firmware-update-orc-server[5767]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 5 00:02:14 kjcf05n03 firmware-update-orc[5729]: celery multi v5.2.7 (dawn-chorus) Nov 5 00:02:14 kjcf05n03 firmware-update-orc[5729]: > Starting nodes... Nov 5 00:02:14 kjcf05n03 firmware-update-orc[5729]: > worker1@kjcf05n03: OK Nov 5 00:02:14 kjcf05n03 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 5 00:02:14 kjcf05n03 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 5 00:02:14 kjcf05n03 firmware-update-orc-server[5794]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 5 00:02:14 kjcf05n03 firmware-update-orc-server[5794]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 5 00:02:14 kjcf05n03 firmware-update-orc-server[5794]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 5 00:02:14 kjcf05n03 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 5 00:02:14 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:14 kjcf05n03 systemd[3131]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:14 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:14 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:14 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 5 00:02:14 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 5 00:02:14 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 5 00:02:14 kjcf05n03 dbus-daemon[2152]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 5 00:02:14 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 5 00:02:14 kjcf05n03 dbus-daemon[2152]: [system] Reloaded configuration Nov 5 00:02:14 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 5 00:02:14 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 5 00:02:14 kjcf05n03 dbus-daemon[2152]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 5 00:02:14 kjcf05n03 dbus-daemon[2152]: [system] Reloaded configuration Nov 5 00:02:14 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 5 00:02:14 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 5 00:02:14 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 5 00:02:14 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 5 00:02:14 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:15 kjcf05n03 systemd[1]: Starting Manages hardware resources... Nov 5 00:02:15 kjcf05n03 ras-resource-manager-agent[5910]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 5 00:02:15 kjcf05n03 ras-resource-manager-agent[5896]: Starting ras-resource-manager-agent:[ OK ] Nov 5 00:02:15 kjcf05n03 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 5 00:02:15 kjcf05n03 ras-resource-manager-agent[5912]: INFO Starting the service handler (service_main_handler.py:98) Nov 5 00:02:15 kjcf05n03 ras-resource-manager-client[5912]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 5 00:02:15 kjcf05n03 systemd[1]: Started Manages hardware resources. Nov 5 00:02:15 kjcf05n03 ras-resource-manager-client[5912]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 5 00:02:15 kjcf05n03 ras-resource-manager-client[5922]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 5 00:02:15 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:16 kjcf05n03 systemd[3131]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:16 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:16 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:16 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 5 00:02:16 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 5 00:02:16 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:16 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 5 00:02:16 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:17 kjcf05n03 systemd[3131]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: Press Ctrl+C to exit. Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: Plugin support version 1.0 Nov 5 00:02:17 kjcf05n03 zabbix_agent2[5996]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 00:02:17 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:17 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:17 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:17 kjcf05n03 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 5 00:02:17 kjcf05n03 dcs-notification-sender[6073]: dcs-notification-senderd is stopped Nov 5 00:02:17 kjcf05n03 zabbix-agent2[6087]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 5 00:02:17 kjcf05n03 dcs-notification-sender[6073]: Starting notification-sender:[ OK ] Nov 5 00:02:17 kjcf05n03 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 5 00:02:17 kjcf05n03 zabbix-agent2[6090]: INFO DCS notification agent started. (agent.py:61) Nov 5 00:02:17 kjcf05n03 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 5 00:02:17 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:18 kjcf05n03 systemd[3131]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:18 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:18 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:18 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:18 kjcf05n03 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 5 00:02:18 kjcf05n03 dcs-collectord[6204]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 5 00:02:18 kjcf05n03 dcs-collectord[6204]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 5 00:02:18 kjcf05n03 dcs-bulk-data-sender[6204]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 5 00:02:18 kjcf05n03 dcs-bulk-data-sender[6195]: Starting bulk-data-sender:[ OK ] Nov 5 00:02:18 kjcf05n03 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 5 00:02:18 kjcf05n03 dcs-collectord[6206]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 5 00:02:18 kjcf05n03 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 5 00:02:18 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:19 kjcf05n03 systemd[3131]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:19 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:19 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:19 kjcf05n03 nscd[2141]: 2141 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 5 00:02:19 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 5 00:02:19 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 5 00:02:19 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 5 00:02:19 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 5 00:02:19 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 5 00:02:19 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 5 00:02:19 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 5 00:02:19 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 5 00:02:19 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 5 00:02:19 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 5 00:02:19 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 5 00:02:19 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 5 00:02:19 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 5 00:02:19 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 5 00:02:19 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 00:02:19 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 00:02:19 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 00:02:19 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 5 00:02:20 kjcf05n03 systemd[1]: Stopping System Security Services Daemon... Nov 5 00:02:20 kjcf05n03 sssd[nss][2501]: Shutting down (status = 0) Nov 5 00:02:20 kjcf05n03 sssd[be[implicit_files]][2405]: Shutting down (status = 0) Nov 5 00:02:20 kjcf05n03 systemd[1]: sssd.service: Succeeded. Nov 5 00:02:20 kjcf05n03 systemd[1]: Stopped System Security Services Daemon. Nov 5 00:02:20 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 5 00:02:20 kjcf05n03 python3.9[5215]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 5 00:02:20 kjcf05n03 python3.9[3131]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:20 kjcf05n03 sssd[sssd][6270]: Starting up Nov 5 00:02:20 kjcf05n03 sssd[be[implicit_files]][6283]: Starting up Nov 5 00:02:20 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 5 00:02:20 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 5 00:02:20 kjcf05n03 sssd[nss][6284]: Starting up Nov 5 00:02:20 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 5 00:02:20 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 5 00:02:20 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 5 00:02:21 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 5 00:02:21 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 5 00:02:21 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 5 00:02:21 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 5 00:02:21 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 5 00:02:21 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 5 00:02:21 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure) defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 5 00:02:21 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure: defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 5 00:02:21 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure) defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 5 00:02:21 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure: defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 5 00:02:21 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 5 00:02:21 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 5 00:02:21 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 5 00:02:21 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 5 00:02:21 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:02:21 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:02:21 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:21 kjcf05n03 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 5 00:02:22 kjcf05n03 icinga2[6332]: [2024-11-05 00:02:22 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 5 00:02:22 kjcf05n03 icinga2[6332]: [2024-11-05 00:02:22 -0600] information/cli: Loading configuration file(s). Nov 5 00:02:22 kjcf05n03 icinga2[6332]: [2024-11-05 00:02:22 -0600] information/ConfigItem: Committing config item(s). Nov 5 00:02:22 kjcf05n03 icinga2[6332]: [2024-11-05 00:02:22 -0600] information/ApiListener: My API identity: kjcf05n03 Nov 5 00:02:22 kjcf05n03 icinga2[6332]: [2024-11-05 00:02:22 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 5 00:02:22 kjcf05n03 icinga2[6332]: [2024-11-05 00:02:22 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 5 00:02:22 kjcf05n03 icinga2[6332]: [2024-11-05 00:02:22 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 5 00:02:22 kjcf05n03 icinga2[6332]: [2024-11-05 00:02:22 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 5 00:02:22 kjcf05n03 icinga2[6332]: [2024-11-05 00:02:22 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 5 00:02:22 kjcf05n03 icinga2[6332]: [2024-11-05 00:02:22 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 5 00:02:22 kjcf05n03 icinga2[6332]: [2024-11-05 00:02:22 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 5 00:02:22 kjcf05n03 icinga2[6332]: [2024-11-05 00:02:22 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 5 00:02:22 kjcf05n03 icinga2[6332]: [2024-11-05 00:02:22 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 5 00:02:22 kjcf05n03 icinga2[6332]: [2024-11-05 00:02:22 -0600] information/cli: Closing console log. Nov 5 00:02:22 kjcf05n03 systemd[1]: Started Icinga host/service/network monitoring system. Nov 5 00:02:22 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:22 kjcf05n03 systemd[3131]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:22 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:22 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:22 kjcf05n00 zabbix-server[2562117]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:02:22 kjcf05n00 zabbix-server[2562117]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 334.85\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 223.1\\"}}"' Nov 5 00:02:22 kjcf05n00 log_interesting_event.py[2562117]: Event '46850' acknowledged Nov 5 00:02:23 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 5 00:02:23 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 5 00:02:23 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:23 kjcf05n03 systemd[1]: Started Icinga2 network monitor. Nov 5 00:02:23 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:24 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 5 00:02:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 5 00:02:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 5 00:02:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 5 00:02:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 5 00:02:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 5 00:02:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 5 00:02:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 5 00:02:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 5 00:02:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 5 00:02:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 5 00:02:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 5 00:02:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 5 00:02:24 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 5 00:02:24 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 5 00:02:24 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 5 00:02:24 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 5 00:02:24 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:24 kjcf05n03 systemd[1]: Starting Naming services LDAP client daemon.... Nov 5 00:02:24 kjcf05n03 nslcd[6944]: version 0.9.9 starting Nov 5 00:02:24 kjcf05n03 nslcd[6944]: accepting connections Nov 5 00:02:24 kjcf05n03 systemd[1]: Started Naming services LDAP client daemon.. Nov 5 00:02:24 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:25 kjcf05n03 dcs-bulk-data-sender[6206]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 5 00:02:25 kjcf05n03 dcs-collectord[6206]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 5 00:02:25 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:25 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:25 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:25 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 5 00:02:25 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 5 00:02:25 kjcf05n00 mcfcli[3673891]: %3|1730786545.189|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 00:02:25 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 5 00:02:25 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 5 00:02:25 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 5 00:02:26 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 5 00:02:26 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 5 00:02:26 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 5 00:02:26 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:27 kjcf05n03 systemd[1]: Starting DEAR Control Plane worker process... Nov 5 00:02:27 kjcf05n03 dearcpw[7189]: Using config script: /etc/dearcpw.conf Nov 5 00:02:27 kjcf05n03 dearcpw[7189]: - Creating default directory: '/var/log/dearcpw' Nov 5 00:02:27 kjcf05n03 dearcpw[7189]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 5 00:02:27 kjcf05n03 dearcpw[7189]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 5 00:02:27 kjcf05n03 dearcpw[7189]: - Creating default directory: '/var/run/dearcpw' Nov 5 00:02:27 kjcf05n03 dearcpw[7189]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 5 00:02:27 kjcf05n03 dearcpw[7189]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 5 00:02:27 kjcf05n03 dearcpw-server[7229]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 5 00:02:27 kjcf05n03 dearcpw[7189]: celery multi v5.2.7 (dawn-chorus) Nov 5 00:02:27 kjcf05n03 dearcpw[7189]: > Starting nodes... Nov 5 00:02:27 kjcf05n03 dearcpw[7189]: > dearcpw@kjcf05n03: OK Nov 5 00:02:27 kjcf05n03 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 5 00:02:27 kjcf05n03 dearcpw-server[7244]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 5 00:02:27 kjcf05n03 dearcpw-server[7244]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 5 00:02:27 kjcf05n03 dearcpw-server[7244]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 5 00:02:27 kjcf05n03 systemd[1]: Started DEAR Control Plane worker process. Nov 5 00:02:27 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:27 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:27 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 5 00:02:27 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 5 00:02:27 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 5 00:02:27 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 5 00:02:27 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 5 00:02:27 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 5 00:02:27 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 5 00:02:27 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 5 00:02:27 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 5 00:02:27 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 5 00:02:27 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:47054). Nov 5 00:02:27 kjcf05n01 rsyncd[3969840]: connect from kjcf05n03 (172.16.2.6) Nov 5 00:02:27 kjcf05n01 rsyncd[3969840]: rsync to puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 5 00:02:27 kjcf05n01 rsyncd[3969840]: receiving file list Nov 5 00:02:27 kjcf05n01 rsyncd[3969840]: sent 29 bytes received 325 bytes total size 10901 Nov 5 00:02:27 kjcf05n01 systemd[1]: rsyncd@676-172.16.2.2:873-172.16.2.6:47054.service: Succeeded. Nov 5 00:02:27 kjcf05n03 puppet[7434]: IEC: 017000000: Node is up and running: { "node": "kjcf05n03" } Nov 5 00:02:27 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 5 00:02:27 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 5 00:02:27 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 5 00:02:27 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 5 00:02:27 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 5 00:02:27 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 5 00:02:27 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 5 00:02:27 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 5 00:02:28 kjcf05n03 dcs-collectord[5648]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 00:02:28 kjcf05n03 dcs-collectord[5648]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 5 00:02:28 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 5 00:02:28 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 5 00:02:28 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 5 00:02:28 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 5 00:02:28 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 5 00:02:28 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 5 00:02:29 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 5 00:02:29 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 5 00:02:29 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 5 00:02:29 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 5 00:02:30 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 5 00:02:30 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 5 00:02:30 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 5 00:02:30 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 5 00:02:30 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 5 00:02:30 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 5 00:02:30 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:30 kjcf05n03 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 5 00:02:31 kjcf05n03 ipmievd[3985]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 5 00:02:31 kjcf05n03 ipmievd[3985]: System Event sensor - Timestamp Clock Sync Nov 5 00:02:31 kjcf05n03 ipmievd[3131]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:31 kjcf05n03 diskless-swap[7615]: HA_PS_000: recovering journal Nov 5 00:02:31 kjcf05n03 systemd-udevd[1570]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 00:02:31 kjcf05n03 diskless-swap[7615]: HA_PS_000: clean, 2290/6400 files, 7062/25600 blocks Nov 5 00:02:31 kjcf05n03 diskless-swap[7615]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 5 00:02:31 kjcf05n03 diskless-swap[7615]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 5 00:02:31 kjcf05n03 diskless-swap[7615]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 5 00:02:31 kjcf05n03 diskless-swap[7615]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 5 00:02:31 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 5 00:02:31 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:31 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:31 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 5 00:02:31 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 5 00:02:31 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 5 00:02:31 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 5 00:02:31 kjcf05n03 systemd[1]: Stopping OpenSSH server daemon... Nov 5 00:02:31 kjcf05n03 systemd[1]: sshd.service: Succeeded. Nov 5 00:02:31 kjcf05n03 systemd[1]: Stopped OpenSSH server daemon. Nov 5 00:02:31 kjcf05n03 systemd[1]: Stopped target sshd-keygen.target. Nov 5 00:02:31 kjcf05n03 systemd[1]: Stopping sshd-keygen.target. Nov 5 00:02:31 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 5 00:02:31 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 5 00:02:31 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 5 00:02:31 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 5 00:02:31 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 5 00:02:32 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 5 00:02:32 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 5 00:02:32 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 5 00:02:32 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 5 00:02:32 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 5 00:02:32 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 5 00:02:33 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 5 00:02:33 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 5 00:02:33 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 5 00:02:33 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 5 00:02:34 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 5 00:02:34 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 5 00:02:34 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 5 00:02:34 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 5 00:02:34 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 5 00:02:34 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 5 00:02:34 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 5 00:02:34 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 5 00:02:34 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:35 kjcf05n03 systemd[1]: Set up automount opt-firmware.automount. Nov 5 00:02:35 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:35 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:35 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 5 00:02:35 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 5 00:02:35 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:35 kjcf05n03 systemd[1]: Set up automount mnt-llog.automount. Nov 5 00:02:35 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:35 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:35 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 5 00:02:35 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 5 00:02:35 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:35 kjcf05n03 systemd[1]: Set up automount usr-share-man.automount. Nov 5 00:02:36 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:36 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:36 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 5 00:02:36 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 5 00:02:36 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 5 00:02:36 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 5 00:02:36 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 5 00:02:36 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 5 00:02:36 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 5 00:02:36 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 5 00:02:36 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 00:02:36 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 00:02:36 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:36 kjcf05n03 systemd[1]: Starting Crash recovery kernel arming... Nov 5 00:02:36 kjcf05n03 kdumpctl[7855]: kdump: No kdump initial ramdisk found. Nov 5 00:02:36 kjcf05n03 kdumpctl[7855]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 5 00:02:36 kjcf05n03 dracut[7967]: dracut-049-135.git20210121.el8 Nov 5 00:02:36 kjcf05n00 mcfcli[3673891]: %3|1730786556.360|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:02:37 kjcf05n03 dracut[7969]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 5 00:02:37 kjcf05n03 dracut[7969]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 5 00:02:37 kjcf05n03 dracut[7969]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 5 00:02:37 kjcf05n03 dracut[7969]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 5 00:02:37 kjcf05n03 dracut[7969]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 5 00:02:37 kjcf05n03 dracut[7969]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 5 00:02:37 kjcf05n03 dracut[7969]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 5 00:02:37 kjcf05n03 dracut[7969]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + is_func check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ type -t check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 0 -ne 0 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check -h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local dev holder Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + require_binaries mdadm expr Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _module_name=90hperaid Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ mdadm = \-\m ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for cmd in "$@" Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + find_binary mdadm Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for cmd in "$@" Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + find_binary expr Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n -h ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for dev in "${!host_fs_types[@]}" Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ nfs != *_raid_member ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + continue Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _ret=255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + ret=255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ 255 = 0 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ 255 = 255 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ module_depends hperaid Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: +++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: +++ set -x Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ depends Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo rootfs-block Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ return 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ _ret=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ return 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for _moddep in $(module_depends $_mod) Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all == *\ hperaid\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + add_dracutmodules+=' rootfs-block ' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ == *\ hperaid\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check_module rootfs-block Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _mod=rootfs-block Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddep Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ == *\ rootfs-block\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n '' ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + mods_checked_as_dep+=' rootfs-block ' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all == *\ rootfs-block\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + module_check rootfs-block 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 5 00:02:37 kjcf05n03 kdumpctl[3131]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _forced=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 2 -eq 2 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _forced=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + is_func check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ type -t check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 0 -ne 0 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check -h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _ret=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + ret=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ 0 = 0 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ module_depends rootfs-block Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: +++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 5 00:02:37 kjcf05n03 kdumpctl[3131]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ depends Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo fs-lib Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ _ret=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ return 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for _moddep in $(module_depends $_mod) Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all == *\ rootfs-block\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + add_dracutmodules+=' fs-lib ' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ == *\ rootfs-block\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check_module fs-lib Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _mod=fs-lib Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddep Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n '' ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + mods_checked_as_dep+=' fs-lib ' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all == *\ fs-lib\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + module_check fs-lib 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _forced=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 2 -eq 2 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _forced=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + is_func check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ type -t check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 0 -ne 0 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check -h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _ret=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + ret=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ 0 = 0 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ module_depends fs-lib Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: +++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ depends Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ return 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ _ret=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ return 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + mods_to_load+=' fs-lib ' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + mods_to_load+=' rootfs-block ' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + mods_to_load+=' hperaid ' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _mod=90kernel-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _mod=kernel-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check_module kernel-modules 1 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _mod=kernel-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddep Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n 1 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all = all ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + module_check kernel-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _forced=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 1 -eq 2 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + is_func check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ type -t check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 0 -ne 0 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check -h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + true Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _ret=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + ret=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ 0 != 0 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ module_depends kernel-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: +++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ depends Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ true Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ _ret=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ return 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + mods_to_load+=' kernel-modules ' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _mod=90kernel-modules-extra Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _mod=kernel-modules-extra Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check_module kernel-modules-extra 1 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _mod=kernel-modules-extra Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddep Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n 1 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all = all ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + module_check kernel-modules-extra Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _forced=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 1 -eq 2 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + is_func check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ type -t check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 0 -ne 0 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check -h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + true Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _ret=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + ret=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ 0 != 0 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ module_depends kernel-modules-extra Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: +++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ depends Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ true Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ _ret=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ return 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + mods_to_load+=' kernel-modules-extra ' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _mod=90kernel-network-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _mod=kernel-network-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check_module kernel-network-modules 1 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _mod=kernel-network-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddep Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n 1 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all = all ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + module_check kernel-network-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _forced=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 1 -eq 2 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + is_func check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ type -t check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 0 -ne 0 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check -h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _ret=255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + ret=255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ 255 != 0 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n 1 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 1 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _mod=90livenet Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _mod=livenet Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check_module livenet 1 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _mod=livenet Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddep Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n 1 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all = all ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + module_check livenet Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _forced=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 1 -eq 2 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + is_func check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ type -t check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 0 -ne 0 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check -h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _ret=255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + ret=255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ 255 != 0 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n 1 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 1 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _mod=90lvm Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _mod=lvm Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check_module lvm 1 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _mod=lvm Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddep Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n 1 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all = all ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + module_check lvm Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _forced=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 1 -eq 2 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + is_func check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ type -t check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 0 -ne 0 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check -h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + require_binaries lvm Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _module_name=90lvm Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ lvm = \-\m ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for cmd in "$@" Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + find_binary lvm Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n -h ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for fs in "${host_fs_types[@]}" Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ nfs = LVM*_member ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _ret=255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + ret=255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ 255 != 0 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n 1 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 1 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _mod=90mdraid Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _mod=mdraid Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check_module mdraid 1 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _mod=mdraid Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddep Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n 1 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all = all ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + module_check mdraid Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _forced=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 1 -eq 2 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + is_func check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ type -t check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 0 -ne 0 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check -h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _rootdev Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + require_binaries mdadm expr Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _module_name=90mdraid Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ mdadm = \-\m ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for cmd in "$@" Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + find_binary mdadm Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for cmd in "$@" Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + find_binary expr Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n -h ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for dev in "${!host_fs_types[@]}" Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ nfs != *_raid_member ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + continue Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _ret=255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + ret=255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ 255 != 0 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n 1 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 1 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _mod=90multipath Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _mod=multipath Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check_module multipath 1 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _mod=multipath Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddep Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n 1 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all = all ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + module_check multipath Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _forced=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 1 -eq 2 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + is_func check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ type -t check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 0 -ne 0 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check -h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _rootdev Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n -h ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for_each_host_dev_and_slaves is_mpath Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _func=is_mpath Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _dev Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for _dev in "${host_devs[@]}" Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + continue Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 1 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _ret=255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + ret=255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ 255 != 0 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n 1 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 1 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _mod=90qemu Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _mod=qemu Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check_module qemu 1 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _mod=qemu Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddep Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n 1 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all = all ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + module_check qemu Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _forced=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 1 -eq 2 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + is_func check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ type -t check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 0 -ne 0 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check -h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n -h ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + type -P systemd-detect-virt Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ systemd-detect-virt --vm Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + vm=none Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + (( 1 != 0 )) Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _ret=255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + ret=255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ 255 != 0 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n 1 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 1 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _mod=90qemu-net Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _mod=qemu-net Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check_module qemu-net 1 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _mod=qemu-net Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddep Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n 1 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all = all ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + module_check qemu-net Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _forced=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 1 -eq 2 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + is_func check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ type -t check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 0 -ne 0 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check -h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n -h ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + type -P systemd-detect-virt Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ systemd-detect-virt --vm Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + vm= Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + (( 1 != 0 )) Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _ret=255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + ret=255 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ 255 != 0 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n 1 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + return 1 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _mod=90stratis Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + _mod=stratis Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check_module stratis 1 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _mod=stratis Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddep Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -n 1 ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ all = all ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + module_check stratis Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ read a b Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _forced=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _hostonly=-h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 1 -eq 2 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + is_func check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: ++ type -t check Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + '[' 0 -ne 0 ']' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + check -h Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _module_name=90stratis Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + local _ret=0 Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + [[ stratisd-init = \-\m ]] Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + for cmd in "$@" Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + find_binary stratisd-init Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 5 00:02:37 kjcf05n03 kdumpctl[7855]: + set +x Nov 5 00:02:37 kjcf05n03 dracut[7969]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 5 00:02:37 kjcf05n03 dracut[7969]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 5 00:02:37 kjcf05n03 dracut[7969]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 5 00:02:37 kjcf05n03 dracut[7969]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 5 00:02:37 kjcf05n03 dracut[7969]: memstrack is available Nov 5 00:02:37 kjcf05n03 dracut[7969]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 5 00:02:37 kjcf05n03 dracut[7969]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 5 00:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 5 00:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 5 00:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 5 00:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 5 00:02:37 kjcf05n03 dracut[7969]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 5 00:02:37 kjcf05n03 dracut[7969]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 5 00:02:37 kjcf05n03 dracut[7969]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 5 00:02:37 kjcf05n03 dracut[7969]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 5 00:02:38 kjcf05n03 dracut[7969]: *** Including module: bash *** Nov 5 00:02:38 kjcf05n03 dracut[7969]: *** Including module: systemd *** Nov 5 00:02:38 kjcf05n03 dracut[7969]: *** Including module: fips *** Nov 5 00:02:39 kjcf05n03 dracut[7969]: *** Including module: systemd-initrd *** Nov 5 00:02:39 kjcf05n03 dracut[7969]: *** Including module: watchdog-modules *** Nov 5 00:02:39 kjcf05n03 dracut[7969]: *** Including module: nss-softokn *** Nov 5 00:02:39 kjcf05n03 dracut[7969]: *** Including module: i18n *** Nov 5 00:02:39 kjcf05n03 dracut[7969]: No KEYMAP configured. Nov 5 00:02:39 kjcf05n03 dracut[7969]: *** Including module: network-legacy *** Nov 5 00:02:40 kjcf05n03 dracut[7969]: *** Including module: network *** Nov 5 00:02:40 kjcf05n03 dracut[7969]: *** Including module: ib_bonding *** Nov 5 00:02:40 kjcf05n03 dracut[7969]: *** Including module: drm *** Nov 5 00:02:43 kjcf05n03 dcs-collectord[5648]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 00:02:43 kjcf05n03 dcs-collectord[5648]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 5 00:02:43 kjcf05n03 dracut[7969]: *** Including module: hperaid *** Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + install Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + local rule rule_path Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + inst_multiple cat expr Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.4EF4QM/initramfs -a -f cat expr Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + _ret=0 Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + (( 0 != 0 )) Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + : Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + return 0 Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + inst_multiple -o mdmon Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.4EF4QM/initramfs -a -f -o mdmon Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + _ret=0 Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + (( 0 != 0 )) Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + : Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + return 0 Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: ++ command -v partx Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + inst /usr/sbin/partx /sbin/partx Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + local _hostonly_install Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + [[ /usr/sbin/partx == \-\H ]] Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + [[ -e /tmp/dracut.4EF4QM/initramfs//sbin/partx ]] Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.4EF4QM/initramfs -f /usr/sbin/partx /sbin/partx Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + (( 0 != 0 )) Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + : Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: ++ command -v mdadm Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + local _hostonly_install Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + [[ -e /tmp/dracut.4EF4QM/initramfs//sbin/mdadm ]] Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.4EF4QM/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + (( 0 != 0 )) Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + : Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + [[ yes == \y\e\s ]] Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + local _raidconf Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: ++ cmdline Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: ++ local _activated dev line UUID Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: ++ declare -A _activated Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: ++ for dev in "${!host_fs_types[@]}" Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: ++ [[ nfs != *_raid_member ]] Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: ++ continue Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + _raidconf= Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + [[ -n '' ]] Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + inst_rules 64-md-raid.rules Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + local _target=/etc/udev/rules.d _rule _found Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + inst_dir /usr/lib/udev/rules.d Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + [[ -e /tmp/dracut.4EF4QM/initramfs//usr/lib/udev/rules.d ]] Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + return 0 Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + inst_dir /etc/udev/rules.d Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + [[ -e /tmp/dracut.4EF4QM/initramfs//etc/udev/rules.d ]] Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + return 0 Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + for _rule in "$@" Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + continue Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + continue Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + for r in '' $dracutbasedir/rules.d/ Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + [[ 64-md-raid.rules != /* ]] Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + continue Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + for r in '' $dracutbasedir/rules.d/ Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + continue Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + [[ -n '' ]] Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 5 00:02:43 kjcf05n03 kdumpctl[7855]: + set +x Nov 5 00:02:43 kjcf05n03 dracut[7969]: Skipping udev rule: 64-md-raid.rules Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + installkernel Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + instmods =drivers/md Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + local _optional=-o Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + local _silent Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + local _ret Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + [[ '' = yes ]] Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + [[ =drivers/md = \-\c ]] Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + [[ =drivers/md = \-\s ]] Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + (( 1 == 0 )) Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.4EF4QM/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + _ret=0 Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + (( 0 != 0 )) Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + [[ -n '' ]] Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + return 0 Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + _ret=0 Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + unset check depends cmdline install installkernel Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + return 0 Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + modules_loaded+='hperaid ' Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + '[' -n '' ']' Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + _d_mod=90kernel-modules Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + _d_mod=kernel-modules Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + [[ '' = yes ]] Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + dinfo '*** Including module: kernel-modules ***' Nov 5 00:02:44 kjcf05n03 kdumpctl[7855]: + set +x Nov 5 00:02:44 kjcf05n03 dracut[7969]: *** Including module: kernel-modules *** Nov 5 00:02:44 kjcf05n03 dracut[7969]: *** Including module: kernel-modules-extra *** Nov 5 00:02:45 kjcf05n03 dracut[7969]: *** Including module: kernel-network-modules *** Nov 5 00:02:45 kjcf05n03 dracut[7969]: *** Including module: diskless-mod *** Nov 5 00:02:45 kjcf05n03 dracut[7969]: *** Including module: fstab-sys *** Nov 5 00:02:45 kjcf05n03 dracut[7969]: *** Including module: nfs *** Nov 5 00:02:45 kjcf05n03 dracut[7969]: *** Including module: rootfs-block *** Nov 5 00:02:45 kjcf05n03 dracut[7969]: *** Including module: terminfo *** Nov 5 00:02:45 kjcf05n03 dracut[7969]: *** Including module: udev-rules *** Nov 5 00:02:46 kjcf05n03 dracut[7969]: Skipping udev rule: 91-permissions.rules Nov 5 00:02:46 kjcf05n03 dracut[7969]: Skipping udev rule: 80-drivers-modprobe.rules Nov 5 00:02:46 kjcf05n03 dracut[7969]: *** Including module: dracut-systemd *** Nov 5 00:02:46 kjcf05n00 zabbix-server[2562248]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:02:46 kjcf05n00 zabbix-server[2562248]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 221.72\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 233.08\\"}}"' Nov 5 00:02:46 kjcf05n00 log_interesting_event.py[2562248]: Event '46851' acknowledged Nov 5 00:02:46 kjcf05n03 dracut[7969]: *** Including module: usrmount *** Nov 5 00:02:46 kjcf05n03 dracut[7969]: *** Including module: base *** Nov 5 00:02:47 kjcf05n03 dracut[7969]: *** Including module: fs-lib *** Nov 5 00:02:47 kjcf05n03 dracut[7969]: *** Including module: kdumpbase *** Nov 5 00:02:47 kjcf05n03 dracut[7969]: *** Including module: memstrack *** Nov 5 00:02:47 kjcf05n03 dracut[7969]: *** Including module: shutdown *** Nov 5 00:02:47 kjcf05n03 dracut[7969]: *** Including module: squash *** Nov 5 00:02:48 kjcf05n03 dracut[7969]: *** Including modules done *** Nov 5 00:02:48 kjcf05n03 dracut[7969]: *** Installing kernel module dependencies *** Nov 5 00:02:48 kjcf05n03 dracut[7969]: *** Installing kernel module dependencies done *** Nov 5 00:02:48 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n03": interface became available Nov 5 00:02:48 kjcf05n03 dracut[7969]: *** Resolving executable dependencies *** Nov 5 00:02:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730786568', 'host':'kjcf05n03', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.4% (3683588 kB) used.'}"] Nov 5 00:02:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'RAM usage', 'description': 'OK - 1.4% (3683588 kB) used.', 'message': 'OK - 1.4% (3683588 kB) used.', 'value': 'ok', 'timestamp': '1730786568'} Nov 5 00:02:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:02:49 kjcf05n03 dracut[7969]: *** Resolving executable dependencies done*** Nov 5 00:02:49 kjcf05n03 dracut[7969]: *** Hardlinking files *** Nov 5 00:02:49 kjcf05n03 dracut[7969]: *** Hardlinking files done *** Nov 5 00:02:49 kjcf05n03 dracut[7969]: *** Generating early-microcode cpio image *** Nov 5 00:02:49 kjcf05n03 dracut[7969]: *** Constructing AuthenticAMD.bin **** Nov 5 00:02:49 kjcf05n03 dracut[7969]: *** Store current command line parameters *** Nov 5 00:02:49 kjcf05n03 dracut[7969]: Stored kernel commandline: Nov 5 00:02:49 kjcf05n03 dracut[7969]: rd.driver.pre=sd_mod Nov 5 00:02:49 kjcf05n03 dracut[7969]: rd.driver.pre=nvme Nov 5 00:02:49 kjcf05n03 dracut[7969]: rd.driver.pre=ipmi_si Nov 5 00:02:49 kjcf05n03 dracut[7969]: rd.driver.pre=ipmi_devintf Nov 5 00:02:49 kjcf05n03 dracut[7969]: rd.driver.pre=ipmi_msghandler Nov 5 00:02:49 kjcf05n03 dracut[7969]: nameserver=172.16.2.2 Nov 5 00:02:49 kjcf05n03 dracut[7969]: nameserver=127.0.0.1 Nov 5 00:02:49 kjcf05n03 dracut[7969]: nameserver=172.16.2.2 Nov 5 00:02:49 kjcf05n03 dracut[7969]: nameserver=127.0.0.1 Nov 5 00:02:49 kjcf05n03 dracut[7969]: ifname=kdump-meth0:00:09:3d:06:9a:1a team=mgmt0:kdump-meth0 Nov 5 00:02:49 kjcf05n03 dracut[7969]: rd.neednet Nov 5 00:02:49 kjcf05n03 dracut[7969]: kdumpnic=mgmt0 Nov 5 00:02:49 kjcf05n03 dracut[7969]: bootdev=mgmt0 Nov 5 00:02:49 kjcf05n03 dracut[7969]: *** Install squash loader *** Nov 5 00:02:49 kjcf05n00 zabbix-server[2562259]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:02:49 kjcf05n00 zabbix-server[2562259]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 5 00:02:49 kjcf05n00 log_interesting_event.py[2562259]: Event '46852' acknowledged Nov 5 00:02:50 kjcf05n03 dracut[7969]: *** Squashing the files inside the initramfs *** Nov 5 00:02:50 kjcf05n03 dracut[7969]: *** Squashing the files inside the initramfs done *** Nov 5 00:02:50 kjcf05n03 dracut[7969]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 5 00:02:50 kjcf05n03 dracut[7969]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 5 00:02:51 kjcf05n03 kdumpctl[7855]: kdump: kexec: loaded kdump kernel Nov 5 00:02:51 kjcf05n03 kdumpctl[7855]: kdump: Starting kdump: [OK] Nov 5 00:02:51 kjcf05n03 systemd[1]: Started Crash recovery kernel arming. Nov 5 00:02:51 kjcf05n03 systemd[1]: Reloading. Nov 5 00:02:51 kjcf05n03 systemd[3131]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:02:51 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:02:51 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:02:51 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 5 00:02:51 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 5 00:02:51 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 5 00:02:51 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 5 00:02:51 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 5 00:02:51 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 5 00:02:51 kjcf05n03 ifdown[14551]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 00:02:51 kjcf05n03 ifdown[14552]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:02:51 kjcf05n03 ifdown[14553]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:02:52 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 5 00:02:52 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 5 00:02:52 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 5 00:02:52 kjcf05n03 ifup[14627]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 00:02:52 kjcf05n03 ifup[14628]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:02:52 kjcf05n03 ifup[14630]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:02:52 kjcf05n00 zabbix-server[2562266]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:02:52 kjcf05n00 zabbix-server[2562266]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n03 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n03:system.uptime): 00:02:53\\"}}"' Nov 5 00:02:52 kjcf05n00 log_interesting_event.py[2562266]: Event '46853' acknowledged Nov 5 00:02:52 kjcf05n00 zabbix-server[2562267]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:02:52 kjcf05n00 zabbix-server[2562267]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n03:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 5 00:02:53 kjcf05n00 log_interesting_event.py[2562267]: Event '46854' acknowledged Nov 5 00:02:54 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 5 00:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 5 00:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 5 00:02:55 kjcf05n00 mcfcli[3673891]: %3|1730786575.617|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 00:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 5 00:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 5 00:02:56 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 5 00:02:57 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 00:02:57 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 00:02:57 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:02:57 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:02:57 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:02:57 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:02:57 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 5 00:02:57 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 5 00:02:57 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 00:02:57 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 00:02:57 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:02:57 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:02:57 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:02:57 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:02:57 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 5 00:02:57 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 5 00:02:57 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 5 00:02:57 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 5 00:02:57 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 5 00:02:57 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 5 00:02:57 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 5 00:02:57 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 5 00:02:57 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 5 00:02:57 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 5 00:02:57 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 5 00:02:57 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 5 00:02:57 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 5 00:02:57 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 5 00:02:57 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 5 00:02:57 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 5 00:02:57 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 5 00:02:57 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 5 00:02:57 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 5 00:02:57 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 5 00:02:57 kjcf05n03 ifdown[14811]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 00:02:57 kjcf05n03 ifdown[14812]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:02:57 kjcf05n03 ifdown[14813]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:02:57 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 5 00:02:57 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 5 00:02:57 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 5 00:02:57 kjcf05n03 ifup[14887]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 00:02:57 kjcf05n03 ifup[14888]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:02:57 kjcf05n03 ifup[14889]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:02:58 kjcf05n03 dcs-collectord[5648]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 00:02:58 kjcf05n03 dcs-collectord[5648]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 5 00:02:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 5 00:02:59 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 5 00:03:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 5 00:03:00 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 5 00:03:00 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 5 00:03:00 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 5 00:03:00 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n03: info_xyraid ERR40: HA services are not running Nov 5 00:03:00 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n03: ssh exited with exit code 1 Nov 5 00:03:01 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 5 00:03:01 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 5 00:03:01 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 5 00:03:01 kjcf05n03 systemd[1]: Reloading. Nov 5 00:03:02 kjcf05n03 systemd[1]: Starting Corosync Cluster Engine... Nov 5 00:03:02 kjcf05n03 await_ha_peer[15159]: Waiting for HA peer kjcf05n02 Nov 5 00:03:03 kjcf05n03 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 5 00:03:03 kjcf05n03 await_ha_peer[15159]: Peer kjcf05n02 has started, starting HA Nov 5 00:03:03 kjcf05n03 systemd[1]: Started Corosync Cluster Engine. Nov 5 00:03:03 kjcf05n03 systemd[1]: Started Fast STONITH daemon. Nov 5 00:03:03 kjcf05n03 fstonithd.py[15201]: Listening for kdump packets from partner Nov 5 00:03:03 kjcf05n03 systemd[1]: Reloading. Nov 5 00:03:04 kjcf05n03 systemd[3131]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:03:04 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:03:04 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:03:04 kjcf05n03 systemd[1]: Reloading. Nov 5 00:03:04 kjcf05n03 systemd[1]: Reached target resource-agents dependencies. Nov 5 00:03:04 kjcf05n03 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 5 00:03:04 kjcf05n03 systemd[1]: Reloading. Nov 5 00:03:05 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 5 00:03:05 kjcf05n01 systemd[1]: unbound-anchor.service: Succeeded. Nov 5 00:03:05 kjcf05n01 systemd[1]: Started update of the root trust anchor for DNSSEC validation in unbound. Nov 5 00:03:05 kjcf05n03 puppet-agent[3572]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:03:05 kjcf05n03 puppet[3572]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:03:05 kjcf05n03 puppet-agent[3572]: Applied catalog in 92.94 seconds Nov 5 00:03:05 kjcf05n03 puppet[3572]: Notice: Applied catalog in 92.94 seconds Nov 5 00:03:05 kjcf05n03 systemd[1]: Started Puppet agent. Nov 5 00:03:05 kjcf05n03 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 5 00:03:05 kjcf05n03 systemd[1]: Started Collect SAS Health Report every hour. Nov 5 00:03:05 kjcf05n03 systemd[1]: Reached target Timers. Nov 5 00:03:05 kjcf05n03 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 5 00:03:05 kjcf05n03 systemd[1]: Started Startup script for monitoring-ec-node. Nov 5 00:03:05 kjcf05n03 systemd[1]: Started Startup script for gateway-ec-node. Nov 5 00:03:05 kjcf05n03 systemd[1]: Starting Set absolute GEM time... Nov 5 00:03:05 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 5 00:03:05 kjcf05n03 systemd[1]: Started Service to do FW and inventory check on boot. Nov 5 00:03:05 kjcf05n03 wce-disable.sh[15349]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 5 00:03:05 kjcf05n03 systemd[1]: disable-write-cache.service: Succeeded. Nov 5 00:03:05 kjcf05n03 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 5 00:03:05 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 5 00:03:05 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 5 00:03:05 kjcf05n03 systemd[1]: set_gem_time.service: Succeeded. Nov 5 00:03:05 kjcf05n03 systemd[1]: Started Set absolute GEM time. Nov 5 00:03:05 kjcf05n03 python3.9[15351]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 5 00:03:05 kjcf05n03 gateway-ec-node.py[15352]: Starting gateway-ec-node service Nov 5 00:03:05 kjcf05n03 python3.9[15351]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 5 00:03:05 kjcf05n03 RFSF-API[15350]: INFO[2024-11-05T00:03:05-06:00] Datapath API RESTful Service starting Nov 5 00:03:05 kjcf05n03 dp-api-server-node[15350]: INFO[2024-11-05T00:03:05-06:00] Datapath API RESTful Service starting Nov 5 00:03:05 kjcf05n03 RFSF-API[15350]: INFO[2024-11-05T00:03:05-06:00] Running in production mode, starting dbus event listener Nov 5 00:03:05 kjcf05n03 dp-api-server-node[15350]: INFO[2024-11-05T00:03:05-06:00] Running in production mode, starting dbus event listener Nov 5 00:03:05 kjcf05n03 RFSF-API[15350]: INFO[2024-11-05T00:03:05-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 5 00:03:05 kjcf05n03 dp-api-server-node[15350]: INFO[2024-11-05T00:03:05-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 5 00:03:05 kjcf05n03 RFSF-API[15350]: INFO[2024-11-05T00:03:05-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 5 00:03:05 kjcf05n03 dp-api-server-node[15350]: INFO[2024-11-05T00:03:05-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 5 00:03:05 kjcf05n03 dp-api-server-node[15350]: INFO[2024-11-05T00:03:05-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 5 00:03:05 kjcf05n03 RFSF-API[15350]: INFO[2024-11-05T00:03:05-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 5 00:03:05 kjcf05n03 RFSF-API[15350]: INFO[2024-11-05T00:03:05-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 5 00:03:05 kjcf05n03 dp-api-server-node[15350]: INFO[2024-11-05T00:03:05-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 5 00:03:05 kjcf05n03 RFSF-API[15350]: INFO[2024-11-05T00:03:05-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 5 00:03:05 kjcf05n03 dp-api-server-node[15350]: INFO[2024-11-05T00:03:05-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 5 00:03:05 kjcf05n03 RFSF-API[15350]: INFO[2024-11-05T00:03:05-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 5 00:03:05 kjcf05n03 dp-api-server-node[15350]: INFO[2024-11-05T00:03:05-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 5 00:03:05 kjcf05n03 RFSF-API[15350]: INFO[2024-11-05T00:03:05-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 5 00:03:05 kjcf05n03 dp-api-server-node[15350]: INFO[2024-11-05T00:03:05-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 5 00:03:05 kjcf05n03 RFSF-API[15350]: INFO[2024-11-05T00:03:05-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 5 00:03:05 kjcf05n03 dp-api-server-node[15350]: INFO[2024-11-05T00:03:05-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 5 00:03:05 kjcf05n03 RFSF-API[15350]: INFO[2024-11-05T00:03:05-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 5 00:03:05 kjcf05n03 dp-api-server-node[15350]: INFO[2024-11-05T00:03:05-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 5 00:03:05 kjcf05n03 RFSF-API[15350]: INFO[2024-11-05T00:03:05-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 5 00:03:05 kjcf05n03 dp-api-server-node[15350]: INFO[2024-11-05T00:03:05-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 5 00:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730786585', 'host':'kjcf05n03', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 5 00:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730786585'} Nov 5 00:03:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730786585', 'host':'kjcf05n03', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 5 00:03:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730786585'} Nov 5 00:03:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:03:11 kjcf05n03 systemd[1]: Reloading. Nov 5 00:03:11 kjcf05n03 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 5 00:03:11 kjcf05n03 systemd[1]: Reloading. Nov 5 00:03:11 kjcf05n03 systemd[1]: Starting Cluster Controlled lcnmon... Nov 5 00:03:12 kjcf05n03 diskmonitor_pre[15830]: Key management is currently disabled.DEAR disabled Nov 5 00:03:12 kjcf05n03 systemd[1]: Started Cluster Controlled diskmonitor. Nov 5 00:03:13 kjcf05n03 dcs-collectord[5648]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 5 00:03:13 kjcf05n03 dcs-collectord[5648]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 00:03:13 kjcf05n03 dcs-collectord[5648]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 5 00:03:13 kjcf05n03 sh[15892]: LNET configured: New Created Nov 5 00:03:14 kjcf05n03 systemd[1]: Started Cluster Controlled lcnmon. Nov 5 00:03:14 kjcf05n03 LCNmon[17980]: Interface ib0 is up Nov 5 00:03:14 kjcf05n03 LCNmon[17980]: Interface ib1 is up Nov 5 00:03:14 kjcf05n03 LCNmon[17980]: Can ping through interface ib0 Nov 5 00:03:15 kjcf05n03 LCNmon[17980]: Can ping through interface ib1 Nov 5 00:03:15 kjcf05n03 LCNmon[17980]: NIC ib0, initial state UP Nov 5 00:03:15 kjcf05n03 LCNmon[17980]: NIC ib1, initial state UP Nov 5 00:03:15 kjcf05n03 LCNmon[17980]: LCNstat initial state UP Nov 5 00:03:15 kjcf05n03 LCNmon[17980]: LCNmon monitoring hosts kjcf05n03 and kjcf05n02 Nov 5 00:03:14 kjcf05n00 httpd[1812025]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-B): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n03', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 5 00:03:15 kjcf05n03 systemd[1]: nodebootchecks.service: Succeeded. Nov 5 00:03:16 kjcf05n00 mcfcli[3673891]: %3|1730786596.260|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: /var/run/diskmonitor does not exist, creating Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: Creating /var/run/diskmonitor/disk Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: Creating /var/run/diskmonitor/encl Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: Creating /var/run/diskmonitor/cli Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: RAS_Interlocks_enabled: 1 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: Using default ssd ids: HUSSL4010ASS600 , Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: add handler for sig: 14 sa_flags: 10000004 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: add handler for sig: 1 sa_flags: 10000004 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: add handler for sig: 2 sa_flags: 00000004 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: add handler for sig: 15 sa_flags: 00000004 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: add handler for sig: 6 sa_flags: 00000004 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: add handler for sig: 3 sa_flags: 00000004 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: add handler for sig: 30 sa_flags: 00000004 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: add handler for sig: 20 sa_flags: 00000004 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: add handler for sig: 10 sa_flags: 10000004 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: add handler for sig: 11 sa_flags: 00000004 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: add handler for sig: 7 sa_flags: 00000004 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: add handler for sig: 4 sa_flags: 00000004 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: add handler for sig: 8 sa_flags: 00000004 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: init_watch: /var/run/diskmonitor/encl initialized Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: init_watch: /var/run/diskmonitor/disk initialized Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: Using HA Baton locks - key: diskmonitor Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: Baton will be held for at most 570 seconds Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: DMMP Enabled: 0 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: random seed: 55f49e88 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: NVMe Enclosure: 1 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: ZFS Enclosure: 0 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: Dbus, Initialized Connection Successfully Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: int_catcher_thread: thread start Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: Received dbus message 4 org.freedesktop.DBus -> :1.105 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b07bec_S4EUNF0MA05386M encl_slot: 0 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b07bed_S4EUNF0MA05387D encl_slot: 0 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 5 00:03:16 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 5 00:03:17 kjcf05n03 openhpid[5554]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 5 00:03:17 kjcf05n03 openhpid[5554]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 5 00:03:17 kjcf05n03 systemd[1]: openhpid.service: Succeeded. Nov 5 00:03:17 kjcf05n03 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 5 00:03:17 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 5 00:03:18 kjcf05n03 systemd[1]: openhpid.service: Supervising process 18450 which is not our child. We'll most likely not notice when it exits. Nov 5 00:03:18 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 5 00:03:18 kjcf05n03 systemd[1]: Reached target Multi-User System. Nov 5 00:03:18 kjcf05n03 systemd[1]: Reached target Graphical Interface. Nov 5 00:03:18 kjcf05n03 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 5 00:03:18 kjcf05n03 dcs-collectord[5648]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 5 00:03:18 kjcf05n03 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 5 00:03:18 kjcf05n03 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 5 00:03:18 kjcf05n03 systemd[1]: Startup finished in 50.667s (kernel) + 2min 29.566s (userspace) = 3min 20.234s. Nov 5 00:03:18 kjcf05n03 openhpid[18450]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 5 00:03:18 kjcf05n03 openhpid[18450]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 5 00:03:18 kjcf05n03 openhpid[18450]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 5 00:03:18 kjcf05n03 openhpid[18450]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 5 00:03:19 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18576 (bash) Nov 5 00:03:19 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 5 00:03:19 kjcf05n03 systemd[1]: Reached target Host and Network Name Lookups. Nov 5 00:03:19 kjcf05n03 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 5 00:03:19 kjcf05n03 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 5 00:03:19 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 5 00:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730786599', 'host':'kjcf05n03', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 5 00:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730786599'} Nov 5 00:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730786599', 'host':'kjcf05n03', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 5 00:03:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730786599'} Nov 5 00:03:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730786599', 'host':'kjcf05n03', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 2.02, 1.97, 0.90'}"] Nov 5 00:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Load', 'description': 'OK - load average: 2.02, 1.97, 0.90', 'message': 'OK - load average: 2.02, 1.97, 0.90', 'value': 'ok', 'timestamp': '1730786599'} Nov 5 00:03:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730786599', 'host':'kjcf05n03', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 359 processes with STATE = RSZDT '}"] Nov 5 00:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Total Processes', 'description': 'PROCS OK: 359 processes with STATE = RSZDT ', 'message': 'PROCS OK: 359 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730786599'} Nov 5 00:03:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:03:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730786601', 'host':'kjcf05n03', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 5 00:03:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730786601', 'host':'kjcf05n03', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(4088.0B/2552.0B), ib1=(2576.0B/2560.0B), icl0=(7.9kB/9.6kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.1MB), mgmt0=(1478.5MB/8.0MB)'}"] Nov 5 00:03:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730786601'} Nov 5 00:03:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(4088.0B/2552.0B), ib1=(2576.0B/2560.0B), icl0=(7.9kB/9.6kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.1MB), mgmt0=(1478.5MB/8.0MB)', 'message': 'NET OK - (Rx/Tx) ib0=(4088.0B/2552.0B), ib1=(2576.0B/2560.0B), icl0=(7.9kB/9.6kB), lo=(1080.0B/1080.0B), meth0=(1541.6MB/8.1MB), mgmt0=(1478.5MB/8.0MB)', 'value': 'ok', 'timestamp': '1730786601'} Nov 5 00:03:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:03:22 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 5 00:03:22 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 5 00:03:25 kjcf05n07 systemd[1]: unbound-anchor.service: Succeeded. Nov 5 00:03:25 kjcf05n07 systemd[1]: Started update of the root trust anchor for DNSSEC validation in unbound. Nov 5 00:03:25 kjcf05n00 mcfcli[3673891]: %3|1730786605.617|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:03:27 kjcf05n02 systemd[1]: unbound-anchor.service: Succeeded. Nov 5 00:03:27 kjcf05n02 systemd[1]: Started update of the root trust anchor for DNSSEC validation in unbound. Nov 5 00:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-05T00:03:27.268328235-06:00 level=info msg="Completed cleanup jobs" duration=41.595543ms Nov 5 00:03:27 kjcf05n06 systemd[1]: unbound-anchor.service: Succeeded. Nov 5 00:03:27 kjcf05n06 systemd[1]: Started update of the root trust anchor for DNSSEC validation in unbound. Nov 5 00:03:27 kjcf05n05 systemd[1]: unbound-anchor.service: Succeeded. Nov 5 00:03:27 kjcf05n05 systemd[1]: Started update of the root trust anchor for DNSSEC validation in unbound. Nov 5 00:03:28 kjcf05n03 dcs-collectord[5648]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 00:03:28 kjcf05n03 dcs-collectord[5648]: WARNING No data collected (hpi_parser.py:353) Nov 5 00:03:28 kjcf05n00 systemd[1]: unbound-anchor.service: Succeeded. Nov 5 00:03:28 kjcf05n00 systemd[1]: Started update of the root trust anchor for DNSSEC validation in unbound. Nov 5 00:03:30 kjcf05n04 systemd[1]: unbound-anchor.service: Succeeded. Nov 5 00:03:30 kjcf05n04 systemd[1]: Started update of the root trust anchor for DNSSEC validation in unbound. Nov 5 00:03:34 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31470 deleted. Nov 5 00:03:41 kjcf05n03 ipmievd[3985]: System Event sensor - Timestamp Clock Sync Nov 5 00:03:43 kjcf05n03 ipmievd[3131]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:03:43 kjcf05n03 dcs-collectord[5648]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 00:03:55 kjcf05n00 mcfcli[3673891]: %3|1730786635.004|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b07bed_S4EUNF0MA05387D encl_sn: USE26000024VS001, slot: 2 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b07bec_S4EUNF0MA05386M encl_sn: USE26000024VS001, slot: 1 Nov 5 00:03:55 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 5 00:03:55 kjcf05n00 mcfcli[3673891]: %3|1730786635.617|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 00:03:58 kjcf05n03 dcs-collectord[5648]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 00:04:03 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e301437002538450000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 5 00:04:03 kjcf05n03 ras-resource-manager-agent[5912]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "c1bd73e0-9b3b-11ef-97cb-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 5 00:04:03 kjcf05n03 ras-resource-manager-agent[5912]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'c1bd73e0-9b3b-11ef-97cb-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 5 00:04:03 kjcf05n03 ras-resource-manager-agent[5912]: INFO Submitting new device inserted signal, starting to qualify drive: c1bd73e0-9b3b-11ef-97cb-00093d069a1b (admin_action.py:110) Nov 5 00:04:03 kjcf05n02 firmware-update-orc-server[5915]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "c9ec65bb-b7ac-44d6-8af0-f56db2091510"} (logger.py:65) Nov 5 00:04:03 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 86784 (get_disk_device) Nov 5 00:04:03 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 5 00:04:03 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 5 00:04:03 kjcf05n02 ccp-client[86805]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 5 00:04:02 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'c1bd73e0-9b3b-11ef-97cb-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 5 00:04:02 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'c1bd73e0-9b3b-11ef-97cb-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 5 00:04:02 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': 'c1bd73e0-9b3b-11ef-97cb-00093d069a1b', 'response ID': 'c1c7f518-9b3b-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 5 00:04:02 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: c1c7f518-9b3b-11ef-acfe-00093d0696a6 (logger.py:65) Nov 5 00:04:03 kjcf05n02 ccp-client[86805]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 5 00:04:03 kjcf05n02 ccp-client[86829]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 5 00:04:03 kjcf05n02 ccp-client[86805]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 5 00:04:03 kjcf05n02 ccp-client[86805]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 5 00:04:03 kjcf05n02 ccp-client[86829]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 5 00:04:03 kjcf05n02 ccp-client[86829]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 5 00:04:03 kjcf05n03 diskmonitor[17577]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 5 00:04:03 kjcf05n03 ras-resource-manager-agent[5912]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "c2100916-9b3b-11ef-97cb-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 5 00:04:03 kjcf05n03 ras-resource-manager-agent[5912]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'c2100916-9b3b-11ef-97cb-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 5 00:04:03 kjcf05n03 ras-resource-manager-agent[5912]: INFO Submitting new device inserted signal, starting to qualify drive: c2100916-9b3b-11ef-97cb-00093d069a1b (admin_action.py:110) Nov 5 00:04:03 kjcf05n03 firmware-update-orc-server[5868]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "ab5f9e46-9cf0-4ac3-a0da-459f9c5c101c"} (logger.py:65) Nov 5 00:04:03 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'c2100916-9b3b-11ef-97cb-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 5 00:04:03 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'c2100916-9b3b-11ef-97cb-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 5 00:04:03 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': 'c2100916-9b3b-11ef-97cb-00093d069a1b', 'response ID': 'c2176c10-9b3b-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 5 00:04:03 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: c2176c10-9b3b-11ef-acfe-00093d0696a6 (logger.py:65) Nov 5 00:04:06 kjcf05n02 DRVFW[87002]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 5 00:04:06 kjcf05n02 ccp-client[87003]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 5 00:04:06 kjcf05n02 ccp-client[87003]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 5 00:04:06 kjcf05n02 ccp-client[87012]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 5 00:04:06 kjcf05n02 ccp-client[87003]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 5 00:04:06 kjcf05n02 ccp-client[87003]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 5 00:04:06 kjcf05n02 ccp-client[87012]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 5 00:04:06 kjcf05n02 ccp-client[87012]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 5 00:04:06 kjcf05n02 firmware-update-orc-server[5915]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 5 00:04:07 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: c1c7f518-9b3b-11ef-acfe-00093d0696a6 (logger.py:65) Nov 5 00:04:07 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': 'c1bd73e0-9b3b-11ef-97cb-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'c1bd73e0-9b3b-11ef-97cb-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}}} (logger.py:65) Nov 5 00:04:08 kjcf05n03 ras-resource-manager-agent[5912]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'c1bd73e0-9b3b-11ef-97cb-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 5 00:04:08 kjcf05n03 ras-resource-manager-agent[5912]: INFO Drive qualification complete responding: c1bd73e0-9b3b-11ef-97cb-00093d069a1b (admin_action.py:205) Nov 5 00:04:08 kjcf05n03 ras-resource-manager-agent[5912]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "c1bd73e0-9b3b-11ef-97cb-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (interesting_event.py:59) Nov 5 00:04:08 kjcf05n02 nslcd[6988]: [5558ec] ldap_result() failed: Can't contact LDAP server Nov 5 00:04:08 kjcf05n02 nslcd[6988]: [8e1f29] ldap_result() failed: Can't contact LDAP server Nov 5 00:04:12 kjcf05n03 diskmonitor[17577]: 0005 Nov 5 00:04:12 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 5 00:04:12 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 5 00:04:12 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 5 00:04:12 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 5 00:04:12 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 5 00:04:12 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 5 00:04:12 kjcf05n03 diskmonitor[17577]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 5 00:04:12 kjcf05n03 diskmonitor[17577]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 5 00:04:12 kjcf05n03 diskmonitor[17577]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 5 00:04:12 kjcf05n03 diskmonitor[17577]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 5 00:04:12 kjcf05n03 diskmonitor[17577]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 5 00:04:12 kjcf05n03 diskmonitor[17577]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "c1bd73e0-9b3b-11ef-97cb-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 5 00:04:12 kjcf05n03 diskmonitor[17577]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 5 00:04:12 kjcf05n03 diskmonitor[17577]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 5 00:04:12 kjcf05n03 diskmonitor[17577]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "c2100916-9b3b-11ef-97cb-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 5 00:04:12 kjcf05n03 diskmonitor[17577]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 5 00:04:12 kjcf05n03 diskmonitor[17577]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 5 00:04:13 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22295 (get_disk_device) Nov 5 00:04:13 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 5 00:04:13 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 5 00:04:13 kjcf05n02 nslcd[6988]: [e87ccd] ldap_result() failed: Can't contact LDAP server Nov 5 00:04:14 kjcf05n03 ccp-client[22316]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 5 00:04:14 kjcf05n03 ccp-client[22316]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 5 00:04:14 kjcf05n03 ccp-client[22325]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 5 00:04:14 kjcf05n03 ccp-client[22316]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 5 00:04:14 kjcf05n03 ccp-client[22316]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 5 00:04:14 kjcf05n03 ccp-client[22325]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 5 00:04:14 kjcf05n03 ccp-client[22325]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 5 00:04:14 kjcf05n03 chronyd[5153]: Selected source 172.16.2.1 Nov 5 00:04:16 kjcf05n03 DRVFW[22567]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 5 00:04:17 kjcf05n03 ccp-client[22574]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 5 00:04:17 kjcf05n03 ccp-client[22574]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 5 00:04:17 kjcf05n03 ccp-client[22585]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 5 00:04:17 kjcf05n03 ccp-client[22574]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 5 00:04:17 kjcf05n03 ccp-client[22574]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 5 00:04:17 kjcf05n03 ccp-client[22585]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 5 00:04:17 kjcf05n03 ccp-client[22585]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 5 00:04:17 kjcf05n03 firmware-update-orc-server[5868]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 5 00:04:17 kjcf05n03 ras-resource-manager-agent[5912]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'c2100916-9b3b-11ef-97cb-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 5 00:04:17 kjcf05n03 ras-resource-manager-agent[5912]: INFO Drive qualification complete responding: c2100916-9b3b-11ef-97cb-00093d069a1b (admin_action.py:205) Nov 5 00:04:17 kjcf05n03 ras-resource-manager-agent[5912]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "c2100916-9b3b-11ef-97cb-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (interesting_event.py:59) Nov 5 00:04:17 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: c2176c10-9b3b-11ef-acfe-00093d0696a6 (logger.py:65) Nov 5 00:04:17 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': 'c2100916-9b3b-11ef-97cb-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'c2100916-9b3b-11ef-97cb-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}}} (logger.py:65) Nov 5 00:04:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730786657}"] Nov 5 00:04:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730786657, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:04:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:04:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730786657}"] Nov 5 00:04:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730786657, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:04:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:04:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730786657}"] Nov 5 00:04:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730786657, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:04:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:04:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730786657}"] Nov 5 00:04:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730786657, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:04:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:04:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730786657}"] Nov 5 00:04:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730786657, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:04:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:04:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730786657}"] Nov 5 00:04:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730786657, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:04:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:04:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730786659}"] Nov 5 00:04:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730786659, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:04:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:04:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730786659}"] Nov 5 00:04:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730786659, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:04:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:04:20 kjcf05n03 systemd[1]: Unmounting /mnt/llog... Nov 5 00:04:20 kjcf05n03 systemd[1]: mnt-llog.mount: Succeeded. Nov 5 00:04:20 kjcf05n03 systemd[1]: Unmounted /mnt/llog. Nov 5 00:04:26 kjcf05n03 python3.9[5215]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 5 00:04:25 kjcf05n00 mcfcli[3673891]: %3|1730786665.617|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:04:28 kjcf05n03 python3.9[3131]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:04:28 kjcf05n03 ras-resource-manager-agent[5912]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "c1bd73e0-9b3b-11ef-97cb-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} (service_main_handler.py:66) Nov 5 00:04:28 kjcf05n03 ras-resource-manager-agent[5912]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'c1bd73e0-9b3b-11ef-97cb-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 4}}} (resource_admin.py:98) Nov 5 00:04:28 kjcf05n03 ras-resource-manager-agent[5912]: INFO Device qualification response has been acknowledged: c1bd73e0-9b3b-11ef-97cb-00093d069a1b (admin_action.py:151) Nov 5 00:04:28 kjcf05n03 ras-resource-manager-agent[5912]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "c2100916-9b3b-11ef-97cb-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (service_main_handler.py:66) Nov 5 00:04:28 kjcf05n03 ras-resource-manager-agent[5912]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'c2100916-9b3b-11ef-97cb-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 5 00:04:28 kjcf05n03 ras-resource-manager-agent[5912]: INFO Device qualification response has been acknowledged: c2100916-9b3b-11ef-97cb-00093d069a1b (admin_action.py:151) Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "c1bd73e0-9b3b-11ef-97cb-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: Dbus, handle_ingress_ras_signals, uuid: c1bd73e0-9b3b-11ef-97cb-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "c1bd73e0-9b3b-11ef-97cb-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 4}}} Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "c2100916-9b3b-11ef-97cb-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: Dbus, handle_ingress_ras_signals, uuid: c2100916-9b3b-11ef-97cb-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "c2100916-9b3b-11ef-97cb-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 5 00:04:30 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 5 00:04:32 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 5 00:04:32 kjcf05n03 diskmonitor[17577]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 5 00:04:32 kjcf05n00 mcfcli[3673891]: %3|1730786672.552|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:04:34 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31471 deleted. Nov 5 00:04:38 kjcf05n03 diskmonitor[17577]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 5 00:04:38 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 5 00:04:38 kjcf05n03 diskmonitor[17577]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 5 00:04:38 kjcf05n03 diskmonitor[17577]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 5 00:04:38 kjcf05n03 diskmonitor[17577]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 5 00:04:38 kjcf05n03 diskmonitor[17577]: leaving test state: 1 next state: 2 Nov 5 00:04:38 kjcf05n03 diskmonitor[17577]: lock req: no timeout Nov 5 00:04:38 kjcf05n03 diskmonitor[17577]: leaving test state: 2 next state: 4 Nov 5 00:04:38 kjcf05n03 diskmonitor[17577]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 5 00:04:54 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 5 00:04:55 kjcf05n00 mcfcli[3673891]: %3|1730786695.618|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:05:09 kjcf05n00 mcfcli[3673891]: %3|1730786709.506|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:05:24 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 5 00:05:24 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 5 00:05:24 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 5 00:05:25 kjcf05n00 mcfcli[3673891]: %3|1730786725.618|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:05:34 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 5 00:05:34 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 5 00:05:34 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 5 00:05:38 kjcf05n03 dcs-collectord[5648]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 5 00:05:40 kjcf05n00 python3.9[2564284]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 5 00:05:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730786747}"] Nov 5 00:05:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730786747, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:05:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:05:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:05:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:05:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:05:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:05:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:05:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:05:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:05:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:05:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:05:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:05:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:05:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:05:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.273358ms Nov 5 00:05:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:05:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.273358ms Nov 5 00:05:47 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:05:47 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:05:47 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:05:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730786747}"] Nov 5 00:05:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730786747, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:05:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:05:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:05:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:05:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:05:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:05:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:05:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:05:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:05:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:05:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:05:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:05:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:05:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:05:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.73535ms Nov 5 00:05:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:05:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.73535ms Nov 5 00:05:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:05:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:05:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:05:49 kjcf05n00 mcfcli[3673891]: %3|1730786749.504|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:05:52 kjcf05n03 diskmonitor[17577]: lock acquired Nov 5 00:05:52 kjcf05n03 diskmonitor[17577]: leaving test state: 4 next state: 8 Nov 5 00:05:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730786453', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 5 00:05:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730786453'} Nov 5 00:05:54 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:05:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730786453', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 5 00:05:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730786453'} Nov 5 00:05:54 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:05:55 kjcf05n00 mcfcli[3673891]: %3|1730786755.618|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:06:12 kjcf05n03 diskmonitor[17577]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 5 00:06:12 kjcf05n03 diskmonitor[17577]: leaving test state: 8 next state: 20 Nov 5 00:06:12 kjcf05n03 diskmonitor[17577]: leaving test state: 20 next state: 40 Nov 5 00:06:12 kjcf05n03 diskmonitor[17577]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset d2b8770000 Nov 5 00:06:12 kjcf05n03 diskmonitor[17577]: leaving test state: 40 next state: 80 Nov 5 00:06:25 kjcf05n00 mcfcli[3673891]: %3|1730786785.620|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:06:28 kjcf05n00 mcfcli[3673891]: %3|1730786788.054|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:06:55 kjcf05n00 mcfcli[3673891]: %3|1730786815.620|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 00:07:00 kjcf05n02 systemd[1]: Starting Generate a daily summary of process accounting... Nov 5 00:07:00 kjcf05n02 systemd[1]: sysstat-summary.service: Succeeded. Nov 5 00:07:00 kjcf05n02 systemd[1]: Started Generate a daily summary of process accounting. Nov 5 00:07:00 kjcf05n03 systemd[1]: Starting Generate a daily summary of process accounting... Nov 5 00:07:00 kjcf05n03 systemd[1]: sysstat-summary.service: Succeeded. Nov 5 00:07:00 kjcf05n03 systemd[1]: Started Generate a daily summary of process accounting. Nov 5 00:07:00 kjcf05n07 systemd[1]: Starting Generate a daily summary of process accounting... Nov 5 00:07:00 kjcf05n07 systemd[1]: sysstat-summary.service: Succeeded. Nov 5 00:07:00 kjcf05n07 systemd[1]: Started Generate a daily summary of process accounting. Nov 5 00:07:00 kjcf05n05 systemd[1]: Starting Generate a daily summary of process accounting... Nov 5 00:07:00 kjcf05n05 systemd[1]: sysstat-summary.service: Succeeded. Nov 5 00:07:00 kjcf05n05 systemd[1]: Started Generate a daily summary of process accounting. Nov 5 00:07:00 kjcf05n06 systemd[1]: Starting Generate a daily summary of process accounting... Nov 5 00:07:00 kjcf05n06 systemd[1]: sysstat-summary.service: Succeeded. Nov 5 00:07:00 kjcf05n06 systemd[1]: Started Generate a daily summary of process accounting. Nov 5 00:07:00 kjcf05n04 systemd[1]: Starting Generate a daily summary of process accounting... Nov 5 00:07:00 kjcf05n04 systemd[1]: sysstat-summary.service: Succeeded. Nov 5 00:07:00 kjcf05n04 systemd[1]: Started Generate a daily summary of process accounting. Nov 5 00:07:00 kjcf05n00 systemd[1]: Starting Generate a daily summary of process accounting... Nov 5 00:07:00 kjcf05n00 systemd[1]: sysstat-summary.service: Succeeded. Nov 5 00:07:00 kjcf05n00 systemd[1]: Started Generate a daily summary of process accounting. Nov 5 00:07:01 kjcf05n01 systemd[1]: Starting Generate a daily summary of process accounting... Nov 5 00:07:01 kjcf05n01 systemd[1]: sysstat-summary.service: Succeeded. Nov 5 00:07:01 kjcf05n01 systemd[1]: Started Generate a daily summary of process accounting. Nov 5 00:07:02 kjcf05n00 mcfcli[3673891]: %3|1730786822.706|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:07:04 kjcf05n00 zabbix-server[2565410]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:07:04 kjcf05n00 zabbix-server[2565410]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n03' from event '46868' Nov 5 00:07:04 kjcf05n00 zabbix-server[2565410]: Host created 'enclosure_USE26000024VS001' Nov 5 00:07:04 kjcf05n00 zabbix-server[2565410]: Running puppet on 'kjcf05n03' Nov 5 00:07:06 kjcf05n03 puppet-agent[29506]: Using configured environment 'production' Nov 5 00:07:06 kjcf05n03 puppet-agent[29506]: Retrieving pluginfacts Nov 5 00:07:06 kjcf05n03 puppet-agent[29506]: Retrieving plugin Nov 5 00:07:06 kjcf05n03 puppet-agent[29506]: Loading facts Nov 5 00:07:09 kjcf05n03 puppet-agent[29506]: Caching catalog for kjcf05n03 Nov 5 00:07:09 kjcf05n03 puppet-agent[29506]: Applying configuration version '1730786827' Nov 5 00:07:11 kjcf05n03 puppet-agent[29506]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 00:07:11 kjcf05n03 puppet-agent[29506]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 00:07:11 kjcf05n03 puppet-agent[29506]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 00:07:12 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 5 00:07:12 kjcf05n03 zabbix_agent2[5996]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 00:07:12 kjcf05n03 zabbix_agent2[3131]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:07:12 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 00:07:12 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 5 00:07:12 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 5 00:07:12 kjcf05n03 puppet-agent[29506]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: Press Ctrl+C to exit. Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: Plugin support version 1.0 Nov 5 00:07:12 kjcf05n03 zabbix_agent2[30555]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 00:07:12 kjcf05n03 diskmonitor[17577]: leaving test state: 80 next state: 100 Nov 5 00:07:12 kjcf05n03 diskmonitor[17577]: lock release: time: Tue Nov 5 00:07:07 2024 Nov 5 00:07:12 kjcf05n03 diskmonitor[17577]: leaving test state: 100 next state: 1 Nov 5 00:07:14 kjcf05n03 puppet-agent[29506]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 00:07:14 kjcf05n03 puppet-agent[29506]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 00:07:14 kjcf05n03 puppet-agent[29506]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 00:07:14 kjcf05n03 puppet-agent[29506]: Applied catalog in 5.13 seconds Nov 5 00:07:14 kjcf05n00 zabbix-server[2565410]: puppet completed status:(0): '' Nov 5 00:07:14 kjcf05n00 zabbix-server[2565410]: Event '46868' acknowledged Nov 5 00:07:14 kjcf05n00 zabbix-server[2565410]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n03"}' Nov 5 00:07:25 kjcf05n00 mcfcli[3673891]: %3|1730786845.620|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:07:41 kjcf05n00 mcfcli[3673891]: %3|1730786861.137|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:07:55 kjcf05n00 mcfcli[3673891]: %3|1730786875.620|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 00:08:17 kjcf05n00 mcfcli[3673891]: %3|1730786897.970|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:08:25 kjcf05n00 mcfcli[3673891]: %3|1730786905.620|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:08:39 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 5 00:08:39 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 5 00:08:39 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 5 00:08:55 kjcf05n00 mcfcli[3673891]: %3|1730786935.620|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:08:56 kjcf05n00 mcfcli[3673891]: %3|1730786936.598|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:09:07 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 5 00:09:22 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 5 00:09:22 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 5 00:09:22 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 5 00:09:25 kjcf05n00 mcfcli[3673891]: %3|1730786965.621|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 00:09:35 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 5 00:09:35 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 5 00:09:34 kjcf05n00 mcfcli[3673891]: %3|1730786974.883|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:09:55 kjcf05n00 mcfcli[3673891]: %3|1730786995.621|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 5 00:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 5 00:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 5 00:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 5 00:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 5 00:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 5 00:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 5 00:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 5 00:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 5 00:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 5 00:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 5 00:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 5 00:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 5 00:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 5 00:10:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 5 00:10:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:10:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 5 00:10:13 kjcf05n00 mcfcli[3673891]: %3|1730787013.154|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:10:25 kjcf05n00 mcfcli[3673891]: %3|1730787025.621|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 5 00:10:39 kjcf05n00 python3.9[2567205]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 5 00:10:47 kjcf05n00 mcfcli[3673891]: %3|1730787047.627|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:10:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730786453', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 5 00:10:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730786453'} Nov 5 00:10:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:10:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730786453', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 5 00:10:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730786453'} Nov 5 00:10:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:10:55 kjcf05n00 mcfcli[3673891]: %3|1730787055.621|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 00:10:56 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 5 00:10:56 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 5 00:10:56 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 5 00:11:10 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 5 00:11:25 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 5 00:11:25 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 5 00:11:25 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 5 00:11:25 kjcf05n00 mcfcli[3673891]: %3|1730787085.296|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:11:25 kjcf05n00 mcfcli[3673891]: %3|1730787085.622|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:11:38 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 5 00:11:38 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 5 00:11:55 kjcf05n00 mcfcli[3673891]: %3|1730787115.622|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 00:12:02 kjcf05n00 mcfcli[3673891]: %3|1730787122.483|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:12:25 kjcf05n00 mcfcli[3673891]: %3|1730787145.623|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:12:41 kjcf05n00 mcfcli[3673891]: %3|1730787161.181|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:12:55 kjcf05n00 mcfcli[3673891]: %3|1730787175.623|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 00:13:19 kjcf05n00 mcfcli[3673891]: %3|1730787199.068|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:13:25 kjcf05n00 mcfcli[3673891]: %3|1730787205.623|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-05T00:13:27.253447739-06:00 level=info msg="Completed cleanup jobs" duration=26.620507ms Nov 5 00:13:53 kjcf05n03 root[41469]: failback_xyraid Nov 5 00:13:55 kjcf05n03 root[41579]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 5 00:13:56 kjcf05n03 root[41656]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 5 00:13:55 kjcf05n00 mcfcli[3673891]: %3|1730787235.623|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:13:57 kjcf05n00 mcfcli[3673891]: %3|1730787237.461|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:13:59 kjcf05n02 systemd[1]: data-kjcf05n03:md66.mount: Succeeded. Nov 5 00:14:03 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme5n1 Nov 5 00:14:03 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme22n1 Nov 5 00:14:03 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme6n1 Nov 5 00:14:03 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme11n1 Nov 5 00:14:03 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme21n1 Nov 5 00:14:03 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme10n1 Nov 5 00:14:03 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme12n1 Nov 5 00:14:03 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme20n1 Nov 5 00:14:03 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme16n1 Nov 5 00:14:03 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme15n1 Nov 5 00:14:03 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme7n1 Nov 5 00:14:05 kjcf05n03 dcs-bulk-data-sender[6206]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 5 00:14:05 kjcf05n03 dwd[5186]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 5 00:14:05 kjcf05n03 dwd[5186]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 5 00:14:05 kjcf05n03 dwd[5186]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 5 00:14:05 kjcf05n03 dwd[5186]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 5 00:14:05 kjcf05n03 dwd[5186]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 5 00:14:05 kjcf05n03 dwd[5186]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 5 00:14:05 kjcf05n03 dwd[5186]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 5 00:14:05 kjcf05n03 dwd[5186]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 5 00:14:05 kjcf05n03 dwd[5186]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 5 00:14:05 kjcf05n03 dwd[5186]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 5 00:14:05 kjcf05n03 dwd[5186]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 5 00:14:05 kjcf05n03 dwd[5186]: Starting NVME thread for nvme10n1 Nov 5 00:14:05 kjcf05n03 dwd[5186]: Starting NVME thread for nvme15n1 Nov 5 00:14:05 kjcf05n03 dwd[5186]: Starting NVME thread for nvme21n1 Nov 5 00:14:06 kjcf05n03 dwd[5186]: Starting NVME thread for nvme11n1 Nov 5 00:14:06 kjcf05n03 dwd[5186]: Starting NVME thread for nvme20n1 Nov 5 00:14:06 kjcf05n03 systemd-udevd[44419]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44421]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44419]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44423]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44421]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44424]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44423]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44419]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44421]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44424]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44423]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44419]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44421]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44424]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44423]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44419]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44421]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44424]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44423]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44421]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44419]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44424]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44423]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44421]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44419]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44424]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44423]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44421]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44424]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44419]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44423]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44419]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44457]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44459]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44461]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44462]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44457]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44461]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44459]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44462]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44457]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44456]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44462]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44457]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44462]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44457]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44456]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44457]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44456]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44457]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44456]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44457]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44456]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44457]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44457]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44456]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44457]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44456]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44457]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44457]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44456]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44457]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44457]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 systemd-udevd[44457]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:14:06 kjcf05n03 dwd[5186]: Starting NVME thread for nvme12n1 Nov 5 00:14:06 kjcf05n03 dwd[5186]: Starting NVME thread for nvme7n1 Nov 5 00:14:06 kjcf05n03 dwd[5186]: Starting NVME thread for nvme6n1 Nov 5 00:14:06 kjcf05n03 dwd[5186]: Starting NVME thread for nvme5n1 Nov 5 00:14:07 kjcf05n03 dwd[5186]: Starting NVME thread for nvme16n1 Nov 5 00:14:07 kjcf05n03 nslcd[6944]: [8b4567] (re)loading /etc/nsswitch.conf Nov 5 00:14:07 kjcf05n03 dwd[5186]: Starting NVME thread for nvme22n1 Nov 5 00:14:17 kjcf05n03 diskmonitor[17577]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 5 00:14:23 kjcf05n03 diskmonitor[17577]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 5 00:14:23 kjcf05n03 diskmonitor[17577]: Scan for ReadErrorMax change for md66 Nov 5 00:14:23 kjcf05n03 diskmonitor[17577]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 5 00:14:23 kjcf05n03 diskmonitor[17577]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 5 00:14:23 kjcf05n03 diskmonitor[17577]: read_saved_file: md66 no saved speed Nov 5 00:14:23 kjcf05n03 diskmonitor[17577]: reconstruction_policy: sync_action prev = current = idle - md66 Nov 5 00:14:23 kjcf05n03 diskmonitor[17577]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 5 00:14:25 kjcf05n00 mcfcli[3673891]: %3|1730787265.623|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 00:14:34 kjcf05n00 mcfcli[3673891]: %3|1730787274.633|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:14:41 kjcf05n02 diskmonitor[17460]: Removed MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 5 00:14:41 kjcf05n02 diskmonitor[17460]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 5 00:14:55 kjcf05n00 mcfcli[3673891]: %3|1730787295.623|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 5 00:14:58 kjcf05n03 systemd[1]: Starting Cleanup of Temporary Directories... Nov 5 00:14:58 kjcf05n03 systemd-tmpfiles[47168]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 00:14:58 kjcf05n03 systemd-tmpfiles[47168]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 00:14:58 kjcf05n03 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 5 00:14:58 kjcf05n03 systemd[1]: Started Cleanup of Temporary Directories. Nov 5 00:15:02 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47390 (bash) Nov 5 00:15:02 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 5 00:15:02 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 5 00:15:14 kjcf05n00 mcfcli[3673891]: %3|1730787314.099|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:15:25 kjcf05n00 mcfcli[3673891]: %3|1730787325.623|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 5 00:15:40 kjcf05n00 python3.9[2570151]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 5 00:15:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730787348}"] Nov 5 00:15:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730787348, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:15:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.974558ms Nov 5 00:15:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.974558ms Nov 5 00:15:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:15:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:15:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:15:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730787348}"] Nov 5 00:15:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730787348, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:15:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.970751ms Nov 5 00:15:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.970751ms Nov 5 00:15:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:15:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:15:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:15:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730787348}"] Nov 5 00:15:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730787348, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:15:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.90105ms Nov 5 00:15:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.90105ms Nov 5 00:15:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:15:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:15:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:15:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730787348}"] Nov 5 00:15:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730787348, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:15:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.936216ms Nov 5 00:15:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.936216ms Nov 5 00:15:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:15:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:15:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:15:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730787348}"] Nov 5 00:15:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730787348, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:15:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.777282ms Nov 5 00:15:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.777282ms Nov 5 00:15:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:15:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:15:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:15:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730787348}"] Nov 5 00:15:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730787348, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:15:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:48-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:48 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:48-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:48 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:48-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:48 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.72964ms Nov 5 00:15:48 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:48-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.72964ms Nov 5 00:15:48 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:15:48 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:15:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:15:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730787348}"] Nov 5 00:15:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730787348, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:15:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.437141ms Nov 5 00:15:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.437141ms Nov 5 00:15:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:15:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:15:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:15:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730787348}"] Nov 5 00:15:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730787348, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:15:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.131552ms Nov 5 00:15:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.131552ms Nov 5 00:15:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:15:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:15:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:15:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730787348}"] Nov 5 00:15:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730787348, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:15:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.596179ms Nov 5 00:15:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.596179ms Nov 5 00:15:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:15:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:15:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:15:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730787348}"] Nov 5 00:15:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730787348, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:15:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.55755ms Nov 5 00:15:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.55755ms Nov 5 00:15:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:15:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:15:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:15:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730787348}"] Nov 5 00:15:49 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730787348, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:15:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:49-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:15:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:49 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:15:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:49-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:15:49 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:15:49-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:15:49 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:15:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.028599ms Nov 5 00:15:49 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:15:49-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.028599ms Nov 5 00:15:49 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:15:49 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:15:49 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:15:51 kjcf05n00 mcfcli[3673891]: %3|1730787351.862|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:15:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730787353', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 5 00:15:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730787353'} Nov 5 00:15:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:15:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730787353', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 5 00:15:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730787353'} Nov 5 00:15:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:15:55 kjcf05n00 mcfcli[3673891]: %3|1730787355.624|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:16:25 kjcf05n00 mcfcli[3673891]: %3|1730787385.624|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:16:31 kjcf05n00 mcfcli[3673891]: %3|1730787391.620|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:16:55 kjcf05n00 mcfcli[3673891]: %3|1730787415.624|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 5 00:17:11 kjcf05n00 mcfcli[3673891]: %3|1730787431.617|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:17:25 kjcf05n00 mcfcli[3673891]: %3|1730787445.625|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 00:17:50 kjcf05n00 mcfcli[3673891]: %3|1730787470.343|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:17:55 kjcf05n00 mcfcli[3673891]: %3|1730787475.625|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:18:23 kjcf05n00 zabbix-server[2571996]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:18:23 kjcf05n00 zabbix-server[2571996]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 116.57\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 169.97\\"}}"' Nov 5 00:18:24 kjcf05n00 log_interesting_event.py[2571996]: Event '46872' acknowledged Nov 5 00:18:25 kjcf05n00 mcfcli[3673891]: %3|1730787505.625|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:18:28 kjcf05n00 mcfcli[3673891]: %3|1730787508.457|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:18:55 kjcf05n00 mcfcli[3673891]: %3|1730787535.626|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 00:19:08 kjcf05n00 mcfcli[3673891]: %3|1730787548.183|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:19:25 kjcf05n00 mcfcli[3673891]: %3|1730787565.626|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 00:19:31 kjcf05n03 dwd[5186]: nvme21n1 passed periodic SMART status check Nov 5 00:19:31 kjcf05n03 dwd[5186]: nvme10n1 passed periodic SMART status check Nov 5 00:19:31 kjcf05n03 dwd[5186]: nvme15n1 passed periodic SMART status check Nov 5 00:19:31 kjcf05n03 dwd[5186]: nvme11n1 passed periodic SMART status check Nov 5 00:19:32 kjcf05n03 dwd[5186]: nvme5n1 passed periodic SMART status check Nov 5 00:19:32 kjcf05n03 dwd[5186]: nvme6n1 passed periodic SMART status check Nov 5 00:19:32 kjcf05n03 dwd[5186]: nvme20n1 passed periodic SMART status check Nov 5 00:19:32 kjcf05n03 dwd[5186]: nvme12n1 passed periodic SMART status check Nov 5 00:19:32 kjcf05n03 dwd[5186]: nvme16n1 passed periodic SMART status check Nov 5 00:19:32 kjcf05n03 dwd[5186]: nvme7n1 passed periodic SMART status check Nov 5 00:19:33 kjcf05n03 dwd[5186]: nvme22n1 passed periodic SMART status check Nov 5 00:19:43 kjcf05n00 mcfcli[3673891]: %3|1730787583.588|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:19:46 kjcf05n00 zabbix-server[2572703]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:19:46 kjcf05n00 zabbix-server[2572703]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 82.11\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 125.72\\"}}"' Nov 5 00:19:46 kjcf05n00 log_interesting_event.py[2572703]: Event '46873' acknowledged Nov 5 00:19:55 kjcf05n00 mcfcli[3673891]: %3|1730787595.626|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 00:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 5 00:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 5 00:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 5 00:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 5 00:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 5 00:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 5 00:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 5 00:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 5 00:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 5 00:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 5 00:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 5 00:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 5 00:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 5 00:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 5 00:20:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 5 00:20:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:20:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 5 00:20:07 kjcf05n00 zabbix-server[2572883]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:20:07 kjcf05n00 zabbix-server[2572883]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n03' from event '46874' Nov 5 00:20:07 kjcf05n00 zabbix-server[2572883]: Filesystem 'kjcf05' has been mounted Nov 5 00:20:08 kjcf05n00 zabbix-server[2572883]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 5 00:20:08 kjcf05n00 zabbix-server[2572883]: Running puppet on 'None' Nov 5 00:20:10 kjcf05n05 puppet-agent[2880067]: Using configured environment 'production' Nov 5 00:20:10 kjcf05n05 puppet-agent[2880067]: Retrieving pluginfacts Nov 5 00:20:10 kjcf05n05 puppet-agent[2880067]: Retrieving plugin Nov 5 00:20:10 kjcf05n06 puppet-agent[2681998]: Using configured environment 'production' Nov 5 00:20:10 kjcf05n06 puppet-agent[2681998]: Retrieving pluginfacts Nov 5 00:20:10 kjcf05n06 puppet-agent[2681998]: Retrieving plugin Nov 5 00:20:10 kjcf05n04 puppet-agent[2667211]: Using configured environment 'production' Nov 5 00:20:10 kjcf05n04 puppet-agent[2667211]: Retrieving pluginfacts Nov 5 00:20:10 kjcf05n04 puppet-agent[2667211]: Retrieving plugin Nov 5 00:20:10 kjcf05n03 puppet-agent[55820]: Using configured environment 'production' Nov 5 00:20:10 kjcf05n03 puppet-agent[55820]: Retrieving pluginfacts Nov 5 00:20:10 kjcf05n03 puppet-agent[55820]: Retrieving plugin Nov 5 00:20:10 kjcf05n03 puppet-agent[55820]: Loading facts Nov 5 00:20:10 kjcf05n02 puppet-agent[117160]: Using configured environment 'production' Nov 5 00:20:10 kjcf05n02 puppet-agent[117160]: Retrieving pluginfacts Nov 5 00:20:10 kjcf05n02 puppet-agent[117160]: Retrieving plugin Nov 5 00:20:10 kjcf05n07 puppet-agent[2682682]: Using configured environment 'production' Nov 5 00:20:10 kjcf05n07 puppet-agent[2682682]: Retrieving pluginfacts Nov 5 00:20:10 kjcf05n07 puppet-agent[2682682]: Retrieving plugin Nov 5 00:20:10 kjcf05n07 puppet-agent[2682682]: Loading facts Nov 5 00:20:10 kjcf05n05 puppet-agent[2880067]: Loading facts Nov 5 00:20:10 kjcf05n06 puppet-agent[2681998]: Loading facts Nov 5 00:20:10 kjcf05n04 puppet-agent[2667211]: Loading facts Nov 5 00:20:10 kjcf05n01 puppet-agent[3976794]: Using configured environment 'production' Nov 5 00:20:10 kjcf05n01 puppet-agent[3976794]: Retrieving pluginfacts Nov 5 00:20:10 kjcf05n01 puppet-agent[3976794]: Retrieving plugin Nov 5 00:20:10 kjcf05n01 puppet-agent[3976794]: Loading facts Nov 5 00:20:10 kjcf05n02 puppet-agent[117160]: Loading facts Nov 5 00:20:10 kjcf05n00 puppet-agent[2572948]: Using configured environment 'production' Nov 5 00:20:10 kjcf05n00 puppet-agent[2572948]: Retrieving pluginfacts Nov 5 00:20:10 kjcf05n00 puppet-agent[2572948]: Retrieving plugin Nov 5 00:20:10 kjcf05n00 puppet-agent[2572948]: Loading facts Nov 5 00:20:13 kjcf05n03 puppet-agent[55820]: Caching catalog for kjcf05n03 Nov 5 00:20:13 kjcf05n03 puppet-agent[55820]: Applying configuration version '1730787611' Nov 5 00:20:12 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 5 00:20:12 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 5 00:20:13 kjcf05n06 puppet-agent[2681998]: Caching catalog for kjcf05n06 Nov 5 00:20:13 kjcf05n06 puppet-agent[2681998]: Applying configuration version '1730787611' Nov 5 00:20:13 kjcf05n02 puppet-agent[117160]: Caching catalog for kjcf05n02 Nov 5 00:20:13 kjcf05n02 puppet-agent[117160]: Applying configuration version '1730787611' Nov 5 00:20:13 kjcf05n07 puppet-agent[2682682]: Caching catalog for kjcf05n07 Nov 5 00:20:13 kjcf05n07 puppet-agent[2682682]: Applying configuration version '1730787611' Nov 5 00:20:14 kjcf05n01 puppet-agent[3976794]: Caching catalog for kjcf05n01 Nov 5 00:20:15 kjcf05n01 puppet-agent[3976794]: Applying configuration version '1730787612' Nov 5 00:20:15 kjcf05n07 puppet-agent[2682682]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 00:20:15 kjcf05n03 puppet-agent[55820]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 00:20:15 kjcf05n03 puppet-agent[55820]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 00:20:15 kjcf05n03 puppet-agent[55820]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 00:20:14 kjcf05n00 puppet-agent[2572948]: Caching catalog for kjcf05n00 Nov 5 00:20:14 kjcf05n00 puppet-agent[2572948]: Applying configuration version '1730787612' Nov 5 00:20:15 kjcf05n04 puppet-agent[2667211]: Caching catalog for kjcf05n04 Nov 5 00:20:15 kjcf05n04 puppet-agent[2667211]: Applying configuration version '1730787614' Nov 5 00:20:15 kjcf05n06 puppet-agent[2681998]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 00:20:15 kjcf05n06 puppet-agent[2681998]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 00:20:15 kjcf05n06 puppet-agent[2681998]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 00:20:15 kjcf05n02 puppet-agent[117160]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 00:20:15 kjcf05n02 puppet-agent[117160]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 00:20:15 kjcf05n02 puppet-agent[117160]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 00:20:15 kjcf05n07 puppet-agent[2682682]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 00:20:15 kjcf05n07 puppet-agent[2682682]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 00:20:15 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 5 00:20:15 kjcf05n03 zabbix_agent2[30555]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 00:20:15 kjcf05n03 zabbix_agent2[3131]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:20:15 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 00:20:15 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 5 00:20:15 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 5 00:20:15 kjcf05n03 puppet-agent[55820]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: Press Ctrl+C to exit. Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: Plugin support version 1.0 Nov 5 00:20:15 kjcf05n03 zabbix_agent2[56509]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 00:20:16 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 5 00:20:16 kjcf05n02 zabbix_agent2[57347]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 00:20:16 kjcf05n02 zabbix_agent2[3231]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 00:20:16 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 00:20:16 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 5 00:20:16 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 5 00:20:16 kjcf05n02 puppet-agent[117160]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: Press Ctrl+C to exit. Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: Plugin support version 1.0 Nov 5 00:20:16 kjcf05n02 zabbix_agent2[117514]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 00:20:16 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2628580]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 00:20:16 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 5 00:20:16 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 00:20:16 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 5 00:20:16 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 5 00:20:16 kjcf05n06 puppet-agent[2681998]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: Press Ctrl+C to exit. Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: Plugin support version 1.0 Nov 5 00:20:16 kjcf05n06 zabbix_agent2[2682396]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 5 00:20:16 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2629731]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 00:20:16 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 5 00:20:16 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 00:20:16 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 5 00:20:16 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 5 00:20:16 kjcf05n07 puppet-agent[2682682]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: Press Ctrl+C to exit. Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: Plugin support version 1.0 Nov 5 00:20:16 kjcf05n07 zabbix_agent2[2683078]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 5 00:20:17 kjcf05n04 puppet-agent[2667211]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 00:20:17 kjcf05n04 puppet-agent[2667211]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 00:20:17 kjcf05n04 puppet-agent[2667211]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 00:20:17 kjcf05n01 puppet-agent[3976794]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 5 00:20:17 kjcf05n01 puppet-agent[3976794]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-23:55:59]/mode) mode changed '0755' to '0750' Nov 5 00:20:17 kjcf05n01 puppet-agent[3976794]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-23:55:59/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 5 00:20:17 kjcf05n01 puppet-agent[3976794]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-23:55:59/vmcore]/mode) mode changed '0600' to '0640' Nov 5 00:20:17 kjcf05n01 puppet-agent[3976794]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-04-23:55:59/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 5 00:20:17 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 5 00:20:17 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 5 00:20:17 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 5 00:20:17 kjcf05n03 puppet-agent[55820]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 00:20:17 kjcf05n03 puppet-agent[55820]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 00:20:17 kjcf05n03 puppet-agent[55820]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 00:20:17 kjcf05n06 puppet-agent[2681998]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 00:20:17 kjcf05n06 puppet-agent[2681998]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 00:20:17 kjcf05n06 puppet-agent[2681998]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 00:20:17 kjcf05n06 puppet-agent[2681998]: Applied catalog in 4.83 seconds Nov 5 00:20:18 kjcf05n02 puppet-agent[117160]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 00:20:18 kjcf05n02 puppet-agent[117160]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 00:20:18 kjcf05n02 puppet-agent[117160]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 00:20:17 kjcf05n00 puppet-agent[2572948]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 5 00:20:18 kjcf05n07 puppet-agent[2682682]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 00:20:18 kjcf05n07 puppet-agent[2682682]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 00:20:18 kjcf05n07 puppet-agent[2682682]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 00:20:18 kjcf05n07 puppet-agent[2682682]: Applied catalog in 4.89 seconds Nov 5 00:20:18 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2609452]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 00:20:18 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 5 00:20:18 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 00:20:18 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 5 00:20:18 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 5 00:20:18 kjcf05n04 puppet-agent[2667211]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: Press Ctrl+C to exit. Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: Plugin support version 1.0 Nov 5 00:20:18 kjcf05n04 zabbix_agent2[2668294]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 5 00:20:18 kjcf05n03 puppet-agent[55820]: Applied catalog in 5.12 seconds Nov 5 00:20:18 kjcf05n02 puppet-agent[117160]: Applied catalog in 4.99 seconds Nov 5 00:20:18 kjcf05n01 puppet-agent[3976794]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 00:20:18 kjcf05n01 puppet-agent[3976794]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 00:20:18 kjcf05n01 puppet-agent[3976794]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 00:20:18 kjcf05n00 puppet-agent[2572948]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 00:20:18 kjcf05n00 puppet-agent[2572948]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 00:20:18 kjcf05n00 puppet-agent[2572948]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 00:20:19 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3964889]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 00:20:19 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 5 00:20:19 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 00:20:19 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 5 00:20:19 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 5 00:20:19 kjcf05n01 puppet-agent[3976794]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: Press Ctrl+C to exit. Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: Plugin support version 1.0 Nov 5 00:20:19 kjcf05n01 zabbix_agent2[3977238]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 5 00:20:19 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2554293]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 00:20:19 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 5 00:20:19 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 00:20:19 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 5 00:20:19 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 5 00:20:19 kjcf05n00 puppet-agent[2572948]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: Press Ctrl+C to exit. Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: Plugin support version 1.0 Nov 5 00:20:19 kjcf05n00 zabbix_agent2[2573426]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 5 00:20:20 kjcf05n04 puppet-agent[2667211]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 00:20:20 kjcf05n04 puppet-agent[2667211]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 00:20:20 kjcf05n04 puppet-agent[2667211]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 00:20:19 kjcf05n00 zabbix-server[2573451]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:20:20 kjcf05n04 puppet-agent[2667211]: Applied catalog in 4.80 seconds Nov 5 00:20:20 kjcf05n00 zabbix-server[2573453]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:20:20 kjcf05n00 zabbix-server[2573462]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:20:20 kjcf05n00 zabbix-server[2573464]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:20:21 kjcf05n00 mcfcli[3673891]: %3|1730787621.206|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:20:21 kjcf05n01 puppet-agent[3976794]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241105_000318.log]/mode) mode changed '0644' to '0640' Nov 5 00:20:21 kjcf05n01 puppet-agent[3976794]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241105_001502.log]/mode) mode changed '0644' to '0640' Nov 5 00:20:21 kjcf05n00 puppet-agent[2572948]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 5 00:20:22 kjcf05n01 puppet-agent[3976794]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241105_000318.log]/mode) mode changed '0644' to '0640' Nov 5 00:20:22 kjcf05n01 puppet-agent[3976794]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241105_001502.log]/mode) mode changed '0644' to '0640' Nov 5 00:20:22 kjcf05n01 puppet-agent[3976794]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241105_001502]/mode) mode changed '0755' to '0750' Nov 5 00:20:22 kjcf05n01 puppet-agent[3976794]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241105_001502/screenlog.0]/mode) mode changed '0644' to '0640' Nov 5 00:20:22 kjcf05n01 puppet-agent[3976794]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 00:20:22 kjcf05n01 puppet-agent[3976794]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 00:20:22 kjcf05n01 puppet-agent[3976794]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 00:20:22 kjcf05n00 puppet-agent[2572948]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 00:20:22 kjcf05n00 puppet-agent[2572948]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 00:20:22 kjcf05n00 puppet-agent[2572948]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 00:20:22 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 5 00:20:23 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 5 00:20:23 kjcf05n00 puppet-agent[2572948]: Applied catalog in 8.33 seconds Nov 5 00:20:23 kjcf05n01 puppet-agent[3976794]: Applied catalog in 9.04 seconds Nov 5 00:20:25 kjcf05n00 mcfcli[3673891]: %3|1730787625.626|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 00:20:31 kjcf05n05 puppet-agent[2880067]: Caching catalog for kjcf05n05 Nov 5 00:20:31 kjcf05n05 puppet-agent[2880067]: Applying configuration version '1730787629' Nov 5 00:20:33 kjcf05n05 puppet-agent[2880067]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 00:20:33 kjcf05n05 puppet-agent[2880067]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 00:20:33 kjcf05n05 puppet-agent[2880067]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 00:20:34 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2822806]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 00:20:34 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 5 00:20:34 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 00:20:34 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 5 00:20:34 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 5 00:20:34 kjcf05n05 puppet-agent[2880067]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: Press Ctrl+C to exit. Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: Plugin support version 1.0 Nov 5 00:20:34 kjcf05n05 zabbix_agent2[2882197]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 5 00:20:35 kjcf05n05 puppet-agent[2880067]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 00:20:35 kjcf05n05 puppet-agent[2880067]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 00:20:35 kjcf05n05 puppet-agent[2880067]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 00:20:35 kjcf05n05 puppet-agent[2880067]: Applied catalog in 4.79 seconds Nov 5 00:20:35 kjcf05n00 zabbix-server[2572883]: puppet completed status:(0): '' Nov 5 00:20:36 kjcf05n00 zabbix-server[2572883]: Event '46874' acknowledged Nov 5 00:20:36 kjcf05n00 zabbix-server[2572883]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n03"}' Nov 5 00:20:40 kjcf05n00 python3.9[2573640]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 5 00:20:55 kjcf05n00 mcfcli[3673891]: %3|1730787655.626|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 00:20:58 kjcf05n00 mcfcli[3673891]: %3|1730787658.488|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:21:25 kjcf05n00 mcfcli[3673891]: %3|1730787685.627|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:21:37 kjcf05n00 mcfcli[3673891]: %3|1730787697.375|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:21:55 kjcf05n00 mcfcli[3673891]: %3|1730787715.627|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:22:14 kjcf05n00 mcfcli[3673891]: %3|1730787734.520|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:22:25 kjcf05n00 mcfcli[3673891]: %3|1730787745.627|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:22:51 kjcf05n00 mcfcli[3673891]: %3|1730787771.384|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:22:55 kjcf05n00 mcfcli[3673891]: %3|1730787775.627|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 00:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T06:23:15.867823Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 5 00:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T06:23:15.867921Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.123ms Nov 5 00:23:25 kjcf05n00 mcfcli[3673891]: %3|1730787805.627|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 00:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-05T00:23:27.253198532-06:00 level=info msg="Completed cleanup jobs" duration=26.507865ms Nov 5 00:23:28 kjcf05n00 mcfcli[3673891]: %3|1730787808.628|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:23:55 kjcf05n00 mcfcli[3673891]: %3|1730787835.628|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 5 00:24:07 kjcf05n00 mcfcli[3673891]: %3|1730787847.556|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:24:09 kjcf05n02 nslcd[6988]: [1b58ba] ldap_result() failed: Can't contact LDAP server Nov 5 00:24:12 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 5 00:24:12 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 0 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007398 sec, idle for 1 hour(s)] Nov 5 00:24:13 kjcf05n02 nslcd[6988]: [b141f2] ldap_result() failed: Can't contact LDAP server Nov 5 00:24:25 kjcf05n00 mcfcli[3673891]: %3|1730787865.629|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:24:47 kjcf05n00 mcfcli[3673891]: %3|1730787887.553|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:24:55 kjcf05n00 mcfcli[3673891]: %3|1730787895.629|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 00:25:25 kjcf05n00 mcfcli[3673891]: %3|1730787925.269|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:25:26 kjcf05n00 mcfcli[3673891]: %3|1730787926.128|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 00:25:43 kjcf05n00 python3.9[2576585]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 5 00:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 5 00:25:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 5 00:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 5 00:25:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 5 00:25:56 kjcf05n00 mcfcli[3673891]: %3|1730787956.129|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:26:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 5 00:26:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 5 00:26:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 5 00:26:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 5 00:26:02 kjcf05n00 mcfcli[3673891]: %3|1730787962.893|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:26:07 kjcf05n00 zabbix_server[15719]: Zabbix agent item "xrtx.enclosure.discovery" on host "kjcf05n03" failed: first network error, wait for 15 seconds Nov 5 00:26:14 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 5 00:26:14 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 5 00:26:14 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 5 00:26:14 kjcf05n02 fstonithd.py[15175]: My partner 172.16.2.6 is kdumping. Forcing HA into GATHER state. Nov 5 00:26:15 kjcf05n02 root[127870]: is_enc_ipmi_off starts Nov 5 00:26:15 kjcf05n02 root[127871]: is_viking_off starts Nov 5 00:26:16 kjcf05n02 root[127887]: is_lan_ipmi_off leaves Nov 5 00:26:16 kjcf05n02 root[127889]: is_lan_ipmi_sec_off leaves Nov 5 00:26:16 kjcf05n02 root[127892]: I am master Nov 5 00:26:16 kjcf05n02 root[127895]: I am in slot 0; partner is in slot 1 Nov 5 00:26:20 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 5 00:26:20 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 5 00:26:22 kjcf05n00 zabbix_server[15776]: Zabbix agent item "vfs.fs.size[/var/lib/reboot_cnt,total]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 5 00:26:23 kjcf05n00 zabbix_server[15745]: Zabbix agent item "vfs.fs.size[/etc/ganesha,total]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 5 00:26:23 kjcf05n02 root[128155]: is_viking_off leaves Nov 5 00:26:23 kjcf05n02 root[128166]: kjcf05n03 not already off look at kdump Nov 5 00:26:23 kjcf05n02 root[128182]: is_kdump_off starts Nov 5 00:26:23 kjcf05n02 fence_kdump[128183]: waiting for message from '172.16.2.6' Nov 5 00:26:23 kjcf05n02 fence_kdump[128183]: received valid message from '172.16.2.6' Nov 5 00:26:23 kjcf05n02 root[128194]: is_kdump_off detected kdump on kjcf05n03 Nov 5 00:26:23 kjcf05n02 root[128206]: kjcf05n03 is kdumping Nov 5 00:26:23 kjcf05n02 root[128301]: is_enc_ipmi_off starts Nov 5 00:26:23 kjcf05n02 root[128303]: is_viking_off starts Nov 5 00:26:24 kjcf05n02 root[128355]: I am master Nov 5 00:26:24 kjcf05n02 root[128358]: I am in slot 0; partner is in slot 1 Nov 5 00:26:24 kjcf05n02 root[128366]: is_lan_ipmi_off leaves Nov 5 00:26:24 kjcf05n02 root[128368]: is_lan_ipmi_sec_off leaves Nov 5 00:26:24 kjcf05n00 zabbix_server[15763]: Zabbix agent item "vfs.fs.size[/mnt/persistent_ha_data,used]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 5 00:26:24 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 5 00:26:24 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 5 00:26:25 kjcf05n00 zabbix_server[15738]: Zabbix agent item "proc.num[,,run]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 5 00:26:26 kjcf05n00 zabbix_server[15728]: Zabbix agent item "vfs.fs.size[/var/lib/mdraidscripts,used]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 5 00:26:26 kjcf05n00 mcfcli[3673891]: %3|1730787986.129|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:26:26 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 5 00:26:26 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 5 00:26:27 kjcf05n00 zabbix_server[15734]: Zabbix agent item "system.cpu.intr" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 5 00:26:28 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='70', error='Connection reset by peer (104)' Nov 5 00:26:28 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='70', client='AF_INET(172.16.2.6:46431)', local='AF_INET(0.0.0.0:601)' Nov 5 00:26:30 kjcf05n02 root[128586]: is_viking_off leaves Nov 5 00:26:30 kjcf05n02 root[128589]: kjcf05n03 not already off look at kdump Nov 5 00:26:30 kjcf05n02 root[128590]: is_kdump_off starts Nov 5 00:26:30 kjcf05n02 fence_kdump[128591]: waiting for message from '172.16.2.6' Nov 5 00:26:31 kjcf05n02 fence_kdump[128591]: received valid message from '172.16.2.6' Nov 5 00:26:31 kjcf05n02 root[128594]: is_kdump_off detected kdump on kjcf05n03 Nov 5 00:26:31 kjcf05n02 root[128595]: kjcf05n03 is kdumping Nov 5 00:26:35 kjcf05n02 systemd-udevd[130798]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130803]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130805]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130798]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130803]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130805]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130798]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130803]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130805]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130798]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130803]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130805]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130798]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130803]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130798]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130805]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130803]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130798]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130805]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130800]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130803]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130798]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130805]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130803]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130805]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130803]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130798]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130800]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130839]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130803]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130798]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130839]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130803]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130800]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130798]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130839]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130803]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130839]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130803]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130805]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130839]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130803]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130839]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130803]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130839]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130803]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130839]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130839]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130803]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130839]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130803]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130839]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130839]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130803]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130839]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130839]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 systemd-udevd[130839]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:26:35 kjcf05n02 dwd[5236]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 5 00:26:35 kjcf05n02 dwd[5236]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 5 00:26:35 kjcf05n02 dwd[5236]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 5 00:26:35 kjcf05n02 dwd[5236]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 5 00:26:35 kjcf05n02 dwd[5236]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 5 00:26:35 kjcf05n02 dwd[5236]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 5 00:26:35 kjcf05n02 dwd[5236]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 5 00:26:35 kjcf05n02 dwd[5236]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 5 00:26:35 kjcf05n02 dwd[5236]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 5 00:26:35 kjcf05n02 dwd[5236]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 5 00:26:35 kjcf05n02 dwd[5236]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 5 00:26:35 kjcf05n02 dwd[5236]: Starting NVME thread for nvme6n1 Nov 5 00:26:36 kjcf05n02 dwd[5236]: Starting NVME thread for nvme15n1 Nov 5 00:26:36 kjcf05n02 dwd[5236]: Starting NVME thread for nvme16n1 Nov 5 00:26:36 kjcf05n02 dwd[5236]: Starting NVME thread for nvme5n1 Nov 5 00:26:36 kjcf05n02 dwd[5236]: Starting NVME thread for nvme20n1 Nov 5 00:26:36 kjcf05n02 dwd[5236]: Starting NVME thread for nvme11n1 Nov 5 00:26:36 kjcf05n02 dwd[5236]: Starting NVME thread for nvme22n1 Nov 5 00:26:37 kjcf05n02 dwd[5236]: Starting NVME thread for nvme21n1 Nov 5 00:26:37 kjcf05n02 dwd[5236]: Starting NVME thread for nvme12n1 Nov 5 00:26:37 kjcf05n02 dwd[5236]: Starting NVME thread for nvme10n1 Nov 5 00:26:37 kjcf05n02 dwd[5236]: Starting NVME thread for nvme7n1 Nov 5 00:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 5 00:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 5 00:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 5 00:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 5 00:26:38 kjcf05n02 diskmonitor[17460]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 5 00:26:41 kjcf05n00 mcfcli[3673891]: %3|1730788001.337|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:26:42 kjcf05n00 zabbix_server[15783]: Zabbix agent item "vm.memory.size[cached]" on host "kjcf05n03" failed: another network error, wait for 15 seconds Nov 5 00:26:46 kjcf05n02 diskmonitor[17460]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 5 00:26:46 kjcf05n02 diskmonitor[17460]: Scan for ReadErrorMax change for md66 Nov 5 00:26:46 kjcf05n02 diskmonitor[17460]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 5 00:26:46 kjcf05n02 diskmonitor[17460]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 5 00:26:46 kjcf05n02 diskmonitor[17460]: read_saved_file: md66 no saved speed Nov 5 00:26:46 kjcf05n02 diskmonitor[17460]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 5 00:26:46 kjcf05n02 diskmonitor[17460]: Set sync_speed_min (10000) for md66 Nov 5 00:26:46 kjcf05n02 diskmonitor[17460]: Set sync_speed_max (200000) for md66 Nov 5 00:26:46 kjcf05n02 diskmonitor[17460]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 5 00:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 5 00:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 5 00:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 5 00:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 5 00:26:56 kjcf05n00 mcfcli[3673891]: %3|1730788016.129|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:26:57 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n03": interface unavailable Nov 5 00:27:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 5 00:27:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 5 00:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 5 00:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 5 00:27:18 kjcf05n00 mcfcli[3673891]: %3|1730788038.988|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:27:20 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 5 00:27:20 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 5 00:27:24 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 5 00:27:24 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 5 00:27:26 kjcf05n00 mcfcli[3673891]: %3|1730788046.130|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 5 00:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 5 00:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 5 00:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 5 00:27:44 kjcf05n02 nslcd[6988]: [b71efb] ldap_result() failed: Can't contact LDAP server Nov 5 00:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 5 00:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 5 00:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 5 00:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 5 00:27:56 kjcf05n00 mcfcli[3673891]: %3|1730788076.130|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:27:57 kjcf05n00 mcfcli[3673891]: %3|1730788077.915|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:28:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 5 00:28:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 5 00:28:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 5 00:28:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 5 00:28:11 kjcf05n02 nslcd[6988]: [45e146] ldap_result() failed: Can't contact LDAP server Nov 5 00:28:20 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 5 00:28:20 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 5 00:28:24 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 5 00:28:24 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 5 00:28:26 kjcf05n00 mcfcli[3673891]: %3|1730788106.130|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 5 00:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 5 00:28:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 5 00:28:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 5 00:28:37 kjcf05n00 mcfcli[3673891]: %3|1730788117.912|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 5 00:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 5 00:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 5 00:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 5 00:28:56 kjcf05n00 mcfcli[3673891]: %3|1730788136.130|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:29:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 5 00:29:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 5 00:29:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 5 00:29:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 5 00:29:15 kjcf05n02 chronyd[5203]: Selected source 16.110.135.123 Nov 5 00:29:17 kjcf05n00 mcfcli[3673891]: %3|1730788157.910|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:29:20 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 5 00:29:20 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 5 00:29:24 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 5 00:29:24 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 5 00:29:26 kjcf05n00 mcfcli[3673891]: %3|1730788166.130|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:29:33 kjcf05n00 zabbix-server[2579058]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:29:33 kjcf05n00 zabbix-server[2579058]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n03:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 5 00:29:33 kjcf05n00 log_interesting_event.py[2579058]: Event '46877' acknowledged Nov 5 00:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 5 00:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 5 00:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 5 00:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 5 00:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 5 00:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 5 00:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 5 00:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 5 00:29:56 kjcf05n00 mcfcli[3673891]: %3|1730788196.131|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:29:57 kjcf05n00 mcfcli[3673891]: %3|1730788197.907|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:30:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 5 00:30:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 5 00:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 5 00:30:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 5 00:30:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 5 00:29:59 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 5 00:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 5 00:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 5 00:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 5 00:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 5 00:30:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 5 00:30:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:30:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 5 00:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 5 00:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 5 00:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 5 00:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 5 00:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 5 00:30:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 5 00:30:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:30:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 5 00:30:01 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:9a:1a Nov 5 00:30:01 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 5 00:30:05 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a Nov 5 00:30:05 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.6 00:09:3d:06:9a:1a kjcf05n03 Nov 5 00:30:05 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.6 Nov 5 00:30:05 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 5 00:30:05 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.6 Nov 5 00:30:05 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.6 Nov 5 00:30:05 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/pxelinux.cfg to 172.16.2.6 Nov 5 00:30:09 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/vmlinuz_diskless to 172.16.2.6 Nov 5 00:30:12 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n03/boot/initramfs-diskless.img to 172.16.2.6 Nov 5 00:30:20 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 5 00:30:20 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 5 00:30:24 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 5 00:30:24 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 5 00:30:26 kjcf05n00 mcfcli[3673891]: %3|1730788226.131|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 5 00:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 5 00:30:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 5 00:30:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 5 00:30:37 kjcf05n00 mcfcli[3673891]: %3|1730788237.904|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 5 00:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 5 00:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 5 00:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 5 00:30:56 kjcf05n00 mcfcli[3673891]: %3|1730788256.131|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:30:56 kjcf05n00 python3.9[2579620]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 5 00:30:59 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:58040). Nov 5 00:30:59 kjcf05n01 rsyncd[3981329]: connect from kjcf05n03 (172.16.2.6) Nov 5 00:30:59 kjcf05n01 rsyncd[3981329]: rsync on puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 5 00:30:59 kjcf05n01 rsyncd[3981329]: building file list Nov 5 00:30:59 kjcf05n01 rsyncd[3981329]: sent 11442 bytes received 132 bytes total size 10901 Nov 5 00:30:59 kjcf05n01 systemd[1]: rsyncd@677-172.16.2.2:873-172.16.2.6:58040.service: Succeeded. Nov 5 00:31:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 5 00:31:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 5 00:31:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 5 00:31:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 5 00:31:11 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730788270', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 5 00:31:11 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730788270'} Nov 5 00:31:11 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:31:11 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730788270', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 5 00:31:11 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730788270'} Nov 5 00:31:11 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:31:14 kjcf05n02 fstonithd.py[15175]: Listening for kdump packets from partner Nov 5 00:31:17 kjcf05n00 mcfcli[3673891]: %3|1730788277.279|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:31:20 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 5 00:31:20 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 5 00:31:24 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 5 00:31:24 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 5 00:31:26 kjcf05n00 mcfcli[3673891]: %3|1730788286.132|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 5 00:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 5 00:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 5 00:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 5 00:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 5 00:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 5 00:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 5 00:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 5 00:31:56 kjcf05n00 mcfcli[3673891]: %3|1730788316.132|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:31:57 kjcf05n00 mcfcli[3673891]: %3|1730788317.276|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:32:00 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 5 00:32:00 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 5 00:32:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 5 00:32:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 5 00:32:01 kjcf05n02 dwd[5236]: nvme5n1 passed periodic SMART status check Nov 5 00:32:01 kjcf05n02 dwd[5236]: nvme16n1 passed periodic SMART status check Nov 5 00:32:01 kjcf05n02 dwd[5236]: nvme6n1 passed periodic SMART status check Nov 5 00:32:01 kjcf05n02 dwd[5236]: nvme15n1 passed periodic SMART status check Nov 5 00:32:02 kjcf05n02 dwd[5236]: nvme21n1 passed periodic SMART status check Nov 5 00:32:02 kjcf05n02 dwd[5236]: nvme22n1 passed periodic SMART status check Nov 5 00:32:02 kjcf05n02 dwd[5236]: nvme10n1 passed periodic SMART status check Nov 5 00:32:02 kjcf05n02 dwd[5236]: nvme12n1 passed periodic SMART status check Nov 5 00:32:02 kjcf05n02 dwd[5236]: nvme20n1 passed periodic SMART status check Nov 5 00:32:02 kjcf05n02 dwd[5236]: nvme11n1 passed periodic SMART status check Nov 5 00:32:03 kjcf05n02 dwd[5236]: nvme7n1 passed periodic SMART status check Nov 5 00:32:20 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib0 Nov 5 00:32:20 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib0 Nov 5 00:32:24 kjcf05n02 LCNmon[17867]: 10.16.100.53 is unreachable via ib1 Nov 5 00:32:24 kjcf05n02 LCNmon[17867]: 10.16.100.59 is unreachable via ib1 Nov 5 00:32:25 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='70', client='AF_INET(172.16.2.6:44169)', local='AF_INET(0.0.0.0:601)' Nov 5 00:32:25 kjcf05n03 syslog-ng[3159]: Configuration reload request received, reloading configuration; Nov 5 00:32:25 kjcf05n03 syslog-ng[3159]: Configuration reload finished; Nov 5 00:32:25 kjcf05n03 syslog-ng[3159]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 5 00:32:25 kjcf05n03 dracut: dracut-049-135.git20210121.el8 Nov 5 00:32:25 kjcf05n03 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 5 00:32:25 kjcf05n03 dracut: Loading and integrity checking all crypto modules Nov 5 00:32:25 kjcf05n03 dracut: Self testing crypto algorithms Nov 5 00:32:25 kjcf05n03 dracut: rd.md=0: removing MD RAID activation Nov 5 00:32:25 kjcf05n03 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 5 00:32:25 kjcf05n03 Copying live image to RAM... Nov 5 00:32:25 kjcf05n03 (this may take a minute) Nov 5 00:32:25 kjcf05n03 Done copying live image to RAM. Nov 5 00:32:25 kjcf05n03 dracut: Mounted root filesystem LiveOS_rootfs Nov 5 00:32:25 kjcf05n03 dracut: Checking integrity of kernel Nov 5 00:32:25 kjcf05n03 dracut: All initrd crypto checks done Nov 5 00:32:25 kjcf05n03 dracut: Switching root Nov 5 00:32:25 kjcf05n03 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 5 00:32:25 kjcf05n03 systemd: Detected architecture x86-64. Nov 5 00:32:25 kjcf05n03 systemd: Set hostname to . Nov 5 00:32:25 kjcf05n03 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 5 00:32:25 kjcf05n03 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 5 00:32:25 kjcf05n03 systemd: Reached target Swap. Nov 5 00:32:25 kjcf05n03 systemd: Listening on initctl Compatibility Named Pipe. Nov 5 00:32:25 kjcf05n03 systemd: Listening on Journal Socket. Nov 5 00:32:25 kjcf05n03 systemd: Mounting Kernel Debug File System... Nov 5 00:32:25 kjcf05n03 systemd: Listening on Process Core Dump Socket. Nov 5 00:32:25 kjcf05n03 systemd-journald[1549]: Journal started Nov 5 00:32:25 kjcf05n03 systemd-journald[1549]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 5 00:32:25 kjcf05n03 systemd-modules-load[1541]: Inserted module 'fuse' Nov 5 00:32:25 kjcf05n03 systemd[1]: Mounted POSIX Message Queue File System. Nov 5 00:32:25 kjcf05n03 systemd[1]: Mounted /mnt. Nov 5 00:32:25 kjcf05n03 systemd[1]: Mounted Huge Pages File System. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Load/Save Random Seed... Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Rebuild Hardware Database... Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Create System Users... Nov 5 00:32:25 kjcf05n03 systemd[1]: Mounting Kernel Configuration File System... Nov 5 00:32:25 kjcf05n03 systemd[1]: Mounting FUSE Control File System... Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Apply Kernel Variables... Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Load/Save Random Seed. Nov 5 00:32:25 kjcf05n03 systemd[1]: Mounted Kernel Configuration File System. Nov 5 00:32:25 kjcf05n03 systemd[1]: Mounted FUSE Control File System. Nov 5 00:32:25 kjcf05n03 systemd-journald[1549]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Create System Users. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Flush Journal to Persistent Storage. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 5 00:32:25 kjcf05n03 systemd-sysctl[1572]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 5 00:32:25 kjcf05n03 systemd-sysctl[1572]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Apply Kernel Variables. Nov 5 00:32:25 kjcf05n03 systemd-tmpfiles[1576]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 00:32:25 kjcf05n03 systemd-tmpfiles[1576]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Create Static Device Nodes in /dev. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started udev Coldplug all Devices. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Rebuild Hardware Database. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting udev Kernel Device Manager... Nov 5 00:32:25 kjcf05n03 systemd-udevd[1585]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started udev Kernel Device Manager. Nov 5 00:32:25 kjcf05n03 systemd[1]: Found device /dev/ttyS0. Nov 5 00:32:25 kjcf05n03 systemd-udevd[1633]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:32:25 kjcf05n03 systemd-udevd[1609]: Using default interface naming scheme 'rhel-8.0'. Nov 5 00:32:25 kjcf05n03 systemd-udevd[1609]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:32:25 kjcf05n03 systemd-udevd[1625]: Using default interface naming scheme 'rhel-8.0'. Nov 5 00:32:25 kjcf05n03 systemd-udevd[1625]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:32:25 kjcf05n03 systemd-udevd[1650]: Using default interface naming scheme 'rhel-8.0'. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 5 00:32:25 kjcf05n03 systemd[1]: Reached target Local File Systems (Pre). Nov 5 00:32:25 kjcf05n03 systemd[1]: Reached target Local File Systems. Nov 5 00:32:25 kjcf05n03 systemd-udevd[1650]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Rebuild Journal Catalog... Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting openibd - configure Mellanox devices... Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Create Volatile Files and Directories... Nov 5 00:32:25 kjcf05n03 root[1816]: openibd: running in auto mode Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Mark the need to relabel after reboot... Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 5 00:32:25 kjcf05n03 systemd-tmpfiles[1815]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 00:32:25 kjcf05n03 systemd-tmpfiles[1815]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 00:32:25 kjcf05n03 systemd-tmpfiles[1815]: "/var/tmp" already exists and is not a directory. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Rebuild Journal Catalog. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Create Volatile Files and Directories. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Mark the need to relabel after reboot. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting RPC Bind... Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting RDMA Node Description Daemon... Nov 5 00:32:25 kjcf05n03 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 5 00:32:25 kjcf05n03 systemd[1]: Started RDMA Node Description Daemon. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started RPC Bind. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 5 00:32:25 kjcf05n03 systemd-modules-load[1884]: Inserted module 'ib_iser' Nov 5 00:32:25 kjcf05n03 systemd-modules-load[1884]: Inserted module 'ib_isert' Nov 5 00:32:25 kjcf05n03 systemd-modules-load[1884]: Inserted module 'ib_srpt' Nov 5 00:32:25 kjcf05n03 systemd-modules-load[1885]: Inserted module 'ib_ipoib' Nov 5 00:32:25 kjcf05n03 systemd-udevd[1642]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:32:25 kjcf05n03 systemd-modules-load[1884]: Inserted module 'rdma_ucm' Nov 5 00:32:25 kjcf05n03 systemd-modules-load[1884]: Module 'svcrdma' is blacklisted Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 5 00:32:25 kjcf05n03 systemd-udevd[1656]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:32:25 kjcf05n03 systemd-udevd[1642]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 5 00:32:25 kjcf05n03 systemd-udevd[1656]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 5 00:32:25 kjcf05n03 systemd-modules-load[1885]: Inserted module 'ib_umad' Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 5 00:32:25 kjcf05n03 systemd[1]: Reached target RDMA Hardware. Nov 5 00:32:25 kjcf05n03 systemd[1]: Reached target Network (Pre). Nov 5 00:32:25 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 5 00:32:25 kjcf05n03 systemd[3159]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:25 kjcf05n03 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 5 00:32:25 kjcf05n03 openibd[1801]: Loading HCA driver and Access Layer:[ OK ] Nov 5 00:32:25 kjcf05n03 systemd[1]: Started openibd - configure Mellanox devices. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Update is Completed... Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Update is Completed. Nov 5 00:32:25 kjcf05n03 setup-icl[1792]: Setting LAN IP Address to 203.0.113.4 Nov 5 00:32:25 kjcf05n03 setup-icl[1792]: Setting LAN Subnet Mask to 255.255.255.0 Nov 5 00:32:25 kjcf05n03 setup-icl[1792]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 5 00:32:25 kjcf05n03 setup-icl[1792]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 5 00:32:25 kjcf05n03 systemd-udevd[1642]: Using default interface naming scheme 'rhel-8.0'. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 5 00:32:25 kjcf05n03 systemd[1]: Reached target System Initialization. Nov 5 00:32:25 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 5 00:32:25 kjcf05n03 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 5 00:32:25 kjcf05n03 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 5 00:32:25 kjcf05n03 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 5 00:32:25 kjcf05n03 systemd[1]: Listening on lldpad.socket. Nov 5 00:32:25 kjcf05n03 systemd[1]: Reached target Sockets. Nov 5 00:32:25 kjcf05n03 systemd[1]: Reached target Basic System. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started D-Bus System Message Bus. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Resets System Activity Logs... Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[2155]: Setting up Mellanox network interface: ib1 Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 5 00:32:25 kjcf05n03 dwd[2153]: dwd: vMay 29 2024 : 15:38:26 Nov 5 00:32:25 kjcf05n03 dwd[2153]: /usr/sbin/dwd -d --standalone=0 Nov 5 00:32:25 kjcf05n03 dwd[2153]: dwd: option Lethal: 0 Nov 5 00:32:25 kjcf05n03 dwd[2153]: dwd: option Interval: 60 Nov 5 00:32:25 kjcf05n03 dwd[2153]: dwd: option abrtlimit: 10 Nov 5 00:32:25 kjcf05n03 dwd[2153]: dwd: option DZPeriod: 604800 Nov 5 00:32:25 kjcf05n03 dwd[2153]: dwd: option SmartPeriod: 43200 Nov 5 00:32:25 kjcf05n03 dwd[2153]: dwd: option SDDEnabled: 1 Nov 5 00:32:25 kjcf05n03 dwd[2153]: dwd: option SDDAwaitScale: 3 Nov 5 00:32:25 kjcf05n03 dwd[2153]: dwd: option SDDAwaitMin: 100 Nov 5 00:32:25 kjcf05n03 dwd[2153]: dwd: option Verbosity: 1 Nov 5 00:32:25 kjcf05n03 dwd[2153]: dwd: option StandAlone: 0 Nov 5 00:32:25 kjcf05n03 dwd[2153]: option Lethal: 0 Nov 5 00:32:25 kjcf05n03 dwd[2153]: option Interval: 60 Nov 5 00:32:25 kjcf05n03 dwd[2153]: option abrtlimit: 10 Nov 5 00:32:25 kjcf05n03 dwd[2153]: option DZPeriod: 604800 Nov 5 00:32:25 kjcf05n03 dwd[2153]: option SmartPeriod: 43200 Nov 5 00:32:25 kjcf05n03 dwd[2153]: option SDDEnabled: 1 Nov 5 00:32:25 kjcf05n03 dwd[2153]: option SDDAwaitScale: 3 Nov 5 00:32:25 kjcf05n03 dwd[2153]: option SDDAwaitMin: 100 Nov 5 00:32:25 kjcf05n03 dwd[2153]: option Verbosity: 1 Nov 5 00:32:25 kjcf05n03 dwd[2153]: option StandAlone: 0 Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting LSB: Bring up/down networking... Nov 5 00:32:25 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 5 00:32:25 kjcf05n03 network[2171]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[2202]: Setting up Mellanox network interface: ib0 Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 5 00:32:25 kjcf05n03 dbus-daemon[2157]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 5 00:32:25 kjcf05n03 network[2210]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 5 00:32:25 kjcf05n03 network[2171]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Manage Cutlass PHYs... Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[2234]: set_ipoib_cm: ib1 connection mode set to connected Nov 5 00:32:25 kjcf05n03 network[2236]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:32:25 kjcf05n03 network[2171]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Name Service Cache Daemon... Nov 5 00:32:25 kjcf05n03 nscd[2279]: 2279 monitoring file `/etc/hosts` (1) Nov 5 00:32:25 kjcf05n03 nscd[2279]: 2279 monitoring directory `/etc` (2) Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 5 00:32:25 kjcf05n03 nscd[2279]: 2279 monitoring file `/etc/resolv.conf` (3) Nov 5 00:32:25 kjcf05n03 nscd[2279]: 2279 monitoring directory `/etc` (2) Nov 5 00:32:25 kjcf05n03 mdraid-phy[2265]: no Cutlass to worry about Nov 5 00:32:25 kjcf05n03 systemd[1]: Started irqbalance daemon. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[2268]: set_ipoib_cm: ib0 connection mode set to connected Nov 5 00:32:25 kjcf05n03 network[2270]: It is advised to switch to 'NetworkManager' instead for network management. Nov 5 00:32:25 kjcf05n03 chronyd[2297]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[2278]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 0 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 1 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 2 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 3 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 4 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 5 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 6 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 7 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 8 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 9 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 10 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 11 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 12 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 13 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 14 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 15 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 16 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 17 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 18 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 19 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 20 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 21 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 22 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 23 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 24 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 25 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 26 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 27 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 28 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 29 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 30 Nov 5 00:32:25 kjcf05n03 cpupower[2316]: Setting cpu: 31 Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 5 00:32:25 kjcf05n03 mcelog[2307]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 5 00:32:25 kjcf05n03 mcelog[2307]: CPU is unsupported Nov 5 00:32:25 kjcf05n03 beSetMlxConfig[2289]: ConnectX-3 multiport not detected Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Resets System Activity Logs. Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[2302]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 5 00:32:25 kjcf05n03 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[2313]: No configuration found for ib1 Nov 5 00:32:25 kjcf05n03 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Manage Cutlass PHYs. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[2325]: No configuration found for ib0 Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Name Service Cache Daemon. Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[2331]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 5 00:32:25 kjcf05n03 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 5 00:32:25 kjcf05n03 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 0 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 1 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 2 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 3 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 4 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 5 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 6 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 7 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 8 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 9 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 10 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 11 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 12 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 13 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 14 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 15 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 16 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 17 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 18 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 19 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 20 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 21 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 22 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 23 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 24 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 25 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 26 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 27 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 28 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 29 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 30 Nov 5 00:32:25 kjcf05n03 cpupower[2349]: Idlestate 2 disabled on CPU 31 Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 5 00:32:25 kjcf05n03 chronyd[2297]: Wrong owner of /var/run/chrony (UID != 991) Nov 5 00:32:25 kjcf05n03 chronyd[2297]: Disabled command socket /var/run/chrony/chronyd.sock Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[2340]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 5 00:32:25 kjcf05n03 beSetMlxConfig[2289]: Starting MST (Mellanox Software Tools) driver set Nov 5 00:32:25 kjcf05n03 mlnx_conf_mgr[2371]: INFO: No configurations found for mlx5_1, skipping. Nov 5 00:32:25 kjcf05n03 sssd[sssd][2209]: Starting up Nov 5 00:32:25 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 5 00:32:25 kjcf05n03 mlnx_conf_mgr[2394]: INFO: No configurations found for mlx5_0, skipping. Nov 5 00:32:25 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 5 00:32:25 kjcf05n03 beSetMlxConfig[2289]: Loading MST PCI module - Success Nov 5 00:32:25 kjcf05n03 beSetMlxConfig[2289]: Loading MST PCI configuration module - Success Nov 5 00:32:25 kjcf05n03 beSetMlxConfig[2289]: Create devices Nov 5 00:32:25 kjcf05n03 sssd[be[implicit_files]][2413]: Starting up Nov 5 00:32:25 kjcf05n03 sssd[nss][2500]: Starting up Nov 5 00:32:25 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 5 00:32:25 kjcf05n03 systemd[1]: Reached target User and Group Name Lookups. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Login Service... Nov 5 00:32:25 kjcf05n03 systemd-logind[2601]: New seat seat0. Nov 5 00:32:25 kjcf05n03 systemd-logind[2601]: Watching system buttons on /dev/input/event0 (Power Button) Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Login Service. Nov 5 00:32:25 kjcf05n03 python3.9[2156]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 5 00:32:25 kjcf05n03 python3.9[3159]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 00:32:25 kjcf05n03 systemd-sysctl[2760]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 5 00:32:25 kjcf05n03 systemd-sysctl[2760]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 5 00:32:25 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 00:32:25 kjcf05n03 python3.9[2843]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 5 00:32:25 kjcf05n03 python3.9[3159]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 5 00:32:25 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 00:32:25 kjcf05n03 network[2171]: Bringing up loopback interface: [ OK ] Nov 5 00:32:25 kjcf05n03 systemd-sysctl[3085]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 5 00:32:25 kjcf05n03 systemd-sysctl[3085]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 5 00:32:25 kjcf05n03 systemd[1]: Started LSB: Bring up/down networking. Nov 5 00:32:25 kjcf05n03 python3.9[3016]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 5 00:32:25 kjcf05n03 python3.9[3159]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:25 kjcf05n03 systemd[1]: Reached target Network. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 5 00:32:25 kjcf05n03 systemd[1]: Reached target Network is Online. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Notify NFS peers of a restart... Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting System Logger Daemon... Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 00:32:25 kjcf05n03 sm-notify[3145]: Version 2.3.3 starting Nov 5 00:32:25 kjcf05n03 systemd[1]: Started GSSAPI Proxy Daemon. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Notify NFS peers of a restart. Nov 5 00:32:25 kjcf05n03 systemd[1]: Reached target NFS client services. Nov 5 00:32:25 kjcf05n03 systemd[1]: Reached target Remote File Systems (Pre). Nov 5 00:32:25 kjcf05n03 systemd[1]: Reached target Remote File Systems. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Permit User Sessions... Nov 5 00:32:25 kjcf05n03 lldpad[3134]: setsockopt nearest_bridge: Invalid argument Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Permit User Sessions. Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 5 00:32:25 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 00:32:25 kjcf05n03 lldpad[3134]: setsockopt nearest_bridge: Invalid argument Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Serial Getty on ttyS0. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Getty on tty1. Nov 5 00:32:25 kjcf05n03 systemd[1]: Reached target Login Prompts. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 5 00:32:25 kjcf05n03 syslog-ng[3159]: [2024-11-05T06:31:12.684465] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 5 00:32:25 kjcf05n03 syslog-ng[3159]: [2024-11-05T06:31:12.684785] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 5 00:32:25 kjcf05n03 syslog-ng[3159]: [2024-11-05T06:31:12.684824] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 5 00:32:25 kjcf05n03 syslog-ng[3159]: [2024-11-05T06:31:12.685414] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 5 00:32:25 kjcf05n03 syslog-ng[3159]: [2024-11-05T06:31:12.685721] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 5 00:32:25 kjcf05n03 systemd[1]: Started System Logger Daemon. Nov 5 00:32:25 kjcf05n03 python3.9[3228]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 5 00:32:25 kjcf05n03 python3.9[3159]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 00:32:25 kjcf05n03 beSetMlxConfig[2289]: Unloading MST PCI module (unused) - Success Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 5 00:32:25 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 00:32:25 kjcf05n03 python3.9[3465]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 5 00:32:25 kjcf05n03 python3.9[3159]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 5 00:32:25 kjcf05n03 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 5 00:32:25 kjcf05n03 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 00:32:25 kjcf05n03 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 5 00:32:25 kjcf05n03 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 5 00:32:25 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 5 00:32:25 kjcf05n03 sshd[3474]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 5 00:32:25 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 5 00:32:25 kjcf05n03 chronyd[2297]: System's initial offset : 0.000044 seconds fast of true (slew) Nov 5 00:32:25 kjcf05n03 systemd[1]: Started NTP client/server. Nov 5 00:32:25 kjcf05n03 beSetMlxConfig[2289]: Configuring /dev/mst/mt4123_pciconf1 Nov 5 00:32:25 kjcf05n03 beSetMlxConfig[2289]: ib mode Nov 5 00:32:25 kjcf05n03 root[3492]: openibd: Set node_desc for mlx5_0: kjcf05n03 HCA-1 Nov 5 00:32:25 kjcf05n03 root[3494]: openibd: Set node_desc for mlx5_1: kjcf05n03 HCA-2 Nov 5 00:32:25 kjcf05n03 beSetMlxConfig[2289]: Configuring /dev/mst/mt4123_pciconf0 Nov 5 00:32:25 kjcf05n03 beSetMlxConfig[2289]: ib mode Nov 5 00:32:25 kjcf05n03 systemd-udevd[1585]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 00:32:25 kjcf05n03 systemd-udevd[3508]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:32:25 kjcf05n03 systemd-udevd[3509]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:32:25 kjcf05n03 systemd-udevd[3512]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:32:25 kjcf05n03 systemd-udevd[3515]: Using default interface naming scheme 'rhel-8.0'. Nov 5 00:32:25 kjcf05n03 systemd-udevd[3515]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:32:25 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 5 00:32:25 kjcf05n03 systemd[3159]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:25 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[3550]: Setting up Mellanox network interface: ib0 Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[3551]: Setting up Mellanox network interface: ib1 Nov 5 00:32:25 kjcf05n03 systemd-udevd[3511]: Using default interface naming scheme 'rhel-8.0'. Nov 5 00:32:25 kjcf05n03 systemd-udevd[3510]: Using default interface naming scheme 'rhel-8.0'. Nov 5 00:32:25 kjcf05n03 systemd-udevd[3511]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:32:25 kjcf05n03 systemd-udevd[3510]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Puppet agent... Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[3600]: set_ipoib_cm: ib0 connection mode set to connected Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[3601]: set_ipoib_cm: ib1 connection mode set to connected Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[3632]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[3631]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[3633]: No configuration found for ib1 Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[3634]: No configuration found for ib0 Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[3641]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[3642]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 5 00:32:25 kjcf05n03 mlnx_conf_mgr[3681]: INFO: No configurations found for mlx5_1, skipping. Nov 5 00:32:25 kjcf05n03 mlnx_conf_mgr[3682]: INFO: No configurations found for mlx5_0, skipping. Nov 5 00:32:25 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 5 00:32:25 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 5 00:32:25 kjcf05n03 systemd[1]: Stopping Command Scheduler... Nov 5 00:32:25 kjcf05n03 systemd[1]: crond.service: Succeeded. Nov 5 00:32:25 kjcf05n03 systemd[1]: Stopped Command Scheduler. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Command Scheduler. Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 5 00:32:25 kjcf05n03 systemd[1]: Stopping Job spooling tools... Nov 5 00:32:25 kjcf05n03 systemd[1]: atd.service: Succeeded. Nov 5 00:32:25 kjcf05n03 systemd[1]: Stopped Job spooling tools. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Job spooling tools. Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 5 00:32:25 kjcf05n03 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 5 00:32:25 kjcf05n03 lldpad[3134]: init_ports: Error adding device ib0 Nov 5 00:32:25 kjcf05n03 lldpad[3134]: init_ports: Error adding device ib1 Nov 5 00:32:25 kjcf05n03 lldpad[3134]: Signal 15 received - terminating Nov 5 00:32:25 kjcf05n03 systemd[1]: lldpad.service: Succeeded. Nov 5 00:32:25 kjcf05n03 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 5 00:32:25 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 5 00:32:25 kjcf05n03 systemd[1]: lldpad.socket: Succeeded. Nov 5 00:32:25 kjcf05n03 systemd[1]: Closed lldpad.socket. Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 5 00:32:25 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting IPMI Driver... Nov 5 00:32:25 kjcf05n03 systemd[1]: Started IPMI Driver. Nov 5 00:32:25 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:25 kjcf05n03 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:25 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Ipmievd Daemon... Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 1 | Nov-05-2024 | 06:01:35 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 2 | Nov-05-2024 | 06:02:27 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 3 | Nov-05-2024 | 06:02:27 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 4 | Nov-05-2024 | 06:03:32 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 5 | Nov-05-2024 | 06:03:33 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 6 | Nov-05-2024 | 06:26:55 | Sensor #0 (Generator ID 21h) | Memory | Assertion Event | Correctable memory error ; OEM Event Data2 code = 30h ; OEM Event Data3 code = 00h Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 7 | Nov-05-2024 | 06:28:30 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 8 | Nov-05-2024 | 06:28:30 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 9 | Nov-05-2024 | 06:28:30 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 10 | Nov-05-2024 | 06:28:30 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 11 | Nov-05-2024 | 06:28:30 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 12 | Nov-05-2024 | 06:28:30 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 13 | Nov-05-2024 | 06:28:30 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 14 | Nov-05-2024 | 06:28:30 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 15 | Nov-05-2024 | 06:28:30 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 16 | Nov-05-2024 | 06:28:30 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 17 | Nov-05-2024 | 06:28:31 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 18 | Nov-05-2024 | 06:28:31 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 19 | Nov-05-2024 | 06:28:31 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 20 | Nov-05-2024 | 06:28:31 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 21 | Nov-05-2024 | 06:28:31 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 22 | Nov-05-2024 | 06:28:31 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 23 | Nov-05-2024 | 06:28:31 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 24 | Nov-05-2024 | 06:28:31 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 25 | Nov-05-2024 | 06:28:31 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 26 | Nov-05-2024 | 06:28:31 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 27 | Nov-05-2024 | 06:28:31 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 28 | Nov-05-2024 | 06:28:31 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 29 | Nov-05-2024 | 06:28:32 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 30 | Nov-05-2024 | 06:28:32 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 31 | Nov-05-2024 | 06:28:32 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 32 | Nov-05-2024 | 06:28:32 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 33 | Nov-05-2024 | 06:28:32 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 34 | Nov-05-2024 | 06:28:32 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 35 | Nov-05-2024 | 06:28:32 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 36 | Nov-05-2024 | 06:28:32 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 37 | Nov-05-2024 | 06:28:32 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 38 | Nov-05-2024 | 06:28:32 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 39 | Nov-05-2024 | 06:29:01 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 40 | Nov-05-2024 | 06:29:01 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 41 | Nov-05-2024 | 06:29:01 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 42 | Nov-05-2024 | 06:29:01 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 43 | Nov-05-2024 | 06:29:01 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 44 | Nov-05-2024 | 06:29:01 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 45 | Nov-05-2024 | 06:29:01 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 46 | Nov-05-2024 | 06:29:01 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 47 | Nov-05-2024 | 06:29:01 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 48 | Nov-05-2024 | 06:29:01 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 49 | Nov-05-2024 | 06:29:01 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 5 00:32:25 kjcf05n03 ipmievd[4024]: 50 | Nov-05-2024 | 06:29:01 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 5 00:32:25 kjcf05n03 ipmievd[4027]: Reading sensors... Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Ipmievd Daemon. Nov 5 00:32:25 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:25 kjcf05n03 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 5 00:32:25 kjcf05n03 nscd[2279]: 2279 monitored file `/etc/hosts` was moved into place, adding watch Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 5 00:32:25 kjcf05n03 systemd[1]: set-mlx-config.service: Succeeded. Nov 5 00:32:25 kjcf05n03 systemd[1]: Stopped Set Mellanox configuration. Nov 5 00:32:25 kjcf05n03 systemd[1]: Stopping Set Mellanox configuration... Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Set Mellanox configuration... Nov 5 00:32:25 kjcf05n03 beSetMlxConfig[4085]: ConnectX-3 multiport not detected Nov 5 00:32:25 kjcf05n03 beSetMlxConfig[4085]: Starting MST (Mellanox Software Tools) driver set Nov 5 00:32:25 kjcf05n03 beSetMlxConfig[4085]: Loading MST PCI module - Success Nov 5 00:32:25 kjcf05n03 systemd-udevd[1585]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 00:32:25 kjcf05n03 beSetMlxConfig[4085]: [warn] mst_pciconf is already loaded, skipping Nov 5 00:32:25 kjcf05n03 beSetMlxConfig[4085]: Create devices Nov 5 00:32:25 kjcf05n03 beSetMlxConfig[4085]: Unloading MST PCI module (unused) - Success Nov 5 00:32:25 kjcf05n03 ipmievd[4027]: Waiting for events... Nov 5 00:32:25 kjcf05n03 beSetMlxConfig[4085]: Configuring /dev/mst/mt4123_pciconf1 Nov 5 00:32:25 kjcf05n03 beSetMlxConfig[4085]: ib mode Nov 5 00:32:25 kjcf05n03 beSetMlxConfig[4085]: Configuring /dev/mst/mt4123_pciconf0 Nov 5 00:32:25 kjcf05n03 beSetMlxConfig[4085]: ib mode Nov 5 00:32:25 kjcf05n03 systemd-udevd[1585]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 00:32:25 kjcf05n03 systemd-udevd[4984]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:32:25 kjcf05n03 systemd-udevd[4985]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:32:25 kjcf05n03 systemd-udevd[4988]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:32:25 kjcf05n03 systemd-udevd[4990]: Using default interface naming scheme 'rhel-8.0'. Nov 5 00:32:25 kjcf05n03 systemd-udevd[4990]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:32:25 kjcf05n03 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 5 00:32:25 kjcf05n03 systemd[3159]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:25 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[5026]: Setting up Mellanox network interface: ib1 Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[5027]: Setting up Mellanox network interface: ib0 Nov 5 00:32:25 kjcf05n03 systemd-udevd[4987]: Using default interface naming scheme 'rhel-8.0'. Nov 5 00:32:25 kjcf05n03 systemd-udevd[4986]: Using default interface naming scheme 'rhel-8.0'. Nov 5 00:32:25 kjcf05n03 systemd-udevd[4987]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:32:25 kjcf05n03 systemd-udevd[4986]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Set Mellanox configuration. Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[5078]: set_ipoib_cm: ib1 connection mode set to connected Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[5084]: set_ipoib_cm: ib0 connection mode set to connected Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[5105]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[5108]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[5109]: No configuration found for ib1 Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[5110]: No configuration found for ib0 Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[5114]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 5 00:32:25 kjcf05n03 mlnx_interface_mgr[5118]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 5 00:32:25 kjcf05n03 mlnx_conf_mgr[5154]: INFO: No configurations found for mlx5_1, skipping. Nov 5 00:32:25 kjcf05n03 mlnx_conf_mgr[5158]: INFO: No configurations found for mlx5_0, skipping. Nov 5 00:32:25 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 5 00:32:25 kjcf05n03 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}3908603099fc713b2800f4fc098ddf4380862dbe81fea175d8924624d5daf327' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}ef65926d0edb5ef1345b6523f73d9b3eb4bfb4fd2a7fa1d436b4e5a5d8f88229' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}ef65926d0edb5ef1345b6523f73d9b3eb4bfb4fd2a7fa1d436b4e5a5d8f88229' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}4967d00f3383ca9b590eb2bf6c33e89fa0b501c3acb5f24a400f417435bd4dcf' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}4967d00f3383ca9b590eb2bf6c33e89fa0b501c3acb5f24a400f417435bd4dcf' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}e0c8e0a14c3483f301426665e2a71a2b3df293ee271f057ef35da858115fd4fa' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}e0c8e0a14c3483f301426665e2a71a2b3df293ee271f057ef35da858115fd4fa' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}066ae305c8638dd717a4a9120251a83542c3dc73aa90c4c8c3eb960746224820' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}066ae305c8638dd717a4a9120251a83542c3dc73aa90c4c8c3eb960746224820' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 5 00:32:25 kjcf05n03 systemd[1]: Stopping NTP client/server... Nov 5 00:32:25 kjcf05n03 chronyd[2297]: chronyd exiting Nov 5 00:32:25 kjcf05n03 systemd[1]: chronyd.service: Succeeded. Nov 5 00:32:25 kjcf05n03 systemd[1]: Stopped NTP client/server. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting NTP client/server... Nov 5 00:32:25 kjcf05n03 chronyd[5193]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 5 00:32:25 kjcf05n03 chronyd[5193]: Wrong owner of /var/run/chrony (UID != 991) Nov 5 00:32:25 kjcf05n03 chronyd[5193]: Disabled command socket /var/run/chrony/chronyd.sock Nov 5 00:32:25 kjcf05n03 chronyd[5193]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 5 00:32:25 kjcf05n03 systemd[1]: Started NTP client/server. Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 5 00:32:25 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:25 kjcf05n03 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 5 00:32:25 kjcf05n03 systemd[1]: dwd.service: Succeeded. Nov 5 00:32:25 kjcf05n03 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 5 00:32:25 kjcf05n03 dwd[5225]: dwd: vMay 29 2024 : 15:38:26 Nov 5 00:32:25 kjcf05n03 dwd[5225]: /usr/sbin/dwd -i 15 -d Nov 5 00:32:25 kjcf05n03 dwd[5225]: dwd: option Lethal: 0 Nov 5 00:32:25 kjcf05n03 dwd[5225]: dwd: option Interval: 15 Nov 5 00:32:25 kjcf05n03 dwd[5225]: dwd: option abrtlimit: 10 Nov 5 00:32:25 kjcf05n03 dwd[5225]: dwd: option DZPeriod: 604800 Nov 5 00:32:25 kjcf05n03 dwd[5225]: dwd: option SmartPeriod: 43200 Nov 5 00:32:25 kjcf05n03 dwd[5225]: dwd: option SDDEnabled: 1 Nov 5 00:32:25 kjcf05n03 dwd[5225]: dwd: option SDDAwaitScale: 3 Nov 5 00:32:25 kjcf05n03 dwd[5225]: dwd: option SDDAwaitMin: 100 Nov 5 00:32:25 kjcf05n03 dwd[5225]: dwd: option Verbosity: 1 Nov 5 00:32:25 kjcf05n03 dwd[5225]: dwd: option StandAlone: 0 Nov 5 00:32:25 kjcf05n03 dwd[5225]: option Lethal: 0 Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Disk Watching Daemon (DWD). Nov 5 00:32:25 kjcf05n03 dwd[5225]: option Interval: 15 Nov 5 00:32:25 kjcf05n03 dwd[5225]: option abrtlimit: 10 Nov 5 00:32:25 kjcf05n03 dwd[5225]: option DZPeriod: 604800 Nov 5 00:32:25 kjcf05n03 dwd[5225]: option SmartPeriod: 43200 Nov 5 00:32:25 kjcf05n03 dwd[5225]: option SDDEnabled: 1 Nov 5 00:32:25 kjcf05n03 dwd[5225]: option SDDAwaitScale: 3 Nov 5 00:32:25 kjcf05n03 dwd[5225]: option SDDAwaitMin: 100 Nov 5 00:32:25 kjcf05n03 dwd[5225]: option Verbosity: 1 Nov 5 00:32:25 kjcf05n03 dwd[5225]: option StandAlone: 0 Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 5 00:32:25 kjcf05n03 dwd[5226]: option Lethal now set to 1 Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 5 00:32:25 kjcf05n03 dwd[5226]: option abrtlimit now set to 1 Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 5 00:32:25 kjcf05n03 dwd[5226]: option SmartPeriod now set to 86400 Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 5 00:32:25 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 5 00:32:25 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Discard unused blocks. Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:25 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:25 kjcf05n03 python3.9[5255]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 5 00:32:25 kjcf05n03 python3.9[3159]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 5 00:32:25 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Periodic ZFS scrub. Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:25 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 5 00:32:25 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:25 kjcf05n03 systemd[1]: Starting Sed Control Plane worker process... Nov 5 00:32:25 kjcf05n03 sedcpwrkr[5393]: Using config script: /etc/sedcpwrkr.conf Nov 5 00:32:25 kjcf05n03 sedcpwrkr[5393]: - Creating default directory: '/var/log/sedcpwrkr' Nov 5 00:32:25 kjcf05n03 sedcpwrkr[5393]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 5 00:32:25 kjcf05n03 sedcpwrkr[5393]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 5 00:32:25 kjcf05n03 sedcpwrkr[5393]: - Creating default directory: '/var/run/sedcpwrkr' Nov 5 00:32:25 kjcf05n03 sedcpwrkr[5393]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 5 00:32:25 kjcf05n03 sedcpwrkr[5393]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 5 00:32:25 kjcf05n03 sedcpwrkr-server[5424]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 5 00:32:25 kjcf05n03 sedcpwrkr[5393]: celery multi v5.2.7 (dawn-chorus) Nov 5 00:32:25 kjcf05n03 sedcpwrkr[5393]: > Starting nodes... Nov 5 00:32:25 kjcf05n03 sedcpwrkr[5393]: > sedcpwrkr@kjcf05n03: OK Nov 5 00:32:25 kjcf05n03 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 5 00:32:25 kjcf05n03 sedcpwrkr-server[5426]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 5 00:32:25 kjcf05n03 sedcpwrkr-server[5426]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 5 00:32:25 kjcf05n03 sedcpwrkr-server[5426]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 5 00:32:25 kjcf05n03 systemd[1]: Started Sed Control Plane worker process. Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 5 00:32:25 kjcf05n03 systemd[1]: Reloading System Logger Daemon. Nov 5 00:32:25 kjcf05n03 systemd[1]: Reloaded System Logger Daemon. Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 5 00:32:25 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 5 00:32:25 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 5 00:32:26 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:26 kjcf05n03 systemd[1]: Starting IPv4 firewall with iptables... Nov 5 00:32:26 kjcf05n03 systemd-udevd[1585]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 00:32:26 kjcf05n03 iptables.init[5493]: iptables: Applying firewall rules: [ OK ] Nov 5 00:32:26 kjcf05n03 systemd[1]: Started IPv4 firewall with iptables. Nov 5 00:32:26 kjcf05n00 mcfcli[3673891]: %3|1730788346.132|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:32:26 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:27 kjcf05n03 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}0087eeddd5181c4d813257c5f97fbdae42be53e4c8cb266582b64a1441e8ff15' Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}ea5135cb1b68237724581715511fac37563edb9f55df315537d7043fa46e0792' Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 5 00:32:27 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 5 00:32:27 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 5 00:32:27 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:27 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 5 00:32:27 kjcf05n03 systemd[1]: openhpid.service: Supervising process 5591 which is not our child. We'll most likely not notice when it exits. Nov 5 00:32:27 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 5 00:32:27 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:28 kjcf05n03 openhpid[5591]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 5 00:32:28 kjcf05n03 openhpid[5591]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 5 00:32:28 kjcf05n03 openhpid[5591]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 5 00:32:28 kjcf05n03 openhpid[5591]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 5 00:32:28 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:28 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:28 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:28 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 5 00:32:28 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}4c86b3bd20578a8dc5364065299957fa425e756e10e4a3ba47c3e89e4f6cc531' Nov 5 00:32:28 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 5 00:32:28 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 5 00:32:28 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:28 kjcf05n03 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 5 00:32:29 kjcf05n03 dcs-collectord[5682]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 5 00:32:29 kjcf05n03 hpi.inv.log[5682]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 5 00:32:29 kjcf05n03 dcs-collectord[5682]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 5 00:32:29 kjcf05n03 dcs-collectord[5682]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 5 00:32:29 kjcf05n03 dcs-collector[5673]: Starting dcs-collector:[ OK ] Nov 5 00:32:29 kjcf05n03 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 5 00:32:29 kjcf05n03 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 5 00:32:29 kjcf05n03 dcs-collectord[5685]: INFO Starting collection for memory_info (collection_process.py:52) Nov 5 00:32:29 kjcf05n03 dcs-collectord[5685]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 5 00:32:29 kjcf05n03 dcs-collectord[5685]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 00:32:29 kjcf05n03 dcs-collectord[5685]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 5 00:32:29 kjcf05n03 dcs-collectord[5685]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 5 00:32:29 kjcf05n03 dcs-collectord[5685]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 5 00:32:29 kjcf05n03 dcs-collectord[5685]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 5 00:32:29 kjcf05n03 dcs-collectord[5685]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259349384", "units": "kB"}, {"name": "MemAvailable", "value": "258629064", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821320", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1687108", "units": "kB"}, {"name": "Inactive", "value": "959548", "units": "kB"}, {"name": "Active(anon)", "value": "1520620", "units": "kB"}, {"name": "Inactive(anon)", "value": "823712", "units": "kB"}, {"name": "Active(file)", "value": "166488", "units": "kB"}, {"name": "Inactive(file)", "value": "135836", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "750424", "units": "kB"}, {"name": "Mapped", "value": "85684", "units": "kB"}, {"name": "Shmem", "value": "1593448", "units": "kB"}, {"name": "KReclaimable", "value": "109196", "units": "kB"}, {"name": "Slab", "value": "275912", "units": "kB"}, {"name": "SReclaimable", "value": "109196", "units": "kB"}, {"name": "SUnreclaim", "value": "166716", "units": "kB"}, {"name": "KernelStack", "value": "9760", "units": "kB"}, {"name": "PageTables", "value": "20748", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3215208", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11264", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "6144", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "297288", "units": "kB"}, {"name": "DirectMap2M", "value": "21587968", "units": "kB"}, {"name": "DirectMap1G", "value": "246415360", "units": "kB"}]}' Nov 5 00:32:29 kjcf05n03 dcs-collectord[5685]: INFO Completed collection for memory_info (collection_process.py:59) Nov 5 00:32:29 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:29 kjcf05n03 dcs-collectord[5685]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 5 00:32:29 kjcf05n03 dcs-collectord[5685]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730788348.9678364], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730788349.2088034], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730788348.9014678, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 5 00:32:29 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:29 kjcf05n03 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 5 00:32:29 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:29 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:29 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 5 00:32:29 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}ffdc0c4cea3c95ce5086252ad7915ec6c024022962bba6332c80f94b580ecf35' Nov 5 00:32:29 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 5 00:32:29 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 5 00:32:29 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:29 kjcf05n03 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 5 00:32:29 kjcf05n03 firmware-update-orc[5791]: Using config script: /etc/firmware_update_orc.conf Nov 5 00:32:29 kjcf05n03 firmware-update-orc[5791]: - Creating default directory: '/var/log/firmware-update-orc' Nov 5 00:32:30 kjcf05n03 firmware-update-orc[5791]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 5 00:32:30 kjcf05n03 firmware-update-orc[5791]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 5 00:32:30 kjcf05n03 firmware-update-orc[5791]: - Creating default directory: '/var/run/firmware-update-orc' Nov 5 00:32:30 kjcf05n03 firmware-update-orc[5791]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 5 00:32:30 kjcf05n03 firmware-update-orc[5791]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 5 00:32:30 kjcf05n03 firmware-update-orc-server[5827]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 5 00:32:30 kjcf05n03 firmware-update-orc[5791]: celery multi v5.2.7 (dawn-chorus) Nov 5 00:32:30 kjcf05n03 firmware-update-orc[5791]: > Starting nodes... Nov 5 00:32:30 kjcf05n03 firmware-update-orc[5791]: > worker1@kjcf05n03: OK Nov 5 00:32:30 kjcf05n03 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 5 00:32:30 kjcf05n03 firmware-update-orc-server[5831]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 5 00:32:30 kjcf05n03 firmware-update-orc-server[5831]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 5 00:32:30 kjcf05n03 firmware-update-orc-server[5831]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 5 00:32:30 kjcf05n03 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 5 00:32:30 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:31 kjcf05n03 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:31 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:31 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:31 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 5 00:32:31 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 5 00:32:31 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 5 00:32:31 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 5 00:32:31 kjcf05n03 dbus-daemon[2157]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 5 00:32:31 kjcf05n03 dbus-daemon[2157]: [system] Reloaded configuration Nov 5 00:32:31 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 5 00:32:31 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 5 00:32:31 kjcf05n03 dbus-daemon[2157]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 5 00:32:31 kjcf05n03 dbus-daemon[2157]: [system] Reloaded configuration Nov 5 00:32:31 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 5 00:32:31 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 5 00:32:31 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 5 00:32:31 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 5 00:32:31 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:31 kjcf05n03 systemd[1]: Starting Manages hardware resources... Nov 5 00:32:32 kjcf05n03 ras-resource-manager-agent[5947]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 5 00:32:32 kjcf05n03 ras-resource-manager-agent[5933]: Starting ras-resource-manager-agent:[ OK ] Nov 5 00:32:32 kjcf05n03 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 5 00:32:32 kjcf05n03 ras-resource-manager-agent[5949]: INFO Starting the service handler (service_main_handler.py:98) Nov 5 00:32:32 kjcf05n03 systemd[1]: Started Manages hardware resources. Nov 5 00:32:32 kjcf05n03 ras-resource-manager-client[5949]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 5 00:32:32 kjcf05n03 ras-resource-manager-client[5949]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 5 00:32:32 kjcf05n03 ras-resource-manager-client[5959]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 5 00:32:32 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:32 kjcf05n03 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:32 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:32 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:32 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 5 00:32:32 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 5 00:32:32 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:32 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 5 00:32:32 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:33 kjcf05n03 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: Press Ctrl+C to exit. Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: Plugin support version 1.0 Nov 5 00:32:33 kjcf05n03 zabbix_agent2[6033]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 00:32:33 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:33 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:33 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:33 kjcf05n03 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 5 00:32:33 kjcf05n03 dcs-notification-sender[6110]: dcs-notification-senderd is stopped Nov 5 00:32:33 kjcf05n03 zabbix-agent2[6128]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 5 00:32:33 kjcf05n03 dcs-notification-sender[6110]: Starting notification-sender:[ OK ] Nov 5 00:32:33 kjcf05n03 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 5 00:32:33 kjcf05n03 zabbix-agent2[6130]: INFO DCS notification agent started. (agent.py:61) Nov 5 00:32:33 kjcf05n03 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 5 00:32:33 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:34 kjcf05n03 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:34 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:34 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:34 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:34 kjcf05n03 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 5 00:32:34 kjcf05n03 dcs-collectord[6229]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 5 00:32:34 kjcf05n03 dcs-collectord[6229]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 5 00:32:34 kjcf05n03 dcs-bulk-data-sender[6229]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 5 00:32:34 kjcf05n03 dcs-bulk-data-sender[6220]: Starting bulk-data-sender:[ OK ] Nov 5 00:32:34 kjcf05n03 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 5 00:32:34 kjcf05n03 dcs-collectord[6231]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 5 00:32:34 kjcf05n03 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 5 00:32:34 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:35 kjcf05n03 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:35 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:35 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:35 kjcf05n03 nscd[2279]: 2279 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 5 00:32:35 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 5 00:32:35 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 5 00:32:35 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 5 00:32:35 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 5 00:32:35 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 5 00:32:35 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 5 00:32:35 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 5 00:32:35 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}52b46c8439b497d30685c5bd5189cbf9541d9a3256ee188765cdb90be481d070' Nov 5 00:32:35 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 5 00:32:35 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}9df05f3fb9f69451c9fe870b5442c0f8b9d94facbca4690351d75bfc92429c6c' Nov 5 00:32:35 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 5 00:32:35 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 5 00:32:35 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 5 00:32:35 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 5 00:32:35 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 00:32:35 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 00:32:35 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 00:32:35 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 00:32:36 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 5 00:32:36 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 5 00:32:36 kjcf05n03 systemd[1]: Stopping System Security Services Daemon... Nov 5 00:32:36 kjcf05n03 sssd[nss][2500]: Shutting down (status = 0) Nov 5 00:32:36 kjcf05n03 sssd[be[implicit_files]][2413]: Shutting down (status = 0) Nov 5 00:32:36 kjcf05n03 systemd[1]: sssd.service: Succeeded. Nov 5 00:32:36 kjcf05n03 systemd[1]: Stopped System Security Services Daemon. Nov 5 00:32:36 kjcf05n03 systemd[1]: Starting System Security Services Daemon... Nov 5 00:32:36 kjcf05n03 python3.9[5255]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 5 00:32:36 kjcf05n03 python3.9[3159]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:36 kjcf05n03 sssd[sssd][6311]: Starting up Nov 5 00:32:36 kjcf05n03 sssd[be[implicit_files]][6312]: Starting up Nov 5 00:32:37 kjcf05n00 mcfcli[3673891]: %3|1730788357.027|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:32:37 kjcf05n03 sssd[nss][6313]: Starting up Nov 5 00:32:37 kjcf05n03 systemd[1]: Started System Security Services Daemon. Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5c8a447e05e855ec19703ef26284cba3da9c946d4ef5534569e727bd56e032c7' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 5 00:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.53 is unreachable via ib0 Nov 5 00:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.59 is unreachable via ib0 Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure) defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.key]/ensure: defined content as '{sha256}ef1c9447a59c714506b1813be1ce4637732aa711eeb9bb12db3e599c4d9222a2' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure) defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n03.crt]/ensure: defined content as '{sha256}9e4533604a16f0dcae7609bee09dc2eedc6bbeb41ec731be971ce01e18866549' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 5 00:32:37 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 5 00:32:37 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:38 kjcf05n04 LCNmon[48428]: 10.16.100.53 is unreachable via ib0 Nov 5 00:32:38 kjcf05n04 LCNmon[48428]: 10.16.100.59 is unreachable via ib0 Nov 5 00:32:38 kjcf05n03 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 5 00:32:38 kjcf05n03 icinga2[6361]: [2024-11-05 00:32:38 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 5 00:32:38 kjcf05n03 icinga2[6361]: [2024-11-05 00:32:38 -0600] information/cli: Loading configuration file(s). Nov 5 00:32:38 kjcf05n03 icinga2[6361]: [2024-11-05 00:32:38 -0600] information/ConfigItem: Committing config item(s). Nov 5 00:32:38 kjcf05n03 icinga2[6361]: [2024-11-05 00:32:38 -0600] information/ApiListener: My API identity: kjcf05n03 Nov 5 00:32:38 kjcf05n03 icinga2[6361]: [2024-11-05 00:32:38 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 5 00:32:38 kjcf05n03 icinga2[6361]: [2024-11-05 00:32:38 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 5 00:32:38 kjcf05n03 icinga2[6361]: [2024-11-05 00:32:38 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 5 00:32:38 kjcf05n03 icinga2[6361]: [2024-11-05 00:32:38 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 5 00:32:38 kjcf05n03 icinga2[6361]: [2024-11-05 00:32:38 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 5 00:32:38 kjcf05n03 icinga2[6361]: [2024-11-05 00:32:38 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 5 00:32:38 kjcf05n03 icinga2[6361]: [2024-11-05 00:32:38 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 5 00:32:38 kjcf05n03 icinga2[6361]: [2024-11-05 00:32:38 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 5 00:32:38 kjcf05n03 icinga2[6361]: [2024-11-05 00:32:38 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 5 00:32:38 kjcf05n03 icinga2[6361]: [2024-11-05 00:32:38 -0600] information/cli: Closing console log. Nov 5 00:32:38 kjcf05n03 systemd[1]: Started Icinga host/service/network monitoring system. Nov 5 00:32:38 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:39 kjcf05n03 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:39 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:39 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:39 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 5 00:32:39 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 5 00:32:39 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:39 kjcf05n03 systemd[1]: Started Icinga2 network monitor. Nov 5 00:32:39 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:40 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 5 00:32:40 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:40 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:40 kjcf05n03 dcs-bulk-data-sender[6231]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 5 00:32:40 kjcf05n03 dcs-collectord[6231]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 5 00:32:40 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 5 00:32:40 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 5 00:32:40 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 5 00:32:40 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 5 00:32:40 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 5 00:32:40 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 5 00:32:40 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 5 00:32:40 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 5 00:32:40 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 5 00:32:40 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 5 00:32:40 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 5 00:32:40 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 5 00:32:40 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 5 00:32:40 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 5 00:32:40 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:41 kjcf05n03 systemd[1]: Starting Naming services LDAP client daemon.... Nov 5 00:32:41 kjcf05n03 nslcd[6975]: version 0.9.9 starting Nov 5 00:32:41 kjcf05n03 nslcd[6975]: accepting connections Nov 5 00:32:41 kjcf05n03 systemd[1]: Started Naming services LDAP client daemon.. Nov 5 00:32:41 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:41 kjcf05n03 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:41 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:41 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:41 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 5 00:32:41 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 5 00:32:41 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 5 00:32:41 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 5 00:32:42 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 5 00:32:42 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 5 00:32:42 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 5 00:32:42 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 5 00:32:42 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:43 kjcf05n03 systemd[1]: Starting DEAR Control Plane worker process... Nov 5 00:32:43 kjcf05n03 dearcpw[7076]: Using config script: /etc/dearcpw.conf Nov 5 00:32:43 kjcf05n03 dearcpw[7076]: - Creating default directory: '/var/log/dearcpw' Nov 5 00:32:43 kjcf05n03 dearcpw[7076]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 5 00:32:43 kjcf05n03 dearcpw[7076]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 5 00:32:43 kjcf05n03 dearcpw[7076]: - Creating default directory: '/var/run/dearcpw' Nov 5 00:32:43 kjcf05n03 dearcpw[7076]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 5 00:32:43 kjcf05n03 dearcpw[7076]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 5 00:32:43 kjcf05n03 dearcpw-server[7130]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 5 00:32:43 kjcf05n03 dearcpw[7076]: celery multi v5.2.7 (dawn-chorus) Nov 5 00:32:43 kjcf05n03 dearcpw[7076]: > Starting nodes... Nov 5 00:32:43 kjcf05n03 dearcpw[7076]: > dearcpw@kjcf05n03: OK Nov 5 00:32:43 kjcf05n03 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 5 00:32:43 kjcf05n03 dearcpw-server[7132]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 5 00:32:43 kjcf05n03 dearcpw-server[7132]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 5 00:32:43 kjcf05n03 dearcpw-server[7132]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 5 00:32:43 kjcf05n03 systemd[1]: Started DEAR Control Plane worker process. Nov 5 00:32:43 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:43 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:43 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 5 00:32:43 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 5 00:32:43 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 5 00:32:43 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 5 00:32:43 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 5 00:32:43 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 5 00:32:43 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 5 00:32:43 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 5 00:32:43 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 5 00:32:43 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 5 00:32:44 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.6:58074). Nov 5 00:32:44 kjcf05n01 rsyncd[3982275]: connect from kjcf05n03 (172.16.2.6) Nov 5 00:32:44 kjcf05n01 rsyncd[3982275]: rsync to puppet_cert/ from kjcf05n03 (172.16.2.6) Nov 5 00:32:44 kjcf05n01 rsyncd[3982275]: receiving file list Nov 5 00:32:44 kjcf05n01 rsyncd[3982275]: sent 29 bytes received 325 bytes total size 10901 Nov 5 00:32:44 kjcf05n01 systemd[1]: rsyncd@678-172.16.2.2:873-172.16.2.6:58074.service: Succeeded. Nov 5 00:32:44 kjcf05n03 puppet[7158]: IEC: 017000000: Node is up and running: { "node": "kjcf05n03" } Nov 5 00:32:44 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 5 00:32:44 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 5 00:32:44 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 5 00:32:44 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 5 00:32:44 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 5 00:32:44 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 5 00:32:44 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 5 00:32:44 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 5 00:32:44 kjcf05n03 dcs-collectord[5685]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 00:32:44 kjcf05n03 dcs-collectord[5685]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 5 00:32:44 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 5 00:32:44 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 5 00:32:45 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 5 00:32:45 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 5 00:32:45 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 5 00:32:45 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 5 00:32:45 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 5 00:32:45 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 5 00:32:45 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 5 00:32:45 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 5 00:32:45 kjcf05n00 zabbix-server[2580847]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:32:45 kjcf05n00 zabbix-server[2580847]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 121.94\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 154.58\\"}}"' Nov 5 00:32:45 kjcf05n00 log_interesting_event.py[2580847]: Event '46878' acknowledged Nov 5 00:32:46 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 5 00:32:46 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 5 00:32:46 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 5 00:32:46 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 5 00:32:47 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 5 00:32:47 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 5 00:32:47 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:47 kjcf05n03 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 5 00:32:47 kjcf05n03 ipmievd[4027]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 5 00:32:47 kjcf05n03 ipmievd[4027]: System Event sensor - Timestamp Clock Sync Nov 5 00:32:47 kjcf05n03 ipmievd[3159]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:47 kjcf05n03 diskless-swap[7658]: HA_PS_000: recovering journal Nov 5 00:32:47 kjcf05n03 systemd-udevd[1585]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 00:32:47 kjcf05n03 diskless-swap[7658]: HA_PS_000: clean, 2290/6400 files, 7062/25600 blocks Nov 5 00:32:47 kjcf05n03 diskless-swap[7658]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 5 00:32:47 kjcf05n03 diskless-swap[7658]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 5 00:32:47 kjcf05n03 diskless-swap[7658]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 5 00:32:47 kjcf05n03 diskless-swap[7658]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 5 00:32:47 kjcf05n03 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 5 00:32:47 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:47 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:47 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 5 00:32:47 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 5 00:32:47 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 5 00:32:47 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 5 00:32:47 kjcf05n03 systemd[1]: Stopping OpenSSH server daemon... Nov 5 00:32:48 kjcf05n03 systemd[1]: sshd.service: Succeeded. Nov 5 00:32:48 kjcf05n03 systemd[1]: Stopped OpenSSH server daemon. Nov 5 00:32:48 kjcf05n03 systemd[1]: Stopped target sshd-keygen.target. Nov 5 00:32:48 kjcf05n03 systemd[1]: Stopping sshd-keygen.target. Nov 5 00:32:48 kjcf05n03 systemd[1]: Reached target sshd-keygen.target. Nov 5 00:32:48 kjcf05n03 systemd[1]: Starting OpenSSH server daemon... Nov 5 00:32:48 kjcf05n03 systemd[1]: Started OpenSSH server daemon. Nov 5 00:32:48 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 5 00:32:48 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 5 00:32:48 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 5 00:32:48 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 5 00:32:48 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 5 00:32:48 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 5 00:32:48 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 5 00:32:48 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 5 00:32:49 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 5 00:32:49 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 5 00:32:49 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 5 00:32:49 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 5 00:32:50 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 5 00:32:50 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 5 00:32:50 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 5 00:32:50 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 5 00:32:51 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 5 00:32:51 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 5 00:32:51 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 5 00:32:51 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 5 00:32:51 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:51 kjcf05n03 systemd[1]: Set up automount opt-firmware.automount. Nov 5 00:32:51 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:51 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:51 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 5 00:32:51 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}e683e3abeeb269bb7c94afee176d88f30a6d7a366f42fb882176144cb70336b1' Nov 5 00:32:51 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:52 kjcf05n03 systemd[1]: Set up automount mnt-llog.automount. Nov 5 00:32:52 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:52 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:52 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 5 00:32:52 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 5 00:32:52 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:52 kjcf05n03 systemd[1]: Set up automount usr-share-man.automount. Nov 5 00:32:52 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:32:52 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:32:52 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 5 00:32:52 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 5 00:32:52 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 5 00:32:52 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 5 00:32:52 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 5 00:32:52 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 5 00:32:52 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 5 00:32:52 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 5 00:32:52 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 00:32:52 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 00:32:52 kjcf05n03 systemd[1]: Reloading. Nov 5 00:32:52 kjcf05n03 systemd[1]: Starting Crash recovery kernel arming... Nov 5 00:32:52 kjcf05n03 kdumpctl[7886]: kdump: No kdump initial ramdisk found. Nov 5 00:32:52 kjcf05n03 kdumpctl[7886]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 5 00:32:52 kjcf05n03 dracut[7998]: dracut-049-135.git20210121.el8 Nov 5 00:32:53 kjcf05n03 dracut[8000]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 5 00:32:53 kjcf05n03 dracut[8000]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 5 00:32:53 kjcf05n03 dracut[8000]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 5 00:32:53 kjcf05n03 dracut[8000]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 5 00:32:53 kjcf05n03 dracut[8000]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 5 00:32:53 kjcf05n03 dracut[8000]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 5 00:32:53 kjcf05n03 dracut[8000]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 5 00:32:53 kjcf05n03 dracut[8000]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + is_func check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ type -t check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 0 -ne 0 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check -h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local dev holder Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + require_binaries mdadm expr Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _module_name=90hperaid Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ mdadm = \-\m ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for cmd in "$@" Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + find_binary mdadm Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for cmd in "$@" Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + find_binary expr Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n -h ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for dev in "${!host_fs_types[@]}" Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ nfs != *_raid_member ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + continue Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _ret=255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + ret=255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ 255 = 0 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ 255 = 255 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ module_depends hperaid Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: +++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: +++ set -x Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ depends Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo rootfs-block Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ return 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ _ret=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ return 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for _moddep in $(module_depends $_mod) Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all == *\ hperaid\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + add_dracutmodules+=' rootfs-block ' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ == *\ hperaid\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check_module rootfs-block Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _mod=rootfs-block Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddep Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ == *\ rootfs-block\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n '' ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + mods_checked_as_dep+=' rootfs-block ' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all == *\ rootfs-block\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + module_check rootfs-block 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _forced=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 2 -eq 2 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _forced=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + is_func check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ type -t check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 0 -ne 0 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check -h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _ret=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + ret=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ 0 = 0 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ module_depends rootfs-block Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: +++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 5 00:32:53 kjcf05n03 kdumpctl[3159]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ depends Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo fs-lib Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ _ret=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ return 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for _moddep in $(module_depends $_mod) Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all == *\ rootfs-block\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + add_dracutmodules+=' fs-lib ' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ == *\ rootfs-block\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check_module fs-lib Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _mod=fs-lib Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddep Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n '' ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + mods_checked_as_dep+=' fs-lib ' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all == *\ fs-lib\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + module_check fs-lib 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _forced=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 2 -eq 2 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _forced=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + is_func check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ type -t check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 0 -ne 0 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check -h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _ret=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + ret=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ 0 = 0 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ module_depends fs-lib Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: +++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ depends Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ return 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ _ret=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ return 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + mods_to_load+=' fs-lib ' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + mods_to_load+=' rootfs-block ' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + mods_to_load+=' hperaid ' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _mod=90kernel-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _mod=kernel-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check_module kernel-modules 1 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _mod=kernel-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddep Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n 1 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all = all ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + module_check kernel-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _forced=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 1 -eq 2 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + is_func check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ type -t check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 0 -ne 0 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check -h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + true Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _ret=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + ret=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ 0 != 0 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ module_depends kernel-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: +++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ depends Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ true Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ _ret=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ return 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + mods_to_load+=' kernel-modules ' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _mod=90kernel-modules-extra Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _mod=kernel-modules-extra Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check_module kernel-modules-extra 1 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _mod=kernel-modules-extra Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddep Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n 1 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all = all ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + module_check kernel-modules-extra Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _forced=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 1 -eq 2 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + is_func check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ type -t check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 0 -ne 0 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check -h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + true Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _ret=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + ret=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ 0 != 0 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ module_depends kernel-modules-extra Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: +++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ depends Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ true Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ _ret=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ return 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + mods_to_load+=' kernel-modules-extra ' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _mod=90kernel-network-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _mod=kernel-network-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check_module kernel-network-modules 1 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _mod=kernel-network-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddep Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n 1 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all = all ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + module_check kernel-network-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _forced=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 1 -eq 2 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + is_func check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ type -t check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 0 -ne 0 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check -h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _ret=255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + ret=255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ 255 != 0 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n 1 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 1 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _mod=90livenet Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _mod=livenet Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check_module livenet 1 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _mod=livenet Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddep Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n 1 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all = all ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + module_check livenet Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _forced=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 1 -eq 2 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + is_func check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ type -t check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 0 -ne 0 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check -h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _ret=255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + ret=255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ 255 != 0 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n 1 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 1 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _mod=90lvm Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _mod=lvm Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check_module lvm 1 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _mod=lvm Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddep Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n 1 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all = all ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + module_check lvm Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 5 00:32:53 kjcf05n03 kdumpctl[3159]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _forced=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 1 -eq 2 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + is_func check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ type -t check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 0 -ne 0 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check -h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + require_binaries lvm Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _module_name=90lvm Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ lvm = \-\m ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for cmd in "$@" Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + find_binary lvm Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n -h ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for fs in "${host_fs_types[@]}" Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ nfs = LVM*_member ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _ret=255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + ret=255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ 255 != 0 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n 1 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 1 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _mod=90mdraid Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _mod=mdraid Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check_module mdraid 1 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _mod=mdraid Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddep Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n 1 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all = all ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + module_check mdraid Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _forced=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 1 -eq 2 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + is_func check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ type -t check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 0 -ne 0 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check -h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _rootdev Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + require_binaries mdadm expr Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _module_name=90mdraid Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ mdadm = \-\m ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for cmd in "$@" Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + find_binary mdadm Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for cmd in "$@" Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + find_binary expr Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n -h ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for dev in "${!host_fs_types[@]}" Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ nfs != *_raid_member ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + continue Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _ret=255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + ret=255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ 255 != 0 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n 1 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 1 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _mod=90multipath Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _mod=multipath Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check_module multipath 1 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _mod=multipath Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddep Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n 1 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all = all ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + module_check multipath Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _forced=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 1 -eq 2 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + is_func check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ type -t check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 0 -ne 0 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check -h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _rootdev Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n -h ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for_each_host_dev_and_slaves is_mpath Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _func=is_mpath Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _dev Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for _dev in "${host_devs[@]}" Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + continue Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 1 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _ret=255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + ret=255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ 255 != 0 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n 1 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 1 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _mod=90qemu Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _mod=qemu Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check_module qemu 1 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _mod=qemu Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddep Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n 1 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all = all ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + module_check qemu Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _forced=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 1 -eq 2 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + is_func check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ type -t check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 0 -ne 0 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check -h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n -h ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + type -P systemd-detect-virt Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ systemd-detect-virt --vm Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + vm=none Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + (( 1 != 0 )) Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _ret=255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + ret=255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ 255 != 0 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n 1 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 1 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _mod=90qemu-net Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _mod=qemu-net Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check_module qemu-net 1 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _mod=qemu-net Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddep Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n 1 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all = all ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + module_check qemu-net Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _forced=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 1 -eq 2 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + is_func check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ type -t check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 0 -ne 0 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check -h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n -h ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + type -P systemd-detect-virt Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ systemd-detect-virt --vm Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + vm= Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + (( 1 != 0 )) Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _ret=255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + ret=255 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ 255 != 0 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n 1 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + return 1 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _mod=90stratis Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + _mod=stratis Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check_module stratis 1 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _mod=stratis Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddep Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -n 1 ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ all = all ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + module_check stratis Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ read a b Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _forced=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _hostonly=-h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 1 -eq 2 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + is_func check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: ++ type -t check Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + '[' 0 -ne 0 ']' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + check -h Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _module_name=90stratis Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + local _ret=0 Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + [[ stratisd-init = \-\m ]] Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + for cmd in "$@" Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + find_binary stratisd-init Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 5 00:32:53 kjcf05n03 kdumpctl[7886]: + set +x Nov 5 00:32:53 kjcf05n03 dracut[8000]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 5 00:32:53 kjcf05n03 dracut[8000]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 5 00:32:53 kjcf05n03 dracut[8000]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 5 00:32:53 kjcf05n03 dracut[8000]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 5 00:32:53 kjcf05n03 dracut[8000]: memstrack is available Nov 5 00:32:53 kjcf05n03 dracut[8000]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 5 00:32:54 kjcf05n03 dracut[8000]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 5 00:32:54 kjcf05n03 dracut[8000]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 5 00:32:54 kjcf05n03 dracut[8000]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 5 00:32:54 kjcf05n03 dracut[8000]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 5 00:32:54 kjcf05n03 dracut[8000]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 5 00:32:54 kjcf05n03 dracut[8000]: *** Including module: bash *** Nov 5 00:32:54 kjcf05n03 dracut[8000]: *** Including module: systemd *** Nov 5 00:32:55 kjcf05n03 dracut[8000]: *** Including module: fips *** Nov 5 00:32:55 kjcf05n03 dracut[8000]: *** Including module: systemd-initrd *** Nov 5 00:32:55 kjcf05n03 dracut[8000]: *** Including module: watchdog-modules *** Nov 5 00:32:55 kjcf05n03 dracut[8000]: *** Including module: nss-softokn *** Nov 5 00:32:55 kjcf05n03 dracut[8000]: *** Including module: i18n *** Nov 5 00:32:55 kjcf05n03 dracut[8000]: No KEYMAP configured. Nov 5 00:32:55 kjcf05n03 dracut[8000]: *** Including module: network-legacy *** Nov 5 00:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib0 Nov 5 00:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib0 Nov 5 00:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib0 Nov 5 00:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib0 Nov 5 00:32:56 kjcf05n03 dracut[8000]: *** Including module: network *** Nov 5 00:32:56 kjcf05n03 dracut[8000]: *** Including module: ib_bonding *** Nov 5 00:32:56 kjcf05n03 dracut[8000]: *** Including module: drm *** Nov 5 00:32:56 kjcf05n00 mcfcli[3673891]: %3|1730788376.133|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:32:59 kjcf05n03 dcs-collectord[5685]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 00:32:59 kjcf05n03 dcs-collectord[5685]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 5 00:32:59 kjcf05n07 LCNmon[23459]: 10.16.100.53 is unreachable via ib1 Nov 5 00:32:59 kjcf05n07 LCNmon[23459]: 10.16.100.59 is unreachable via ib1 Nov 5 00:33:00 kjcf05n06 LCNmon[23798]: 10.16.100.53 is unreachable via ib1 Nov 5 00:33:00 kjcf05n06 LCNmon[23798]: 10.16.100.59 is unreachable via ib1 Nov 5 00:33:00 kjcf05n03 dracut[8000]: *** Including module: hperaid *** Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + install Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + local rule rule_path Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + inst_multiple cat expr Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.R1DD0d/initramfs -a -f cat expr Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + _ret=0 Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + (( 0 != 0 )) Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + : Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + return 0 Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + inst_multiple -o mdmon Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.R1DD0d/initramfs -a -f -o mdmon Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + _ret=0 Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + (( 0 != 0 )) Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + : Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + return 0 Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: ++ command -v partx Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + inst /usr/sbin/partx /sbin/partx Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + local _hostonly_install Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + [[ /usr/sbin/partx == \-\H ]] Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + [[ -e /tmp/dracut.R1DD0d/initramfs//sbin/partx ]] Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.R1DD0d/initramfs -f /usr/sbin/partx /sbin/partx Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + (( 0 != 0 )) Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + : Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: ++ command -v mdadm Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + local _hostonly_install Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + [[ -e /tmp/dracut.R1DD0d/initramfs//sbin/mdadm ]] Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.R1DD0d/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + (( 0 != 0 )) Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + : Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + [[ yes == \y\e\s ]] Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + local _raidconf Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: ++ cmdline Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: ++ local _activated dev line UUID Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: ++ declare -A _activated Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: ++ for dev in "${!host_fs_types[@]}" Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: ++ [[ nfs != *_raid_member ]] Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: ++ continue Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + _raidconf= Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + [[ -n '' ]] Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + inst_rules 64-md-raid.rules Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + local _target=/etc/udev/rules.d _rule _found Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + inst_dir /usr/lib/udev/rules.d Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + [[ -e /tmp/dracut.R1DD0d/initramfs//usr/lib/udev/rules.d ]] Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + return 0 Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + inst_dir /etc/udev/rules.d Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + [[ -e /tmp/dracut.R1DD0d/initramfs//etc/udev/rules.d ]] Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + return 0 Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + for _rule in "$@" Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + continue Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + continue Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + for r in '' $dracutbasedir/rules.d/ Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + [[ 64-md-raid.rules != /* ]] Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + continue Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + for r in '' $dracutbasedir/rules.d/ Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + continue Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + [[ -n '' ]] Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + set +x Nov 5 00:33:00 kjcf05n03 dracut[8000]: Skipping udev rule: 64-md-raid.rules Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + installkernel Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + instmods =drivers/md Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + local _optional=-o Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + local _silent Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + local _ret Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + [[ '' = yes ]] Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + [[ =drivers/md = \-\c ]] Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + [[ =drivers/md = \-\s ]] Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + (( 1 == 0 )) Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.R1DD0d/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + _ret=0 Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + (( 0 != 0 )) Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + [[ -n '' ]] Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + return 0 Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + _ret=0 Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + unset check depends cmdline install installkernel Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + return 0 Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + modules_loaded+='hperaid ' Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + '[' -n '' ']' Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + _d_mod=90kernel-modules Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + _d_mod=kernel-modules Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + [[ '' = yes ]] Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + dinfo '*** Including module: kernel-modules ***' Nov 5 00:33:00 kjcf05n03 kdumpctl[7886]: + set +x Nov 5 00:33:00 kjcf05n03 dracut[8000]: *** Including module: kernel-modules *** Nov 5 00:33:00 kjcf05n03 dracut[8000]: *** Including module: kernel-modules-extra *** Nov 5 00:33:01 kjcf05n03 dracut[8000]: *** Including module: kernel-network-modules *** Nov 5 00:33:01 kjcf05n03 dracut[8000]: *** Including module: diskless-mod *** Nov 5 00:33:01 kjcf05n03 dracut[8000]: *** Including module: fstab-sys *** Nov 5 00:33:01 kjcf05n03 dracut[8000]: *** Including module: nfs *** Nov 5 00:33:01 kjcf05n03 dracut[8000]: *** Including module: rootfs-block *** Nov 5 00:33:01 kjcf05n03 dracut[8000]: *** Including module: terminfo *** Nov 5 00:33:01 kjcf05n03 dracut[8000]: *** Including module: udev-rules *** Nov 5 00:33:01 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n03": interface became available Nov 5 00:33:02 kjcf05n03 dracut[8000]: Skipping udev rule: 91-permissions.rules Nov 5 00:33:02 kjcf05n03 dracut[8000]: Skipping udev rule: 80-drivers-modprobe.rules Nov 5 00:33:02 kjcf05n03 dracut[8000]: *** Including module: dracut-systemd *** Nov 5 00:33:03 kjcf05n03 dracut[8000]: *** Including module: usrmount *** Nov 5 00:33:03 kjcf05n03 dracut[8000]: *** Including module: base *** Nov 5 00:33:03 kjcf05n03 dracut[8000]: *** Including module: fs-lib *** Nov 5 00:33:03 kjcf05n03 dracut[8000]: *** Including module: kdumpbase *** Nov 5 00:33:04 kjcf05n03 dracut[8000]: *** Including module: memstrack *** Nov 5 00:33:04 kjcf05n03 dracut[8000]: *** Including module: shutdown *** Nov 5 00:33:04 kjcf05n03 dracut[8000]: *** Including module: squash *** Nov 5 00:33:04 kjcf05n03 dracut[8000]: *** Including modules done *** Nov 5 00:33:04 kjcf05n03 dracut[8000]: *** Installing kernel module dependencies *** Nov 5 00:33:04 kjcf05n03 dracut[8000]: *** Installing kernel module dependencies done *** Nov 5 00:33:04 kjcf05n03 dracut[8000]: *** Resolving executable dependencies *** Nov 5 00:33:06 kjcf05n03 dracut[8000]: *** Resolving executable dependencies done*** Nov 5 00:33:06 kjcf05n03 dracut[8000]: *** Hardlinking files *** Nov 5 00:33:06 kjcf05n03 dracut[8000]: *** Hardlinking files done *** Nov 5 00:33:06 kjcf05n03 dracut[8000]: *** Generating early-microcode cpio image *** Nov 5 00:33:06 kjcf05n03 dracut[8000]: *** Constructing AuthenticAMD.bin **** Nov 5 00:33:06 kjcf05n03 dracut[8000]: *** Store current command line parameters *** Nov 5 00:33:06 kjcf05n03 dracut[8000]: Stored kernel commandline: Nov 5 00:33:06 kjcf05n03 dracut[8000]: rd.driver.pre=sd_mod Nov 5 00:33:06 kjcf05n03 dracut[8000]: rd.driver.pre=nvme Nov 5 00:33:06 kjcf05n03 dracut[8000]: rd.driver.pre=ipmi_si Nov 5 00:33:06 kjcf05n03 dracut[8000]: rd.driver.pre=ipmi_devintf Nov 5 00:33:06 kjcf05n03 dracut[8000]: rd.driver.pre=ipmi_msghandler Nov 5 00:33:06 kjcf05n03 dracut[8000]: nameserver=172.16.2.2 Nov 5 00:33:06 kjcf05n03 dracut[8000]: nameserver=127.0.0.1 Nov 5 00:33:06 kjcf05n03 dracut[8000]: nameserver=172.16.2.2 Nov 5 00:33:06 kjcf05n03 dracut[8000]: nameserver=127.0.0.1 Nov 5 00:33:06 kjcf05n03 dracut[8000]: ifname=kdump-meth0:00:09:3d:06:9a:1a team=mgmt0:kdump-meth0 Nov 5 00:33:06 kjcf05n03 dracut[8000]: rd.neednet Nov 5 00:33:06 kjcf05n03 dracut[8000]: kdumpnic=mgmt0 Nov 5 00:33:06 kjcf05n03 dracut[8000]: bootdev=mgmt0 Nov 5 00:33:06 kjcf05n03 dracut[8000]: *** Install squash loader *** Nov 5 00:33:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730788385', 'host':'kjcf05n03', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 5 00:33:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730788385', 'host':'kjcf05n03', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 5 00:33:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730788385'} Nov 5 00:33:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730788385'} Nov 5 00:33:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:33:06 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 5 00:33:06 kjcf05n03 dracut[8000]: *** Squashing the files inside the initramfs *** Nov 5 00:33:06 kjcf05n03 dracut[8000]: *** Squashing the files inside the initramfs done *** Nov 5 00:33:06 kjcf05n03 dracut[8000]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 5 00:33:06 kjcf05n03 dracut[8000]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 5 00:33:06 kjcf05n00 zabbix-server[2581150]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:33:06 kjcf05n00 zabbix-server[2581150]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n03 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n03:system.uptime): 00:02:49\\"}}"' Nov 5 00:33:07 kjcf05n00 log_interesting_event.py[2581150]: Event '46882' acknowledged Nov 5 00:33:07 kjcf05n03 kdumpctl[7886]: kdump: kexec: loaded kdump kernel Nov 5 00:33:07 kjcf05n03 kdumpctl[7886]: kdump: Starting kdump: [OK] Nov 5 00:33:07 kjcf05n03 systemd[1]: Started Crash recovery kernel arming. Nov 5 00:33:07 kjcf05n03 systemd[1]: Reloading. Nov 5 00:33:08 kjcf05n03 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:33:08 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:33:08 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:33:08 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 5 00:33:08 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}b08cebc83a78ae96394bb3052a67aeb7dc157b52abe1d1eed432a3a2f4905edd' Nov 5 00:33:08 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 5 00:33:08 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}504eea65a975dec8b0889d413ec0094713f2b4a915b7da4f7cde833ecc76f371' Nov 5 00:33:08 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 5 00:33:08 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}b3cb12db26a22b057c20fe70d0e8d459a254ed8a5cd9bc58f1771e0d252fdc63' Nov 5 00:33:08 kjcf05n03 ifdown[14595]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 00:33:08 kjcf05n03 ifdown[14612]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:33:08 kjcf05n03 ifdown[14613]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:33:08 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 5 00:33:08 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 5 00:33:08 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 5 00:33:08 kjcf05n03 ifup[14673]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 00:33:08 kjcf05n03 ifup[14674]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:33:08 kjcf05n03 ifup[14675]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:33:11 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 5 00:33:12 kjcf05n03 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 5 00:33:13 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 00:33:13 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:33:13 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 00:33:13 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:33:13 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:33:13 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:33:13 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 5 00:33:13 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 5 00:33:13 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 00:33:13 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 00:33:13 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:33:13 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:33:13 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:33:13 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:33:13 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 5 00:33:13 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 5 00:33:13 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 5 00:33:13 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 5 00:33:13 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 5 00:33:13 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 5 00:33:13 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 5 00:33:13 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 5 00:33:13 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 5 00:33:13 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 5 00:33:13 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 5 00:33:13 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 5 00:33:13 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 5 00:33:13 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 5 00:33:13 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 5 00:33:13 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a327e223b7e9afe17f1924d39103b5fda178eb2e599631da8ae5c728d699b810' Nov 5 00:33:13 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 5 00:33:13 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}7963cdd2ce56537f14d9f1c0ba4c2afb706e392c7d788274448c418d875e9ab2' Nov 5 00:33:13 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 5 00:33:13 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}cb55b5a2f4ed291e767f0e90d56f8f150de2865dd72a416698d9d133ff45677e' Nov 5 00:33:13 kjcf05n03 ifdown[14841]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 00:33:13 kjcf05n03 ifdown[14842]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:33:13 kjcf05n03 ifdown[14848]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:33:13 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 5 00:33:13 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 5 00:33:13 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 5 00:33:13 kjcf05n03 ifup[14917]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 00:33:13 kjcf05n03 ifup[14918]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:33:13 kjcf05n03 ifup[14919]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:33:14 kjcf05n03 dcs-collectord[5685]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 00:33:14 kjcf05n03 dcs-collectord[5685]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 5 00:33:15 kjcf05n03 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 5 00:33:17 kjcf05n00 mcfcli[3673891]: %3|1730788397.024|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:33:17 kjcf05n03 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 5 00:33:18 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 5 00:33:18 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 5 00:33:18 kjcf05n03 systemd[1]: Reloading. Nov 5 00:33:18 kjcf05n03 systemd[1]: Starting Corosync Cluster Engine... Nov 5 00:33:18 kjcf05n03 await_ha_peer[15121]: Waiting for HA peer kjcf05n02 Nov 5 00:33:19 kjcf05n03 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 5 00:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730788399', 'host':'kjcf05n03', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 5 00:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730788399'} Nov 5 00:33:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730788399', 'host':'kjcf05n03', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.87, 1.91, 0.86'}"] Nov 5 00:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Current Load', 'description': 'OK - load average: 1.87, 1.91, 0.86', 'message': 'OK - load average: 1.87, 1.91, 0.86', 'value': 'ok', 'timestamp': '1730788399'} Nov 5 00:33:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730788399', 'host':'kjcf05n03', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 331 processes with STATE = RSZDT '}"] Nov 5 00:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Total Processes', 'description': 'PROCS OK: 331 processes with STATE = RSZDT ', 'message': 'PROCS OK: 331 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730788399'} Nov 5 00:33:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:33:19 kjcf05n03 await_ha_peer[15121]: Peer kjcf05n02 has started, starting HA Nov 5 00:33:20 kjcf05n03 systemd[1]: Started Corosync Cluster Engine. Nov 5 00:33:20 kjcf05n03 systemd[1]: Started Fast STONITH daemon. Nov 5 00:33:20 kjcf05n03 fstonithd.py[15181]: Listening for kdump packets from partner Nov 5 00:33:20 kjcf05n03 systemd[1]: Reloading. Nov 5 00:33:20 kjcf05n03 systemd[3159]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:33:20 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:33:20 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:33:20 kjcf05n03 systemd[1]: Reloading. Nov 5 00:33:20 kjcf05n03 systemd[1]: Reached target resource-agents dependencies. Nov 5 00:33:21 kjcf05n03 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 5 00:33:21 kjcf05n03 systemd[1]: Reloading. Nov 5 00:33:21 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 5 00:33:21 kjcf05n03 puppet-agent[3616]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 5 00:33:21 kjcf05n03 puppet[3616]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 5 00:33:21 kjcf05n03 puppet-agent[3616]: Applied catalog in 93.10 seconds Nov 5 00:33:21 kjcf05n03 puppet[3616]: Notice: Applied catalog in 93.10 seconds Nov 5 00:33:21 kjcf05n03 systemd[1]: Started Puppet agent. Nov 5 00:33:21 kjcf05n03 systemd[1]: Starting Set absolute GEM time... Nov 5 00:33:21 kjcf05n03 systemd[1]: Started Service to do FW and inventory check on boot. Nov 5 00:33:21 kjcf05n03 systemd[1]: Started Collect SAS Health Report every hour. Nov 5 00:33:21 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 5 00:33:21 kjcf05n03 systemd[1]: Reached target Timers. Nov 5 00:33:21 kjcf05n03 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 5 00:33:21 kjcf05n03 systemd[1]: Started Startup script for gateway-ec-node. Nov 5 00:33:21 kjcf05n03 systemd[1]: Started Startup script for monitoring-ec-node. Nov 5 00:33:21 kjcf05n03 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 5 00:33:21 kjcf05n03 wce-disable.sh[15347]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 5 00:33:21 kjcf05n03 systemd[1]: disable-write-cache.service: Succeeded. Nov 5 00:33:21 kjcf05n03 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 5 00:33:21 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 5 00:33:21 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 5 00:33:21 kjcf05n03 systemd[1]: set_gem_time.service: Succeeded. Nov 5 00:33:21 kjcf05n03 systemd[1]: Started Set absolute GEM time. Nov 5 00:33:22 kjcf05n03 python3.9[15346]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 5 00:33:22 kjcf05n03 python3.9[15346]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 5 00:33:22 kjcf05n03 gateway-ec-node.py[15345]: Starting gateway-ec-node service Nov 5 00:33:22 kjcf05n03 RFSF-API[15344]: INFO[2024-11-05T00:33:21-06:00] Datapath API RESTful Service starting Nov 5 00:33:22 kjcf05n03 dp-api-server-node[15344]: INFO[2024-11-05T00:33:21-06:00] Datapath API RESTful Service starting Nov 5 00:33:22 kjcf05n03 RFSF-API[15344]: INFO[2024-11-05T00:33:21-06:00] Running in production mode, starting dbus event listener Nov 5 00:33:22 kjcf05n03 dp-api-server-node[15344]: INFO[2024-11-05T00:33:21-06:00] Running in production mode, starting dbus event listener Nov 5 00:33:22 kjcf05n03 RFSF-API[15344]: INFO[2024-11-05T00:33:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 5 00:33:22 kjcf05n03 dp-api-server-node[15344]: INFO[2024-11-05T00:33:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 5 00:33:22 kjcf05n03 RFSF-API[15344]: INFO[2024-11-05T00:33:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 5 00:33:22 kjcf05n03 dp-api-server-node[15344]: INFO[2024-11-05T00:33:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 5 00:33:22 kjcf05n03 RFSF-API[15344]: INFO[2024-11-05T00:33:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 5 00:33:22 kjcf05n03 dp-api-server-node[15344]: INFO[2024-11-05T00:33:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 5 00:33:22 kjcf05n03 RFSF-API[15344]: INFO[2024-11-05T00:33:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 5 00:33:22 kjcf05n03 dp-api-server-node[15344]: INFO[2024-11-05T00:33:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 5 00:33:22 kjcf05n03 RFSF-API[15344]: INFO[2024-11-05T00:33:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 5 00:33:22 kjcf05n03 dp-api-server-node[15344]: INFO[2024-11-05T00:33:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 5 00:33:22 kjcf05n03 RFSF-API[15344]: INFO[2024-11-05T00:33:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 5 00:33:22 kjcf05n03 dp-api-server-node[15344]: INFO[2024-11-05T00:33:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 5 00:33:22 kjcf05n03 RFSF-API[15344]: INFO[2024-11-05T00:33:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 5 00:33:22 kjcf05n03 dp-api-server-node[15344]: INFO[2024-11-05T00:33:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 5 00:33:22 kjcf05n03 RFSF-API[15344]: INFO[2024-11-05T00:33:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 5 00:33:22 kjcf05n03 dp-api-server-node[15344]: INFO[2024-11-05T00:33:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 5 00:33:22 kjcf05n03 RFSF-API[15344]: INFO[2024-11-05T00:33:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 5 00:33:22 kjcf05n03 dp-api-server-node[15344]: INFO[2024-11-05T00:33:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 5 00:33:22 kjcf05n03 RFSF-API[15344]: INFO[2024-11-05T00:33:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 5 00:33:22 kjcf05n03 dp-api-server-node[15344]: INFO[2024-11-05T00:33:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 5 00:33:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730788403', 'host':'kjcf05n03', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.5% (3896764 kB) used.'}"] Nov 5 00:33:23 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'RAM usage', 'description': 'OK - 1.5% (3896764 kB) used.', 'message': 'OK - 1.5% (3896764 kB) used.', 'value': 'ok', 'timestamp': '1730788403'} Nov 5 00:33:23 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:33:24 kjcf05n00 zabbix-server[2581212]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:33:24 kjcf05n00 zabbix-server[2581212]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 242.54\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 100.11\\"}}"' Nov 5 00:33:24 kjcf05n00 log_interesting_event.py[2581212]: Event '46890' acknowledged Nov 5 00:33:26 kjcf05n00 mcfcli[3673891]: %3|1730788406.133|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-05T00:33:27.253159277-06:00 level=info msg="Completed cleanup jobs" duration=26.585441ms Nov 5 00:33:28 kjcf05n03 systemd[1]: Reloading. Nov 5 00:33:29 kjcf05n03 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 5 00:33:29 kjcf05n03 systemd[1]: Starting Cluster Controlled lcnmon... Nov 5 00:33:29 kjcf05n03 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 5 00:33:29 kjcf05n03 dcs-collectord[5685]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 00:33:29 kjcf05n03 dcs-collectord[5685]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 5 00:33:29 kjcf05n03 dcs-collectord[5685]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 5 00:33:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730788409', 'host':'kjcf05n03', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(952.0B/776.0B), ib1=(924.0B/776.0B), icl0=(7.3kB/9.0kB), lo=(800.0B/800.0B), meth0=(1541.5MB/8.1MB), mgmt0=(1478.3MB/8.1MB)'}"] Nov 5 00:33:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(952.0B/776.0B), ib1=(924.0B/776.0B), icl0=(7.3kB/9.0kB), lo=(800.0B/800.0B), meth0=(1541.5MB/8.1MB), mgmt0=(1478.3MB/8.1MB)', 'message': 'NET OK - (Rx/Tx) ib0=(952.0B/776.0B), ib1=(924.0B/776.0B), icl0=(7.3kB/9.0kB), lo=(800.0B/800.0B), meth0=(1541.5MB/8.1MB), mgmt0=(1478.3MB/8.1MB)', 'value': 'ok', 'timestamp': '1730788409'} Nov 5 00:33:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:33:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730788409', 'host':'kjcf05n03', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 5 00:33:29 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730788409'} Nov 5 00:33:29 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:33:29 kjcf05n03 diskmonitor_pre[15888]: Key management is currently disabled.DEAR disabled Nov 5 00:33:29 kjcf05n03 systemd[1]: Started Cluster Controlled diskmonitor. Nov 5 00:33:31 kjcf05n03 sh[15884]: LNET configured: New Created Nov 5 00:33:30 kjcf05n00 httpd[1812016]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-B): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n03', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 5 00:33:31 kjcf05n03 systemd[1]: Started Cluster Controlled lcnmon. Nov 5 00:33:31 kjcf05n03 LCNmon[18007]: Interface ib0 is up Nov 5 00:33:31 kjcf05n03 LCNmon[18007]: Interface ib1 is up Nov 5 00:33:31 kjcf05n03 LCNmon[18007]: Can ping through interface ib0 Nov 5 00:33:31 kjcf05n03 systemd[1]: nodebootchecks.service: Succeeded. Nov 5 00:33:33 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18160 (bash) Nov 5 00:33:33 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 5 00:33:33 kjcf05n03 systemd[1]: Reached target Host and Network Name Lookups. Nov 5 00:33:33 kjcf05n03 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 5 00:33:33 kjcf05n03 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 5 00:33:33 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: /var/run/diskmonitor does not exist, creating Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: Creating /var/run/diskmonitor/disk Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: Creating /var/run/diskmonitor/encl Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: Creating /var/run/diskmonitor/cli Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: RAS_Interlocks_enabled: 1 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: Using default ssd ids: HUSSL4010ASS600 , Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: add handler for sig: 14 sa_flags: 10000004 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: add handler for sig: 1 sa_flags: 10000004 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: add handler for sig: 2 sa_flags: 00000004 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: add handler for sig: 15 sa_flags: 00000004 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: add handler for sig: 6 sa_flags: 00000004 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: add handler for sig: 3 sa_flags: 00000004 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: add handler for sig: 30 sa_flags: 00000004 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: add handler for sig: 20 sa_flags: 00000004 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: add handler for sig: 10 sa_flags: 10000004 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: add handler for sig: 11 sa_flags: 00000004 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: add handler for sig: 7 sa_flags: 00000004 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: add handler for sig: 4 sa_flags: 00000004 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: add handler for sig: 8 sa_flags: 00000004 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: init_watch: /var/run/diskmonitor/encl initialized Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: init_watch: /var/run/diskmonitor/disk initialized Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: Using HA Baton locks - key: diskmonitor Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: Baton will be held for at most 570 seconds Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: DMMP Enabled: 0 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: random seed: 410a9b0a Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: NVMe Enclosure: 1 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: ZFS Enclosure: 0 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: Dbus, Initialized Connection Successfully Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: int_catcher_thread: thread start Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: Received dbus message 4 org.freedesktop.DBus -> :1.98 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b07bec_S4EUNF0MA05386M encl_slot: 0 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b07bed_S4EUNF0MA05387D encl_slot: 0 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 5 00:33:33 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 5 00:33:33 kjcf05n03 openhpid[5591]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 5 00:33:33 kjcf05n03 openhpid[5591]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 5 00:33:34 kjcf05n03 systemd[1]: openhpid.service: Succeeded. Nov 5 00:33:34 kjcf05n03 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 5 00:33:34 kjcf05n03 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 5 00:33:34 kjcf05n03 systemd[1]: openhpid.service: Supervising process 18335 which is not our child. We'll most likely not notice when it exits. Nov 5 00:33:34 kjcf05n03 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 5 00:33:34 kjcf05n03 systemd[1]: Reached target Multi-User System. Nov 5 00:33:34 kjcf05n03 systemd[1]: Reached target Graphical Interface. Nov 5 00:33:34 kjcf05n03 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 5 00:33:34 kjcf05n03 dcs-collectord[5685]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 5 00:33:34 kjcf05n03 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 5 00:33:34 kjcf05n03 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 5 00:33:34 kjcf05n03 systemd[1]: Startup finished in 50.967s (kernel) + 2min 28.530s (userspace) = 3min 19.497s. Nov 5 00:33:34 kjcf05n03 openhpid[18335]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 5 00:33:34 kjcf05n03 openhpid[18335]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 5 00:33:34 kjcf05n03 openhpid[18335]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 5 00:33:34 kjcf05n03 openhpid[18335]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 5 00:33:35 kjcf05n03 LCNmon[18007]: 10.16.100.57 is unreachable via ib1 Nov 5 00:33:35 kjcf05n03 LCNmon[18007]: Can ping through interface ib1 Nov 5 00:33:35 kjcf05n03 LCNmon[18007]: NIC ib0, initial state UP Nov 5 00:33:35 kjcf05n03 LCNmon[18007]: NIC ib1, initial state UP Nov 5 00:33:35 kjcf05n03 LCNmon[18007]: LCNstat initial state UP Nov 5 00:33:35 kjcf05n03 LCNmon[18007]: LCNmon monitoring hosts kjcf05n03 and kjcf05n02 Nov 5 00:33:36 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31482 deleted. Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b07bec_S4EUNF0MA05386M encl_sn: USE26000024VS001, slot: 1 Nov 5 00:33:40 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 5 00:33:44 kjcf05n03 dcs-collectord[5685]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 00:33:44 kjcf05n03 dcs-collectord[5685]: WARNING No data collected (hpi_parser.py:353) Nov 5 00:33:56 kjcf05n00 mcfcli[3673891]: %3|1730788436.133|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:33:56 kjcf05n00 mcfcli[3673891]: %3|1730788436.334|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:33:57 kjcf05n03 ipmievd[4027]: System Event sensor - Timestamp Clock Sync Nov 5 00:33:59 kjcf05n03 ipmievd[3159]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:33:59 kjcf05n03 dcs-collectord[5685]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b07bed_S4EUNF0MA05387D encl_sn: USE26000024VS001, slot: 2 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 5 00:34:11 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 5 00:34:14 kjcf05n03 dcs-collectord[5685]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 00:34:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730788456', 'host':'kjcf05n03', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 5 00:34:16 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730788456'} Nov 5 00:34:16 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:34:19 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'fc6e77ce-9b3f-11ef-a68e-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 5 00:34:19 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'fc6e77ce-9b3f-11ef-a68e-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 5 00:34:19 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': 'fc6e77ce-9b3f-11ef-a68e-00093d069a1b', 'response ID': 'fc7990c8-9b3f-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 5 00:34:19 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: fc7990c8-9b3f-11ef-acfe-00093d0696a6 (logger.py:65) Nov 5 00:34:19 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db0102600253845000000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 5 00:34:19 kjcf05n03 ras-resource-manager-agent[5949]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "fc6e77ce-9b3f-11ef-a68e-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 5 00:34:19 kjcf05n03 ras-resource-manager-agent[5949]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'fc6e77ce-9b3f-11ef-a68e-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 5 00:34:19 kjcf05n03 ras-resource-manager-agent[5949]: INFO Submitting new device inserted signal, starting to qualify drive: fc6e77ce-9b3f-11ef-a68e-00093d069a1b (admin_action.py:110) Nov 5 00:34:19 kjcf05n02 firmware-update-orc-server[5915]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "bdcba761-21ba-47af-a4ef-47e3417d3ad6"} (logger.py:65) Nov 5 00:34:19 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 146822 (get_disk_device) Nov 5 00:34:19 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 5 00:34:19 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 5 00:34:20 kjcf05n02 ccp-client[146856]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 5 00:34:20 kjcf05n02 ccp-client[146856]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 5 00:34:20 kjcf05n02 ccp-client[146869]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 5 00:34:20 kjcf05n02 ccp-client[146856]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 5 00:34:20 kjcf05n02 ccp-client[146856]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 5 00:34:20 kjcf05n02 ccp-client[146869]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 5 00:34:20 kjcf05n02 ccp-client[146869]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 5 00:34:19 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'fcbe9b6e-9b3f-11ef-a68e-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 5 00:34:19 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': 'fcbe9b6e-9b3f-11ef-a68e-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 5 00:34:19 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': 'fcbe9b6e-9b3f-11ef-a68e-00093d069a1b', 'response ID': 'fcc65692-9b3f-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 5 00:34:19 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: fcc65692-9b3f-11ef-acfe-00093d0696a6 (logger.py:65) Nov 5 00:34:20 kjcf05n03 diskmonitor[17542]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 5 00:34:20 kjcf05n03 ras-resource-manager-agent[5949]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "fcbe9b6e-9b3f-11ef-a68e-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 5 00:34:20 kjcf05n03 ras-resource-manager-agent[5949]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': 'fcbe9b6e-9b3f-11ef-a68e-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 5 00:34:20 kjcf05n03 ras-resource-manager-agent[5949]: INFO Submitting new device inserted signal, starting to qualify drive: fcbe9b6e-9b3f-11ef-a68e-00093d069a1b (admin_action.py:110) Nov 5 00:34:20 kjcf05n03 firmware-update-orc-server[5905]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "e247bb21-0259-4e82-9f1d-eda4fe2a7acc"} (logger.py:65) Nov 5 00:34:22 kjcf05n02 DRVFW[146995]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 5 00:34:22 kjcf05n02 ccp-client[146996]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 5 00:34:22 kjcf05n02 ccp-client[146996]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 5 00:34:22 kjcf05n02 ccp-client[147007]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 5 00:34:22 kjcf05n02 ccp-client[146996]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 5 00:34:22 kjcf05n02 ccp-client[147007]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 5 00:34:22 kjcf05n02 ccp-client[146996]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 5 00:34:22 kjcf05n02 ccp-client[147007]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 5 00:34:22 kjcf05n02 firmware-update-orc-server[5915]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 5 00:34:24 kjcf05n03 ras-resource-manager-agent[5949]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'fc6e77ce-9b3f-11ef-a68e-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}} (resource_admin.py:98) Nov 5 00:34:24 kjcf05n03 ras-resource-manager-agent[5949]: INFO Drive qualification complete responding: fc6e77ce-9b3f-11ef-a68e-00093d069a1b (admin_action.py:205) Nov 5 00:34:24 kjcf05n03 ras-resource-manager-agent[5949]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "fc6e77ce-9b3f-11ef-a68e-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} (interesting_event.py:59) Nov 5 00:34:24 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: fc7990c8-9b3f-11ef-acfe-00093d0696a6 (logger.py:65) Nov 5 00:34:24 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': 'fc6e77ce-9b3f-11ef-a68e-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'fc6e77ce-9b3f-11ef-a68e-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}}} (logger.py:65) Nov 5 00:34:26 kjcf05n00 mcfcli[3673891]: %3|1730788466.134|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 00:34:27 kjcf05n03 diskmonitor[17542]: 04 Nov 5 00:34:27 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 5 00:34:27 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 5 00:34:27 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 5 00:34:27 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 5 00:34:27 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 5 00:34:27 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 5 00:34:27 kjcf05n03 diskmonitor[17542]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 5 00:34:27 kjcf05n03 diskmonitor[17542]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 5 00:34:27 kjcf05n03 diskmonitor[17542]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 5 00:34:27 kjcf05n03 diskmonitor[17542]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 5 00:34:27 kjcf05n03 diskmonitor[17542]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 5 00:34:27 kjcf05n03 diskmonitor[17542]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "fc6e77ce-9b3f-11ef-a68e-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 5 00:34:27 kjcf05n03 diskmonitor[17542]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 5 00:34:27 kjcf05n03 diskmonitor[17542]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 5 00:34:27 kjcf05n03 diskmonitor[17542]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "fcbe9b6e-9b3f-11ef-a68e-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 5 00:34:27 kjcf05n03 diskmonitor[17542]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 5 00:34:27 kjcf05n03 diskmonitor[17542]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 5 00:34:29 kjcf05n03 ras-resource-manager-agent[5949]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "fc6e77ce-9b3f-11ef-a68e-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} (service_main_handler.py:66) Nov 5 00:34:29 kjcf05n03 ras-resource-manager-agent[5949]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'fc6e77ce-9b3f-11ef-a68e-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 3}}} (resource_admin.py:98) Nov 5 00:34:29 kjcf05n03 ras-resource-manager-agent[5949]: INFO Device qualification response has been acknowledged: fc6e77ce-9b3f-11ef-a68e-00093d069a1b (admin_action.py:151) Nov 5 00:34:30 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22535 (get_disk_device) Nov 5 00:34:30 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 5 00:34:30 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 5 00:34:30 kjcf05n03 ccp-client[22578]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 5 00:34:30 kjcf05n03 ccp-client[22578]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 5 00:34:30 kjcf05n03 ccp-client[22625]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 5 00:34:30 kjcf05n03 ccp-client[22578]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 5 00:34:30 kjcf05n03 ccp-client[22578]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 5 00:34:30 kjcf05n03 ccp-client[22625]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 5 00:34:30 kjcf05n03 ccp-client[22625]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 5 00:34:30 kjcf05n03 chronyd[5193]: Selected source 172.16.2.1 Nov 5 00:34:33 kjcf05n03 DRVFW[23415]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 5 00:34:33 kjcf05n03 diskmonitor[17542]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 5 00:34:33 kjcf05n03 ccp-client[23417]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 5 00:34:33 kjcf05n03 ccp-client[23417]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 5 00:34:33 kjcf05n03 ccp-client[23487]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 5 00:34:33 kjcf05n03 ccp-client[23417]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 5 00:34:33 kjcf05n03 ccp-client[23417]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 5 00:34:33 kjcf05n03 ccp-client[23487]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 5 00:34:33 kjcf05n03 ccp-client[23487]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 5 00:34:33 kjcf05n03 systemd[1]: Unmounting /mnt/llog... Nov 5 00:34:33 kjcf05n03 firmware-update-orc-server[5905]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 5 00:34:33 kjcf05n03 systemd[1]: mnt-llog.mount: Succeeded. Nov 5 00:34:33 kjcf05n03 systemd[1]: Unmounted /mnt/llog. Nov 5 00:34:33 kjcf05n03 diskmonitor[17542]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 5 00:34:33 kjcf05n03 ras-resource-manager-agent[5949]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "05351124-9b40-11ef-a68e-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 5 00:34:33 kjcf05n03 ras-resource-manager-agent[5949]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '05351124-9b40-11ef-a68e-00093d069a1b', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 5 00:34:33 kjcf05n03 ras-resource-manager-agent[5949]: INFO Requests ['fcbe9b6e-9b3f-11ef-a68e-00093d069a1b', '05351124-9b40-11ef-a68e-00093d069a1b'] already in progress (admin_action.py:99) Nov 5 00:34:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730788473}"] Nov 5 00:34:33 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730788473, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:34:33 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:34:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730788473}"] Nov 5 00:34:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730788473, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:34:34 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:34:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730788473}"] Nov 5 00:34:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730788473, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:34:34 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:34:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730788473}"] Nov 5 00:34:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730788473, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:34:34 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:34:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730788473}"] Nov 5 00:34:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730788473, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:34:34 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:34:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730788473}"] Nov 5 00:34:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730788473, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:34:34 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:34:34 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: fcc65692-9b3f-11ef-acfe-00093d0696a6 (logger.py:65) Nov 5 00:34:34 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': 'fcbe9b6e-9b3f-11ef-a68e-00093d069a1b', 'response': {'jsonrpc': '2.0', 'id': 'fcbe9b6e-9b3f-11ef-a68e-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}}} (logger.py:65) Nov 5 00:34:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730788474}"] Nov 5 00:34:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730788474, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:34:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:34:35 kjcf05n03 ras-resource-manager-agent[5949]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': 'fcbe9b6e-9b3f-11ef-a68e-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 5 00:34:35 kjcf05n03 ras-resource-manager-agent[5949]: INFO Drive qualification complete responding: fcbe9b6e-9b3f-11ef-a68e-00093d069a1b (admin_action.py:205) Nov 5 00:34:35 kjcf05n03 ras-resource-manager-agent[5949]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "fcbe9b6e-9b3f-11ef-a68e-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (interesting_event.py:59) Nov 5 00:34:35 kjcf05n03 ras-resource-manager-agent[5949]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "05351124-9b40-11ef-a68e-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (interesting_event.py:59) Nov 5 00:34:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730788474}"] Nov 5 00:34:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730788474, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:34:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:34:36 kjcf05n00 mcfcli[3673891]: %3|1730788476.001|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:34:36 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31483 deleted. Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "fc6e77ce-9b3f-11ef-a68e-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: Dbus, handle_ingress_ras_signals, uuid: fc6e77ce-9b3f-11ef-a68e-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "fc6e77ce-9b3f-11ef-a68e-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 3}}} Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: main: Pending firmware leveling requests exist, rescanning disks Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "05351124-9b40-11ef-a68e-00093d069a1b", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: leaving test state: 1 next state: 2 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: lock req: no timeout Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: leaving test state: 2 next state: 4 Nov 5 00:34:40 kjcf05n03 diskmonitor[17542]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 5 00:34:54 kjcf05n03 python3.9[5255]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 5 00:34:56 kjcf05n00 mcfcli[3673891]: %3|1730788496.135|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:35:00 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 5 00:35:15 kjcf05n00 mcfcli[3673891]: %3|1730788515.547|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:35:26 kjcf05n00 mcfcli[3673891]: %3|1730788526.201|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:35:39 kjcf05n03 python3.9[3159]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:35:39 kjcf05n03 ras-resource-manager-agent[5949]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "fcbe9b6e-9b3f-11ef-a68e-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (service_main_handler.py:66) Nov 5 00:35:39 kjcf05n03 ras-resource-manager-agent[5949]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': 'fcbe9b6e-9b3f-11ef-a68e-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 5 00:35:39 kjcf05n03 ras-resource-manager-agent[5949]: INFO Device qualification response has been acknowledged: fcbe9b6e-9b3f-11ef-a68e-00093d069a1b (admin_action.py:151) Nov 5 00:35:39 kjcf05n03 ras-resource-manager-agent[5949]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "05351124-9b40-11ef-a68e-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} (service_main_handler.py:66) Nov 5 00:35:39 kjcf05n03 ras-resource-manager-agent[5949]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '05351124-9b40-11ef-a68e-00093d069a1b', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 14}}} (resource_admin.py:98) Nov 5 00:35:39 kjcf05n03 ras-resource-manager-agent[5949]: INFO Device qualification response has been acknowledged: 05351124-9b40-11ef-a68e-00093d069a1b (admin_action.py:151) Nov 5 00:35:40 kjcf05n03 diskmonitor[17542]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 5 00:35:40 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 5 00:35:40 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 5 00:35:40 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 5 00:35:40 kjcf05n00 python3.9[2582599]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 5 00:35:50 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 5 00:35:50 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 5 00:35:50 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 5 00:35:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730788270', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 5 00:35:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730788270'} Nov 5 00:35:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:35:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730788270', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 5 00:35:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730788270'} Nov 5 00:35:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:35:54 kjcf05n00 mcfcli[3673891]: %3|1730788554.382|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:35:55 kjcf05n03 dcs-collectord[5685]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 5 00:35:56 kjcf05n00 mcfcli[3673891]: %3|1730788556.201|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 00:35:57 kjcf05n03 diskmonitor[17542]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "fcbe9b6e-9b3f-11ef-a68e-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 5 00:35:57 kjcf05n03 diskmonitor[17542]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 5 00:35:57 kjcf05n03 diskmonitor[17542]: Dbus, handle_ingress_ras_signals, uuid: fcbe9b6e-9b3f-11ef-a68e-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 5 00:35:57 kjcf05n03 diskmonitor[17542]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 5 00:35:57 kjcf05n03 diskmonitor[17542]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "fcbe9b6e-9b3f-11ef-a68e-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 5 00:35:57 kjcf05n03 diskmonitor[17542]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "05351124-9b40-11ef-a68e-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 5 00:35:57 kjcf05n03 diskmonitor[17542]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 5 00:35:57 kjcf05n03 diskmonitor[17542]: Dbus, handle_ingress_ras_signals, uuid: 05351124-9b40-11ef-a68e-00093d069a1b, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 5 00:35:57 kjcf05n03 diskmonitor[17542]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "05351124-9b40-11ef-a68e-00093d069a1b", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 14}}} Nov 5 00:35:57 kjcf05n03 diskmonitor[17542]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 5 00:35:57 kjcf05n03 diskmonitor[17542]: lock acquired Nov 5 00:35:57 kjcf05n03 diskmonitor[17542]: leaving test state: 4 next state: 8 Nov 5 00:35:57 kjcf05n03 diskmonitor[17542]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 5 00:36:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730788563}"] Nov 5 00:36:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730788563, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:36:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:36:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:36:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:36:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:36:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:36:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:36:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:36:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:36:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:36:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:36:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:36:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:36:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:36:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.962114ms Nov 5 00:36:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:36:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.962114ms Nov 5 00:36:04 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:36:04 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:36:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:36:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Inactive', 'timestamp': 1730788564}"] Nov 5 00:36:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730788564, 'value': 'Inactive', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:36:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:36:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:36:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:36:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:36:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:36:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:36:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:36:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:36:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:36:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:36:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:36:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:36:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:36:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.899648ms Nov 5 00:36:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:36:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.899648ms Nov 5 00:36:04 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:36:04 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:36:10 kjcf05n03 diskmonitor[17542]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 5 00:36:10 kjcf05n03 diskmonitor[17542]: leaving test state: 8 next state: 20 Nov 5 00:36:10 kjcf05n03 diskmonitor[17542]: leaving test state: 20 next state: 40 Nov 5 00:36:10 kjcf05n03 diskmonitor[17542]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 1e2cc620000 Nov 5 00:36:10 kjcf05n03 diskmonitor[17542]: leaving test state: 40 next state: 80 Nov 5 00:36:26 kjcf05n00 mcfcli[3673891]: %3|1730788586.201|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:36:32 kjcf05n00 mcfcli[3673891]: %3|1730788592.395|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:36:56 kjcf05n00 mcfcli[3673891]: %3|1730788616.637|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 00:37:06 kjcf05n00 zabbix-server[2583902]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:37:06 kjcf05n00 zabbix-server[2583902]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n03' from event '46894' Nov 5 00:37:06 kjcf05n00 zabbix-server[2583902]: Host created 'enclosure_USE26000024VS001' Nov 5 00:37:06 kjcf05n00 zabbix-server[2583902]: Running puppet on 'kjcf05n03' Nov 5 00:37:08 kjcf05n03 diskmonitor[17542]: leaving test state: 80 next state: 100 Nov 5 00:37:08 kjcf05n03 diskmonitor[17542]: lock release: time: Tue Nov 5 00:37:00 2024 Nov 5 00:37:08 kjcf05n03 diskmonitor[17542]: leaving test state: 100 next state: 1 Nov 5 00:37:09 kjcf05n03 puppet-agent[30178]: Using configured environment 'production' Nov 5 00:37:09 kjcf05n03 puppet-agent[30178]: Retrieving pluginfacts Nov 5 00:37:09 kjcf05n03 puppet-agent[30178]: Retrieving plugin Nov 5 00:37:09 kjcf05n03 puppet-agent[30178]: Loading facts Nov 5 00:37:10 kjcf05n00 mcfcli[3673891]: %3|1730788630.534|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:37:12 kjcf05n03 puppet-agent[30178]: Caching catalog for kjcf05n03 Nov 5 00:37:12 kjcf05n03 puppet-agent[30178]: Applying configuration version '1730788630' Nov 5 00:37:14 kjcf05n03 puppet-agent[30178]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 00:37:14 kjcf05n03 puppet-agent[30178]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 00:37:14 kjcf05n03 puppet-agent[30178]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 00:37:15 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 5 00:37:15 kjcf05n03 zabbix_agent2[6033]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 00:37:15 kjcf05n03 zabbix_agent2[3159]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:37:15 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 00:37:15 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 5 00:37:15 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 5 00:37:15 kjcf05n03 puppet-agent[30178]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: Press Ctrl+C to exit. Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: Plugin support version 1.0 Nov 5 00:37:15 kjcf05n03 zabbix_agent2[30568]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 00:37:17 kjcf05n03 puppet-agent[30178]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 00:37:17 kjcf05n03 puppet-agent[30178]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 00:37:17 kjcf05n03 puppet-agent[30178]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 00:37:17 kjcf05n03 puppet-agent[30178]: Applied catalog in 5.12 seconds Nov 5 00:37:17 kjcf05n00 zabbix-server[2583902]: puppet completed status:(0): '' Nov 5 00:37:17 kjcf05n00 zabbix-server[2583902]: Event '46894' acknowledged Nov 5 00:37:17 kjcf05n00 zabbix-server[2583902]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n03"}' Nov 5 00:37:26 kjcf05n00 mcfcli[3673891]: %3|1730788646.637|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:37:48 kjcf05n00 mcfcli[3673891]: %3|1730788668.811|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:37:56 kjcf05n00 mcfcli[3673891]: %3|1730788676.637|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 00:38:25 kjcf05n00 mcfcli[3673891]: %3|1730788705.646|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:38:27 kjcf05n00 mcfcli[3673891]: %3|1730788707.137|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 00:38:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730788713}"] Nov 5 00:38:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730788713, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:38:34 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:38:34-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:38:34 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:38:34-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:38:34 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:38:34-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:38:34 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:38:34-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:38:34 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:38:34-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:38:34 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:38:34-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:38:34 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:38:34-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.15182ms Nov 5 00:38:34 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:38:34-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.15182ms Nov 5 00:38:34 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:38:34 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:38:34 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:38:57 kjcf05n00 mcfcli[3673891]: %3|1730788737.138|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 5 00:39:01 kjcf05n00 mcfcli[3673891]: %3|1730788741.400|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:39:27 kjcf05n00 mcfcli[3673891]: %3|1730788767.202|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 00:39:41 kjcf05n00 mcfcli[3673891]: %3|1730788781.397|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:39:57 kjcf05n00 mcfcli[3673891]: %3|1730788797.202|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 5 00:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 5 00:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 5 00:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 5 00:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 5 00:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 5 00:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 5 00:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 5 00:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 5 00:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 5 00:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 5 00:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 5 00:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 5 00:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 5 00:40:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 5 00:40:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:40:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 5 00:40:21 kjcf05n00 mcfcli[3673891]: %3|1730788821.394|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:40:27 kjcf05n00 mcfcli[3673891]: %3|1730788827.202|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:40:41 kjcf05n00 python3.9[2585600]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 5 00:40:57 kjcf05n00 mcfcli[3673891]: %3|1730788857.203|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:40:57 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730788270', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 5 00:40:57 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730788270'} Nov 5 00:40:57 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:40:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730788270', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 5 00:40:58 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730788270'} Nov 5 00:40:58 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:40:59 kjcf05n00 mcfcli[3673891]: %3|1730788859.447|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:41:27 kjcf05n00 mcfcli[3673891]: %3|1730788887.203|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:41:38 kjcf05n00 mcfcli[3673891]: %3|1730788898.507|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:41:57 kjcf05n00 mcfcli[3673891]: %3|1730788917.203|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:42:18 kjcf05n00 mcfcli[3673891]: %3|1730788938.504|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:42:27 kjcf05n00 mcfcli[3673891]: %3|1730788947.641|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 00:42:55 kjcf05n00 mcfcli[3673891]: %3|1730788975.199|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:42:57 kjcf05n00 mcfcli[3673891]: %3|1730788977.641|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 00:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-05T00:43:27.252671753-06:00 level=info msg="Completed cleanup jobs" duration=26.280988ms Nov 5 00:43:27 kjcf05n00 mcfcli[3673891]: %3|1730789007.641|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 00:43:32 kjcf05n00 mcfcli[3673891]: %3|1730789012.856|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:43:57 kjcf05n00 mcfcli[3673891]: %3|1730789037.641|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:44:07 kjcf05n03 root[41868]: failback_xyraid Nov 5 00:44:08 kjcf05n02 nslcd[6988]: [5f007c] ldap_result() failed: Can't contact LDAP server Nov 5 00:44:09 kjcf05n03 root[41977]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 5 00:44:10 kjcf05n03 root[42048]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 5 00:44:10 kjcf05n00 mcfcli[3673891]: %3|1730789050.711|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:44:13 kjcf05n02 systemd[1]: data-kjcf05n03:md66.mount: Succeeded. Nov 5 00:44:15 kjcf05n02 nslcd[6988]: ldap_result() failed: Can't contact LDAP server Nov 5 00:44:17 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme21n1 Nov 5 00:44:17 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme11n1 Nov 5 00:44:17 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme20n1 Nov 5 00:44:17 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme15n1 Nov 5 00:44:17 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme5n1 Nov 5 00:44:17 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme22n1 Nov 5 00:44:17 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme12n1 Nov 5 00:44:17 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme7n1 Nov 5 00:44:17 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme16n1 Nov 5 00:44:17 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme6n1 Nov 5 00:44:17 kjcf05n02 dwd[5236]: Drive path is missing, purging: nvme10n1 Nov 5 00:44:19 kjcf05n03 dwd[5226]: Disk nvme20n1 has WWN eui.345950304db010070025384500000004 Nov 5 00:44:19 kjcf05n03 dwd[5226]: Disk nvme15n1 has WWN eui.345950304db009940025384500000004 Nov 5 00:44:19 kjcf05n03 dwd[5226]: Disk nvme6n1 has WWN eui.345950304e3006180025384500000003 Nov 5 00:44:19 kjcf05n03 dwd[5226]: Disk nvme11n1 has WWN eui.345950304e3006130025384500000003 Nov 5 00:44:19 kjcf05n03 dwd[5226]: Disk nvme10n1 has WWN eui.345950304e3006330025384500000003 Nov 5 00:44:19 kjcf05n03 dwd[5226]: Disk nvme22n1 has WWN eui.345950304db010120025384500000004 Nov 5 00:44:19 kjcf05n03 dwd[5226]: Disk nvme5n1 has WWN eui.345950304e3006320025384500000003 Nov 5 00:44:19 kjcf05n03 dwd[5226]: Disk nvme16n1 has WWN eui.345950304db010130025384500000004 Nov 5 00:44:19 kjcf05n03 dwd[5226]: Disk nvme12n1 has WWN eui.345950304e3006140025384500000003 Nov 5 00:44:19 kjcf05n03 dwd[5226]: Disk nvme7n1 has WWN eui.345950304e3006260025384500000003 Nov 5 00:44:19 kjcf05n03 dwd[5226]: Disk nvme21n1 has WWN eui.345950304db010010025384500000004 Nov 5 00:44:19 kjcf05n03 dwd[5226]: Starting NVME thread for nvme10n1 Nov 5 00:44:19 kjcf05n03 dwd[5226]: Starting NVME thread for nvme15n1 Nov 5 00:44:19 kjcf05n03 dwd[5226]: Starting NVME thread for nvme21n1 Nov 5 00:44:20 kjcf05n03 dwd[5226]: Starting NVME thread for nvme11n1 Nov 5 00:44:20 kjcf05n03 dcs-bulk-data-sender[6231]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 140}' Nov 5 00:44:20 kjcf05n03 dwd[5226]: Starting NVME thread for nvme20n1 Nov 5 00:44:20 kjcf05n03 systemd-udevd[44819]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44820]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44823]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44825]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44819]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44820]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44823]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 dwd[5226]: Starting NVME thread for nvme12n1 Nov 5 00:44:20 kjcf05n03 systemd-udevd[44825]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44819]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44820]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44823]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44825]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001..checksums=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44819]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44820]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44823]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44825]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44819]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44825]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44823]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44820]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44819]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44820]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44825]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44823]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44819]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44825]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44820]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44819]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44823]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.checksums=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44825]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44820]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44819]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0001.resend_count=43'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44857]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44861]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44860]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44863]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44857]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44861]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44860]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44863]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44857]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44861]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44863]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44857]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44857]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44863]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44861]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44857]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44863]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44857]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44863]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44857]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44863]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44857]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44857]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44863]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44857]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44863]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44857]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44863]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44857]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44857]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44857]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:44:20 kjcf05n03 systemd-udevd[44857]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:44:21 kjcf05n03 dwd[5226]: Starting NVME thread for nvme7n1 Nov 5 00:44:21 kjcf05n03 dwd[5226]: Starting NVME thread for nvme6n1 Nov 5 00:44:21 kjcf05n03 dwd[5226]: Starting NVME thread for nvme5n1 Nov 5 00:44:21 kjcf05n03 dwd[5226]: Starting NVME thread for nvme16n1 Nov 5 00:44:21 kjcf05n03 dwd[5226]: Starting NVME thread for nvme22n1 Nov 5 00:44:22 kjcf05n03 nslcd[6975]: [8b4567] (re)loading /etc/nsswitch.conf Nov 5 00:44:22 kjcf05n03 diskmonitor[17542]: IEC: 012001001: MD Array: {"name": "md66", "UUID": "76c05c06:3fa0949b:68ee86c1:978c2ca8", "status": "Optimal"} Nov 5 00:44:28 kjcf05n00 mcfcli[3673891]: %3|1730789068.141|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 00:44:30 kjcf05n03 diskmonitor[17542]: Array md66 has ext4 label: kjcf05-MDT0001 Nov 5 00:44:30 kjcf05n03 diskmonitor[17542]: Scan for ReadErrorMax change for md66 Nov 5 00:44:30 kjcf05n03 diskmonitor[17542]: set /sys/devices/virtual/block/md66/md/max_read_errors to 20 Nov 5 00:44:30 kjcf05n03 diskmonitor[17542]: Added MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 5 00:44:30 kjcf05n03 diskmonitor[17542]: read_saved_file: md66 no saved speed Nov 5 00:44:30 kjcf05n03 diskmonitor[17542]: reconstruction_policy: sync_action prev = current = resync - md66 Nov 5 00:44:30 kjcf05n03 diskmonitor[17542]: Set sync_speed_min (10000) for md66 Nov 5 00:44:30 kjcf05n03 diskmonitor[17542]: Set sync_speed_max (200000) for md66 Nov 5 00:44:30 kjcf05n03 diskmonitor[17542]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 5 00:44:44 kjcf05n02 diskmonitor[17460]: Removed MD Array: md66, UUID: 76c05c06:3fa0949b:68ee86c1:978c2ca8 Nov 5 00:44:44 kjcf05n02 diskmonitor[17460]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 5 00:44:50 kjcf05n00 mcfcli[3673891]: %3|1730789090.623|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:44:58 kjcf05n00 mcfcli[3673891]: %3|1730789098.141|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 00:45:14 kjcf05n03 systemd[1]: Starting Cleanup of Temporary Directories... Nov 5 00:45:14 kjcf05n03 systemd-tmpfiles[47609]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 00:45:14 kjcf05n03 systemd-tmpfiles[47609]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 00:45:14 kjcf05n03 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 5 00:45:14 kjcf05n03 systemd[1]: Started Cleanup of Temporary Directories. Nov 5 00:45:16 kjcf05n03 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 47810 (bash) Nov 5 00:45:16 kjcf05n03 systemd[1]: Mounting /mnt/llog... Nov 5 00:45:16 kjcf05n03 systemd[1]: Mounted /mnt/llog. Nov 5 00:45:23 kjcf05n00 zabbix-server[2588619]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:45:23 kjcf05n00 zabbix-server[2588619]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 145.42\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 124.94\\"}}"' Nov 5 00:45:23 kjcf05n00 log_interesting_event.py[2588619]: Event '46898' acknowledged Nov 5 00:45:26 kjcf05n00 mcfcli[3673891]: %3|1730789126.549|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:45:28 kjcf05n00 mcfcli[3673891]: %3|1730789128.141|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 00:45:40 kjcf05n00 python3.9[2588683]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 5 00:45:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730789153', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 5 00:45:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730789153'} Nov 5 00:45:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:45:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730789153', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 5 00:45:53 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730789153'} Nov 5 00:45:53 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:45:58 kjcf05n00 mcfcli[3673891]: %3|1730789158.143|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:46:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,14,status]', 'value': 'Ok', 'timestamp': 1730789164}"] Nov 5 00:46:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '14', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789164, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:46:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.958548ms Nov 5 00:46:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.958548ms Nov 5 00:46:04 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:46:04 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:46:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:46:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,15,status]', 'value': 'Ok', 'timestamp': 1730789164}"] Nov 5 00:46:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '15', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789164, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:46:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.923352ms Nov 5 00:46:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.923352ms Nov 5 00:46:04 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:46:04 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:46:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:46:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,16,status]', 'value': 'Ok', 'timestamp': 1730789164}"] Nov 5 00:46:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '16', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789164, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:46:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.06136ms Nov 5 00:46:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.06136ms Nov 5 00:46:04 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:46:04 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:46:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:46:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,17,status]', 'value': 'Ok', 'timestamp': 1730789164}"] Nov 5 00:46:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '17', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789164, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:46:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.918483ms Nov 5 00:46:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.918483ms Nov 5 00:46:04 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:46:04 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:46:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:46:05 kjcf05n00 mcfcli[3673891]: %3|1730789165.461|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:46:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,18,status]', 'value': 'Ok', 'timestamp': 1730789164}"] Nov 5 00:46:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '18', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789164, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:46:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.946806ms Nov 5 00:46:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.946806ms Nov 5 00:46:05 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:46:05 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:46:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:46:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,19,status]', 'value': 'Ok', 'timestamp': 1730789165}"] Nov 5 00:46:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '19', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789165, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:46:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.34404ms Nov 5 00:46:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.34404ms Nov 5 00:46:05 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:46:05 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:46:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:46:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,2,status]', 'value': 'Ok', 'timestamp': 1730789165}"] Nov 5 00:46:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789165, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:46:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.438577ms Nov 5 00:46:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.438577ms Nov 5 00:46:05 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:46:05 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:46:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:46:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,3,status]', 'value': 'Ok', 'timestamp': 1730789165}"] Nov 5 00:46:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789165, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:46:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.993543ms Nov 5 00:46:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.993543ms Nov 5 00:46:05 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:46:05 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:46:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:46:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,4,status]', 'value': 'Ok', 'timestamp': 1730789165}"] Nov 5 00:46:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789165, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:46:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.755587ms Nov 5 00:46:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.755587ms Nov 5 00:46:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:46:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:46:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:46:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,5,status]', 'value': 'Ok', 'timestamp': 1730789165}"] Nov 5 00:46:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789165, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:46:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.010626ms Nov 5 00:46:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.010626ms Nov 5 00:46:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:46:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:46:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:46:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,6,status]', 'value': 'Ok', 'timestamp': 1730789165}"] Nov 5 00:46:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789165, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:46:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:46:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:46:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:46:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:46:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:46:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:46:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.130119ms Nov 5 00:46:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:46:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.130119ms Nov 5 00:46:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:46:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:46:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:46:28 kjcf05n00 mcfcli[3673891]: %3|1730789188.205|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 00:46:45 kjcf05n00 mcfcli[3673891]: %3|1730789205.458|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:46:58 kjcf05n00 mcfcli[3673891]: %3|1730789218.205|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:47:22 kjcf05n00 mcfcli[3673891]: %3|1730789242.138|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:47:28 kjcf05n00 mcfcli[3673891]: %3|1730789248.205|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 5 00:47:58 kjcf05n00 mcfcli[3673891]: %3|1730789278.206|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 5 00:48:00 kjcf05n00 mcfcli[3673891]: %3|1730789280.175|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:48:28 kjcf05n00 mcfcli[3673891]: %3|1730789308.206|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 00:48:38 kjcf05n00 mcfcli[3673891]: %3|1730789318.485|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:48:58 kjcf05n00 mcfcli[3673891]: %3|1730789338.206|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:49:18 kjcf05n00 mcfcli[3673891]: %3|1730789358.325|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:49:28 kjcf05n00 mcfcli[3673891]: %3|1730789368.206|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:49:35 kjcf05n03 dwd[5226]: nvme12n1 passed periodic SMART status check Nov 5 00:49:35 kjcf05n03 dwd[5226]: nvme11n1 passed periodic SMART status check Nov 5 00:49:35 kjcf05n03 dwd[5226]: nvme15n1 passed periodic SMART status check Nov 5 00:49:35 kjcf05n03 dwd[5226]: nvme21n1 passed periodic SMART status check Nov 5 00:49:35 kjcf05n03 dwd[5226]: nvme7n1 passed periodic SMART status check Nov 5 00:49:35 kjcf05n03 dwd[5226]: nvme20n1 passed periodic SMART status check Nov 5 00:49:35 kjcf05n03 dwd[5226]: nvme10n1 passed periodic SMART status check Nov 5 00:49:36 kjcf05n03 dwd[5226]: nvme16n1 passed periodic SMART status check Nov 5 00:49:36 kjcf05n03 dwd[5226]: nvme5n1 passed periodic SMART status check Nov 5 00:49:36 kjcf05n03 dwd[5226]: nvme22n1 passed periodic SMART status check Nov 5 00:49:36 kjcf05n03 dwd[5226]: nvme6n1 passed periodic SMART status check Nov 5 00:49:45 kjcf05n00 zabbix-server[2591064]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:49:45 kjcf05n00 zabbix-server[2591064]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 280.21\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 194.73\\"}}"' Nov 5 00:49:46 kjcf05n00 log_interesting_event.py[2591064]: Event '46900' acknowledged Nov 5 00:49:58 kjcf05n00 mcfcli[3673891]: %3|1730789398.322|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:49:58 kjcf05n00 mcfcli[3673891]: %3|1730789398.322|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 00:50:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 5 00:50:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:50:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 5 00:50:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 5 00:50:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:50:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 5 00:50:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 5 00:50:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:50:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 5 00:50:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 5 00:50:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:50:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 5 00:50:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 5 00:50:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:50:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 5 00:50:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 5 00:50:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:50:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 5 00:50:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 5 00:50:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:50:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 5 00:50:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 5 00:50:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 00:50:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 5 00:50:09 kjcf05n00 zabbix-server[2591360]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:50:09 kjcf05n00 zabbix-server[2591360]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n03' from event '46901' Nov 5 00:50:09 kjcf05n00 zabbix-server[2591360]: Filesystem 'kjcf05' has been mounted Nov 5 00:50:09 kjcf05n00 zabbix-server[2591360]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 5 00:50:09 kjcf05n00 zabbix-server[2591360]: Running puppet on 'None' Nov 5 00:50:11 kjcf05n03 puppet-agent[56259]: Using configured environment 'production' Nov 5 00:50:11 kjcf05n03 puppet-agent[56259]: Retrieving pluginfacts Nov 5 00:50:11 kjcf05n03 puppet-agent[56259]: Retrieving plugin Nov 5 00:50:11 kjcf05n03 puppet-agent[56259]: Loading facts Nov 5 00:50:11 kjcf05n06 puppet-agent[2735245]: Using configured environment 'production' Nov 5 00:50:11 kjcf05n06 puppet-agent[2735245]: Retrieving pluginfacts Nov 5 00:50:11 kjcf05n06 puppet-agent[2735245]: Retrieving plugin Nov 5 00:50:11 kjcf05n06 puppet-agent[2735245]: Loading facts Nov 5 00:50:11 kjcf05n05 puppet-agent[2927538]: Using configured environment 'production' Nov 5 00:50:11 kjcf05n05 puppet-agent[2927538]: Retrieving pluginfacts Nov 5 00:50:11 kjcf05n05 puppet-agent[2927538]: Retrieving plugin Nov 5 00:50:12 kjcf05n04 puppet-agent[2714165]: Using configured environment 'production' Nov 5 00:50:12 kjcf05n04 puppet-agent[2714165]: Retrieving pluginfacts Nov 5 00:50:12 kjcf05n04 puppet-agent[2714165]: Retrieving plugin Nov 5 00:50:12 kjcf05n02 puppet-agent[175903]: Using configured environment 'production' Nov 5 00:50:12 kjcf05n02 puppet-agent[175903]: Retrieving pluginfacts Nov 5 00:50:12 kjcf05n02 puppet-agent[175903]: Retrieving plugin Nov 5 00:50:12 kjcf05n07 puppet-agent[2735931]: Using configured environment 'production' Nov 5 00:50:12 kjcf05n07 puppet-agent[2735931]: Retrieving pluginfacts Nov 5 00:50:12 kjcf05n07 puppet-agent[2735931]: Retrieving plugin Nov 5 00:50:12 kjcf05n07 puppet-agent[2735931]: Loading facts Nov 5 00:50:12 kjcf05n01 puppet-agent[3988784]: Using configured environment 'production' Nov 5 00:50:12 kjcf05n01 puppet-agent[3988784]: Retrieving pluginfacts Nov 5 00:50:12 kjcf05n01 puppet-agent[3988784]: Retrieving plugin Nov 5 00:50:12 kjcf05n01 puppet-agent[3988784]: Loading facts Nov 5 00:50:12 kjcf05n04 puppet-agent[2714165]: Loading facts Nov 5 00:50:12 kjcf05n05 puppet-agent[2927538]: Loading facts Nov 5 00:50:12 kjcf05n02 puppet-agent[175903]: Loading facts Nov 5 00:50:12 kjcf05n00 puppet-agent[2591426]: Using configured environment 'production' Nov 5 00:50:12 kjcf05n00 puppet-agent[2591426]: Retrieving pluginfacts Nov 5 00:50:12 kjcf05n00 puppet-agent[2591426]: Retrieving plugin Nov 5 00:50:12 kjcf05n00 puppet-agent[2591426]: Loading facts Nov 5 00:50:15 kjcf05n02 puppet-agent[175903]: Caching catalog for kjcf05n02 Nov 5 00:50:15 kjcf05n02 puppet-agent[175903]: Applying configuration version '1730789413' Nov 5 00:50:15 kjcf05n03 puppet-agent[56259]: Caching catalog for kjcf05n03 Nov 5 00:50:15 kjcf05n03 puppet-agent[56259]: Applying configuration version '1730789413' Nov 5 00:50:15 kjcf05n06 puppet-agent[2735245]: Caching catalog for kjcf05n06 Nov 5 00:50:15 kjcf05n06 puppet-agent[2735245]: Applying configuration version '1730789413' Nov 5 00:50:14 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 5 00:50:14 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 5 00:50:15 kjcf05n07 puppet-agent[2735931]: Caching catalog for kjcf05n07 Nov 5 00:50:15 kjcf05n07 puppet-agent[2735931]: Applying configuration version '1730789413' Nov 5 00:50:16 kjcf05n01 puppet-agent[3988784]: Caching catalog for kjcf05n01 Nov 5 00:50:16 kjcf05n01 puppet-agent[3988784]: Applying configuration version '1730789414' Nov 5 00:50:16 kjcf05n00 puppet-agent[2591426]: Caching catalog for kjcf05n00 Nov 5 00:50:16 kjcf05n00 puppet-agent[2591426]: Applying configuration version '1730789414' Nov 5 00:50:17 kjcf05n03 puppet-agent[56259]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 00:50:17 kjcf05n03 puppet-agent[56259]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 00:50:17 kjcf05n03 puppet-agent[56259]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 00:50:17 kjcf05n02 puppet-agent[175903]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 00:50:17 kjcf05n02 puppet-agent[175903]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 00:50:17 kjcf05n02 puppet-agent[175903]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 00:50:17 kjcf05n06 puppet-agent[2735245]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 00:50:17 kjcf05n06 puppet-agent[2735245]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 00:50:17 kjcf05n06 puppet-agent[2735245]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 00:50:17 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 5 00:50:17 kjcf05n02 zabbix_agent2[117514]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 00:50:17 kjcf05n02 zabbix_agent2[3231]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 00:50:17 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 00:50:17 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 5 00:50:17 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 5 00:50:17 kjcf05n02 puppet-agent[175903]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: Press Ctrl+C to exit. Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: Plugin support version 1.0 Nov 5 00:50:17 kjcf05n02 zabbix_agent2[176267]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 00:50:17 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 5 00:50:17 kjcf05n03 zabbix_agent2[30568]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 00:50:17 kjcf05n03 zabbix_agent2[3159]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 00:50:17 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 00:50:17 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 5 00:50:17 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 5 00:50:17 kjcf05n03 puppet-agent[56259]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: Press Ctrl+C to exit. Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: Plugin support version 1.0 Nov 5 00:50:17 kjcf05n03 zabbix_agent2[56673]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 00:50:17 kjcf05n07 puppet-agent[2735931]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 00:50:17 kjcf05n07 puppet-agent[2735931]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 00:50:17 kjcf05n07 puppet-agent[2735931]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 00:50:17 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2682396]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 00:50:17 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 5 00:50:17 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 00:50:17 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 5 00:50:17 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 5 00:50:17 kjcf05n06 puppet-agent[2735245]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: Press Ctrl+C to exit. Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: Plugin support version 1.0 Nov 5 00:50:17 kjcf05n06 zabbix_agent2[2735646]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 5 00:50:18 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2683078]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 00:50:18 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 5 00:50:18 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 00:50:18 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 5 00:50:18 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 5 00:50:18 kjcf05n07 puppet-agent[2735931]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: Press Ctrl+C to exit. Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: Plugin support version 1.0 Nov 5 00:50:18 kjcf05n07 zabbix_agent2[2736346]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 5 00:50:19 kjcf05n01 puppet-agent[3988784]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 5 00:50:19 kjcf05n01 puppet-agent[3988784]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-05-00:26:14]/mode) mode changed '0755' to '0750' Nov 5 00:50:19 kjcf05n01 puppet-agent[3988784]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-05-00:26:14/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 5 00:50:19 kjcf05n01 puppet-agent[3988784]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-05-00:26:14/vmcore]/mode) mode changed '0600' to '0640' Nov 5 00:50:19 kjcf05n01 puppet-agent[3988784]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.6-2024-11-05-00:26:14/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 5 00:50:19 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 5 00:50:19 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 5 00:50:19 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 5 00:50:19 kjcf05n00 puppet-agent[2591426]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 5 00:50:19 kjcf05n06 puppet-agent[2735245]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 00:50:19 kjcf05n06 puppet-agent[2735245]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 00:50:19 kjcf05n06 puppet-agent[2735245]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 00:50:19 kjcf05n02 puppet-agent[175903]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 00:50:19 kjcf05n02 puppet-agent[175903]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 00:50:19 kjcf05n02 puppet-agent[175903]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 00:50:19 kjcf05n02 puppet-agent[175903]: Applied catalog in 5.09 seconds Nov 5 00:50:19 kjcf05n03 puppet-agent[56259]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 00:50:19 kjcf05n03 puppet-agent[56259]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 00:50:19 kjcf05n03 puppet-agent[56259]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 00:50:20 kjcf05n06 puppet-agent[2735245]: Applied catalog in 4.99 seconds Nov 5 00:50:20 kjcf05n01 puppet-agent[3988784]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 00:50:20 kjcf05n01 puppet-agent[3988784]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 00:50:20 kjcf05n01 puppet-agent[3988784]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 00:50:20 kjcf05n07 puppet-agent[2735931]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 00:50:20 kjcf05n07 puppet-agent[2735931]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 00:50:20 kjcf05n07 puppet-agent[2735931]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 00:50:20 kjcf05n07 puppet-agent[2735931]: Applied catalog in 4.89 seconds Nov 5 00:50:20 kjcf05n03 puppet-agent[56259]: Applied catalog in 5.15 seconds Nov 5 00:50:20 kjcf05n00 puppet-agent[2591426]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 00:50:20 kjcf05n00 puppet-agent[2591426]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 00:50:20 kjcf05n00 puppet-agent[2591426]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 00:50:21 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3977238]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 00:50:21 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 5 00:50:21 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 00:50:21 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 5 00:50:21 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 5 00:50:21 kjcf05n01 puppet-agent[3988784]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: Press Ctrl+C to exit. Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: Plugin support version 1.0 Nov 5 00:50:21 kjcf05n01 zabbix_agent2[3989252]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 5 00:50:20 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2573426]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 00:50:21 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 5 00:50:20 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 00:50:20 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 5 00:50:20 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 5 00:50:20 kjcf05n00 puppet-agent[2591426]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: Press Ctrl+C to exit. Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: Plugin support version 1.0 Nov 5 00:50:20 kjcf05n00 zabbix_agent2[2591918]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 5 00:50:21 kjcf05n00 zabbix-server[2591958]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:50:21 kjcf05n00 zabbix-server[2591973]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:50:22 kjcf05n00 zabbix-server[2591979]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:50:22 kjcf05n00 zabbix-server[2591981]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:50:23 kjcf05n01 puppet-agent[3988784]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241105_003332.log]/mode) mode changed '0644' to '0640' Nov 5 00:50:23 kjcf05n01 puppet-agent[3988784]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241105_004516.log]/mode) mode changed '0644' to '0640' Nov 5 00:50:22 kjcf05n00 puppet-agent[2591426]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 5 00:50:23 kjcf05n01 puppet-agent[3988784]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241105_003332.log]/mode) mode changed '0644' to '0640' Nov 5 00:50:23 kjcf05n01 puppet-agent[3988784]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241105_004516.log]/mode) mode changed '0644' to '0640' Nov 5 00:50:23 kjcf05n01 puppet-agent[3988784]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241105_004516]/mode) mode changed '0755' to '0750' Nov 5 00:50:23 kjcf05n01 puppet-agent[3988784]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/vmstat_kjcf05n03_20241105_004516/screenlog.0]/mode) mode changed '0644' to '0640' Nov 5 00:50:23 kjcf05n01 puppet-agent[3988784]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 00:50:23 kjcf05n01 puppet-agent[3988784]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 00:50:23 kjcf05n01 puppet-agent[3988784]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 00:50:23 kjcf05n00 puppet-agent[2591426]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 00:50:23 kjcf05n00 puppet-agent[2591426]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 00:50:23 kjcf05n00 puppet-agent[2591426]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 00:50:24 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 5 00:50:24 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 5 00:50:24 kjcf05n00 puppet-agent[2591426]: Applied catalog in 8.32 seconds Nov 5 00:50:25 kjcf05n04 puppet-agent[2714165]: Caching catalog for kjcf05n04 Nov 5 00:50:25 kjcf05n04 puppet-agent[2714165]: Applying configuration version '1730789423' Nov 5 00:50:25 kjcf05n01 puppet-agent[3988784]: Applied catalog in 8.84 seconds Nov 5 00:50:27 kjcf05n04 puppet-agent[2714165]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 00:50:27 kjcf05n04 puppet-agent[2714165]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 00:50:27 kjcf05n04 puppet-agent[2714165]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 00:50:27 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2668294]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 00:50:27 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 5 00:50:27 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 00:50:27 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 5 00:50:27 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 5 00:50:27 kjcf05n04 puppet-agent[2714165]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: Press Ctrl+C to exit. Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: Plugin support version 1.0 Nov 5 00:50:27 kjcf05n04 zabbix_agent2[2715042]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 5 00:50:28 kjcf05n00 mcfcli[3673891]: %3|1730789428.645|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 00:50:29 kjcf05n04 puppet-agent[2714165]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 00:50:29 kjcf05n04 puppet-agent[2714165]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 00:50:29 kjcf05n04 puppet-agent[2714165]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 00:50:29 kjcf05n04 puppet-agent[2714165]: Applied catalog in 4.76 seconds Nov 5 00:50:36 kjcf05n00 mcfcli[3673891]: %3|1730789436.280|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:50:40 kjcf05n00 python3.9[2592097]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 5 00:50:45 kjcf05n05 puppet-agent[2927538]: Caching catalog for kjcf05n05 Nov 5 00:50:45 kjcf05n05 puppet-agent[2927538]: Applying configuration version '1730789444' Nov 5 00:50:47 kjcf05n05 puppet-agent[2927538]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 00:50:47 kjcf05n05 puppet-agent[2927538]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 00:50:47 kjcf05n05 puppet-agent[2927538]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 00:50:48 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2882197]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 00:50:48 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 5 00:50:48 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 00:50:48 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 5 00:50:48 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 5 00:50:48 kjcf05n05 puppet-agent[2927538]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: Starting Zabbix Agent 2 (6.2.1) Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: Press Ctrl+C to exit. Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: Plugin support version 1.0 Nov 5 00:50:48 kjcf05n05 zabbix_agent2[2929873]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 5 00:50:50 kjcf05n05 puppet-agent[2927538]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 00:50:50 kjcf05n05 puppet-agent[2927538]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 00:50:50 kjcf05n05 puppet-agent[2927538]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 00:50:50 kjcf05n05 puppet-agent[2927538]: Applied catalog in 4.78 seconds Nov 5 00:50:50 kjcf05n00 zabbix-server[2591360]: puppet completed status:(0): '' Nov 5 00:50:50 kjcf05n00 zabbix-server[2591360]: Event '46901' acknowledged Nov 5 00:50:50 kjcf05n00 zabbix-server[2591360]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n03"}' Nov 5 00:50:58 kjcf05n00 mcfcli[3673891]: %3|1730789458.645|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:51:16 kjcf05n00 mcfcli[3673891]: %3|1730789476.277|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:51:28 kjcf05n00 mcfcli[3673891]: %3|1730789488.645|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:51:55 kjcf05n00 mcfcli[3673891]: %3|1730789515.214|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:51:58 kjcf05n00 mcfcli[3673891]: %3|1730789518.645|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 00:52:08 kjcf05n06 chronyd[5469]: Selected source 16.110.135.123 Nov 5 00:52:28 kjcf05n00 mcfcli[3673891]: %3|1730789548.646|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:52:33 kjcf05n00 mcfcli[3673891]: %3|1730789553.504|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:52:58 kjcf05n00 mcfcli[3673891]: %3|1730789578.646|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:53:11 kjcf05n00 mcfcli[3673891]: %3|1730789591.784|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T06:53:15.867575Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 5 00:53:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T06:53:15.867647Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.096ms Nov 5 00:53:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-05T00:53:27.253667945-06:00 level=info msg="Completed cleanup jobs" duration=27.249872ms Nov 5 00:53:28 kjcf05n00 mcfcli[3673891]: %3|1730789608.646|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 00:53:47 kjcf05n00 mcfcli[3673891]: %3|1730789627.894|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:53:58 kjcf05n00 mcfcli[3673891]: %3|1730789638.646|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:54:23 kjcf05n00 zabbix-server[2594243]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 00:54:23 kjcf05n00 zabbix-server[2594243]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 161.49\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 156.62\\"}}"' Nov 5 00:54:23 kjcf05n00 log_interesting_event.py[2594243]: Event '46902' acknowledged Nov 5 00:54:27 kjcf05n00 mcfcli[3673891]: %3|1730789667.707|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:54:28 kjcf05n00 mcfcli[3673891]: %3|1730789668.646|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:54:58 kjcf05n00 mcfcli[3673891]: %3|1730789698.646|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:55:05 kjcf05n00 mcfcli[3673891]: %3|1730789705.515|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:55:28 kjcf05n00 mcfcli[3673891]: %3|1730789728.647|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:55:40 kjcf05n00 python3.9[2594924]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 5 00:55:45 kjcf05n00 mcfcli[3673891]: %3|1730789745.512|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 5 00:55:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 5 00:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 5 00:55:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 5 00:55:58 kjcf05n00 mcfcli[3673891]: %3|1730789758.647|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 5 00:55:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 5 00:56:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 5 00:56:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 5 00:56:21 kjcf05n00 zabbix_server[15726]: Zabbix agent item "dcs.lustre.filesystem_name[kjcf05]" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 5 00:56:21 kjcf05n00 zabbix_server[15764]: Zabbix agent item "dcs.lustre.device.mdt.name[MDT0001,mdt_name]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 5 00:56:24 kjcf05n00 mcfcli[3673891]: %3|1730789784.315|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:56:27 kjcf05n03 fstonithd.py[15181]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 5 00:56:27 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 5 00:56:27 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 5 00:56:27 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 5 00:56:28 kjcf05n03 root[66700]: is_enc_ipmi_off starts Nov 5 00:56:28 kjcf05n03 root[66701]: is_viking_off starts Nov 5 00:56:28 kjcf05n03 root[66717]: is_lan_ipmi_off leaves Nov 5 00:56:28 kjcf05n03 root[66719]: is_lan_ipmi_sec_off leaves Nov 5 00:56:28 kjcf05n03 root[66723]: I am not master; I will get master Nov 5 00:56:28 kjcf05n03 root[66726]: I am in slot 1; partner is in slot 0 Nov 5 00:56:28 kjcf05n00 mcfcli[3673891]: %3|1730789788.648|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:56:33 kjcf05n03 root[66826]: I am now master Nov 5 00:56:36 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0000,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 5 00:56:36 kjcf05n00 zabbix_server[15783]: Zabbix agent item "proc.num" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 5 00:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 5 00:56:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 5 00:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 5 00:56:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 5 00:56:38 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='47', error='Connection reset by peer (104)' Nov 5 00:56:38 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='47', client='AF_INET(172.16.2.5:45925)', local='AF_INET(0.0.0.0:601)' Nov 5 00:56:40 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib0 Nov 5 00:56:40 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib0 Nov 5 00:56:44 kjcf05n03 root[67111]: is_viking_off leaves Nov 5 00:56:44 kjcf05n03 root[67114]: kjcf05n02 not already off look at kdump Nov 5 00:56:44 kjcf05n03 root[67115]: is_kdump_off starts Nov 5 00:56:44 kjcf05n03 fence_kdump[67116]: waiting for message from '172.16.2.5' Nov 5 00:56:45 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib1 Nov 5 00:56:45 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib1 Nov 5 00:56:45 kjcf05n03 fence_kdump[67116]: received valid message from '172.16.2.5' Nov 5 00:56:45 kjcf05n03 root[67142]: is_kdump_off detected kdump on kjcf05n02 Nov 5 00:56:45 kjcf05n03 root[67143]: kjcf05n02 is kdumping Nov 5 00:56:45 kjcf05n03 root[67233]: is_viking_off starts Nov 5 00:56:45 kjcf05n03 root[67232]: is_enc_ipmi_off starts Nov 5 00:56:46 kjcf05n03 root[67249]: is_lan_ipmi_off leaves Nov 5 00:56:46 kjcf05n03 root[67251]: is_lan_ipmi_sec_off leaves Nov 5 00:56:46 kjcf05n03 root[67254]: I am in slot 1; partner is in slot 0 Nov 5 00:56:46 kjcf05n03 root[67257]: I am master Nov 5 00:56:48 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 5 00:56:48 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 5 00:56:51 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0003,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 5 00:56:51 kjcf05n00 zabbix_server[15783]: Zabbix agent item "proc.num[,,run]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 5 00:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 5 00:56:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 5 00:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 5 00:56:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 5 00:56:57 kjcf05n03 root[67685]: is_viking_off leaves Nov 5 00:56:57 kjcf05n03 root[67688]: kjcf05n02 not already off look at kdump Nov 5 00:56:57 kjcf05n03 root[67689]: is_kdump_off starts Nov 5 00:56:57 kjcf05n03 fence_kdump[67704]: waiting for message from '172.16.2.5' Nov 5 00:56:57 kjcf05n03 fence_kdump[67704]: received valid message from '172.16.2.5' Nov 5 00:56:57 kjcf05n03 root[67705]: is_kdump_off detected kdump on kjcf05n02 Nov 5 00:56:57 kjcf05n03 root[67706]: kjcf05n02 is kdumping Nov 5 00:56:58 kjcf05n00 mcfcli[3673891]: %3|1730789818.648|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 5 00:56:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 5 00:56:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 5 00:56:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 5 00:57:01 kjcf05n03 dwd[5226]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 5 00:57:01 kjcf05n03 dwd[5226]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 5 00:57:01 kjcf05n03 dwd[5226]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 5 00:57:01 kjcf05n03 dwd[5226]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 5 00:57:01 kjcf05n03 dwd[5226]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 5 00:57:01 kjcf05n03 dwd[5226]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 5 00:57:01 kjcf05n03 dwd[5226]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 5 00:57:01 kjcf05n03 dwd[5226]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 5 00:57:01 kjcf05n03 dwd[5226]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 5 00:57:01 kjcf05n03 dwd[5226]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 5 00:57:01 kjcf05n03 dwd[5226]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 5 00:57:01 kjcf05n03 dwd[5226]: Starting NVME thread for nvme25n1 Nov 5 00:57:02 kjcf05n03 dwd[5226]: Starting NVME thread for nvme8n1 Nov 5 00:57:02 kjcf05n03 dwd[5226]: Starting NVME thread for nvme18n1 Nov 5 00:57:02 kjcf05n03 dwd[5226]: Starting NVME thread for nvme23n1 Nov 5 00:57:02 kjcf05n03 dwd[5226]: Starting NVME thread for nvme9n1 Nov 5 00:57:02 kjcf05n03 dwd[5226]: Starting NVME thread for nvme4n1 Nov 5 00:57:02 kjcf05n03 dwd[5226]: Starting NVME thread for nvme2n1 Nov 5 00:57:03 kjcf05n03 systemd-udevd[69947]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69948]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69951]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69952]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69947]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69948]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69951]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69952]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69947]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69948]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69951]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69947]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69952]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69963]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69948]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69951]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69966]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69971]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69968]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69952]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69947]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69948]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69963]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69951]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69971]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69966]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69968]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69952]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69948]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69963]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69951]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69971]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69968]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69966]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69948]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69963]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69952]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69948]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69966]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69968]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69963]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69952]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69971]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69948]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69966]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69963]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69968]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69971]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69948]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69963]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69971]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69948]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69963]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69971]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69971]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69971]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69963]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69971]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69963]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69971]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69963]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69971]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69963]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 systemd-udevd[69963]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 00:57:03 kjcf05n03 dwd[5226]: Starting NVME thread for nvme3n1 Nov 5 00:57:03 kjcf05n03 dwd[5226]: Starting NVME thread for nvme19n1 Nov 5 00:57:03 kjcf05n03 dwd[5226]: Starting NVME thread for nvme17n1 Nov 5 00:57:03 kjcf05n03 dwd[5226]: Starting NVME thread for nvme24n1 Nov 5 00:57:04 kjcf05n00 mcfcli[3673891]: %3|1730789824.312|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:57:06 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 5 00:57:06 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 5 00:57:07 kjcf05n03 diskmonitor[17542]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 5 00:57:15 kjcf05n03 diskmonitor[17542]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 5 00:57:15 kjcf05n03 diskmonitor[17542]: Scan for ReadErrorMax change for md65 Nov 5 00:57:15 kjcf05n03 diskmonitor[17542]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 5 00:57:15 kjcf05n03 diskmonitor[17542]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 5 00:57:15 kjcf05n03 diskmonitor[17542]: read_saved_file: md65 no saved speed Nov 5 00:57:15 kjcf05n03 diskmonitor[17542]: reconstruction_policy: sync_action prev = current = idle - md65 Nov 5 00:57:15 kjcf05n03 diskmonitor[17542]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 5 00:57:28 kjcf05n00 mcfcli[3673891]: %3|1730789848.648|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 00:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 5 00:57:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 5 00:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 5 00:57:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 5 00:57:38 kjcf05n00 mcfcli[3673891]: %3|1730789858.144|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:57:40 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib0 Nov 5 00:57:40 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib0 Nov 5 00:57:45 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib1 Nov 5 00:57:45 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib1 Nov 5 00:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 5 00:57:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 5 00:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 5 00:57:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 5 00:57:58 kjcf05n03 nslcd[6975]: ldap_result() failed: Can't contact LDAP server Nov 5 00:57:58 kjcf05n03 nslcd[6975]: (re)loading /etc/nsswitch.conf Nov 5 00:57:58 kjcf05n00 mcfcli[3673891]: %3|1730789878.648|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 00:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 5 00:57:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 5 00:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 5 00:57:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 5 00:58:14 kjcf05n00 mcfcli[3673891]: %3|1730789894.638|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:58:28 kjcf05n00 mcfcli[3673891]: %3|1730789908.649|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 00:58:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730789914}"] Nov 5 00:58:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789914, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:58:34 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:34-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:34 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:34-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:34 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:34-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:34 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:34-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:34 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:34-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:34 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:34-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:34 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:34-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.412648ms Nov 5 00:58:34 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:34-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.412648ms Nov 5 00:58:34 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:58:34 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:58:34 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:58:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730789914}"] Nov 5 00:58:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789914, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:58:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.063895ms Nov 5 00:58:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.063895ms Nov 5 00:58:35 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:58:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:58:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:58:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730789914}"] Nov 5 00:58:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789914, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:58:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.150588ms Nov 5 00:58:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.150588ms Nov 5 00:58:35 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:58:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:58:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:58:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730789914}"] Nov 5 00:58:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789914, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:58:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.851447ms Nov 5 00:58:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.851447ms Nov 5 00:58:35 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:58:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:58:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:58:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730789914}"] Nov 5 00:58:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789914, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:58:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.136812ms Nov 5 00:58:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.136812ms Nov 5 00:58:35 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:58:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:58:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:58:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730789914}"] Nov 5 00:58:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789914, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:58:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.1463ms Nov 5 00:58:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.1463ms Nov 5 00:58:35 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:58:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:58:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:58:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730789914}"] Nov 5 00:58:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789914, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:58:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.616928ms Nov 5 00:58:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.616928ms Nov 5 00:58:35 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:58:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:58:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:58:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730789914}"] Nov 5 00:58:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789914, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:58:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:35-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:35 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:35-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:35 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:35-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:35 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.974117ms Nov 5 00:58:35 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:35-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.974117ms Nov 5 00:58:35 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:58:35 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:58:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:58:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730789914}"] Nov 5 00:58:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789914, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:58:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.873458ms Nov 5 00:58:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.873458ms Nov 5 00:58:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:58:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:58:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:58:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730789914}"] Nov 5 00:58:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789914, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:58:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.022117ms Nov 5 00:58:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.022117ms Nov 5 00:58:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:58:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:58:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:58:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730789914}"] Nov 5 00:58:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730789914, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 00:58:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:36-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 00:58:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:36 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T00:58:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:36-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 00:58:36 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T00:58:36-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 00:58:36 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T00:58:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.997223ms Nov 5 00:58:36 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T00:58:36-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.997223ms Nov 5 00:58:36 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:00:58:36 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 00:58:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 00:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 5 00:58:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 5 00:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 5 00:58:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 5 00:58:40 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib0 Nov 5 00:58:40 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib0 Nov 5 00:58:45 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib1 Nov 5 00:58:45 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib1 Nov 5 00:58:49 kjcf05n00 mcfcli[3673891]: %3|1730789929.453|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 5 00:58:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 5 00:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 5 00:58:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 5 00:58:58 kjcf05n00 mcfcli[3673891]: %3|1730789938.650|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 00:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 5 00:58:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 5 00:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 5 00:58:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 5 00:59:24 kjcf05n00 mcfcli[3673891]: %3|1730789964.282|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 00:59:28 kjcf05n00 mcfcli[3673891]: %3|1730789968.650|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 5 00:59:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 5 00:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 5 00:59:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 5 00:59:40 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib0 Nov 5 00:59:40 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib0 Nov 5 00:59:44 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib1 Nov 5 00:59:44 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib1 Nov 5 00:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 5 00:59:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 5 00:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 5 00:59:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 5 00:59:58 kjcf05n00 mcfcli[3673891]: %3|1730789998.650|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 00:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 5 00:59:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 5 00:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 5 00:59:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 5 01:00:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 5 01:00:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:00:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 5 01:00:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 5 01:00:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:00:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 5 01:00:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 5 01:00:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:00:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 5 01:00:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 5 01:00:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:00:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 5 01:00:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 5 01:00:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:00:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 5 01:00:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 5 01:00:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:00:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 5 01:00:01 kjcf05n00 mcfcli[3673891]: %3|1730790001.907|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:00:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 5 01:00:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:00:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 5 01:00:05 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 5 01:00:05 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 5 01:00:06 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 5 01:00:09 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 5 01:00:09 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 5 01:00:09 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 5 01:00:09 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 5 01:00:09 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 5 01:00:09 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 5 01:00:09 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 5 01:00:11 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 5 01:00:11 kjcf05n00 zabbix-server[2597932]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 01:00:11 kjcf05n00 zabbix-server[2597932]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 5 01:00:12 kjcf05n00 log_interesting_event.py[2597932]: Event '46904' acknowledged Nov 5 01:00:14 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 5 01:00:28 kjcf05n00 mcfcli[3673891]: %3|1730790028.650|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 01:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 5 01:00:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 5 01:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 5 01:00:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 5 01:00:39 kjcf05n00 mcfcli[3673891]: %3|1730790039.985|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:00:40 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib0 Nov 5 01:00:40 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib0 Nov 5 01:00:45 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib1 Nov 5 01:00:45 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib1 Nov 5 01:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 5 01:00:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 5 01:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 5 01:00:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 5 01:00:56 kjcf05n00 python3.9[2598443]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 5 01:00:58 kjcf05n00 mcfcli[3673891]: %3|1730790058.651|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 5 01:00:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 5 01:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 5 01:00:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 5 01:01:01 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:53604). Nov 5 01:01:01 kjcf05n01 rsyncd[3993418]: connect from kjcf05n02 (172.16.2.5) Nov 5 01:01:01 kjcf05n01 rsyncd[3993418]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 5 01:01:01 kjcf05n01 rsyncd[3993418]: building file list Nov 5 01:01:01 kjcf05n01 rsyncd[3993418]: sent 11450 bytes received 136 bytes total size 10905 Nov 5 01:01:01 kjcf05n01 systemd[1]: rsyncd@679-172.16.2.2:873-172.16.2.5:53604.service: Succeeded. Nov 5 01:01:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730790070', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 5 01:01:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730790070'} Nov 5 01:01:10 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:01:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730790070', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 5 01:01:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730790070'} Nov 5 01:01:10 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:01:15 kjcf05n00 mcfcli[3673891]: %3|1730790075.907|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:01:27 kjcf05n03 fstonithd.py[15181]: Listening for kdump packets from partner Nov 5 01:01:29 kjcf05n00 mcfcli[3673891]: %3|1730790089.150|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 01:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 5 01:01:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 5 01:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 5 01:01:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 5 01:01:40 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib0 Nov 5 01:01:40 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib0 Nov 5 01:01:45 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib1 Nov 5 01:01:45 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib1 Nov 5 01:01:54 kjcf05n00 mcfcli[3673891]: %3|1730790114.466|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 5 01:01:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 5 01:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 5 01:01:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 5 01:01:59 kjcf05n00 mcfcli[3673891]: %3|1730790119.150|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 5 01:01:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 5 01:01:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 5 01:01:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 5 01:02:26 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='39', client='AF_INET(172.16.2.5:40213)', local='AF_INET(0.0.0.0:601)' Nov 5 01:02:26 kjcf05n02 syslog-ng[3135]: Configuration reload request received, reloading configuration; Nov 5 01:02:26 kjcf05n02 syslog-ng[3135]: Configuration reload finished; Nov 5 01:02:26 kjcf05n02 syslog-ng[3135]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 5 01:02:26 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 5 01:02:26 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 5 01:02:26 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 5 01:02:26 kjcf05n02 dracut: Self testing crypto algorithms Nov 5 01:02:26 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 5 01:02:26 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 5 01:02:26 kjcf05n02 Copying live image to RAM... Nov 5 01:02:26 kjcf05n02 (this may take a minute) Nov 5 01:02:26 kjcf05n02 Done copying live image to RAM. Nov 5 01:02:26 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 5 01:02:26 kjcf05n02 dracut: Checking integrity of kernel Nov 5 01:02:26 kjcf05n02 dracut: All initrd crypto checks done Nov 5 01:02:26 kjcf05n02 dracut: Switching root Nov 5 01:02:26 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 5 01:02:26 kjcf05n02 systemd: Detected architecture x86-64. Nov 5 01:02:26 kjcf05n02 systemd: Set hostname to . Nov 5 01:02:26 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 5 01:02:26 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 5 01:02:26 kjcf05n02 systemd: Reached target Swap. Nov 5 01:02:26 kjcf05n02 systemd: Listening on Journal Socket (/dev/log). Nov 5 01:02:26 kjcf05n02 systemd: Listening on udev Kernel Socket. Nov 5 01:02:26 kjcf05n02 systemd: Listening on udev Control Socket. Nov 5 01:02:26 kjcf05n02 systemd: Created slice system-serial\x2dgetty.slice. Nov 5 01:02:26 kjcf05n02 systemd-journald[1502]: Journal started Nov 5 01:02:26 kjcf05n02 systemd-journald[1502]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 5 01:02:26 kjcf05n02 systemd-modules-load[1510]: Inserted module 'fuse' Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Remount Root and Kernel File Systems. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Create list of required static device nodes for the current kernel. Nov 5 01:02:26 kjcf05n02 systemd[1]: Mounted Temporary Directory (/tmp). Nov 5 01:02:26 kjcf05n02 systemd[1]: Mounted POSIX Message Queue File System. Nov 5 01:02:26 kjcf05n02 systemd[1]: Mounted Huge Pages File System. Nov 5 01:02:26 kjcf05n02 systemd[1]: Mounted /mnt. Nov 5 01:02:26 kjcf05n02 systemd[1]: Mounted /data. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Create System Users... Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Rebuild Hardware Database... Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Load/Save Random Seed... Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Apply Kernel Variables... Nov 5 01:02:26 kjcf05n02 systemd[1]: Mounting Kernel Configuration File System... Nov 5 01:02:26 kjcf05n02 systemd[1]: Mounting FUSE Control File System... Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Create System Users. Nov 5 01:02:26 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 5 01:02:26 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 5 01:02:26 kjcf05n02 systemd-sysctl[1539]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 5 01:02:26 kjcf05n02 systemd-sysctl[1539]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 5 01:02:26 kjcf05n02 systemd-journald[1502]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 5 01:02:26 kjcf05n02 systemd-tmpfiles[1548]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 01:02:26 kjcf05n02 systemd-tmpfiles[1548]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 5 01:02:26 kjcf05n02 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 5 01:02:26 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 5 01:02:26 kjcf05n02 systemd-udevd[1623]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:02:26 kjcf05n02 systemd-udevd[1606]: Using default interface naming scheme 'rhel-8.0'. Nov 5 01:02:26 kjcf05n02 systemd-udevd[1606]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:02:26 kjcf05n02 systemd-udevd[1592]: Using default interface naming scheme 'rhel-8.0'. Nov 5 01:02:26 kjcf05n02 systemd-udevd[1592]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:02:26 kjcf05n02 systemd-udevd[1570]: Using default interface naming scheme 'rhel-8.0'. Nov 5 01:02:26 kjcf05n02 systemd-udevd[1570]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 5 01:02:26 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 5 01:02:26 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 5 01:02:26 kjcf05n02 systemd-tmpfiles[1763]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 01:02:26 kjcf05n02 systemd-tmpfiles[1763]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 01:02:26 kjcf05n02 systemd-tmpfiles[1763]: "/var/tmp" already exists and is not a directory. Nov 5 01:02:26 kjcf05n02 root[1781]: openibd: running in auto mode Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started RPC Bind. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 5 01:02:26 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 5 01:02:26 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 5 01:02:26 kjcf05n02 systemd-modules-load[1867]: Inserted module 'ib_iser' Nov 5 01:02:26 kjcf05n02 systemd-modules-load[1867]: Inserted module 'ib_isert' Nov 5 01:02:26 kjcf05n02 systemd-modules-load[1867]: Inserted module 'ib_srpt' Nov 5 01:02:26 kjcf05n02 systemd-udevd[1631]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:02:26 kjcf05n02 systemd-udevd[1617]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:02:26 kjcf05n02 systemd-modules-load[1868]: Inserted module 'ib_ipoib' Nov 5 01:02:26 kjcf05n02 systemd-modules-load[1867]: Inserted module 'rdma_ucm' Nov 5 01:02:26 kjcf05n02 systemd-modules-load[1867]: Module 'svcrdma' is blacklisted Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 5 01:02:26 kjcf05n02 systemd-udevd[1617]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 5 01:02:26 kjcf05n02 systemd-udevd[1631]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 5 01:02:26 kjcf05n02 systemd-modules-load[1868]: Inserted module 'ib_umad' Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 5 01:02:26 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 5 01:02:26 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 5 01:02:26 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 5 01:02:26 kjcf05n02 systemd[3135]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:26 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 5 01:02:26 kjcf05n02 openibd[1764]: Loading HCA driver and Access Layer:[ OK ] Nov 5 01:02:26 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Update is Completed. Nov 5 01:02:26 kjcf05n02 setup-icl[1747]: Setting LAN IP Address to 203.0.113.3 Nov 5 01:02:26 kjcf05n02 setup-icl[1747]: Setting LAN Subnet Mask to 255.255.255.0 Nov 5 01:02:26 kjcf05n02 setup-icl[1747]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 5 01:02:26 kjcf05n02 setup-icl[1747]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 5 01:02:26 kjcf05n02 systemd-udevd[1631]: Using default interface naming scheme 'rhel-8.0'. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 5 01:02:26 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 5 01:02:26 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 5 01:02:26 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 5 01:02:26 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 5 01:02:26 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 5 01:02:26 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 5 01:02:26 kjcf05n02 systemd[1]: Reached target Sockets. Nov 5 01:02:26 kjcf05n02 systemd[1]: Reached target Basic System. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 5 01:02:26 kjcf05n02 chronyd[2072]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 5 01:02:26 kjcf05n02 beSetMlxConfig[2070]: ConnectX-3 multiport not detected Nov 5 01:02:26 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 5 01:02:26 kjcf05n02 mdraid-phy[2078]: no Cutlass to worry about Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 5 01:02:26 kjcf05n02 dwd[2084]: dwd: vMay 29 2024 : 15:38:26 Nov 5 01:02:26 kjcf05n02 dwd[2084]: /usr/sbin/dwd -d --standalone=0 Nov 5 01:02:26 kjcf05n02 dwd[2084]: dwd: option Lethal: 0 Nov 5 01:02:26 kjcf05n02 dwd[2084]: dwd: option Interval: 60 Nov 5 01:02:26 kjcf05n02 dwd[2084]: dwd: option abrtlimit: 10 Nov 5 01:02:26 kjcf05n02 dwd[2084]: dwd: option DZPeriod: 604800 Nov 5 01:02:26 kjcf05n02 dwd[2084]: dwd: option SmartPeriod: 43200 Nov 5 01:02:26 kjcf05n02 dwd[2084]: dwd: option SDDEnabled: 1 Nov 5 01:02:26 kjcf05n02 dwd[2084]: dwd: option SDDAwaitScale: 3 Nov 5 01:02:26 kjcf05n02 dwd[2084]: dwd: option SDDAwaitMin: 100 Nov 5 01:02:26 kjcf05n02 dwd[2084]: dwd: option Verbosity: 1 Nov 5 01:02:26 kjcf05n02 dwd[2084]: dwd: option StandAlone: 0 Nov 5 01:02:26 kjcf05n02 dwd[2084]: option Lethal: 0 Nov 5 01:02:26 kjcf05n02 dwd[2084]: option Interval: 60 Nov 5 01:02:26 kjcf05n02 dwd[2084]: option abrtlimit: 10 Nov 5 01:02:26 kjcf05n02 dwd[2084]: option DZPeriod: 604800 Nov 5 01:02:26 kjcf05n02 dwd[2084]: option SmartPeriod: 43200 Nov 5 01:02:26 kjcf05n02 dwd[2084]: option SDDEnabled: 1 Nov 5 01:02:26 kjcf05n02 dwd[2084]: option SDDAwaitScale: 3 Nov 5 01:02:26 kjcf05n02 dwd[2084]: option SDDAwaitMin: 100 Nov 5 01:02:26 kjcf05n02 dwd[2084]: option Verbosity: 1 Nov 5 01:02:26 kjcf05n02 dwd[2084]: option StandAlone: 0 Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 5 01:02:26 kjcf05n02 mcelog[2104]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 5 01:02:26 kjcf05n02 mcelog[2104]: CPU is unsupported Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[2100]: Setting up Mellanox network interface: ib1 Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 01:02:26 kjcf05n02 chronyd[2072]: Wrong owner of /var/run/chrony (UID != 991) Nov 5 01:02:26 kjcf05n02 chronyd[2072]: Disabled command socket /var/run/chrony/chronyd.sock Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 0 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 1 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 2 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 3 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 4 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 5 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 6 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 7 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 8 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 9 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 10 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 11 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 12 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 13 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 14 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 15 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 16 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 17 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 18 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 19 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 20 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 21 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 22 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 23 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 24 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 25 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 26 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 27 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 28 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 29 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 30 Nov 5 01:02:26 kjcf05n02 cpupower[2156]: Setting cpu: 31 Nov 5 01:02:26 kjcf05n02 network[2129]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 5 01:02:26 kjcf05n02 beSetMlxConfig[2070]: Starting MST (Mellanox Software Tools) driver set Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 5 01:02:26 kjcf05n02 nscd[2181]: 2181 monitoring file `/etc/hosts` (1) Nov 5 01:02:26 kjcf05n02 nscd[2181]: 2181 monitoring directory `/etc` (2) Nov 5 01:02:26 kjcf05n02 nscd[2181]: 2181 monitoring file `/etc/resolv.conf` (3) Nov 5 01:02:26 kjcf05n02 nscd[2181]: 2181 monitoring directory `/etc` (2) Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 5 01:02:26 kjcf05n02 dbus-daemon[2106]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 5 01:02:26 kjcf05n02 network[2162]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 5 01:02:26 kjcf05n02 network[2129]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 5 01:02:26 kjcf05n02 beSetMlxConfig[2070]: Loading MST PCI module - Success Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[2195]: set_ipoib_cm: ib1 connection mode set to connected Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 5 01:02:26 kjcf05n02 network[2197]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:02:26 kjcf05n02 network[2129]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[2212]: Setting up Mellanox network interface: ib0 Nov 5 01:02:26 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 5 01:02:26 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 5 01:02:26 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 5 01:02:26 kjcf05n02 network[2224]: It is advised to switch to 'NetworkManager' instead for network management. Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[2227]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 5 01:02:26 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 5 01:02:26 kjcf05n02 beSetMlxConfig[2070]: Loading MST PCI configuration module - Success Nov 5 01:02:26 kjcf05n02 beSetMlxConfig[2070]: Create devices Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 0 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 1 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 2 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 3 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 4 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 5 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 6 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 7 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 8 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 9 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 10 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 11 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 12 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 13 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 14 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 15 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 16 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 17 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 18 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 19 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 20 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 21 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 22 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 23 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 24 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 25 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 26 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 27 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 28 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 29 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 30 Nov 5 01:02:26 kjcf05n02 cpupower[2268]: Idlestate 2 disabled on CPU 31 Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[2259]: No configuration found for ib1 Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[2262]: set_ipoib_cm: ib0 connection mode set to connected Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[2289]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[2297]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[2324]: No configuration found for ib0 Nov 5 01:02:26 kjcf05n02 mlnx_conf_mgr[2340]: INFO: No configurations found for mlx5_1, skipping. Nov 5 01:02:26 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 5 01:02:26 kjcf05n02 sssd[sssd][2163]: Starting up Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[2359]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 5 01:02:26 kjcf05n02 mlnx_conf_mgr[2413]: INFO: No configurations found for mlx5_0, skipping. Nov 5 01:02:26 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 5 01:02:26 kjcf05n02 sssd[be[implicit_files]][2391]: Starting up Nov 5 01:02:26 kjcf05n02 sssd[nss][2518]: Starting up Nov 5 01:02:26 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 5 01:02:26 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Login Service... Nov 5 01:02:26 kjcf05n02 systemd-logind[2654]: New seat seat0. Nov 5 01:02:26 kjcf05n02 systemd-logind[2654]: Watching system buttons on /dev/input/event0 (Power Button) Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Login Service. Nov 5 01:02:26 kjcf05n02 python3.9[2126]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 5 01:02:26 kjcf05n02 python3.9[3135]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 01:02:26 kjcf05n02 systemd-sysctl[2798]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 5 01:02:26 kjcf05n02 systemd-sysctl[2798]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 5 01:02:26 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 01:02:26 kjcf05n02 network[2129]: Bringing up loopback interface: [ OK ] Nov 5 01:02:26 kjcf05n02 python3.9[3039]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 5 01:02:26 kjcf05n02 python3.9[3135]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 01:02:26 kjcf05n02 systemd-sysctl[3126]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 5 01:02:26 kjcf05n02 systemd-sysctl[3126]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 5 01:02:26 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 5 01:02:26 kjcf05n02 systemd[1]: Reached target Network. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 5 01:02:26 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 5 01:02:26 kjcf05n02 sm-notify[3134]: Version 2.3.3 starting Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 5 01:02:26 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 01:02:26 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 5 01:02:26 kjcf05n02 beSetMlxConfig[2070]: Unloading MST PCI module (unused) - Success Nov 5 01:02:26 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 5 01:02:26 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 5 01:02:26 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 5 01:02:26 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 5 01:02:26 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 5 01:02:26 kjcf05n02 lldpad[3138]: setsockopt nearest_bridge: Invalid argument Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 5 01:02:26 kjcf05n02 python3.9[3157]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 5 01:02:26 kjcf05n02 python3.9[3135]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 5 01:02:26 kjcf05n02 lldpad[3138]: setsockopt nearest_bridge: Invalid argument Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 5 01:02:26 kjcf05n02 sshd[3260]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 5 01:02:26 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 5 01:02:26 kjcf05n02 syslog-ng[3135]: [2024-11-05T07:01:13.667160] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 5 01:02:26 kjcf05n02 syslog-ng[3135]: [2024-11-05T07:01:13.667435] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 5 01:02:26 kjcf05n02 syslog-ng[3135]: [2024-11-05T07:01:13.667471] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 5 01:02:26 kjcf05n02 syslog-ng[3135]: [2024-11-05T07:01:13.668010] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 5 01:02:26 kjcf05n02 syslog-ng[3135]: [2024-11-05T07:01:13.668189] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 5 01:02:26 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 5 01:02:26 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 01:02:26 kjcf05n02 python3.9[3393]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 5 01:02:26 kjcf05n02 python3.9[3135]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 5 01:02:26 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 01:02:26 kjcf05n02 python3.9[3397]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 5 01:02:26 kjcf05n02 python3.9[3135]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 5 01:02:26 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 5 01:02:26 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 01:02:26 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 5 01:02:26 kjcf05n02 chronyd[2072]: System's initial offset : 0.003569 seconds fast of true (slew) Nov 5 01:02:26 kjcf05n02 systemd[1]: Started NTP client/server. Nov 5 01:02:26 kjcf05n02 beSetMlxConfig[2070]: Configuring /dev/mst/mt4123_pciconf1 Nov 5 01:02:26 kjcf05n02 beSetMlxConfig[2070]: ib mode Nov 5 01:02:26 kjcf05n02 root[3418]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 5 01:02:26 kjcf05n02 root[3420]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 5 01:02:26 kjcf05n02 beSetMlxConfig[2070]: Configuring /dev/mst/mt4123_pciconf0 Nov 5 01:02:26 kjcf05n02 beSetMlxConfig[2070]: ib mode Nov 5 01:02:26 kjcf05n02 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 01:02:26 kjcf05n02 systemd-udevd[3436]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:02:26 kjcf05n02 systemd-udevd[3437]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:02:26 kjcf05n02 systemd-udevd[3440]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:02:26 kjcf05n02 systemd-udevd[3443]: Using default interface naming scheme 'rhel-8.0'. Nov 5 01:02:26 kjcf05n02 systemd-udevd[3443]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:02:26 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 5 01:02:26 kjcf05n02 systemd[3135]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:26 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[3479]: Setting up Mellanox network interface: ib1 Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[3478]: Setting up Mellanox network interface: ib0 Nov 5 01:02:26 kjcf05n02 systemd-udevd[3439]: Using default interface naming scheme 'rhel-8.0'. Nov 5 01:02:26 kjcf05n02 systemd-udevd[3438]: Using default interface naming scheme 'rhel-8.0'. Nov 5 01:02:26 kjcf05n02 systemd-udevd[3439]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:02:26 kjcf05n02 systemd-udevd[3438]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[3528]: set_ipoib_cm: ib1 connection mode set to connected Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[3529]: set_ipoib_cm: ib0 connection mode set to connected Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[3559]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[3560]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[3561]: No configuration found for ib1 Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[3562]: No configuration found for ib0 Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[3568]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[3570]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 5 01:02:26 kjcf05n02 mlnx_conf_mgr[3609]: INFO: No configurations found for mlx5_1, skipping. Nov 5 01:02:26 kjcf05n02 mlnx_conf_mgr[3610]: INFO: No configurations found for mlx5_0, skipping. Nov 5 01:02:26 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 5 01:02:26 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 5 01:02:26 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 5 01:02:26 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 5 01:02:26 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 5 01:02:26 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 5 01:02:26 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 5 01:02:26 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 5 01:02:26 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 5 01:02:26 kjcf05n02 lldpad[3138]: init_ports: Error adding device ib0 Nov 5 01:02:26 kjcf05n02 lldpad[3138]: init_ports: Error adding device ib1 Nov 5 01:02:26 kjcf05n02 lldpad[3138]: Signal 15 received - terminating Nov 5 01:02:26 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 5 01:02:26 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 5 01:02:26 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 5 01:02:26 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 5 01:02:26 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 5 01:02:26 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 5 01:02:26 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 5 01:02:26 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:26 kjcf05n02 systemd[3135]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:26 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 1 | Nov-05-2024 | 05:31:35 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 2 | Nov-05-2024 | 05:32:26 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 3 | Nov-05-2024 | 05:32:27 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 4 | Nov-05-2024 | 05:33:33 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 5 | Nov-05-2024 | 05:33:33 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 6 | Nov-05-2024 | 06:58:33 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 7 | Nov-05-2024 | 06:58:33 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 8 | Nov-05-2024 | 06:58:33 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 9 | Nov-05-2024 | 06:58:33 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 10 | Nov-05-2024 | 06:58:33 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 11 | Nov-05-2024 | 06:58:33 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 12 | Nov-05-2024 | 06:58:33 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 13 | Nov-05-2024 | 06:58:33 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 14 | Nov-05-2024 | 06:58:33 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 15 | Nov-05-2024 | 06:58:33 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 16 | Nov-05-2024 | 06:58:33 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 17 | Nov-05-2024 | 06:58:33 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 18 | Nov-05-2024 | 06:58:33 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 19 | Nov-05-2024 | 06:58:33 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 20 | Nov-05-2024 | 06:58:33 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 21 | Nov-05-2024 | 06:58:33 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 22 | Nov-05-2024 | 06:58:33 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 23 | Nov-05-2024 | 06:58:33 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 24 | Nov-05-2024 | 06:58:33 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 25 | Nov-05-2024 | 06:58:33 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 26 | Nov-05-2024 | 06:58:33 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 27 | Nov-05-2024 | 06:58:33 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 28 | Nov-05-2024 | 06:58:34 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 29 | Nov-05-2024 | 06:58:34 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 30 | Nov-05-2024 | 06:58:34 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 31 | Nov-05-2024 | 06:58:34 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 32 | Nov-05-2024 | 06:58:34 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 33 | Nov-05-2024 | 06:58:34 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 34 | Nov-05-2024 | 06:58:34 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 35 | Nov-05-2024 | 06:58:34 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 36 | Nov-05-2024 | 06:58:34 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 37 | Nov-05-2024 | 06:58:34 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 38 | Nov-05-2024 | 06:59:04 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 39 | Nov-05-2024 | 06:59:04 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 40 | Nov-05-2024 | 06:59:04 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 41 | Nov-05-2024 | 06:59:04 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 42 | Nov-05-2024 | 06:59:04 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 43 | Nov-05-2024 | 06:59:04 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 44 | Nov-05-2024 | 06:59:04 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 45 | Nov-05-2024 | 06:59:04 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 46 | Nov-05-2024 | 06:59:04 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 47 | Nov-05-2024 | 06:59:04 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 48 | Nov-05-2024 | 06:59:04 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 49 | Nov-05-2024 | 06:59:04 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 50 | Nov-05-2024 | 06:59:04 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 51 | Nov-05-2024 | 06:59:04 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 52 | Nov-05-2024 | 06:59:04 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 53 | Nov-05-2024 | 06:59:04 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 54 | Nov-05-2024 | 06:59:04 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 55 | Nov-05-2024 | 06:59:04 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 56 | Nov-05-2024 | 06:59:04 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 57 | Nov-05-2024 | 06:59:04 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 58 | Nov-05-2024 | 06:59:04 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 59 | Nov-05-2024 | 06:59:04 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 60 | Nov-05-2024 | 06:59:05 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 61 | Nov-05-2024 | 06:59:06 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 62 | Nov-05-2024 | 06:59:06 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 63 | Nov-05-2024 | 06:59:06 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 64 | Nov-05-2024 | 06:59:06 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 65 | Nov-05-2024 | 06:59:06 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 66 | Nov-05-2024 | 06:59:06 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 67 | Nov-05-2024 | 06:59:06 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 68 | Nov-05-2024 | 06:59:06 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3951]: 69 | Nov-05-2024 | 06:59:06 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:02:26 kjcf05n02 ipmievd[3954]: Reading sensors... Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 5 01:02:26 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:26 kjcf05n02 systemd[3135]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 5 01:02:26 kjcf05n02 nscd[2181]: 2181 monitored file `/etc/hosts` was moved into place, adding watch Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 5 01:02:26 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 5 01:02:26 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 5 01:02:26 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 5 01:02:26 kjcf05n02 beSetMlxConfig[4012]: ConnectX-3 multiport not detected Nov 5 01:02:26 kjcf05n02 beSetMlxConfig[4012]: Starting MST (Mellanox Software Tools) driver set Nov 5 01:02:26 kjcf05n02 beSetMlxConfig[4012]: Loading MST PCI module - Success Nov 5 01:02:26 kjcf05n02 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 01:02:26 kjcf05n02 beSetMlxConfig[4012]: [warn] mst_pciconf is already loaded, skipping Nov 5 01:02:26 kjcf05n02 beSetMlxConfig[4012]: Create devices Nov 5 01:02:26 kjcf05n02 beSetMlxConfig[4012]: Unloading MST PCI module (unused) - Success Nov 5 01:02:26 kjcf05n02 ipmievd[3954]: Waiting for events... Nov 5 01:02:26 kjcf05n02 beSetMlxConfig[4012]: Configuring /dev/mst/mt4123_pciconf1 Nov 5 01:02:26 kjcf05n02 beSetMlxConfig[4012]: ib mode Nov 5 01:02:26 kjcf05n02 beSetMlxConfig[4012]: Configuring /dev/mst/mt4123_pciconf0 Nov 5 01:02:26 kjcf05n02 beSetMlxConfig[4012]: ib mode Nov 5 01:02:26 kjcf05n02 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 01:02:26 kjcf05n02 systemd-udevd[4911]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:02:26 kjcf05n02 systemd-udevd[4912]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:02:26 kjcf05n02 systemd-udevd[4915]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:02:26 kjcf05n02 systemd-udevd[4918]: Using default interface naming scheme 'rhel-8.0'. Nov 5 01:02:26 kjcf05n02 systemd-udevd[4918]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:02:26 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 5 01:02:26 kjcf05n02 systemd[3135]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:26 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[4953]: Setting up Mellanox network interface: ib0 Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[4954]: Setting up Mellanox network interface: ib1 Nov 5 01:02:26 kjcf05n02 systemd-udevd[4913]: Using default interface naming scheme 'rhel-8.0'. Nov 5 01:02:26 kjcf05n02 systemd-udevd[4913]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[5003]: set_ipoib_cm: ib0 connection mode set to connected Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[5004]: set_ipoib_cm: ib1 connection mode set to connected Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[5020]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[5019]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[5021]: No configuration found for ib0 Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[5022]: No configuration found for ib1 Nov 5 01:02:26 kjcf05n02 systemd-udevd[4914]: Using default interface naming scheme 'rhel-8.0'. Nov 5 01:02:26 kjcf05n02 systemd-udevd[4914]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[5029]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 5 01:02:26 kjcf05n02 mlnx_interface_mgr[5030]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 5 01:02:26 kjcf05n02 mlnx_conf_mgr[5084]: INFO: No configurations found for mlx5_1, skipping. Nov 5 01:02:26 kjcf05n02 mlnx_conf_mgr[5085]: INFO: No configurations found for mlx5_0, skipping. Nov 5 01:02:26 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 5 01:02:26 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}44caeb2944bc33f7ad658c0c992b5a6f41034187892742881eb5453c9ccf9352' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}44caeb2944bc33f7ad658c0c992b5a6f41034187892742881eb5453c9ccf9352' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}6db2d174cbed5b571c1da92d4cd1c9b431d3acd6b949ecd86f66ce5ba33397d0' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}6db2d174cbed5b571c1da92d4cd1c9b431d3acd6b949ecd86f66ce5ba33397d0' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}e8ede2af1d3c8cfbee1e57d1396f4a0e2a70fa86de4bafa20ea92923927d7410' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}e8ede2af1d3c8cfbee1e57d1396f4a0e2a70fa86de4bafa20ea92923927d7410' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}7291cd3bfa752e03ecfd252039f19c6c6b8855c54192ed86dd36b82b9fdee84e' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}7291cd3bfa752e03ecfd252039f19c6c6b8855c54192ed86dd36b82b9fdee84e' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 5 01:02:26 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 5 01:02:26 kjcf05n02 chronyd[2072]: chronyd exiting Nov 5 01:02:26 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 5 01:02:26 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 5 01:02:26 kjcf05n02 chronyd[5119]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 5 01:02:26 kjcf05n02 chronyd[5119]: Wrong owner of /var/run/chrony (UID != 991) Nov 5 01:02:26 kjcf05n02 chronyd[5119]: Disabled command socket /var/run/chrony/chronyd.sock Nov 5 01:02:26 kjcf05n02 chronyd[5119]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 5 01:02:26 kjcf05n02 systemd[1]: Started NTP client/server. Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 5 01:02:26 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:26 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 5 01:02:26 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 5 01:02:26 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 5 01:02:26 kjcf05n02 dwd[5151]: dwd: vMay 29 2024 : 15:38:26 Nov 5 01:02:26 kjcf05n02 dwd[5151]: /usr/sbin/dwd -i 15 -d Nov 5 01:02:26 kjcf05n02 dwd[5151]: dwd: option Lethal: 0 Nov 5 01:02:26 kjcf05n02 dwd[5151]: dwd: option Interval: 15 Nov 5 01:02:26 kjcf05n02 dwd[5151]: dwd: option abrtlimit: 10 Nov 5 01:02:26 kjcf05n02 dwd[5151]: dwd: option DZPeriod: 604800 Nov 5 01:02:26 kjcf05n02 dwd[5151]: dwd: option SmartPeriod: 43200 Nov 5 01:02:26 kjcf05n02 dwd[5151]: dwd: option SDDEnabled: 1 Nov 5 01:02:26 kjcf05n02 dwd[5151]: dwd: option SDDAwaitScale: 3 Nov 5 01:02:26 kjcf05n02 dwd[5151]: dwd: option SDDAwaitMin: 100 Nov 5 01:02:26 kjcf05n02 dwd[5151]: dwd: option Verbosity: 1 Nov 5 01:02:26 kjcf05n02 dwd[5151]: dwd: option StandAlone: 0 Nov 5 01:02:26 kjcf05n02 dwd[5151]: option Lethal: 0 Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 5 01:02:26 kjcf05n02 dwd[5151]: option Interval: 15 Nov 5 01:02:26 kjcf05n02 dwd[5151]: option abrtlimit: 10 Nov 5 01:02:26 kjcf05n02 dwd[5151]: option DZPeriod: 604800 Nov 5 01:02:26 kjcf05n02 dwd[5151]: option SmartPeriod: 43200 Nov 5 01:02:26 kjcf05n02 dwd[5151]: option SDDEnabled: 1 Nov 5 01:02:26 kjcf05n02 dwd[5151]: option SDDAwaitScale: 3 Nov 5 01:02:26 kjcf05n02 dwd[5151]: option SDDAwaitMin: 100 Nov 5 01:02:26 kjcf05n02 dwd[5151]: option Verbosity: 1 Nov 5 01:02:26 kjcf05n02 dwd[5151]: option StandAlone: 0 Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 5 01:02:26 kjcf05n02 dwd[5152]: option Lethal now set to 1 Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 5 01:02:26 kjcf05n02 dwd[5152]: option abrtlimit now set to 1 Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 5 01:02:26 kjcf05n02 dwd[5152]: option SmartPeriod now set to 86400 Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 5 01:02:26 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 5 01:02:26 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:26 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 5 01:02:26 kjcf05n02 python3.9[5181]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 5 01:02:26 kjcf05n02 python3.9[3135]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:26 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:26 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 5 01:02:26 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:26 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 5 01:02:26 kjcf05n02 sedcpwrkr[5320]: Using config script: /etc/sedcpwrkr.conf Nov 5 01:02:26 kjcf05n02 sedcpwrkr[5320]: - Creating default directory: '/var/log/sedcpwrkr' Nov 5 01:02:26 kjcf05n02 sedcpwrkr[5320]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 5 01:02:26 kjcf05n02 sedcpwrkr[5320]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 5 01:02:26 kjcf05n02 sedcpwrkr[5320]: - Creating default directory: '/var/run/sedcpwrkr' Nov 5 01:02:26 kjcf05n02 sedcpwrkr[5320]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 5 01:02:26 kjcf05n02 sedcpwrkr[5320]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 5 01:02:26 kjcf05n02 sedcpwrkr-server[5351]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 5 01:02:26 kjcf05n02 sedcpwrkr[5320]: celery multi v5.2.7 (dawn-chorus) Nov 5 01:02:26 kjcf05n02 sedcpwrkr[5320]: > Starting nodes... Nov 5 01:02:26 kjcf05n02 sedcpwrkr[5320]: > sedcpwrkr@kjcf05n02: OK Nov 5 01:02:26 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 5 01:02:26 kjcf05n02 sedcpwrkr-server[5353]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 5 01:02:26 kjcf05n02 sedcpwrkr-server[5353]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 5 01:02:26 kjcf05n02 sedcpwrkr-server[5353]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 5 01:02:26 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 5 01:02:26 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 5 01:02:26 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 5 01:02:26 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 5 01:02:26 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 5 01:02:26 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:27 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 5 01:02:27 kjcf05n02 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 01:02:27 kjcf05n02 iptables.init[5420]: iptables: Applying firewall rules: [ OK ] Nov 5 01:02:27 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 5 01:02:27 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:27 kjcf05n03 dwd[5226]: nvme25n1 passed periodic SMART status check Nov 5 01:02:27 kjcf05n02 systemd[3135]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:27 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:27 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:27 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 5 01:02:27 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 5 01:02:27 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 5 01:02:27 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 5 01:02:27 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 5 01:02:27 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 5 01:02:27 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 5 01:02:27 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 5 01:02:27 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 5 01:02:27 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 5 01:02:28 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 5 01:02:28 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 5 01:02:28 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 01:02:28 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 5 01:02:28 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 5 01:02:28 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 5 01:02:28 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 5 01:02:28 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 5 01:02:28 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 5 01:02:28 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 5 01:02:28 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 5 01:02:28 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 5 01:02:28 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 5 01:02:28 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 5 01:02:28 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 5 01:02:28 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 5 01:02:28 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 5 01:02:28 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 5 01:02:28 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 5 01:02:28 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 5 01:02:28 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 5 01:02:28 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 5 01:02:28 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 5 01:02:28 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 5 01:02:28 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 5 01:02:28 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 5 01:02:28 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 5 01:02:28 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 5 01:02:28 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 5 01:02:28 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 5 01:02:28 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 5 01:02:28 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 5 01:02:28 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 5 01:02:28 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 5 01:02:28 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 5 01:02:28 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 5 01:02:28 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 5 01:02:28 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 5 01:02:28 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 5 01:02:28 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 5 01:02:28 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:28 kjcf05n03 dwd[5226]: nvme18n1 passed periodic SMART status check Nov 5 01:02:28 kjcf05n03 dwd[5226]: nvme8n1 passed periodic SMART status check Nov 5 01:02:28 kjcf05n03 dwd[5226]: nvme4n1 passed periodic SMART status check Nov 5 01:02:28 kjcf05n03 dwd[5226]: nvme9n1 passed periodic SMART status check Nov 5 01:02:28 kjcf05n03 dwd[5226]: nvme23n1 passed periodic SMART status check Nov 5 01:02:28 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 5 01:02:28 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5517 which is not our child. We'll most likely not notice when it exits. Nov 5 01:02:28 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 5 01:02:28 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:28 kjcf05n02 openhpid[5517]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 5 01:02:28 kjcf05n02 openhpid[5517]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 5 01:02:28 kjcf05n02 openhpid[5517]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 5 01:02:28 kjcf05n02 openhpid[5517]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 5 01:02:28 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:29 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:29 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:29 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 5 01:02:29 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 5 01:02:29 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 5 01:02:29 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 5 01:02:29 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:29 kjcf05n03 dwd[5226]: nvme19n1 passed periodic SMART status check Nov 5 01:02:29 kjcf05n03 dwd[5226]: nvme24n1 passed periodic SMART status check Nov 5 01:02:29 kjcf05n03 dwd[5226]: nvme17n1 passed periodic SMART status check Nov 5 01:02:29 kjcf05n03 dwd[5226]: nvme3n1 passed periodic SMART status check Nov 5 01:02:29 kjcf05n03 dwd[5226]: nvme2n1 passed periodic SMART status check Nov 5 01:02:29 kjcf05n00 mcfcli[3673891]: %3|1730790149.151|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:02:29 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 5 01:02:29 kjcf05n02 dcs-collectord[5608]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 5 01:02:29 kjcf05n02 hpi.inv.log[5608]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 5 01:02:30 kjcf05n02 dcs-collectord[5608]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 5 01:02:30 kjcf05n02 dcs-collectord[5608]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 5 01:02:30 kjcf05n02 dcs-collector[5599]: Starting dcs-collector:[ OK ] Nov 5 01:02:30 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 5 01:02:30 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 5 01:02:30 kjcf05n02 dcs-collectord[5611]: INFO Starting collection for memory_info (collection_process.py:52) Nov 5 01:02:30 kjcf05n02 dcs-collectord[5611]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 5 01:02:30 kjcf05n02 dcs-collectord[5611]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 01:02:30 kjcf05n02 dcs-collectord[5611]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 5 01:02:30 kjcf05n02 dcs-collectord[5611]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 5 01:02:30 kjcf05n02 dcs-collectord[5611]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 5 01:02:30 kjcf05n02 dcs-collectord[5611]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 5 01:02:30 kjcf05n02 dcs-collectord[5611]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452756", "units": "kB"}, {"name": "MemFree", "value": "259346064", "units": "kB"}, {"name": "MemAvailable", "value": "258625828", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1821272", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686848", "units": "kB"}, {"name": "Inactive", "value": "962120", "units": "kB"}, {"name": "Active(anon)", "value": "1520812", "units": "kB"}, {"name": "Inactive(anon)", "value": "826236", "units": "kB"}, {"name": "Active(file)", "value": "166036", "units": "kB"}, {"name": "Inactive(file)", "value": "135884", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "752968", "units": "kB"}, {"name": "Mapped", "value": "86080", "units": "kB"}, {"name": "Shmem", "value": "1593296", "units": "kB"}, {"name": "KReclaimable", "value": "109428", "units": "kB"}, {"name": "Slab", "value": "275120", "units": "kB"}, {"name": "SReclaimable", "value": "109428", "units": "kB"}, {"name": "SUnreclaim", "value": "165692", "units": "kB"}, {"name": "KernelStack", "value": "9728", "units": "kB"}, {"name": "PageTables", "value": "20068", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726376", "units": "kB"}, {"name": "Committed_AS", "value": "3267812", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11136", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "8192", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "313672", "units": "kB"}, {"name": "DirectMap2M", "value": "18425856", "units": "kB"}, {"name": "DirectMap1G", "value": "249561088", "units": "kB"}]}' Nov 5 01:02:30 kjcf05n02 dcs-collectord[5611]: INFO Completed collection for memory_info (collection_process.py:59) Nov 5 01:02:30 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:30 kjcf05n02 dcs-collectord[5611]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 5 01:02:30 kjcf05n02 dcs-collectord[5611]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730790149.7885783], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730790150.0220728], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730790149.7201524, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 5 01:02:30 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:30 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 5 01:02:30 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:30 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:30 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 5 01:02:30 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 5 01:02:30 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 5 01:02:30 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 5 01:02:30 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:30 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 5 01:02:31 kjcf05n02 firmware-update-orc[5717]: Using config script: /etc/firmware_update_orc.conf Nov 5 01:02:31 kjcf05n02 firmware-update-orc[5717]: - Creating default directory: '/var/log/firmware-update-orc' Nov 5 01:02:31 kjcf05n02 firmware-update-orc[5717]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 5 01:02:31 kjcf05n02 firmware-update-orc[5717]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 5 01:02:31 kjcf05n02 firmware-update-orc[5717]: - Creating default directory: '/var/run/firmware-update-orc' Nov 5 01:02:31 kjcf05n02 firmware-update-orc[5717]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 5 01:02:31 kjcf05n02 firmware-update-orc[5717]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 5 01:02:31 kjcf05n02 firmware-update-orc-server[5755]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 5 01:02:31 kjcf05n02 firmware-update-orc[5717]: celery multi v5.2.7 (dawn-chorus) Nov 5 01:02:31 kjcf05n02 firmware-update-orc[5717]: > Starting nodes... Nov 5 01:02:31 kjcf05n02 firmware-update-orc[5717]: > worker1@kjcf05n02: OK Nov 5 01:02:31 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 5 01:02:31 kjcf05n02 firmware-update-orc-server[5757]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 5 01:02:31 kjcf05n02 firmware-update-orc-server[5757]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 5 01:02:31 kjcf05n02 firmware-update-orc-server[5757]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 5 01:02:31 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 5 01:02:31 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:32 kjcf05n02 systemd[3135]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:32 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:32 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:32 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 5 01:02:32 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 5 01:02:32 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 5 01:02:32 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 5 01:02:32 kjcf05n02 dbus-daemon[2106]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 5 01:02:32 kjcf05n02 dbus-daemon[2106]: [system] Reloaded configuration Nov 5 01:02:32 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 5 01:02:32 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 5 01:02:32 kjcf05n02 dbus-daemon[2106]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 5 01:02:32 kjcf05n02 dbus-daemon[2106]: [system] Reloaded configuration Nov 5 01:02:32 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 5 01:02:32 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 5 01:02:32 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 5 01:02:32 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 5 01:02:32 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:32 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 5 01:02:33 kjcf05n02 ras-resource-manager-agent[5873]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 5 01:02:33 kjcf05n02 ras-resource-manager-agent[5859]: Starting ras-resource-manager-agent:[ OK ] Nov 5 01:02:33 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 5 01:02:33 kjcf05n02 ras-resource-manager-agent[5875]: INFO Starting the service handler (service_main_handler.py:98) Nov 5 01:02:33 kjcf05n02 ras-resource-manager-client[5875]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 5 01:02:33 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 5 01:02:33 kjcf05n02 ras-resource-manager-client[5875]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 5 01:02:33 kjcf05n02 ras-resource-manager-client[5885]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 5 01:02:33 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:33 kjcf05n02 systemd[3135]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:33 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:33 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:33 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 5 01:02:33 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 5 01:02:33 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:33 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 5 01:02:33 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:34 kjcf05n02 systemd[3135]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: Press Ctrl+C to exit. Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: Plugin support version 1.0 Nov 5 01:02:34 kjcf05n02 zabbix_agent2[5959]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 01:02:34 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:34 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:34 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:33 kjcf05n00 mcfcli[3673891]: %3|1730790153.858|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:02:34 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 5 01:02:34 kjcf05n02 dcs-notification-sender[6040]: dcs-notification-senderd is stopped Nov 5 01:02:34 kjcf05n02 zabbix-agent2[6054]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 5 01:02:34 kjcf05n02 dcs-notification-sender[6040]: Starting notification-sender:[ OK ] Nov 5 01:02:34 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 5 01:02:34 kjcf05n02 zabbix-agent2[6056]: INFO DCS notification agent started. (agent.py:61) Nov 5 01:02:34 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 5 01:02:34 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:35 kjcf05n02 systemd[3135]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:35 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:35 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:35 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:35 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 5 01:02:35 kjcf05n02 dcs-collectord[6157]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 5 01:02:35 kjcf05n02 dcs-collectord[6157]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 5 01:02:35 kjcf05n02 dcs-bulk-data-sender[6157]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 5 01:02:35 kjcf05n02 dcs-bulk-data-sender[6148]: Starting bulk-data-sender:[ OK ] Nov 5 01:02:35 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 5 01:02:35 kjcf05n02 dcs-collectord[6159]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 5 01:02:35 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 5 01:02:35 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:36 kjcf05n02 systemd[3135]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:36 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:36 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:36 kjcf05n02 nscd[2181]: 2181 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 5 01:02:36 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 5 01:02:36 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 5 01:02:36 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 5 01:02:36 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 5 01:02:36 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 5 01:02:36 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 5 01:02:36 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 5 01:02:36 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 5 01:02:36 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 5 01:02:36 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 5 01:02:36 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 5 01:02:36 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 5 01:02:36 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 5 01:02:36 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 5 01:02:36 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 01:02:36 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 5 01:02:37 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 5 01:02:37 kjcf05n02 sssd[nss][2518]: Shutting down (status = 0) Nov 5 01:02:37 kjcf05n02 sssd[be[implicit_files]][2391]: Shutting down (status = 0) Nov 5 01:02:37 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 5 01:02:37 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 5 01:02:37 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 5 01:02:37 kjcf05n02 python3.9[5181]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 5 01:02:37 kjcf05n02 python3.9[3135]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:37 kjcf05n02 sssd[sssd][6241]: Starting up Nov 5 01:02:37 kjcf05n02 sssd[be[implicit_files]][6242]: Starting up Nov 5 01:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 5 01:02:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 5 01:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 5 01:02:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 5 01:02:37 kjcf05n02 sssd[nss][6243]: Starting up Nov 5 01:02:37 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 5 01:02:37 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 5 01:02:37 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 5 01:02:38 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 5 01:02:38 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 5 01:02:38 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 5 01:02:38 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 5 01:02:38 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 5 01:02:38 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 5 01:02:38 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 5 01:02:38 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 5 01:02:38 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 5 01:02:38 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 5 01:02:38 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 5 01:02:38 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 5 01:02:38 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 5 01:02:38 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 5 01:02:38 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:02:38 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:02:38 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:38 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 5 01:02:38 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 5 01:02:39 kjcf05n00 zabbix_server[15695]: item "kjcf05n02:vfs.fs.size[/mnt/persistent_ha_data,pused]" became not supported: no such file or directory Nov 5 01:02:39 kjcf05n02 icinga2[6292]: [2024-11-05 01:02:39 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 5 01:02:39 kjcf05n02 icinga2[6292]: [2024-11-05 01:02:39 -0600] information/cli: Loading configuration file(s). Nov 5 01:02:39 kjcf05n02 icinga2[6292]: [2024-11-05 01:02:39 -0600] information/ConfigItem: Committing config item(s). Nov 5 01:02:39 kjcf05n02 icinga2[6292]: [2024-11-05 01:02:39 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 5 01:02:39 kjcf05n02 icinga2[6292]: [2024-11-05 01:02:39 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 5 01:02:39 kjcf05n02 icinga2[6292]: [2024-11-05 01:02:39 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 5 01:02:39 kjcf05n02 icinga2[6292]: [2024-11-05 01:02:39 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 5 01:02:39 kjcf05n02 icinga2[6292]: [2024-11-05 01:02:39 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 5 01:02:39 kjcf05n02 icinga2[6292]: [2024-11-05 01:02:39 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 5 01:02:39 kjcf05n02 icinga2[6292]: [2024-11-05 01:02:39 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 5 01:02:39 kjcf05n02 icinga2[6292]: [2024-11-05 01:02:39 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 5 01:02:39 kjcf05n02 icinga2[6292]: [2024-11-05 01:02:39 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 5 01:02:39 kjcf05n02 icinga2[6292]: [2024-11-05 01:02:39 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 5 01:02:39 kjcf05n02 icinga2[6292]: [2024-11-05 01:02:39 -0600] information/cli: Closing console log. Nov 5 01:02:39 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 5 01:02:39 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:39 kjcf05n02 systemd[3135]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:39 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:39 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:40 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 5 01:02:40 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 5 01:02:40 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:40 kjcf05n00 zabbix_server[15685]: item "kjcf05n02:vfs.fs.inode[/mnt/persistent_ha_data,pfree]" became not supported: no such file or directory Nov 5 01:02:40 kjcf05n00 zabbix_server[15685]: item "kjcf05n02:vfs.fs.size[/mnt/persistent_ha_data,used]" became not supported: no such file or directory Nov 5 01:02:40 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 5 01:02:40 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:40 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 5 01:02:40 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib0 Nov 5 01:02:40 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib0 Nov 5 01:02:41 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:41 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:40 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 5 01:02:41 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 5 01:02:41 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 5 01:02:41 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 5 01:02:41 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 5 01:02:41 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 5 01:02:41 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 5 01:02:41 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 5 01:02:41 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 5 01:02:41 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 5 01:02:41 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 5 01:02:41 kjcf05n00 zabbix-server[2599559]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 01:02:41 kjcf05n00 zabbix-server[2599559]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:22\\"}}"' Nov 5 01:02:41 kjcf05n00 log_interesting_event.py[2599559]: Event '46910' acknowledged Nov 5 01:02:41 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 5 01:02:41 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 5 01:02:41 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 5 01:02:41 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 5 01:02:41 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:41 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 5 01:02:42 kjcf05n02 nslcd[6906]: version 0.9.9 starting Nov 5 01:02:42 kjcf05n02 nslcd[6906]: accepting connections Nov 5 01:02:42 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 5 01:02:42 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:42 kjcf05n02 systemd[3135]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:42 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:42 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:42 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 5 01:02:42 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 5 01:02:42 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 5 01:02:42 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 5 01:02:42 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 5 01:02:42 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 5 01:02:43 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 5 01:02:43 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 5 01:02:43 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:44 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 5 01:02:44 kjcf05n02 dearcpw[7008]: Using config script: /etc/dearcpw.conf Nov 5 01:02:44 kjcf05n02 dearcpw[7008]: - Creating default directory: '/var/log/dearcpw' Nov 5 01:02:44 kjcf05n02 dearcpw[7008]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 5 01:02:44 kjcf05n02 dearcpw[7008]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 5 01:02:44 kjcf05n02 dearcpw[7008]: - Creating default directory: '/var/run/dearcpw' Nov 5 01:02:44 kjcf05n02 dearcpw[7008]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 5 01:02:44 kjcf05n02 dearcpw[7008]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 5 01:02:44 kjcf05n02 dearcpw-server[7048]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 5 01:02:44 kjcf05n02 dearcpw[7008]: celery multi v5.2.7 (dawn-chorus) Nov 5 01:02:44 kjcf05n02 dearcpw[7008]: > Starting nodes... Nov 5 01:02:44 kjcf05n02 dearcpw[7008]: > dearcpw@kjcf05n02: OK Nov 5 01:02:44 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 5 01:02:44 kjcf05n02 dearcpw-server[7060]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 5 01:02:44 kjcf05n02 dearcpw-server[7060]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 5 01:02:44 kjcf05n02 dearcpw-server[7060]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 5 01:02:44 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 5 01:02:44 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:44 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:44 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 5 01:02:44 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 5 01:02:44 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 5 01:02:44 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 5 01:02:44 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 5 01:02:44 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 5 01:02:44 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 5 01:02:44 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 5 01:02:44 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 5 01:02:44 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 5 01:02:44 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:53638). Nov 5 01:02:44 kjcf05n01 rsyncd[3994280]: connect from kjcf05n02 (172.16.2.5) Nov 5 01:02:44 kjcf05n01 rsyncd[3994280]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 5 01:02:44 kjcf05n01 rsyncd[3994280]: receiving file list Nov 5 01:02:44 kjcf05n01 rsyncd[3994280]: sent 29 bytes received 325 bytes total size 10905 Nov 5 01:02:44 kjcf05n01 systemd[1]: rsyncd@680-172.16.2.2:873-172.16.2.5:53638.service: Succeeded. Nov 5 01:02:44 kjcf05n00 zabbix-server[2599562]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 01:02:44 kjcf05n00 zabbix-server[2599562]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n05:system.cpu.load[all,avg1]): 99.91\\",\\"2\\": \\"Number of CPUs (kjcf05n05:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n05:system.cpu.load[all,avg5]): 188.23\\"}}"' Nov 5 01:02:44 kjcf05n00 log_interesting_event.py[2599562]: Event '46914' acknowledged Nov 5 01:02:45 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib1 Nov 5 01:02:45 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib1 Nov 5 01:02:45 kjcf05n02 puppet[7084]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 5 01:02:45 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 5 01:02:45 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 5 01:02:45 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 5 01:02:45 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 5 01:02:45 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 5 01:02:45 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 5 01:02:45 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 5 01:02:45 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 5 01:02:45 kjcf05n02 dcs-collectord[5611]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 01:02:45 kjcf05n02 dcs-collectord[5611]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 5 01:02:44 kjcf05n00 zabbix-server[2599563]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 01:02:44 kjcf05n00 zabbix-server[2599563]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib1: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib1: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib1/operstate\\"]): down (2)\\"}}"' Nov 5 01:02:44 kjcf05n00 log_interesting_event.py[2599563]: Event '46915' acknowledged Nov 5 01:02:45 kjcf05n02 dcs-bulk-data-sender[6159]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 5 01:02:45 kjcf05n02 dcs-collectord[6159]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 5 01:02:45 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 5 01:02:45 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 5 01:02:45 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 5 01:02:45 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 5 01:02:45 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 5 01:02:45 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 5 01:02:46 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 5 01:02:46 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 5 01:02:46 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 5 01:02:46 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 5 01:02:47 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 5 01:02:47 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 5 01:02:47 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 5 01:02:47 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 5 01:02:47 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 5 01:02:47 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 5 01:02:47 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:47 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 5 01:02:48 kjcf05n02 ipmievd[3954]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 5 01:02:48 kjcf05n02 ipmievd[3954]: System Event sensor - Timestamp Clock Sync Nov 5 01:02:48 kjcf05n02 ipmievd[3135]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:48 kjcf05n02 diskless-swap[7582]: HA_PS_000: recovering journal Nov 5 01:02:48 kjcf05n02 systemd-udevd[1558]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 01:02:48 kjcf05n02 diskless-swap[7582]: HA_PS_000: clean, 2294/6400 files, 7094/25600 blocks Nov 5 01:02:48 kjcf05n02 diskless-swap[7582]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 5 01:02:48 kjcf05n00 zabbix-server[2599578]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 01:02:48 kjcf05n00 zabbix-server[2599578]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Interface ib0: Link down\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"2\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\",\\"3\\": \\"Interface ib0: Operational status (kjcf05n02:vfs.file.contents[\\"/sys/class/net/ib0/operstate\\"]): down (2)\\"}}"' Nov 5 01:02:48 kjcf05n00 log_interesting_event.py[2599578]: Event '46916' acknowledged Nov 5 01:02:48 kjcf05n02 diskless-swap[7582]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 5 01:02:48 kjcf05n02 diskless-swap[7582]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 5 01:02:48 kjcf05n02 diskless-swap[7582]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 5 01:02:48 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 5 01:02:48 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:48 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:48 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 5 01:02:48 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 5 01:02:48 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 5 01:02:48 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 5 01:02:48 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 5 01:02:48 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 5 01:02:48 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 5 01:02:48 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 5 01:02:48 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 5 01:02:48 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 5 01:02:48 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 5 01:02:48 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 5 01:02:48 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 5 01:02:48 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 5 01:02:48 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 5 01:02:48 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 5 01:02:49 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 5 01:02:49 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 5 01:02:49 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 5 01:02:49 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 5 01:02:50 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 5 01:02:50 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 5 01:02:50 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 5 01:02:50 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 5 01:02:51 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 5 01:02:51 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 5 01:02:51 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 5 01:02:51 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 5 01:02:51 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 5 01:02:51 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 5 01:02:51 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 5 01:02:51 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 5 01:02:51 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:52 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 5 01:02:52 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:52 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:52 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 5 01:02:52 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 5 01:02:52 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:52 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 5 01:02:52 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:52 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:52 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 5 01:02:52 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 5 01:02:52 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:53 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 5 01:02:53 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:02:53 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:02:53 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 5 01:02:53 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 5 01:02:53 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 5 01:02:53 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 5 01:02:53 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 5 01:02:53 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 5 01:02:53 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 5 01:02:53 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 5 01:02:53 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 01:02:53 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 01:02:53 kjcf05n02 systemd[1]: Reloading. Nov 5 01:02:53 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 5 01:02:53 kjcf05n02 kdumpctl[7836]: kdump: No kdump initial ramdisk found. Nov 5 01:02:53 kjcf05n02 kdumpctl[7836]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 5 01:02:53 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 5 01:02:53 kjcf05n02 dracut[7948]: dracut-049-135.git20210121.el8 Nov 5 01:02:54 kjcf05n02 dracut[7950]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 5 01:02:54 kjcf05n02 dracut[7950]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 5 01:02:54 kjcf05n02 dracut[7950]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 5 01:02:54 kjcf05n02 dracut[7950]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 5 01:02:54 kjcf05n02 dracut[7950]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 5 01:02:54 kjcf05n02 dracut[7950]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 5 01:02:54 kjcf05n02 dracut[7950]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 5 01:02:54 kjcf05n02 dracut[7950]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + is_func check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check -h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local dev holder Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + require_binaries mdadm expr Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _module_name=90hperaid Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ mdadm = \-\m ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for cmd in "$@" Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + find_binary mdadm Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for cmd in "$@" Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + find_binary expr Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n -h ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for dev in "${!host_fs_types[@]}" Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ nfs != *_raid_member ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + continue Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _ret=255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + ret=255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ 255 = 0 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ 255 = 255 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ module_depends hperaid Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: +++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: +++ set -x Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ depends Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo rootfs-block Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ return 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ _ret=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ return 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for _moddep in $(module_depends $_mod) Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all == *\ hperaid\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + add_dracutmodules+=' rootfs-block ' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ == *\ hperaid\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check_module rootfs-block Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _mod=rootfs-block Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ == *\ rootfs-block\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n '' ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + mods_checked_as_dep+=' rootfs-block ' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all == *\ rootfs-block\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + module_check rootfs-block 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 2 -eq 2 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _forced=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + is_func check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check -h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _ret=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + ret=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ 0 = 0 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ module_depends rootfs-block Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: +++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 5 01:02:54 kjcf05n02 kdumpctl[3135]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ depends Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo fs-lib Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ _ret=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ return 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for _moddep in $(module_depends $_mod) Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all == *\ rootfs-block\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + add_dracutmodules+=' fs-lib ' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ == *\ rootfs-block\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check_module fs-lib Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _mod=fs-lib Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n '' ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + mods_checked_as_dep+=' fs-lib ' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all == *\ fs-lib\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + module_check fs-lib 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 2 -eq 2 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _forced=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + is_func check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check -h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _ret=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + ret=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ 0 = 0 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ module_depends fs-lib Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: +++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ depends Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ return 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ _ret=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ return 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + mods_to_load+=' fs-lib ' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + mods_to_load+=' rootfs-block ' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + mods_to_load+=' hperaid ' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _mod=90kernel-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _mod=kernel-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check_module kernel-modules 1 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _mod=kernel-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all = all ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + module_check kernel-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 1 -eq 2 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + is_func check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check -h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + true Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _ret=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + ret=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ 0 != 0 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ module_depends kernel-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: +++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ depends Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ true Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ _ret=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ return 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + mods_to_load+=' kernel-modules ' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _mod=90kernel-modules-extra Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _mod=kernel-modules-extra Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check_module kernel-modules-extra 1 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _mod=kernel-modules-extra Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all = all ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + module_check kernel-modules-extra Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 1 -eq 2 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + is_func check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check -h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + true Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _ret=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + ret=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ 0 != 0 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ module_depends kernel-modules-extra Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: +++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ depends Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ true Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ _ret=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ return 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + mods_to_load+=' kernel-modules-extra ' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _mod=90kernel-network-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _mod=kernel-network-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check_module kernel-network-modules 1 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _mod=kernel-network-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all = all ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + module_check kernel-network-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 1 -eq 2 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + is_func check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check -h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _ret=255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + ret=255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ 255 != 0 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 1 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _mod=90livenet Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _mod=livenet Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check_module livenet 1 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _mod=livenet Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all = all ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + module_check livenet Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 1 -eq 2 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + is_func check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check -h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _ret=255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + ret=255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ 255 != 0 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 1 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _mod=90lvm Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _mod=lvm Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check_module lvm 1 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _mod=lvm Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all = all ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + module_check lvm Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 1 -eq 2 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + is_func check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check -h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + require_binaries lvm Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _module_name=90lvm Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ lvm = \-\m ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for cmd in "$@" Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + find_binary lvm Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n -h ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for fs in "${host_fs_types[@]}" Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ nfs = LVM*_member ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _ret=255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + ret=255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ 255 != 0 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 1 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _mod=90mdraid Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _mod=mdraid Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check_module mdraid 1 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _mod=mdraid Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all = all ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + module_check mdraid Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 1 -eq 2 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + is_func check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check -h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _rootdev Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + require_binaries mdadm expr Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _module_name=90mdraid Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ mdadm = \-\m ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for cmd in "$@" Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + find_binary mdadm Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for cmd in "$@" Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + find_binary expr Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n -h ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for dev in "${!host_fs_types[@]}" Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ nfs != *_raid_member ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + continue Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _ret=255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + ret=255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ 255 != 0 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 1 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _mod=90multipath Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _mod=multipath Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check_module multipath 1 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _mod=multipath Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all = all ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + module_check multipath Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 1 -eq 2 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + is_func check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check -h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _rootdev Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n -h ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for_each_host_dev_and_slaves is_mpath Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _func=is_mpath Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _dev Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for _dev in "${host_devs[@]}" Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + continue Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 1 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _ret=255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + ret=255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ 255 != 0 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 1 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _mod=90qemu Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _mod=qemu Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check_module qemu 1 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _mod=qemu Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all = all ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + module_check qemu Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 1 -eq 2 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + is_func check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check -h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n -h ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + type -P systemd-detect-virt Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ systemd-detect-virt --vm Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + vm=none Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + (( 1 != 0 )) Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _ret=255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + ret=255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ 255 != 0 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 1 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _mod=90qemu-net Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _mod=qemu-net Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check_module qemu-net 1 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _mod=qemu-net Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all = all ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + module_check qemu-net Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 1 -eq 2 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + is_func check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check -h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n -h ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + type -P systemd-detect-virt Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ systemd-detect-virt --vm Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + vm= Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + (( 1 != 0 )) Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _ret=255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + ret=255 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ 255 != 0 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + return 1 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _mod=90stratis Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + _mod=stratis Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check_module stratis 1 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _mod=stratis Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddep Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -n 1 ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ all = all ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + module_check stratis Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ read a b Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _forced=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _hostonly=-h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 1 -eq 2 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + is_func check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: ++ type -t check Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + '[' 0 -ne 0 ']' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + check -h Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _module_name=90stratis Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + local _ret=0 Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + [[ stratisd-init = \-\m ]] Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + for cmd in "$@" Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + find_binary stratisd-init Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 5 01:02:54 kjcf05n02 kdumpctl[7836]: + set +x Nov 5 01:02:54 kjcf05n02 dracut[7950]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 5 01:02:54 kjcf05n02 dracut[7950]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 5 01:02:54 kjcf05n02 dracut[7950]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 5 01:02:54 kjcf05n02 dracut[7950]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 5 01:02:54 kjcf05n02 dracut[7950]: memstrack is available Nov 5 01:02:54 kjcf05n02 dracut[7950]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 5 01:02:54 kjcf05n02 dracut[7950]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 5 01:02:54 kjcf05n02 dracut[7950]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 5 01:02:54 kjcf05n02 dracut[7950]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 5 01:02:54 kjcf05n02 dracut[7950]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 5 01:02:54 kjcf05n02 dracut[7950]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 5 01:02:55 kjcf05n02 dracut[7950]: *** Including module: bash *** Nov 5 01:02:55 kjcf05n02 dracut[7950]: *** Including module: systemd *** Nov 5 01:02:55 kjcf05n02 dracut[7950]: *** Including module: fips *** Nov 5 01:02:55 kjcf05n00 zabbix_server[15691]: item "kjcf05n02:vfs.fs.size[/mnt/persistent_ha_data,used]" became supported Nov 5 01:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 5 01:02:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 5 01:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 5 01:02:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 5 01:02:56 kjcf05n02 dracut[7950]: *** Including module: systemd-initrd *** Nov 5 01:02:56 kjcf05n02 dracut[7950]: *** Including module: watchdog-modules *** Nov 5 01:02:56 kjcf05n02 dracut[7950]: *** Including module: nss-softokn *** Nov 5 01:02:56 kjcf05n02 dracut[7950]: *** Including module: i18n *** Nov 5 01:02:56 kjcf05n02 dracut[7950]: No KEYMAP configured. Nov 5 01:02:56 kjcf05n02 dracut[7950]: *** Including module: network-legacy *** Nov 5 01:02:56 kjcf05n02 dracut[7950]: *** Including module: network *** Nov 5 01:02:56 kjcf05n02 dracut[7950]: *** Including module: ib_bonding *** Nov 5 01:02:56 kjcf05n02 dracut[7950]: *** Including module: drm *** Nov 5 01:02:59 kjcf05n00 mcfcli[3673891]: %3|1730790179.151|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:02:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 5 01:02:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 5 01:02:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 5 01:02:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 5 01:03:00 kjcf05n02 dcs-collectord[5611]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 01:03:00 kjcf05n02 dcs-collectord[5611]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 5 01:03:00 kjcf05n02 dracut[7950]: *** Including module: hperaid *** Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + install Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + local rule rule_path Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + inst_multiple cat expr Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.FMxVwl/initramfs -a -f cat expr Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + _ret=0 Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + (( 0 != 0 )) Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + : Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + return 0 Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + inst_multiple -o mdmon Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.FMxVwl/initramfs -a -f -o mdmon Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + _ret=0 Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + (( 0 != 0 )) Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + : Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + return 0 Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: ++ command -v partx Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + inst /usr/sbin/partx /sbin/partx Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + local _hostonly_install Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + [[ /usr/sbin/partx == \-\H ]] Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + [[ -e /tmp/dracut.FMxVwl/initramfs//sbin/partx ]] Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.FMxVwl/initramfs -f /usr/sbin/partx /sbin/partx Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + (( 0 != 0 )) Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + : Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: ++ command -v mdadm Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + local _hostonly_install Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + [[ -e /tmp/dracut.FMxVwl/initramfs//sbin/mdadm ]] Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.FMxVwl/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + (( 0 != 0 )) Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + : Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + [[ yes == \y\e\s ]] Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + local _raidconf Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: ++ cmdline Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: ++ local _activated dev line UUID Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: ++ declare -A _activated Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: ++ for dev in "${!host_fs_types[@]}" Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: ++ [[ nfs != *_raid_member ]] Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: ++ continue Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + _raidconf= Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + [[ -n '' ]] Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + inst_rules 64-md-raid.rules Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + local _target=/etc/udev/rules.d _rule _found Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + inst_dir /usr/lib/udev/rules.d Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + [[ -e /tmp/dracut.FMxVwl/initramfs//usr/lib/udev/rules.d ]] Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + return 0 Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + inst_dir /etc/udev/rules.d Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + [[ -e /tmp/dracut.FMxVwl/initramfs//etc/udev/rules.d ]] Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + return 0 Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + for _rule in "$@" Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + continue Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + continue Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + for r in '' $dracutbasedir/rules.d/ Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + [[ 64-md-raid.rules != /* ]] Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + continue Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + for r in '' $dracutbasedir/rules.d/ Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + continue Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + [[ -n '' ]] Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + set +x Nov 5 01:03:00 kjcf05n02 dracut[7950]: Skipping udev rule: 64-md-raid.rules Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + installkernel Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + instmods =drivers/md Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + local _optional=-o Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + local _silent Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + local _ret Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + [[ '' = yes ]] Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + [[ =drivers/md = \-\c ]] Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + [[ =drivers/md = \-\s ]] Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + (( 1 == 0 )) Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.FMxVwl/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + _ret=0 Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + (( 0 != 0 )) Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + [[ -n '' ]] Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + return 0 Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + _ret=0 Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + unset check depends cmdline install installkernel Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + return 0 Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + modules_loaded+='hperaid ' Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + '[' -n '' ']' Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + _d_mod=90kernel-modules Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + _d_mod=kernel-modules Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + [[ '' = yes ]] Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + dinfo '*** Including module: kernel-modules ***' Nov 5 01:03:00 kjcf05n02 kdumpctl[7836]: + set +x Nov 5 01:03:00 kjcf05n02 dracut[7950]: *** Including module: kernel-modules *** Nov 5 01:03:00 kjcf05n02 dracut[7950]: *** Including module: kernel-modules-extra *** Nov 5 01:03:00 kjcf05n02 dracut[7950]: *** Including module: kernel-network-modules *** Nov 5 01:03:01 kjcf05n02 dracut[7950]: *** Including module: diskless-mod *** Nov 5 01:03:01 kjcf05n02 dracut[7950]: *** Including module: fstab-sys *** Nov 5 01:03:01 kjcf05n02 dracut[7950]: *** Including module: nfs *** Nov 5 01:03:01 kjcf05n02 dracut[7950]: *** Including module: rootfs-block *** Nov 5 01:03:01 kjcf05n02 dracut[7950]: *** Including module: terminfo *** Nov 5 01:03:01 kjcf05n02 dracut[7950]: *** Including module: udev-rules *** Nov 5 01:03:02 kjcf05n02 dracut[7950]: Skipping udev rule: 91-permissions.rules Nov 5 01:03:02 kjcf05n02 dracut[7950]: Skipping udev rule: 80-drivers-modprobe.rules Nov 5 01:03:02 kjcf05n02 dracut[7950]: *** Including module: dracut-systemd *** Nov 5 01:03:02 kjcf05n02 dracut[7950]: *** Including module: usrmount *** Nov 5 01:03:02 kjcf05n02 dracut[7950]: *** Including module: base *** Nov 5 01:03:03 kjcf05n02 dracut[7950]: *** Including module: fs-lib *** Nov 5 01:03:03 kjcf05n02 dracut[7950]: *** Including module: kdumpbase *** Nov 5 01:03:03 kjcf05n02 dracut[7950]: *** Including module: memstrack *** Nov 5 01:03:03 kjcf05n02 dracut[7950]: *** Including module: shutdown *** Nov 5 01:03:03 kjcf05n02 dracut[7950]: *** Including module: squash *** Nov 5 01:03:03 kjcf05n02 dracut[7950]: *** Including modules done *** Nov 5 01:03:03 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 5 01:03:03 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 5 01:03:03 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 5 01:03:03 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running Nov 5 01:03:03 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 5 01:03:04 kjcf05n02 dracut[7950]: *** Installing kernel module dependencies *** Nov 5 01:03:04 kjcf05n02 dracut[7950]: *** Installing kernel module dependencies done *** Nov 5 01:03:04 kjcf05n02 dracut[7950]: *** Resolving executable dependencies *** Nov 5 01:03:05 kjcf05n02 dracut[7950]: *** Resolving executable dependencies done*** Nov 5 01:03:05 kjcf05n02 dracut[7950]: *** Hardlinking files *** Nov 5 01:03:05 kjcf05n02 dracut[7950]: *** Hardlinking files done *** Nov 5 01:03:05 kjcf05n02 dracut[7950]: *** Generating early-microcode cpio image *** Nov 5 01:03:05 kjcf05n02 dracut[7950]: *** Constructing AuthenticAMD.bin **** Nov 5 01:03:05 kjcf05n02 dracut[7950]: *** Store current command line parameters *** Nov 5 01:03:05 kjcf05n02 dracut[7950]: Stored kernel commandline: Nov 5 01:03:05 kjcf05n02 dracut[7950]: rd.driver.pre=sd_mod Nov 5 01:03:05 kjcf05n02 dracut[7950]: rd.driver.pre=nvme Nov 5 01:03:05 kjcf05n02 dracut[7950]: rd.driver.pre=ipmi_si Nov 5 01:03:05 kjcf05n02 dracut[7950]: rd.driver.pre=ipmi_devintf Nov 5 01:03:05 kjcf05n02 dracut[7950]: rd.driver.pre=ipmi_msghandler Nov 5 01:03:05 kjcf05n02 dracut[7950]: nameserver=172.16.2.2 Nov 5 01:03:05 kjcf05n02 dracut[7950]: nameserver=127.0.0.1 Nov 5 01:03:05 kjcf05n02 dracut[7950]: nameserver=172.16.2.2 Nov 5 01:03:05 kjcf05n02 dracut[7950]: nameserver=127.0.0.1 Nov 5 01:03:05 kjcf05n02 dracut[7950]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 5 01:03:05 kjcf05n02 dracut[7950]: rd.neednet Nov 5 01:03:05 kjcf05n02 dracut[7950]: kdumpnic=mgmt0 Nov 5 01:03:05 kjcf05n02 dracut[7950]: bootdev=mgmt0 Nov 5 01:03:05 kjcf05n02 dracut[7950]: *** Install squash loader *** Nov 5 01:03:05 kjcf05n02 dracut[7950]: *** Squashing the files inside the initramfs *** Nov 5 01:03:06 kjcf05n02 dracut[7950]: *** Squashing the files inside the initramfs done *** Nov 5 01:03:06 kjcf05n02 dracut[7950]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 5 01:03:07 kjcf05n02 dracut[7950]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 5 01:03:07 kjcf05n02 kdumpctl[7836]: kdump: kexec: loaded kdump kernel Nov 5 01:03:07 kjcf05n02 kdumpctl[7836]: kdump: Starting kdump: [OK] Nov 5 01:03:07 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 5 01:03:07 kjcf05n02 systemd[1]: Reloading. Nov 5 01:03:07 kjcf05n02 systemd[3135]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:03:07 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:03:07 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:03:07 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 5 01:03:07 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 5 01:03:07 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 5 01:03:07 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 5 01:03:07 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 5 01:03:07 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 5 01:03:07 kjcf05n02 ifdown[14589]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 01:03:07 kjcf05n02 ifdown[14590]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:03:07 kjcf05n02 ifdown[14591]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:03:08 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 5 01:03:08 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 5 01:03:08 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 5 01:03:08 kjcf05n02 ifup[14651]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 01:03:08 kjcf05n02 ifup[14652]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:03:08 kjcf05n02 ifup[14653]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:03:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730790189', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 327 processes with STATE = RSZDT '}"] Nov 5 01:03:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 327 processes with STATE = RSZDT ', 'message': 'PROCS OK: 327 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730790189'} Nov 5 01:03:10 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 5 01:03:10 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:03:12 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 5 01:03:12 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 01:03:12 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:03:12 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 01:03:12 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:03:12 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:03:12 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:03:12 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 5 01:03:12 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 5 01:03:12 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 01:03:12 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 01:03:12 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:03:12 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:03:12 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:03:12 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:03:12 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 5 01:03:12 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 5 01:03:12 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 5 01:03:12 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 5 01:03:12 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 5 01:03:12 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 5 01:03:12 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 5 01:03:12 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 5 01:03:12 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 5 01:03:12 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 5 01:03:12 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 5 01:03:12 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 5 01:03:12 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 5 01:03:12 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 5 01:03:12 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 5 01:03:12 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 5 01:03:12 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 5 01:03:12 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 5 01:03:12 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 5 01:03:12 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 5 01:03:12 kjcf05n02 ifdown[14929]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 01:03:12 kjcf05n02 ifdown[14932]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:03:12 kjcf05n02 ifdown[14933]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:03:12 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: beXYRAID: exitcode=1 Nov 5 01:03:12 kjcf05n00 python3.9[8977]: nodes-monitor [ResourceStatusWorkerThread-3]: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 5 01:03:12 kjcf05n00 python3.9[8977]: command: beXYRAID: exitcode=1 Nov 5 01:03:12 kjcf05n00 python3.9[8977]: thr: cmd_list ['beXYRAID', '-w', 'kjcf05n[00-07]', 'info'] script failed with return code 1. kjcf05n02: info_xyraid ERR40: HA services are not running Nov 5 01:03:12 kjcf05n00 python3.9[8977]: pdsh@kjcf05n00: kjcf05n02: ssh exited with exit code 1 Nov 5 01:03:12 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 5 01:03:12 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 5 01:03:13 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 5 01:03:13 kjcf05n02 ifup[14993]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 01:03:13 kjcf05n02 ifup[14994]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:03:13 kjcf05n02 ifup[14995]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:03:13 kjcf05n00 mcfcli[3673891]: %3|1730790193.088|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:03:15 kjcf05n02 dcs-collectord[5611]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 01:03:15 kjcf05n02 dcs-collectord[5611]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 5 01:03:15 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 5 01:03:17 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 5 01:03:17 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 5 01:03:17 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 5 01:03:17 kjcf05n02 systemd[1]: Reloading. Nov 5 01:03:18 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 5 01:03:18 kjcf05n02 await_ha_peer[15204]: Waiting for HA peer kjcf05n03 Nov 5 01:03:19 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 5 01:03:19 kjcf05n02 await_ha_peer[15204]: Peer kjcf05n03 has started, starting HA Nov 5 01:03:19 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 5 01:03:19 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 5 01:03:19 kjcf05n02 fstonithd.py[15253]: Listening for kdump packets from partner Nov 5 01:03:19 kjcf05n02 systemd[1]: Reloading. Nov 5 01:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730790199', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.5% (3836568 kB) used.'}"] Nov 5 01:03:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.5% (3836568 kB) used.', 'message': 'OK - 1.5% (3836568 kB) used.', 'value': 'ok', 'timestamp': '1730790199'} Nov 5 01:03:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:03:19 kjcf05n02 systemd[3135]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:03:19 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:03:19 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:03:20 kjcf05n02 systemd[1]: Reloading. Nov 5 01:03:20 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 5 01:03:20 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 5 01:03:20 kjcf05n02 systemd[1]: Reloading. Nov 5 01:03:20 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 5 01:03:20 kjcf05n02 puppet-agent[3544]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:03:20 kjcf05n02 puppet[3544]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:03:20 kjcf05n02 puppet-agent[3544]: Applied catalog in 91.78 seconds Nov 5 01:03:20 kjcf05n02 puppet[3544]: Notice: Applied catalog in 91.78 seconds Nov 5 01:03:20 kjcf05n02 systemd[1]: Started Puppet agent. Nov 5 01:03:20 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 5 01:03:20 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 5 01:03:20 kjcf05n02 systemd[1]: Reached target Timers. Nov 5 01:03:20 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 5 01:03:20 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 5 01:03:20 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 5 01:03:20 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 5 01:03:20 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 5 01:03:20 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 5 01:03:20 kjcf05n02 wce-disable.sh[15444]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 5 01:03:20 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 5 01:03:20 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 5 01:03:20 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 5 01:03:20 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 5 01:03:20 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 5 01:03:20 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 5 01:03:21 kjcf05n02 gateway-ec-node.py[15447]: Starting gateway-ec-node service Nov 5 01:03:21 kjcf05n02 python3.9[15448]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 5 01:03:21 kjcf05n02 python3.9[15448]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 5 01:03:21 kjcf05n02 RFSF-API[15446]: INFO[2024-11-05T01:03:21-06:00] Datapath API RESTful Service starting Nov 5 01:03:21 kjcf05n02 dp-api-server-node[15446]: INFO[2024-11-05T01:03:21-06:00] Datapath API RESTful Service starting Nov 5 01:03:21 kjcf05n02 RFSF-API[15446]: INFO[2024-11-05T01:03:21-06:00] Running in production mode, starting dbus event listener Nov 5 01:03:21 kjcf05n02 dp-api-server-node[15446]: INFO[2024-11-05T01:03:21-06:00] Running in production mode, starting dbus event listener Nov 5 01:03:21 kjcf05n02 RFSF-API[15446]: INFO[2024-11-05T01:03:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 5 01:03:21 kjcf05n02 dp-api-server-node[15446]: INFO[2024-11-05T01:03:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 5 01:03:21 kjcf05n02 RFSF-API[15446]: INFO[2024-11-05T01:03:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 5 01:03:21 kjcf05n02 dp-api-server-node[15446]: INFO[2024-11-05T01:03:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 5 01:03:21 kjcf05n02 RFSF-API[15446]: INFO[2024-11-05T01:03:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 5 01:03:21 kjcf05n02 dp-api-server-node[15446]: INFO[2024-11-05T01:03:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 5 01:03:21 kjcf05n02 RFSF-API[15446]: INFO[2024-11-05T01:03:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 5 01:03:21 kjcf05n02 dp-api-server-node[15446]: INFO[2024-11-05T01:03:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 5 01:03:21 kjcf05n02 RFSF-API[15446]: INFO[2024-11-05T01:03:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 5 01:03:21 kjcf05n02 dp-api-server-node[15446]: INFO[2024-11-05T01:03:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 5 01:03:21 kjcf05n02 RFSF-API[15446]: INFO[2024-11-05T01:03:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 5 01:03:21 kjcf05n02 dp-api-server-node[15446]: INFO[2024-11-05T01:03:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 5 01:03:21 kjcf05n02 RFSF-API[15446]: INFO[2024-11-05T01:03:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 5 01:03:21 kjcf05n02 dp-api-server-node[15446]: INFO[2024-11-05T01:03:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 5 01:03:21 kjcf05n02 RFSF-API[15446]: INFO[2024-11-05T01:03:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 5 01:03:21 kjcf05n02 dp-api-server-node[15446]: INFO[2024-11-05T01:03:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 5 01:03:21 kjcf05n02 RFSF-API[15446]: INFO[2024-11-05T01:03:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 5 01:03:21 kjcf05n02 dp-api-server-node[15446]: INFO[2024-11-05T01:03:21-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 5 01:03:21 kjcf05n02 RFSF-API[15446]: INFO[2024-11-05T01:03:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 5 01:03:21 kjcf05n02 dp-api-server-node[15446]: INFO[2024-11-05T01:03:21-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 5 01:03:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730790201', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 5 01:03:22 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730790201'} Nov 5 01:03:22 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:03:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730790205', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 5 01:03:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730790205'} Nov 5 01:03:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:03:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-05T01:03:27.252953669-06:00 level=info msg="Completed cleanup jobs" duration=26.136304ms Nov 5 01:03:27 kjcf05n02 systemd[1]: Reloading. Nov 5 01:03:27 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 5 01:03:27 kjcf05n02 systemd[1]: Reloading. Nov 5 01:03:27 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 5 01:03:28 kjcf05n02 diskmonitor_pre[15914]: Key management is currently disabled.DEAR disabled Nov 5 01:03:28 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 5 01:03:29 kjcf05n00 mcfcli[3673891]: %3|1730790209.151|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:03:30 kjcf05n02 dcs-collectord[5611]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 01:03:30 kjcf05n02 dcs-collectord[5611]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 5 01:03:30 kjcf05n02 dcs-collectord[5611]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 5 01:03:30 kjcf05n02 sh[15982]: LNET configured: New Created Nov 5 01:03:30 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 5 01:03:30 kjcf05n02 LCNmon[18072]: Interface ib0 is up Nov 5 01:03:30 kjcf05n02 LCNmon[18072]: Interface ib1 is up Nov 5 01:03:30 kjcf05n02 LCNmon[18072]: Can ping through interface ib0 Nov 5 01:03:30 kjcf05n02 LCNmon[18072]: Can ping through interface ib1 Nov 5 01:03:30 kjcf05n02 LCNmon[18072]: NIC ib0, initial state UP Nov 5 01:03:30 kjcf05n02 LCNmon[18072]: NIC ib1, initial state UP Nov 5 01:03:30 kjcf05n02 LCNmon[18072]: LCNstat initial state UP Nov 5 01:03:30 kjcf05n02 LCNmon[18072]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 5 01:03:30 kjcf05n00 httpd[1812016]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 5 01:03:31 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: /var/run/diskmonitor does not exist, creating Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: Creating /var/run/diskmonitor/disk Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: Creating /var/run/diskmonitor/encl Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: Creating /var/run/diskmonitor/cli Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: RAS_Interlocks_enabled: 1 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: Using default ssd ids: HUSSL4010ASS600 , Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: add handler for sig: 14 sa_flags: 10000004 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: add handler for sig: 1 sa_flags: 10000004 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: add handler for sig: 2 sa_flags: 00000004 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: add handler for sig: 15 sa_flags: 00000004 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: add handler for sig: 6 sa_flags: 00000004 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: add handler for sig: 3 sa_flags: 00000004 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: add handler for sig: 30 sa_flags: 00000004 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: add handler for sig: 20 sa_flags: 00000004 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: add handler for sig: 10 sa_flags: 10000004 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: add handler for sig: 11 sa_flags: 00000004 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: add handler for sig: 7 sa_flags: 00000004 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: add handler for sig: 4 sa_flags: 00000004 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: add handler for sig: 8 sa_flags: 00000004 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: init_watch: /var/run/diskmonitor/encl initialized Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: init_watch: /var/run/diskmonitor/disk initialized Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: Using HA Baton locks - key: diskmonitor Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: Baton will be held for at most 570 seconds Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: DMMP Enabled: 0 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: random seed: 2ba36a0a Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: NVMe Enclosure: 1 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: ZFS Enclosure: 0 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: Dbus, Initialized Connection Successfully Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: int_catcher_thread: thread start Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: Received dbus message 4 org.freedesktop.DBus -> :1.108 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 5 01:03:32 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 5 01:03:34 kjcf05n02 openhpid[5517]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 5 01:03:34 kjcf05n02 openhpid[5517]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 5 01:03:35 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 5 01:03:35 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 5 01:03:35 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 5 01:03:35 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18602 which is not our child. We'll most likely not notice when it exits. Nov 5 01:03:35 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 5 01:03:35 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 5 01:03:35 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 5 01:03:35 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 5 01:03:35 kjcf05n02 dcs-collectord[5611]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 5 01:03:35 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 5 01:03:35 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 5 01:03:35 kjcf05n02 systemd[1]: Startup finished in 47.594s (kernel) + 2min 28.382s (userspace) = 3min 15.977s. Nov 5 01:03:35 kjcf05n02 openhpid[18602]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 5 01:03:35 kjcf05n02 openhpid[18602]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 5 01:03:35 kjcf05n02 openhpid[18602]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 5 01:03:35 kjcf05n02 openhpid[18602]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 5 01:03:36 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18706 (bash) Nov 5 01:03:36 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 5 01:03:36 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 5 01:03:36 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 5 01:03:36 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 5 01:03:36 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 5 01:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730790216', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 5 01:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730790216'} Nov 5 01:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730790216', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 5 01:03:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730790216'} Nov 5 01:03:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:03:39 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 5 01:03:39 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 5 01:03:39 kjcf05n00 zabbix_server[15697]: item "kjcf05n02:vfs.fs.inode[/mnt/persistent_ha_data,pfree]" became supported Nov 5 01:03:44 kjcf05n00 zabbix_server[15702]: item "kjcf05n02:vfs.fs.size[/mnt/persistent_ha_data,pused]" became supported Nov 5 01:03:45 kjcf05n02 dcs-collectord[5611]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 01:03:45 kjcf05n02 dcs-collectord[5611]: WARNING No data collected (hpi_parser.py:353) Nov 5 01:03:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730790228', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(3024.0B/2376.0B), ib1=(2744.0B/2736.0B), icl0=(8.8kB/10.4kB), lo=(1688.0B/1688.0B), meth0=(1541.8MB/8.1MB), mgmt0=(1478.6MB/8.1MB)'}"] Nov 5 01:03:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(3024.0B/2376.0B), ib1=(2744.0B/2736.0B), icl0=(8.8kB/10.4kB), lo=(1688.0B/1688.0B), meth0=(1541.8MB/8.1MB), mgmt0=(1478.6MB/8.1MB)', 'message': 'NET OK - (Rx/Tx) ib0=(3024.0B/2376.0B), ib1=(2744.0B/2736.0B), icl0=(8.8kB/10.4kB), lo=(1688.0B/1688.0B), meth0=(1541.8MB/8.1MB), mgmt0=(1478.6MB/8.1MB)', 'value': 'ok', 'timestamp': '1730790228'} Nov 5 01:03:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:03:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730790228', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 5 01:03:48 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730790228'} Nov 5 01:03:48 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:03:50 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31481 deleted. Nov 5 01:03:52 kjcf05n00 mcfcli[3673891]: %3|1730790232.179|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:03:58 kjcf05n02 ipmievd[3954]: System Event sensor - Timestamp Clock Sync Nov 5 01:03:59 kjcf05n00 mcfcli[3673891]: %3|1730790239.151|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 01:04:00 kjcf05n02 ipmievd[3135]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:04:00 kjcf05n02 dcs-collectord[5611]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 5 01:04:11 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 5 01:04:15 kjcf05n02 dcs-collectord[5611]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 01:04:19 kjcf05n03 firmware-update-orc-server[5905]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "8ad110eb-6a09-478f-bf87-540ab6a5220e"} (logger.py:65) Nov 5 01:04:19 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 85109 (get_disk_device) Nov 5 01:04:19 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 5 01:04:19 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 5 01:04:19 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 5 01:04:19 kjcf05n02 ras-resource-manager-agent[5875]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "2d615aaa-9b44-11ef-aa88-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 5 01:04:19 kjcf05n02 ras-resource-manager-agent[5875]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '2d615aaa-9b44-11ef-aa88-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 5 01:04:19 kjcf05n02 ras-resource-manager-agent[5875]: INFO Submitting new device inserted signal, starting to qualify drive: 2d615aaa-9b44-11ef-aa88-00093d0695e3 (admin_action.py:110) Nov 5 01:04:19 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '2d615aaa-9b44-11ef-aa88-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 5 01:04:19 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '2d615aaa-9b44-11ef-aa88-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 5 01:04:19 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '2d615aaa-9b44-11ef-aa88-00093d0695e3', 'response ID': '2d6d5db4-9b44-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 5 01:04:19 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 2d6d5db4-9b44-11ef-acfe-00093d0696a6 (logger.py:65) Nov 5 01:04:20 kjcf05n03 ccp-client[85130]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 5 01:04:20 kjcf05n03 ccp-client[85130]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 5 01:04:20 kjcf05n03 ccp-client[85139]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 5 01:04:20 kjcf05n03 ccp-client[85130]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 5 01:04:20 kjcf05n03 ccp-client[85130]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 5 01:04:20 kjcf05n03 ccp-client[85139]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 5 01:04:20 kjcf05n03 ccp-client[85139]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 5 01:04:20 kjcf05n02 diskmonitor[17685]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 5 01:04:20 kjcf05n02 ras-resource-manager-agent[5875]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "2db1cc9c-9b44-11ef-aa88-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 5 01:04:20 kjcf05n02 ras-resource-manager-agent[5875]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '2db1cc9c-9b44-11ef-aa88-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 5 01:04:20 kjcf05n02 ras-resource-manager-agent[5875]: INFO Submitting new device inserted signal, starting to qualify drive: 2db1cc9c-9b44-11ef-aa88-00093d0695e3 (admin_action.py:110) Nov 5 01:04:20 kjcf05n02 firmware-update-orc-server[5832]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "d6e8cdae-77b5-4de8-a2a3-cb67fbb8d2c6"} (logger.py:65) Nov 5 01:04:19 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '2db1cc9c-9b44-11ef-aa88-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 5 01:04:19 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '2db1cc9c-9b44-11ef-aa88-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 5 01:04:19 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '2db1cc9c-9b44-11ef-aa88-00093d0695e3', 'response ID': '2dba496c-9b44-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 5 01:04:19 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 2dba496c-9b44-11ef-acfe-00093d0696a6 (logger.py:65) Nov 5 01:04:22 kjcf05n03 nslcd[6975]: [e8944a] ldap_result() failed: Can't contact LDAP server Nov 5 01:04:23 kjcf05n03 DRVFW[85324]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 5 01:04:23 kjcf05n03 ccp-client[85325]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 5 01:04:23 kjcf05n03 ccp-client[85325]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 5 01:04:23 kjcf05n03 ccp-client[85334]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 5 01:04:23 kjcf05n03 ccp-client[85325]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 5 01:04:23 kjcf05n03 ccp-client[85325]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 5 01:04:23 kjcf05n03 ccp-client[85334]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 5 01:04:23 kjcf05n03 ccp-client[85334]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 5 01:04:23 kjcf05n03 firmware-update-orc-server[5905]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 5 01:04:24 kjcf05n02 ras-resource-manager-agent[5875]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '2d615aaa-9b44-11ef-aa88-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 5 01:04:24 kjcf05n02 ras-resource-manager-agent[5875]: INFO Drive qualification complete responding: 2d615aaa-9b44-11ef-aa88-00093d0695e3 (admin_action.py:205) Nov 5 01:04:24 kjcf05n02 ras-resource-manager-agent[5875]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "2d615aaa-9b44-11ef-aa88-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (interesting_event.py:59) Nov 5 01:04:24 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 2d6d5db4-9b44-11ef-acfe-00093d0696a6 (logger.py:65) Nov 5 01:04:24 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '2d615aaa-9b44-11ef-aa88-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '2d615aaa-9b44-11ef-aa88-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}}} (logger.py:65) Nov 5 01:04:27 kjcf05n02 diskmonitor[17685]: 004 Nov 5 01:04:27 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 5 01:04:27 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 5 01:04:27 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 5 01:04:27 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 5 01:04:27 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 5 01:04:27 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 5 01:04:27 kjcf05n02 diskmonitor[17685]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 5 01:04:27 kjcf05n02 diskmonitor[17685]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010240025384500000004 Nov 5 01:04:27 kjcf05n02 diskmonitor[17685]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 5 01:04:27 kjcf05n02 diskmonitor[17685]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 5 01:04:27 kjcf05n02 diskmonitor[17685]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 5 01:04:27 kjcf05n02 diskmonitor[17685]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "2d615aaa-9b44-11ef-aa88-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 5 01:04:27 kjcf05n02 diskmonitor[17685]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 5 01:04:27 kjcf05n02 diskmonitor[17685]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 5 01:04:27 kjcf05n02 diskmonitor[17685]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "2db1cc9c-9b44-11ef-aa88-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 5 01:04:27 kjcf05n02 diskmonitor[17685]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 5 01:04:27 kjcf05n02 diskmonitor[17685]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 5 01:04:29 kjcf05n00 mcfcli[3673891]: %3|1730790269.151|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 01:04:30 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 22501 (get_disk_device) Nov 5 01:04:30 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 5 01:04:30 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 5 01:04:30 kjcf05n02 ccp-client[22538]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 5 01:04:30 kjcf05n02 ccp-client[22538]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 5 01:04:30 kjcf05n02 ccp-client[22547]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 5 01:04:30 kjcf05n02 ccp-client[22538]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 5 01:04:30 kjcf05n02 ccp-client[22538]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 5 01:04:30 kjcf05n02 ccp-client[22547]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 5 01:04:30 kjcf05n02 ccp-client[22547]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 5 01:04:31 kjcf05n02 chronyd[5119]: Selected source 172.16.2.1 Nov 5 01:04:31 kjcf05n00 mcfcli[3673891]: %3|1730790271.446|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:04:33 kjcf05n02 DRVFW[22744]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 5 01:04:33 kjcf05n02 ccp-client[22745]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 5 01:04:33 kjcf05n02 ccp-client[22745]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 5 01:04:33 kjcf05n02 ccp-client[22754]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 5 01:04:33 kjcf05n02 ccp-client[22745]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 5 01:04:33 kjcf05n02 ccp-client[22754]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 5 01:04:33 kjcf05n02 ccp-client[22754]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 5 01:04:33 kjcf05n02 ccp-client[22745]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 5 01:04:33 kjcf05n02 firmware-update-orc-server[5832]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 5 01:04:35 kjcf05n02 ras-resource-manager-agent[5875]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '2db1cc9c-9b44-11ef-aa88-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}} (resource_admin.py:98) Nov 5 01:04:35 kjcf05n02 ras-resource-manager-agent[5875]: INFO Drive qualification complete responding: 2db1cc9c-9b44-11ef-aa88-00093d0695e3 (admin_action.py:205) Nov 5 01:04:35 kjcf05n02 ras-resource-manager-agent[5875]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "2db1cc9c-9b44-11ef-aa88-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (interesting_event.py:59) Nov 5 01:04:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730790274}"] Nov 5 01:04:34 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730790274, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:04:34 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:04:34 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 2dba496c-9b44-11ef-acfe-00093d0696a6 (logger.py:65) Nov 5 01:04:34 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '2db1cc9c-9b44-11ef-aa88-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '2db1cc9c-9b44-11ef-aa88-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}}} (logger.py:65) Nov 5 01:04:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730790274}"] Nov 5 01:04:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730790274, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:04:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:04:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730790274}"] Nov 5 01:04:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730790274, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:04:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:04:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730790274}"] Nov 5 01:04:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730790274, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:04:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:04:35 kjcf05n02 ras-resource-manager-agent[5875]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2d615aaa-9b44-11ef-aa88-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (service_main_handler.py:66) Nov 5 01:04:35 kjcf05n02 ras-resource-manager-agent[5875]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '2d615aaa-9b44-11ef-aa88-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 5 01:04:35 kjcf05n02 ras-resource-manager-agent[5875]: INFO Device qualification response has been acknowledged: 2d615aaa-9b44-11ef-aa88-00093d0695e3 (admin_action.py:151) Nov 5 01:04:35 kjcf05n02 ras-resource-manager-agent[5875]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2db1cc9c-9b44-11ef-aa88-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} (service_main_handler.py:66) Nov 5 01:04:35 kjcf05n02 ras-resource-manager-agent[5875]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '2db1cc9c-9b44-11ef-aa88-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 14}}} (resource_admin.py:98) Nov 5 01:04:35 kjcf05n02 ras-resource-manager-agent[5875]: INFO Device qualification response has been acknowledged: 2db1cc9c-9b44-11ef-aa88-00093d0695e3 (admin_action.py:151) Nov 5 01:04:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730790274}"] Nov 5 01:04:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730790274, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:04:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:04:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730790274}"] Nov 5 01:04:35 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730790274, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:04:35 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:04:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730790275}"] Nov 5 01:04:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730790275, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:04:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:04:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730790275}"] Nov 5 01:04:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730790275, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:04:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:04:36 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 5 01:04:36 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 5 01:04:36 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "2d615aaa-9b44-11ef-aa88-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: Dbus, handle_ingress_ras_signals, uuid: 2d615aaa-9b44-11ef-aa88-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2d615aaa-9b44-11ef-aa88-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "2db1cc9c-9b44-11ef-aa88-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: Dbus, handle_ingress_ras_signals, uuid: 2db1cc9c-9b44-11ef-aa88-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "2db1cc9c-9b44-11ef-aa88-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 14}}} Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 5 01:04:37 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 5 01:04:39 kjcf05n02 python3.9[5181]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 5 01:04:39 kjcf05n02 python3.9[3135]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:04:39 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_sloIEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 5 01:04:40 kjcf05n02 diskmonitor[17685]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 5 01:04:45 kjcf05n02 diskmonitor[17685]: ts, Found drive: nvme23n1 in enclosure slot: 8 Nov 5 01:04:45 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 5 01:04:45 kjcf05n02 diskmonitor[17685]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 5 01:04:45 kjcf05n02 diskmonitor[17685]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 5 01:04:45 kjcf05n02 diskmonitor[17685]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 5 01:04:45 kjcf05n02 diskmonitor[17685]: leaving test state: 1 next state: 2 Nov 5 01:04:45 kjcf05n02 diskmonitor[17685]: lock req: no timeout Nov 5 01:04:45 kjcf05n02 diskmonitor[17685]: leaving test state: 2 next state: 4 Nov 5 01:04:45 kjcf05n02 diskmonitor[17685]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 5 01:04:50 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31480 deleted. Nov 5 01:04:59 kjcf05n00 mcfcli[3673891]: %3|1730790299.152|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 01:05:06 kjcf05n00 mcfcli[3673891]: %3|1730790306.732|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:05:07 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 5 01:05:29 kjcf05n00 mcfcli[3673891]: %3|1730790329.152|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:05:40 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 5 01:05:40 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 5 01:05:40 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 5 01:05:44 kjcf05n00 mcfcli[3673891]: %3|1730790344.193|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:05:46 kjcf05n00 python3.9[2601576]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 5 01:05:50 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 5 01:05:50 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 5 01:05:50 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 5 01:05:55 kjcf05n02 diskmonitor[17685]: lock acquired Nov 5 01:05:55 kjcf05n02 diskmonitor[17685]: leaving test state: 4 next state: 8 Nov 5 01:05:56 kjcf05n02 dcs-collectord[5611]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 5 01:05:59 kjcf05n00 mcfcli[3673891]: %3|1730790359.152|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 01:06:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730790070', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 5 01:06:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730790070'} Nov 5 01:06:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:06:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730790070', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 5 01:06:00 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730790070'} Nov 5 01:06:00 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:06:03 kjcf05n02 diskmonitor[17685]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 5 01:06:03 kjcf05n02 diskmonitor[17685]: leaving test state: 8 next state: 20 Nov 5 01:06:03 kjcf05n02 diskmonitor[17685]: leaving test state: 20 next state: 40 Nov 5 01:06:03 kjcf05n02 diskmonitor[17685]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 1e1d6748000 Nov 5 01:06:03 kjcf05n02 diskmonitor[17685]: leaving test state: 40 next state: 80 Nov 5 01:06:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730790364}"] Nov 5 01:06:04 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730790364, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:06:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:06:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:06:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:06:04-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:06:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:06:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:06:04 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:06:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:06:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:06:04-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:06:04 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:06:04-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:06:04 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:06:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.067972ms Nov 5 01:06:04 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:06:04-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.067972ms Nov 5 01:06:04 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:01:06:04 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 01:06:04 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:06:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730790365}"] Nov 5 01:06:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730790365, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:06:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:06:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:06:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:06:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:06:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:06:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:06:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:06:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:06:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:06:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:06:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:06:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:06:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:06:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.02925ms Nov 5 01:06:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:06:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.02925ms Nov 5 01:06:05 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:01:06:05 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 01:06:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:06:20 kjcf05n00 mcfcli[3673891]: %3|1730790380.487|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:06:29 kjcf05n00 mcfcli[3673891]: %3|1730790389.153|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:06:57 kjcf05n00 mcfcli[3673891]: %3|1730790417.400|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:06:59 kjcf05n00 mcfcli[3673891]: %3|1730790419.154|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 01:07:09 kjcf05n02 diskmonitor[17685]: leaving test state: 80 next state: 100 Nov 5 01:07:09 kjcf05n02 diskmonitor[17685]: lock release: time: Tue Nov 5 01:07:02 2024 Nov 5 01:07:09 kjcf05n02 diskmonitor[17685]: leaving test state: 100 next state: 1 Nov 5 01:07:20 kjcf05n06 systemd[1]: Starting Collect SAS Health Report... Nov 5 01:07:20 kjcf05n06 systemd[1]: sashealth.service: Succeeded. Nov 5 01:07:20 kjcf05n06 systemd[1]: Started Collect SAS Health Report. Nov 5 01:07:29 kjcf05n00 mcfcli[3673891]: %3|1730790449.212|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 01:07:37 kjcf05n00 mcfcli[3673891]: %3|1730790457.397|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:07:41 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 5 01:07:55 kjcf05n03 systemd[1]: Starting Collect SAS Health Report... Nov 5 01:07:55 kjcf05n03 systemd[1]: sashealth.service: Succeeded. Nov 5 01:07:55 kjcf05n03 systemd[1]: Started Collect SAS Health Report. Nov 5 01:07:59 kjcf05n00 mcfcli[3673891]: %3|1730790479.213|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:08:08 kjcf05n00 shell-ie-logger[2603385]: IEC: 028000000: Editor invoked: { "cwd": "/home/admin", "args": "apply_build.sh", "cmd": "vim" } Nov 5 01:08:11 kjcf05n00 su[2603514]: (to root) admin on pts/22 Nov 5 01:08:15 kjcf05n00 mcfcli[3673891]: %3|1730790495.478|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:08:24 kjcf05n07 systemd[1]: Starting Collect SAS Health Report... Nov 5 01:08:24 kjcf05n07 systemd[1]: sashealth.service: Succeeded. Nov 5 01:08:24 kjcf05n07 systemd[1]: Started Collect SAS Health Report. Nov 5 01:08:29 kjcf05n00 mcfcli[3673891]: %3|1730790509.213|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 01:08:55 kjcf05n00 mcfcli[3673891]: %3|1730790535.200|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:08:59 kjcf05n00 mcfcli[3673891]: %3|1730790539.655|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 01:09:11 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 5 01:09:11 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 5 01:09:11 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 5 01:09:16 kjcf05n05 systemd[1]: Starting Collect SAS Health Report... Nov 5 01:09:29 kjcf05n00 mcfcli[3673891]: %3|1730790569.656|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:09:34 kjcf05n00 mcfcli[3673891]: %3|1730790574.477|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:09:40 kjcf05n04 systemd[1]: Starting Collect SAS Health Report... Nov 5 01:09:44 kjcf05n05 systemd[1]: sashealth.service: Succeeded. Nov 5 01:09:44 kjcf05n05 systemd[1]: Started Collect SAS Health Report. Nov 5 01:09:59 kjcf05n00 mcfcli[3673891]: %3|1730790599.656|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:10:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 5 01:10:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:10:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 5 01:10:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 5 01:10:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:10:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 5 01:10:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 5 01:10:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:10:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 5 01:10:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 5 01:10:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:10:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 5 01:10:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 5 01:10:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:10:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 5 01:10:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 5 01:10:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:10:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 5 01:10:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 5 01:10:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:10:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 5 01:10:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 5 01:10:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:10:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 5 01:10:08 kjcf05n04 systemd[1]: sashealth.service: Succeeded. Nov 5 01:10:08 kjcf05n04 systemd[1]: Started Collect SAS Health Report. Nov 5 01:10:08 kjcf05n00 zabbix-server[2604397]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 01:10:08 kjcf05n00 zabbix-server[2604397]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n02' from event '46936' Nov 5 01:10:08 kjcf05n00 zabbix-server[2604397]: Host created 'enclosure_USE26000024VS001' Nov 5 01:10:08 kjcf05n00 zabbix-server[2604397]: Running puppet on 'kjcf05n02' Nov 5 01:10:10 kjcf05n02 puppet-agent[35381]: Using configured environment 'production' Nov 5 01:10:10 kjcf05n02 puppet-agent[35381]: Retrieving pluginfacts Nov 5 01:10:10 kjcf05n02 puppet-agent[35381]: Retrieving plugin Nov 5 01:10:10 kjcf05n02 puppet-agent[35381]: Loading facts Nov 5 01:10:12 kjcf05n00 mcfcli[3673891]: %3|1730790612.322|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:10:14 kjcf05n02 puppet-agent[35381]: Caching catalog for kjcf05n02 Nov 5 01:10:14 kjcf05n02 puppet-agent[35381]: Applying configuration version '1730790612' Nov 5 01:10:16 kjcf05n02 puppet-agent[35381]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 01:10:16 kjcf05n02 puppet-agent[35381]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 01:10:16 kjcf05n02 puppet-agent[35381]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 01:10:16 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 5 01:10:16 kjcf05n02 zabbix_agent2[5959]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 01:10:16 kjcf05n02 zabbix_agent2[3135]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:10:16 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 01:10:16 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 5 01:10:16 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 5 01:10:16 kjcf05n02 puppet-agent[35381]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: Press Ctrl+C to exit. Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: Plugin support version 1.0 Nov 5 01:10:16 kjcf05n02 zabbix_agent2[35739]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 01:10:18 kjcf05n02 puppet-agent[35381]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 01:10:18 kjcf05n02 puppet-agent[35381]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 01:10:18 kjcf05n02 puppet-agent[35381]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 01:10:19 kjcf05n02 puppet-agent[35381]: Applied catalog in 5.05 seconds Nov 5 01:10:18 kjcf05n00 zabbix-server[2604397]: puppet completed status:(0): '' Nov 5 01:10:18 kjcf05n00 zabbix-server[2604397]: Event '46936' acknowledged Nov 5 01:10:18 kjcf05n00 zabbix-server[2604397]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n02"}' Nov 5 01:10:29 kjcf05n00 mcfcli[3673891]: %3|1730790629.656|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:10:32 kjcf05n04 multipathd[10508]: path checkers took longer than 25 seconds, consider increasing max_polling_interval Nov 5 01:10:34 kjcf05n05 multipathd[10769]: path checkers took longer than 25 seconds, consider increasing max_polling_interval Nov 5 01:10:41 kjcf05n00 python3.9[2604743]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 5 01:10:51 kjcf05n00 mcfcli[3673891]: %3|1730790651.978|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:10:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730790070', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 5 01:10:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730790070'} Nov 5 01:10:54 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:10:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730790070', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 5 01:10:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730790070'} Nov 5 01:10:54 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:10:59 kjcf05n00 mcfcli[3673891]: %3|1730790659.656|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:11:29 kjcf05n00 mcfcli[3673891]: %3|1730790689.656|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:11:31 kjcf05n00 mcfcli[3673891]: %3|1730790691.055|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:11:59 kjcf05n00 mcfcli[3673891]: %3|1730790719.657|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:12:09 kjcf05n00 mcfcli[3673891]: %3|1730790729.848|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:12:29 kjcf05n00 mcfcli[3673891]: %3|1730790749.657|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:12:49 kjcf05n00 mcfcli[3673891]: %3|1730790769.845|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:12:59 kjcf05n00 mcfcli[3673891]: %3|1730790779.657|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:13:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-05T01:13:27.269174165-06:00 level=info msg="Completed cleanup jobs" duration=42.460874ms Nov 5 01:13:27 kjcf05n00 mcfcli[3673891]: %3|1730790807.536|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:13:29 kjcf05n00 mcfcli[3673891]: %3|1730790809.658|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 01:13:59 kjcf05n00 mcfcli[3673891]: %3|1730790839.659|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:14:06 kjcf05n00 mcfcli[3673891]: %3|1730790846.052|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:14:09 kjcf05n02 root[42352]: failback_xyraid Nov 5 01:14:11 kjcf05n02 root[42514]: move_xyraid kjcf05n03_md65-group kjcf05n02 params="kjcf05n03_md65-group" Nov 5 01:14:12 kjcf05n02 root[42655]: move_xyraid kjcf05n03_md66-group kjcf05n03 params="kjcf05n03_md66-group" Nov 5 01:14:14 kjcf05n03 systemd[1]: data-kjcf05n03:md65.mount: Succeeded. Nov 5 01:14:18 kjcf05n03 dwd[5226]: Drive path is missing, purging: nvme18n1 Nov 5 01:14:18 kjcf05n03 dwd[5226]: Drive path is missing, purging: nvme24n1 Nov 5 01:14:18 kjcf05n03 dwd[5226]: Drive path is missing, purging: nvme9n1 Nov 5 01:14:18 kjcf05n03 dwd[5226]: Drive path is missing, purging: nvme25n1 Nov 5 01:14:18 kjcf05n03 dwd[5226]: Drive path is missing, purging: nvme8n1 Nov 5 01:14:18 kjcf05n03 dwd[5226]: Drive path is missing, purging: nvme2n1 Nov 5 01:14:18 kjcf05n03 dwd[5226]: Drive path is missing, purging: nvme4n1 Nov 5 01:14:18 kjcf05n03 dwd[5226]: Drive path is missing, purging: nvme23n1 Nov 5 01:14:18 kjcf05n03 dwd[5226]: Drive path is missing, purging: nvme17n1 Nov 5 01:14:18 kjcf05n03 dwd[5226]: Drive path is missing, purging: nvme3n1 Nov 5 01:14:18 kjcf05n03 dwd[5226]: Drive path is missing, purging: nvme19n1 Nov 5 01:14:20 kjcf05n02 dcs-bulk-data-sender[6159]: IEC: 022002002: Lustre bulk data collection successful after one or more unsuccessful attempts: b'{"unsuccessful_collection_attempts": 139}' Nov 5 01:14:20 kjcf05n02 dwd[5152]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 5 01:14:20 kjcf05n02 dwd[5152]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 5 01:14:20 kjcf05n02 dwd[5152]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 5 01:14:20 kjcf05n02 dwd[5152]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 5 01:14:20 kjcf05n02 dwd[5152]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 5 01:14:20 kjcf05n02 dwd[5152]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 5 01:14:20 kjcf05n02 dwd[5152]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 5 01:14:20 kjcf05n02 dwd[5152]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 5 01:14:20 kjcf05n02 dwd[5152]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 5 01:14:20 kjcf05n02 dwd[5152]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 5 01:14:20 kjcf05n02 dwd[5152]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 5 01:14:20 kjcf05n02 dwd[5152]: Starting NVME thread for nvme2n1 Nov 5 01:14:20 kjcf05n02 dwd[5152]: Starting NVME thread for nvme18n1 Nov 5 01:14:20 kjcf05n02 dwd[5152]: Starting NVME thread for nvme19n1 Nov 5 01:14:20 kjcf05n02 dwd[5152]: Starting NVME thread for nvme9n1 Nov 5 01:14:21 kjcf05n02 systemd-udevd[45367]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45366]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45369]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45371]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45366]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45367]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45369]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45371]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45367]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45366]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45369]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45371]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45367]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45366]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45369]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45371]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45367]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45366]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45369]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45371]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45367]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45366]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45371]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45369]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45395]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45367]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45371]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45369]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45366]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45396]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45398]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45403]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45395]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45371]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45367]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45369]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45366]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45396]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45398]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45371]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45396]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45371]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45371]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45369]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45371]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45369]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45396]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45398]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45367]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45369]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45371]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45396]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45369]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45371]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45369]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45369]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45369]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45371]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45369]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45371]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45369]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45371]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45369]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 systemd-udevd[45369]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 01:14:21 kjcf05n02 dwd[5152]: Starting NVME thread for nvme3n1 Nov 5 01:14:21 kjcf05n02 dwd[5152]: Starting NVME thread for nvme24n1 Nov 5 01:14:21 kjcf05n02 nslcd[6906]: [8b4567] (re)loading /etc/nsswitch.conf Nov 5 01:14:21 kjcf05n02 dwd[5152]: Starting NVME thread for nvme4n1 Nov 5 01:14:21 kjcf05n02 dwd[5152]: Starting NVME thread for nvme23n1 Nov 5 01:14:21 kjcf05n02 dwd[5152]: Starting NVME thread for nvme17n1 Nov 5 01:14:21 kjcf05n02 dwd[5152]: Starting NVME thread for nvme25n1 Nov 5 01:14:21 kjcf05n02 dwd[5152]: Starting NVME thread for nvme8n1 Nov 5 01:14:28 kjcf05n02 diskmonitor[17685]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 5 01:14:29 kjcf05n00 mcfcli[3673891]: %3|1730790869.659|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 01:14:33 kjcf05n02 diskmonitor[17685]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 5 01:14:33 kjcf05n02 diskmonitor[17685]: Scan for ReadErrorMax change for md65 Nov 5 01:14:33 kjcf05n02 diskmonitor[17685]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 5 01:14:33 kjcf05n02 diskmonitor[17685]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 5 01:14:33 kjcf05n02 diskmonitor[17685]: read_saved_file: md65 no saved speed Nov 5 01:14:33 kjcf05n02 diskmonitor[17685]: reconstruction_policy: sync_action prev = current = idle - md65 Nov 5 01:14:33 kjcf05n02 diskmonitor[17685]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 5 01:14:43 kjcf05n00 mcfcli[3673891]: %3|1730790883.086|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:14:59 kjcf05n00 mcfcli[3673891]: %3|1730790899.659|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:15:12 kjcf05n03 diskmonitor[17542]: Removed MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 5 01:15:12 kjcf05n03 diskmonitor[17542]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 5 01:15:18 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 48481 (bash) Nov 5 01:15:18 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 5 01:15:18 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 5 01:15:19 kjcf05n02 systemd[1]: Starting Cleanup of Temporary Directories... Nov 5 01:15:19 kjcf05n02 systemd-tmpfiles[48557]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 01:15:19 kjcf05n02 systemd-tmpfiles[48557]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 01:15:19 kjcf05n02 systemd[1]: systemd-tmpfiles-clean.service: Succeeded. Nov 5 01:15:19 kjcf05n02 systemd[1]: Started Cleanup of Temporary Directories. Nov 5 01:15:21 kjcf05n00 mcfcli[3673891]: %3|1730790921.687|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:15:29 kjcf05n00 mcfcli[3673891]: %3|1730790929.659|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 5 01:15:41 kjcf05n00 python3.9[2607792]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 5 01:15:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730790954', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.'}"] Nov 5 01:15:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MGTs are mounted. The optimal number of MGTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730790954'} Nov 5 01:15:54 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:15:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730790954', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'OK', 'message':'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.'}"] Nov 5 01:15:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'message': 'Node is powered on. Lustre is running normally. All MDTs are mounted. The optimal number of MDTs are mounted on this node.', 'value': 'ok', 'timestamp': '1730790954'} Nov 5 01:15:54 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:15:59 kjcf05n00 mcfcli[3673891]: %3|1730790959.660|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 01:16:00 kjcf05n00 mcfcli[3673891]: %3|1730790960.347|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:16:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,10,status]', 'value': 'Ok', 'timestamp': 1730790965}"] Nov 5 01:16:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '10', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730790965, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:16:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.20536ms Nov 5 01:16:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.20536ms Nov 5 01:16:05 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:01:16:05 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 01:16:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:16:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,11,status]', 'value': 'Ok', 'timestamp': 1730790965}"] Nov 5 01:16:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '11', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730790965, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:16:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.006277ms Nov 5 01:16:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.006277ms Nov 5 01:16:05 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:01:16:05 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 01:16:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:16:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,12,status]', 'value': 'Ok', 'timestamp': 1730790965}"] Nov 5 01:16:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '12', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730790965, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:16:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.047074ms Nov 5 01:16:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.047074ms Nov 5 01:16:05 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:01:16:05 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 01:16:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:16:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,20,status]', 'value': 'Ok', 'timestamp': 1730790965}"] Nov 5 01:16:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '20', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730790965, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:16:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.201332ms Nov 5 01:16:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.201332ms Nov 5 01:16:05 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:01:16:05 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 01:16:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:16:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,21,status]', 'value': 'Ok', 'timestamp': 1730790965}"] Nov 5 01:16:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '21', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730790965, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:16:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.210199ms Nov 5 01:16:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.210199ms Nov 5 01:16:05 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:01:16:05 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 01:16:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:16:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,22,status]', 'value': 'Ok', 'timestamp': 1730790965}"] Nov 5 01:16:05 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '22', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730790965, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:16:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:05-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:05 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:05-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:05 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:05-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:05 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.356393ms Nov 5 01:16:05 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:05-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.356393ms Nov 5 01:16:05 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:01:16:05 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 01:16:05 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:16:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,23,status]', 'value': 'Ok', 'timestamp': 1730790965}"] Nov 5 01:16:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '23', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730790965, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:16:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.065217ms Nov 5 01:16:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.065217ms Nov 5 01:16:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:01:16:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 01:16:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:16:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,24,status]', 'value': 'Ok', 'timestamp': 1730790965}"] Nov 5 01:16:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '24', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730790965, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:16:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.874931ms Nov 5 01:16:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.874931ms Nov 5 01:16:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:01:16:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 01:16:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:16:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,7,status]', 'value': 'Ok', 'timestamp': 1730790965}"] Nov 5 01:16:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '7', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730790965, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:16:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.727285ms Nov 5 01:16:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.727285ms Nov 5 01:16:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:01:16:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 01:16:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:16:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,8,status]', 'value': 'Ok', 'timestamp': 1730790965}"] Nov 5 01:16:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '8', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730790965, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:16:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.980699ms Nov 5 01:16:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.980699ms Nov 5 01:16:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:01:16:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 01:16:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:16:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,9,status]', 'value': 'Ok', 'timestamp': 1730790965}"] Nov 5 01:16:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '9', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730790965, 'value': 'Ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:16:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:06-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:16:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:06 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:16:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:06-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:16:06 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:16:06-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:16:06 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:16:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.19985ms Nov 5 01:16:06 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:16:06-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.19985ms Nov 5 01:16:06 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:01:16:06 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 01:16:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:16:29 kjcf05n00 mcfcli[3673891]: %3|1730790989.660|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 01:16:37 kjcf05n00 mcfcli[3673891]: %3|1730790997.295|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:16:59 kjcf05n00 mcfcli[3673891]: %3|1730791019.660|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 01:17:14 kjcf05n00 mcfcli[3673891]: %3|1730791034.139|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:17:29 kjcf05n00 mcfcli[3673891]: %3|1730791049.660|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 5 01:17:52 kjcf05n00 mcfcli[3673891]: %3|1730791072.522|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:17:59 kjcf05n00 mcfcli[3673891]: %3|1730791079.661|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 01:18:29 kjcf05n00 mcfcli[3673891]: %3|1730791109.661|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:18:32 kjcf05n00 mcfcli[3673891]: %3|1730791112.519|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:18:59 kjcf05n00 mcfcli[3673891]: %3|1730791139.661|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:19:09 kjcf05n00 mcfcli[3673891]: %3|1730791149.630|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:19:30 kjcf05n00 mcfcli[3673891]: %3|1730791170.162|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 01:19:47 kjcf05n02 dwd[5152]: nvme18n1 passed periodic SMART status check Nov 5 01:19:47 kjcf05n02 dwd[5152]: nvme19n1 passed periodic SMART status check Nov 5 01:19:47 kjcf05n02 dwd[5152]: nvme9n1 passed periodic SMART status check Nov 5 01:19:47 kjcf05n02 dwd[5152]: nvme2n1 passed periodic SMART status check Nov 5 01:19:48 kjcf05n02 dwd[5152]: nvme8n1 passed periodic SMART status check Nov 5 01:19:48 kjcf05n02 dwd[5152]: nvme25n1 passed periodic SMART status check Nov 5 01:19:48 kjcf05n02 dwd[5152]: nvme3n1 passed periodic SMART status check Nov 5 01:19:48 kjcf05n02 dwd[5152]: nvme4n1 passed periodic SMART status check Nov 5 01:19:48 kjcf05n02 dwd[5152]: nvme17n1 passed periodic SMART status check Nov 5 01:19:48 kjcf05n02 dwd[5152]: nvme24n1 passed periodic SMART status check Nov 5 01:19:48 kjcf05n02 dwd[5152]: nvme23n1 passed periodic SMART status check Nov 5 01:19:48 kjcf05n03 chronyd[5193]: Selected source 16.110.135.123 Nov 5 01:19:49 kjcf05n00 mcfcli[3673891]: %3|1730791189.627|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:20:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 5 01:20:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:20:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 5 01:20:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 5 01:20:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:20:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 5 01:20:00 kjcf05n00 mcfcli[3673891]: %3|1730791200.162|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 5 01:20:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 5 01:20:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:20:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 5 01:20:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 5 01:20:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:20:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 5 01:20:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 5 01:20:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:20:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 5 01:20:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 5 01:20:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:20:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 5 01:20:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 5 01:20:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:20:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 5 01:20:01 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 5 01:20:01 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:20:01 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 5 01:20:11 kjcf05n00 zabbix-server[2610458]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 01:20:11 kjcf05n00 zabbix-server[2610458]: Attempting to create lustre hostname for lustre filesystem name 'kjcf05' on host 'kjcf05n02' from event '46938' Nov 5 01:20:11 kjcf05n00 zabbix-server[2610458]: Filesystem 'kjcf05' has been mounted Nov 5 01:20:11 kjcf05n00 zabbix-server[2610458]: Node 'lustre_kjcf05' has been enabled for Lustre data monitoring because filesystem associated with this node has now been mounted Nov 5 01:20:11 kjcf05n00 zabbix-server[2610458]: Running puppet on 'None' Nov 5 01:20:13 kjcf05n05 puppet-agent[2986993]: Using configured environment 'production' Nov 5 01:20:13 kjcf05n05 puppet-agent[2986993]: Retrieving pluginfacts Nov 5 01:20:13 kjcf05n05 puppet-agent[2986993]: Retrieving plugin Nov 5 01:20:13 kjcf05n03 puppet-agent[113020]: Using configured environment 'production' Nov 5 01:20:13 kjcf05n03 puppet-agent[113020]: Retrieving pluginfacts Nov 5 01:20:13 kjcf05n03 puppet-agent[113020]: Retrieving plugin Nov 5 01:20:13 kjcf05n03 puppet-agent[113020]: Loading facts Nov 5 01:20:13 kjcf05n06 puppet-agent[2788016]: Using configured environment 'production' Nov 5 01:20:13 kjcf05n06 puppet-agent[2788016]: Retrieving pluginfacts Nov 5 01:20:13 kjcf05n06 puppet-agent[2788016]: Retrieving plugin Nov 5 01:20:13 kjcf05n04 puppet-agent[2772529]: Using configured environment 'production' Nov 5 01:20:13 kjcf05n04 puppet-agent[2772529]: Retrieving pluginfacts Nov 5 01:20:13 kjcf05n04 puppet-agent[2772529]: Retrieving plugin Nov 5 01:20:13 kjcf05n04 puppet-agent[2772529]: Loading facts Nov 5 01:20:14 kjcf05n02 puppet-agent[57615]: Using configured environment 'production' Nov 5 01:20:14 kjcf05n02 puppet-agent[57615]: Retrieving pluginfacts Nov 5 01:20:14 kjcf05n02 puppet-agent[57615]: Retrieving plugin Nov 5 01:20:14 kjcf05n07 puppet-agent[2788716]: Using configured environment 'production' Nov 5 01:20:14 kjcf05n07 puppet-agent[2788716]: Retrieving pluginfacts Nov 5 01:20:14 kjcf05n07 puppet-agent[2788716]: Retrieving plugin Nov 5 01:20:14 kjcf05n07 puppet-agent[2788716]: Loading facts Nov 5 01:20:14 kjcf05n01 puppet-agent[4001021]: Using configured environment 'production' Nov 5 01:20:14 kjcf05n01 puppet-agent[4001021]: Retrieving pluginfacts Nov 5 01:20:14 kjcf05n01 puppet-agent[4001021]: Retrieving plugin Nov 5 01:20:14 kjcf05n01 puppet-agent[4001021]: Loading facts Nov 5 01:20:14 kjcf05n05 puppet-agent[2986993]: Loading facts Nov 5 01:20:14 kjcf05n06 puppet-agent[2788016]: Loading facts Nov 5 01:20:14 kjcf05n02 puppet-agent[57615]: Loading facts Nov 5 01:20:14 kjcf05n00 puppet-agent[2610611]: Using configured environment 'production' Nov 5 01:20:14 kjcf05n00 puppet-agent[2610611]: Retrieving pluginfacts Nov 5 01:20:14 kjcf05n00 puppet-agent[2610611]: Retrieving plugin Nov 5 01:20:14 kjcf05n00 puppet-agent[2610611]: Loading facts Nov 5 01:20:17 kjcf05n03 puppet-agent[113020]: Caching catalog for kjcf05n03 Nov 5 01:20:17 kjcf05n03 puppet-agent[113020]: Applying configuration version '1730791215' Nov 5 01:20:17 kjcf05n02 puppet-agent[57615]: Caching catalog for kjcf05n02 Nov 5 01:20:17 kjcf05n02 puppet-agent[57615]: Applying configuration version '1730791215' Nov 5 01:20:17 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: `+' after local variable or literal is interpreted as binary operator Nov 5 01:20:17 kjcf05n00 puppetserver[10072]: /etc/puppetlabs/code/environments/production/modules/nfs/templates/exports.erb:4: warning: even though it seems like unary operator Nov 5 01:20:17 kjcf05n06 puppet-agent[2788016]: Caching catalog for kjcf05n06 Nov 5 01:20:17 kjcf05n06 puppet-agent[2788016]: Applying configuration version '1730791215' Nov 5 01:20:18 kjcf05n07 puppet-agent[2788716]: Caching catalog for kjcf05n07 Nov 5 01:20:18 kjcf05n07 puppet-agent[2788716]: Applying configuration version '1730791215' Nov 5 01:20:18 kjcf05n01 puppet-agent[4001021]: Caching catalog for kjcf05n01 Nov 5 01:20:19 kjcf05n01 puppet-agent[4001021]: Applying configuration version '1730791216' Nov 5 01:20:18 kjcf05n00 puppet-agent[2610611]: Caching catalog for kjcf05n00 Nov 5 01:20:18 kjcf05n00 puppet-agent[2610611]: Applying configuration version '1730791216' Nov 5 01:20:19 kjcf05n03 puppet-agent[113020]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 01:20:19 kjcf05n03 puppet-agent[113020]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 01:20:19 kjcf05n03 puppet-agent[113020]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 01:20:19 kjcf05n02 puppet-agent[57615]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 01:20:19 kjcf05n02 puppet-agent[57615]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 01:20:19 kjcf05n02 puppet-agent[57615]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 01:20:19 kjcf05n03 systemd[1]: Stopping Zabbix Agent 2... Nov 5 01:20:19 kjcf05n03 zabbix_agent2[56673]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 01:20:19 kjcf05n03 zabbix_agent2[3159]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n03 Nov 5 01:20:19 kjcf05n03 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 01:20:19 kjcf05n03 systemd[1]: Stopped Zabbix Agent 2. Nov 5 01:20:19 kjcf05n03 systemd[1]: Started Zabbix Agent 2. Nov 5 01:20:19 kjcf05n03 puppet-agent[113020]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: Press Ctrl+C to exit. Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: Plugin support version 1.0 Nov 5 01:20:19 kjcf05n03 zabbix_agent2[113374]: Zabbix Agent2 hostname: [kjcf05n03,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 01:20:19 kjcf05n06 puppet-agent[2788016]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 01:20:19 kjcf05n06 puppet-agent[2788016]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 01:20:19 kjcf05n06 puppet-agent[2788016]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 01:20:20 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 5 01:20:20 kjcf05n02 zabbix_agent2[35739]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 01:20:20 kjcf05n02 zabbix_agent2[3135]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:20:20 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 01:20:20 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 5 01:20:20 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 5 01:20:20 kjcf05n02 puppet-agent[57615]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: Press Ctrl+C to exit. Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: Plugin support version 1.0 Nov 5 01:20:20 kjcf05n02 zabbix_agent2[57960]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 01:20:20 kjcf05n07 puppet-agent[2788716]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 01:20:20 kjcf05n07 puppet-agent[2788716]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 01:20:20 kjcf05n07 puppet-agent[2788716]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 01:20:20 kjcf05n06 systemd[1]: Stopping Zabbix Agent 2... Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2735646]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 01:20:20 kjcf05n06 zabbix_agent2[3277]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n06 Nov 5 01:20:20 kjcf05n06 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 01:20:20 kjcf05n06 systemd[1]: Stopped Zabbix Agent 2. Nov 5 01:20:20 kjcf05n06 systemd[1]: Started Zabbix Agent 2. Nov 5 01:20:20 kjcf05n06 puppet-agent[2788016]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: Press Ctrl+C to exit. Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: Plugin support version 1.0 Nov 5 01:20:20 kjcf05n06 zabbix_agent2[2788430]: Zabbix Agent2 hostname: [kjcf05n06,enclosure_USE26000024VS005,lustre_kjcf05] Nov 5 01:20:20 kjcf05n07 systemd[1]: Stopping Zabbix Agent 2... Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2736346]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 01:20:20 kjcf05n07 zabbix_agent2[3269]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n07 Nov 5 01:20:20 kjcf05n07 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 01:20:20 kjcf05n07 systemd[1]: Stopped Zabbix Agent 2. Nov 5 01:20:20 kjcf05n07 systemd[1]: Started Zabbix Agent 2. Nov 5 01:20:20 kjcf05n07 puppet-agent[2788716]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: Press Ctrl+C to exit. Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: Plugin support version 1.0 Nov 5 01:20:20 kjcf05n07 zabbix_agent2[2789134]: Zabbix Agent2 hostname: [kjcf05n07,enclosure_USE26000024VS005,lustre_kjcf05] Nov 5 01:20:21 kjcf05n01 puppet-agent[4001021]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 5 01:20:21 kjcf05n01 puppet-agent[4001021]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-05-00:56:27]/mode) mode changed '0755' to '0750' Nov 5 01:20:21 kjcf05n01 puppet-agent[4001021]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-05-00:56:27/kexec-dmesg.log]/mode) mode changed '0644' to '0640' Nov 5 01:20:21 kjcf05n01 puppet-agent[4001021]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-05-00:56:27/vmcore]/mode) mode changed '0600' to '0640' Nov 5 01:20:21 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 5 01:20:21 kjcf05n01 puppet-agent[4001021]: (/Stage[main]/Nfs::Mgmt/File[/mnt/nfsdata/kdump/var/crash/172.16.2.5-2024-11-05-00:56:27/vmcore-dmesg.txt]/mode) mode changed '0644' to '0640' Nov 5 01:20:21 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 5 01:20:21 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 5 01:20:21 kjcf05n03 puppet-agent[113020]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 01:20:21 kjcf05n03 puppet-agent[113020]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 01:20:21 kjcf05n03 puppet-agent[113020]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 01:20:21 kjcf05n03 puppet-agent[113020]: Applied catalog in 5.06 seconds Nov 5 01:20:22 kjcf05n02 puppet-agent[57615]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 01:20:22 kjcf05n02 puppet-agent[57615]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 01:20:22 kjcf05n02 puppet-agent[57615]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 01:20:21 kjcf05n00 puppet-agent[2610611]: (/Stage[main]/Wake_on_lan/Exec[ethtool-enable-WoL]/returns) executed successfully (corrective) Nov 5 01:20:22 kjcf05n06 puppet-agent[2788016]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 01:20:22 kjcf05n06 puppet-agent[2788016]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 01:20:22 kjcf05n06 puppet-agent[2788016]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 01:20:22 kjcf05n02 puppet-agent[57615]: Applied catalog in 5.00 seconds Nov 5 01:20:22 kjcf05n07 puppet-agent[2788716]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 01:20:22 kjcf05n07 puppet-agent[2788716]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 01:20:22 kjcf05n07 puppet-agent[2788716]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 01:20:22 kjcf05n07 puppet-agent[2788716]: Applied catalog in 4.83 seconds Nov 5 01:20:22 kjcf05n01 puppet-agent[4001021]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 01:20:22 kjcf05n01 puppet-agent[4001021]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 01:20:22 kjcf05n01 puppet-agent[4001021]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 01:20:22 kjcf05n06 puppet-agent[2788016]: Applied catalog in 4.88 seconds Nov 5 01:20:22 kjcf05n00 puppet-agent[2610611]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 01:20:22 kjcf05n00 puppet-agent[2610611]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 01:20:22 kjcf05n00 puppet-agent[2610611]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 01:20:23 kjcf05n01 systemd[1]: Stopping Zabbix Agent 2... Nov 5 01:20:23 kjcf05n01 zabbix_agent2[3989252]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 01:20:23 kjcf05n01 zabbix_agent2[15072]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n01 Nov 5 01:20:23 kjcf05n01 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 01:20:23 kjcf05n01 systemd[1]: Stopped Zabbix Agent 2. Nov 5 01:20:23 kjcf05n01 systemd[1]: Started Zabbix Agent 2. Nov 5 01:20:23 kjcf05n01 puppet-agent[4001021]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: Press Ctrl+C to exit. Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: Plugin support version 1.0 Nov 5 01:20:23 kjcf05n01 zabbix_agent2[4001487]: Zabbix Agent2 hostname: [kjcf05n01,mgmt,enclosure_USE26000024VS00F] Nov 5 01:20:23 kjcf05n00 systemd[1]: Stopping Zabbix Agent 2... Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2591918]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 01:20:23 kjcf05n00 zabbix_agent2[15617]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 5 01:20:23 kjcf05n00 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 01:20:23 kjcf05n00 systemd[1]: Stopped Zabbix Agent 2. Nov 5 01:20:23 kjcf05n00 systemd[1]: Started Zabbix Agent 2. Nov 5 01:20:23 kjcf05n00 puppet-agent[2610611]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: Press Ctrl+C to exit. Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: Plugin support version 1.0 Nov 5 01:20:23 kjcf05n00 zabbix_agent2[2611151]: Zabbix Agent2 hostname: [kjcf05n00,mgmt,enclosure_USE26000024VS00F] Nov 5 01:20:23 kjcf05n00 zabbix-server[2611179]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 01:20:24 kjcf05n00 zabbix-server[2611181]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 01:20:24 kjcf05n00 zabbix-server[2611192]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 01:20:25 kjcf05n00 zabbix-server[2611195]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 01:20:25 kjcf05n01 puppet-agent[4001021]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241105_010335.log]/mode) mode changed '0644' to '0640' Nov 5 01:20:25 kjcf05n01 puppet-agent[4001021]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/md_stats_kjcf05n02_20241105_011518.log]/mode) mode changed '0644' to '0640' Nov 5 01:20:25 kjcf05n01 puppet-agent[4001021]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241105_011518]/mode) mode changed '0755' to '0750' Nov 5 01:20:25 kjcf05n01 puppet-agent[4001021]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n02]/File[/mnt/nfsdata/llog/kjcf05n02/vmstat_kjcf05n02_20241105_011518/screenlog.0]/mode) mode changed '0644' to '0640' Nov 5 01:20:25 kjcf05n00 puppet-agent[2610611]: (/Stage[main]/Csm_dcs::Server/Exec[install_array_config]/returns) executed successfully (corrective) Nov 5 01:20:26 kjcf05n01 puppet-agent[4001021]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241105_010335.log]/mode) mode changed '0644' to '0640' Nov 5 01:20:26 kjcf05n01 puppet-agent[4001021]: (/Stage[main]/Nfs::Mgmt/Nfs::Llog_dir[kjcf05n03]/File[/mnt/nfsdata/llog/kjcf05n03/md_stats_kjcf05n03_20241105_011518.log]/mode) mode changed '0644' to '0640' Nov 5 01:20:26 kjcf05n01 puppet-agent[4001021]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 01:20:26 kjcf05n01 puppet-agent[4001021]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 01:20:26 kjcf05n01 puppet-agent[4001021]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 01:20:26 kjcf05n00 puppet-agent[2610611]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 01:20:26 kjcf05n00 puppet-agent[2610611]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 01:20:26 kjcf05n00 puppet-agent[2610611]: (/Stage[main]/Meltdown::Mgmt/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 01:20:27 kjcf05n00 systemd[1]: run-lustre_client-mountpoint.mount: What= setting is missing. Refusing. Nov 5 01:20:27 kjcf05n00 systemd[15617]: Last message 'run-lustre_client-mo' repeated 2 times, suppressed by syslog-ng on kjcf05n00 Nov 5 01:20:27 kjcf05n00 puppet-agent[2610611]: Applied catalog in 8.38 seconds Nov 5 01:20:27 kjcf05n01 puppet-agent[4001021]: Applied catalog in 9.00 seconds Nov 5 01:20:28 kjcf05n00 mcfcli[3673891]: %3|1730791228.878|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:20:30 kjcf05n00 mcfcli[3673891]: %3|1730791230.217|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 01:20:31 kjcf05n05 puppet-agent[2986993]: Caching catalog for kjcf05n05 Nov 5 01:20:31 kjcf05n05 puppet-agent[2986993]: Applying configuration version '1730791229' Nov 5 01:20:33 kjcf05n05 puppet-agent[2986993]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 01:20:33 kjcf05n05 puppet-agent[2986993]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 01:20:33 kjcf05n05 puppet-agent[2986993]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 01:20:34 kjcf05n05 systemd[1]: Stopping Zabbix Agent 2... Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2929873]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 01:20:34 kjcf05n05 zabbix_agent2[8085]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n05 Nov 5 01:20:34 kjcf05n05 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 01:20:34 kjcf05n05 systemd[1]: Stopped Zabbix Agent 2. Nov 5 01:20:34 kjcf05n05 systemd[1]: Started Zabbix Agent 2. Nov 5 01:20:34 kjcf05n05 puppet-agent[2986993]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: Press Ctrl+C to exit. Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: Plugin support version 1.0 Nov 5 01:20:34 kjcf05n05 zabbix_agent2[2988757]: Zabbix Agent2 hostname: [kjcf05n05,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 5 01:20:36 kjcf05n05 puppet-agent[2986993]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 01:20:36 kjcf05n05 puppet-agent[2986993]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 01:20:36 kjcf05n05 puppet-agent[2986993]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 01:20:36 kjcf05n05 puppet-agent[2986993]: Applied catalog in 4.84 seconds Nov 5 01:20:39 kjcf05n04 puppet-agent[2772529]: Caching catalog for kjcf05n04 Nov 5 01:20:39 kjcf05n04 puppet-agent[2772529]: Applying configuration version '1730791237' Nov 5 01:20:41 kjcf05n04 puppet-agent[2772529]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 01:20:41 kjcf05n04 puppet-agent[2772529]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 01:20:41 kjcf05n04 puppet-agent[2772529]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 01:20:41 kjcf05n00 python3.9[2611293]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 5 01:20:42 kjcf05n04 systemd[1]: Stopping Zabbix Agent 2... Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2715042]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 01:20:42 kjcf05n04 zabbix_agent2[7867]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n04 Nov 5 01:20:42 kjcf05n04 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 01:20:42 kjcf05n04 systemd[1]: Stopped Zabbix Agent 2. Nov 5 01:20:42 kjcf05n04 systemd[1]: Started Zabbix Agent 2. Nov 5 01:20:42 kjcf05n04 puppet-agent[2772529]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: Press Ctrl+C to exit. Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: Plugin support version 1.0 Nov 5 01:20:42 kjcf05n04 zabbix_agent2[2773638]: Zabbix Agent2 hostname: [kjcf05n04,enclosure_SGFGD20025060FF,enclosure_USE26000024VS00B,lustre_kjcf05] Nov 5 01:20:43 kjcf05n04 puppet-agent[2772529]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 01:20:43 kjcf05n04 puppet-agent[2772529]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 01:20:43 kjcf05n04 puppet-agent[2772529]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 01:20:43 kjcf05n00 zabbix-server[2610458]: puppet completed status:(0): '' Nov 5 01:20:43 kjcf05n00 zabbix-server[2610458]: Event '46938' acknowledged Nov 5 01:20:43 kjcf05n00 zabbix-server[2610458]: IEC: 010002004: DCS mounted Lustre filesystem notification event was triggered: b'{"filesystem": "kjcf05", "origin_server_node": "kjcf05n02"}' Nov 5 01:20:44 kjcf05n04 puppet-agent[2772529]: Applied catalog in 4.79 seconds Nov 5 01:21:00 kjcf05n00 mcfcli[3673891]: %3|1730791260.218|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:21:07 kjcf05n00 mcfcli[3673891]: %3|1730791267.456|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:21:30 kjcf05n00 mcfcli[3673891]: %3|1730791290.663|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 01:21:45 kjcf05n00 mcfcli[3673891]: %3|1730791305.858|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:22:00 kjcf05n00 mcfcli[3673891]: %3|1730791320.663|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:22:24 kjcf05n00 mcfcli[3673891]: %3|1730791344.138|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:22:30 kjcf05n00 mcfcli[3673891]: %3|1730791350.663|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 01:23:00 kjcf05n00 mcfcli[3673891]: %3|1730791380.442|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:23:00 kjcf05n00 mcfcli[3673891]: %3|1730791380.664|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 01:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T07:23:15.867678Z lvl=info msg="Retention policy deletion check (start)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=start Nov 5 01:23:15 kjcf05n00 influxd-systemd-start.sh[14551]: ts=2024-11-05T07:23:15.867743Z lvl=info msg="Retention policy deletion check (end)" log_id=0s8llxRG000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.084ms Nov 5 01:23:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-05T01:23:27.267785498-06:00 level=info msg="Completed cleanup jobs" duration=41.141223ms Nov 5 01:23:30 kjcf05n00 mcfcli[3673891]: %3|1730791410.664|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:23:36 kjcf05n00 mcfcli[3673891]: %3|1730791416.652|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:24:00 kjcf05n00 mcfcli[3673891]: %3|1730791440.665|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 01:24:13 kjcf05n00 zabbix_server[15643]: executing housekeeper Nov 5 01:24:13 kjcf05n00 zabbix_server[15643]: housekeeper [deleted 0 hist/trends, 0 items/triggers, 0 events, 0 problems, 0 sessions, 0 alarms, 0 audit, 0 records in 0.007630 sec, idle for 1 hour(s)] Nov 5 01:24:14 kjcf05n00 mcfcli[3673891]: %3|1730791454.511|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:24:30 kjcf05n00 mcfcli[3673891]: %3|1730791470.665|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:24:54 kjcf05n00 mcfcli[3673891]: %3|1730791494.067|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:25:00 kjcf05n00 mcfcli[3673891]: %3|1730791500.665|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:25:30 kjcf05n01 diskmonitor[1331407]: leaving test state: 1 next state: 2 Nov 5 01:25:30 kjcf05n01 diskmonitor[1331407]: lock req: no timeout Nov 5 01:25:30 kjcf05n01 diskmonitor[1331407]: leaving test state: 2 next state: 4 Nov 5 01:25:30 kjcf05n00 mcfcli[3673891]: %3|1730791530.665|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:25:32 kjcf05n00 mcfcli[3673891]: %3|1730791532.956|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:25:43 kjcf05n00 python3.9[2614249]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 5 01:26:00 kjcf05n00 mcfcli[3673891]: %3|1730791560.665|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:26:12 kjcf05n00 mcfcli[3673891]: %3|1730791572.488|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:26:22 kjcf05n00 zabbix_server[15743]: Zabbix agent item "dcs.lustre.device.mdt.name[MDT0000,mdt_name]" on host "lustre_kjcf05" failed: first network error, wait for 15 seconds Nov 5 01:26:22 kjcf05n00 zabbix_server[15782]: Zabbix agent item "vm.memory.size[cached]" on host "kjcf05n02" failed: first network error, wait for 15 seconds Nov 5 01:26:29 kjcf05n01 systemd[1]: Starting "vmcore cleanup"... Nov 5 01:26:29 kjcf05n01 systemd[1]: clean_kdump.service: Succeeded. Nov 5 01:26:29 kjcf05n01 systemd[1]: Started "vmcore cleanup". Nov 5 01:26:29 kjcf05n03 fstonithd.py[15181]: My partner 172.16.2.5 is kdumping. Forcing HA into GATHER state. Nov 5 01:26:30 kjcf05n00 mcfcli[3673891]: %3|1730791590.666|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:26:31 kjcf05n03 root[123612]: is_viking_off starts Nov 5 01:26:31 kjcf05n03 root[123611]: is_enc_ipmi_off starts Nov 5 01:26:31 kjcf05n03 root[123641]: is_lan_ipmi_off leaves Nov 5 01:26:31 kjcf05n03 root[123643]: is_lan_ipmi_sec_off leaves Nov 5 01:26:31 kjcf05n03 root[123646]: I am in slot 1; partner is in slot 0 Nov 5 01:26:31 kjcf05n03 root[123649]: I am master Nov 5 01:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 5 01:26:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 5 01:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 5 01:26:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 5 01:26:37 kjcf05n01 diskmonitor[1331407]: lock acquired Nov 5 01:26:37 kjcf05n01 diskmonitor[1331407]: leaving test state: 4 next state: 8 Nov 5 01:26:37 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0000,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 5 01:26:37 kjcf05n00 zabbix_server[15783]: Zabbix agent item "system.cpu.load[all,avg1]" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 5 01:26:37 kjcf05n03 root[123754]: is_viking_off leaves Nov 5 01:26:37 kjcf05n03 root[123757]: kjcf05n02 not already off look at kdump Nov 5 01:26:37 kjcf05n03 root[123758]: is_kdump_off starts Nov 5 01:26:37 kjcf05n03 fence_kdump[123759]: waiting for message from '172.16.2.5' Nov 5 01:26:37 kjcf05n03 fence_kdump[123759]: received valid message from '172.16.2.5' Nov 5 01:26:37 kjcf05n03 root[123760]: is_kdump_off detected kdump on kjcf05n02 Nov 5 01:26:38 kjcf05n03 root[123761]: kjcf05n02 is kdumping Nov 5 01:26:38 kjcf05n03 root[123874]: is_viking_off starts Nov 5 01:26:38 kjcf05n03 root[123875]: is_enc_ipmi_off starts Nov 5 01:26:38 kjcf05n03 root[123894]: I am master Nov 5 01:26:38 kjcf05n03 root[123897]: I am in slot 1; partner is in slot 0 Nov 5 01:26:38 kjcf05n03 root[123905]: is_lan_ipmi_off leaves Nov 5 01:26:38 kjcf05n03 root[123907]: is_lan_ipmi_sec_off leaves Nov 5 01:26:40 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib0 Nov 5 01:26:40 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib0 Nov 5 01:26:40 kjcf05n00 python3.9[8977]: nodes-monitor [MainThread]: Not creating auto-bundle because trigger Failover is disabled Nov 5 01:26:40 kjcf05n00 python3.9[8977]: app: Not creating auto-bundle because trigger Failover is disabled Nov 5 01:26:44 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib1 Nov 5 01:26:44 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib1 Nov 5 01:26:44 kjcf05n03 root[124199]: is_viking_off leaves Nov 5 01:26:45 kjcf05n03 root[124202]: kjcf05n02 not already off look at kdump Nov 5 01:26:45 kjcf05n03 root[124203]: is_kdump_off starts Nov 5 01:26:45 kjcf05n03 fence_kdump[124204]: waiting for message from '172.16.2.5' Nov 5 01:26:46 kjcf05n03 fence_kdump[124204]: received valid message from '172.16.2.5' Nov 5 01:26:46 kjcf05n03 root[124222]: is_kdump_off detected kdump on kjcf05n02 Nov 5 01:26:46 kjcf05n03 root[124223]: kjcf05n02 is kdumping Nov 5 01:26:50 kjcf05n03 systemd-udevd[126432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126431]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126435]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126436]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_dirty_mb=2000'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126431]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126435]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126436]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126431]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126435]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126436]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000..checksums=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126431]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126435]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126436]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_mod_rpcs_in_flight=7'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126431]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126435]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126436]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126431]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126435]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126436]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126458]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126461]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126463]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126431]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126465]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126436]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126435]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.checksums=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126458]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126432]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0000-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126461]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126431]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0001-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126465]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126435]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0003-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126436]: Process '/usr/sbin/lctl set_param 'osp.kjcf05-OST0002-osc-MDT0000.resend_count=43'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126458]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126432]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126435]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126436]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126432]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126436]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126432]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126458]: Process '/usr/sbin/lctl set_param 'osc.*.max_pages_per_rpc=1024'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126435]: Process '/usr/sbin/lctl set_param 'obdfilter.*.brw_size=16'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126465]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_mb=2048'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126432]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126436]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0000*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126435]: Process '/usr/sbin/lctl set_param 'llite.*.max_read_ahead_per_file_mb=2048'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126432]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.read_cache_enable=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126436]: Process '/usr/sbin/lctl set_param 'osc.kjcf05-OST0001*.max_pages_per_rpc=4096'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126432]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.read_cache_enable=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126432]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.read_cache_enable=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126436]: Process '/usr/sbin/lctl set_param 'osc.*.max_dirty_mb=2000'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126432]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.read_cache_enable=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126436]: Process '/usr/sbin/lctl set_param 'osc.*.checksums=1'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126432]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0000.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126436]: Process '/usr/sbin/lctl set_param 'osc.*.idle_timeout=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126432]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0001.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126432]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0002.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n03 systemd-udevd[126432]: Process '/usr/sbin/lctl set_param 'osd-ldiskfs.kjcf05-OST0003.writethrough_cache_enable=0'' failed with exit code 2. Nov 5 01:26:50 kjcf05n00 syslog-ng[15617]: Error reading RFC6587 style framed data; fd='39', error='Connection reset by peer (104)' Nov 5 01:26:50 kjcf05n00 syslog-ng[15617]: Syslog connection closed; fd='39', client='AF_INET(172.16.2.5:40213)', local='AF_INET(0.0.0.0:601)' Nov 5 01:26:50 kjcf05n01 diskmonitor[1331407]: Test selected disk: eui.34594e304e3005410025384500000001_S4YNNE0N300541 Nov 5 01:26:50 kjcf05n01 diskmonitor[1331407]: leaving test state: 8 next state: 20 Nov 5 01:26:50 kjcf05n01 diskmonitor[1331407]: leaving test state: 20 next state: 40 Nov 5 01:26:50 kjcf05n01 diskmonitor[1331407]: Test /dev/disk/by-id/nvme-eui.34594e304e3005410025384500000001_S4YNNE0N300541, offset 13124420000 Nov 5 01:26:50 kjcf05n01 diskmonitor[1331407]: leaving test state: 40 next state: 80 Nov 5 01:26:50 kjcf05n03 dwd[5226]: Disk nvme3n1 has WWN eui.345950304e3006450025384500000003 Nov 5 01:26:50 kjcf05n03 dwd[5226]: Disk nvme18n1 has WWN eui.345950304e3014370025384500000005 Nov 5 01:26:50 kjcf05n03 dwd[5226]: Disk nvme23n1 has WWN eui.345950304db010060025384500000004 Nov 5 01:26:50 kjcf05n03 dwd[5226]: Disk nvme9n1 has WWN eui.345950304e3006310025384500000003 Nov 5 01:26:50 kjcf05n03 dwd[5226]: Disk nvme17n1 has WWN eui.345950304db010240025384500000004 Nov 5 01:26:50 kjcf05n03 dwd[5226]: Disk nvme2n1 has WWN eui.345950304e3006250025384500000003 Nov 5 01:26:50 kjcf05n03 dwd[5226]: Disk nvme8n1 has WWN eui.345950304e3006430025384500000003 Nov 5 01:26:50 kjcf05n03 dwd[5226]: Disk nvme25n1 has WWN eui.345950304db009960025384500000004 Nov 5 01:26:50 kjcf05n03 dwd[5226]: Disk nvme4n1 has WWN eui.345950304e3006300025384500000003 Nov 5 01:26:50 kjcf05n03 dwd[5226]: Disk nvme19n1 has WWN eui.345950304db010160025384500000004 Nov 5 01:26:50 kjcf05n03 dwd[5226]: Disk nvme24n1 has WWN eui.345950304db010260025384500000004 Nov 5 01:26:51 kjcf05n03 dwd[5226]: Starting NVME thread for nvme23n1 Nov 5 01:26:51 kjcf05n03 dwd[5226]: Starting NVME thread for nvme18n1 Nov 5 01:26:51 kjcf05n03 dwd[5226]: Starting NVME thread for nvme25n1 Nov 5 01:26:51 kjcf05n03 dwd[5226]: Starting NVME thread for nvme17n1 Nov 5 01:26:51 kjcf05n03 dwd[5226]: Starting NVME thread for nvme3n1 Nov 5 01:26:51 kjcf05n00 mcfcli[3673891]: %3|1730791611.252|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:26:51 kjcf05n03 dwd[5226]: Starting NVME thread for nvme9n1 Nov 5 01:26:51 kjcf05n03 dwd[5226]: Starting NVME thread for nvme8n1 Nov 5 01:26:52 kjcf05n03 dwd[5226]: Starting NVME thread for nvme19n1 Nov 5 01:26:52 kjcf05n03 dwd[5226]: Starting NVME thread for nvme24n1 Nov 5 01:26:52 kjcf05n03 dwd[5226]: Starting NVME thread for nvme2n1 Nov 5 01:26:52 kjcf05n00 zabbix_server[15783]: Zabbix agent item "proc.num" on host "kjcf05n02" failed: another network error, wait for 15 seconds Nov 5 01:26:52 kjcf05n00 zabbix_server[15783]: Zabbix agent item "dcs.lustre.device.ost.name[OST0001,ost_name]" on host "lustre_kjcf05" failed: another network error, wait for 15 seconds Nov 5 01:26:52 kjcf05n03 dwd[5226]: Starting NVME thread for nvme4n1 Nov 5 01:26:55 kjcf05n03 diskmonitor[17542]: IEC: 012001001: MD Array: {"name": "md65", "UUID": "794fe8ae:1f010087:7de04f0b:557d9e3f", "status": "Optimal"} Nov 5 01:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 5 01:26:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 5 01:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 5 01:26:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 5 01:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 5 01:26:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 5 01:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 5 01:27:00 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 5 01:27:00 kjcf05n00 mcfcli[3673891]: %3|1730791620.667|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 5 01:27:05 kjcf05n03 diskmonitor[17542]: Array md65 has ext4 label: kjcf05-MDT0000 Nov 5 01:27:05 kjcf05n03 diskmonitor[17542]: Scan for ReadErrorMax change for md65 Nov 5 01:27:05 kjcf05n03 diskmonitor[17542]: set /sys/devices/virtual/block/md65/md/max_read_errors to 20 Nov 5 01:27:05 kjcf05n03 diskmonitor[17542]: Added MD Array: md65, UUID: 794fe8ae:1f010087:7de04f0b:557d9e3f Nov 5 01:27:05 kjcf05n03 diskmonitor[17542]: read_saved_file: md65 no saved speed Nov 5 01:27:05 kjcf05n03 diskmonitor[17542]: reconstruction_policy: sync_action prev = current = idle - md65 Nov 5 01:27:05 kjcf05n03 diskmonitor[17542]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 5 01:27:07 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "kjcf05n02": interface unavailable Nov 5 01:27:07 kjcf05n00 zabbix_server[15783]: temporarily disabling Zabbix agent checks on host "lustre_kjcf05": interface unavailable Nov 5 01:27:29 kjcf05n00 mcfcli[3673891]: %3|1730791649.128|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:27:31 kjcf05n00 mcfcli[3673891]: %3|1730791651.166|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 01:27:32 kjcf05n01 diskmonitor[1331407]: leaving test state: 80 next state: 100 Nov 5 01:27:32 kjcf05n01 diskmonitor[1331407]: lock release: time: Tue Nov 5 01:27:31 2024 Nov 5 01:27:32 kjcf05n01 diskmonitor[1331407]: leaving test state: 100 next state: 1 Nov 5 01:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 5 01:27:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 5 01:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 5 01:27:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 5 01:27:40 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib0 Nov 5 01:27:40 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib0 Nov 5 01:27:44 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib1 Nov 5 01:27:44 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib1 Nov 5 01:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 5 01:27:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 5 01:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 5 01:27:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 5 01:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 5 01:27:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 5 01:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 5 01:27:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 5 01:28:01 kjcf05n00 mcfcli[3673891]: %3|1730791681.167|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:28:05 kjcf05n00 mcfcli[3673891]: %3|1730791685.525|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:28:31 kjcf05n00 mcfcli[3673891]: %3|1730791711.167|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 5 01:28:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 5 01:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 5 01:28:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 5 01:28:40 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib0 Nov 5 01:28:40 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib0 Nov 5 01:28:43 kjcf05n00 mcfcli[3673891]: %3|1730791723.338|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:28:45 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib1 Nov 5 01:28:45 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib1 Nov 5 01:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 5 01:28:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 5 01:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 5 01:28:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 5 01:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 5 01:28:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 5 01:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 5 01:28:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 5 01:29:01 kjcf05n00 mcfcli[3673891]: %3|1730791741.168|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:29:23 kjcf05n00 mcfcli[3673891]: %3|1730791763.335|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:29:31 kjcf05n00 mcfcli[3673891]: %3|1730791771.168|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 5 01:29:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 5 01:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 5 01:29:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 5 01:29:40 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib0 Nov 5 01:29:40 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib0 Nov 5 01:29:45 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib1 Nov 5 01:29:45 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib1 Nov 5 01:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 5 01:29:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 5 01:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 5 01:29:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 5 01:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 5 01:29:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 5 01:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 5 01:29:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 5 01:30:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 5 01:30:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:30:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 5 01:30:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 5 01:30:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:30:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 5 01:30:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 5 01:30:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:30:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 5 01:30:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 5 01:30:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:30:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 5 01:30:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 5 01:30:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:30:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 5 01:30:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 5 01:30:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:30:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 5 01:30:00 kjcf05n00 mcfcli[3673891]: %3|1730791800.413|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:30:01 kjcf05n00 mcfcli[3673891]: %3|1730791801.168|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 01:30:02 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 5 01:30:02 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:30:02 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 5 01:30:11 kjcf05n00 zabbix-server[2616796]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 01:30:11 kjcf05n00 zabbix-server[2616796]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Zabbix agent is not available (for 3m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Zabbix agent availability (kjcf05n02:zabbix[host,agent,available]): not available (0)\\"}}"' Nov 5 01:30:11 kjcf05n00 log_interesting_event.py[2616796]: Event '46940' acknowledged Nov 5 01:30:12 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 5 01:30:16 kjcf05n01 dnsmasq-dhcp[15046]: DHCPDISCOVER(mgmt0) 00:09:3d:06:95:e2 Nov 5 01:30:16 kjcf05n01 dnsmasq-dhcp[15046]: DHCPOFFER(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 5 01:30:20 kjcf05n01 dnsmasq-dhcp[15046]: DHCPREQUEST(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 Nov 5 01:30:20 kjcf05n01 dnsmasq-dhcp[15046]: DHCPACK(mgmt0) 172.16.2.5 00:09:3d:06:95:e2 kjcf05n02 Nov 5 01:30:20 kjcf05n01 dnsmasq-tftp[15046]: error 0 TFTP Aborted received from 172.16.2.5 Nov 5 01:30:20 kjcf05n01 dnsmasq-tftp[15046]: failed sending /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 5 01:30:20 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/pxelinux.0 to 172.16.2.5 Nov 5 01:30:20 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot/ldlinux.c32 to 172.16.2.5 Nov 5 01:30:20 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/pxelinux.cfg to 172.16.2.5 Nov 5 01:30:23 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/vmlinuz_diskless to 172.16.2.5 Nov 5 01:30:25 kjcf05n01 dnsmasq-tftp[15046]: sent /mnt/nfsdata/tftpboot//nodes/kjcf05n02/boot/initramfs-diskless.img to 172.16.2.5 Nov 5 01:30:31 kjcf05n00 mcfcli[3673891]: %3|1730791831.168|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 5 01:30:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 5 01:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 5 01:30:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 5 01:30:38 kjcf05n00 mcfcli[3673891]: %3|1730791838.935|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:30:40 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib0 Nov 5 01:30:40 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib0 Nov 5 01:30:44 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib1 Nov 5 01:30:44 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib1 Nov 5 01:30:46 kjcf05n00 python3.9[2617198]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 5 01:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 5 01:30:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 5 01:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 5 01:30:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 5 01:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 5 01:30:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 5 01:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 5 01:30:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 5 01:31:01 kjcf05n00 mcfcli[3673891]: %3|1730791861.168|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:31:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730791866', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 5 01:31:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730791866'} Nov 5 01:31:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:31:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730791866', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 5 01:31:06 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730791866'} Nov 5 01:31:06 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:31:13 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:50150). Nov 5 01:31:13 kjcf05n01 rsyncd[4006366]: connect from kjcf05n02 (172.16.2.5) Nov 5 01:31:13 kjcf05n01 rsyncd[4006366]: rsync on puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 5 01:31:13 kjcf05n01 rsyncd[4006366]: building file list Nov 5 01:31:13 kjcf05n01 rsyncd[4006366]: sent 11450 bytes received 136 bytes total size 10905 Nov 5 01:31:13 kjcf05n01 systemd[1]: rsyncd@681-172.16.2.2:873-172.16.2.5:50150.service: Succeeded. Nov 5 01:31:16 kjcf05n00 mcfcli[3673891]: %3|1730791876.107|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:31:29 kjcf05n03 fstonithd.py[15181]: Listening for kdump packets from partner Nov 5 01:31:31 kjcf05n00 mcfcli[3673891]: %3|1730791891.169|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 5 01:31:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 5 01:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 5 01:31:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 5 01:31:40 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib0 Nov 5 01:31:40 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib0 Nov 5 01:31:45 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib1 Nov 5 01:31:45 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib1 Nov 5 01:31:53 kjcf05n00 mcfcli[3673891]: %3|1730791913.875|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 5 01:31:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 5 01:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 5 01:31:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 5 01:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 5 01:31:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 5 01:31:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 5 01:31:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 5 01:32:01 kjcf05n00 mcfcli[3673891]: %3|1730791921.221|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 01:32:16 kjcf05n03 dwd[5226]: nvme23n1 passed periodic SMART status check Nov 5 01:32:17 kjcf05n03 dwd[5226]: nvme9n1 passed periodic SMART status check Nov 5 01:32:17 kjcf05n03 dwd[5226]: nvme3n1 passed periodic SMART status check Nov 5 01:32:17 kjcf05n03 dwd[5226]: nvme8n1 passed periodic SMART status check Nov 5 01:32:17 kjcf05n03 dwd[5226]: nvme17n1 passed periodic SMART status check Nov 5 01:32:17 kjcf05n03 dwd[5226]: nvme18n1 passed periodic SMART status check Nov 5 01:32:17 kjcf05n03 dwd[5226]: nvme25n1 passed periodic SMART status check Nov 5 01:32:18 kjcf05n03 dwd[5226]: nvme24n1 passed periodic SMART status check Nov 5 01:32:18 kjcf05n03 dwd[5226]: nvme4n1 passed periodic SMART status check Nov 5 01:32:18 kjcf05n03 dwd[5226]: nvme2n1 passed periodic SMART status check Nov 5 01:32:18 kjcf05n03 dwd[5226]: nvme19n1 passed periodic SMART status check Nov 5 01:32:31 kjcf05n00 mcfcli[3673891]: %3|1730791951.221|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:32:31 kjcf05n00 mcfcli[3673891]: %3|1730791951.959|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.52 is unreachable via ib0 Nov 5 01:32:37 kjcf05n05 LCNmon[49165]: 10.16.100.58 is unreachable via ib0 Nov 5 01:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.52 is unreachable via ib0 Nov 5 01:32:37 kjcf05n04 LCNmon[48428]: 10.16.100.58 is unreachable via ib0 Nov 5 01:32:39 kjcf05n00 syslog-ng[15617]: Syslog connection accepted; fd='47', client='AF_INET(172.16.2.5:40319)', local='AF_INET(0.0.0.0:601)' Nov 5 01:32:39 kjcf05n02 syslog-ng[3132]: Configuration reload request received, reloading configuration; Nov 5 01:32:39 kjcf05n02 syslog-ng[3132]: Configuration reload finished; Nov 5 01:32:39 kjcf05n02 syslog-ng[3132]: Syslog connection established; fd='19', server='AF_INET(172.16.2.1:601)', local='AF_INET(0.0.0.0:0)' Nov 5 01:32:39 kjcf05n02 dracut: dracut-049-135.git20210121.el8 Nov 5 01:32:39 kjcf05n02 dracut: livenet: root image at nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 5 01:32:39 kjcf05n02 dracut: Loading and integrity checking all crypto modules Nov 5 01:32:39 kjcf05n02 dracut: Self testing crypto algorithms Nov 5 01:32:39 kjcf05n02 dracut: rd.md=0: removing MD RAID activation Nov 5 01:32:39 kjcf05n02 dracut: fetching nfs:172.16.2.2:/mnt/nfsdata/images/6.7-020.141_LUS-10208_2.16.0_RC5_4_g60e267b/appliance.x86_64.squashfs:ro,nfsvers=3 Nov 5 01:32:39 kjcf05n02 Copying live image to RAM... Nov 5 01:32:39 kjcf05n02 (this may take a minute) Nov 5 01:32:39 kjcf05n02 Done copying live image to RAM. Nov 5 01:32:39 kjcf05n02 dracut: Mounted root filesystem LiveOS_rootfs Nov 5 01:32:39 kjcf05n02 dracut: Checking integrity of kernel Nov 5 01:32:39 kjcf05n02 dracut: All initrd crypto checks done Nov 5 01:32:39 kjcf05n02 dracut: Switching root Nov 5 01:32:39 kjcf05n02 systemd: systemd 239 (239-51.el8_5.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) Nov 5 01:32:39 kjcf05n02 systemd: Detected architecture x86-64. Nov 5 01:32:39 kjcf05n02 systemd: Set hostname to . Nov 5 01:32:39 kjcf05n02 systemd: File /usr/lib/systemd/system/systemd-logind.service.d/nss_nis.conf:2 configures an IP firewall (IPAddressAllow=any), but the local system does not support BPF/cgroup based firewalling. Nov 5 01:32:39 kjcf05n02 systemd: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) Nov 5 01:32:39 kjcf05n02 systemd: Listening on Journal Socket (/dev/log). Nov 5 01:32:39 kjcf05n02 systemd: Created slice User and Session Slice. Nov 5 01:32:39 kjcf05n02 systemd: Reached target rpc_pipefs.target. Nov 5 01:32:39 kjcf05n02 systemd: Listening on Device-mapper event daemon FIFOs. Nov 5 01:32:39 kjcf05n02 systemd: Reached target ZFS pool import target. Nov 5 01:32:39 kjcf05n02 systemd-journald[1525]: Journal started Nov 5 01:32:39 kjcf05n02 systemd-journald[1525]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 5 01:32:39 kjcf05n02 systemd-modules-load[1533]: Inserted module 'fuse' Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Read and set NIS domainname from /etc/sysconfig/network. Nov 5 01:32:39 kjcf05n02 systemd[1]: Mounted /mnt. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Load Kernel Modules. Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Apply Kernel Variables... Nov 5 01:32:39 kjcf05n02 systemd[1]: Mounting Kernel Configuration File System... Nov 5 01:32:39 kjcf05n02 systemd[1]: Mounting FUSE Control File System... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Load/Save Random Seed... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Flush Journal to Persistent Storage... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Rebuild Hardware Database... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Create System Users... Nov 5 01:32:39 kjcf05n02 systemd[1]: Mounted Kernel Configuration File System. Nov 5 01:32:39 kjcf05n02 systemd-sysctl[1540]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 5 01:32:39 kjcf05n02 systemd-sysctl[1540]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Apply Kernel Variables. Nov 5 01:32:39 kjcf05n02 systemd[1]: Mounted FUSE Control File System. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Load/Save Random Seed. Nov 5 01:32:39 kjcf05n02 systemd-journald[1525]: Runtime journal (/run/log/journal/bfc36554886d4dac9e6f964eea9cc594) is 8.0M, max 4.0G, 3.9G free. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Flush Journal to Persistent Storage. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Create System Users. Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Create Static Device Nodes in /dev... Nov 5 01:32:39 kjcf05n02 systemd-tmpfiles[1556]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 01:32:39 kjcf05n02 systemd-tmpfiles[1556]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Create Static Device Nodes in /dev. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started udev Coldplug all Devices. Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting udev Wait for Complete Device Initialization... Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Rebuild Hardware Database. Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting udev Kernel Device Manager... Nov 5 01:32:39 kjcf05n02 systemd-udevd[1561]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started udev Kernel Device Manager. Nov 5 01:32:39 kjcf05n02 systemd[1]: Found device /dev/ttyS0. Nov 5 01:32:39 kjcf05n02 systemd-udevd[1633]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:32:39 kjcf05n02 systemd-udevd[1591]: Using default interface naming scheme 'rhel-8.0'. Nov 5 01:32:39 kjcf05n02 systemd-udevd[1591]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:32:39 kjcf05n02 systemd-udevd[1624]: Using default interface naming scheme 'rhel-8.0'. Nov 5 01:32:39 kjcf05n02 systemd-udevd[1624]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:32:39 kjcf05n02 systemd-udevd[1603]: Using default interface naming scheme 'rhel-8.0'. Nov 5 01:32:39 kjcf05n02 systemd-udevd[1603]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Nov 5 01:32:39 kjcf05n02 systemd[1]: Reached target Local File Systems (Pre). Nov 5 01:32:39 kjcf05n02 systemd[1]: Reached target Local File Systems. Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Mark the need to relabel after reboot... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Restore /run/initramfs on shutdown... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Rebuild Dynamic Linker Cache... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Rebuild Journal Catalog... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Create Volatile Files and Directories... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting openibd - configure Mellanox devices... Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Mark the need to relabel after reboot. Nov 5 01:32:39 kjcf05n02 systemd-tmpfiles[1772]: [/usr/lib/tmpfiles.d/nss-pam-ldapd.conf:2] Line references path below legacy directory /var/run/, updating /var/run/nslcd → /run/nslcd; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 01:32:39 kjcf05n02 systemd-tmpfiles[1772]: [/usr/lib/tmpfiles.d/portreserve.conf:1] Line references path below legacy directory /var/run/, updating /var/run/portreserve → /run/portreserve; please update the tmpfiles.d/ drop-in file accordingly. Nov 5 01:32:39 kjcf05n02 systemd-tmpfiles[1772]: "/var/tmp" already exists and is not a directory. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Restore /run/initramfs on shutdown. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Rebuild Journal Catalog. Nov 5 01:32:39 kjcf05n02 root[1787]: openibd: running in auto mode Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Create Volatile Files and Directories. Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Update UTMP about System Boot/Shutdown... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting RPC Bind... Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Update UTMP about System Boot/Shutdown. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started RPC Bind. Nov 5 01:32:39 kjcf05n02 systemd[1]: Created slice system-rdma\x2dload\x2dmodules.slice. Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/infiniband.conf... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting RDMA Node Description Daemon... Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/roce.conf. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started RDMA Node Description Daemon. Nov 5 01:32:39 kjcf05n02 systemd-modules-load[1922]: Inserted module 'ib_iser' Nov 5 01:32:39 kjcf05n02 systemd-modules-load[1922]: Inserted module 'ib_isert' Nov 5 01:32:39 kjcf05n02 systemd-modules-load[1922]: Inserted module 'ib_srpt' Nov 5 01:32:39 kjcf05n02 systemd-modules-load[1921]: Inserted module 'ib_ipoib' Nov 5 01:32:39 kjcf05n02 systemd-udevd[1564]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:32:39 kjcf05n02 systemd-udevd[1633]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:32:39 kjcf05n02 systemd-modules-load[1922]: Inserted module 'rdma_ucm' Nov 5 01:32:39 kjcf05n02 systemd-modules-load[1922]: Module 'svcrdma' is blacklisted Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/rdma.conf. Nov 5 01:32:39 kjcf05n02 systemd-udevd[1633]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 5 01:32:39 kjcf05n02 systemd-udevd[1564]: Process '/usr/bin/killall -SIGHUP irqbalance' failed with exit code 1. Nov 5 01:32:39 kjcf05n02 systemd-modules-load[1921]: Inserted module 'ib_umad' Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Load RDMA modules from /etc/rdma/modules/infiniband.conf. Nov 5 01:32:39 kjcf05n02 systemd[1]: Reached target RDMA Hardware. Nov 5 01:32:39 kjcf05n02 systemd[1]: Reached target Network (Pre). Nov 5 01:32:39 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 5 01:32:39 kjcf05n02 systemd[3132]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:32:39 kjcf05n02 systemd[1]: Created slice system-mlnx_interface_mgr.slice. Nov 5 01:32:39 kjcf05n02 openibd[1773]: Loading HCA driver and Access Layer:[ OK ] Nov 5 01:32:39 kjcf05n02 systemd[1]: Started openibd - configure Mellanox devices. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Rebuild Dynamic Linker Cache. Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Update is Completed... Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Update is Completed. Nov 5 01:32:39 kjcf05n02 setup-icl[1747]: Setting LAN IP Address to 203.0.113.3 Nov 5 01:32:39 kjcf05n02 setup-icl[1747]: Setting LAN Subnet Mask to 255.255.255.0 Nov 5 01:32:39 kjcf05n02 setup-icl[1747]: Setting LAN Default Gateway IP to 0.0.0.0 Nov 5 01:32:39 kjcf05n02 setup-icl[1747]: Setting LAN Backup Gateway IP to 0.0.0.0 Nov 5 01:32:39 kjcf05n02 systemd-udevd[1564]: Using default interface naming scheme 'rhel-8.0'. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started udev Wait for Complete Device Initialization. Nov 5 01:32:39 kjcf05n02 systemd[1]: Reached target System Initialization. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Run system activity accounting tool every 10 minutes. Nov 5 01:32:39 kjcf05n02 systemd[1]: Listening on Name Service Cache Daemon Socket. Nov 5 01:32:39 kjcf05n02 systemd[1]: Listening on D-Bus System Message Bus Socket. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Daily Cleanup of Temporary Directories. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Generate summary of yesterday's process accounting. Nov 5 01:32:39 kjcf05n02 systemd[1]: Listening on lldpad.socket. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started daily update of the root trust anchor for DNSSEC. Nov 5 01:32:39 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsid Socket. Nov 5 01:32:39 kjcf05n02 systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Nov 5 01:32:39 kjcf05n02 systemd[1]: Reached target Sockets. Nov 5 01:32:39 kjcf05n02 systemd[1]: Reached target Basic System. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (stop). Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Configure CPU power related settings, HPE modified... Nov 5 01:32:39 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 0 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 1 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 2 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 3 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 4 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 5 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 6 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 7 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 8 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 9 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 10 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 11 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 12 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 13 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 14 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 15 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 16 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 17 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 18 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 19 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 20 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 21 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 22 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 23 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 24 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 25 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 26 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 27 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 28 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 29 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 30 Nov 5 01:32:39 kjcf05n02 cpupower[2055]: Setting cpu: 31 Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting OpenSSH ecdsa Server Key Generation... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting OpenSSH ed25519 Server Key Generation... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Name Service Cache Daemon... Nov 5 01:32:39 kjcf05n02 chronyd[2079]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[2069]: Setting up Mellanox network interface: ib0 Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 5 01:32:39 kjcf05n02 nscd[2088]: 2088 monitoring file `/etc/hosts` (1) Nov 5 01:32:39 kjcf05n02 nscd[2088]: 2088 monitoring directory `/etc` (2) Nov 5 01:32:39 kjcf05n02 nscd[2088]: 2088 monitoring file `/etc/resolv.conf` (3) Nov 5 01:32:39 kjcf05n02 nscd[2088]: 2088 monitoring directory `/etc` (2) Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Resets System Activity Logs... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting LSB: Bring up/down networking... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 5 01:32:39 kjcf05n02 beSetMlxConfig[2082]: ConnectX-3 multiport not detected Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Machine Check Exception Logging Daemon. Nov 5 01:32:39 kjcf05n02 network[2109]: WARN : [network] You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started D-Bus System Message Bus. Nov 5 01:32:39 kjcf05n02 mcelog[2132]: mcelog: ERROR: AMD Processor family 23: mcelog does not support this processor. Please use the edac_mce_amd module instead. Nov 5 01:32:39 kjcf05n02 mcelog[2132]: CPU is unsupported Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Add back interfaces blacklisted by dracut... Nov 5 01:32:39 kjcf05n02 network[2136]: You are using 'network' service provided by 'network-scripts', which are now deprecated. Nov 5 01:32:39 kjcf05n02 network[2109]: WARN : [network] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Manage Cutlass PHYs... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 5 01:32:39 kjcf05n02 chronyd[2079]: Wrong owner of /var/run/chrony (UID != 991) Nov 5 01:32:39 kjcf05n02 chronyd[2079]: Disabled command socket /var/run/chrony/chronyd.sock Nov 5 01:32:39 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting OpenSSH rsa Server Key Generation... Nov 5 01:32:39 kjcf05n02 mdraid-phy[2155]: no Cutlass to worry about Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[2149]: set_ipoib_cm: ib0 connection mode set to connected Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 01:32:39 kjcf05n02 network[2151]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:32:39 kjcf05n02 network[2109]: WARN : [network] It is advised to switch to 'NetworkManager' instead for network management. Nov 5 01:32:39 kjcf05n02 beSetMlxConfig[2082]: Starting MST (Mellanox Software Tools) driver set Nov 5 01:32:39 kjcf05n02 systemd[1]: Started irqbalance daemon. Nov 5 01:32:39 kjcf05n02 dwd[2164]: dwd: vMay 29 2024 : 15:38:26 Nov 5 01:32:39 kjcf05n02 dwd[2164]: /usr/sbin/dwd -d --standalone=0 Nov 5 01:32:39 kjcf05n02 dwd[2164]: dwd: option Lethal: 0 Nov 5 01:32:39 kjcf05n02 dwd[2164]: dwd: option Interval: 60 Nov 5 01:32:39 kjcf05n02 dwd[2164]: dwd: option abrtlimit: 10 Nov 5 01:32:39 kjcf05n02 dwd[2164]: dwd: option DZPeriod: 604800 Nov 5 01:32:39 kjcf05n02 dwd[2164]: dwd: option SmartPeriod: 43200 Nov 5 01:32:39 kjcf05n02 dwd[2164]: dwd: option SDDEnabled: 1 Nov 5 01:32:39 kjcf05n02 dwd[2164]: dwd: option SDDAwaitScale: 3 Nov 5 01:32:39 kjcf05n02 dwd[2164]: dwd: option SDDAwaitMin: 100 Nov 5 01:32:39 kjcf05n02 dwd[2164]: dwd: option Verbosity: 1 Nov 5 01:32:39 kjcf05n02 dwd[2164]: dwd: option StandAlone: 0 Nov 5 01:32:39 kjcf05n02 dwd[2164]: option Lethal: 0 Nov 5 01:32:39 kjcf05n02 dwd[2164]: option Interval: 60 Nov 5 01:32:39 kjcf05n02 dwd[2164]: option abrtlimit: 10 Nov 5 01:32:39 kjcf05n02 dwd[2164]: option DZPeriod: 604800 Nov 5 01:32:39 kjcf05n02 dwd[2164]: option SmartPeriod: 43200 Nov 5 01:32:39 kjcf05n02 dwd[2164]: option SDDEnabled: 1 Nov 5 01:32:39 kjcf05n02 dwd[2164]: option SDDAwaitScale: 3 Nov 5 01:32:39 kjcf05n02 dwd[2164]: option SDDAwaitMin: 100 Nov 5 01:32:39 kjcf05n02 dwd[2164]: option Verbosity: 1 Nov 5 01:32:39 kjcf05n02 dwd[2164]: option StandAlone: 0 Nov 5 01:32:39 kjcf05n02 dbus-daemon[2141]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 5 01:32:39 kjcf05n02 systemd[1]: sshd-keygen@ecdsa.service: Succeeded. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started OpenSSH ecdsa Server Key Generation. Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[2178]: Setting up Mellanox network interface: ib1 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 0 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 1 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 2 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 3 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 4 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 5 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 6 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 7 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 8 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 9 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 10 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 11 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 12 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 13 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 14 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 15 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 16 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 17 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 18 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 19 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 20 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 21 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 22 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 23 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 24 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 25 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 26 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 27 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 28 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 29 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 30 Nov 5 01:32:39 kjcf05n02 cpupower[2202]: Idlestate 2 disabled on CPU 31 Nov 5 01:32:39 kjcf05n02 systemd[1]: sshd-keygen@ed25519.service: Succeeded. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started OpenSSH ed25519 Server Key Generation. Nov 5 01:32:39 kjcf05n02 network[2188]: It is advised to switch to 'NetworkManager' instead for network management. Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[2194]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 5 01:32:39 kjcf05n02 beSetMlxConfig[2082]: Loading MST PCI module - Success Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Name Service Cache Daemon. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Resets System Activity Logs. Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[2241]: No configuration found for ib0 Nov 5 01:32:39 kjcf05n02 systemd[1]: mcelog.service: Main process exited, code=exited, status=1/FAILURE Nov 5 01:32:39 kjcf05n02 systemd[1]: mcelog.service: Failed with result 'exit-code'. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Manage Cutlass PHYs. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[2247]: set_ipoib_cm: ib1 connection mode set to connected Nov 5 01:32:39 kjcf05n02 beSetMlxConfig[2082]: Loading MST PCI configuration module - Success Nov 5 01:32:39 kjcf05n02 beSetMlxConfig[2082]: Create devices Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Configure CPU power related settings, HPE modified. Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[2253]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Add back interfaces blacklisted by dracut. Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[2268]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 5 01:32:39 kjcf05n02 sssd[sssd][2119]: Starting up Nov 5 01:32:39 kjcf05n02 mlnx_conf_mgr[2291]: INFO: No configurations found for mlx5_0, skipping. Nov 5 01:32:39 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[2308]: No configuration found for ib1 Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[2344]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 5 01:32:39 kjcf05n02 mlnx_conf_mgr[2381]: INFO: No configurations found for mlx5_1, skipping. Nov 5 01:32:39 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 5 01:32:39 kjcf05n02 sssd[be[implicit_files]][2333]: Starting up Nov 5 01:32:39 kjcf05n02 sssd[nss][2469]: Starting up Nov 5 01:32:39 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 5 01:32:39 kjcf05n02 systemd[1]: sshd-keygen@rsa.service: Succeeded. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started OpenSSH rsa Server Key Generation. Nov 5 01:32:39 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 5 01:32:39 kjcf05n02 systemd[1]: Reached target User and Group Name Lookups. Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Login Service... Nov 5 01:32:39 kjcf05n02 systemd-logind[2619]: New seat seat0. Nov 5 01:32:39 kjcf05n02 systemd-logind[2619]: Watching system buttons on /dev/input/event0 (Power Button) Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Login Service. Nov 5 01:32:39 kjcf05n02 python3.9[2184]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 5 01:32:39 kjcf05n02 python3.9[3132]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 01:32:39 kjcf05n02 systemd-sysctl[2767]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 5 01:32:39 kjcf05n02 systemd-sysctl[2767]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 1. Nov 5 01:32:39 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 01:32:39 kjcf05n02 python3.9[2903]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 5 01:32:39 kjcf05n02 python3.9[3132]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 01:32:39 kjcf05n02 network[2109]: Bringing up loopback interface: [ OK ] Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 2. Nov 5 01:32:39 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 01:32:39 kjcf05n02 systemd-sysctl[3114]: Couldn't write '1' to 'kernel/exec-shield', ignoring: No such file or directory Nov 5 01:32:39 kjcf05n02 systemd-sysctl[3114]: Couldn't write '1' to 'net/ipv4/icmp_ignore_bogus_error_messages', ignoring: No such file or directory Nov 5 01:32:39 kjcf05n02 systemd[1]: Started LSB: Bring up/down networking. Nov 5 01:32:39 kjcf05n02 systemd[1]: Reached target Network. Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Logout off all iSCSI sessions on shutdown... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting GSSAPI Proxy Daemon... Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Link Layer Discovery Protocol Agent Daemon.. Nov 5 01:32:39 kjcf05n02 systemd[1]: Reached target Network is Online. Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Notify NFS peers of a restart... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting System Logger Daemon... Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Logout off all iSCSI sessions on shutdown. Nov 5 01:32:39 kjcf05n02 sm-notify[3131]: Version 2.3.3 starting Nov 5 01:32:39 kjcf05n02 python3.9[3109]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 5 01:32:39 kjcf05n02 python3.9[3132]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:32:39 kjcf05n02 systemd[1]: Started GSSAPI Proxy Daemon. Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Notify NFS peers of a restart. Nov 5 01:32:39 kjcf05n02 sshd[3126]: Unable to load host key: /etc/ssh/ssh_host_ed25519_key Nov 5 01:32:39 kjcf05n02 systemd[1]: Reached target NFS client services. Nov 5 01:32:39 kjcf05n02 systemd[1]: Reached target Remote File Systems (Pre). Nov 5 01:32:39 kjcf05n02 systemd[1]: Reached target Remote File Systems. Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Permit User Sessions... Nov 5 01:32:39 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 5 01:32:39 kjcf05n02 beSetMlxConfig[2082]: Unloading MST PCI module (unused) - Success Nov 5 01:32:39 kjcf05n02 lldpad[3128]: setsockopt nearest_bridge: Invalid argument Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Permit User Sessions. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Serial Getty on ttyS0. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Getty on tty1. Nov 5 01:32:39 kjcf05n02 lldpad[3128]: setsockopt nearest_bridge: Invalid argument Nov 5 01:32:39 kjcf05n02 systemd[1]: Reached target Login Prompts. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 3. Nov 5 01:32:39 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 01:32:39 kjcf05n02 syslog-ng[3132]: [2024-11-05T07:31:26.540529] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='log_prefix', change='program_override', location='/etc/syslog-ng/syslog-ng.conf:3:20' Nov 5 01:32:39 kjcf05n02 syslog-ng[3132]: [2024-11-05T07:31:26.540826] Using /dev/log Unix socket with systemd is not possible. Changing to systemd-syslog source, which supports socket activation.; Nov 5 01:32:39 kjcf05n02 syslog-ng[3132]: [2024-11-05T07:31:26.540861] WARNING: Your configuration file uses an obsoleted keyword, please update your configuration; keyword='flush_timeout', change='Some drivers support batch-timeout() instead that you can specify at the destination level.', location='/etc/syslog-ng/syslog-ng.conf:10:2' Nov 5 01:32:39 kjcf05n02 syslog-ng[3132]: [2024-11-05T07:31:26.541429] WARNING: With use-dns(no), dns-cache() will be forced to 'no' too!; Nov 5 01:32:39 kjcf05n02 syslog-ng[3132]: [2024-11-05T07:31:26.541609] Failed to acquire /run/systemd/journal/syslog socket, disabling systemd-syslog source; Nov 5 01:32:39 kjcf05n02 systemd[1]: Started System Logger Daemon. Nov 5 01:32:39 kjcf05n02 python3.9[3270]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 5 01:32:39 kjcf05n02 python3.9[3132]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 4. Nov 5 01:32:39 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 01:32:39 kjcf05n02 python3.9[3382]: [ses_monitor.py:416 - load_config() ] [ERROR] CSM:Generic : Critical error: can't read HW_PROFILE file: [Errno 2] No such file or directory: '/var/lib/xyratex/hw_profile' Nov 5 01:32:39 kjcf05n02 python3.9[3132]: Last message '[ses_monitor.py:416 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Main process exited, code=exited, status=3/NOTIMPLEMENTED Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Service RestartSec=100ms expired, scheduling restart. Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Scheduled restart job, restart counter is at 5. Nov 5 01:32:39 kjcf05n02 systemd[1]: Stopped Startup script for the Xyratex SES Monitor. Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Start request repeated too quickly. Nov 5 01:32:39 kjcf05n02 systemd[1]: ses_monitor.service: Failed with result 'exit-code'. Nov 5 01:32:39 kjcf05n02 systemd[1]: Failed to start Startup script for the Xyratex SES Monitor. Nov 5 01:32:39 kjcf05n02 chronyd[2079]: System's initial offset : 0.002226 seconds slow of true (slew) Nov 5 01:32:39 kjcf05n02 systemd[1]: Started NTP client/server. Nov 5 01:32:39 kjcf05n02 beSetMlxConfig[2082]: Configuring /dev/mst/mt4123_pciconf1 Nov 5 01:32:39 kjcf05n02 beSetMlxConfig[2082]: ib mode Nov 5 01:32:39 kjcf05n02 root[3402]: openibd: Set node_desc for mlx5_0: kjcf05n02 HCA-1 Nov 5 01:32:39 kjcf05n02 root[3404]: openibd: Set node_desc for mlx5_1: kjcf05n02 HCA-2 Nov 5 01:32:39 kjcf05n02 beSetMlxConfig[2082]: Configuring /dev/mst/mt4123_pciconf0 Nov 5 01:32:39 kjcf05n02 beSetMlxConfig[2082]: ib mode Nov 5 01:32:39 kjcf05n02 systemd-udevd[1561]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 01:32:39 kjcf05n02 systemd-udevd[3418]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:32:39 kjcf05n02 systemd-udevd[3419]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:32:39 kjcf05n02 systemd-udevd[3422]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:32:39 kjcf05n02 systemd-udevd[3423]: Using default interface naming scheme 'rhel-8.0'. Nov 5 01:32:39 kjcf05n02 systemd-udevd[3423]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:32:39 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 5 01:32:39 kjcf05n02 systemd[3132]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:32:39 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[3461]: Setting up Mellanox network interface: ib1 Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[3460]: Setting up Mellanox network interface: ib0 Nov 5 01:32:39 kjcf05n02 systemd-udevd[3421]: Using default interface naming scheme 'rhel-8.0'. Nov 5 01:32:39 kjcf05n02 systemd-udevd[3420]: Using default interface naming scheme 'rhel-8.0'. Nov 5 01:32:39 kjcf05n02 systemd-udevd[3421]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:32:39 kjcf05n02 systemd-udevd[3420]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Puppet agent... Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[3510]: set_ipoib_cm: ib1 connection mode set to connected Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[3511]: set_ipoib_cm: ib0 connection mode set to connected Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[3542]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[3543]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[3544]: No configuration found for ib0 Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[3545]: No configuration found for ib1 Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[3553]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[3552]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 5 01:32:39 kjcf05n02 mlnx_conf_mgr[3593]: INFO: No configurations found for mlx5_0, skipping. Nov 5 01:32:39 kjcf05n02 mlnx_conf_mgr[3592]: INFO: No configurations found for mlx5_1, skipping. Nov 5 01:32:39 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 5 01:32:39 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/facter]/ensure) created Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter]/ensure: created Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure) defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/base_config_version.rb]/ensure: defined content as '{sha256}4fb5efef1caaf004b7966f5d79c41c9313ca7b32e35e93cd5771732214150e6b' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure) defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/lustre_config_version.rb]/ensure: defined content as '{sha256}2c3ddac387aa53796b653be7e23dd45e3ea98d676b8996185fa8d2e673870c65' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure) defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/package_provider.rb]/ensure: defined content as '{sha256}4bebfa2bfd6b23a680b317b59699b47621e24a8515aff5def45b2133ba4b6b06' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure) defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/pe_version.rb]/ensure: defined content as '{sha256}d3957f7e68ed02bf0a0d7a9524251cf32200029b6eef9289d7db2a25505d5900' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure) defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/puppet_settings.rb]/ensure: defined content as '{sha256}a9b6b5816ace9e30669dbfc4a72d74ba716457895b25ac22155e694f1a206263' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure) defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/root_home.rb]/ensure: defined content as '{sha256}a6a8c2cb6c7367372956e08c680c7a4b561ef5eda5f6a70a9f4a1b5a873851ab' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure) defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/service_provider.rb]/ensure: defined content as '{sha256}12f477c5d71d2e0b23a813a587c4028a7688813b47390e77b75ddded0ae56555' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure) created Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util]/ensure: created Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure) defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/util/puppet_settings.rb]/ensure: defined content as '{sha256}d7b183633e89570364ee8cbd815f0a482e90a6b89ac22b2d9d7fc133c646c088' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure) defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/facter/zabbix_version.rb]/ensure: defined content as '{sha256}55833b69c6b4b168c4244c0d9df0af4e5c779f61d88febb273c44a4242655979' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure) created Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet]/ensure: created Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure) created Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions]/ensure: created Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure) defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/deprecation.rb]/ensure: defined content as '{sha256}53ed4ef112422d6fdd1e255b497d8e95dabad66310ee17cf0c031a90d4c9682f' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure) defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/fact.rb]/ensure: defined content as '{sha256}10eb4da2d090949285d0e94ca24d102c0c17c782e06714f070a9202a3d74d388' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure) defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_a.rb]/ensure: defined content as '{sha256}869b2af1f1808a8b185017630792e3f0ca776c5b02bd9455e3b13f5a9d45730a' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}a2dc8fbe7b3e3059e8d657a091ea5fa0b7fdebfc0e929c431a681b1a7c5c3abd' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure) defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_array.rb]/ensure: defined content as '{sha256}11e36c8529467cd1a28a0ff79a0510263db7fbcdadd6530afa7b858147939aa0' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure) defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_bool.rb]/ensure: defined content as '{sha256}f7b603133bfc7f5482bf5e92c5c1af48654fd00574d2f11b89f1446d1b64895a' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure) defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_float.rb]/ensure: defined content as '{sha256}846314ddc178139a7a7032d9b05ea8cfcfe7f2fb53fbf3857eeb6f0537be8937' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure) defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ip_address.rb]/ensure: defined content as '{sha256}58fa73b42d78286dfb1cbdb0b6c1b9b563f8ba37cff00ac5e0d2cdae03451971' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}d08c59efcbce238ce98d05f780613daaf8e6730cc393f689beed5733666f8a36' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}65b8da6762a314bf7f0e5b910f9ad6a10ca8d83bbd4c1a950edf04aaf03874c0' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure) defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_numeric.rb]/ensure: defined content as '{sha256}b2362a9a0060b81119a118ad149406b9dff549f786b15eef6a060ff7f6fc61df' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure) defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/is_string.rb]/ensure: defined content as '{sha256}e8a72f25c257d084e6ce7f41127ba439f5381c230da7189f7e6f9a96a6038175' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure) defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/length.rb]/ensure: defined content as '{sha256}e8d7ae6346462b8304332275b8e38960f98c6d595f3c4c7bc44c787f5ad7f1fc' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure) defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/merge.rb]/ensure: defined content as '{sha256}dd22c1a18581bc02f380cc76df3cb9387ef8b019fd49d184649ecca264f97eaa' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure) defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/os_version_gte.rb]/ensure: defined content as '{sha256}db595bf07f1d37d1675c61f8d832490515ca447b119b85c003d3f64c6f691743' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure) defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/parsehocon.rb]/ensure: defined content as '{sha256}90b8d87c18a34357c3a67f0796ee535c837ad6e88892036280eef8cfb2ea9cce' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure) defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/seeded_rand_string.rb]/ensure: defined content as '{sha256}4f45b3e89757c1967a0057cf7900cc86dff8b4054851a525de4593194de36de4' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure) defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/sprintf_hash.rb]/ensure: defined content as '{sha256}b8b8ee5339ca016b9d1a0fe548a1d3b63e41ef989c4afcb8ec008c7598b6416c' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure) created Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib]/ensure: created Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure) defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/end_with.rb]/ensure: defined content as '{sha256}6224087110c137225c0f88b1870888e4114506c05087845ac11b48f15cb7f673' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure) defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/extname.rb]/ensure: defined content as '{sha256}d7a740091698b33500bf815b916509412a7575b61e315b34f9f7ea5f9631a94f' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure) defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/ip_in_range.rb]/ensure: defined content as '{sha256}46b7241ca1a4aa1ce73e9f0ab5f9ab11d6dc6992f33890219213584d89bbbd5c' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure) defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/stdlib/start_with.rb]/ensure: defined content as '{sha256}3bd485d65ba8b721b1616a1c666169fe9119950393a880b734a99c50e15e18c3' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure) defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json.rb]/ensure: defined content as '{sha256}e7448d221e197d5ac18c8b601b1f780b5d9986a861b705093364094c375c0952' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure) defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_json_pretty.rb]/ensure: defined content as '{sha256}2c34f6a7f6339887028465e4bcdf17624318c1ade7b79af900683bfd4253198a' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure) defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/to_yaml.rb]/ensure: defined content as '{sha256}5381f2870a02ccba94a28cfca12c4734b07e4eecfab8a13d1557ac9afd5b9577' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure) defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/type_of.rb]/ensure: defined content as '{sha256}2a17332cb76c79f4200e459f786fa056862067b66c81851d9da6775bfb0ba75e' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}6b2f7943391ccf1ce35fef72e11749c55e95641de9dcd272fc9c4fbc9a67fd6e' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure) defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_array.rb]/ensure: defined content as '{sha256}74d3c715b65049b8b4eb9bf75393f4d0766c18640d6fb0dcb321487ffb0522ec' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure) defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_bool.rb]/ensure: defined content as '{sha256}8cdb657204eb9b566d5c886f3d8a87121cd330409bad3aa541bf8757da16ce3f' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure) defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_hash.rb]/ensure: defined content as '{sha256}b2fc850edccbcd68b9c9c0aeb929ea9dbe8b01b2ac9b1ca608195f30b8e505ad' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure) defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_integer.rb]/ensure: defined content as '{sha256}2307ce86c2eefd80beb77b197418c30535de098d42391fcca2c6cca1fe86b76e' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}650da06a5ac19b79e7f0a4e69daa20293a9db67c1846bb10ad8a3635b108a19f' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}a12ff53162a66f7dd2565fcfee7c90848e1592f34309524e986f00a993155c83' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}3aa51880d3b12b4a1a33173ea7a72c83fff6dc0b20ce500c5a0980dfa8980c5d' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure) defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_legacy.rb]/ensure: defined content as '{sha256}b58d7ca78a27a1d9a95f86f9d3fb204537f7b01520abfb1f686f7cb168f87f6d' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure) defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_numeric.rb]/ensure: defined content as '{sha256}c66e84ed856a9b96f816f339007a71215c30bf0ab7b1baa1cbe5bfe63848926a' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure) defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_re.rb]/ensure: defined content as '{sha256}64c14a70e90f453b19ec1637d1216ff49ac5b2a25d9f2220b048e96f61809448' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure) defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_slength.rb]/ensure: defined content as '{sha256}b3e2d1b3430b9537cdfe539ceeeac57ace064f948d99164dbbff4e81c2217d6d' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure) defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/functions/validate_string.rb]/ensure: defined content as '{sha256}f24fdf23d09e32c3f8f938e262b14c939c2d497ee293d4cfde5409045042b8ac' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure) created Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser]/ensure: created Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure) created Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions]/ensure: created Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure) defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/abs.rb]/ensure: defined content as '{sha256}7dfd387a9ab17ac9a6780f845691aa0fd0e63b6ee5d8362db52e41d361781c0c' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure) defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2array.rb]/ensure: defined content as '{sha256}c89327b110c8ca83cbdd18ac870ee375733993fa2bab32d525fe6929fa080d4f' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure) defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/any2bool.rb]/ensure: defined content as '{sha256}2ed278c2d0a03792a8cb4def41999ff387c02e34c46353743a0be10b79493d5e' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure) defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/assert_private.rb]/ensure: defined content as '{sha256}0c863d21db6f2822caabac857ac7491298c3d60841fd61f1f9e4793d9de09d9e' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure) defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/base64.rb]/ensure: defined content as '{sha256}5c683b5b933c58f47d9c4c916766f7dc19bae8eb5e332dbfc8942026243870f3' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure) defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/basename.rb]/ensure: defined content as '{sha256}48a2c983accd27cf6b681363e792b3d35a6cba3f601fc0861afe9e9939cbcfb1' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure) defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2num.rb]/ensure: defined content as '{sha256}f11fe6468904ab9212901418c1e0206cbe7e3bfb7ca187b30040859144961116' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure) defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/bool2str.rb]/ensure: defined content as '{sha256}398a006b3a5f6f381af657efe1eb81ceee897afe687dcbe4270104f7775b115a' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure) defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/camelcase.rb]/ensure: defined content as '{sha256}2086a684eb665e56cc6194927e8016a8030cfc64ddf9387c70ce1efc55b5aa95' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure) defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/capitalize.rb]/ensure: defined content as '{sha256}cb6c8c996001a24c97eb59c03d38520d79acb14d5dcec907393fcfb6d1938ce7' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure) defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ceiling.rb]/ensure: defined content as '{sha256}45f74daf4768aaca7fab5fd15961cfd4dd85b6e7f1dd6e0299c733042ba0bdb7' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure) defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chomp.rb]/ensure: defined content as '{sha256}a2ec69592049bbd5e4fa81830daaca7d0245a3a20a63a92ff1573ec5936ef05a' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure) defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/chop.rb]/ensure: defined content as '{sha256}4eb11d3006702d93b43927618e60c4936b418585244a756145642db966590649' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure) defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/clamp.rb]/ensure: defined content as '{sha256}b14e512dfe6ef97c1194f872bc90bda5934197b5fc0854fa655fc9dbf8a0adb0' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure) defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/concat.rb]/ensure: defined content as '{sha256}b0786bae6acf3e6085a262107bbf25d712aa550e444a3e0e289ef003170115fd' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure) defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/convert_base.rb]/ensure: defined content as '{sha256}b0c9ebf16285bcc2dcf3b0b7b1e6b8834d29875d65ac33b98666d94418c3fb75' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure) defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/count.rb]/ensure: defined content as '{sha256}7a0816e68bff07ac8ba2b653a9d95d5e95634593ee58c8d03c3da9fc6b5715c7' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure) defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deep_merge.rb]/ensure: defined content as '{sha256}baa7ae748835937691b611acf0d1a1c33aa64a394243d8e53bef4c9a49c39d52' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure) defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/defined_with_params.rb]/ensure: defined content as '{sha256}acf73715b2f84b74b9903b512be53520ee64da657b1f528a4ac993fa26a6b00e' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure) defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete.rb]/ensure: defined content as '{sha256}56b279ed09b465207a7f33f7690bbc2fae85a822ff4473f997ada95244647e36' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure) defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_at.rb]/ensure: defined content as '{sha256}358b26685b568baf48865323de110d959a9d7469f32391d133ea3c5e0de380c4' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure) defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_regex.rb]/ensure: defined content as '{sha256}af35636d1bea0a19eab2085d34a7231a434c959cf2e8a6e3f78aef161814b67b' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure) defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_undef_values.rb]/ensure: defined content as '{sha256}8ba2311b0d21780c3f0085b9580cfab0fbffaa36017bbfb4ab8e598ba5936543' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure) defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/delete_values.rb]/ensure: defined content as '{sha256}4f7257f8e36e25fe083d2cdcab8b11c38460e9b6e0e94f93d06f50c0edc6ca2b' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure) defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/deprecation.rb]/ensure: defined content as '{sha256}767951acab40f2f5080d7433f6d59c4476cffd153fe9122e04f334a772aa74c1' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure) defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/difference.rb]/ensure: defined content as '{sha256}3a151b661b54b779b4bd87d36f912bfb90afd0f00061448c7c60af4e53d2f696' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure) defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig.rb]/ensure: defined content as '{sha256}e72e389b7e72ea2377ceb751217e2e161b4b61ec739365e60ff89f2657da62c8' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure) defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dig44.rb]/ensure: defined content as '{sha256}51c2926bf8c76759776f883c8231fd5e789ce7ef87e0df4f1e6c377f3a649d31' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure) defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dirname.rb]/ensure: defined content as '{sha256}bfbdde48f228c4aa0170a8c79d6d7e9a6ad9a004cd9ba5739f26afa5d38f08b1' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure) defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/dos2unix.rb]/ensure: defined content as '{sha256}1d8f9f112377e8b0029d2593ca2a678487122ca6bd7a65c785c31387b8deed4a' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure) defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/downcase.rb]/ensure: defined content as '{sha256}233b1e7a3cbdc18ade550b5578bdd45db10dccbaaaab2859a9cd1b1416336cb0' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure) defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/empty.rb]/ensure: defined content as '{sha256}363e39d63d3876105a2c0338b743633a4c9c775d52518ad81711e129c0803621' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure) defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/enclose_ipv6.rb]/ensure: defined content as '{sha256}263aaa91f876dd5e43b7af436ddbca5195a7ed360cb3297c442aaad71834ee7a' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure) defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_packages.rb]/ensure: defined content as '{sha256}72ef62f7d796f91dee18ec14ff2e9097d55db1cccaf1252c97e7215daf841a07' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure) defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resource.rb]/ensure: defined content as '{sha256}1ac97adf01c9e81715bf21bbf1616a1e6274b0c84943107963632e1b2e9491c7' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure) defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/ensure_resources.rb]/ensure: defined content as '{sha256}53eefe12c5055ea79cdaa161da1318bf583d11f06815074af228e77814064ced' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure) defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/flatten.rb]/ensure: defined content as '{sha256}99d09201c9ea8ebb529c8cf917d9309f78e3ec125e622e568fe4ea4f80e8d536' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure) defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/floor.rb]/ensure: defined content as '{sha256}c5623ed5f8b99846935861cb5e3785424a4a9f67a351849152e14d74f47410e6' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure) defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rand_string.rb]/ensure: defined content as '{sha256}e16987f8ef462fef508609589bbe5469a8f04f7ff792cec736070b7a4c5efca6' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure) defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_rotate.rb]/ensure: defined content as '{sha256}6088ff7374d85256401c951371ca7357ac8773e0611d2f2d461281a087a1cf28' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure) defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/fqdn_uuid.rb]/ensure: defined content as '{sha256}9851515dd0605b6e4c8ea514e215bd982a5942c4bf8f1783e3a56a03ee0608eb' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure) defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/get_module_path.rb]/ensure: defined content as '{sha256}806136f58203b5eacc496f97a279c40e4ba8dd4c4ea9753af0a6e777de905c4b' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure) defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getparam.rb]/ensure: defined content as '{sha256}8d1f89ff3219bc5a00b72a27d002096024e2396b33117aeeab75927ab9e8b586' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure) defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/getvar.rb]/ensure: defined content as '{sha256}48656b0eece8cbd83ab991d512c7b6b179b5986704b387d9c6cc5c9374b1a60a' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure) defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/glob.rb]/ensure: defined content as '{sha256}fe546f6980b40cef90f09f83d8c2a3d8ae99f42a86309d68ec76e6973ec8aa50' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure) defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/grep.rb]/ensure: defined content as '{sha256}cef13052774ccd03e351949e2a4100459c9d31400300ac056cf1a62d70273e82' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure) defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_interface_with.rb]/ensure: defined content as '{sha256}2cf198f765337acf3043ace1686501e8badb3065a1237dfda17c6230d6cd5a5e' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure) defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_address.rb]/ensure: defined content as '{sha256}4f925ab2e06b0cfcf6ce618e72d15606b8fd7eddbd2c6647c9a877d45dcfefb5' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure) defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_ip_network.rb]/ensure: defined content as '{sha256}723e62c5b966297851dd997396aa033a787a97412d377ade43a14016e579a1c4' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure) defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/has_key.rb]/ensure: defined content as '{sha256}10b2801f244aa0458524dcb71fc92d3ed49bfde0dc6d19731455d6bece592355' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure) defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/hash.rb]/ensure: defined content as '{sha256}6c48bb15f53327063702afe19c363f47c5dd7a7bf8809feebba57de93a725de0' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure) defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/intersection.rb]/ensure: defined content as '{sha256}adc90c1903b68764e8d5109b996e5a53fafaa0ea6b4d1b103ef4d03dcdbd9738' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure) defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_absolute_path.rb]/ensure: defined content as '{sha256}9eb94fa489df71863e1b87622486c86da98342adff5c131e061d57d9138d72c3' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure) defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_array.rb]/ensure: defined content as '{sha256}95a5c5fa996e8e29412ebcea3a91dfd9707e6002fb144f460b80e17bf6d07dec' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure) defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_bool.rb]/ensure: defined content as '{sha256}e8fa0c7fdf085e06249e50264816d5081d87a3b26881d774a83377e9da617f71' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure) defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_domain_name.rb]/ensure: defined content as '{sha256}5e9863da99f043cac9b418e0e66727d6757d012c7518a96c4d06ccd1d318a599' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure) defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_email_address.rb]/ensure: defined content as '{sha256}acf6012ad8b718951b636e7656c1d8e41879fc35fc5fc01f2aaab70134a5504d' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure) defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_float.rb]/ensure: defined content as '{sha256}7b4a7aeedf0956aa0ea7b674983b5a13df9ada8b3409b0dd3c2b36da6f06583c' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure) defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_function_available.rb]/ensure: defined content as '{sha256}19aa7ab236376b74889b1d5e74280a67047161def81e94fd1fc21ac53d8ade70' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure) defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_hash.rb]/ensure: defined content as '{sha256}80c4bed51423a958ade2b47560c4cdad0cde50474f082798b43e24c49d8dbed1' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure) defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_integer.rb]/ensure: defined content as '{sha256}d69127c56038a797518d9c1ef7b070523ccc39879fa36d7f95f99cdd4c298bb7' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure) defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ip_address.rb]/ensure: defined content as '{sha256}170cd678dd9a3e332c81da4b91a1859442c8b09668b160be9c639aa18ec2ca2d' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure) defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv4_address.rb]/ensure: defined content as '{sha256}8d7602e59549ee9b4716191342425261bd31b0076f95a9cf715b736bb3e24936' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure) defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_ipv6_address.rb]/ensure: defined content as '{sha256}627acb19641cef61cb1ee4217ed58f6019ed25bb17e2df96f8c2f20bb64ecd1b' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure) defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_mac_address.rb]/ensure: defined content as '{sha256}cc7990ed0e32c3eac90046620d7e200d699496dd6ddf0101589ea0c63530802a' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure) defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_numeric.rb]/ensure: defined content as '{sha256}010b1854b8d2542938249924bb37e9b167f83d26698b0193f39c834c571df369' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure) defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/is_string.rb]/ensure: defined content as '{sha256}f1e3bb14cf08e929c4e263b69a9613b1b414d2befa5531f402cdd5d69ab2ae95' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure) defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join.rb]/ensure: defined content as '{sha256}4a4f999cfdbec79de177a1e764d8a4037df1339dab37df6ea8f1be674392357b' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure) defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/join_keys_to_values.rb]/ensure: defined content as '{sha256}86d793c5f1c24b068df8ed14e63228b91db9870db7b403ad0b11880c30c16b0f' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure) defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/keys.rb]/ensure: defined content as '{sha256}159bc0ede56baded162ed68ab441f3a5104b62f2f95fa1505c3694b4cf3771ba' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure) defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/load_module_metadata.rb]/ensure: defined content as '{sha256}143ac16c9446711b2485029287797b9be5dcfe4c36d3c6dc106f4c88113b544e' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure) defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadjson.rb]/ensure: defined content as '{sha256}a750e34b86b418c088bf502a246b8e9cb1c022d103cf3f6a143885d291fa3428' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure) defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/loadyaml.rb]/ensure: defined content as '{sha256}4bb6560ac9f852bfbb2d25342548ba95b5ba4bc4139ea9fe70a2c7a7c39ccfe8' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure) defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/lstrip.rb]/ensure: defined content as '{sha256}56bc4eb83f6a79fca93e92765b69b29189dcddb47a1a13b2daca21584f53f32d' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure) defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/max.rb]/ensure: defined content as '{sha256}63674e9f37a9b7b94b36679b885dee3e7c047de079d7aa65f0e7aa0daf1afec0' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure) defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/member.rb]/ensure: defined content as '{sha256}fcd8eb01cfd015bc45840ee493d10b113df171b25a071daccb02f1afacbd653f' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure) defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/merge.rb]/ensure: defined content as '{sha256}d44934589e1c10f0ff881a942e88f55d85941777fb8db9a543052e686c864081' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure) defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/min.rb]/ensure: defined content as '{sha256}02491817666dbb0027f5f70230b1c00dd817066220e96c88ebaf62709c127628' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure) defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/num2bool.rb]/ensure: defined content as '{sha256}803a2ccc88281ada9ea4a507be02c0371011b1c9f1ccc8f5c53523958eee35fd' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure) defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parsejson.rb]/ensure: defined content as '{sha256}6bf9e7808b7baa5294a55844b1042437a61d5695ad734ae457dc8bb002b49717' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure) defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/parseyaml.rb]/ensure: defined content as '{sha256}1816fec72799e4e78e53a88ed1f5bc7fff8459ee245ec844b28ce91ca1494ee4' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure) defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick.rb]/ensure: defined content as '{sha256}0ebe5cafa58d2d4d474004973dbfbd9ea1e9a9dd947764c6583a2b1db764278a' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure) defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pick_default.rb]/ensure: defined content as '{sha256}f5806f3a0e0431fad52dcec4cbb2c64bde608988a2faddce70d3b25d7a662403' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure) defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/prefix.rb]/ensure: defined content as '{sha256}17b4d2f4061f14c665deb0d9bca619f18cfaa05caa6d72eb15b42896e5978ece' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure) defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/private.rb]/ensure: defined content as '{sha256}e7bd2a3077f68156c6bfb3ed5cbc5934d4512c8733cc9c08e20977586f845306' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure) defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pry.rb]/ensure: defined content as '{sha256}ed749c28fdaa2b157e85d8e38d3d8aae19912cb4c7e84f86a2d8acfa50d3fe40' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure) defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/pw_hash.rb]/ensure: defined content as '{sha256}4f328254592046202ea2bef8adaeb53be002e060d239ef3979e9f3fe957c6f4a' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure) defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/range.rb]/ensure: defined content as '{sha256}0e0d32b4dc0ca92f66b0b11124d3755acff00d1b05e93111b8abd3c82453367d' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure) defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/regexpescape.rb]/ensure: defined content as '{sha256}2821961873d322657760321f914db7fee7cea7a7382b6e178bc2709f2d1d6a9e' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure) defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reject.rb]/ensure: defined content as '{sha256}d45268fd2432b2f117a396c8f919cd4c239b852da748c30da2014d8a1aa73d6e' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure) defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/reverse.rb]/ensure: defined content as '{sha256}5f12736a96cb35adde36815a450bd40fe806a53af1f2ed7acbba1599185efd4c' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure) defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/round.rb]/ensure: defined content as '{sha256}5669291d3e3638e6609fa864085f4770781e23e5eb689847c1b06717b9f7a577' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure) defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/rstrip.rb]/ensure: defined content as '{sha256}e4c60391d247fafe10bc3b5e0debff2766e6c766cd5d997f0260515ddb626468' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure) defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/seeded_rand.rb]/ensure: defined content as '{sha256}7b1accdd657a09ed16e96194bd283044b21e9ac7c795fd8248fe9cd4fb515958' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure) defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_escape.rb]/ensure: defined content as '{sha256}d1c94aedc3a4f42d2e0635a87d916e1503b0ea59aab742531d59b82af014b21c' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure) defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_join.rb]/ensure: defined content as '{sha256}3e1f26efbe5a5b361a6882644d075f54ba93bb5a777c6c63c2be7b38d5fb3b93' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure) defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shell_split.rb]/ensure: defined content as '{sha256}1d8fbafcd4e5324f264efb682f886899f5dcf5adacd80fb7f4e4e0edb999021b' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure) defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/shuffle.rb]/ensure: defined content as '{sha256}e1cdac40261ba8afa6b69187b9702b3517c2aac62d598c3a7e3bf91155733602' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure) defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/size.rb]/ensure: defined content as '{sha256}a3e928c8e11cdaf6e9252a4a26cb5f607ce185cf07d8101ec006fc0171e5776e' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure) defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/sort.rb]/ensure: defined content as '{sha256}92b8d7c9961cffadbbd92de8585533a0cfc7ab097f02ecc516e05af50e21fea9' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure) defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/squeeze.rb]/ensure: defined content as '{sha256}9182646903b6e560e94fcfb4dfa42b1555a39334a143e4ede422c58b80561052' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure) defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2bool.rb]/ensure: defined content as '{sha256}382024b27511052d76f08c8d80abec969059ab9aa791b81cb8b6a02e60e7e071' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure) defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedpbkdf2.rb]/ensure: defined content as '{sha256}151f27d32c41ac38ebb923c59d770936ef97c8b06811625588c6729c3acc1be3' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure) defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/str2saltedsha512.rb]/ensure: defined content as '{sha256}ba6157059ff0bdf1541e72f29d27fadeb28126a1cc2f8cdc576d96bd5315bb7c' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure) defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/strip.rb]/ensure: defined content as '{sha256}e1d0d74e07f8aab70e921b9eaa57825dcec67e81950d4358543f50e1c5aaac65' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure) defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/suffix.rb]/ensure: defined content as '{sha256}8c2760c51384657805666dfdefe8365d981bda96eb233ee51687e12595b7a6a5' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure) defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/swapcase.rb]/ensure: defined content as '{sha256}435e78ccf9005032926b10c69da70fa6eafc4628a68b889eeb78ade231fca7d3' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure) defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/time.rb]/ensure: defined content as '{sha256}41674bdf4fe256adb7a6f05c443bb4018dd1f829d9a5fde26b59bbcd6072c884' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure) defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/to_bytes.rb]/ensure: defined content as '{sha256}b14be9345bc61e0a796433187aaa6c3c84cde18441a138a306bbeaa701f88a54' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure) defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/try_get_value.rb]/ensure: defined content as '{sha256}0ae82d7f761eb1e98db857cfc47ce4d9ecc12959eb4f0df2b58ea1b35287430f' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure) defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type.rb]/ensure: defined content as '{sha256}a2489a9393633521cd9b849f5cb77e098d3b0a47bc8aaac74a52f210af152999' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure) defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/type3x.rb]/ensure: defined content as '{sha256}d650d1e4bcf2af0d0b07deef69b24210736cb150002f49de8cb0338225e93fc4' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure) defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/union.rb]/ensure: defined content as '{sha256}bffd9fdad84b1b277c26d9776b6bc6d690238cfd8ac9c94212cfee2d2c2b1283' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure) defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unique.rb]/ensure: defined content as '{sha256}eec62c4d58c910d8fd37cd459aa97e3478527c35536b2a6590d5b3b785828336' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure) defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/unix2dos.rb]/ensure: defined content as '{sha256}2ff7917c2d460aae11f0a9b187ed575bb16bd3b3dc86d357dd8a4480f13ed901' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure) defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/upcase.rb]/ensure: defined content as '{sha256}8dd6ec52c53958b6c5acbcdb35f87133d6d3f07ee29e9778e16872fef45558a8' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure) defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/uriescape.rb]/ensure: defined content as '{sha256}fbc449938b4612aa02bcf93344031c5951a1e9207dec336a7bc9ec07b951544f' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure) defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_absolute_path.rb]/ensure: defined content as '{sha256}27fa28ab892ef0380a484dbaaf6a50d9c7a885ed3ce191356742b87124f35236' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure) defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_array.rb]/ensure: defined content as '{sha256}d4218405da5a68adeb1ac4d10a26eb2c077934134002e6b3e92d66001ba59be0' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure) defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_augeas.rb]/ensure: defined content as '{sha256}bf5ce2cb710a4588d997158129b8e0b31f036ab343b7a082a345c7b4b5bf3202' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure) defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_bool.rb]/ensure: defined content as '{sha256}c32655fbcf31961610823a27bc60faadc86e5e1fc2ec6d4abbd9487b960fbdec' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure) defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_cmd.rb]/ensure: defined content as '{sha256}ed37511374f343792e910f25ffd26a041e4877ff4ee3a23ca52753a6923bdcd3' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure) defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_domain_name.rb]/ensure: defined content as '{sha256}47bcbcdb9dbe67748050e808b37682c5fdefe4771311c559033a29493365def8' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure) defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_email_address.rb]/ensure: defined content as '{sha256}420683d70613cfc90f9b262d1411455543a5406baa3c0209edc432e3e5c139a1' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure) defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_hash.rb]/ensure: defined content as '{sha256}05127761df674deb1d866232c7776bebd94e4e355a82ebb4b2cea1fe19325e13' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure) defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_integer.rb]/ensure: defined content as '{sha256}e73f8228e30dd029188c99be913dc1ee1a689f689aa9cda5d4df84dbecec4604' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure) defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ip_address.rb]/ensure: defined content as '{sha256}d847155db35f6f5730729421acbcdf62f3191d116d27ab82827fcb5e1f96d045' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure) defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv4_address.rb]/ensure: defined content as '{sha256}c4cb56f458a665f5320dfdea93bb87cc23b5ebf564543ab78c198349c9305718' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure) defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_ipv6_address.rb]/ensure: defined content as '{sha256}d254b0a802eb3f979c8c705fe018759292e1947c5db80b5be9ae3e0cecc68ee0' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure) defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_numeric.rb]/ensure: defined content as '{sha256}462111b6203d20940f0455f86e8d912991f5a6ee4569cbbc10a000638b7782ca' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure) defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_re.rb]/ensure: defined content as '{sha256}d27fa66f552f20895a9ab3f232a7d868d760232f3f611c89ab2a9ec546c97c4c' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure) defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_slength.rb]/ensure: defined content as '{sha256}a277caae50ad91b2f1d02667e21ec5fa1196a637b6b8414ec4dfcda7d812df31' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure) defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_string.rb]/ensure: defined content as '{sha256}83778c405c140d29899efe9861e34fe6e0aa1a0d0e9e852637b97bbe37fa82a8' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure) defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/validate_x509_rsa_key_pair.rb]/ensure: defined content as '{sha256}9147a9a9f11c1da4eca603ab5dbfbb5eaf1a78a4e1a34ff9dd017da24ce2efcd' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure) defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values.rb]/ensure: defined content as '{sha256}036bd974e0e090ae9f7cf06dc3ebd508c5ce6c69265bd040d0b93a53da885758' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure) defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/values_at.rb]/ensure: defined content as '{sha256}9a43494cb3ca8a4baa1c3a6e996e76b292286f992832600d6537def36580f0c4' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure) defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/parser/functions/zip.rb]/ensure: defined content as '{sha256}b5e6a36eb875559b0dab768ec8adfd02e4b83c105248da7b89dd272e96aca55b' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure) created Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider]/ensure: created Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure) created Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line]/ensure: created Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure) defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/provider/file_line/ruby.rb]/ensure: defined content as '{sha256}e5f1ba7db87e8663cf9e03509773906c356e4d34d47989d95e5efb4753abb514' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure) created Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type]/ensure: created Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure) defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/anchor.rb]/ensure: defined content as '{sha256}79d89bd13924550250bb58b4097be1028cfd0b660b8cd0fa5bd77db176e4f4b1' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure) defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /File[/var/lib/puppetlabs/puppet/lib/puppet/type/file_line.rb]/ensure: defined content as '{sha256}58774a8dc405b09568f293994354da042e014f8db1b0da5406c4133d1bdae147' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure) created Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Etc_base/File[/etc/udev/rules.d/99-lustre-server.rules]/ensure: created Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Etc_base/File[/etc/localtime]/target) target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Etc_base/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/UTC' to '/usr/share/zoneinfo/US/Central' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Etc_base/File[/etc/cluster]/ensure) created Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Etc_base/File[/etc/cluster]/ensure: created Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure) defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Etc_base/File[/etc/cluster/fence_xvm.key]/ensure: defined content as '{sha256}dd912d1c293590d2655b93d3c639f36ac7fea9235a2ffd804970eb74f046d5d1' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/raid5_stripe_size.conf]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure) defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/libcfs_cpu_npartitions.conf]/ensure: defined content as '{sha256}fcf3f62f45292f26e6bcd9c88664eae4d7d886e682e60bf7518110a7477aa2bb' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure) defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Etc_base/File[/etc/modprobe.d/ost_threads.conf]/ensure: defined content as '{sha256}5aff187e67d0b9a4d85ee6a93149a8009df2309b6a62766b41a0a19a22fee89d' Nov 5 01:32:39 kjcf05n02 systemd[1]: Stopping Command Scheduler... Nov 5 01:32:39 kjcf05n02 systemd[1]: crond.service: Succeeded. Nov 5 01:32:39 kjcf05n02 systemd[1]: Stopped Command Scheduler. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Command Scheduler. Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Etc_base/Service[crond]) Triggered 'refresh' from 1 event Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Etc_base/Service[crond]: Triggered 'refresh' from 1 event Nov 5 01:32:39 kjcf05n02 systemd[1]: Stopping Job spooling tools... Nov 5 01:32:39 kjcf05n02 systemd[1]: atd.service: Succeeded. Nov 5 01:32:39 kjcf05n02 systemd[1]: Stopped Job spooling tools. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Job spooling tools. Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Etc_base/Service[atd]) Triggered 'refresh' from 1 event Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Etc_base/Service[atd]: Triggered 'refresh' from 1 event Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Etc_base/Mount[/tmp]/ensure) ensure changed 'ghost' to 'defined' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Etc_base/Mount[/tmp]/ensure: ensure changed 'ghost' to 'defined' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Etc_base/Mount[/tmp]) Triggered 'refresh' from 1 event Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Etc_base/Mount[/tmp]: Triggered 'refresh' from 1 event Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner) owner changed 'root' to 't0backend' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/owner: owner changed 'root' to 't0backend' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group) group changed 'root' to 't0backend' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/group: group changed 'root' to 't0backend' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode) mode changed '0755' to '0775' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Trinity_misc/File[/var/lib/xyratex]/mode: mode changed '0755' to '0775' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Trinity_misc::Users::Admin/User[admin]/password) changed [redacted] to [redacted] Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Trinity_misc::Users::Admin/User[admin]/password: changed [redacted] to [redacted] Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure) defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ssh/File[/etc/ssh/ssh_known_hosts]/ensure: defined content as '{sha256}ef5e8fc0921b92f011bb0c4b25cf6b8ecf49d8345c81578efacd8473c2c5f450' Nov 5 01:32:39 kjcf05n02 systemd[1]: Stopping Link Layer Discovery Protocol Agent Daemon.... Nov 5 01:32:39 kjcf05n02 lldpad[3128]: init_ports: Error adding device ib0 Nov 5 01:32:39 kjcf05n02 lldpad[3128]: init_ports: Error adding device ib1 Nov 5 01:32:39 kjcf05n02 lldpad[3128]: Signal 15 received - terminating Nov 5 01:32:39 kjcf05n02 systemd[1]: lldpad.service: Succeeded. Nov 5 01:32:39 kjcf05n02 systemd[1]: Stopped Link Layer Discovery Protocol Agent Daemon.. Nov 5 01:32:39 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure) ensure changed 'running' to 'stopped' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad]/ensure: ensure changed 'running' to 'stopped' Nov 5 01:32:39 kjcf05n02 systemd[1]: lldpad.socket: Succeeded. Nov 5 01:32:39 kjcf05n02 systemd[1]: Closed lldpad.socket. Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure) ensure changed 'running' to 'stopped' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Service[lldpad.socket]/ensure: ensure changed 'running' to 'stopped' Nov 5 01:32:39 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting IPMI Driver... Nov 5 01:32:39 kjcf05n02 systemd[1]: Started IPMI Driver. Nov 5 01:32:39 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:39 kjcf05n02 systemd[3132]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Openipmi/Service[ipmi]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Openipmi/Service[ipmi]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:32:39 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Ipmievd Daemon... Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 1 | Nov-05-2024 | 07:01:52 | Sensor #25 (Generator ID 20h) | Event Logging Disabled | Assertion Event | Log Area Reset/Cleared Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 2 | Nov-05-2024 | 07:02:43 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 3 | Nov-05-2024 | 07:02:44 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 4 | Nov-05-2024 | 07:03:49 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 5 | Nov-05-2024 | 07:03:50 | Sensor #255 (Generator ID 20h) | System Event | Assertion Event | Timestamp Clock Synch Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 6 | Nov-05-2024 | 07:28:46 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 7 | Nov-05-2024 | 07:28:46 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 8 | Nov-05-2024 | 07:28:46 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 9 | Nov-05-2024 | 07:28:46 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 10 | Nov-05-2024 | 07:28:46 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 11 | Nov-05-2024 | 07:28:46 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 12 | Nov-05-2024 | 07:28:46 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 13 | Nov-05-2024 | 07:28:46 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 14 | Nov-05-2024 | 07:28:46 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 15 | Nov-05-2024 | 07:28:46 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 16 | Nov-05-2024 | 07:28:47 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 17 | Nov-05-2024 | 07:28:47 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 18 | Nov-05-2024 | 07:29:17 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 19 | Nov-05-2024 | 07:29:17 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 20 | Nov-05-2024 | 07:29:17 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 21 | Nov-05-2024 | 07:29:17 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 22 | Nov-05-2024 | 07:29:17 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 23 | Nov-05-2024 | 07:29:17 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 24 | Nov-05-2024 | 07:29:17 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 25 | Nov-05-2024 | 07:29:17 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 26 | Nov-05-2024 | 07:29:17 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 27 | Nov-05-2024 | 07:29:17 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 28 | Nov-05-2024 | 07:29:17 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 00h (Event Type Code = 70h) Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 29 | Nov-05-2024 | 07:29:17 | Sensor #141 (Generator ID 20h) | OEM Reserved | Assertion Event | OEM Event Offset = 01h (Event Type Code = 70h) Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 30 | Nov-05-2024 | 07:29:17 | Sensor #129 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 31 | Nov-05-2024 | 07:29:17 | Sensor #130 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 32 | Nov-05-2024 | 07:29:17 | Sensor #131 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 33 | Nov-05-2024 | 07:29:17 | Sensor #132 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 34 | Nov-05-2024 | 07:29:17 | Sensor #133 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 35 | Nov-05-2024 | 07:29:17 | Sensor #134 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 36 | Nov-05-2024 | 07:29:17 | Sensor #135 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 37 | Nov-05-2024 | 07:29:17 | Sensor #136 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 38 | Nov-05-2024 | 07:29:17 | Sensor #137 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 39 | Nov-05-2024 | 07:29:17 | Sensor #138 (Generator ID 20h) | Entity Presence | Deassertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 40 | Nov-05-2024 | 07:29:18 | Sensor #129 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 41 | Nov-05-2024 | 07:29:18 | Sensor #130 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 42 | Nov-05-2024 | 07:29:18 | Sensor #131 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 43 | Nov-05-2024 | 07:29:18 | Sensor #132 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 44 | Nov-05-2024 | 07:29:18 | Sensor #133 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 45 | Nov-05-2024 | 07:29:18 | Sensor #134 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 46 | Nov-05-2024 | 07:29:18 | Sensor #135 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 47 | Nov-05-2024 | 07:29:18 | Sensor #136 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 48 | Nov-05-2024 | 07:29:18 | Sensor #137 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3938]: 49 | Nov-05-2024 | 07:29:18 | Sensor #138 (Generator ID 20h) | Entity Presence | Assertion Event | Entity Present Nov 5 01:32:39 kjcf05n02 ipmievd[3941]: Reading sensors... Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Ipmievd Daemon. Nov 5 01:32:39 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:39 kjcf05n02 systemd[3132]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Openipmi/Service[ipmievd]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Openipmi/Service[ipmievd]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Trinity_misc::Users::Lock/User[root]/password) changed [redacted] to [redacted] Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Trinity_misc::Users::Lock/User[root]/password: changed [redacted] to [redacted] Nov 5 01:32:39 kjcf05n02 nscd[2088]: 2088 monitored file `/etc/hosts` was moved into place, adding watch Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Etc_base/File[/etc/hosts]/content) content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Etc_base/File[/etc/hosts]/content: content changed '{sha256}a9af57e0e489885f728afdaecbe3bbcfb43f8b851dc6107b4fd6c4b53ec9b629' to '{sha256}a290c71a0b6454686d6d9c4341c12bf1b718b06c84bf4350788c10577e1498e1' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Etc_base/File[/etc/genders]/ensure) defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Etc_base/File[/etc/genders]/ensure: defined content as '{sha256}70ad49792df9ce776f4015d9f7847508894263e3825ff300f9760e00ee8a99b9' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Etc_base/File[/etc/issue]/content) content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Etc_base/File[/etc/issue]/content: content changed '{sha256}188029a4a5fc320b6157195899bf6d424610d385949a857a811d992602fa48c9' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Etc_base/File[/etc/issue.net]/content) content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Etc_base/File[/etc/issue.net]/content: content changed '{sha256}17657f4ee63966a9c7687e97028b9ca514f6e9bcbefec4b7f4e81ac861eb3483' to '{sha256}c373d0bf5f8b1260a5d63c7aca270aa4d3d6b1f7c112e16acc096eef0edc0dbd' Nov 5 01:32:39 kjcf05n02 systemd[1]: set-mlx-config.service: Succeeded. Nov 5 01:32:39 kjcf05n02 systemd[1]: Stopped Set Mellanox configuration. Nov 5 01:32:39 kjcf05n02 systemd[1]: Stopping Set Mellanox configuration... Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Set Mellanox configuration... Nov 5 01:32:39 kjcf05n02 beSetMlxConfig[3999]: ConnectX-3 multiport not detected Nov 5 01:32:39 kjcf05n02 beSetMlxConfig[3999]: Starting MST (Mellanox Software Tools) driver set Nov 5 01:32:39 kjcf05n02 beSetMlxConfig[3999]: Loading MST PCI module - Success Nov 5 01:32:39 kjcf05n02 systemd-udevd[1561]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 01:32:39 kjcf05n02 beSetMlxConfig[3999]: [warn] mst_pciconf is already loaded, skipping Nov 5 01:32:39 kjcf05n02 beSetMlxConfig[3999]: Create devices Nov 5 01:32:39 kjcf05n02 beSetMlxConfig[3999]: Unloading MST PCI module (unused) - Success Nov 5 01:32:39 kjcf05n02 ipmievd[3941]: Waiting for events... Nov 5 01:32:39 kjcf05n02 beSetMlxConfig[3999]: Configuring /dev/mst/mt4123_pciconf1 Nov 5 01:32:39 kjcf05n02 beSetMlxConfig[3999]: ib mode Nov 5 01:32:39 kjcf05n02 beSetMlxConfig[3999]: Configuring /dev/mst/mt4123_pciconf0 Nov 5 01:32:39 kjcf05n02 beSetMlxConfig[3999]: ib mode Nov 5 01:32:39 kjcf05n02 systemd-udevd[1561]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 01:32:39 kjcf05n02 systemd-udevd[4900]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:32:39 kjcf05n02 systemd-udevd[4901]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:32:39 kjcf05n02 systemd-udevd[4904]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:32:39 kjcf05n02 systemd-udevd[4907]: Using default interface naming scheme 'rhel-8.0'. Nov 5 01:32:39 kjcf05n02 systemd-udevd[4907]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:32:39 kjcf05n02 systemd[1]: /etc/systemd/system/mlnx_interface_mgr@.service:3: Unknown lvalue 'NoDefaultDependencies' in section 'Unit' Nov 5 01:32:39 kjcf05n02 systemd[3132]: Last message '/etc/systemd/system/' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:32:39 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib1. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started mlnx_interface_mgr - configure ib0. Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[4942]: Setting up Mellanox network interface: ib1 Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[4943]: Setting up Mellanox network interface: ib0 Nov 5 01:32:39 kjcf05n02 systemd-udevd[4902]: Using default interface naming scheme 'rhel-8.0'. Nov 5 01:32:39 kjcf05n02 systemd-udevd[4903]: Using default interface naming scheme 'rhel-8.0'. Nov 5 01:32:39 kjcf05n02 systemd-udevd[4902]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:32:39 kjcf05n02 systemd-udevd[4903]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Set Mellanox configuration. Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]) Triggered 'refresh' from 1 event Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Trinity_misc::Set_mlx_config/Service[set-mlx-config]: Triggered 'refresh' from 1 event Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[4992]: set_ipoib_cm: ib0 connection mode set to connected Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[4993]: set_ipoib_cm: ib1 connection mode set to connected Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[5023]: set_RPS_cpu: Configured RPS cpu for ib0 to 00ff0000 Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[5024]: set_RPS_cpu: Configured RPS cpu for ib1 to ff000000 Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[5025]: No configuration found for ib0 Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[5026]: No configuration found for ib1 Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[5034]: Running: /bin/mlnx_conf_mgr.sh ib0 Nov 5 01:32:39 kjcf05n02 mlnx_interface_mgr[5033]: Running: /bin/mlnx_conf_mgr.sh ib1 Nov 5 01:32:39 kjcf05n02 mlnx_conf_mgr[5074]: INFO: No configurations found for mlx5_1, skipping. Nov 5 01:32:39 kjcf05n02 mlnx_conf_mgr[5073]: INFO: No configurations found for mlx5_0, skipping. Nov 5 01:32:39 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib0.service: Succeeded. Nov 5 01:32:39 kjcf05n02 systemd[1]: mlnx_interface_mgr@ib1.service: Succeeded. Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure) defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Trinity_misc::Node/File[/var/lib/xyratex/hw_profile]/ensure: defined content as '{sha256}17f63be0a772ab569a32b37af59d3853f7faa2da665dd1a724350768846b2f9d' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content) content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ssh/File[/etc/ssh/sshd_config]/content: content changed '{sha256}f723bcd8186b1d2cd10f3ab2a21a01dff2d3cec8e8022eebb31a6c2dddb318aa' to '{sha256}b84cd15009b6a82768f70a80bd202fadae87fb061264acb0528fe632dec18fc8' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure) defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key]/ensure: defined content as '{sha256}2ed73f8979254f932de6f7331208f94087d5d6f8e6339e23fd93cf19b17e09ea' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure) defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ed25519_key.pub]/ensure: defined content as '{sha256}8c0174c654ecb758a291147b70980e26c3409a82b866941d6ffa65f134563fdd' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content) content changed '{sha256}774b796558ec57db35abf3a02aac77262e3a583885724da581fe8478838ee3b6' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/content: content changed '{sha256}774b796558ec57db35abf3a02aac77262e3a583885724da581fe8478838ee3b6' to '{sha256}29a2609f6e560d32bfa91f1dedfaf57aa2726bd464dcc5f7ab43ced9a16c5fde' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group) group changed 'ssh_keys' to 'root' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/group: group changed 'ssh_keys' to 'root' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode) mode changed '0640' to '0600' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key]/mode: mode changed '0640' to '0600' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content) content changed '{sha256}fd7ead5e68272bb228397f58f577934c9058e3b74164ed0fe5552e3d325231f9' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_ecdsa_key.pub]/content: content changed '{sha256}fd7ead5e68272bb228397f58f577934c9058e3b74164ed0fe5552e3d325231f9' to '{sha256}4cc6712217bb14278f43ac7786a320a66c9b84d4a1f3a8b29f118645fbc32002' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content) content changed '{sha256}85658816f657fa9d77fe5f5ec6373127fb3af2ecae76b622155cb6382ec2c849' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/content: content changed '{sha256}85658816f657fa9d77fe5f5ec6373127fb3af2ecae76b622155cb6382ec2c849' to '{sha256}19c777ef5b4f63340f7945e0b8ef37fbb1ef5b40b3e77631a72c4b869375b592' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group) group changed 'ssh_keys' to 'root' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/group: group changed 'ssh_keys' to 'root' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode) mode changed '0640' to '0600' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key]/mode: mode changed '0640' to '0600' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content) content changed '{sha256}b8cbfc1f78ea2bd018ecc9a78685e89e61620126aa100232eb15cf72121ca70a' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ssh::Base/File[/etc/ssh/ssh_host_rsa_key.pub]/content: content changed '{sha256}b8cbfc1f78ea2bd018ecc9a78685e89e61620126aa100232eb15cf72121ca70a' to '{sha256}53cd8ca816992164b8e6b205a91c58f6456fe1b13cc49ea7c1ad6e4182292c3a' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ntp/File[/etc/chrony.conf]/ensure) defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ntp/File[/etc/chrony.conf]/ensure: defined content as '{sha256}a5cec34c69700aef354445b3fb3bff42073bea635a789c7e008764a33f773d70' Nov 5 01:32:39 kjcf05n02 systemd[1]: Stopping NTP client/server... Nov 5 01:32:39 kjcf05n02 chronyd[2079]: chronyd exiting Nov 5 01:32:39 kjcf05n02 systemd[1]: chronyd.service: Succeeded. Nov 5 01:32:39 kjcf05n02 systemd[1]: Stopped NTP client/server. Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting NTP client/server... Nov 5 01:32:39 kjcf05n02 chronyd[5108]: chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +SECHASH +IPV6 +DEBUG) Nov 5 01:32:39 kjcf05n02 chronyd[5108]: Wrong owner of /var/run/chrony (UID != 991) Nov 5 01:32:39 kjcf05n02 chronyd[5108]: Disabled command socket /var/run/chrony/chronyd.sock Nov 5 01:32:39 kjcf05n02 chronyd[5108]: Frequency 0.000 +/- 1000000.000 ppm read from /var/lib/chrony/drift Nov 5 01:32:39 kjcf05n02 systemd[1]: Started NTP client/server. Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ntp/Service[chronyd]) Triggered 'refresh' from 1 event Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ntp/Service[chronyd]: Triggered 'refresh' from 1 event Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure) created Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Openipmi/Cron[ipmi-sel-clean]/ensure: created Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure) defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Lnet::Peer_discovery/File[/etc/modprobe.d/lnet_peer_discovery.conf]/ensure: defined content as '{sha256}ac42eb45377c078f689d085991cefe1beefc6af7044eade53829e845ef2b7846' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure) defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_custom.conf]/ensure: defined content as '{sha256}3ea9c847537243e3372f4d0c6a7adb4943aac8cb460e332c943fda56bac6b8b7' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure) defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet.conf]/ensure: defined content as '{sha256}ae3520d3214e56fc1c1c9309309d54ba51b9c388837d4f55b63200c8b3aafda0' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure) defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Lnet/File[/etc/lustre/ip2nets.dat]/ensure: defined content as '{sha256}376e1b8d97474f0d9fde5c05a23b6466050a4b20c3dbd5ebaa47c330be01ffee' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure) defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Lnet/File[/etc/lustre/routes.dat]/ensure: defined content as '{sha256}164936c25f43c000d8156e6ad27f5cf60de3307bbf3e27e127c89481ee6e6803' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure) defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Lnet/File[/etc/modprobe.d/lnet_multirail_tuning.conf]/ensure: defined content as '{sha256}62c6470c00c013e7329c35c75d51885c22406f0854367a2aa3e97d7f3acf2172' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure) defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Profiled::Fsname/File[/etc/profile.d/lustre-fs-name.sh]/ensure: defined content as '{sha256}d9f8e03699fa4840c22696b98938f5ea19bf0a2290689c8f5779034c80570cf2' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure) defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ha::Peer_corosync_conf/File[/etc/corosync/peer_corosync_conf]/ensure: defined content as '{sha256}6b60e4fe723832fca4f5381f8073f52f8db02abe59030d72d187df189cfc3d0c' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure) created Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy]/ensure: created Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure) defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_degraded]/ensure: defined content as '{sha256}00d9cd208c4bb685541067ed529222ed418e5cc75d71304d8ef159f3ea3aa50e' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure) defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_boost]/ensure: defined content as '{sha256}f5c3594b7f0767ed09d04ac4758b7a27ceb2b4d09789ed39eeffcd68d2fdbe8e' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure) defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_recover]/ensure: defined content as '{sha256}2213928a59a04f9a7b41a46183db1111fbf34cfb7586c8af0b30c4c23b9e6c12' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure) defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_min_check]/ensure: defined content as '{sha256}95748710a797fe6a92062d642e4677a7c671a40f1835450101f4f9f9477c2708' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure) defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Mdraid::Speed/File[/var/lib/xyratex/reconstruction_policy/sync_speed_max_check]/ensure: defined content as '{sha256}2d5c043a952d70ef9564858b25a01a30613abfb3d1562f67ef8d089646bbf786' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure) defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Mdraid::T10pi/File[/etc/sysconfig/mdraid-sysconfig.local]/ensure: defined content as '{sha256}246bbf6197d55b8025cc9159b6f204e989ea6ddcaadbec6281b75726fdb11fb1' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content) content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/raid-check]/content: content changed '{sha256}78a8b6301ea32b28c7f1144f9123fb761043f5d37d3aec8a2deab0ebe0d59a81' to '{sha256}941d82e4de4f75c7f644c7be75caa6277503e575c1fdc6ff99677dafee22a0fc' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure) defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Mdraid::Check/File[/etc/sysconfig/urc]/ensure: defined content as '{sha256}01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure) created Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor]/ensure: created Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure) defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.6.default]/ensure: defined content as '{sha256}205e7b780de08f42eda9fbf1715507758afd1f2eb499ffc6d0a352f904ee72f1' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure) defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Diskmonitor::Base/File[/var/lib/xyratex/diskmonitor/max_read_errors.default]/ensure: defined content as '{sha256}f5ca38f748a1d6eaf726b8a42fb575c3c71f1864a8143301782de13da2d9202b' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure) defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/etc/systemd/system/dwd.service.d/polling.conf]/ensure: defined content as '{sha256}1f6eb05c42cc9ea4a8d84b71c020f59f341aa9553f8a6453cbc98291fa6b4fe0' Nov 5 01:32:39 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:39 kjcf05n02 systemd[1]: Stopping Disk Watching Daemon (DWD)... Nov 5 01:32:39 kjcf05n02 systemd[1]: dwd.service: Succeeded. Nov 5 01:32:39 kjcf05n02 systemd[1]: Stopped Disk Watching Daemon (DWD). Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Disk Watching Daemon (DWD)... Nov 5 01:32:39 kjcf05n02 dwd[5139]: dwd: vMay 29 2024 : 15:38:26 Nov 5 01:32:39 kjcf05n02 dwd[5139]: /usr/sbin/dwd -i 15 -d Nov 5 01:32:39 kjcf05n02 dwd[5139]: dwd: option Lethal: 0 Nov 5 01:32:39 kjcf05n02 dwd[5139]: dwd: option Interval: 15 Nov 5 01:32:39 kjcf05n02 dwd[5139]: dwd: option abrtlimit: 10 Nov 5 01:32:39 kjcf05n02 dwd[5139]: dwd: option DZPeriod: 604800 Nov 5 01:32:39 kjcf05n02 dwd[5139]: dwd: option SmartPeriod: 43200 Nov 5 01:32:39 kjcf05n02 dwd[5139]: dwd: option SDDEnabled: 1 Nov 5 01:32:39 kjcf05n02 dwd[5139]: dwd: option SDDAwaitScale: 3 Nov 5 01:32:39 kjcf05n02 dwd[5139]: dwd: option SDDAwaitMin: 100 Nov 5 01:32:39 kjcf05n02 dwd[5139]: dwd: option Verbosity: 1 Nov 5 01:32:39 kjcf05n02 dwd[5139]: dwd: option StandAlone: 0 Nov 5 01:32:39 kjcf05n02 dwd[5139]: option Lethal: 0 Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Disk Watching Daemon (DWD). Nov 5 01:32:39 kjcf05n02 dwd[5139]: option Interval: 15 Nov 5 01:32:39 kjcf05n02 dwd[5139]: option abrtlimit: 10 Nov 5 01:32:39 kjcf05n02 dwd[5139]: option DZPeriod: 604800 Nov 5 01:32:39 kjcf05n02 dwd[5139]: option SmartPeriod: 43200 Nov 5 01:32:39 kjcf05n02 dwd[5139]: option SDDEnabled: 1 Nov 5 01:32:39 kjcf05n02 dwd[5139]: option SDDAwaitScale: 3 Nov 5 01:32:39 kjcf05n02 dwd[5139]: option SDDAwaitMin: 100 Nov 5 01:32:39 kjcf05n02 dwd[5139]: option Verbosity: 1 Nov 5 01:32:39 kjcf05n02 dwd[5139]: option StandAlone: 0 Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Diskmonitor::Dwd/Service[dwd]) Triggered 'refresh' from 1 event Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Diskmonitor::Dwd/Service[dwd]: Triggered 'refresh' from 1 event Nov 5 01:32:39 kjcf05n02 dwd[5140]: option Lethal now set to 1 Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/lethal]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 5 01:32:39 kjcf05n02 dwd[5140]: option abrtlimit now set to 1 Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure) defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/abrtlimit]/ensure: defined content as '{sha256}4355a46b19d348dc2f57c046f8ef63d4538ebb936000f3c9ee954a27460dd865' Nov 5 01:32:39 kjcf05n02 dwd[5140]: option SmartPeriod now set to 86400 Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure) defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Diskmonitor::Dwd/File[/var/lib/xyratex/dwd/period]/ensure: defined content as '{sha256}6e23d401c461c79e6e4acad089cc6a0a40e8fc46e5eede5a749190c5a9f55d26' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure) defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ses_monitor/File[/var/lib/xyratex/ses_monitor.cfg]/ensure: defined content as '{sha256}c4b7cad4824ff21b4d83abb25a5263d75464ed3c25f54d3b9e7e8e88602061b9' Nov 5 01:32:39 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Startup script for the Xyratex SES Monitor. Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ses_monitor/Service[ses_monitor]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ses_monitor/Service[ses_monitor]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure) defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Fstrim/File[/etc/sysconfig/XYMNTR]/ensure: defined content as '{sha256}e40ca2a59f27639f0c4c773216ad6eda8a3488eb6482945453468f8a8f857888' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Fstrim/File[/etc/systemd/system/fstrim.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}1755eb35f91ec3229626af519c7a941701b0ecb4fae8fe938e6d699ae4086fd5' Nov 5 01:32:39 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Discard unused blocks. Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Fstrim/Service[fstrim.timer]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Fstrim/Service[fstrim.timer]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:32:39 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:39 kjcf05n02 python3.9[5169]: [ses_monitor.py:471 - load_config() ] [INFO] CSM:Generic : Not an OSS node, ddump interval was set to 0 (disabled) Nov 5 01:32:39 kjcf05n02 python3.9[3132]: Last message '[ses_monitor.py:471 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Fstrim/Exec[fstrim-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content) content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zfs::Scrub/File[/etc/systemd/system/zfsscrub.timer.d/period.conf]/content: content changed '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' to '{sha256}ca6ef0a9e827b537ea0f34d3653abe97b6ff728f596db20a22a9b5451ea2f789' Nov 5 01:32:39 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Periodic ZFS scrub. Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zfs::Scrub/Service[zfsscrub.timer]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:32:39 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]) Triggered 'refresh' from 1 event Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zfs::Scrub/Exec[zfsscrub-systemctl-daemon-reload]: Triggered 'refresh' from 1 event Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content) content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Lustre::Ldev/File[/etc/ldev.conf]/content: content changed '{sha256}febe06bca9a7cb7d4af17d505afb06104e6f03f953fa183cdbd29b7a41d8b06a' to '{sha256}e418893c1a080feabb6ac16cea35886c0942f4678d0a4a502d3ef26f1a2d60d4' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Lustre::Snapshot_name/File[/etc/zfs/snapshot_name]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content) content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sedkeymgmt/File[/etc/sysconfig/sedkeymgmt]/content: content changed '{sha256}899229bd5bd2b455cc3683792ee24e2b067afeff0736c9faf3e5fc7f7021856d' to '{sha256}3a8f3b14ff5df13e53c1978990f5c596cd4be112f7a468e4f3c2948d0e0248b4' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content) content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sedkeymgmt::Ko/File[/etc/ko/kod.ini]/content: content changed '{sha256}81a9c4420c417a50f1fba0a8ec78a27473eaa159b3995adaeebf8a389d918daa' to '{sha256}ec20639eca4528084081433fd0d2a33e03c37980c3c31a0640bc3953c3071c4b' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure) defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/File[/etc/sedcpwrkr.conf]/ensure: defined content as '{sha256}ad4f6b27377e1c4952e14dfb3f3582999ca3045ecedcaa344d98f8e55351ba0d' Nov 5 01:32:39 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting Sed Control Plane worker process... Nov 5 01:32:39 kjcf05n02 sedcpwrkr[5308]: Using config script: /etc/sedcpwrkr.conf Nov 5 01:32:39 kjcf05n02 sedcpwrkr[5308]: - Creating default directory: '/var/log/sedcpwrkr' Nov 5 01:32:39 kjcf05n02 sedcpwrkr[5308]: - Changing permissions of '/var/log/sedcpwrkr' to 02755 Nov 5 01:32:39 kjcf05n02 sedcpwrkr[5308]: - Changing owner of '/var/log/sedcpwrkr' to 'root' Nov 5 01:32:39 kjcf05n02 sedcpwrkr[5308]: - Creating default directory: '/var/run/sedcpwrkr' Nov 5 01:32:39 kjcf05n02 sedcpwrkr[5308]: - Changing permissions of '/var/run/sedcpwrkr' to 02755 Nov 5 01:32:39 kjcf05n02 sedcpwrkr[5308]: - Changing owner of '/var/run/sedcpwrkr' to 'root' Nov 5 01:32:39 kjcf05n02 sedcpwrkr-server[5339]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 5 01:32:39 kjcf05n02 sedcpwrkr[5308]: celery multi v5.2.7 (dawn-chorus) Nov 5 01:32:39 kjcf05n02 sedcpwrkr[5308]: > Starting nodes... Nov 5 01:32:39 kjcf05n02 sedcpwrkr[5308]: > sedcpwrkr@kjcf05n02: OK Nov 5 01:32:39 kjcf05n02 systemd[1]: sedcpwrkr.service: Can't open PID file /var/run/sedcpwrkr/sedcpwrkr.pid (yet?) after start: No such file or directory Nov 5 01:32:39 kjcf05n02 sedcpwrkr-server[5341]: INFO Logging has been initialized for 'sedcpwrkr-server' (log_utils.py:68) Nov 5 01:32:39 kjcf05n02 sedcpwrkr-server[5341]: INFO Registered task 'Proxy' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 5 01:32:39 kjcf05n02 sedcpwrkr-server[5341]: INFO Registered task 'Status' with CCP server service 'sedcpwrkr-server' (logger.py:65) Nov 5 01:32:39 kjcf05n02 systemd[1]: Started Sed Control Plane worker process. Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sedkeymgmt::Sedcpwrkr/Service[sedcpwrkr]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure) created Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Diskless::Mountpoints/File[/mnt/llog]/ensure: created Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content) content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Syslog_ng/File[/etc/syslog-ng/syslog-ng.conf]/content: content changed '{sha256}3df62c5a1007a9d4315929c5fb0f6802a7967e984526491ba6bddb2629ef422b' to '{sha256}bb6a66d7784cfe90b1e9e98d94b1fff47d09db05173f6cf0b88cfc6468182420' Nov 5 01:32:39 kjcf05n02 systemd[1]: Reloading System Logger Daemon. Nov 5 01:32:39 kjcf05n02 systemd[1]: Reloaded System Logger Daemon. Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Syslog_ng/Service[syslog-ng]) Triggered 'refresh' from 3 events Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Syslog_ng/Service[syslog-ng]: Triggered 'refresh' from 3 events Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content) content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/content: content changed '{sha256}2fa384887f83e544cb49320f7ff3cf024d39a10f6653e570780dbc4e6b1c1ea7' to '{sha256}ce567f2960ef0b64ba9680888af420ac0ddaef183af8cd61668a658bb6849ffb' Nov 5 01:32:39 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode) mode changed '0600' to '0644' Nov 5 01:32:39 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Iptables::Common/File[/etc/sysconfig/iptables]/mode: mode changed '0600' to '0644' Nov 5 01:32:39 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:39 kjcf05n02 systemd[1]: Starting IPv4 firewall with iptables... Nov 5 01:32:39 kjcf05n02 systemd-udevd[1561]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 01:32:39 kjcf05n02 iptables.init[5408]: iptables: Applying firewall rules: [ OK ] Nov 5 01:32:39 kjcf05n02 systemd[1]: Started IPv4 firewall with iptables. Nov 5 01:32:39 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:40 kjcf05n02 systemd[3132]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Iptables::Common/Service[iptables]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Iptables::Common/Service[iptables]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content) content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/content: content changed '{sha256}f455839439e7d90802a8a6de705f01579d0f2d22cbd6021d621f28ea49f1a439' to '{sha256}95a971e8e3801fabdcce3f1a8019e7a95550912da4b8722665e10834a25e6f7b' Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner) owner changed 'root' to 'zabbix' Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/owner: owner changed 'root' to 'zabbix' Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group) group changed 'root' to 'zabbix' Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/group: group changed 'root' to 'zabbix' Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode) mode changed '0644' to '0600' Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.conf]/mode: mode changed '0644' to '0600' Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure) created Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix_agent2.conf]/ensure: created Nov 5 01:32:40 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib0 Nov 5 01:32:40 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib0 Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure) defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/base-config.conf]/ensure: defined content as '{sha256}a951f432d99b88ae4b9f01c1ff738ee55be779df58c81254d19955665f2ea1cb' Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]: Not removing directory; use 'force' to override Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure: removed Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure) removed Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/ceph.conf]/ensure: removed Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure) removed Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/docker.conf]/ensure: removed Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure) removed Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/memcached.conf]/ensure: removed Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure) removed Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/modbus.conf]/ensure: removed Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure) removed Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mqtt.conf]/ensure: removed Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure) removed Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/mysql.conf]/ensure: removed Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure) removed Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/oracle.conf]/ensure: removed Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure) removed Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/postgres.conf]/ensure: removed Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure) removed Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/redis.conf]/ensure: removed Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure) removed Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d/smart.conf]/ensure: removed Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure) defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_notification_sender.conf]/ensure: defined content as '{sha256}abda1c027adda1de48003e86911f95d8d3e57d26587a39c8528524b7e89d5514' Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure) defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf]/ensure: defined content as '{sha256}3e0afeb58ac43e5e3344e656772edf1ddb59a51d8051540980a1e457f4cc40e7' Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure) created Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/]/ensure: created Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure) defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf]/ensure: defined content as '{sha256}84863f3d7591019c66d746bc5d03c96767924b7af0ed030571dab92e1e88c2b8' Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure) created Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_bulk_data_sender.conf.d/]/ensure: created Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure) defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/File[/etc/dcs_collector.conf.d/disk_monitoring.conf]/ensure: defined content as '{sha256}93c437fcdbfbb39656db418744686f875e94ec198c8d715ebe012f683164e8f4' Nov 5 01:32:40 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content) content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 5 01:32:40 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Openhpi/File[/etc/openhpi/openhpi.conf]/content: content changed '{sha256}1950898325e200e869f7c73bf8f342923ff177066ba3dfb6f830b0833a460c91' to '{sha256}39501435ba80c678271aebe46df5ca2080edad508c5d887ae32f3ce0797d4164' Nov 5 01:32:40 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:40 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 5 01:32:41 kjcf05n02 systemd[1]: openhpid.service: Supervising process 5508 which is not our child. We'll most likely not notice when it exits. Nov 5 01:32:41 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 5 01:32:41 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:41 kjcf05n02 openhpid[5508]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 5 01:32:41 kjcf05n02 openhpid[5508]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 5 01:32:41 kjcf05n02 openhpid[5508]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 5 01:32:41 kjcf05n02 openhpid[5508]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 5 01:32:41 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:41 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Openhpi/Service[openhpid]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:32:41 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Openhpi/Service[openhpid]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:32:41 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure) defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 5 01:32:41 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_bulk_data_sender.conf.d/lustre.conf]/ensure: defined content as '{sha256}ef702f13aaaed69771a4f101f32dd20b71dfbe88fe2f1745407e0d2f31cc98eb' Nov 5 01:32:41 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure) defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 5 01:32:41 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ras_lustre_monitoring::Node/File[/etc/dcs_collector.conf.d/lustre.conf]/ensure: defined content as '{sha256}28d95f7792fd47a82fa64eb95f403f9b81dea229824e8d34cf140fa0a046a0ee' Nov 5 01:32:41 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:41 kjcf05n02 systemd[1]: Starting Collects DCS data periodically to be used by the DCS subsystem... Nov 5 01:32:42 kjcf05n02 dcs-collectord[5599]: INFO Logging has been initialized for DCS 'collector' service (service_logging.py:69) Nov 5 01:32:42 kjcf05n02 hpi.inv.log[5599]: INFO Logging has been initialized for DCS 'inventory_logger' service (service_logging.py:69) Nov 5 01:32:42 kjcf05n02 dcs-collectord[5599]: INFO 'lustre_discovery' data collection will occur at 5 second intervals (lustre_device_data_collection_process.py:65) Nov 5 01:32:42 kjcf05n02 dcs-collectord[5599]: INFO Initializing collection for memory_info (collection_process.py:46) Nov 5 01:32:42 kjcf05n02 dcs-collector[5590]: Starting dcs-collector:[ OK ] Nov 5 01:32:42 kjcf05n02 systemd[1]: dcs-collector.service: Can't open PID file /var/run/zabbix/dcs-collector.pid (yet?) after start: No such file or directory Nov 5 01:32:42 kjcf05n02 systemd[1]: Started Collects DCS data periodically to be used by the DCS subsystem. Nov 5 01:32:42 kjcf05n02 dcs-collectord[5602]: INFO Starting collection for memory_info (collection_process.py:52) Nov 5 01:32:42 kjcf05n02 dcs-collectord[5602]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 5 01:32:42 kjcf05n02 dcs-collectord[5602]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 01:32:42 kjcf05n02 dcs-collectord[5602]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 5 01:32:42 kjcf05n02 dcs-collectord[5602]: WARNING An error occurred during data collection: exc=, msg=None (container.py:99) Nov 5 01:32:42 kjcf05n02 dcs-collectord[5602]: WARNING An error occurred during data collection: exc=, msg= (container.py:99) Nov 5 01:32:42 kjcf05n02 dcs-collectord[5602]: WARNING Unable to collect dm report data: Non-zero data extraction status 1 (dm_report_collection_process.py:163) Nov 5 01:32:42 kjcf05n02 dcs-collectord[5602]: IEC: 006002001: DCS Start Memory snapshot: b'{"memory_info": [{"name": "MemTotal", "value": "263452760", "units": "kB"}, {"name": "MemFree", "value": "259349400", "units": "kB"}, {"name": "MemAvailable", "value": "258629484", "units": "kB"}, {"name": "Buffers", "value": "84264", "units": "kB"}, {"name": "Cached", "value": "1820920", "units": "kB"}, {"name": "SwapCached", "value": "0", "units": "kB"}, {"name": "Active", "value": "1686500", "units": "kB"}, {"name": "Inactive", "value": "962752", "units": "kB"}, {"name": "Active(anon)", "value": "1520496", "units": "kB"}, {"name": "Inactive(anon)", "value": "826600", "units": "kB"}, {"name": "Active(file)", "value": "166004", "units": "kB"}, {"name": "Inactive(file)", "value": "136152", "units": "kB"}, {"name": "Unevictable", "value": "9812", "units": "kB"}, {"name": "Mlocked", "value": "0", "units": "kB"}, {"name": "SwapTotal", "value": "0", "units": "kB"}, {"name": "SwapFree", "value": "0", "units": "kB"}, {"name": "Dirty", "value": "0", "units": "kB"}, {"name": "Writeback", "value": "0", "units": "kB"}, {"name": "AnonPages", "value": "753312", "units": "kB"}, {"name": "Mapped", "value": "86348", "units": "kB"}, {"name": "Shmem", "value": "1593216", "units": "kB"}, {"name": "KReclaimable", "value": "109828", "units": "kB"}, {"name": "Slab", "value": "275208", "units": "kB"}, {"name": "SReclaimable", "value": "109828", "units": "kB"}, {"name": "SUnreclaim", "value": "165380", "units": "kB"}, {"name": "KernelStack", "value": "9568", "units": "kB"}, {"name": "PageTables", "value": "20276", "units": "kB"}, {"name": "NFS_Unstable", "value": "0", "units": "kB"}, {"name": "Bounce", "value": "0", "units": "kB"}, {"name": "WritebackTmp", "value": "0", "units": "kB"}, {"name": "CommitLimit", "value": "131726380", "units": "kB"}, {"name": "Committed_AS", "value": "3261540", "units": "kB"}, {"name": "VmallocTotal", "value": "34359738367", "units": "kB"}, {"name": "VmallocUsed", "value": "0", "units": "kB"}, {"name": "VmallocChunk", "value": "0", "units": "kB"}, {"name": "Percpu", "value": "11392", "units": "kB"}, {"name": "HardwareCorrupted", "value": "0", "units": "kB"}, {"name": "AnonHugePages", "value": "4096", "units": "kB"}, {"name": "ShmemHugePages", "value": "0", "units": "kB"}, {"name": "ShmemPmdMapped", "value": "0", "units": "kB"}, {"name": "FileHugePages", "value": "0", "units": "kB"}, {"name": "FilePmdMapped", "value": "0", "units": "kB"}, {"name": "HugePages_Total", "value": "0", "units": "None"}, {"name": "HugePages_Free", "value": "0", "units": "None"}, {"name": "HugePages_Rsvd", "value": "0", "units": "None"}, {"name": "HugePages_Surp", "value": "0", "units": "None"}, {"name": "Hugepagesize", "value": "2048", "units": "kB"}, {"name": "Hugetlb", "value": "0", "units": "kB"}, {"name": "DirectMap4k", "value": "250184", "units": "kB"}, {"name": "DirectMap2M", "value": "26877952", "units": "kB"}, {"name": "DirectMap1G", "value": "241172480", "units": "kB"}]}' Nov 5 01:32:42 kjcf05n02 dcs-collectord[5602]: INFO Completed collection for memory_info (collection_process.py:59) Nov 5 01:32:42 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:42 kjcf05n02 dcs-collectord[5602]: IEC: 006001005: Error when opening a session for OpenHPI: b'{"fail_count": 1, "fail_limit": 1}' Nov 5 01:32:42 kjcf05n02 dcs-collectord[5602]: IEC: 006001006: Attempting to restart OpenHPI: b'{"last_n_check_start_time": [1730791962.3024106], "last_n_service_checks": [0], "last_n_openhpi_connections": [], "last_n_openhpi_parse": [], "last_n_openhpi_parse_time": [], "last_n_openhpi_connections_time": [], "last_n_restarts": [1730791962.5349548], "openhpid_restarts": 1, "total_checks": 1, "start_time": 1730791962.2361147, "service_status_failcount": 0, "service_status_fail_limit": 2, "connection_failcount": 1, "connection_fail_limit": 1, "parse_failcount": 0, "parse_fail_limit": 10, "poll_frequency": 300, "poll_recheck_frequency": 30}' Nov 5 01:32:42 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:42 kjcf05n02 systemd[1]: Stopping Daemon providing access to the SAF Hardware Platform Interface... Nov 5 01:32:42 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:32:42 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-collector]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:32:42 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content) content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 5 01:32:42 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc.conf]/content: content changed '{sha256}3ea6b668daf4ccc51bbecf03beacd81318c92f8a89f494aed23d3c6a74fd5a6d' to '{sha256}3c3e20852528ad949eaaf7de00da069a736bec401544b73575e453835d8e35d4' Nov 5 01:32:42 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content) content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 5 01:32:42 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Firmware_update_orc::Node/File[/etc/firmware_update_orc_ccp_task.conf]/content: content changed '{sha256}62fb8fa57dc94a6c4edf086733f49415e772884ac3373bd5a1c64bdcf9d21898' to '{sha256}cebd948d4440f0a57da5b99c1fd1c34c0c195a0c5e251f3f7e5513c836de8434' Nov 5 01:32:42 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:43 kjcf05n02 systemd[1]: Starting Run celery worker to manage firmware update requests... Nov 5 01:32:43 kjcf05n02 firmware-update-orc[5708]: Using config script: /etc/firmware_update_orc.conf Nov 5 01:32:43 kjcf05n02 firmware-update-orc[5708]: - Creating default directory: '/var/log/firmware-update-orc' Nov 5 01:32:43 kjcf05n02 firmware-update-orc[5708]: - Changing permissions of '/var/log/firmware-update-orc' to 02755 Nov 5 01:32:43 kjcf05n02 firmware-update-orc[5708]: - Changing owner of '/var/log/firmware-update-orc' to 'root' Nov 5 01:32:43 kjcf05n02 firmware-update-orc[5708]: - Creating default directory: '/var/run/firmware-update-orc' Nov 5 01:32:43 kjcf05n02 firmware-update-orc[5708]: - Changing permissions of '/var/run/firmware-update-orc' to 02755 Nov 5 01:32:43 kjcf05n02 firmware-update-orc[5708]: - Changing owner of '/var/run/firmware-update-orc' to 'root' Nov 5 01:32:43 kjcf05n02 firmware-update-orc-server[5744]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 5 01:32:43 kjcf05n02 firmware-update-orc[5708]: celery multi v5.2.7 (dawn-chorus) Nov 5 01:32:43 kjcf05n02 firmware-update-orc[5708]: > Starting nodes... Nov 5 01:32:43 kjcf05n02 firmware-update-orc[5708]: > worker1@kjcf05n02: OK Nov 5 01:32:43 kjcf05n02 systemd[1]: firmware-update-orc.service: Can't open PID file /var/run/firmware-update-orc/worker1.pid (yet?) after start: No such file or directory Nov 5 01:32:43 kjcf05n02 firmware-update-orc-server[5748]: INFO Logging has been initialized for 'firmware-update-orc-server' (log_utils.py:68) Nov 5 01:32:43 kjcf05n02 firmware-update-orc-server[5748]: INFO Registered task 'update_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 5 01:32:43 kjcf05n02 firmware-update-orc-server[5748]: INFO Registered task 'check_drive_firmware' with CCP server service 'firmware-update-orc-server' (logger.py:65) Nov 5 01:32:43 kjcf05n02 systemd[1]: Started Run celery worker to manage firmware update requests. Nov 5 01:32:43 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:44 kjcf05n02 systemd[3132]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:32:44 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:32:44 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Firmware_update_orc::Node/Service[firmware-update-orc]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:32:44 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content) content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 5 01:32:44 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/content: content changed '{sha256}825f9501e378e40181e0799c1131e03342b2341391613fa713af86baded9fed4' to '{sha256}338ec39b2311c53b4ea2c6cae2e238118c83184d471c9a99d3dbf666ccd5ffb4' Nov 5 01:32:44 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner) owner changed 'root' to 'zabbix' Nov 5 01:32:44 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/owner: owner changed 'root' to 'zabbix' Nov 5 01:32:44 kjcf05n02 dbus-daemon[2141]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 5 01:32:44 kjcf05n02 dbus-daemon[2141]: [system] Reloaded configuration Nov 5 01:32:44 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group) group changed 'root' to 'zabbix' Nov 5 01:32:44 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/dbus-1/system.d/com.cray.RasResourceManagerAgent.conf]/group: group changed 'root' to 'zabbix' Nov 5 01:32:44 kjcf05n02 dbus-daemon[2141]: [system] Service file "/usr/share/dbus-1/system-services/org.cray.Sed.service" should have been named "com.cray.Sed.service" and will not work with system bus activation Nov 5 01:32:44 kjcf05n02 dbus-daemon[2141]: [system] Reloaded configuration Nov 5 01:32:44 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure) defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 5 01:32:44 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_ccp_task.conf]/ensure: defined content as '{sha256}af8a4d8e6ed144beb562a22f2d4f01876a05fc693194b119c8a3c4c8ed073a08' Nov 5 01:32:44 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure) defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 5 01:32:44 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ras_resource_manager::Node/File[/etc/ras_resource_manager_agent.conf]/ensure: defined content as '{sha256}39f88ba7b201414bbc6d780a1512187d46e2742ace229ff5473cfd1c1399b2c0' Nov 5 01:32:44 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:44 kjcf05n02 systemd[1]: Starting Manages hardware resources... Nov 5 01:32:45 kjcf05n03 LCNmon[18007]: 10.16.100.52 is unreachable via ib1 Nov 5 01:32:45 kjcf05n03 LCNmon[18007]: 10.16.100.58 is unreachable via ib1 Nov 5 01:32:45 kjcf05n02 ras-resource-manager-agent[5864]: INFO Logging has been initialized for 'ras-resource-manager-agent' (log_utils.py:68) Nov 5 01:32:45 kjcf05n02 ras-resource-manager-agent[5850]: Starting ras-resource-manager-agent:[ OK ] Nov 5 01:32:45 kjcf05n02 systemd[1]: ras-resource-manager-agent.service: Can't open PID file /var/run/zabbix/ras-resource-manager-agent.pid (yet?) after start: No such file or directory Nov 5 01:32:45 kjcf05n02 ras-resource-manager-agent[5866]: INFO Starting the service handler (service_main_handler.py:98) Nov 5 01:32:45 kjcf05n02 ras-resource-manager-client[5866]: INFO Logging has been initialized for 'ras-resource-manager-client' (log_utils.py:68) Nov 5 01:32:45 kjcf05n02 systemd[1]: Started Manages hardware resources. Nov 5 01:32:45 kjcf05n02 ras-resource-manager-client[5866]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 5 01:32:45 kjcf05n02 ras-resource-manager-client[5876]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 5 01:32:45 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:45 kjcf05n02 systemd[3132]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:32:45 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:32:45 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ras_resource_manager::Node/Service[ras-resource-manager-agent]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:32:45 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure) defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 5 01:32:45 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Csm_dcs::Array_dcs/File[/etc/zabbix/zabbix_agent2.d/array-config.conf]/ensure: defined content as '{sha256}6c365d6ac6fb17b5a02b869eee6265a427a505553a01b987ba031985575fef13' Nov 5 01:32:45 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:45 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 5 01:32:45 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:45 kjcf05n00 plex[12314]: IEC: info: 011005001: Data collection cache has now gone stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 5 01:32:46 kjcf05n02 systemd[3132]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: Press Ctrl+C to exit. Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: Plugin support version 1.0 Nov 5 01:32:46 kjcf05n02 zabbix_agent2[5950]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 01:32:46 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:32:46 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/Service[zabbix-agent2]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:32:46 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:46 kjcf05n02 systemd[1]: Starting DCS Notification service sends data notifications to be collected by the DCS subsystem... Nov 5 01:32:46 kjcf05n02 dcs-notification-sender[6026]: dcs-notification-senderd is stopped Nov 5 01:32:46 kjcf05n02 zabbix-agent2[6040]: INFO Logging has been initialized for DCS 'notification-sender' service (service_logging.py:69) Nov 5 01:32:46 kjcf05n02 dcs-notification-sender[6026]: Starting notification-sender:[ OK ] Nov 5 01:32:46 kjcf05n02 systemd[1]: dcs-notification-sender.service: Can't open PID file /var/run/zabbix/dcs-notification-sender.pid (yet?) after start: No such file or directory Nov 5 01:32:47 kjcf05n02 zabbix-agent2[6046]: INFO DCS notification agent started. (agent.py:61) Nov 5 01:32:47 kjcf05n02 systemd[1]: Started DCS Notification service sends data notifications to be collected by the DCS subsystem. Nov 5 01:32:47 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:47 kjcf05n02 systemd[3132]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:32:47 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:32:47 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-notification-sender]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:32:47 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:47 kjcf05n02 systemd[1]: Starting Collects DCS data in bulk and periodically and sends it directly to Zabbix Server... Nov 5 01:32:47 kjcf05n02 dcs-collectord[6129]: INFO Logging has been initialized for DCS 'dcs-bulk-data-sender' service (service_logging.py:69) Nov 5 01:32:48 kjcf05n02 dcs-collectord[6129]: INFO 'lustre' config data collection will occur at 120 second intervals (lustre_config_collection_process.py:122) Nov 5 01:32:48 kjcf05n02 dcs-bulk-data-sender[6129]: IEC: 022001001: Invalid bulk data sender module configuration: b'{"module_name": "lustre_jobstats", "config": {}}' Nov 5 01:32:48 kjcf05n02 dcs-bulk-data-sender[6120]: Starting bulk-data-sender:[ OK ] Nov 5 01:32:48 kjcf05n02 systemd[1]: dcs-bulk-data-sender.service: Can't open PID file /var/run/zabbix/dcs-bulk-data-sender.pid (yet?) after start: No such file or directory Nov 5 01:32:48 kjcf05n02 dcs-collectord[6131]: INFO Finished bulk data collection (successful) for 'lustre-config'. There were 0 unsuccessful attempts before this one. Will poll in 120 sec. (lustre_config_collection_process.py:140) Nov 5 01:32:48 kjcf05n02 systemd[1]: Started Collects DCS data in bulk and periodically and sends it directly to Zabbix Server. Nov 5 01:32:48 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:48 kjcf05n02 systemd[3132]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:32:48 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:32:48 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Zabbix::Agent/Service[dcs-bulk-data-sender]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:32:48 kjcf05n02 nscd[2088]: 2088 monitored file `/etc/resolv.conf` was moved into place, adding watch Nov 5 01:32:48 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content) content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 5 01:32:48 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: content changed '{sha256}93974555aa4fda0e9d298d1c804c2bef5cff6de8a039d9d09468fab4cbff20b1' to '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 5 01:32:48 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure) defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 5 01:32:48 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Resolvconf/File[/etc/resolv.conf.backup]/ensure: defined content as '{sha256}197b45a8d944d1ef0c7863b7c0cedf204477e7a04e0c0307a35ae9a904e62625' Nov 5 01:32:48 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content) content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 5 01:32:48 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Kdump/File[/etc/sysconfig/kdump]/content: content changed '{sha256}bbfb5a9a57801b39114044973f3e3cd2eea09724ed464e871d6da77d4b95b503' to '{sha256}7e11a2af60c54431e32caf8c43ef3b8ae40ef3067e7ffc99190201659bbefd04' Nov 5 01:32:48 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content) content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 5 01:32:48 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Kdump::Node/File[/etc/kdump.conf]/content: content changed '{sha256}6cd49388ce38f237c4b89bfc3a03e68773f5072e1c712e93b9fa8115293938e6' to '{sha256}644468265de3587a39a8a08ec7510a7ee7f730a3ee29d48af83e22912bcf93cd' Nov 5 01:32:48 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure) defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 5 01:32:48 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Lustre/File[/etc/lustre/format_lustre_targets.sh]/ensure: defined content as '{sha256}0f67923f61dd5eb9618468e3f13ecb5b7a95aeefc72137a755b7c6e7207505c0' Nov 5 01:32:48 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure) defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 5 01:32:48 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Lustre/File[/etc/modprobe.d/disable_balanced_mkdir.conf]/ensure: defined content as '{sha256}dc021ebd0c0fb9d77ead86fe893976a0a99977cd298bcdc62f10d10d4bf0e1cc' Nov 5 01:32:48 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure) defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 5 01:32:48 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/sssd/sssd.conf]/ensure: defined content as '{sha256}c029cc800f5caeca15fd71b45a4117af306d93716bd0ae9f678543458cf0850c' Nov 5 01:32:49 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 01:32:49 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.keytab]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 01:32:49 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content) content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 01:32:49 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/content: content changed '{sha256}003cd0a16a54e9ff1e852cb08b8d5b0b3df17ac8f8cc382537097d82e35251b2' to '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 01:32:49 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode) mode changed '0644' to '0600' Nov 5 01:32:49 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sssd::Sssd/File[/etc/krb5.conf]/mode: mode changed '0644' to '0600' Nov 5 01:32:49 kjcf05n02 systemd[1]: Stopping System Security Services Daemon... Nov 5 01:32:49 kjcf05n02 sssd[nss][2469]: Shutting down (status = 0) Nov 5 01:32:49 kjcf05n02 sssd[be[implicit_files]][2333]: Shutting down (status = 0) Nov 5 01:32:49 kjcf05n02 systemd[1]: sssd.service: Succeeded. Nov 5 01:32:49 kjcf05n02 systemd[1]: Stopped System Security Services Daemon. Nov 5 01:32:49 kjcf05n02 systemd[1]: Starting System Security Services Daemon... Nov 5 01:32:49 kjcf05n02 sssd[sssd][6218]: Starting up Nov 5 01:32:49 kjcf05n02 sssd[be[implicit_files]][6219]: Starting up Nov 5 01:32:49 kjcf05n02 python3.9[5169]: [ses_monitor.py:520 - run() ] [INFO] CSM:Generic : Nov 5 01:32:50 kjcf05n02 python3.9[3132]: Last message '[ses_monitor.py:520 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:32:50 kjcf05n02 sssd[nss][6220]: Starting up Nov 5 01:32:50 kjcf05n02 systemd[1]: Started System Security Services Daemon. Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sssd::Sssd/Service[sssd]) Triggered 'refresh' from 1 event Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sssd::Sssd/Service[sssd]: Triggered 'refresh' from 1 event Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2]/mode) mode changed '0750' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2]/mode: mode changed '0750' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode) mode changed '0750' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d]/mode: mode changed '0750' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/app.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/commands.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/downtimes.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/groups.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/hosts.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/notifications.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/services.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/templates.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/timeperiods.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/conf.d/users.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf.trinity]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode) mode changed '0750' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available]/mode: mode changed '0750' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/api.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/checker.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/command.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/compatlog.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/debuglog.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/elasticsearch.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/gelf.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/graphite.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/icingadb.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/influxdb2.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/livestatus.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/mainlog.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/notification.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/opentsdb.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/perfdata.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/statusdata.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-available/syslog.conf]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode) mode changed '0750' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled]/mode: mode changed '0750' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner) owner changed 'root' to 'icinga' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/owner: owner changed 'root' to 'icinga' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group) group changed 'root' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/checker.conf]/group: group changed 'root' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner) owner changed 'root' to 'icinga' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/owner: owner changed 'root' to 'icinga' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group) group changed 'root' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/mainlog.conf]/group: group changed 'root' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner) owner changed 'root' to 'icinga' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/owner: owner changed 'root' to 'icinga' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group) group changed 'root' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/notification.conf]/group: group changed 'root' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner) owner changed 'root' to 'icinga' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/owner: owner changed 'root' to 'icinga' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group) group changed 'root' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf]/group: group changed 'root' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.rpmsave]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/icinga2.conf.trinity]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode) mode changed '0750' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive]/mode: mode changed '0750' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode) mode changed '0750' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts]/mode: mode changed '0750' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group) group changed 'root' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/group: group changed 'root' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode) mode changed '0755' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-host-notification.sh]/mode: mode changed '0755' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner) owner changed 'root' to 'icinga' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/owner: owner changed 'root' to 'icinga' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group) group changed 'root' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/group: group changed 'root' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode) mode changed '0755' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/scripts/mail-service-notification.sh]/mode: mode changed '0755' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode) mode changed '0750' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d]/mode: mode changed '0750' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode) mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/zones.d/README]/mode: mode changed '0640' to '0775' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure) defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/constants.conf]/ensure: defined content as '{sha256}b5370969e0f85eedddff1d27794e7adf174d27c294148ffb1501d47eb6f07e34' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure) defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/features-enabled/api.conf]/ensure: defined content as '{sha256}db80c67657fffaa2e0de154a4d2890556a0ae983bc455eefacac995363608454' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure) defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/minfo.yaml]/ensure: defined content as '{sha256}5aa93d772f66e91d886240bbbb1eba08b693860e47384bd96ea4708abfb9fc7b' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure) defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/File[/etc/icinga2/passive/enclosure_services.yaml]/ensure: defined content as '{sha256}fcd49b1375b31d33b5d23d01880e478ce8f55b1f3adc8f7c399bc01ecfbe78ef' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure) defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.key]/ensure: defined content as '{sha256}8b9ecae118f11f118e2fcff87cf3ceb2ec63991ec4599f1c9082b09d4c89b8fd' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure) defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/kjcf05n02.crt]/ensure: defined content as '{sha256}d2ed38afa312212911840b6e2050320267c9e7cc51dcdb448bbc51725896354b' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure) defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2::Api/File[/var/lib/icinga2/certs/ca.crt]/ensure: defined content as '{sha256}a86154524e2a0237d921bc85cd67f93296cc48e3c6b6546a375f6594ed839c07' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content) content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/content: content changed '{sha256}700c501caf6e7cc20212e425ea785137b13e5c32faa23a0639affddd1097834e' to '{sha256}70b4e74d896b293fde21bdac17708281ca491279d209fcd2a3de2fd54be651c2' Nov 5 01:32:50 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group) group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/zones.conf]/group: group changed 'icinga' to 't0backend' Nov 5 01:32:50 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:51 kjcf05n02 systemd[1]: Starting Icinga host/service/network monitoring system... Nov 5 01:32:51 kjcf05n02 icinga2[6281]: [2024-11-05 01:32:51 -0600] information/cli: Icinga application loader (version: 2.13.1-1) Nov 5 01:32:51 kjcf05n02 icinga2[6281]: [2024-11-05 01:32:51 -0600] information/cli: Loading configuration file(s). Nov 5 01:32:51 kjcf05n02 icinga2[6281]: [2024-11-05 01:32:51 -0600] information/ConfigItem: Committing config item(s). Nov 5 01:32:51 kjcf05n02 icinga2[6281]: [2024-11-05 01:32:51 -0600] information/ApiListener: My API identity: kjcf05n02 Nov 5 01:32:51 kjcf05n02 icinga2[6281]: [2024-11-05 01:32:51 -0600] information/ConfigItem: Instantiated 1 NotificationComponent. Nov 5 01:32:51 kjcf05n02 icinga2[6281]: [2024-11-05 01:32:51 -0600] information/ConfigItem: Instantiated 1 CheckerComponent. Nov 5 01:32:51 kjcf05n02 icinga2[6281]: [2024-11-05 01:32:51 -0600] information/ConfigItem: Instantiated 3 Zones. Nov 5 01:32:51 kjcf05n02 icinga2[6281]: [2024-11-05 01:32:51 -0600] information/ConfigItem: Instantiated 1 IcingaApplication. Nov 5 01:32:51 kjcf05n02 icinga2[6281]: [2024-11-05 01:32:51 -0600] information/ConfigItem: Instantiated 2 Endpoints. Nov 5 01:32:51 kjcf05n02 icinga2[6281]: [2024-11-05 01:32:51 -0600] information/ConfigItem: Instantiated 1 FileLogger. Nov 5 01:32:51 kjcf05n02 icinga2[6281]: [2024-11-05 01:32:51 -0600] information/ConfigItem: Instantiated 237 CheckCommands. Nov 5 01:32:51 kjcf05n02 icinga2[6281]: [2024-11-05 01:32:51 -0600] information/ConfigItem: Instantiated 1 ApiListener. Nov 5 01:32:51 kjcf05n02 icinga2[6281]: [2024-11-05 01:32:51 -0600] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars' Nov 5 01:32:51 kjcf05n02 icinga2[6281]: [2024-11-05 01:32:51 -0600] information/cli: Closing console log. Nov 5 01:32:51 kjcf05n02 systemd[1]: Started Icinga host/service/network monitoring system. Nov 5 01:32:51 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:52 kjcf05n02 systemd[3132]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:32:52 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/Service[icinga2]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:32:52 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/Service[icinga2]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:32:52 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure) defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 5 01:32:52 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2::Node/File[/etc/icinga2/passive/passive_checks_services.yaml]/ensure: defined content as '{sha256}78c216ee695996d25dedd66452a5e87637f33b367211e2fc11057dd329013ac3' Nov 5 01:32:52 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:52 kjcf05n02 systemd[1]: Started Icinga2 network monitor. Nov 5 01:32:52 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:53 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 5 01:32:53 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:32:53 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Icinga2/Service[icinga_passive_checks]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:32:53 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure) defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 5 01:32:53 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Logrotate/File[/etc/logrotate.d/syslog]/ensure: defined content as '{sha256}afa65de7c135b381c5ab1b32d7c694fdac1d88a1151dd3541ff9e66bedb93f4f' Nov 5 01:32:53 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content) content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 5 01:32:53 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Diskmonitor::Conffile/File[/etc/diskmonitor.conf]/content: content changed '{sha256}7f72d08c4874e592db9250b13a334b1bafd24f9c21b970292e3889432390268b' to '{sha256}3b95e0093d4fafdaf0c50273389679173f67919b886e6f67644d57bcac6d2b03' Nov 5 01:32:53 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Diskmonitor/Service[diskmonitor]) Triggered 'refresh' from 2 events Nov 5 01:32:53 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Diskmonitor/Service[diskmonitor]: Triggered 'refresh' from 2 events Nov 5 01:32:53 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure) removed Nov 5 01:32:53 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Nss::Nis/File[/etc/yp.conf]/ensure: removed Nov 5 01:32:53 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content) content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 5 01:32:53 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Nss::Openldap/File[/etc/nslcd.conf]/content: content changed '{sha256}abca4f509e74ad1ee5edaa5b463a7751fde306bbac5a539189ecc0840ae52469' to '{sha256}3a17580fadf9a6fc70bcfd425d875d0de6b253944d8fbad5aebf84d529caa7f4' Nov 5 01:32:53 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content) content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 5 01:32:53 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/content: content changed '{sha256}3bea281bbd267ed31c02249d9ce4c7659d764c6c36b0f0c81a39e4c810236eb2' to '{sha256}8f95c5b8169bf4af6b63c11e68403c59e38806aeb67344e37409f01760b189f7' Nov 5 01:32:53 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode) mode changed '0644' to '0600' Nov 5 01:32:53 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Nss::Openldap/File[/etc/openldap/ldap.conf]/mode: mode changed '0644' to '0600' Nov 5 01:32:54 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:54 kjcf05n02 systemd[1]: Starting Naming services LDAP client daemon.... Nov 5 01:32:54 kjcf05n02 nslcd[6893]: version 0.9.9 starting Nov 5 01:32:54 kjcf05n02 nslcd[6893]: accepting connections Nov 5 01:32:54 kjcf05n02 systemd[1]: Started Naming services LDAP client daemon.. Nov 5 01:32:54 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:54 kjcf05n02 systemd[3132]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:32:54 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Nss::Openldap/Service[nslcd]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:32:54 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Nss::Openldap/Service[nslcd]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:32:54 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure) defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 5 01:32:54 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/perm.conf]/ensure: defined content as '{sha256}8b877f1693ec6abcd54234068e5886cf71971c5178d93b9f1467d92dc1a2e557' Nov 5 01:32:54 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure) defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 5 01:32:54 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/passwd]/ensure: defined content as '{sha256}274e31a98c28dfced2c7670b70a81fc546bc465adf6e4c1096b236efa4a2fcaa' Nov 5 01:32:55 kjcf05n02 dcs-bulk-data-sender[6131]: IEC: 022002001: Lustre bulk data collection unsuccessful: b'{"reason": "Lustre is not mounted"}' Nov 5 01:32:55 kjcf05n02 dcs-collectord[6131]: WARNING Finished bulk data collection (unsuccessful) for 'lustre'. Will poll in 5 sec. (lustre_bulk_data_collection_sender_process.py:295) Nov 5 01:32:55 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure) defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 5 01:32:55 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Nss::Mds/File[/etc/lustre/group]/ensure: defined content as '{sha256}36517d2569860b8e06a1b7eaa6d5d34f1abf877327d53653b38c14ac8bfe66dc' Nov 5 01:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib0 Nov 5 01:32:55 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib0 Nov 5 01:32:55 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure) defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 5 01:32:55 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Dear::Node/File[/var/lib/dear/certs/CA.pem]/ensure: defined content as '{sha256}d73aab04f68d4dbff301f3aab0edfc7fd02427af13728bac6e387f076943539d' Nov 5 01:32:55 kjcf05n02 systemd[1]: Reloading. Nov 5 01:32:55 kjcf05n02 systemd[1]: Starting DEAR Control Plane worker process... Nov 5 01:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib0 Nov 5 01:32:55 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib0 Nov 5 01:32:56 kjcf05n02 dearcpw[7124]: Using config script: /etc/dearcpw.conf Nov 5 01:32:56 kjcf05n02 dearcpw[7124]: - Creating default directory: '/var/log/dearcpw' Nov 5 01:32:56 kjcf05n02 dearcpw[7124]: - Changing permissions of '/var/log/dearcpw' to 02755 Nov 5 01:32:56 kjcf05n02 dearcpw[7124]: - Changing owner of '/var/log/dearcpw' to 'root' Nov 5 01:32:56 kjcf05n02 dearcpw[7124]: - Creating default directory: '/var/run/dearcpw' Nov 5 01:32:56 kjcf05n02 dearcpw[7124]: - Changing permissions of '/var/run/dearcpw' to 02755 Nov 5 01:32:56 kjcf05n02 dearcpw[7124]: - Changing owner of '/var/run/dearcpw' to 'root' Nov 5 01:32:56 kjcf05n02 dearcpw-server[7177]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 5 01:32:56 kjcf05n02 dearcpw[7124]: celery multi v5.2.7 (dawn-chorus) Nov 5 01:32:56 kjcf05n02 dearcpw[7124]: > Starting nodes... Nov 5 01:32:56 kjcf05n02 dearcpw[7124]: > dearcpw@kjcf05n02: OK Nov 5 01:32:56 kjcf05n02 systemd[1]: dearcpw.service: Can't open PID file /var/run/dearcpw/dearcpw.pid (yet?) after start: No such file or directory Nov 5 01:32:56 kjcf05n02 dearcpw-server[7179]: INFO Logging has been initialized for 'dearcpw-server' (log_utils.py:68) Nov 5 01:32:56 kjcf05n02 dearcpw-server[7179]: INFO Registered task 'Sedcmd' with CCP server service 'dearcpw-server' (logger.py:65) Nov 5 01:32:56 kjcf05n02 dearcpw-server[7179]: INFO Registered task 'Broadcast' with CCP server service 'dearcpw-server' (logger.py:65) Nov 5 01:32:56 kjcf05n02 systemd[1]: Started DEAR Control Plane worker process. Nov 5 01:32:56 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Dear::Node/Service[dearcpw]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:32:56 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Dear::Node/Service[dearcpw]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:32:56 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure) created Nov 5 01:32:56 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh1]/File_line[net.ipv4.neigh.default.gc_thresh1]/ensure: created Nov 5 01:32:56 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure) created Nov 5 01:32:56 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh2]/File_line[net.ipv4.neigh.default.gc_thresh2]/ensure: created Nov 5 01:32:56 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure) created Nov 5 01:32:56 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.ipv4.neigh.default.gc_thresh3]/File_line[net.ipv4.neigh.default.gc_thresh3]/ensure: created Nov 5 01:32:56 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure) created Nov 5 01:32:56 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Etc_base/Sysctl::Conf[net.core.somaxconn]/File_line[net.core.somaxconn]/ensure: created Nov 5 01:32:56 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns) executed successfully Nov 5 01:32:56 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Diskless::Puppet/Exec[puppet-cert]/returns: executed successfully Nov 5 01:32:57 kjcf05n02 puppet[7364]: IEC: 017000000: Node is up and running: { "node": "kjcf05n02" } Nov 5 01:32:57 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns) executed successfully Nov 5 01:32:57 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Diskless::Puppet/Exec[log-ie-boot]/returns: executed successfully Nov 5 01:32:57 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure) created Nov 5 01:32:57 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Diskless::Puppet/File[/var/lib/puppetlabs/puppet/certcopy.done]/ensure: created Nov 5 01:32:57 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure) created Nov 5 01:32:57 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh]/ensure: created Nov 5 01:32:57 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 5 01:32:57 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}a0220678ff3dc13ffb32b3ca0c14d61a5c7206b3bfb5dfef149cf5362124fa6e' Nov 5 01:32:57 kjcf05n01 systemd[1]: Started fast remote file copy program daemon (172.16.2.5:50184). Nov 5 01:32:57 kjcf05n01 rsyncd[4007287]: connect from kjcf05n02 (172.16.2.5) Nov 5 01:32:57 kjcf05n01 rsyncd[4007287]: rsync to puppet_cert/ from kjcf05n02 (172.16.2.5) Nov 5 01:32:57 kjcf05n01 rsyncd[4007287]: receiving file list Nov 5 01:32:57 kjcf05n01 rsyncd[4007287]: sent 29 bytes received 325 bytes total size 10905 Nov 5 01:32:57 kjcf05n01 systemd[1]: rsyncd@682-172.16.2.2:873-172.16.2.5:50184.service: Succeeded. Nov 5 01:32:57 kjcf05n02 dcs-collectord[5602]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 01:32:57 kjcf05n02 dcs-collectord[5602]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 5 01:32:57 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 5 01:32:57 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}8885385be5ee0b48f7db84c04a7a9e8e9ca7e443cb571da8b7b35eee3a126b50' Nov 5 01:32:58 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 5 01:32:58 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ssh::Root/Ssh::Dotssh[root]/File[/root/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}1923c0cfdfc55718e11a827343de1a6454efeb3a297a721574dba8efecbd38bf' Nov 5 01:32:58 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 5 01:32:58 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 5 01:32:58 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content) content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 5 01:32:58 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/content: content changed '{sha256}413f2dc32504db2907974b6a9fea78414e804048bd9f3a02c28bd6292b87b0ed' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 5 01:32:58 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode) mode changed '0644' to '0600' Nov 5 01:32:58 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bashrc]/mode: mode changed '0644' to '0600' Nov 5 01:32:59 kjcf05n07 LCNmon[23459]: 10.16.100.52 is unreachable via ib1 Nov 5 01:32:59 kjcf05n07 LCNmon[23459]: 10.16.100.58 is unreachable via ib1 Nov 5 01:32:59 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content) content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 5 01:32:59 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/content: content changed '{sha256}173704a195292bed3d32ebaff5ace8810f7d02e986c43c0cb514d173dc4b2d5c' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 5 01:32:59 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode) mode changed '0644' to '0600' Nov 5 01:32:59 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_profile]/mode: mode changed '0644' to '0600' Nov 5 01:32:59 kjcf05n06 LCNmon[23798]: 10.16.100.52 is unreachable via ib1 Nov 5 01:32:59 kjcf05n06 LCNmon[23798]: 10.16.100.58 is unreachable via ib1 Nov 5 01:33:00 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode) mode changed '0644' to '0600' Nov 5 01:33:00 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Trinity_misc::Node/Trinity_misc::Users::Skeleton[root]/File[/root/.bash_logout]/mode: mode changed '0644' to '0600' Nov 5 01:33:00 kjcf05n02 systemd[1]: Reloading. Nov 5 01:33:00 kjcf05n02 systemd[1]: Starting Persistent storage and swap for diskless nodes (start)... Nov 5 01:33:00 kjcf05n02 diskless-swap[7567]: HA_PS_000: recovering journal Nov 5 01:33:00 kjcf05n02 systemd-udevd[1561]: Network interface NamePolicy= disabled on kernel command line, ignoring. Nov 5 01:33:00 kjcf05n02 diskless-swap[7567]: HA_PS_000: clean, 2294/6400 files, 7094/25600 blocks Nov 5 01:33:00 kjcf05n02 diskless-swap[7567]: mount: /mnt/persistent_ha_data/dirs/var/lib/pacemaker bound on /var/lib/pacemaker. Nov 5 01:33:00 kjcf05n02 diskless-swap[7567]: mount: /mnt/persistent_ha_data/dirs/var/lib/mdraidscripts bound on /var/lib/mdraidscripts. Nov 5 01:33:00 kjcf05n02 diskless-swap[7567]: mount: /mnt/persistent_ha_data/dirs/var/lib/reboot_cnt bound on /var/lib/reboot_cnt. Nov 5 01:33:00 kjcf05n02 diskless-swap[7567]: mount: /mnt/persistent_ha_data/dirs/etc/ganesha bound on /etc/ganesha. Nov 5 01:33:00 kjcf05n02 systemd[1]: Started Persistent storage and swap for diskless nodes (start). Nov 5 01:33:00 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:33:00 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Diskless::Swap/Service[diskless-swap]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:33:00 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure) created Nov 5 01:33:00 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh]/ensure: created Nov 5 01:33:00 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure) defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 5 01:33:00 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_authorized_keys]/ensure: defined content as '{sha256}fef8265fd20fc22fff80a87519d2d9f6b041c5abfd343a4e87ec7c5f78485c9e' Nov 5 01:33:00 kjcf05n02 systemd[1]: Stopping OpenSSH server daemon... Nov 5 01:33:01 kjcf05n02 systemd[1]: sshd.service: Succeeded. Nov 5 01:33:01 kjcf05n02 systemd[1]: Stopped OpenSSH server daemon. Nov 5 01:33:01 kjcf05n02 systemd[1]: Stopped target sshd-keygen.target. Nov 5 01:33:01 kjcf05n02 systemd[1]: Stopping sshd-keygen.target. Nov 5 01:33:01 kjcf05n02 systemd[1]: Reached target sshd-keygen.target. Nov 5 01:33:01 kjcf05n02 systemd[1]: Starting OpenSSH server daemon... Nov 5 01:33:01 kjcf05n02 systemd[1]: Started OpenSSH server daemon. Nov 5 01:33:01 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ssh/Service[sshd]) Triggered 'refresh' from 2 events Nov 5 01:33:01 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ssh/Service[sshd]: Triggered 'refresh' from 2 events Nov 5 01:33:01 kjcf05n02 ipmievd[3941]: Event Logging Disabled sensor SEL_sensor - Log area reset/cleared Asserted Nov 5 01:33:01 kjcf05n02 ipmievd[3941]: System Event sensor - Timestamp Clock Sync Nov 5 01:33:01 kjcf05n02 ipmievd[3132]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:33:01 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure) defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 5 01:33:01 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa]/ensure: defined content as '{sha256}3b414827970865b82410e7f6adc88f41b727dbf23dc945e38b6632674e3f816d' Nov 5 01:33:01 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure) defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 5 01:33:01 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ssh::Admin/Ssh::Dotssh[admin]/File[/home/admin/.ssh/cs_id_ecdsa.pub]/ensure: defined content as '{sha256}33be3efc613d3b8add9566e614c04d228db7f7ac46a86847a46490cba7cb2c77' Nov 5 01:33:01 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure) defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 5 01:33:01 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_history]/ensure: defined content as '{sha256}32c4858e22cc2c967b42150fa550562a2c839c2cebcaab91cabdf6f4da020022' Nov 5 01:33:01 kjcf05n00 mcfcli[3673891]: %3|1730791981.670|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:33:02 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content) content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 5 01:33:02 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/content: content changed '{sha256}036d993cef232aecccdd124aed13e65cea76527529e94075500706141617baf5' to '{sha256}917dd3909fe9220b7124ad67bcfab5800bd5e1219378d7d32be5441d58b9832f' Nov 5 01:33:02 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode) mode changed '0644' to '0600' Nov 5 01:33:02 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bashrc]/mode: mode changed '0644' to '0600' Nov 5 01:33:03 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content) content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 5 01:33:03 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/content: content changed '{sha256}28bc81aadfd6e6639675760dc11dddd4ed1fcbd08f423224a93c09802552b87e' to '{sha256}14e6f29f9b1c664dd3a670d0717cd8a8a98c2f567d0a77c10bb6cbe5a0b909ef' Nov 5 01:33:03 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode) mode changed '0644' to '0600' Nov 5 01:33:03 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_profile]/mode: mode changed '0644' to '0600' Nov 5 01:33:03 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode) mode changed '0644' to '0600' Nov 5 01:33:03 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Trinity_misc::Users::Admin/Trinity_misc::Users::Skeleton[admin]/File[/home/admin/.bash_logout]/mode: mode changed '0644' to '0600' Nov 5 01:33:04 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure) defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 5 01:33:04 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/File[/etc/systemd/system/opt-firmware.mount]/ensure: defined content as '{sha256}277c09bde7e11d25a2d8009169ae0a74f9360a5a0a65c64ae0e8cb72c8fc577c' Nov 5 01:33:04 kjcf05n02 systemd[1]: Reloading. Nov 5 01:33:04 kjcf05n02 systemd[1]: Set up automount opt-firmware.automount. Nov 5 01:33:04 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:33:04 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[opt-firmware]/Service[opt-firmware.automount]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:33:04 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure) defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 5 01:33:04 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/File[/etc/systemd/system/mnt-llog.mount]/ensure: defined content as '{sha256}a312aa36a4a0105a1c04e4a162d243259da99d87023bfa6b0ce98f242624976b' Nov 5 01:33:04 kjcf05n02 systemd[1]: Reloading. Nov 5 01:33:04 kjcf05n02 systemd[1]: Set up automount mnt-llog.automount. Nov 5 01:33:04 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:33:04 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[mnt-llog]/Service[mnt-llog.automount]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:33:04 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure) defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 5 01:33:04 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/File[/etc/systemd/system/usr-share-man.mount]/ensure: defined content as '{sha256}ce476f0806297455d1e9a3645113cdf5ebb17e03af913df7318d2da2b9b72c74' Nov 5 01:33:04 kjcf05n02 systemd[1]: Reloading. Nov 5 01:33:05 kjcf05n02 systemd[1]: Set up automount usr-share-man.automount. Nov 5 01:33:05 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:33:05 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Diskless::Mountpoints/Diskless::Automount[usr-share-man]/Service[usr-share-man.automount]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:33:05 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully Nov 5 01:33:05 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns: executed successfully Nov 5 01:33:05 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully Nov 5 01:33:05 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns: executed successfully Nov 5 01:33:05 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully Nov 5 01:33:05 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns: executed successfully Nov 5 01:33:05 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure) defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 5 01:33:05 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/ifcfg-mgmt0]/ensure: defined content as '{sha256}d2876db526194499715d04d2067c9532c26f47eb6e110ba60e4e7be318b0c090' Nov 5 01:33:05 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure) defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 01:33:05 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Kdump::Node/Ifcfg::Ifcfg[mgmt0]/File[/etc/sysconfig/network-scripts/route-mgmt0]/ensure: defined content as '{sha256}e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855' Nov 5 01:33:05 kjcf05n02 systemd[1]: Reloading. Nov 5 01:33:05 kjcf05n02 systemd[1]: Starting Crash recovery kernel arming... Nov 5 01:33:05 kjcf05n02 kdumpctl[7801]: kdump: No kdump initial ramdisk found. Nov 5 01:33:05 kjcf05n02 kdumpctl[7801]: kdump: Rebuilding /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img Nov 5 01:33:05 kjcf05n02 dracut[7913]: dracut-049-135.git20210121.el8 Nov 5 01:33:06 kjcf05n02 dracut[7915]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict -o "plymouth dash resume ifcfg earlykdump" --mount "172.16.2.2:/mnt/nfsdata/kdump /mnt/nfsdata/kdump nfs defaults" --add-drivers " ipmi_devintf ipmi_watchdog" --no-hostonly-default-device -f /boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img 4.18.0-305.10.2.x6.7.010.44.x86_64 Nov 5 01:33:06 kjcf05n02 dracut[7915]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 5 01:33:06 kjcf05n02 dracut[7915]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 5 01:33:06 kjcf05n02 dracut[7915]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Nov 5 01:33:06 kjcf05n02 dracut[7915]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Nov 5 01:33:06 kjcf05n02 dracut[7915]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 5 01:33:06 kjcf05n02 dracut[7915]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 5 01:33:06 kjcf05n02 dracut[7915]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + is_func check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ type -t check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 0 -ne 0 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check -h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local dev holder Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + require_binaries mdadm expr Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _module_name=90hperaid Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ mdadm = \-\m ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for cmd in "$@" Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + find_binary mdadm Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for cmd in "$@" Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + find_binary expr Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n -h ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for dev in "${!host_fs_types[@]}" Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ nfs != *_raid_member ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + continue Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _ret=255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + ret=255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ 255 = 0 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ 255 = 255 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ module_depends hperaid Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: +++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: +++ echo /usr/lib/dracut/modules.d/90hperaid Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ local _moddir=/usr/lib/dracut/modules.d/90hperaid Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ [[ -d /usr/lib/dracut/modules.d/90hperaid ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ [[ ! -f /usr/lib/dracut/modules.d/90hperaid/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ . /usr/lib/dracut/modules.d/90hperaid/module-setup.sh Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: +++ set -x Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ moddir=/usr/lib/dracut/modules.d/90hperaid Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ depends Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo rootfs-block Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ return 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ _ret=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ return 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for _moddep in $(module_depends $_mod) Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all == *\ hperaid\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ fips nss-softokn hperaid kdumpbase == *\ hperaid\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ fips nss-softokn hperaid kdumpbase != *\ rootfs-block\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + add_dracutmodules+=' rootfs-block ' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ == *\ hperaid\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check_module rootfs-block Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _mod=rootfs-block Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddep Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ rootfs-block\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ == *\ rootfs-block\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n '' ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + mods_checked_as_dep+=' rootfs-block ' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ plymouth dash resume ifcfg earlykdump == *\ rootfs-block\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all == *\ rootfs-block\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + module_check rootfs-block 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 5 01:33:06 kjcf05n02 kdumpctl[3132]: Last message '++ echo /usr/lib/dra' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _forced=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 2 -eq 2 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _forced=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + is_func check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ type -t check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 0 -ne 0 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check -h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _ret=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + ret=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ 0 = 0 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ module_depends rootfs-block Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: +++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: +++ echo /usr/lib/dracut/modules.d/95rootfs-block Nov 5 01:33:06 kjcf05n02 kdumpctl[3132]: Last message '+++ echo /usr/lib/dr' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ local _moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ [[ -d /usr/lib/dracut/modules.d/95rootfs-block ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ [[ ! -f /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ . /usr/lib/dracut/modules.d/95rootfs-block/module-setup.sh Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ moddir=/usr/lib/dracut/modules.d/95rootfs-block Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ depends Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo fs-lib Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ _ret=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ return 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for _moddep in $(module_depends $_mod) Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all == *\ rootfs-block\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block == *\ rootfs-block\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ fips nss-softokn hperaid kdumpbase rootfs-block != *\ fs-lib\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + add_dracutmodules+=' fs-lib ' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ == *\ rootfs-block\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check_module fs-lib Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _mod=fs-lib Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddep Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ rootfs-block == *\ fs-lib\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n '' ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + mods_checked_as_dep+=' fs-lib ' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ plymouth dash resume ifcfg earlykdump == *\ fs-lib\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ fs-lib\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all == *\ fs-lib\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + module_check fs-lib 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _forced=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 2 -eq 2 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _forced=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + is_func check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ type -t check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 0 -ne 0 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check -h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _ret=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + ret=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ 0 = 0 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ module_depends fs-lib Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: +++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: +++ echo /usr/lib/dracut/modules.d/99fs-lib Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ local _moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ [[ -d /usr/lib/dracut/modules.d/99fs-lib ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ [[ ! -f /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ . /usr/lib/dracut/modules.d/99fs-lib/module-setup.sh Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ moddir=/usr/lib/dracut/modules.d/99fs-lib Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ depends Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ return 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ _ret=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ return 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding == *\ fs-lib\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + mods_to_load+=' fs-lib ' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib == *\ rootfs-block\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + mods_to_load+=' rootfs-block ' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block == *\ hperaid\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + mods_to_load+=' hperaid ' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/install ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/installkernel ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _mod=90kernel-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _mod=kernel-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check_module kernel-modules 1 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _mod=kernel-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddep Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n 1 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all = all ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + module_check kernel-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _forced=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 1 -eq 2 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + is_func check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ type -t check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 0 -ne 0 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check -h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + true Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _ret=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + ret=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ 0 != 0 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ module_depends kernel-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: +++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ . /usr/lib/dracut/modules.d/90kernel-modules/module-setup.sh Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ depends Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ true Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ _ret=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ return 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid == *\ kernel-modules\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + mods_to_load+=' kernel-modules ' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/install ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/installkernel ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _mod=90kernel-modules-extra Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _mod=kernel-modules-extra Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check_module kernel-modules-extra 1 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _mod=kernel-modules-extra Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddep Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n 1 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-modules-extra\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-modules-extra\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all = all ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + module_check kernel-modules-extra Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _forced=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 1 -eq 2 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + is_func check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ type -t check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 0 -ne 0 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check -h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + true Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _ret=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + ret=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ 0 != 0 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ module_depends kernel-modules-extra Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: +++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: +++ echo /usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ local _moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ [[ -d /usr/lib/dracut/modules.d/90kernel-modules-extra ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ [[ ! -f /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ . /usr/lib/dracut/modules.d/90kernel-modules-extra/module-setup.sh Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ moddir=/usr/lib/dracut/modules.d/90kernel-modules-extra Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ depends Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ true Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ _ret=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ return 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules == *\ kernel-modules-extra\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + mods_to_load+=' kernel-modules-extra ' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/install ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/installkernel ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _mod=90kernel-network-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _mod=kernel-network-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check_module kernel-network-modules 1 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _mod=kernel-network-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddep Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ kernel-network-modules\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n 1 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ plymouth dash resume ifcfg earlykdump == *\ kernel-network-modules\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ kernel-network-modules\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all = all ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + module_check kernel-network-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _forced=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 1 -eq 2 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90kernel-network-modules ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ ! -f /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + . /usr/lib/dracut/modules.d/90kernel-network-modules/module-setup.sh Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + is_func check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ type -t check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 0 -ne 0 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + moddir=/usr/lib/dracut/modules.d/90kernel-network-modules Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check -h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _ret=255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + ret=255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ 255 != 0 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n 1 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 1 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90livenet/install ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90livenet/installkernel ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _mod=90livenet Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _mod=livenet Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check_module livenet 1 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _mod=livenet Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddep Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ livenet\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ rootfs-block fs-lib == *\ livenet\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n 1 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ plymouth dash resume ifcfg earlykdump == *\ livenet\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ livenet\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all = all ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + module_check livenet Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90livenet Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/90livenet Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _forced=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 1 -eq 2 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90livenet ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ ! -f /usr/lib/dracut/modules.d/90livenet/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + . /usr/lib/dracut/modules.d/90livenet/module-setup.sh Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + is_func check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ type -t check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 0 -ne 0 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + moddir=/usr/lib/dracut/modules.d/90livenet Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check -h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _ret=255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + ret=255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ 255 != 0 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n 1 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 1 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90lvm/install ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90lvm/installkernel ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _mod=90lvm Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _mod=lvm Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check_module lvm 1 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _mod=lvm Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddep Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ lvm\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ rootfs-block fs-lib == *\ lvm\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n 1 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ plymouth dash resume ifcfg earlykdump == *\ lvm\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ lvm\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all = all ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + module_check lvm Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90lvm Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/90lvm Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _forced=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 1 -eq 2 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90lvm ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ ! -f /usr/lib/dracut/modules.d/90lvm/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + . /usr/lib/dracut/modules.d/90lvm/module-setup.sh Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + is_func check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ type -t check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 0 -ne 0 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + moddir=/usr/lib/dracut/modules.d/90lvm Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check -h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + require_binaries lvm Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _module_name=90lvm Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ lvm = \-\m ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for cmd in "$@" Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + find_binary lvm Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n -h ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for fs in "${host_fs_types[@]}" Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ nfs = LVM*_member ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _ret=255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + ret=255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ 255 != 0 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n 1 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 1 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/install ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/installkernel ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _mod=90mdraid Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _mod=mdraid Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check_module mdraid 1 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _mod=mdraid Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddep Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ mdraid\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ rootfs-block fs-lib == *\ mdraid\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n 1 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ plymouth dash resume ifcfg earlykdump == *\ mdraid\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ mdraid\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all = all ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + module_check mdraid Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90mdraid Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/90mdraid Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _forced=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 1 -eq 2 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90mdraid ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ ! -f /usr/lib/dracut/modules.d/90mdraid/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + . /usr/lib/dracut/modules.d/90mdraid/module-setup.sh Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + is_func check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ type -t check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 0 -ne 0 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + moddir=/usr/lib/dracut/modules.d/90mdraid Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check -h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _rootdev Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + require_binaries mdadm expr Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _module_name=90mdraid Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ mdadm = \-\m ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for cmd in "$@" Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + find_binary mdadm Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for cmd in "$@" Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + find_binary expr Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n -h ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for dev in "${!host_fs_types[@]}" Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ nfs != *_raid_member ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + continue Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _ret=255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + ret=255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ 255 != 0 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n 1 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 1 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90multipath/install ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90multipath/installkernel ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _mod=90multipath Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _mod=multipath Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check_module multipath 1 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _mod=multipath Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddep Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ multipath\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ rootfs-block fs-lib == *\ multipath\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n 1 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ plymouth dash resume ifcfg earlykdump == *\ multipath\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ multipath\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all = all ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + module_check multipath Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90multipath Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/90multipath Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _forced=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 1 -eq 2 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90multipath ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ ! -f /usr/lib/dracut/modules.d/90multipath/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + . /usr/lib/dracut/modules.d/90multipath/module-setup.sh Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + is_func check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ type -t check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 0 -ne 0 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + moddir=/usr/lib/dracut/modules.d/90multipath Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check -h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _rootdev Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n -h ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for_each_host_dev_and_slaves is_mpath Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _func=is_mpath Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _dev Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for _dev in "${host_devs[@]}" Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -b 172.16.2.2:/mnt/nfsdata/kdump ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + continue Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 1 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _ret=255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + ret=255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ 255 != 0 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n 1 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 1 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90qemu/install ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90qemu/installkernel ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _mod=90qemu Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _mod=qemu Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check_module qemu 1 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _mod=qemu Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddep Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ rootfs-block fs-lib == *\ qemu\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n 1 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all = all ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + module_check qemu Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90qemu Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/90qemu Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _forced=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 1 -eq 2 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90qemu ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + . /usr/lib/dracut/modules.d/90qemu/module-setup.sh Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + is_func check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ type -t check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 0 -ne 0 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + moddir=/usr/lib/dracut/modules.d/90qemu Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check -h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n -h ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + type -P systemd-detect-virt Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ systemd-detect-virt --vm Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + vm=none Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + (( 1 != 0 )) Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _ret=255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + ret=255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ 255 != 0 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n 1 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 1 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/install ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/installkernel ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _mod=90qemu-net Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _mod=qemu-net Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check_module qemu-net 1 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _mod=qemu-net Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddep Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ qemu-net\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n 1 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ plymouth dash resume ifcfg earlykdump == *\ qemu-net\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ qemu-net\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all = all ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + module_check qemu-net Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90qemu-net Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _forced=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 1 -eq 2 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90qemu-net ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ ! -f /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + . /usr/lib/dracut/modules.d/90qemu-net/module-setup.sh Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + is_func check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ type -t check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 0 -ne 0 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + moddir=/usr/lib/dracut/modules.d/90qemu-net Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check -h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n -h ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + type -P systemd-detect-virt Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ systemd-detect-virt --vm Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + vm= Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + (( 1 != 0 )) Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _ret=255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + ret=255 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ 255 != 0 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n 1 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + return 1 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for _moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90stratis/install ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90stratis/installkernel ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _mod=90stratis Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + _mod=stratis Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check_module stratis 1 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _mod=stratis Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddep Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ bash systemd fips systemd-initrd nss-softokn i18n ib_bonding fs-lib rootfs-block hperaid kernel-modules kernel-modules-extra == *\ stratis\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ rootfs-block fs-lib == *\ stratis\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -n 1 ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ plymouth dash resume ifcfg earlykdump == *\ stratis\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all fips nss-softokn hperaid kdumpbase rootfs-block fs-lib == *\ stratis\ * ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ all = all ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + module_check stratis Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ read a b Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ echo /usr/lib/dracut/modules.d/90stratis Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _moddir=/usr/lib/dracut/modules.d/90stratis Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _forced=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _hostonly=-h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 1 -eq 2 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ -d /usr/lib/dracut/modules.d/90stratis ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ ! -f /usr/lib/dracut/modules.d/90stratis/module-setup.sh ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + . /usr/lib/dracut/modules.d/90stratis/module-setup.sh Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + is_func check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: ++ type -t check Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ function = \f\u\n\c\t\i\o\n ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + '[' 0 -ne 0 ']' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + moddir=/usr/lib/dracut/modules.d/90stratis Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + check -h Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + require_binaries stratisd-init thin_check thin_repair mkfs.xfs xfs_admin xfs_growfs Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _module_name=90stratis Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + local _ret=0 Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + [[ stratisd-init = \-\m ]] Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + for cmd in "$@" Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + find_binary stratisd-init Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + dinfo 'dracut module '\''stratis'\'' will not be installed, because command '\''stratisd-init'\'' could not be found!' Nov 5 01:33:06 kjcf05n02 kdumpctl[7801]: + set +x Nov 5 01:33:06 kjcf05n02 dracut[7915]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 5 01:33:06 kjcf05n02 dracut[7915]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Nov 5 01:33:06 kjcf05n02 dracut[7915]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Nov 5 01:33:06 kjcf05n02 dracut[7915]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Nov 5 01:33:06 kjcf05n02 dracut[7915]: memstrack is available Nov 5 01:33:06 kjcf05n02 dracut[7915]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Nov 5 01:33:06 kjcf05n02 dracut[7915]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Nov 5 01:33:06 kjcf05n02 dracut[7915]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Nov 5 01:33:06 kjcf05n02 dracut[7915]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Nov 5 01:33:06 kjcf05n02 dracut[7915]: dracut module 'dmsquash-live-ntfs' will not be installed, because command 'ntfs-3g' could not be found! Nov 5 01:33:06 kjcf05n02 dracut[7915]: dracut module 'stratis' will not be installed, because command 'stratisd-init' could not be found! Nov 5 01:33:07 kjcf05n02 dracut[7915]: *** Including module: bash *** Nov 5 01:33:07 kjcf05n02 dracut[7915]: *** Including module: systemd *** Nov 5 01:33:07 kjcf05n02 dracut[7915]: *** Including module: fips *** Nov 5 01:33:08 kjcf05n02 dracut[7915]: *** Including module: systemd-initrd *** Nov 5 01:33:08 kjcf05n02 dracut[7915]: *** Including module: watchdog-modules *** Nov 5 01:33:08 kjcf05n02 dracut[7915]: *** Including module: nss-softokn *** Nov 5 01:33:08 kjcf05n02 dracut[7915]: *** Including module: i18n *** Nov 5 01:33:08 kjcf05n02 dracut[7915]: No KEYMAP configured. Nov 5 01:33:08 kjcf05n00 mcfcli[3673891]: %3|1730791988.228|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:33:08 kjcf05n02 dracut[7915]: *** Including module: network-legacy *** Nov 5 01:33:08 kjcf05n02 dracut[7915]: *** Including module: network *** Nov 5 01:33:09 kjcf05n02 dracut[7915]: *** Including module: ib_bonding *** Nov 5 01:33:09 kjcf05n02 dracut[7915]: *** Including module: drm *** Nov 5 01:33:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730791989', 'host':'kjcf05n02', 'service_name':'Total Processes', 'value':'OK', 'message':'PROCS OK: 331 processes with STATE = RSZDT '}"] Nov 5 01:33:10 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Total Processes', 'description': 'PROCS OK: 331 processes with STATE = RSZDT ', 'message': 'PROCS OK: 331 processes with STATE = RSZDT ', 'value': 'ok', 'timestamp': '1730791989'} Nov 5 01:33:10 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:33:12 kjcf05n02 dracut[7915]: *** Including module: hperaid *** Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + install Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + local rule rule_path Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + inst_multiple cat expr Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.OrTxv1/initramfs -a -f cat expr Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + _ret=0 Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + (( 0 != 0 )) Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + : Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + return 0 Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + inst_multiple -o mdmon Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.OrTxv1/initramfs -a -f -o mdmon Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + _ret=0 Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + (( 0 != 0 )) Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + : Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + return 0 Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: ++ command -v partx Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + inst /usr/sbin/partx /sbin/partx Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + local _hostonly_install Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + [[ /usr/sbin/partx == \-\H ]] Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + [[ -e /tmp/dracut.OrTxv1/initramfs//sbin/partx ]] Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.OrTxv1/initramfs -f /usr/sbin/partx /sbin/partx Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + (( 0 != 0 )) Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + : Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: ++ command -v mdadm Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + inst /usr/sbin/mdadm /sbin/mdadm Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + local _hostonly_install Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + [[ /usr/sbin/mdadm == \-\H ]] Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + [[ -e /tmp/dracut.OrTxv1/initramfs//sbin/mdadm ]] Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.OrTxv1/initramfs -f /usr/sbin/mdadm /sbin/mdadm Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + (( 0 != 0 )) Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + : Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + [[ yes == \y\e\s ]] Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + local _raidconf Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: ++ cmdline Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: ++ local _activated dev line UUID Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: ++ declare -A _activated Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: ++ for dev in "${!host_fs_types[@]}" Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: ++ [[ nfs != *_raid_member ]] Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: ++ continue Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + _raidconf= Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + [[ -n '' ]] Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + inst_rules 64-md-raid.rules Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + local _target=/etc/udev/rules.d _rule _found Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + inst_dir /usr/lib/udev/rules.d Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + [[ -e /tmp/dracut.OrTxv1/initramfs//usr/lib/udev/rules.d ]] Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + return 0 Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + inst_dir /etc/udev/rules.d Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + [[ -e /tmp/dracut.OrTxv1/initramfs//etc/udev/rules.d ]] Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + return 0 Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + for _rule in "$@" Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + '[' 64-md-raid.rules = 64-md-raid.rules ']' Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + [[ -e /usr/lib/udev/rules.d/64-md-raid.rules ]] Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + continue Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + for r in ${udevdir}/rules.d ${hostonly:+/etc/udev/rules.d} Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + [[ -e /etc/udev/rules.d/64-md-raid.rules ]] Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + continue Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + for r in '' $dracutbasedir/rules.d/ Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + [[ 64-md-raid.rules != /* ]] Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + continue Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + for r in '' $dracutbasedir/rules.d/ Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + [[ /usr/lib/dracut/rules.d/64-md-raid.rules != /* ]] Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + [[ -f /usr/lib/dracut/rules.d/64-md-raid.rules ]] Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + continue Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + [[ -n '' ]] Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + dinfo 'Skipping udev rule: 64-md-raid.rules' Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + set +x Nov 5 01:33:12 kjcf05n02 dracut[7915]: Skipping udev rule: 64-md-raid.rules Nov 5 01:33:12 kjcf05n02 dcs-collectord[5602]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 01:33:12 kjcf05n02 dcs-collectord[5602]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + moddir=/usr/lib/dracut/modules.d/90hperaid Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + installkernel Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + instmods =drivers/md Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + local _optional=-o Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + local _silent Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + local _ret Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + [[ '' = yes ]] Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + [[ =drivers/md = \-\c ]] Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + [[ =drivers/md = \-\s ]] Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + (( 1 == 0 )) Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + /usr/lib/dracut/dracut-install -D /tmp/dracut.OrTxv1/initramfs -H -N '.*/gpu|mtd|pcmcia|dvb|memstick|mmc/.*|nls_.*|sata_.*|pata_.*|sgi_.*|firewire-.*|iscsi_ibft|3w-.*|aacraid|aic[79].*|arcmsr|be2iscsi|bfa|bnx2.*|libcxgbi|cxgb[34].*|.*/fcoe/.*|fnic|hpsa|hptiop|imm|initio|ips|libfc|lpfc|megaraid.*|mvsas|libosd|osd|pmcraid|ppa|qla.*|scsi_transport_fc|sym53c8xx|stex|aoe|cciss|floppy|sx8|cdrom|ums-.*|.*/usb/storage/.*|pdc_adma|dm_multipath|.*/net/tulip/.*|.*/net/usb/.*|3c59x|8139.*|8390|acenic|amd8111e|atl[12].*|b44|be2net|bna|cassini|cxgb|dl2k|dnet|enic|epic100|ethoc|fealnx|forcedeth|jme|myri10ge|natsemi|niu|netxen_nic|ns83820|pch_gbe|qla3xxx|qlcnic|qlge|r6040|r8169|sc92031|s2io|sis|sfc|skge|sky2|smsc9420|starfire|sun[dgh].*|tehuti|tlan|typhoon|via-velocity|vxlan|vxge|hdlc.*|9pnet|bnxt_re|i40iw|ib_.*|iw_.*|mlx.*|.*rdma.*|qedr|usnic_verbs|svcrdma|xprtrdma|cxi-core|sbl|.*/btrfs|cifs|ecryptfs|fuse|gfs2|jffs2|udf|xfs|fat/.*|fid|fld|ko2iblnd|ksocklnd|ldiskfs|lfsck|libcfs|llog_test|lmv|lnet|lnet_selftest|lod|lov|lquota|lustre|mdc|mdd|mdt|mgc|mgs|obdclass|obdecho|ofd|osc|osd_ldiskfs|osd_zfs|osp|ost|ptlrpc|kkfilnd|raid6_pq' --kerneldir /lib/modules/4.18.0-305.10.2.x6.7.010.44.x86_64/ -o -m =drivers/md Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + _ret=0 Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + (( 0 != 0 )) Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + [[ -n '' ]] Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + return 0 Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + _ret=0 Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + unset check depends cmdline install installkernel Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + return 0 Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + mods_to_load=' fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack ' Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + modules_loaded+='hperaid ' Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + '[' -n '' ']' Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + for moddir in "$dracutbasedir/modules.d"/[0-9][0-9]* Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + _d_mod=90kernel-modules Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + _d_mod=kernel-modules Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + [[ fs-lib rootfs-block kernel-modules kernel-modules-extra diskless-mod fstab-sys kernel-network-modules nfs terminfo udev-rules dracut-systemd usrmount base shutdown squash kdumpbase memstrack == *\ kernel-modules\ * ]] Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + [[ '' = yes ]] Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + dinfo '*** Including module: kernel-modules ***' Nov 5 01:33:12 kjcf05n02 kdumpctl[7801]: + set +x Nov 5 01:33:12 kjcf05n02 dracut[7915]: *** Including module: kernel-modules *** Nov 5 01:33:12 kjcf05n02 dracut[7915]: *** Including module: kernel-modules-extra *** Nov 5 01:33:13 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "kjcf05n02": interface became available Nov 5 01:33:13 kjcf05n02 dracut[7915]: *** Including module: kernel-network-modules *** Nov 5 01:33:13 kjcf05n02 dracut[7915]: *** Including module: diskless-mod *** Nov 5 01:33:13 kjcf05n02 dracut[7915]: *** Including module: fstab-sys *** Nov 5 01:33:13 kjcf05n02 dracut[7915]: *** Including module: nfs *** Nov 5 01:33:13 kjcf05n02 dracut[7915]: *** Including module: rootfs-block *** Nov 5 01:33:13 kjcf05n02 dracut[7915]: *** Including module: terminfo *** Nov 5 01:33:13 kjcf05n02 dracut[7915]: *** Including module: udev-rules *** Nov 5 01:33:14 kjcf05n02 dracut[7915]: Skipping udev rule: 91-permissions.rules Nov 5 01:33:14 kjcf05n02 dracut[7915]: Skipping udev rule: 80-drivers-modprobe.rules Nov 5 01:33:14 kjcf05n02 dracut[7915]: *** Including module: dracut-systemd *** Nov 5 01:33:14 kjcf05n00 zabbix_server[15783]: enabling Zabbix agent checks on host "lustre_kjcf05": interface became available Nov 5 01:33:14 kjcf05n00 zabbix-server[2618859]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 01:33:14 kjcf05n00 zabbix-server[2618859]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"kjcf05n02 has been restarted (uptime < 10m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Warning\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"System uptime (kjcf05n02:system.uptime): 00:02:46\\"}}"' Nov 5 01:33:14 kjcf05n00 log_interesting_event.py[2618859]: Event '46941' acknowledged Nov 5 01:33:15 kjcf05n02 dracut[7915]: *** Including module: usrmount *** Nov 5 01:33:15 kjcf05n02 dracut[7915]: *** Including module: base *** Nov 5 01:33:15 kjcf05n02 dracut[7915]: *** Including module: fs-lib *** Nov 5 01:33:15 kjcf05n02 dracut[7915]: *** Including module: kdumpbase *** Nov 5 01:33:16 kjcf05n02 dracut[7915]: *** Including module: memstrack *** Nov 5 01:33:16 kjcf05n02 dracut[7915]: *** Including module: shutdown *** Nov 5 01:33:16 kjcf05n02 dracut[7915]: *** Including module: squash *** Nov 5 01:33:16 kjcf05n02 dracut[7915]: *** Including modules done *** Nov 5 01:33:16 kjcf05n02 dracut[7915]: *** Installing kernel module dependencies *** Nov 5 01:33:16 kjcf05n02 dracut[7915]: *** Installing kernel module dependencies done *** Nov 5 01:33:16 kjcf05n02 dracut[7915]: *** Resolving executable dependencies *** Nov 5 01:33:17 kjcf05n02 dracut[7915]: *** Resolving executable dependencies done*** Nov 5 01:33:17 kjcf05n02 dracut[7915]: *** Hardlinking files *** Nov 5 01:33:17 kjcf05n02 dracut[7915]: *** Hardlinking files done *** Nov 5 01:33:17 kjcf05n02 dracut[7915]: *** Generating early-microcode cpio image *** Nov 5 01:33:17 kjcf05n02 dracut[7915]: *** Constructing AuthenticAMD.bin **** Nov 5 01:33:17 kjcf05n02 dracut[7915]: *** Store current command line parameters *** Nov 5 01:33:17 kjcf05n02 dracut[7915]: Stored kernel commandline: Nov 5 01:33:17 kjcf05n02 dracut[7915]: rd.driver.pre=sd_mod Nov 5 01:33:17 kjcf05n02 dracut[7915]: rd.driver.pre=nvme Nov 5 01:33:17 kjcf05n02 dracut[7915]: rd.driver.pre=ipmi_si Nov 5 01:33:17 kjcf05n02 dracut[7915]: rd.driver.pre=ipmi_devintf Nov 5 01:33:17 kjcf05n02 dracut[7915]: rd.driver.pre=ipmi_msghandler Nov 5 01:33:17 kjcf05n02 dracut[7915]: nameserver=172.16.2.2 Nov 5 01:33:17 kjcf05n02 dracut[7915]: nameserver=127.0.0.1 Nov 5 01:33:17 kjcf05n02 dracut[7915]: nameserver=172.16.2.2 Nov 5 01:33:17 kjcf05n02 dracut[7915]: nameserver=127.0.0.1 Nov 5 01:33:17 kjcf05n02 dracut[7915]: ifname=kdump-meth0:00:09:3d:06:95:e2 team=mgmt0:kdump-meth0 Nov 5 01:33:17 kjcf05n02 dracut[7915]: rd.neednet Nov 5 01:33:17 kjcf05n02 dracut[7915]: kdumpnic=mgmt0 Nov 5 01:33:17 kjcf05n02 dracut[7915]: bootdev=mgmt0 Nov 5 01:33:17 kjcf05n02 dracut[7915]: *** Install squash loader *** Nov 5 01:33:18 kjcf05n02 dracut[7915]: *** Squashing the files inside the initramfs *** Nov 5 01:33:18 kjcf05n02 dracut[7915]: *** Squashing the files inside the initramfs done *** Nov 5 01:33:18 kjcf05n02 dracut[7915]: *** Creating image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' *** Nov 5 01:33:18 kjcf05n02 dracut[7915]: *** Creating initramfs image file '/boot/initramfs-4.18.0-305.10.2.x6.7.010.44.x86_64kdump.img' done *** Nov 5 01:33:19 kjcf05n02 kdumpctl[7801]: kdump: kexec: loaded kdump kernel Nov 5 01:33:19 kjcf05n02 kdumpctl[7801]: kdump: Starting kdump: [OK] Nov 5 01:33:19 kjcf05n02 systemd[1]: Started Crash recovery kernel arming. Nov 5 01:33:19 kjcf05n02 systemd[1]: Reloading. Nov 5 01:33:19 kjcf05n02 systemd[3132]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:33:19 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Kdump::Node/Service[kdump]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:33:19 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Kdump::Node/Service[kdump]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:33:19 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure) defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 5 01:33:19 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/ifcfg-ib0]/ensure: defined content as '{sha256}33053a7957aab335996ec894d2e88db55ed35994a7050f7377df360096f5df8d' Nov 5 01:33:19 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure) defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 5 01:33:19 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/route-ib0]/ensure: defined content as '{sha256}785902e15b11ccd957b3f0f6e890336c4aece4d268c9bec24eea6ce0042702dd' Nov 5 01:33:19 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure) defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 5 01:33:19 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/File[/etc/sysconfig/network-scripts/rule-ib0]/ensure: defined content as '{sha256}c49d69d00b0be59f6354831c7cd5741c29aba79a79f1f571c08039bf7653a299' Nov 5 01:33:19 kjcf05n02 ifdown[14492]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 01:33:19 kjcf05n02 ifdown[14493]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:33:19 kjcf05n02 ifdown[14494]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730791999', 'host':'kjcf05n02', 'service_name':'RAM usage', 'value':'OK', 'message':'OK - 1.4% (3699284 kB) used.'}"] Nov 5 01:33:19 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'RAM usage', 'description': 'OK - 1.4% (3699284 kB) used.', 'message': 'OK - 1.4% (3699284 kB) used.', 'value': 'ok', 'timestamp': '1730791999'} Nov 5 01:33:19 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:33:20 kjcf05n02 ifup[14571]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 01:33:20 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 5 01:33:20 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state DOWN group default Nov 5 01:33:20 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 5 01:33:20 kjcf05n02 ifup[14572]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:33:20 kjcf05n02 ifup[14573]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:33:23 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UNKNOWN Nov 5 01:33:23 kjcf05n00 zabbix-server[2618901]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 01:33:23 kjcf05n00 zabbix-server[2618901]: IEC: 010001001: DCS default notification event was triggered: b'"{\\"Trigger\\": \\"Load average is too high (per CPU load over 1.5 for 5m)\\", \\"Trigger status\\": \\"PROBLEM\\", \\"Trigger severity\\": \\"Average\\", \\"Trigger URL\\": \\"\\", \\"Item values\\": {\\"1\\": \\"Load average (1m avg) (kjcf05n04:system.cpu.load[all,avg1]): 74.22\\",\\"2\\": \\"Number of CPUs (kjcf05n04:system.cpu.num): 32\\",\\"3\\": \\"Load average (5m avg) (kjcf05n04:system.cpu.load[all,avg5]): 169.06\\"}}"' Nov 5 01:33:24 kjcf05n00 log_interesting_event.py[2618901]: Event '46946' acknowledged Nov 5 01:33:24 kjcf05n02 ip-monitor-link: 5: ib0: mtu 65520 qdisc fq_codel state UP group default Nov 5 01:33:25 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 01:33:25 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 01:33:25 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:33:25 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:33:25 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:33:25 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:33:25 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 5 01:33:25 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 5 01:33:25 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 01:33:25 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 01:33:25 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:33:25 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:33:25 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:33:25 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:33:25 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]) Triggered 'refresh' from 3 events Nov 5 01:33:25 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Ifcfg::Ifcfg[ib0]/Exec[/sbin/ifdown ib0; /sbin/ip neigh flush dev ib0; /sbin/ifup ib0; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib0; exit $err]: Triggered 'refresh' from 3 events Nov 5 01:33:25 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns) executed successfully Nov 5 01:33:25 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[increase-transfer-queue-ib0]/returns: executed successfully Nov 5 01:33:25 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]) Triggered 'refresh' from 1 event Nov 5 01:33:25 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Exec[irq-affinity-ib0]: Triggered 'refresh' from 1 event Nov 5 01:33:25 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure) created Nov 5 01:33:25 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_ignore]/File_line[net.ipv4.conf.ib0.arp_ignore]/ensure: created Nov 5 01:33:25 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure) created Nov 5 01:33:25 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_filter]/File_line[net.ipv4.conf.ib0.arp_filter]/ensure: created Nov 5 01:33:25 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure) created Nov 5 01:33:25 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.arp_announce]/File_line[net.ipv4.conf.ib0.arp_announce]/ensure: created Nov 5 01:33:25 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure) created Nov 5 01:33:25 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib0]/Sysctl::Conf[net.ipv4.conf.ib0.rp_filter]/File_line[net.ipv4.conf.ib0.rp_filter]/ensure: created Nov 5 01:33:25 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure) defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 5 01:33:25 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/ifcfg-ib1]/ensure: defined content as '{sha256}a4cc9bcdb6799ef00f0af0df2fe402efb1972db88201f80107e42f262929af34' Nov 5 01:33:25 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure) defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 5 01:33:25 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/route-ib1]/ensure: defined content as '{sha256}bc9cc423358df63f73228f7546e461508cd3f85cc3a9c120f908281f1a381a29' Nov 5 01:33:25 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure) defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 5 01:33:25 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/File[/etc/sysconfig/network-scripts/rule-ib1]/ensure: defined content as '{sha256}048a2263cb89ab0ff4cf2a1ba2f5c54968575f97670d160d6e954e8f90e885e4' Nov 5 01:33:25 kjcf05n02 ifdown[14747]: You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 01:33:25 kjcf05n02 ifdown[14748]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:33:25 kjcf05n02 ifdown[14749]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:33:25 kjcf05n02 ifup[14824]: You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 01:33:25 kjcf05n02 ifup[14825]: 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:33:25 kjcf05n02 ifup[14826]: It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:33:25 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UNKNOWN group default Nov 5 01:33:25 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state DOWN group default Nov 5 01:33:25 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 5 01:33:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730792005', 'host':'kjcf05n02', 'service_name':'Current Users', 'value':'OK', 'message':'USERS OK - 0 users currently logged in '}"] Nov 5 01:33:25 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Users', 'description': 'USERS OK - 0 users currently logged in ', 'message': 'USERS OK - 0 users currently logged in ', 'value': 'ok', 'timestamp': '1730792005'} Nov 5 01:33:25 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:33:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-05T01:33:27.253162664-06:00 level=info msg="Completed cleanup jobs" duration=26.537369ms Nov 5 01:33:27 kjcf05n02 ip-monitor-link: Link state has changed: link=ib0, state=UP Nov 5 01:33:27 kjcf05n02 dcs-collectord[5602]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 01:33:27 kjcf05n02 dcs-collectord[5602]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 5 01:33:29 kjcf05n02 ip-monitor-link: 6: ib1: mtu 65520 qdisc fq_codel state UP group default Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] You are using 'ifdown' script provided by 'network-scripts', which are now deprecated. Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifdown] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) RTNETLINK answers: No such file or directory Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: RTNETLINK answers: No such file or directory Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] You are using 'ifup' script provided by 'network-scripts', which are now deprecated. Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] 'network-scripts' will be removed in one of the next major releases of RHEL. Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns) WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]/returns: WARN : [ifup] It is advised to switch to 'NetworkManager' instead - it provides 'ifup/ifdown' scripts as well. Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]) Triggered 'refresh' from 3 events Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Ifcfg::Ifcfg[ib1]/Exec[/sbin/ifdown ib1; /sbin/ip neigh flush dev ib1; /sbin/ifup ib1; err=$?; /sbin/ip route flush cache; test -n && ip l set up dev ib1; exit $err]: Triggered 'refresh' from 3 events Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns) executed successfully Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[increase-transfer-queue-ib1]/returns: executed successfully Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]) Triggered 'refresh' from 1 event Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Exec[irq-affinity-ib1]: Triggered 'refresh' from 1 event Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure) created Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_ignore]/File_line[net.ipv4.conf.ib1.arp_ignore]/ensure: created Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure) created Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_filter]/File_line[net.ipv4.conf.ib1.arp_filter]/ensure: created Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure) created Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.arp_announce]/File_line[net.ipv4.conf.ib1.arp_announce]/ensure: created Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure) created Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ifcfg::Hsn_multirail/Ifcfg::Ifcfg_mr[ib1]/Sysctl::Conf[net.ipv4.conf.ib1.rp_filter]/File_line[net.ipv4.conf.ib1.rp_filter]/ensure: created Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) fs.suid_dumpable = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: fs.suid_dumpable = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_pattern = core.%e Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_pattern = core.%e Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.core_uses_pid = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.core_uses_pid = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic_on_oops = 1 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic_on_oops = 1 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.panic = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.panic = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.randomize_va_space = 1 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.randomize_va_space = 1 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) kernel.sysrq = 1 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: kernel.sysrq = 1 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_default = 16777216 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_default = 16777216 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.rmem_max = 16777216 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.rmem_max = 16777216 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_default = 16777216 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_default = 16777216 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.wmem_max = 16777216 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.wmem_max = 16777216 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_redirects = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_redirects = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.accept_source_route = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.accept_source_route = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_announce = 2 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_announce = 2 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_filter = 1 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_filter = 1 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.arp_ignore = 1 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.arp_ignore = 1 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.rp_filter = 1 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.rp_filter = 1 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.secure_redirects = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.secure_redirects = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.all.send_redirects = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.all.send_redirects = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_redirects = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_redirects = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.accept_source_route = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.accept_source_route = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_announce = 2 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_announce = 2 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_filter = 1 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_filter = 1 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.arp_ignore = 1 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.arp_ignore = 1 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.rp_filter = 1 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.rp_filter = 1 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.secure_redirects = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.secure_redirects = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.default.send_redirects = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.default.send_redirects = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_policy = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_policy = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.lo.disable_xfrm = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.lo.disable_xfrm = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_echo_ignore_broadcasts = 1 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.icmp_ignore_bogus_error_responses = 1 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_stale_time = 600 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_stale_time = 600 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_max_syn_backlog = 4096 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_max_syn_backlog = 4096 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_syncookies = 1 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_syncookies = 1 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_rmem_min = 16384 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_rmem_min = 16384 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.udp_wmem_min = 16384 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.udp_wmem_min = 16384 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_ra = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_ra = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.accept_redirects = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.accept_redirects = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.all.disable_ipv6 = 1 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.all.disable_ipv6 = 1 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_ra = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_ra = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.accept_redirects = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.accept_redirects = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv6.conf.default.disable_ipv6 = 1 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv6.conf.default.disable_ipv6 = 1 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.panic_on_oom = 2 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.panic_on_oom = 2 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) vm.zone_reclaim_mode = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: vm.zone_reclaim_mode = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.tcp_sack = 1 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.tcp_sack = 1 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh1 = 4096 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh2 = 4300 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.neigh.default.gc_thresh3 = 4505 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.core.somaxconn = 8192 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.core.somaxconn = 8192 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_ignore = 1 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_ignore = 1 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_filter = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_filter = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.arp_announce = 2 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.arp_announce = 2 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib0.rp_filter = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib0.rp_filter = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_ignore = 1 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_ignore = 1 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_filter = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_filter = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.arp_announce = 2 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.arp_announce = 2 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns) net.ipv4.conf.ib1.rp_filter = 0 Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]/returns: net.ipv4.conf.ib1.rp_filter = 0 Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Sysctl/Exec[subscribe-sysctl]) Triggered 'refresh' from 12 events Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Sysctl/Exec[subscribe-sysctl]: Triggered 'refresh' from 12 events Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure) defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/corosync.conf]/ensure: defined content as '{sha256}27a16524d46e37cc84e8840973d7e2526c91168b2fab659a1cb9830f1c3676e1' Nov 5 01:33:29 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure) defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 5 01:33:29 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ha::Corosync/File[/etc/corosync/authkey]/ensure: defined content as '{sha256}a1a7edee42c15f31fc0c902df1d21686fae98d3510ceddb1255d058bf820baa4' Nov 5 01:33:29 kjcf05n02 systemd[1]: Reloading. Nov 5 01:33:30 kjcf05n02 systemd[1]: Starting Corosync Cluster Engine... Nov 5 01:33:30 kjcf05n02 await_ha_peer[15046]: Waiting for HA peer kjcf05n03 Nov 5 01:33:31 kjcf05n02 ip-monitor-link: Link state has changed: link=ib1, state=UP Nov 5 01:33:31 kjcf05n02 await_ha_peer[15046]: Peer kjcf05n03 has started, starting HA Nov 5 01:33:31 kjcf05n02 systemd[1]: Started Corosync Cluster Engine. Nov 5 01:33:31 kjcf05n02 systemd[1]: Started Fast STONITH daemon. Nov 5 01:33:31 kjcf05n02 fstonithd.py[15082]: Listening for kdump packets from partner Nov 5 01:33:31 kjcf05n02 systemd[1]: Reloading. Nov 5 01:33:31 kjcf05n00 mcfcli[3673891]: %3|1730792011.670|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 01:33:32 kjcf05n02 systemd[3132]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:33:32 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ha::Corosync/Service[corosync]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:33:32 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ha::Corosync/Service[corosync]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:33:32 kjcf05n02 systemd[1]: Reloading. Nov 5 01:33:32 kjcf05n02 systemd[1]: Reached target resource-agents dependencies. Nov 5 01:33:32 kjcf05n02 systemd[1]: Started Pacemaker High Availability Cluster Manager. Nov 5 01:33:32 kjcf05n02 systemd[1]: Reloading. Nov 5 01:33:33 kjcf05n02 systemd[15617]: Last message 'Reloading.' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 5 01:33:33 kjcf05n02 puppet-agent[3527]: (/Stage[main]/Ha::Corosync/Service[pacemaker]/ensure) ensure changed 'stopped' to 'running' Nov 5 01:33:33 kjcf05n02 puppet[3527]: Notice: /Stage[main]/Ha::Corosync/Service[pacemaker]/ensure: ensure changed 'stopped' to 'running' Nov 5 01:33:33 kjcf05n02 puppet-agent[3527]: Applied catalog in 91.05 seconds Nov 5 01:33:33 kjcf05n02 puppet[3527]: Notice: Applied catalog in 91.05 seconds Nov 5 01:33:33 kjcf05n02 systemd[1]: Started Puppet agent. Nov 5 01:33:33 kjcf05n02 systemd[1]: Started Service to do FW and inventory check on boot. Nov 5 01:33:33 kjcf05n02 systemd[1]: Starting Disable write cache for SSD drives in canister... Nov 5 01:33:33 kjcf05n02 systemd[1]: Started Collect SAS Health Report every hour. Nov 5 01:33:33 kjcf05n02 systemd[1]: Reached target Timers. Nov 5 01:33:33 kjcf05n02 systemd[1]: Starting Set absolute GEM time... Nov 5 01:33:33 kjcf05n02 systemd[1]: Starting Collect SAS Health Report... Nov 5 01:33:33 kjcf05n02 systemd[1]: Started DP-API REST gRPC Storage Node Service. Nov 5 01:33:33 kjcf05n02 systemd[1]: Started Startup script for monitoring-ec-node. Nov 5 01:33:33 kjcf05n02 systemd[1]: Started Startup script for gateway-ec-node. Nov 5 01:33:33 kjcf05n02 wce-disable.sh[15238]: /opt/xyratex/bin/wce-disable.sh: line 15: hdparm: command not found Nov 5 01:33:33 kjcf05n02 systemd[1]: disable-write-cache.service: Succeeded. Nov 5 01:33:33 kjcf05n02 systemd[1]: Started Disable write cache for SSD drives in canister. Nov 5 01:33:33 kjcf05n02 systemd[1]: sashealth.service: Succeeded. Nov 5 01:33:33 kjcf05n02 systemd[1]: Started Collect SAS Health Report. Nov 5 01:33:33 kjcf05n02 systemd[1]: set_gem_time.service: Succeeded. Nov 5 01:33:33 kjcf05n02 systemd[1]: Started Set absolute GEM time. Nov 5 01:33:33 kjcf05n02 python3.9[15242]: [signal_receiver.py:51 - start_existing_metric_reports() ] [INFO] CSM:Generic : No persitently stored EventDestinations seen. No data streams to start on init. Nov 5 01:33:33 kjcf05n02 python3.9[15242]: [monitoring-ec-node.py:26 - serve() ] [INFO] CSM:Generic : Starting monitoring-ec service Nov 5 01:33:33 kjcf05n02 gateway-ec-node.py[15243]: Starting gateway-ec-node service Nov 5 01:33:33 kjcf05n02 RFSF-API[15241]: INFO[2024-11-05T01:33:33-06:00] Datapath API RESTful Service starting Nov 5 01:33:33 kjcf05n02 dp-api-server-node[15241]: INFO[2024-11-05T01:33:33-06:00] Datapath API RESTful Service starting Nov 5 01:33:33 kjcf05n02 RFSF-API[15241]: INFO[2024-11-05T01:33:33-06:00] Running in production mode, starting dbus event listener Nov 5 01:33:33 kjcf05n02 dp-api-server-node[15241]: INFO[2024-11-05T01:33:33-06:00] Running in production mode, starting dbus event listener Nov 5 01:33:33 kjcf05n02 RFSF-API[15241]: INFO[2024-11-05T01:33:33-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 5 01:33:33 kjcf05n02 dp-api-server-node[15241]: INFO[2024-11-05T01:33:33-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json Nov 5 01:33:33 kjcf05n02 RFSF-API[15241]: INFO[2024-11-05T01:33:33-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 5 01:33:33 kjcf05n02 dp-api-server-node[15241]: INFO[2024-11-05T01:33:33-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LustreStats.json" locally Nov 5 01:33:33 kjcf05n02 RFSF-API[15241]: INFO[2024-11-05T01:33:33-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 5 01:33:33 kjcf05n02 dp-api-server-node[15241]: INFO[2024-11-05T01:33:33-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json Nov 5 01:33:33 kjcf05n02 RFSF-API[15241]: INFO[2024-11-05T01:33:33-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 5 01:33:33 kjcf05n02 dp-api-server-node[15241]: INFO[2024-11-05T01:33:33-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/LinuxStats.json" locally Nov 5 01:33:33 kjcf05n02 RFSF-API[15241]: INFO[2024-11-05T01:33:33-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 5 01:33:33 kjcf05n02 dp-api-server-node[15241]: INFO[2024-11-05T01:33:33-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json Nov 5 01:33:33 kjcf05n02 RFSF-API[15241]: INFO[2024-11-05T01:33:33-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 5 01:33:33 kjcf05n02 dp-api-server-node[15241]: INFO[2024-11-05T01:33:33-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/JobStats.json" locally Nov 5 01:33:33 kjcf05n02 RFSF-API[15241]: INFO[2024-11-05T01:33:33-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 5 01:33:33 kjcf05n02 dp-api-server-node[15241]: INFO[2024-11-05T01:33:33-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json Nov 5 01:33:33 kjcf05n02 RFSF-API[15241]: INFO[2024-11-05T01:33:33-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 5 01:33:33 kjcf05n02 dp-api-server-node[15241]: INFO[2024-11-05T01:33:33-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/EnvironmentalStats.json" locally Nov 5 01:33:33 kjcf05n02 RFSF-API[15241]: INFO[2024-11-05T01:33:33-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 5 01:33:33 kjcf05n02 dp-api-server-node[15241]: INFO[2024-11-05T01:33:33-06:00] Saving resource to /mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json Nov 5 01:33:33 kjcf05n02 RFSF-API[15241]: INFO[2024-11-05T01:33:33-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 5 01:33:33 kjcf05n02 dp-api-server-node[15241]: INFO[2024-11-05T01:33:33-06:00] Successfully saved resource "/mnt/persistent_ha_data/rfsf_resources//TelemetryService/MetricDefinitions/TieringStats.json" locally Nov 5 01:33:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730792016', 'host':'kjcf05n02', 'service_name':'Lustre Health', 'value':'OK', 'message':'OK:Lustre isn't mounted'}"] Nov 5 01:33:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730792016', 'host':'kjcf05n02', 'service_name':'Swap Usage', 'value':'OK', 'message':'SWAP OK - 100% free (16383 MB out of 16383 MB) '}"] Nov 5 01:33:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Swap Usage', 'description': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'message': 'SWAP OK - 100% free (16383 MB out of 16383 MB) ', 'value': 'ok', 'timestamp': '1730792016'} Nov 5 01:33:36 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Lustre Health', 'description': "OK:Lustre isn't mounted", 'message': "OK:Lustre isn't mounted", 'value': 'ok', 'timestamp': '1730792016'} Nov 5 01:33:36 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:33:40 kjcf05n00 python3.9[15617]: Last message 'dbus[10432]: A handl' repeated 1 times, suppressed by syslog-ng on kjcf05n00 Nov 5 01:33:40 kjcf05n02 systemd[1]: Reloading. Nov 5 01:33:40 kjcf05n02 systemd[1]: Starting Cluster Controlled diskmonitor... Nov 5 01:33:40 kjcf05n02 systemd[1]: Reloading. Nov 5 01:33:40 kjcf05n02 systemd[1]: Starting Cluster Controlled lcnmon... Nov 5 01:33:41 kjcf05n02 diskmonitor_pre[15720]: Key management is currently disabled.DEAR disabled Nov 5 01:33:41 kjcf05n02 systemd[1]: Started Cluster Controlled diskmonitor. Nov 5 01:33:42 kjcf05n02 dcs-collectord[5602]: WARNING Failed to fetch system inventory (hpi_collection_process.py:158) Nov 5 01:33:42 kjcf05n02 dcs-collectord[5602]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 01:33:42 kjcf05n02 dcs-collectord[5602]: ERROR openHPI: Unable to open session 'NO_RESPONSE' (hpi_session_management.py:81) Nov 5 01:33:42 kjcf05n02 sh[15780]: LNET configured: New Created Nov 5 01:33:42 kjcf05n02 systemd[1]: Started Cluster Controlled lcnmon. Nov 5 01:33:42 kjcf05n02 LCNmon[17809]: Interface ib0 is up Nov 5 01:33:42 kjcf05n02 LCNmon[17809]: Interface ib1 is up Nov 5 01:33:42 kjcf05n00 httpd[1812024]: [elements.py:2085 - store() ] [INFO] CSM:Inventory : srv_inventory data received (node_id kjcf05n:Node-R1C1-34U-A): {'bmc': {'Firmware Revision': '10.52'}, 'hostname': 'kjcf05n02', 'hsbp': {}, 'psu': [{'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001277', 'state': 'ok'}, {'Manufacturer': 'DELTA', 'Part Number': ' ', 'Product Name': 'DPS-1600EB A', 'Serial Number': 'GSAD1944001106', 'state': 'ok'}]} Nov 5 01:33:43 kjcf05n02 systemd[1]: nodebootchecks.service: Succeeded. Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: Starting: version=v1.0.x.6.7.010-118.x.394975b4 verbosity=1 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: /var/run/diskmonitor does not exist, creating Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: /var/run/diskmonitor/sync_speed_min does not exist, creating Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: Creating /var/run/diskmonitor/disk Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: Creating /var/run/diskmonitor/encl Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: Creating /var/run/diskmonitor/cli Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: RAS_Interlocks_enabled: 1 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: Failed disk history at /var/lib/diskmonitor/failed_disks Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: Reconstruction policy dir: /var/lib/xyratex/reconstruction_policy Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: Could not open /opt/xyratex/etc/known_ssds (2) Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: Using default ssd ids: HUSSL4010ASS600 , Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: add handler for sig: 14 sa_flags: 10000004 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: add handler for sig: 1 sa_flags: 10000004 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: add handler for sig: 2 sa_flags: 00000004 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: add handler for sig: 15 sa_flags: 00000004 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: add handler for sig: 6 sa_flags: 00000004 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: add handler for sig: 3 sa_flags: 00000004 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: add handler for sig: 30 sa_flags: 00000004 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: add handler for sig: 20 sa_flags: 00000004 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: add handler for sig: 10 sa_flags: 10000004 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: add handler for sig: 11 sa_flags: 00000004 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: add handler for sig: 7 sa_flags: 00000004 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: add handler for sig: 4 sa_flags: 00000004 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: add handler for sig: 8 sa_flags: 00000004 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: init_watch: /var/run/diskmonitor/encl initialized Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: init_watch: /var/run/diskmonitor/disk initialized Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: init_watch: /var/lib/xyratex/reconstruction_policy initialized Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: init_watch: /var/lib/xyratex/diskmonitor initialized Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: pidfname: /var/run/diskmonitor/diskmonitor.pid Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: Using HA Baton locks - key: diskmonitor Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: Baton will be held for at most 570 seconds Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: DMMP Enabled: 0 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: random seed: 3c84ba02 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: is_nvme_enclosure, system enclosure name: VSSEP1EA Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: NVMe Enclosure: 1 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: get_encl_DWPD, Enclosure DWPD setting: 1 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: ZFS Enclosure: 0 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: Dbus, Initialized Connection Successfully Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: int_catcher_thread: thread start Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: Received dbus message 4 org.freedesktop.DBus -> :1.95 /org/freedesktop/DBus/org.freedesktop.DBus/NameAcquired Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: get_nvme_enclosure_serial_number, Attempting ipmitool for Chassis serial number: ipmitool fru print 2 | grep -m 1 'Chassis Serial' Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: add_nvme_encl_if_valid, manufacturer: Viking, product: VSSEP1EA, serial number: USE26000024VS001, encl_slot: 0 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: Inserted Enclosure:prod_id: VSSEP1EA, vendor: Viking, serial_number: USE26000024VS001 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme0n1 update slot: 1 nvme_wwn[0] old: new: eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_slot: 0 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme1n1 update slot: 2 nvme_wwn[0] old: new: eui.0025385a91b0b311_S4EUNF0MA19503M encl_slot: 0 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme2n1 update slot: 24 nvme_wwn[0] old: new: eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_slot: 0 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme3n1 update slot: 22 nvme_wwn[0] old: new: eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_slot: 0 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme4n1 update slot: 20 nvme_wwn[0] old: new: eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_slot: 0 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme5n1 update slot: 18 nvme_wwn[0] old: new: eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_slot: 0 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme6n1 update slot: 16 nvme_wwn[0] old: new: eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_slot: 0 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme7n1 update slot: 14 nvme_wwn[0] old: new: eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_slot: 0 Nov 5 01:33:44 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 5 01:33:44 kjcf05n00 mcfcli[3673891]: %3|1730792024.820|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:33:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730792026', 'host':'kjcf05n02', 'service_name':'Current Load', 'value':'OK', 'message':'OK - load average: 1.99, 1.88, 0.86'}"] Nov 5 01:33:46 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Current Load', 'description': 'OK - load average: 1.99, 1.88, 0.86', 'message': 'OK - load average: 1.99, 1.88, 0.86', 'value': 'ok', 'timestamp': '1730792026'} Nov 5 01:33:46 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:33:47 kjcf05n02 openhpid[5508]: (null): gemhpi_discovery_api.c:224: Gemhpi Context is Shutting down Nov 5 01:33:47 kjcf05n02 openhpid[5508]: (null): gemhpi_core_api.c:1015: Plugin instance shutdown complete Nov 5 01:33:47 kjcf05n02 LCNmon[17809]: 10.16.100.57 is unreachable via ib0 Nov 5 01:33:47 kjcf05n02 LCNmon[17809]: Can ping through interface ib0 Nov 5 01:33:47 kjcf05n02 systemd[1]: openhpid.service: Succeeded. Nov 5 01:33:47 kjcf05n02 systemd[1]: Stopped Daemon providing access to the SAF Hardware Platform Interface. Nov 5 01:33:47 kjcf05n02 systemd[1]: Starting Daemon providing access to the SAF Hardware Platform Interface... Nov 5 01:33:47 kjcf05n02 systemd[1]: openhpid.service: Supervising process 18444 which is not our child. We'll most likely not notice when it exits. Nov 5 01:33:47 kjcf05n02 systemd[1]: Started Daemon providing access to the SAF Hardware Platform Interface. Nov 5 01:33:47 kjcf05n02 systemd[1]: Reached target Multi-User System. Nov 5 01:33:47 kjcf05n02 systemd[1]: Reached target Graphical Interface. Nov 5 01:33:47 kjcf05n02 systemd[1]: Starting Update UTMP about System Runlevel Changes... Nov 5 01:33:47 kjcf05n02 dcs-collectord[5602]: IEC: 006001003: Successfully restarted the OpenHPI service Nov 5 01:33:47 kjcf05n02 systemd[1]: systemd-update-utmp-runlevel.service: Succeeded. Nov 5 01:33:47 kjcf05n02 systemd[1]: Started Update UTMP about System Runlevel Changes. Nov 5 01:33:47 kjcf05n02 systemd[1]: Startup finished in 50.534s (kernel) + 2min 28.929s (userspace) = 3min 19.463s. Nov 5 01:33:47 kjcf05n02 openhpid[18444]: (null): gemhpi_discovery_api.c:1911: Unable to get SCSI device scan count Nov 5 01:33:47 kjcf05n02 openhpid[18444]: (null): gemhpi_discovery_api.c:1410: Unable to get SCSI device scan count Nov 5 01:33:47 kjcf05n02 openhpid[18444]: (null): gemhpi_hpi_repos_api.c:586: Discovery update failure detected; Error code:-1009 Nov 5 01:33:47 kjcf05n02 openhpid[18444]: (null): gemhpi_discovery_api.c:676: Failure detected updating enclosure map; Error code:-1009 Nov 5 01:33:47 kjcf05n02 LCNmon[17809]: Can ping through interface ib1 Nov 5 01:33:47 kjcf05n02 LCNmon[17809]: NIC ib0, initial state UP Nov 5 01:33:47 kjcf05n02 LCNmon[17809]: NIC ib1, initial state UP Nov 5 01:33:47 kjcf05n02 LCNmon[17809]: LCNstat initial state UP Nov 5 01:33:47 kjcf05n02 LCNmon[17809]: LCNmon monitoring hosts kjcf05n02 and kjcf05n03 Nov 5 01:33:48 kjcf05n02 systemd[1]: mnt-llog.automount: Got automount request for /mnt/llog, triggered by 18570 (bash) Nov 5 01:33:48 kjcf05n02 systemd[1]: Mounting /mnt/llog... Nov 5 01:33:48 kjcf05n02 systemd[1]: Reached target Host and Network Name Lookups. Nov 5 01:33:48 kjcf05n02 systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Nov 5 01:33:48 kjcf05n02 systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Nov 5 01:33:48 kjcf05n02 systemd[1]: Mounted /mnt/llog. Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme8n1 update slot: 23 nvme_wwn[0] old: new: eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_slot: 0 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme9n1 update slot: 21 nvme_wwn[0] old: new: eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_slot: 0 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme10n1 update slot: 19 nvme_wwn[0] old: new: eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_slot: 0 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme11n1 update slot: 17 nvme_wwn[0] old: new: eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_slot: 0 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme12n1 update slot: 15 nvme_wwn[0] old: new: eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_slot: 0 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme13n1 update slot: 13 nvme_wwn[0] old: new: eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_slot: 0 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme14n1 update slot: 1 nvme_wwn[0] old: new: eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_slot: 0 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme15n1 update slot: 3 nvme_wwn[0] old: new: eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_slot: 0 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme16n1 update slot: 5 nvme_wwn[0] old: new: eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_slot: 0 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme17n1 update slot: 7 nvme_wwn[0] old: new: eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_slot: 0 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme18n1 update slot: 9 nvme_wwn[0] old: new: eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_slot: 0 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme19n1 update slot: 11 nvme_wwn[0] old: new: eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_slot: 0 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme20n1 update slot: 2 nvme_wwn[0] old: new: eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_slot: 0 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme21n1 update slot: 4 nvme_wwn[0] old: new: eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_slot: 0 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme22n1 update slot: 6 nvme_wwn[0] old: new: eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_slot: 0 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme23n1 update slot: 8 nvme_wwn[0] old: new: eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_slot: 0 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme24n1 update slot: 10 nvme_wwn[0] old: new: eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_slot: 0 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots nvme disk: nvme25n1 update slot: 12 nvme_wwn[0] old: new: eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_slot: 0 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme11n1, eui.345950304e3006130025384500000003_S4YPNE0N300613 encl_sn: USE26000024VS001, slot: 17 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006130025384500000003 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme5n1, eui.345950304e3006320025384500000003_S4YPNE0N300632 encl_sn: USE26000024VS001, slot: 18 Nov 5 01:33:51 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006320025384500000003 Nov 5 01:33:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730792031', 'host':'kjcf05n02', 'service_name':'Network statistics', 'value':'OK', 'message':'NET OK - (Rx/Tx) ib0=(3360.0B/2756.0B), ib1=(2688.0B/2672.0B), icl0=(8.0kB/9.6kB), lo=(1080.0B/1080.0B), meth0=(1541.7MB/8.4MB), mgmt0=(1478.4MB/8.4MB)'}"] Nov 5 01:33:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Network statistics', 'description': 'NET OK - (Rx/Tx) ib0=(3360.0B/2756.0B), ib1=(2688.0B/2672.0B), icl0=(8.0kB/9.6kB), lo=(1080.0B/1080.0B), meth0=(1541.7MB/8.4MB), mgmt0=(1478.4MB/8.4MB)', 'message': 'NET OK - (Rx/Tx) ib0=(3360.0B/2756.0B), ib1=(2688.0B/2672.0B), icl0=(8.0kB/9.6kB), lo=(1080.0B/1080.0B), meth0=(1541.7MB/8.4MB), mgmt0=(1478.4MB/8.4MB)', 'value': 'ok', 'timestamp': '1730792031'} Nov 5 01:33:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:33:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730792031', 'host':'kjcf05n02', 'service_name':'Free Space', 'value':'OK', 'message':'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);'}"] Nov 5 01:33:51 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Free Space', 'description': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'message': 'DISK OK - free space: /tmp 128639 MiB (99.99% inode=100%);', 'value': 'ok', 'timestamp': '1730792031'} Nov 5 01:33:51 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:33:57 kjcf05n02 dcs-collectord[5602]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 01:33:57 kjcf05n02 dcs-collectord[5602]: WARNING No data collected (hpi_parser.py:353) Nov 5 01:34:01 kjcf05n00 mcfcli[3673891]: %3|1730792041.670|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:34:11 kjcf05n02 ipmievd[3941]: System Event sensor - Timestamp Clock Sync Nov 5 01:34:12 kjcf05n02 ipmievd[3132]: Last message 'System Event sensor ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:34:12 kjcf05n02 dcs-collectord[5602]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 01:34:22 kjcf05n00 mcfcli[3673891]: %3|1730792062.662|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme7n1, eui.345950304e3006260025384500000003_S4YPNE0N300626 encl_sn: USE26000024VS001, slot: 14 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006260025384500000003 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme13n1, eui.345950304db010210025384500000004_S4YPNE0MB01021 encl_sn: USE26000024VS001, slot: 13 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010210025384500000004 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme1n1, eui.0025385a91b0b311_S4EUNF0MA19503M encl_sn: USE26000024VS001, slot: 2 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme14n1, eui.345950304db010370025384500000004_S4YPNE0MB01037 encl_sn: USE26000024VS001, slot: 1 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010370025384500000004 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme6n1, eui.345950304e3006180025384500000003_S4YPNE0N300618 encl_sn: USE26000024VS001, slot: 16 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006180025384500000003 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme10n1, eui.345950304e3006330025384500000003_S4YPNE0N300633 encl_sn: USE26000024VS001, slot: 19 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006330025384500000003 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme3n1, eui.345950304e3006450025384500000003_S4YPNE0N300645 encl_sn: USE26000024VS001, slot: 22 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006450025384500000003 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme4n1, eui.345950304e3006300025384500000003_S4YPNE0N300630 encl_sn: USE26000024VS001, slot: 20 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006300025384500000003 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme0n1, eui.0025385a91b0b2a1_S4EUNF0MA19391N encl_sn: USE26000024VS001, slot: 1 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme2n1, eui.345950304e3006250025384500000003_S4YPNE0N300625 encl_sn: USE26000024VS001, slot: 24 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006250025384500000003 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme12n1, eui.345950304e3006140025384500000003_S4YPNE0N300614 encl_sn: USE26000024VS001, slot: 15 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006140025384500000003 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme19n1, eui.345950304db010160025384500000004_S4YPNE0MB01016 encl_sn: USE26000024VS001, slot: 11 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010160025384500000004 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme8n1, eui.345950304e3006430025384500000003_S4YPNE0N300643 encl_sn: USE26000024VS001, slot: 23 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006430025384500000003 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme16n1, eui.345950304db010130025384500000004_S4YPNE0MB01013 encl_sn: USE26000024VS001, slot: 5 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010130025384500000004 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme21n1, eui.345950304db010010025384500000004_S4YPNE0MB01001 encl_sn: USE26000024VS001, slot: 4 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010010025384500000004 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme15n1, eui.345950304db009940025384500000004_S4YPNE0MB00994 encl_sn: USE26000024VS001, slot: 3 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009940025384500000004 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme20n1, eui.345950304db010070025384500000004_S4YPNE0MB01007 encl_sn: USE26000024VS001, slot: 2 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010070025384500000004 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme24n1, eui.345950304db010260025384500000004_S4YPNE0MB01026 encl_sn: USE26000024VS001, slot: 10 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010260025384500000004 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme22n1, eui.345950304db010120025384500000004_S4YPNE0MB01012 encl_sn: USE26000024VS001, slot: 6 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010120025384500000004 Nov 5 01:34:23 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme17n1, eui.345950304db010240025384500000004_S4YPNE0MB01024 encl_sn: USE26000024VS001, slot: 7 Nov 5 01:34:27 kjcf05n02 dcs-collectord[5602]: INFO File /tmp/diskmonitor/dm_report.yaml missing, will reschedule hardware collection in 15 seconds (hardware_collection_process.py:182) Nov 5 01:34:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730792068', 'host':'kjcf05n02', 'service_name':'SAS Health', 'value':'OK', 'message':'OK'}"] Nov 5 01:34:28 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'SAS Health', 'description': 'OK', 'message': 'OK', 'value': 'ok', 'timestamp': '1730792068'} Nov 5 01:34:28 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:34:31 kjcf05n03 firmware-update-orc-server[5905]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false}, "id": "b7a8913f-60ad-4703-a1d3-52f2867b7349"} (logger.py:65) Nov 5 01:34:31 kjcf05n00 ras-resource-manager-server[16172]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '65811e08-9b48-11ef-bea8-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 5 01:34:31 kjcf05n00 ras-resource-manager-server[16172]: INFO Making request to Firmware Manager to update firmware: {'request ID': '65811e08-9b48-11ef-bea8-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (logger.py:65) Nov 5 01:34:31 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware manager received update request successfully: {'request ID': '65811e08-9b48-11ef-bea8-00093d0695e3', 'response ID': '658b9824-9b48-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 5 01:34:31 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task starting: 658b9824-9b48-11ef-acfe-00093d0696a6 (logger.py:65) Nov 5 01:34:31 kjcf05n00 mcfcli[3673891]: %3|1730792071.670|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 01:34:31 kjcf05n03 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 141392 (get_disk_device) Nov 5 01:34:31 kjcf05n03 systemd[1]: Mounting /opt/firmware... Nov 5 01:34:31 kjcf05n03 systemd[1]: Mounted /opt/firmware. Nov 5 01:34:31 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db01024002538450000000IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 5 01:34:31 kjcf05n02 ras-resource-manager-agent[5866]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "65811e08-9b48-11ef-bea8-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} (service_main_handler.py:66) Nov 5 01:34:31 kjcf05n02 ras-resource-manager-agent[5866]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '65811e08-9b48-11ef-bea8-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}} (resource_admin.py:98) Nov 5 01:34:31 kjcf05n02 ras-resource-manager-agent[5866]: INFO Submitting new device inserted signal, starting to qualify drive: 65811e08-9b48-11ef-bea8-00093d0695e3 (admin_action.py:110) Nov 5 01:34:32 kjcf05n03 ccp-client[141415]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 5 01:34:32 kjcf05n03 ccp-client[141415]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 5 01:34:32 kjcf05n03 ccp-client[141424]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 5 01:34:32 kjcf05n03 ccp-client[141415]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 5 01:34:32 kjcf05n03 ccp-client[141415]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 5 01:34:32 kjcf05n03 ccp-client[141424]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 5 01:34:32 kjcf05n03 ccp-client[141424]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 5 01:34:32 kjcf05n00 ras-resource-manager-server[16173]: INFO Starting 'device_qualification' task {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '65d1abde-9b48-11ef-bea8-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 5 01:34:32 kjcf05n00 ras-resource-manager-server[16173]: INFO Making request to Firmware Manager to update firmware: {'request ID': '65d1abde-9b48-11ef-bea8-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (logger.py:65) Nov 5 01:34:32 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware manager received update request successfully: {'request ID': '65d1abde-9b48-11ef-bea8-00093d0695e3', 'response ID': '65d91630-9b48-11ef-acfe-00093d0696a6'} (logger.py:65) Nov 5 01:34:32 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task starting: 65d91630-9b48-11ef-acfe-00093d0696a6 (logger.py:65) Nov 5 01:34:32 kjcf05n02 diskmonitor[17387]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 5 01:34:32 kjcf05n02 ras-resource-manager-agent[5866]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "65d1abde-9b48-11ef-bea8-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 5 01:34:32 kjcf05n02 ras-resource-manager-agent[5866]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '65d1abde-9b48-11ef-bea8-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 5 01:34:32 kjcf05n02 ras-resource-manager-agent[5866]: INFO Submitting new device inserted signal, starting to qualify drive: 65d1abde-9b48-11ef-bea8-00093d0695e3 (admin_action.py:110) Nov 5 01:34:32 kjcf05n02 firmware-update-orc-server[5822]: INFO Received task udpate_drive_firmware with request {"jsonrpc": "2.0", "method": "firmware.update", "params": {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false}, "id": "742d35e5-44bf-49bd-a065-a0481d27493c"} (logger.py:65) Nov 5 01:34:35 kjcf05n03 DRVFW[141569]: Skipped: eui.345950304db010370025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 5 01:34:35 kjcf05n03 ccp-client[141582]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 5 01:34:35 kjcf05n03 ccp-client[141582]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 5 01:34:35 kjcf05n03 ccp-client[141595]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 5 01:34:35 kjcf05n03 ccp-client[141582]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 5 01:34:35 kjcf05n03 ccp-client[141595]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 5 01:34:35 kjcf05n03 ccp-client[141595]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 5 01:34:35 kjcf05n03 ccp-client[141582]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 5 01:34:35 kjcf05n03 firmware-update-orc-server[5905]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01037", "fru_index": 1, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03"} (logger.py:65) Nov 5 01:34:35 kjcf05n02 ras-resource-manager-agent[5866]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '65811e08-9b48-11ef-bea8-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 5 01:34:35 kjcf05n02 ras-resource-manager-agent[5866]: INFO Drive qualification complete responding: 65811e08-9b48-11ef-bea8-00093d0695e3 (admin_action.py:205) Nov 5 01:34:35 kjcf05n02 ras-resource-manager-agent[5866]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "65811e08-9b48-11ef-bea8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (interesting_event.py:59) Nov 5 01:34:35 kjcf05n00 ras-resource-manager-server[16172]: INFO Firmware update task completed: 658b9824-9b48-11ef-acfe-00093d0696a6 (logger.py:65) Nov 5 01:34:35 kjcf05n00 ras-resource-manager-server[16172]: INFO Device qualification response: {'request ID': '65811e08-9b48-11ef-bea8-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '65811e08-9b48-11ef-bea8-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}}} (logger.py:65) Nov 5 01:34:38 kjcf05n02 diskmonitor[17387]: 4 Nov 5 01:34:38 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme23n1, eui.345950304db010060025384500000004_S4YPNE0MB01006 encl_sn: USE26000024VS001, slot: 8 Nov 5 01:34:38 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db010060025384500000004 Nov 5 01:34:38 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme25n1, eui.345950304db009960025384500000004_S4YPNE0MB00996 encl_sn: USE26000024VS001, slot: 12 Nov 5 01:34:38 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304db009960025384500000004 Nov 5 01:34:38 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme9n1, eui.345950304e3006310025384500000003_S4YPNE0N300631 encl_sn: USE26000024VS001, slot: 21 Nov 5 01:34:38 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3006310025384500000003 Nov 5 01:34:38 kjcf05n02 diskmonitor[17387]: Inserted NVME Device: /dev/nvme18n1, eui.345950304e3014370025384500000005_S4YPNE0N301437 encl_sn: USE26000024VS001, slot: 9 Nov 5 01:34:38 kjcf05n02 diskmonitor[17387]: unlock_drive, Successfully enrolled/unlocked the drive: eui.345950304e3014370025384500000005 Nov 5 01:34:38 kjcf05n02 diskmonitor[17387]: read_mdstat: alloc 4096 bytes for mdstat buffers Nov 5 01:34:38 kjcf05n02 diskmonitor[17387]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 5 01:34:38 kjcf05n02 diskmonitor[17387]: Dbus, notify_RAS_device_insert, interlock index: 0 Nov 5 01:34:38 kjcf05n02 diskmonitor[17387]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "65811e08-9b48-11ef-bea8-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}} Nov 5 01:34:38 kjcf05n02 diskmonitor[17387]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 5 01:34:38 kjcf05n02 diskmonitor[17387]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 5 01:34:38 kjcf05n02 diskmonitor[17387]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "65d1abde-9b48-11ef-bea8-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 5 01:34:38 kjcf05n02 diskmonitor[17387]: Writing NVMe disk report to /var/run/diskmonitor/nvme_report.json Nov 5 01:34:38 kjcf05n02 diskmonitor[17387]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 5 01:34:40 kjcf05n02 ras-resource-manager-agent[5866]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "65811e08-9b48-11ef-bea8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} (service_main_handler.py:66) Nov 5 01:34:40 kjcf05n02 ras-resource-manager-agent[5866]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '65811e08-9b48-11ef-bea8-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 1, 'device_serial_number': 'S4YPNE0MB01037'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n03', 'task_duration': 4}}} (resource_admin.py:98) Nov 5 01:34:40 kjcf05n02 ras-resource-manager-agent[5866]: INFO Device qualification response has been acknowledged: 65811e08-9b48-11ef-bea8-00093d0695e3 (admin_action.py:151) Nov 5 01:34:44 kjcf05n02 chronyd[5108]: Selected source 172.16.2.1 Nov 5 01:34:44 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31486 deleted. Nov 5 01:34:44 kjcf05n00 zabbix_server[15706]: escalation canceled: trigger id:31487 deleted. Nov 5 01:34:44 kjcf05n02 diskmonitor[17387]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01037", "device_slot": 1, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 5 01:34:45 kjcf05n02 diskmonitor[17387]: IEC: 012004001: Device insertion detected, requesting firmware leveling: {"device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 5 01:34:45 kjcf05n02 ras-resource-manager-agent[5866]: INFO Received new signal with payload: {"jsonrpc": 2.0, "method": "device.approve", "id": "6db4f5e0-9b48-11ef-bea8-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} (service_main_handler.py:66) Nov 5 01:34:45 kjcf05n02 ras-resource-manager-agent[5866]: INFO Processing request (1): {'jsonrpc': 2.0, 'method': 'device.approve', 'id': '6db4f5e0-9b48-11ef-bea8-00093d0695e3', 'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}} (resource_admin.py:98) Nov 5 01:34:45 kjcf05n02 ras-resource-manager-agent[5866]: INFO Requests ['65d1abde-9b48-11ef-bea8-00093d0695e3', '6db4f5e0-9b48-11ef-bea8-00093d0695e3'] already in progress (admin_action.py:99) Nov 5 01:34:47 kjcf05n02 systemd[1]: opt-firmware.automount: Got automount request for /opt/firmware, triggered by 23724 (get_disk_device) Nov 5 01:34:47 kjcf05n02 systemd[1]: Mounting /opt/firmware... Nov 5 01:34:47 kjcf05n02 systemd[1]: Mounted /opt/firmware. Nov 5 01:34:47 kjcf05n02 ccp-client[23751]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 5 01:34:47 kjcf05n02 ccp-client[23751]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 5 01:34:47 kjcf05n02 ccp-client[23764]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 5 01:34:47 kjcf05n02 ccp-client[23751]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 5 01:34:47 kjcf05n02 ccp-client[23751]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 5 01:34:47 kjcf05n02 ccp-client[23764]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 5 01:34:47 kjcf05n02 ccp-client[23764]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 5 01:34:49 kjcf05n02 systemd[1]: Unmounting /mnt/llog... Nov 5 01:34:49 kjcf05n02 systemd[1]: mnt-llog.mount: Succeeded. Nov 5 01:34:49 kjcf05n02 systemd[1]: Unmounted /mnt/llog. Nov 5 01:34:50 kjcf05n02 DRVFW[24101]: Skipped: eui.345950304db010210025384500000004 : samsung : SAMSUNG-MZWLJ3T8HBLS-00007 : EPK9GB5Q Nov 5 01:34:50 kjcf05n02 ccp-client[24106]: INFO Logging has been initialized for 'ccp-client' (log_utils.py:68) Nov 5 01:34:50 kjcf05n02 ccp-client[24106]: INFO Starting Remote Task Tracker (remote_task_tracker.py:93) Nov 5 01:34:50 kjcf05n02 ccp-client[24125]: INFO Starting Remote Task Manager (remote_task_mgr.py:86) Nov 5 01:34:50 kjcf05n02 ccp-client[24106]: INFO Shutting down Remote Task Tracker (remote_task_tracker.py:119) Nov 5 01:34:50 kjcf05n02 ccp-client[24106]: INFO Remote Task Tracker has shutdown (remote_task_tracker.py:142) Nov 5 01:34:50 kjcf05n02 ccp-client[24125]: INFO Shutting down Remote Task Manager (remote_task_mgr.py:104) Nov 5 01:34:50 kjcf05n02 ccp-client[24125]: INFO Remote Task Manager has shutdown (remote_task_mgr.py:121) Nov 5 01:34:50 kjcf05n02 firmware-update-orc-server[5822]: INFO IEC: 051001002: Drive firmware update was skipped: {"enclosure": "USE26000024VS001", "fru_type": "disk", "fru_serial_no": "S4YPNE0MB01021", "fru_index": 13, "notify": false, "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02"} (logger.py:65) Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "65811e08-9b48-11ef-bea8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 0 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: Dbus, handle_ingress_ras_signals, uuid: 65811e08-9b48-11ef-bea8-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01037, interlock index: 0 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "65811e08-9b48-11ef-bea8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 1, "device_serial_number": "S4YPNE0MB01037"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n03", "task_duration": 4}}} Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: main: Pending firmware leveling requests exist, rescanning disks Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_enclosures, Scanning NVMe Enclosure: nvme0 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme0n1 in internal slot: 1 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme1n1 in internal slot: 2 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme2n1 in enclosure slot: 24 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme3n1 in enclosure slot: 22 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme4n1 in enclosure slot: 20 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme5n1 in enclosure slot: 18 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme6n1 in enclosure slot: 16 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme7n1 in enclosure slot: 14 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme8n1 in enclosure slot: 23 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme9n1 in enclosure slot: 21 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme10n1 in enclosure slot: 19 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme11n1 in enclosure slot: 17 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme12n1 in enclosure slot: 15 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme13n1 in enclosure slot: 13 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme14n1 in enclosure slot: 1 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme15n1 in enclosure slot: 3 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme16n1 in enclosure slot: 5 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme17n1 in enclosure slot: 7 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme18n1 in enclosure slot: 9 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme19n1 in enclosure slot: 11 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme20n1 in enclosure slot: 2 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme21n1 in enclosure slot: 4 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme22n1 in enclosure slot: 6 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme23n1 in enclosure slot: 8 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme24n1 in enclosure slot: 10 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: scan_nvme_encl_slots, Found drive: nvme25n1 in enclosure slot: 12 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: mdadm_zdb_examine_disk: Drive nvme14n1 updated to dps value 0 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: Dbus, notify_RAS_device_insert, interlock index: 1 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: Dbus, Sending to Resource Manager: {"jsonrpc": 2.0, "method": "device.approve", "id": "6db4f5e0-9b48-11ef-bea8-00093d0695e3", "params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}} Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: leaving test state: 1 next state: 2 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: lock req: no timeout Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: leaving test state: 2 next state: 4 Nov 5 01:34:51 kjcf05n02 diskmonitor[17387]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 5 01:34:52 kjcf05n00 ras-resource-manager-server[16173]: INFO Firmware update task completed: 65d91630-9b48-11ef-acfe-00093d0696a6 (logger.py:65) Nov 5 01:34:52 kjcf05n02 ras-resource-manager-agent[5866]: INFO Processing request (3): {'jsonrpc': '2.0', 'id': '65d1abde-9b48-11ef-bea8-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 18}}} (resource_admin.py:98) Nov 5 01:34:52 kjcf05n02 ras-resource-manager-agent[5866]: INFO Drive qualification complete responding: 65d1abde-9b48-11ef-bea8-00093d0695e3 (admin_action.py:205) Nov 5 01:34:52 kjcf05n02 ras-resource-manager-agent[5866]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "65d1abde-9b48-11ef-bea8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} (interesting_event.py:59) Nov 5 01:34:52 kjcf05n02 ras-resource-manager-agent[5866]: INFO IEC: 057001002: A new device has been successfully qualified: {"jsonrpc": "2.0", "id": "6db4f5e0-9b48-11ef-bea8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} (interesting_event.py:59) Nov 5 01:34:52 kjcf05n00 ras-resource-manager-server[16173]: INFO Device qualification response: {'request ID': '65d1abde-9b48-11ef-bea8-00093d0695e3', 'response': {'jsonrpc': '2.0', 'id': '65d1abde-9b48-11ef-bea8-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 18}}}} (logger.py:65) Nov 5 01:34:59 kjcf05n02 python3.9[5169]: [ses_monitor.py:618 - run() ] [INFO] CSM:Generic : starting pyinotify thread to monitor for NVMe inventory dumps Nov 5 01:35:01 kjcf05n00 mcfcli[3673891]: %3|1730792101.670|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 5 01:35:02 kjcf05n02 python3.9[3132]: Last message '[ses_monitor.py:618 ' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:35:02 kjcf05n00 mcfcli[3673891]: %3|1730792102.659|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:35:13 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "node", "category": "performance", "value": "linux"} Nov 5 01:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,1,overall_health]', 'value': 'ok', 'timestamp': 1730792117}"] Nov 5 01:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730792117, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:35:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,2,overall_health]', 'value': 'ok', 'timestamp': 1730792117}"] Nov 5 01:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730792117, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:35:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,3,overall_health]', 'value': 'ok', 'timestamp': 1730792117}"] Nov 5 01:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '3', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730792117, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:35:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,4,overall_health]', 'value': 'ok', 'timestamp': 1730792117}"] Nov 5 01:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '4', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730792117, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:35:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,5,overall_health]', 'value': 'ok', 'timestamp': 1730792117}"] Nov 5 01:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '5', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730792117, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:35:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},cooling,6,overall_health]', 'value': 'ok', 'timestamp': 1730792117}"] Nov 5 01:35:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '6', 'type': 'cooling', 'attribute': 'overall_health', 'timestamp': 1730792117, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:35:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:35:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,1,overall_health]', 'value': 'ok', 'timestamp': 1730792117}"] Nov 5 01:35:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730792117, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:35:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:35:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.enclosure.components.attributes[{$SERIAL_NUMBER},power_supply,2,overall_health]', 'value': 'ok', 'timestamp': 1730792117}"] Nov 5 01:35:18 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '2', 'type': 'power_supply', 'attribute': 'overall_health', 'timestamp': 1730792117, 'value': 'ok', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:35:18 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:35:31 kjcf05n00 mcfcli[3673891]: %3|1730792131.670|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 01:35:38 kjcf05n00 mcfcli[3673891]: %3|1730792138.428|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:35:40 kjcf05n00 python3.9[2620325]: [dimm_checker.py:164 - get_state() ] [WARNING] CSM:Generic : Warning: Correctable error(s): DIMM H code 4000 Nov 5 01:35:51 kjcf05n02 ras-resource-manager-agent[5866]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "65d1abde-9b48-11ef-bea8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} (service_main_handler.py:66) Nov 5 01:35:51 kjcf05n02 ras-resource-manager-agent[5866]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '65d1abde-9b48-11ef-bea8-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 18}}} (resource_admin.py:98) Nov 5 01:35:51 kjcf05n02 ras-resource-manager-agent[5866]: INFO Device qualification response has been acknowledged: 65d1abde-9b48-11ef-bea8-00093d0695e3 (admin_action.py:151) Nov 5 01:35:51 kjcf05n02 ras-resource-manager-agent[5866]: INFO Received new signal with payload: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "6db4f5e0-9b48-11ef-bea8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} (service_main_handler.py:66) Nov 5 01:35:51 kjcf05n02 ras-resource-manager-agent[5866]: INFO Processing request (2): {'jsonrpc': '2.0', 'method': 'device.approve.ack', 'id': '6db4f5e0-9b48-11ef-bea8-00093d0695e3', 'result': {'message': 'Skipping firmware update, firmware already at EPK9GB5Q', 'data': {'params': {'enclosure_serial_number': 'USE26000024VS001', 'device_type': 'disk', 'index': 13, 'device_serial_number': 'S4YPNE0MB01021'}, 'reason': 'approved', 'status': 'skipped', 'firmware_version': 'EPK9GB5Q', 'hostname': 'kjcf05n02', 'task_duration': 18}}} (resource_admin.py:98) Nov 5 01:35:51 kjcf05n02 ras-resource-manager-agent[5866]: INFO Device qualification response has been acknowledged: 6db4f5e0-9b48-11ef-bea8-00093d0695e3 (admin_action.py:151) Nov 5 01:35:51 kjcf05n02 diskmonitor[17387]: IEC: 012004002: Firmware leveled successfully and permission granted to use: { "device_wwn": "0000000000000000", "device_sn": "S4YPNE0MB01021", "device_slot": 13, "encl_wwn": "0000000000000000", "encl_sn": "USE26000024VS001"} Nov 5 01:35:52 kjcf05n03 systemd[1]: Unmounting /opt/firmware... Nov 5 01:35:52 kjcf05n03 systemd[1]: opt-firmware.mount: Succeeded. Nov 5 01:35:52 kjcf05n03 systemd[1]: Unmounted /opt/firmware. Nov 5 01:35:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730791866', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 5 01:35:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730791866'} Nov 5 01:35:54 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:35:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730791866', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 5 01:35:54 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730791866'} Nov 5 01:35:54 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:36:01 kjcf05n00 mcfcli[3673891]: %3|1730792161.670|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 93 identical error(s) suppressed) Nov 5 01:36:08 kjcf05n02 dcs-collectord[5602]: INFO Successfully collected data dmreport after 7 failures (dm_report_collection_process.py:204) Nov 5 01:36:08 kjcf05n02 systemd[1]: Unmounting /opt/firmware... Nov 5 01:36:08 kjcf05n02 systemd[1]: opt-firmware.mount: Succeeded. Nov 5 01:36:08 kjcf05n02 systemd[1]: Unmounted /opt/firmware. Nov 5 01:36:09 kjcf05n02 diskmonitor[17387]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "65d1abde-9b48-11ef-bea8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} Nov 5 01:36:09 kjcf05n02 diskmonitor[17387]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 5 01:36:09 kjcf05n02 diskmonitor[17387]: Dbus, handle_ingress_ras_signals, uuid: 65d1abde-9b48-11ef-bea8-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 5 01:36:09 kjcf05n02 diskmonitor[17387]: Dbus, process_ingress_dev_approve_msg, Setting device status: Active, reason: approved Nov 5 01:36:09 kjcf05n02 diskmonitor[17387]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "65d1abde-9b48-11ef-bea8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} Nov 5 01:36:09 kjcf05n02 diskmonitor[17387]: Dbus, handle_ingress_ras_signals, Received ingress msg: {"jsonrpc": "2.0", "id": "6db4f5e0-9b48-11ef-bea8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} Nov 5 01:36:09 kjcf05n02 diskmonitor[17387]: Dbus, process_ingress_msg, Found existing interlocks data structure at index: 1 Nov 5 01:36:09 kjcf05n02 diskmonitor[17387]: Dbus, handle_ingress_ras_signals, uuid: 6db4f5e0-9b48-11ef-bea8-00093d0695e3, encl sn: USE26000024VS001, device sn: S4YPNE0MB01021, interlock index: 1 Nov 5 01:36:09 kjcf05n02 diskmonitor[17387]: Dbus, Sending to Resource Manager: {"jsonrpc": "2.0", "method": "device.approve.ack", "id": "6db4f5e0-9b48-11ef-bea8-00093d0695e3", "result": {"message": "Skipping firmware update, firmware already at EPK9GB5Q", "data": {"params": {"enclosure_serial_number": "USE26000024VS001", "device_type": "disk", "index": 13, "device_serial_number": "S4YPNE0MB01021"}, "reason": "approved", "status": "skipped", "firmware_version": "EPK9GB5Q", "hostname": "kjcf05n02", "task_duration": 18}}} Nov 5 01:36:09 kjcf05n02 diskmonitor[17387]: mdadm_zdb_examine_disk: Drive nvme13n1 updated to dps value 0 Nov 5 01:36:09 kjcf05n02 diskmonitor[17387]: lock acquired Nov 5 01:36:09 kjcf05n02 diskmonitor[17387]: leaving test state: 4 next state: 8 Nov 5 01:36:09 kjcf05n02 diskmonitor[17387]: write_installer_inventory_yaml encl path: nvme0, type: 2 Nov 5 01:36:15 kjcf05n00 mcfcli[3673891]: %3|1730792175.643|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:36:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,1,status]', 'value': 'Hot Spare', 'timestamp': 1730792177}"] Nov 5 01:36:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '1', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730792177, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:36:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:36:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:36:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:36:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:36:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:36:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:36:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:36:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:36:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:36:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:36:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:36:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:36:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:36:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.035742ms Nov 5 01:36:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:36:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 2.035742ms Nov 5 01:36:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:01:36:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 01:36:17 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:36:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Inactive', 'timestamp': 1730792177}"] Nov 5 01:36:17 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730792177, 'value': 'Inactive', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:36:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:36:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:36:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:36:17-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:36:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:36:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:36:17 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:36:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:36:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:36:17-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:36:17 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:36:17-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:36:17 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:36:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.930535ms Nov 5 01:36:17 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:36:17-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.930535ms Nov 5 01:36:17 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:01:36:17 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 01:36:24 kjcf05n02 diskmonitor[17387]: Test selected disk: eui.345950304db010370025384500000004_S4YPNE0MB01037 Nov 5 01:36:24 kjcf05n02 diskmonitor[17387]: leaving test state: 8 next state: 20 Nov 5 01:36:24 kjcf05n02 diskmonitor[17387]: leaving test state: 20 next state: 40 Nov 5 01:36:24 kjcf05n02 diskmonitor[17387]: Test /dev/disk/by-id/nvme-eui.345950304db010370025384500000004_S4YPNE0MB01037, offset 1e4eed60000 Nov 5 01:36:24 kjcf05n02 diskmonitor[17387]: leaving test state: 40 next state: 80 Nov 5 01:36:31 kjcf05n00 mcfcli[3673891]: %3|1730792191.671|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 91 identical error(s) suppressed) Nov 5 01:36:55 kjcf05n00 mcfcli[3673891]: %3|1730792215.234|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:37:01 kjcf05n00 mcfcli[3673891]: %3|1730792221.671|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 5 01:37:20 kjcf05n02 diskmonitor[17387]: leaving test state: 80 next state: 100 Nov 5 01:37:20 kjcf05n02 diskmonitor[17387]: lock release: time: Tue Nov 5 01:37:15 2024 Nov 5 01:37:20 kjcf05n02 diskmonitor[17387]: leaving test state: 100 next state: 1 Nov 5 01:37:31 kjcf05n00 mcfcli[3673891]: %3|1730792251.672|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 01:37:34 kjcf05n00 mcfcli[3673891]: %3|1730792254.531|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:37:46 kjcf05n00 plex[12314]: IEC: info: 011005002: Data collection cache is no longer stale.: {"type": "filesystem", "category": "performance", "value": "lustre"} Nov 5 01:37:56 kjcf05n00 su[2621977]: (to root) admin on pts/22 Nov 5 01:38:02 kjcf05n00 mcfcli[3673891]: %3|1730792282.172|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 94 identical error(s) suppressed) Nov 5 01:38:10 kjcf05n00 mcfcli[3673891]: %3|1730792290.990|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:38:32 kjcf05n00 mcfcli[3673891]: %3|1730792312.172|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 92 identical error(s) suppressed) Nov 5 01:38:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'host': 'enclosure_USE26000024VS001', 'key': 'xrtx.dm_report.disk.attributes[{$SERIAL_NUMBER},disk,13,status]', 'value': 'Hot Spare', 'timestamp': 1730792327}"] Nov 5 01:38:47 kjcf05n00 python3.9[10432]: [monitoring-ec.py:32 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'index': '13', 'type': 'disk', 'attribute': 'status', 'timestamp': 1730792327, 'value': 'Hot Spare', 'enclosure_serial_number': 'USE26000024VS001'} Nov 5 01:38:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:38:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:38:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:38:47-06:00] Verify User Privilege to: /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives Nov 5 01:38:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:38:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:38:47 kjcf05n00 RFSF-API[9864]: INFO[2024-11-05T01:38:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:38:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:38:47-06:00] Received Task request from [Datapath API RESTful Service] for method [GET] Nov 5 01:38:47 kjcf05n00 dm-mgmt-ec[9864]: INFO[2024-11-05T01:38:47-06:00] ResourceHandler "StoragePool ProvidingDrives": Processing Get("/redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives") Nov 5 01:38:47 kjcf05n00 RFSF-API[8976]: INFO[2024-11-05T01:38:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.999534ms Nov 5 01:38:47 kjcf05n00 dp-api-server[8976]: INFO[2024-11-05T01:38:47-06:00] GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives RedfishV1StorageServicesStorageServiceIdStoragePoolsStoragePoolIdCapacitySourcesCapacitySourceIdProvidingDrivesGet 1.999534ms Nov 5 01:38:47 kjcf05n00 dp-api-server[8976]: 127.0.0.1 - - [05/Nov/2024:01:38:47 -0600] "GET /redfish/v1/StorageServices/USE26000024VS001/StoragePools/USE26000024VS001/CapacitySources/USE26000024VS001/ProvidingDrives HTTP/1.1" 200 4320 Nov 5 01:38:47 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:38:50 kjcf05n00 mcfcli[3673891]: %3|1730792330.153|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:39:02 kjcf05n00 mcfcli[3673891]: %3|1730792342.172|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 5 01:39:29 kjcf05n00 mcfcli[3673891]: %3|1730792369.706|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:39:32 kjcf05n00 mcfcli[3673891]: %3|1730792372.173|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 90 identical error(s) suppressed) Nov 5 01:40:00 kjcf05n03 systemd[1]: Starting system activity accounting tool... Nov 5 01:40:00 kjcf05n03 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:40:00 kjcf05n03 systemd[1]: Started system activity accounting tool. Nov 5 01:40:00 kjcf05n07 systemd[1]: Starting system activity accounting tool... Nov 5 01:40:00 kjcf05n07 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:40:00 kjcf05n07 systemd[1]: Started system activity accounting tool. Nov 5 01:40:00 kjcf05n02 systemd[1]: Starting system activity accounting tool... Nov 5 01:40:00 kjcf05n02 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:40:00 kjcf05n02 systemd[1]: Started system activity accounting tool. Nov 5 01:40:00 kjcf05n05 systemd[1]: Starting system activity accounting tool... Nov 5 01:40:00 kjcf05n05 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:40:00 kjcf05n05 systemd[1]: Started system activity accounting tool. Nov 5 01:40:00 kjcf05n06 systemd[1]: Starting system activity accounting tool... Nov 5 01:40:00 kjcf05n06 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:40:00 kjcf05n06 systemd[1]: Started system activity accounting tool. Nov 5 01:40:00 kjcf05n04 systemd[1]: Starting system activity accounting tool... Nov 5 01:40:00 kjcf05n04 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:40:00 kjcf05n04 systemd[1]: Started system activity accounting tool. Nov 5 01:40:00 kjcf05n01 systemd[1]: Starting system activity accounting tool... Nov 5 01:40:00 kjcf05n01 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:40:00 kjcf05n01 systemd[1]: Started system activity accounting tool. Nov 5 01:40:00 kjcf05n00 systemd[1]: Starting system activity accounting tool... Nov 5 01:40:00 kjcf05n00 systemd[1]: sysstat-collect.service: Succeeded. Nov 5 01:40:00 kjcf05n00 systemd[1]: Started system activity accounting tool. Nov 5 01:40:02 kjcf05n00 mcfcli[3673891]: %3|1730792402.173|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 83 identical error(s) suppressed) Nov 5 01:40:07 kjcf05n00 mcfcli[3673891]: %3|1730792407.196|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:40:11 kjcf05n00 zabbix-server[2623174]: INFO Logging has been initialized for DCS 'api' service (service_logging.py:69) Nov 5 01:40:11 kjcf05n00 zabbix-server[2623174]: Attempting to create enclosure for serial number 'USE26000024VS001' on host 'kjcf05n02' from event '46955' Nov 5 01:40:11 kjcf05n00 zabbix-server[2623174]: Host created 'enclosure_USE26000024VS001' Nov 5 01:40:11 kjcf05n00 zabbix-server[2623174]: Running puppet on 'kjcf05n02' Nov 5 01:40:13 kjcf05n02 puppet-agent[35760]: Using configured environment 'production' Nov 5 01:40:13 kjcf05n02 puppet-agent[35760]: Retrieving pluginfacts Nov 5 01:40:13 kjcf05n02 puppet-agent[35760]: Retrieving plugin Nov 5 01:40:14 kjcf05n02 puppet-agent[35760]: Loading facts Nov 5 01:40:16 kjcf05n02 puppet-agent[35760]: Caching catalog for kjcf05n02 Nov 5 01:40:16 kjcf05n02 puppet-agent[35760]: Applying configuration version '1730792415' Nov 5 01:40:18 kjcf05n02 puppet-agent[35760]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]) Not removing directory; use 'force' to override Nov 5 01:40:18 kjcf05n02 puppet-agent[35760]: (/Stage[main]/Zabbix::Agent/File[/etc/zabbix/zabbix_agent2.d/plugins.d]/ensure) removed (corrective) Nov 5 01:40:18 kjcf05n02 puppet-agent[35760]: (/etc/zabbix/zabbix_agent2.d) Scheduling refresh of Service[zabbix-agent2] Nov 5 01:40:19 kjcf05n02 systemd[1]: Stopping Zabbix Agent 2... Nov 5 01:40:19 kjcf05n02 zabbix_agent2[5950]: Zabbix Agent 2 stopped. (6.2.1) Nov 5 01:40:19 kjcf05n02 zabbix_agent2[3132]: Last message 'Zabbix Agent 2 stopp' repeated 1 times, suppressed by syslog-ng on kjcf05n02 Nov 5 01:40:19 kjcf05n02 systemd[1]: zabbix-agent2.service: Succeeded. Nov 5 01:40:19 kjcf05n02 systemd[1]: Stopped Zabbix Agent 2. Nov 5 01:40:19 kjcf05n02 systemd[1]: Started Zabbix Agent 2. Nov 5 01:40:19 kjcf05n02 puppet-agent[35760]: (/Stage[main]/Zabbix::Agent/Service[zabbix-agent2]) Triggered 'refresh' from 1 event Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: OpenSSL library (OpenSSL 1.1.1k FIPS 25 Mar 2021) initialized Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using configuration file: /etc/zabbix/zabbix_agent2.conf Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Agent' (built-in) providing following interfaces: exporter Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Ceph' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Cpu' (built-in) providing following interfaces: exporter, collector, runner Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'DNS' (built-in) providing following interfaces: exporter Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Docker' (built-in) providing following interfaces: exporter, configurator Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'File' (built-in) providing following interfaces: exporter, configurator Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Hw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Kernel' (built-in) providing following interfaces: exporter Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Log' (built-in) providing following interfaces: exporter, configurator Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'MQTT' (built-in) providing following interfaces: watcher, configurator Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Memcached' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Memory' (built-in) providing following interfaces: exporter Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Modbus' (built-in) providing following interfaces: exporter, configurator Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Mysql' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: Starting Zabbix Agent 2 (6.2.1) Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: Press Ctrl+C to exit. Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'NetIf' (built-in) providing following interfaces: exporter Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Oracle' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Postgres' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Proc' (built-in) providing following interfaces: exporter, collector Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'ProcExporter' (built-in) providing following interfaces: exporter Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Redis' (built-in) providing following interfaces: exporter, runner, configurator Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Smart' (built-in) providing following interfaces: exporter, configurator Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Sw' (built-in) providing following interfaces: exporter, configurator Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Swap' (built-in) providing following interfaces: exporter Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'SystemRun' (built-in) providing following interfaces: exporter, configurator Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Systemd' (built-in) providing following interfaces: exporter Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'TCP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'UDP' (built-in) providing following interfaces: exporter, configurator Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Uname' (built-in) providing following interfaces: exporter Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Uptime' (built-in) providing following interfaces: exporter Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'UserParameter' (built-in) providing following interfaces: exporter Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'Users' (built-in) providing following interfaces: exporter, configurator Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'VFSDev' (built-in) providing following interfaces: exporter, collector Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'VFSDir' (built-in) providing following interfaces: exporter Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'VfsFs' (built-in) providing following interfaces: exporter Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'WebCertificate' (built-in) providing following interfaces: exporter, configurator Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'WebPage' (built-in) providing following interfaces: exporter, configurator Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'ZabbixAsync' (built-in) providing following interfaces: exporter Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'ZabbixStats' (built-in) providing following interfaces: exporter, configurator Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: lowering the plugin ZabbixSync capacity to 1 as the configured capacity 100 exceeds limits Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: using plugin 'ZabbixSync' (built-in) providing following interfaces: exporter Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: Plugin support version 1.0 Nov 5 01:40:19 kjcf05n02 zabbix_agent2[36114]: Zabbix Agent2 hostname: [kjcf05n02,enclosure_USE26000024VS001,lustre_kjcf05] Nov 5 01:40:21 kjcf05n02 puppet-agent[35760]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[pti_enabled]/Exec[sysfs-pti_enabled]/returns) executed successfully (corrective) Nov 5 01:40:21 kjcf05n02 puppet-agent[35760]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[ibrs_enabled]/Exec[sysfs-ibrs_enabled]/returns) executed successfully (corrective) Nov 5 01:40:21 kjcf05n02 puppet-agent[35760]: (/Stage[main]/Meltdown::Node/Meltdown::Sysfs[retp_enabled]/Exec[sysfs-retp_enabled]/returns) executed successfully (corrective) Nov 5 01:40:21 kjcf05n02 puppet-agent[35760]: Applied catalog in 5.03 seconds Nov 5 01:40:21 kjcf05n00 zabbix-server[2623174]: puppet completed status:(0): '' Nov 5 01:40:21 kjcf05n00 zabbix-server[2623174]: Event '46955' acknowledged Nov 5 01:40:21 kjcf05n00 zabbix-server[2623174]: IEC: 010001002: DCS added new enclosure notification event was triggered: b'{"serial_number": "USE26000024VS001", "origin_server_node": "kjcf05n02"}' Nov 5 01:40:32 kjcf05n00 mcfcli[3673891]: %3|1730792432.174|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 85 identical error(s) suppressed) Nov 5 01:40:43 kjcf05n00 mcfcli[3673891]: %3|1730792443.767|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:40:57 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730791866', 'host':'kjcf05n02', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.'}"] Nov 5 01:40:57 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n02', 'service_name': 'Node Status', 'description': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'message': 'Node is powered on. Lustre is stopped (per a manual operation or a crash). See the Node Control tab for more details.', 'value': 'critical', 'timestamp': '1730791866'} Nov 5 01:40:57 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:40:57 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730791866', 'host':'kjcf05n03', 'service_name':'Node Status', 'value':'CRITICAL', 'message':'Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.'}"] Nov 5 01:40:57 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n03', 'service_name': 'Node Status', 'description': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'message': "Node is powered on. This node has mounted its HA partner's resources and is not running in an optimal configuration. See the Node Control tab for more details.", 'value': 'critical', 'timestamp': '1730791866'} Nov 5 01:40:57 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:40:57 kjcf05n00 python3.9[10432]: [monitoring-ec.py:25 - ProcessTaskRequest() ] [INFO] CSM:Generic : Received an event ["{'name':'IcingaEventService', 'timestamp':'1730792457', 'host':'kjcf05n00', 'service_name':'DIMMs Status', 'value':'OK', 'message':'OK - 8 DIMMs are present.'}"] Nov 5 01:40:57 kjcf05n00 python3.9[10432]: [monitoring-ec.py:42 - ProcessTaskRequest() ] [INFO] CSM:Generic : Sending notification for {'host': 'kjcf05n00', 'service_name': 'DIMMs Status', 'description': 'OK - 8 DIMMs are present.', 'message': 'OK - 8 DIMMs are present.', 'value': 'ok', 'timestamp': '1730792457'} Nov 5 01:40:57 kjcf05n00 python3.9[10432]: dbus[10432]: A handler is already registered for /org/freedesktop/DBus Nov 5 01:41:02 kjcf05n00 mcfcli[3673891]: %3|1730792462.174|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 82 identical error(s) suppressed) Nov 5 01:41:23 kjcf05n00 mcfcli[3673891]: %3|1730792483.076|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:41:32 kjcf05n00 mcfcli[3673891]: %3|1730792492.175|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 77 identical error(s) suppressed) Nov 5 01:42:00 kjcf05n00 mcfcli[3673891]: %3|1730792520.367|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:42:02 kjcf05n00 mcfcli[3673891]: %3|1730792522.175|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 64 identical error(s) suppressed) Nov 5 01:42:32 kjcf05n00 mcfcli[3673891]: %3|1730792552.175|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 5 01:42:40 kjcf05n00 mcfcli[3673891]: %3|1730792560.364|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:42:45 kjcf05n00 shell-ie-logger[2624994]: IEC: 028000000: Editor invoked: { "cwd": "/home/admin", "args": "/mnt/mgmt/var/log/kern", "cmd": "vim" } Nov 5 01:43:02 kjcf05n00 mcfcli[3673891]: %3|1730792582.176|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 63 identical error(s) suppressed) Nov 5 01:43:15 kjcf05n00 mcfcli[3673891]: %3|1730792595.221|FAIL|1#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: nfsserv:19092: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 4 identical error(s) suppressed) Nov 5 01:43:27 kjcf05n00 grafana[16174]: logger=cleanup t=2024-11-05T01:43:27.268562263-06:00 level=info msg="Completed cleanup jobs" duration=41.502386ms Nov 5 01:43:32 kjcf05n00 mcfcli[3673891]: %3|1730792612.177|FAIL|1#consumer-1| [thrd:nfsserv:19092/bootstrap]: nfsserv:19092/1: Connect to ipv4#172.16.2.2:19092 failed: Connection refused (after 0ms in state CONNECT, 62 identical error(s) suppressed)